2024-09-21T00:36:04.724 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T00:36:04.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T00:36:04.842 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913342 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/blogbench}} email: pdonnell@redhat.com first_in_suite: false job_id: '7913342' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mds: mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 1843221895adccfb3b692060251dd6a0183bc410 subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.dir_split install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi001.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE/+wh5eMUtmjWuV11uEznbMoRCLBWP0i421PMq2N6BTUejj34gOspnmci1EkHPOf62rZTZwpFOlOUsMbPbJMNY= smithi042.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGL20RIJCbYOs66Xp7HgqYBDQYQ0d3gk/H7dR6XujxdZ7J1Gm7RNs/8ab+uzlbOa983hMKSrgTTHqgTQAxzk8jo= smithi193.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAcZvHwHITcs7BNVy0YIdOzJNNN2RN0pzQpWgu5S0lx4AKmDmh72iv32pnt4Q/ITs7NfgOpy37uHPML4DUEk/qk= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/blogbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T00:36:04.842 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T00:36:04.843 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T00:36:04.843 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T00:36:04.844 INFO:teuthology.task.internal:Checking packages... 2024-09-21T00:36:04.864 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T00:36:04.865 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T00:36:04.865 INFO:teuthology.packaging:ref: None 2024-09-21T00:36:04.865 INFO:teuthology.packaging:tag: None 2024-09-21T00:36:04.865 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T00:36:04.865 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:36:04.865 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T00:36:05.022 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120.g18432218 2024-09-21T00:36:05.023 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T00:36:05.042 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T00:36:05.042 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T00:36:05.125 INFO:teuthology.task.internal:Saving configuration 2024-09-21T00:36:05.145 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T00:36:05.157 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T00:36:05.182 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi001.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913342', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 00:30:58.884821', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE/+wh5eMUtmjWuV11uEznbMoRCLBWP0i421PMq2N6BTUejj34gOspnmci1EkHPOf62rZTZwpFOlOUsMbPbJMNY='} 2024-09-21T00:36:05.206 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi042.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913342', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 00:30:58.886170', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGL20RIJCbYOs66Xp7HgqYBDQYQ0d3gk/H7dR6XujxdZ7J1Gm7RNs/8ab+uzlbOa983hMKSrgTTHqgTQAxzk8jo='} 2024-09-21T00:36:05.227 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi193.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913342', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 00:30:58.887317', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAcZvHwHITcs7BNVy0YIdOzJNNN2RN0pzQpWgu5S0lx4AKmDmh72iv32pnt4Q/ITs7NfgOpy37uHPML4DUEk/qk='} 2024-09-21T00:36:05.227 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T00:36:05.231 INFO:teuthology.task.internal:roles: ubuntu@smithi001.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-21T00:36:05.232 INFO:teuthology.task.internal:roles: ubuntu@smithi042.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-21T00:36:05.232 INFO:teuthology.task.internal:roles: ubuntu@smithi193.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-21T00:36:05.232 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T00:36:05.377 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9a681a4160>, signals=[15]) 2024-09-21T00:36:05.378 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T00:36:05.382 INFO:teuthology.task.internal:Opening connections... 2024-09-21T00:36:05.382 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi001.front.sepia.ceph.com 2024-09-21T00:36:05.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:36:05.466 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi042.front.sepia.ceph.com 2024-09-21T00:36:05.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:36:05.539 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi193.front.sepia.ceph.com 2024-09-21T00:36:05.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:36:05.615 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T00:36:05.620 DEBUG:teuthology.orchestra.run.smithi001:> uname -m 2024-09-21T00:36:05.638 INFO:teuthology.orchestra.run.smithi001.stdout:x86_64 2024-09-21T00:36:05.638 DEBUG:teuthology.orchestra.run.smithi001:> cat /etc/os-release 2024-09-21T00:36:05.697 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="CentOS Stream" 2024-09-21T00:36:05.697 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="9" 2024-09-21T00:36:05.697 INFO:teuthology.orchestra.run.smithi001.stdout:ID="centos" 2024-09-21T00:36:05.697 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE="rhel fedora" 2024-09-21T00:36:05.697 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="9" 2024-09-21T00:36:05.697 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM_ID="platform:el9" 2024-09-21T00:36:05.697 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T00:36:05.697 INFO:teuthology.orchestra.run.smithi001.stdout:ANSI_COLOR="0;31" 2024-09-21T00:36:05.697 INFO:teuthology.orchestra.run.smithi001.stdout:LOGO="fedora-logo-icon" 2024-09-21T00:36:05.697 INFO:teuthology.orchestra.run.smithi001.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T00:36:05.697 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://centos.org/" 2024-09-21T00:36:05.697 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T00:36:05.698 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T00:36:05.698 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T00:36:05.698 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server 2024-09-21T00:36:05.719 DEBUG:teuthology.orchestra.run.smithi042:> uname -m 2024-09-21T00:36:05.736 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64 2024-09-21T00:36:05.737 DEBUG:teuthology.orchestra.run.smithi042:> cat /etc/os-release 2024-09-21T00:36:05.794 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="CentOS Stream" 2024-09-21T00:36:05.794 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="9" 2024-09-21T00:36:05.794 INFO:teuthology.orchestra.run.smithi042.stdout:ID="centos" 2024-09-21T00:36:05.794 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="rhel fedora" 2024-09-21T00:36:05.794 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="9" 2024-09-21T00:36:05.794 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el9" 2024-09-21T00:36:05.794 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T00:36:05.795 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31" 2024-09-21T00:36:05.795 INFO:teuthology.orchestra.run.smithi042.stdout:LOGO="fedora-logo-icon" 2024-09-21T00:36:05.795 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T00:36:05.795 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://centos.org/" 2024-09-21T00:36:05.795 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T00:36:05.795 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T00:36:05.795 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T00:36:05.795 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2024-09-21T00:36:05.819 DEBUG:teuthology.orchestra.run.smithi193:> uname -m 2024-09-21T00:36:05.837 INFO:teuthology.orchestra.run.smithi193.stdout:x86_64 2024-09-21T00:36:05.838 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2024-09-21T00:36:05.896 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="CentOS Stream" 2024-09-21T00:36:05.896 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="9" 2024-09-21T00:36:05.896 INFO:teuthology.orchestra.run.smithi193.stdout:ID="centos" 2024-09-21T00:36:05.896 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="rhel fedora" 2024-09-21T00:36:05.897 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="9" 2024-09-21T00:36:05.897 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el9" 2024-09-21T00:36:05.897 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T00:36:05.897 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2024-09-21T00:36:05.897 INFO:teuthology.orchestra.run.smithi193.stdout:LOGO="fedora-logo-icon" 2024-09-21T00:36:05.897 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T00:36:05.897 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://centos.org/" 2024-09-21T00:36:05.897 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T00:36:05.897 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T00:36:05.897 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T00:36:05.898 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2024-09-21T00:36:05.919 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T00:36:05.928 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T00:36:05.975 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T00:36:05.976 DEBUG:teuthology.orchestra.run.smithi001:> test '!' -e /home/ubuntu/cephtest 2024-09-21T00:36:05.978 DEBUG:teuthology.orchestra.run.smithi042:> test '!' -e /home/ubuntu/cephtest 2024-09-21T00:36:05.981 DEBUG:teuthology.orchestra.run.smithi193:> test '!' -e /home/ubuntu/cephtest 2024-09-21T00:36:05.998 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T00:36:06.003 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T00:36:06.004 DEBUG:teuthology.orchestra.run.smithi001:> test -z $(ls -A /var/lib/ceph) 2024-09-21T00:36:06.036 DEBUG:teuthology.orchestra.run.smithi042:> test -z $(ls -A /var/lib/ceph) 2024-09-21T00:36:06.038 DEBUG:teuthology.orchestra.run.smithi193:> test -z $(ls -A /var/lib/ceph) 2024-09-21T00:36:06.132 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T00:36:06.210 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T00:36:06.223 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-21T00:36:06.223 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-21T00:36:06.223 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-21T00:36:06.224 DEBUG:teuthology.orchestra.run.smithi001:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T00:36:06.241 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:36:06.241 DEBUG:teuthology.orchestra.run.smithi001:> uname -r 2024-09-21T00:36:06.299 INFO:teuthology.orchestra.run.smithi001.stdout:5.14.0-503.el9.x86_64 2024-09-21T00:36:06.299 INFO:teuthology.task.kernel:Running kernel on smithi001: 5.14.0-503.el9.x86_64 2024-09-21T00:36:06.299 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum install -y kernel 2024-09-21T00:36:08.776 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-21T00:36:10.735 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-21T00:36:17.711 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - CRB 2.2 MB/s | 6.5 MB 00:03 2024-09-21T00:36:19.136 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - Extras packages 121 kB/s | 19 kB 00:00 2024-09-21T00:36:19.924 INFO:teuthology.orchestra.run.smithi001.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-21T00:36:25.521 INFO:teuthology.orchestra.run.smithi001.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-21T00:36:27.462 INFO:teuthology.orchestra.run.smithi001.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T00:36:27.462 INFO:teuthology.orchestra.run.smithi001.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T00:36:27.561 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-09-21T00:36:27.570 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-09-21T00:36:27.570 INFO:teuthology.orchestra.run.smithi001.stdout: Package Architecture Version Repository Size 2024-09-21T00:36:27.570 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-09-21T00:36:27.570 INFO:teuthology.orchestra.run.smithi001.stdout:Installing: 2024-09-21T00:36:27.570 INFO:teuthology.orchestra.run.smithi001.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T00:36:27.571 INFO:teuthology.orchestra.run.smithi001.stdout:Installing dependencies: 2024-09-21T00:36:27.571 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T00:36:27.571 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T00:36:27.571 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T00:36:27.571 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:36:27.571 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2024-09-21T00:36:27.571 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-09-21T00:36:27.571 INFO:teuthology.orchestra.run.smithi001.stdout:Install 4 Packages 2024-09-21T00:36:27.571 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:36:27.571 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 79 M 2024-09-21T00:36:27.571 INFO:teuthology.orchestra.run.smithi001.stdout:Installed size: 126 M 2024-09-21T00:36:27.571 INFO:teuthology.orchestra.run.smithi001.stdout:Downloading Packages: 2024-09-21T00:36:27.723 INFO:teuthology.orchestra.run.smithi001.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 339 kB/s | 36 kB 00:00 2024-09-21T00:36:28.098 INFO:teuthology.orchestra.run.smithi001.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-09-21T00:36:28.608 INFO:teuthology.orchestra.run.smithi001.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 35 MB/s | 35 MB 00:00 2024-09-21T00:36:28.874 INFO:teuthology.orchestra.run.smithi001.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 25 MB/s | 29 MB 00:01 2024-09-21T00:36:28.874 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:36:28.874 INFO:teuthology.orchestra.run.smithi001.stdout:Total 60 MB/s | 79 MB 00:01 2024-09-21T00:36:29.584 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction check 2024-09-21T00:36:29.969 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction check succeeded. 2024-09-21T00:36:29.969 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction test 2024-09-21T00:36:30.928 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction test succeeded. 2024-09-21T00:36:30.928 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction 2024-09-21T00:36:33.512 INFO:teuthology.orchestra.run.smithi001.stdout: Preparing : 1/1 2024-09-21T00:36:34.169 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T00:36:34.257 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T00:36:37.007 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T00:36:37.128 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T00:36:42.257 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T00:36:42.403 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:36:47.543 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:37:26.313 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:37:26.354 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:37:26.702 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:37:26.702 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T00:37:26.702 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T00:37:26.702 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T00:37:27.570 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:37:27.570 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:37:27.570 INFO:teuthology.orchestra.run.smithi001.stdout:Installed: 2024-09-21T00:37:27.570 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T00:37:27.570 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T00:37:27.570 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T00:37:27.571 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T00:37:27.571 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:37:27.571 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-09-21T00:37:27.927 DEBUG:teuthology.orchestra.run.smithi001:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T00:37:28.008 INFO:teuthology.orchestra.run.smithi001.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T00:37:28.009 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T00:37:28.009 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T00:37:28.009 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T00:37:28.009 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T00:37:28.009 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-21T00:37:28.009 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi001.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T00:37:28.009 DEBUG:teuthology.orchestra.run.smithi001:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T00:37:28.068 INFO:teuthology.orchestra.run.smithi001.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T00:37:28.068 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T00:37:28.069 DEBUG:teuthology.orchestra.run.smithi001:> sudo rpm -qi grub2-tools 2024-09-21T00:37:28.100 INFO:teuthology.orchestra.run.smithi001.stdout:Name : grub2-tools 2024-09-21T00:37:28.100 INFO:teuthology.orchestra.run.smithi001.stdout:Epoch : 1 2024-09-21T00:37:28.100 INFO:teuthology.orchestra.run.smithi001.stdout:Version : 2.06 2024-09-21T00:37:28.100 INFO:teuthology.orchestra.run.smithi001.stdout:Release : 82.el9 2024-09-21T00:37:28.100 INFO:teuthology.orchestra.run.smithi001.stdout:Architecture: x86_64 2024-09-21T00:37:28.100 INFO:teuthology.orchestra.run.smithi001.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T00:37:28.100 INFO:teuthology.orchestra.run.smithi001.stdout:Group : Unspecified 2024-09-21T00:37:28.100 INFO:teuthology.orchestra.run.smithi001.stdout:Size : 8274670 2024-09-21T00:37:28.101 INFO:teuthology.orchestra.run.smithi001.stdout:License : GPLv3+ 2024-09-21T00:37:28.101 INFO:teuthology.orchestra.run.smithi001.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T00:37:28.101 INFO:teuthology.orchestra.run.smithi001.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T00:37:28.101 INFO:teuthology.orchestra.run.smithi001.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T00:37:28.101 INFO:teuthology.orchestra.run.smithi001.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T00:37:28.101 INFO:teuthology.orchestra.run.smithi001.stdout:Packager : builder@centos.org 2024-09-21T00:37:28.101 INFO:teuthology.orchestra.run.smithi001.stdout:Vendor : CentOS 2024-09-21T00:37:28.101 INFO:teuthology.orchestra.run.smithi001.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T00:37:28.101 INFO:teuthology.orchestra.run.smithi001.stdout:Summary : Support tools for GRUB. 2024-09-21T00:37:28.101 INFO:teuthology.orchestra.run.smithi001.stdout:Description : 2024-09-21T00:37:28.101 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:37:28.101 INFO:teuthology.orchestra.run.smithi001.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T00:37:28.101 INFO:teuthology.orchestra.run.smithi001.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T00:37:28.101 INFO:teuthology.orchestra.run.smithi001.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T00:37:28.101 INFO:teuthology.orchestra.run.smithi001.stdout:hardware devices. 2024-09-21T00:37:28.102 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:37:28.102 INFO:teuthology.orchestra.run.smithi001.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T00:37:28.102 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T00:37:28.103 INFO:teuthology.task.kernel:Updating grub on smithi001 to boot 5.14.0-508.el9.x86_64 2024-09-21T00:37:28.103 DEBUG:teuthology.orchestra.run.smithi001:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T00:37:28.749 INFO:teuthology.orchestra.run.smithi001.stderr:Generating grub configuration file ... 2024-09-21T00:37:30.094 INFO:teuthology.orchestra.run.smithi001.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T00:37:30.127 INFO:teuthology.orchestra.run.smithi001.stderr:done 2024-09-21T00:37:30.129 DEBUG:teuthology.orchestra.run.smithi001:> mktemp 2024-09-21T00:37:30.145 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/tmp.oZ8aAWbx6t 2024-09-21T00:37:30.145 DEBUG:teuthology.orchestra.run.smithi001:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.oZ8aAWbx6t 2024-09-21T00:37:30.211 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0666 /tmp/tmp.oZ8aAWbx6t 2024-09-21T00:37:30.356 DEBUG:teuthology.orchestra.remote:smithi001:/tmp/tmp.oZ8aAWbx6t is 6KB 2024-09-21T00:37:30.376 DEBUG:teuthology.orchestra.run.smithi001:> rm -fr /tmp/tmp.oZ8aAWbx6t 2024-09-21T00:37:30.406 DEBUG:teuthology.orchestra.run.smithi001:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T00:37:30.453 INFO:teuthology.orchestra.run.smithi001.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T00:37:30.453 INFO:teuthology.orchestra.run.smithi001.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T00:37:30.453 INFO:teuthology.orchestra.run.smithi001.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T00:37:30.453 INFO:teuthology.orchestra.run.smithi001.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T00:37:30.454 DEBUG:teuthology.orchestra.run.smithi001:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T00:37:30.613 DEBUG:teuthology.orchestra.run.smithi001:> sudo shutdown -r now 2024-09-21T00:38:00.616 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-21T00:38:00.616 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-21T00:38:00.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:38:19.119 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.1 2024-09-21T00:38:28.121 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-21T00:38:28.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:39:28.124 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T00:39:40.125 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-21T00:39:40.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:39:40.381 DEBUG:teuthology.orchestra.run.smithi001:> true 2024-09-21T00:39:40.781 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-21T00:39:40.781 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-21T00:39:40.781 DEBUG:teuthology.orchestra.run.smithi001:> uname -r 2024-09-21T00:39:40.798 INFO:teuthology.orchestra.run.smithi001.stdout:5.14.0-508.el9.x86_64 2024-09-21T00:39:40.798 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T00:39:40.798 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T00:39:40.799 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T00:39:41.800 DEBUG:teuthology.parallel:result is None 2024-09-21T00:39:41.800 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T00:39:41.811 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T00:39:41.811 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T00:39:41.813 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T00:39:41.816 DEBUG:teuthology.orchestra.run.smithi193:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T00:39:41.834 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T00:39:41.894 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T00:39:41.928 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T00:39:41.928 DEBUG:teuthology.orchestra.run.smithi001:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T00:39:41.930 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T00:39:41.933 DEBUG:teuthology.orchestra.run.smithi193:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T00:39:42.066 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T00:39:42.073 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T00:39:42.073 DEBUG:teuthology.orchestra.run.smithi042:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T00:39:42.089 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:39:42.090 DEBUG:teuthology.orchestra.run.smithi193:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T00:39:42.107 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:39:42.107 DEBUG:teuthology.orchestra.run.smithi001:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T00:39:42.110 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T00:39:42.133 DEBUG:teuthology.orchestra.run.smithi193:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T00:39:42.167 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:39:42.189 INFO:teuthology.orchestra.run.smithi193.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:39:42.200 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:39:42.202 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:39:42.209 INFO:teuthology.orchestra.run.smithi193.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:39:42.218 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:39:42.219 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T00:39:42.226 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T00:39:42.226 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T00:39:42.228 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T00:39:42.244 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T00:39:42.278 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T00:39:42.288 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T00:39:42.288 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T00:39:42.299 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T00:39:42.311 DEBUG:teuthology.orchestra.run.smithi193:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T00:39:42.336 DEBUG:teuthology.orchestra.run.smithi001:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:39:42.397 DEBUG:teuthology.orchestra.run.smithi001:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:39:42.443 DEBUG:teuthology.orchestra.run.smithi001:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:39:42.528 DEBUG:teuthology.orchestra.run.smithi001:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:39:42.569 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-21T00:39:42.570 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T00:39:42.637 DEBUG:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:39:42.681 DEBUG:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:39:42.738 DEBUG:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:39:42.823 DEBUG:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:39:42.865 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-21T00:39:42.865 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T00:39:42.931 DEBUG:teuthology.orchestra.run.smithi193:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:39:42.976 DEBUG:teuthology.orchestra.run.smithi193:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:39:43.027 DEBUG:teuthology.orchestra.run.smithi193:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:39:43.113 DEBUG:teuthology.orchestra.run.smithi193:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:39:43.155 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-21T00:39:43.155 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T00:39:43.222 DEBUG:teuthology.orchestra.run.smithi001:> sudo service rsyslog restart 2024-09-21T00:39:43.224 DEBUG:teuthology.orchestra.run.smithi042:> sudo service rsyslog restart 2024-09-21T00:39:43.226 DEBUG:teuthology.orchestra.run.smithi193:> sudo service rsyslog restart 2024-09-21T00:39:43.263 INFO:teuthology.orchestra.run.smithi042.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T00:39:43.269 INFO:teuthology.orchestra.run.smithi001.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T00:39:43.298 INFO:teuthology.orchestra.run.smithi193.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T00:39:43.785 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T00:39:43.792 INFO:teuthology.task.internal:Starting timer... 2024-09-21T00:39:43.792 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T00:39:43.831 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T00:39:43.863 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-21T00:39:43.863 DEBUG:teuthology.orchestra.run.smithi001:> sudo service auditd rotate 2024-09-21T00:39:43.917 INFO:teuthology.orchestra.run.smithi001.stdout:Rotating logs: 2024-09-21T00:39:43.919 DEBUG:teuthology.orchestra.run.smithi042:> sudo service auditd rotate 2024-09-21T00:39:43.973 INFO:teuthology.orchestra.run.smithi042.stdout:Rotating logs: 2024-09-21T00:39:43.976 DEBUG:teuthology.orchestra.run.smithi193:> sudo service auditd rotate 2024-09-21T00:39:44.036 INFO:teuthology.orchestra.run.smithi193.stdout:Rotating logs: 2024-09-21T00:39:44.038 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T00:39:44.038 DEBUG:teuthology.orchestra.run.smithi001:> /usr/sbin/getenforce 2024-09-21T00:39:44.068 INFO:teuthology.orchestra.run.smithi001.stdout:Permissive 2024-09-21T00:39:44.068 DEBUG:teuthology.orchestra.run.smithi042:> /usr/sbin/getenforce 2024-09-21T00:39:44.107 INFO:teuthology.orchestra.run.smithi042.stdout:Permissive 2024-09-21T00:39:44.107 DEBUG:teuthology.orchestra.run.smithi193:> /usr/sbin/getenforce 2024-09-21T00:39:44.132 INFO:teuthology.orchestra.run.smithi193.stdout:Permissive 2024-09-21T00:39:44.132 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi001.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi042.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi193.front.sepia.ceph.com': 'permissive'} 2024-09-21T00:39:44.132 DEBUG:teuthology.orchestra.run.smithi001:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T00:39:44.162 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:39:44.163 DEBUG:teuthology.orchestra.run.smithi042:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T00:39:44.193 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:39:44.193 DEBUG:teuthology.orchestra.run.smithi193:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T00:39:44.225 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:39:44.225 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T00:39:44.226 DEBUG:teuthology.orchestra.run.smithi001:> sudo /usr/sbin/setenforce permissive 2024-09-21T00:39:44.256 DEBUG:teuthology.orchestra.run.smithi042:> sudo /usr/sbin/setenforce permissive 2024-09-21T00:39:44.288 DEBUG:teuthology.orchestra.run.smithi193:> sudo /usr/sbin/setenforce permissive 2024-09-21T00:39:44.325 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T00:39:44.340 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T00:39:44.350 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T00:39:44.351 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi001.front.sepia.ceph.com,smithi042.front.sepia.ceph.com,smithi193.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T00:43:50.256 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi001.front.sepia.ceph.com'), Remote(name='ubuntu@smithi042.front.sepia.ceph.com'), Remote(name='ubuntu@smithi193.front.sepia.ceph.com')] 2024-09-21T00:43:50.257 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-21T00:43:50.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:43:50.335 DEBUG:teuthology.orchestra.run.smithi001:> true 2024-09-21T00:43:50.415 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-21T00:43:50.416 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-21T00:43:50.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:43:50.490 DEBUG:teuthology.orchestra.run.smithi042:> true 2024-09-21T00:43:50.567 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-21T00:43:50.567 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-09-21T00:43:50.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:43:50.642 DEBUG:teuthology.orchestra.run.smithi193:> true 2024-09-21T00:43:50.728 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-09-21T00:43:50.729 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T00:43:50.745 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T00:43:50.746 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T00:43:50.746 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T00:43:50.748 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T00:43:50.749 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T00:43:50.751 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T00:43:50.751 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T00:43:50.781 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T00:43:50.781 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T00:43:50.796 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T00:43:50.798 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T00:43:50.801 INFO:teuthology.orchestra.run.smithi193.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T00:43:50.817 INFO:teuthology.orchestra.run.smithi193.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T00:43:50.822 INFO:teuthology.orchestra.run.smithi042.stderr:sudo: ntpd: command not found 2024-09-21T00:43:50.826 INFO:teuthology.orchestra.run.smithi001.stderr:sudo: ntpd: command not found 2024-09-21T00:43:50.834 INFO:teuthology.orchestra.run.smithi042.stdout:506 Cannot talk to daemon 2024-09-21T00:43:50.838 INFO:teuthology.orchestra.run.smithi001.stdout:506 Cannot talk to daemon 2024-09-21T00:43:50.843 INFO:teuthology.orchestra.run.smithi193.stderr:sudo: ntpd: command not found 2024-09-21T00:43:50.848 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T00:43:50.854 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T00:43:50.854 INFO:teuthology.orchestra.run.smithi193.stdout:506 Cannot talk to daemon 2024-09-21T00:43:50.863 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T00:43:50.869 INFO:teuthology.orchestra.run.smithi193.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T00:43:50.869 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T00:43:50.883 INFO:teuthology.orchestra.run.smithi193.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T00:43:50.918 INFO:teuthology.orchestra.run.smithi042.stderr:bash: line 1: ntpq: command not found 2024-09-21T00:43:50.920 INFO:teuthology.orchestra.run.smithi042.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T00:43:50.921 INFO:teuthology.orchestra.run.smithi042.stdout:=============================================================================== 2024-09-21T00:43:50.921 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:43:50.921 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:43:50.921 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:43:50.921 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:43:50.929 INFO:teuthology.orchestra.run.smithi001.stderr:bash: line 1: ntpq: command not found 2024-09-21T00:43:50.934 INFO:teuthology.orchestra.run.smithi001.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T00:43:50.934 INFO:teuthology.orchestra.run.smithi001.stdout:=============================================================================== 2024-09-21T00:43:50.934 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:43:50.934 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:43:50.934 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:43:50.934 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:43:50.939 INFO:teuthology.orchestra.run.smithi193.stderr:bash: line 1: ntpq: command not found 2024-09-21T00:43:50.942 INFO:teuthology.orchestra.run.smithi193.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T00:43:50.942 INFO:teuthology.orchestra.run.smithi193.stdout:=============================================================================== 2024-09-21T00:43:50.942 INFO:teuthology.orchestra.run.smithi193.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:43:50.942 INFO:teuthology.orchestra.run.smithi193.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:43:50.942 INFO:teuthology.orchestra.run.smithi193.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:43:50.942 INFO:teuthology.orchestra.run.smithi193.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:43:50.943 INFO:teuthology.run_tasks:Running task install... 2024-09-21T00:43:50.952 DEBUG:teuthology.task.install:project ceph 2024-09-21T00:43:50.952 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T00:43:50.952 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T00:43:50.952 INFO:teuthology.task.install:Using flavor: default 2024-09-21T00:43:50.962 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T00:43:50.963 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-21T00:43:50.963 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T00:43:50.964 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:43:50.966 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T00:43:50.966 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:43:50.968 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T00:43:50.968 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:43:51.114 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T00:43:51.114 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T00:43:51.120 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T00:43:51.120 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T00:43:51.137 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T00:43:51.137 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T00:43:51.226 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T00:43:51.226 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-21T00:43:51.226 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T00:43:51.233 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T00:43:51.233 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-21T00:43:51.233 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T00:43:51.246 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T00:43:51.246 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-21T00:43:51.246 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T00:43:51.254 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T00:43:51.254 DEBUG:teuthology.orchestra.run.smithi001:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T00:43:51.259 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T00:43:51.259 DEBUG:teuthology.orchestra.run.smithi193:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T00:43:51.272 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T00:43:51.272 DEBUG:teuthology.orchestra.run.smithi042:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T00:43:51.320 DEBUG:teuthology.orchestra.run.smithi001:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T00:43:51.324 DEBUG:teuthology.orchestra.run.smithi193:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T00:43:51.338 DEBUG:teuthology.orchestra.run.smithi042:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T00:43:51.397 DEBUG:teuthology.orchestra.run.smithi001:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T00:43:51.398 DEBUG:teuthology.orchestra.run.smithi193:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T00:43:51.412 DEBUG:teuthology.orchestra.run.smithi042:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T00:43:51.461 INFO:teuthology.orchestra.run.smithi001.stdout:check_obsoletes = 1 2024-09-21T00:43:51.463 INFO:teuthology.orchestra.run.smithi193.stdout:check_obsoletes = 1 2024-09-21T00:43:51.464 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum clean all 2024-09-21T00:43:51.465 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum clean all 2024-09-21T00:43:51.477 INFO:teuthology.orchestra.run.smithi042.stdout:check_obsoletes = 1 2024-09-21T00:43:51.478 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum clean all 2024-09-21T00:43:51.688 INFO:teuthology.orchestra.run.smithi193.stdout:45 files removed 2024-09-21T00:43:51.695 INFO:teuthology.orchestra.run.smithi001.stdout:45 files removed 2024-09-21T00:43:51.710 INFO:teuthology.orchestra.run.smithi042.stdout:45 files removed 2024-09-21T00:43:51.716 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T00:43:51.723 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T00:43:51.737 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T00:43:52.317 INFO:teuthology.orchestra.run.smithi193.stdout:ceph packages for x86_64 258 kB/s | 84 kB 00:00 2024-09-21T00:43:52.371 INFO:teuthology.orchestra.run.smithi042.stdout:ceph packages for x86_64 239 kB/s | 84 kB 00:00 2024-09-21T00:43:52.380 INFO:teuthology.orchestra.run.smithi001.stdout:ceph packages for x86_64 236 kB/s | 84 kB 00:00 2024-09-21T00:43:52.801 INFO:teuthology.orchestra.run.smithi193.stdout:ceph noarch packages 54 kB/s | 24 kB 00:00 2024-09-21T00:43:52.872 INFO:teuthology.orchestra.run.smithi042.stdout:ceph noarch packages 53 kB/s | 24 kB 00:00 2024-09-21T00:43:52.930 INFO:teuthology.orchestra.run.smithi001.stdout:ceph noarch packages 48 kB/s | 24 kB 00:00 2024-09-21T00:43:53.360 INFO:teuthology.orchestra.run.smithi193.stdout:ceph source packages 3.6 kB/s | 1.9 kB 00:00 2024-09-21T00:43:53.389 INFO:teuthology.orchestra.run.smithi042.stdout:ceph source packages 4.0 kB/s | 1.9 kB 00:00 2024-09-21T00:43:53.423 INFO:teuthology.orchestra.run.smithi001.stdout:ceph source packages 4.2 kB/s | 1.9 kB 00:00 2024-09-21T00:43:53.947 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.3 MB 00:00 2024-09-21T00:43:54.919 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - BaseOS 5.4 MB/s | 8.3 MB 00:01 2024-09-21T00:43:55.181 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.3 MB 00:01 2024-09-21T00:43:57.007 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:01 2024-09-21T00:43:58.024 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - AppStream 12 MB/s | 20 MB 00:01 2024-09-21T00:43:58.136 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - AppStream 9.6 MB/s | 20 MB 00:02 2024-09-21T00:44:02.383 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - CRB 4.7 MB/s | 6.5 MB 00:01 2024-09-21T00:44:02.628 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - CRB 9.5 MB/s | 6.5 MB 00:00 2024-09-21T00:44:03.850 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.5 MB 00:01 2024-09-21T00:44:04.100 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 19 kB 00:00 2024-09-21T00:44:04.112 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - Extras packages 78 kB/s | 19 kB 00:00 2024-09-21T00:44:05.078 INFO:teuthology.orchestra.run.smithi193.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-21T00:44:05.304 INFO:teuthology.orchestra.run.smithi001.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-21T00:44:05.542 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 19 kB 00:00 2024-09-21T00:44:06.625 INFO:teuthology.orchestra.run.smithi042.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-21T00:44:10.565 INFO:teuthology.orchestra.run.smithi193.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-21T00:44:10.836 INFO:teuthology.orchestra.run.smithi001.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-21T00:44:12.228 INFO:teuthology.orchestra.run.smithi042.stdout:lab-extras 49 kB/s | 1.7 kB 00:00 2024-09-21T00:44:12.686 INFO:teuthology.orchestra.run.smithi193.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T00:44:12.686 INFO:teuthology.orchestra.run.smithi193.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T00:44:12.700 INFO:teuthology.orchestra.run.smithi193.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T00:44:12.701 INFO:teuthology.orchestra.run.smithi193.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T00:44:12.702 INFO:teuthology.orchestra.run.smithi193.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T00:44:12.703 INFO:teuthology.orchestra.run.smithi193.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T00:44:12.705 INFO:teuthology.orchestra.run.smithi193.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T00:44:12.708 INFO:teuthology.orchestra.run.smithi193.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T00:44:12.709 INFO:teuthology.orchestra.run.smithi193.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T00:44:12.772 INFO:teuthology.orchestra.run.smithi193.stdout:Dependencies resolved. 2024-09-21T00:44:12.782 INFO:teuthology.orchestra.run.smithi193.stdout:======================================================================================= 2024-09-21T00:44:12.782 INFO:teuthology.orchestra.run.smithi193.stdout: Package Arch Version Repository Size 2024-09-21T00:44:12.782 INFO:teuthology.orchestra.run.smithi193.stdout:======================================================================================= 2024-09-21T00:44:12.782 INFO:teuthology.orchestra.run.smithi193.stdout:Installing: 2024-09-21T00:44:12.782 INFO:teuthology.orchestra.run.smithi193.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T00:44:12.782 INFO:teuthology.orchestra.run.smithi193.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T00:44:12.782 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T00:44:12.782 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T00:44:12.782 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T00:44:12.783 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T00:44:12.783 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T00:44:12.783 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T00:44:12.783 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T00:44:12.783 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T00:44:12.783 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T00:44:12.783 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T00:44:12.783 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T00:44:12.783 INFO:teuthology.orchestra.run.smithi193.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T00:44:12.783 INFO:teuthology.orchestra.run.smithi193.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T00:44:12.783 INFO:teuthology.orchestra.run.smithi193.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T00:44:12.783 INFO:teuthology.orchestra.run.smithi193.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T00:44:12.783 INFO:teuthology.orchestra.run.smithi193.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T00:44:12.784 INFO:teuthology.orchestra.run.smithi193.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T00:44:12.784 INFO:teuthology.orchestra.run.smithi193.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T00:44:12.784 INFO:teuthology.orchestra.run.smithi193.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T00:44:12.784 INFO:teuthology.orchestra.run.smithi193.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T00:44:12.784 INFO:teuthology.orchestra.run.smithi193.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T00:44:12.784 INFO:teuthology.orchestra.run.smithi193.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T00:44:12.784 INFO:teuthology.orchestra.run.smithi193.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T00:44:12.784 INFO:teuthology.orchestra.run.smithi193.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T00:44:12.784 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T00:44:12.784 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T00:44:12.784 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T00:44:12.784 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T00:44:12.784 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T00:44:12.784 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T00:44:12.784 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T00:44:12.785 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T00:44:12.785 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T00:44:12.785 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T00:44:12.785 INFO:teuthology.orchestra.run.smithi193.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T00:44:12.785 INFO:teuthology.orchestra.run.smithi193.stdout:Upgrading: 2024-09-21T00:44:12.785 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T00:44:12.785 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T00:44:12.785 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T00:44:12.785 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T00:44:12.785 INFO:teuthology.orchestra.run.smithi193.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T00:44:12.785 INFO:teuthology.orchestra.run.smithi193.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T00:44:12.785 INFO:teuthology.orchestra.run.smithi193.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T00:44:12.785 INFO:teuthology.orchestra.run.smithi193.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T00:44:12.785 INFO:teuthology.orchestra.run.smithi193.stdout:Installing dependencies: 2024-09-21T00:44:12.786 INFO:teuthology.orchestra.run.smithi193.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T00:44:12.786 INFO:teuthology.orchestra.run.smithi193.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T00:44:12.786 INFO:teuthology.orchestra.run.smithi193.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T00:44:12.786 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T00:44:12.786 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T00:44:12.786 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T00:44:12.786 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T00:44:12.786 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T00:44:12.786 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T00:44:12.786 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T00:44:12.786 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T00:44:12.786 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T00:44:12.786 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T00:44:12.786 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T00:44:12.787 INFO:teuthology.orchestra.run.smithi193.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T00:44:12.787 INFO:teuthology.orchestra.run.smithi193.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T00:44:12.787 INFO:teuthology.orchestra.run.smithi193.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T00:44:12.787 INFO:teuthology.orchestra.run.smithi193.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T00:44:12.787 INFO:teuthology.orchestra.run.smithi193.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T00:44:12.787 INFO:teuthology.orchestra.run.smithi193.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T00:44:12.787 INFO:teuthology.orchestra.run.smithi193.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T00:44:12.787 INFO:teuthology.orchestra.run.smithi193.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T00:44:12.787 INFO:teuthology.orchestra.run.smithi193.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T00:44:12.787 INFO:teuthology.orchestra.run.smithi193.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T00:44:12.787 INFO:teuthology.orchestra.run.smithi193.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T00:44:12.787 INFO:teuthology.orchestra.run.smithi193.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T00:44:12.787 INFO:teuthology.orchestra.run.smithi193.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T00:44:12.787 INFO:teuthology.orchestra.run.smithi193.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T00:44:12.788 INFO:teuthology.orchestra.run.smithi193.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T00:44:12.788 INFO:teuthology.orchestra.run.smithi193.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T00:44:12.788 INFO:teuthology.orchestra.run.smithi193.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T00:44:12.788 INFO:teuthology.orchestra.run.smithi193.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T00:44:12.788 INFO:teuthology.orchestra.run.smithi193.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T00:44:12.788 INFO:teuthology.orchestra.run.smithi193.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T00:44:12.788 INFO:teuthology.orchestra.run.smithi193.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T00:44:12.788 INFO:teuthology.orchestra.run.smithi193.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T00:44:12.788 INFO:teuthology.orchestra.run.smithi193.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T00:44:12.788 INFO:teuthology.orchestra.run.smithi193.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T00:44:12.788 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T00:44:12.788 INFO:teuthology.orchestra.run.smithi193.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T00:44:12.788 INFO:teuthology.orchestra.run.smithi193.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T00:44:12.788 INFO:teuthology.orchestra.run.smithi193.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T00:44:12.789 INFO:teuthology.orchestra.run.smithi193.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T00:44:12.789 INFO:teuthology.orchestra.run.smithi193.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T00:44:12.789 INFO:teuthology.orchestra.run.smithi193.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T00:44:12.789 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T00:44:12.789 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T00:44:12.789 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T00:44:12.789 INFO:teuthology.orchestra.run.smithi193.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T00:44:12.789 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T00:44:12.789 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T00:44:12.789 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T00:44:12.789 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T00:44:12.789 INFO:teuthology.orchestra.run.smithi193.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T00:44:12.789 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T00:44:12.789 INFO:teuthology.orchestra.run.smithi193.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T00:44:12.790 INFO:teuthology.orchestra.run.smithi193.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T00:44:12.790 INFO:teuthology.orchestra.run.smithi193.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T00:44:12.790 INFO:teuthology.orchestra.run.smithi193.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T00:44:12.790 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T00:44:12.790 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T00:44:12.790 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T00:44:12.790 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T00:44:12.790 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T00:44:12.790 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T00:44:12.790 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T00:44:12.790 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T00:44:12.790 INFO:teuthology.orchestra.run.smithi193.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T00:44:12.790 INFO:teuthology.orchestra.run.smithi193.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T00:44:12.790 INFO:teuthology.orchestra.run.smithi193.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T00:44:12.791 INFO:teuthology.orchestra.run.smithi193.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T00:44:12.791 INFO:teuthology.orchestra.run.smithi193.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T00:44:12.791 INFO:teuthology.orchestra.run.smithi193.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T00:44:12.791 INFO:teuthology.orchestra.run.smithi193.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T00:44:12.791 INFO:teuthology.orchestra.run.smithi193.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T00:44:12.791 INFO:teuthology.orchestra.run.smithi193.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T00:44:12.791 INFO:teuthology.orchestra.run.smithi193.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T00:44:12.791 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T00:44:12.791 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T00:44:12.791 INFO:teuthology.orchestra.run.smithi193.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T00:44:12.791 INFO:teuthology.orchestra.run.smithi193.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T00:44:12.791 INFO:teuthology.orchestra.run.smithi193.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T00:44:12.791 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T00:44:12.791 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T00:44:12.792 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T00:44:12.792 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T00:44:12.792 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T00:44:12.792 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T00:44:12.792 INFO:teuthology.orchestra.run.smithi193.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T00:44:12.792 INFO:teuthology.orchestra.run.smithi193.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T00:44:12.792 INFO:teuthology.orchestra.run.smithi193.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T00:44:12.792 INFO:teuthology.orchestra.run.smithi193.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T00:44:12.792 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T00:44:12.792 INFO:teuthology.orchestra.run.smithi193.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T00:44:12.792 INFO:teuthology.orchestra.run.smithi193.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T00:44:12.792 INFO:teuthology.orchestra.run.smithi193.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T00:44:12.792 INFO:teuthology.orchestra.run.smithi193.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T00:44:12.792 INFO:teuthology.orchestra.run.smithi193.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T00:44:12.792 INFO:teuthology.orchestra.run.smithi193.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T00:44:12.793 INFO:teuthology.orchestra.run.smithi193.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T00:44:12.793 INFO:teuthology.orchestra.run.smithi193.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T00:44:12.793 INFO:teuthology.orchestra.run.smithi193.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T00:44:12.793 INFO:teuthology.orchestra.run.smithi193.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T00:44:12.793 INFO:teuthology.orchestra.run.smithi193.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T00:44:12.793 INFO:teuthology.orchestra.run.smithi193.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T00:44:12.793 INFO:teuthology.orchestra.run.smithi193.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T00:44:12.793 INFO:teuthology.orchestra.run.smithi193.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T00:44:12.793 INFO:teuthology.orchestra.run.smithi193.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T00:44:12.793 INFO:teuthology.orchestra.run.smithi193.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T00:44:12.793 INFO:teuthology.orchestra.run.smithi193.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T00:44:12.793 INFO:teuthology.orchestra.run.smithi193.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T00:44:12.793 INFO:teuthology.orchestra.run.smithi193.stdout:Installing weak dependencies: 2024-09-21T00:44:12.793 INFO:teuthology.orchestra.run.smithi193.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T00:44:12.793 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-21T00:44:12.794 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction Summary 2024-09-21T00:44:12.794 INFO:teuthology.orchestra.run.smithi193.stdout:======================================================================================= 2024-09-21T00:44:12.794 INFO:teuthology.orchestra.run.smithi193.stdout:Install 149 Packages 2024-09-21T00:44:12.794 INFO:teuthology.orchestra.run.smithi193.stdout:Upgrade 8 Packages 2024-09-21T00:44:12.794 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-21T00:44:12.794 INFO:teuthology.orchestra.run.smithi193.stdout:Total download size: 228 M 2024-09-21T00:44:12.794 INFO:teuthology.orchestra.run.smithi193.stdout:Downloading Packages: 2024-09-21T00:44:13.099 INFO:teuthology.orchestra.run.smithi001.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T00:44:13.099 INFO:teuthology.orchestra.run.smithi001.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T00:44:13.109 INFO:teuthology.orchestra.run.smithi001.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T00:44:13.110 INFO:teuthology.orchestra.run.smithi001.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T00:44:13.111 INFO:teuthology.orchestra.run.smithi001.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T00:44:13.111 INFO:teuthology.orchestra.run.smithi001.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T00:44:13.113 INFO:teuthology.orchestra.run.smithi001.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T00:44:13.116 INFO:teuthology.orchestra.run.smithi001.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T00:44:13.117 INFO:teuthology.orchestra.run.smithi001.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T00:44:13.183 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-09-21T00:44:13.204 INFO:teuthology.orchestra.run.smithi001.stdout:======================================================================================= 2024-09-21T00:44:13.204 INFO:teuthology.orchestra.run.smithi001.stdout: Package Arch Version Repository Size 2024-09-21T00:44:13.204 INFO:teuthology.orchestra.run.smithi001.stdout:======================================================================================= 2024-09-21T00:44:13.204 INFO:teuthology.orchestra.run.smithi001.stdout:Installing: 2024-09-21T00:44:13.204 INFO:teuthology.orchestra.run.smithi001.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T00:44:13.204 INFO:teuthology.orchestra.run.smithi001.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T00:44:13.204 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T00:44:13.205 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T00:44:13.205 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T00:44:13.205 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T00:44:13.205 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T00:44:13.205 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T00:44:13.205 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T00:44:13.205 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T00:44:13.205 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T00:44:13.205 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T00:44:13.205 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T00:44:13.205 INFO:teuthology.orchestra.run.smithi001.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T00:44:13.205 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T00:44:13.205 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T00:44:13.205 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T00:44:13.206 INFO:teuthology.orchestra.run.smithi001.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T00:44:13.206 INFO:teuthology.orchestra.run.smithi001.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T00:44:13.206 INFO:teuthology.orchestra.run.smithi001.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T00:44:13.206 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T00:44:13.206 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T00:44:13.206 INFO:teuthology.orchestra.run.smithi001.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T00:44:13.206 INFO:teuthology.orchestra.run.smithi001.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T00:44:13.206 INFO:teuthology.orchestra.run.smithi001.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T00:44:13.206 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T00:44:13.206 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T00:44:13.206 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T00:44:13.206 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T00:44:13.206 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T00:44:13.206 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T00:44:13.207 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T00:44:13.207 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T00:44:13.207 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T00:44:13.207 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T00:44:13.207 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T00:44:13.207 INFO:teuthology.orchestra.run.smithi001.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T00:44:13.207 INFO:teuthology.orchestra.run.smithi001.stdout:Upgrading: 2024-09-21T00:44:13.207 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T00:44:13.207 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T00:44:13.207 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T00:44:13.207 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T00:44:13.207 INFO:teuthology.orchestra.run.smithi001.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T00:44:13.207 INFO:teuthology.orchestra.run.smithi001.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T00:44:13.207 INFO:teuthology.orchestra.run.smithi001.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T00:44:13.208 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T00:44:13.208 INFO:teuthology.orchestra.run.smithi001.stdout:Installing dependencies: 2024-09-21T00:44:13.208 INFO:teuthology.orchestra.run.smithi001.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T00:44:13.208 INFO:teuthology.orchestra.run.smithi001.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T00:44:13.208 INFO:teuthology.orchestra.run.smithi001.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T00:44:13.208 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T00:44:13.208 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T00:44:13.208 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T00:44:13.208 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T00:44:13.208 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T00:44:13.208 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T00:44:13.208 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T00:44:13.208 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T00:44:13.209 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T00:44:13.209 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T00:44:13.209 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T00:44:13.209 INFO:teuthology.orchestra.run.smithi001.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T00:44:13.209 INFO:teuthology.orchestra.run.smithi001.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T00:44:13.209 INFO:teuthology.orchestra.run.smithi001.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T00:44:13.209 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T00:44:13.209 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T00:44:13.209 INFO:teuthology.orchestra.run.smithi001.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T00:44:13.209 INFO:teuthology.orchestra.run.smithi001.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T00:44:13.209 INFO:teuthology.orchestra.run.smithi001.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T00:44:13.209 INFO:teuthology.orchestra.run.smithi001.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T00:44:13.209 INFO:teuthology.orchestra.run.smithi001.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T00:44:13.209 INFO:teuthology.orchestra.run.smithi001.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T00:44:13.209 INFO:teuthology.orchestra.run.smithi001.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T00:44:13.209 INFO:teuthology.orchestra.run.smithi001.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T00:44:13.210 INFO:teuthology.orchestra.run.smithi001.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T00:44:13.210 INFO:teuthology.orchestra.run.smithi001.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T00:44:13.210 INFO:teuthology.orchestra.run.smithi001.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T00:44:13.210 INFO:teuthology.orchestra.run.smithi001.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T00:44:13.210 INFO:teuthology.orchestra.run.smithi001.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T00:44:13.210 INFO:teuthology.orchestra.run.smithi001.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T00:44:13.210 INFO:teuthology.orchestra.run.smithi001.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T00:44:13.210 INFO:teuthology.orchestra.run.smithi001.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T00:44:13.210 INFO:teuthology.orchestra.run.smithi001.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T00:44:13.210 INFO:teuthology.orchestra.run.smithi001.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T00:44:13.210 INFO:teuthology.orchestra.run.smithi001.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T00:44:13.210 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T00:44:13.210 INFO:teuthology.orchestra.run.smithi001.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T00:44:13.210 INFO:teuthology.orchestra.run.smithi001.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T00:44:13.210 INFO:teuthology.orchestra.run.smithi001.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T00:44:13.211 INFO:teuthology.orchestra.run.smithi001.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T00:44:13.211 INFO:teuthology.orchestra.run.smithi001.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T00:44:13.211 INFO:teuthology.orchestra.run.smithi001.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T00:44:13.211 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T00:44:13.211 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T00:44:13.211 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T00:44:13.211 INFO:teuthology.orchestra.run.smithi001.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T00:44:13.211 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T00:44:13.211 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T00:44:13.211 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T00:44:13.211 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T00:44:13.211 INFO:teuthology.orchestra.run.smithi001.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T00:44:13.211 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T00:44:13.211 INFO:teuthology.orchestra.run.smithi001.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T00:44:13.211 INFO:teuthology.orchestra.run.smithi001.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T00:44:13.212 INFO:teuthology.orchestra.run.smithi001.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T00:44:13.212 INFO:teuthology.orchestra.run.smithi001.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T00:44:13.212 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T00:44:13.212 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T00:44:13.212 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T00:44:13.212 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T00:44:13.212 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T00:44:13.212 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T00:44:13.212 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T00:44:13.212 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T00:44:13.212 INFO:teuthology.orchestra.run.smithi001.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T00:44:13.212 INFO:teuthology.orchestra.run.smithi001.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T00:44:13.212 INFO:teuthology.orchestra.run.smithi001.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T00:44:13.212 INFO:teuthology.orchestra.run.smithi001.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T00:44:13.213 INFO:teuthology.orchestra.run.smithi001.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T00:44:13.213 INFO:teuthology.orchestra.run.smithi001.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T00:44:13.213 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T00:44:13.213 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T00:44:13.213 INFO:teuthology.orchestra.run.smithi001.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T00:44:13.213 INFO:teuthology.orchestra.run.smithi001.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T00:44:13.213 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T00:44:13.213 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T00:44:13.213 INFO:teuthology.orchestra.run.smithi001.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T00:44:13.213 INFO:teuthology.orchestra.run.smithi001.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T00:44:13.213 INFO:teuthology.orchestra.run.smithi001.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T00:44:13.213 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T00:44:13.213 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T00:44:13.213 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T00:44:13.214 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T00:44:13.214 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T00:44:13.214 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T00:44:13.214 INFO:teuthology.orchestra.run.smithi001.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T00:44:13.214 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T00:44:13.214 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T00:44:13.214 INFO:teuthology.orchestra.run.smithi001.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T00:44:13.214 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T00:44:13.214 INFO:teuthology.orchestra.run.smithi001.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T00:44:13.214 INFO:teuthology.orchestra.run.smithi001.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T00:44:13.214 INFO:teuthology.orchestra.run.smithi001.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T00:44:13.214 INFO:teuthology.orchestra.run.smithi001.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T00:44:13.214 INFO:teuthology.orchestra.run.smithi001.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T00:44:13.215 INFO:teuthology.orchestra.run.smithi001.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T00:44:13.215 INFO:teuthology.orchestra.run.smithi001.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T00:44:13.215 INFO:teuthology.orchestra.run.smithi001.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T00:44:13.215 INFO:teuthology.orchestra.run.smithi001.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T00:44:13.215 INFO:teuthology.orchestra.run.smithi001.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T00:44:13.215 INFO:teuthology.orchestra.run.smithi001.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T00:44:13.215 INFO:teuthology.orchestra.run.smithi001.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T00:44:13.215 INFO:teuthology.orchestra.run.smithi001.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T00:44:13.215 INFO:teuthology.orchestra.run.smithi001.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T00:44:13.215 INFO:teuthology.orchestra.run.smithi001.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T00:44:13.215 INFO:teuthology.orchestra.run.smithi001.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T00:44:13.215 INFO:teuthology.orchestra.run.smithi001.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T00:44:13.215 INFO:teuthology.orchestra.run.smithi001.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T00:44:13.215 INFO:teuthology.orchestra.run.smithi001.stdout:Installing weak dependencies: 2024-09-21T00:44:13.216 INFO:teuthology.orchestra.run.smithi001.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T00:44:13.216 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:44:13.216 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2024-09-21T00:44:13.216 INFO:teuthology.orchestra.run.smithi001.stdout:======================================================================================= 2024-09-21T00:44:13.216 INFO:teuthology.orchestra.run.smithi001.stdout:Install 149 Packages 2024-09-21T00:44:13.216 INFO:teuthology.orchestra.run.smithi001.stdout:Upgrade 8 Packages 2024-09-21T00:44:13.216 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:44:13.216 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 228 M 2024-09-21T00:44:13.216 INFO:teuthology.orchestra.run.smithi001.stdout:Downloading Packages: 2024-09-21T00:44:13.616 INFO:teuthology.orchestra.run.smithi193.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 51 kB/s | 6.6 kB 00:00 2024-09-21T00:44:13.695 INFO:teuthology.orchestra.run.smithi001.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 47 kB/s | 6.6 kB 00:00 2024-09-21T00:44:13.933 INFO:teuthology.orchestra.run.smithi193.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 2.7 MB/s | 873 kB 00:00 2024-09-21T00:44:13.971 INFO:teuthology.orchestra.run.smithi001.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 3.1 MB/s | 873 kB 00:00 2024-09-21T00:44:13.992 INFO:teuthology.orchestra.run.smithi193.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 2.5 MB/s | 148 kB 00:00 2024-09-21T00:44:14.037 INFO:teuthology.orchestra.run.smithi001.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 2.2 MB/s | 148 kB 00:00 2024-09-21T00:44:14.342 INFO:teuthology.orchestra.run.smithi193.stdout:(4/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 6.5 MB/s | 2.3 MB 00:00 2024-09-21T00:44:14.396 INFO:teuthology.orchestra.run.smithi001.stdout:(4/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 6.4 MB/s | 2.3 MB 00:00 2024-09-21T00:44:14.440 INFO:teuthology.orchestra.run.smithi042.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T00:44:14.441 INFO:teuthology.orchestra.run.smithi042.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T00:44:14.453 INFO:teuthology.orchestra.run.smithi042.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T00:44:14.454 INFO:teuthology.orchestra.run.smithi042.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T00:44:14.454 INFO:teuthology.orchestra.run.smithi042.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T00:44:14.455 INFO:teuthology.orchestra.run.smithi042.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T00:44:14.457 INFO:teuthology.orchestra.run.smithi042.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T00:44:14.460 INFO:teuthology.orchestra.run.smithi042.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T00:44:14.461 INFO:teuthology.orchestra.run.smithi042.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T00:44:14.476 INFO:teuthology.orchestra.run.smithi193.stdout:(5/157): ceph-base-19.3.0-5120.g18432218.el9.x8 5.6 MB/s | 5.5 MB 00:00 2024-09-21T00:44:14.528 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-21T00:44:14.530 INFO:teuthology.orchestra.run.smithi001.stdout:(5/157): ceph-base-19.3.0-5120.g18432218.el9.x8 5.7 MB/s | 5.5 MB 00:00 2024-09-21T00:44:14.548 INFO:teuthology.orchestra.run.smithi042.stdout:======================================================================================= 2024-09-21T00:44:14.548 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-09-21T00:44:14.548 INFO:teuthology.orchestra.run.smithi042.stdout:======================================================================================= 2024-09-21T00:44:14.548 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-09-21T00:44:14.548 INFO:teuthology.orchestra.run.smithi042.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T00:44:14.548 INFO:teuthology.orchestra.run.smithi042.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T00:44:14.548 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T00:44:14.548 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T00:44:14.548 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T00:44:14.549 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T00:44:14.549 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T00:44:14.549 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T00:44:14.549 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T00:44:14.549 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T00:44:14.549 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T00:44:14.549 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T00:44:14.549 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T00:44:14.549 INFO:teuthology.orchestra.run.smithi042.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T00:44:14.549 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T00:44:14.549 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T00:44:14.550 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T00:44:14.550 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T00:44:14.550 INFO:teuthology.orchestra.run.smithi042.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T00:44:14.550 INFO:teuthology.orchestra.run.smithi042.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T00:44:14.550 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T00:44:14.550 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T00:44:14.550 INFO:teuthology.orchestra.run.smithi042.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T00:44:14.550 INFO:teuthology.orchestra.run.smithi042.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T00:44:14.550 INFO:teuthology.orchestra.run.smithi042.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T00:44:14.550 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T00:44:14.551 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T00:44:14.551 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T00:44:14.551 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T00:44:14.551 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T00:44:14.551 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T00:44:14.551 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T00:44:14.551 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T00:44:14.551 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T00:44:14.551 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T00:44:14.551 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T00:44:14.551 INFO:teuthology.orchestra.run.smithi042.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T00:44:14.551 INFO:teuthology.orchestra.run.smithi042.stdout:Upgrading: 2024-09-21T00:44:14.551 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T00:44:14.552 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T00:44:14.552 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T00:44:14.552 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T00:44:14.552 INFO:teuthology.orchestra.run.smithi042.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T00:44:14.552 INFO:teuthology.orchestra.run.smithi042.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T00:44:14.552 INFO:teuthology.orchestra.run.smithi042.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T00:44:14.552 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T00:44:14.552 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-09-21T00:44:14.552 INFO:teuthology.orchestra.run.smithi042.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T00:44:14.552 INFO:teuthology.orchestra.run.smithi042.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T00:44:14.552 INFO:teuthology.orchestra.run.smithi042.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T00:44:14.552 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T00:44:14.552 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T00:44:14.553 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T00:44:14.553 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T00:44:14.553 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T00:44:14.553 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T00:44:14.553 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T00:44:14.553 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T00:44:14.553 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T00:44:14.553 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T00:44:14.553 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T00:44:14.553 INFO:teuthology.orchestra.run.smithi042.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T00:44:14.553 INFO:teuthology.orchestra.run.smithi042.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T00:44:14.553 INFO:teuthology.orchestra.run.smithi042.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T00:44:14.553 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T00:44:14.554 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T00:44:14.554 INFO:teuthology.orchestra.run.smithi042.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T00:44:14.554 INFO:teuthology.orchestra.run.smithi042.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T00:44:14.554 INFO:teuthology.orchestra.run.smithi042.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T00:44:14.554 INFO:teuthology.orchestra.run.smithi042.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T00:44:14.554 INFO:teuthology.orchestra.run.smithi042.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T00:44:14.554 INFO:teuthology.orchestra.run.smithi042.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T00:44:14.554 INFO:teuthology.orchestra.run.smithi042.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T00:44:14.554 INFO:teuthology.orchestra.run.smithi042.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T00:44:14.554 INFO:teuthology.orchestra.run.smithi042.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T00:44:14.554 INFO:teuthology.orchestra.run.smithi042.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T00:44:14.554 INFO:teuthology.orchestra.run.smithi042.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T00:44:14.554 INFO:teuthology.orchestra.run.smithi042.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T00:44:14.554 INFO:teuthology.orchestra.run.smithi042.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T00:44:14.555 INFO:teuthology.orchestra.run.smithi042.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T00:44:14.555 INFO:teuthology.orchestra.run.smithi042.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T00:44:14.555 INFO:teuthology.orchestra.run.smithi042.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T00:44:14.555 INFO:teuthology.orchestra.run.smithi042.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T00:44:14.555 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T00:44:14.555 INFO:teuthology.orchestra.run.smithi042.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T00:44:14.555 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T00:44:14.555 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T00:44:14.555 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T00:44:14.555 INFO:teuthology.orchestra.run.smithi042.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T00:44:14.555 INFO:teuthology.orchestra.run.smithi042.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T00:44:14.555 INFO:teuthology.orchestra.run.smithi042.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T00:44:14.555 INFO:teuthology.orchestra.run.smithi042.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T00:44:14.556 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T00:44:14.556 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T00:44:14.556 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T00:44:14.556 INFO:teuthology.orchestra.run.smithi042.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T00:44:14.556 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T00:44:14.556 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T00:44:14.556 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T00:44:14.556 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T00:44:14.556 INFO:teuthology.orchestra.run.smithi042.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T00:44:14.556 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T00:44:14.556 INFO:teuthology.orchestra.run.smithi042.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T00:44:14.556 INFO:teuthology.orchestra.run.smithi042.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T00:44:14.556 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T00:44:14.556 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T00:44:14.557 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T00:44:14.557 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T00:44:14.557 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T00:44:14.557 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T00:44:14.557 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T00:44:14.557 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T00:44:14.557 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T00:44:14.557 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T00:44:14.557 INFO:teuthology.orchestra.run.smithi042.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T00:44:14.557 INFO:teuthology.orchestra.run.smithi042.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T00:44:14.557 INFO:teuthology.orchestra.run.smithi042.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T00:44:14.557 INFO:teuthology.orchestra.run.smithi042.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T00:44:14.557 INFO:teuthology.orchestra.run.smithi042.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T00:44:14.557 INFO:teuthology.orchestra.run.smithi042.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T00:44:14.558 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T00:44:14.558 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T00:44:14.558 INFO:teuthology.orchestra.run.smithi042.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T00:44:14.558 INFO:teuthology.orchestra.run.smithi042.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T00:44:14.558 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T00:44:14.558 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T00:44:14.558 INFO:teuthology.orchestra.run.smithi042.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T00:44:14.558 INFO:teuthology.orchestra.run.smithi042.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T00:44:14.558 INFO:teuthology.orchestra.run.smithi042.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T00:44:14.558 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T00:44:14.558 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T00:44:14.558 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T00:44:14.558 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T00:44:14.559 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T00:44:14.559 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T00:44:14.559 INFO:teuthology.orchestra.run.smithi042.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T00:44:14.559 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T00:44:14.559 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T00:44:14.559 INFO:teuthology.orchestra.run.smithi042.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T00:44:14.559 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T00:44:14.559 INFO:teuthology.orchestra.run.smithi042.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T00:44:14.559 INFO:teuthology.orchestra.run.smithi042.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T00:44:14.559 INFO:teuthology.orchestra.run.smithi042.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T00:44:14.559 INFO:teuthology.orchestra.run.smithi042.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T00:44:14.559 INFO:teuthology.orchestra.run.smithi042.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T00:44:14.559 INFO:teuthology.orchestra.run.smithi042.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T00:44:14.559 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T00:44:14.559 INFO:teuthology.orchestra.run.smithi042.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T00:44:14.560 INFO:teuthology.orchestra.run.smithi042.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T00:44:14.560 INFO:teuthology.orchestra.run.smithi042.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T00:44:14.560 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T00:44:14.560 INFO:teuthology.orchestra.run.smithi042.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T00:44:14.560 INFO:teuthology.orchestra.run.smithi042.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T00:44:14.560 INFO:teuthology.orchestra.run.smithi042.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T00:44:14.560 INFO:teuthology.orchestra.run.smithi042.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T00:44:14.560 INFO:teuthology.orchestra.run.smithi042.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T00:44:14.560 INFO:teuthology.orchestra.run.smithi042.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T00:44:14.560 INFO:teuthology.orchestra.run.smithi042.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T00:44:14.560 INFO:teuthology.orchestra.run.smithi042.stdout:Installing weak dependencies: 2024-09-21T00:44:14.560 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T00:44:14.560 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T00:44:14.560 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-09-21T00:44:14.561 INFO:teuthology.orchestra.run.smithi042.stdout:======================================================================================= 2024-09-21T00:44:14.561 INFO:teuthology.orchestra.run.smithi042.stdout:Install 149 Packages 2024-09-21T00:44:14.561 INFO:teuthology.orchestra.run.smithi042.stdout:Upgrade 8 Packages 2024-09-21T00:44:14.561 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T00:44:14.561 INFO:teuthology.orchestra.run.smithi193.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 7.0 MB/s | 1.5 MB 00:00 2024-09-21T00:44:14.562 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 228 M 2024-09-21T00:44:14.562 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-09-21T00:44:14.613 INFO:teuthology.orchestra.run.smithi001.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 7.0 MB/s | 1.5 MB 00:00 2024-09-21T00:44:15.027 INFO:teuthology.orchestra.run.smithi193.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 9.0 MB/s | 5.0 MB 00:00 2024-09-21T00:44:15.080 INFO:teuthology.orchestra.run.smithi001.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 9.0 MB/s | 5.0 MB 00:00 2024-09-21T00:44:15.421 INFO:teuthology.orchestra.run.smithi042.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 20 kB/s | 6.6 kB 00:00 2024-09-21T00:44:15.760 INFO:teuthology.orchestra.run.smithi193.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 8.8 MB/s | 20 MB 00:02 2024-09-21T00:44:15.810 INFO:teuthology.orchestra.run.smithi193.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 506 kB/s | 25 kB 00:00 2024-09-21T00:44:15.864 INFO:teuthology.orchestra.run.smithi001.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 8.6 MB/s | 20 MB 00:02 2024-09-21T00:44:15.922 INFO:teuthology.orchestra.run.smithi042.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 873 kB 00:00 2024-09-21T00:44:15.931 INFO:teuthology.orchestra.run.smithi001.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 379 kB/s | 25 kB 00:00 2024-09-21T00:44:16.030 INFO:teuthology.orchestra.run.smithi042.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.3 MB/s | 148 kB 00:00 2024-09-21T00:44:16.060 INFO:teuthology.orchestra.run.smithi193.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 10 MB/s | 10 MB 00:01 2024-09-21T00:44:16.144 INFO:teuthology.orchestra.run.smithi193.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 2.7 MB/s | 226 kB 00:00 2024-09-21T00:44:16.202 INFO:teuthology.orchestra.run.smithi193.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 464 kB/s | 27 kB 00:00 2024-09-21T00:44:16.247 INFO:teuthology.orchestra.run.smithi001.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 8.9 MB/s | 10 MB 00:01 2024-09-21T00:44:16.253 INFO:teuthology.orchestra.run.smithi193.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 635 kB/s | 32 kB 00:00 2024-09-21T00:44:16.314 INFO:teuthology.orchestra.run.smithi001.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 3.3 MB/s | 226 kB 00:00 2024-09-21T00:44:16.381 INFO:teuthology.orchestra.run.smithi001.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 405 kB/s | 27 kB 00:00 2024-09-21T00:44:16.395 INFO:teuthology.orchestra.run.smithi193.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 5.3 MB/s | 766 kB 00:00 2024-09-21T00:44:16.440 INFO:teuthology.orchestra.run.smithi001.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 545 kB/s | 32 kB 00:00 2024-09-21T00:44:16.548 INFO:teuthology.orchestra.run.smithi001.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 6.9 MB/s | 766 kB 00:00 2024-09-21T00:44:16.562 INFO:teuthology.orchestra.run.smithi193.stdout:(15/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 8.9 MB/s | 18 MB 00:02 2024-09-21T00:44:16.587 INFO:teuthology.orchestra.run.smithi193.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 826 kB/s | 158 kB 00:00 2024-09-21T00:44:16.614 INFO:teuthology.orchestra.run.smithi042.stdout:(4/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 3.9 MB/s | 2.3 MB 00:00 2024-09-21T00:44:16.615 INFO:teuthology.orchestra.run.smithi001.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 2.3 MB/s | 158 kB 00:00 2024-09-21T00:44:16.629 INFO:teuthology.orchestra.run.smithi193.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 1.9 MB/s | 127 kB 00:00 2024-09-21T00:44:16.654 INFO:teuthology.orchestra.run.smithi193.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 7.4 MB/s | 507 kB 00:00 2024-09-21T00:44:16.704 INFO:teuthology.orchestra.run.smithi193.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 903 kB/s | 45 kB 00:00 2024-09-21T00:44:16.772 INFO:teuthology.orchestra.run.smithi193.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 2.2 MB/s | 148 kB 00:00 2024-09-21T00:44:16.816 INFO:teuthology.orchestra.run.smithi001.stdout:(16/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 8.1 MB/s | 18 MB 00:02 2024-09-21T00:44:16.838 INFO:teuthology.orchestra.run.smithi193.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 2.4 MB/s | 161 kB 00:00 2024-09-21T00:44:16.841 INFO:teuthology.orchestra.run.smithi001.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 561 kB/s | 127 kB 00:00 2024-09-21T00:44:16.864 INFO:teuthology.orchestra.run.smithi042.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 6.1 MB/s | 1.5 MB 00:00 2024-09-21T00:44:16.914 INFO:teuthology.orchestra.run.smithi193.stdout:(22/157): python3-rados-19.3.0-5120.g18432218.e 4.2 MB/s | 321 kB 00:00 2024-09-21T00:44:16.949 INFO:teuthology.orchestra.run.smithi001.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 3.7 MB/s | 507 kB 00:00 2024-09-21T00:44:16.998 INFO:teuthology.orchestra.run.smithi193.stdout:(23/157): python3-rbd-19.3.0-5120.g18432218.el9 3.6 MB/s | 307 kB 00:00 2024-09-21T00:44:17.042 INFO:teuthology.orchestra.run.smithi001.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 492 kB/s | 45 kB 00:00 2024-09-21T00:44:17.073 INFO:teuthology.orchestra.run.smithi193.stdout:(24/157): python3-rgw-19.3.0-5120.g18432218.el9 1.3 MB/s | 99 kB 00:00 2024-09-21T00:44:17.125 INFO:teuthology.orchestra.run.smithi001.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.7 MB/s | 148 kB 00:00 2024-09-21T00:44:17.148 INFO:teuthology.orchestra.run.smithi193.stdout:(25/157): librgw2-19.3.0-5120.g18432218.el9.x86 10 MB/s | 5.3 MB 00:00 2024-09-21T00:44:17.165 INFO:teuthology.orchestra.run.smithi193.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 938 kB/s | 86 kB 00:00 2024-09-21T00:44:17.201 INFO:teuthology.orchestra.run.smithi001.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 2.1 MB/s | 161 kB 00:00 2024-09-21T00:44:17.257 INFO:teuthology.orchestra.run.smithi193.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 1.8 MB/s | 170 kB 00:00 2024-09-21T00:44:17.293 INFO:teuthology.orchestra.run.smithi001.stdout:(22/157): python3-rados-19.3.0-5120.g18432218.e 3.4 MB/s | 321 kB 00:00 2024-09-21T00:44:17.349 INFO:teuthology.orchestra.run.smithi193.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 373 kB/s | 34 kB 00:00 2024-09-21T00:44:17.384 INFO:teuthology.orchestra.run.smithi001.stdout:(23/157): python3-rbd-19.3.0-5120.g18432218.el9 3.3 MB/s | 307 kB 00:00 2024-09-21T00:44:17.441 INFO:teuthology.orchestra.run.smithi193.stdout:(29/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 1.6 MB/s | 154 kB 00:00 2024-09-21T00:44:17.493 INFO:teuthology.orchestra.run.smithi001.stdout:(24/157): librgw2-19.3.0-5120.g18432218.el9.x86 8.1 MB/s | 5.3 MB 00:00 2024-09-21T00:44:17.518 INFO:teuthology.orchestra.run.smithi001.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 744 kB/s | 99 kB 00:00 2024-09-21T00:44:17.566 INFO:teuthology.orchestra.run.smithi193.stdout:(30/157): rbd-mirror-19.3.0-5120.g18432218.el9. 7.4 MB/s | 3.1 MB 00:00 2024-09-21T00:44:17.577 INFO:teuthology.orchestra.run.smithi001.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.0 MB/s | 86 kB 00:00 2024-09-21T00:44:17.664 INFO:teuthology.orchestra.run.smithi042.stdout:(6/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 6.2 MB/s | 5.0 MB 00:00 2024-09-21T00:44:17.677 INFO:teuthology.orchestra.run.smithi001.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 1.7 MB/s | 170 kB 00:00 2024-09-21T00:44:17.778 INFO:teuthology.orchestra.run.smithi001.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 343 kB/s | 34 kB 00:00 2024-09-21T00:44:18.028 INFO:teuthology.orchestra.run.smithi001.stdout:(29/157): rbd-mirror-19.3.0-5120.g18432218.el9. 6.1 MB/s | 3.1 MB 00:00 2024-09-21T00:44:18.228 INFO:teuthology.orchestra.run.smithi001.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 343 kB/s | 154 kB 00:00 2024-09-21T00:44:18.525 INFO:teuthology.orchestra.run.smithi193.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 7.7 MB/s | 7.4 MB 00:00 2024-09-21T00:44:18.581 INFO:teuthology.orchestra.run.smithi042.stdout:(7/157): ceph-common-19.3.0-5120.g18432218.el9. 5.7 MB/s | 20 MB 00:03 2024-09-21T00:44:18.625 INFO:teuthology.orchestra.run.smithi193.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 2.9 MB/s | 292 kB 00:00 2024-09-21T00:44:18.717 INFO:teuthology.orchestra.run.smithi193.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 537 kB/s | 49 kB 00:00 2024-09-21T00:44:18.809 INFO:teuthology.orchestra.run.smithi193.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 179 kB/s | 16 kB 00:00 2024-09-21T00:44:18.909 INFO:teuthology.orchestra.run.smithi193.stdout:(35/157): ceph-volume-19.3.0-5120.g18432218.el9 2.8 MB/s | 285 kB 00:00 2024-09-21T00:44:19.085 INFO:teuthology.orchestra.run.smithi193.stdout:(36/157): cephadm-19.3.0-5120.g18432218.el9.noa 4.4 MB/s | 784 kB 00:00 2024-09-21T00:44:19.172 INFO:teuthology.orchestra.run.smithi193.stdout:(37/157): cephfs-top-19.3.0-5120.g18432218.el9. 210 kB/s | 18 kB 00:00 2024-09-21T00:44:19.281 INFO:teuthology.orchestra.run.smithi193.stdout:(38/157): fuse-2.9.9-16.el9.x86_64.rpm 736 kB/s | 80 kB 00:00 2024-09-21T00:44:19.448 INFO:teuthology.orchestra.run.smithi193.stdout:(39/157): ceph-mgr-dashboard-19.3.0-5120.g18432 7.1 MB/s | 14 MB 00:02 2024-09-21T00:44:19.515 INFO:teuthology.orchestra.run.smithi193.stdout:(40/157): libgfortran-11.5.0-2.el9.x86_64.rpm 3.4 MB/s | 801 kB 00:00 2024-09-21T00:44:19.557 INFO:teuthology.orchestra.run.smithi193.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.9 MB/s | 253 kB 00:00 2024-09-21T00:44:19.583 INFO:teuthology.orchestra.run.smithi193.stdout:(42/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 191 kB 00:00 2024-09-21T00:44:19.589 INFO:teuthology.orchestra.run.smithi042.stdout:(8/157): ceph-radosgw-19.3.0-5120.g18432218.el9 10 MB/s | 10 MB 00:01 2024-09-21T00:44:19.631 INFO:teuthology.orchestra.run.smithi042.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 606 kB/s | 25 kB 00:00 2024-09-21T00:44:19.633 INFO:teuthology.orchestra.run.smithi193.stdout:(43/157): python3-cryptography-36.0.1-4.el9.x86 16 MB/s | 1.2 MB 00:00 2024-09-21T00:44:19.637 INFO:teuthology.orchestra.run.smithi001.stdout:(31/157): ceph-test-19.3.0-5120.g18432218.el9.x 11 MB/s | 40 MB 00:03 2024-09-21T00:44:19.658 INFO:teuthology.orchestra.run.smithi193.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-21T00:44:19.684 INFO:teuthology.orchestra.run.smithi193.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-21T00:44:19.709 INFO:teuthology.orchestra.run.smithi193.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-21T00:44:19.720 INFO:teuthology.orchestra.run.smithi001.stdout:(32/157): ceph-mgr-diskprediction-local-19.3.0- 4.9 MB/s | 7.4 MB 00:01 2024-09-21T00:44:19.734 INFO:teuthology.orchestra.run.smithi193.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-21T00:44:19.745 INFO:teuthology.orchestra.run.smithi001.stdout:(33/157): ceph-mgr-modules-core-19.3.0-5120.g18 2.6 MB/s | 292 kB 00:00 2024-09-21T00:44:19.771 INFO:teuthology.orchestra.run.smithi001.stdout:(34/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 986 kB/s | 49 kB 00:00 2024-09-21T00:44:19.796 INFO:teuthology.orchestra.run.smithi001.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 329 kB/s | 16 kB 00:00 2024-09-21T00:44:19.882 INFO:teuthology.orchestra.run.smithi042.stdout:(10/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 8.0 MB/s | 18 MB 00:02 2024-09-21T00:44:19.932 INFO:teuthology.orchestra.run.smithi042.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 4.4 MB/s | 226 kB 00:00 2024-09-21T00:44:19.946 INFO:teuthology.orchestra.run.smithi001.stdout:(36/157): ceph-mgr-dashboard-19.3.0-5120.g18432 7.4 MB/s | 14 MB 00:01 2024-09-21T00:44:19.960 INFO:teuthology.orchestra.run.smithi193.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 2.7 MB/s | 689 kB 00:00 2024-09-21T00:44:19.972 INFO:teuthology.orchestra.run.smithi001.stdout:(37/157): ceph-volume-19.3.0-5120.g18432218.el9 1.4 MB/s | 285 kB 00:00 2024-09-21T00:44:19.997 INFO:teuthology.orchestra.run.smithi001.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 370 kB/s | 18 kB 00:00 2024-09-21T00:44:20.018 INFO:teuthology.orchestra.run.smithi193.stdout:(49/157): bison-3.7.4-5.el9.x86_64.rpm 3.2 MB/s | 943 kB 00:00 2024-09-21T00:44:20.032 INFO:teuthology.orchestra.run.smithi042.stdout:(12/157): ceph-base-19.3.0-5120.g18432218.el9.x 1.1 MB/s | 5.5 MB 00:04 2024-09-21T00:44:20.038 INFO:teuthology.orchestra.run.smithi001.stdout:(39/157): cephadm-19.3.0-5120.g18432218.el9.noa 3.2 MB/s | 784 kB 00:00 2024-09-21T00:44:20.058 INFO:teuthology.orchestra.run.smithi042.stdout:(13/157): cephfs-shell-19.3.0-5120.g18432218.el 216 kB/s | 27 kB 00:00 2024-09-21T00:44:20.060 INFO:teuthology.orchestra.run.smithi193.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 1.0 MB/s | 107 kB 00:00 2024-09-21T00:44:20.083 INFO:teuthology.orchestra.run.smithi042.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 633 kB/s | 32 kB 00:00 2024-09-21T00:44:20.085 INFO:teuthology.orchestra.run.smithi193.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 324 kB/s | 22 kB 00:00 2024-09-21T00:44:20.106 INFO:teuthology.orchestra.run.smithi001.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 597 kB/s | 80 kB 00:00 2024-09-21T00:44:20.136 INFO:teuthology.orchestra.run.smithi193.stdout:(52/157): flexiblas-3.0.4-8.el9.x86_64.rpm 654 kB/s | 33 kB 00:00 2024-09-21T00:44:20.150 INFO:teuthology.orchestra.run.smithi042.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 8.1 MB/s | 766 kB 00:00 2024-09-21T00:44:20.164 INFO:teuthology.orchestra.run.smithi001.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-21T00:44:20.169 INFO:teuthology.orchestra.run.smithi193.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-21T00:44:20.189 INFO:teuthology.orchestra.run.smithi001.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-21T00:44:20.200 INFO:teuthology.orchestra.run.smithi042.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 1.3 MB/s | 158 kB 00:00 2024-09-21T00:44:20.215 INFO:teuthology.orchestra.run.smithi001.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 3.6 MB/s | 801 kB 00:00 2024-09-21T00:44:20.220 INFO:teuthology.orchestra.run.smithi193.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-09-21T00:44:20.225 INFO:teuthology.orchestra.run.smithi042.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 1.6 MB/s | 127 kB 00:00 2024-09-21T00:44:20.240 INFO:teuthology.orchestra.run.smithi001.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-21T00:44:20.265 INFO:teuthology.orchestra.run.smithi001.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-21T00:44:20.270 INFO:teuthology.orchestra.run.smithi193.stdout:(55/157): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-09-21T00:44:20.290 INFO:teuthology.orchestra.run.smithi001.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-21T00:44:20.316 INFO:teuthology.orchestra.run.smithi001.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-21T00:44:20.349 INFO:teuthology.orchestra.run.smithi001.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 6.6 MB/s | 1.2 MB 00:00 2024-09-21T00:44:20.401 INFO:teuthology.orchestra.run.smithi042.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 2.5 MB/s | 507 kB 00:00 2024-09-21T00:44:20.459 INFO:teuthology.orchestra.run.smithi042.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 773 kB/s | 45 kB 00:00 2024-09-21T00:44:20.602 INFO:teuthology.orchestra.run.smithi042.stdout:(20/157): librgw2-19.3.0-5120.g18432218.el9.x86 14 MB/s | 5.3 MB 00:00 2024-09-21T00:44:20.627 INFO:teuthology.orchestra.run.smithi042.stdout:(21/157): python3-ceph-common-19.3.0-5120.g1843 890 kB/s | 148 kB 00:00 2024-09-21T00:44:20.645 INFO:teuthology.orchestra.run.smithi193.stdout:(56/157): ceph-test-19.3.0-5120.g18432218.el9.x 8.2 MB/s | 40 MB 00:04 2024-09-21T00:44:20.660 INFO:teuthology.orchestra.run.smithi042.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 2.7 MB/s | 161 kB 00:00 2024-09-21T00:44:20.671 INFO:teuthology.orchestra.run.smithi193.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 426 kB/s | 171 kB 00:00 2024-09-21T00:44:20.719 INFO:teuthology.orchestra.run.smithi042.stdout:(23/157): python3-rbd-19.3.0-5120.g18432218.el9 5.1 MB/s | 307 kB 00:00 2024-09-21T00:44:20.721 INFO:teuthology.orchestra.run.smithi193.stdout:(58/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 907 kB/s | 45 kB 00:00 2024-09-21T00:44:20.769 INFO:teuthology.orchestra.run.smithi042.stdout:(24/157): python3-rados-19.3.0-5120.g18432218.e 2.2 MB/s | 321 kB 00:00 2024-09-21T00:44:20.795 INFO:teuthology.orchestra.run.smithi042.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.3 MB/s | 99 kB 00:00 2024-09-21T00:44:20.804 INFO:teuthology.orchestra.run.smithi193.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2024-09-21T00:44:20.820 INFO:teuthology.orchestra.run.smithi042.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T00:44:20.841 INFO:teuthology.orchestra.run.smithi001.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 217 kB/s | 107 kB 00:00 2024-09-21T00:44:20.863 INFO:teuthology.orchestra.run.smithi193.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 4.6 MB/s | 662 kB 00:00 2024-09-21T00:44:20.895 INFO:teuthology.orchestra.run.smithi042.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.2 MB/s | 170 kB 00:00 2024-09-21T00:44:20.954 INFO:teuthology.orchestra.run.smithi042.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 590 kB/s | 34 kB 00:00 2024-09-21T00:44:20.955 INFO:teuthology.orchestra.run.smithi193.stdout:(61/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.6 MB/s | 3.0 MB 00:00 2024-09-21T00:44:20.972 INFO:teuthology.orchestra.run.smithi193.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 226 kB/s | 24 kB 00:00 2024-09-21T00:44:20.983 INFO:teuthology.orchestra.run.smithi001.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 153 kB/s | 22 kB 00:00 2024-09-21T00:44:21.005 INFO:teuthology.orchestra.run.smithi193.stdout:(63/157): libtool-2.4.6-46.el9.x86_64.rpm 2.8 MB/s | 581 kB 00:00 2024-09-21T00:44:21.038 INFO:teuthology.orchestra.run.smithi042.stdout:(29/157): rbd-mirror-19.3.0-5120.g18432218.el9. 13 MB/s | 3.1 MB 00:00 2024-09-21T00:44:21.056 INFO:teuthology.orchestra.run.smithi193.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-21T00:44:21.063 INFO:teuthology.orchestra.run.smithi042.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 1.4 MB/s | 154 kB 00:00 2024-09-21T00:44:21.081 INFO:teuthology.orchestra.run.smithi193.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-21T00:44:21.098 INFO:teuthology.orchestra.run.smithi193.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 920 kB/s | 38 kB 00:00 2024-09-21T00:44:21.109 INFO:teuthology.orchestra.run.smithi001.stdout:(51/157): automake-1.16.2-8.el9.noarch.rpm 842 kB/s | 689 kB 00:00 2024-09-21T00:44:21.115 INFO:teuthology.orchestra.run.smithi193.stdout:(67/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 297 kB/s | 47 kB 00:00 2024-09-21T00:44:21.169 INFO:teuthology.orchestra.run.smithi001.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 1.1 MB/s | 943 kB 00:00 2024-09-21T00:44:21.210 INFO:teuthology.orchestra.run.smithi001.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 326 kB/s | 33 kB 00:00 2024-09-21T00:44:21.319 INFO:teuthology.orchestra.run.smithi001.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 168 kB/s | 18 kB 00:00 2024-09-21T00:44:21.360 INFO:teuthology.orchestra.run.smithi001.stdout:(55/157): flex-2.6.4-9.el9.x86_64.rpm 834 kB/s | 313 kB 00:00 2024-09-21T00:44:21.418 INFO:teuthology.orchestra.run.smithi001.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 111 kB/s | 11 kB 00:00 2024-09-21T00:44:21.481 INFO:teuthology.orchestra.run.smithi001.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.4 MB/s | 171 kB 00:00 2024-09-21T00:44:21.535 INFO:teuthology.orchestra.run.smithi001.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-21T00:44:21.581 INFO:teuthology.orchestra.run.smithi001.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 451 kB/s | 45 kB 00:00 2024-09-21T00:44:21.651 INFO:teuthology.orchestra.run.smithi193.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 3.0 MB/s | 1.6 MB 00:00 2024-09-21T00:44:21.653 INFO:teuthology.orchestra.run.smithi001.stdout:(60/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.9 MB/s | 3.0 MB 00:00 2024-09-21T00:44:21.664 INFO:teuthology.orchestra.run.smithi042.stdout:(31/157): ceph-test-19.3.0-5120.g18432218.el9.x 20 MB/s | 40 MB 00:02 2024-09-21T00:44:21.714 INFO:teuthology.orchestra.run.smithi042.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 5.8 MB/s | 292 kB 00:00 2024-09-21T00:44:21.764 INFO:teuthology.orchestra.run.smithi042.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 989 kB/s | 49 kB 00:00 2024-09-21T00:44:21.770 INFO:teuthology.orchestra.run.smithi001.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 210 kB/s | 24 kB 00:00 2024-09-21T00:44:21.791 INFO:teuthology.orchestra.run.smithi193.stdout:(69/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 6.4 MB/s | 4.4 MB 00:00 2024-09-21T00:44:21.845 INFO:teuthology.orchestra.run.smithi001.stdout:(62/157): librdkafka-1.6.1-102.el9.x86_64.rpm 2.1 MB/s | 662 kB 00:00 2024-09-21T00:44:21.883 INFO:teuthology.orchestra.run.smithi193.stdout:(70/157): openblas-openmp-0.3.26-2.el9.x86_64.r 6.2 MB/s | 4.9 MB 00:00 2024-09-21T00:44:21.887 INFO:teuthology.orchestra.run.smithi001.stdout:(63/157): libtool-2.4.6-46.el9.x86_64.rpm 1.8 MB/s | 581 kB 00:00 2024-09-21T00:44:21.909 INFO:teuthology.orchestra.run.smithi193.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-21T00:44:21.912 INFO:teuthology.orchestra.run.smithi001.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 334 kB/s | 47 kB 00:00 2024-09-21T00:44:21.963 INFO:teuthology.orchestra.run.smithi001.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-21T00:44:21.973 INFO:teuthology.orchestra.run.smithi042.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 79 kB/s | 16 kB 00:00 2024-09-21T00:44:22.005 INFO:teuthology.orchestra.run.smithi001.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-21T00:44:22.016 INFO:teuthology.orchestra.run.smithi193.stdout:(72/157): postgresql-contrib-13.16-1.el9.x86_64 2.4 MB/s | 910 kB 00:00 2024-09-21T00:44:22.054 INFO:teuthology.orchestra.run.smithi001.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 271 kB/s | 38 kB 00:00 2024-09-21T00:44:22.108 INFO:teuthology.orchestra.run.smithi193.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 5.0 MB/s | 1.0 MB 00:00 2024-09-21T00:44:22.134 INFO:teuthology.orchestra.run.smithi193.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 747 kB/s | 87 kB 00:00 2024-09-21T00:44:22.140 INFO:teuthology.orchestra.run.smithi042.stdout:(35/157): ceph-mgr-dashboard-19.3.0-5120.g18432 13 MB/s | 14 MB 00:01 2024-09-21T00:44:22.182 INFO:teuthology.orchestra.run.smithi042.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 1.3 MB/s | 285 kB 00:00 2024-09-21T00:44:22.204 INFO:teuthology.orchestra.run.smithi193.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 916 kB/s | 61 kB 00:00 2024-09-21T00:44:22.213 INFO:teuthology.orchestra.run.smithi001.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-09-21T00:44:22.232 INFO:teuthology.orchestra.run.smithi042.stdout:(37/157): cephfs-top-19.3.0-5120.g18432218.el9. 370 kB/s | 18 kB 00:00 2024-09-21T00:44:22.274 INFO:teuthology.orchestra.run.smithi042.stdout:(38/157): cephadm-19.3.0-5120.g18432218.el9.noa 5.7 MB/s | 784 kB 00:00 2024-09-21T00:44:22.314 INFO:teuthology.orchestra.run.smithi001.stdout:(69/157): openblas-openmp-0.3.26-2.el9.x86_64.r 14 MB/s | 4.9 MB 00:00 2024-09-21T00:44:22.356 INFO:teuthology.orchestra.run.smithi001.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 6.3 MB/s | 910 kB 00:00 2024-09-21T00:44:22.359 INFO:teuthology.orchestra.run.smithi193.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.5 MB/s | 245 kB 00:00 2024-09-21T00:44:22.366 INFO:teuthology.orchestra.run.smithi042.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 598 kB/s | 80 kB 00:00 2024-09-21T00:44:22.433 INFO:teuthology.orchestra.run.smithi042.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-21T00:44:22.447 INFO:teuthology.orchestra.run.smithi001.stdout:(71/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-09-21T00:44:22.484 INFO:teuthology.orchestra.run.smithi042.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 3.7 MB/s | 801 kB 00:00 2024-09-21T00:44:22.489 INFO:teuthology.orchestra.run.smithi001.stdout:(72/157): postgresql-private-libs-13.16-1.el9.x 783 kB/s | 137 kB 00:00 2024-09-21T00:44:22.509 INFO:teuthology.orchestra.run.smithi193.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.6 MB/s | 248 kB 00:00 2024-09-21T00:44:22.517 INFO:teuthology.orchestra.run.smithi042.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-21T00:44:22.567 INFO:teuthology.orchestra.run.smithi042.stdout:(43/157): python3-cryptography-36.0.1-4.el9.x86 15 MB/s | 1.2 MB 00:00 2024-09-21T00:44:22.576 INFO:teuthology.orchestra.run.smithi193.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 385 kB/s | 26 kB 00:00 2024-09-21T00:44:22.581 INFO:teuthology.orchestra.run.smithi001.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 7.6 MB/s | 1.0 MB 00:00 2024-09-21T00:44:22.593 INFO:teuthology.orchestra.run.smithi042.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-21T00:44:22.606 INFO:teuthology.orchestra.run.smithi001.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 748 kB/s | 87 kB 00:00 2024-09-21T00:44:22.618 INFO:teuthology.orchestra.run.smithi042.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-21T00:44:22.627 INFO:teuthology.orchestra.run.smithi193.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-21T00:44:22.643 INFO:teuthology.orchestra.run.smithi042.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-21T00:44:22.669 INFO:teuthology.orchestra.run.smithi042.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-21T00:44:22.690 INFO:teuthology.orchestra.run.smithi001.stdout:(75/157): postgresql-server-13.16-1.el9.x86_64. 17 MB/s | 5.8 MB 00:00 2024-09-21T00:44:22.723 INFO:teuthology.orchestra.run.smithi001.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 524 kB/s | 61 kB 00:00 2024-09-21T00:44:22.794 INFO:teuthology.orchestra.run.smithi193.stdout:(80/157): postgresql-server-13.16-1.el9.x86_64. 6.3 MB/s | 5.8 MB 00:00 2024-09-21T00:44:22.807 INFO:teuthology.orchestra.run.smithi001.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.0 MB/s | 245 kB 00:00 2024-09-21T00:44:22.819 INFO:teuthology.orchestra.run.smithi193.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 897 kB/s | 172 kB 00:00 2024-09-21T00:44:22.841 INFO:teuthology.orchestra.run.smithi001.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-09-21T00:44:22.844 INFO:teuthology.orchestra.run.smithi193.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 694 kB/s | 35 kB 00:00 2024-09-21T00:44:22.924 INFO:teuthology.orchestra.run.smithi001.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 219 kB/s | 26 kB 00:00 2024-09-21T00:44:22.986 INFO:teuthology.orchestra.run.smithi193.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.7 MB/s | 250 kB 00:00 2024-09-21T00:44:23.008 INFO:teuthology.orchestra.run.smithi001.stdout:(80/157): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-09-21T00:44:23.025 INFO:teuthology.orchestra.run.smithi001.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 104 kB/s | 19 kB 00:00 2024-09-21T00:44:23.050 INFO:teuthology.orchestra.run.smithi001.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-21T00:44:23.061 INFO:teuthology.orchestra.run.smithi193.stdout:(84/157): python3-babel-2.9.1-2.el9.noarch.rpm 6.3 MB/s | 6.0 MB 00:00 2024-09-21T00:44:23.077 INFO:teuthology.orchestra.run.smithi042.stdout:(48/157): ceph-mgr-diskprediction-local-19.3.0- 3.7 MB/s | 7.4 MB 00:02 2024-09-21T00:44:23.087 INFO:teuthology.orchestra.run.smithi193.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-09-21T00:44:23.109 INFO:teuthology.orchestra.run.smithi001.stdout:(83/157): python3-markupsafe-1.1.1-12.el9.x86_6 345 kB/s | 35 kB 00:00 2024-09-21T00:44:23.154 INFO:teuthology.orchestra.run.smithi193.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 633 kB/s | 42 kB 00:00 2024-09-21T00:44:23.176 INFO:teuthology.orchestra.run.smithi001.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.0 MB/s | 250 kB 00:00 2024-09-21T00:44:23.212 INFO:teuthology.orchestra.run.smithi193.stdout:(87/157): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-21T00:44:23.226 INFO:teuthology.orchestra.run.smithi001.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.9 MB/s | 222 kB 00:00 2024-09-21T00:44:23.237 INFO:teuthology.orchestra.run.smithi193.stdout:(88/157): python3-packaging-20.9-5.el9.noarch.r 439 kB/s | 77 kB 00:00 2024-09-21T00:44:23.271 INFO:teuthology.orchestra.run.smithi193.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-21T00:44:23.301 INFO:teuthology.orchestra.run.smithi001.stdout:(86/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 18 MB/s | 5.1 MB 00:00 2024-09-21T00:44:23.319 INFO:teuthology.orchestra.run.smithi042.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 1.0 MB/s | 689 kB 00:00 2024-09-21T00:44:23.321 INFO:teuthology.orchestra.run.smithi193.stdout:(90/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-21T00:44:23.327 INFO:teuthology.orchestra.run.smithi001.stdout:(87/157): python3-packaging-20.9-5.el9.noarch.r 513 kB/s | 77 kB 00:00 2024-09-21T00:44:23.343 INFO:teuthology.orchestra.run.smithi001.stdout:(88/157): python3-prettytable-0.7.2-27.el9.noar 360 kB/s | 42 kB 00:00 2024-09-21T00:44:23.372 INFO:teuthology.orchestra.run.smithi193.stdout:(91/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-21T00:44:23.386 INFO:teuthology.orchestra.run.smithi042.stdout:(50/157): bison-3.7.4-5.el9.x86_64.rpm 1.3 MB/s | 943 kB 00:00 2024-09-21T00:44:23.397 INFO:teuthology.orchestra.run.smithi193.stdout:(92/157): python3-pyasn1-modules-0.4.8-6.el9.no 1.7 MB/s | 279 kB 00:00 2024-09-21T00:44:23.419 INFO:teuthology.orchestra.run.smithi001.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 2.2 MB/s | 269 kB 00:00 2024-09-21T00:44:23.444 INFO:teuthology.orchestra.run.smithi001.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-21T00:44:23.447 INFO:teuthology.orchestra.run.smithi193.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 832 kB/s | 42 kB 00:00 2024-09-21T00:44:23.469 INFO:teuthology.orchestra.run.smithi001.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.2 MB/s | 279 kB 00:00 2024-09-21T00:44:23.503 INFO:teuthology.orchestra.run.smithi042.stdout:(51/157): boost-program-options-1.75.0-8.el9.x8 251 kB/s | 107 kB 00:00 2024-09-21T00:44:23.514 INFO:teuthology.orchestra.run.smithi193.stdout:(94/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 7.3 MB/s | 5.1 MB 00:00 2024-09-21T00:44:23.519 INFO:teuthology.orchestra.run.smithi001.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 508 kB/s | 51 kB 00:00 2024-09-21T00:44:23.539 INFO:teuthology.orchestra.run.smithi193.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 481 kB/s | 44 kB 00:00 2024-09-21T00:44:23.545 INFO:teuthology.orchestra.run.smithi001.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 533 kB/s | 54 kB 00:00 2024-09-21T00:44:23.573 INFO:teuthology.orchestra.run.smithi193.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-21T00:44:23.578 INFO:teuthology.orchestra.run.smithi042.stdout:(52/157): elfutils-libelf-devel-0.191-4.el9.x86 84 kB/s | 22 kB 00:00 2024-09-21T00:44:23.599 INFO:teuthology.orchestra.run.smithi193.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 608 kB/s | 36 kB 00:00 2024-09-21T00:44:23.620 INFO:teuthology.orchestra.run.smithi001.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-09-21T00:44:23.624 INFO:teuthology.orchestra.run.smithi193.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 938 kB/s | 47 kB 00:00 2024-09-21T00:44:23.645 INFO:teuthology.orchestra.run.smithi001.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 442 kB/s | 44 kB 00:00 2024-09-21T00:44:23.683 INFO:teuthology.orchestra.run.smithi193.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 990 kB/s | 58 kB 00:00 2024-09-21T00:44:23.737 INFO:teuthology.orchestra.run.smithi001.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-09-21T00:44:23.741 INFO:teuthology.orchestra.run.smithi193.stdout:(100/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-21T00:44:23.754 INFO:teuthology.orchestra.run.smithi001.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 330 kB/s | 36 kB 00:00 2024-09-21T00:44:23.770 INFO:teuthology.orchestra.run.smithi042.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 122 kB/s | 33 kB 00:00 2024-09-21T00:44:23.775 INFO:teuthology.orchestra.run.smithi193.stdout:(101/157): socat-1.7.4.1-6.el9.x86_64.rpm 1.7 MB/s | 304 kB 00:00 2024-09-21T00:44:23.808 INFO:teuthology.orchestra.run.smithi193.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 949 kB/s | 64 kB 00:00 2024-09-21T00:44:23.834 INFO:teuthology.orchestra.run.smithi193.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 766 kB/s | 45 kB 00:00 2024-09-21T00:44:23.838 INFO:teuthology.orchestra.run.smithi001.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 474 kB/s | 47 kB 00:00 2024-09-21T00:44:23.871 INFO:teuthology.orchestra.run.smithi001.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.5 MB/s | 304 kB 00:00 2024-09-21T00:44:23.938 INFO:teuthology.orchestra.run.smithi001.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 576 kB/s | 58 kB 00:00 2024-09-21T00:44:23.970 INFO:teuthology.orchestra.run.smithi042.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 537 kB/s | 313 kB 00:00 2024-09-21T00:44:23.989 INFO:teuthology.orchestra.run.smithi001.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 820 kB/s | 96 kB 00:00 2024-09-21T00:44:24.029 INFO:teuthology.orchestra.run.smithi042.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 70 kB/s | 18 kB 00:00 2024-09-21T00:44:24.039 INFO:teuthology.orchestra.run.smithi001.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 635 kB/s | 64 kB 00:00 2024-09-21T00:44:24.106 INFO:teuthology.orchestra.run.smithi001.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 383 kB/s | 45 kB 00:00 2024-09-21T00:44:24.148 INFO:teuthology.orchestra.run.smithi001.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 206 kB/s | 22 kB 00:00 2024-09-21T00:44:24.154 INFO:teuthology.orchestra.run.smithi042.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 61 kB/s | 11 kB 00:00 2024-09-21T00:44:24.198 INFO:teuthology.orchestra.run.smithi001.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-21T00:44:24.240 INFO:teuthology.orchestra.run.smithi001.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 7.3 MB/s | 308 kB 00:00 2024-09-21T00:44:24.265 INFO:teuthology.orchestra.run.smithi001.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 776 kB/s | 19 kB 00:00 2024-09-21T00:44:24.376 INFO:teuthology.orchestra.run.smithi193.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 39 kB/s | 22 kB 00:00 2024-09-21T00:44:24.426 INFO:teuthology.orchestra.run.smithi193.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-21T00:44:24.454 INFO:teuthology.orchestra.run.smithi042.stdout:(57/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.4 MB/s | 3.0 MB 00:00 2024-09-21T00:44:24.457 INFO:teuthology.orchestra.run.smithi001.stdout:(108/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 16 MB/s | 16 MB 00:00 2024-09-21T00:44:24.459 INFO:teuthology.orchestra.run.smithi193.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-21T00:44:24.480 INFO:teuthology.orchestra.run.smithi042.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 379 kB/s | 171 kB 00:00 2024-09-21T00:44:24.485 INFO:teuthology.orchestra.run.smithi193.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 774 kB/s | 19 kB 00:00 2024-09-21T00:44:24.507 INFO:teuthology.orchestra.run.smithi001.stdout:(109/157): protobuf-compiler-3.14.0-13.el9.x86_ 2.1 MB/s | 863 kB 00:00 2024-09-21T00:44:24.549 INFO:teuthology.orchestra.run.smithi001.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 284 kB/s | 26 kB 00:00 2024-09-21T00:44:24.566 INFO:teuthology.orchestra.run.smithi001.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 4.6 MB/s | 67 kB 00:00 2024-09-21T00:44:24.591 INFO:teuthology.orchestra.run.smithi001.stdout:(112/157): liboath-2.6.7-2.el9.x86_64.rpm 595 kB/s | 49 kB 00:00 2024-09-21T00:44:24.594 INFO:teuthology.orchestra.run.smithi193.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-21T00:44:24.617 INFO:teuthology.orchestra.run.smithi001.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-21T00:44:24.619 INFO:teuthology.orchestra.run.smithi193.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T00:44:24.650 INFO:teuthology.orchestra.run.smithi001.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-21T00:44:24.654 INFO:teuthology.orchestra.run.smithi193.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-21T00:44:24.663 INFO:teuthology.orchestra.run.smithi042.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 315 kB/s | 160 kB 00:00 2024-09-21T00:44:24.676 INFO:teuthology.orchestra.run.smithi001.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T00:44:24.678 INFO:teuthology.orchestra.run.smithi193.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T00:44:24.701 INFO:teuthology.orchestra.run.smithi001.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T00:44:24.703 INFO:teuthology.orchestra.run.smithi193.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-21T00:44:24.726 INFO:teuthology.orchestra.run.smithi001.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 568 kB/s | 14 kB 00:00 2024-09-21T00:44:24.745 INFO:teuthology.orchestra.run.smithi193.stdout:(113/157): protobuf-compiler-3.14.0-13.el9.x86_ 947 kB/s | 863 kB 00:00 2024-09-21T00:44:24.787 INFO:teuthology.orchestra.run.smithi193.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.8 MB/s | 839 kB 00:00 2024-09-21T00:44:24.797 INFO:teuthology.orchestra.run.smithi042.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 132 kB/s | 45 kB 00:00 2024-09-21T00:44:24.801 INFO:teuthology.orchestra.run.smithi001.stdout:(118/157): libarrow-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 4.4 MB 00:00 2024-09-21T00:44:24.804 INFO:teuthology.orchestra.run.smithi193.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.8 MB/s | 43 kB 00:00 2024-09-21T00:44:24.821 INFO:teuthology.orchestra.run.smithi193.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-21T00:44:24.827 INFO:teuthology.orchestra.run.smithi001.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 1.7 MB/s | 172 kB 00:00 2024-09-21T00:44:24.838 INFO:teuthology.orchestra.run.smithi193.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 852 kB/s | 14 kB 00:00 2024-09-21T00:44:24.861 INFO:teuthology.orchestra.run.smithi001.stdout:(120/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.0 MB/s | 839 kB 00:00 2024-09-21T00:44:24.871 INFO:teuthology.orchestra.run.smithi193.stdout:(118/157): python3-asyncssh-2.13.2-5.el9.noarch 4.2 MB/s | 548 kB 00:00 2024-09-21T00:44:24.894 INFO:teuthology.orchestra.run.smithi001.stdout:(121/157): python3-google-auth-2.34.0-1.el9.noa 6.5 MB/s | 220 kB 00:00 2024-09-21T00:44:24.897 INFO:teuthology.orchestra.run.smithi193.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-21T00:44:24.919 INFO:teuthology.orchestra.run.smithi001.stdout:(122/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.2 MB/s | 303 kB 00:00 2024-09-21T00:44:24.922 INFO:teuthology.orchestra.run.smithi193.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-21T00:44:24.944 INFO:teuthology.orchestra.run.smithi001.stdout:(123/157): python3-cherrypy-18.6.1-2.el9.noarch 2.5 MB/s | 358 kB 00:00 2024-09-21T00:44:24.956 INFO:teuthology.orchestra.run.smithi193.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-21T00:44:24.970 INFO:teuthology.orchestra.run.smithi001.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-21T00:44:24.981 INFO:teuthology.orchestra.run.smithi193.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-21T00:44:24.995 INFO:teuthology.orchestra.run.smithi001.stdout:(125/157): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-09-21T00:44:25.012 INFO:teuthology.orchestra.run.smithi001.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 421 kB/s | 18 kB 00:00 2024-09-21T00:44:25.015 INFO:teuthology.orchestra.run.smithi193.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-21T00:44:25.029 INFO:teuthology.orchestra.run.smithi001.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 689 kB/s | 23 kB 00:00 2024-09-21T00:44:25.040 INFO:teuthology.orchestra.run.smithi193.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 426 kB/s | 11 kB 00:00 2024-09-21T00:44:25.046 INFO:teuthology.orchestra.run.smithi001.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 579 kB/s | 19 kB 00:00 2024-09-21T00:44:25.063 INFO:teuthology.orchestra.run.smithi001.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 589 kB/s | 20 kB 00:00 2024-09-21T00:44:25.065 INFO:teuthology.orchestra.run.smithi193.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 696 kB/s | 18 kB 00:00 2024-09-21T00:44:25.072 INFO:teuthology.orchestra.run.smithi042.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 89 kB/s | 24 kB 00:00 2024-09-21T00:44:25.080 INFO:teuthology.orchestra.run.smithi001.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-21T00:44:25.091 INFO:teuthology.orchestra.run.smithi193.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 924 kB/s | 23 kB 00:00 2024-09-21T00:44:25.105 INFO:teuthology.orchestra.run.smithi001.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T00:44:25.105 INFO:teuthology.orchestra.run.smithi042.stdout:(62/157): librdkafka-1.6.1-102.el9.x86_64.rpm 1.0 MB/s | 662 kB 00:00 2024-09-21T00:44:25.116 INFO:teuthology.orchestra.run.smithi193.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 781 kB/s | 19 kB 00:00 2024-09-21T00:44:25.130 INFO:teuthology.orchestra.run.smithi001.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T00:44:25.158 INFO:teuthology.orchestra.run.smithi193.stdout:(128/157): python3-grpcio-1.46.7-10.el9.x86_64. 10 MB/s | 2.0 MB 00:00 2024-09-21T00:44:25.164 INFO:teuthology.orchestra.run.smithi001.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-21T00:44:25.183 INFO:teuthology.orchestra.run.smithi193.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 292 kB/s | 20 kB 00:00 2024-09-21T00:44:25.189 INFO:teuthology.orchestra.run.smithi001.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 656 kB/s | 16 kB 00:00 2024-09-21T00:44:25.209 INFO:teuthology.orchestra.run.smithi193.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T00:44:25.231 INFO:teuthology.orchestra.run.smithi001.stdout:(135/157): python3-kubernetes-26.1.0-2.el9.noar 5.5 MB/s | 1.0 MB 00:00 2024-09-21T00:44:25.234 INFO:teuthology.orchestra.run.smithi193.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T00:44:25.256 INFO:teuthology.orchestra.run.smithi001.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-09-21T00:44:25.259 INFO:teuthology.orchestra.run.smithi193.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T00:44:25.265 INFO:teuthology.orchestra.run.smithi042.stdout:(63/157): libtool-2.4.6-46.el9.x86_64.rpm 967 kB/s | 581 kB 00:00 2024-09-21T00:44:25.282 INFO:teuthology.orchestra.run.smithi001.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-09-21T00:44:25.293 INFO:teuthology.orchestra.run.smithi193.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-09-21T00:44:25.307 INFO:teuthology.orchestra.run.smithi001.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-21T00:44:25.318 INFO:teuthology.orchestra.run.smithi193.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 661 kB/s | 16 kB 00:00 2024-09-21T00:44:25.332 INFO:teuthology.orchestra.run.smithi001.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T00:44:25.344 INFO:teuthology.orchestra.run.smithi193.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-21T00:44:25.357 INFO:teuthology.orchestra.run.smithi001.stdout:(140/157): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-21T00:44:25.369 INFO:teuthology.orchestra.run.smithi193.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-21T00:44:25.383 INFO:teuthology.orchestra.run.smithi001.stdout:(141/157): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-21T00:44:25.394 INFO:teuthology.orchestra.run.smithi193.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 561 kB/s | 28 kB 00:00 2024-09-21T00:44:25.408 INFO:teuthology.orchestra.run.smithi001.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-21T00:44:25.419 INFO:teuthology.orchestra.run.smithi193.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 610 kB/s | 31 kB 00:00 2024-09-21T00:44:25.423 INFO:teuthology.orchestra.run.smithi042.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 135 kB/s | 47 kB 00:00 2024-09-21T00:44:25.433 INFO:teuthology.orchestra.run.smithi001.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T00:44:25.445 INFO:teuthology.orchestra.run.smithi193.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T00:44:25.459 INFO:teuthology.orchestra.run.smithi001.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-21T00:44:25.470 INFO:teuthology.orchestra.run.smithi193.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-21T00:44:25.484 INFO:teuthology.orchestra.run.smithi001.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 800 kB/s | 20 kB 00:00 2024-09-21T00:44:25.495 INFO:teuthology.orchestra.run.smithi193.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-21T00:44:25.521 INFO:teuthology.orchestra.run.smithi193.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-21T00:44:25.526 INFO:teuthology.orchestra.run.smithi001.stdout:(146/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.2 MB/s | 2.0 MB 00:00 2024-09-21T00:44:25.546 INFO:teuthology.orchestra.run.smithi193.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T00:44:25.551 INFO:teuthology.orchestra.run.smithi001.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-21T00:44:25.571 INFO:teuthology.orchestra.run.smithi193.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-21T00:44:25.577 INFO:teuthology.orchestra.run.smithi001.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-21T00:44:25.597 INFO:teuthology.orchestra.run.smithi193.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 798 kB/s | 20 kB 00:00 2024-09-21T00:44:25.615 INFO:teuthology.orchestra.run.smithi042.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 574 kB/s | 292 kB 00:00 2024-09-21T00:44:25.622 INFO:teuthology.orchestra.run.smithi193.stdout:(146/157): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-09-21T00:44:25.627 INFO:teuthology.orchestra.run.smithi001.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T00:44:25.647 INFO:teuthology.orchestra.run.smithi193.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T00:44:25.698 INFO:teuthology.orchestra.run.smithi042.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 140 kB/s | 38 kB 00:00 2024-09-21T00:44:25.732 INFO:teuthology.orchestra.run.smithi042.stdout:(67/157): lua-5.4.4-4.el9.x86_64.rpm 403 kB/s | 188 kB 00:00 2024-09-21T00:44:25.814 INFO:teuthology.orchestra.run.smithi193.stdout:(148/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.7 MB/s | 16 MB 00:02 2024-09-21T00:44:25.819 INFO:teuthology.orchestra.run.smithi001.stdout:(150/157): NetworkManager-1.51.0-1.el9.x86_64.r 13 MB/s | 2.3 MB 00:00 2024-09-21T00:44:25.864 INFO:teuthology.orchestra.run.smithi193.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 6.5 MB/s | 1.6 MB 00:00 2024-09-21T00:44:25.869 INFO:teuthology.orchestra.run.smithi001.stdout:(151/157): librados2-19.3.0-5120.g18432218.el9. 11 MB/s | 3.4 MB 00:00 2024-09-21T00:44:25.920 INFO:teuthology.orchestra.run.smithi001.stdout:(152/157): NetworkManager-libnm-1.51.0-1.el9.x8 18 MB/s | 1.8 MB 00:00 2024-09-21T00:44:25.945 INFO:teuthology.orchestra.run.smithi001.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 543 kB/s | 41 kB 00:00 2024-09-21T00:44:25.970 INFO:teuthology.orchestra.run.smithi001.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 4.9 MB/s | 249 kB 00:00 2024-09-21T00:44:26.032 INFO:teuthology.orchestra.run.smithi193.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 8.8 MB/s | 3.4 MB 00:00 2024-09-21T00:44:26.045 INFO:teuthology.orchestra.run.smithi001.stdout:(155/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 32 MB/s | 2.4 MB 00:00 2024-09-21T00:44:26.082 INFO:teuthology.orchestra.run.smithi193.stdout:(151/157): NetworkManager-1.51.0-1.el9.x86_64.r 11 MB/s | 2.3 MB 00:00 2024-09-21T00:44:26.104 INFO:teuthology.orchestra.run.smithi001.stdout:(156/157): librbd1-19.3.0-5120.g18432218.el9.x8 6.0 MB/s | 3.2 MB 00:00 2024-09-21T00:44:26.124 INFO:teuthology.orchestra.run.smithi193.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 974 kB/s | 41 kB 00:00 2024-09-21T00:44:26.162 INFO:teuthology.orchestra.run.smithi001.stdout:(157/157): openssl-3.2.2-6.el9.x86_64.rpm 6.2 MB/s | 1.4 MB 00:00 2024-09-21T00:44:26.166 INFO:teuthology.orchestra.run.smithi193.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 5.8 MB/s | 249 kB 00:00 2024-09-21T00:44:26.168 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:44:26.168 INFO:teuthology.orchestra.run.smithi001.stdout:Total 18 MB/s | 228 MB 00:12 2024-09-21T00:44:26.225 INFO:teuthology.orchestra.run.smithi193.stdout:(154/157): librbd1-19.3.0-5120.g18432218.el9.x8 7.7 MB/s | 3.2 MB 00:00 2024-09-21T00:44:26.318 INFO:teuthology.orchestra.run.smithi193.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 8.9 MB/s | 1.4 MB 00:00 2024-09-21T00:44:26.359 INFO:teuthology.orchestra.run.smithi193.stdout:(156/157): NetworkManager-libnm-1.51.0-1.el9.x8 5.5 MB/s | 1.8 MB 00:00 2024-09-21T00:44:26.499 INFO:teuthology.orchestra.run.smithi042.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 5.6 MB/s | 4.9 MB 00:00 2024-09-21T00:44:26.517 INFO:teuthology.orchestra.run.smithi193.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 8.2 MB/s | 2.4 MB 00:00 2024-09-21T00:44:26.523 INFO:teuthology.orchestra.run.smithi193.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:44:26.523 INFO:teuthology.orchestra.run.smithi193.stdout:Total 17 MB/s | 228 MB 00:13 2024-09-21T00:44:26.541 INFO:teuthology.orchestra.run.smithi042.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 2.0 MB/s | 1.6 MB 00:00 2024-09-21T00:44:26.749 INFO:teuthology.orchestra.run.smithi042.stdout:(70/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.2 MB/s | 4.4 MB 00:01 2024-09-21T00:44:26.983 INFO:teuthology.orchestra.run.smithi042.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 311 kB/s | 137 kB 00:00 2024-09-21T00:44:27.175 INFO:teuthology.orchestra.run.smithi042.stdout:(72/157): postgresql-contrib-13.16-1.el9.x86_64 1.3 MB/s | 910 kB 00:00 2024-09-21T00:44:27.431 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction check 2024-09-21T00:44:27.526 INFO:teuthology.orchestra.run.smithi042.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 250 kB/s | 87 kB 00:00 2024-09-21T00:44:27.602 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction check succeeded. 2024-09-21T00:44:27.602 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction test 2024-09-21T00:44:27.693 INFO:teuthology.orchestra.run.smithi042.stdout:(74/157): postgresql-server-13.16-1.el9.x86_64. 6.1 MB/s | 5.8 MB 00:00 2024-09-21T00:44:27.768 INFO:teuthology.orchestra.run.smithi042.stdout:(75/157): protobuf-3.14.0-13.el9.x86_64.rpm 1.3 MB/s | 1.0 MB 00:00 2024-09-21T00:44:27.787 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction check 2024-09-21T00:44:27.940 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction check succeeded. 2024-09-21T00:44:27.941 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction test 2024-09-21T00:44:28.052 INFO:teuthology.orchestra.run.smithi042.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 171 kB/s | 61 kB 00:00 2024-09-21T00:44:28.285 INFO:teuthology.orchestra.run.smithi042.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 474 kB/s | 245 kB 00:00 2024-09-21T00:44:28.577 INFO:teuthology.orchestra.run.smithi042.stdout:(78/157): python3-babel-2.9.1-2.el9.noarch.rpm 5.7 MB/s | 6.0 MB 00:01 2024-09-21T00:44:28.602 INFO:teuthology.orchestra.run.smithi042.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 81 kB/s | 26 kB 00:00 2024-09-21T00:44:28.627 INFO:teuthology.orchestra.run.smithi042.stdout:(80/157): python3-jinja2-2.11.3-6.el9.noarch.rp 431 kB/s | 248 kB 00:00 2024-09-21T00:44:28.853 INFO:teuthology.orchestra.run.smithi042.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 70 kB/s | 19 kB 00:00 2024-09-21T00:44:28.903 INFO:teuthology.orchestra.run.smithi042.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 126 kB/s | 35 kB 00:00 2024-09-21T00:44:29.137 INFO:teuthology.orchestra.run.smithi042.stdout:(83/157): python3-mako-1.1.4-6.el9.noarch.rpm 322 kB/s | 172 kB 00:00 2024-09-21T00:44:29.437 INFO:teuthology.orchestra.run.smithi042.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 469 kB/s | 250 kB 00:00 2024-09-21T00:44:29.662 INFO:teuthology.orchestra.run.smithi042.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 423 kB/s | 222 kB 00:00 2024-09-21T00:44:29.746 INFO:teuthology.orchestra.run.smithi042.stdout:(86/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.7 MB/s | 5.1 MB 00:00 2024-09-21T00:44:29.761 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction test succeeded. 2024-09-21T00:44:29.762 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction 2024-09-21T00:44:29.854 INFO:teuthology.orchestra.run.smithi042.stdout:(87/157): python3-packaging-20.9-5.el9.noarch.r 185 kB/s | 77 kB 00:00 2024-09-21T00:44:29.939 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction test succeeded. 2024-09-21T00:44:29.939 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction 2024-09-21T00:44:30.005 INFO:teuthology.orchestra.run.smithi042.stdout:(88/157): python3-prettytable-0.7.2-27.el9.noar 123 kB/s | 42 kB 00:00 2024-09-21T00:44:30.280 INFO:teuthology.orchestra.run.smithi042.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 373 kB/s | 159 kB 00:00 2024-09-21T00:44:30.305 INFO:teuthology.orchestra.run.smithi042.stdout:(90/157): python3-protobuf-3.14.0-13.el9.noarch 482 kB/s | 269 kB 00:00 2024-09-21T00:44:30.597 INFO:teuthology.orchestra.run.smithi042.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 471 kB/s | 279 kB 00:00 2024-09-21T00:44:30.622 INFO:teuthology.orchestra.run.smithi042.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 149 kB/s | 51 kB 00:00 2024-09-21T00:44:30.647 INFO:teuthology.orchestra.run.smithi042.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 157 kB/s | 54 kB 00:00 2024-09-21T00:44:30.898 INFO:teuthology.orchestra.run.smithi042.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 151 kB/s | 42 kB 00:00 2024-09-21T00:44:30.990 INFO:teuthology.orchestra.run.smithi042.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 129 kB/s | 44 kB 00:00 2024-09-21T00:44:31.257 INFO:teuthology.orchestra.run.smithi042.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 134 kB/s | 36 kB 00:00 2024-09-21T00:44:31.407 INFO:teuthology.orchestra.run.smithi042.stdout:(97/157): qatlib-24.02.0-1.el9.x86_64.rpm 434 kB/s | 221 kB 00:00 2024-09-21T00:44:31.599 INFO:teuthology.orchestra.run.smithi042.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 139 kB/s | 47 kB 00:00 2024-09-21T00:44:31.932 INFO:teuthology.orchestra.run.smithi042.stdout:(99/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 12 MB/s | 16 MB 00:01 2024-09-21T00:44:31.966 INFO:teuthology.orchestra.run.smithi042.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 157 kB/s | 58 kB 00:00 2024-09-21T00:44:32.050 INFO:teuthology.orchestra.run.smithi042.stdout:(101/157): socat-1.7.4.1-6.el9.x86_64.rpm 473 kB/s | 304 kB 00:00 2024-09-21T00:44:32.333 INFO:teuthology.orchestra.run.smithi042.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 173 kB/s | 64 kB 00:00 2024-09-21T00:44:32.478 INFO:teuthology.orchestra.run.smithi042.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 105 kB/s | 45 kB 00:00 2024-09-21T00:44:32.697 INFO:teuthology.orchestra.run.smithi042.stdout:(104/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 125 kB/s | 96 kB 00:00 2024-09-21T00:44:32.718 INFO:teuthology.orchestra.run.smithi042.stdout:(105/157): lua-devel-5.4.4-4.el9.x86_64.rpm 58 kB/s | 22 kB 00:00 2024-09-21T00:44:32.776 INFO:teuthology.orchestra.run.smithi042.stdout:(106/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-21T00:44:32.801 INFO:teuthology.orchestra.run.smithi042.stdout:(107/157): gperftools-libs-2.9.1-3.el9.x86_64.r 3.6 MB/s | 308 kB 00:00 2024-09-21T00:44:32.818 INFO:teuthology.orchestra.run.smithi042.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 465 kB/s | 19 kB 00:00 2024-09-21T00:44:32.835 INFO:teuthology.orchestra.run.smithi042.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-09-21T00:44:32.852 INFO:teuthology.orchestra.run.smithi042.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 2.9 MB/s | 49 kB 00:00 2024-09-21T00:44:32.877 INFO:teuthology.orchestra.run.smithi042.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T00:44:32.919 INFO:teuthology.orchestra.run.smithi042.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 3.5 MB/s | 151 kB 00:00 2024-09-21T00:44:32.961 INFO:teuthology.orchestra.run.smithi042.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-21T00:44:33.004 INFO:teuthology.orchestra.run.smithi042.stdout:(114/157): protobuf-compiler-3.14.0-13.el9.x86_ 1.6 MB/s | 863 kB 00:00 2024-09-21T00:44:33.054 INFO:teuthology.orchestra.run.smithi042.stdout:(115/157): python3-asyncssh-2.13.2-5.el9.noarch 5.8 MB/s | 548 kB 00:00 2024-09-21T00:44:33.079 INFO:teuthology.orchestra.run.smithi042.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.4 MB/s | 32 kB 00:00 2024-09-21T00:44:33.104 INFO:teuthology.orchestra.run.smithi042.stdout:(117/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 434 kB/s | 43 kB 00:00 2024-09-21T00:44:33.129 INFO:teuthology.orchestra.run.smithi042.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-21T00:44:33.172 INFO:teuthology.orchestra.run.smithi042.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-09-21T00:44:33.197 INFO:teuthology.orchestra.run.smithi042.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-21T00:44:33.230 INFO:teuthology.orchestra.run.smithi042.stdout:(121/157): python3-google-auth-2.34.0-1.el9.noa 6.5 MB/s | 220 kB 00:00 2024-09-21T00:44:33.256 INFO:teuthology.orchestra.run.smithi042.stdout:(122/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.5 MB/s | 303 kB 00:00 2024-09-21T00:44:33.289 INFO:teuthology.orchestra.run.smithi042.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-21T00:44:33.315 INFO:teuthology.orchestra.run.smithi042.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-21T00:44:33.340 INFO:teuthology.orchestra.run.smithi042.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 707 kB/s | 18 kB 00:00 2024-09-21T00:44:33.365 INFO:teuthology.orchestra.run.smithi042.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 936 kB/s | 23 kB 00:00 2024-09-21T00:44:33.390 INFO:teuthology.orchestra.run.smithi042.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 779 kB/s | 19 kB 00:00 2024-09-21T00:44:33.416 INFO:teuthology.orchestra.run.smithi042.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 787 kB/s | 20 kB 00:00 2024-09-21T00:44:33.499 INFO:teuthology.orchestra.run.smithi042.stdout:(129/157): libarrow-9.0.0-11.el9.x86_64.rpm 6.3 MB/s | 4.4 MB 00:00 2024-09-21T00:44:33.525 INFO:teuthology.orchestra.run.smithi042.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T00:44:33.550 INFO:teuthology.orchestra.run.smithi042.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T00:44:33.575 INFO:teuthology.orchestra.run.smithi042.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T00:44:33.609 INFO:teuthology.orchestra.run.smithi042.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-21T00:44:33.634 INFO:teuthology.orchestra.run.smithi042.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 657 kB/s | 16 kB 00:00 2024-09-21T00:44:33.676 INFO:teuthology.orchestra.run.smithi042.stdout:(135/157): python3-grpcio-1.46.7-10.el9.x86_64. 4.6 MB/s | 2.0 MB 00:00 2024-09-21T00:44:33.710 INFO:teuthology.orchestra.run.smithi042.stdout:(136/157): python3-kubernetes-26.1.0-2.el9.noar 3.5 MB/s | 1.0 MB 00:00 2024-09-21T00:44:33.735 INFO:teuthology.orchestra.run.smithi042.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 482 kB/s | 28 kB 00:00 2024-09-21T00:44:33.760 INFO:teuthology.orchestra.run.smithi042.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-21T00:44:33.786 INFO:teuthology.orchestra.run.smithi042.stdout:(139/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 596 kB/s | 90 kB 00:00 2024-09-21T00:44:33.811 INFO:teuthology.orchestra.run.smithi042.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-21T00:44:33.828 INFO:teuthology.orchestra.run.smithi042.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 854 kB/s | 36 kB 00:00 2024-09-21T00:44:33.862 INFO:teuthology.orchestra.run.smithi042.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-21T00:44:33.887 INFO:teuthology.orchestra.run.smithi042.stdout:(143/157): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-21T00:44:33.912 INFO:teuthology.orchestra.run.smithi042.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-21T00:44:33.929 INFO:teuthology.orchestra.run.smithi042.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-21T00:44:33.954 INFO:teuthology.orchestra.run.smithi042.stdout:(146/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-21T00:44:33.979 INFO:teuthology.orchestra.run.smithi042.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T00:44:34.029 INFO:teuthology.orchestra.run.smithi042.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-21T00:44:34.080 INFO:teuthology.orchestra.run.smithi042.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-21T00:44:34.272 INFO:teuthology.orchestra.run.smithi042.stdout:(150/157): NetworkManager-1.51.0-1.el9.x86_64.r 12 MB/s | 2.3 MB 00:00 2024-09-21T00:44:34.339 INFO:teuthology.orchestra.run.smithi042.stdout:(151/157): librados2-19.3.0-5120.g18432218.el9. 9.4 MB/s | 3.4 MB 00:00 2024-09-21T00:44:34.390 INFO:teuthology.orchestra.run.smithi042.stdout:(152/157): NetworkManager-libnm-1.51.0-1.el9.x8 16 MB/s | 1.8 MB 00:00 2024-09-21T00:44:34.415 INFO:teuthology.orchestra.run.smithi042.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 544 kB/s | 41 kB 00:00 2024-09-21T00:44:34.440 INFO:teuthology.orchestra.run.smithi042.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 4.9 MB/s | 249 kB 00:00 2024-09-21T00:44:34.515 INFO:teuthology.orchestra.run.smithi042.stdout:(155/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 32 MB/s | 2.4 MB 00:00 2024-09-21T00:44:34.582 INFO:teuthology.orchestra.run.smithi042.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 8.1 MB/s | 1.4 MB 00:00 2024-09-21T00:44:34.774 INFO:teuthology.orchestra.run.smithi042.stdout:(157/157): librbd1-19.3.0-5120.g18432218.el9.x8 4.3 MB/s | 3.2 MB 00:00 2024-09-21T00:44:34.780 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:44:34.780 INFO:teuthology.orchestra.run.smithi042.stdout:Total 11 MB/s | 228 MB 00:20 2024-09-21T00:44:36.045 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-09-21T00:44:36.213 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-09-21T00:44:36.213 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-09-21T00:44:36.225 INFO:teuthology.orchestra.run.smithi193.stdout: Preparing : 1/1 2024-09-21T00:44:36.321 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T00:44:36.359 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T00:44:36.420 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T00:44:36.455 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T00:44:36.480 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T00:44:36.523 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T00:44:36.678 INFO:teuthology.orchestra.run.smithi001.stdout: Preparing : 1/1 2024-09-21T00:44:36.775 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T00:44:36.814 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T00:44:36.863 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T00:44:36.885 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T00:44:36.926 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T00:44:36.951 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T00:44:36.990 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T00:44:37.011 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T00:44:37.107 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T00:44:37.132 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T00:44:37.208 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T00:44:37.237 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T00:44:37.266 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T00:44:37.381 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T00:44:37.427 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T00:44:37.485 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T00:44:37.493 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T00:44:37.513 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T00:44:37.619 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T00:44:37.623 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T00:44:37.648 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T00:44:37.653 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T00:44:37.710 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T00:44:37.733 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T00:44:37.746 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T00:44:37.752 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T00:44:37.775 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T00:44:37.813 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T00:44:37.899 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T00:44:37.995 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T00:44:38.045 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T00:44:38.047 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T00:44:38.074 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T00:44:38.127 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-09-21T00:44:38.127 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-09-21T00:44:38.147 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T00:44:38.183 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T00:44:38.209 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T00:44:38.243 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T00:44:38.275 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T00:44:38.302 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T00:44:38.315 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T00:44:38.323 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T00:44:38.528 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T00:44:38.545 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T00:44:38.637 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T00:44:38.669 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T00:44:38.704 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T00:44:38.739 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T00:44:38.768 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T00:44:38.813 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T00:44:38.845 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T00:44:38.859 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T00:44:38.893 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T00:44:38.925 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T00:44:38.953 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T00:44:38.970 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T00:44:39.013 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T00:44:39.043 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T00:44:39.067 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T00:44:39.106 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T00:44:39.141 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T00:44:39.227 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T00:44:39.261 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T00:44:39.285 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T00:44:39.305 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T00:44:39.333 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T00:44:39.394 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T00:44:39.404 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T00:44:39.422 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T00:44:39.449 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T00:44:39.449 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T00:44:39.525 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T00:44:39.531 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T00:44:39.575 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T00:44:39.615 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T00:44:39.659 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T00:44:39.670 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T00:44:39.692 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T00:44:39.719 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T00:44:39.726 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T00:44:39.790 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T00:44:39.842 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T00:44:39.881 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T00:44:39.925 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T00:44:40.007 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T00:44:40.043 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T00:44:40.087 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T00:44:40.115 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T00:44:40.188 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T00:44:40.238 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T00:44:40.270 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T00:44:40.315 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T00:44:40.355 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T00:44:40.384 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T00:44:40.427 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T00:44:40.460 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T00:44:40.465 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T00:44:40.507 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T00:44:40.516 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T00:44:40.665 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T00:44:40.727 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T00:44:40.817 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T00:44:40.878 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T00:44:40.952 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T00:44:40.983 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T00:44:41.019 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T00:44:41.065 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T00:44:41.074 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T00:44:41.102 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T00:44:41.144 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T00:44:41.163 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T00:44:41.187 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T00:44:41.206 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T00:44:41.250 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T00:44:41.287 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T00:44:41.322 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T00:44:41.330 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T00:44:41.364 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T00:44:41.405 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T00:44:41.493 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T00:44:41.506 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T00:44:41.539 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T00:44:41.549 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T00:44:41.579 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T00:44:41.605 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T00:44:41.643 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T00:44:41.680 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T00:44:41.714 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T00:44:41.788 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T00:44:41.825 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T00:44:41.861 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T00:44:41.909 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T00:44:41.944 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T00:44:41.958 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T00:44:41.988 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T00:44:42.038 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T00:44:42.098 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T00:44:42.146 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T00:44:42.173 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T00:44:42.183 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T00:44:42.208 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T00:44:42.223 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T00:44:42.247 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T00:44:42.264 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T00:44:42.278 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T00:44:42.308 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T00:44:42.343 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T00:44:42.373 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T00:44:42.376 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T00:44:42.418 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T00:44:42.452 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T00:44:42.538 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T00:44:42.582 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T00:44:42.614 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T00:44:42.638 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T00:44:42.689 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T00:44:42.719 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T00:44:42.729 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T00:44:42.754 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T00:44:42.767 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T00:44:42.860 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T00:44:42.990 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T00:44:43.031 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T00:44:43.060 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T00:44:43.094 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T00:44:43.133 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T00:44:43.173 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T00:44:43.202 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T00:44:43.237 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T00:44:43.270 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T00:44:43.312 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T00:44:43.346 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T00:44:43.436 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T00:44:43.480 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T00:44:43.485 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T00:44:43.516 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T00:44:43.531 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T00:44:43.556 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T00:44:43.624 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T00:44:43.655 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T00:44:43.677 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T00:44:43.712 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T00:44:43.757 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T00:44:43.844 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T00:44:43.876 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T00:44:44.061 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T00:44:44.091 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T00:44:44.168 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T00:44:44.443 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T00:44:44.497 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T00:44:44.531 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T00:44:44.608 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-09-21T00:44:44.633 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T00:44:44.687 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T00:44:44.711 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T00:44:44.741 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T00:44:44.751 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T00:44:44.804 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T00:44:44.811 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T00:44:44.831 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T00:44:44.846 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T00:44:44.871 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T00:44:44.874 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T00:44:44.914 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T00:44:44.931 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T00:44:45.060 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T00:44:45.090 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T00:44:45.170 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T00:44:45.273 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T00:44:45.406 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T00:44:45.777 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T00:44:45.806 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T00:44:45.872 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T00:44:45.882 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T00:44:45.940 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T00:44:45.974 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T00:44:46.001 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T00:44:46.140 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T00:44:46.154 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T00:44:46.209 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T00:44:46.229 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T00:44:46.236 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T00:44:46.257 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T00:44:46.290 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T00:44:46.327 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T00:44:46.354 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T00:44:46.416 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T00:44:46.438 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T00:44:46.464 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T00:44:46.606 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T00:44:46.618 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T00:44:46.661 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T00:44:46.749 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T00:44:46.753 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T00:44:46.783 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T00:44:46.819 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T00:44:46.911 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T00:44:47.003 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T00:44:47.079 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T00:44:47.307 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T00:44:47.327 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T00:44:47.335 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T00:44:47.365 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T00:44:47.410 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T00:44:47.415 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T00:44:47.436 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T00:44:47.437 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T00:44:47.438 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T00:44:47.466 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T00:44:47.471 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T00:44:47.481 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T00:44:47.557 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T00:44:47.608 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T00:44:47.647 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T00:44:47.690 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T00:44:47.723 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T00:44:47.751 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T00:44:47.814 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T00:44:47.822 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T00:44:47.867 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T00:44:47.899 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T00:44:47.928 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T00:44:47.959 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T00:44:47.964 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T00:44:47.988 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T00:44:48.025 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T00:44:48.048 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T00:44:48.083 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T00:44:48.127 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T00:44:48.155 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T00:44:48.228 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T00:44:48.279 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T00:44:48.364 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T00:44:48.509 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T00:44:48.554 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T00:44:48.564 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T00:44:48.578 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T00:44:48.658 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T00:44:48.688 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T00:44:49.120 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T00:44:49.211 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T00:44:49.247 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T00:44:49.290 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T00:44:49.328 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T00:44:49.370 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T00:44:49.523 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T00:44:49.582 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T00:44:49.684 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T00:44:49.755 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T00:44:49.829 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T00:44:49.867 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T00:44:49.912 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T00:44:49.959 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T00:44:49.994 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T00:44:50.038 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T00:44:50.082 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T00:44:50.088 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T00:44:50.113 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T00:44:50.231 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T00:44:50.273 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T00:44:50.315 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T00:44:50.422 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T00:44:50.455 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T00:44:50.496 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T00:44:50.537 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T00:44:50.571 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T00:44:50.649 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T00:44:50.687 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T00:44:50.725 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T00:44:50.786 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T00:44:50.809 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T00:44:50.809 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T00:44:50.809 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T00:44:50.809 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-21T00:44:50.827 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T00:44:50.852 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T00:44:50.856 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T00:44:50.890 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T00:44:50.930 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T00:44:50.969 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T00:44:51.002 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T00:44:51.035 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T00:44:51.069 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T00:44:51.073 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T00:44:51.109 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T00:44:51.111 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T00:44:51.153 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T00:44:51.251 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T00:44:51.309 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T00:44:51.340 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T00:44:51.447 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T00:44:51.500 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T00:44:51.736 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T00:44:51.887 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T00:44:51.973 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T00:44:51.974 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T00:44:51.974 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T00:44:51.974 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:44:52.031 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T00:44:52.295 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T00:44:52.338 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T00:44:52.415 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T00:44:52.523 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T00:44:52.569 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T00:44:52.622 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T00:44:52.712 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T00:44:52.765 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T00:44:52.947 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T00:44:52.988 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T00:44:53.067 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T00:44:53.750 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T00:44:53.873 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T00:44:55.178 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T00:44:55.275 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T00:44:55.303 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T00:44:55.336 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T00:44:55.688 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T00:44:55.740 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T00:44:55.816 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T00:44:55.845 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T00:44:55.881 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T00:44:56.408 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T00:44:56.435 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T00:44:56.497 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T00:44:56.519 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T00:44:58.855 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T00:44:58.883 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T00:44:59.484 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T00:44:59.519 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T00:44:59.611 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T00:44:59.611 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T00:44:59.612 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T00:44:59.612 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T00:44:59.646 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T00:45:02.643 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T00:45:02.644 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /sys 2024-09-21T00:45:02.644 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /proc 2024-09-21T00:45:02.644 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /mnt 2024-09-21T00:45:02.644 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /var/tmp 2024-09-21T00:45:02.644 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /home 2024-09-21T00:45:02.644 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /root 2024-09-21T00:45:02.644 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /tmp 2024-09-21T00:45:02.644 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-21T00:45:02.841 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T00:45:02.857 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T00:45:02.857 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:02.857 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T00:45:02.857 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-21T00:45:04.284 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T00:45:04.284 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /sys 2024-09-21T00:45:04.284 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /proc 2024-09-21T00:45:04.284 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /mnt 2024-09-21T00:45:04.285 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /var/tmp 2024-09-21T00:45:04.285 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /home 2024-09-21T00:45:04.285 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /root 2024-09-21T00:45:04.285 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /tmp 2024-09-21T00:45:04.285 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:45:04.452 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T00:45:04.464 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T00:45:04.480 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T00:45:04.480 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:04.481 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T00:45:04.481 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T00:45:04.481 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T00:45:04.481 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-21T00:45:04.484 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T00:45:04.484 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:04.484 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T00:45:04.484 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:45:04.703 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T00:45:04.727 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T00:45:04.727 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:04.727 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T00:45:04.727 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T00:45:04.727 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T00:45:04.727 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-21T00:45:05.195 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T00:45:05.219 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T00:45:05.220 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:05.220 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T00:45:05.220 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T00:45:05.220 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T00:45:05.220 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-21T00:45:05.326 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T00:45:05.382 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T00:45:05.437 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T00:45:05.630 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T00:45:05.680 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T00:45:05.758 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T00:45:05.846 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T00:45:05.987 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T00:45:06.022 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T00:45:06.053 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T00:45:06.082 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T00:45:06.138 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T00:45:06.166 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T00:45:06.167 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:06.167 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T00:45:06.167 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T00:45:06.167 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T00:45:06.167 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:45:06.405 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T00:45:06.430 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T00:45:06.430 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:06.431 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T00:45:06.431 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T00:45:06.431 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T00:45:06.431 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:45:06.541 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T00:45:06.572 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T00:45:06.604 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T00:45:06.671 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T00:45:06.695 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T00:45:06.923 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T00:45:06.947 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T00:45:06.948 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:06.948 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T00:45:06.948 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T00:45:06.948 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T00:45:06.948 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:45:07.054 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T00:45:07.113 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T00:45:07.176 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T00:45:07.374 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T00:45:07.424 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T00:45:07.505 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T00:45:07.604 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T00:45:07.747 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T00:45:07.791 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T00:45:07.822 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T00:45:07.850 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T00:45:08.302 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T00:45:08.332 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T00:45:08.364 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T00:45:08.433 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T00:45:08.463 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T00:45:09.887 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T00:45:09.943 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T00:45:10.908 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T00:45:10.935 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T00:45:11.052 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T00:45:11.228 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T00:45:11.254 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T00:45:11.279 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T00:45:11.279 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:11.279 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T00:45:11.279 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T00:45:11.279 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T00:45:11.279 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-21T00:45:11.330 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T00:45:11.342 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T00:45:11.440 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T00:45:11.494 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T00:45:11.858 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T00:45:11.919 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T00:45:11.946 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T00:45:11.946 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /sys 2024-09-21T00:45:11.946 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /proc 2024-09-21T00:45:11.946 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /mnt 2024-09-21T00:45:11.946 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /var/tmp 2024-09-21T00:45:11.946 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /home 2024-09-21T00:45:11.946 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /root 2024-09-21T00:45:11.946 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /tmp 2024-09-21T00:45:11.947 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T00:45:12.124 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T00:45:12.140 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T00:45:12.141 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:12.141 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T00:45:12.141 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T00:45:12.461 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T00:45:12.491 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T00:45:12.514 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T00:45:12.514 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:12.514 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T00:45:12.514 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T00:45:12.515 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T00:45:12.515 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-21T00:45:12.558 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T00:45:12.581 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T00:45:12.581 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:12.581 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T00:45:12.581 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-21T00:45:12.642 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T00:45:12.665 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T00:45:12.665 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:12.665 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T00:45:12.665 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T00:45:12.665 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T00:45:12.665 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-21T00:45:12.935 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T00:45:12.969 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T00:45:12.984 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T00:45:13.008 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T00:45:13.008 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:13.008 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T00:45:13.009 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T00:45:13.009 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T00:45:13.009 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-21T00:45:13.093 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T00:45:13.260 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T00:45:13.279 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T00:45:13.305 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T00:45:13.305 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:13.305 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T00:45:13.305 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T00:45:13.305 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T00:45:13.305 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:45:13.371 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T00:45:13.384 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T00:45:13.487 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T00:45:13.540 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T00:45:13.785 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T00:45:13.812 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T00:45:13.812 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:13.812 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T00:45:13.812 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T00:45:13.812 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T00:45:13.812 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T00:45:14.044 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T00:45:14.067 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T00:45:14.068 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:14.068 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T00:45:14.068 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T00:45:14.068 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T00:45:14.068 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T00:45:14.557 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T00:45:14.562 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T00:45:14.585 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T00:45:14.585 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:14.585 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T00:45:14.585 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T00:45:14.585 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T00:45:14.585 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T00:45:14.591 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T00:45:14.616 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T00:45:14.616 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:14.616 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T00:45:14.616 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T00:45:14.616 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T00:45:14.617 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:45:14.658 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T00:45:14.683 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T00:45:14.683 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:14.683 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T00:45:14.683 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:45:14.701 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T00:45:14.733 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T00:45:14.758 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T00:45:14.759 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:14.759 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T00:45:14.759 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T00:45:14.759 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T00:45:14.759 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:45:14.759 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T00:45:14.823 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T00:45:15.018 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T00:45:15.072 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T00:45:15.093 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T00:45:15.117 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T00:45:15.117 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:15.117 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T00:45:15.118 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T00:45:15.118 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T00:45:15.118 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:45:15.152 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T00:45:15.241 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T00:45:15.394 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T00:45:15.430 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T00:45:15.470 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T00:45:15.497 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T00:45:15.950 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T00:45:15.979 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T00:45:16.012 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T00:45:16.080 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T00:45:16.119 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T00:45:16.989 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T00:45:17.030 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T00:45:17.070 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T00:45:17.102 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T00:45:17.130 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T00:45:17.311 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T00:45:17.360 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T00:45:17.391 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T00:45:17.420 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T00:45:17.458 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T00:45:18.025 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T00:45:18.065 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T00:45:18.087 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T00:45:18.924 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T00:45:19.004 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T00:45:19.045 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T00:45:19.134 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T00:45:19.166 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T00:45:19.191 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T00:45:19.217 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T00:45:19.217 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T00:45:19.310 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T00:45:19.310 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T00:45:19.382 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T00:45:19.402 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T00:45:19.422 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T00:45:19.435 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T00:45:19.441 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T00:45:19.441 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T00:45:19.463 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T00:45:19.494 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T00:45:19.500 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T00:45:19.521 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T00:45:19.558 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T00:45:19.621 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T00:45:19.621 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T00:45:19.705 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T00:45:19.752 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T00:45:19.768 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T00:45:19.801 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T00:45:19.832 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T00:45:19.861 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T00:45:19.924 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T00:45:20.519 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T00:45:20.564 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T00:45:20.573 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T00:45:20.585 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T00:45:20.600 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T00:45:20.721 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T00:45:20.892 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T00:45:20.919 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T00:45:20.943 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T00:45:20.943 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:20.943 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T00:45:20.943 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T00:45:20.944 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T00:45:20.944 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T00:45:20.995 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T00:45:21.007 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T00:45:21.110 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T00:45:21.169 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T00:45:21.501 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T00:45:21.601 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T00:45:21.648 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T00:45:21.743 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T00:45:21.771 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T00:45:21.796 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T00:45:21.822 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T00:45:21.822 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T00:45:21.915 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T00:45:21.915 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T00:45:21.999 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T00:45:22.023 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T00:45:22.029 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T00:45:22.029 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T00:45:22.195 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T00:45:22.217 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T00:45:22.217 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T00:45:22.231 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T00:45:22.255 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T00:45:22.255 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:22.255 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T00:45:22.255 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T00:45:22.255 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T00:45:22.256 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T00:45:22.298 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T00:45:22.301 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T00:45:22.322 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T00:45:22.322 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:22.322 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T00:45:22.322 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T00:45:22.377 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T00:45:22.382 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T00:45:22.405 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T00:45:22.405 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:22.405 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T00:45:22.406 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T00:45:22.406 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T00:45:22.406 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T00:45:22.741 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T00:45:22.764 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T00:45:22.765 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:22.765 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T00:45:22.765 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T00:45:22.765 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T00:45:22.765 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T00:45:26.015 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T00:45:26.015 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T00:45:26.015 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T00:45:26.016 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T00:45:26.016 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T00:45:26.016 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T00:45:26.016 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T00:45:26.016 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T00:45:26.016 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T00:45:26.016 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T00:45:26.016 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T00:45:26.016 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T00:45:26.016 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T00:45:26.016 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T00:45:26.016 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T00:45:26.017 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T00:45:26.017 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T00:45:26.017 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T00:45:26.017 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T00:45:26.017 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T00:45:26.017 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T00:45:26.017 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T00:45:26.017 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T00:45:26.017 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T00:45:26.017 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T00:45:26.017 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T00:45:26.017 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T00:45:26.017 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T00:45:26.017 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T00:45:26.017 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T00:45:26.018 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T00:45:26.018 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T00:45:26.018 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T00:45:26.018 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T00:45:26.018 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T00:45:26.018 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T00:45:26.018 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T00:45:26.018 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T00:45:26.018 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T00:45:26.018 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T00:45:26.018 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T00:45:26.018 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T00:45:26.019 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T00:45:26.019 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T00:45:26.019 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T00:45:26.019 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T00:45:26.019 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T00:45:26.019 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T00:45:26.019 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T00:45:26.019 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T00:45:26.019 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T00:45:26.019 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T00:45:26.019 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T00:45:26.019 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T00:45:26.019 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T00:45:26.019 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T00:45:26.020 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T00:45:26.020 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T00:45:26.020 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T00:45:26.020 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T00:45:26.020 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T00:45:26.020 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T00:45:26.020 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T00:45:26.020 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T00:45:26.020 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T00:45:26.020 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T00:45:26.020 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T00:45:26.020 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T00:45:26.020 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T00:45:26.020 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T00:45:26.020 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T00:45:26.021 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T00:45:26.021 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T00:45:26.021 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T00:45:26.021 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T00:45:26.021 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T00:45:26.021 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T00:45:26.021 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T00:45:26.021 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T00:45:26.021 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T00:45:26.021 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T00:45:26.021 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T00:45:26.021 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T00:45:26.021 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T00:45:26.021 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T00:45:26.022 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T00:45:26.022 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T00:45:26.022 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T00:45:26.022 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T00:45:26.022 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T00:45:26.022 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T00:45:26.022 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T00:45:26.022 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T00:45:26.022 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T00:45:26.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T00:45:26.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T00:45:26.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T00:45:26.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T00:45:26.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T00:45:26.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T00:45:26.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T00:45:26.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T00:45:26.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T00:45:26.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T00:45:26.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T00:45:26.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T00:45:26.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T00:45:26.024 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T00:45:26.024 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T00:45:26.024 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T00:45:26.024 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T00:45:26.024 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T00:45:26.024 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T00:45:26.024 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T00:45:26.024 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T00:45:26.024 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T00:45:26.024 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T00:45:26.024 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T00:45:26.024 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T00:45:26.024 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T00:45:26.025 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T00:45:26.025 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T00:45:26.025 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T00:45:26.025 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T00:45:26.025 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T00:45:26.025 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T00:45:26.025 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T00:45:26.025 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T00:45:26.025 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T00:45:26.025 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T00:45:26.025 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T00:45:26.026 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T00:45:26.026 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T00:45:26.026 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T00:45:26.026 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T00:45:26.026 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T00:45:26.026 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T00:45:26.026 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T00:45:26.026 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T00:45:26.026 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T00:45:26.026 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T00:45:26.026 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T00:45:26.027 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T00:45:26.027 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T00:45:26.027 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T00:45:26.027 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T00:45:26.027 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T00:45:26.027 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T00:45:26.027 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T00:45:26.027 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T00:45:26.027 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T00:45:26.027 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T00:45:26.027 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T00:45:26.027 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T00:45:26.027 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T00:45:26.028 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T00:45:26.028 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T00:45:26.028 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T00:45:26.028 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T00:45:26.028 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T00:45:26.028 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T00:45:26.028 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T00:45:26.028 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T00:45:26.028 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T00:45:26.028 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T00:45:26.971 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T00:45:27.012 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T00:45:27.054 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T00:45:27.093 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T00:45:27.128 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T00:45:27.332 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T00:45:27.376 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T00:45:27.406 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T00:45:27.435 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T00:45:27.498 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T00:45:28.147 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T00:45:28.188 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T00:45:28.208 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T00:45:28.513 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T00:45:28.513 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-21T00:45:28.513 INFO:teuthology.orchestra.run.smithi193.stdout:Upgraded: 2024-09-21T00:45:28.513 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T00:45:28.513 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T00:45:28.514 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T00:45:28.514 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T00:45:28.514 INFO:teuthology.orchestra.run.smithi193.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:28.514 INFO:teuthology.orchestra.run.smithi193.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:28.514 INFO:teuthology.orchestra.run.smithi193.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T00:45:28.514 INFO:teuthology.orchestra.run.smithi193.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T00:45:28.514 INFO:teuthology.orchestra.run.smithi193.stdout:Installed: 2024-09-21T00:45:28.514 INFO:teuthology.orchestra.run.smithi193.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T00:45:28.514 INFO:teuthology.orchestra.run.smithi193.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T00:45:28.514 INFO:teuthology.orchestra.run.smithi193.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T00:45:28.514 INFO:teuthology.orchestra.run.smithi193.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T00:45:28.514 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:28.514 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:28.514 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:28.515 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:28.515 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:45:28.515 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:28.515 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:28.515 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:28.515 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:45:28.515 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:45:28.515 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:45:28.515 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:45:28.515 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:45:28.515 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:28.515 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:28.515 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:45:28.515 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:28.516 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:28.516 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:28.516 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:45:28.516 INFO:teuthology.orchestra.run.smithi193.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:45:28.516 INFO:teuthology.orchestra.run.smithi193.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:28.516 INFO:teuthology.orchestra.run.smithi193.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:28.516 INFO:teuthology.orchestra.run.smithi193.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:45:28.516 INFO:teuthology.orchestra.run.smithi193.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T00:45:28.516 INFO:teuthology.orchestra.run.smithi193.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T00:45:28.516 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T00:45:28.516 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T00:45:28.516 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T00:45:28.516 INFO:teuthology.orchestra.run.smithi193.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T00:45:28.516 INFO:teuthology.orchestra.run.smithi193.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T00:45:28.516 INFO:teuthology.orchestra.run.smithi193.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T00:45:28.516 INFO:teuthology.orchestra.run.smithi193.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T00:45:28.517 INFO:teuthology.orchestra.run.smithi193.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T00:45:28.517 INFO:teuthology.orchestra.run.smithi193.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T00:45:28.517 INFO:teuthology.orchestra.run.smithi193.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:28.517 INFO:teuthology.orchestra.run.smithi193.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:28.517 INFO:teuthology.orchestra.run.smithi193.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:28.517 INFO:teuthology.orchestra.run.smithi193.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T00:45:28.517 INFO:teuthology.orchestra.run.smithi193.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T00:45:28.517 INFO:teuthology.orchestra.run.smithi193.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T00:45:28.517 INFO:teuthology.orchestra.run.smithi193.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T00:45:28.517 INFO:teuthology.orchestra.run.smithi193.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T00:45:28.517 INFO:teuthology.orchestra.run.smithi193.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T00:45:28.517 INFO:teuthology.orchestra.run.smithi193.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:28.517 INFO:teuthology.orchestra.run.smithi193.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:28.517 INFO:teuthology.orchestra.run.smithi193.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T00:45:28.518 INFO:teuthology.orchestra.run.smithi193.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:28.518 INFO:teuthology.orchestra.run.smithi193.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T00:45:28.518 INFO:teuthology.orchestra.run.smithi193.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T00:45:28.518 INFO:teuthology.orchestra.run.smithi193.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T00:45:28.518 INFO:teuthology.orchestra.run.smithi193.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T00:45:28.518 INFO:teuthology.orchestra.run.smithi193.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T00:45:28.518 INFO:teuthology.orchestra.run.smithi193.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T00:45:28.518 INFO:teuthology.orchestra.run.smithi193.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T00:45:28.518 INFO:teuthology.orchestra.run.smithi193.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T00:45:28.518 INFO:teuthology.orchestra.run.smithi193.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T00:45:28.518 INFO:teuthology.orchestra.run.smithi193.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T00:45:28.518 INFO:teuthology.orchestra.run.smithi193.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T00:45:28.518 INFO:teuthology.orchestra.run.smithi193.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T00:45:28.518 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T00:45:28.519 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T00:45:28.519 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T00:45:28.519 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T00:45:28.519 INFO:teuthology.orchestra.run.smithi193.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T00:45:28.519 INFO:teuthology.orchestra.run.smithi193.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T00:45:28.519 INFO:teuthology.orchestra.run.smithi193.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T00:45:28.519 INFO:teuthology.orchestra.run.smithi193.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T00:45:28.519 INFO:teuthology.orchestra.run.smithi193.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T00:45:28.519 INFO:teuthology.orchestra.run.smithi193.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T00:45:28.519 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T00:45:28.519 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:28.519 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:28.519 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:28.519 INFO:teuthology.orchestra.run.smithi193.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T00:45:28.519 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T00:45:28.520 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T00:45:28.520 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T00:45:28.520 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T00:45:28.520 INFO:teuthology.orchestra.run.smithi193.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T00:45:28.520 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T00:45:28.520 INFO:teuthology.orchestra.run.smithi193.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T00:45:28.520 INFO:teuthology.orchestra.run.smithi193.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T00:45:28.520 INFO:teuthology.orchestra.run.smithi193.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T00:45:28.520 INFO:teuthology.orchestra.run.smithi193.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T00:45:28.520 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T00:45:28.520 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T00:45:28.520 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T00:45:28.520 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T00:45:28.520 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T00:45:28.520 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T00:45:28.521 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T00:45:28.521 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T00:45:28.521 INFO:teuthology.orchestra.run.smithi193.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T00:45:28.521 INFO:teuthology.orchestra.run.smithi193.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T00:45:28.521 INFO:teuthology.orchestra.run.smithi193.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T00:45:28.521 INFO:teuthology.orchestra.run.smithi193.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T00:45:28.521 INFO:teuthology.orchestra.run.smithi193.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T00:45:28.521 INFO:teuthology.orchestra.run.smithi193.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T00:45:28.521 INFO:teuthology.orchestra.run.smithi193.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T00:45:28.521 INFO:teuthology.orchestra.run.smithi193.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T00:45:28.521 INFO:teuthology.orchestra.run.smithi193.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T00:45:28.521 INFO:teuthology.orchestra.run.smithi193.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T00:45:28.521 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T00:45:28.521 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T00:45:28.522 INFO:teuthology.orchestra.run.smithi193.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T00:45:28.522 INFO:teuthology.orchestra.run.smithi193.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T00:45:28.522 INFO:teuthology.orchestra.run.smithi193.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T00:45:28.522 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T00:45:28.522 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T00:45:28.522 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T00:45:28.522 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T00:45:28.522 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T00:45:28.522 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T00:45:28.522 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:28.522 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:28.522 INFO:teuthology.orchestra.run.smithi193.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T00:45:28.522 INFO:teuthology.orchestra.run.smithi193.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T00:45:28.522 INFO:teuthology.orchestra.run.smithi193.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T00:45:28.522 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:28.523 INFO:teuthology.orchestra.run.smithi193.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T00:45:28.523 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T00:45:28.523 INFO:teuthology.orchestra.run.smithi193.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T00:45:28.523 INFO:teuthology.orchestra.run.smithi193.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T00:45:28.523 INFO:teuthology.orchestra.run.smithi193.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T00:45:28.523 INFO:teuthology.orchestra.run.smithi193.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T00:45:28.523 INFO:teuthology.orchestra.run.smithi193.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T00:45:28.523 INFO:teuthology.orchestra.run.smithi193.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T00:45:28.523 INFO:teuthology.orchestra.run.smithi193.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T00:45:28.523 INFO:teuthology.orchestra.run.smithi193.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T00:45:28.523 INFO:teuthology.orchestra.run.smithi193.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T00:45:28.523 INFO:teuthology.orchestra.run.smithi193.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T00:45:28.523 INFO:teuthology.orchestra.run.smithi193.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T00:45:28.523 INFO:teuthology.orchestra.run.smithi193.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T00:45:28.524 INFO:teuthology.orchestra.run.smithi193.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T00:45:28.524 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:28.524 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:28.524 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:28.524 INFO:teuthology.orchestra.run.smithi193.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T00:45:28.524 INFO:teuthology.orchestra.run.smithi193.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T00:45:28.524 INFO:teuthology.orchestra.run.smithi193.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T00:45:28.524 INFO:teuthology.orchestra.run.smithi193.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T00:45:28.524 INFO:teuthology.orchestra.run.smithi193.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T00:45:28.524 INFO:teuthology.orchestra.run.smithi193.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T00:45:28.525 INFO:teuthology.orchestra.run.smithi193.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T00:45:28.525 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-21T00:45:28.525 INFO:teuthology.orchestra.run.smithi193.stdout:Complete! 2024-09-21T00:45:28.550 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T00:45:28.550 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T00:45:28.550 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T00:45:28.550 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T00:45:28.551 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T00:45:28.551 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T00:45:28.551 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T00:45:28.551 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T00:45:28.551 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T00:45:28.551 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T00:45:28.551 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T00:45:28.551 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T00:45:28.551 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T00:45:28.551 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T00:45:28.551 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T00:45:28.551 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T00:45:28.551 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T00:45:28.551 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T00:45:28.551 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T00:45:28.552 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T00:45:28.552 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T00:45:28.552 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T00:45:28.552 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T00:45:28.552 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T00:45:28.552 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T00:45:28.552 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T00:45:28.552 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T00:45:28.552 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T00:45:28.552 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T00:45:28.552 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T00:45:28.552 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T00:45:28.552 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T00:45:28.552 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T00:45:28.552 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T00:45:28.552 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T00:45:28.553 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T00:45:28.553 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T00:45:28.553 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T00:45:28.553 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T00:45:28.553 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T00:45:28.553 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T00:45:28.553 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T00:45:28.553 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T00:45:28.553 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T00:45:28.553 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T00:45:28.553 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T00:45:28.553 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T00:45:28.553 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T00:45:28.553 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T00:45:28.553 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T00:45:28.554 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T00:45:28.554 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T00:45:28.554 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T00:45:28.554 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T00:45:28.554 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T00:45:28.554 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T00:45:28.554 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T00:45:28.554 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T00:45:28.554 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T00:45:28.554 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T00:45:28.554 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T00:45:28.554 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T00:45:28.554 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T00:45:28.554 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T00:45:28.555 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T00:45:28.555 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T00:45:28.555 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T00:45:28.555 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T00:45:28.555 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T00:45:28.555 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T00:45:28.555 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T00:45:28.555 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T00:45:28.555 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T00:45:28.555 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T00:45:28.555 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T00:45:28.555 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T00:45:28.555 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T00:45:28.555 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T00:45:28.555 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T00:45:28.556 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T00:45:28.556 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T00:45:28.556 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T00:45:28.556 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T00:45:28.556 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T00:45:28.556 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T00:45:28.556 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T00:45:28.556 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T00:45:28.556 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T00:45:28.556 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T00:45:28.556 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T00:45:28.556 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T00:45:28.556 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T00:45:28.556 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T00:45:28.556 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T00:45:28.556 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T00:45:28.557 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T00:45:28.557 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T00:45:28.557 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T00:45:28.557 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T00:45:28.557 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T00:45:28.557 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T00:45:28.557 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T00:45:28.557 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T00:45:28.557 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T00:45:28.557 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T00:45:28.557 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T00:45:28.557 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T00:45:28.557 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T00:45:28.557 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T00:45:28.557 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T00:45:28.558 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T00:45:28.558 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T00:45:28.558 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T00:45:28.558 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T00:45:28.558 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T00:45:28.558 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T00:45:28.558 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T00:45:28.558 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T00:45:28.558 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T00:45:28.558 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T00:45:28.558 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T00:45:28.558 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T00:45:28.558 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T00:45:28.558 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T00:45:28.559 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T00:45:28.559 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T00:45:28.559 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T00:45:28.559 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T00:45:28.559 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T00:45:28.559 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T00:45:28.559 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T00:45:28.559 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T00:45:28.559 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T00:45:28.559 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T00:45:28.559 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T00:45:28.559 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T00:45:28.559 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T00:45:28.559 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T00:45:28.559 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T00:45:28.560 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T00:45:28.560 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T00:45:28.560 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T00:45:28.560 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T00:45:28.560 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T00:45:28.560 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T00:45:28.560 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T00:45:28.560 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T00:45:28.560 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T00:45:28.560 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T00:45:28.560 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T00:45:28.560 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T00:45:28.560 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T00:45:28.560 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T00:45:28.560 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T00:45:28.561 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T00:45:28.561 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T00:45:28.561 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T00:45:28.561 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T00:45:28.561 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T00:45:28.561 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T00:45:28.561 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T00:45:28.561 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T00:45:28.561 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T00:45:28.561 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T00:45:28.561 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T00:45:28.928 DEBUG:teuthology.parallel:result is None 2024-09-21T00:45:29.101 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T00:45:29.193 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T00:45:29.235 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T00:45:29.318 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T00:45:29.345 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T00:45:29.371 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T00:45:29.397 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T00:45:29.397 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T00:45:29.490 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T00:45:29.490 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T00:45:29.582 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T00:45:29.607 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T00:45:29.612 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T00:45:29.613 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T00:45:29.800 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T00:45:29.801 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T00:45:29.893 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T00:45:29.959 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T00:45:31.033 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T00:45:31.033 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:45:31.033 INFO:teuthology.orchestra.run.smithi001.stdout:Upgraded: 2024-09-21T00:45:31.033 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T00:45:31.033 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T00:45:31.034 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T00:45:31.034 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T00:45:31.034 INFO:teuthology.orchestra.run.smithi001.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:31.034 INFO:teuthology.orchestra.run.smithi001.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:31.034 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T00:45:31.034 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T00:45:31.034 INFO:teuthology.orchestra.run.smithi001.stdout:Installed: 2024-09-21T00:45:31.034 INFO:teuthology.orchestra.run.smithi001.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T00:45:31.034 INFO:teuthology.orchestra.run.smithi001.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T00:45:31.034 INFO:teuthology.orchestra.run.smithi001.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T00:45:31.034 INFO:teuthology.orchestra.run.smithi001.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T00:45:31.034 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:31.035 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:31.035 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:31.035 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:31.035 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:45:31.035 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:31.035 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:31.035 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:31.035 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:45:31.035 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:45:31.035 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:45:31.036 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:45:31.036 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:45:31.036 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:31.036 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:31.036 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:45:31.036 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:31.036 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:31.036 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:31.036 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:45:31.036 INFO:teuthology.orchestra.run.smithi001.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:45:31.036 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:31.036 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:31.037 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:45:31.037 INFO:teuthology.orchestra.run.smithi001.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T00:45:31.037 INFO:teuthology.orchestra.run.smithi001.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T00:45:31.037 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T00:45:31.037 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T00:45:31.037 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T00:45:31.037 INFO:teuthology.orchestra.run.smithi001.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T00:45:31.037 INFO:teuthology.orchestra.run.smithi001.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T00:45:31.037 INFO:teuthology.orchestra.run.smithi001.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T00:45:31.037 INFO:teuthology.orchestra.run.smithi001.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T00:45:31.038 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T00:45:31.038 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T00:45:31.038 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:31.038 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:31.038 INFO:teuthology.orchestra.run.smithi001.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:31.038 INFO:teuthology.orchestra.run.smithi001.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T00:45:31.038 INFO:teuthology.orchestra.run.smithi001.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T00:45:31.038 INFO:teuthology.orchestra.run.smithi001.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T00:45:31.038 INFO:teuthology.orchestra.run.smithi001.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T00:45:31.038 INFO:teuthology.orchestra.run.smithi001.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T00:45:31.038 INFO:teuthology.orchestra.run.smithi001.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T00:45:31.039 INFO:teuthology.orchestra.run.smithi001.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:31.039 INFO:teuthology.orchestra.run.smithi001.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:31.039 INFO:teuthology.orchestra.run.smithi001.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T00:45:31.039 INFO:teuthology.orchestra.run.smithi001.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:31.039 INFO:teuthology.orchestra.run.smithi001.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T00:45:31.039 INFO:teuthology.orchestra.run.smithi001.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T00:45:31.039 INFO:teuthology.orchestra.run.smithi001.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T00:45:31.039 INFO:teuthology.orchestra.run.smithi001.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T00:45:31.039 INFO:teuthology.orchestra.run.smithi001.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T00:45:31.039 INFO:teuthology.orchestra.run.smithi001.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T00:45:31.040 INFO:teuthology.orchestra.run.smithi001.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T00:45:31.040 INFO:teuthology.orchestra.run.smithi001.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T00:45:31.040 INFO:teuthology.orchestra.run.smithi001.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T00:45:31.040 INFO:teuthology.orchestra.run.smithi001.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T00:45:31.040 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T00:45:31.040 INFO:teuthology.orchestra.run.smithi001.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T00:45:31.040 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T00:45:31.040 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T00:45:31.040 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T00:45:31.040 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T00:45:31.040 INFO:teuthology.orchestra.run.smithi001.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T00:45:31.040 INFO:teuthology.orchestra.run.smithi001.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T00:45:31.040 INFO:teuthology.orchestra.run.smithi001.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T00:45:31.041 INFO:teuthology.orchestra.run.smithi001.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T00:45:31.041 INFO:teuthology.orchestra.run.smithi001.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T00:45:31.041 INFO:teuthology.orchestra.run.smithi001.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T00:45:31.041 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T00:45:31.041 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:31.041 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:31.041 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:31.041 INFO:teuthology.orchestra.run.smithi001.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T00:45:31.041 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T00:45:31.041 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T00:45:31.041 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T00:45:31.041 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T00:45:31.042 INFO:teuthology.orchestra.run.smithi001.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T00:45:31.042 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T00:45:31.042 INFO:teuthology.orchestra.run.smithi001.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T00:45:31.042 INFO:teuthology.orchestra.run.smithi001.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T00:45:31.042 INFO:teuthology.orchestra.run.smithi001.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T00:45:31.042 INFO:teuthology.orchestra.run.smithi001.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T00:45:31.042 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T00:45:31.042 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T00:45:31.042 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T00:45:31.042 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T00:45:31.042 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T00:45:31.042 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T00:45:31.042 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T00:45:31.042 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T00:45:31.043 INFO:teuthology.orchestra.run.smithi001.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T00:45:31.043 INFO:teuthology.orchestra.run.smithi001.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T00:45:31.043 INFO:teuthology.orchestra.run.smithi001.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T00:45:31.043 INFO:teuthology.orchestra.run.smithi001.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T00:45:31.043 INFO:teuthology.orchestra.run.smithi001.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T00:45:31.043 INFO:teuthology.orchestra.run.smithi001.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T00:45:31.043 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T00:45:31.043 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T00:45:31.043 INFO:teuthology.orchestra.run.smithi001.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T00:45:31.043 INFO:teuthology.orchestra.run.smithi001.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T00:45:31.043 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T00:45:31.043 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T00:45:31.043 INFO:teuthology.orchestra.run.smithi001.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T00:45:31.043 INFO:teuthology.orchestra.run.smithi001.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T00:45:31.044 INFO:teuthology.orchestra.run.smithi001.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T00:45:31.044 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T00:45:31.044 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T00:45:31.044 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T00:45:31.044 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T00:45:31.044 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T00:45:31.044 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T00:45:31.044 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:31.044 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:31.044 INFO:teuthology.orchestra.run.smithi001.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T00:45:31.045 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T00:45:31.045 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T00:45:31.045 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:31.045 INFO:teuthology.orchestra.run.smithi001.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T00:45:31.045 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T00:45:31.045 INFO:teuthology.orchestra.run.smithi001.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T00:45:31.045 INFO:teuthology.orchestra.run.smithi001.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T00:45:31.045 INFO:teuthology.orchestra.run.smithi001.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T00:45:31.045 INFO:teuthology.orchestra.run.smithi001.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T00:45:31.045 INFO:teuthology.orchestra.run.smithi001.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T00:45:31.046 INFO:teuthology.orchestra.run.smithi001.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T00:45:31.046 INFO:teuthology.orchestra.run.smithi001.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T00:45:31.046 INFO:teuthology.orchestra.run.smithi001.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T00:45:31.046 INFO:teuthology.orchestra.run.smithi001.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T00:45:31.046 INFO:teuthology.orchestra.run.smithi001.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T00:45:31.046 INFO:teuthology.orchestra.run.smithi001.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T00:45:31.046 INFO:teuthology.orchestra.run.smithi001.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T00:45:31.046 INFO:teuthology.orchestra.run.smithi001.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T00:45:31.046 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:31.047 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:31.047 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:31.047 INFO:teuthology.orchestra.run.smithi001.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T00:45:31.047 INFO:teuthology.orchestra.run.smithi001.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T00:45:31.047 INFO:teuthology.orchestra.run.smithi001.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T00:45:31.047 INFO:teuthology.orchestra.run.smithi001.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T00:45:31.047 INFO:teuthology.orchestra.run.smithi001.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T00:45:31.048 INFO:teuthology.orchestra.run.smithi001.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T00:45:31.048 INFO:teuthology.orchestra.run.smithi001.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T00:45:31.048 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:45:31.048 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-09-21T00:45:31.492 DEBUG:teuthology.parallel:result is None 2024-09-21T00:45:36.389 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T00:45:36.389 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T00:45:36.389 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T00:45:36.389 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T00:45:36.389 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T00:45:36.389 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T00:45:36.389 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T00:45:36.389 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T00:45:36.389 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T00:45:36.389 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T00:45:36.390 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T00:45:36.390 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T00:45:36.390 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T00:45:36.390 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T00:45:36.390 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T00:45:36.390 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T00:45:36.390 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T00:45:36.390 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T00:45:36.390 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T00:45:36.390 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T00:45:36.390 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T00:45:36.390 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T00:45:36.390 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T00:45:36.391 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T00:45:36.391 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T00:45:36.391 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T00:45:36.391 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T00:45:36.391 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T00:45:36.391 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T00:45:36.391 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T00:45:36.391 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T00:45:36.402 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T00:45:36.402 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T00:45:36.402 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T00:45:36.402 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T00:45:36.402 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T00:45:36.403 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T00:45:36.403 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T00:45:36.403 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T00:45:36.403 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T00:45:36.403 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T00:45:36.403 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T00:45:36.403 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T00:45:36.403 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T00:45:36.403 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T00:45:36.403 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T00:45:36.403 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T00:45:36.403 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T00:45:36.403 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T00:45:36.403 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T00:45:36.404 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T00:45:36.404 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T00:45:36.404 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T00:45:36.404 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T00:45:36.404 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T00:45:36.404 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T00:45:36.404 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T00:45:36.404 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T00:45:36.404 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T00:45:36.404 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T00:45:36.404 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T00:45:36.404 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T00:45:36.404 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T00:45:36.404 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T00:45:36.405 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T00:45:36.405 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T00:45:36.405 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T00:45:36.405 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T00:45:36.405 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T00:45:36.405 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T00:45:36.405 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T00:45:36.405 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T00:45:36.405 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T00:45:36.405 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T00:45:36.405 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T00:45:36.405 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T00:45:36.405 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T00:45:36.406 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T00:45:36.406 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T00:45:36.406 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T00:45:36.406 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T00:45:36.406 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T00:45:36.406 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T00:45:36.406 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T00:45:36.406 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T00:45:36.406 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T00:45:36.406 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T00:45:36.406 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T00:45:36.406 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T00:45:36.406 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T00:45:36.407 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T00:45:36.407 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T00:45:36.407 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T00:45:36.407 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T00:45:36.407 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T00:45:36.407 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T00:45:36.407 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T00:45:36.407 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T00:45:36.407 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T00:45:36.407 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T00:45:36.407 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T00:45:36.407 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T00:45:36.407 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T00:45:36.407 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T00:45:36.408 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T00:45:36.408 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T00:45:36.408 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T00:45:36.408 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T00:45:36.408 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T00:45:36.408 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T00:45:36.408 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T00:45:36.408 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T00:45:36.408 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T00:45:36.408 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T00:45:36.408 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T00:45:36.408 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T00:45:36.408 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T00:45:36.408 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T00:45:36.408 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T00:45:36.408 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T00:45:36.409 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T00:45:36.409 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T00:45:36.409 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T00:45:36.409 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T00:45:36.409 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T00:45:36.409 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T00:45:36.409 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T00:45:36.409 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T00:45:36.409 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T00:45:36.409 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T00:45:36.409 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T00:45:36.409 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T00:45:36.409 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T00:45:36.409 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T00:45:36.409 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T00:45:36.410 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T00:45:36.410 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T00:45:36.410 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T00:45:36.410 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T00:45:36.410 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T00:45:36.410 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T00:45:36.410 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T00:45:36.410 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T00:45:36.410 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T00:45:36.410 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T00:45:36.410 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T00:45:36.410 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T00:45:36.410 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T00:45:36.410 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T00:45:36.411 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T00:45:36.411 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T00:45:36.411 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T00:45:36.411 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T00:45:36.411 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T00:45:36.411 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T00:45:36.411 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T00:45:36.411 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T00:45:36.411 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T00:45:36.411 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T00:45:36.411 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T00:45:36.411 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T00:45:36.411 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T00:45:36.411 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T00:45:36.412 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T00:45:36.412 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T00:45:38.963 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T00:45:38.963 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T00:45:38.963 INFO:teuthology.orchestra.run.smithi042.stdout:Upgraded: 2024-09-21T00:45:38.963 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T00:45:38.964 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T00:45:38.964 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T00:45:38.964 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T00:45:38.964 INFO:teuthology.orchestra.run.smithi042.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:38.964 INFO:teuthology.orchestra.run.smithi042.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:38.964 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T00:45:38.964 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T00:45:38.964 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-09-21T00:45:38.964 INFO:teuthology.orchestra.run.smithi042.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T00:45:38.964 INFO:teuthology.orchestra.run.smithi042.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T00:45:38.964 INFO:teuthology.orchestra.run.smithi042.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T00:45:38.964 INFO:teuthology.orchestra.run.smithi042.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T00:45:38.964 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:38.965 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:38.965 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:38.965 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:38.965 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:45:38.965 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:38.965 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:38.965 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:38.965 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:45:38.965 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:45:38.965 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:45:38.965 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:45:38.965 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:45:38.965 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:38.965 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:38.966 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:45:38.966 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:38.966 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:38.966 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:38.966 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:45:38.966 INFO:teuthology.orchestra.run.smithi042.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:45:38.966 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:38.966 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:38.966 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:45:38.966 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T00:45:38.966 INFO:teuthology.orchestra.run.smithi042.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T00:45:38.966 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T00:45:38.966 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T00:45:38.967 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T00:45:38.967 INFO:teuthology.orchestra.run.smithi042.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T00:45:38.967 INFO:teuthology.orchestra.run.smithi042.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T00:45:38.967 INFO:teuthology.orchestra.run.smithi042.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T00:45:38.967 INFO:teuthology.orchestra.run.smithi042.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T00:45:38.967 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T00:45:38.967 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T00:45:38.967 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:38.967 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:38.967 INFO:teuthology.orchestra.run.smithi042.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:38.967 INFO:teuthology.orchestra.run.smithi042.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T00:45:38.967 INFO:teuthology.orchestra.run.smithi042.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T00:45:38.967 INFO:teuthology.orchestra.run.smithi042.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T00:45:38.967 INFO:teuthology.orchestra.run.smithi042.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T00:45:38.967 INFO:teuthology.orchestra.run.smithi042.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T00:45:38.968 INFO:teuthology.orchestra.run.smithi042.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T00:45:38.968 INFO:teuthology.orchestra.run.smithi042.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:38.968 INFO:teuthology.orchestra.run.smithi042.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:38.968 INFO:teuthology.orchestra.run.smithi042.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T00:45:38.968 INFO:teuthology.orchestra.run.smithi042.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:38.968 INFO:teuthology.orchestra.run.smithi042.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T00:45:38.968 INFO:teuthology.orchestra.run.smithi042.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T00:45:38.968 INFO:teuthology.orchestra.run.smithi042.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T00:45:38.968 INFO:teuthology.orchestra.run.smithi042.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T00:45:38.968 INFO:teuthology.orchestra.run.smithi042.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T00:45:38.968 INFO:teuthology.orchestra.run.smithi042.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T00:45:38.968 INFO:teuthology.orchestra.run.smithi042.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T00:45:38.968 INFO:teuthology.orchestra.run.smithi042.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T00:45:38.968 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T00:45:38.969 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T00:45:38.969 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T00:45:38.969 INFO:teuthology.orchestra.run.smithi042.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T00:45:38.969 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T00:45:38.969 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T00:45:38.969 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T00:45:38.969 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T00:45:38.969 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T00:45:38.969 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T00:45:38.969 INFO:teuthology.orchestra.run.smithi042.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T00:45:38.969 INFO:teuthology.orchestra.run.smithi042.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T00:45:38.969 INFO:teuthology.orchestra.run.smithi042.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T00:45:38.969 INFO:teuthology.orchestra.run.smithi042.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T00:45:38.970 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T00:45:38.970 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:38.970 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:38.970 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:38.970 INFO:teuthology.orchestra.run.smithi042.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T00:45:38.970 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T00:45:38.970 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T00:45:38.970 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T00:45:38.970 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T00:45:38.970 INFO:teuthology.orchestra.run.smithi042.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T00:45:38.970 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T00:45:38.970 INFO:teuthology.orchestra.run.smithi042.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T00:45:38.970 INFO:teuthology.orchestra.run.smithi042.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T00:45:38.970 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T00:45:38.970 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T00:45:38.971 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T00:45:38.971 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T00:45:38.971 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T00:45:38.971 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T00:45:38.971 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T00:45:38.971 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T00:45:38.971 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T00:45:38.971 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T00:45:38.971 INFO:teuthology.orchestra.run.smithi042.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T00:45:38.971 INFO:teuthology.orchestra.run.smithi042.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T00:45:38.971 INFO:teuthology.orchestra.run.smithi042.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T00:45:38.971 INFO:teuthology.orchestra.run.smithi042.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T00:45:38.971 INFO:teuthology.orchestra.run.smithi042.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T00:45:38.971 INFO:teuthology.orchestra.run.smithi042.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T00:45:38.972 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T00:45:38.972 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T00:45:38.972 INFO:teuthology.orchestra.run.smithi042.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T00:45:38.972 INFO:teuthology.orchestra.run.smithi042.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T00:45:38.973 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T00:45:38.973 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T00:45:38.973 INFO:teuthology.orchestra.run.smithi042.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T00:45:38.973 INFO:teuthology.orchestra.run.smithi042.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T00:45:38.973 INFO:teuthology.orchestra.run.smithi042.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T00:45:38.974 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T00:45:38.974 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T00:45:38.974 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T00:45:38.974 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T00:45:38.974 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T00:45:38.974 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T00:45:38.974 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:38.974 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:38.974 INFO:teuthology.orchestra.run.smithi042.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T00:45:38.974 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T00:45:38.974 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T00:45:38.974 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:38.974 INFO:teuthology.orchestra.run.smithi042.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T00:45:38.975 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T00:45:38.975 INFO:teuthology.orchestra.run.smithi042.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T00:45:38.975 INFO:teuthology.orchestra.run.smithi042.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T00:45:38.975 INFO:teuthology.orchestra.run.smithi042.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T00:45:38.975 INFO:teuthology.orchestra.run.smithi042.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T00:45:38.975 INFO:teuthology.orchestra.run.smithi042.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T00:45:38.975 INFO:teuthology.orchestra.run.smithi042.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T00:45:38.975 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T00:45:38.975 INFO:teuthology.orchestra.run.smithi042.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T00:45:38.975 INFO:teuthology.orchestra.run.smithi042.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T00:45:38.975 INFO:teuthology.orchestra.run.smithi042.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T00:45:38.975 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T00:45:38.975 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T00:45:38.976 INFO:teuthology.orchestra.run.smithi042.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T00:45:38.976 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:38.976 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:38.976 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:45:38.976 INFO:teuthology.orchestra.run.smithi042.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T00:45:38.976 INFO:teuthology.orchestra.run.smithi042.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T00:45:38.976 INFO:teuthology.orchestra.run.smithi042.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T00:45:38.976 INFO:teuthology.orchestra.run.smithi042.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T00:45:38.976 INFO:teuthology.orchestra.run.smithi042.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T00:45:38.976 INFO:teuthology.orchestra.run.smithi042.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T00:45:38.977 INFO:teuthology.orchestra.run.smithi042.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T00:45:38.977 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T00:45:38.977 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-21T00:45:39.408 DEBUG:teuthology.parallel:result is None 2024-09-21T00:45:39.408 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:45:39.552 DEBUG:teuthology.orchestra.run.smithi001:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T00:45:39.579 INFO:teuthology.orchestra.run.smithi001.stdout:19.3.0-5120.g18432218.el9 2024-09-21T00:45:39.580 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T00:45:39.580 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T00:45:39.581 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:45:39.724 DEBUG:teuthology.orchestra.run.smithi042:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T00:45:39.747 INFO:teuthology.orchestra.run.smithi042.stdout:19.3.0-5120.g18432218.el9 2024-09-21T00:45:39.747 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T00:45:39.748 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T00:45:39.749 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:45:39.885 DEBUG:teuthology.orchestra.run.smithi193:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T00:45:39.911 INFO:teuthology.orchestra.run.smithi193.stdout:19.3.0-5120.g18432218.el9 2024-09-21T00:45:39.912 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T00:45:39.912 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T00:45:39.913 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T00:45:39.913 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-21T00:45:39.913 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T00:45:39.947 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-21T00:45:39.947 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T00:45:39.977 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-21T00:45:39.977 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T00:45:40.009 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T00:45:40.009 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-21T00:45:40.009 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T00:45:40.039 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T00:45:40.107 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-21T00:45:40.107 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T00:45:40.135 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T00:45:40.202 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-21T00:45:40.203 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T00:45:40.233 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T00:45:40.301 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T00:45:40.301 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-21T00:45:40.301 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T00:45:40.326 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T00:45:40.392 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-21T00:45:40.392 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T00:45:40.419 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T00:45:40.486 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-21T00:45:40.486 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T00:45:40.516 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T00:45:40.586 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T00:45:40.586 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-21T00:45:40.586 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T00:45:40.612 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T00:45:40.678 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-21T00:45:40.678 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T00:45:40.706 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T00:45:40.773 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-21T00:45:40.773 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T00:45:40.802 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T00:45:40.870 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-21T00:45:40.955 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mds': {'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-21T00:45:40.955 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:45:40.955 INFO:tasks.cephadm:Cluster fsid is d3972c20-77b2-11ef-baf5-efdc52797490 2024-09-21T00:45:40.956 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-21T00:45:40.956 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.1', 'mon.b': '172.21.15.42', 'mon.c': '172.21.15.193'} 2024-09-21T00:45:40.956 INFO:tasks.cephadm:First mon is mon.a on smithi001 2024-09-21T00:45:40.956 INFO:tasks.cephadm:First mgr is x 2024-09-21T00:45:40.956 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-21T00:45:40.956 DEBUG:teuthology.orchestra.run.smithi001:> sudo hostname $(hostname -s) 2024-09-21T00:45:40.982 DEBUG:teuthology.orchestra.run.smithi042:> sudo hostname $(hostname -s) 2024-09-21T00:45:41.009 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname $(hostname -s) 2024-09-21T00:45:41.037 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-21T00:45:41.037 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:45:41.179 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.4.75+confusa13', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-21 00:04:17.484514', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['x86_64', 'source', 'arm64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.2.22+braggi22', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-20 22:54:16.499090', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-21T00:45:41.318 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-pdonnell-testing-20240920.212106-debug, sha1 1843221895adccfb3b692060251dd6a0183bc410 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:45:41.319 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T00:45:41.319 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T00:45:41.319 DEBUG:teuthology.orchestra.run.smithi001:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T00:45:41.860 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 00:45 /home/ubuntu/cephtest/cephadm 2024-09-21T00:45:41.860 DEBUG:teuthology.orchestra.run.smithi042:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T00:45:42.456 INFO:teuthology.orchestra.run.smithi042.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 00:45 /home/ubuntu/cephtest/cephadm 2024-09-21T00:45:42.457 DEBUG:teuthology.orchestra.run.smithi193:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T00:45:43.064 INFO:teuthology.orchestra.run.smithi193.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 00:45 /home/ubuntu/cephtest/cephadm 2024-09-21T00:45:43.064 DEBUG:teuthology.orchestra.run.smithi001:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T00:45:43.085 DEBUG:teuthology.orchestra.run.smithi042:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T00:45:43.104 DEBUG:teuthology.orchestra.run.smithi193:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T00:45:43.135 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 on all hosts... 2024-09-21T00:45:43.135 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T00:45:43.137 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T00:45:43.147 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T00:45:44.685 INFO:teuthology.orchestra.run.smithi193.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T00:45:44.700 INFO:teuthology.orchestra.run.smithi001.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T00:45:44.811 INFO:teuthology.orchestra.run.smithi042.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T00:46:14.786 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-21T00:46:14.786 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T00:46:14.786 INFO:teuthology.orchestra.run.smithi042.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T00:46:14.786 INFO:teuthology.orchestra.run.smithi042.stdout: "repo_digests": [ 2024-09-21T00:46:14.786 INFO:teuthology.orchestra.run.smithi042.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T00:46:14.786 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-09-21T00:46:14.786 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-21T00:46:17.435 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-09-21T00:46:17.436 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T00:46:17.436 INFO:teuthology.orchestra.run.smithi193.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T00:46:17.436 INFO:teuthology.orchestra.run.smithi193.stdout: "repo_digests": [ 2024-09-21T00:46:17.436 INFO:teuthology.orchestra.run.smithi193.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T00:46:17.436 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-09-21T00:46:17.436 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-09-21T00:46:20.599 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T00:46:20.599 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T00:46:20.599 INFO:teuthology.orchestra.run.smithi001.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T00:46:20.599 INFO:teuthology.orchestra.run.smithi001.stdout: "repo_digests": [ 2024-09-21T00:46:20.599 INFO:teuthology.orchestra.run.smithi001.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T00:46:20.599 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-21T00:46:20.599 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T00:46:20.626 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /etc/ceph 2024-09-21T00:46:20.668 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /etc/ceph 2024-09-21T00:46:20.702 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /etc/ceph 2024-09-21T00:46:20.735 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 777 /etc/ceph 2024-09-21T00:46:20.760 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 777 /etc/ceph 2024-09-21T00:46:20.788 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod 777 /etc/ceph 2024-09-21T00:46:20.817 INFO:tasks.cephadm:Writing seed config... 2024-09-21T00:46:20.818 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-21T00:46:20.818 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-21T00:46:20.818 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-09-21T00:46:20.818 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-21T00:46:20.818 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-21T00:46:20.818 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-21T00:46:20.819 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-21T00:46:20.819 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-21T00:46:20.819 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-21T00:46:20.819 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-21T00:46:20.819 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-21T00:46:20.819 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-21T00:46:20.819 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-21T00:46:20.819 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-21T00:46:20.819 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-21T00:46:20.819 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-21T00:46:20.819 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-21T00:46:20.819 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-21T00:46:20.819 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-21T00:46:20.819 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-21T00:46:20.820 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-21T00:46:20.820 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-21T00:46:20.820 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-21T00:46:20.820 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-21T00:46:20.820 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-21T00:46:20.820 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-21T00:46:20.820 DEBUG:teuthology.orchestra.run.smithi001:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-21T00:46:20.836 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = d3972c20-77b2-11ef-baf5-efdc52797490 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 2024-09-21T00:46:20.837 DEBUG:teuthology.orchestra.run.smithi001:mon.a> sudo journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mon.a.service 2024-09-21T00:46:20.879 DEBUG:teuthology.orchestra.run.smithi001:mgr.x> sudo journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mgr.x.service 2024-09-21T00:46:20.921 INFO:tasks.cephadm:Bootstrapping... 2024-09-21T00:46:20.922 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 -v bootstrap --fsid d3972c20-77b2-11ef-baf5-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.1 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-21T00:46:21.132 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:46:21.132 INFO:teuthology.orchestra.run.smithi001.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', '-v', 'bootstrap', '--fsid', 'd3972c20-77b2-11ef-baf5-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.1', '--skip-admin-label'] 2024-09-21T00:46:21.132 INFO:teuthology.orchestra.run.smithi001.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-21T00:46:21.132 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying podman|docker is present... 2024-09-21T00:46:21.162 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stdout 5.2.2 2024-09-21T00:46:21.162 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying lvm2 is present... 2024-09-21T00:46:21.162 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying time synchronization is in place... 2024-09-21T00:46:21.170 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T00:46:21.170 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T00:46:21.177 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T00:46:21.177 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-09-21T00:46:21.184 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout enabled 2024-09-21T00:46:21.190 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout active 2024-09-21T00:46:21.190 INFO:teuthology.orchestra.run.smithi001.stdout:Unit chronyd.service is enabled and running 2024-09-21T00:46:21.190 INFO:teuthology.orchestra.run.smithi001.stdout:Repeating the final host check... 2024-09-21T00:46:21.212 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stdout 5.2.2 2024-09-21T00:46:21.212 INFO:teuthology.orchestra.run.smithi001.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-21T00:46:21.213 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl is present 2024-09-21T00:46:21.213 INFO:teuthology.orchestra.run.smithi001.stdout:lvcreate is present 2024-09-21T00:46:21.219 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T00:46:21.219 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T00:46:21.225 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T00:46:21.226 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-09-21T00:46:21.232 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout enabled 2024-09-21T00:46:21.239 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout active 2024-09-21T00:46:21.239 INFO:teuthology.orchestra.run.smithi001.stdout:Unit chronyd.service is enabled and running 2024-09-21T00:46:21.239 INFO:teuthology.orchestra.run.smithi001.stdout:Host looks OK 2024-09-21T00:46:21.239 INFO:teuthology.orchestra.run.smithi001.stdout:Cluster fsid: d3972c20-77b2-11ef-baf5-efdc52797490 2024-09-21T00:46:21.239 INFO:teuthology.orchestra.run.smithi001.stdout:Acquiring lock 139993961593200 on /run/cephadm/d3972c20-77b2-11ef-baf5-efdc52797490.lock 2024-09-21T00:46:21.239 INFO:teuthology.orchestra.run.smithi001.stdout:Lock 139993961593200 acquired on /run/cephadm/d3972c20-77b2-11ef-baf5-efdc52797490.lock 2024-09-21T00:46:21.240 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying IP 172.21.15.1 port 3300 ... 2024-09-21T00:46:21.240 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying IP 172.21.15.1 port 6789 ... 2024-09-21T00:46:21.240 INFO:teuthology.orchestra.run.smithi001.stdout:Base mon IP(s) is [172.21.15.1:3300, 172.21.15.1:6789], mon addrv is [v2:172.21.15.1:3300,v1:172.21.15.1:6789] 2024-09-21T00:46:21.243 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.1 metric 100 2024-09-21T00:46:21.244 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.1 metric 100 2024-09-21T00:46:21.246 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-21T00:46:21.246 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-21T00:46:21.246 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1795sec hoplimit 64 pref medium 2024-09-21T00:46:21.249 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-21T00:46:21.249 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-21T00:46:21.249 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T00:46:21.249 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-21T00:46:21.249 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:15e8/64 scope link 2024-09-21T00:46:21.249 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T00:46:21.250 INFO:teuthology.orchestra.run.smithi001.stdout:Mon IP `172.21.15.1` is in CIDR network `172.21.0.0/20` 2024-09-21T00:46:21.250 INFO:teuthology.orchestra.run.smithi001.stdout:Mon IP `172.21.15.1` is in CIDR network `172.21.0.0/20` 2024-09-21T00:46:21.250 INFO:teuthology.orchestra.run.smithi001.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-21T00:46:21.250 INFO:teuthology.orchestra.run.smithi001.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-21T00:46:21.251 INFO:teuthology.orchestra.run.smithi001.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T00:46:21.725 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stdout ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T00:46:21.726 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T00:46:21.726 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Getting image source signatures 2024-09-21T00:46:21.726 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Copying blob sha256:8425bc7408d91b180e7fdc62f23e7ae6603757f4f36e9969a4eaf9fd9416b764 2024-09-21T00:46:21.726 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-21T00:46:21.726 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Copying config sha256:ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T00:46:21.726 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-21T00:46:22.659 INFO:teuthology.orchestra.run.smithi001.stdout:ceph: stdout ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T00:46:22.659 INFO:teuthology.orchestra.run.smithi001.stdout:Ceph version: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T00:46:22.659 INFO:teuthology.orchestra.run.smithi001.stdout:Extracting ceph user uid/gid from container image... 2024-09-21T00:46:23.654 INFO:teuthology.orchestra.run.smithi001.stdout:stat: stdout 167 167 2024-09-21T00:46:23.654 INFO:teuthology.orchestra.run.smithi001.stdout:Creating initial keys... 2024-09-21T00:46:24.593 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph-authtool: stdout AQBfF+5mrEHbOhAAK8cBkjwg43HojejKS0PGTw== 2024-09-21T00:46:25.465 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph-authtool: stdout AQBgF+5mFiahNhAAOyp5D+UcxptO3tMo6UtwSQ== 2024-09-21T00:46:26.404 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph-authtool: stdout AQBhF+5m1wnbMRAA+vSFVMoBCtP7HzJDQzcEpg== 2024-09-21T00:46:26.405 INFO:teuthology.orchestra.run.smithi001.stdout:Creating initial monmap... 2024-09-21T00:46:27.320 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T00:46:27.320 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-21T00:46:27.320 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to d3972c20-77b2-11ef-baf5-efdc52797490 2024-09-21T00:46:27.320 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T00:46:27.320 INFO:teuthology.orchestra.run.smithi001.stdout:monmaptool for a [v2:172.21.15.1:3300,v1:172.21.15.1:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T00:46:27.320 INFO:teuthology.orchestra.run.smithi001.stdout:setting min_mon_release = quincy 2024-09-21T00:46:27.320 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: set fsid to d3972c20-77b2-11ef-baf5-efdc52797490 2024-09-21T00:46:27.320 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T00:46:27.320 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:46:27.320 INFO:teuthology.orchestra.run.smithi001.stdout:Creating mon... 2024-09-21T00:46:28.207 INFO:teuthology.orchestra.run.smithi001.stdout:create mon.a on 2024-09-21T00:46:28.426 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-21T00:46:28.597 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-21T00:46:28.784 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-d3972c20-77b2-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-d3972c20-77b2-11ef-baf5-efdc52797490.target. 2024-09-21T00:46:28.784 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-d3972c20-77b2-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-d3972c20-77b2-11ef-baf5-efdc52797490.target. 2024-09-21T00:46:29.053 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mon.a 2024-09-21T00:46:29.053 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mon.a.service: Unit ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mon.a.service not loaded. 2024-09-21T00:46:29.232 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d3972c20-77b2-11ef-baf5-efdc52797490.target.wants/ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mon.a.service → /etc/systemd/system/ceph-d3972c20-77b2-11ef-baf5-efdc52797490@.service. 2024-09-21T00:46:29.285 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:29 smithi001 systemd[1]: Starting Ceph mon.a for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T00:46:29.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:29 smithi001 podman[30822]: 2024-09-21 00:46:29.374841438 +0000 UTC m=+0.018104324 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:46:29.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:29 smithi001 podman[30822]: 2024-09-21 00:46:29.482319319 +0000 UTC m=+0.125582200 container create f9aaac3a95b41fa320f03ad1a445fbf59bd32d5029486fc10c56004a2cab67bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mon-a, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T00:46:29.766 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T00:46:29.766 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout disabled 2024-09-21T00:46:29.773 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T00:46:29.774 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-09-21T00:46:29.774 INFO:teuthology.orchestra.run.smithi001.stdout:firewalld.service is not enabled 2024-09-21T00:46:29.774 INFO:teuthology.orchestra.run.smithi001.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T00:46:29.774 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mon to start... 2024-09-21T00:46:29.774 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mon... 2024-09-21T00:46:29.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:29 smithi001 podman[30822]: 2024-09-21 00:46:29.692849364 +0000 UTC m=+0.336112250 container init f9aaac3a95b41fa320f03ad1a445fbf59bd32d5029486fc10c56004a2cab67bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mon-a, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-21T00:46:29.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:29 smithi001 podman[30822]: 2024-09-21 00:46:29.696848728 +0000 UTC m=+0.340111610 container start f9aaac3a95b41fa320f03ad1a445fbf59bd32d5029486fc10c56004a2cab67bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD) 2024-09-21T00:46:29.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:29 smithi001 ceph-mon[30841]: mkfs d3972c20-77b2-11ef-baf5-efdc52797490 2024-09-21T00:46:29.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:29 smithi001 ceph-mon[30841]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T00:46:29.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:29 smithi001 bash[30822]: f9aaac3a95b41fa320f03ad1a445fbf59bd32d5029486fc10c56004a2cab67bc 2024-09-21T00:46:29.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:29 smithi001 systemd[1]: Started Ceph mon.a for d3972c20-77b2-11ef-baf5-efdc52797490. 2024-09-21T00:46:30.854 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout cluster: 2024-09-21T00:46:30.854 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout id: d3972c20-77b2-11ef-baf5-efdc52797490 2024-09-21T00:46:30.854 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-21T00:46:30.855 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-21T00:46:30.855 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout services: 2024-09-21T00:46:30.855 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.562499s) 2024-09-21T00:46:30.855 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-21T00:46:30.855 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-21T00:46:30.855 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-21T00:46:30.855 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout data: 2024-09-21T00:46:30.855 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-21T00:46:30.855 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-21T00:46:30.855 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-21T00:46:30.855 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout pgs: 2024-09-21T00:46:30.855 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-21T00:46:30.855 INFO:teuthology.orchestra.run.smithi001.stdout:mon is available 2024-09-21T00:46:30.855 INFO:teuthology.orchestra.run.smithi001.stdout:Assimilating anything we can from ceph.conf... 2024-09-21T00:46:30.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:30 smithi001 ceph-mon[30841]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T00:46:30.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:30 smithi001 ceph-mon[30841]: monmap epoch 1 2024-09-21T00:46:30.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:30 smithi001 ceph-mon[30841]: fsid d3972c20-77b2-11ef-baf5-efdc52797490 2024-09-21T00:46:30.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:30 smithi001 ceph-mon[30841]: last_changed 2024-09-21T00:46:26.733268+0000 2024-09-21T00:46:30.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:30 smithi001 ceph-mon[30841]: created 2024-09-21T00:46:26.733268+0000 2024-09-21T00:46:30.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:30 smithi001 ceph-mon[30841]: min_mon_release 19 (squid) 2024-09-21T00:46:30.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:30 smithi001 ceph-mon[30841]: election_strategy: 1 2024-09-21T00:46:30.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:30 smithi001 ceph-mon[30841]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-21T00:46:30.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:30 smithi001 ceph-mon[30841]: fsmap 2024-09-21T00:46:30.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:30 smithi001 ceph-mon[30841]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T00:46:30.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:30 smithi001 ceph-mon[30841]: mgrmap e1: no daemons active 2024-09-21T00:46:30.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:30 smithi001 ceph-mon[30841]: from='client.? 172.21.15.1:0/1376241290' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-21T00:46:31.837 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-21T00:46:31.837 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T00:46:31.837 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout fsid = d3972c20-77b2-11ef-baf5-efdc52797490 2024-09-21T00:46:31.837 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T00:46:31.837 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.1:3300,v1:172.21.15.1:6789] 2024-09-21T00:46:31.837 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T00:46:31.837 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T00:46:31.837 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T00:46:31.838 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T00:46:31.838 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-21T00:46:31.838 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T00:46:31.838 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T00:46:31.838 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-21T00:46:31.838 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T00:46:31.838 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T00:46:31.838 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T00:46:31.838 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T00:46:31.838 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T00:46:31.838 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T00:46:31.838 INFO:teuthology.orchestra.run.smithi001.stdout:Generating new minimal ceph.conf... 2024-09-21T00:46:31.950 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:31 smithi001 ceph-mon[30841]: from='client.? 172.21.15.1:0/980761676' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T00:46:31.950 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:31 smithi001 ceph-mon[30841]: from='client.? 172.21.15.1:0/980761676' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-21T00:46:32.905 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:32 smithi001 ceph-mon[30841]: from='client.? 172.21.15.1:0/1529678531' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:46:32.908 INFO:teuthology.orchestra.run.smithi001.stdout:Restarting the monitor... 2024-09-21T00:46:33.193 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:32 smithi001 systemd[1]: Stopping Ceph mon.a for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T00:46:33.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:33 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mon-a[30837]: 2024-09-21T00:46:33.190+0000 7f4f96080640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T00:46:33.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:33 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mon-a[30837]: 2024-09-21T00:46:33.190+0000 7f4f96080640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-21T00:46:33.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:33 smithi001 podman[31084]: 2024-09-21 00:46:33.263726425 +0000 UTC m=+0.186247560 container died f9aaac3a95b41fa320f03ad1a445fbf59bd32d5029486fc10c56004a2cab67bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mon-a, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T00:46:33.895 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:33 smithi001 podman[31084]: 2024-09-21 00:46:33.683249968 +0000 UTC m=+0.605771091 container cleanup f9aaac3a95b41fa320f03ad1a445fbf59bd32d5029486fc10c56004a2cab67bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mon-a, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux ) 2024-09-21T00:46:33.895 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:33 smithi001 bash[31084]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mon-a 2024-09-21T00:46:34.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:33 smithi001 podman[31095]: 2024-09-21 00:46:33.894755786 +0000 UTC m=+0.622198855 container remove f9aaac3a95b41fa320f03ad1a445fbf59bd32d5029486fc10c56004a2cab67bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mon-a, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-21T00:46:34.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 systemd[1]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T00:46:34.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 systemd[1]: Stopped Ceph mon.a for d3972c20-77b2-11ef-baf5-efdc52797490. 2024-09-21T00:46:34.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 systemd[1]: Starting Ceph mon.a for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T00:46:34.521 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 podman[31192]: 2024-09-21 00:46:34.22674207 +0000 UTC m=+0.093667288 container create cf9589d851866bcaa582824d56d9222900c430fe1d3313842d992dd218ff1f44 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T00:46:34.521 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 podman[31192]: 2024-09-21 00:46:34.149037854 +0000 UTC m=+0.015963023 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:46:34.521 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 podman[31192]: 2024-09-21 00:46:34.429020831 +0000 UTC m=+0.295946016 container init cf9589d851866bcaa582824d56d9222900c430fe1d3313842d992dd218ff1f44 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-21T00:46:34.521 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 podman[31192]: 2024-09-21 00:46:34.432253639 +0000 UTC m=+0.299178798 container start cf9589d851866bcaa582824d56d9222900c430fe1d3313842d992dd218ff1f44 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mon-a, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T00:46:34.521 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T00:46:34.521 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T00:46:34.522 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: pidfile_write: ignore empty --pid-file 2024-09-21T00:46:34.522 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: load: jerasure load: lrc 2024-09-21T00:46:34.522 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: RocksDB version: 7.9.2 2024-09-21T00:46:34.522 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Git sha 0 2024-09-21T00:46:34.522 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T00:46:34.522 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: DB SUMMARY 2024-09-21T00:46:34.522 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: DB Session ID: CKOMWJAB0DFHX6DI6ZV8 2024-09-21T00:46:34.522 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: CURRENT file: CURRENT 2024-09-21T00:46:34.522 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T00:46:34.522 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-21T00:46:34.522 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-21T00:46:34.522 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 95364 ; 2024-09-21T00:46:34.522 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.error_if_exists: 0 2024-09-21T00:46:34.522 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.create_if_missing: 0 2024-09-21T00:46:34.523 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.paranoid_checks: 1 2024-09-21T00:46:34.523 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T00:46:34.523 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T00:46:34.523 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T00:46:34.523 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.env: 0x5589cfc20d60 2024-09-21T00:46:34.523 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T00:46:34.523 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.info_log: 0x5589d5e1d360 2024-09-21T00:46:34.523 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T00:46:34.523 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.statistics: (nil) 2024-09-21T00:46:34.523 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.use_fsync: 0 2024-09-21T00:46:34.523 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.max_log_file_size: 0 2024-09-21T00:46:34.523 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T00:46:34.523 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T00:46:34.523 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T00:46:34.523 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T00:46:34.524 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.allow_fallocate: 1 2024-09-21T00:46:34.524 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T00:46:34.524 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T00:46:34.524 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.use_direct_reads: 0 2024-09-21T00:46:34.524 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T00:46:34.524 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T00:46:34.524 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.db_log_dir: 2024-09-21T00:46:34.524 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.wal_dir: 2024-09-21T00:46:34.524 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T00:46:34.524 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T00:46:34.524 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T00:46:34.524 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T00:46:34.524 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T00:46:34.524 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T00:46:34.524 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T00:46:34.524 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T00:46:34.524 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.write_buffer_manager: 0x5589d5e21d60 2024-09-21T00:46:34.525 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T00:46:34.525 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T00:46:34.525 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T00:46:34.525 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T00:46:34.526 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T00:46:34.526 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T00:46:34.526 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T00:46:34.526 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T00:46:34.526 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.unordered_write: 0 2024-09-21T00:46:34.526 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T00:46:34.526 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T00:46:34.526 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T00:46:34.526 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T00:46:34.526 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.row_cache: None 2024-09-21T00:46:34.527 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.wal_filter: None 2024-09-21T00:46:34.527 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T00:46:34.527 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T00:46:34.527 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.two_write_queues: 0 2024-09-21T00:46:34.527 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T00:46:34.527 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.wal_compression: 0 2024-09-21T00:46:34.527 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.atomic_flush: 0 2024-09-21T00:46:34.527 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T00:46:34.527 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T00:46:34.527 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T00:46:34.527 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.log_readahead_size: 0 2024-09-21T00:46:34.527 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T00:46:34.527 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T00:46:34.527 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T00:46:34.528 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T00:46:34.528 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T00:46:34.528 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T00:46:34.528 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T00:46:34.528 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.max_background_jobs: 2 2024-09-21T00:46:34.528 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.max_background_compactions: -1 2024-09-21T00:46:34.528 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.max_subcompactions: 1 2024-09-21T00:46:34.528 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T00:46:34.528 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T00:46:34.528 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T00:46:34.528 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T00:46:34.528 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T00:46:34.528 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T00:46:34.528 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T00:46:34.528 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T00:46:34.528 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.max_open_files: -1 2024-09-21T00:46:34.529 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T00:46:34.529 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T00:46:34.529 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T00:46:34.529 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T00:46:34.529 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.max_background_flushes: -1 2024-09-21T00:46:34.529 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Compression algorithms supported: 2024-09-21T00:46:34.529 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: kZSTD supported: 0 2024-09-21T00:46:34.529 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: kXpressCompression supported: 0 2024-09-21T00:46:34.529 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: kBZip2Compression supported: 0 2024-09-21T00:46:34.529 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T00:46:34.529 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: kLZ4Compression supported: 1 2024-09-21T00:46:34.529 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: kZlibCompression supported: 1 2024-09-21T00:46:34.529 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T00:46:34.529 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: kSnappyCompression supported: 1 2024-09-21T00:46:34.529 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T00:46:34.530 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T00:46:34.530 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-21T00:46:34.530 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T00:46:34.530 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T00:46:34.530 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.merge_operator: 2024-09-21T00:46:34.530 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.compaction_filter: None 2024-09-21T00:46:34.530 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T00:46:34.530 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T00:46:34.530 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T00:46:34.530 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T00:46:34.530 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5589d5e1cfa0) 2024-09-21T00:46:34.530 INFO:journalctl@ceph.mon.a.smithi001.stdout: cache_index_and_filter_blocks: 1 2024-09-21T00:46:34.530 INFO:journalctl@ceph.mon.a.smithi001.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T00:46:34.530 INFO:journalctl@ceph.mon.a.smithi001.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T00:46:34.530 INFO:journalctl@ceph.mon.a.smithi001.stdout: pin_top_level_index_and_filter: 1 2024-09-21T00:46:34.530 INFO:journalctl@ceph.mon.a.smithi001.stdout: index_type: 0 2024-09-21T00:46:34.531 INFO:journalctl@ceph.mon.a.smithi001.stdout: data_block_index_type: 0 2024-09-21T00:46:34.531 INFO:journalctl@ceph.mon.a.smithi001.stdout: index_shortening: 1 2024-09-21T00:46:34.531 INFO:journalctl@ceph.mon.a.smithi001.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T00:46:34.531 INFO:journalctl@ceph.mon.a.smithi001.stdout: checksum: 4 2024-09-21T00:46:34.531 INFO:journalctl@ceph.mon.a.smithi001.stdout: no_block_cache: 0 2024-09-21T00:46:34.531 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_cache: 0x5589d1de1610 2024-09-21T00:46:34.531 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_cache_name: BinnedLRUCache 2024-09-21T00:46:34.531 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_cache_options: 2024-09-21T00:46:34.531 INFO:journalctl@ceph.mon.a.smithi001.stdout: capacity : 536870912 2024-09-21T00:46:34.531 INFO:journalctl@ceph.mon.a.smithi001.stdout: num_shard_bits : 4 2024-09-21T00:46:34.531 INFO:journalctl@ceph.mon.a.smithi001.stdout: strict_capacity_limit : 0 2024-09-21T00:46:34.531 INFO:journalctl@ceph.mon.a.smithi001.stdout: high_pri_pool_ratio: 0.000 2024-09-21T00:46:34.531 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_cache_compressed: (nil) 2024-09-21T00:46:34.531 INFO:journalctl@ceph.mon.a.smithi001.stdout: persistent_cache: (nil) 2024-09-21T00:46:34.531 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_size: 4096 2024-09-21T00:46:34.532 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_size_deviation: 10 2024-09-21T00:46:34.532 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_restart_interval: 16 2024-09-21T00:46:34.532 INFO:journalctl@ceph.mon.a.smithi001.stdout: index_block_restart_interval: 1 2024-09-21T00:46:34.532 INFO:journalctl@ceph.mon.a.smithi001.stdout: metadata_block_size: 4096 2024-09-21T00:46:34.532 INFO:journalctl@ceph.mon.a.smithi001.stdout: partition_filters: 0 2024-09-21T00:46:34.532 INFO:journalctl@ceph.mon.a.smithi001.stdout: use_delta_encoding: 1 2024-09-21T00:46:34.532 INFO:journalctl@ceph.mon.a.smithi001.stdout: filter_policy: bloomfilter 2024-09-21T00:46:34.532 INFO:journalctl@ceph.mon.a.smithi001.stdout: whole_key_filtering: 1 2024-09-21T00:46:34.532 INFO:journalctl@ceph.mon.a.smithi001.stdout: verify_compression: 0 2024-09-21T00:46:34.532 INFO:journalctl@ceph.mon.a.smithi001.stdout: read_amp_bytes_per_bit: 0 2024-09-21T00:46:34.532 INFO:journalctl@ceph.mon.a.smithi001.stdout: format_version: 5 2024-09-21T00:46:34.532 INFO:journalctl@ceph.mon.a.smithi001.stdout: enable_index_compression: 1 2024-09-21T00:46:34.532 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_align: 0 2024-09-21T00:46:34.532 INFO:journalctl@ceph.mon.a.smithi001.stdout: max_auto_readahead_size: 262144 2024-09-21T00:46:34.532 INFO:journalctl@ceph.mon.a.smithi001.stdout: prepopulate_block_cache: 0 2024-09-21T00:46:34.533 INFO:journalctl@ceph.mon.a.smithi001.stdout: initial_auto_readahead_size: 8192 2024-09-21T00:46:34.533 INFO:journalctl@ceph.mon.a.smithi001.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T00:46:34.533 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T00:46:34.533 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T00:46:34.533 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.compression: NoCompression 2024-09-21T00:46:34.533 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T00:46:34.533 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T00:46:34.533 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T00:46:34.533 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.num_levels: 7 2024-09-21T00:46:34.533 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T00:46:34.533 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T00:46:34.533 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T00:46:34.533 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T00:46:34.533 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T00:46:34.533 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T00:46:34.533 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T00:46:34.534 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T00:46:34.534 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T00:46:34.534 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T00:46:34.534 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T00:46:34.534 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T00:46:34.534 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T00:46:34.534 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T00:46:34.534 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T00:46:34.534 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T00:46:34.534 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T00:46:34.534 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T00:46:34.534 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T00:46:34.534 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T00:46:34.534 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T00:46:34.534 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T00:46:34.535 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T00:46:34.535 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T00:46:34.535 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T00:46:34.535 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T00:46:34.535 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T00:46:34.535 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T00:46:34.535 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T00:46:34.535 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T00:46:34.535 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T00:46:34.535 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T00:46:34.535 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T00:46:34.535 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T00:46:34.535 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T00:46:34.535 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T00:46:34.535 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T00:46:34.535 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T00:46:34.536 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T00:46:34.536 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T00:46:34.536 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T00:46:34.536 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T00:46:34.536 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T00:46:34.536 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T00:46:34.536 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T00:46:34.536 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T00:46:34.536 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T00:46:34.536 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T00:46:34.536 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T00:46:34.536 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T00:46:34.536 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T00:46:34.536 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T00:46:34.536 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T00:46:34.536 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T00:46:34.537 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.inplace_update_support: 0 2024-09-21T00:46:34.537 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T00:46:34.537 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T00:46:34.537 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T00:46:34.537 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T00:46:34.537 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.bloom_locality: 0 2024-09-21T00:46:34.537 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.max_successive_merges: 0 2024-09-21T00:46:34.537 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T00:46:34.537 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T00:46:34.537 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T00:46:34.537 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T00:46:34.537 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.ttl: 2592000 2024-09-21T00:46:34.537 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T00:46:34.537 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T00:46:34.537 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T00:46:34.537 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.enable_blob_files: false 2024-09-21T00:46:34.538 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.min_blob_size: 0 2024-09-21T00:46:34.538 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T00:46:34.538 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T00:46:34.538 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T00:46:34.538 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T00:46:34.538 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T00:46:34.538 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T00:46:34.538 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T00:46:34.538 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T00:46:34.538 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-21T00:46:34.538 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-21T00:46:34.538 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 4b43ea8b-d7d1-4f51-8cac-7e34d26cca1f 2024-09-21T00:46:34.538 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726879594468366, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-21T00:46:34.539 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-21T00:46:34.539 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726879594469548, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91551, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 285, "table_properties": {"data_size": 89592, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11738, "raw_average_key_size": 48, "raw_value_size": 82933, "raw_average_value_size": 339, "num_data_blocks": 12, "num_entries": 244, "num_filter_entries": 244, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726879594, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "4b43ea8b-d7d1-4f51-8cac-7e34d26cca1f", "db_session_id": "CKOMWJAB0DFHX6DI6ZV8", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-21T00:46:34.539 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726879594469656, "job": 1, "event": "recovery_finished"} 2024-09-21T00:46:34.539 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-21T00:46:34.539 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T00:46:34.539 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5589d5e40a80 2024-09-21T00:46:34.539 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: DB pointer 0x5589d6be6000 2024-09-21T00:46:34.539 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T00:46:34.539 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T00:46:34.539 INFO:journalctl@ceph.mon.a.smithi001.stdout: ** DB Stats ** 2024-09-21T00:46:34.539 INFO:journalctl@ceph.mon.a.smithi001.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T00:46:34.539 INFO:journalctl@ceph.mon.a.smithi001.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T00:46:34.539 INFO:journalctl@ceph.mon.a.smithi001.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T00:46:34.539 INFO:journalctl@ceph.mon.a.smithi001.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T00:46:34.539 INFO:journalctl@ceph.mon.a.smithi001.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T00:46:34.540 INFO:journalctl@ceph.mon.a.smithi001.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T00:46:34.540 INFO:journalctl@ceph.mon.a.smithi001.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T00:46:34.540 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-09-21T00:46:34.540 INFO:journalctl@ceph.mon.a.smithi001.stdout: ** Compaction Stats [default] ** 2024-09-21T00:46:34.540 INFO:journalctl@ceph.mon.a.smithi001.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T00:46:34.540 INFO:journalctl@ceph.mon.a.smithi001.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T00:46:34.540 INFO:journalctl@ceph.mon.a.smithi001.stdout: L0 2/0 91.27 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 123.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T00:46:34.540 INFO:journalctl@ceph.mon.a.smithi001.stdout: Sum 2/0 91.27 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 123.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T00:46:34.540 INFO:journalctl@ceph.mon.a.smithi001.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 123.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T00:46:34.540 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-09-21T00:46:34.540 INFO:journalctl@ceph.mon.a.smithi001.stdout: ** Compaction Stats [default] ** 2024-09-21T00:46:34.540 INFO:journalctl@ceph.mon.a.smithi001.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T00:46:34.540 INFO:journalctl@ceph.mon.a.smithi001.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T00:46:34.540 INFO:journalctl@ceph.mon.a.smithi001.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 123.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T00:46:34.540 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-09-21T00:46:34.540 INFO:journalctl@ceph.mon.a.smithi001.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T00:46:34.541 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-09-21T00:46:34.541 INFO:journalctl@ceph.mon.a.smithi001.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T00:46:34.541 INFO:journalctl@ceph.mon.a.smithi001.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T00:46:34.541 INFO:journalctl@ceph.mon.a.smithi001.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T00:46:34.541 INFO:journalctl@ceph.mon.a.smithi001.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T00:46:34.541 INFO:journalctl@ceph.mon.a.smithi001.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T00:46:34.541 INFO:journalctl@ceph.mon.a.smithi001.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T00:46:34.541 INFO:journalctl@ceph.mon.a.smithi001.stdout: Cumulative compaction: 0.00 GB write, 25.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T00:46:34.541 INFO:journalctl@ceph.mon.a.smithi001.stdout: Interval compaction: 0.00 GB write, 25.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T00:46:34.541 INFO:journalctl@ceph.mon.a.smithi001.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T00:46:34.541 INFO:journalctl@ceph.mon.a.smithi001.stdout: Block cache BinnedLRUCache@0x5589d1de1610#2 capacity: 512.00 MB usage: 1.31 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-21T00:46:34.541 INFO:journalctl@ceph.mon.a.smithi001.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-21T00:46:34.542 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-09-21T00:46:34.542 INFO:journalctl@ceph.mon.a.smithi001.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T00:46:34.542 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: starting mon.a rank 0 at public addrs [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] at bind addrs [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid d3972c20-77b2-11ef-baf5-efdc52797490 2024-09-21T00:46:34.542 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: mon.a@-1(???) e1 preinit fsid d3972c20-77b2-11ef-baf5-efdc52797490 2024-09-21T00:46:34.542 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: mon.a@-1(???).mds e1 new map 2024-09-21T00:46:34.542 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: mon.a@-1(???).mds e1 print_map 2024-09-21T00:46:34.542 INFO:journalctl@ceph.mon.a.smithi001.stdout: e1 2024-09-21T00:46:34.542 INFO:journalctl@ceph.mon.a.smithi001.stdout: btime 2024-09-21T00:46:29:745789+0000 2024-09-21T00:46:34.542 INFO:journalctl@ceph.mon.a.smithi001.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T00:46:34.542 INFO:journalctl@ceph.mon.a.smithi001.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T00:46:34.542 INFO:journalctl@ceph.mon.a.smithi001.stdout: legacy client fscid: -1 2024-09-21T00:46:34.542 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-09-21T00:46:34.542 INFO:journalctl@ceph.mon.a.smithi001.stdout: No filesystems configured 2024-09-21T00:46:34.542 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T00:46:34.543 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T00:46:34.543 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T00:46:34.543 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T00:46:34.543 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-21T00:46:34.543 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 bash[31192]: cf9589d851866bcaa582824d56d9222900c430fe1d3313842d992dd218ff1f44 2024-09-21T00:46:34.543 INFO:teuthology.orchestra.run.smithi001.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-21T00:46:34.832 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 systemd[1]: Started Ceph mon.a for d3972c20-77b2-11ef-baf5-efdc52797490. 2024-09-21T00:46:34.832 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T00:46:34.832 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: monmap epoch 1 2024-09-21T00:46:34.833 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: fsid d3972c20-77b2-11ef-baf5-efdc52797490 2024-09-21T00:46:34.833 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: last_changed 2024-09-21T00:46:26.733268+0000 2024-09-21T00:46:34.833 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: created 2024-09-21T00:46:26.733268+0000 2024-09-21T00:46:34.833 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: min_mon_release 19 (squid) 2024-09-21T00:46:34.833 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: election_strategy: 1 2024-09-21T00:46:34.833 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-21T00:46:34.833 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: fsmap 2024-09-21T00:46:34.833 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T00:46:34.833 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:34 smithi001 ceph-mon[31211]: mgrmap e1: no daemons active 2024-09-21T00:46:35.539 INFO:teuthology.orchestra.run.smithi001.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-21T00:46:35.552 INFO:teuthology.orchestra.run.smithi001.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-21T00:46:35.552 INFO:teuthology.orchestra.run.smithi001.stdout:Creating mgr... 2024-09-21T00:46:35.553 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-21T00:46:35.554 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-21T00:46:35.814 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mgr.x 2024-09-21T00:46:35.814 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mgr.x.service: Unit ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mgr.x.service not loaded. 2024-09-21T00:46:35.965 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d3972c20-77b2-11ef-baf5-efdc52797490.target.wants/ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mgr.x.service → /etc/systemd/system/ceph-d3972c20-77b2-11ef-baf5-efdc52797490@.service. 2024-09-21T00:46:36.196 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:35 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/264310895' entity='client.admin' 2024-09-21T00:46:36.460 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:46:36 smithi001 podman[31424]: 2024-09-21 00:46:36.39286961 +0000 UTC m=+0.305707852 container start 107c19e3a41fcb34112c4f2ac8f94033095c540229c97cec871946ecf5eef34c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T00:46:36.499 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T00:46:36.499 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout disabled 2024-09-21T00:46:36.506 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T00:46:36.506 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-09-21T00:46:36.506 INFO:teuthology.orchestra.run.smithi001.stdout:firewalld.service is not enabled 2024-09-21T00:46:36.507 INFO:teuthology.orchestra.run.smithi001.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T00:46:36.516 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T00:46:36.516 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout disabled 2024-09-21T00:46:36.524 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T00:46:36.524 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-09-21T00:46:36.524 INFO:teuthology.orchestra.run.smithi001.stdout:firewalld.service is not enabled 2024-09-21T00:46:36.524 INFO:teuthology.orchestra.run.smithi001.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-21T00:46:36.524 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mgr to start... 2024-09-21T00:46:36.524 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mgr... 2024-09-21T00:46:36.760 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:46:36 smithi001 bash[31424]: 107c19e3a41fcb34112c4f2ac8f94033095c540229c97cec871946ecf5eef34c 2024-09-21T00:46:36.760 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:46:36 smithi001 systemd[1]: Started Ceph mgr.x for d3972c20-77b2-11ef-baf5-efdc52797490. 2024-09-21T00:46:37.346 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:37 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/2580582859' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T00:46:37.649 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-21T00:46:37.651 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-21T00:46:37.651 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsid": "d3972c20-77b2-11ef-baf5-efdc52797490", 2024-09-21T00:46:37.651 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T00:46:37.652 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T00:46:37.652 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T00:46:37.652 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T00:46:37.652 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:46:37.652 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T00:46:37.652 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T00:46:37.652 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 0 2024-09-21T00:46:37.652 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-21T00:46:37.652 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T00:46:37.652 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T00:46:37.652 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-21T00:46:37.652 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-21T00:46:37.652 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T00:46:37.652 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:46:37.653 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T00:46:37.653 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T00:46:37.653 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:46:37.653 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T00:46:37.653 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:46:37.653 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T00:46:37.653 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T00:46:37.653 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T00:46:37.657 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T00:46:37.657 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T00:46:37.657 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T00:46:37.657 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:46:37.657 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T00:46:37.657 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T00:46:37.657 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T00:46:37.657 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T00:46:37.657 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T00:46:37.657 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T00:46:37.657 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T00:46:37.657 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T00:46:37.657 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T00:46:37.658 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:46:37.658 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T00:46:37.658 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:46:37.658 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T00:46:29:745789+0000", 2024-09-21T00:46:37.658 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T00:46:37.658 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T00:46:37.658 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:46:37.658 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T00:46:37.658 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T00:46:37.658 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T00:46:37.658 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T00:46:37.658 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T00:46:37.659 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T00:46:37.659 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T00:46:37.659 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-21T00:46:37.659 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T00:46:37.659 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:46:37.659 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T00:46:37.659 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:46:37.659 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T00:46:29.746585+0000", 2024-09-21T00:46:37.659 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T00:46:37.659 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:46:37.659 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T00:46:37.659 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-21T00:46:37.659 INFO:teuthology.orchestra.run.smithi001.stdout:mgr not available, waiting (1/15)... 2024-09-21T00:46:41.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:41 smithi001 ceph-mon[31211]: Activating manager daemon x 2024-09-21T00:46:41.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:41 smithi001 ceph-mon[31211]: mgrmap e2: x(active, starting, since 0.00403653s) 2024-09-21T00:46:41.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:41 smithi001 ceph-mon[31211]: from='mgr.14100 172.21.15.1:0/3185423484' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T00:46:41.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:41 smithi001 ceph-mon[31211]: from='mgr.14100 172.21.15.1:0/3185423484' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T00:46:41.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:41 smithi001 ceph-mon[31211]: from='mgr.14100 172.21.15.1:0/3185423484' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T00:46:41.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:41 smithi001 ceph-mon[31211]: from='mgr.14100 172.21.15.1:0/3185423484' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:46:41.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:41 smithi001 ceph-mon[31211]: from='mgr.14100 172.21.15.1:0/3185423484' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T00:46:41.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:41 smithi001 ceph-mon[31211]: Manager daemon x is now available 2024-09-21T00:46:41.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:41 smithi001 ceph-mon[31211]: from='mgr.14100 172.21.15.1:0/3185423484' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T00:46:41.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:41 smithi001 ceph-mon[31211]: from='mgr.14100 172.21.15.1:0/3185423484' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T00:46:41.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:41 smithi001 ceph-mon[31211]: from='mgr.14100 172.21.15.1:0/3185423484' entity='mgr.x' 2024-09-21T00:46:41.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:41 smithi001 ceph-mon[31211]: from='mgr.14100 172.21.15.1:0/3185423484' entity='mgr.x' 2024-09-21T00:46:41.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:41 smithi001 ceph-mon[31211]: from='mgr.14100 172.21.15.1:0/3185423484' entity='mgr.x' 2024-09-21T00:46:43.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:43 smithi001 ceph-mon[31211]: mgrmap e3: x(active, since 1.00884s) 2024-09-21T00:46:43.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:43 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1972933886' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T00:46:44.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:44 smithi001 ceph-mon[31211]: mgrmap e4: x(active, since 2s) 2024-09-21T00:46:49.210 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-21T00:46:49.210 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-21T00:46:49.210 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsid": "d3972c20-77b2-11ef-baf5-efdc52797490", 2024-09-21T00:46:49.210 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T00:46:49.210 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T00:46:49.210 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T00:46:49.211 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T00:46:49.211 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:46:49.211 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T00:46:49.211 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T00:46:49.211 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 0 2024-09-21T00:46:49.211 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-21T00:46:49.211 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T00:46:49.211 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T00:46:49.211 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-21T00:46:49.211 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-21T00:46:49.211 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T00:46:49.211 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:46:49.211 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T00:46:49.211 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T00:46:49.212 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:46:49.212 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T00:46:49.212 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:46:49.212 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T00:46:49.212 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T00:46:49.212 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T00:46:49.215 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T00:46:49.215 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T00:46:49.215 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T00:46:49.215 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:46:49.215 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T00:46:49.215 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T00:46:49.215 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T00:46:49.216 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T00:46:49.216 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T00:46:49.216 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T00:46:49.216 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T00:46:49.216 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T00:46:49.216 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T00:46:49.216 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:46:49.216 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T00:46:49.216 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:46:49.216 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T00:46:29:745789+0000", 2024-09-21T00:46:49.216 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T00:46:49.216 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T00:46:49.216 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:46:49.216 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T00:46:49.216 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T00:46:49.217 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T00:46:49.217 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T00:46:49.217 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T00:46:49.217 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T00:46:49.217 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T00:46:49.217 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-21T00:46:49.217 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T00:46:49.217 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:46:49.217 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T00:46:49.217 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:46:49.217 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T00:46:29.746585+0000", 2024-09-21T00:46:49.217 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T00:46:49.217 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:46:49.217 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T00:46:49.217 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-21T00:46:49.217 INFO:teuthology.orchestra.run.smithi001.stdout:mgr is available 2024-09-21T00:46:52.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:52 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/2873454348' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T00:46:52.954 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-21T00:46:52.956 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T00:46:52.956 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout fsid = d3972c20-77b2-11ef-baf5-efdc52797490 2024-09-21T00:46:52.956 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T00:46:52.956 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.1:3300,v1:172.21.15.1:6789] 2024-09-21T00:46:52.956 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T00:46:52.957 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T00:46:52.957 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T00:46:52.957 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T00:46:52.957 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-21T00:46:52.957 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T00:46:52.957 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T00:46:52.957 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-21T00:46:52.957 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T00:46:52.957 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T00:46:52.957 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T00:46:52.957 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T00:46:52.957 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T00:46:52.957 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T00:46:52.957 INFO:teuthology.orchestra.run.smithi001.stdout:Enabling cephadm module... 2024-09-21T00:46:53.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:53 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/496471396' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-21T00:46:53.960 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:46:53 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: ignoring --setuser ceph since I am not root 2024-09-21T00:46:53.960 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:46:53 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: ignoring --setgroup ceph since I am not root 2024-09-21T00:46:54.922 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:54 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/496471396' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-21T00:46:54.922 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:54 smithi001 ceph-mon[31211]: mgrmap e5: x(active, since 12s) 2024-09-21T00:46:55.475 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-21T00:46:55.476 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-21T00:46:55.476 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T00:46:55.476 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T00:46:55.476 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T00:46:55.476 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-21T00:46:55.476 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for the mgr to restart... 2024-09-21T00:46:55.476 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mgr epoch 5... 2024-09-21T00:46:55.800 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:55 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/4216160047' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T00:46:59.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:59 smithi001 ceph-mon[31211]: Active manager daemon x restarted 2024-09-21T00:46:59.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:59 smithi001 ceph-mon[31211]: Activating manager daemon x 2024-09-21T00:46:59.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:59 smithi001 ceph-mon[31211]: osdmap e2: 0 total, 0 up, 0 in 2024-09-21T00:46:59.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:59 smithi001 ceph-mon[31211]: mgrmap e6: x(active, starting, since 0.00388804s) 2024-09-21T00:46:59.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:59 smithi001 ceph-mon[31211]: from='mgr.14116 172.21.15.1:0/2572489961' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:46:59.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:59 smithi001 ceph-mon[31211]: from='mgr.14116 172.21.15.1:0/2572489961' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T00:46:59.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:59 smithi001 ceph-mon[31211]: from='mgr.14116 172.21.15.1:0/2572489961' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T00:46:59.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:59 smithi001 ceph-mon[31211]: from='mgr.14116 172.21.15.1:0/2572489961' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T00:46:59.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:59 smithi001 ceph-mon[31211]: from='mgr.14116 172.21.15.1:0/2572489961' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T00:46:59.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:46:59 smithi001 ceph-mon[31211]: Manager daemon x is now available 2024-09-21T00:47:00.519 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-21T00:47:00.519 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-21T00:47:00.519 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T00:47:00.519 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-21T00:47:00.519 INFO:teuthology.orchestra.run.smithi001.stdout:mgr epoch 5 is available 2024-09-21T00:47:00.519 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying orchestrator module is enabled... 2024-09-21T00:47:01.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:00 smithi001 ceph-mon[31211]: from='mgr.14116 172.21.15.1:0/2572489961' entity='mgr.x' 2024-09-21T00:47:01.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:00 smithi001 ceph-mon[31211]: from='mgr.14116 172.21.15.1:0/2572489961' entity='mgr.x' 2024-09-21T00:47:01.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:00 smithi001 ceph-mon[31211]: Found migration_current of "None". Setting to last migration. 2024-09-21T00:47:01.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:00 smithi001 ceph-mon[31211]: from='mgr.14116 172.21.15.1:0/2572489961' entity='mgr.x' 2024-09-21T00:47:01.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:00 smithi001 ceph-mon[31211]: from='mgr.14116 172.21.15.1:0/2572489961' entity='mgr.x' 2024-09-21T00:47:01.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:00 smithi001 ceph-mon[31211]: from='mgr.14116 172.21.15.1:0/2572489961' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:47:01.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:00 smithi001 ceph-mon[31211]: from='mgr.14116 172.21.15.1:0/2572489961' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:47:01.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:00 smithi001 ceph-mon[31211]: from='mgr.14116 172.21.15.1:0/2572489961' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T00:47:01.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:00 smithi001 ceph-mon[31211]: from='mgr.14116 172.21.15.1:0/2572489961' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T00:47:01.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:00 smithi001 ceph-mon[31211]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T00:47:01.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:00 smithi001 ceph-mon[31211]: mgrmap e7: x(active, since 1.00617s) 2024-09-21T00:47:01.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:00 smithi001 ceph-mon[31211]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T00:47:02.114 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:01 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/2491780040' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2024-09-21T00:47:02.114 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:01 smithi001 ceph-mon[31211]: [21/Sep/2024:00:47:01] ENGINE Bus STARTING 2024-09-21T00:47:02.114 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:01 smithi001 ceph-mon[31211]: [21/Sep/2024:00:47:01] ENGINE Serving on https://172.21.15.1:7150 2024-09-21T00:47:02.114 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:01 smithi001 ceph-mon[31211]: [21/Sep/2024:00:47:01] ENGINE Error in HTTPServer.serve 2024-09-21T00:47:02.114 INFO:journalctl@ceph.mon.a.smithi001.stdout: Traceback (most recent call last): 2024-09-21T00:47:02.114 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T00:47:02.114 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._connections.run(self.expiration_interval) 2024-09-21T00:47:02.114 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T00:47:02.115 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._run(expiration_interval) 2024-09-21T00:47:02.115 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T00:47:02.115 INFO:journalctl@ceph.mon.a.smithi001.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T00:47:02.115 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T00:47:02.115 INFO:journalctl@ceph.mon.a.smithi001.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T00:47:02.115 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T00:47:02.115 INFO:journalctl@ceph.mon.a.smithi001.stdout: s = self.context.wrap_socket( 2024-09-21T00:47:02.115 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T00:47:02.115 INFO:journalctl@ceph.mon.a.smithi001.stdout: return self.sslsocket_class._create( 2024-09-21T00:47:02.115 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T00:47:02.115 INFO:journalctl@ceph.mon.a.smithi001.stdout: self.do_handshake() 2024-09-21T00:47:02.115 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T00:47:02.115 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._sslobj.do_handshake() 2024-09-21T00:47:02.115 INFO:journalctl@ceph.mon.a.smithi001.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T00:47:02.116 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:01 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: 2024-09-21T00:47:01.751+0000 7f2c79129640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:00:47:01] ENGINE Error in HTTPServer.serve 2024-09-21T00:47:02.116 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:01 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: Traceback (most recent call last): 2024-09-21T00:47:02.116 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:01 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T00:47:02.116 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:01 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: self._connections.run(self.expiration_interval) 2024-09-21T00:47:02.116 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:01 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T00:47:02.116 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:01 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: self._run(expiration_interval) 2024-09-21T00:47:02.116 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:01 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T00:47:02.116 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:01 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T00:47:02.116 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:01 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T00:47:02.116 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:01 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T00:47:02.116 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:01 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T00:47:02.116 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:01 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: s = self.context.wrap_socket( 2024-09-21T00:47:02.117 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:01 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T00:47:02.117 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:01 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: return self.sslsocket_class._create( 2024-09-21T00:47:02.117 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:01 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T00:47:02.117 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:01 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: self.do_handshake() 2024-09-21T00:47:02.117 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:01 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T00:47:02.117 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:01 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: self._sslobj.do_handshake() 2024-09-21T00:47:02.117 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:01 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T00:47:02.117 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:01 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: 2024-09-21T00:47:02.383 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2024-09-21T00:47:02.384 INFO:teuthology.orchestra.run.smithi001.stdout:Setting orchestrator backend to cephadm... 2024-09-21T00:47:02.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:02 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/2491780040' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2024-09-21T00:47:02.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:02 smithi001 ceph-mon[31211]: mgrmap e8: x(active, since 2s) 2024-09-21T00:47:02.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:02 smithi001 ceph-mon[31211]: [21/Sep/2024:00:47:01] ENGINE Serving on http://172.21.15.1:8765 2024-09-21T00:47:02.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:02 smithi001 ceph-mon[31211]: [21/Sep/2024:00:47:01] ENGINE Bus STARTED 2024-09-21T00:47:02.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:02 smithi001 ceph-mon[31211]: from='mgr.14116 172.21.15.1:0/2572489961' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:47:04.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:04 smithi001 ceph-mon[31211]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:04.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:04 smithi001 ceph-mon[31211]: from='mgr.14116 172.21.15.1:0/2572489961' entity='mgr.x' 2024-09-21T00:47:04.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:04 smithi001 ceph-mon[31211]: from='mgr.14116 172.21.15.1:0/2572489961' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:47:04.938 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-21T00:47:04.938 INFO:teuthology.orchestra.run.smithi001.stdout:Generating ssh key... 2024-09-21T00:47:05.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:05 smithi001 ceph-mon[31211]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:06.375 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:06 smithi001 ceph-mon[31211]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:06.375 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:06 smithi001 ceph-mon[31211]: Generating ssh key... 2024-09-21T00:47:06.375 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:06 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: Generating public/private rsa key pair. 2024-09-21T00:47:06.375 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:06 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: Your identification has been saved in /tmp/tmpp6o5pkq_/key 2024-09-21T00:47:06.375 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:06 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: Your public key has been saved in /tmp/tmpp6o5pkq_/key.pub 2024-09-21T00:47:06.376 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:06 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: The key fingerprint is: 2024-09-21T00:47:06.376 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:06 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: SHA256:0HOcP+xLg9XUWc8kLi5ol7NAx7Xrs/NSCokRTIoAa7c ceph-d3972c20-77b2-11ef-baf5-efdc52797490 2024-09-21T00:47:06.376 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:06 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: The key's randomart image is: 2024-09-21T00:47:06.376 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:06 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: +---[RSA 3072]----+ 2024-09-21T00:47:06.376 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:06 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: |... o. . . o| 2024-09-21T00:47:06.376 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:06 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: | . . . ooo o o =+| 2024-09-21T00:47:06.376 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:06 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: |.. .. o +.* o o.+| 2024-09-21T00:47:06.376 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:06 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: |. . . o.= = = | 2024-09-21T00:47:06.376 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:06 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: | E So=.B . | 2024-09-21T00:47:06.376 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:06 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: | ..ooO .. | 2024-09-21T00:47:06.376 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:06 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: | o.*o | 2024-09-21T00:47:06.376 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:06 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: | .+= | 2024-09-21T00:47:06.376 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:06 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: | o+. | 2024-09-21T00:47:06.376 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:06 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: +----[SHA256]-----+ 2024-09-21T00:47:07.285 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:07 smithi001 ceph-mon[31211]: from='mgr.14116 172.21.15.1:0/2572489961' entity='mgr.x' 2024-09-21T00:47:07.285 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:07 smithi001 ceph-mon[31211]: from='mgr.14116 172.21.15.1:0/2572489961' entity='mgr.x' 2024-09-21T00:47:07.851 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxicmObuq3xpsYyB0DQQ9brrvgqxrfWQPwv1fooxNP9wGm1AITjUeLJa2czVZn32IEEuOT3TVGyjehrWXZTwSYveSg9SYQNyAtTQraNqm9/vPZj37533XOTLLlw+IdICWl+lrVOtTllmSsYQahat1qh3qOd5GcDwQI4oAxLSF+1tDjofQuRAgqORT63MdQJW4iaAX2do9k+GYZ2dohWk30IJ2nh9A8Jya/DAVsb/Qn06jVFICS0RHbo1nZ+jDiXuJyhe1+ZcNEEnqULvSOm5kxo17MODHDezdn5ZDBpXlwyEi0uSUm3KhMU+djQzH19hYp537PX0nZq/8tsqSTGxEDJXZAEzVIeF+TKTJtF7TzXVrx3UBvZba3k+EcDs5O01sVIiTxNUtPoz3JKCerKVp8ZecgH+dHOgBlHHoLFO9KrtE08Shg573lOwzb5tPZ3wEB5VMjQPX5jXfkEsHr5sEA2APttiGb8DetgM2Z9xOzHK5OwzPn9QQdfBrDCKh+PLU= ceph-d3972c20-77b2-11ef-baf5-efdc52797490 2024-09-21T00:47:07.851 INFO:teuthology.orchestra.run.smithi001.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-21T00:47:07.851 INFO:teuthology.orchestra.run.smithi001.stdout:Adding key to root@localhost authorized_keys... 2024-09-21T00:47:07.854 INFO:teuthology.orchestra.run.smithi001.stdout:Adding host smithi001... 2024-09-21T00:47:08.184 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:08 smithi001 ceph-mon[31211]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:09.205 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:09 smithi001 ceph-mon[31211]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi001", "addr": "172.21.15.1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:10.345 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:10 smithi001 ceph-mon[31211]: Deploying cephadm binary to smithi001 2024-09-21T00:47:13.045 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout Added host 'smithi001' with addr '172.21.15.1' 2024-09-21T00:47:13.045 INFO:teuthology.orchestra.run.smithi001.stdout:Deploying unmanaged mon service... 2024-09-21T00:47:13.330 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:13 smithi001 ceph-mon[31211]: from='mgr.14116 172.21.15.1:0/2572489961' entity='mgr.x' 2024-09-21T00:47:13.330 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:13 smithi001 ceph-mon[31211]: Added host smithi001 2024-09-21T00:47:13.330 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:13 smithi001 ceph-mon[31211]: from='mgr.14116 172.21.15.1:0/2572489961' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:47:15.122 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:14 smithi001 ceph-mon[31211]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:15.122 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:14 smithi001 ceph-mon[31211]: Saving service mon spec with placement count:5 2024-09-21T00:47:15.122 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:14 smithi001 ceph-mon[31211]: from='mgr.14116 172.21.15.1:0/2572489961' entity='mgr.x' 2024-09-21T00:47:15.122 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:14 smithi001 ceph-mon[31211]: from='mgr.14116 172.21.15.1:0/2572489961' entity='mgr.x' 2024-09-21T00:47:15.124 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-21T00:47:15.124 INFO:teuthology.orchestra.run.smithi001.stdout:Deploying unmanaged mgr service... 2024-09-21T00:47:16.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:16 smithi001 ceph-mon[31211]: from='mgr.14116 172.21.15.1:0/2572489961' entity='mgr.x' 2024-09-21T00:47:16.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:16 smithi001 ceph-mon[31211]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:16.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:16 smithi001 ceph-mon[31211]: Saving service mgr spec with placement count:2 2024-09-21T00:47:16.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:16 smithi001 ceph-mon[31211]: from='mgr.14116 172.21.15.1:0/2572489961' entity='mgr.x' 2024-09-21T00:47:16.817 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-21T00:47:18.685 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:18 smithi001 ceph-mon[31211]: from='mgr.14116 172.21.15.1:0/2572489961' entity='mgr.x' 2024-09-21T00:47:18.685 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:18 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/3477977620' entity='client.admin' 2024-09-21T00:47:19.255 INFO:teuthology.orchestra.run.smithi001.stdout:Enabling the dashboard module... 2024-09-21T00:47:19.840 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:19 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/2502199722' entity='client.admin' 2024-09-21T00:47:19.840 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:19 smithi001 ceph-mon[31211]: from='mgr.14116 172.21.15.1:0/2572489961' entity='mgr.x' 2024-09-21T00:47:20.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:20 smithi001 ceph-mon[31211]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:47:20.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:20 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/957510235' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-21T00:47:20.960 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:20 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: ignoring --setuser ceph since I am not root 2024-09-21T00:47:20.960 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:20 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: ignoring --setgroup ceph since I am not root 2024-09-21T00:47:21.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:21 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/957510235' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-21T00:47:21.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:21 smithi001 ceph-mon[31211]: mgrmap e9: x(active, since 21s) 2024-09-21T00:47:22.575 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-21T00:47:22.575 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-21T00:47:22.575 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T00:47:22.575 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T00:47:22.575 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T00:47:22.575 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-21T00:47:22.575 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for the mgr to restart... 2024-09-21T00:47:22.575 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mgr epoch 9... 2024-09-21T00:47:22.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:22 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/3522122449' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T00:47:26.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:26 smithi001 ceph-mon[31211]: Active manager daemon x restarted 2024-09-21T00:47:26.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:26 smithi001 ceph-mon[31211]: Activating manager daemon x 2024-09-21T00:47:26.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:26 smithi001 ceph-mon[31211]: osdmap e3: 0 total, 0 up, 0 in 2024-09-21T00:47:26.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:26 smithi001 ceph-mon[31211]: mgrmap e10: x(active, starting, since 0.00417814s) 2024-09-21T00:47:26.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:26 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:47:26.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:26 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T00:47:26.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:26 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T00:47:26.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:26 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T00:47:26.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:26 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T00:47:26.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:26 smithi001 ceph-mon[31211]: Manager daemon x is now available 2024-09-21T00:47:27.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:27 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:47:27.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:27 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T00:47:27.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:27 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T00:47:27.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:27 smithi001 ceph-mon[31211]: mgrmap e11: x(active, since 1.00732s) 2024-09-21T00:47:27.882 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-21T00:47:27.883 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-21T00:47:27.883 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T00:47:27.883 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-21T00:47:27.883 INFO:teuthology.orchestra.run.smithi001.stdout:mgr epoch 9 is available 2024-09-21T00:47:27.883 INFO:teuthology.orchestra.run.smithi001.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-21T00:47:28.166 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:28 smithi001 ceph-mon[31211]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T00:47:28.166 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:28 smithi001 ceph-mon[31211]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T00:47:28.166 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:27 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: 2024-09-21T00:47:27.995+0000 7fdd8542a640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:00:47:27] ENGINE Error in HTTPServer.serve 2024-09-21T00:47:28.166 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:27 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: Traceback (most recent call last): 2024-09-21T00:47:28.166 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:27 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T00:47:28.166 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:27 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: self._connections.run(self.expiration_interval) 2024-09-21T00:47:28.166 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:27 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T00:47:28.166 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:27 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: self._run(expiration_interval) 2024-09-21T00:47:28.167 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:27 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T00:47:28.167 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:27 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T00:47:28.167 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:27 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T00:47:28.167 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:27 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T00:47:28.167 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:27 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T00:47:28.167 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:27 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: s = self.context.wrap_socket( 2024-09-21T00:47:28.167 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:27 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T00:47:28.167 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:27 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: return self.sslsocket_class._create( 2024-09-21T00:47:28.167 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:27 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T00:47:28.167 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:27 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: self.do_handshake() 2024-09-21T00:47:28.167 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:27 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T00:47:28.167 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:27 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: self._sslobj.do_handshake() 2024-09-21T00:47:28.167 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:27 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T00:47:28.167 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:47:27 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: 2024-09-21T00:47:29.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:29 smithi001 ceph-mon[31211]: [21/Sep/2024:00:47:27] ENGINE Bus STARTING 2024-09-21T00:47:29.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:29 smithi001 ceph-mon[31211]: [21/Sep/2024:00:47:27] ENGINE Serving on https://172.21.15.1:7150 2024-09-21T00:47:29.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:29 smithi001 ceph-mon[31211]: [21/Sep/2024:00:47:27] ENGINE Error in HTTPServer.serve 2024-09-21T00:47:29.460 INFO:journalctl@ceph.mon.a.smithi001.stdout: Traceback (most recent call last): 2024-09-21T00:47:29.460 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T00:47:29.460 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._connections.run(self.expiration_interval) 2024-09-21T00:47:29.460 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T00:47:29.461 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._run(expiration_interval) 2024-09-21T00:47:29.461 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T00:47:29.461 INFO:journalctl@ceph.mon.a.smithi001.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T00:47:29.461 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T00:47:29.461 INFO:journalctl@ceph.mon.a.smithi001.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T00:47:29.461 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T00:47:29.461 INFO:journalctl@ceph.mon.a.smithi001.stdout: s = self.context.wrap_socket( 2024-09-21T00:47:29.461 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T00:47:29.461 INFO:journalctl@ceph.mon.a.smithi001.stdout: return self.sslsocket_class._create( 2024-09-21T00:47:29.461 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T00:47:29.461 INFO:journalctl@ceph.mon.a.smithi001.stdout: self.do_handshake() 2024-09-21T00:47:29.461 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T00:47:29.462 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._sslobj.do_handshake() 2024-09-21T00:47:29.462 INFO:journalctl@ceph.mon.a.smithi001.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T00:47:29.462 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:29 smithi001 ceph-mon[31211]: mgrmap e12: x(active, since 2s) 2024-09-21T00:47:29.462 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:29 smithi001 ceph-mon[31211]: [21/Sep/2024:00:47:28] ENGINE Serving on http://172.21.15.1:8765 2024-09-21T00:47:29.462 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:29 smithi001 ceph-mon[31211]: [21/Sep/2024:00:47:28] ENGINE Bus STARTED 2024-09-21T00:47:29.462 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:29 smithi001 ceph-mon[31211]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:29.462 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:29 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:30.638 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:30 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:30.980 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+jCCAuKgAwIBAgIUYO03OmhJ4Lh1Sp738BTmyQZ5qgcwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkyMTAwNDcyOVoXDTM0\nMDkyMjAwNDcyOVowFjEUMBIGA1UEAwwLMTcyLjIxLjE1LjEwggIiMA0GCSqGSIb3\nDQEBAQUAA4ICDwAwggIKAoICAQCh07QnQdv5qjkXbf3N6VL7iUXaIBtpiAm9td2v\nIcpIdTrcWwCW06XqYskIWPeY85IUwGHyN/FxGlfZrsnzl6IwLa5oUk3GBvPGEeR9\nRBmnjrisU5kZYK14l7Fo13QxNbhe4/eqy5TjK8lU63rKk+h22pMzweJjz9UHnXSO\n7MbqBbwSOc7q2d0fYKOHKFf+aQqnOorutwqsnhol9KQFNLWRCXkAuDB9iMKqFgGe\nw/AHaF03gbpn9YxdTaPQpKkT/tAy2kFyNkNkT8Oi7C2eTfmT8pqbsWFnaBRqQWFv\nUMRRLD0fv2z+5W6viFKDsLuNLg6giSLzDhCQd86jP2F/aCshph3ls1cyDwq0zGSd\nyNwVWM/QxlKeDZzWDhd9k4KS1O2QgVqQx0SHt1bmwMQdT8d5+ibfI1VT3KYFqkRL\nSHWuTHPmzo9tZ0QFi6R386tapWk+L+gu/Nm5OP4N/B9dzWBjfI2cpM70eRub6h/J\nnb3x30Z+MArv/01rAD5ttP5KnYg8C+qvc7AV+HGXgfzfKSf+Yo9Ftg/Byz7JOeoU\n7bc+1MWa2WfGdAm1X7BoKWhXeHMdu5S8GWewnLxq0lIucodH9mYtU0m5ffxpenQJ\nJVmH+QO2iyUU8kudaaAHah8ydHYcwAUHAiuz4vplHEeCX4Mq5yddRyc8LsHBqWDb\nLUJBSwIDAQABoz8wPTAtBgNVHREEJjAkgglzbWl0aGkwMDGCEWRhc2hib2FyZF9z\nZXJ2ZXJzhwSsFQ8BMAwGA1UdEwEB/wQCMAAwDQYJKoZIhvcNAQELBQADggIBAH9v\nwXcsNAMb6SFwZW8WzHjUz3OwHH1nwSDt8YIaOrYCI43Tll2AzL0980aq2DhbvKw8\nCgIm1+NPqkYOXw7AJl+k9Y3EqqZFXvcZnxXikvG2PE+QWjG8LppIs6061IPtMc4A\neofvk50CuU4TRVLPei52SkKw/svhZmLpvCBr/WvUOe6rvoHc+T99GplJe4ajoIf7\nuMjf9+9TRh+NGSQ7Cfgn4tZeT+OooLM4XO6fAmf6uoORfwAptmnOIG65zQdyuNb2\nyZvYL3j9E+7gwG+IoeAcepRPqROx/UzrE58KGkttSW5EgTOIX8gyNnbQAOKqRQrA\njv4aOTcR+4L4ov/IpFa9rRiXXGZPRfEt4vQPZV7rMOG/g0YjodkBFeKHLHBeIzZ6\nVpljDynZRReYowxWV6Emp1nZ/g3hr6thQxCNXVHuJeSO6IUV2wYv+T7XNx4PrkHU\nw4MyT5ljDapFOpNUZ7amuuwj3Goxqa+cvwqaV2628lSL6irrrkgIAwhKGqsiiEQH\nDFwvkcLQ5wibQYVRpBuTSg7g3t8yWRumb2w25uyyt9exnpewUYbUKoNNZFThOG3i\n0soUx9kneqSOj6VMgCy3d/bTLvIH3LHAKQsMcGdg144hYu3gj/XbnZVIaL8HoSPZ\n9uULJgaa51DyXDF2QCIEvlpjG9xBnzPzpU+2CvVc\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKQIBAAKCAgEAodO0J0Hb+ao5F239zelS+4lF2iAbaYgJvbXdryHKSHU63FsA\nltOl6mLJCFj3mPOSFMBh8jfxcRpX2a7J85eiMC2uaFJNxgbzxhHkfUQZp464rFOZ\nGWCteJexaNd0MTW4XuP3qsuU4yvJVOt6ypPodtqTM8HiY8/VB510juzG6gW8EjnO\n6tndH2CjhyhX/mkKpzqK7rcKrJ4aJfSkBTS1kQl5ALgwfYjCqhYBnsPwB2hdN4G6\nZ/WMXU2j0KSpE/7QMtpBcjZDZE/Douwtnk35k/Kam7FhZ2gUakFhb1DEUSw9H79s\n/uVur4hSg7C7jS4OoIki8w4QkHfOoz9hf2grIaYd5bNXMg8KtMxkncjcFVjP0MZS\nng2c1g4XfZOCktTtkIFakMdEh7dW5sDEHU/Hefom3yNVU9ymBapES0h1rkxz5s6P\nbWdEBYukd/OrWqVpPi/oLvzZuTj+DfwfXc1gY3yNnKTO9Hkbm+ofyZ298d9GfjAK\n7/9NawA+bbT+Sp2IPAvqr3OwFfhxl4H83ykn/mKPRbYPwcs+yTnqFO23PtTFmtln\nxnQJtV+waCloV3hzHbuUvBlnsJy8atJSLnKHR/ZmLVNJuX38aXp0CSVZh/kDtosl\nFPJLnWmgB2ofMnR2HMAFBwIrs+L6ZRxHgl+DKucnXUcnPC7Bwalg2y1CQUsCAwEA\nAQKCAgAgNcercq/qq0eO0s1MUW87ctDNAEwEftfVg1/7DmI5dt/+4TwmST1CgGQc\nPb0WnBCNAdfdAuaTSReIVAKNcjaNmWIYEJ27V0HpQEF273mdwMogPsl/5B7THHpq\n8EuHyfYHKR/wRnI9n0cFGJPJw5PnKE1ZZXN+w2zXBa+gDR/wj7Cl/gyh8ThSmQUj\nj1OoZ1b//yaNKjC9OADjYiTNhnbHRhfoHUFFk1WPzi6HX9+kUdEQDcnBDH5iSeRb\n0JJ40OS24ntZVNSoIDpD8PeJhWKyYH0GlVFaaDx8A8R1iCFzOLd33L3ApIEZ/ivS\nW3iROsQdjv4+W6PPZZFjK+fnmJ/Q0xGc9PQWyx8upMC1bZrh3H4siSN+CiJLh2B3\nygbET0TeoezrXGh+su+FTKNK1NKI0SmNQjhCorhg7iJ+HsJk1FfNEKA8Hzzq6Kg+\nej9y89WBaZ1fPG0WgBgdsw6XWEg7Hpbwtp0qxS06uFdrcLJF8EEI3eG03dwHrVXb\nc29Jxab9wJ1ZKodiuNuZqzsoET7zXYVQnsx1Vu+JSm+lBkM5OeolRuuQc1ElIj4e\nu5ICVkANY4aYAfd3I7kSNI1fS1tsOmfyfohhiWxXGzB2kowp+QL1Aac49yuraDkG\n14ixyfvkWyKmZ7Do786Rt3DXh4mwEaHAG+KN+BHJpVQozR83FQKCAQEA2Tqx3ahx\nwMeTmkSH/BzIq0CyfaewDayJ8LZcc/lOhiYIWRqpiUUU9h3nbMpH89tIvHKYmUIf\nwNpkoQGdU4jYFc9jigaIl9vUuFkXNFPN1Xafv0LNY/kz27puu4v3wdSi3A8Bfi/G\noUmGzbJ6+5CE4ladtHv1m64crjdZMSxi6nZBCULNc4kGoB0VmGNebi1VJjw6AsLs\n52ludCRoXZh13uixVEouX6AKK9K/5NULh11H6myncJi76x2tfOFClgLPcN+PQ7uy\n7+IOtX4Fh2MRJVpGFvfjHDkWaJU0C7jF7/B+JKTk5UIU3NmSkI7qtEK3toJAjcjN\nxRSY6YYLfOFPpwKCAQEAvrWm7MpR1OunvzkdC40ocU8o0QC/M39DYNI8Tdm0IYo8\nFZ1StngzF5uwAoyo0U2b10N7TlXzklxA5HR+LymVqWhnHe0dTTkRYmriJ9toSMzT\nbO5oxizfvAWUzuvDP1DFY7ljHrweXKS9mehFz0qbDDS1rAz++GcFNasuCp7JkPdm\nb65kkal+UgOpRiU1Up9GRETfo8ZtGsQ/MKHb5o3klH7Q1I0qW6Pqx8kIIgVFeuAg\n2iewAsA8IqqfvxdqBFyt3bU6o+dRjm3eZQCn1wSnGebOg9Ay29vwQ/wijhGeDEj4\nov1tiRH/VHs+qRG9fSrtzTK7cxGF9eSWDJ9Lp8hVvQKCAQAOJLct8mitn5Dpq2qb\nLJiYJdc5PTDGQyScCpOMbYACVfmXK5g8OsY5nArUV3tF0lIzCtcKq3Z7zPxeS0ee\nB7vh96XId9Ju6L453nsXShmNu3J9NnE/ABuzQ7kv9tYDxb9wyn1TZPLuz2W6gNNn\nC6rLPc540NVV9IkjgrEI9ZXfJCHp43KTAinvRNWCHX4peEQiACvawCxCiOfLIg+1\ngFa0U7wv+8B3M2lWHxulX4Wno5gqGDbyqs8ZaM5B4jy+naI5/CRMyazF15cTlAfy\nH64fG3iSyEL+NG1UE9rWpIomrCbaZe4NSzcmhff394YqhGmHtYVUde2H1mZ6VeLr\nl5PjAoIBAQCTUzk0y8cTuUjJTJHHjrCjeAeMDgum+LVQYpj7eybQkj2AZRy0oX62\nyirajVcM+eteDF+BUJztgB8RXXztai6XxHOEhtyP/3oSkYdMSw7wzmq2SCbgkWH1\nmkou36rhisAyHdEYuTKrVwixkOH9FSFZ+I4v74o40z0PDMJwqeIE/1o/BHXkoQ9Y\nxENMUQo0XZ6mtp4dovg+KUS3iRKbtRnULXOd/7+tM5/33rFNtszJ88LtRKOQPHk4\nPp9RvADGheI61/oJDHXQlcesNylxzcJZHBiFc50Wg33Ex07aeXmi++w33Zd0wFaD\nKQJrEa1UuIkkcACnD+5w2rmf3p9Pak/xAoIBAQCUjs56WXpOvgogWqPzoCZAHXy+\nQnPTdveLeH4CaunwlkDmQR7e37V/ovcvgvPcBA/a6Zn9v26uIGNwVlD08A6uVoxf\nJvpCQOMBZKDp93wnI2dh/qkp7o7idE2m2TOtnmzfgx1nsWHVPCLT4BtIhBmBb4f6\nhVXPhBZuKmc+mIC2FEPMKZcTKr/tCJJTv7ffqaElJitH3NtK//fpwtTqELuWBNmm\n1zHDCPhZfXfPgqXKlGwlf1hEq+rTDvWSBuN/PlB/K2Qd6k0qFLHix0uyeD4+o527\nZD07ZqKRgfzdCkjVxa/wgTbDQJhUaukJGfH6S3ttoZBsW8lln39UlaD659Jn\n-----END RSA PRIVATE KEY-----\n"} 2024-09-21T00:47:32.229 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-21T00:47:32.897 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:32 smithi001 ceph-mon[31211]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:32.897 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:32 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:33.476 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-21T00:47:33.476 INFO:teuthology.orchestra.run.smithi001.stdout:Creating initial admin user... 2024-09-21T00:47:34.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:33 smithi001 ceph-mon[31211]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:34.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:33 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:34.957 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$AlUYkX38f808dZq.RlGSoeEWwbCssvKY36m2gZULqSIp0CCmQJPGW", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726879654, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-21T00:47:34.958 INFO:teuthology.orchestra.run.smithi001.stdout:Fetching dashboard port number... 2024-09-21T00:47:35.575 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:35 smithi001 ceph-mon[31211]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:35.575 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:35 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:36.179 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 8443 2024-09-21T00:47:36.190 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T00:47:36.190 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout disabled 2024-09-21T00:47:36.198 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T00:47:36.198 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-09-21T00:47:36.198 INFO:teuthology.orchestra.run.smithi001.stdout:firewalld.service is not enabled 2024-09-21T00:47:36.199 INFO:teuthology.orchestra.run.smithi001.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-21T00:47:36.200 INFO:teuthology.orchestra.run.smithi001.stdout:Ceph Dashboard is now available at: 2024-09-21T00:47:36.200 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:47:36.200 INFO:teuthology.orchestra.run.smithi001.stdout: URL: https://smithi001.front.sepia.ceph.com:8443/ 2024-09-21T00:47:36.201 INFO:teuthology.orchestra.run.smithi001.stdout: User: admin 2024-09-21T00:47:36.201 INFO:teuthology.orchestra.run.smithi001.stdout: Password: d9rzefdvza 2024-09-21T00:47:36.201 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:47:36.201 INFO:teuthology.orchestra.run.smithi001.stdout:Saving cluster configuration to /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/config directory 2024-09-21T00:47:36.433 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:36 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1019109411' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-21T00:47:37.436 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-21T00:47:37.436 INFO:teuthology.orchestra.run.smithi001.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-21T00:47:37.437 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:47:37.437 INFO:teuthology.orchestra.run.smithi001.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-21T00:47:37.437 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:47:37.437 INFO:teuthology.orchestra.run.smithi001.stdout:Or, if you are only running a single cluster on this host: 2024-09-21T00:47:37.437 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:47:37.437 INFO:teuthology.orchestra.run.smithi001.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-21T00:47:37.437 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:47:37.437 INFO:teuthology.orchestra.run.smithi001.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-21T00:47:37.437 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:47:37.437 INFO:teuthology.orchestra.run.smithi001.stdout: ceph telemetry on 2024-09-21T00:47:37.438 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:47:37.438 INFO:teuthology.orchestra.run.smithi001.stdout:For more information see: 2024-09-21T00:47:37.438 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:47:37.438 INFO:teuthology.orchestra.run.smithi001.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-21T00:47:37.438 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:47:37.438 INFO:teuthology.orchestra.run.smithi001.stdout:Bootstrap complete. 2024-09-21T00:47:37.476 INFO:tasks.cephadm:Fetching config... 2024-09-21T00:47:37.477 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-21T00:47:37.477 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-21T00:47:37.493 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-21T00:47:37.494 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-21T00:47:37.494 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-21T00:47:37.552 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-21T00:47:37.552 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-21T00:47:37.552 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/keyring of=/dev/stdout 2024-09-21T00:47:37.619 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-21T00:47:37.619 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-21T00:47:37.619 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-21T00:47:37.676 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-21T00:47:37.677 DEBUG:teuthology.orchestra.run.smithi001:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxicmObuq3xpsYyB0DQQ9brrvgqxrfWQPwv1fooxNP9wGm1AITjUeLJa2czVZn32IEEuOT3TVGyjehrWXZTwSYveSg9SYQNyAtTQraNqm9/vPZj37533XOTLLlw+IdICWl+lrVOtTllmSsYQahat1qh3qOd5GcDwQI4oAxLSF+1tDjofQuRAgqORT63MdQJW4iaAX2do9k+GYZ2dohWk30IJ2nh9A8Jya/DAVsb/Qn06jVFICS0RHbo1nZ+jDiXuJyhe1+ZcNEEnqULvSOm5kxo17MODHDezdn5ZDBpXlwyEi0uSUm3KhMU+djQzH19hYp537PX0nZq/8tsqSTGxEDJXZAEzVIeF+TKTJtF7TzXVrx3UBvZba3k+EcDs5O01sVIiTxNUtPoz3JKCerKVp8ZecgH+dHOgBlHHoLFO9KrtE08Shg573lOwzb5tPZ3wEB5VMjQPX5jXfkEsHr5sEA2APttiGb8DetgM2Z9xOzHK5OwzPn9QQdfBrDCKh+PLU= ceph-d3972c20-77b2-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T00:47:37.759 INFO:teuthology.orchestra.run.smithi001.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxicmObuq3xpsYyB0DQQ9brrvgqxrfWQPwv1fooxNP9wGm1AITjUeLJa2czVZn32IEEuOT3TVGyjehrWXZTwSYveSg9SYQNyAtTQraNqm9/vPZj37533XOTLLlw+IdICWl+lrVOtTllmSsYQahat1qh3qOd5GcDwQI4oAxLSF+1tDjofQuRAgqORT63MdQJW4iaAX2do9k+GYZ2dohWk30IJ2nh9A8Jya/DAVsb/Qn06jVFICS0RHbo1nZ+jDiXuJyhe1+ZcNEEnqULvSOm5kxo17MODHDezdn5ZDBpXlwyEi0uSUm3KhMU+djQzH19hYp537PX0nZq/8tsqSTGxEDJXZAEzVIeF+TKTJtF7TzXVrx3UBvZba3k+EcDs5O01sVIiTxNUtPoz3JKCerKVp8ZecgH+dHOgBlHHoLFO9KrtE08Shg573lOwzb5tPZ3wEB5VMjQPX5jXfkEsHr5sEA2APttiGb8DetgM2Z9xOzHK5OwzPn9QQdfBrDCKh+PLU= ceph-d3972c20-77b2-11ef-baf5-efdc52797490 2024-09-21T00:47:37.781 DEBUG:teuthology.orchestra.run.smithi042:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxicmObuq3xpsYyB0DQQ9brrvgqxrfWQPwv1fooxNP9wGm1AITjUeLJa2czVZn32IEEuOT3TVGyjehrWXZTwSYveSg9SYQNyAtTQraNqm9/vPZj37533XOTLLlw+IdICWl+lrVOtTllmSsYQahat1qh3qOd5GcDwQI4oAxLSF+1tDjofQuRAgqORT63MdQJW4iaAX2do9k+GYZ2dohWk30IJ2nh9A8Jya/DAVsb/Qn06jVFICS0RHbo1nZ+jDiXuJyhe1+ZcNEEnqULvSOm5kxo17MODHDezdn5ZDBpXlwyEi0uSUm3KhMU+djQzH19hYp537PX0nZq/8tsqSTGxEDJXZAEzVIeF+TKTJtF7TzXVrx3UBvZba3k+EcDs5O01sVIiTxNUtPoz3JKCerKVp8ZecgH+dHOgBlHHoLFO9KrtE08Shg573lOwzb5tPZ3wEB5VMjQPX5jXfkEsHr5sEA2APttiGb8DetgM2Z9xOzHK5OwzPn9QQdfBrDCKh+PLU= ceph-d3972c20-77b2-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T00:47:37.824 INFO:teuthology.orchestra.run.smithi042.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxicmObuq3xpsYyB0DQQ9brrvgqxrfWQPwv1fooxNP9wGm1AITjUeLJa2czVZn32IEEuOT3TVGyjehrWXZTwSYveSg9SYQNyAtTQraNqm9/vPZj37533XOTLLlw+IdICWl+lrVOtTllmSsYQahat1qh3qOd5GcDwQI4oAxLSF+1tDjofQuRAgqORT63MdQJW4iaAX2do9k+GYZ2dohWk30IJ2nh9A8Jya/DAVsb/Qn06jVFICS0RHbo1nZ+jDiXuJyhe1+ZcNEEnqULvSOm5kxo17MODHDezdn5ZDBpXlwyEi0uSUm3KhMU+djQzH19hYp537PX0nZq/8tsqSTGxEDJXZAEzVIeF+TKTJtF7TzXVrx3UBvZba3k+EcDs5O01sVIiTxNUtPoz3JKCerKVp8ZecgH+dHOgBlHHoLFO9KrtE08Shg573lOwzb5tPZ3wEB5VMjQPX5jXfkEsHr5sEA2APttiGb8DetgM2Z9xOzHK5OwzPn9QQdfBrDCKh+PLU= ceph-d3972c20-77b2-11ef-baf5-efdc52797490 2024-09-21T00:47:37.837 DEBUG:teuthology.orchestra.run.smithi193:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxicmObuq3xpsYyB0DQQ9brrvgqxrfWQPwv1fooxNP9wGm1AITjUeLJa2czVZn32IEEuOT3TVGyjehrWXZTwSYveSg9SYQNyAtTQraNqm9/vPZj37533XOTLLlw+IdICWl+lrVOtTllmSsYQahat1qh3qOd5GcDwQI4oAxLSF+1tDjofQuRAgqORT63MdQJW4iaAX2do9k+GYZ2dohWk30IJ2nh9A8Jya/DAVsb/Qn06jVFICS0RHbo1nZ+jDiXuJyhe1+ZcNEEnqULvSOm5kxo17MODHDezdn5ZDBpXlwyEi0uSUm3KhMU+djQzH19hYp537PX0nZq/8tsqSTGxEDJXZAEzVIeF+TKTJtF7TzXVrx3UBvZba3k+EcDs5O01sVIiTxNUtPoz3JKCerKVp8ZecgH+dHOgBlHHoLFO9KrtE08Shg573lOwzb5tPZ3wEB5VMjQPX5jXfkEsHr5sEA2APttiGb8DetgM2Z9xOzHK5OwzPn9QQdfBrDCKh+PLU= ceph-d3972c20-77b2-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T00:47:37.878 INFO:teuthology.orchestra.run.smithi193.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxicmObuq3xpsYyB0DQQ9brrvgqxrfWQPwv1fooxNP9wGm1AITjUeLJa2czVZn32IEEuOT3TVGyjehrWXZTwSYveSg9SYQNyAtTQraNqm9/vPZj37533XOTLLlw+IdICWl+lrVOtTllmSsYQahat1qh3qOd5GcDwQI4oAxLSF+1tDjofQuRAgqORT63MdQJW4iaAX2do9k+GYZ2dohWk30IJ2nh9A8Jya/DAVsb/Qn06jVFICS0RHbo1nZ+jDiXuJyhe1+ZcNEEnqULvSOm5kxo17MODHDezdn5ZDBpXlwyEi0uSUm3KhMU+djQzH19hYp537PX0nZq/8tsqSTGxEDJXZAEzVIeF+TKTJtF7TzXVrx3UBvZba3k+EcDs5O01sVIiTxNUtPoz3JKCerKVp8ZecgH+dHOgBlHHoLFO9KrtE08Shg573lOwzb5tPZ3wEB5VMjQPX5jXfkEsHr5sEA2APttiGb8DetgM2Z9xOzHK5OwzPn9QQdfBrDCKh+PLU= ceph-d3972c20-77b2-11ef-baf5-efdc52797490 2024-09-21T00:47:37.891 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-21T00:47:38.142 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:47:38.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:37 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/2643553421' entity='client.admin' 2024-09-21T00:47:39.408 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-21T00:47:39.408 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-21T00:47:39.803 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:47:40.053 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:39 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1284444884' entity='client.admin' 2024-09-21T00:47:40.053 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:39 smithi001 ceph-mon[31211]: mgrmap e13: x(active, since 12s) 2024-09-21T00:47:40.053 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:39 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:40.053 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:39 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:40.053 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:39 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi001", "name": "osd_memory_target"} : dispatch 2024-09-21T00:47:40.054 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:39 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:40.054 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:39 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:47:40.054 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:39 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:41.464 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi042 2024-09-21T00:47:41.464 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-21T00:47:41.464 DEBUG:teuthology.orchestra.run.smithi042:> dd of=/etc/ceph/ceph.conf 2024-09-21T00:47:41.484 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-21T00:47:41.484 DEBUG:teuthology.orchestra.run.smithi042:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:47:41.541 INFO:tasks.cephadm:Adding host smithi042 to orchestrator... 2024-09-21T00:47:41.541 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph orch host add smithi042 2024-09-21T00:47:41.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:41 smithi001 ceph-mon[31211]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:41.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:41 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:41.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:41 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:47:41.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:41 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:47:41.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:41 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:47:41.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:41 smithi001 ceph-mon[31211]: Updating smithi001:/etc/ceph/ceph.conf 2024-09-21T00:47:41.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:41 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:41.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:41 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:41.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:41 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:42.224 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:47:42.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:42 smithi001 ceph-mon[31211]: Updating smithi001:/var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:47:42.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:42 smithi001 ceph-mon[31211]: Updating smithi001:/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:47:42.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:42 smithi001 ceph-mon[31211]: Updating smithi001:/var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T00:47:44.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:43 smithi001 ceph-mon[31211]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi042", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:45.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:44 smithi001 ceph-mon[31211]: Deploying cephadm binary to smithi042 2024-09-21T00:47:46.631 INFO:teuthology.orchestra.run.smithi001.stdout:Added host 'smithi042' with addr '172.21.15.42' 2024-09-21T00:47:47.256 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T00:47:47.510 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:47:47.883 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:47 smithi001 ceph-mon[31211]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:47:47.883 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:47 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:47.883 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:47 smithi001 ceph-mon[31211]: Added host smithi042 2024-09-21T00:47:47.883 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:47 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:47:47.883 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:47 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:47.883 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:47 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:48.179 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:47:48.180 INFO:teuthology.orchestra.run.smithi001.stdout:[{"addr": "172.21.15.1", "hostname": "smithi001", "labels": [], "status": ""}, {"addr": "172.21.15.42", "hostname": "smithi042", "labels": [], "status": ""}] 2024-09-21T00:47:48.764 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi193 2024-09-21T00:47:48.764 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-21T00:47:48.765 DEBUG:teuthology.orchestra.run.smithi193:> dd of=/etc/ceph/ceph.conf 2024-09-21T00:47:48.784 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-21T00:47:48.784 DEBUG:teuthology.orchestra.run.smithi193:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:47:48.843 INFO:tasks.cephadm:Adding host smithi193 to orchestrator... 2024-09-21T00:47:48.843 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph orch host add smithi193 2024-09-21T00:47:49.095 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:47:49.187 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:48 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:49.188 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:48 smithi001 ceph-mon[31211]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:47:49.188 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:48 smithi001 ceph-mon[31211]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:47:50.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:49 smithi001 ceph-mon[31211]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi193", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:51.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:51 smithi001 ceph-mon[31211]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:47:51.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:51 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:51.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:51 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:51.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:51 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:51.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:51 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:51.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:51 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi042", "name": "osd_memory_target"} : dispatch 2024-09-21T00:47:51.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:51 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:47:51.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:51 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:47:51.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:51 smithi001 ceph-mon[31211]: Updating smithi042:/etc/ceph/ceph.conf 2024-09-21T00:47:51.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:51 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:51.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:51 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:51.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:51 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:52.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:52 smithi001 ceph-mon[31211]: Updating smithi042:/var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:47:52.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:52 smithi001 ceph-mon[31211]: Deploying cephadm binary to smithi193 2024-09-21T00:47:52.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:52 smithi001 ceph-mon[31211]: Updating smithi042:/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:47:52.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:52 smithi001 ceph-mon[31211]: Updating smithi042:/var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T00:47:53.566 INFO:teuthology.orchestra.run.smithi001.stdout:Added host 'smithi193' with addr '172.21.15.193' 2024-09-21T00:47:53.899 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:53 smithi001 ceph-mon[31211]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:47:53.899 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:53 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:53.900 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:53 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:47:54.223 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T00:47:54.478 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:47:54.895 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:54 smithi001 ceph-mon[31211]: Added host smithi193 2024-09-21T00:47:54.895 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:54 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:54.895 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:54 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:55.109 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:47:55.109 INFO:teuthology.orchestra.run.smithi001.stdout:[{"addr": "172.21.15.1", "hostname": "smithi001", "labels": [], "status": ""}, {"addr": "172.21.15.42", "hostname": "smithi042", "labels": [], "status": ""}, {"addr": "172.21.15.193", "hostname": "smithi193", "labels": [], "status": ""}] 2024-09-21T00:47:55.681 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-21T00:47:55.681 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph osd crush tunables default 2024-09-21T00:47:55.934 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:47:55.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:55 smithi001 ceph-mon[31211]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:47:55.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:55 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:56.713 INFO:teuthology.orchestra.run.smithi001.stderr:adjusted tunables profile to default 2024-09-21T00:47:57.043 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:56 smithi001 ceph-mon[31211]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:47:57.044 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:56 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/3261082917' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T00:47:57.283 INFO:tasks.cephadm:Adding mon.a on smithi001 2024-09-21T00:47:57.283 INFO:tasks.cephadm:Adding mon.b on smithi042 2024-09-21T00:47:57.283 INFO:tasks.cephadm:Adding mon.c on smithi193 2024-09-21T00:47:57.284 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph orch apply mon '3;smithi001:172.21.15.1=a;smithi042:172.21.15.42=b;smithi193:172.21.15.193=c' 2024-09-21T00:47:57.557 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T00:47:57.603 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T00:47:58.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:57 smithi001 ceph-mon[31211]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:47:58.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:57 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/3261082917' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T00:47:58.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:57 smithi001 ceph-mon[31211]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T00:47:58.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:57 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:58.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:57 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:58.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:57 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:58.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:57 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:58.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:57 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi193", "name": "osd_memory_target"} : dispatch 2024-09-21T00:47:58.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:57 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:47:58.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:57 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:47:58.326 INFO:teuthology.orchestra.run.smithi193.stdout:Scheduled mon update... 2024-09-21T00:47:58.893 DEBUG:teuthology.orchestra.run.smithi042:mon.b> sudo journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mon.b.service 2024-09-21T00:47:58.895 DEBUG:teuthology.orchestra.run.smithi193:mon.c> sudo journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mon.c.service 2024-09-21T00:47:58.898 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T00:47:58.898 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T00:47:59.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:58 smithi001 ceph-mon[31211]: Updating smithi193:/etc/ceph/ceph.conf 2024-09-21T00:47:59.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:58 smithi001 ceph-mon[31211]: Updating smithi193:/var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:47:59.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:58 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:59.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:58 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:59.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:58 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:59.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:58 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:59.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:58 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:47:59.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:58 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:47:59.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:58 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:47:59.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:58 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:47:59.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:58 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:47:59.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:58 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:00.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:59 smithi001 ceph-mon[31211]: Updating smithi193:/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:48:00.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:59 smithi001 ceph-mon[31211]: Updating smithi193:/var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T00:48:00.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:59 smithi001 ceph-mon[31211]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:00.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:59 smithi001 ceph-mon[31211]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi001:172.21.15.1=a;smithi042:172.21.15.42=b;smithi193:172.21.15.193=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:00.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:59 smithi001 ceph-mon[31211]: Saving service mon spec with placement smithi001:172.21.15.1=a;smithi042:172.21.15.42=b;smithi193:172.21.15.193=c;count:3 2024-09-21T00:48:00.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:47:59 smithi001 ceph-mon[31211]: Deploying daemon mon.c on smithi193 2024-09-21T00:48:00.815 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:48:01.639 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-21T00:48:01.639 INFO:teuthology.orchestra.run.smithi193.stdout:{"epoch":1,"fsid":"d3972c20-77b2-11ef-baf5-efdc52797490","modified":"2024-09-21T00:46:26.733268Z","created":"2024-09-21T00:46:26.733268Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:3300","nonce":0},{"type":"v1","addr":"172.21.15.1:6789","nonce":0}]},"addr":"172.21.15.1:6789/0","public_addr":"172.21.15.1:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T00:48:01.639 INFO:teuthology.orchestra.run.smithi193.stderr:dumped monmap epoch 1 2024-09-21T00:48:01.946 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:01 smithi193 systemd[1]: Starting Ceph mon.c for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T00:48:01.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:01 smithi001 ceph-mon[31211]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:01.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:01 smithi001 ceph-mon[31211]: from='client.? 172.21.15.193:0/120915071' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T00:48:02.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 podman[34640]: 2024-09-21 00:48:02.388562059 +0000 UTC m=+0.112380144 container create 9ad1b23dd6cd60d792594a83cc1ee27b4dceeee10770b04d78626f3ac77de353 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-21T00:48:02.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 podman[34640]: 2024-09-21 00:48:02.298516418 +0000 UTC m=+0.022334514 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:48:02.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 podman[34640]: 2024-09-21 00:48:02.624427441 +0000 UTC m=+0.348245526 container init 9ad1b23dd6cd60d792594a83cc1ee27b4dceeee10770b04d78626f3ac77de353 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mon-c, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2) 2024-09-21T00:48:02.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 podman[34640]: 2024-09-21 00:48:02.627612691 +0000 UTC m=+0.351430776 container start 9ad1b23dd6cd60d792594a83cc1ee27b4dceeee10770b04d78626f3ac77de353 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T00:48:02.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T00:48:02.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T00:48:02.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: pidfile_write: ignore empty --pid-file 2024-09-21T00:48:02.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: load: jerasure load: lrc 2024-09-21T00:48:02.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: RocksDB version: 7.9.2 2024-09-21T00:48:02.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Git sha 0 2024-09-21T00:48:02.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T00:48:02.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: DB SUMMARY 2024-09-21T00:48:02.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: DB Session ID: 0IO9DJODU9I5J3PZEROJ 2024-09-21T00:48:02.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: CURRENT file: CURRENT 2024-09-21T00:48:02.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T00:48:02.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-21T00:48:02.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-21T00:48:02.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-21T00:48:02.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.error_if_exists: 0 2024-09-21T00:48:02.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.create_if_missing: 0 2024-09-21T00:48:02.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.paranoid_checks: 1 2024-09-21T00:48:02.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T00:48:02.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T00:48:02.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T00:48:02.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.env: 0x56505b02bd60 2024-09-21T00:48:02.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T00:48:02.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.info_log: 0x56505f969360 2024-09-21T00:48:02.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T00:48:02.983 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.statistics: (nil) 2024-09-21T00:48:02.983 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.use_fsync: 0 2024-09-21T00:48:02.983 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.max_log_file_size: 0 2024-09-21T00:48:02.983 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T00:48:02.983 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T00:48:02.983 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T00:48:02.983 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T00:48:02.983 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.allow_fallocate: 1 2024-09-21T00:48:02.983 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T00:48:02.984 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T00:48:02.984 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.use_direct_reads: 0 2024-09-21T00:48:02.984 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T00:48:02.984 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T00:48:02.984 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.db_log_dir: 2024-09-21T00:48:02.984 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.wal_dir: 2024-09-21T00:48:02.984 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T00:48:02.984 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T00:48:02.984 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T00:48:02.984 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T00:48:02.984 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T00:48:02.984 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T00:48:02.984 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T00:48:02.984 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T00:48:02.984 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.write_buffer_manager: 0x56505f96dd60 2024-09-21T00:48:02.985 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T00:48:02.985 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T00:48:02.985 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T00:48:02.985 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T00:48:02.985 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T00:48:02.985 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T00:48:02.985 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T00:48:02.985 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T00:48:02.985 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.unordered_write: 0 2024-09-21T00:48:02.985 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T00:48:02.985 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T00:48:02.985 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T00:48:02.985 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T00:48:02.985 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.row_cache: None 2024-09-21T00:48:02.986 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.wal_filter: None 2024-09-21T00:48:02.986 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T00:48:02.986 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T00:48:02.986 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.two_write_queues: 0 2024-09-21T00:48:02.986 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T00:48:02.986 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.wal_compression: 0 2024-09-21T00:48:02.986 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.atomic_flush: 0 2024-09-21T00:48:02.986 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T00:48:02.986 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T00:48:02.986 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T00:48:02.986 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.log_readahead_size: 0 2024-09-21T00:48:02.986 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T00:48:02.986 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T00:48:02.986 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T00:48:02.986 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T00:48:02.987 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T00:48:02.987 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T00:48:02.987 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T00:48:02.987 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.max_background_jobs: 2 2024-09-21T00:48:02.987 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.max_background_compactions: -1 2024-09-21T00:48:02.987 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.max_subcompactions: 1 2024-09-21T00:48:02.987 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T00:48:02.987 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T00:48:02.987 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T00:48:02.987 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T00:48:02.987 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T00:48:02.987 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T00:48:02.987 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T00:48:02.987 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T00:48:02.987 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.max_open_files: -1 2024-09-21T00:48:02.988 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T00:48:02.988 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T00:48:02.988 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T00:48:02.988 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T00:48:02.988 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.max_background_flushes: -1 2024-09-21T00:48:02.988 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Compression algorithms supported: 2024-09-21T00:48:02.988 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: kZSTD supported: 0 2024-09-21T00:48:02.988 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: kXpressCompression supported: 0 2024-09-21T00:48:02.988 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: kBZip2Compression supported: 0 2024-09-21T00:48:02.988 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T00:48:02.988 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: kLZ4Compression supported: 1 2024-09-21T00:48:02.988 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: kZlibCompression supported: 1 2024-09-21T00:48:02.988 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T00:48:02.988 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: kSnappyCompression supported: 1 2024-09-21T00:48:02.988 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T00:48:02.988 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T00:48:02.988 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-21T00:48:02.989 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T00:48:02.989 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T00:48:02.989 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.merge_operator: 2024-09-21T00:48:02.989 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.compaction_filter: None 2024-09-21T00:48:02.989 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T00:48:02.989 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T00:48:02.989 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T00:48:02.989 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T00:48:02.989 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56505f968fa0) 2024-09-21T00:48:02.989 INFO:journalctl@ceph.mon.c.smithi193.stdout: cache_index_and_filter_blocks: 1 2024-09-21T00:48:02.989 INFO:journalctl@ceph.mon.c.smithi193.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T00:48:02.989 INFO:journalctl@ceph.mon.c.smithi193.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T00:48:02.989 INFO:journalctl@ceph.mon.c.smithi193.stdout: pin_top_level_index_and_filter: 1 2024-09-21T00:48:02.989 INFO:journalctl@ceph.mon.c.smithi193.stdout: index_type: 0 2024-09-21T00:48:02.989 INFO:journalctl@ceph.mon.c.smithi193.stdout: data_block_index_type: 0 2024-09-21T00:48:02.989 INFO:journalctl@ceph.mon.c.smithi193.stdout: index_shortening: 1 2024-09-21T00:48:02.990 INFO:journalctl@ceph.mon.c.smithi193.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T00:48:02.990 INFO:journalctl@ceph.mon.c.smithi193.stdout: checksum: 4 2024-09-21T00:48:02.990 INFO:journalctl@ceph.mon.c.smithi193.stdout: no_block_cache: 0 2024-09-21T00:48:02.990 INFO:journalctl@ceph.mon.c.smithi193.stdout: block_cache: 0x56505b92d610 2024-09-21T00:48:02.990 INFO:journalctl@ceph.mon.c.smithi193.stdout: block_cache_name: BinnedLRUCache 2024-09-21T00:48:02.990 INFO:journalctl@ceph.mon.c.smithi193.stdout: block_cache_options: 2024-09-21T00:48:02.990 INFO:journalctl@ceph.mon.c.smithi193.stdout: capacity : 536870912 2024-09-21T00:48:02.990 INFO:journalctl@ceph.mon.c.smithi193.stdout: num_shard_bits : 4 2024-09-21T00:48:02.990 INFO:journalctl@ceph.mon.c.smithi193.stdout: strict_capacity_limit : 0 2024-09-21T00:48:02.990 INFO:journalctl@ceph.mon.c.smithi193.stdout: high_pri_pool_ratio: 0.000 2024-09-21T00:48:02.990 INFO:journalctl@ceph.mon.c.smithi193.stdout: block_cache_compressed: (nil) 2024-09-21T00:48:02.990 INFO:journalctl@ceph.mon.c.smithi193.stdout: persistent_cache: (nil) 2024-09-21T00:48:02.990 INFO:journalctl@ceph.mon.c.smithi193.stdout: block_size: 4096 2024-09-21T00:48:02.991 INFO:journalctl@ceph.mon.c.smithi193.stdout: block_size_deviation: 10 2024-09-21T00:48:02.991 INFO:journalctl@ceph.mon.c.smithi193.stdout: block_restart_interval: 16 2024-09-21T00:48:02.991 INFO:journalctl@ceph.mon.c.smithi193.stdout: index_block_restart_interval: 1 2024-09-21T00:48:02.991 INFO:journalctl@ceph.mon.c.smithi193.stdout: metadata_block_size: 4096 2024-09-21T00:48:02.991 INFO:journalctl@ceph.mon.c.smithi193.stdout: partition_filters: 0 2024-09-21T00:48:02.991 INFO:journalctl@ceph.mon.c.smithi193.stdout: use_delta_encoding: 1 2024-09-21T00:48:02.991 INFO:journalctl@ceph.mon.c.smithi193.stdout: filter_policy: bloomfilter 2024-09-21T00:48:02.991 INFO:journalctl@ceph.mon.c.smithi193.stdout: whole_key_filtering: 1 2024-09-21T00:48:02.991 INFO:journalctl@ceph.mon.c.smithi193.stdout: verify_compression: 0 2024-09-21T00:48:02.991 INFO:journalctl@ceph.mon.c.smithi193.stdout: read_amp_bytes_per_bit: 0 2024-09-21T00:48:02.991 INFO:journalctl@ceph.mon.c.smithi193.stdout: format_version: 5 2024-09-21T00:48:02.991 INFO:journalctl@ceph.mon.c.smithi193.stdout: enable_index_compression: 1 2024-09-21T00:48:02.991 INFO:journalctl@ceph.mon.c.smithi193.stdout: block_align: 0 2024-09-21T00:48:02.991 INFO:journalctl@ceph.mon.c.smithi193.stdout: max_auto_readahead_size: 262144 2024-09-21T00:48:02.991 INFO:journalctl@ceph.mon.c.smithi193.stdout: prepopulate_block_cache: 0 2024-09-21T00:48:02.991 INFO:journalctl@ceph.mon.c.smithi193.stdout: initial_auto_readahead_size: 8192 2024-09-21T00:48:02.992 INFO:journalctl@ceph.mon.c.smithi193.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T00:48:02.992 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T00:48:02.992 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T00:48:02.992 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.compression: NoCompression 2024-09-21T00:48:02.992 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T00:48:02.992 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T00:48:02.992 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T00:48:02.992 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.num_levels: 7 2024-09-21T00:48:02.992 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T00:48:02.992 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T00:48:02.992 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T00:48:02.992 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T00:48:02.992 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T00:48:02.992 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T00:48:02.992 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T00:48:02.992 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T00:48:02.993 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T00:48:02.993 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T00:48:02.993 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T00:48:02.993 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T00:48:02.993 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T00:48:02.993 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T00:48:02.993 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T00:48:02.993 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T00:48:02.993 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T00:48:02.993 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T00:48:02.993 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T00:48:02.993 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T00:48:02.993 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T00:48:02.993 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T00:48:02.993 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T00:48:02.993 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T00:48:02.994 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T00:48:02.994 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T00:48:02.994 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T00:48:02.994 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T00:48:02.994 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T00:48:02.994 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T00:48:02.994 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T00:48:02.994 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T00:48:02.994 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T00:48:02.994 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T00:48:02.994 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T00:48:02.994 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T00:48:02.994 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T00:48:02.994 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T00:48:02.994 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T00:48:02.994 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T00:48:02.995 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T00:48:02.995 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T00:48:02.995 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T00:48:02.995 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T00:48:02.995 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T00:48:02.995 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T00:48:02.995 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T00:48:02.995 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T00:48:02.995 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T00:48:02.995 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T00:48:02.995 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T00:48:02.995 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T00:48:02.995 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T00:48:02.995 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T00:48:02.995 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.inplace_update_support: 0 2024-09-21T00:48:02.995 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T00:48:02.996 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T00:48:02.996 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T00:48:02.996 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T00:48:02.996 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.bloom_locality: 0 2024-09-21T00:48:02.996 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.max_successive_merges: 0 2024-09-21T00:48:02.996 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T00:48:02.996 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T00:48:02.996 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T00:48:02.996 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T00:48:02.996 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.ttl: 2592000 2024-09-21T00:48:02.996 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T00:48:02.996 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T00:48:02.996 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T00:48:02.996 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.enable_blob_files: false 2024-09-21T00:48:02.997 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.min_blob_size: 0 2024-09-21T00:48:02.997 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T00:48:02.997 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T00:48:02.997 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T00:48:02.997 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T00:48:02.997 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T00:48:02.997 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T00:48:02.997 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T00:48:02.997 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T00:48:02.997 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T00:48:02.997 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T00:48:02.997 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 4d08b61c-0ba3-426c-a44d-4cafe3bc79a3 2024-09-21T00:48:02.997 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726879682664610, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-21T00:48:02.997 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-21T00:48:02.997 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726879682665051, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726879682, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "4d08b61c-0ba3-426c-a44d-4cafe3bc79a3", "db_session_id": "0IO9DJODU9I5J3PZEROJ", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-21T00:48:02.997 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726879682665144, "job": 1, "event": "recovery_finished"} 2024-09-21T00:48:02.997 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-21T00:48:02.998 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T00:48:02.998 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56505f98ca80 2024-09-21T00:48:02.998 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: DB pointer 0x565060732000 2024-09-21T00:48:02.998 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T00:48:02.998 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T00:48:02.998 INFO:journalctl@ceph.mon.c.smithi193.stdout: ** DB Stats ** 2024-09-21T00:48:02.998 INFO:journalctl@ceph.mon.c.smithi193.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T00:48:02.998 INFO:journalctl@ceph.mon.c.smithi193.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T00:48:02.998 INFO:journalctl@ceph.mon.c.smithi193.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T00:48:02.998 INFO:journalctl@ceph.mon.c.smithi193.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T00:48:02.998 INFO:journalctl@ceph.mon.c.smithi193.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T00:48:02.998 INFO:journalctl@ceph.mon.c.smithi193.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T00:48:02.998 INFO:journalctl@ceph.mon.c.smithi193.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T00:48:02.998 INFO:journalctl@ceph.mon.c.smithi193.stdout: 2024-09-21T00:48:02.998 INFO:journalctl@ceph.mon.c.smithi193.stdout: ** Compaction Stats [default] ** 2024-09-21T00:48:02.999 INFO:journalctl@ceph.mon.c.smithi193.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T00:48:02.999 INFO:journalctl@ceph.mon.c.smithi193.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T00:48:02.999 INFO:journalctl@ceph.mon.c.smithi193.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T00:48:02.999 INFO:journalctl@ceph.mon.c.smithi193.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T00:48:02.999 INFO:journalctl@ceph.mon.c.smithi193.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T00:48:02.999 INFO:journalctl@ceph.mon.c.smithi193.stdout: 2024-09-21T00:48:02.999 INFO:journalctl@ceph.mon.c.smithi193.stdout: ** Compaction Stats [default] ** 2024-09-21T00:48:02.999 INFO:journalctl@ceph.mon.c.smithi193.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T00:48:02.999 INFO:journalctl@ceph.mon.c.smithi193.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T00:48:02.999 INFO:journalctl@ceph.mon.c.smithi193.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T00:48:02.999 INFO:journalctl@ceph.mon.c.smithi193.stdout: 2024-09-21T00:48:02.999 INFO:journalctl@ceph.mon.c.smithi193.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T00:48:02.999 INFO:journalctl@ceph.mon.c.smithi193.stdout: 2024-09-21T00:48:02.999 INFO:journalctl@ceph.mon.c.smithi193.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T00:48:02.999 INFO:journalctl@ceph.mon.c.smithi193.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T00:48:02.999 INFO:journalctl@ceph.mon.c.smithi193.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T00:48:03.000 INFO:journalctl@ceph.mon.c.smithi193.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T00:48:03.000 INFO:journalctl@ceph.mon.c.smithi193.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T00:48:03.000 INFO:journalctl@ceph.mon.c.smithi193.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T00:48:03.000 INFO:journalctl@ceph.mon.c.smithi193.stdout: Cumulative compaction: 0.00 GB write, 0.58 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T00:48:03.000 INFO:journalctl@ceph.mon.c.smithi193.stdout: Interval compaction: 0.00 GB write, 0.58 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T00:48:03.000 INFO:journalctl@ceph.mon.c.smithi193.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T00:48:03.000 INFO:journalctl@ceph.mon.c.smithi193.stdout: Block cache BinnedLRUCache@0x56505b92d610#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-21T00:48:03.000 INFO:journalctl@ceph.mon.c.smithi193.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-21T00:48:03.000 INFO:journalctl@ceph.mon.c.smithi193.stdout: 2024-09-21T00:48:03.000 INFO:journalctl@ceph.mon.c.smithi193.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T00:48:03.000 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-21T00:48:03.000 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: using public_addr v2:172.21.15.193:0/0 -> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] 2024-09-21T00:48:03.000 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: starting mon.c rank -1 at public addrs [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] at bind addrs [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid d3972c20-77b2-11ef-baf5-efdc52797490 2024-09-21T00:48:03.000 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: mon.c@-1(???) e0 preinit fsid d3972c20-77b2-11ef-baf5-efdc52797490 2024-09-21T00:48:03.000 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: mon.c@-1(synchronizing).mds e1 new map 2024-09-21T00:48:03.000 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-21T00:48:03.001 INFO:journalctl@ceph.mon.c.smithi193.stdout: e1 2024-09-21T00:48:03.001 INFO:journalctl@ceph.mon.c.smithi193.stdout: btime 2024-09-21T00:46:29:745789+0000 2024-09-21T00:48:03.001 INFO:journalctl@ceph.mon.c.smithi193.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T00:48:03.001 INFO:journalctl@ceph.mon.c.smithi193.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T00:48:03.001 INFO:journalctl@ceph.mon.c.smithi193.stdout: legacy client fscid: -1 2024-09-21T00:48:03.001 INFO:journalctl@ceph.mon.c.smithi193.stdout: 2024-09-21T00:48:03.001 INFO:journalctl@ceph.mon.c.smithi193.stdout: No filesystems configured 2024-09-21T00:48:03.001 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T00:48:03.001 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T00:48:03.001 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T00:48:03.001 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T00:48:03.001 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T00:48:03.001 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T00:48:03.001 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T00:48:03.001 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T00:48:03.001 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T00:48:03.002 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T00:48:03.002 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi193", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:03.002 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:03.002 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:03.002 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:03.002 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:03.002 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:03.002 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi042", "name": "osd_memory_target"} : dispatch 2024-09-21T00:48:03.002 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:03.002 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:48:03.002 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: Updating smithi042:/etc/ceph/ceph.conf 2024-09-21T00:48:03.002 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:03.002 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:03.002 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:03.003 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: Updating smithi042:/var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:48:03.003 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: Deploying cephadm binary to smithi193 2024-09-21T00:48:03.003 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: Updating smithi042:/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:48:03.003 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: Updating smithi042:/var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T00:48:03.003 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:03.003 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:03.003 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:48:03.003 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: Added host smithi193 2024-09-21T00:48:03.003 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:03.003 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:03.003 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:03.003 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:03.003 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:48:03.003 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/3261082917' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T00:48:03.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:03.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/3261082917' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T00:48:03.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T00:48:03.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:03.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:03.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:03.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:03.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi193", "name": "osd_memory_target"} : dispatch 2024-09-21T00:48:03.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:03.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:48:03.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: Updating smithi193:/etc/ceph/ceph.conf 2024-09-21T00:48:03.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: Updating smithi193:/var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:48:03.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:03.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:03.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:03.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:03.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:48:03.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:03.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:48:03.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:03.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:48:03.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:03.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: Updating smithi193:/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:48:03.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: Updating smithi193:/var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T00:48:03.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:03.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi001:172.21.15.1=a;smithi042:172.21.15.42=b;smithi193:172.21.15.193=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:03.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: Saving service mon spec with placement smithi001:172.21.15.1=a;smithi042:172.21.15.42=b;smithi193:172.21.15.193=c;count:3 2024-09-21T00:48:03.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: Deploying daemon mon.c on smithi193 2024-09-21T00:48:03.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:03.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: from='client.? 172.21.15.193:0/120915071' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T00:48:03.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 ceph-mon[34660]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T00:48:03.006 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 bash[34640]: 9ad1b23dd6cd60d792594a83cc1ee27b4dceeee10770b04d78626f3ac77de353 2024-09-21T00:48:03.006 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:02 smithi193 systemd[1]: Started Ceph mon.c for d3972c20-77b2-11ef-baf5-efdc52797490. 2024-09-21T00:48:03.248 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T00:48:03.248 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T00:48:03.495 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:48:08.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:07 smithi001 ceph-mon[31211]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:08.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:07 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:48:08.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:07 smithi001 ceph-mon[31211]: mon.a calling monitor election 2024-09-21T00:48:08.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:07 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:48:08.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:07 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:48:08.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:07 smithi001 ceph-mon[31211]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:08.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:07 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:48:08.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:07 smithi001 ceph-mon[31211]: mon.c calling monitor election 2024-09-21T00:48:08.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:07 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:48:08.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:07 smithi001 ceph-mon[31211]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:08.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:07 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:48:08.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:07 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:48:08.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:07 smithi001 ceph-mon[31211]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T00:48:08.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:07 smithi001 ceph-mon[31211]: monmap epoch 2 2024-09-21T00:48:08.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:07 smithi001 ceph-mon[31211]: fsid d3972c20-77b2-11ef-baf5-efdc52797490 2024-09-21T00:48:08.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:07 smithi001 ceph-mon[31211]: last_changed 2024-09-21T00:48:02.693053+0000 2024-09-21T00:48:08.212 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:07 smithi001 ceph-mon[31211]: created 2024-09-21T00:46:26.733268+0000 2024-09-21T00:48:08.212 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:07 smithi001 ceph-mon[31211]: min_mon_release 19 (squid) 2024-09-21T00:48:08.212 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:07 smithi001 ceph-mon[31211]: election_strategy: 1 2024-09-21T00:48:08.212 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:07 smithi001 ceph-mon[31211]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-21T00:48:08.212 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:07 smithi001 ceph-mon[31211]: 1: [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] mon.c 2024-09-21T00:48:08.212 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:07 smithi001 ceph-mon[31211]: fsmap 2024-09-21T00:48:08.212 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:07 smithi001 ceph-mon[31211]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T00:48:08.212 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:07 smithi001 ceph-mon[31211]: mgrmap e13: x(active, since 41s) 2024-09-21T00:48:08.212 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:07 smithi001 ceph-mon[31211]: overall HEALTH_OK 2024-09-21T00:48:08.212 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:07 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:08.212 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:07 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:08.212 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:07 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:08.212 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:07 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:48:08.212 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:07 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:08.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:07 smithi193 ceph-mon[34660]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:08.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:07 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:48:08.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:07 smithi193 ceph-mon[34660]: mon.a calling monitor election 2024-09-21T00:48:08.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:07 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:48:08.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:07 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:48:08.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:07 smithi193 ceph-mon[34660]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:08.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:07 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:48:08.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:07 smithi193 ceph-mon[34660]: mon.c calling monitor election 2024-09-21T00:48:08.231 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:07 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:48:08.231 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:07 smithi193 ceph-mon[34660]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:08.231 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:07 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:48:08.231 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:07 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:48:08.231 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:07 smithi193 ceph-mon[34660]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T00:48:08.231 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:07 smithi193 ceph-mon[34660]: monmap epoch 2 2024-09-21T00:48:08.231 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:07 smithi193 ceph-mon[34660]: fsid d3972c20-77b2-11ef-baf5-efdc52797490 2024-09-21T00:48:08.231 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:07 smithi193 ceph-mon[34660]: last_changed 2024-09-21T00:48:02.693053+0000 2024-09-21T00:48:08.231 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:07 smithi193 ceph-mon[34660]: created 2024-09-21T00:46:26.733268+0000 2024-09-21T00:48:08.231 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:07 smithi193 ceph-mon[34660]: min_mon_release 19 (squid) 2024-09-21T00:48:08.231 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:07 smithi193 ceph-mon[34660]: election_strategy: 1 2024-09-21T00:48:08.231 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:07 smithi193 ceph-mon[34660]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-21T00:48:08.231 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:07 smithi193 ceph-mon[34660]: 1: [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] mon.c 2024-09-21T00:48:08.231 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:07 smithi193 ceph-mon[34660]: fsmap 2024-09-21T00:48:08.232 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:07 smithi193 ceph-mon[34660]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T00:48:08.232 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:07 smithi193 ceph-mon[34660]: mgrmap e13: x(active, since 41s) 2024-09-21T00:48:08.232 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:07 smithi193 ceph-mon[34660]: overall HEALTH_OK 2024-09-21T00:48:08.232 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:07 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:08.232 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:07 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:08.232 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:07 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:08.232 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:07 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:48:08.232 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:07 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:08.612 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-21T00:48:08.612 INFO:teuthology.orchestra.run.smithi193.stdout:{"epoch":2,"fsid":"d3972c20-77b2-11ef-baf5-efdc52797490","modified":"2024-09-21T00:48:02.693053Z","created":"2024-09-21T00:46:26.733268Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:3300","nonce":0},{"type":"v1","addr":"172.21.15.1:6789","nonce":0}]},"addr":"172.21.15.1:6789/0","public_addr":"172.21.15.1:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:3300","nonce":0},{"type":"v1","addr":"172.21.15.193:6789","nonce":0}]},"addr":"172.21.15.193:6789/0","public_addr":"172.21.15.193:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T00:48:08.612 INFO:teuthology.orchestra.run.smithi193.stderr:dumped monmap epoch 2 2024-09-21T00:48:08.915 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:08 smithi193 ceph-mon[34660]: Deploying daemon mon.b on smithi042 2024-09-21T00:48:08.916 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:08 smithi193 ceph-mon[34660]: from='client.? 172.21.15.193:0/1400670623' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T00:48:08.916 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:08 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:48:09.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:08 smithi001 ceph-mon[31211]: Deploying daemon mon.b on smithi042 2024-09-21T00:48:09.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:08 smithi001 ceph-mon[31211]: from='client.? 172.21.15.193:0/1400670623' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T00:48:09.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:08 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:48:10.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:09 smithi001 ceph-mon[31211]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:10.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:09 smithi193 ceph-mon[34660]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:10.243 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T00:48:10.243 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T00:48:10.492 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:48:11.477 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-21T00:48:11.477 INFO:teuthology.orchestra.run.smithi193.stdout:{"epoch":2,"fsid":"d3972c20-77b2-11ef-baf5-efdc52797490","modified":"2024-09-21T00:48:02.693053Z","created":"2024-09-21T00:46:26.733268Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:3300","nonce":0},{"type":"v1","addr":"172.21.15.1:6789","nonce":0}]},"addr":"172.21.15.1:6789/0","public_addr":"172.21.15.1:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:3300","nonce":0},{"type":"v1","addr":"172.21.15.193:6789","nonce":0}]},"addr":"172.21.15.193:6789/0","public_addr":"172.21.15.193:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T00:48:11.477 INFO:teuthology.orchestra.run.smithi193.stderr:dumped monmap epoch 2 2024-09-21T00:48:11.491 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 podman[34462]: 2024-09-21 00:48:11.458525523 +0000 UTC m=+0.345038927 container start 966868c6dd90b21b2b8cad1930946937d59f17e1a3e1988fdf801357e9176831 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mon-b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T00:48:11.491 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T00:48:11.491 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T00:48:11.491 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: pidfile_write: ignore empty --pid-file 2024-09-21T00:48:11.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: load: jerasure load: lrc 2024-09-21T00:48:11.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: RocksDB version: 7.9.2 2024-09-21T00:48:11.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Git sha 0 2024-09-21T00:48:11.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T00:48:11.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: DB SUMMARY 2024-09-21T00:48:11.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: DB Session ID: 8D5OJLRHHOBCTQ0CGMM3 2024-09-21T00:48:11.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: CURRENT file: CURRENT 2024-09-21T00:48:11.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T00:48:11.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-21T00:48:11.744 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-21T00:48:11.744 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-21T00:48:11.744 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.error_if_exists: 0 2024-09-21T00:48:11.744 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.create_if_missing: 0 2024-09-21T00:48:11.744 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.paranoid_checks: 1 2024-09-21T00:48:11.744 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T00:48:11.744 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T00:48:11.744 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T00:48:11.744 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.env: 0x556359a3ed60 2024-09-21T00:48:11.744 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T00:48:11.744 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.info_log: 0x55635f2c1360 2024-09-21T00:48:11.744 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T00:48:11.744 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.statistics: (nil) 2024-09-21T00:48:11.744 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.use_fsync: 0 2024-09-21T00:48:11.744 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.max_log_file_size: 0 2024-09-21T00:48:11.744 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T00:48:11.745 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T00:48:11.745 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T00:48:11.745 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T00:48:11.745 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.allow_fallocate: 1 2024-09-21T00:48:11.745 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T00:48:11.745 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T00:48:11.745 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.use_direct_reads: 0 2024-09-21T00:48:11.745 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T00:48:11.745 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T00:48:11.745 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.db_log_dir: 2024-09-21T00:48:11.745 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.wal_dir: 2024-09-21T00:48:11.745 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T00:48:11.745 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T00:48:11.745 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T00:48:11.745 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T00:48:11.745 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T00:48:11.746 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T00:48:11.746 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T00:48:11.746 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T00:48:11.746 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.write_buffer_manager: 0x55635f2c5d60 2024-09-21T00:48:11.746 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T00:48:11.746 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T00:48:11.746 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T00:48:11.746 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T00:48:11.746 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T00:48:11.746 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T00:48:11.746 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T00:48:11.746 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T00:48:11.746 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.unordered_write: 0 2024-09-21T00:48:11.746 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T00:48:11.746 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T00:48:11.746 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T00:48:11.747 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T00:48:11.747 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.row_cache: None 2024-09-21T00:48:11.747 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.wal_filter: None 2024-09-21T00:48:11.747 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T00:48:11.747 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T00:48:11.747 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.two_write_queues: 0 2024-09-21T00:48:11.747 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T00:48:11.747 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.wal_compression: 0 2024-09-21T00:48:11.747 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.atomic_flush: 0 2024-09-21T00:48:11.747 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T00:48:11.747 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T00:48:11.747 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T00:48:11.747 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.log_readahead_size: 0 2024-09-21T00:48:11.747 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T00:48:11.747 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T00:48:11.747 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T00:48:11.747 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T00:48:11.748 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T00:48:11.748 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T00:48:11.748 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T00:48:11.748 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.max_background_jobs: 2 2024-09-21T00:48:11.748 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.max_background_compactions: -1 2024-09-21T00:48:11.748 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.max_subcompactions: 1 2024-09-21T00:48:11.749 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T00:48:11.749 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T00:48:11.749 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T00:48:11.749 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T00:48:11.749 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T00:48:11.749 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T00:48:11.750 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T00:48:11.750 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T00:48:11.750 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.max_open_files: -1 2024-09-21T00:48:11.750 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T00:48:11.750 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T00:48:11.750 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T00:48:11.750 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T00:48:11.750 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.max_background_flushes: -1 2024-09-21T00:48:11.750 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Compression algorithms supported: 2024-09-21T00:48:11.750 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: kZSTD supported: 0 2024-09-21T00:48:11.750 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: kXpressCompression supported: 0 2024-09-21T00:48:11.750 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: kBZip2Compression supported: 0 2024-09-21T00:48:11.750 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T00:48:11.750 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: kLZ4Compression supported: 1 2024-09-21T00:48:11.750 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: kZlibCompression supported: 1 2024-09-21T00:48:11.751 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T00:48:11.751 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: kSnappyCompression supported: 1 2024-09-21T00:48:11.751 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T00:48:11.751 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T00:48:11.751 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-21T00:48:11.751 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T00:48:11.751 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T00:48:11.751 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.merge_operator: 2024-09-21T00:48:11.751 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.compaction_filter: None 2024-09-21T00:48:11.751 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T00:48:11.751 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T00:48:11.751 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T00:48:11.751 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T00:48:11.751 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55635f2c0fa0) 2024-09-21T00:48:11.751 INFO:journalctl@ceph.mon.b.smithi042.stdout: cache_index_and_filter_blocks: 1 2024-09-21T00:48:11.752 INFO:journalctl@ceph.mon.b.smithi042.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T00:48:11.752 INFO:journalctl@ceph.mon.b.smithi042.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T00:48:11.752 INFO:journalctl@ceph.mon.b.smithi042.stdout: pin_top_level_index_and_filter: 1 2024-09-21T00:48:11.752 INFO:journalctl@ceph.mon.b.smithi042.stdout: index_type: 0 2024-09-21T00:48:11.752 INFO:journalctl@ceph.mon.b.smithi042.stdout: data_block_index_type: 0 2024-09-21T00:48:11.752 INFO:journalctl@ceph.mon.b.smithi042.stdout: index_shortening: 1 2024-09-21T00:48:11.752 INFO:journalctl@ceph.mon.b.smithi042.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T00:48:11.752 INFO:journalctl@ceph.mon.b.smithi042.stdout: checksum: 4 2024-09-21T00:48:11.752 INFO:journalctl@ceph.mon.b.smithi042.stdout: no_block_cache: 0 2024-09-21T00:48:11.752 INFO:journalctl@ceph.mon.b.smithi042.stdout: block_cache: 0x55635b285610 2024-09-21T00:48:11.752 INFO:journalctl@ceph.mon.b.smithi042.stdout: block_cache_name: BinnedLRUCache 2024-09-21T00:48:11.752 INFO:journalctl@ceph.mon.b.smithi042.stdout: block_cache_options: 2024-09-21T00:48:11.752 INFO:journalctl@ceph.mon.b.smithi042.stdout: capacity : 536870912 2024-09-21T00:48:11.752 INFO:journalctl@ceph.mon.b.smithi042.stdout: num_shard_bits : 4 2024-09-21T00:48:11.752 INFO:journalctl@ceph.mon.b.smithi042.stdout: strict_capacity_limit : 0 2024-09-21T00:48:11.753 INFO:journalctl@ceph.mon.b.smithi042.stdout: high_pri_pool_ratio: 0.000 2024-09-21T00:48:11.753 INFO:journalctl@ceph.mon.b.smithi042.stdout: block_cache_compressed: (nil) 2024-09-21T00:48:11.753 INFO:journalctl@ceph.mon.b.smithi042.stdout: persistent_cache: (nil) 2024-09-21T00:48:11.753 INFO:journalctl@ceph.mon.b.smithi042.stdout: block_size: 4096 2024-09-21T00:48:11.753 INFO:journalctl@ceph.mon.b.smithi042.stdout: block_size_deviation: 10 2024-09-21T00:48:11.753 INFO:journalctl@ceph.mon.b.smithi042.stdout: block_restart_interval: 16 2024-09-21T00:48:11.753 INFO:journalctl@ceph.mon.b.smithi042.stdout: index_block_restart_interval: 1 2024-09-21T00:48:11.753 INFO:journalctl@ceph.mon.b.smithi042.stdout: metadata_block_size: 4096 2024-09-21T00:48:11.753 INFO:journalctl@ceph.mon.b.smithi042.stdout: partition_filters: 0 2024-09-21T00:48:11.753 INFO:journalctl@ceph.mon.b.smithi042.stdout: use_delta_encoding: 1 2024-09-21T00:48:11.753 INFO:journalctl@ceph.mon.b.smithi042.stdout: filter_policy: bloomfilter 2024-09-21T00:48:11.753 INFO:journalctl@ceph.mon.b.smithi042.stdout: whole_key_filtering: 1 2024-09-21T00:48:11.753 INFO:journalctl@ceph.mon.b.smithi042.stdout: verify_compression: 0 2024-09-21T00:48:11.753 INFO:journalctl@ceph.mon.b.smithi042.stdout: read_amp_bytes_per_bit: 0 2024-09-21T00:48:11.753 INFO:journalctl@ceph.mon.b.smithi042.stdout: format_version: 5 2024-09-21T00:48:11.753 INFO:journalctl@ceph.mon.b.smithi042.stdout: enable_index_compression: 1 2024-09-21T00:48:11.753 INFO:journalctl@ceph.mon.b.smithi042.stdout: block_align: 0 2024-09-21T00:48:11.754 INFO:journalctl@ceph.mon.b.smithi042.stdout: max_auto_readahead_size: 262144 2024-09-21T00:48:11.754 INFO:journalctl@ceph.mon.b.smithi042.stdout: prepopulate_block_cache: 0 2024-09-21T00:48:11.754 INFO:journalctl@ceph.mon.b.smithi042.stdout: initial_auto_readahead_size: 8192 2024-09-21T00:48:11.754 INFO:journalctl@ceph.mon.b.smithi042.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T00:48:11.754 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T00:48:11.754 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T00:48:11.754 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.compression: NoCompression 2024-09-21T00:48:11.754 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T00:48:11.754 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T00:48:11.754 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T00:48:11.754 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.num_levels: 7 2024-09-21T00:48:11.754 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T00:48:11.754 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T00:48:11.754 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T00:48:11.754 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T00:48:11.754 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T00:48:11.754 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T00:48:11.755 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T00:48:11.755 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T00:48:11.755 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T00:48:11.755 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T00:48:11.755 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T00:48:11.755 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T00:48:11.755 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T00:48:11.755 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T00:48:11.755 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T00:48:11.755 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T00:48:11.755 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T00:48:11.755 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T00:48:11.755 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T00:48:11.755 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T00:48:11.755 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T00:48:11.755 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T00:48:11.756 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T00:48:11.756 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T00:48:11.756 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T00:48:11.756 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T00:48:11.756 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T00:48:11.756 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T00:48:11.756 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T00:48:11.756 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T00:48:11.756 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T00:48:11.756 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T00:48:11.756 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T00:48:11.756 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T00:48:11.756 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T00:48:11.756 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T00:48:11.756 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T00:48:11.756 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T00:48:11.756 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T00:48:11.757 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T00:48:11.757 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T00:48:11.757 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T00:48:11.757 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T00:48:11.757 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T00:48:11.757 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T00:48:11.757 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T00:48:11.757 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T00:48:11.757 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T00:48:11.757 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T00:48:11.757 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T00:48:11.757 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T00:48:11.757 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T00:48:11.757 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T00:48:11.757 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T00:48:11.757 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.inplace_update_support: 0 2024-09-21T00:48:11.757 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T00:48:11.758 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T00:48:11.758 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T00:48:11.758 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T00:48:11.758 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.bloom_locality: 0 2024-09-21T00:48:11.758 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.max_successive_merges: 0 2024-09-21T00:48:11.758 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T00:48:11.758 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T00:48:11.758 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T00:48:11.758 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T00:48:11.758 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.ttl: 2592000 2024-09-21T00:48:11.758 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T00:48:11.758 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T00:48:11.758 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T00:48:11.758 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.enable_blob_files: false 2024-09-21T00:48:11.758 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.min_blob_size: 0 2024-09-21T00:48:11.758 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T00:48:11.759 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T00:48:11.759 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T00:48:11.759 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T00:48:11.759 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T00:48:11.759 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T00:48:11.759 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T00:48:11.759 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T00:48:11.759 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T00:48:11.759 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T00:48:11.759 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 0f8f1531-51ec-49f9-bbde-bda410cc4e68 2024-09-21T00:48:11.759 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726879691495909, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-21T00:48:11.759 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-21T00:48:11.759 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726879691496319, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726879691, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "0f8f1531-51ec-49f9-bbde-bda410cc4e68", "db_session_id": "8D5OJLRHHOBCTQ0CGMM3", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-21T00:48:11.759 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726879691496415, "job": 1, "event": "recovery_finished"} 2024-09-21T00:48:11.759 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-21T00:48:11.760 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T00:48:11.760 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55635f2e4a80 2024-09-21T00:48:11.760 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: DB pointer 0x55636008a000 2024-09-21T00:48:11.760 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T00:48:11.760 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T00:48:11.760 INFO:journalctl@ceph.mon.b.smithi042.stdout: ** DB Stats ** 2024-09-21T00:48:11.760 INFO:journalctl@ceph.mon.b.smithi042.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T00:48:11.760 INFO:journalctl@ceph.mon.b.smithi042.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T00:48:11.760 INFO:journalctl@ceph.mon.b.smithi042.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T00:48:11.760 INFO:journalctl@ceph.mon.b.smithi042.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T00:48:11.760 INFO:journalctl@ceph.mon.b.smithi042.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T00:48:11.760 INFO:journalctl@ceph.mon.b.smithi042.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T00:48:11.760 INFO:journalctl@ceph.mon.b.smithi042.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T00:48:11.760 INFO:journalctl@ceph.mon.b.smithi042.stdout: 2024-09-21T00:48:11.760 INFO:journalctl@ceph.mon.b.smithi042.stdout: ** Compaction Stats [default] ** 2024-09-21T00:48:11.760 INFO:journalctl@ceph.mon.b.smithi042.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T00:48:11.760 INFO:journalctl@ceph.mon.b.smithi042.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T00:48:11.761 INFO:journalctl@ceph.mon.b.smithi042.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T00:48:11.761 INFO:journalctl@ceph.mon.b.smithi042.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T00:48:11.761 INFO:journalctl@ceph.mon.b.smithi042.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T00:48:11.761 INFO:journalctl@ceph.mon.b.smithi042.stdout: 2024-09-21T00:48:11.761 INFO:journalctl@ceph.mon.b.smithi042.stdout: ** Compaction Stats [default] ** 2024-09-21T00:48:11.761 INFO:journalctl@ceph.mon.b.smithi042.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T00:48:11.761 INFO:journalctl@ceph.mon.b.smithi042.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T00:48:11.761 INFO:journalctl@ceph.mon.b.smithi042.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T00:48:11.761 INFO:journalctl@ceph.mon.b.smithi042.stdout: 2024-09-21T00:48:11.761 INFO:journalctl@ceph.mon.b.smithi042.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T00:48:11.761 INFO:journalctl@ceph.mon.b.smithi042.stdout: 2024-09-21T00:48:11.761 INFO:journalctl@ceph.mon.b.smithi042.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T00:48:11.761 INFO:journalctl@ceph.mon.b.smithi042.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T00:48:11.761 INFO:journalctl@ceph.mon.b.smithi042.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T00:48:11.761 INFO:journalctl@ceph.mon.b.smithi042.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T00:48:11.761 INFO:journalctl@ceph.mon.b.smithi042.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T00:48:11.761 INFO:journalctl@ceph.mon.b.smithi042.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T00:48:11.762 INFO:journalctl@ceph.mon.b.smithi042.stdout: Cumulative compaction: 0.00 GB write, 0.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T00:48:11.762 INFO:journalctl@ceph.mon.b.smithi042.stdout: Interval compaction: 0.00 GB write, 0.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T00:48:11.762 INFO:journalctl@ceph.mon.b.smithi042.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T00:48:11.762 INFO:journalctl@ceph.mon.b.smithi042.stdout: Block cache BinnedLRUCache@0x55635b285610#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-21T00:48:11.762 INFO:journalctl@ceph.mon.b.smithi042.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-21T00:48:11.762 INFO:journalctl@ceph.mon.b.smithi042.stdout: 2024-09-21T00:48:11.762 INFO:journalctl@ceph.mon.b.smithi042.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T00:48:11.762 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-21T00:48:11.762 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: using public_addr v2:172.21.15.42:0/0 -> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] 2024-09-21T00:48:11.762 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: starting mon.b rank -1 at public addrs [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] at bind addrs [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid d3972c20-77b2-11ef-baf5-efdc52797490 2024-09-21T00:48:11.762 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: mon.b@-1(???) e0 preinit fsid d3972c20-77b2-11ef-baf5-efdc52797490 2024-09-21T00:48:11.762 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: mon.b@-1(synchronizing).mds e1 new map 2024-09-21T00:48:11.762 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-21T00:48:11.762 INFO:journalctl@ceph.mon.b.smithi042.stdout: e1 2024-09-21T00:48:11.762 INFO:journalctl@ceph.mon.b.smithi042.stdout: btime 2024-09-21T00:46:29:745789+0000 2024-09-21T00:48:11.763 INFO:journalctl@ceph.mon.b.smithi042.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T00:48:11.763 INFO:journalctl@ceph.mon.b.smithi042.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T00:48:11.763 INFO:journalctl@ceph.mon.b.smithi042.stdout: legacy client fscid: -1 2024-09-21T00:48:11.763 INFO:journalctl@ceph.mon.b.smithi042.stdout: 2024-09-21T00:48:11.763 INFO:journalctl@ceph.mon.b.smithi042.stdout: No filesystems configured 2024-09-21T00:48:11.763 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T00:48:11.763 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T00:48:11.763 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T00:48:11.763 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T00:48:11.763 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T00:48:11.763 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T00:48:11.763 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T00:48:11.763 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T00:48:11.763 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T00:48:11.763 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T00:48:11.763 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi193", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:11.763 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:11.764 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:11.764 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:11.764 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:11.764 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:11.764 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi042", "name": "osd_memory_target"} : dispatch 2024-09-21T00:48:11.764 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:11.764 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:48:11.764 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: Updating smithi042:/etc/ceph/ceph.conf 2024-09-21T00:48:11.764 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:11.764 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:11.764 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:11.764 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: Updating smithi042:/var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:48:11.764 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: Deploying cephadm binary to smithi193 2024-09-21T00:48:11.764 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: Updating smithi042:/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:48:11.764 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: Updating smithi042:/var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T00:48:11.764 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:11.764 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:11.765 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:48:11.765 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: Added host smithi193 2024-09-21T00:48:11.765 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:11.765 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:11.765 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:11.765 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:11.765 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:48:11.765 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/3261082917' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T00:48:11.765 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:11.765 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/3261082917' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T00:48:11.765 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T00:48:11.765 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:11.765 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:11.765 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:11.765 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:11.765 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi193", "name": "osd_memory_target"} : dispatch 2024-09-21T00:48:11.766 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:11.766 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:48:11.766 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: Updating smithi193:/etc/ceph/ceph.conf 2024-09-21T00:48:11.766 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: Updating smithi193:/var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:48:11.766 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:11.766 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:11.766 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:11.766 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:11.766 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:48:11.766 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:11.766 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:48:11.766 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:11.766 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:48:11.766 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:11.766 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: Updating smithi193:/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:48:11.766 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: Updating smithi193:/var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T00:48:11.767 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:11.767 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi001:172.21.15.1=a;smithi042:172.21.15.42=b;smithi193:172.21.15.193=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:11.767 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: Saving service mon spec with placement smithi001:172.21.15.1=a;smithi042:172.21.15.42=b;smithi193:172.21.15.193=c;count:3 2024-09-21T00:48:11.767 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: Deploying daemon mon.c on smithi193 2024-09-21T00:48:11.767 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:11.767 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='client.? 172.21.15.193:0/120915071' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T00:48:11.767 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:11.767 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:48:11.767 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: mon.a calling monitor election 2024-09-21T00:48:11.767 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:48:11.767 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:48:11.767 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:11.767 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:48:11.767 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: mon.c calling monitor election 2024-09-21T00:48:11.767 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:48:11.767 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:11.767 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:48:11.768 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:48:11.768 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T00:48:11.768 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: monmap epoch 2 2024-09-21T00:48:11.768 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: fsid d3972c20-77b2-11ef-baf5-efdc52797490 2024-09-21T00:48:11.768 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: last_changed 2024-09-21T00:48:02.693053+0000 2024-09-21T00:48:11.768 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: created 2024-09-21T00:46:26.733268+0000 2024-09-21T00:48:11.768 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: min_mon_release 19 (squid) 2024-09-21T00:48:11.768 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: election_strategy: 1 2024-09-21T00:48:11.768 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-21T00:48:11.768 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: 1: [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] mon.c 2024-09-21T00:48:11.768 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: fsmap 2024-09-21T00:48:11.768 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T00:48:11.768 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: mgrmap e13: x(active, since 41s) 2024-09-21T00:48:11.768 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: overall HEALTH_OK 2024-09-21T00:48:11.768 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:11.768 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:11.768 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:11.769 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:48:11.769 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:11.769 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: Deploying daemon mon.b on smithi042 2024-09-21T00:48:11.769 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='client.? 172.21.15.193:0/1400670623' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T00:48:11.769 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:48:11.769 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:11.769 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 ceph-mon[34481]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T00:48:11.769 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 bash[34462]: 966868c6dd90b21b2b8cad1930946937d59f17e1a3e1988fdf801357e9176831 2024-09-21T00:48:11.769 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:11 smithi042 systemd[1]: Started Ceph mon.b for d3972c20-77b2-11ef-baf5-efdc52797490. 2024-09-21T00:48:13.065 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T00:48:13.066 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T00:48:13.317 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:48:16.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:16 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:48:16.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:16 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:48:16.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:16 smithi001 ceph-mon[31211]: mon.a calling monitor election 2024-09-21T00:48:16.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:16 smithi001 ceph-mon[31211]: mon.c calling monitor election 2024-09-21T00:48:16.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:16 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:48:16.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:16 smithi001 ceph-mon[31211]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:16.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:16 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:48:16.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:16 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:48:16.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:16 smithi001 ceph-mon[31211]: mon.b calling monitor election 2024-09-21T00:48:16.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:16 smithi001 ceph-mon[31211]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:16.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:16 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:48:16.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:16 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:48:16.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:16 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:48:16.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:16 smithi001 ceph-mon[31211]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T00:48:16.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:16 smithi001 ceph-mon[31211]: monmap epoch 3 2024-09-21T00:48:16.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:16 smithi001 ceph-mon[31211]: fsid d3972c20-77b2-11ef-baf5-efdc52797490 2024-09-21T00:48:16.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:16 smithi001 ceph-mon[31211]: last_changed 2024-09-21T00:48:11.523159+0000 2024-09-21T00:48:16.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:16 smithi001 ceph-mon[31211]: created 2024-09-21T00:46:26.733268+0000 2024-09-21T00:48:16.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:16 smithi001 ceph-mon[31211]: min_mon_release 19 (squid) 2024-09-21T00:48:16.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:16 smithi001 ceph-mon[31211]: election_strategy: 1 2024-09-21T00:48:16.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:16 smithi001 ceph-mon[31211]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-21T00:48:16.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:16 smithi001 ceph-mon[31211]: 1: [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] mon.c 2024-09-21T00:48:16.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:16 smithi001 ceph-mon[31211]: 2: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-21T00:48:16.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:16 smithi001 ceph-mon[31211]: fsmap 2024-09-21T00:48:16.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:16 smithi001 ceph-mon[31211]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T00:48:16.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:16 smithi001 ceph-mon[31211]: mgrmap e13: x(active, since 50s) 2024-09-21T00:48:16.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:16 smithi001 ceph-mon[31211]: overall HEALTH_OK 2024-09-21T00:48:16.963 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:16 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:16.963 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:16 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:16.963 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:16 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:16.963 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:16 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:16.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:16 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:48:16.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:16 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:48:16.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:16 smithi193 ceph-mon[34660]: mon.a calling monitor election 2024-09-21T00:48:16.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:16 smithi193 ceph-mon[34660]: mon.c calling monitor election 2024-09-21T00:48:16.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:16 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:48:16.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:16 smithi193 ceph-mon[34660]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:16.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:16 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:48:16.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:16 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:48:16.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:16 smithi193 ceph-mon[34660]: mon.b calling monitor election 2024-09-21T00:48:16.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:16 smithi193 ceph-mon[34660]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:16.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:16 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:48:16.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:16 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:48:16.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:16 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:48:16.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:16 smithi193 ceph-mon[34660]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T00:48:16.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:16 smithi193 ceph-mon[34660]: monmap epoch 3 2024-09-21T00:48:16.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:16 smithi193 ceph-mon[34660]: fsid d3972c20-77b2-11ef-baf5-efdc52797490 2024-09-21T00:48:16.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:16 smithi193 ceph-mon[34660]: last_changed 2024-09-21T00:48:11.523159+0000 2024-09-21T00:48:16.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:16 smithi193 ceph-mon[34660]: created 2024-09-21T00:46:26.733268+0000 2024-09-21T00:48:16.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:16 smithi193 ceph-mon[34660]: min_mon_release 19 (squid) 2024-09-21T00:48:16.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:16 smithi193 ceph-mon[34660]: election_strategy: 1 2024-09-21T00:48:16.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:16 smithi193 ceph-mon[34660]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-21T00:48:16.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:16 smithi193 ceph-mon[34660]: 1: [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] mon.c 2024-09-21T00:48:16.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:16 smithi193 ceph-mon[34660]: 2: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-21T00:48:16.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:16 smithi193 ceph-mon[34660]: fsmap 2024-09-21T00:48:16.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:16 smithi193 ceph-mon[34660]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T00:48:16.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:16 smithi193 ceph-mon[34660]: mgrmap e13: x(active, since 50s) 2024-09-21T00:48:16.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:16 smithi193 ceph-mon[34660]: overall HEALTH_OK 2024-09-21T00:48:16.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:16 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:16.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:16 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:16.982 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:16 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:16.982 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:16 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:16.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:16 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:48:16.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:16 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:48:16.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:16 smithi042 ceph-mon[34481]: mon.a calling monitor election 2024-09-21T00:48:16.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:16 smithi042 ceph-mon[34481]: mon.c calling monitor election 2024-09-21T00:48:16.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:16 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:48:16.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:16 smithi042 ceph-mon[34481]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:16.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:16 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:48:16.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:16 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:48:16.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:16 smithi042 ceph-mon[34481]: mon.b calling monitor election 2024-09-21T00:48:16.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:16 smithi042 ceph-mon[34481]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:16.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:16 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:48:16.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:16 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:48:16.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:16 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:48:16.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:16 smithi042 ceph-mon[34481]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T00:48:16.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:16 smithi042 ceph-mon[34481]: monmap epoch 3 2024-09-21T00:48:16.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:16 smithi042 ceph-mon[34481]: fsid d3972c20-77b2-11ef-baf5-efdc52797490 2024-09-21T00:48:16.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:16 smithi042 ceph-mon[34481]: last_changed 2024-09-21T00:48:11.523159+0000 2024-09-21T00:48:16.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:16 smithi042 ceph-mon[34481]: created 2024-09-21T00:46:26.733268+0000 2024-09-21T00:48:16.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:16 smithi042 ceph-mon[34481]: min_mon_release 19 (squid) 2024-09-21T00:48:16.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:16 smithi042 ceph-mon[34481]: election_strategy: 1 2024-09-21T00:48:16.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:16 smithi042 ceph-mon[34481]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-21T00:48:16.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:16 smithi042 ceph-mon[34481]: 1: [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] mon.c 2024-09-21T00:48:16.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:16 smithi042 ceph-mon[34481]: 2: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-09-21T00:48:16.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:16 smithi042 ceph-mon[34481]: fsmap 2024-09-21T00:48:16.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:16 smithi042 ceph-mon[34481]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T00:48:16.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:16 smithi042 ceph-mon[34481]: mgrmap e13: x(active, since 50s) 2024-09-21T00:48:16.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:16 smithi042 ceph-mon[34481]: overall HEALTH_OK 2024-09-21T00:48:16.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:16 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:16.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:16 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:16.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:16 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:16.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:16 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:17.121 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-21T00:48:17.121 INFO:teuthology.orchestra.run.smithi193.stdout:{"epoch":3,"fsid":"d3972c20-77b2-11ef-baf5-efdc52797490","modified":"2024-09-21T00:48:11.523159Z","created":"2024-09-21T00:46:26.733268Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:3300","nonce":0},{"type":"v1","addr":"172.21.15.1:6789","nonce":0}]},"addr":"172.21.15.1:6789/0","public_addr":"172.21.15.1:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:3300","nonce":0},{"type":"v1","addr":"172.21.15.193:6789","nonce":0}]},"addr":"172.21.15.193:6789/0","public_addr":"172.21.15.193:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:3300","nonce":0},{"type":"v1","addr":"172.21.15.42:6789","nonce":0}]},"addr":"172.21.15.42:6789/0","public_addr":"172.21.15.42:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-21T00:48:17.121 INFO:teuthology.orchestra.run.smithi193.stderr:dumped monmap epoch 3 2024-09-21T00:48:17.854 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:17 smithi193 ceph-mon[34660]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:17.854 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:48:17.854 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:17 smithi193 ceph-mon[34660]: from='client.? 172.21.15.193:0/2127661355' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T00:48:17.854 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:48:17.880 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-21T00:48:17.880 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph config generate-minimal-conf 2024-09-21T00:48:17.908 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:17 smithi001 ceph-mon[31211]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:17.908 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:48:17.908 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:17 smithi001 ceph-mon[31211]: from='client.? 172.21.15.193:0/2127661355' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T00:48:17.908 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:48:17.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:17 smithi042 ceph-mon[34481]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:17.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:48:17.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:17 smithi042 ceph-mon[34481]: from='client.? 172.21.15.193:0/2127661355' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T00:48:17.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:48:18.143 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:18.907 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:18 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.907 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:18 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.907 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:18 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.907 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:18 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.908 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:18 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:18.908 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:18 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:48:18.908 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:18 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.908 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:18 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.908 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:18 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.908 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:18 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.908 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:18 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.908 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:18 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.908 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:18 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.908 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:18 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.908 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:18 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.908 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:18 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.908 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:18 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.908 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:18 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:48:18.909 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:18 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T00:48:18.909 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:18 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:18.973 INFO:teuthology.orchestra.run.smithi001.stdout:# minimal ceph.conf for d3972c20-77b2-11ef-baf5-efdc52797490 2024-09-21T00:48:18.973 INFO:teuthology.orchestra.run.smithi001.stdout:[global] 2024-09-21T00:48:18.973 INFO:teuthology.orchestra.run.smithi001.stdout: fsid = d3972c20-77b2-11ef-baf5-efdc52797490 2024-09-21T00:48:18.973 INFO:teuthology.orchestra.run.smithi001.stdout: mon_host = [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] 2024-09-21T00:48:18.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:18 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:18 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:18 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:18 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:18 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:18.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:18 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:48:18.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:18 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:18 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:18 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:18 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:18 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:18 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:18 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:18 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:18 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:18 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:18 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:18 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:48:18.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:18 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T00:48:18.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:18 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:18.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:18 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:18 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:18 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:18 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:18 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:18.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:18 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:48:18.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:18 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:18 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:18 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:18 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:18 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:18 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:18 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:18 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:18 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:18 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:18 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:18.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:18 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:48:18.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:18 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T00:48:18.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:18 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:19.627 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-21T00:48:19.627 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-21T00:48:19.627 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T00:48:19.696 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-21T00:48:19.696 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:48:19.762 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-21T00:48:19.762 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T00:48:19.795 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-21T00:48:19.795 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:48:19.863 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-21T00:48:19.863 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T00:48:19.865 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:19 smithi001 ceph-mon[31211]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:19.865 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:19 smithi001 ceph-mon[31211]: Updating smithi001:/etc/ceph/ceph.conf 2024-09-21T00:48:19.865 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:19 smithi001 ceph-mon[31211]: Updating smithi042:/etc/ceph/ceph.conf 2024-09-21T00:48:19.865 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:19 smithi001 ceph-mon[31211]: Updating smithi193:/etc/ceph/ceph.conf 2024-09-21T00:48:19.865 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:19 smithi001 ceph-mon[31211]: Updating smithi001:/var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:48:19.865 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:19 smithi001 ceph-mon[31211]: Updating smithi193:/var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:48:19.865 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:19 smithi001 ceph-mon[31211]: Updating smithi042:/var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:48:19.865 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:19 smithi001 ceph-mon[31211]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T00:48:19.865 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:19 smithi001 ceph-mon[31211]: Reconfiguring daemon mon.a on smithi001 2024-09-21T00:48:19.865 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:19 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1342393223' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:19.895 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-21T00:48:19.895 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:48:19.960 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:19 smithi193 ceph-mon[34660]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:19.960 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:19 smithi193 ceph-mon[34660]: Updating smithi001:/etc/ceph/ceph.conf 2024-09-21T00:48:19.960 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:19 smithi193 ceph-mon[34660]: Updating smithi042:/etc/ceph/ceph.conf 2024-09-21T00:48:19.960 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:19 smithi193 ceph-mon[34660]: Updating smithi193:/etc/ceph/ceph.conf 2024-09-21T00:48:19.960 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:19 smithi193 ceph-mon[34660]: Updating smithi001:/var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:48:19.960 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:19 smithi193 ceph-mon[34660]: Updating smithi193:/var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:48:19.960 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:19 smithi193 ceph-mon[34660]: Updating smithi042:/var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:48:19.960 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:19 smithi193 ceph-mon[34660]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T00:48:19.960 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:19 smithi193 ceph-mon[34660]: Reconfiguring daemon mon.a on smithi001 2024-09-21T00:48:19.960 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:19 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/1342393223' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:19.963 INFO:tasks.cephadm:Adding mgr.x on smithi001 2024-09-21T00:48:19.964 INFO:tasks.cephadm:Adding mgr.y on smithi042 2024-09-21T00:48:19.964 INFO:tasks.cephadm:Adding mgr.z on smithi193 2024-09-21T00:48:19.964 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph orch apply mgr '3;smithi001=x;smithi042=y;smithi193=z' 2024-09-21T00:48:19.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:19 smithi042 ceph-mon[34481]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:19.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:19 smithi042 ceph-mon[34481]: Updating smithi001:/etc/ceph/ceph.conf 2024-09-21T00:48:19.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:19 smithi042 ceph-mon[34481]: Updating smithi042:/etc/ceph/ceph.conf 2024-09-21T00:48:19.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:19 smithi042 ceph-mon[34481]: Updating smithi193:/etc/ceph/ceph.conf 2024-09-21T00:48:19.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:19 smithi042 ceph-mon[34481]: Updating smithi001:/var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:48:19.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:19 smithi042 ceph-mon[34481]: Updating smithi193:/var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:48:19.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:19 smithi042 ceph-mon[34481]: Updating smithi042:/var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:48:19.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:19 smithi042 ceph-mon[34481]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T00:48:19.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:19 smithi042 ceph-mon[34481]: Reconfiguring daemon mon.a on smithi001 2024-09-21T00:48:19.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:19 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/1342393223' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:20.249 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:48:20.931 INFO:teuthology.orchestra.run.smithi193.stdout:Scheduled mgr update... 2024-09-21T00:48:21.523 DEBUG:teuthology.orchestra.run.smithi042:mgr.y> sudo journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mgr.y.service 2024-09-21T00:48:21.525 DEBUG:teuthology.orchestra.run.smithi193:mgr.z> sudo journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mgr.z.service 2024-09-21T00:48:21.528 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-21T00:48:21.528 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph config set client client_mount_timeout 600 2024-09-21T00:48:21.531 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-21T00:48:21.531 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph config set client debug_client 20 2024-09-21T00:48:21.573 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-21T00:48:21.574 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph config set client debug_ms 1 2024-09-21T00:48:21.617 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-21T00:48:21.617 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph config set client rados_mon_op_timeout 900 2024-09-21T00:48:21.660 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-21T00:48:21.660 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph config set client rados_osd_op_timeout 900 2024-09-21T00:48:21.681 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:21 smithi001 ceph-mon[31211]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:21.681 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:21 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:21.681 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:21 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:21.681 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:21 smithi001 ceph-mon[31211]: Reconfiguring mon.b (monmap changed)... 2024-09-21T00:48:21.681 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:21 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:48:21.681 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:21 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T00:48:21.682 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:21 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:21.682 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:21 smithi001 ceph-mon[31211]: Reconfiguring daemon mon.b on smithi042 2024-09-21T00:48:21.682 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:21 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:21.682 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:21 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:21.683 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-21T00:48:21.683 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds 20 2024-09-21T00:48:21.725 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-21T00:48:21.726 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds_balancer 20 2024-09-21T00:48:21.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:21 smithi193 ceph-mon[34660]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:21.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:21 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:21.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:21 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:21.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:21 smithi193 ceph-mon[34660]: Reconfiguring mon.b (monmap changed)... 2024-09-21T00:48:21.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:21 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:48:21.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:21 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T00:48:21.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:21 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:21.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:21 smithi193 ceph-mon[34660]: Reconfiguring daemon mon.b on smithi042 2024-09-21T00:48:21.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:21 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:21.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:21 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:21.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:21 smithi042 ceph-mon[34481]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:21.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:21 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:21.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:21 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:21.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:21 smithi042 ceph-mon[34481]: Reconfiguring mon.b (monmap changed)... 2024-09-21T00:48:21.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:21 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:48:21.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:21 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T00:48:21.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:21 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:21.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:21 smithi042 ceph-mon[34481]: Reconfiguring daemon mon.b on smithi042 2024-09-21T00:48:21.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:21 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:21.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:21 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:21.769 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-21T00:48:21.769 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph config set mds debug_ms 2 2024-09-21T00:48:21.813 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-21T00:48:21.813 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-21T00:48:21.861 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-21T00:48:21.862 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_merge_size 5 2024-09-21T00:48:21.862 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:21.905 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-21T00:48:21.905 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_bits 3 2024-09-21T00:48:21.957 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-21T00:48:21.957 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_size 100 2024-09-21T00:48:22.001 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-21T00:48:22.001 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_frag True 2024-09-21T00:48:22.046 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-21T00:48:22.047 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_scatterstat True 2024-09-21T00:48:22.097 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-21T00:48:22.097 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph config set mds mds_op_complaint_time 180 2024-09-21T00:48:22.150 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-21T00:48:22.150 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph config set mds mds_verify_scatter True 2024-09-21T00:48:22.195 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-21T00:48:22.195 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph config set mds osd_op_complaint_time 180 2024-09-21T00:48:22.239 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T00:48:22.239 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph config set mds rados_mon_op_timeout 900 2024-09-21T00:48:22.290 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T00:48:22.290 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph config set mds rados_osd_op_timeout 900 2024-09-21T00:48:22.344 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2024-09-21T00:48:22.344 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph config set mgr client_mount_timeout 30 2024-09-21T00:48:22.388 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2024-09-21T00:48:22.389 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph config set mgr debug_client 20 2024-09-21T00:48:22.444 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2024-09-21T00:48:22.444 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph config set mgr debug_mgr 20 2024-09-21T00:48:22.446 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:22.485 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:22 smithi001 ceph-mon[31211]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi001=x;smithi042=y;smithi193=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:22.485 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:22 smithi001 ceph-mon[31211]: Saving service mgr spec with placement smithi001=x;smithi042=y;smithi193=z;count:3 2024-09-21T00:48:22.485 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:22 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:22.485 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:22 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:22.485 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:22 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:48:22.485 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:22 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T00:48:22.485 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:22 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:22.486 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2024-09-21T00:48:22.487 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph config set mgr debug_ms 1 2024-09-21T00:48:22.552 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T00:48:22.553 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T00:48:22.611 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-21T00:48:22.611 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph config set mon mon_op_complaint_time 120 2024-09-21T00:48:22.612 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:22.661 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-21T00:48:22.661 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph config set osd osd_op_complaint_time 180 2024-09-21T00:48:22.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:22 smithi193 ceph-mon[34660]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi001=x;smithi042=y;smithi193=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:22.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:22 smithi193 ceph-mon[34660]: Saving service mgr spec with placement smithi001=x;smithi042=y;smithi193=z;count:3 2024-09-21T00:48:22.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:22 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:22.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:22 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:22.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:22 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:48:22.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:22 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T00:48:22.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:22 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:22.735 DEBUG:tasks.cephadm:set 26 configs 2024-09-21T00:48:22.735 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3972c20-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi001') 2024-09-21T00:48:22.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:22 smithi042 ceph-mon[34481]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi001=x;smithi042=y;smithi193=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:22.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:22 smithi042 ceph-mon[34481]: Saving service mgr spec with placement smithi001=x;smithi042=y;smithi193=z;count:3 2024-09-21T00:48:22.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:22 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:22.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:22 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:22.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:22 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:48:22.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:22 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T00:48:22.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:22 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:22.966 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:23.614 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:23 smithi001 ceph-mon[31211]: Reconfiguring mon.c (monmap changed)... 2024-09-21T00:48:23.614 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:23 smithi001 ceph-mon[31211]: Reconfiguring daemon mon.c on smithi193 2024-09-21T00:48:23.614 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:23 smithi001 ceph-mon[31211]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:23.614 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:23 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1298639398' entity='client.admin' 2024-09-21T00:48:23.614 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:23 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:23.614 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:23 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:23.614 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:23 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:48:23.614 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:23 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:23.614 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:23 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:48:23.615 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:23 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:23.615 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:23 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T00:48:23.615 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:23 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T00:48:23.615 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:23 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T00:48:23.615 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:23 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:23.721 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:23 smithi193 ceph-mon[34660]: Reconfiguring mon.c (monmap changed)... 2024-09-21T00:48:23.721 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:23 smithi193 ceph-mon[34660]: Reconfiguring daemon mon.c on smithi193 2024-09-21T00:48:23.721 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:23 smithi193 ceph-mon[34660]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:23.721 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:23 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/1298639398' entity='client.admin' 2024-09-21T00:48:23.722 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:23 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:23.722 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:23 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:23.722 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:23 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:48:23.722 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:23 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:23.722 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:23 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:48:23.722 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:23 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:23.722 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:23 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T00:48:23.722 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:23 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T00:48:23.722 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:23 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T00:48:23.722 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:23 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:23.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:23 smithi042 ceph-mon[34481]: Reconfiguring mon.c (monmap changed)... 2024-09-21T00:48:23.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:23 smithi042 ceph-mon[34481]: Reconfiguring daemon mon.c on smithi193 2024-09-21T00:48:23.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:23 smithi042 ceph-mon[34481]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:23.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:23 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/1298639398' entity='client.admin' 2024-09-21T00:48:23.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:23 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:23.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:23 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:23.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:23 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:48:23.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:23 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:23.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:23 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:48:23.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:23 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:23.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:23 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T00:48:23.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:23 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T00:48:23.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:23 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T00:48:23.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:23 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:24.616 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:24.617 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:24.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:24 smithi001 ceph-mon[31211]: Deploying daemon mgr.z on smithi193 2024-09-21T00:48:24.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:24 smithi001 ceph-mon[31211]: from='client.? ' entity='client.admin' 2024-09-21T00:48:24.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:24 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/3133871331' entity='client.admin' 2024-09-21T00:48:24.726 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:24 smithi193 ceph-mon[34660]: Deploying daemon mgr.z on smithi193 2024-09-21T00:48:24.726 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:24 smithi193 ceph-mon[34660]: from='client.? ' entity='client.admin' 2024-09-21T00:48:24.726 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:24 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/3133871331' entity='client.admin' 2024-09-21T00:48:24.979 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 21 00:48:24 smithi193 systemd[1]: Starting Ceph mgr.z for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T00:48:24.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:24 smithi042 ceph-mon[34481]: Deploying daemon mgr.z on smithi193 2024-09-21T00:48:24.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:24 smithi042 ceph-mon[34481]: from='client.? ' entity='client.admin' 2024-09-21T00:48:24.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:24 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/3133871331' entity='client.admin' 2024-09-21T00:48:25.371 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 21 00:48:25 smithi193 podman[35901]: 2024-09-21 00:48:25.102180154 +0000 UTC m=+0.108794518 container create e589e006b115792cfc50300677bc2c348ceee409a172768302931a56812ade2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-z, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-21T00:48:25.371 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 21 00:48:25 smithi193 podman[35901]: 2024-09-21 00:48:25.008716961 +0000 UTC m=+0.015331335 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:48:25.371 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 21 00:48:25 smithi193 podman[35901]: 2024-09-21 00:48:25.304405944 +0000 UTC m=+0.311020309 container init e589e006b115792cfc50300677bc2c348ceee409a172768302931a56812ade2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-z, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T00:48:25.371 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 21 00:48:25 smithi193 podman[35901]: 2024-09-21 00:48:25.307136805 +0000 UTC m=+0.313751178 container start e589e006b115792cfc50300677bc2c348ceee409a172768302931a56812ade2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True) 2024-09-21T00:48:25.371 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 21 00:48:25 smithi193 ceph-mgr[35920]: -- 172.21.15.193:0/4063150937 <== mon.1 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55af361c30e0 con 0x55af361e1a80 2024-09-21T00:48:25.372 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 21 00:48:25 smithi193 bash[35901]: e589e006b115792cfc50300677bc2c348ceee409a172768302931a56812ade2e 2024-09-21T00:48:25.624 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 21 00:48:25 smithi193 systemd[1]: Started Ceph mgr.z for d3972c20-77b2-11ef-baf5-efdc52797490. 2024-09-21T00:48:25.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:25 smithi001 ceph-mon[31211]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:25.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:25 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:25.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:25 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:25.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:25 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:25.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:25 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T00:48:25.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:25 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T00:48:25.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:25 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T00:48:25.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:25 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:25.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:25 smithi193 ceph-mon[34660]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:25.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:25 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:25.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:25 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:25.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:25 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:25.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:25 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T00:48:25.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:25 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T00:48:25.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:25 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T00:48:25.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:25 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:25.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:25 smithi042 ceph-mon[34481]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:25.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:25 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:25.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:25 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:25.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:25 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:25.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:25 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T00:48:25.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:25 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T00:48:25.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:25 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T00:48:25.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:25 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:26.291 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3972c20-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi001') 2024-09-21T00:48:26.291 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3972c20-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi001') 2024-09-21T00:48:26.551 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:26.551 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:26.551 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:26.804 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:26 smithi001 ceph-mon[31211]: Deploying daemon mgr.y on smithi042 2024-09-21T00:48:26.946 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:26 smithi042 ceph-mon[34481]: Deploying daemon mgr.y on smithi042 2024-09-21T00:48:26.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:26 smithi193 ceph-mon[34660]: Deploying daemon mgr.y on smithi042 2024-09-21T00:48:27.242 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 00:48:27 smithi042 systemd[1]: Starting Ceph mgr.y for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T00:48:27.629 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 00:48:27 smithi042 podman[35288]: 2024-09-21 00:48:27.25902217 +0000 UTC m=+0.016231465 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:48:27.630 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 00:48:27 smithi042 podman[35288]: 2024-09-21 00:48:27.357158598 +0000 UTC m=+0.114367873 container create 67d58454386daf6e512953e30e5286251954913c8c3bd8d324b083b6eb0f9940 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-y, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T00:48:27.630 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 00:48:27 smithi042 podman[35288]: 2024-09-21 00:48:27.551167675 +0000 UTC m=+0.308376950 container init 67d58454386daf6e512953e30e5286251954913c8c3bd8d324b083b6eb0f9940 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-y, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T00:48:27.630 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 00:48:27 smithi042 podman[35288]: 2024-09-21 00:48:27.553845585 +0000 UTC m=+0.311054871 container start 67d58454386daf6e512953e30e5286251954913c8c3bd8d324b083b6eb0f9940 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-y, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T00:48:27.630 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 00:48:27 smithi042 ceph-mgr[35308]: -- 172.21.15.42:0/4204941227 <== mon.2 v2:172.21.15.42:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55befe5010e0 con 0x55bf032a4480 2024-09-21T00:48:27.820 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:27 smithi001 ceph-mon[31211]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:27.820 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:27 smithi001 ceph-mon[31211]: from='client.? ' entity='client.admin' 2024-09-21T00:48:27.861 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:27.861 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:27.863 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:27.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:27 smithi193 ceph-mon[34660]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:27.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:27 smithi193 ceph-mon[34660]: from='client.? ' entity='client.admin' 2024-09-21T00:48:27.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:27 smithi042 ceph-mon[34481]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:27.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:27 smithi042 ceph-mon[34481]: from='client.? ' entity='client.admin' 2024-09-21T00:48:27.992 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 00:48:27 smithi042 bash[35288]: 67d58454386daf6e512953e30e5286251954913c8c3bd8d324b083b6eb0f9940 2024-09-21T00:48:27.993 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 00:48:27 smithi042 systemd[1]: Started Ceph mgr.y for d3972c20-77b2-11ef-baf5-efdc52797490. 2024-09-21T00:48:28.892 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:28.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:28 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:28.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:28 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:28.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:28 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:28.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:28 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:28.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:28 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:48:28.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:28 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/253838874' entity='client.admin' 2024-09-21T00:48:28.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:28 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/238138113' entity='client.admin' 2024-09-21T00:48:28.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:28 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:28.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:28 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:28.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:28 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:28.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:28 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:28.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:28 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:48:28.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:28 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/253838874' entity='client.admin' 2024-09-21T00:48:28.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:28 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/238138113' entity='client.admin' 2024-09-21T00:48:28.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:28 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:28.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:28 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:28.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:28 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:28.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:28 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:28.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:28 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:48:28.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:28 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/253838874' entity='client.admin' 2024-09-21T00:48:28.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:28 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/238138113' entity='client.admin' 2024-09-21T00:48:29.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:29 smithi001 ceph-mon[31211]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:29.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:29 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:29.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:29 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:29.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:29 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:29.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:29 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:29.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:29 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:29.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:29 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:48:29.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:29 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:29.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:29 smithi001 ceph-mon[31211]: from='client.? ' entity='client.admin' 2024-09-21T00:48:29.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:29 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T00:48:29.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:29 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T00:48:29.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:29 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:29.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:29 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1472024193' entity='client.admin' 2024-09-21T00:48:29.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:29 smithi042 ceph-mon[34481]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:29.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:29 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:29.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:29 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:29.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:29 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:29.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:29 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:29.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:29 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:29.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:29 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:48:29.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:29 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:29.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:29 smithi042 ceph-mon[34481]: from='client.? ' entity='client.admin' 2024-09-21T00:48:29.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:29 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T00:48:29.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:29 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T00:48:29.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:29 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:29.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:29 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/1472024193' entity='client.admin' 2024-09-21T00:48:30.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:29 smithi193 ceph-mon[34660]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:30.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:29 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:30.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:29 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:30.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:29 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:30.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:29 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:30.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:29 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:30.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:29 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:48:30.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:29 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:30.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:29 smithi193 ceph-mon[34660]: from='client.? ' entity='client.admin' 2024-09-21T00:48:30.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:29 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T00:48:30.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:29 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T00:48:30.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:29 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:30.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:29 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/1472024193' entity='client.admin' 2024-09-21T00:48:30.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:30 smithi042 ceph-mon[34481]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T00:48:30.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:30 smithi042 ceph-mon[34481]: Reconfiguring daemon mgr.x on smithi001 2024-09-21T00:48:30.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:30 smithi042 ceph-mon[34481]: Standby manager daemon z started 2024-09-21T00:48:30.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:30 smithi042 ceph-mon[34481]: from='mgr.? 172.21.15.193:0/1218219396' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T00:48:30.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:30 smithi042 ceph-mon[34481]: from='mgr.? 172.21.15.193:0/1218219396' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T00:48:30.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:30 smithi042 ceph-mon[34481]: from='mgr.? 172.21.15.193:0/1218219396' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T00:48:30.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:30 smithi042 ceph-mon[34481]: from='mgr.? 172.21.15.193:0/1218219396' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T00:48:30.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:30 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/2287596556' entity='client.admin' 2024-09-21T00:48:31.051 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:30 smithi001 ceph-mon[31211]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T00:48:31.051 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:30 smithi001 ceph-mon[31211]: Reconfiguring daemon mgr.x on smithi001 2024-09-21T00:48:31.051 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:30 smithi001 ceph-mon[31211]: Standby manager daemon z started 2024-09-21T00:48:31.051 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:30 smithi001 ceph-mon[31211]: from='mgr.? 172.21.15.193:0/1218219396' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T00:48:31.051 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:30 smithi001 ceph-mon[31211]: from='mgr.? 172.21.15.193:0/1218219396' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T00:48:31.052 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:30 smithi001 ceph-mon[31211]: from='mgr.? 172.21.15.193:0/1218219396' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T00:48:31.052 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:30 smithi001 ceph-mon[31211]: from='mgr.? 172.21.15.193:0/1218219396' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T00:48:31.052 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:30 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/2287596556' entity='client.admin' 2024-09-21T00:48:31.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:30 smithi193 ceph-mon[34660]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T00:48:31.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:30 smithi193 ceph-mon[34660]: Reconfiguring daemon mgr.x on smithi001 2024-09-21T00:48:31.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:30 smithi193 ceph-mon[34660]: Standby manager daemon z started 2024-09-21T00:48:31.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:30 smithi193 ceph-mon[34660]: from='mgr.? 172.21.15.193:0/1218219396' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T00:48:31.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:30 smithi193 ceph-mon[34660]: from='mgr.? 172.21.15.193:0/1218219396' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T00:48:31.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:30 smithi193 ceph-mon[34660]: from='mgr.? 172.21.15.193:0/1218219396' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T00:48:31.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:30 smithi193 ceph-mon[34660]: from='mgr.? 172.21.15.193:0/1218219396' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T00:48:31.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:30 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/2287596556' entity='client.admin' 2024-09-21T00:48:31.638 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:31.638 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:31.639 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:31.640 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:31.641 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:31.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:31 smithi042 ceph-mon[34481]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:31.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:31 smithi042 ceph-mon[34481]: mgrmap e14: x(active, since 64s), standbys: z 2024-09-21T00:48:31.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:31 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T00:48:31.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:31 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/2749853361' entity='client.admin' 2024-09-21T00:48:31.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:31 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:31.993 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:31 smithi001 ceph-mon[31211]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:31.993 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:31 smithi001 ceph-mon[31211]: mgrmap e14: x(active, since 64s), standbys: z 2024-09-21T00:48:31.993 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:31 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T00:48:31.993 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:31 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/2749853361' entity='client.admin' 2024-09-21T00:48:31.993 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:31 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:32.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:31 smithi193 ceph-mon[34660]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:32.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:31 smithi193 ceph-mon[34660]: mgrmap e14: x(active, since 64s), standbys: z 2024-09-21T00:48:32.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:31 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T00:48:32.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:31 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/2749853361' entity='client.admin' 2024-09-21T00:48:32.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:31 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:33.923 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:33 smithi001 ceph-mon[31211]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:33.923 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:33 smithi001 ceph-mon[31211]: Standby manager daemon y started 2024-09-21T00:48:33.923 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:33 smithi001 ceph-mon[31211]: from='mgr.? 172.21.15.42:0/653766012' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T00:48:33.923 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:33 smithi001 ceph-mon[31211]: from='mgr.? 172.21.15.42:0/653766012' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T00:48:33.923 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:33 smithi001 ceph-mon[31211]: from='mgr.? 172.21.15.42:0/653766012' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T00:48:33.923 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:33 smithi001 ceph-mon[31211]: from='mgr.? 172.21.15.42:0/653766012' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T00:48:33.923 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:33 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/2700909226' entity='client.admin' 2024-09-21T00:48:33.924 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:33 smithi001 ceph-mon[31211]: from='client.? ' entity='client.admin' 2024-09-21T00:48:33.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:33 smithi042 ceph-mon[34481]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:33.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:33 smithi042 ceph-mon[34481]: Standby manager daemon y started 2024-09-21T00:48:33.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:33 smithi042 ceph-mon[34481]: from='mgr.? 172.21.15.42:0/653766012' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T00:48:33.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:33 smithi042 ceph-mon[34481]: from='mgr.? 172.21.15.42:0/653766012' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T00:48:33.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:33 smithi042 ceph-mon[34481]: from='mgr.? 172.21.15.42:0/653766012' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T00:48:33.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:33 smithi042 ceph-mon[34481]: from='mgr.? 172.21.15.42:0/653766012' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T00:48:33.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:33 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/2700909226' entity='client.admin' 2024-09-21T00:48:33.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:33 smithi042 ceph-mon[34481]: from='client.? ' entity='client.admin' 2024-09-21T00:48:34.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:33 smithi193 ceph-mon[34660]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:34.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:33 smithi193 ceph-mon[34660]: Standby manager daemon y started 2024-09-21T00:48:34.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:33 smithi193 ceph-mon[34660]: from='mgr.? 172.21.15.42:0/653766012' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T00:48:34.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:33 smithi193 ceph-mon[34660]: from='mgr.? 172.21.15.42:0/653766012' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T00:48:34.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:33 smithi193 ceph-mon[34660]: from='mgr.? 172.21.15.42:0/653766012' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T00:48:34.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:33 smithi193 ceph-mon[34660]: from='mgr.? 172.21.15.42:0/653766012' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T00:48:34.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:33 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/2700909226' entity='client.admin' 2024-09-21T00:48:34.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:33 smithi193 ceph-mon[34660]: from='client.? ' entity='client.admin' 2024-09-21T00:48:35.047 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:34 smithi001 ceph-mon[31211]: mgrmap e15: x(active, since 67s), standbys: z, y 2024-09-21T00:48:35.047 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:34 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T00:48:35.047 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:34 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1972150505' entity='client.admin' 2024-09-21T00:48:35.047 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:34 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/89604980' entity='client.admin' 2024-09-21T00:48:35.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:34 smithi193 ceph-mon[34660]: mgrmap e15: x(active, since 67s), standbys: z, y 2024-09-21T00:48:35.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:34 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T00:48:35.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:34 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/1972150505' entity='client.admin' 2024-09-21T00:48:35.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:34 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/89604980' entity='client.admin' 2024-09-21T00:48:35.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:34 smithi042 ceph-mon[34481]: mgrmap e15: x(active, since 67s), standbys: z, y 2024-09-21T00:48:35.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:34 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T00:48:35.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:34 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/1972150505' entity='client.admin' 2024-09-21T00:48:35.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:34 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/89604980' entity='client.admin' 2024-09-21T00:48:35.400 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:35.401 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:35.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:35.583+0000 7ff0f6dae640 1 -- 172.21.15.1:0/2010553861 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff0dc0b6480 msgr2=0x7ff0dc0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:35.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:35.583+0000 7ff0f6dae640 1 --2- 172.21.15.1:0/2010553861 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff0dc0b6480 0x7ff0dc0b8990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0005fd0 tx=0x7ff0e0007040 comp rx=0 tx=0).stop 2024-09-21T00:48:35.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:35.583+0000 7ff0f6dae640 1 -- 172.21.15.1:0/2010553861 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0f0103700 msgr2=0x7ff0f019a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:35.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:35.583+0000 7ff0f6dae640 1 --2- 172.21.15.1:0/2010553861 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0f0103700 0x7ff0f019a4f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8006010 tx=0x7ff0d8032c20 comp rx=0 tx=0).stop 2024-09-21T00:48:35.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:35.583+0000 7ff0f6dae640 1 -- 172.21.15.1:0/2010553861 shutdown_connections 2024-09-21T00:48:35.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:35.583+0000 7ff0f6dae640 1 --2- 172.21.15.1:0/2010553861 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff0f01040a0 0x7ff0f019b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:35.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:35.583+0000 7ff0f6dae640 1 --2- 172.21.15.1:0/2010553861 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff0dc0b6480 0x7ff0dc0b8990 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:35.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:35.583+0000 7ff0f6dae640 1 --2- 172.21.15.1:0/2010553861 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0f0103700 0x7ff0f019a4f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:35.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:35.583+0000 7ff0f6dae640 1 --2- 172.21.15.1:0/2010553861 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0f0102670 0x7ff0f0199e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:35.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:35.583+0000 7ff0f6dae640 1 -- 172.21.15.1:0/2010553861 >> 172.21.15.1:0/2010553861 conn(0x7ff0f00fdfe0 msgr2=0x7ff0f00ff940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:35.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:35.583+0000 7ff0f6dae640 1 -- 172.21.15.1:0/2010553861 shutdown_connections 2024-09-21T00:48:35.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:35.583+0000 7ff0f6dae640 1 -- 172.21.15.1:0/2010553861 wait complete. 2024-09-21T00:48:35.902 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:35 smithi001 ceph-mon[31211]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:35.903 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:35 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/2010553861' entity='client.admin' 2024-09-21T00:48:36.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:35 smithi193 ceph-mon[34660]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:36.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:35 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/2010553861' entity='client.admin' 2024-09-21T00:48:36.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:35 smithi042 ceph-mon[34481]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:36.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:35 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/2010553861' entity='client.admin' 2024-09-21T00:48:37.133 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:38.032 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:37 smithi193 ceph-mon[34660]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:38.044 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:37 smithi042 ceph-mon[34481]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:38.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:37 smithi001 ceph-mon[31211]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:38.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.631+0000 7f1d5998b640 1 -- 172.21.15.1:0/3289454189 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1d541094a0 msgr2=0x7f1d5410b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:38.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.631+0000 7f1d5998b640 1 --2- 172.21.15.1:0/3289454189 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1d541094a0 0x7f1d5410b9b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c009ca0 tx=0x7f1d4c02a8c0 comp rx=0 tx=0).stop 2024-09-21T00:48:38.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.631+0000 7f1d5998b640 1 -- 172.21.15.1:0/3289454189 shutdown_connections 2024-09-21T00:48:38.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.631+0000 7f1d5998b640 1 --2- 172.21.15.1:0/3289454189 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1d541094a0 0x7f1d5410b9b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:38.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.631+0000 7f1d5998b640 1 --2- 172.21.15.1:0/3289454189 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1d54106960 0x7f1d54108d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:38.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.631+0000 7f1d5998b640 1 --2- 172.21.15.1:0/3289454189 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d5406c2e0 0x7f1d54106420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:38.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.631+0000 7f1d5998b640 1 -- 172.21.15.1:0/3289454189 >> 172.21.15.1:0/3289454189 conn(0x7f1d540fdfe0 msgr2=0x7f1d54100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:38.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.631+0000 7f1d5998b640 1 -- 172.21.15.1:0/3289454189 shutdown_connections 2024-09-21T00:48:38.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.631+0000 7f1d5998b640 1 -- 172.21.15.1:0/3289454189 wait complete. 2024-09-21T00:48:38.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.632+0000 7f1d5998b640 1 Processor -- start 2024-09-21T00:48:38.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.632+0000 7f1d5998b640 1 -- start start 2024-09-21T00:48:38.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.632+0000 7f1d5998b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d5406c2e0 0x7f1d54199e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:38.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.632+0000 7f1d5998b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1d54106960 0x7f1d5419a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:38.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.632+0000 7f1d5998b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1d541094a0 0x7f1d5419b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:38.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.632+0000 7f1d5998b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5410f270 con 0x7f1d54106960 2024-09-21T00:48:38.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.632+0000 7f1d5998b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5410f0f0 con 0x7f1d5406c2e0 2024-09-21T00:48:38.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.632+0000 7f1d5998b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5410f3f0 con 0x7f1d541094a0 2024-09-21T00:48:38.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.632+0000 7f1d4bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1d54106960 0x7f1d5419a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:38.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.632+0000 7f1d4bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1d54106960 0x7f1d5419a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46338/0 (socket says 172.21.15.1:46338) 2024-09-21T00:48:38.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.632+0000 7f1d4bfff640 1 -- 172.21.15.1:0/4028483910 learned_addr learned my addr 172.21.15.1:0/4028483910 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:48:38.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.632+0000 7f1d537fe640 1 --2- 172.21.15.1:0/4028483910 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1d541094a0 0x7f1d5419b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:38.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.632+0000 7f1d52ffd640 1 --2- 172.21.15.1:0/4028483910 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d5406c2e0 0x7f1d54199e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:38.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.633+0000 7f1d4bfff640 1 -- 172.21.15.1:0/4028483910 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1d541094a0 msgr2=0x7f1d5419b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:38.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.633+0000 7f1d4bfff640 1 --2- 172.21.15.1:0/4028483910 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1d541094a0 0x7f1d5419b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:38.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.633+0000 7f1d4bfff640 1 -- 172.21.15.1:0/4028483910 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d5406c2e0 msgr2=0x7f1d54199e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:38.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.633+0000 7f1d4bfff640 1 --2- 172.21.15.1:0/4028483910 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d5406c2e0 0x7f1d54199e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:38.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.633+0000 7f1d4bfff640 1 -- 172.21.15.1:0/4028483910 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d5419b8a0 con 0x7f1d54106960 2024-09-21T00:48:38.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.633+0000 7f1d4bfff640 1 --2- 172.21.15.1:0/4028483910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1d54106960 0x7f1d5419a4e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c00d770 tx=0x7f1d3c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:38.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.633+0000 7f1d58989640 1 -- 172.21.15.1:0/4028483910 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c017070 con 0x7f1d54106960 2024-09-21T00:48:38.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.633+0000 7f1d58989640 1 -- 172.21.15.1:0/4028483910 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f1d3c0054b0 con 0x7f1d54106960 2024-09-21T00:48:38.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.633+0000 7f1d58989640 1 -- 172.21.15.1:0/4028483910 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c004c70 con 0x7f1d54106960 2024-09-21T00:48:38.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.633+0000 7f1d5998b640 1 -- 172.21.15.1:0/4028483910 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d5419bb90 con 0x7f1d54106960 2024-09-21T00:48:38.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.633+0000 7f1d5998b640 1 -- 172.21.15.1:0/4028483910 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d541a2290 con 0x7f1d54106960 2024-09-21T00:48:38.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.634+0000 7f1d5998b640 1 -- 172.21.15.1:0/4028483910 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d540ffb00 con 0x7f1d54106960 2024-09-21T00:48:38.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.636+0000 7f1d58989640 1 -- 172.21.15.1:0/4028483910 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 15) ==== 154455+0+0 (secure 0 0 0) 0x7f1d3c004e10 con 0x7f1d54106960 2024-09-21T00:48:38.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.637+0000 7f1d58989640 1 --2- 172.21.15.1:0/4028483910 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f1d400b6500 0x7f1d400b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:38.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.637+0000 7f1d52ffd640 1 --2- 172.21.15.1:0/4028483910 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f1d400b6500 0x7f1d400b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:38.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.637+0000 7f1d58989640 1 -- 172.21.15.1:0/4028483910 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1d3c0e53a0 con 0x7f1d54106960 2024-09-21T00:48:38.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.638+0000 7f1d52ffd640 1 --2- 172.21.15.1:0/4028483910 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f1d400b6500 0x7f1d400b8a10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400bbe0 tx=0x7f1d4400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:38.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.640+0000 7f1d58989640 1 -- 172.21.15.1:0/4028483910 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1d3c0b1d40 con 0x7f1d54106960 2024-09-21T00:48:38.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.832+0000 7f1d5998b640 1 -- 172.21.15.1:0/4028483910 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f1d5402e640 con 0x7f1d54106960 2024-09-21T00:48:38.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.836+0000 7f1d58989640 1 -- 172.21.15.1:0/4028483910 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v25)=0 v25) ==== 108+0+0 (secure 0 0 0) 0x7f1d3c0b6c80 con 0x7f1d54106960 2024-09-21T00:48:38.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.839+0000 7f1d5998b640 1 -- 172.21.15.1:0/4028483910 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f1d400b6500 msgr2=0x7f1d400b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:38.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.839+0000 7f1d5998b640 1 --2- 172.21.15.1:0/4028483910 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f1d400b6500 0x7f1d400b8a10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400bbe0 tx=0x7f1d4400b390 comp rx=0 tx=0).stop 2024-09-21T00:48:38.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.839+0000 7f1d5998b640 1 -- 172.21.15.1:0/4028483910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1d54106960 msgr2=0x7f1d5419a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:38.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.839+0000 7f1d5998b640 1 --2- 172.21.15.1:0/4028483910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1d54106960 0x7f1d5419a4e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c00d770 tx=0x7f1d3c00dc30 comp rx=0 tx=0).stop 2024-09-21T00:48:38.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.839+0000 7f1d5998b640 1 -- 172.21.15.1:0/4028483910 shutdown_connections 2024-09-21T00:48:38.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.839+0000 7f1d5998b640 1 --2- 172.21.15.1:0/4028483910 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1d541094a0 0x7f1d5419b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:38.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.839+0000 7f1d5998b640 1 --2- 172.21.15.1:0/4028483910 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f1d400b6500 0x7f1d400b8a10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:38.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.839+0000 7f1d5998b640 1 --2- 172.21.15.1:0/4028483910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1d54106960 0x7f1d5419a4e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:38.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.839+0000 7f1d5998b640 1 --2- 172.21.15.1:0/4028483910 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d5406c2e0 0x7f1d54199e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:38.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.839+0000 7f1d5998b640 1 -- 172.21.15.1:0/4028483910 >> 172.21.15.1:0/4028483910 conn(0x7f1d540fdfe0 msgr2=0x7f1d54104ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:38.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.839+0000 7f1d5998b640 1 -- 172.21.15.1:0/4028483910 shutdown_connections 2024-09-21T00:48:38.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:38.839+0000 7f1d5998b640 1 -- 172.21.15.1:0/4028483910 wait complete. 2024-09-21T00:48:39.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.276+0000 7f6bb0af6640 1 -- 172.21.15.1:0/2140397891 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bac104070 msgr2=0x7f6bac10aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:39.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.276+0000 7f6bb0af6640 1 --2- 172.21.15.1:0/2140397891 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bac104070 0x7f6bac10aa10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4009ca0 tx=0x7f6ba402a950 comp rx=0 tx=0).stop 2024-09-21T00:48:39.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.276+0000 7f6bb0af6640 1 -- 172.21.15.1:0/2140397891 shutdown_connections 2024-09-21T00:48:39.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.276+0000 7f6bb0af6640 1 --2- 172.21.15.1:0/2140397891 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bac104070 0x7f6bac10aa10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:39.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.276+0000 7f6bb0af6640 1 --2- 172.21.15.1:0/2140397891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bac1036d0 0x7f6bac103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:39.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.276+0000 7f6bb0af6640 1 --2- 172.21.15.1:0/2140397891 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6bac102640 0x7f6bac102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:39.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.276+0000 7f6bb0af6640 1 -- 172.21.15.1:0/2140397891 >> 172.21.15.1:0/2140397891 conn(0x7f6bac0fdfb0 msgr2=0x7f6bac100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:39.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.276+0000 7f6bb0af6640 1 -- 172.21.15.1:0/2140397891 shutdown_connections 2024-09-21T00:48:39.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.276+0000 7f6bb0af6640 1 -- 172.21.15.1:0/2140397891 wait complete. 2024-09-21T00:48:39.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.277+0000 7f6bb0af6640 1 Processor -- start 2024-09-21T00:48:39.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.277+0000 7f6bb0af6640 1 -- start start 2024-09-21T00:48:39.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.277+0000 7f6bb0af6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bac102640 0x7f6bac106230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:39.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.277+0000 7f6bb0af6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bac1036d0 0x7f6bac104b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:39.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.277+0000 7f6bb0af6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6bac104070 0x7f6bac105040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:39.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.277+0000 7f6bb0af6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6bac10e150 con 0x7f6bac1036d0 2024-09-21T00:48:39.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.277+0000 7f6bb0af6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6bac10dfd0 con 0x7f6bac102640 2024-09-21T00:48:39.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.277+0000 7f6bb0af6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6bac10e2d0 con 0x7f6bac104070 2024-09-21T00:48:39.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.277+0000 7f6ba3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bac1036d0 0x7f6bac104b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:39.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.277+0000 7f6ba3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bac1036d0 0x7f6bac104b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57336/0 (socket says 172.21.15.1:57336) 2024-09-21T00:48:39.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.277+0000 7f6baa59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bac102640 0x7f6bac106230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:39.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.277+0000 7f6ba3fff640 1 -- 172.21.15.1:0/1595507491 learned_addr learned my addr 172.21.15.1:0/1595507491 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:48:39.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.278+0000 7f6baad9d640 1 --2- 172.21.15.1:0/1595507491 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6bac104070 0x7f6bac105040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:39.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.278+0000 7f6ba3fff640 1 -- 172.21.15.1:0/1595507491 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6bac104070 msgr2=0x7f6bac105040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:39.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.278+0000 7f6ba3fff640 1 --2- 172.21.15.1:0/1595507491 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6bac104070 0x7f6bac105040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:39.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.278+0000 7f6ba3fff640 1 -- 172.21.15.1:0/1595507491 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bac102640 msgr2=0x7f6bac106230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:39.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.278+0000 7f6ba3fff640 1 --2- 172.21.15.1:0/1595507491 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bac102640 0x7f6bac106230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:39.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.278+0000 7f6ba3fff640 1 -- 172.21.15.1:0/1595507491 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bac105740 con 0x7f6bac1036d0 2024-09-21T00:48:39.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.278+0000 7f6ba3fff640 1 --2- 172.21.15.1:0/1595507491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bac1036d0 0x7f6bac104b00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6b9400d950 tx=0x7f6b9400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:39.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.278+0000 7f6ba37fe640 1 -- 172.21.15.1:0/1595507491 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b94017030 con 0x7f6bac1036d0 2024-09-21T00:48:39.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.278+0000 7f6bb0af6640 1 -- 172.21.15.1:0/1595507491 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bac1a3f40 con 0x7f6bac1036d0 2024-09-21T00:48:39.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.278+0000 7f6ba37fe640 1 -- 172.21.15.1:0/1595507491 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f6b94004020 con 0x7f6bac1036d0 2024-09-21T00:48:39.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.278+0000 7f6ba37fe640 1 -- 172.21.15.1:0/1595507491 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b940055e0 con 0x7f6bac1036d0 2024-09-21T00:48:39.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.278+0000 7f6bb0af6640 1 -- 172.21.15.1:0/1595507491 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bac1a42e0 con 0x7f6bac1036d0 2024-09-21T00:48:39.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.280+0000 7f6bb0af6640 1 -- 172.21.15.1:0/1595507491 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bac102ab0 con 0x7f6bac1036d0 2024-09-21T00:48:39.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.281+0000 7f6ba37fe640 1 -- 172.21.15.1:0/1595507491 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 15) ==== 154455+0+0 (secure 0 0 0) 0x7f6b94009a30 con 0x7f6bac1036d0 2024-09-21T00:48:39.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.281+0000 7f6ba37fe640 1 --2- 172.21.15.1:0/1595507491 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6b980b6480 0x7f6b980b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:39.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.282+0000 7f6baa59c640 1 --2- 172.21.15.1:0/1595507491 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6b980b6480 0x7f6b980b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:39.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.282+0000 7f6ba37fe640 1 -- 172.21.15.1:0/1595507491 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6b940e4fb0 con 0x7f6bac1036d0 2024-09-21T00:48:39.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.282+0000 7f6baa59c640 1 --2- 172.21.15.1:0/1595507491 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6b980b6480 0x7f6b980b8990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c009bd0 tx=0x7f6b9c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:39.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.286+0000 7f6ba37fe640 1 -- 172.21.15.1:0/1595507491 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6b940ad510 con 0x7f6bac1036d0 2024-09-21T00:48:39.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.475+0000 7f6bb0af6640 1 -- 172.21.15.1:0/1595507491 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f6bac1a45a0 con 0x7f6bac1036d0 2024-09-21T00:48:39.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.480+0000 7f6ba37fe640 1 -- 172.21.15.1:0/1595507491 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v26)=0 v26) ==== 106+0+0 (secure 0 0 0) 0x7f6b940cee20 con 0x7f6bac1036d0 2024-09-21T00:48:39.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.482+0000 7f6bb0af6640 1 -- 172.21.15.1:0/1595507491 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6b980b6480 msgr2=0x7f6b980b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:39.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.482+0000 7f6bb0af6640 1 --2- 172.21.15.1:0/1595507491 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6b980b6480 0x7f6b980b8990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c009bd0 tx=0x7f6b9c005f90 comp rx=0 tx=0).stop 2024-09-21T00:48:39.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.482+0000 7f6bb0af6640 1 -- 172.21.15.1:0/1595507491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bac1036d0 msgr2=0x7f6bac104b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:39.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.482+0000 7f6bb0af6640 1 --2- 172.21.15.1:0/1595507491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bac1036d0 0x7f6bac104b00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6b9400d950 tx=0x7f6b9400de10 comp rx=0 tx=0).stop 2024-09-21T00:48:39.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.482+0000 7f6bb0af6640 1 -- 172.21.15.1:0/1595507491 shutdown_connections 2024-09-21T00:48:39.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.482+0000 7f6bb0af6640 1 --2- 172.21.15.1:0/1595507491 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6bac104070 0x7f6bac105040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:39.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.482+0000 7f6bb0af6640 1 --2- 172.21.15.1:0/1595507491 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6b980b6480 0x7f6b980b8990 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:39.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.482+0000 7f6bb0af6640 1 --2- 172.21.15.1:0/1595507491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bac1036d0 0x7f6bac104b00 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:39.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.482+0000 7f6bb0af6640 1 --2- 172.21.15.1:0/1595507491 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bac102640 0x7f6bac106230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:39.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.482+0000 7f6bb0af6640 1 -- 172.21.15.1:0/1595507491 >> 172.21.15.1:0/1595507491 conn(0x7f6bac0fdfb0 msgr2=0x7f6bac0ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:39.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.482+0000 7f6bb0af6640 1 -- 172.21.15.1:0/1595507491 shutdown_connections 2024-09-21T00:48:39.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.482+0000 7f6bb0af6640 1 -- 172.21.15.1:0/1595507491 wait complete. 2024-09-21T00:48:39.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.504+0000 7fad0c949640 1 -- 172.21.15.1:0/2491496767 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad08102640 msgr2=0x7fad08102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:39.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.504+0000 7fad0c949640 1 --2- 172.21.15.1:0/2491496767 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad08102640 0x7fad08102ab0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7facf8009be0 tx=0x7facf802a750 comp rx=0 tx=0).stop 2024-09-21T00:48:39.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.504+0000 7fad0c949640 1 -- 172.21.15.1:0/2491496767 shutdown_connections 2024-09-21T00:48:39.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.504+0000 7fad0c949640 1 --2- 172.21.15.1:0/2491496767 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad08104070 0x7fad0810aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:39.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.504+0000 7fad0c949640 1 --2- 172.21.15.1:0/2491496767 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad081036d0 0x7fad08103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:39.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.504+0000 7fad0c949640 1 --2- 172.21.15.1:0/2491496767 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad08102640 0x7fad08102ab0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:39.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.504+0000 7fad0c949640 1 -- 172.21.15.1:0/2491496767 >> 172.21.15.1:0/2491496767 conn(0x7fad080fdfd0 msgr2=0x7fad08100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:39.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.504+0000 7fad0c949640 1 -- 172.21.15.1:0/2491496767 shutdown_connections 2024-09-21T00:48:39.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.504+0000 7fad0c949640 1 -- 172.21.15.1:0/2491496767 wait complete. 2024-09-21T00:48:39.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.505+0000 7fad0c949640 1 Processor -- start 2024-09-21T00:48:39.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.506+0000 7fad0c949640 1 -- start start 2024-09-21T00:48:39.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.506+0000 7fad0c949640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad08102640 0x7fad08106230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:39.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.506+0000 7fad0c949640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad081036d0 0x7fad08104b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:39.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.506+0000 7fad0c949640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad08104070 0x7fad08105040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:39.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.506+0000 7fad0c949640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fad0810e120 con 0x7fad081036d0 2024-09-21T00:48:39.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.506+0000 7fad0c949640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fad0810dfa0 con 0x7fad08104070 2024-09-21T00:48:39.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.506+0000 7fad0c949640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fad0810e2a0 con 0x7fad08102640 2024-09-21T00:48:39.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.506+0000 7fad0659c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad08102640 0x7fad08106230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:39.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.506+0000 7fad0659c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad08102640 0x7fad08106230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:60596/0 (socket says 172.21.15.1:60596) 2024-09-21T00:48:39.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.506+0000 7fad0659c640 1 -- 172.21.15.1:0/2860611549 learned_addr learned my addr 172.21.15.1:0/2860611549 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:48:39.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.506+0000 7fad05d9b640 1 --2- 172.21.15.1:0/2860611549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad081036d0 0x7fad08104b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:39.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.506+0000 7fad06d9d640 1 --2- 172.21.15.1:0/2860611549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad08104070 0x7fad08105040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:39.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.507+0000 7fad06d9d640 1 -- 172.21.15.1:0/2860611549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad08102640 msgr2=0x7fad08106230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:39.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.507+0000 7fad06d9d640 1 --2- 172.21.15.1:0/2860611549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad08102640 0x7fad08106230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:39.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.507+0000 7fad06d9d640 1 -- 172.21.15.1:0/2860611549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad081036d0 msgr2=0x7fad08104b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:39.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.507+0000 7fad06d9d640 1 --2- 172.21.15.1:0/2860611549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad081036d0 0x7fad08104b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:39.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.507+0000 7fad06d9d640 1 -- 172.21.15.1:0/2860611549 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad08105740 con 0x7fad08104070 2024-09-21T00:48:39.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.507+0000 7fad0659c640 1 --2- 172.21.15.1:0/2860611549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad08102640 0x7fad08106230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:48:39.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.507+0000 7fad06d9d640 1 --2- 172.21.15.1:0/2860611549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad08104070 0x7fad08105040 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fad0000e970 tx=0x7fad0000ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:39.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.507+0000 7facff7fe640 1 -- 172.21.15.1:0/2860611549 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0000ccc0 con 0x7fad08104070 2024-09-21T00:48:39.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.507+0000 7fad0c949640 1 -- 172.21.15.1:0/2860611549 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad081a3f60 con 0x7fad08104070 2024-09-21T00:48:39.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.507+0000 7fad0c949640 1 -- 172.21.15.1:0/2860611549 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad081a4300 con 0x7fad08104070 2024-09-21T00:48:39.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.507+0000 7facff7fe640 1 -- 172.21.15.1:0/2860611549 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fad00005020 con 0x7fad08104070 2024-09-21T00:48:39.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.507+0000 7facff7fe640 1 -- 172.21.15.1:0/2860611549 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0000ce60 con 0x7fad08104070 2024-09-21T00:48:39.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.509+0000 7fad0c949640 1 -- 172.21.15.1:0/2860611549 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7face80052c0 con 0x7fad08104070 2024-09-21T00:48:39.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.510+0000 7facff7fe640 1 -- 172.21.15.1:0/2860611549 <== mon.2 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 15) ==== 154455+0+0 (secure 0 0 0) 0x7fad00004a00 con 0x7fad08104070 2024-09-21T00:48:39.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.511+0000 7facff7fe640 1 --2- 172.21.15.1:0/2860611549 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7facf40b6580 0x7facf40b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:39.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.511+0000 7fad0659c640 1 --2- 172.21.15.1:0/2860611549 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7facf40b6580 0x7facf40b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:39.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.511+0000 7facff7fe640 1 -- 172.21.15.1:0/2860611549 <== mon.2 v2:172.21.15.42:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fad000e5560 con 0x7fad08104070 2024-09-21T00:48:39.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.511+0000 7fad0659c640 1 --2- 172.21.15.1:0/2860611549 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7facf40b6580 0x7facf40b8a90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7facf80099a0 tx=0x7facf8004a60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:39.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.516+0000 7facff7fe640 1 -- 172.21.15.1:0/2860611549 <== mon.2 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fad000ada20 con 0x7fad08104070 2024-09-21T00:48:39.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.710+0000 7fad0c949640 1 -- 172.21.15.1:0/2860611549 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7face80055b0 con 0x7fad08104070 2024-09-21T00:48:39.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.716+0000 7facff7fe640 1 -- 172.21.15.1:0/2860611549 <== mon.2 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v27)=0 v27) ==== 119+0+0 (secure 0 0 0) 0x7fad000b1e00 con 0x7fad08104070 2024-09-21T00:48:39.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.718+0000 7fad0c949640 1 -- 172.21.15.1:0/2860611549 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7facf40b6580 msgr2=0x7facf40b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:39.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.718+0000 7fad0c949640 1 --2- 172.21.15.1:0/2860611549 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7facf40b6580 0x7facf40b8a90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7facf80099a0 tx=0x7facf8004a60 comp rx=0 tx=0).stop 2024-09-21T00:48:39.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.718+0000 7fad0c949640 1 -- 172.21.15.1:0/2860611549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad08104070 msgr2=0x7fad08105040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:39.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.718+0000 7fad0c949640 1 --2- 172.21.15.1:0/2860611549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad08104070 0x7fad08105040 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fad0000e970 tx=0x7fad0000ee30 comp rx=0 tx=0).stop 2024-09-21T00:48:39.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.718+0000 7fad0c949640 1 -- 172.21.15.1:0/2860611549 shutdown_connections 2024-09-21T00:48:39.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.718+0000 7fad0c949640 1 --2- 172.21.15.1:0/2860611549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad08104070 0x7fad08105040 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:39.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.718+0000 7fad0c949640 1 --2- 172.21.15.1:0/2860611549 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7facf40b6580 0x7facf40b8a90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:39.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.718+0000 7fad0c949640 1 --2- 172.21.15.1:0/2860611549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad081036d0 0x7fad08104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:39.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.718+0000 7fad0c949640 1 --2- 172.21.15.1:0/2860611549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad08102640 0x7fad08106230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:39.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.718+0000 7fad0c949640 1 -- 172.21.15.1:0/2860611549 >> 172.21.15.1:0/2860611549 conn(0x7fad080fdfd0 msgr2=0x7fad080ff920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:39.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.718+0000 7fad0c949640 1 -- 172.21.15.1:0/2860611549 shutdown_connections 2024-09-21T00:48:39.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:39.719+0000 7fad0c949640 1 -- 172.21.15.1:0/2860611549 wait complete. 2024-09-21T00:48:40.087 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:39 smithi001 ceph-mon[31211]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:40.087 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:39 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/4028483910' entity='client.admin' 2024-09-21T00:48:40.087 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:39 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1595507491' entity='client.admin' 2024-09-21T00:48:40.087 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:39 smithi001 ceph-mon[31211]: from='client.? ' entity='client.admin' 2024-09-21T00:48:40.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:39 smithi193 ceph-mon[34660]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:40.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:39 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/4028483910' entity='client.admin' 2024-09-21T00:48:40.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:39 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/1595507491' entity='client.admin' 2024-09-21T00:48:40.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:39 smithi193 ceph-mon[34660]: from='client.? ' entity='client.admin' 2024-09-21T00:48:40.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:39 smithi042 ceph-mon[34481]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:40.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:39 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/4028483910' entity='client.admin' 2024-09-21T00:48:40.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:39 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/1595507491' entity='client.admin' 2024-09-21T00:48:40.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:39 smithi042 ceph-mon[34481]: from='client.? ' entity='client.admin' 2024-09-21T00:48:40.282 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:40.282 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:40.282 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:40.283 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:41.926 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:41 smithi001 ceph-mon[31211]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:41.926 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:41 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:41.926 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:41 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:41.926 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:41 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:48:41.957 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3972c20-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi001') 2024-09-21T00:48:41.958 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3972c20-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi001') 2024-09-21T00:48:42.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:41 smithi193 ceph-mon[34660]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:42.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:41 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:42.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:41 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:42.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:41 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:48:42.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:41 smithi042 ceph-mon[34481]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:42.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:41 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:42.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:41 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:42.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:41 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:48:42.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.710+0000 7f95ad99e640 1 -- 172.21.15.1:0/3143108230 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95a81068e0 msgr2=0x7f95a8108d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:42.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.710+0000 7f95ad99e640 1 --2- 172.21.15.1:0/3143108230 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95a81068e0 0x7f95a8108d40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f959c009900 tx=0x7f959c02a410 comp rx=0 tx=0).stop 2024-09-21T00:48:42.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.710+0000 7f95ad99e640 1 -- 172.21.15.1:0/3143108230 shutdown_connections 2024-09-21T00:48:42.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.710+0000 7f95ad99e640 1 --2- 172.21.15.1:0/3143108230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95a8109480 0x7f95a810b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:42.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.710+0000 7f95ad99e640 1 --2- 172.21.15.1:0/3143108230 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95a81068e0 0x7f95a8108d40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:42.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.710+0000 7f95ad99e640 1 --2- 172.21.15.1:0/3143108230 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95a806c600 0x7f95a81063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:42.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.710+0000 7f95ad99e640 1 -- 172.21.15.1:0/3143108230 >> 172.21.15.1:0/3143108230 conn(0x7f95a80fdfa0 msgr2=0x7f95a8100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:42.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.710+0000 7f95ad99e640 1 -- 172.21.15.1:0/3143108230 shutdown_connections 2024-09-21T00:48:42.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.710+0000 7f95ad99e640 1 -- 172.21.15.1:0/3143108230 wait complete. 2024-09-21T00:48:42.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.710+0000 7f95ad99e640 1 Processor -- start 2024-09-21T00:48:42.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.711+0000 7f95ad99e640 1 -- start start 2024-09-21T00:48:42.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.711+0000 7f95ad99e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95a806c600 0x7f95a8199f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:42.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.711+0000 7f95ad99e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95a81068e0 0x7f95a819a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:42.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.711+0000 7f95ad99e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95a8109480 0x7f95a819b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:42.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.711+0000 7f95ad99e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f95a810f230 con 0x7f95a81068e0 2024-09-21T00:48:42.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.711+0000 7f95ad99e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f95a810f0b0 con 0x7f95a806c600 2024-09-21T00:48:42.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.711+0000 7f95ad99e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f95a810f3b0 con 0x7f95a8109480 2024-09-21T00:48:42.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.711+0000 7f95a67fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95a81068e0 0x7f95a819a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:42.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.711+0000 7f95a67fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95a81068e0 0x7f95a819a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57368/0 (socket says 172.21.15.1:57368) 2024-09-21T00:48:42.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.711+0000 7f95a67fc640 1 -- 172.21.15.1:0/2117958475 learned_addr learned my addr 172.21.15.1:0/2117958475 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:48:42.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.711+0000 7f95a6ffd640 1 --2- 172.21.15.1:0/2117958475 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95a806c600 0x7f95a8199f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:42.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.711+0000 7f95a77fe640 1 --2- 172.21.15.1:0/2117958475 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95a8109480 0x7f95a819b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:42.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.711+0000 7f95a67fc640 1 -- 172.21.15.1:0/2117958475 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95a8109480 msgr2=0x7f95a819b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:42.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.711+0000 7f95a67fc640 1 --2- 172.21.15.1:0/2117958475 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95a8109480 0x7f95a819b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:42.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.711+0000 7f95a67fc640 1 -- 172.21.15.1:0/2117958475 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95a806c600 msgr2=0x7f95a8199f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:42.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.711+0000 7f95a67fc640 1 --2- 172.21.15.1:0/2117958475 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95a806c600 0x7f95a8199f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:42.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.711+0000 7f95a67fc640 1 -- 172.21.15.1:0/2117958475 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a819b940 con 0x7f95a81068e0 2024-09-21T00:48:42.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.712+0000 7f95a67fc640 1 --2- 172.21.15.1:0/2117958475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95a81068e0 0x7f95a819a580 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f959c006010 tx=0x7f959c0042d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:42.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.712+0000 7f95ac99c640 1 -- 172.21.15.1:0/2117958475 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959c03f030 con 0x7f95a81068e0 2024-09-21T00:48:42.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.712+0000 7f95ac99c640 1 -- 172.21.15.1:0/2117958475 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f959c0044c0 con 0x7f95a81068e0 2024-09-21T00:48:42.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.712+0000 7f95ad99e640 1 -- 172.21.15.1:0/2117958475 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95a819bbd0 con 0x7f95a81068e0 2024-09-21T00:48:42.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.712+0000 7f95ac99c640 1 -- 172.21.15.1:0/2117958475 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959c035070 con 0x7f95a81068e0 2024-09-21T00:48:42.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.712+0000 7f95ad99e640 1 -- 172.21.15.1:0/2117958475 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95a81a2330 con 0x7f95a81068e0 2024-09-21T00:48:42.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.713+0000 7f95ad99e640 1 -- 172.21.15.1:0/2117958475 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95a80ffac0 con 0x7f95a81068e0 2024-09-21T00:48:42.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.715+0000 7f95ac99c640 1 -- 172.21.15.1:0/2117958475 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 15) ==== 154455+0+0 (secure 0 0 0) 0x7f959c042030 con 0x7f95a81068e0 2024-09-21T00:48:42.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.716+0000 7f95ac99c640 1 --2- 172.21.15.1:0/2117958475 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f95900b6500 0x7f95900b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:42.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.716+0000 7f95a6ffd640 1 --2- 172.21.15.1:0/2117958475 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f95900b6500 0x7f95900b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:42.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.716+0000 7f95ac99c640 1 -- 172.21.15.1:0/2117958475 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f959c106330 con 0x7f95a81068e0 2024-09-21T00:48:42.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.716+0000 7f95a6ffd640 1 --2- 172.21.15.1:0/2117958475 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f95900b6500 0x7f95900b8a10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9598005c40 tx=0x7f959800a590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:42.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.719+0000 7f95ac99c640 1 -- 172.21.15.1:0/2117958475 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f959c0d2c70 con 0x7f95a81068e0 2024-09-21T00:48:42.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.911+0000 7f95ad99e640 1 -- 172.21.15.1:0/2117958475 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f95a802e640 con 0x7f95a81068e0 2024-09-21T00:48:42.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.915+0000 7f95ac99c640 1 -- 172.21.15.1:0/2117958475 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v28)=0 v28) ==== 123+0+0 (secure 0 0 0) 0x7f959c0d7bb0 con 0x7f95a81068e0 2024-09-21T00:48:42.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.916+0000 7f95ac99c640 1 -- 172.21.15.1:0/2117958475 <== mon.0 v2:172.21.15.1:3300/0 8 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f959c0cdd50 con 0x7f95a81068e0 2024-09-21T00:48:42.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.917+0000 7f95ad99e640 1 -- 172.21.15.1:0/2117958475 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f95900b6500 msgr2=0x7f95900b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:42.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.917+0000 7f95ad99e640 1 --2- 172.21.15.1:0/2117958475 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f95900b6500 0x7f95900b8a10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9598005c40 tx=0x7f959800a590 comp rx=0 tx=0).stop 2024-09-21T00:48:42.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.917+0000 7f95ad99e640 1 -- 172.21.15.1:0/2117958475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95a81068e0 msgr2=0x7f95a819a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:42.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.917+0000 7f95ad99e640 1 --2- 172.21.15.1:0/2117958475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95a81068e0 0x7f95a819a580 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f959c006010 tx=0x7f959c0042d0 comp rx=0 tx=0).stop 2024-09-21T00:48:42.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.918+0000 7f95ad99e640 1 -- 172.21.15.1:0/2117958475 shutdown_connections 2024-09-21T00:48:42.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.918+0000 7f95ad99e640 1 --2- 172.21.15.1:0/2117958475 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95a8109480 0x7f95a819b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:42.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.918+0000 7f95ad99e640 1 --2- 172.21.15.1:0/2117958475 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f95900b6500 0x7f95900b8a10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:42.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.918+0000 7f95ad99e640 1 --2- 172.21.15.1:0/2117958475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95a81068e0 0x7f95a819a580 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:42.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.918+0000 7f95ad99e640 1 --2- 172.21.15.1:0/2117958475 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95a806c600 0x7f95a8199f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:42.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.918+0000 7f95ad99e640 1 -- 172.21.15.1:0/2117958475 >> 172.21.15.1:0/2117958475 conn(0x7f95a80fdfa0 msgr2=0x7f95a8104e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:42.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.918+0000 7f95ad99e640 1 -- 172.21.15.1:0/2117958475 shutdown_connections 2024-09-21T00:48:42.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:42.918+0000 7f95ad99e640 1 -- 172.21.15.1:0/2117958475 wait complete. 2024-09-21T00:48:43.855 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:43 smithi001 ceph-mon[31211]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:43.855 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:43 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/2117958475' entity='client.admin' 2024-09-21T00:48:43.855 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:43 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/199356363' entity='client.admin' 2024-09-21T00:48:44.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.355+0000 7f79f21c3640 1 -- 172.21.15.1:0/297881926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79ec1036d0 msgr2=0x7f79ec103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:44.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.355+0000 7f79f21c3640 1 --2- 172.21.15.1:0/297881926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79ec1036d0 0x7f79ec103ae0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f79e0009900 tx=0x7f79e002a480 comp rx=0 tx=0).stop 2024-09-21T00:48:44.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.355+0000 7f79f21c3640 1 -- 172.21.15.1:0/297881926 shutdown_connections 2024-09-21T00:48:44.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.355+0000 7f79f21c3640 1 --2- 172.21.15.1:0/297881926 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79ec104070 0x7f79ec10aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:44.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.355+0000 7f79f21c3640 1 --2- 172.21.15.1:0/297881926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79ec1036d0 0x7f79ec103ae0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:44.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.355+0000 7f79f21c3640 1 --2- 172.21.15.1:0/297881926 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79ec102640 0x7f79ec102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:44.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.355+0000 7f79f21c3640 1 -- 172.21.15.1:0/297881926 >> 172.21.15.1:0/297881926 conn(0x7f79ec0fdfd0 msgr2=0x7f79ec100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:44.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.355+0000 7f79f21c3640 1 -- 172.21.15.1:0/297881926 shutdown_connections 2024-09-21T00:48:44.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.355+0000 7f79f21c3640 1 -- 172.21.15.1:0/297881926 wait complete. 2024-09-21T00:48:44.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.356+0000 7f79f21c3640 1 Processor -- start 2024-09-21T00:48:44.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.356+0000 7f79f21c3640 1 -- start start 2024-09-21T00:48:44.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.356+0000 7f79f21c3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79ec102640 0x7f79ec06c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:44.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.356+0000 7f79f21c3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79ec1036d0 0x7f79ec19ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:44.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.356+0000 7f79f21c3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79ec104070 0x7f79ec1a1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:44.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.356+0000 7f79f21c3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f79ec10e270 con 0x7f79ec102640 2024-09-21T00:48:44.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.356+0000 7f79f21c3640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f79ec10e0f0 con 0x7f79ec104070 2024-09-21T00:48:44.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.356+0000 7f79f21c3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f79ec10e3f0 con 0x7f79ec1036d0 2024-09-21T00:48:44.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.356+0000 7f79eb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79ec102640 0x7f79ec06c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:44.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.356+0000 7f79eb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79ec102640 0x7f79ec06c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57380/0 (socket says 172.21.15.1:57380) 2024-09-21T00:48:44.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.356+0000 7f79eb7fe640 1 -- 172.21.15.1:0/199356363 learned_addr learned my addr 172.21.15.1:0/199356363 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:48:44.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.357+0000 7f79ebfff640 1 --2- 172.21.15.1:0/199356363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79ec104070 0x7f79ec1a1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:44.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.357+0000 7f79eaffd640 1 --2- 172.21.15.1:0/199356363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79ec1036d0 0x7f79ec19ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:44.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.357+0000 7f79eb7fe640 1 -- 172.21.15.1:0/199356363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79ec1036d0 msgr2=0x7f79ec19ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:44.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.357+0000 7f79eb7fe640 1 --2- 172.21.15.1:0/199356363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79ec1036d0 0x7f79ec19ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:44.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.357+0000 7f79eb7fe640 1 -- 172.21.15.1:0/199356363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79ec104070 msgr2=0x7f79ec1a1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:44.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.357+0000 7f79eb7fe640 1 --2- 172.21.15.1:0/199356363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79ec104070 0x7f79ec1a1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:44.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.357+0000 7f79eb7fe640 1 -- 172.21.15.1:0/199356363 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79ec1a1a00 con 0x7f79ec102640 2024-09-21T00:48:44.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.357+0000 7f79ebfff640 1 --2- 172.21.15.1:0/199356363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79ec104070 0x7f79ec1a1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:48:44.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.357+0000 7f79eb7fe640 1 --2- 172.21.15.1:0/199356363 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79ec102640 0x7f79ec06c400 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00d950 tx=0x7f79dc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:44.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.357+0000 7f79e8ff9640 1 -- 172.21.15.1:0/199356363 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79dc017070 con 0x7f79ec102640 2024-09-21T00:48:44.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.357+0000 7f79f21c3640 1 -- 172.21.15.1:0/199356363 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79ec1a1cf0 con 0x7f79ec102640 2024-09-21T00:48:44.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.357+0000 7f79e8ff9640 1 -- 172.21.15.1:0/199356363 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79dc009c30 con 0x7f79ec102640 2024-09-21T00:48:44.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.357+0000 7f79e8ff9640 1 -- 172.21.15.1:0/199356363 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79dc00f620 con 0x7f79ec102640 2024-09-21T00:48:44.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.357+0000 7f79f21c3640 1 -- 172.21.15.1:0/199356363 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79ec1a21c0 con 0x7f79ec102640 2024-09-21T00:48:44.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.358+0000 7f79f21c3640 1 -- 172.21.15.1:0/199356363 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79ec109800 con 0x7f79ec102640 2024-09-21T00:48:44.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.360+0000 7f79e8ff9640 1 -- 172.21.15.1:0/199356363 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 15) ==== 154455+0+0 (secure 0 0 0) 0x7f79dc010460 con 0x7f79ec102640 2024-09-21T00:48:44.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.360+0000 7f79e8ff9640 1 --2- 172.21.15.1:0/199356363 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f79d40b6480 0x7f79d40b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:44.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.360+0000 7f79eaffd640 1 --2- 172.21.15.1:0/199356363 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f79d40b6480 0x7f79d40b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:44.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.361+0000 7f79e8ff9640 1 -- 172.21.15.1:0/199356363 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f79dc0e5310 con 0x7f79ec102640 2024-09-21T00:48:44.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.361+0000 7f79eaffd640 1 --2- 172.21.15.1:0/199356363 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f79d40b6480 0x7f79d40b8990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f79e002a9a0 tx=0x7f79e0005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:44.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.364+0000 7f79e8ff9640 1 -- 172.21.15.1:0/199356363 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f79dc0ad870 con 0x7f79ec102640 2024-09-21T00:48:44.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.552+0000 7f79f21c3640 1 -- 172.21.15.1:0/199356363 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f79ec02e640 con 0x7f79ec102640 2024-09-21T00:48:44.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.557+0000 7f79e8ff9640 1 -- 172.21.15.1:0/199356363 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v29)=0 v29) ==== 121+0+0 (secure 0 0 0) 0x7f79dc009de0 con 0x7f79ec102640 2024-09-21T00:48:44.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.559+0000 7f79f21c3640 1 -- 172.21.15.1:0/199356363 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f79d40b6480 msgr2=0x7f79d40b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:44.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.559+0000 7f79f21c3640 1 --2- 172.21.15.1:0/199356363 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f79d40b6480 0x7f79d40b8990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f79e002a9a0 tx=0x7f79e0005fd0 comp rx=0 tx=0).stop 2024-09-21T00:48:44.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.559+0000 7f79f21c3640 1 -- 172.21.15.1:0/199356363 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79ec102640 msgr2=0x7f79ec06c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:44.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.559+0000 7f79f21c3640 1 --2- 172.21.15.1:0/199356363 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79ec102640 0x7f79ec06c400 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00d950 tx=0x7f79dc00de10 comp rx=0 tx=0).stop 2024-09-21T00:48:44.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.559+0000 7f79f21c3640 1 -- 172.21.15.1:0/199356363 shutdown_connections 2024-09-21T00:48:44.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.559+0000 7f79f21c3640 1 --2- 172.21.15.1:0/199356363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79ec104070 0x7f79ec1a1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:44.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.559+0000 7f79f21c3640 1 --2- 172.21.15.1:0/199356363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79ec1036d0 0x7f79ec19ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:44.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.559+0000 7f79f21c3640 1 --2- 172.21.15.1:0/199356363 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f79d40b6480 0x7f79d40b8990 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:44.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.559+0000 7f79f21c3640 1 --2- 172.21.15.1:0/199356363 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79ec102640 0x7f79ec06c400 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:44.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.559+0000 7f79f21c3640 1 -- 172.21.15.1:0/199356363 >> 172.21.15.1:0/199356363 conn(0x7f79ec0fdfd0 msgr2=0x7f79ec1069d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:44.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.560+0000 7f79f21c3640 1 -- 172.21.15.1:0/199356363 shutdown_connections 2024-09-21T00:48:44.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.560+0000 7f79f21c3640 1 -- 172.21.15.1:0/199356363 wait complete. 2024-09-21T00:48:44.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:43 smithi193 ceph-mon[34660]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:44.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:43 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/2117958475' entity='client.admin' 2024-09-21T00:48:44.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:43 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/199356363' entity='client.admin' 2024-09-21T00:48:44.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:43 smithi042 ceph-mon[34481]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:44.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:43 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/2117958475' entity='client.admin' 2024-09-21T00:48:44.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:43 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/199356363' entity='client.admin' 2024-09-21T00:48:44.641 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:44.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.768+0000 7fd8e43bb640 1 -- 172.21.15.1:0/438405895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8dc1068e0 msgr2=0x7fd8dc108d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:44.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.768+0000 7fd8e43bb640 1 --2- 172.21.15.1:0/438405895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8dc1068e0 0x7fd8dc108d40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc009900 tx=0x7fd8cc02a410 comp rx=0 tx=0).stop 2024-09-21T00:48:44.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.768+0000 7fd8e43bb640 1 -- 172.21.15.1:0/438405895 shutdown_connections 2024-09-21T00:48:44.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.768+0000 7fd8e43bb640 1 --2- 172.21.15.1:0/438405895 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8dc109480 0x7fd8dc10b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:44.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.768+0000 7fd8e43bb640 1 --2- 172.21.15.1:0/438405895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8dc1068e0 0x7fd8dc108d40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:44.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.768+0000 7fd8e43bb640 1 --2- 172.21.15.1:0/438405895 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd8dc06c600 0x7fd8dc1063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:44.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.768+0000 7fd8e43bb640 1 -- 172.21.15.1:0/438405895 >> 172.21.15.1:0/438405895 conn(0x7fd8dc0fdfa0 msgr2=0x7fd8dc100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:44.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.768+0000 7fd8e43bb640 1 -- 172.21.15.1:0/438405895 shutdown_connections 2024-09-21T00:48:44.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.768+0000 7fd8e43bb640 1 -- 172.21.15.1:0/438405895 wait complete. 2024-09-21T00:48:44.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.769+0000 7fd8e43bb640 1 Processor -- start 2024-09-21T00:48:44.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.769+0000 7fd8e43bb640 1 -- start start 2024-09-21T00:48:44.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.769+0000 7fd8e43bb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8dc06c600 0x7fd8dc199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:44.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.769+0000 7fd8e43bb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd8dc1068e0 0x7fd8dc19a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:44.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.769+0000 7fd8e43bb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8dc109480 0x7fd8dc19b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:44.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.769+0000 7fd8e43bb640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd8dc10f370 con 0x7fd8dc109480 2024-09-21T00:48:44.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.769+0000 7fd8e43bb640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd8dc10f1f0 con 0x7fd8dc06c600 2024-09-21T00:48:44.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.769+0000 7fd8e43bb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd8dc10f4f0 con 0x7fd8dc1068e0 2024-09-21T00:48:44.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.769+0000 7fd8e2958640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8dc109480 0x7fd8dc19b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:44.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.769+0000 7fd8e2958640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8dc109480 0x7fd8dc19b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57418/0 (socket says 172.21.15.1:57418) 2024-09-21T00:48:44.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.769+0000 7fd8e2958640 1 -- 172.21.15.1:0/3175752636 learned_addr learned my addr 172.21.15.1:0/3175752636 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:48:44.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.769+0000 7fd8e1956640 1 --2- 172.21.15.1:0/3175752636 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd8dc1068e0 0x7fd8dc19a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:44.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.770+0000 7fd8e2157640 1 --2- 172.21.15.1:0/3175752636 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8dc06c600 0x7fd8dc199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:44.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.770+0000 7fd8e2958640 1 -- 172.21.15.1:0/3175752636 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd8dc1068e0 msgr2=0x7fd8dc19a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:44.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.770+0000 7fd8e2958640 1 --2- 172.21.15.1:0/3175752636 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd8dc1068e0 0x7fd8dc19a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:44.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.770+0000 7fd8e2958640 1 -- 172.21.15.1:0/3175752636 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8dc06c600 msgr2=0x7fd8dc199ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:44.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.770+0000 7fd8e2958640 1 --2- 172.21.15.1:0/3175752636 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8dc06c600 0x7fd8dc199ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:44.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.770+0000 7fd8e2958640 1 -- 172.21.15.1:0/3175752636 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8dc19ba20 con 0x7fd8dc109480 2024-09-21T00:48:44.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.770+0000 7fd8e2157640 1 --2- 172.21.15.1:0/3175752636 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8dc06c600 0x7fd8dc199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:48:44.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.770+0000 7fd8e2958640 1 --2- 172.21.15.1:0/3175752636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8dc109480 0x7fd8dc19b200 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd8d400cad0 tx=0x7fd8d400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:44.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.770+0000 7fd8d37fe640 1 -- 172.21.15.1:0/3175752636 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d400ae20 con 0x7fd8dc109480 2024-09-21T00:48:44.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.770+0000 7fd8d37fe640 1 -- 172.21.15.1:0/3175752636 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8d4005020 con 0x7fd8dc109480 2024-09-21T00:48:44.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.770+0000 7fd8e43bb640 1 -- 172.21.15.1:0/3175752636 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8dc19bd10 con 0x7fd8dc109480 2024-09-21T00:48:44.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.770+0000 7fd8d37fe640 1 -- 172.21.15.1:0/3175752636 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d400f6b0 con 0x7fd8dc109480 2024-09-21T00:48:44.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.770+0000 7fd8e43bb640 1 -- 172.21.15.1:0/3175752636 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8dc1a2410 con 0x7fd8dc109480 2024-09-21T00:48:44.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.771+0000 7fd8e43bb640 1 -- 172.21.15.1:0/3175752636 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8dc0ffac0 con 0x7fd8dc109480 2024-09-21T00:48:44.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.773+0000 7fd8d37fe640 1 -- 172.21.15.1:0/3175752636 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 15) ==== 154455+0+0 (secure 0 0 0) 0x7fd8d40051d0 con 0x7fd8dc109480 2024-09-21T00:48:44.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.774+0000 7fd8d37fe640 1 --2- 172.21.15.1:0/3175752636 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd8c80b6480 0x7fd8c80b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:44.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.774+0000 7fd8e2157640 1 --2- 172.21.15.1:0/3175752636 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd8c80b6480 0x7fd8c80b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:44.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.774+0000 7fd8d37fe640 1 -- 172.21.15.1:0/3175752636 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd8d40e5a20 con 0x7fd8dc109480 2024-09-21T00:48:44.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.774+0000 7fd8e2157640 1 --2- 172.21.15.1:0/3175752636 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd8c80b6480 0x7fd8c80b8990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8005d00 tx=0x7fd8d8005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:44.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.777+0000 7fd8d37fe640 1 -- 172.21.15.1:0/3175752636 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd8d4014030 con 0x7fd8dc109480 2024-09-21T00:48:44.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.994+0000 7fd8e43bb640 1 -- 172.21.15.1:0/3175752636 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fd8dc02e640 con 0x7fd8dc109480 2024-09-21T00:48:44.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.995+0000 7fd8d37fe640 1 -- 172.21.15.1:0/3175752636 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v30)=0 v30) ==== 106+0+0 (secure 0 0 0) 0x7fd8d40adf80 con 0x7fd8dc109480 2024-09-21T00:48:44.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.997+0000 7fd8e43bb640 1 -- 172.21.15.1:0/3175752636 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd8c80b6480 msgr2=0x7fd8c80b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:44.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.997+0000 7fd8e43bb640 1 --2- 172.21.15.1:0/3175752636 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd8c80b6480 0x7fd8c80b8990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8005d00 tx=0x7fd8d8005c70 comp rx=0 tx=0).stop 2024-09-21T00:48:44.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.997+0000 7fd8e43bb640 1 -- 172.21.15.1:0/3175752636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8dc109480 msgr2=0x7fd8dc19b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:44.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.997+0000 7fd8e43bb640 1 --2- 172.21.15.1:0/3175752636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8dc109480 0x7fd8dc19b200 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd8d400cad0 tx=0x7fd8d400cf90 comp rx=0 tx=0).stop 2024-09-21T00:48:44.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.997+0000 7fd8e43bb640 1 -- 172.21.15.1:0/3175752636 shutdown_connections 2024-09-21T00:48:44.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.997+0000 7fd8e43bb640 1 --2- 172.21.15.1:0/3175752636 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd8c80b6480 0x7fd8c80b8990 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:44.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.997+0000 7fd8e43bb640 1 --2- 172.21.15.1:0/3175752636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8dc109480 0x7fd8dc19b200 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:44.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.997+0000 7fd8e43bb640 1 --2- 172.21.15.1:0/3175752636 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd8dc1068e0 0x7fd8dc19a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:44.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.997+0000 7fd8e43bb640 1 --2- 172.21.15.1:0/3175752636 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8dc06c600 0x7fd8dc199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:44.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.997+0000 7fd8e43bb640 1 -- 172.21.15.1:0/3175752636 >> 172.21.15.1:0/3175752636 conn(0x7fd8dc0fdfa0 msgr2=0x7fd8dc104df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:44.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.997+0000 7fd8e43bb640 1 -- 172.21.15.1:0/3175752636 shutdown_connections 2024-09-21T00:48:44.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.997+0000 7fd8e43bb640 1 -- 172.21.15.1:0/3175752636 wait complete. 2024-09-21T00:48:45.098 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:44 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1697355192' entity='client.admin' 2024-09-21T00:48:45.098 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:44 smithi001 ceph-mon[31211]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:45.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.899+0000 7f05b33ad640 1 -- 172.21.15.1:0/1600094220 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05ac1051b0 msgr2=0x7f05ac10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:45.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.899+0000 7f05b33ad640 1 --2- 172.21.15.1:0/1600094220 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05ac1051b0 0x7f05ac10bb50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f05a4009ca0 tx=0x7f05a402a950 comp rx=0 tx=0).stop 2024-09-21T00:48:45.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.899+0000 7f05b33ad640 1 -- 172.21.15.1:0/1600094220 shutdown_connections 2024-09-21T00:48:45.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.899+0000 7f05b33ad640 1 --2- 172.21.15.1:0/1600094220 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05ac1051b0 0x7f05ac10bb50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:45.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.899+0000 7f05b33ad640 1 --2- 172.21.15.1:0/1600094220 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05ac104810 0x7f05ac104c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:45.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.899+0000 7f05b33ad640 1 --2- 172.21.15.1:0/1600094220 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05ac103780 0x7f05ac103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:45.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.899+0000 7f05b33ad640 1 -- 172.21.15.1:0/1600094220 >> 172.21.15.1:0/1600094220 conn(0x7f05ac0ff0f0 msgr2=0x7f05ac1015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:45.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.899+0000 7f05b33ad640 1 -- 172.21.15.1:0/1600094220 shutdown_connections 2024-09-21T00:48:45.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.899+0000 7f05b33ad640 1 -- 172.21.15.1:0/1600094220 wait complete. 2024-09-21T00:48:45.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.900+0000 7f05b33ad640 1 Processor -- start 2024-09-21T00:48:45.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.900+0000 7f05b33ad640 1 -- start start 2024-09-21T00:48:45.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.900+0000 7f05b33ad640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05ac103780 0x7f05ac076e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:45.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.900+0000 7f05b33ad640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05ac104810 0x7f05ac075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:45.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.900+0000 7f05b33ad640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05ac1051b0 0x7f05ac075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:45.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.900+0000 7f05b33ad640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f05ac10f3d0 con 0x7f05ac103780 2024-09-21T00:48:45.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.900+0000 7f05b33ad640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f05ac10f250 con 0x7f05ac1051b0 2024-09-21T00:48:45.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.900+0000 7f05b33ad640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f05ac10f550 con 0x7f05ac104810 2024-09-21T00:48:45.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.900+0000 7f05b1149640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05ac103780 0x7f05ac076e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:45.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.900+0000 7f05b1149640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05ac103780 0x7f05ac076e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57440/0 (socket says 172.21.15.1:57440) 2024-09-21T00:48:45.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.900+0000 7f05b1149640 1 -- 172.21.15.1:0/2291442090 learned_addr learned my addr 172.21.15.1:0/2291442090 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:48:45.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.900+0000 7f05b194a640 1 --2- 172.21.15.1:0/2291442090 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05ac1051b0 0x7f05ac075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:45.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.901+0000 7f05b0948640 1 --2- 172.21.15.1:0/2291442090 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05ac104810 0x7f05ac075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:45.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.901+0000 7f05b1149640 1 -- 172.21.15.1:0/2291442090 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05ac104810 msgr2=0x7f05ac075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:45.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.901+0000 7f05b1149640 1 --2- 172.21.15.1:0/2291442090 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05ac104810 0x7f05ac075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:45.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.901+0000 7f05b1149640 1 -- 172.21.15.1:0/2291442090 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05ac1051b0 msgr2=0x7f05ac075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:45.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.901+0000 7f05b1149640 1 --2- 172.21.15.1:0/2291442090 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05ac1051b0 0x7f05ac075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:45.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.901+0000 7f05b1149640 1 -- 172.21.15.1:0/2291442090 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05ac076350 con 0x7f05ac103780 2024-09-21T00:48:45.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.901+0000 7f05b0948640 1 --2- 172.21.15.1:0/2291442090 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05ac104810 0x7f05ac075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:48:45.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.901+0000 7f05b1149640 1 --2- 172.21.15.1:0/2291442090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05ac103780 0x7f05ac076e40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f05a800d770 tx=0x7f05a800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:45.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.901+0000 7f05a27fc640 1 -- 172.21.15.1:0/2291442090 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a8017070 con 0x7f05ac103780 2024-09-21T00:48:45.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.901+0000 7f05a27fc640 1 -- 172.21.15.1:0/2291442090 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05a80054d0 con 0x7f05ac103780 2024-09-21T00:48:45.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.901+0000 7f05a27fc640 1 -- 172.21.15.1:0/2291442090 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a8004c30 con 0x7f05ac103780 2024-09-21T00:48:45.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.901+0000 7f05b33ad640 1 -- 172.21.15.1:0/2291442090 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05ac1a4000 con 0x7f05ac103780 2024-09-21T00:48:45.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.901+0000 7f05b33ad640 1 -- 172.21.15.1:0/2291442090 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05ac1a4460 con 0x7f05ac103780 2024-09-21T00:48:45.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.902+0000 7f05b33ad640 1 -- 172.21.15.1:0/2291442090 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05ac10a960 con 0x7f05ac103780 2024-09-21T00:48:45.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.904+0000 7f05a27fc640 1 -- 172.21.15.1:0/2291442090 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 15) ==== 154455+0+0 (secure 0 0 0) 0x7f05a8004dd0 con 0x7f05ac103780 2024-09-21T00:48:45.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.905+0000 7f05a27fc640 1 --2- 172.21.15.1:0/2291442090 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f05980b6500 0x7f05980b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:45.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.905+0000 7f05b0948640 1 --2- 172.21.15.1:0/2291442090 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f05980b6500 0x7f05980b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:45.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.905+0000 7f05a27fc640 1 -- 172.21.15.1:0/2291442090 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f05a80e55a0 con 0x7f05ac103780 2024-09-21T00:48:45.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.905+0000 7f05b0948640 1 --2- 172.21.15.1:0/2291442090 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f05980b6500 0x7f05980b8a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f059c0058c0 tx=0x7f059c005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:45.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:44.908+0000 7f05a27fc640 1 -- 172.21.15.1:0/2291442090 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f05a80ada60 con 0x7f05ac103780 2024-09-21T00:48:45.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:45.097+0000 7f05b33ad640 1 -- 172.21.15.1:0/2291442090 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f05ac02e640 con 0x7f05ac103780 2024-09-21T00:48:45.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:45.097+0000 7f05a27fc640 1 -- 172.21.15.1:0/2291442090 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v30)=0 v30) ==== 108+0+0 (secure 0 0 0) 0x7f05a80b1e40 con 0x7f05ac103780 2024-09-21T00:48:45.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:45.099+0000 7f05b33ad640 1 -- 172.21.15.1:0/2291442090 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f05980b6500 msgr2=0x7f05980b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:45.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:45.099+0000 7f05b33ad640 1 --2- 172.21.15.1:0/2291442090 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f05980b6500 0x7f05980b8a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f059c0058c0 tx=0x7f059c005ec0 comp rx=0 tx=0).stop 2024-09-21T00:48:45.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:45.099+0000 7f05b33ad640 1 -- 172.21.15.1:0/2291442090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05ac103780 msgr2=0x7f05ac076e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:45.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:45.099+0000 7f05b33ad640 1 --2- 172.21.15.1:0/2291442090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05ac103780 0x7f05ac076e40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f05a800d770 tx=0x7f05a800dc30 comp rx=0 tx=0).stop 2024-09-21T00:48:45.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:45.100+0000 7f05b33ad640 1 -- 172.21.15.1:0/2291442090 shutdown_connections 2024-09-21T00:48:45.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:45.100+0000 7f05b33ad640 1 --2- 172.21.15.1:0/2291442090 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05ac1051b0 0x7f05ac075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:45.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:45.100+0000 7f05b33ad640 1 --2- 172.21.15.1:0/2291442090 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05ac104810 0x7f05ac075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:45.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:45.100+0000 7f05b33ad640 1 --2- 172.21.15.1:0/2291442090 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f05980b6500 0x7f05980b8a10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:45.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:45.100+0000 7f05b33ad640 1 --2- 172.21.15.1:0/2291442090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05ac103780 0x7f05ac076e40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:45.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:45.100+0000 7f05b33ad640 1 -- 172.21.15.1:0/2291442090 >> 172.21.15.1:0/2291442090 conn(0x7f05ac0ff0f0 msgr2=0x7f05ac107b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:45.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:45.100+0000 7f05b33ad640 1 -- 172.21.15.1:0/2291442090 shutdown_connections 2024-09-21T00:48:45.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:45.100+0000 7f05b33ad640 1 -- 172.21.15.1:0/2291442090 wait complete. 2024-09-21T00:48:45.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:44 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/1697355192' entity='client.admin' 2024-09-21T00:48:45.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:44 smithi193 ceph-mon[34660]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:45.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:44 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/1697355192' entity='client.admin' 2024-09-21T00:48:45.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:44 smithi042 ceph-mon[34481]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:45.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.652+0000 7fcf73dd5640 1 -- 172.21.15.1:0/31271985 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf6c105180 msgr2=0x7fcf6c10bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:45.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.652+0000 7fcf73dd5640 1 --2- 172.21.15.1:0/31271985 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf6c105180 0x7fcf6c10bb20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcf64009ca0 tx=0x7fcf6402a950 comp rx=0 tx=0).stop 2024-09-21T00:48:45.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.652+0000 7fcf73dd5640 1 -- 172.21.15.1:0/31271985 shutdown_connections 2024-09-21T00:48:45.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.652+0000 7fcf73dd5640 1 --2- 172.21.15.1:0/31271985 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf6c105180 0x7fcf6c10bb20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:45.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.652+0000 7fcf73dd5640 1 --2- 172.21.15.1:0/31271985 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf6c1047e0 0x7fcf6c104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:45.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.652+0000 7fcf73dd5640 1 --2- 172.21.15.1:0/31271985 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf6c103750 0x7fcf6c103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:45.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.652+0000 7fcf73dd5640 1 -- 172.21.15.1:0/31271985 >> 172.21.15.1:0/31271985 conn(0x7fcf6c0ff0c0 msgr2=0x7fcf6c101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:45.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.652+0000 7fcf73dd5640 1 -- 172.21.15.1:0/31271985 shutdown_connections 2024-09-21T00:48:45.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.652+0000 7fcf73dd5640 1 -- 172.21.15.1:0/31271985 wait complete. 2024-09-21T00:48:45.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.652+0000 7fcf73dd5640 1 Processor -- start 2024-09-21T00:48:45.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.653+0000 7fcf73dd5640 1 -- start start 2024-09-21T00:48:45.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.653+0000 7fcf73dd5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf6c103750 0x7fcf6c199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:45.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.653+0000 7fcf73dd5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf6c1047e0 0x7fcf6c19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:45.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.653+0000 7fcf73dd5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf6c105180 0x7fcf6c19b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:45.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.653+0000 7fcf73dd5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6c10f380 con 0x7fcf6c1047e0 2024-09-21T00:48:45.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.653+0000 7fcf73dd5640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6c10f200 con 0x7fcf6c103750 2024-09-21T00:48:45.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.653+0000 7fcf73dd5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6c10f500 con 0x7fcf6c105180 2024-09-21T00:48:45.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.653+0000 7fcf71370640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf6c1047e0 0x7fcf6c19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:45.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.653+0000 7fcf71370640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf6c1047e0 0x7fcf6c19a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57406/0 (socket says 172.21.15.1:57406) 2024-09-21T00:48:45.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.653+0000 7fcf71370640 1 -- 172.21.15.1:0/1697355192 learned_addr learned my addr 172.21.15.1:0/1697355192 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:48:45.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.653+0000 7fcf71b71640 1 --2- 172.21.15.1:0/1697355192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf6c103750 0x7fcf6c199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:45.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.653+0000 7fcf72372640 1 --2- 172.21.15.1:0/1697355192 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf6c105180 0x7fcf6c19b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:45.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.653+0000 7fcf71370640 1 -- 172.21.15.1:0/1697355192 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf6c105180 msgr2=0x7fcf6c19b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:45.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.653+0000 7fcf71370640 1 --2- 172.21.15.1:0/1697355192 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf6c105180 0x7fcf6c19b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:45.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.653+0000 7fcf71370640 1 -- 172.21.15.1:0/1697355192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf6c103750 msgr2=0x7fcf6c199f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:45.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.653+0000 7fcf71370640 1 --2- 172.21.15.1:0/1697355192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf6c103750 0x7fcf6c199f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:45.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.653+0000 7fcf71370640 1 -- 172.21.15.1:0/1697355192 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf6c19b910 con 0x7fcf6c1047e0 2024-09-21T00:48:45.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.653+0000 7fcf71370640 1 --2- 172.21.15.1:0/1697355192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf6c1047e0 0x7fcf6c19a5e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c00d950 tx=0x7fcf5c00dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:45.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.654+0000 7fcf62ffd640 1 -- 172.21.15.1:0/1697355192 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c017030 con 0x7fcf6c1047e0 2024-09-21T00:48:45.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.654+0000 7fcf62ffd640 1 -- 172.21.15.1:0/1697355192 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf5c004020 con 0x7fcf6c1047e0 2024-09-21T00:48:45.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.654+0000 7fcf73dd5640 1 -- 172.21.15.1:0/1697355192 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf6c19bc00 con 0x7fcf6c1047e0 2024-09-21T00:48:45.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.654+0000 7fcf62ffd640 1 -- 172.21.15.1:0/1697355192 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c005560 con 0x7fcf6c1047e0 2024-09-21T00:48:45.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.654+0000 7fcf73dd5640 1 -- 172.21.15.1:0/1697355192 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf6c1a2390 con 0x7fcf6c1047e0 2024-09-21T00:48:45.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.655+0000 7fcf73dd5640 1 -- 172.21.15.1:0/1697355192 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf6c10a910 con 0x7fcf6c1047e0 2024-09-21T00:48:45.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.656+0000 7fcf62ffd640 1 -- 172.21.15.1:0/1697355192 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 15) ==== 154455+0+0 (secure 0 0 0) 0x7fcf5c009a30 con 0x7fcf6c1047e0 2024-09-21T00:48:45.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.657+0000 7fcf62ffd640 1 --2- 172.21.15.1:0/1697355192 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fcf580b6480 0x7fcf580b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:45.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.657+0000 7fcf71b71640 1 --2- 172.21.15.1:0/1697355192 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fcf580b6480 0x7fcf580b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:45.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.657+0000 7fcf62ffd640 1 -- 172.21.15.1:0/1697355192 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fcf5c0e5500 con 0x7fcf6c1047e0 2024-09-21T00:48:45.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.658+0000 7fcf71b71640 1 --2- 172.21.15.1:0/1697355192 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fcf580b6480 0x7fcf580b8990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcf6800abe0 tx=0x7fcf6800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:45.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.660+0000 7fcf62ffd640 1 -- 172.21.15.1:0/1697355192 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcf5c0ada60 con 0x7fcf6c1047e0 2024-09-21T00:48:45.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.854+0000 7fcf73dd5640 1 -- 172.21.15.1:0/1697355192 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fcf6c02e640 con 0x7fcf6c1047e0 2024-09-21T00:48:45.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.858+0000 7fcf62ffd640 1 -- 172.21.15.1:0/1697355192 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v30)=0 v30) ==== 121+0+0 (secure 0 0 0) 0x7fcf5c0b1e40 con 0x7fcf6c1047e0 2024-09-21T00:48:45.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.862+0000 7fcf73dd5640 1 -- 172.21.15.1:0/1697355192 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fcf580b6480 msgr2=0x7fcf580b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:45.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.862+0000 7fcf73dd5640 1 --2- 172.21.15.1:0/1697355192 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fcf580b6480 0x7fcf580b8990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcf6800abe0 tx=0x7fcf6800a2d0 comp rx=0 tx=0).stop 2024-09-21T00:48:45.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.862+0000 7fcf73dd5640 1 -- 172.21.15.1:0/1697355192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf6c1047e0 msgr2=0x7fcf6c19a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:45.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.862+0000 7fcf73dd5640 1 --2- 172.21.15.1:0/1697355192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf6c1047e0 0x7fcf6c19a5e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c00d950 tx=0x7fcf5c00dd50 comp rx=0 tx=0).stop 2024-09-21T00:48:45.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.862+0000 7fcf73dd5640 1 -- 172.21.15.1:0/1697355192 shutdown_connections 2024-09-21T00:48:45.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.862+0000 7fcf73dd5640 1 --2- 172.21.15.1:0/1697355192 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf6c105180 0x7fcf6c19b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:45.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.862+0000 7fcf73dd5640 1 --2- 172.21.15.1:0/1697355192 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fcf580b6480 0x7fcf580b8990 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:45.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.862+0000 7fcf73dd5640 1 --2- 172.21.15.1:0/1697355192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf6c1047e0 0x7fcf6c19a5e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:45.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.862+0000 7fcf73dd5640 1 --2- 172.21.15.1:0/1697355192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf6c103750 0x7fcf6c199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:45.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.862+0000 7fcf73dd5640 1 -- 172.21.15.1:0/1697355192 >> 172.21.15.1:0/1697355192 conn(0x7fcf6c0ff0c0 msgr2=0x7fcf6c107ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:45.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.862+0000 7fcf73dd5640 1 -- 172.21.15.1:0/1697355192 shutdown_connections 2024-09-21T00:48:45.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:43.862+0000 7fcf73dd5640 1 -- 172.21.15.1:0/1697355192 wait complete. 2024-09-21T00:48:46.171 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:45 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:46.171 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:45 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:48:46.171 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:45 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:46.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:45 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:46.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:45 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:48:46.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:45 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:46.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:45 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:46.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:45 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:48:46.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:45 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:46.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.719+0000 7f5fda008640 1 -- 172.21.15.1:0/1254391068 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5fd4104090 msgr2=0x7f5fd410aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:46.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.719+0000 7f5fda008640 1 --2- 172.21.15.1:0/1254391068 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5fd4104090 0x7f5fd410aa30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc009ca0 tx=0x7f5fcc02a950 comp rx=0 tx=0).stop 2024-09-21T00:48:46.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.719+0000 7f5fda008640 1 -- 172.21.15.1:0/1254391068 shutdown_connections 2024-09-21T00:48:46.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.719+0000 7f5fda008640 1 --2- 172.21.15.1:0/1254391068 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5fd4104090 0x7f5fd410aa30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:46.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.719+0000 7f5fda008640 1 --2- 172.21.15.1:0/1254391068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5fd41036f0 0x7f5fd4103b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:46.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.719+0000 7f5fda008640 1 --2- 172.21.15.1:0/1254391068 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fd4102660 0x7f5fd4102ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:46.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.719+0000 7f5fda008640 1 -- 172.21.15.1:0/1254391068 >> 172.21.15.1:0/1254391068 conn(0x7f5fd40fdfd0 msgr2=0x7f5fd4100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:46.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.720+0000 7f5fda008640 1 -- 172.21.15.1:0/1254391068 shutdown_connections 2024-09-21T00:48:46.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.720+0000 7f5fda008640 1 -- 172.21.15.1:0/1254391068 wait complete. 2024-09-21T00:48:46.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.720+0000 7f5fda008640 1 Processor -- start 2024-09-21T00:48:46.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.720+0000 7f5fda008640 1 -- start start 2024-09-21T00:48:46.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.721+0000 7f5fda008640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5fd4102660 0x7f5fd4199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:46.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.721+0000 7f5fda008640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fd41036f0 0x7f5fd419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:46.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.721+0000 7f5fda008640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5fd4104090 0x7f5fd419b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:46.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.721+0000 7f5fda008640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd410e290 con 0x7f5fd4104090 2024-09-21T00:48:46.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.721+0000 7f5fda008640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd410e110 con 0x7f5fd41036f0 2024-09-21T00:48:46.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.721+0000 7f5fda008640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd410e410 con 0x7f5fd4102660 2024-09-21T00:48:46.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.721+0000 7f5fd3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5fd4104090 0x7f5fd419b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:46.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.721+0000 7f5fd3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5fd4104090 0x7f5fd419b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57448/0 (socket says 172.21.15.1:57448) 2024-09-21T00:48:46.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.721+0000 7f5fd3fff640 1 -- 172.21.15.1:0/728225699 learned_addr learned my addr 172.21.15.1:0/728225699 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:48:46.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.721+0000 7f5fd2ffd640 1 --2- 172.21.15.1:0/728225699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fd41036f0 0x7f5fd419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:46.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.721+0000 7f5fd37fe640 1 --2- 172.21.15.1:0/728225699 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5fd4102660 0x7f5fd4199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:46.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.721+0000 7f5fd3fff640 1 -- 172.21.15.1:0/728225699 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5fd4102660 msgr2=0x7f5fd4199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:46.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.721+0000 7f5fd3fff640 1 --2- 172.21.15.1:0/728225699 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5fd4102660 0x7f5fd4199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:46.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.721+0000 7f5fd3fff640 1 -- 172.21.15.1:0/728225699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fd41036f0 msgr2=0x7f5fd419a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:46.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.721+0000 7f5fd3fff640 1 --2- 172.21.15.1:0/728225699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fd41036f0 0x7f5fd419a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:46.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.721+0000 7f5fd3fff640 1 -- 172.21.15.1:0/728225699 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd419b950 con 0x7f5fd4104090 2024-09-21T00:48:46.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.721+0000 7f5fd3fff640 1 --2- 172.21.15.1:0/728225699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5fd4104090 0x7f5fd419b1c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc006010 tx=0x7f5fcc031d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:46.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.722+0000 7f5fd0ff9640 1 -- 172.21.15.1:0/728225699 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc034040 con 0x7f5fd4104090 2024-09-21T00:48:46.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.722+0000 7f5fd0ff9640 1 -- 172.21.15.1:0/728225699 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5fcc0308f0 con 0x7f5fd4104090 2024-09-21T00:48:46.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.722+0000 7f5fda008640 1 -- 172.21.15.1:0/728225699 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fd419bbe0 con 0x7f5fd4104090 2024-09-21T00:48:46.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.722+0000 7f5fd0ff9640 1 -- 172.21.15.1:0/728225699 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc004750 con 0x7f5fd4104090 2024-09-21T00:48:46.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.722+0000 7f5fda008640 1 -- 172.21.15.1:0/728225699 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fd41a2200 con 0x7f5fd4104090 2024-09-21T00:48:46.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.723+0000 7f5fda008640 1 -- 172.21.15.1:0/728225699 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fd41a23d0 con 0x7f5fd4104090 2024-09-21T00:48:46.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.725+0000 7f5fd0ff9640 1 -- 172.21.15.1:0/728225699 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 15) ==== 154455+0+0 (secure 0 0 0) 0x7f5fcc037020 con 0x7f5fd4104090 2024-09-21T00:48:46.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.725+0000 7f5fd0ff9640 1 --2- 172.21.15.1:0/728225699 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5fbc0b6480 0x7f5fbc0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:46.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.725+0000 7f5fd37fe640 1 --2- 172.21.15.1:0/728225699 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5fbc0b6480 0x7f5fbc0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:46.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.725+0000 7f5fd0ff9640 1 -- 172.21.15.1:0/728225699 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5fcc106610 con 0x7f5fd4104090 2024-09-21T00:48:46.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.726+0000 7f5fd37fe640 1 --2- 172.21.15.1:0/728225699 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5fbc0b6480 0x7f5fbc0b8990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5fc400bbe0 tx=0x7f5fc400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:46.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.730+0000 7f5fd0ff9640 1 -- 172.21.15.1:0/728225699 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5fcc083710 con 0x7f5fd4104090 2024-09-21T00:48:46.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.920+0000 7f5fda008640 1 -- 172.21.15.1:0/728225699 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f5fd41a25a0 con 0x7f5fd4104090 2024-09-21T00:48:46.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.924+0000 7f5fd0ff9640 1 -- 172.21.15.1:0/728225699 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v31)=0 v31) ==== 120+0+0 (secure 0 0 0) 0x7f5fcc0ceb70 con 0x7f5fd4104090 2024-09-21T00:48:46.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.927+0000 7f5fda008640 1 -- 172.21.15.1:0/728225699 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5fbc0b6480 msgr2=0x7f5fbc0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:46.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.927+0000 7f5fda008640 1 --2- 172.21.15.1:0/728225699 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5fbc0b6480 0x7f5fbc0b8990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5fc400bbe0 tx=0x7f5fc400b390 comp rx=0 tx=0).stop 2024-09-21T00:48:46.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.927+0000 7f5fda008640 1 -- 172.21.15.1:0/728225699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5fd4104090 msgr2=0x7f5fd419b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:46.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.927+0000 7f5fda008640 1 --2- 172.21.15.1:0/728225699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5fd4104090 0x7f5fd419b1c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc006010 tx=0x7f5fcc031d30 comp rx=0 tx=0).stop 2024-09-21T00:48:46.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.927+0000 7f5fda008640 1 -- 172.21.15.1:0/728225699 shutdown_connections 2024-09-21T00:48:46.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.927+0000 7f5fda008640 1 --2- 172.21.15.1:0/728225699 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5fbc0b6480 0x7f5fbc0b8990 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:46.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.927+0000 7f5fda008640 1 --2- 172.21.15.1:0/728225699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5fd4104090 0x7f5fd419b1c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:46.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.927+0000 7f5fda008640 1 --2- 172.21.15.1:0/728225699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fd41036f0 0x7f5fd419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:46.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.927+0000 7f5fda008640 1 --2- 172.21.15.1:0/728225699 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5fd4102660 0x7f5fd4199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:46.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.927+0000 7f5fda008640 1 -- 172.21.15.1:0/728225699 >> 172.21.15.1:0/728225699 conn(0x7f5fd40fdfd0 msgr2=0x7f5fd40ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:46.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.927+0000 7f5fda008640 1 -- 172.21.15.1:0/728225699 shutdown_connections 2024-09-21T00:48:46.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:46.927+0000 7f5fda008640 1 -- 172.21.15.1:0/728225699 wait complete. 2024-09-21T00:48:47.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:46 smithi193 ceph-mon[34660]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:47.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:46 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/728225699' entity='client.admin' 2024-09-21T00:48:47.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:46 smithi042 ceph-mon[34481]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:47.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:46 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/728225699' entity='client.admin' 2024-09-21T00:48:47.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:46 smithi001 ceph-mon[31211]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:47.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:46 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/728225699' entity='client.admin' 2024-09-21T00:48:47.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.851+0000 7f55cac6e640 1 -- 172.21.15.1:0/3522497985 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55c4105790 msgr2=0x7f55c4107c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:47.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.851+0000 7f55cac6e640 1 --2- 172.21.15.1:0/3522497985 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55c4105790 0x7f55c4107c70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f55b8009900 tx=0x7f55b802a410 comp rx=0 tx=0).stop 2024-09-21T00:48:47.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.852+0000 7f55cac6e640 1 -- 172.21.15.1:0/3522497985 shutdown_connections 2024-09-21T00:48:47.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.852+0000 7f55cac6e640 1 --2- 172.21.15.1:0/3522497985 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f55c41083b0 0x7f55c410a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:47.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.852+0000 7f55cac6e640 1 --2- 172.21.15.1:0/3522497985 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55c4105790 0x7f55c4107c70 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:47.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.852+0000 7f55cac6e640 1 --2- 172.21.15.1:0/3522497985 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55c4102cd0 0x7f55c4105150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:47.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.852+0000 7f55cac6e640 1 -- 172.21.15.1:0/3522497985 >> 172.21.15.1:0/3522497985 conn(0x7f55c40fd770 msgr2=0x7f55c40ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:47.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.852+0000 7f55cac6e640 1 -- 172.21.15.1:0/3522497985 shutdown_connections 2024-09-21T00:48:47.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.852+0000 7f55cac6e640 1 -- 172.21.15.1:0/3522497985 wait complete. 2024-09-21T00:48:47.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.852+0000 7f55cac6e640 1 Processor -- start 2024-09-21T00:48:47.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.852+0000 7f55cac6e640 1 -- start start 2024-09-21T00:48:47.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.853+0000 7f55cac6e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55c4102cd0 0x7f55c4104990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:47.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.853+0000 7f55cac6e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f55c4105790 0x7f55c4103260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:47.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.853+0000 7f55cac6e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55c41083b0 0x7f55c41037a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:47.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.853+0000 7f55cac6e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f55c410e2f0 con 0x7f55c4102cd0 2024-09-21T00:48:47.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.853+0000 7f55cac6e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f55c410e170 con 0x7f55c41083b0 2024-09-21T00:48:47.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.853+0000 7f55cac6e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f55c410e470 con 0x7f55c4105790 2024-09-21T00:48:47.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.853+0000 7f55c8a0a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55c4102cd0 0x7f55c4104990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:47.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.853+0000 7f55c8a0a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55c4102cd0 0x7f55c4104990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57454/0 (socket says 172.21.15.1:57454) 2024-09-21T00:48:47.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.853+0000 7f55c8a0a640 1 -- 172.21.15.1:0/854576267 learned_addr learned my addr 172.21.15.1:0/854576267 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:48:47.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.853+0000 7f55c920b640 1 --2- 172.21.15.1:0/854576267 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55c41083b0 0x7f55c41037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:47.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.853+0000 7f55c3fff640 1 --2- 172.21.15.1:0/854576267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f55c4105790 0x7f55c4103260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:47.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.853+0000 7f55c8a0a640 1 -- 172.21.15.1:0/854576267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f55c4105790 msgr2=0x7f55c4103260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:47.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.853+0000 7f55c8a0a640 1 --2- 172.21.15.1:0/854576267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f55c4105790 0x7f55c4103260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:47.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.853+0000 7f55c8a0a640 1 -- 172.21.15.1:0/854576267 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55c41083b0 msgr2=0x7f55c41037a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:47.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.853+0000 7f55c8a0a640 1 --2- 172.21.15.1:0/854576267 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55c41083b0 0x7f55c41037a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:47.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.853+0000 7f55c8a0a640 1 -- 172.21.15.1:0/854576267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55c4103ea0 con 0x7f55c4102cd0 2024-09-21T00:48:47.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.853+0000 7f55c8a0a640 1 --2- 172.21.15.1:0/854576267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55c4102cd0 0x7f55c4104990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f55b400d950 tx=0x7f55b400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:47.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.853+0000 7f55c1ffb640 1 -- 172.21.15.1:0/854576267 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b4017070 con 0x7f55c4102cd0 2024-09-21T00:48:47.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.853+0000 7f55c1ffb640 1 -- 172.21.15.1:0/854576267 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55b4009c30 con 0x7f55c4102cd0 2024-09-21T00:48:47.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.853+0000 7f55cac6e640 1 -- 172.21.15.1:0/854576267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55c41a40a0 con 0x7f55c4102cd0 2024-09-21T00:48:47.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.854+0000 7f55c1ffb640 1 -- 172.21.15.1:0/854576267 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b400f620 con 0x7f55c4102cd0 2024-09-21T00:48:47.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.854+0000 7f55cac6e640 1 -- 172.21.15.1:0/854576267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55c41a4550 con 0x7f55c4102cd0 2024-09-21T00:48:47.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.855+0000 7f55cac6e640 1 -- 172.21.15.1:0/854576267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55c41a4800 con 0x7f55c4102cd0 2024-09-21T00:48:47.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.856+0000 7f55c1ffb640 1 -- 172.21.15.1:0/854576267 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 15) ==== 154455+0+0 (secure 0 0 0) 0x7f55b4010460 con 0x7f55c4102cd0 2024-09-21T00:48:47.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.857+0000 7f55c1ffb640 1 --2- 172.21.15.1:0/854576267 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f55ac0b6500 0x7f55ac0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:47.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.857+0000 7f55c3fff640 1 --2- 172.21.15.1:0/854576267 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f55ac0b6500 0x7f55ac0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:47.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.857+0000 7f55c1ffb640 1 -- 172.21.15.1:0/854576267 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f55b40e51c0 con 0x7f55c4102cd0 2024-09-21T00:48:47.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.857+0000 7f55c3fff640 1 --2- 172.21.15.1:0/854576267 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f55ac0b6500 0x7f55ac0b8a10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f55b8000c00 tx=0x7f55b8031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:47.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:47.861+0000 7f55c1ffb640 1 -- 172.21.15.1:0/854576267 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f55b40ad720 con 0x7f55c4102cd0 2024-09-21T00:48:47.992 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3972c20-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi001') 2024-09-21T00:48:47.992 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3972c20-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi001') 2024-09-21T00:48:47.992 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3972c20-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi001') 2024-09-21T00:48:47.992 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3972c20-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi001') 2024-09-21T00:48:47.992 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3972c20-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi001') 2024-09-21T00:48:47.993 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3972c20-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi001') 2024-09-21T00:48:47.993 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3972c20-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi001') 2024-09-21T00:48:47.993 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3972c20-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi001') 2024-09-21T00:48:47.993 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3972c20-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi001') 2024-09-21T00:48:47.993 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3972c20-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi001') 2024-09-21T00:48:48.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.053+0000 7f55cac6e640 1 -- 172.21.15.1:0/854576267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f55c41a49d0 con 0x7f55c4102cd0 2024-09-21T00:48:48.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.059+0000 7f55c1ffb640 1 -- 172.21.15.1:0/854576267 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v32)=0 v32) ==== 121+0+0 (secure 0 0 0) 0x7f55b4009de0 con 0x7f55c4102cd0 2024-09-21T00:48:48.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.062+0000 7f55cac6e640 1 -- 172.21.15.1:0/854576267 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f55ac0b6500 msgr2=0x7f55ac0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:48.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.062+0000 7f55cac6e640 1 --2- 172.21.15.1:0/854576267 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f55ac0b6500 0x7f55ac0b8a10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f55b8000c00 tx=0x7f55b8031400 comp rx=0 tx=0).stop 2024-09-21T00:48:48.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.062+0000 7f55cac6e640 1 -- 172.21.15.1:0/854576267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55c4102cd0 msgr2=0x7f55c4104990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:48.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.062+0000 7f55cac6e640 1 --2- 172.21.15.1:0/854576267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55c4102cd0 0x7f55c4104990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f55b400d950 tx=0x7f55b400de10 comp rx=0 tx=0).stop 2024-09-21T00:48:48.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.062+0000 7f55cac6e640 1 -- 172.21.15.1:0/854576267 shutdown_connections 2024-09-21T00:48:48.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.062+0000 7f55cac6e640 1 --2- 172.21.15.1:0/854576267 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55c41083b0 0x7f55c41037a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:48.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.062+0000 7f55cac6e640 1 --2- 172.21.15.1:0/854576267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f55c4105790 0x7f55c4103260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:48.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.062+0000 7f55cac6e640 1 --2- 172.21.15.1:0/854576267 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f55ac0b6500 0x7f55ac0b8a10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:48.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.062+0000 7f55cac6e640 1 --2- 172.21.15.1:0/854576267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55c4102cd0 0x7f55c4104990 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:48.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.062+0000 7f55cac6e640 1 -- 172.21.15.1:0/854576267 >> 172.21.15.1:0/854576267 conn(0x7f55c40fd770 msgr2=0x7f55c41078c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:48.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.062+0000 7f55cac6e640 1 -- 172.21.15.1:0/854576267 shutdown_connections 2024-09-21T00:48:48.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.062+0000 7f55cac6e640 1 -- 172.21.15.1:0/854576267 wait complete. 2024-09-21T00:48:48.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.830+0000 7fe4d19c6640 1 -- 172.21.15.1:0/2203572158 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4cc106910 msgr2=0x7fe4cc108d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:48.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.830+0000 7fe4d19c6640 1 --2- 172.21.15.1:0/2203572158 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4cc106910 0x7fe4cc108d70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0009900 tx=0x7fe4c002a410 comp rx=0 tx=0).stop 2024-09-21T00:48:48.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.831+0000 7fe4d19c6640 1 -- 172.21.15.1:0/2203572158 shutdown_connections 2024-09-21T00:48:48.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.831+0000 7fe4d19c6640 1 --2- 172.21.15.1:0/2203572158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4cc1094b0 0x7fe4cc10b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:48.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.831+0000 7fe4d19c6640 1 --2- 172.21.15.1:0/2203572158 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4cc106910 0x7fe4cc108d70 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:48.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.831+0000 7fe4d19c6640 1 --2- 172.21.15.1:0/2203572158 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4cc06c6a0 0x7fe4cc1063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:48.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.831+0000 7fe4d19c6640 1 -- 172.21.15.1:0/2203572158 >> 172.21.15.1:0/2203572158 conn(0x7fe4cc0fdff0 msgr2=0x7fe4cc1004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:48.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.831+0000 7fe4d19c6640 1 -- 172.21.15.1:0/2203572158 shutdown_connections 2024-09-21T00:48:48.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.831+0000 7fe4d19c6640 1 -- 172.21.15.1:0/2203572158 wait complete. 2024-09-21T00:48:48.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.831+0000 7fe4d19c6640 1 Processor -- start 2024-09-21T00:48:48.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.831+0000 7fe4d19c6640 1 -- start start 2024-09-21T00:48:48.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.832+0000 7fe4d19c6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4cc06c6a0 0x7fe4cc19a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:48.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.832+0000 7fe4d19c6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4cc106910 0x7fe4cc19a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:48.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.832+0000 7fe4d19c6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4cc1094b0 0x7fe4cc19b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:48.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.832+0000 7fe4d19c6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe4cc10f440 con 0x7fe4cc106910 2024-09-21T00:48:48.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.832+0000 7fe4d19c6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe4cc10f2c0 con 0x7fe4cc1094b0 2024-09-21T00:48:48.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.832+0000 7fe4d19c6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe4cc10f5c0 con 0x7fe4cc06c6a0 2024-09-21T00:48:48.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.832+0000 7fe4ca7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4cc106910 0x7fe4cc19a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:48.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.832+0000 7fe4ca7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4cc106910 0x7fe4cc19a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57484/0 (socket says 172.21.15.1:57484) 2024-09-21T00:48:48.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.832+0000 7fe4ca7fc640 1 -- 172.21.15.1:0/982968457 learned_addr learned my addr 172.21.15.1:0/982968457 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:48:48.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.832+0000 7fe4caffd640 1 --2- 172.21.15.1:0/982968457 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4cc06c6a0 0x7fe4cc19a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:48.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.832+0000 7fe4cb7fe640 1 --2- 172.21.15.1:0/982968457 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4cc1094b0 0x7fe4cc19b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:48.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.832+0000 7fe4ca7fc640 1 -- 172.21.15.1:0/982968457 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4cc06c6a0 msgr2=0x7fe4cc19a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:48.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.832+0000 7fe4ca7fc640 1 --2- 172.21.15.1:0/982968457 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4cc06c6a0 0x7fe4cc19a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:48.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.832+0000 7fe4ca7fc640 1 -- 172.21.15.1:0/982968457 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4cc1094b0 msgr2=0x7fe4cc19b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:48.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.832+0000 7fe4ca7fc640 1 --2- 172.21.15.1:0/982968457 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4cc1094b0 0x7fe4cc19b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:48.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.832+0000 7fe4ca7fc640 1 -- 172.21.15.1:0/982968457 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4cc19bac0 con 0x7fe4cc106910 2024-09-21T00:48:48.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.832+0000 7fe4cb7fe640 1 --2- 172.21.15.1:0/982968457 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4cc1094b0 0x7fe4cc19b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:48:48.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.832+0000 7fe4caffd640 1 --2- 172.21.15.1:0/982968457 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4cc06c6a0 0x7fe4cc19a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:48:48.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.832+0000 7fe4ca7fc640 1 --2- 172.21.15.1:0/982968457 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4cc106910 0x7fe4cc19a700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0006010 tx=0x7fe4c0004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:48.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.833+0000 7fe4d09c4640 1 -- 172.21.15.1:0/982968457 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c003f030 con 0x7fe4cc106910 2024-09-21T00:48:48.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.833+0000 7fe4d09c4640 1 -- 172.21.15.1:0/982968457 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4c0003cb0 con 0x7fe4cc106910 2024-09-21T00:48:48.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.833+0000 7fe4d19c6640 1 -- 172.21.15.1:0/982968457 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4cc19bd50 con 0x7fe4cc106910 2024-09-21T00:48:48.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.833+0000 7fe4d09c4640 1 -- 172.21.15.1:0/982968457 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c0035070 con 0x7fe4cc106910 2024-09-21T00:48:48.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.833+0000 7fe4d19c6640 1 -- 172.21.15.1:0/982968457 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4cc1a2360 con 0x7fe4cc106910 2024-09-21T00:48:48.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.834+0000 7fe4d19c6640 1 -- 172.21.15.1:0/982968457 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4cc0ffb10 con 0x7fe4cc106910 2024-09-21T00:48:48.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.835+0000 7fe4d09c4640 1 -- 172.21.15.1:0/982968457 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 15) ==== 154455+0+0 (secure 0 0 0) 0x7fe4c0042030 con 0x7fe4cc106910 2024-09-21T00:48:48.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.836+0000 7fe4d09c4640 1 --2- 172.21.15.1:0/982968457 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe4b40b6480 0x7fe4b40b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:48.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.836+0000 7fe4caffd640 1 --2- 172.21.15.1:0/982968457 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe4b40b6480 0x7fe4b40b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:48.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.836+0000 7fe4d09c4640 1 -- 172.21.15.1:0/982968457 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe4c01063d0 con 0x7fe4cc106910 2024-09-21T00:48:48.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.837+0000 7fe4caffd640 1 --2- 172.21.15.1:0/982968457 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe4b40b6480 0x7fe4b40b8990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc005fd0 tx=0x7fe4bc009520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:48.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:48.839+0000 7fe4d09c4640 1 -- 172.21.15.1:0/982968457 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe4c00ce930 con 0x7fe4cc106910 2024-09-21T00:48:49.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:49.027+0000 7fe4d19c6640 1 -- 172.21.15.1:0/982968457 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7fe4cc02e640 con 0x7fe4cc106910 2024-09-21T00:48:49.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:49.031+0000 7fe4d09c4640 1 -- 172.21.15.1:0/982968457 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v33)=0 v33) ==== 125+0+0 (secure 0 0 0) 0x7fe4c00d2d10 con 0x7fe4cc106910 2024-09-21T00:48:49.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:49.034+0000 7fe4d19c6640 1 -- 172.21.15.1:0/982968457 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe4b40b6480 msgr2=0x7fe4b40b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:49.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:49.034+0000 7fe4d19c6640 1 --2- 172.21.15.1:0/982968457 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe4b40b6480 0x7fe4b40b8990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc005fd0 tx=0x7fe4bc009520 comp rx=0 tx=0).stop 2024-09-21T00:48:49.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:49.034+0000 7fe4d19c6640 1 -- 172.21.15.1:0/982968457 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4cc106910 msgr2=0x7fe4cc19a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:49.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:49.034+0000 7fe4d19c6640 1 --2- 172.21.15.1:0/982968457 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4cc106910 0x7fe4cc19a700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0006010 tx=0x7fe4c0004340 comp rx=0 tx=0).stop 2024-09-21T00:48:49.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:49.034+0000 7fe4d19c6640 1 -- 172.21.15.1:0/982968457 shutdown_connections 2024-09-21T00:48:49.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:49.034+0000 7fe4d19c6640 1 --2- 172.21.15.1:0/982968457 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4cc1094b0 0x7fe4cc19b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:49.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:49.034+0000 7fe4d19c6640 1 --2- 172.21.15.1:0/982968457 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe4b40b6480 0x7fe4b40b8990 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:49.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:49.034+0000 7fe4d19c6640 1 --2- 172.21.15.1:0/982968457 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4cc106910 0x7fe4cc19a700 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:49.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:49.034+0000 7fe4d19c6640 1 --2- 172.21.15.1:0/982968457 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4cc06c6a0 0x7fe4cc19a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:49.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:49.034+0000 7fe4d19c6640 1 -- 172.21.15.1:0/982968457 >> 172.21.15.1:0/982968457 conn(0x7fe4cc0fdff0 msgr2=0x7fe4cc104dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:49.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:49.034+0000 7fe4d19c6640 1 -- 172.21.15.1:0/982968457 shutdown_connections 2024-09-21T00:48:49.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:49.034+0000 7fe4d19c6640 1 -- 172.21.15.1:0/982968457 wait complete. 2024-09-21T00:48:49.465 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:49 smithi001 ceph-mon[31211]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:49.466 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:49 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/854576267' entity='client.admin' 2024-09-21T00:48:49.466 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:49 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/982968457' entity='client.admin' 2024-09-21T00:48:49.466 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:49 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:48:49.485 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:49 smithi193 ceph-mon[34660]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:49.486 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:49 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/854576267' entity='client.admin' 2024-09-21T00:48:49.486 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:49 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/982968457' entity='client.admin' 2024-09-21T00:48:49.486 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:49 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:48:49.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:49 smithi042 ceph-mon[34481]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:49.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:49 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/854576267' entity='client.admin' 2024-09-21T00:48:49.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:49 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/982968457' entity='client.admin' 2024-09-21T00:48:49.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:49 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:48:50.139 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3972c20-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi001') 2024-09-21T00:48:50.140 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3972c20-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi001') 2024-09-21T00:48:50.140 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3972c20-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi001') 2024-09-21T00:48:50.140 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3972c20-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi001') 2024-09-21T00:48:50.140 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3972c20-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi001') 2024-09-21T00:48:50.140 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3972c20-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi001') 2024-09-21T00:48:50.140 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3972c20-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi001') 2024-09-21T00:48:50.140 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3972c20-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi001') 2024-09-21T00:48:50.316 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:50 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:50.316 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:50 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:48:50.316 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:50 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:50.387 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:50 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:50.387 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:50 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:48:50.387 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:50 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:50.388 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:50 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:50.389 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:50 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:48:50.389 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:50 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:48:50.416 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3972c20-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi001') 2024-09-21T00:48:50.417 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3972c20-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi001') 2024-09-21T00:48:50.417 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3972c20-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi001') 2024-09-21T00:48:50.417 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph config dump 2024-09-21T00:48:50.674 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:51.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.149+0000 7f5f810fc640 1 -- 172.21.15.1:0/3926350012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f7c1036d0 msgr2=0x7f5f7c103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:51.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.149+0000 7f5f810fc640 1 --2- 172.21.15.1:0/3926350012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f7c1036d0 0x7f5f7c103ae0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5f64009900 tx=0x7f5f6402a480 comp rx=0 tx=0).stop 2024-09-21T00:48:51.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.150+0000 7f5f810fc640 1 -- 172.21.15.1:0/3926350012 shutdown_connections 2024-09-21T00:48:51.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.150+0000 7f5f810fc640 1 --2- 172.21.15.1:0/3926350012 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f7c104070 0x7f5f7c10aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:51.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.150+0000 7f5f810fc640 1 --2- 172.21.15.1:0/3926350012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f7c1036d0 0x7f5f7c103ae0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:51.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.150+0000 7f5f810fc640 1 --2- 172.21.15.1:0/3926350012 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f7c102640 0x7f5f7c102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:51.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.150+0000 7f5f810fc640 1 -- 172.21.15.1:0/3926350012 >> 172.21.15.1:0/3926350012 conn(0x7f5f7c0fdfb0 msgr2=0x7f5f7c100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:51.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.150+0000 7f5f810fc640 1 -- 172.21.15.1:0/3926350012 shutdown_connections 2024-09-21T00:48:51.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.150+0000 7f5f810fc640 1 -- 172.21.15.1:0/3926350012 wait complete. 2024-09-21T00:48:51.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.150+0000 7f5f810fc640 1 Processor -- start 2024-09-21T00:48:51.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.151+0000 7f5f810fc640 1 -- start start 2024-09-21T00:48:51.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.151+0000 7f5f810fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f7c102640 0x7f5f7c19c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:51.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.151+0000 7f5f810fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f7c1036d0 0x7f5f7c19c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:51.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.151+0000 7f5f810fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f7c104070 0x7f5f7c19d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:51.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.151+0000 7f5f810fc640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7c10e270 con 0x7f5f7c1036d0 2024-09-21T00:48:51.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.151+0000 7f5f810fc640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7c10e0f0 con 0x7f5f7c102640 2024-09-21T00:48:51.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.151+0000 7f5f810fc640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7c10e3f0 con 0x7f5f7c104070 2024-09-21T00:48:51.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.151+0000 7f5f73fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f7c1036d0 0x7f5f7c19c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:51.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.151+0000 7f5f73fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f7c1036d0 0x7f5f7c19c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58806/0 (socket says 172.21.15.1:58806) 2024-09-21T00:48:51.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.151+0000 7f5f73fff640 1 -- 172.21.15.1:0/313613915 learned_addr learned my addr 172.21.15.1:0/313613915 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:48:51.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.151+0000 7f5f7b59e640 1 --2- 172.21.15.1:0/313613915 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f7c104070 0x7f5f7c19d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:51.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.151+0000 7f5f7ad9d640 1 --2- 172.21.15.1:0/313613915 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f7c102640 0x7f5f7c19c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:51.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.151+0000 7f5f73fff640 1 -- 172.21.15.1:0/313613915 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f7c104070 msgr2=0x7f5f7c19d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:51.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.151+0000 7f5f73fff640 1 --2- 172.21.15.1:0/313613915 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f7c104070 0x7f5f7c19d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:51.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.151+0000 7f5f73fff640 1 -- 172.21.15.1:0/313613915 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f7c102640 msgr2=0x7f5f7c19c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:51.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.151+0000 7f5f73fff640 1 --2- 172.21.15.1:0/313613915 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f7c102640 0x7f5f7c19c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:51.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.151+0000 7f5f73fff640 1 -- 172.21.15.1:0/313613915 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f7c19dbc0 con 0x7f5f7c1036d0 2024-09-21T00:48:51.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.152+0000 7f5f73fff640 1 --2- 172.21.15.1:0/313613915 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f7c1036d0 0x7f5f7c19c800 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5f64006010 tx=0x7f5f64004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:51.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.152+0000 7f5f78d99640 1 -- 172.21.15.1:0/313613915 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6403f030 con 0x7f5f7c1036d0 2024-09-21T00:48:51.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.152+0000 7f5f810fc640 1 -- 172.21.15.1:0/313613915 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f7c19de50 con 0x7f5f7c1036d0 2024-09-21T00:48:51.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.152+0000 7f5f78d99640 1 -- 172.21.15.1:0/313613915 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f64003cb0 con 0x7f5f7c1036d0 2024-09-21T00:48:51.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.152+0000 7f5f78d99640 1 -- 172.21.15.1:0/313613915 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f64035070 con 0x7f5f7c1036d0 2024-09-21T00:48:51.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.152+0000 7f5f810fc640 1 -- 172.21.15.1:0/313613915 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f7c1a43e0 con 0x7f5f7c1036d0 2024-09-21T00:48:51.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.153+0000 7f5f810fc640 1 -- 172.21.15.1:0/313613915 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f7c102ab0 con 0x7f5f7c1036d0 2024-09-21T00:48:51.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.155+0000 7f5f78d99640 1 -- 172.21.15.1:0/313613915 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 15) ==== 154455+0+0 (secure 0 0 0) 0x7f5f64042030 con 0x7f5f7c1036d0 2024-09-21T00:48:51.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.155+0000 7f5f78d99640 1 --2- 172.21.15.1:0/313613915 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5f680b6480 0x7f5f680b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:51.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.156+0000 7f5f7ad9d640 1 --2- 172.21.15.1:0/313613915 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5f680b6480 0x7f5f680b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:51.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.156+0000 7f5f78d99640 1 -- 172.21.15.1:0/313613915 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5f641063a0 con 0x7f5f7c1036d0 2024-09-21T00:48:51.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.156+0000 7f5f7ad9d640 1 --2- 172.21.15.1:0/313613915 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5f680b6480 0x7f5f680b8990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c005fd0 tx=0x7f5f6c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:51.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.159+0000 7f5f78d99640 1 -- 172.21.15.1:0/313613915 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5f640ce900 con 0x7f5f7c1036d0 2024-09-21T00:48:51.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.349+0000 7f5f810fc640 1 -- 172.21.15.1:0/313613915 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f5f7c1a4690 con 0x7f5f7c1036d0 2024-09-21T00:48:51.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.350+0000 7f5f78d99640 1 -- 172.21.15.1:0/313613915 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v33) ==== 59+0+21518 (secure 0 0 0) 0x7f5f64003e60 con 0x7f5f7c1036d0 2024-09-21T00:48:51.351 INFO:teuthology.orchestra.run.smithi001.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T00:48:51.351 INFO:teuthology.orchestra.run.smithi001.stdout:global dev auth_debug true 2024-09-21T00:48:51.351 INFO:teuthology.orchestra.run.smithi001.stdout:global basic container_image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 * 2024-09-21T00:48:51.352 INFO:teuthology.orchestra.run.smithi001.stdout:global dev debug_asserts_on_shutdown true 2024-09-21T00:48:51.352 INFO:teuthology.orchestra.run.smithi001.stdout:global basic log_to_file true 2024-09-21T00:48:51.352 INFO:teuthology.orchestra.run.smithi001.stdout:global basic log_to_journald false 2024-09-21T00:48:51.352 INFO:teuthology.orchestra.run.smithi001.stdout:global basic log_to_stderr false 2024-09-21T00:48:51.352 INFO:teuthology.orchestra.run.smithi001.stdout:global advanced mon_allow_pool_delete true 2024-09-21T00:48:51.352 INFO:teuthology.orchestra.run.smithi001.stdout:global advanced mon_clock_drift_allowed 1.000000 2024-09-21T00:48:51.352 INFO:teuthology.orchestra.run.smithi001.stdout:global advanced mon_cluster_log_to_file true 2024-09-21T00:48:51.352 INFO:teuthology.orchestra.run.smithi001.stdout:global advanced mon_max_pg_per_osd 10000 2024-09-21T00:48:51.352 INFO:teuthology.orchestra.run.smithi001.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2024-09-21T00:48:51.352 INFO:teuthology.orchestra.run.smithi001.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2024-09-21T00:48:51.352 INFO:teuthology.orchestra.run.smithi001.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2024-09-21T00:48:51.352 INFO:teuthology.orchestra.run.smithi001.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2024-09-21T00:48:51.352 INFO:teuthology.orchestra.run.smithi001.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2024-09-21T00:48:51.352 INFO:teuthology.orchestra.run.smithi001.stdout:global advanced mon_warn_on_too_few_osds false 2024-09-21T00:48:51.352 INFO:teuthology.orchestra.run.smithi001.stdout:global dev ms_die_on_bug true 2024-09-21T00:48:51.353 INFO:teuthology.orchestra.run.smithi001.stdout:global dev ms_die_on_old_message true 2024-09-21T00:48:51.353 INFO:teuthology.orchestra.run.smithi001.stdout:global dev ms_die_on_skipped_message false 2024-09-21T00:48:51.353 INFO:teuthology.orchestra.run.smithi001.stdout:global advanced osd_pool_default_erasure_code_profile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T00:48:51.353 INFO:teuthology.orchestra.run.smithi001.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2024-09-21T00:48:51.353 INFO:teuthology.orchestra.run.smithi001.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2024-09-21T00:48:51.353 INFO:teuthology.orchestra.run.smithi001.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2024-09-21T00:48:51.353 INFO:teuthology.orchestra.run.smithi001.stdout:mon advanced auth_service_ticket_ttl 240.000000 2024-09-21T00:48:51.353 INFO:teuthology.orchestra.run.smithi001.stdout:mon advanced debug_mon 20/20 2024-09-21T00:48:51.353 INFO:teuthology.orchestra.run.smithi001.stdout:mon advanced debug_ms 1/1 2024-09-21T00:48:51.353 INFO:teuthology.orchestra.run.smithi001.stdout:mon advanced debug_paxos 20/20 2024-09-21T00:48:51.353 INFO:teuthology.orchestra.run.smithi001.stdout:mon advanced mon_data_avail_warn 5 2024-09-21T00:48:51.353 INFO:teuthology.orchestra.run.smithi001.stdout:mon advanced mon_down_mkfs_grace 300 2024-09-21T00:48:51.353 INFO:teuthology.orchestra.run.smithi001.stdout:mon advanced mon_mgr_mkfs_grace 240 2024-09-21T00:48:51.354 INFO:teuthology.orchestra.run.smithi001.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T00:48:51.354 INFO:teuthology.orchestra.run.smithi001.stdout:mon dev mon_osd_prime_pg_temp true 2024-09-21T00:48:51.354 INFO:teuthology.orchestra.run.smithi001.stdout:mon advanced mon_osd_reporter_subtree_level osd 2024-09-21T00:48:51.354 INFO:teuthology.orchestra.run.smithi001.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T00:48:51.354 INFO:teuthology.orchestra.run.smithi001.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T00:48:51.354 INFO:teuthology.orchestra.run.smithi001.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2024-09-21T00:48:51.354 INFO:teuthology.orchestra.run.smithi001.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2024-09-21T00:48:51.354 INFO:teuthology.orchestra.run.smithi001.stdout:mon advanced public_network 172.21.0.0/20 * 2024-09-21T00:48:51.354 INFO:teuthology.orchestra.run.smithi001.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2024-09-21T00:48:51.354 INFO:teuthology.orchestra.run.smithi001.stdout:mgr advanced client_mount_timeout 30 2024-09-21T00:48:51.354 INFO:teuthology.orchestra.run.smithi001.stdout:mgr advanced debug_client 20/20 2024-09-21T00:48:51.354 INFO:teuthology.orchestra.run.smithi001.stdout:mgr advanced debug_mgr 20/20 2024-09-21T00:48:51.354 INFO:teuthology.orchestra.run.smithi001.stdout:mgr advanced debug_ms 1/1 2024-09-21T00:48:51.354 INFO:teuthology.orchestra.run.smithi001.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2024-09-21T00:48:51.354 INFO:teuthology.orchestra.run.smithi001.stdout:mgr advanced mgr/cephadm/container_init True * 2024-09-21T00:48:51.355 INFO:teuthology.orchestra.run.smithi001.stdout:mgr advanced mgr/cephadm/migration_current 7 * 2024-09-21T00:48:51.355 INFO:teuthology.orchestra.run.smithi001.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2024-09-21T00:48:51.355 INFO:teuthology.orchestra.run.smithi001.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2024-09-21T00:48:51.355 INFO:teuthology.orchestra.run.smithi001.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T00:48:51.355 INFO:teuthology.orchestra.run.smithi001.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T00:48:51.355 INFO:teuthology.orchestra.run.smithi001.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T00:48:51.355 INFO:teuthology.orchestra.run.smithi001.stdout:osd dev bdev_debug_aio true 2024-09-21T00:48:51.355 INFO:teuthology.orchestra.run.smithi001.stdout:osd dev bluestore_block_size 96636764160 * 2024-09-21T00:48:51.355 INFO:teuthology.orchestra.run.smithi001.stdout:osd advanced bluestore_compression_mode aggressive 2024-09-21T00:48:51.355 INFO:teuthology.orchestra.run.smithi001.stdout:osd dev bluestore_fsck_on_mount true 2024-09-21T00:48:51.355 INFO:teuthology.orchestra.run.smithi001.stdout:osd advanced debug_bluefs 20/20 2024-09-21T00:48:51.355 INFO:teuthology.orchestra.run.smithi001.stdout:osd advanced debug_bluestore 20/20 2024-09-21T00:48:51.356 INFO:teuthology.orchestra.run.smithi001.stdout:osd advanced debug_ms 1/1 2024-09-21T00:48:51.356 INFO:teuthology.orchestra.run.smithi001.stdout:osd advanced debug_osd 20/20 2024-09-21T00:48:51.356 INFO:teuthology.orchestra.run.smithi001.stdout:osd advanced debug_rocksdb 10/10 2024-09-21T00:48:51.356 INFO:teuthology.orchestra.run.smithi001.stdout:osd dev osd_debug_misdirected_ops true 2024-09-21T00:48:51.356 INFO:teuthology.orchestra.run.smithi001.stdout:osd dev osd_debug_op_order true 2024-09-21T00:48:51.356 INFO:teuthology.orchestra.run.smithi001.stdout:osd dev osd_debug_pg_log_writeout true 2024-09-21T00:48:51.356 INFO:teuthology.orchestra.run.smithi001.stdout:osd dev osd_debug_shutdown true 2024-09-21T00:48:51.356 INFO:teuthology.orchestra.run.smithi001.stdout:osd dev osd_debug_verify_cached_snaps true 2024-09-21T00:48:51.356 INFO:teuthology.orchestra.run.smithi001.stdout:osd dev osd_debug_verify_missing_on_start true 2024-09-21T00:48:51.356 INFO:teuthology.orchestra.run.smithi001.stdout:osd dev osd_debug_verify_stray_on_activate true 2024-09-21T00:48:51.356 INFO:teuthology.orchestra.run.smithi001.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2024-09-21T00:48:51.356 INFO:teuthology.orchestra.run.smithi001.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2024-09-21T00:48:51.356 INFO:teuthology.orchestra.run.smithi001.stdout:osd advanced osd_max_omap_entries_per_request 10 2024-09-21T00:48:51.356 INFO:teuthology.orchestra.run.smithi001.stdout:osd advanced osd_mclock_profile high_recovery_ops 2024-09-21T00:48:51.356 INFO:teuthology.orchestra.run.smithi001.stdout:osd advanced osd_memory_target_autotune true 2024-09-21T00:48:51.357 INFO:teuthology.orchestra.run.smithi001.stdout:osd advanced osd_objectstore bluestore * 2024-09-21T00:48:51.357 INFO:teuthology.orchestra.run.smithi001.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T00:48:51.357 INFO:teuthology.orchestra.run.smithi001.stdout:osd advanced osd_op_queue debug_random * 2024-09-21T00:48:51.357 INFO:teuthology.orchestra.run.smithi001.stdout:osd advanced osd_op_queue_cut_off debug_random * 2024-09-21T00:48:51.357 INFO:teuthology.orchestra.run.smithi001.stdout:osd advanced osd_recover_clone_overlap true 2024-09-21T00:48:51.357 INFO:teuthology.orchestra.run.smithi001.stdout:osd advanced osd_recovery_max_chunk 1048576 2024-09-21T00:48:51.357 INFO:teuthology.orchestra.run.smithi001.stdout:osd advanced osd_scrub_load_threshold 5.000000 2024-09-21T00:48:51.357 INFO:teuthology.orchestra.run.smithi001.stdout:osd advanced osd_scrub_max_interval 600.000000 2024-09-21T00:48:51.357 INFO:teuthology.orchestra.run.smithi001.stdout:osd advanced osd_shutdown_pgref_assert true 2024-09-21T00:48:51.357 INFO:teuthology.orchestra.run.smithi001.stdout:mds advanced debug_mds 20/20 2024-09-21T00:48:51.357 INFO:teuthology.orchestra.run.smithi001.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T00:48:51.357 INFO:teuthology.orchestra.run.smithi001.stdout:mds advanced debug_ms 2/2 2024-09-21T00:48:51.358 INFO:teuthology.orchestra.run.smithi001.stdout:mds advanced mds_bal_fragment_size_max 10000 2024-09-21T00:48:51.358 INFO:teuthology.orchestra.run.smithi001.stdout:mds advanced mds_bal_merge_size 5 2024-09-21T00:48:51.358 INFO:teuthology.orchestra.run.smithi001.stdout:mds advanced mds_bal_replicate_threshold 1.000000 2024-09-21T00:48:51.358 INFO:teuthology.orchestra.run.smithi001.stdout:mds advanced mds_bal_split_bits 3 2024-09-21T00:48:51.358 INFO:teuthology.orchestra.run.smithi001.stdout:mds advanced mds_bal_split_size 100 2024-09-21T00:48:51.358 INFO:teuthology.orchestra.run.smithi001.stdout:mds dev mds_debug_frag true 2024-09-21T00:48:51.358 INFO:teuthology.orchestra.run.smithi001.stdout:mds dev mds_debug_scatterstat true 2024-09-21T00:48:51.358 INFO:teuthology.orchestra.run.smithi001.stdout:mds advanced mds_export_ephemeral_random_max 0.100000 2024-09-21T00:48:51.358 INFO:teuthology.orchestra.run.smithi001.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T00:48:51.358 INFO:teuthology.orchestra.run.smithi001.stdout:mds dev mds_verify_scatter true 2024-09-21T00:48:51.358 INFO:teuthology.orchestra.run.smithi001.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T00:48:51.358 INFO:teuthology.orchestra.run.smithi001.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T00:48:51.358 INFO:teuthology.orchestra.run.smithi001.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T00:48:51.358 INFO:teuthology.orchestra.run.smithi001.stdout:client advanced client_mount_timeout 600 2024-09-21T00:48:51.359 INFO:teuthology.orchestra.run.smithi001.stdout:client advanced debug_client 20/20 2024-09-21T00:48:51.359 INFO:teuthology.orchestra.run.smithi001.stdout:client advanced debug_ms 1/1 2024-09-21T00:48:51.359 INFO:teuthology.orchestra.run.smithi001.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T00:48:51.359 INFO:teuthology.orchestra.run.smithi001.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T00:48:51.359 INFO:teuthology.orchestra.run.smithi001.stdout:client.rgw advanced rgw_cache_enabled true 2024-09-21T00:48:51.359 INFO:teuthology.orchestra.run.smithi001.stdout:client.rgw advanced rgw_enable_ops_log true 2024-09-21T00:48:51.359 INFO:teuthology.orchestra.run.smithi001.stdout:client.rgw advanced rgw_enable_usage_log true 2024-09-21T00:48:51.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.352+0000 7f5f810fc640 1 -- 172.21.15.1:0/313613915 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5f680b6480 msgr2=0x7f5f680b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:51.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.352+0000 7f5f810fc640 1 --2- 172.21.15.1:0/313613915 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5f680b6480 0x7f5f680b8990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c005fd0 tx=0x7f5f6c005850 comp rx=0 tx=0).stop 2024-09-21T00:48:51.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.352+0000 7f5f810fc640 1 -- 172.21.15.1:0/313613915 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f7c1036d0 msgr2=0x7f5f7c19c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:51.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.352+0000 7f5f810fc640 1 --2- 172.21.15.1:0/313613915 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f7c1036d0 0x7f5f7c19c800 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5f64006010 tx=0x7f5f64004340 comp rx=0 tx=0).stop 2024-09-21T00:48:51.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.352+0000 7f5f810fc640 1 -- 172.21.15.1:0/313613915 shutdown_connections 2024-09-21T00:48:51.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.352+0000 7f5f810fc640 1 --2- 172.21.15.1:0/313613915 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f7c104070 0x7f5f7c19d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:51.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.352+0000 7f5f810fc640 1 --2- 172.21.15.1:0/313613915 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5f680b6480 0x7f5f680b8990 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:51.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.352+0000 7f5f810fc640 1 --2- 172.21.15.1:0/313613915 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f7c1036d0 0x7f5f7c19c800 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:51.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.352+0000 7f5f810fc640 1 --2- 172.21.15.1:0/313613915 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f7c102640 0x7f5f7c19c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:51.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.352+0000 7f5f810fc640 1 -- 172.21.15.1:0/313613915 >> 172.21.15.1:0/313613915 conn(0x7f5f7c0fdfb0 msgr2=0x7f5f7c0ff8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:51.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.352+0000 7f5f810fc640 1 -- 172.21.15.1:0/313613915 shutdown_connections 2024-09-21T00:48:51.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:51.352+0000 7f5f810fc640 1 -- 172.21.15.1:0/313613915 wait complete. 2024-09-21T00:48:51.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:51 smithi001 ceph-mon[31211]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:51.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:51 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/313613915' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T00:48:51.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:51 smithi193 ceph-mon[34660]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:51.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:51 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/313613915' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T00:48:51.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:51 smithi042 ceph-mon[34481]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:51.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:51 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/313613915' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T00:48:52.015 INFO:tasks.cephadm:Deploying OSDs... 2024-09-21T00:48:52.015 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-21T00:48:52.015 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T00:48:52.033 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T00:48:52.033 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_1 2024-09-21T00:48:52.089 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T00:48:52.089 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:48:52.090 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-21T00:48:52.090 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:48:52.090 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:48:52.090 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-09-21 00:47:41.004155055 +0000 2024-09-21T00:48:52.090 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-09-21 00:43:16.946976500 +0000 2024-09-21T00:48:52.090 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-09-21 00:43:16.946976500 +0000 2024-09-21T00:48:52.090 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-09-21 00:43:16.946976500 +0000 2024-09-21T00:48:52.090 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T00:48:52.155 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-09-21T00:48:52.155 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-09-21T00:48:52.155 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.000113988 s, 4.5 MB/s 2024-09-21T00:48:52.156 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T00:48:52.213 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_2 2024-09-21T00:48:52.269 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T00:48:52.269 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:48:52.270 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-21T00:48:52.270 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:48:52.270 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:48:52.270 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-09-21 00:47:41.033154718 +0000 2024-09-21T00:48:52.270 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-09-21 00:43:17.270972958 +0000 2024-09-21T00:48:52.270 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-09-21 00:43:17.270972958 +0000 2024-09-21T00:48:52.270 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-09-21 00:43:17.270972958 +0000 2024-09-21T00:48:52.270 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T00:48:52.333 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-09-21T00:48:52.334 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-09-21T00:48:52.334 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.000109309 s, 4.7 MB/s 2024-09-21T00:48:52.335 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T00:48:52.392 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_3 2024-09-21T00:48:52.448 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T00:48:52.448 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:48:52.448 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-21T00:48:52.448 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:48:52.449 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:48:52.449 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-09-21 00:47:41.064154357 +0000 2024-09-21T00:48:52.449 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-09-21 00:43:17.582969547 +0000 2024-09-21T00:48:52.449 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-09-21 00:43:17.582969547 +0000 2024-09-21T00:48:52.449 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-09-21 00:43:17.582969547 +0000 2024-09-21T00:48:52.449 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T00:48:52.512 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-09-21T00:48:52.512 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-09-21T00:48:52.512 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 9.7343e-05 s, 5.3 MB/s 2024-09-21T00:48:52.513 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T00:48:52.571 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_4 2024-09-21T00:48:52.626 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T00:48:52.626 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:48:52.627 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-21T00:48:52.627 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:48:52.627 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:48:52.627 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-09-21 00:47:41.099153949 +0000 2024-09-21T00:48:52.627 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-09-21 00:43:17.892966158 +0000 2024-09-21T00:48:52.627 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-09-21 00:43:17.892966158 +0000 2024-09-21T00:48:52.627 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-09-21 00:43:17.892966158 +0000 2024-09-21T00:48:52.627 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T00:48:52.690 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-09-21T00:48:52.690 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-09-21T00:48:52.690 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.000109319 s, 4.7 MB/s 2024-09-21T00:48:52.691 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T00:48:52.748 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-21T00:48:52.748 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T00:48:52.768 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T00:48:52.768 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_1 2024-09-21T00:48:52.827 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T00:48:52.827 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:48:52.827 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-21T00:48:52.828 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:48:52.828 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:48:52.828 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-21 00:48:27.085416221 +0000 2024-09-21T00:48:52.828 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-21 00:43:29.943244422 +0000 2024-09-21T00:48:52.828 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-21 00:43:29.943244422 +0000 2024-09-21T00:48:52.828 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-09-21 00:43:29.943244422 +0000 2024-09-21T00:48:52.828 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T00:48:52.897 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-21T00:48:52.897 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-21T00:48:52.897 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000125463 s, 4.1 MB/s 2024-09-21T00:48:52.899 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T00:48:52.957 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_2 2024-09-21T00:48:53.015 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T00:48:53.015 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:48:53.015 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-21T00:48:53.015 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:48:53.015 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:48:53.015 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-21 00:48:27.085416221 +0000 2024-09-21T00:48:53.015 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-21 00:43:30.261242094 +0000 2024-09-21T00:48:53.016 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-21 00:43:30.261242094 +0000 2024-09-21T00:48:53.016 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-09-21 00:43:30.261242094 +0000 2024-09-21T00:48:53.016 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T00:48:53.082 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-21T00:48:53.082 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-21T00:48:53.083 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.00012052 s, 4.2 MB/s 2024-09-21T00:48:53.084 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T00:48:53.141 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_3 2024-09-21T00:48:53.198 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T00:48:53.199 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:48:53.199 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-21T00:48:53.199 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:48:53.199 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:48:53.199 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-21 00:48:27.086416214 +0000 2024-09-21T00:48:53.199 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-21 00:43:30.589239692 +0000 2024-09-21T00:48:53.199 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-21 00:43:30.589239692 +0000 2024-09-21T00:48:53.199 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-09-21 00:43:30.589239692 +0000 2024-09-21T00:48:53.199 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T00:48:53.264 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-21T00:48:53.264 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-21T00:48:53.264 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000115411 s, 4.4 MB/s 2024-09-21T00:48:53.266 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T00:48:53.325 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_4 2024-09-21T00:48:53.381 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T00:48:53.381 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:48:53.381 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-21T00:48:53.381 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:48:53.381 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:48:53.381 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-21 00:48:27.086416214 +0000 2024-09-21T00:48:53.381 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-21 00:43:30.901237408 +0000 2024-09-21T00:48:53.381 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-21 00:43:30.901237408 +0000 2024-09-21T00:48:53.381 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-09-21 00:43:30.901237408 +0000 2024-09-21T00:48:53.382 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T00:48:53.446 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-21T00:48:53.446 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-21T00:48:53.446 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000108779 s, 4.7 MB/s 2024-09-21T00:48:53.447 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T00:48:53.506 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-21T00:48:53.507 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T00:48:53.527 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T00:48:53.527 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_1 2024-09-21T00:48:53.586 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T00:48:53.586 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:48:53.586 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-21T00:48:53.586 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:48:53.586 INFO:teuthology.orchestra.run.smithi193.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:48:53.586 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-09-21 00:48:24.835381102 +0000 2024-09-21T00:48:53.586 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-09-21 00:43:21.479206771 +0000 2024-09-21T00:48:53.586 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-09-21 00:43:21.479206771 +0000 2024-09-21T00:48:53.586 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: 2024-09-21 00:43:21.479206771 +0000 2024-09-21T00:48:53.587 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T00:48:53.653 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:53 smithi193 ceph-mon[34660]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:53.657 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-09-21T00:48:53.657 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-09-21T00:48:53.657 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.000293491 s, 1.7 MB/s 2024-09-21T00:48:53.659 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T00:48:53.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:53 smithi001 ceph-mon[31211]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:53.717 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_2 2024-09-21T00:48:53.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:53 smithi042 ceph-mon[34481]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:53.775 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T00:48:53.775 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:48:53.775 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-21T00:48:53.775 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:48:53.775 INFO:teuthology.orchestra.run.smithi193.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:48:53.775 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-09-21 00:48:24.835381102 +0000 2024-09-21T00:48:53.775 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-09-21 00:43:21.811201835 +0000 2024-09-21T00:48:53.775 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-09-21 00:43:21.811201835 +0000 2024-09-21T00:48:53.775 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: 2024-09-21 00:43:21.811201835 +0000 2024-09-21T00:48:53.776 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T00:48:53.840 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-09-21T00:48:53.840 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-09-21T00:48:53.840 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.000233588 s, 2.2 MB/s 2024-09-21T00:48:53.841 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T00:48:53.899 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_3 2024-09-21T00:48:53.956 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T00:48:53.956 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:48:53.956 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-21T00:48:53.956 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:48:53.956 INFO:teuthology.orchestra.run.smithi193.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:48:53.956 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-09-21 00:48:24.835381102 +0000 2024-09-21T00:48:53.956 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-09-21 00:43:22.117197285 +0000 2024-09-21T00:48:53.956 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-09-21 00:43:22.117197285 +0000 2024-09-21T00:48:53.956 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: 2024-09-21 00:43:22.117197285 +0000 2024-09-21T00:48:53.957 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T00:48:54.020 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-09-21T00:48:54.020 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-09-21T00:48:54.020 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.000241366 s, 2.1 MB/s 2024-09-21T00:48:54.021 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T00:48:54.078 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_4 2024-09-21T00:48:54.134 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T00:48:54.134 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:48:54.134 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-21T00:48:54.134 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:48:54.134 INFO:teuthology.orchestra.run.smithi193.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:48:54.134 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-09-21 00:48:24.836381088 +0000 2024-09-21T00:48:54.135 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-09-21 00:43:22.436192542 +0000 2024-09-21T00:48:54.135 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-09-21 00:43:22.436192542 +0000 2024-09-21T00:48:54.135 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: 2024-09-21 00:43:22.436192542 +0000 2024-09-21T00:48:54.135 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T00:48:54.198 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-09-21T00:48:54.198 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-09-21T00:48:54.198 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.000194269 s, 2.6 MB/s 2024-09-21T00:48:54.199 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T00:48:54.256 INFO:tasks.cephadm:Deploying osd.0 on smithi001 with /dev/vg_nvme/lv_4... 2024-09-21T00:48:54.256 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T00:48:54.519 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:55.640 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:55 smithi001 ceph-mon[31211]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:55.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:55 smithi193 ceph-mon[34660]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:55.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:55 smithi042 ceph-mon[34481]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:56.910 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:48:56.937 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi001:vg_nvme/lv_4 2024-09-21T00:48:57.187 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:57.560 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:57 smithi001 ceph-mon[31211]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:57.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.655+0000 7fbebd59a640 1 -- 172.21.15.1:0/322147511 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbeb81047e0 msgr2=0x7fbeb8104bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:57.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.655+0000 7fbebd59a640 1 --2- 172.21.15.1:0/322147511 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbeb81047e0 0x7fbeb8104bf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbeac009900 tx=0x7fbeac02a480 comp rx=0 tx=0).stop 2024-09-21T00:48:57.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.655+0000 7fbebd59a640 1 -- 172.21.15.1:0/322147511 shutdown_connections 2024-09-21T00:48:57.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.655+0000 7fbebd59a640 1 --2- 172.21.15.1:0/322147511 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbeb8105180 0x7fbeb810bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:57.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.655+0000 7fbebd59a640 1 --2- 172.21.15.1:0/322147511 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbeb81047e0 0x7fbeb8104bf0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:57.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.655+0000 7fbebd59a640 1 --2- 172.21.15.1:0/322147511 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbeb8103750 0x7fbeb8103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:57.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.655+0000 7fbebd59a640 1 -- 172.21.15.1:0/322147511 >> 172.21.15.1:0/322147511 conn(0x7fbeb80ff0c0 msgr2=0x7fbeb8101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:57.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.655+0000 7fbebd59a640 1 -- 172.21.15.1:0/322147511 shutdown_connections 2024-09-21T00:48:57.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.655+0000 7fbebd59a640 1 -- 172.21.15.1:0/322147511 wait complete. 2024-09-21T00:48:57.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.655+0000 7fbebd59a640 1 Processor -- start 2024-09-21T00:48:57.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.656+0000 7fbebd59a640 1 -- start start 2024-09-21T00:48:57.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.656+0000 7fbebd59a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbeb8103750 0x7fbeb8076e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:57.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.656+0000 7fbebd59a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbeb81047e0 0x7fbeb8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:57.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.656+0000 7fbebd59a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbeb8105180 0x7fbeb8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:57.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.656+0000 7fbebd59a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb810f3a0 con 0x7fbeb81047e0 2024-09-21T00:48:57.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.656+0000 7fbebd59a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb810f220 con 0x7fbeb8105180 2024-09-21T00:48:57.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.656+0000 7fbebd59a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb810f520 con 0x7fbeb8103750 2024-09-21T00:48:57.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.656+0000 7fbeb67fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbeb81047e0 0x7fbeb8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:57.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.656+0000 7fbeb67fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbeb81047e0 0x7fbeb8075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58820/0 (socket says 172.21.15.1:58820) 2024-09-21T00:48:57.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.656+0000 7fbeb67fc640 1 -- 172.21.15.1:0/140566554 learned_addr learned my addr 172.21.15.1:0/140566554 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:48:57.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.656+0000 7fbeb6ffd640 1 --2- 172.21.15.1:0/140566554 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbeb8103750 0x7fbeb8076e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:57.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.656+0000 7fbeb77fe640 1 --2- 172.21.15.1:0/140566554 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbeb8105180 0x7fbeb8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:57.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.656+0000 7fbeb67fc640 1 -- 172.21.15.1:0/140566554 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbeb8103750 msgr2=0x7fbeb8076e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:57.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.656+0000 7fbeb67fc640 1 --2- 172.21.15.1:0/140566554 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbeb8103750 0x7fbeb8076e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:57.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.656+0000 7fbeb67fc640 1 -- 172.21.15.1:0/140566554 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbeb8105180 msgr2=0x7fbeb8075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:57.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.656+0000 7fbeb67fc640 1 --2- 172.21.15.1:0/140566554 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbeb8105180 0x7fbeb8075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:57.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.656+0000 7fbeb67fc640 1 -- 172.21.15.1:0/140566554 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeb8076350 con 0x7fbeb81047e0 2024-09-21T00:48:57.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.657+0000 7fbeb67fc640 1 --2- 172.21.15.1:0/140566554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbeb81047e0 0x7fbeb8075710 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbeac006010 tx=0x7fbeac004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:57.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.657+0000 7fbe9ffff640 1 -- 172.21.15.1:0/140566554 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeac03f030 con 0x7fbeb81047e0 2024-09-21T00:48:57.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.657+0000 7fbe9ffff640 1 -- 172.21.15.1:0/140566554 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbeac003cb0 con 0x7fbeb81047e0 2024-09-21T00:48:57.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.657+0000 7fbebd59a640 1 -- 172.21.15.1:0/140566554 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbeb81a4090 con 0x7fbeb81047e0 2024-09-21T00:48:57.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.657+0000 7fbe9ffff640 1 -- 172.21.15.1:0/140566554 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeac035070 con 0x7fbeb81047e0 2024-09-21T00:48:57.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.657+0000 7fbebd59a640 1 -- 172.21.15.1:0/140566554 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbeb81a4480 con 0x7fbeb81047e0 2024-09-21T00:48:57.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.658+0000 7fbebd59a640 1 -- 172.21.15.1:0/140566554 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbeb8103bc0 con 0x7fbeb81047e0 2024-09-21T00:48:57.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.660+0000 7fbe9ffff640 1 -- 172.21.15.1:0/140566554 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 15) ==== 154455+0+0 (secure 0 0 0) 0x7fbeac042030 con 0x7fbeb81047e0 2024-09-21T00:48:57.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.660+0000 7fbe9ffff640 1 --2- 172.21.15.1:0/140566554 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fbea00b6500 0x7fbea00b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:57.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.661+0000 7fbeb6ffd640 1 --2- 172.21.15.1:0/140566554 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fbea00b6500 0x7fbea00b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:57.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.661+0000 7fbe9ffff640 1 -- 172.21.15.1:0/140566554 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fbeac1062f0 con 0x7fbeb81047e0 2024-09-21T00:48:57.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.661+0000 7fbeb6ffd640 1 --2- 172.21.15.1:0/140566554 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fbea00b6500 0x7fbea00b8a10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbea8005fd0 tx=0x7fbea8009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:57.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.664+0000 7fbe9ffff640 1 -- 172.21.15.1:0/140566554 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbeac0ce850 con 0x7fbeb81047e0 2024-09-21T00:48:57.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:57 smithi193 ceph-mon[34660]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:57.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:57 smithi042 ceph-mon[34481]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:57.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:48:57.862+0000 7fbebd59a640 1 -- 172.21.15.1:0/140566554 --> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fbeb8063800 con 0x7fbea00b6500 2024-09-21T00:48:58.505 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:58 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:48:58.505 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:58 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:48:58.505 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:58 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:58.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:58 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:48:58.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:58 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:48:58.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:58 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:58.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:58 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:48:58.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:58 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:48:58.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:58 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:59.561 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:59 smithi001 ceph-mon[31211]: from='client.14388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:59.562 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:48:59 smithi001 ceph-mon[31211]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:59.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:59 smithi193 ceph-mon[34660]: from='client.14388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:59.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:48:59 smithi193 ceph-mon[34660]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:59.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:59 smithi042 ceph-mon[34481]: from='client.14388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:59.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:48:59 smithi042 ceph-mon[34481]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:00.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:00 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/3978968676' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5bf09a34-4d6e-401c-8cef-29bbe72de68d"} : dispatch 2024-09-21T00:49:00.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:00 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/3978968676' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5bf09a34-4d6e-401c-8cef-29bbe72de68d"}]': finished 2024-09-21T00:49:00.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:00 smithi001 ceph-mon[31211]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T00:49:00.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:00 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:49:00.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:00 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/3978968676' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5bf09a34-4d6e-401c-8cef-29bbe72de68d"} : dispatch 2024-09-21T00:49:00.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:00 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/3978968676' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5bf09a34-4d6e-401c-8cef-29bbe72de68d"}]': finished 2024-09-21T00:49:00.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:00 smithi193 ceph-mon[34660]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T00:49:00.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:00 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:49:00.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:00 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/3978968676' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5bf09a34-4d6e-401c-8cef-29bbe72de68d"} : dispatch 2024-09-21T00:49:00.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:00 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/3978968676' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5bf09a34-4d6e-401c-8cef-29bbe72de68d"}]': finished 2024-09-21T00:49:00.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:00 smithi042 ceph-mon[34481]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T00:49:00.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:00 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:49:01.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:01 smithi001 ceph-mon[31211]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:01.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:01 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1738862151' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:49:01.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:01 smithi193 ceph-mon[34660]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:01.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:01 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/1738862151' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:49:01.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:01 smithi042 ceph-mon[34481]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:01.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:01 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/1738862151' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:49:03.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:03 smithi001 ceph-mon[31211]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:03.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:03 smithi193 ceph-mon[34660]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:03.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:03 smithi042 ceph-mon[34481]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:05.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:05 smithi001 ceph-mon[31211]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:05.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:05 smithi193 ceph-mon[34660]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:05.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:05 smithi042 ceph-mon[34481]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:07.603 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:07 smithi001 ceph-mon[31211]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:07.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:07 smithi193 ceph-mon[34660]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:07.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:07 smithi042 ceph-mon[34481]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:09.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:09 smithi001 ceph-mon[31211]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:09.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:09 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T00:49:09.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:09 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:49:09.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:09 smithi001 ceph-mon[31211]: Deploying daemon osd.0 on smithi001 2024-09-21T00:49:09.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:09 smithi193 ceph-mon[34660]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:09.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:09 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T00:49:09.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:09 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:49:09.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:09 smithi193 ceph-mon[34660]: Deploying daemon osd.0 on smithi001 2024-09-21T00:49:09.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:09 smithi042 ceph-mon[34481]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:09.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:09 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T00:49:09.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:09 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:49:09.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:09 smithi042 ceph-mon[34481]: Deploying daemon osd.0 on smithi001 2024-09-21T00:49:11.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:11 smithi001 ceph-mon[31211]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:11.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:11 smithi193 ceph-mon[34660]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:11.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:11 smithi042 ceph-mon[34481]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:13.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:13 smithi001 ceph-mon[31211]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:13.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:13 smithi193 ceph-mon[34660]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:13.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:13 smithi042 ceph-mon[34481]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:15.670 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:15 smithi001 ceph-mon[31211]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:15.670 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:15 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:49:15.670 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:15 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:15.671 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:15 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:15.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:15 smithi193 ceph-mon[34660]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:15.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:15 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:49:15.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:15 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:15.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:15 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:15.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:15 smithi042 ceph-mon[34481]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:15.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:15 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:49:15.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:15 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:15.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:15 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:17.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:17 smithi001 ceph-mon[31211]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:17.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:17.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:17.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:49:17.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:49:17.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:17.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:17 smithi193 ceph-mon[34660]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:17.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:17.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:17.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:49:17.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:49:17.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:17.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:17 smithi042 ceph-mon[34481]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:17.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:17.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:17.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:49:17.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:49:17.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:19.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:49:19.195+0000 7fbe9ffff640 1 -- 172.21.15.1:0/140566554 <== mgr.14150 v2:172.21.15.1:6800/2032980330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbeb8063800 con 0x7fbea00b6500 2024-09-21T00:49:19.196 INFO:teuthology.orchestra.run.smithi001.stdout:Created osd(s) 0 on host 'smithi001' 2024-09-21T00:49:19.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:49:19.197+0000 7fbebd59a640 1 -- 172.21.15.1:0/140566554 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fbea00b6500 msgr2=0x7fbea00b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:49:19.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:49:19.197+0000 7fbebd59a640 1 --2- 172.21.15.1:0/140566554 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fbea00b6500 0x7fbea00b8a10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbea8005fd0 tx=0x7fbea8009680 comp rx=0 tx=0).stop 2024-09-21T00:49:19.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:49:19.197+0000 7fbebd59a640 1 -- 172.21.15.1:0/140566554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbeb81047e0 msgr2=0x7fbeb8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:49:19.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:49:19.197+0000 7fbebd59a640 1 --2- 172.21.15.1:0/140566554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbeb81047e0 0x7fbeb8075710 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbeac006010 tx=0x7fbeac004340 comp rx=0 tx=0).stop 2024-09-21T00:49:19.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:49:19.198+0000 7fbebd59a640 1 -- 172.21.15.1:0/140566554 shutdown_connections 2024-09-21T00:49:19.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:49:19.198+0000 7fbebd59a640 1 --2- 172.21.15.1:0/140566554 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbeb8105180 0x7fbeb8075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:49:19.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:49:19.198+0000 7fbebd59a640 1 --2- 172.21.15.1:0/140566554 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fbea00b6500 0x7fbea00b8a10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:49:19.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:49:19.198+0000 7fbebd59a640 1 --2- 172.21.15.1:0/140566554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbeb81047e0 0x7fbeb8075710 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:49:19.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:49:19.198+0000 7fbebd59a640 1 --2- 172.21.15.1:0/140566554 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbeb8103750 0x7fbeb8076e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:49:19.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:49:19.198+0000 7fbebd59a640 1 -- 172.21.15.1:0/140566554 >> 172.21.15.1:0/140566554 conn(0x7fbeb80ff0c0 msgr2=0x7fbeb8107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:49:19.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:49:19.198+0000 7fbebd59a640 1 -- 172.21.15.1:0/140566554 shutdown_connections 2024-09-21T00:49:19.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:49:19.198+0000 7fbebd59a640 1 -- 172.21.15.1:0/140566554 wait complete. 2024-09-21T00:49:19.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:19 smithi001 ceph-mon[31211]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:19.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:19 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:49:19.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:19 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:19.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:19 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:19.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:19 smithi193 ceph-mon[34660]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:19.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:19 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:49:19.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:19 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:19.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:19 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:19.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:19 smithi042 ceph-mon[34481]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:19.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:19 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:49:19.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:19 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:19.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:19 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:19.827 DEBUG:teuthology.orchestra.run.smithi001:osd.0> sudo journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@osd.0.service 2024-09-21T00:49:19.830 INFO:tasks.cephadm:Deploying osd.1 on smithi042 with /dev/vg_nvme/lv_4... 2024-09-21T00:49:19.830 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T00:49:20.087 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T00:49:20.711 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 21 00:49:20 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-0[46657]: 2024-09-21T00:49:20.536+0000 7f7bb1a83640 -1 osd.0 0 log_to_monitors true 2024-09-21T00:49:21.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:21 smithi001 ceph-mon[31211]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:21.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:21 smithi001 ceph-mon[31211]: from='osd.0 [v2:172.21.15.1:6802/4067586847,v1:172.21.15.1:6803/4067586847]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T00:49:21.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:21 smithi193 ceph-mon[34660]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:21.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:21 smithi193 ceph-mon[34660]: from='osd.0 [v2:172.21.15.1:6802/4067586847,v1:172.21.15.1:6803/4067586847]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T00:49:21.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:21 smithi042 ceph-mon[34481]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:21.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:21 smithi042 ceph-mon[34481]: from='osd.0 [v2:172.21.15.1:6802/4067586847,v1:172.21.15.1:6803/4067586847]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T00:49:22.569 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T00:49:22.598 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi042:vg_nvme/lv_4 2024-09-21T00:49:22.614 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:22 smithi042 ceph-mon[34481]: from='osd.0 [v2:172.21.15.1:6802/4067586847,v1:172.21.15.1:6803/4067586847]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T00:49:22.614 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:22 smithi042 ceph-mon[34481]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T00:49:22.614 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:22 smithi042 ceph-mon[34481]: from='osd.0 [v2:172.21.15.1:6802/4067586847,v1:172.21.15.1:6803/4067586847]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]} : dispatch 2024-09-21T00:49:22.614 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:22 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:49:22.687 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:22 smithi001 ceph-mon[31211]: from='osd.0 [v2:172.21.15.1:6802/4067586847,v1:172.21.15.1:6803/4067586847]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T00:49:22.687 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:22 smithi001 ceph-mon[31211]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T00:49:22.687 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:22 smithi001 ceph-mon[31211]: from='osd.0 [v2:172.21.15.1:6802/4067586847,v1:172.21.15.1:6803/4067586847]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]} : dispatch 2024-09-21T00:49:22.687 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:22 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:49:22.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:22 smithi193 ceph-mon[34660]: from='osd.0 [v2:172.21.15.1:6802/4067586847,v1:172.21.15.1:6803/4067586847]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T00:49:22.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:22 smithi193 ceph-mon[34660]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T00:49:22.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:22 smithi193 ceph-mon[34660]: from='osd.0 [v2:172.21.15.1:6802/4067586847,v1:172.21.15.1:6803/4067586847]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]} : dispatch 2024-09-21T00:49:22.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:22 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:49:22.856 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T00:49:22.960 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 21 00:49:22 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-0[46657]: 2024-09-21T00:49:22.889+0000 7f7bada05640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T00:49:22.960 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 21 00:49:22 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-0[46657]: 2024-09-21T00:49:22.892+0000 7f7ba57fb640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:49:23.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.339+0000 7f50b1f4e640 1 -- 172.21.15.42:0/58412391 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50ac103720 msgr2=0x7f50ac103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:49:23.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.339+0000 7f50b1f4e640 1 --2- 172.21.15.42:0/58412391 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50ac103720 0x7f50ac103b30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5094009900 tx=0x7f509402a480 comp rx=0 tx=0).stop 2024-09-21T00:49:23.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.339+0000 7f50b1f4e640 1 -- 172.21.15.42:0/58412391 shutdown_connections 2024-09-21T00:49:23.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.339+0000 7f50b1f4e640 1 --2- 172.21.15.42:0/58412391 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50ac1040c0 0x7f50ac10aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:49:23.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.339+0000 7f50b1f4e640 1 --2- 172.21.15.42:0/58412391 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50ac103720 0x7f50ac103b30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:49:23.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.339+0000 7f50b1f4e640 1 --2- 172.21.15.42:0/58412391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f50ac102690 0x7f50ac102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:49:23.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.339+0000 7f50b1f4e640 1 -- 172.21.15.42:0/58412391 >> 172.21.15.42:0/58412391 conn(0x7f50ac0fe000 msgr2=0x7f50ac1004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:49:23.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.339+0000 7f50b1f4e640 1 -- 172.21.15.42:0/58412391 shutdown_connections 2024-09-21T00:49:23.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.339+0000 7f50b1f4e640 1 -- 172.21.15.42:0/58412391 wait complete. 2024-09-21T00:49:23.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.340+0000 7f50b1f4e640 1 Processor -- start 2024-09-21T00:49:23.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.340+0000 7f50b1f4e640 1 -- start start 2024-09-21T00:49:23.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.340+0000 7f50b1f4e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50ac102690 0x7f50ac19a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:49:23.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.340+0000 7f50b1f4e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f50ac103720 0x7f50ac19a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:49:23.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.340+0000 7f50b1f4e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50ac1040c0 0x7f50ac19b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:49:23.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.340+0000 7f50b1f4e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f50ac10e2c0 con 0x7f50ac103720 2024-09-21T00:49:23.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.340+0000 7f50b1f4e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f50ac10e140 con 0x7f50ac102690 2024-09-21T00:49:23.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.340+0000 7f50b1f4e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f50ac10e440 con 0x7f50ac1040c0 2024-09-21T00:49:23.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.340+0000 7f50ab7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50ac102690 0x7f50ac19a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:49:23.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.340+0000 7f50ab7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50ac102690 0x7f50ac19a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36204/0 (socket says 172.21.15.42:36204) 2024-09-21T00:49:23.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.340+0000 7f50ab7fe640 1 -- 172.21.15.42:0/1548957117 learned_addr learned my addr 172.21.15.42:0/1548957117 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T00:49:23.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.341+0000 7f50abfff640 1 --2- 172.21.15.42:0/1548957117 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50ac1040c0 0x7f50ac19b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:49:23.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.341+0000 7f50a2ffd640 1 --2- 172.21.15.42:0/1548957117 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f50ac103720 0x7f50ac19a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:49:23.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.341+0000 7f50ab7fe640 1 -- 172.21.15.42:0/1548957117 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50ac1040c0 msgr2=0x7f50ac19b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:49:23.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.341+0000 7f50ab7fe640 1 --2- 172.21.15.42:0/1548957117 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50ac1040c0 0x7f50ac19b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:49:23.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.341+0000 7f50ab7fe640 1 -- 172.21.15.42:0/1548957117 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f50ac103720 msgr2=0x7f50ac19a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:49:23.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.341+0000 7f50ab7fe640 1 --2- 172.21.15.42:0/1548957117 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f50ac103720 0x7f50ac19a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:49:23.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.341+0000 7f50ab7fe640 1 -- 172.21.15.42:0/1548957117 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50ac19ba40 con 0x7f50ac102690 2024-09-21T00:49:23.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.341+0000 7f50ab7fe640 1 --2- 172.21.15.42:0/1548957117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50ac102690 0x7f50ac19a010 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f509c00e9f0 tx=0x7f509c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:49:23.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.341+0000 7f50a97fa640 1 -- 172.21.15.42:0/1548957117 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f509c00cd80 con 0x7f50ac102690 2024-09-21T00:49:23.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.341+0000 7f50a97fa640 1 -- 172.21.15.42:0/1548957117 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f509c0108e0 con 0x7f50ac102690 2024-09-21T00:49:23.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.341+0000 7f50b1f4e640 1 -- 172.21.15.42:0/1548957117 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50ac19bd30 con 0x7f50ac102690 2024-09-21T00:49:23.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.341+0000 7f50a97fa640 1 -- 172.21.15.42:0/1548957117 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f509c018980 con 0x7f50ac102690 2024-09-21T00:49:23.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.341+0000 7f50b1f4e640 1 -- 172.21.15.42:0/1548957117 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50ac104c00 con 0x7f50ac102690 2024-09-21T00:49:23.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.342+0000 7f50b1f4e640 1 -- 172.21.15.42:0/1548957117 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50ac102b00 con 0x7f50ac102690 2024-09-21T00:49:23.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.344+0000 7f50a97fa640 1 -- 172.21.15.42:0/1548957117 <== mon.2 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 15) ==== 154455+0+0 (secure 0 0 0) 0x7f509c010430 con 0x7f50ac102690 2024-09-21T00:49:23.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.345+0000 7f50a97fa640 1 --2- 172.21.15.42:0/1548957117 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f50980b6480 0x7f50980b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:49:23.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.345+0000 7f50a97fa640 1 -- 172.21.15.42:0/1548957117 <== mon.2 v2:172.21.15.42:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f509c0e6000 con 0x7f50ac102690 2024-09-21T00:49:23.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.345+0000 7f50a2ffd640 1 --2- 172.21.15.42:0/1548957117 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f50980b6480 0x7f50980b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:49:23.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.346+0000 7f50a2ffd640 1 --2- 172.21.15.42:0/1548957117 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f50980b6480 0x7f50980b8990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5094031440 tx=0x7f50940314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:49:23.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.349+0000 7f50a97fa640 1 -- 172.21.15.42:0/1548957117 <== mon.2 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f509c0ae420 con 0x7f50ac102690 2024-09-21T00:49:23.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:23.550+0000 7f50b1f4e640 1 -- 172.21.15.42:0/1548957117 --> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f50ac0ffff0 con 0x7f50980b6480 2024-09-21T00:49:23.551 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:23 smithi042 ceph-mon[34481]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:23.551 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:23 smithi042 ceph-mon[34481]: from='osd.0 [v2:172.21.15.1:6802/4067586847,v1:172.21.15.1:6803/4067586847]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-21T00:49:23.551 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:23 smithi042 ceph-mon[34481]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T00:49:23.551 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:23 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:49:23.551 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:23 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:49:23.551 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:23 smithi042 ceph-mon[34481]: Detected new or changed devices on smithi001 2024-09-21T00:49:23.551 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:23 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:23.552 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:23 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:23.552 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:23 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T00:49:23.552 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:23 smithi042 ceph-mon[34481]: Adjusting osd_memory_target on smithi001 to 17092M 2024-09-21T00:49:23.552 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:23 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:23.552 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:23 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:49:23.552 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:23 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:49:23.552 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:23 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:23.552 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:23 smithi042 ceph-mon[34481]: from='osd.0 [v2:172.21.15.1:6802/4067586847,v1:172.21.15.1:6803/4067586847]' entity='osd.0' 2024-09-21T00:49:23.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:23 smithi001 ceph-mon[31211]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:23.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:23 smithi001 ceph-mon[31211]: from='osd.0 [v2:172.21.15.1:6802/4067586847,v1:172.21.15.1:6803/4067586847]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-21T00:49:23.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:23 smithi001 ceph-mon[31211]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T00:49:23.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:23 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:49:23.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:23 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:49:23.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:23 smithi001 ceph-mon[31211]: Detected new or changed devices on smithi001 2024-09-21T00:49:23.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:23 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:23.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:23 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:23.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:23 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T00:49:23.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:23 smithi001 ceph-mon[31211]: Adjusting osd_memory_target on smithi001 to 17092M 2024-09-21T00:49:23.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:23 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:23.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:23 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:49:23.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:23 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:49:23.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:23 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:23.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:23 smithi001 ceph-mon[31211]: from='osd.0 [v2:172.21.15.1:6802/4067586847,v1:172.21.15.1:6803/4067586847]' entity='osd.0' 2024-09-21T00:49:23.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:23 smithi193 ceph-mon[34660]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:23.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:23 smithi193 ceph-mon[34660]: from='osd.0 [v2:172.21.15.1:6802/4067586847,v1:172.21.15.1:6803/4067586847]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-21T00:49:23.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:23 smithi193 ceph-mon[34660]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T00:49:23.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:23 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:49:23.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:23 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:49:23.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:23 smithi193 ceph-mon[34660]: Detected new or changed devices on smithi001 2024-09-21T00:49:23.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:23 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:23.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:23 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:23.731 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:23 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T00:49:23.731 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:23 smithi193 ceph-mon[34660]: Adjusting osd_memory_target on smithi001 to 17092M 2024-09-21T00:49:23.731 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:23 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:23.731 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:23 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:49:23.731 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:23 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:49:23.731 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:23 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:23.731 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:23 smithi193 ceph-mon[34660]: from='osd.0 [v2:172.21.15.1:6802/4067586847,v1:172.21.15.1:6803/4067586847]' entity='osd.0' 2024-09-21T00:49:24.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:24 smithi001 ceph-mon[31211]: purged_snaps scrub starts 2024-09-21T00:49:24.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:24 smithi001 ceph-mon[31211]: purged_snaps scrub ok 2024-09-21T00:49:24.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:24 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:49:24.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:24 smithi001 ceph-mon[31211]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:24.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:24 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:49:24.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:24 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:49:24.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:24 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:49:24.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:24 smithi001 ceph-mon[31211]: osd.0 [v2:172.21.15.1:6802/4067586847,v1:172.21.15.1:6803/4067586847] boot 2024-09-21T00:49:24.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:24 smithi001 ceph-mon[31211]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T00:49:24.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:24 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:49:24.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:24 smithi193 ceph-mon[34660]: purged_snaps scrub starts 2024-09-21T00:49:24.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:24 smithi193 ceph-mon[34660]: purged_snaps scrub ok 2024-09-21T00:49:24.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:24 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:49:24.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:24 smithi193 ceph-mon[34660]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:24.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:24 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:49:24.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:24 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:49:24.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:24 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:49:24.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:24 smithi193 ceph-mon[34660]: osd.0 [v2:172.21.15.1:6802/4067586847,v1:172.21.15.1:6803/4067586847] boot 2024-09-21T00:49:24.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:24 smithi193 ceph-mon[34660]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T00:49:24.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:24 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:49:24.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:24 smithi042 ceph-mon[34481]: purged_snaps scrub starts 2024-09-21T00:49:24.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:24 smithi042 ceph-mon[34481]: purged_snaps scrub ok 2024-09-21T00:49:24.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:24 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:49:24.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:24 smithi042 ceph-mon[34481]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:24.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:24 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:49:24.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:24 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:49:24.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:24 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:49:24.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:24 smithi042 ceph-mon[34481]: osd.0 [v2:172.21.15.1:6802/4067586847,v1:172.21.15.1:6803/4067586847] boot 2024-09-21T00:49:24.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:24 smithi042 ceph-mon[34481]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T00:49:24.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:24 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:49:25.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:25 smithi001 ceph-mon[31211]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:25.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:25 smithi193 ceph-mon[34660]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:25.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:25 smithi042 ceph-mon[34481]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:26.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:26 smithi001 ceph-mon[31211]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T00:49:26.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:26 smithi001 ceph-mon[31211]: from='client.? 172.21.15.42:0/1563542804' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "195f9109-ef61-46be-a59a-d72e3a1b5b45"} : dispatch 2024-09-21T00:49:26.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:26 smithi001 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "195f9109-ef61-46be-a59a-d72e3a1b5b45"} : dispatch 2024-09-21T00:49:26.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:26 smithi001 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "195f9109-ef61-46be-a59a-d72e3a1b5b45"}]': finished 2024-09-21T00:49:26.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:26 smithi001 ceph-mon[31211]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T00:49:26.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:26 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:49:26.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:26 smithi193 ceph-mon[34660]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T00:49:26.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:26 smithi193 ceph-mon[34660]: from='client.? 172.21.15.42:0/1563542804' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "195f9109-ef61-46be-a59a-d72e3a1b5b45"} : dispatch 2024-09-21T00:49:26.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:26 smithi193 ceph-mon[34660]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "195f9109-ef61-46be-a59a-d72e3a1b5b45"} : dispatch 2024-09-21T00:49:26.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:26 smithi193 ceph-mon[34660]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "195f9109-ef61-46be-a59a-d72e3a1b5b45"}]': finished 2024-09-21T00:49:26.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:26 smithi193 ceph-mon[34660]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T00:49:26.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:26 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:49:26.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:26 smithi042 ceph-mon[34481]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T00:49:26.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:26 smithi042 ceph-mon[34481]: from='client.? 172.21.15.42:0/1563542804' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "195f9109-ef61-46be-a59a-d72e3a1b5b45"} : dispatch 2024-09-21T00:49:26.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:26 smithi042 ceph-mon[34481]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "195f9109-ef61-46be-a59a-d72e3a1b5b45"} : dispatch 2024-09-21T00:49:26.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:26 smithi042 ceph-mon[34481]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "195f9109-ef61-46be-a59a-d72e3a1b5b45"}]': finished 2024-09-21T00:49:26.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:26 smithi042 ceph-mon[34481]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T00:49:26.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:26 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:49:27.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:27 smithi001 ceph-mon[31211]: pgmap v60: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:27.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:27 smithi001 ceph-mon[31211]: from='client.? 172.21.15.42:0/4113557761' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:49:27.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:27 smithi193 ceph-mon[34660]: pgmap v60: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:27.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:27 smithi193 ceph-mon[34660]: from='client.? 172.21.15.42:0/4113557761' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:49:27.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:27 smithi042 ceph-mon[34481]: pgmap v60: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:27.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:27 smithi042 ceph-mon[34481]: from='client.? 172.21.15.42:0/4113557761' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:49:29.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:29 smithi001 ceph-mon[31211]: pgmap v61: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:29.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:29 smithi193 ceph-mon[34660]: pgmap v61: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:29.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:29 smithi042 ceph-mon[34481]: pgmap v61: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:31.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:31 smithi193 ceph-mon[34660]: pgmap v62: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:31.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:31 smithi042 ceph-mon[34481]: pgmap v62: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:31.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:31 smithi001 ceph-mon[31211]: pgmap v62: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:33.728 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:33 smithi042 ceph-mon[34481]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:33.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:33 smithi193 ceph-mon[34660]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:33.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:33 smithi001 ceph-mon[31211]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:34.701 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:34 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T00:49:34.701 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:34 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:49:34.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:34 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T00:49:34.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:34 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:49:34.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:34 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T00:49:34.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:34 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:49:35.614 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:35 smithi042 ceph-mon[34481]: pgmap v64: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:35.614 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:35 smithi042 ceph-mon[34481]: Deploying daemon osd.1 on smithi042 2024-09-21T00:49:35.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:35 smithi193 ceph-mon[34660]: pgmap v64: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:35.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:35 smithi193 ceph-mon[34660]: Deploying daemon osd.1 on smithi042 2024-09-21T00:49:35.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:35 smithi001 ceph-mon[31211]: pgmap v64: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:35.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:35 smithi001 ceph-mon[31211]: Deploying daemon osd.1 on smithi042 2024-09-21T00:49:37.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:37 smithi193 ceph-mon[34660]: pgmap v65: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:37.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:37 smithi042 ceph-mon[34481]: pgmap v65: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:37.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:37 smithi001 ceph-mon[31211]: pgmap v65: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:39.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:39 smithi193 ceph-mon[34660]: pgmap v66: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:39.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:39 smithi042 ceph-mon[34481]: pgmap v66: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:39.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:39 smithi001 ceph-mon[31211]: pgmap v66: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:40.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:40 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:49:40.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:40 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:40.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:40 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:40.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:40 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:49:40.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:40 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:40.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:40 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:40.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:40 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:49:40.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:40 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:40.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:40 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:41.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:41 smithi042 ceph-mon[34481]: pgmap v67: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:41.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:41 smithi001 ceph-mon[31211]: pgmap v67: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:41.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:41 smithi193 ceph-mon[34660]: pgmap v67: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:43.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:43 smithi001 ceph-mon[31211]: pgmap v68: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:43.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:43 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:43.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:43 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:43.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:43 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:49:43.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:43 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:49:43.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:43 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:43.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:43 smithi193 ceph-mon[34660]: pgmap v68: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:43.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:43 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:43.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:43 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:43.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:43 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:49:43.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:43 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:49:43.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:43 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:43.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:43 smithi042 ceph-mon[34481]: pgmap v68: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:43.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:43 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:43.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:43 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:43.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:43 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:49:43.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:43 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:49:43.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:43 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:44.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:44.775+0000 7f50a97fa640 1 -- 172.21.15.42:0/1548957117 <== mgr.14150 v2:172.21.15.1:6800/2032980330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f50ac0ffff0 con 0x7f50980b6480 2024-09-21T00:49:44.776 INFO:teuthology.orchestra.run.smithi042.stdout:Created osd(s) 1 on host 'smithi042' 2024-09-21T00:49:44.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:44.778+0000 7f50b1f4e640 1 -- 172.21.15.42:0/1548957117 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f50980b6480 msgr2=0x7f50980b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:49:44.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:44.778+0000 7f50b1f4e640 1 --2- 172.21.15.42:0/1548957117 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f50980b6480 0x7f50980b8990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5094031440 tx=0x7f50940314a0 comp rx=0 tx=0).stop 2024-09-21T00:49:44.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:44.778+0000 7f50b1f4e640 1 -- 172.21.15.42:0/1548957117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50ac102690 msgr2=0x7f50ac19a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:49:44.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:44.778+0000 7f50b1f4e640 1 --2- 172.21.15.42:0/1548957117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50ac102690 0x7f50ac19a010 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f509c00e9f0 tx=0x7f509c00eeb0 comp rx=0 tx=0).stop 2024-09-21T00:49:44.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:44.778+0000 7f50b1f4e640 1 -- 172.21.15.42:0/1548957117 shutdown_connections 2024-09-21T00:49:44.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:44.778+0000 7f50b1f4e640 1 --2- 172.21.15.42:0/1548957117 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50ac1040c0 0x7f50ac19b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:49:44.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:44.778+0000 7f50b1f4e640 1 --2- 172.21.15.42:0/1548957117 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f50980b6480 0x7f50980b8990 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:49:44.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:44.778+0000 7f50b1f4e640 1 --2- 172.21.15.42:0/1548957117 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f50ac103720 0x7f50ac19a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:49:44.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:44.778+0000 7f50b1f4e640 1 --2- 172.21.15.42:0/1548957117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50ac102690 0x7f50ac19a010 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:49:44.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:44.778+0000 7f50b1f4e640 1 -- 172.21.15.42:0/1548957117 >> 172.21.15.42:0/1548957117 conn(0x7f50ac0fe000 msgr2=0x7f50ac0ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:49:44.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:44.778+0000 7f50b1f4e640 1 -- 172.21.15.42:0/1548957117 shutdown_connections 2024-09-21T00:49:44.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:49:44.778+0000 7f50b1f4e640 1 -- 172.21.15.42:0/1548957117 wait complete. 2024-09-21T00:49:45.352 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:45 smithi042 ceph-mon[34481]: pgmap v69: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:45.352 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:45 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:49:45.352 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:45 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:45.352 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:45 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:45.378 DEBUG:teuthology.orchestra.run.smithi042:osd.1> sudo journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@osd.1.service 2024-09-21T00:49:45.421 INFO:tasks.cephadm:Deploying osd.2 on smithi193 with /dev/vg_nvme/lv_4... 2024-09-21T00:49:45.421 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T00:49:45.448 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:45 smithi193 ceph-mon[34660]: pgmap v69: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:45.448 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:45 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:49:45.448 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:45 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:45.448 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:45 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:45.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:45 smithi001 ceph-mon[31211]: pgmap v69: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:45.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:45 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:49:45.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:45 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:45.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:45 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:45.671 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:49:46.731 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 00:49:46 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-1[38383]: 2024-09-21T00:49:46.468+0000 7f8dd4c2c640 -1 osd.1 0 log_to_monitors true 2024-09-21T00:49:47.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:47 smithi042 ceph-mon[34481]: pgmap v70: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:47.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:47 smithi042 ceph-mon[34481]: from='osd.1 [v2:172.21.15.42:6800/436964633,v1:172.21.15.42:6801/436964633]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T00:49:47.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:47 smithi042 ceph-mon[34481]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T00:49:47.373 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:47 smithi193 ceph-mon[34660]: pgmap v70: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:47.374 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:47 smithi193 ceph-mon[34660]: from='osd.1 [v2:172.21.15.42:6800/436964633,v1:172.21.15.42:6801/436964633]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T00:49:47.374 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:47 smithi193 ceph-mon[34660]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T00:49:47.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:47 smithi001 ceph-mon[31211]: pgmap v70: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:47.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:47 smithi001 ceph-mon[31211]: from='osd.1 [v2:172.21.15.42:6800/436964633,v1:172.21.15.42:6801/436964633]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T00:49:47.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:47 smithi001 ceph-mon[31211]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T00:49:48.018 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-21T00:49:48.044 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi193:vg_nvme/lv_4 2024-09-21T00:49:48.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:48 smithi042 ceph-mon[34481]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T00:49:48.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:48 smithi042 ceph-mon[34481]: from='osd.1 [v2:172.21.15.42:6800/436964633,v1:172.21.15.42:6801/436964633]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T00:49:48.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:48 smithi042 ceph-mon[34481]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T00:49:48.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:48 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:49:48.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:48 smithi042 ceph-mon[34481]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T00:49:48.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:48 smithi042 ceph-mon[34481]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-21T00:49:48.349 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:49:48.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:48 smithi001 ceph-mon[31211]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T00:49:48.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:48 smithi001 ceph-mon[31211]: from='osd.1 [v2:172.21.15.42:6800/436964633,v1:172.21.15.42:6801/436964633]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T00:49:48.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:48 smithi001 ceph-mon[31211]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T00:49:48.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:48 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:49:48.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:48 smithi001 ceph-mon[31211]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T00:49:48.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:48 smithi001 ceph-mon[31211]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-21T00:49:48.469 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:48 smithi193 ceph-mon[34660]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T00:49:48.470 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:48 smithi193 ceph-mon[34660]: from='osd.1 [v2:172.21.15.42:6800/436964633,v1:172.21.15.42:6801/436964633]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T00:49:48.470 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:48 smithi193 ceph-mon[34660]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T00:49:48.470 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:48 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:49:48.470 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:48 smithi193 ceph-mon[34660]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T00:49:48.470 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:48 smithi193 ceph-mon[34660]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-21T00:49:48.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.846+0000 7f13c90d8640 1 -- 172.21.15.193:0/1068461026 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13c4109480 msgr2=0x7f13c410b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:49:48.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.846+0000 7f13c90d8640 1 --2- 172.21.15.193:0/1068461026 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13c4109480 0x7f13c410b990 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f13bc009ca0 tx=0x7f13bc02a8c0 comp rx=0 tx=0).stop 2024-09-21T00:49:48.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.846+0000 7f13c90d8640 1 -- 172.21.15.193:0/1068461026 shutdown_connections 2024-09-21T00:49:48.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.846+0000 7f13c90d8640 1 --2- 172.21.15.193:0/1068461026 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13c4109480 0x7f13c410b990 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:49:48.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.846+0000 7f13c90d8640 1 --2- 172.21.15.193:0/1068461026 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13c41068e0 0x7f13c4108d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:49:48.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.846+0000 7f13c90d8640 1 --2- 172.21.15.193:0/1068461026 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13c406c340 0x7f13c41063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:49:48.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.846+0000 7f13c90d8640 1 -- 172.21.15.193:0/1068461026 >> 172.21.15.193:0/1068461026 conn(0x7f13c40fdfa0 msgr2=0x7f13c4100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:49:48.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.846+0000 7f13c90d8640 1 -- 172.21.15.193:0/1068461026 shutdown_connections 2024-09-21T00:49:48.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.846+0000 7f13c90d8640 1 -- 172.21.15.193:0/1068461026 wait complete. 2024-09-21T00:49:48.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.847+0000 7f13c90d8640 1 Processor -- start 2024-09-21T00:49:48.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.847+0000 7f13c90d8640 1 -- start start 2024-09-21T00:49:48.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.847+0000 7f13c90d8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13c406c340 0x7f13c4199f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:49:48.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.847+0000 7f13c90d8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13c41068e0 0x7f13c419a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:49:48.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.847+0000 7f13c90d8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13c4109480 0x7f13c419b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:49:48.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.847+0000 7f13c90d8640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f13c410f3a0 con 0x7f13c406c340 2024-09-21T00:49:48.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.847+0000 7f13c90d8640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f13c410f220 con 0x7f13c41068e0 2024-09-21T00:49:48.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.847+0000 7f13c90d8640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f13c410f520 con 0x7f13c4109480 2024-09-21T00:49:48.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.848+0000 7f13c359e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13c4109480 0x7f13c419b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:49:48.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.848+0000 7f13c359e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13c4109480 0x7f13c419b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.193:54992/0 (socket says 172.21.15.193:54992) 2024-09-21T00:49:48.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.848+0000 7f13c359e640 1 -- 172.21.15.193:0/579678519 learned_addr learned my addr 172.21.15.193:0/579678519 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-21T00:49:48.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.848+0000 7f13c259c640 1 --2- 172.21.15.193:0/579678519 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13c41068e0 0x7f13c419a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:49:48.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.848+0000 7f13c2d9d640 1 --2- 172.21.15.193:0/579678519 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13c406c340 0x7f13c4199f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:49:48.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.848+0000 7f13c359e640 1 -- 172.21.15.193:0/579678519 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13c41068e0 msgr2=0x7f13c419a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:49:48.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.848+0000 7f13c359e640 1 --2- 172.21.15.193:0/579678519 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13c41068e0 0x7f13c419a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:49:48.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.848+0000 7f13c359e640 1 -- 172.21.15.193:0/579678519 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13c406c340 msgr2=0x7f13c4199f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:49:48.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.848+0000 7f13c359e640 1 --2- 172.21.15.193:0/579678519 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13c406c340 0x7f13c4199f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:49:48.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.848+0000 7f13c359e640 1 -- 172.21.15.193:0/579678519 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c419b8d0 con 0x7f13c4109480 2024-09-21T00:49:48.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.848+0000 7f13c359e640 1 --2- 172.21.15.193:0/579678519 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13c4109480 0x7f13c419b140 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f13bc0097b0 tx=0x7f13bc003c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:49:48.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.848+0000 7f13bbfff640 1 -- 172.21.15.193:0/579678519 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13bc004240 con 0x7f13c4109480 2024-09-21T00:49:48.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.848+0000 7f13c90d8640 1 -- 172.21.15.193:0/579678519 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13c419bb60 con 0x7f13c4109480 2024-09-21T00:49:48.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.848+0000 7f13bbfff640 1 -- 172.21.15.193:0/579678519 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13bc02f380 con 0x7f13c4109480 2024-09-21T00:49:48.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.848+0000 7f13bbfff640 1 -- 172.21.15.193:0/579678519 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13bc02fc20 con 0x7f13c4109480 2024-09-21T00:49:48.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.849+0000 7f13c90d8640 1 -- 172.21.15.193:0/579678519 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13c4102180 con 0x7f13c4109480 2024-09-21T00:49:48.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.849+0000 7f13c90d8640 1 -- 172.21.15.193:0/579678519 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13c40ffac0 con 0x7f13c4109480 2024-09-21T00:49:48.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.851+0000 7f13bbfff640 1 -- 172.21.15.193:0/579678519 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 15) ==== 154455+0+0 (secure 0 0 0) 0x7f13bc0043e0 con 0x7f13c4109480 2024-09-21T00:49:48.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.852+0000 7f13bbfff640 1 --2- 172.21.15.193:0/579678519 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f13b00b6480 0x7f13b00b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:49:48.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.852+0000 7f13bbfff640 1 -- 172.21.15.193:0/579678519 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f13bc107290 con 0x7f13c4109480 2024-09-21T00:49:48.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.852+0000 7f13c2d9d640 1 --2- 172.21.15.193:0/579678519 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f13b00b6480 0x7f13b00b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:49:48.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.853+0000 7f13c2d9d640 1 --2- 172.21.15.193:0/579678519 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f13b00b6480 0x7f13b00b8990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f13b40071c0 tx=0x7f13b4010040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:49:48.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:48.860+0000 7f13bbfff640 1 -- 172.21.15.193:0/579678519 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f13bc083710 con 0x7f13c4109480 2024-09-21T00:49:48.992 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 00:49:48 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-1[38383]: 2024-09-21T00:49:48.616+0000 7f8dd0bae640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T00:49:48.992 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 00:49:48 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-1[38383]: 2024-09-21T00:49:48.620+0000 7f8dc89a4640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:49:49.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:49:49.052+0000 7f13c90d8640 1 -- 172.21.15.193:0/579678519 --> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f13c4063800 con 0x7f13b00b6480 2024-09-21T00:49:49.319 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:49 smithi193 ceph-mon[34660]: pgmap v72: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:49.320 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:49 smithi193 ceph-mon[34660]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T00:49:49.320 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:49 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:49:49.320 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:49 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:49:49.320 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:49 smithi193 ceph-mon[34660]: Detected new or changed devices on smithi042 2024-09-21T00:49:49.320 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:49 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:49.320 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:49 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:49.320 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:49 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T00:49:49.320 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:49 smithi193 ceph-mon[34660]: Adjusting osd_memory_target on smithi042 to 17092M 2024-09-21T00:49:49.320 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:49 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:49.320 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:49 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:49:49.320 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:49 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:49:49.320 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:49 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:49.320 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:49 smithi193 ceph-mon[34660]: from='osd.1 ' entity='osd.1' 2024-09-21T00:49:49.320 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:49 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:49:49.321 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:49 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:49:49.321 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:49 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:49:49.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:49 smithi001 ceph-mon[31211]: pgmap v72: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:49.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:49 smithi001 ceph-mon[31211]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T00:49:49.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:49 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:49:49.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:49 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:49:49.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:49 smithi001 ceph-mon[31211]: Detected new or changed devices on smithi042 2024-09-21T00:49:49.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:49 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:49.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:49 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:49.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:49 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T00:49:49.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:49 smithi001 ceph-mon[31211]: Adjusting osd_memory_target on smithi042 to 17092M 2024-09-21T00:49:49.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:49 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:49.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:49 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:49:49.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:49 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:49:49.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:49 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:49.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:49 smithi001 ceph-mon[31211]: from='osd.1 ' entity='osd.1' 2024-09-21T00:49:49.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:49 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:49:49.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:49 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:49:49.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:49 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:49:49.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:49 smithi042 ceph-mon[34481]: pgmap v72: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:49.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:49 smithi042 ceph-mon[34481]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T00:49:49.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:49 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:49:49.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:49 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:49:49.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:49 smithi042 ceph-mon[34481]: Detected new or changed devices on smithi042 2024-09-21T00:49:49.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:49 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:49.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:49 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:49.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:49 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T00:49:49.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:49 smithi042 ceph-mon[34481]: Adjusting osd_memory_target on smithi042 to 17092M 2024-09-21T00:49:49.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:49 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:49.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:49 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:49:49.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:49 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:49:49.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:49 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:49:49.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:49 smithi042 ceph-mon[34481]: from='osd.1 ' entity='osd.1' 2024-09-21T00:49:49.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:49 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:49:49.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:49 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:49:49.494 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:49 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:49:50.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:50 smithi042 ceph-mon[34481]: purged_snaps scrub starts 2024-09-21T00:49:50.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:50 smithi042 ceph-mon[34481]: purged_snaps scrub ok 2024-09-21T00:49:50.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:50 smithi042 ceph-mon[34481]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:50.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:50 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:49:50.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:50 smithi042 ceph-mon[34481]: osd.1 [v2:172.21.15.42:6800/436964633,v1:172.21.15.42:6801/436964633] boot 2024-09-21T00:49:50.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:50 smithi042 ceph-mon[34481]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T00:49:50.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:50 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:49:50.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:50 smithi001 ceph-mon[31211]: purged_snaps scrub starts 2024-09-21T00:49:50.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:50 smithi001 ceph-mon[31211]: purged_snaps scrub ok 2024-09-21T00:49:50.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:50 smithi001 ceph-mon[31211]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:50.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:50 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:49:50.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:50 smithi001 ceph-mon[31211]: osd.1 [v2:172.21.15.42:6800/436964633,v1:172.21.15.42:6801/436964633] boot 2024-09-21T00:49:50.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:50 smithi001 ceph-mon[31211]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T00:49:50.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:50 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:49:50.463 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:50 smithi193 ceph-mon[34660]: purged_snaps scrub starts 2024-09-21T00:49:50.463 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:50 smithi193 ceph-mon[34660]: purged_snaps scrub ok 2024-09-21T00:49:50.463 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:50 smithi193 ceph-mon[34660]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:50.463 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:50 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:49:50.463 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:50 smithi193 ceph-mon[34660]: osd.1 [v2:172.21.15.42:6800/436964633,v1:172.21.15.42:6801/436964633] boot 2024-09-21T00:49:50.463 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:50 smithi193 ceph-mon[34660]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T00:49:50.463 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:50 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:49:51.900 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:51 smithi193 ceph-mon[34660]: pgmap v75: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:51.900 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:51 smithi193 ceph-mon[34660]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T00:49:51.900 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:51 smithi193 ceph-mon[34660]: from='client.? 172.21.15.193:0/208204676' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "47cf90a7-6db6-464a-84ef-9f509f89a46b"} : dispatch 2024-09-21T00:49:51.900 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:51 smithi193 ceph-mon[34660]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "47cf90a7-6db6-464a-84ef-9f509f89a46b"} : dispatch 2024-09-21T00:49:51.900 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:51 smithi193 ceph-mon[34660]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "47cf90a7-6db6-464a-84ef-9f509f89a46b"}]': finished 2024-09-21T00:49:51.900 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:51 smithi193 ceph-mon[34660]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T00:49:51.900 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:51 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:49:51.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:51 smithi001 ceph-mon[31211]: pgmap v75: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:51.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:51 smithi001 ceph-mon[31211]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T00:49:51.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:51 smithi001 ceph-mon[31211]: from='client.? 172.21.15.193:0/208204676' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "47cf90a7-6db6-464a-84ef-9f509f89a46b"} : dispatch 2024-09-21T00:49:51.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:51 smithi001 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "47cf90a7-6db6-464a-84ef-9f509f89a46b"} : dispatch 2024-09-21T00:49:51.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:51 smithi001 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "47cf90a7-6db6-464a-84ef-9f509f89a46b"}]': finished 2024-09-21T00:49:51.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:51 smithi001 ceph-mon[31211]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T00:49:51.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:51 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:49:51.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:51 smithi042 ceph-mon[34481]: pgmap v75: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:49:51.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:51 smithi042 ceph-mon[34481]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T00:49:51.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:51 smithi042 ceph-mon[34481]: from='client.? 172.21.15.193:0/208204676' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "47cf90a7-6db6-464a-84ef-9f509f89a46b"} : dispatch 2024-09-21T00:49:51.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:51 smithi042 ceph-mon[34481]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "47cf90a7-6db6-464a-84ef-9f509f89a46b"} : dispatch 2024-09-21T00:49:51.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:51 smithi042 ceph-mon[34481]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "47cf90a7-6db6-464a-84ef-9f509f89a46b"}]': finished 2024-09-21T00:49:51.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:51 smithi042 ceph-mon[34481]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T00:49:51.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:51 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:49:52.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:52 smithi001 ceph-mon[31211]: from='client.? 172.21.15.193:0/2201544609' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:49:52.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:52 smithi193 ceph-mon[34660]: from='client.? 172.21.15.193:0/2201544609' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:49:52.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:52 smithi042 ceph-mon[34481]: from='client.? 172.21.15.193:0/2201544609' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:49:53.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:53 smithi001 ceph-mon[31211]: pgmap v78: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:49:53.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:53 smithi193 ceph-mon[34660]: pgmap v78: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:49:53.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:53 smithi042 ceph-mon[34481]: pgmap v78: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:49:55.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:55 smithi001 ceph-mon[31211]: pgmap v79: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:49:55.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:55 smithi193 ceph-mon[34660]: pgmap v79: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:49:55.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:55 smithi042 ceph-mon[34481]: pgmap v79: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:49:57.935 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:57 smithi193 ceph-mon[34660]: pgmap v80: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:49:57.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:57 smithi001 ceph-mon[31211]: pgmap v80: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:49:57.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:57 smithi042 ceph-mon[34481]: pgmap v80: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:49:59.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:49:59 smithi001 ceph-mon[31211]: pgmap v81: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:49:59.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:49:59 smithi193 ceph-mon[34660]: pgmap v81: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:49:59.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:49:59 smithi042 ceph-mon[34481]: pgmap v81: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:50:00.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:00 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T00:50:00.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:00 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:00.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:00 smithi001 ceph-mon[31211]: Deploying daemon osd.2 on smithi193 2024-09-21T00:50:00.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:00 smithi001 ceph-mon[31211]: overall HEALTH_OK 2024-09-21T00:50:00.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:00 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T00:50:00.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:00 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:00.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:00 smithi193 ceph-mon[34660]: Deploying daemon osd.2 on smithi193 2024-09-21T00:50:00.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:00 smithi193 ceph-mon[34660]: overall HEALTH_OK 2024-09-21T00:50:00.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:00 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T00:50:00.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:00 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:00.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:00 smithi042 ceph-mon[34481]: Deploying daemon osd.2 on smithi193 2024-09-21T00:50:00.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:00 smithi042 ceph-mon[34481]: overall HEALTH_OK 2024-09-21T00:50:01.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:01 smithi001 ceph-mon[31211]: pgmap v82: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:50:01.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:01 smithi193 ceph-mon[34660]: pgmap v82: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:50:01.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:01 smithi042 ceph-mon[34481]: pgmap v82: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:50:03.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:03 smithi001 ceph-mon[31211]: pgmap v83: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:50:03.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:03 smithi193 ceph-mon[34660]: pgmap v83: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:50:03.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:03 smithi042 ceph-mon[34481]: pgmap v83: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:50:05.824 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:05 smithi193 ceph-mon[34660]: pgmap v84: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:50:05.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:05 smithi001 ceph-mon[31211]: pgmap v84: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:50:05.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:05 smithi042 ceph-mon[34481]: pgmap v84: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:50:06.871 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:06 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:50:06.871 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:06 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:06.871 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:06 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:06.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:06 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:50:06.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:06 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:06.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:06 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:06.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:06 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:50:06.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:06 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:06.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:06 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:07.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:07 smithi001 ceph-mon[31211]: pgmap v85: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:50:07.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:07 smithi193 ceph-mon[34660]: pgmap v85: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:50:07.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:07 smithi042 ceph-mon[34481]: pgmap v85: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:50:09.833 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:09 smithi193 ceph-mon[34660]: pgmap v86: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:50:09.833 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:09 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:09.833 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:09 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:09.833 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:09 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:09.833 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:09 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:50:09.833 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:09 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:09.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:09 smithi001 ceph-mon[31211]: pgmap v86: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:50:09.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:09 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:09.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:09 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:09.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:09 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:09.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:09 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:50:09.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:09 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:09.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:09 smithi042 ceph-mon[34481]: pgmap v86: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:50:09.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:09 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:09.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:09 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:09.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:09 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:09.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:09 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:50:09.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:09 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:10.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:50:10.160+0000 7f13bbfff640 1 -- 172.21.15.193:0/579678519 <== mgr.14150 v2:172.21.15.1:6800/2032980330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f13c4063800 con 0x7f13b00b6480 2024-09-21T00:50:10.162 INFO:teuthology.orchestra.run.smithi193.stdout:Created osd(s) 2 on host 'smithi193' 2024-09-21T00:50:10.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:50:10.163+0000 7f13c90d8640 1 -- 172.21.15.193:0/579678519 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f13b00b6480 msgr2=0x7f13b00b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:10.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:50:10.163+0000 7f13c90d8640 1 --2- 172.21.15.193:0/579678519 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f13b00b6480 0x7f13b00b8990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f13b40071c0 tx=0x7f13b4010040 comp rx=0 tx=0).stop 2024-09-21T00:50:10.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:50:10.163+0000 7f13c90d8640 1 -- 172.21.15.193:0/579678519 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13c4109480 msgr2=0x7f13c419b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:10.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:50:10.163+0000 7f13c90d8640 1 --2- 172.21.15.193:0/579678519 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13c4109480 0x7f13c419b140 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f13bc0097b0 tx=0x7f13bc003c20 comp rx=0 tx=0).stop 2024-09-21T00:50:10.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:50:10.163+0000 7f13c90d8640 1 -- 172.21.15.193:0/579678519 shutdown_connections 2024-09-21T00:50:10.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:50:10.163+0000 7f13c90d8640 1 --2- 172.21.15.193:0/579678519 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13c4109480 0x7f13c419b140 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:10.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:50:10.163+0000 7f13c90d8640 1 --2- 172.21.15.193:0/579678519 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13c41068e0 0x7f13c419a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:10.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:50:10.163+0000 7f13c90d8640 1 --2- 172.21.15.193:0/579678519 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f13b00b6480 0x7f13b00b8990 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:10.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:50:10.163+0000 7f13c90d8640 1 --2- 172.21.15.193:0/579678519 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13c406c340 0x7f13c4199f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:10.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:50:10.163+0000 7f13c90d8640 1 -- 172.21.15.193:0/579678519 >> 172.21.15.193:0/579678519 conn(0x7f13c40fdfa0 msgr2=0x7f13c4104d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:10.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:50:10.163+0000 7f13c90d8640 1 -- 172.21.15.193:0/579678519 shutdown_connections 2024-09-21T00:50:10.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:50:10.163+0000 7f13c90d8640 1 -- 172.21.15.193:0/579678519 wait complete. 2024-09-21T00:50:10.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:10 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:50:10.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:10 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:10.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:10 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:10.768 DEBUG:teuthology.orchestra.run.smithi193:osd.2> sudo journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@osd.2.service 2024-09-21T00:50:10.771 INFO:tasks.cephadm:Deploying osd.3 on smithi001 with /dev/vg_nvme/lv_3... 2024-09-21T00:50:10.771 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T00:50:10.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:10 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:50:10.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:10 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:10.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:10 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:10.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:10 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:50:10.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:10 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:10.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:10 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:11.039 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:50:11.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:11 smithi193 ceph-mon[34660]: pgmap v87: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:50:11.824 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:11 smithi001 ceph-mon[31211]: pgmap v87: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:50:11.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:11 smithi042 ceph-mon[34481]: pgmap v87: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:50:12.130 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 21 00:50:11 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-2[39042]: 2024-09-21T00:50:11.773+0000 7f4cff9b9640 -1 osd.2 0 log_to_monitors true 2024-09-21T00:50:12.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:12 smithi001 ceph-mon[31211]: from='osd.2 [v2:172.21.15.193:6800/3495400570,v1:172.21.15.193:6801/3495400570]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T00:50:12.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:12 smithi001 ceph-mon[31211]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T00:50:12.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:12 smithi193 ceph-mon[34660]: from='osd.2 [v2:172.21.15.193:6800/3495400570,v1:172.21.15.193:6801/3495400570]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T00:50:12.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:12 smithi193 ceph-mon[34660]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T00:50:12.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:12 smithi042 ceph-mon[34481]: from='osd.2 [v2:172.21.15.193:6800/3495400570,v1:172.21.15.193:6801/3495400570]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T00:50:12.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:12 smithi042 ceph-mon[34481]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T00:50:13.461 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:50:13.493 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi001:vg_nvme/lv_3 2024-09-21T00:50:13.762 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:50:13.875 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:13 smithi001 ceph-mon[31211]: pgmap v88: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:50:13.875 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:13 smithi001 ceph-mon[31211]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T00:50:13.875 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:13 smithi001 ceph-mon[31211]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T00:50:13.875 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:13 smithi001 ceph-mon[31211]: from='osd.2 [v2:172.21.15.193:6800/3495400570,v1:172.21.15.193:6801/3495400570]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi193", "root=default"]} : dispatch 2024-09-21T00:50:13.875 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:13 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:50:13.875 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:13 smithi001 ceph-mon[31211]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi193", "root=default"]} : dispatch 2024-09-21T00:50:13.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:13 smithi193 ceph-mon[34660]: pgmap v88: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:50:13.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:13 smithi193 ceph-mon[34660]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T00:50:13.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:13 smithi193 ceph-mon[34660]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T00:50:13.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:13 smithi193 ceph-mon[34660]: from='osd.2 [v2:172.21.15.193:6800/3495400570,v1:172.21.15.193:6801/3495400570]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi193", "root=default"]} : dispatch 2024-09-21T00:50:13.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:13 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:50:13.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:13 smithi193 ceph-mon[34660]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi193", "root=default"]} : dispatch 2024-09-21T00:50:13.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:13 smithi042 ceph-mon[34481]: pgmap v88: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:50:13.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:13 smithi042 ceph-mon[34481]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T00:50:13.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:13 smithi042 ceph-mon[34481]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T00:50:13.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:13 smithi042 ceph-mon[34481]: from='osd.2 [v2:172.21.15.193:6800/3495400570,v1:172.21.15.193:6801/3495400570]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi193", "root=default"]} : dispatch 2024-09-21T00:50:13.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:13 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:50:13.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:13 smithi042 ceph-mon[34481]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi193", "root=default"]} : dispatch 2024-09-21T00:50:14.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.216+0000 7fb67f1cc640 1 -- 172.21.15.1:0/317081286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb678104870 msgr2=0x7fb678104c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:14.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.216+0000 7fb67f1cc640 1 --2- 172.21.15.1:0/317081286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb678104870 0x7fb678104c80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb664009900 tx=0x7fb66402a480 comp rx=0 tx=0).stop 2024-09-21T00:50:14.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.216+0000 7fb67f1cc640 1 -- 172.21.15.1:0/317081286 shutdown_connections 2024-09-21T00:50:14.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.216+0000 7fb67f1cc640 1 --2- 172.21.15.1:0/317081286 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb678105210 0x7fb67810bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:14.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.216+0000 7fb67f1cc640 1 --2- 172.21.15.1:0/317081286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb678104870 0x7fb678104c80 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:14.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.216+0000 7fb67f1cc640 1 --2- 172.21.15.1:0/317081286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6781037e0 0x7fb678103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:14.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.216+0000 7fb67f1cc640 1 -- 172.21.15.1:0/317081286 >> 172.21.15.1:0/317081286 conn(0x7fb6780ff150 msgr2=0x7fb678101600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:14.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.216+0000 7fb67f1cc640 1 -- 172.21.15.1:0/317081286 shutdown_connections 2024-09-21T00:50:14.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.216+0000 7fb67f1cc640 1 -- 172.21.15.1:0/317081286 wait complete. 2024-09-21T00:50:14.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.216+0000 7fb67f1cc640 1 Processor -- start 2024-09-21T00:50:14.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.217+0000 7fb67f1cc640 1 -- start start 2024-09-21T00:50:14.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.217+0000 7fb67f1cc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6781037e0 0x7fb678076e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:14.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.217+0000 7fb67f1cc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb678104870 0x7fb678075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:14.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.217+0000 7fb67f1cc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb678105210 0x7fb678075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:14.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.217+0000 7fb67f1cc640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb67810f3c0 con 0x7fb678104870 2024-09-21T00:50:14.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.217+0000 7fb67f1cc640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb67810f240 con 0x7fb6781037e0 2024-09-21T00:50:14.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.217+0000 7fb67f1cc640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb67810f540 con 0x7fb678105210 2024-09-21T00:50:14.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.217+0000 7fb677fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb678104870 0x7fb678075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:14.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.217+0000 7fb677fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb678104870 0x7fb678075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52830/0 (socket says 172.21.15.1:52830) 2024-09-21T00:50:14.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.217+0000 7fb677fff640 1 -- 172.21.15.1:0/1056602479 learned_addr learned my addr 172.21.15.1:0/1056602479 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:50:14.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.217+0000 7fb67cf68640 1 --2- 172.21.15.1:0/1056602479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6781037e0 0x7fb678076e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:14.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.217+0000 7fb67d769640 1 --2- 172.21.15.1:0/1056602479 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb678105210 0x7fb678075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:14.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.217+0000 7fb677fff640 1 -- 172.21.15.1:0/1056602479 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb678105210 msgr2=0x7fb678075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:14.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.217+0000 7fb677fff640 1 --2- 172.21.15.1:0/1056602479 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb678105210 0x7fb678075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:14.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.217+0000 7fb677fff640 1 -- 172.21.15.1:0/1056602479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6781037e0 msgr2=0x7fb678076e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:14.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.217+0000 7fb677fff640 1 --2- 172.21.15.1:0/1056602479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6781037e0 0x7fb678076e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:14.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.217+0000 7fb677fff640 1 -- 172.21.15.1:0/1056602479 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb678076350 con 0x7fb678104870 2024-09-21T00:50:14.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.218+0000 7fb677fff640 1 --2- 172.21.15.1:0/1056602479 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb678104870 0x7fb678075710 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb664006010 tx=0x7fb664031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:14.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.218+0000 7fb675ffb640 1 -- 172.21.15.1:0/1056602479 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66403f030 con 0x7fb678104870 2024-09-21T00:50:14.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.218+0000 7fb675ffb640 1 -- 172.21.15.1:0/1056602479 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb664003aa0 con 0x7fb678104870 2024-09-21T00:50:14.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.218+0000 7fb67f1cc640 1 -- 172.21.15.1:0/1056602479 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6781a4080 con 0x7fb678104870 2024-09-21T00:50:14.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.218+0000 7fb675ffb640 1 -- 172.21.15.1:0/1056602479 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb664035070 con 0x7fb678104870 2024-09-21T00:50:14.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.218+0000 7fb67f1cc640 1 -- 172.21.15.1:0/1056602479 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6781a4470 con 0x7fb678104870 2024-09-21T00:50:14.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.219+0000 7fb67f1cc640 1 -- 172.21.15.1:0/1056602479 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb678103c50 con 0x7fb678104870 2024-09-21T00:50:14.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.222+0000 7fb675ffb640 1 -- 172.21.15.1:0/1056602479 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 15) ==== 154455+0+0 (secure 0 0 0) 0x7fb664042030 con 0x7fb678104870 2024-09-21T00:50:14.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.223+0000 7fb675ffb640 1 --2- 172.21.15.1:0/1056602479 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb6680b6500 0x7fb6680b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:14.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.223+0000 7fb67cf68640 1 --2- 172.21.15.1:0/1056602479 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb6680b6500 0x7fb6680b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:14.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.223+0000 7fb675ffb640 1 -- 172.21.15.1:0/1056602479 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2571+0+0 (secure 0 0 0) 0x7fb664106720 con 0x7fb678104870 2024-09-21T00:50:14.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.223+0000 7fb67cf68640 1 --2- 172.21.15.1:0/1056602479 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb6680b6500 0x7fb6680b8a10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb66c0058c0 tx=0x7fb66c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:14.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.226+0000 7fb675ffb640 1 -- 172.21.15.1:0/1056602479 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb6640d2ae0 con 0x7fb678104870 2024-09-21T00:50:14.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:14.426+0000 7fb67f1cc640 1 -- 172.21.15.1:0/1056602479 --> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fb678063800 con 0x7fb6680b6500 2024-09-21T00:50:14.479 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 21 00:50:14 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-2[39042]: 2024-09-21T00:50:14.060+0000 7f4cfb93b640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T00:50:14.480 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 21 00:50:14 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-2[39042]: 2024-09-21T00:50:14.064+0000 7f4cf3731640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:50:14.861 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:14 smithi001 ceph-mon[31211]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-21T00:50:14.862 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:14 smithi001 ceph-mon[31211]: Detected new or changed devices on smithi193 2024-09-21T00:50:14.862 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:14 smithi001 ceph-mon[31211]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T00:50:14.862 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:14 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:50:14.862 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:14 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:50:14.862 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:14 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:14.862 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:14 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:14.862 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:14 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T00:50:14.862 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:14 smithi001 ceph-mon[31211]: Adjusting osd_memory_target on smithi193 to 17088M 2024-09-21T00:50:14.862 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:14 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:14.862 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:14 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:14.862 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:14 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:50:14.863 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:14 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:14.863 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:14 smithi001 ceph-mon[31211]: from='osd.2 ' entity='osd.2' 2024-09-21T00:50:14.863 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:14 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:50:14.863 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:14 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:50:14.863 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:14 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:14.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:14 smithi193 ceph-mon[34660]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-21T00:50:14.982 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:14 smithi193 ceph-mon[34660]: Detected new or changed devices on smithi193 2024-09-21T00:50:14.982 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:14 smithi193 ceph-mon[34660]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T00:50:14.982 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:14 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:50:14.982 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:14 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:50:14.982 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:14 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:14.982 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:14 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:14.982 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:14 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T00:50:14.982 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:14 smithi193 ceph-mon[34660]: Adjusting osd_memory_target on smithi193 to 17088M 2024-09-21T00:50:14.982 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:14 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:14.982 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:14 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:14.982 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:14 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:50:14.982 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:14 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:14.982 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:14 smithi193 ceph-mon[34660]: from='osd.2 ' entity='osd.2' 2024-09-21T00:50:14.982 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:14 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:50:14.983 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:14 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:50:14.983 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:14 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:14.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:14 smithi042 ceph-mon[34481]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-21T00:50:14.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:14 smithi042 ceph-mon[34481]: Detected new or changed devices on smithi193 2024-09-21T00:50:14.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:14 smithi042 ceph-mon[34481]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T00:50:14.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:14 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:50:14.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:14 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:50:14.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:14 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:14.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:14 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:14.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:14 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T00:50:14.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:14 smithi042 ceph-mon[34481]: Adjusting osd_memory_target on smithi193 to 17088M 2024-09-21T00:50:14.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:14 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:14.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:14 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:14.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:14 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:50:14.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:14 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:14.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:14 smithi042 ceph-mon[34481]: from='osd.2 ' entity='osd.2' 2024-09-21T00:50:14.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:14 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:50:14.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:14 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:50:14.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:14 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:15.865 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:15 smithi001 ceph-mon[31211]: purged_snaps scrub starts 2024-09-21T00:50:15.865 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:15 smithi001 ceph-mon[31211]: purged_snaps scrub ok 2024-09-21T00:50:15.865 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:15 smithi001 ceph-mon[31211]: pgmap v91: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:50:15.865 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:15 smithi001 ceph-mon[31211]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:15.865 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:15 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:50:15.865 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:15 smithi001 ceph-mon[31211]: osd.2 [v2:172.21.15.193:6800/3495400570,v1:172.21.15.193:6801/3495400570] boot 2024-09-21T00:50:15.865 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:15 smithi001 ceph-mon[31211]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T00:50:15.865 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:15 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:50:15.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:15 smithi193 ceph-mon[34660]: purged_snaps scrub starts 2024-09-21T00:50:15.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:15 smithi193 ceph-mon[34660]: purged_snaps scrub ok 2024-09-21T00:50:15.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:15 smithi193 ceph-mon[34660]: pgmap v91: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:50:15.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:15 smithi193 ceph-mon[34660]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:15.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:15 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:50:15.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:15 smithi193 ceph-mon[34660]: osd.2 [v2:172.21.15.193:6800/3495400570,v1:172.21.15.193:6801/3495400570] boot 2024-09-21T00:50:15.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:15 smithi193 ceph-mon[34660]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T00:50:15.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:15 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:50:15.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:15 smithi042 ceph-mon[34481]: purged_snaps scrub starts 2024-09-21T00:50:15.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:15 smithi042 ceph-mon[34481]: purged_snaps scrub ok 2024-09-21T00:50:15.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:15 smithi042 ceph-mon[34481]: pgmap v91: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:50:15.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:15 smithi042 ceph-mon[34481]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:15.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:15 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:50:15.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:15 smithi042 ceph-mon[34481]: osd.2 [v2:172.21.15.193:6800/3495400570,v1:172.21.15.193:6801/3495400570] boot 2024-09-21T00:50:15.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:15 smithi042 ceph-mon[34481]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T00:50:15.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:15 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:50:16.942 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:16 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T00:50:16.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:16 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T00:50:16.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:16 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T00:50:17.209 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 21 00:50:16 smithi001 sudo[51083]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T00:50:17.209 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 21 00:50:16 smithi001 sudo[51083]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:50:17.210 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 21 00:50:16 smithi001 sudo[51083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:50:17.210 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 21 00:50:16 smithi001 sudo[51083]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:50:17.210 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 21 00:50:16 smithi001 sudo[51086]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T00:50:17.210 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 21 00:50:16 smithi001 sudo[51086]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:50:17.210 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 21 00:50:16 smithi001 sudo[51086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:50:17.210 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 21 00:50:16 smithi001 sudo[51086]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:50:17.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:17 smithi001 sudo[51095]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T00:50:17.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:17 smithi001 sudo[51095]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:50:17.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:17 smithi001 sudo[51095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:50:17.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:17 smithi001 sudo[51095]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:50:17.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:17 smithi001 sudo[51098]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T00:50:17.212 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:17 smithi001 sudo[51098]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:50:17.212 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:17 smithi001 sudo[51098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:50:17.212 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:17 smithi001 sudo[51098]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:50:17.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:17 smithi193 sudo[42868]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T00:50:17.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:17 smithi193 sudo[42868]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:50:17.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:17 smithi193 sudo[42868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:50:17.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:17 smithi193 sudo[42868]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:50:17.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:17 smithi193 sudo[42871]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T00:50:17.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:17 smithi193 sudo[42871]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:50:17.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:17 smithi193 sudo[42871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:50:17.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:17 smithi193 sudo[42871]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:50:17.481 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 21 00:50:17 smithi193 sudo[42862]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T00:50:17.481 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 21 00:50:17 smithi193 sudo[42862]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:50:17.481 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 21 00:50:17 smithi193 sudo[42862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:50:17.481 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 21 00:50:17 smithi193 sudo[42862]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:50:17.481 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 21 00:50:17 smithi193 sudo[42865]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T00:50:17.481 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 21 00:50:17 smithi193 sudo[42865]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:50:17.481 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 21 00:50:17 smithi193 sudo[42865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:50:17.481 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 21 00:50:17 smithi193 sudo[42865]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:50:17.492 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 00:50:17 smithi042 sudo[42293]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T00:50:17.492 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 00:50:17 smithi042 sudo[42293]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:50:17.492 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 00:50:17 smithi042 sudo[42293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:50:17.492 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 00:50:17 smithi042 sudo[42293]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:50:17.492 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 00:50:17 smithi042 sudo[42296]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T00:50:17.492 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 00:50:17 smithi042 sudo[42296]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:50:17.493 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 00:50:17 smithi042 sudo[42296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:50:17.493 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 00:50:17 smithi042 sudo[42296]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:50:17.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:17 smithi042 sudo[42299]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T00:50:17.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:17 smithi042 sudo[42299]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:50:17.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:17 smithi042 sudo[42299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:50:17.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:17 smithi042 sudo[42299]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:50:17.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:17 smithi042 sudo[42302]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T00:50:17.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:17 smithi042 sudo[42302]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:50:17.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:17 smithi042 sudo[42302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:50:17.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:17 smithi042 sudo[42302]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:50:17.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:17 smithi001 ceph-mon[31211]: pgmap v93: 0 pgs: ; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:17.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T00:50:17.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:17 smithi001 ceph-mon[31211]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T00:50:17.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T00:50:17.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:17 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/3825499811' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a5230a66-3c74-41a7-9353-5650780ed25f"} : dispatch 2024-09-21T00:50:17.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T00:50:17.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:17 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/3825499811' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a5230a66-3c74-41a7-9353-5650780ed25f"}]': finished 2024-09-21T00:50:17.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:17 smithi001 ceph-mon[31211]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T00:50:17.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:50:17.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:17.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:17.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:17.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:17 smithi001 ceph-mon[31211]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:50:17.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:17 smithi001 ceph-mon[31211]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:50:17.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:50:17.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:50:17.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:50:17.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:17 smithi001 ceph-mon[31211]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:50:17.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:50:17.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:50:17.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:50:17.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:17 smithi001 ceph-mon[31211]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:50:17.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:17 smithi001 ceph-mon[31211]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:50:17.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:50:17.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:50:17.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:50:17.963 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:17 smithi001 ceph-mon[31211]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:50:17.963 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:17 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/2959487617' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:50:17.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:17 smithi193 ceph-mon[34660]: pgmap v93: 0 pgs: ; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:17.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T00:50:17.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:17 smithi193 ceph-mon[34660]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T00:50:17.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T00:50:17.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:17 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/3825499811' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a5230a66-3c74-41a7-9353-5650780ed25f"} : dispatch 2024-09-21T00:50:17.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T00:50:17.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:17 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/3825499811' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a5230a66-3c74-41a7-9353-5650780ed25f"}]': finished 2024-09-21T00:50:17.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:17 smithi193 ceph-mon[34660]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T00:50:17.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:50:17.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:17.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:17.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:17.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:17 smithi193 ceph-mon[34660]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:50:17.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:17 smithi193 ceph-mon[34660]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:50:17.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:50:17.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:50:17.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:50:17.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:17 smithi193 ceph-mon[34660]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:50:17.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:50:17.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:50:17.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:50:17.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:17 smithi193 ceph-mon[34660]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:50:17.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:17 smithi193 ceph-mon[34660]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:50:17.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:50:17.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:50:17.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:50:17.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:17 smithi193 ceph-mon[34660]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:50:17.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:17 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/2959487617' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:50:17.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:17 smithi042 ceph-mon[34481]: pgmap v93: 0 pgs: ; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:17.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T00:50:17.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:17 smithi042 ceph-mon[34481]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T00:50:17.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T00:50:17.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:17 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/3825499811' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a5230a66-3c74-41a7-9353-5650780ed25f"} : dispatch 2024-09-21T00:50:17.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T00:50:17.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:17 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/3825499811' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a5230a66-3c74-41a7-9353-5650780ed25f"}]': finished 2024-09-21T00:50:17.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:17 smithi042 ceph-mon[34481]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T00:50:17.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:50:17.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:17.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:17.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:17.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:17 smithi042 ceph-mon[34481]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:50:17.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:17 smithi042 ceph-mon[34481]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:50:17.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:50:17.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:50:17.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:50:17.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:17 smithi042 ceph-mon[34481]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:50:17.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:50:17.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:50:17.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:50:17.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:17 smithi042 ceph-mon[34481]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:50:17.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:17 smithi042 ceph-mon[34481]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:50:17.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:50:17.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:50:17.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:50:17.995 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:17 smithi042 ceph-mon[34481]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:50:17.995 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:17 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/2959487617' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:50:18.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:18.901+0000 7fb675ffb640 1 -- 172.21.15.1:0/1056602479 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 16) ==== 154511+0+0 (secure 0 0 0) 0x7fb6640ca320 con 0x7fb678104870 2024-09-21T00:50:19.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:18 smithi001 ceph-mon[31211]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T00:50:19.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:18 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:50:19.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:18 smithi001 ceph-mon[31211]: pgmap v97: 1 pgs: 1 unknown; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:19.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:18 smithi193 ceph-mon[34660]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T00:50:19.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:18 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:50:19.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:18 smithi193 ceph-mon[34660]: pgmap v97: 1 pgs: 1 unknown; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:19.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:18 smithi042 ceph-mon[34481]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T00:50:19.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:18 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:50:19.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:18 smithi042 ceph-mon[34481]: pgmap v97: 1 pgs: 1 unknown; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:20.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:19 smithi001 ceph-mon[31211]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-21T00:50:20.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:19 smithi193 ceph-mon[34660]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-21T00:50:20.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:19 smithi042 ceph-mon[34481]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-21T00:50:21.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:20 smithi001 ceph-mon[31211]: pgmap v98: 1 pgs: 1 unknown; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:21.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:20 smithi193 ceph-mon[34660]: pgmap v98: 1 pgs: 1 unknown; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:21.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:20 smithi042 ceph-mon[34481]: pgmap v98: 1 pgs: 1 unknown; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:23.412 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:23 smithi001 ceph-mon[31211]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:23.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:23 smithi193 ceph-mon[34660]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:23.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:23 smithi042 ceph-mon[34481]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:25.373 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:25 smithi001 ceph-mon[31211]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:25.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:25 smithi193 ceph-mon[34660]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:25.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:25 smithi042 ceph-mon[34481]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:26.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:26 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T00:50:26.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:26 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:26.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:26 smithi001 ceph-mon[31211]: Deploying daemon osd.3 on smithi001 2024-09-21T00:50:26.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:26 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T00:50:26.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:26 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:26.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:26 smithi193 ceph-mon[34660]: Deploying daemon osd.3 on smithi001 2024-09-21T00:50:26.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:26 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T00:50:26.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:26 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:26.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:26 smithi042 ceph-mon[34481]: Deploying daemon osd.3 on smithi001 2024-09-21T00:50:27.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:27 smithi001 ceph-mon[31211]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:27.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:27 smithi193 ceph-mon[34660]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:27.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:27 smithi042 ceph-mon[34481]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:29.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:29 smithi001 ceph-mon[31211]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:29.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:29 smithi193 ceph-mon[34660]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:29.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:29 smithi042 ceph-mon[34481]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:31.446 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:31 smithi001 ceph-mon[31211]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:31.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:31 smithi193 ceph-mon[34660]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:31.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:31 smithi042 ceph-mon[34481]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:32.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:32 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:50:32.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:32 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:32.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:32 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:32.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:32 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:50:32.485 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:32 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:32.485 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:32 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:32.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:32 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:50:32.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:32 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:32.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:32 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:33.100 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:33 smithi001 ceph-mon[31211]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:33.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:33 smithi193 ceph-mon[34660]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:33.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:33 smithi042 ceph-mon[34481]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:35.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:35 smithi001 ceph-mon[31211]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:35.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:35 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:35.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:35 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:35.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:35 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:35.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:35 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:50:35.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:35 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:35.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:35 smithi193 ceph-mon[34660]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:35.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:35 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:35.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:35 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:35.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:35 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:35.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:35 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:50:35.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:35 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:35.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:35 smithi042 ceph-mon[34481]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:35.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:35 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:35.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:35 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:35.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:35 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:35.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:35 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:50:35.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:35 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:36.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:36.241+0000 7fb675ffb640 1 -- 172.21.15.1:0/1056602479 <== mgr.14150 v2:172.21.15.1:6800/2032980330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb678063800 con 0x7fb6680b6500 2024-09-21T00:50:36.243 INFO:teuthology.orchestra.run.smithi001.stdout:Created osd(s) 3 on host 'smithi001' 2024-09-21T00:50:36.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:36.244+0000 7fb67f1cc640 1 -- 172.21.15.1:0/1056602479 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb6680b6500 msgr2=0x7fb6680b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:36.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:36.244+0000 7fb67f1cc640 1 --2- 172.21.15.1:0/1056602479 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb6680b6500 0x7fb6680b8a10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb66c0058c0 tx=0x7fb66c00a2d0 comp rx=0 tx=0).stop 2024-09-21T00:50:36.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:36.244+0000 7fb67f1cc640 1 -- 172.21.15.1:0/1056602479 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb678104870 msgr2=0x7fb678075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:36.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:36.244+0000 7fb67f1cc640 1 --2- 172.21.15.1:0/1056602479 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb678104870 0x7fb678075710 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb664006010 tx=0x7fb664031a50 comp rx=0 tx=0).stop 2024-09-21T00:50:36.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:36.244+0000 7fb67f1cc640 1 -- 172.21.15.1:0/1056602479 shutdown_connections 2024-09-21T00:50:36.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:36.244+0000 7fb67f1cc640 1 --2- 172.21.15.1:0/1056602479 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb678105210 0x7fb678075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:36.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:36.244+0000 7fb67f1cc640 1 --2- 172.21.15.1:0/1056602479 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb6680b6500 0x7fb6680b8a10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:36.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:36.244+0000 7fb67f1cc640 1 --2- 172.21.15.1:0/1056602479 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb678104870 0x7fb678075710 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:36.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:36.244+0000 7fb67f1cc640 1 --2- 172.21.15.1:0/1056602479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6781037e0 0x7fb678076e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:36.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:36.244+0000 7fb67f1cc640 1 -- 172.21.15.1:0/1056602479 >> 172.21.15.1:0/1056602479 conn(0x7fb6780ff150 msgr2=0x7fb678107b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:36.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:36.244+0000 7fb67f1cc640 1 -- 172.21.15.1:0/1056602479 shutdown_connections 2024-09-21T00:50:36.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:50:36.244+0000 7fb67f1cc640 1 -- 172.21.15.1:0/1056602479 wait complete. 2024-09-21T00:50:36.941 DEBUG:teuthology.orchestra.run.smithi001:osd.3> sudo journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@osd.3.service 2024-09-21T00:50:36.943 INFO:tasks.cephadm:Deploying osd.4 on smithi042 with /dev/vg_nvme/lv_3... 2024-09-21T00:50:36.943 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T00:50:37.208 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:37 smithi001 ceph-mon[31211]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:37.208 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:37 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:50:37.208 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:37 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:37.208 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:37 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:37.210 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T00:50:37.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:37 smithi042 ceph-mon[34481]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:37.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:37 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:50:37.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:37 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:37.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:37 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:37.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:37 smithi193 ceph-mon[34660]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:37.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:37 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:50:37.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:37 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:37.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:37 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:38.210 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 21 00:50:38 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-3[53057]: 2024-09-21T00:50:38.155+0000 7f7758353640 -1 osd.3 0 log_to_monitors true 2024-09-21T00:50:39.196 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:39 smithi042 ceph-mon[34481]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:39.196 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:39 smithi042 ceph-mon[34481]: from='osd.3 [v2:172.21.15.1:6810/3221661671,v1:172.21.15.1:6811/3221661671]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T00:50:39.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:39 smithi001 ceph-mon[31211]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:39.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:39 smithi001 ceph-mon[31211]: from='osd.3 [v2:172.21.15.1:6810/3221661671,v1:172.21.15.1:6811/3221661671]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T00:50:39.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:39 smithi193 ceph-mon[34660]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:39.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:39 smithi193 ceph-mon[34660]: from='osd.3 [v2:172.21.15.1:6810/3221661671,v1:172.21.15.1:6811/3221661671]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T00:50:39.950 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T00:50:39.976 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi042:vg_nvme/lv_3 2024-09-21T00:50:40.235 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T00:50:40.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:40 smithi042 ceph-mon[34481]: from='osd.3 [v2:172.21.15.1:6810/3221661671,v1:172.21.15.1:6811/3221661671]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T00:50:40.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:40 smithi042 ceph-mon[34481]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T00:50:40.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:40 smithi042 ceph-mon[34481]: from='osd.3 [v2:172.21.15.1:6810/3221661671,v1:172.21.15.1:6811/3221661671]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]} : dispatch 2024-09-21T00:50:40.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:40 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:50:40.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:40 smithi042 ceph-mon[34481]: Detected new or changed devices on smithi001 2024-09-21T00:50:40.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:40 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:40.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:40 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:40.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:40 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T00:50:40.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:40 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T00:50:40.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:40 smithi042 ceph-mon[34481]: Adjusting osd_memory_target on smithi001 to 8546M 2024-09-21T00:50:40.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:40 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:40.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:40 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:40.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:40 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:50:40.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:40 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:40.460 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 21 00:50:40 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-3[53057]: 2024-09-21T00:50:40.120+0000 7f77542d5640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T00:50:40.461 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 21 00:50:40 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-3[53057]: 2024-09-21T00:50:40.126+0000 7f77500d3640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:50:40.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:40 smithi001 ceph-mon[31211]: from='osd.3 [v2:172.21.15.1:6810/3221661671,v1:172.21.15.1:6811/3221661671]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T00:50:40.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:40 smithi001 ceph-mon[31211]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T00:50:40.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:40 smithi001 ceph-mon[31211]: from='osd.3 [v2:172.21.15.1:6810/3221661671,v1:172.21.15.1:6811/3221661671]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]} : dispatch 2024-09-21T00:50:40.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:40 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:50:40.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:40 smithi001 ceph-mon[31211]: Detected new or changed devices on smithi001 2024-09-21T00:50:40.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:40 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:40.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:40 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:40.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:40 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T00:50:40.462 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:40 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T00:50:40.462 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:40 smithi001 ceph-mon[31211]: Adjusting osd_memory_target on smithi001 to 8546M 2024-09-21T00:50:40.462 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:40 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:40.462 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:40 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:40.462 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:40 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:50:40.462 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:40 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:40.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:40 smithi193 ceph-mon[34660]: from='osd.3 [v2:172.21.15.1:6810/3221661671,v1:172.21.15.1:6811/3221661671]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T00:50:40.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:40 smithi193 ceph-mon[34660]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T00:50:40.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:40 smithi193 ceph-mon[34660]: from='osd.3 [v2:172.21.15.1:6810/3221661671,v1:172.21.15.1:6811/3221661671]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]} : dispatch 2024-09-21T00:50:40.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:40 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:50:40.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:40 smithi193 ceph-mon[34660]: Detected new or changed devices on smithi001 2024-09-21T00:50:40.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:40 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:40.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:40 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:40.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:40 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T00:50:40.481 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:40 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T00:50:40.481 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:40 smithi193 ceph-mon[34660]: Adjusting osd_memory_target on smithi001 to 8546M 2024-09-21T00:50:40.481 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:40 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:40.481 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:40 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:40.481 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:40 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:50:40.481 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:40 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:40.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.755+0000 7fe26c77b640 1 -- 172.21.15.42:0/1634809378 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe264105180 msgr2=0x7fe26410bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:40.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.755+0000 7fe26c77b640 1 --2- 172.21.15.42:0/1634809378 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe264105180 0x7fe26410bb20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe25c009ca0 tx=0x7fe25c02a950 comp rx=0 tx=0).stop 2024-09-21T00:50:40.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.756+0000 7fe26c77b640 1 -- 172.21.15.42:0/1634809378 shutdown_connections 2024-09-21T00:50:40.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.756+0000 7fe26c77b640 1 --2- 172.21.15.42:0/1634809378 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe264105180 0x7fe26410bb20 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:40.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.756+0000 7fe26c77b640 1 --2- 172.21.15.42:0/1634809378 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe2641047e0 0x7fe264104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:40.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.756+0000 7fe26c77b640 1 --2- 172.21.15.42:0/1634809378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe264103750 0x7fe264103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:40.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.756+0000 7fe26c77b640 1 -- 172.21.15.42:0/1634809378 >> 172.21.15.42:0/1634809378 conn(0x7fe2640ff0c0 msgr2=0x7fe264101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:40.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.756+0000 7fe26c77b640 1 -- 172.21.15.42:0/1634809378 shutdown_connections 2024-09-21T00:50:40.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.756+0000 7fe26c77b640 1 -- 172.21.15.42:0/1634809378 wait complete. 2024-09-21T00:50:40.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.756+0000 7fe26c77b640 1 Processor -- start 2024-09-21T00:50:40.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.756+0000 7fe26c77b640 1 -- start start 2024-09-21T00:50:40.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.756+0000 7fe26c77b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe264103750 0x7fe264199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:40.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.756+0000 7fe26c77b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2641047e0 0x7fe26419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:40.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.757+0000 7fe26c77b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe264105180 0x7fe26419b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:40.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.757+0000 7fe26c77b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe26410f3a0 con 0x7fe2641047e0 2024-09-21T00:50:40.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.757+0000 7fe26c77b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe26410f220 con 0x7fe264103750 2024-09-21T00:50:40.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.757+0000 7fe26c77b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe26410f520 con 0x7fe264105180 2024-09-21T00:50:40.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.757+0000 7fe26a517640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe264103750 0x7fe264199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:40.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.757+0000 7fe26a517640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe264103750 0x7fe264199f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46472/0 (socket says 172.21.15.42:46472) 2024-09-21T00:50:40.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.757+0000 7fe26a517640 1 -- 172.21.15.42:0/2652354153 learned_addr learned my addr 172.21.15.42:0/2652354153 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T00:50:40.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.757+0000 7fe269d16640 1 --2- 172.21.15.42:0/2652354153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2641047e0 0x7fe26419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:40.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.757+0000 7fe26ad18640 1 --2- 172.21.15.42:0/2652354153 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe264105180 0x7fe26419b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:40.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.757+0000 7fe26a517640 1 -- 172.21.15.42:0/2652354153 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe264105180 msgr2=0x7fe26419b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:40.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.757+0000 7fe26a517640 1 --2- 172.21.15.42:0/2652354153 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe264105180 0x7fe26419b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:40.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.757+0000 7fe26a517640 1 -- 172.21.15.42:0/2652354153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2641047e0 msgr2=0x7fe26419a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:40.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.757+0000 7fe26a517640 1 --2- 172.21.15.42:0/2652354153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2641047e0 0x7fe26419a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:40.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.757+0000 7fe26a517640 1 -- 172.21.15.42:0/2652354153 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe26419b9a0 con 0x7fe264103750 2024-09-21T00:50:40.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.757+0000 7fe26a517640 1 --2- 172.21.15.42:0/2652354153 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe264103750 0x7fe264199f70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe26000d950 tx=0x7fe26000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:40.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.757+0000 7fe25b7fe640 1 -- 172.21.15.42:0/2652354153 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe260017070 con 0x7fe264103750 2024-09-21T00:50:40.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.757+0000 7fe26c77b640 1 -- 172.21.15.42:0/2652354153 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe26419bc90 con 0x7fe264103750 2024-09-21T00:50:40.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.757+0000 7fe25b7fe640 1 -- 172.21.15.42:0/2652354153 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe260009c30 con 0x7fe264103750 2024-09-21T00:50:40.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.757+0000 7fe25b7fe640 1 -- 172.21.15.42:0/2652354153 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe26000f620 con 0x7fe264103750 2024-09-21T00:50:40.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.757+0000 7fe26c77b640 1 -- 172.21.15.42:0/2652354153 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2641a2390 con 0x7fe264103750 2024-09-21T00:50:40.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.758+0000 7fe26c77b640 1 -- 172.21.15.42:0/2652354153 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe26410a910 con 0x7fe264103750 2024-09-21T00:50:40.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.760+0000 7fe25b7fe640 1 -- 172.21.15.42:0/2652354153 <== mon.2 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 154511+0+0 (secure 0 0 0) 0x7fe260010460 con 0x7fe264103750 2024-09-21T00:50:40.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.761+0000 7fe25b7fe640 1 --2- 172.21.15.42:0/2652354153 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe2500b6510 0x7fe2500b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:40.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.761+0000 7fe25b7fe640 1 -- 172.21.15.42:0/2652354153 <== mon.2 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 3389+0+0 (secure 0 0 0) 0x7fe2600e5c10 con 0x7fe264103750 2024-09-21T00:50:40.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.762+0000 7fe269d16640 1 --2- 172.21.15.42:0/2652354153 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe2500b6510 0x7fe2500b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:40.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.762+0000 7fe269d16640 1 --2- 172.21.15.42:0/2652354153 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe2500b6510 0x7fe2500b8a20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe254009bd0 tx=0x7fe254005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:40.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.765+0000 7fe25b7fe640 1 -- 172.21.15.42:0/2652354153 <== mon.2 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe260009de0 con 0x7fe264103750 2024-09-21T00:50:40.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:50:40.965+0000 7fe26c77b640 1 -- 172.21.15.42:0/2652354153 --> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fe264063800 con 0x7fe2500b6510 2024-09-21T00:50:41.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:41 smithi193 ceph-mon[34660]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:41.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:41 smithi193 ceph-mon[34660]: from='osd.3 [v2:172.21.15.1:6810/3221661671,v1:172.21.15.1:6811/3221661671]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-21T00:50:41.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:41 smithi193 ceph-mon[34660]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T00:50:41.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:41 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:50:41.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:41 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:50:41.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:41 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:50:41.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:41 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:50:41.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:41 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:41.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:41 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:50:41.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:41 smithi042 ceph-mon[34481]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:41.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:41 smithi042 ceph-mon[34481]: from='osd.3 [v2:172.21.15.1:6810/3221661671,v1:172.21.15.1:6811/3221661671]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-21T00:50:41.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:41 smithi042 ceph-mon[34481]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T00:50:41.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:41 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:50:41.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:41 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:50:41.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:41 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:50:41.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:41 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:50:41.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:41 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:41.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:41 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:50:41.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:41 smithi001 ceph-mon[31211]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:41.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:41 smithi001 ceph-mon[31211]: from='osd.3 [v2:172.21.15.1:6810/3221661671,v1:172.21.15.1:6811/3221661671]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-21T00:50:41.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:41 smithi001 ceph-mon[31211]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T00:50:41.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:41 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:50:41.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:41 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:50:41.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:41 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:50:41.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:41 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:50:41.462 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:41 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:41.462 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:41 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:50:42.366 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:42 smithi042 ceph-mon[34481]: purged_snaps scrub starts 2024-09-21T00:50:42.367 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:42 smithi042 ceph-mon[34481]: purged_snaps scrub ok 2024-09-21T00:50:42.367 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:42 smithi042 ceph-mon[34481]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:42.367 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:42 smithi042 ceph-mon[34481]: osd.3 [v2:172.21.15.1:6810/3221661671,v1:172.21.15.1:6811/3221661671] boot 2024-09-21T00:50:42.367 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:42 smithi042 ceph-mon[34481]: osdmap e24: 4 total, 4 up, 4 in 2024-09-21T00:50:42.367 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:42 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:50:42.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:42 smithi001 ceph-mon[31211]: purged_snaps scrub starts 2024-09-21T00:50:42.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:42 smithi001 ceph-mon[31211]: purged_snaps scrub ok 2024-09-21T00:50:42.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:42 smithi001 ceph-mon[31211]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:42.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:42 smithi001 ceph-mon[31211]: osd.3 [v2:172.21.15.1:6810/3221661671,v1:172.21.15.1:6811/3221661671] boot 2024-09-21T00:50:42.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:42 smithi001 ceph-mon[31211]: osdmap e24: 4 total, 4 up, 4 in 2024-09-21T00:50:42.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:42 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:50:42.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:42 smithi193 ceph-mon[34660]: purged_snaps scrub starts 2024-09-21T00:50:42.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:42 smithi193 ceph-mon[34660]: purged_snaps scrub ok 2024-09-21T00:50:42.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:42 smithi193 ceph-mon[34660]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:42.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:42 smithi193 ceph-mon[34660]: osd.3 [v2:172.21.15.1:6810/3221661671,v1:172.21.15.1:6811/3221661671] boot 2024-09-21T00:50:42.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:42 smithi193 ceph-mon[34660]: osdmap e24: 4 total, 4 up, 4 in 2024-09-21T00:50:42.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:42 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:50:43.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:43 smithi001 ceph-mon[31211]: pgmap v112: 1 pgs: 1 peering; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:43.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:43 smithi001 ceph-mon[31211]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T00:50:43.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:43 smithi193 ceph-mon[34660]: pgmap v112: 1 pgs: 1 peering; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:43.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:43 smithi193 ceph-mon[34660]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T00:50:43.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:43 smithi042 ceph-mon[34481]: pgmap v112: 1 pgs: 1 peering; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:50:43.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:43 smithi042 ceph-mon[34481]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T00:50:44.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:44 smithi001 ceph-mon[31211]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T00:50:44.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:44 smithi001 ceph-mon[31211]: from='client.? 172.21.15.42:0/78421596' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b0476b9b-3257-46d4-aff7-1f038286ed43"} : dispatch 2024-09-21T00:50:44.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:44 smithi001 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b0476b9b-3257-46d4-aff7-1f038286ed43"} : dispatch 2024-09-21T00:50:44.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:44 smithi001 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b0476b9b-3257-46d4-aff7-1f038286ed43"}]': finished 2024-09-21T00:50:44.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:44 smithi001 ceph-mon[31211]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T00:50:44.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:44 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:50:44.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:44 smithi001 ceph-mon[31211]: from='client.? 172.21.15.42:0/1063196000' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:50:44.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:44 smithi193 ceph-mon[34660]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T00:50:44.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:44 smithi193 ceph-mon[34660]: from='client.? 172.21.15.42:0/78421596' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b0476b9b-3257-46d4-aff7-1f038286ed43"} : dispatch 2024-09-21T00:50:44.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:44 smithi193 ceph-mon[34660]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b0476b9b-3257-46d4-aff7-1f038286ed43"} : dispatch 2024-09-21T00:50:44.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:44 smithi193 ceph-mon[34660]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b0476b9b-3257-46d4-aff7-1f038286ed43"}]': finished 2024-09-21T00:50:44.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:44 smithi193 ceph-mon[34660]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T00:50:44.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:44 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:50:44.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:44 smithi193 ceph-mon[34660]: from='client.? 172.21.15.42:0/1063196000' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:50:44.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:44 smithi042 ceph-mon[34481]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T00:50:44.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:44 smithi042 ceph-mon[34481]: from='client.? 172.21.15.42:0/78421596' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b0476b9b-3257-46d4-aff7-1f038286ed43"} : dispatch 2024-09-21T00:50:44.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:44 smithi042 ceph-mon[34481]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b0476b9b-3257-46d4-aff7-1f038286ed43"} : dispatch 2024-09-21T00:50:44.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:44 smithi042 ceph-mon[34481]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b0476b9b-3257-46d4-aff7-1f038286ed43"}]': finished 2024-09-21T00:50:44.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:44 smithi042 ceph-mon[34481]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T00:50:44.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:44 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:50:44.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:44 smithi042 ceph-mon[34481]: from='client.? 172.21.15.42:0/1063196000' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:50:45.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:45 smithi001 ceph-mon[31211]: pgmap v116: 1 pgs: 1 peering; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:50:45.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:45 smithi193 ceph-mon[34660]: pgmap v116: 1 pgs: 1 peering; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:50:45.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:45 smithi042 ceph-mon[34481]: pgmap v116: 1 pgs: 1 peering; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:50:47.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:47 smithi001 ceph-mon[31211]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 118 KiB/s, 0 objects/s recovering 2024-09-21T00:50:47.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:47 smithi193 ceph-mon[34660]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 118 KiB/s, 0 objects/s recovering 2024-09-21T00:50:47.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:47 smithi042 ceph-mon[34481]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 118 KiB/s, 0 objects/s recovering 2024-09-21T00:50:49.695 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:49 smithi042 ceph-mon[34481]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T00:50:49.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:49 smithi001 ceph-mon[31211]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T00:50:49.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:49 smithi193 ceph-mon[34660]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T00:50:51.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:51 smithi001 ceph-mon[31211]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-21T00:50:51.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:51 smithi193 ceph-mon[34660]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-21T00:50:51.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:51 smithi042 ceph-mon[34481]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-21T00:50:52.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:52 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T00:50:52.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:52 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:52.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:52 smithi001 ceph-mon[31211]: Deploying daemon osd.4 on smithi042 2024-09-21T00:50:52.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:52 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T00:50:52.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:52 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:52.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:52 smithi193 ceph-mon[34660]: Deploying daemon osd.4 on smithi042 2024-09-21T00:50:52.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:52 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T00:50:52.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:52 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:52.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:52 smithi042 ceph-mon[34481]: Deploying daemon osd.4 on smithi042 2024-09-21T00:50:53.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:53 smithi001 ceph-mon[31211]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-21T00:50:53.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:53 smithi193 ceph-mon[34660]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-21T00:50:53.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:53 smithi042 ceph-mon[34481]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-21T00:50:55.556 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:55 smithi042 ceph-mon[34481]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-21T00:50:55.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:55 smithi001 ceph-mon[31211]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-21T00:50:55.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:55 smithi193 ceph-mon[34660]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-21T00:50:57.614 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:57 smithi042 ceph-mon[34481]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:50:57.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:57 smithi001 ceph-mon[31211]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:50:57.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:57 smithi193 ceph-mon[34660]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:50:58.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:58 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:50:58.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:58 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:58.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:58 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:58.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:58 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:50:58.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:58 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:58.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:58 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:58.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:58 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:50:58.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:58 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:58.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:58 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:50:59.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:50:59 smithi001 ceph-mon[31211]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:50:59.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:50:59 smithi193 ceph-mon[34660]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:50:59.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:50:59 smithi042 ceph-mon[34481]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:51:01.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:01 smithi193 ceph-mon[34660]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:51:01.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:01 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:01.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:01 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:01.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:01 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:01.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:01 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:51:01.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:01 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:01.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:01 smithi042 ceph-mon[34481]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:51:01.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:01 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:01.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:01 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:01.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:01 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:01.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:01 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:51:01.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:01 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:01.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:01 smithi001 ceph-mon[31211]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:51:01.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:01 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:01.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:01 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:01.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:01 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:01.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:01 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:51:01.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:01 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:02.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:02.505+0000 7fe25b7fe640 1 -- 172.21.15.42:0/2652354153 <== mgr.14150 v2:172.21.15.1:6800/2032980330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe264063800 con 0x7fe2500b6510 2024-09-21T00:51:02.506 INFO:teuthology.orchestra.run.smithi042.stdout:Created osd(s) 4 on host 'smithi042' 2024-09-21T00:51:02.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:02.507+0000 7fe26c77b640 1 -- 172.21.15.42:0/2652354153 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe2500b6510 msgr2=0x7fe2500b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:51:02.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:02.507+0000 7fe26c77b640 1 --2- 172.21.15.42:0/2652354153 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe2500b6510 0x7fe2500b8a20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe254009bd0 tx=0x7fe254005f90 comp rx=0 tx=0).stop 2024-09-21T00:51:02.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:02.507+0000 7fe26c77b640 1 -- 172.21.15.42:0/2652354153 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe264103750 msgr2=0x7fe264199f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:51:02.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:02.507+0000 7fe26c77b640 1 --2- 172.21.15.42:0/2652354153 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe264103750 0x7fe264199f70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe26000d950 tx=0x7fe26000de10 comp rx=0 tx=0).stop 2024-09-21T00:51:02.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:02.507+0000 7fe26c77b640 1 -- 172.21.15.42:0/2652354153 shutdown_connections 2024-09-21T00:51:02.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:02.507+0000 7fe26c77b640 1 --2- 172.21.15.42:0/2652354153 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe264105180 0x7fe26419b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:02.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:02.507+0000 7fe26c77b640 1 --2- 172.21.15.42:0/2652354153 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe2500b6510 0x7fe2500b8a20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:02.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:02.507+0000 7fe26c77b640 1 --2- 172.21.15.42:0/2652354153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2641047e0 0x7fe26419a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:02.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:02.507+0000 7fe26c77b640 1 --2- 172.21.15.42:0/2652354153 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe264103750 0x7fe264199f70 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:02.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:02.507+0000 7fe26c77b640 1 -- 172.21.15.42:0/2652354153 >> 172.21.15.42:0/2652354153 conn(0x7fe2640ff0c0 msgr2=0x7fe264107ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:51:02.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:02.508+0000 7fe26c77b640 1 -- 172.21.15.42:0/2652354153 shutdown_connections 2024-09-21T00:51:02.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:02.508+0000 7fe26c77b640 1 -- 172.21.15.42:0/2652354153 wait complete. 2024-09-21T00:51:03.201 DEBUG:teuthology.orchestra.run.smithi042:osd.4> sudo journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@osd.4.service 2024-09-21T00:51:03.203 INFO:tasks.cephadm:Deploying osd.5 on smithi193 with /dev/vg_nvme/lv_3... 2024-09-21T00:51:03.203 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T00:51:03.458 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:51:03.579 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:03 smithi193 ceph-mon[34660]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:51:03.580 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:03 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:51:03.580 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:03 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:03.580 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:03 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:03.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:03 smithi042 ceph-mon[34481]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:51:03.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:03 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:51:03.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:03 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:03.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:03 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:03.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:03 smithi001 ceph-mon[31211]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:51:03.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:03 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:51:03.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:03 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:03.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:03 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:04.602 INFO:journalctl@ceph.osd.4.smithi042.stdout:Sep 21 00:51:04 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-4[44832]: 2024-09-21T00:51:04.531+0000 7f7a57f8d640 -1 osd.4 0 log_to_monitors true 2024-09-21T00:51:05.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:05 smithi193 ceph-mon[34660]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:51:05.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:05 smithi193 ceph-mon[34660]: from='osd.4 [v2:172.21.15.42:6808/2066388104,v1:172.21.15.42:6809/2066388104]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T00:51:05.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:05 smithi193 ceph-mon[34660]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T00:51:05.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:05 smithi042 ceph-mon[34481]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:51:05.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:05 smithi042 ceph-mon[34481]: from='osd.4 [v2:172.21.15.42:6808/2066388104,v1:172.21.15.42:6809/2066388104]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T00:51:05.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:05 smithi042 ceph-mon[34481]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T00:51:05.830 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-21T00:51:05.859 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi193:vg_nvme/lv_3 2024-09-21T00:51:05.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:05 smithi001 ceph-mon[31211]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:51:05.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:05 smithi001 ceph-mon[31211]: from='osd.4 [v2:172.21.15.42:6808/2066388104,v1:172.21.15.42:6809/2066388104]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T00:51:05.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:05 smithi001 ceph-mon[31211]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T00:51:06.111 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:51:06.540 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:06 smithi193 ceph-mon[34660]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T00:51:06.540 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:06 smithi193 ceph-mon[34660]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T00:51:06.540 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:06 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:51:06.540 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:06 smithi193 ceph-mon[34660]: from='osd.4 [v2:172.21.15.42:6808/2066388104,v1:172.21.15.42:6809/2066388104]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T00:51:06.540 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:06 smithi193 ceph-mon[34660]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T00:51:06.540 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:06 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:06.540 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:06 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:06.540 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:06 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T00:51:06.540 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:06 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T00:51:06.540 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:06 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:06.540 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:06 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:06.541 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:06 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:51:06.541 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:06 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:06.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.631+0000 7f09c1b5a640 1 -- 172.21.15.193:0/3371344389 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09bc1040b0 msgr2=0x7f09bc10aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:51:06.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.631+0000 7f09c1b5a640 1 --2- 172.21.15.193:0/3371344389 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09bc1040b0 0x7f09bc10aa50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f09b4009ca0 tx=0x7f09b402a950 comp rx=0 tx=0).stop 2024-09-21T00:51:06.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.631+0000 7f09c1b5a640 1 -- 172.21.15.193:0/3371344389 shutdown_connections 2024-09-21T00:51:06.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.631+0000 7f09c1b5a640 1 --2- 172.21.15.193:0/3371344389 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09bc1040b0 0x7f09bc10aa50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:06.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.631+0000 7f09c1b5a640 1 --2- 172.21.15.193:0/3371344389 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f09bc103710 0x7f09bc103b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:06.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.631+0000 7f09c1b5a640 1 --2- 172.21.15.193:0/3371344389 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09bc102680 0x7f09bc102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:06.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.631+0000 7f09c1b5a640 1 -- 172.21.15.193:0/3371344389 >> 172.21.15.193:0/3371344389 conn(0x7f09bc0fdff0 msgr2=0x7f09bc1004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:51:06.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.631+0000 7f09c1b5a640 1 -- 172.21.15.193:0/3371344389 shutdown_connections 2024-09-21T00:51:06.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.631+0000 7f09c1b5a640 1 -- 172.21.15.193:0/3371344389 wait complete. 2024-09-21T00:51:06.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.631+0000 7f09c1b5a640 1 Processor -- start 2024-09-21T00:51:06.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.632+0000 7f09c1b5a640 1 -- start start 2024-09-21T00:51:06.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.632+0000 7f09c1b5a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09bc102680 0x7f09bc10cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:51:06.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.632+0000 7f09c1b5a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f09bc103710 0x7f09bc10b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:51:06.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.632+0000 7f09c1b5a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09bc1040b0 0x7f09bc10bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:51:06.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.632+0000 7f09c1b5a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f09bc10f3f0 con 0x7f09bc1040b0 2024-09-21T00:51:06.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.632+0000 7f09c1b5a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f09bc10f270 con 0x7f09bc103710 2024-09-21T00:51:06.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.632+0000 7f09c1b5a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f09bc10f570 con 0x7f09bc102680 2024-09-21T00:51:06.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.632+0000 7f09bb7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09bc102680 0x7f09bc10cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:51:06.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.632+0000 7f09bb7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09bc102680 0x7f09bc10cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.193:59930/0 (socket says 172.21.15.193:59930) 2024-09-21T00:51:06.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.632+0000 7f09bb7fe640 1 -- 172.21.15.193:0/4228618407 learned_addr learned my addr 172.21.15.193:0/4228618407 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-21T00:51:06.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.632+0000 7f09baffd640 1 --2- 172.21.15.193:0/4228618407 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f09bc103710 0x7f09bc10b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:51:06.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.632+0000 7f09bbfff640 1 --2- 172.21.15.193:0/4228618407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09bc1040b0 0x7f09bc10bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:51:06.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.632+0000 7f09bb7fe640 1 -- 172.21.15.193:0/4228618407 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f09bc103710 msgr2=0x7f09bc10b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:51:06.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.632+0000 7f09bb7fe640 1 --2- 172.21.15.193:0/4228618407 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f09bc103710 0x7f09bc10b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:06.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.632+0000 7f09bb7fe640 1 -- 172.21.15.193:0/4228618407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09bc1040b0 msgr2=0x7f09bc10bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:51:06.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.632+0000 7f09bb7fe640 1 --2- 172.21.15.193:0/4228618407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09bc1040b0 0x7f09bc10bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:06.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.632+0000 7f09bb7fe640 1 -- 172.21.15.193:0/4228618407 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09bc10c2d0 con 0x7f09bc102680 2024-09-21T00:51:06.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.632+0000 7f09bbfff640 1 --2- 172.21.15.193:0/4228618407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09bc1040b0 0x7f09bc10bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:51:06.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.632+0000 7f09bb7fe640 1 --2- 172.21.15.193:0/4228618407 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09bc102680 0x7f09bc10cdc0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f09ac00e9f0 tx=0x7f09ac00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:51:06.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.633+0000 7f09b8ff9640 1 -- 172.21.15.193:0/4228618407 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ac00cd80 con 0x7f09bc102680 2024-09-21T00:51:06.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.633+0000 7f09b8ff9640 1 -- 172.21.15.193:0/4228618407 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09ac0108e0 con 0x7f09bc102680 2024-09-21T00:51:06.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.633+0000 7f09c1b5a640 1 -- 172.21.15.193:0/4228618407 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09bc1a3ff0 con 0x7f09bc102680 2024-09-21T00:51:06.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.633+0000 7f09b8ff9640 1 -- 172.21.15.193:0/4228618407 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ac018980 con 0x7f09bc102680 2024-09-21T00:51:06.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.633+0000 7f09c1b5a640 1 -- 172.21.15.193:0/4228618407 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09bc1a4390 con 0x7f09bc102680 2024-09-21T00:51:06.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.634+0000 7f09c1b5a640 1 -- 172.21.15.193:0/4228618407 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09bc109860 con 0x7f09bc102680 2024-09-21T00:51:06.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.635+0000 7f09b8ff9640 1 -- 172.21.15.193:0/4228618407 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 16) ==== 154511+0+0 (secure 0 0 0) 0x7f09ac010430 con 0x7f09bc102680 2024-09-21T00:51:06.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.636+0000 7f09b8ff9640 1 --2- 172.21.15.193:0/4228618407 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f09a80b6510 0x7f09a80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:51:06.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.636+0000 7f09b8ff9640 1 -- 172.21.15.193:0/4228618407 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3821+0+0 (secure 0 0 0) 0x7f09ac0e6970 con 0x7f09bc102680 2024-09-21T00:51:06.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.636+0000 7f09baffd640 1 --2- 172.21.15.193:0/4228618407 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f09a80b6510 0x7f09a80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:51:06.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.637+0000 7f09baffd640 1 --2- 172.21.15.193:0/4228618407 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f09a80b6510 0x7f09a80b8a20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f09a4009bd0 tx=0x7f09a4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:51:06.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.639+0000 7f09b8ff9640 1 -- 172.21.15.193:0/4228618407 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f09ac0ae390 con 0x7f09bc102680 2024-09-21T00:51:06.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:06 smithi042 ceph-mon[34481]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T00:51:06.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:06 smithi042 ceph-mon[34481]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T00:51:06.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:06 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:51:06.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:06 smithi042 ceph-mon[34481]: from='osd.4 [v2:172.21.15.42:6808/2066388104,v1:172.21.15.42:6809/2066388104]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T00:51:06.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:06 smithi042 ceph-mon[34481]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T00:51:06.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:06 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:06.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:06 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:06.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:06 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T00:51:06.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:06 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T00:51:06.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:06 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:06.744 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:06 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:06.744 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:06 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:51:06.744 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:06 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:06.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:06.825+0000 7f09c1b5a640 1 -- 172.21.15.193:0/4228618407 --> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f09bc063800 con 0x7f09a80b6510 2024-09-21T00:51:06.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:06 smithi001 ceph-mon[31211]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T00:51:06.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:06 smithi001 ceph-mon[31211]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T00:51:06.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:06 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:51:06.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:06 smithi001 ceph-mon[31211]: from='osd.4 [v2:172.21.15.42:6808/2066388104,v1:172.21.15.42:6809/2066388104]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T00:51:06.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:06 smithi001 ceph-mon[31211]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T00:51:06.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:06 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:06.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:06 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:06.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:06 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T00:51:06.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:06 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T00:51:06.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:06 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:06.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:06 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:06.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:06 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:51:06.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:06 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:07.242 INFO:journalctl@ceph.osd.4.smithi042.stdout:Sep 21 00:51:06 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-4[44832]: 2024-09-21T00:51:06.929+0000 7f7a53f0f640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T00:51:07.242 INFO:journalctl@ceph.osd.4.smithi042.stdout:Sep 21 00:51:06 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-4[44832]: 2024-09-21T00:51:06.935+0000 7f7a4bd05640 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:51:07.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:07 smithi042 ceph-mon[34481]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:51:07.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:07 smithi042 ceph-mon[34481]: Detected new or changed devices on smithi042 2024-09-21T00:51:07.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:07 smithi042 ceph-mon[34481]: Adjusting osd_memory_target on smithi042 to 8546M 2024-09-21T00:51:07.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:07 smithi042 ceph-mon[34481]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-21T00:51:07.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:07 smithi042 ceph-mon[34481]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T00:51:07.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:07 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:51:07.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:07 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:51:07.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:07 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:51:07.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:07 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:51:07.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:07 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:07.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:07 smithi042 ceph-mon[34481]: from='osd.4 ' entity='osd.4' 2024-09-21T00:51:07.903 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:07 smithi193 ceph-mon[34660]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:51:07.904 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:07 smithi193 ceph-mon[34660]: Detected new or changed devices on smithi042 2024-09-21T00:51:07.904 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:07 smithi193 ceph-mon[34660]: Adjusting osd_memory_target on smithi042 to 8546M 2024-09-21T00:51:07.904 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:07 smithi193 ceph-mon[34660]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-21T00:51:07.904 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:07 smithi193 ceph-mon[34660]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T00:51:07.904 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:07 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:51:07.904 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:07 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:51:07.904 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:07 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:51:07.904 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:07 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:51:07.904 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:07 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:07.904 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:07 smithi193 ceph-mon[34660]: from='osd.4 ' entity='osd.4' 2024-09-21T00:51:07.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:07 smithi001 ceph-mon[31211]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:51:07.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:07 smithi001 ceph-mon[31211]: Detected new or changed devices on smithi042 2024-09-21T00:51:07.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:07 smithi001 ceph-mon[31211]: Adjusting osd_memory_target on smithi042 to 8546M 2024-09-21T00:51:07.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:07 smithi001 ceph-mon[31211]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-21T00:51:07.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:07 smithi001 ceph-mon[31211]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T00:51:07.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:07 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:51:07.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:07 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:51:07.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:07 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:51:07.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:07 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:51:07.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:07 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:07.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:07 smithi001 ceph-mon[31211]: from='osd.4 ' entity='osd.4' 2024-09-21T00:51:08.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:08 smithi193 ceph-mon[34660]: purged_snaps scrub starts 2024-09-21T00:51:08.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:08 smithi193 ceph-mon[34660]: purged_snaps scrub ok 2024-09-21T00:51:08.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:08 smithi193 ceph-mon[34660]: from='client.24370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:08.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:08 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:51:08.731 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:08 smithi193 ceph-mon[34660]: osd.4 [v2:172.21.15.42:6808/2066388104,v1:172.21.15.42:6809/2066388104] boot 2024-09-21T00:51:08.731 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:08 smithi193 ceph-mon[34660]: osdmap e30: 5 total, 5 up, 5 in 2024-09-21T00:51:08.731 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:08 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:51:08.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:08 smithi042 ceph-mon[34481]: purged_snaps scrub starts 2024-09-21T00:51:08.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:08 smithi042 ceph-mon[34481]: purged_snaps scrub ok 2024-09-21T00:51:08.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:08 smithi042 ceph-mon[34481]: from='client.24370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:08.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:08 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:51:08.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:08 smithi042 ceph-mon[34481]: osd.4 [v2:172.21.15.42:6808/2066388104,v1:172.21.15.42:6809/2066388104] boot 2024-09-21T00:51:08.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:08 smithi042 ceph-mon[34481]: osdmap e30: 5 total, 5 up, 5 in 2024-09-21T00:51:08.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:08 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:51:08.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:08 smithi001 ceph-mon[31211]: purged_snaps scrub starts 2024-09-21T00:51:08.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:08 smithi001 ceph-mon[31211]: purged_snaps scrub ok 2024-09-21T00:51:08.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:08 smithi001 ceph-mon[31211]: from='client.24370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:08.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:08 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:51:08.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:08 smithi001 ceph-mon[31211]: osd.4 [v2:172.21.15.42:6808/2066388104,v1:172.21.15.42:6809/2066388104] boot 2024-09-21T00:51:08.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:08 smithi001 ceph-mon[31211]: osdmap e30: 5 total, 5 up, 5 in 2024-09-21T00:51:08.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:08 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:51:09.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:09 smithi042 ceph-mon[34481]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:51:09.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:09 smithi042 ceph-mon[34481]: from='client.? 172.21.15.193:0/60856987' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "96701ced-a55a-4ad9-be62-7f102c00697d"} : dispatch 2024-09-21T00:51:09.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:09 smithi042 ceph-mon[34481]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "96701ced-a55a-4ad9-be62-7f102c00697d"} : dispatch 2024-09-21T00:51:09.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:09 smithi042 ceph-mon[34481]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "96701ced-a55a-4ad9-be62-7f102c00697d"}]': finished 2024-09-21T00:51:09.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:09 smithi042 ceph-mon[34481]: osdmap e31: 6 total, 5 up, 6 in 2024-09-21T00:51:09.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:09 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:51:09.769 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:09 smithi193 ceph-mon[34660]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:51:09.769 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:09 smithi193 ceph-mon[34660]: from='client.? 172.21.15.193:0/60856987' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "96701ced-a55a-4ad9-be62-7f102c00697d"} : dispatch 2024-09-21T00:51:09.769 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:09 smithi193 ceph-mon[34660]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "96701ced-a55a-4ad9-be62-7f102c00697d"} : dispatch 2024-09-21T00:51:09.769 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:09 smithi193 ceph-mon[34660]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "96701ced-a55a-4ad9-be62-7f102c00697d"}]': finished 2024-09-21T00:51:09.769 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:09 smithi193 ceph-mon[34660]: osdmap e31: 6 total, 5 up, 6 in 2024-09-21T00:51:09.770 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:09 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:51:09.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:09 smithi001 ceph-mon[31211]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:51:09.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:09 smithi001 ceph-mon[31211]: from='client.? 172.21.15.193:0/60856987' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "96701ced-a55a-4ad9-be62-7f102c00697d"} : dispatch 2024-09-21T00:51:09.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:09 smithi001 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "96701ced-a55a-4ad9-be62-7f102c00697d"} : dispatch 2024-09-21T00:51:09.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:09 smithi001 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "96701ced-a55a-4ad9-be62-7f102c00697d"}]': finished 2024-09-21T00:51:09.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:09 smithi001 ceph-mon[31211]: osdmap e31: 6 total, 5 up, 6 in 2024-09-21T00:51:09.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:09 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:51:10.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:10 smithi042 ceph-mon[34481]: from='client.? 172.21.15.193:0/2647262332' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:51:10.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:10 smithi001 ceph-mon[31211]: from='client.? 172.21.15.193:0/2647262332' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:51:10.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:10 smithi193 ceph-mon[34660]: from='client.? 172.21.15.193:0/2647262332' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:51:11.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:11 smithi042 ceph-mon[34481]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:51:11.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:11 smithi001 ceph-mon[31211]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:51:11.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:11 smithi193 ceph-mon[34660]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:51:13.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:13 smithi001 ceph-mon[31211]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:51:13.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:13 smithi193 ceph-mon[34660]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:51:13.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:13 smithi042 ceph-mon[34481]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:51:15.698 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:15 smithi193 ceph-mon[34660]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:51:15.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:15 smithi001 ceph-mon[31211]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:51:15.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:15 smithi042 ceph-mon[34481]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:51:17.651 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:17 smithi193 ceph-mon[34660]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:51:17.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:17 smithi001 ceph-mon[31211]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:51:17.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:17 smithi042 ceph-mon[34481]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:51:18.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:18 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T00:51:18.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:18 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:18.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:18 smithi193 ceph-mon[34660]: Deploying daemon osd.5 on smithi193 2024-09-21T00:51:18.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:18 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T00:51:18.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:18 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:18.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:18 smithi001 ceph-mon[31211]: Deploying daemon osd.5 on smithi193 2024-09-21T00:51:18.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:18 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T00:51:18.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:18 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:18.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:18 smithi042 ceph-mon[34481]: Deploying daemon osd.5 on smithi193 2024-09-21T00:51:19.645 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:19 smithi193 ceph-mon[34660]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:51:19.861 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:19 smithi001 ceph-mon[31211]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:51:19.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:19 smithi042 ceph-mon[34481]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:51:21.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:21 smithi193 ceph-mon[34660]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:51:21.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:21 smithi001 ceph-mon[31211]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:51:21.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:21 smithi042 ceph-mon[34481]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:51:23.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:23 smithi193 ceph-mon[34660]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:51:23.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:23 smithi001 ceph-mon[31211]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:51:23.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:23 smithi042 ceph-mon[34481]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:51:24.671 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:24 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:51:24.671 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:24 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:24.671 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:24 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:24.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:24 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:51:24.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:24 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:24.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:24 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:24.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:24 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:51:24.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:24 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:24.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:24 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:25.870 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:25 smithi193 ceph-mon[34660]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:51:25.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:25 smithi001 ceph-mon[31211]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:51:25.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:25 smithi042 ceph-mon[34481]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:51:27.676 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:27 smithi193 ceph-mon[34660]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:51:27.676 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:27 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:27.676 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:27 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:27.676 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:27 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:27.676 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:27 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:51:27.676 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:27 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:27.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:27 smithi001 ceph-mon[31211]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:51:27.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:27 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:27.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:27 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:27.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:27 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:27.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:27 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:51:27.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:27 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:27.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:27 smithi042 ceph-mon[34481]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:51:27.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:27 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:27.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:27 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:27.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:27 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:27.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:27 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:51:27.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:27 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:28.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:28.028+0000 7f09b8ff9640 1 -- 172.21.15.193:0/4228618407 <== mgr.14150 v2:172.21.15.1:6800/2032980330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f09bc063800 con 0x7f09a80b6510 2024-09-21T00:51:28.029 INFO:teuthology.orchestra.run.smithi193.stdout:Created osd(s) 5 on host 'smithi193' 2024-09-21T00:51:28.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:28.030+0000 7f09c1b5a640 1 -- 172.21.15.193:0/4228618407 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f09a80b6510 msgr2=0x7f09a80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:51:28.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:28.030+0000 7f09c1b5a640 1 --2- 172.21.15.193:0/4228618407 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f09a80b6510 0x7f09a80b8a20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f09a4009bd0 tx=0x7f09a4005f90 comp rx=0 tx=0).stop 2024-09-21T00:51:28.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:28.030+0000 7f09c1b5a640 1 -- 172.21.15.193:0/4228618407 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09bc102680 msgr2=0x7f09bc10cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:51:28.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:28.030+0000 7f09c1b5a640 1 --2- 172.21.15.193:0/4228618407 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09bc102680 0x7f09bc10cdc0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f09ac00e9f0 tx=0x7f09ac00eeb0 comp rx=0 tx=0).stop 2024-09-21T00:51:28.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:28.030+0000 7f09c1b5a640 1 -- 172.21.15.193:0/4228618407 shutdown_connections 2024-09-21T00:51:28.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:28.030+0000 7f09c1b5a640 1 --2- 172.21.15.193:0/4228618407 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f09a80b6510 0x7f09a80b8a20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:28.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:28.030+0000 7f09c1b5a640 1 --2- 172.21.15.193:0/4228618407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09bc1040b0 0x7f09bc10bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:28.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:28.030+0000 7f09c1b5a640 1 --2- 172.21.15.193:0/4228618407 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f09bc103710 0x7f09bc10b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:28.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:28.030+0000 7f09c1b5a640 1 --2- 172.21.15.193:0/4228618407 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09bc102680 0x7f09bc10cdc0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:28.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:28.030+0000 7f09c1b5a640 1 -- 172.21.15.193:0/4228618407 >> 172.21.15.193:0/4228618407 conn(0x7f09bc0fdff0 msgr2=0x7f09bc106a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:51:28.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:28.030+0000 7f09c1b5a640 1 -- 172.21.15.193:0/4228618407 shutdown_connections 2024-09-21T00:51:28.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:51:28.030+0000 7f09c1b5a640 1 -- 172.21.15.193:0/4228618407 wait complete. 2024-09-21T00:51:28.658 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:28 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:51:28.658 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:28 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:28.659 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:28 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:28.660 DEBUG:teuthology.orchestra.run.smithi193:osd.5> sudo journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@osd.5.service 2024-09-21T00:51:28.662 INFO:tasks.cephadm:Deploying osd.6 on smithi001 with /dev/vg_nvme/lv_2... 2024-09-21T00:51:28.662 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T00:51:28.691 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:28 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:51:28.691 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:28 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:28.691 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:28 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:28.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:28 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:51:28.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:28 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:28.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:28 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:28.931 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:51:29.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:29 smithi001 ceph-mon[31211]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:51:29.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:29 smithi193 ceph-mon[34660]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:51:29.730 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 00:51:29 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T00:51:29.596+0000 7f4331cc3640 -1 osd.5 0 log_to_monitors true 2024-09-21T00:51:29.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:29 smithi042 ceph-mon[34481]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:51:30.668 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:30 smithi001 ceph-mon[31211]: from='osd.5 [v2:172.21.15.193:6808/732336675,v1:172.21.15.193:6809/732336675]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T00:51:30.669 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:30 smithi001 ceph-mon[31211]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T00:51:30.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:30 smithi193 ceph-mon[34660]: from='osd.5 [v2:172.21.15.193:6808/732336675,v1:172.21.15.193:6809/732336675]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T00:51:30.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:30 smithi193 ceph-mon[34660]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T00:51:30.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:30 smithi042 ceph-mon[34481]: from='osd.5 [v2:172.21.15.193:6808/732336675,v1:172.21.15.193:6809/732336675]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T00:51:30.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:30 smithi042 ceph-mon[34481]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T00:51:31.698 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:31 smithi001 ceph-mon[31211]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:51:31.698 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:31 smithi001 ceph-mon[31211]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T00:51:31.698 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:31 smithi001 ceph-mon[31211]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T00:51:31.698 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:31 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:51:31.698 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:31 smithi001 ceph-mon[31211]: from='osd.5 [v2:172.21.15.193:6808/732336675,v1:172.21.15.193:6809/732336675]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]} : dispatch 2024-09-21T00:51:31.698 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:31 smithi001 ceph-mon[31211]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]} : dispatch 2024-09-21T00:51:31.729 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 00:51:31 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T00:51:31.419+0000 7f432dc45640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T00:51:31.730 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 00:51:31 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T00:51:31.425+0000 7f4329a43640 -1 osd.5 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:51:31.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:31 smithi193 ceph-mon[34660]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:51:31.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:31 smithi193 ceph-mon[34660]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T00:51:31.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:31 smithi193 ceph-mon[34660]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T00:51:31.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:31 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:51:31.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:31 smithi193 ceph-mon[34660]: from='osd.5 [v2:172.21.15.193:6808/732336675,v1:172.21.15.193:6809/732336675]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]} : dispatch 2024-09-21T00:51:31.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:31 smithi193 ceph-mon[34660]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]} : dispatch 2024-09-21T00:51:31.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:31 smithi042 ceph-mon[34481]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:51:31.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:31 smithi042 ceph-mon[34481]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T00:51:31.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:31 smithi042 ceph-mon[34481]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T00:51:31.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:31 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:51:31.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:31 smithi042 ceph-mon[34481]: from='osd.5 [v2:172.21.15.193:6808/732336675,v1:172.21.15.193:6809/732336675]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]} : dispatch 2024-09-21T00:51:31.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:31 smithi042 ceph-mon[34481]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]} : dispatch 2024-09-21T00:51:31.888 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:51:31.914 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi001:vg_nvme/lv_2 2024-09-21T00:51:32.214 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:51:32.622 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:32 smithi001 ceph-mon[31211]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-21T00:51:32.622 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:32 smithi001 ceph-mon[31211]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T00:51:32.622 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:32 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:51:32.622 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:32 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:51:32.622 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:32 smithi001 ceph-mon[31211]: Detected new or changed devices on smithi193 2024-09-21T00:51:32.622 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:32 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:32.622 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:32 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:32.622 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:32 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T00:51:32.622 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:32 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T00:51:32.623 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:32 smithi001 ceph-mon[31211]: Adjusting osd_memory_target on smithi193 to 8544M 2024-09-21T00:51:32.623 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:32 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:32.623 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:32 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:32.623 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:32 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:51:32.623 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:32 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:32.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:32 smithi193 ceph-mon[34660]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-21T00:51:32.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:32 smithi193 ceph-mon[34660]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T00:51:32.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:32 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:51:32.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:32 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:51:32.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:32 smithi193 ceph-mon[34660]: Detected new or changed devices on smithi193 2024-09-21T00:51:32.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:32 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:32.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:32 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:32.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:32 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T00:51:32.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:32 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T00:51:32.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:32 smithi193 ceph-mon[34660]: Adjusting osd_memory_target on smithi193 to 8544M 2024-09-21T00:51:32.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:32 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:32.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:32 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:32.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:32 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:51:32.731 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:32 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:32.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.718+0000 7fbafc4fd640 1 -- 172.21.15.1:0/4053348882 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbaf406b900 msgr2=0x7fbaf4106410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:51:32.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.718+0000 7fbafc4fd640 1 --2- 172.21.15.1:0/4053348882 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbaf406b900 0x7fbaf4106410 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0009900 tx=0x7fbaf002a410 comp rx=0 tx=0).stop 2024-09-21T00:51:32.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.718+0000 7fbafc4fd640 1 -- 172.21.15.1:0/4053348882 shutdown_connections 2024-09-21T00:51:32.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.718+0000 7fbafc4fd640 1 --2- 172.21.15.1:0/4053348882 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbaf4109490 0x7fbaf410b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:32.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.718+0000 7fbafc4fd640 1 --2- 172.21.15.1:0/4053348882 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbaf4106950 0x7fbaf4108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:32.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.718+0000 7fbafc4fd640 1 --2- 172.21.15.1:0/4053348882 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbaf406b900 0x7fbaf4106410 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:32.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.718+0000 7fbafc4fd640 1 -- 172.21.15.1:0/4053348882 >> 172.21.15.1:0/4053348882 conn(0x7fbaf40fdfb0 msgr2=0x7fbaf4100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:51:32.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.718+0000 7fbafc4fd640 1 -- 172.21.15.1:0/4053348882 shutdown_connections 2024-09-21T00:51:32.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.718+0000 7fbafc4fd640 1 -- 172.21.15.1:0/4053348882 wait complete. 2024-09-21T00:51:32.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.719+0000 7fbafc4fd640 1 Processor -- start 2024-09-21T00:51:32.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.719+0000 7fbafc4fd640 1 -- start start 2024-09-21T00:51:32.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.719+0000 7fbafc4fd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbaf406b900 0x7fbaf4103a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:51:32.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.719+0000 7fbafc4fd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbaf4106950 0x7fbaf4102310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:51:32.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.719+0000 7fbafc4fd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbaf4109490 0x7fbaf4102850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:51:32.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.719+0000 7fbafc4fd640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf410f370 con 0x7fbaf406b900 2024-09-21T00:51:32.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.719+0000 7fbafc4fd640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf410f1f0 con 0x7fbaf4106950 2024-09-21T00:51:32.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.719+0000 7fbafc4fd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf410f4f0 con 0x7fbaf4109490 2024-09-21T00:51:32.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.719+0000 7fbafa299640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbaf406b900 0x7fbaf4103a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:51:32.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.719+0000 7fbafa299640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbaf406b900 0x7fbaf4103a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49962/0 (socket says 172.21.15.1:49962) 2024-09-21T00:51:32.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.719+0000 7fbafa299640 1 -- 172.21.15.1:0/1949153105 learned_addr learned my addr 172.21.15.1:0/1949153105 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:51:32.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.720+0000 7fbafaa9a640 1 --2- 172.21.15.1:0/1949153105 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbaf4109490 0x7fbaf4102850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:51:32.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.720+0000 7fbaf9a98640 1 --2- 172.21.15.1:0/1949153105 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbaf4106950 0x7fbaf4102310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:51:32.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.720+0000 7fbafa299640 1 -- 172.21.15.1:0/1949153105 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbaf4109490 msgr2=0x7fbaf4102850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:51:32.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.720+0000 7fbafa299640 1 --2- 172.21.15.1:0/1949153105 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbaf4109490 0x7fbaf4102850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:32.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.720+0000 7fbafa299640 1 -- 172.21.15.1:0/1949153105 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbaf4106950 msgr2=0x7fbaf4102310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:51:32.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.720+0000 7fbafa299640 1 --2- 172.21.15.1:0/1949153105 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbaf4106950 0x7fbaf4102310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:32.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.720+0000 7fbafa299640 1 -- 172.21.15.1:0/1949153105 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf4102f50 con 0x7fbaf406b900 2024-09-21T00:51:32.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.720+0000 7fbaf9a98640 1 --2- 172.21.15.1:0/1949153105 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbaf4106950 0x7fbaf4102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:51:32.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.720+0000 7fbafa299640 1 --2- 172.21.15.1:0/1949153105 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbaf406b900 0x7fbaf4103a40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0006010 tx=0x7fbaf0004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:51:32.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.720+0000 7fbae77fe640 1 -- 172.21.15.1:0/1949153105 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf003f030 con 0x7fbaf406b900 2024-09-21T00:51:32.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.720+0000 7fbae77fe640 1 -- 172.21.15.1:0/1949153105 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbaf0003cb0 con 0x7fbaf406b900 2024-09-21T00:51:32.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.720+0000 7fbae77fe640 1 -- 172.21.15.1:0/1949153105 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf0035070 con 0x7fbaf406b900 2024-09-21T00:51:32.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.720+0000 7fbafc4fd640 1 -- 172.21.15.1:0/1949153105 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaf41a4020 con 0x7fbaf406b900 2024-09-21T00:51:32.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.720+0000 7fbafc4fd640 1 -- 172.21.15.1:0/1949153105 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaf41a4410 con 0x7fbaf406b900 2024-09-21T00:51:32.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.721+0000 7fbafc4fd640 1 -- 172.21.15.1:0/1949153105 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaf4106d60 con 0x7fbaf406b900 2024-09-21T00:51:32.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.723+0000 7fbae77fe640 1 -- 172.21.15.1:0/1949153105 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 154511+0+0 (secure 0 0 0) 0x7fbaf0042030 con 0x7fbaf406b900 2024-09-21T00:51:32.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.724+0000 7fbae77fe640 1 --2- 172.21.15.1:0/1949153105 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fbae00b6590 0x7fbae00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:51:32.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.724+0000 7fbaf9a98640 1 --2- 172.21.15.1:0/1949153105 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fbae00b6590 0x7fbae00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:51:32.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.724+0000 7fbae77fe640 1 -- 172.21.15.1:0/1949153105 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4566+0+0 (secure 0 0 0) 0x7fbaf01072a0 con 0x7fbaf406b900 2024-09-21T00:51:32.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.724+0000 7fbaf9a98640 1 --2- 172.21.15.1:0/1949153105 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fbae00b6590 0x7fbae00b8aa0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbae8005d00 tx=0x7fbae8005ed0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:51:32.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.727+0000 7fbae77fe640 1 -- 172.21.15.1:0/1949153105 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbaf00ce930 con 0x7fbaf406b900 2024-09-21T00:51:32.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:32 smithi042 ceph-mon[34481]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-21T00:51:32.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:32 smithi042 ceph-mon[34481]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T00:51:32.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:32 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:51:32.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:32 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:51:32.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:32 smithi042 ceph-mon[34481]: Detected new or changed devices on smithi193 2024-09-21T00:51:32.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:32 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:32.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:32 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:32.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:32 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T00:51:32.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:32 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T00:51:32.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:32 smithi042 ceph-mon[34481]: Adjusting osd_memory_target on smithi193 to 8544M 2024-09-21T00:51:32.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:32 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:32.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:32 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:32.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:32 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:51:32.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:32 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:32.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:32.924+0000 7fbafc4fd640 1 -- 172.21.15.1:0/1949153105 --> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fbaf4063800 con 0x7fbae00b6590 2024-09-21T00:51:33.617 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:33 smithi001 ceph-mon[31211]: purged_snaps scrub starts 2024-09-21T00:51:33.617 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:33 smithi001 ceph-mon[31211]: purged_snaps scrub ok 2024-09-21T00:51:33.617 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:33 smithi001 ceph-mon[31211]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:51:33.617 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:33 smithi001 ceph-mon[31211]: osd.5 [v2:172.21.15.193:6808/732336675,v1:172.21.15.193:6809/732336675] boot 2024-09-21T00:51:33.617 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:33 smithi001 ceph-mon[31211]: osdmap e34: 6 total, 6 up, 6 in 2024-09-21T00:51:33.617 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:33 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:51:33.617 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:33 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:51:33.617 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:33 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:51:33.617 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:33 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:33.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:33 smithi193 ceph-mon[34660]: purged_snaps scrub starts 2024-09-21T00:51:33.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:33 smithi193 ceph-mon[34660]: purged_snaps scrub ok 2024-09-21T00:51:33.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:33 smithi193 ceph-mon[34660]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:51:33.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:33 smithi193 ceph-mon[34660]: osd.5 [v2:172.21.15.193:6808/732336675,v1:172.21.15.193:6809/732336675] boot 2024-09-21T00:51:33.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:33 smithi193 ceph-mon[34660]: osdmap e34: 6 total, 6 up, 6 in 2024-09-21T00:51:33.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:33 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:51:33.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:33 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:51:33.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:33 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:51:33.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:33 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:33.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:33 smithi042 ceph-mon[34481]: purged_snaps scrub starts 2024-09-21T00:51:33.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:33 smithi042 ceph-mon[34481]: purged_snaps scrub ok 2024-09-21T00:51:33.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:33 smithi042 ceph-mon[34481]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:51:33.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:33 smithi042 ceph-mon[34481]: osd.5 [v2:172.21.15.193:6808/732336675,v1:172.21.15.193:6809/732336675] boot 2024-09-21T00:51:33.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:33 smithi042 ceph-mon[34481]: osdmap e34: 6 total, 6 up, 6 in 2024-09-21T00:51:33.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:33 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:51:33.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:33 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:51:33.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:33 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:51:33.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:33 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:34.699 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:34 smithi001 ceph-mon[31211]: from='client.14541 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:34.699 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:34 smithi001 ceph-mon[31211]: osdmap e35: 6 total, 6 up, 6 in 2024-09-21T00:51:34.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:34 smithi193 ceph-mon[34660]: from='client.14541 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:34.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:34 smithi193 ceph-mon[34660]: osdmap e35: 6 total, 6 up, 6 in 2024-09-21T00:51:34.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:34 smithi042 ceph-mon[34481]: from='client.14541 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:34.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:34 smithi042 ceph-mon[34481]: osdmap e35: 6 total, 6 up, 6 in 2024-09-21T00:51:35.706 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:35 smithi001 ceph-mon[31211]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:51:35.706 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:35 smithi001 ceph-mon[31211]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T00:51:35.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:35 smithi193 ceph-mon[34660]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:51:35.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:35 smithi193 ceph-mon[34660]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T00:51:35.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:35 smithi042 ceph-mon[34481]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:51:35.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:35 smithi042 ceph-mon[34481]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T00:51:36.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:36 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/337552770' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "72d76017-e2e3-4118-8316-2c5da01c87b9"} : dispatch 2024-09-21T00:51:36.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:36 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/337552770' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72d76017-e2e3-4118-8316-2c5da01c87b9"}]': finished 2024-09-21T00:51:36.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:36 smithi001 ceph-mon[31211]: osdmap e37: 7 total, 6 up, 7 in 2024-09-21T00:51:36.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:36 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:51:36.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:36 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/129477165' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:51:36.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:36 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/337552770' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "72d76017-e2e3-4118-8316-2c5da01c87b9"} : dispatch 2024-09-21T00:51:36.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:36 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/337552770' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72d76017-e2e3-4118-8316-2c5da01c87b9"}]': finished 2024-09-21T00:51:36.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:36 smithi193 ceph-mon[34660]: osdmap e37: 7 total, 6 up, 7 in 2024-09-21T00:51:36.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:36 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:51:36.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:36 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/129477165' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:51:36.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:36 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/337552770' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "72d76017-e2e3-4118-8316-2c5da01c87b9"} : dispatch 2024-09-21T00:51:36.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:36 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/337552770' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72d76017-e2e3-4118-8316-2c5da01c87b9"}]': finished 2024-09-21T00:51:36.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:36 smithi042 ceph-mon[34481]: osdmap e37: 7 total, 6 up, 7 in 2024-09-21T00:51:36.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:36 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:51:36.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:36 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/129477165' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:51:37.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:37 smithi193 ceph-mon[34660]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T00:51:37.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:37 smithi042 ceph-mon[34481]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T00:51:37.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:37 smithi001 ceph-mon[31211]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T00:51:39.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:39 smithi193 ceph-mon[34660]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-09-21T00:51:39.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:39 smithi042 ceph-mon[34481]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-09-21T00:51:39.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:39 smithi001 ceph-mon[31211]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-09-21T00:51:41.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:41 smithi001 ceph-mon[31211]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-09-21T00:51:41.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:41 smithi193 ceph-mon[34660]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-09-21T00:51:41.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:41 smithi042 ceph-mon[34481]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-09-21T00:51:43.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:43 smithi193 ceph-mon[34660]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T00:51:43.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:43 smithi042 ceph-mon[34481]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T00:51:43.853 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:43 smithi001 ceph-mon[31211]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T00:51:44.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:44 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T00:51:44.729 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:44 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:44.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:44 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T00:51:44.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:44 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:44.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:44 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T00:51:44.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:44 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:45.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:45 smithi193 ceph-mon[34660]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-21T00:51:45.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:45 smithi193 ceph-mon[34660]: Deploying daemon osd.6 on smithi001 2024-09-21T00:51:45.744 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:45 smithi042 ceph-mon[34481]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-21T00:51:45.744 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:45 smithi042 ceph-mon[34481]: Deploying daemon osd.6 on smithi001 2024-09-21T00:51:45.835 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:45 smithi001 ceph-mon[31211]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-21T00:51:45.835 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:45 smithi001 ceph-mon[31211]: Deploying daemon osd.6 on smithi001 2024-09-21T00:51:47.733 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:47 smithi001 ceph-mon[31211]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:51:47.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:47 smithi042 ceph-mon[34481]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:51:47.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:47 smithi193 ceph-mon[34660]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:51:49.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:49 smithi001 ceph-mon[31211]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:51:49.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:49 smithi042 ceph-mon[34481]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:51:49.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:49 smithi193 ceph-mon[34660]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:51:50.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:50 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:51:50.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:50 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:50.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:50 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:50.759 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:50 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:51:50.759 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:50 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:50.759 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:50 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:50.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:50 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:51:50.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:50 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:50.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:50 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:51.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:51 smithi193 ceph-mon[34660]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:51:51.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:51 smithi042 ceph-mon[34481]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:51:51.782 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:51 smithi001 ceph-mon[31211]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:51:53.835 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:53 smithi001 ceph-mon[31211]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:51:53.835 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:53 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:53.835 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:53 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:53.835 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:53 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:53.835 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:53 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:51:53.835 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:53 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:53.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:53 smithi193 ceph-mon[34660]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:51:53.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:53 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:53.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:53 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:53.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:53 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:53.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:53 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:51:53.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:53 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:53.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:53 smithi042 ceph-mon[34481]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:51:53.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:53 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:53.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:53 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:53.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:53 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:53.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:53 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:51:53.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:53 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:54.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:54.266+0000 7fbae77fe640 1 -- 172.21.15.1:0/1949153105 <== mgr.14150 v2:172.21.15.1:6800/2032980330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbaf4063800 con 0x7fbae00b6590 2024-09-21T00:51:54.267 INFO:teuthology.orchestra.run.smithi001.stdout:Created osd(s) 6 on host 'smithi001' 2024-09-21T00:51:54.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:54.269+0000 7fbafc4fd640 1 -- 172.21.15.1:0/1949153105 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fbae00b6590 msgr2=0x7fbae00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:51:54.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:54.269+0000 7fbafc4fd640 1 --2- 172.21.15.1:0/1949153105 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fbae00b6590 0x7fbae00b8aa0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbae8005d00 tx=0x7fbae8005ed0 comp rx=0 tx=0).stop 2024-09-21T00:51:54.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:54.269+0000 7fbafc4fd640 1 -- 172.21.15.1:0/1949153105 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbaf406b900 msgr2=0x7fbaf4103a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:51:54.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:54.269+0000 7fbafc4fd640 1 --2- 172.21.15.1:0/1949153105 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbaf406b900 0x7fbaf4103a40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0006010 tx=0x7fbaf0004340 comp rx=0 tx=0).stop 2024-09-21T00:51:54.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:54.269+0000 7fbafc4fd640 1 -- 172.21.15.1:0/1949153105 shutdown_connections 2024-09-21T00:51:54.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:54.269+0000 7fbafc4fd640 1 --2- 172.21.15.1:0/1949153105 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbaf4109490 0x7fbaf4102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:54.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:54.269+0000 7fbafc4fd640 1 --2- 172.21.15.1:0/1949153105 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbaf4106950 0x7fbaf4102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:54.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:54.269+0000 7fbafc4fd640 1 --2- 172.21.15.1:0/1949153105 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fbae00b6590 0x7fbae00b8aa0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:54.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:54.269+0000 7fbafc4fd640 1 --2- 172.21.15.1:0/1949153105 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbaf406b900 0x7fbaf4103a40 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:54.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:54.269+0000 7fbafc4fd640 1 -- 172.21.15.1:0/1949153105 >> 172.21.15.1:0/1949153105 conn(0x7fbaf40fdfb0 msgr2=0x7fbaf4104ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:51:54.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:54.269+0000 7fbafc4fd640 1 -- 172.21.15.1:0/1949153105 shutdown_connections 2024-09-21T00:51:54.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:51:54.269+0000 7fbafc4fd640 1 -- 172.21.15.1:0/1949153105 wait complete. 2024-09-21T00:51:54.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:54 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:51:54.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:54 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:54.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:54 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:54.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:54 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:51:54.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:54 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:54.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:54 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:54.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:54 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:51:54.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:54 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:54.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:54 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:55.038 DEBUG:teuthology.orchestra.run.smithi001:osd.6> sudo journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@osd.6.service 2024-09-21T00:51:55.040 INFO:tasks.cephadm:Deploying osd.7 on smithi042 with /dev/vg_nvme/lv_2... 2024-09-21T00:51:55.040 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T00:51:55.302 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T00:51:55.673 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:55 smithi042 ceph-mon[34481]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:51:55.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:55 smithi001 ceph-mon[31211]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:51:55.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:55 smithi193 ceph-mon[34660]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:51:56.960 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 00:51:56 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T00:51:56.641+0000 7f4a887b2640 -1 osd.6 0 log_to_monitors true 2024-09-21T00:51:57.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:57 smithi042 ceph-mon[34481]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:51:57.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:57 smithi042 ceph-mon[34481]: from='osd.6 [v2:172.21.15.1:6818/3201517067,v1:172.21.15.1:6819/3201517067]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T00:51:57.825 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:57 smithi001 ceph-mon[31211]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:51:57.825 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:57 smithi001 ceph-mon[31211]: from='osd.6 [v2:172.21.15.1:6818/3201517067,v1:172.21.15.1:6819/3201517067]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T00:51:57.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:57 smithi193 ceph-mon[34660]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:51:57.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:57 smithi193 ceph-mon[34660]: from='osd.6 [v2:172.21.15.1:6818/3201517067,v1:172.21.15.1:6819/3201517067]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T00:51:58.183 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T00:51:58.212 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi042:vg_nvme/lv_2 2024-09-21T00:51:58.463 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T00:51:58.826 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:58 smithi042 ceph-mon[34481]: from='osd.6 [v2:172.21.15.1:6818/3201517067,v1:172.21.15.1:6819/3201517067]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T00:51:58.826 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:58 smithi042 ceph-mon[34481]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T00:51:58.826 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:58 smithi042 ceph-mon[34481]: from='osd.6 [v2:172.21.15.1:6818/3201517067,v1:172.21.15.1:6819/3201517067]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]} : dispatch 2024-09-21T00:51:58.826 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:58 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:51:58.826 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:58 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:58.826 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:58 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:58.826 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:58 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T00:51:58.826 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:58 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T00:51:58.826 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:58 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T00:51:58.826 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:58 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:58.826 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:58 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:58.826 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:58 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:51:58.827 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:58 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:58.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.920+0000 7fb772162640 1 -- 172.21.15.42:0/1157810340 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb76c102650 msgr2=0x7fb76c102ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:51:58.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.920+0000 7fb772162640 1 --2- 172.21.15.42:0/1157810340 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb76c102650 0x7fb76c102ac0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb75c009900 tx=0x7fb75c02a480 comp rx=0 tx=0).stop 2024-09-21T00:51:58.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.920+0000 7fb772162640 1 -- 172.21.15.42:0/1157810340 shutdown_connections 2024-09-21T00:51:58.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.920+0000 7fb772162640 1 --2- 172.21.15.42:0/1157810340 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb76c104080 0x7fb76c10aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:58.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.920+0000 7fb772162640 1 --2- 172.21.15.42:0/1157810340 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb76c1036e0 0x7fb76c103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:58.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.920+0000 7fb772162640 1 --2- 172.21.15.42:0/1157810340 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb76c102650 0x7fb76c102ac0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:58.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.920+0000 7fb772162640 1 -- 172.21.15.42:0/1157810340 >> 172.21.15.42:0/1157810340 conn(0x7fb76c0fdfe0 msgr2=0x7fb76c100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:51:58.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.920+0000 7fb772162640 1 -- 172.21.15.42:0/1157810340 shutdown_connections 2024-09-21T00:51:58.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.920+0000 7fb772162640 1 -- 172.21.15.42:0/1157810340 wait complete. 2024-09-21T00:51:58.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.921+0000 7fb772162640 1 Processor -- start 2024-09-21T00:51:58.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.921+0000 7fb772162640 1 -- start start 2024-09-21T00:51:58.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.921+0000 7fb772162640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb76c102650 0x7fb76c06c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:51:58.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.921+0000 7fb772162640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb76c1036e0 0x7fb76c19ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:51:58.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.921+0000 7fb772162640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb76c104080 0x7fb76c1a12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:51:58.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.921+0000 7fb772162640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb76c10e270 con 0x7fb76c1036e0 2024-09-21T00:51:58.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.921+0000 7fb772162640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb76c10e0f0 con 0x7fb76c104080 2024-09-21T00:51:58.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.921+0000 7fb772162640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb76c10e3f0 con 0x7fb76c102650 2024-09-21T00:51:58.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.921+0000 7fb76bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb76c104080 0x7fb76c1a12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:51:58.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.921+0000 7fb763fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb76c1036e0 0x7fb76c19ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:51:58.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.921+0000 7fb76bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb76c104080 0x7fb76c1a12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53368/0 (socket says 172.21.15.42:53368) 2024-09-21T00:51:58.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.921+0000 7fb76bfff640 1 -- 172.21.15.42:0/2064530645 learned_addr learned my addr 172.21.15.42:0/2064530645 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T00:51:58.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.921+0000 7fb76b7fe640 1 --2- 172.21.15.42:0/2064530645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb76c102650 0x7fb76c06c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:51:58.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.922+0000 7fb76bfff640 1 -- 172.21.15.42:0/2064530645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb76c102650 msgr2=0x7fb76c06c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:51:58.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.922+0000 7fb76bfff640 1 --2- 172.21.15.42:0/2064530645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb76c102650 0x7fb76c06c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:58.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.922+0000 7fb76bfff640 1 -- 172.21.15.42:0/2064530645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb76c1036e0 msgr2=0x7fb76c19ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:51:58.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.922+0000 7fb76bfff640 1 --2- 172.21.15.42:0/2064530645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb76c1036e0 0x7fb76c19ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:58.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.922+0000 7fb76bfff640 1 -- 172.21.15.42:0/2064530645 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb76c1a1a30 con 0x7fb76c104080 2024-09-21T00:51:58.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.922+0000 7fb763fff640 1 --2- 172.21.15.42:0/2064530645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb76c1036e0 0x7fb76c19ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:51:58.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.922+0000 7fb76bfff640 1 --2- 172.21.15.42:0/2064530645 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb76c104080 0x7fb76c1a12a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb76400eb10 tx=0x7fb76400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:51:58.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.922+0000 7fb7697fa640 1 -- 172.21.15.42:0/2064530645 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb76400ce20 con 0x7fb76c104080 2024-09-21T00:51:58.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.922+0000 7fb772162640 1 -- 172.21.15.42:0/2064530645 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb76c1a1d20 con 0x7fb76c104080 2024-09-21T00:51:58.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.922+0000 7fb7697fa640 1 -- 172.21.15.42:0/2064530645 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb764005020 con 0x7fb76c104080 2024-09-21T00:51:58.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.922+0000 7fb7697fa640 1 -- 172.21.15.42:0/2064530645 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb764010690 con 0x7fb76c104080 2024-09-21T00:51:58.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.922+0000 7fb772162640 1 -- 172.21.15.42:0/2064530645 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb76c1a21b0 con 0x7fb76c104080 2024-09-21T00:51:58.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.923+0000 7fb772162640 1 -- 172.21.15.42:0/2064530645 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb76c109830 con 0x7fb76c104080 2024-09-21T00:51:58.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.925+0000 7fb7697fa640 1 -- 172.21.15.42:0/2064530645 <== mon.2 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 154511+0+0 (secure 0 0 0) 0x7fb764005510 con 0x7fb76c104080 2024-09-21T00:51:58.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.925+0000 7fb7697fa640 1 --2- 172.21.15.42:0/2064530645 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb7580b6510 0x7fb7580b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:51:58.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.925+0000 7fb7697fa640 1 -- 172.21.15.42:0/2064530645 <== mon.2 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4685+0+0 (secure 0 0 0) 0x7fb7640e6ab0 con 0x7fb76c104080 2024-09-21T00:51:58.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.925+0000 7fb76b7fe640 1 --2- 172.21.15.42:0/2064530645 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb7580b6510 0x7fb7580b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:51:58.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.926+0000 7fb76b7fe640 1 --2- 172.21.15.42:0/2064530645 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb7580b6510 0x7fb7580b8a20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb75c000c00 tx=0x7fb75c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:51:58.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:58.930+0000 7fb7697fa640 1 -- 172.21.15.42:0/2064530645 <== mon.2 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb7640ae170 con 0x7fb76c104080 2024-09-21T00:51:58.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:58 smithi001 ceph-mon[31211]: from='osd.6 [v2:172.21.15.1:6818/3201517067,v1:172.21.15.1:6819/3201517067]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T00:51:58.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:58 smithi001 ceph-mon[31211]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T00:51:58.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:58 smithi001 ceph-mon[31211]: from='osd.6 [v2:172.21.15.1:6818/3201517067,v1:172.21.15.1:6819/3201517067]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]} : dispatch 2024-09-21T00:51:58.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:58 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:51:58.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:58 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:58.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:58 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:58.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:58 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T00:51:58.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:58 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T00:51:58.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:58 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T00:51:58.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:58 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:58.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:58 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:58.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:58 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:51:58.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:58 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:58.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:58 smithi193 ceph-mon[34660]: from='osd.6 [v2:172.21.15.1:6818/3201517067,v1:172.21.15.1:6819/3201517067]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T00:51:58.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:58 smithi193 ceph-mon[34660]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T00:51:58.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:58 smithi193 ceph-mon[34660]: from='osd.6 [v2:172.21.15.1:6818/3201517067,v1:172.21.15.1:6819/3201517067]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]} : dispatch 2024-09-21T00:51:58.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:58 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:51:58.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:58 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:58.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:58 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:58.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:58 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T00:51:58.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:58 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T00:51:58.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:58 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T00:51:58.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:58 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:58.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:58 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:58.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:58 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:51:58.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:58 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:51:59.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:51:59.130+0000 7fb772162640 1 -- 172.21.15.42:0/2064530645 --> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fb76c063800 con 0x7fb7580b6510 2024-09-21T00:51:59.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 00:51:59 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T00:51:59.018+0000 7f4a84734640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T00:51:59.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 00:51:59 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T00:51:59.026+0000 7f4a7c52a640 -1 osd.6 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:51:59.763 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:59 smithi042 ceph-mon[34481]: Detected new or changed devices on smithi001 2024-09-21T00:51:59.763 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:59 smithi042 ceph-mon[34481]: Adjusting osd_memory_target on smithi001 to 5697M 2024-09-21T00:51:59.763 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:59 smithi042 ceph-mon[34481]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:51:59.763 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:59 smithi042 ceph-mon[34481]: from='osd.6 [v2:172.21.15.1:6818/3201517067,v1:172.21.15.1:6819/3201517067]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-21T00:51:59.763 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:59 smithi042 ceph-mon[34481]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T00:51:59.763 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:59 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:51:59.763 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:59 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:51:59.763 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:59 smithi042 ceph-mon[34481]: from='osd.6 [v2:172.21.15.1:6818/3201517067,v1:172.21.15.1:6819/3201517067]' entity='osd.6' 2024-09-21T00:51:59.764 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:59 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:51:59.764 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:59 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:51:59.764 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:51:59 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:59.828 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:59 smithi001 ceph-mon[31211]: Detected new or changed devices on smithi001 2024-09-21T00:51:59.829 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:59 smithi001 ceph-mon[31211]: Adjusting osd_memory_target on smithi001 to 5697M 2024-09-21T00:51:59.829 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:59 smithi001 ceph-mon[31211]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:51:59.829 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:59 smithi001 ceph-mon[31211]: from='osd.6 [v2:172.21.15.1:6818/3201517067,v1:172.21.15.1:6819/3201517067]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-21T00:51:59.829 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:59 smithi001 ceph-mon[31211]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T00:51:59.829 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:59 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:51:59.829 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:59 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:51:59.829 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:59 smithi001 ceph-mon[31211]: from='osd.6 [v2:172.21.15.1:6818/3201517067,v1:172.21.15.1:6819/3201517067]' entity='osd.6' 2024-09-21T00:51:59.829 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:59 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:51:59.829 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:59 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:51:59.829 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:51:59 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:59.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:59 smithi193 ceph-mon[34660]: Detected new or changed devices on smithi001 2024-09-21T00:51:59.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:59 smithi193 ceph-mon[34660]: Adjusting osd_memory_target on smithi001 to 5697M 2024-09-21T00:51:59.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:59 smithi193 ceph-mon[34660]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:51:59.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:59 smithi193 ceph-mon[34660]: from='osd.6 [v2:172.21.15.1:6818/3201517067,v1:172.21.15.1:6819/3201517067]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-21T00:51:59.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:59 smithi193 ceph-mon[34660]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T00:51:59.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:59 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:51:59.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:59 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:51:59.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:59 smithi193 ceph-mon[34660]: from='osd.6 [v2:172.21.15.1:6818/3201517067,v1:172.21.15.1:6819/3201517067]' entity='osd.6' 2024-09-21T00:51:59.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:59 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:51:59.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:59 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:51:59.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:51:59 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:00.641 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:00 smithi042 ceph-mon[34481]: purged_snaps scrub starts 2024-09-21T00:52:00.642 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:00 smithi042 ceph-mon[34481]: purged_snaps scrub ok 2024-09-21T00:52:00.642 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:00 smithi042 ceph-mon[34481]: from='client.24413 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:00.642 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:00 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:52:00.642 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:00 smithi042 ceph-mon[34481]: osd.6 [v2:172.21.15.1:6818/3201517067,v1:172.21.15.1:6819/3201517067] boot 2024-09-21T00:52:00.642 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:00 smithi042 ceph-mon[34481]: osdmap e40: 7 total, 7 up, 7 in 2024-09-21T00:52:00.642 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:00 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:52:00.712 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:00 smithi001 ceph-mon[31211]: purged_snaps scrub starts 2024-09-21T00:52:00.712 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:00 smithi001 ceph-mon[31211]: purged_snaps scrub ok 2024-09-21T00:52:00.712 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:00 smithi001 ceph-mon[31211]: from='client.24413 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:00.712 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:00 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:52:00.712 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:00 smithi001 ceph-mon[31211]: osd.6 [v2:172.21.15.1:6818/3201517067,v1:172.21.15.1:6819/3201517067] boot 2024-09-21T00:52:00.712 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:00 smithi001 ceph-mon[31211]: osdmap e40: 7 total, 7 up, 7 in 2024-09-21T00:52:00.712 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:00 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:52:00.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:00 smithi193 ceph-mon[34660]: purged_snaps scrub starts 2024-09-21T00:52:00.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:00 smithi193 ceph-mon[34660]: purged_snaps scrub ok 2024-09-21T00:52:00.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:00 smithi193 ceph-mon[34660]: from='client.24413 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:00.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:00 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:52:00.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:00 smithi193 ceph-mon[34660]: osd.6 [v2:172.21.15.1:6818/3201517067,v1:172.21.15.1:6819/3201517067] boot 2024-09-21T00:52:00.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:00 smithi193 ceph-mon[34660]: osdmap e40: 7 total, 7 up, 7 in 2024-09-21T00:52:00.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:00 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:52:01.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:01 smithi042 ceph-mon[34481]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:52:01.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:01 smithi001 ceph-mon[31211]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:52:01.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:01 smithi193 ceph-mon[34660]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:52:02.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:02 smithi042 ceph-mon[34481]: osdmap e41: 7 total, 7 up, 7 in 2024-09-21T00:52:02.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:02 smithi042 ceph-mon[34481]: from='client.? 172.21.15.42:0/2074898109' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8b239f96-2455-41b6-a905-9ed92078b890"} : dispatch 2024-09-21T00:52:02.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:02 smithi042 ceph-mon[34481]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8b239f96-2455-41b6-a905-9ed92078b890"} : dispatch 2024-09-21T00:52:02.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:02 smithi042 ceph-mon[34481]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b239f96-2455-41b6-a905-9ed92078b890"}]': finished 2024-09-21T00:52:02.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:02 smithi042 ceph-mon[34481]: osdmap e42: 8 total, 7 up, 8 in 2024-09-21T00:52:02.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:02 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:52:02.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:02 smithi042 ceph-mon[34481]: from='client.? 172.21.15.42:0/414637850' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:52:02.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:02 smithi001 ceph-mon[31211]: osdmap e41: 7 total, 7 up, 7 in 2024-09-21T00:52:02.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:02 smithi001 ceph-mon[31211]: from='client.? 172.21.15.42:0/2074898109' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8b239f96-2455-41b6-a905-9ed92078b890"} : dispatch 2024-09-21T00:52:02.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:02 smithi001 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8b239f96-2455-41b6-a905-9ed92078b890"} : dispatch 2024-09-21T00:52:02.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:02 smithi001 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b239f96-2455-41b6-a905-9ed92078b890"}]': finished 2024-09-21T00:52:02.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:02 smithi001 ceph-mon[31211]: osdmap e42: 8 total, 7 up, 8 in 2024-09-21T00:52:02.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:02 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:52:02.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:02 smithi001 ceph-mon[31211]: from='client.? 172.21.15.42:0/414637850' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:52:02.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:02 smithi193 ceph-mon[34660]: osdmap e41: 7 total, 7 up, 7 in 2024-09-21T00:52:02.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:02 smithi193 ceph-mon[34660]: from='client.? 172.21.15.42:0/2074898109' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8b239f96-2455-41b6-a905-9ed92078b890"} : dispatch 2024-09-21T00:52:02.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:02 smithi193 ceph-mon[34660]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8b239f96-2455-41b6-a905-9ed92078b890"} : dispatch 2024-09-21T00:52:02.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:02 smithi193 ceph-mon[34660]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b239f96-2455-41b6-a905-9ed92078b890"}]': finished 2024-09-21T00:52:02.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:02 smithi193 ceph-mon[34660]: osdmap e42: 8 total, 7 up, 8 in 2024-09-21T00:52:02.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:52:02.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:02 smithi193 ceph-mon[34660]: from='client.? 172.21.15.42:0/414637850' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:52:03.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:03 smithi193 ceph-mon[34660]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:52:03.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:03 smithi042 ceph-mon[34481]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:52:04.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:03 smithi001 ceph-mon[31211]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:52:05.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:05 smithi193 ceph-mon[34660]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:52:05.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:05 smithi042 ceph-mon[34481]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:52:06.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:05 smithi001 ceph-mon[31211]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:52:07.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:07 smithi042 ceph-mon[34481]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:52:08.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:07 smithi001 ceph-mon[31211]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:52:08.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:07 smithi193 ceph-mon[34660]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:52:09.884 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:09 smithi042 ceph-mon[34481]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:52:10.032 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:09 smithi193 ceph-mon[34660]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:52:10.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:09 smithi001 ceph-mon[31211]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:52:10.863 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:10 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T00:52:10.863 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:10 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:11.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:10 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T00:52:11.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:10 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:11.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:10 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T00:52:11.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:10 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:11.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:11 smithi042 ceph-mon[34481]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:52:11.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:11 smithi042 ceph-mon[34481]: Deploying daemon osd.7 on smithi042 2024-09-21T00:52:12.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:11 smithi001 ceph-mon[31211]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:52:12.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:11 smithi001 ceph-mon[31211]: Deploying daemon osd.7 on smithi042 2024-09-21T00:52:12.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:11 smithi193 ceph-mon[34660]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:52:12.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:11 smithi193 ceph-mon[34660]: Deploying daemon osd.7 on smithi042 2024-09-21T00:52:13.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:13 smithi042 ceph-mon[34481]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:52:14.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:13 smithi001 ceph-mon[31211]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:52:14.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:13 smithi193 ceph-mon[34660]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:52:15.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:15 smithi042 ceph-mon[34481]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:52:16.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:15 smithi001 ceph-mon[31211]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:52:16.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:15 smithi193 ceph-mon[34660]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:52:17.021 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:16 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:52:17.021 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:16 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:17.021 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:16 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:17.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:16 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:52:17.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:16 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:17.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:16 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:17.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:16 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:52:17.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:16 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:17.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:16 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:18.068 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:17 smithi042 ceph-mon[34481]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:52:18.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:17 smithi001 ceph-mon[31211]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:52:18.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:17 smithi193 ceph-mon[34660]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:52:20.012 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:19 smithi001 ceph-mon[31211]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:52:20.012 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:19 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:20.013 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:19 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:20.013 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:19 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:20.013 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:19 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:52:20.013 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:19 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:20.036 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:19 smithi042 ceph-mon[34481]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:52:20.036 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:19 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:20.036 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:19 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:20.036 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:19 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:20.036 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:19 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:52:20.036 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:19 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:20.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:19 smithi193 ceph-mon[34660]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:52:20.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:19 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:20.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:19 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:20.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:19 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:20.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:19 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:52:20.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:19 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:20.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:52:20.683+0000 7fb7697fa640 1 -- 172.21.15.42:0/2064530645 <== mgr.14150 v2:172.21.15.1:6800/2032980330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb76c063800 con 0x7fb7580b6510 2024-09-21T00:52:20.684 INFO:teuthology.orchestra.run.smithi042.stdout:Created osd(s) 7 on host 'smithi042' 2024-09-21T00:52:20.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:52:20.685+0000 7fb772162640 1 -- 172.21.15.42:0/2064530645 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb7580b6510 msgr2=0x7fb7580b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:52:20.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:52:20.685+0000 7fb772162640 1 --2- 172.21.15.42:0/2064530645 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb7580b6510 0x7fb7580b8a20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb75c000c00 tx=0x7fb75c031400 comp rx=0 tx=0).stop 2024-09-21T00:52:20.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:52:20.685+0000 7fb772162640 1 -- 172.21.15.42:0/2064530645 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb76c104080 msgr2=0x7fb76c1a12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:52:20.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:52:20.685+0000 7fb772162640 1 --2- 172.21.15.42:0/2064530645 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb76c104080 0x7fb76c1a12a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb76400eb10 tx=0x7fb76400ef10 comp rx=0 tx=0).stop 2024-09-21T00:52:20.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:52:20.685+0000 7fb772162640 1 -- 172.21.15.42:0/2064530645 shutdown_connections 2024-09-21T00:52:20.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:52:20.685+0000 7fb772162640 1 --2- 172.21.15.42:0/2064530645 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb76c104080 0x7fb76c1a12a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:20.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:52:20.685+0000 7fb772162640 1 --2- 172.21.15.42:0/2064530645 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb7580b6510 0x7fb7580b8a20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:20.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:52:20.685+0000 7fb772162640 1 --2- 172.21.15.42:0/2064530645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb76c1036e0 0x7fb76c19ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:20.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:52:20.685+0000 7fb772162640 1 --2- 172.21.15.42:0/2064530645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb76c102650 0x7fb76c06c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:20.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:52:20.685+0000 7fb772162640 1 -- 172.21.15.42:0/2064530645 >> 172.21.15.42:0/2064530645 conn(0x7fb76c0fdfe0 msgr2=0x7fb76c106a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:52:20.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:52:20.685+0000 7fb772162640 1 -- 172.21.15.42:0/2064530645 shutdown_connections 2024-09-21T00:52:20.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:52:20.685+0000 7fb772162640 1 -- 172.21.15.42:0/2064530645 wait complete. 2024-09-21T00:52:20.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:20 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:52:20.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:20 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:20.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:20 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:21.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:20 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:52:21.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:20 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:21.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:20 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:21.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:20 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:52:21.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:20 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:21.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:20 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:21.413 DEBUG:teuthology.orchestra.run.smithi042:osd.7> sudo journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@osd.7.service 2024-09-21T00:52:21.415 INFO:tasks.cephadm:Deploying osd.8 on smithi193 with /dev/vg_nvme/lv_2... 2024-09-21T00:52:21.415 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T00:52:21.666 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:52:21.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:21 smithi042 ceph-mon[34481]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:52:22.078 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:21 smithi193 ceph-mon[34660]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:52:22.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:21 smithi001 ceph-mon[31211]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:52:23.212 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 00:52:22 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T00:52:22.950+0000 7f23ed294640 -1 osd.7 0 log_to_monitors true 2024-09-21T00:52:23.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:23 smithi042 ceph-mon[34481]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:52:23.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:23 smithi042 ceph-mon[34481]: from='osd.7 [v2:172.21.15.42:6816/2124927218,v1:172.21.15.42:6817/2124927218]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T00:52:23.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:23 smithi042 ceph-mon[34481]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T00:52:24.089 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:23 smithi193 ceph-mon[34660]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:52:24.090 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:23 smithi193 ceph-mon[34660]: from='osd.7 [v2:172.21.15.42:6816/2124927218,v1:172.21.15.42:6817/2124927218]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T00:52:24.090 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:23 smithi193 ceph-mon[34660]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T00:52:24.092 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-21T00:52:24.119 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi193:vg_nvme/lv_2 2024-09-21T00:52:24.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:23 smithi001 ceph-mon[31211]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:52:24.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:23 smithi001 ceph-mon[31211]: from='osd.7 [v2:172.21.15.42:6816/2124927218,v1:172.21.15.42:6817/2124927218]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T00:52:24.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:23 smithi001 ceph-mon[31211]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T00:52:24.389 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:52:24.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.896+0000 7f678f7d5640 1 -- 172.21.15.193:0/1959839326 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f67881047e0 msgr2=0x7f6788104bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:52:24.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.896+0000 7f678f7d5640 1 --2- 172.21.15.193:0/1959839326 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f67881047e0 0x7f6788104bf0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6778009900 tx=0x7f677802a480 comp rx=0 tx=0).stop 2024-09-21T00:52:24.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.896+0000 7f678f7d5640 1 -- 172.21.15.193:0/1959839326 shutdown_connections 2024-09-21T00:52:24.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.896+0000 7f678f7d5640 1 --2- 172.21.15.193:0/1959839326 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6788105180 0x7f678810bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:24.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.896+0000 7f678f7d5640 1 --2- 172.21.15.193:0/1959839326 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f67881047e0 0x7f6788104bf0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:24.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.896+0000 7f678f7d5640 1 --2- 172.21.15.193:0/1959839326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6788103750 0x7f6788103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:24.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.896+0000 7f678f7d5640 1 -- 172.21.15.193:0/1959839326 >> 172.21.15.193:0/1959839326 conn(0x7f67880ff0e0 msgr2=0x7f6788101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:52:24.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.896+0000 7f678f7d5640 1 -- 172.21.15.193:0/1959839326 shutdown_connections 2024-09-21T00:52:24.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.896+0000 7f678f7d5640 1 -- 172.21.15.193:0/1959839326 wait complete. 2024-09-21T00:52:24.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.897+0000 7f678f7d5640 1 Processor -- start 2024-09-21T00:52:24.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.897+0000 7f678f7d5640 1 -- start start 2024-09-21T00:52:24.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.897+0000 7f678f7d5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6788103750 0x7f678819a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:52:24.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.897+0000 7f678f7d5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67881047e0 0x7f678819a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:52:24.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.897+0000 7f678f7d5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6788105180 0x7f678819b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:52:24.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.897+0000 7f678f7d5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f678810f3a0 con 0x7f6788103750 2024-09-21T00:52:24.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.897+0000 7f678f7d5640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f678810f220 con 0x7f67881047e0 2024-09-21T00:52:24.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.897+0000 7f678f7d5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f678810f520 con 0x7f6788105180 2024-09-21T00:52:24.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.897+0000 7f678dd72640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6788105180 0x7f678819b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:52:24.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.898+0000 7f678d571640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6788103750 0x7f678819a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:52:24.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.898+0000 7f678dd72640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6788105180 0x7f678819b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.193:48038/0 (socket says 172.21.15.193:48038) 2024-09-21T00:52:24.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.898+0000 7f678dd72640 1 -- 172.21.15.193:0/3997575420 learned_addr learned my addr 172.21.15.193:0/3997575420 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-21T00:52:24.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.898+0000 7f678cd70640 1 --2- 172.21.15.193:0/3997575420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67881047e0 0x7f678819a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:52:24.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.898+0000 7f678dd72640 1 -- 172.21.15.193:0/3997575420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67881047e0 msgr2=0x7f678819a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:52:24.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.898+0000 7f678dd72640 1 --2- 172.21.15.193:0/3997575420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67881047e0 0x7f678819a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:24.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.898+0000 7f678dd72640 1 -- 172.21.15.193:0/3997575420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6788103750 msgr2=0x7f678819a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:52:24.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.898+0000 7f678dd72640 1 --2- 172.21.15.193:0/3997575420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6788103750 0x7f678819a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:24.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.898+0000 7f678dd72640 1 -- 172.21.15.193:0/3997575420 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f678819ba30 con 0x7f6788105180 2024-09-21T00:52:24.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.898+0000 7f678d571640 1 --2- 172.21.15.193:0/3997575420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6788103750 0x7f678819a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:52:24.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.898+0000 7f678dd72640 1 --2- 172.21.15.193:0/3997575420 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6788105180 0x7f678819b210 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6780009fd0 tx=0x7f678000b260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:52:24.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.898+0000 7f677e7fc640 1 -- 172.21.15.193:0/3997575420 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6780017070 con 0x7f6788105180 2024-09-21T00:52:24.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.898+0000 7f678f7d5640 1 -- 172.21.15.193:0/3997575420 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f678819bd20 con 0x7f6788105180 2024-09-21T00:52:24.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.898+0000 7f677e7fc640 1 -- 172.21.15.193:0/3997575420 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6780003e20 con 0x7f6788105180 2024-09-21T00:52:24.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.898+0000 7f677e7fc640 1 -- 172.21.15.193:0/3997575420 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6780010460 con 0x7f6788105180 2024-09-21T00:52:24.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.898+0000 7f678f7d5640 1 -- 172.21.15.193:0/3997575420 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67881a2420 con 0x7f6788105180 2024-09-21T00:52:24.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.900+0000 7f678f7d5640 1 -- 172.21.15.193:0/3997575420 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6788103bc0 con 0x7f6788105180 2024-09-21T00:52:24.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.902+0000 7f677e7fc640 1 -- 172.21.15.193:0/3997575420 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 16) ==== 154511+0+0 (secure 0 0 0) 0x7f6780003970 con 0x7f6788105180 2024-09-21T00:52:24.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.903+0000 7f677e7fc640 1 --2- 172.21.15.193:0/3997575420 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f67740b6510 0x7f67740b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:52:24.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.903+0000 7f677e7fc640 1 -- 172.21.15.193:0/3997575420 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5117+0+0 (secure 0 0 0) 0x7f67800e6410 con 0x7f6788105180 2024-09-21T00:52:24.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.903+0000 7f678d571640 1 --2- 172.21.15.193:0/3997575420 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f67740b6510 0x7f67740b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:52:24.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.904+0000 7f678d571640 1 --2- 172.21.15.193:0/3997575420 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f67740b6510 0x7f67740b8a20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6784009fc0 tx=0x7f6784005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:52:24.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:24.905+0000 7f677e7fc640 1 -- 172.21.15.193:0/3997575420 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f67800b1c60 con 0x7f6788105180 2024-09-21T00:52:24.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:24 smithi193 ceph-mon[34660]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T00:52:24.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:24 smithi193 ceph-mon[34660]: from='osd.7 [v2:172.21.15.42:6816/2124927218,v1:172.21.15.42:6817/2124927218]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T00:52:24.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:24 smithi193 ceph-mon[34660]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T00:52:24.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:24 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:52:24.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:24 smithi193 ceph-mon[34660]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T00:52:24.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:24 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:24.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:24 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:24.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:24 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T00:52:24.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:24 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T00:52:24.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:24 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T00:52:24.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:24 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:24.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:24 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:24.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:24 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:52:24.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:24 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:24.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:24 smithi193 ceph-mon[34660]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-21T00:52:24.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:24 smithi193 ceph-mon[34660]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T00:52:24.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:24 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:52:25.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:25.099+0000 7f678f7d5640 1 -- 172.21.15.193:0/3997575420 --> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f6788063800 con 0x7f67740b6510 2024-09-21T00:52:25.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:24 smithi001 ceph-mon[31211]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T00:52:25.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:24 smithi001 ceph-mon[31211]: from='osd.7 [v2:172.21.15.42:6816/2124927218,v1:172.21.15.42:6817/2124927218]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T00:52:25.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:24 smithi001 ceph-mon[31211]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T00:52:25.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:24 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:52:25.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:24 smithi001 ceph-mon[31211]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T00:52:25.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:24 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:25.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:24 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:25.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:24 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T00:52:25.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:24 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T00:52:25.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:24 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T00:52:25.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:24 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:25.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:24 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:25.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:24 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:52:25.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:24 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:25.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:24 smithi001 ceph-mon[31211]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-21T00:52:25.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:24 smithi001 ceph-mon[31211]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T00:52:25.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:24 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:52:25.242 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 00:52:24 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T00:52:24.778+0000 7f23e9216640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T00:52:25.242 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 00:52:24 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T00:52:24.791+0000 7f23e5014640 -1 osd.7 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:52:25.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:24 smithi042 ceph-mon[34481]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T00:52:25.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:24 smithi042 ceph-mon[34481]: from='osd.7 [v2:172.21.15.42:6816/2124927218,v1:172.21.15.42:6817/2124927218]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T00:52:25.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:24 smithi042 ceph-mon[34481]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T00:52:25.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:24 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:52:25.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:24 smithi042 ceph-mon[34481]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T00:52:25.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:24 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:25.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:24 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:25.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:24 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T00:52:25.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:24 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T00:52:25.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:24 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T00:52:25.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:24 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:25.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:24 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:25.244 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:24 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:52:25.244 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:24 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:25.244 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:24 smithi042 ceph-mon[34481]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-21T00:52:25.244 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:24 smithi042 ceph-mon[34481]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T00:52:25.244 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:24 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:52:26.083 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:25 smithi193 ceph-mon[34660]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:52:26.083 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:25 smithi193 ceph-mon[34660]: Detected new or changed devices on smithi042 2024-09-21T00:52:26.083 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:25 smithi193 ceph-mon[34660]: Adjusting osd_memory_target on smithi042 to 5697M 2024-09-21T00:52:26.083 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:25 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:52:26.083 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:25 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:52:26.083 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:25 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:52:26.083 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:25 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:26.083 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:25 smithi193 ceph-mon[34660]: osd.7 [v2:172.21.15.42:6816/2124927218,v1:172.21.15.42:6817/2124927218] boot 2024-09-21T00:52:26.083 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:25 smithi193 ceph-mon[34660]: osdmap e45: 8 total, 8 up, 8 in 2024-09-21T00:52:26.083 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:25 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:52:26.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:25 smithi001 ceph-mon[31211]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:52:26.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:25 smithi001 ceph-mon[31211]: Detected new or changed devices on smithi042 2024-09-21T00:52:26.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:25 smithi001 ceph-mon[31211]: Adjusting osd_memory_target on smithi042 to 5697M 2024-09-21T00:52:26.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:25 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:52:26.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:25 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:52:26.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:25 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:52:26.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:25 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:26.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:25 smithi001 ceph-mon[31211]: osd.7 [v2:172.21.15.42:6816/2124927218,v1:172.21.15.42:6817/2124927218] boot 2024-09-21T00:52:26.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:25 smithi001 ceph-mon[31211]: osdmap e45: 8 total, 8 up, 8 in 2024-09-21T00:52:26.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:25 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:52:26.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:25 smithi042 ceph-mon[34481]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:52:26.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:25 smithi042 ceph-mon[34481]: Detected new or changed devices on smithi042 2024-09-21T00:52:26.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:25 smithi042 ceph-mon[34481]: Adjusting osd_memory_target on smithi042 to 5697M 2024-09-21T00:52:26.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:25 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:52:26.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:25 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:52:26.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:25 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:52:26.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:25 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:26.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:25 smithi042 ceph-mon[34481]: osd.7 [v2:172.21.15.42:6816/2124927218,v1:172.21.15.42:6817/2124927218] boot 2024-09-21T00:52:26.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:25 smithi042 ceph-mon[34481]: osdmap e45: 8 total, 8 up, 8 in 2024-09-21T00:52:26.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:25 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:52:26.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:26 smithi193 ceph-mon[34660]: purged_snaps scrub starts 2024-09-21T00:52:26.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:26 smithi193 ceph-mon[34660]: purged_snaps scrub ok 2024-09-21T00:52:26.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:26 smithi193 ceph-mon[34660]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:26.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:26 smithi193 ceph-mon[34660]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T00:52:27.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:26 smithi001 ceph-mon[31211]: purged_snaps scrub starts 2024-09-21T00:52:27.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:26 smithi001 ceph-mon[31211]: purged_snaps scrub ok 2024-09-21T00:52:27.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:26 smithi001 ceph-mon[31211]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:27.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:26 smithi001 ceph-mon[31211]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T00:52:27.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:26 smithi042 ceph-mon[34481]: purged_snaps scrub starts 2024-09-21T00:52:27.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:26 smithi042 ceph-mon[34481]: purged_snaps scrub ok 2024-09-21T00:52:27.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:26 smithi042 ceph-mon[34481]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:27.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:26 smithi042 ceph-mon[34481]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T00:52:27.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:27 smithi193 ceph-mon[34660]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:52:27.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:27 smithi193 ceph-mon[34660]: from='client.? 172.21.15.193:0/3159997399' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8cd93aeb-fe00-4291-9f72-171d01893819"} : dispatch 2024-09-21T00:52:27.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:27 smithi193 ceph-mon[34660]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8cd93aeb-fe00-4291-9f72-171d01893819"} : dispatch 2024-09-21T00:52:27.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:27 smithi193 ceph-mon[34660]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8cd93aeb-fe00-4291-9f72-171d01893819"}]': finished 2024-09-21T00:52:27.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:27 smithi193 ceph-mon[34660]: osdmap e47: 9 total, 8 up, 9 in 2024-09-21T00:52:27.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:27 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:52:28.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:27 smithi001 ceph-mon[31211]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:52:28.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:27 smithi001 ceph-mon[31211]: from='client.? 172.21.15.193:0/3159997399' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8cd93aeb-fe00-4291-9f72-171d01893819"} : dispatch 2024-09-21T00:52:28.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:27 smithi001 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8cd93aeb-fe00-4291-9f72-171d01893819"} : dispatch 2024-09-21T00:52:28.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:27 smithi001 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8cd93aeb-fe00-4291-9f72-171d01893819"}]': finished 2024-09-21T00:52:28.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:27 smithi001 ceph-mon[31211]: osdmap e47: 9 total, 8 up, 9 in 2024-09-21T00:52:28.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:27 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:52:28.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:27 smithi042 ceph-mon[34481]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:52:28.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:27 smithi042 ceph-mon[34481]: from='client.? 172.21.15.193:0/3159997399' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8cd93aeb-fe00-4291-9f72-171d01893819"} : dispatch 2024-09-21T00:52:28.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:27 smithi042 ceph-mon[34481]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8cd93aeb-fe00-4291-9f72-171d01893819"} : dispatch 2024-09-21T00:52:28.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:27 smithi042 ceph-mon[34481]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8cd93aeb-fe00-4291-9f72-171d01893819"}]': finished 2024-09-21T00:52:28.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:27 smithi042 ceph-mon[34481]: osdmap e47: 9 total, 8 up, 9 in 2024-09-21T00:52:28.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:27 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:52:29.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:28 smithi001 ceph-mon[31211]: from='client.? 172.21.15.193:0/2563392708' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:52:29.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:28 smithi193 ceph-mon[34660]: from='client.? 172.21.15.193:0/2563392708' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:52:29.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:28 smithi042 ceph-mon[34481]: from='client.? 172.21.15.193:0/2563392708' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:52:30.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:29 smithi001 ceph-mon[31211]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:52:30.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:29 smithi193 ceph-mon[34660]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:52:30.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:29 smithi042 ceph-mon[34481]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:52:32.168 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:31 smithi193 ceph-mon[34660]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:52:32.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:31 smithi001 ceph-mon[31211]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:52:32.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:31 smithi042 ceph-mon[34481]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:52:33.917 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:33 smithi193 ceph-mon[34660]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-21T00:52:34.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:33 smithi001 ceph-mon[31211]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-21T00:52:34.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:33 smithi042 ceph-mon[34481]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-21T00:52:36.112 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:35 smithi193 ceph-mon[34660]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T00:52:36.112 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:35 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T00:52:36.112 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:35 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:36.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:35 smithi001 ceph-mon[31211]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T00:52:36.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:35 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T00:52:36.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:35 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:36.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:35 smithi042 ceph-mon[34481]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T00:52:36.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:35 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T00:52:36.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:35 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:37.080 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:36 smithi193 ceph-mon[34660]: Deploying daemon osd.8 on smithi193 2024-09-21T00:52:37.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:36 smithi001 ceph-mon[31211]: Deploying daemon osd.8 on smithi193 2024-09-21T00:52:37.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:36 smithi042 ceph-mon[34481]: Deploying daemon osd.8 on smithi193 2024-09-21T00:52:38.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:37 smithi001 ceph-mon[31211]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T00:52:38.222 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:37 smithi193 ceph-mon[34660]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T00:52:38.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:37 smithi042 ceph-mon[34481]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T00:52:40.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:39 smithi001 ceph-mon[31211]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-21T00:52:40.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:39 smithi193 ceph-mon[34660]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-21T00:52:40.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:39 smithi042 ceph-mon[34481]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-21T00:52:41.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:41 smithi193 ceph-mon[34660]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:52:41.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:41 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:52:41.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:41 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:41.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:41 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:42.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:41 smithi001 ceph-mon[31211]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:52:42.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:41 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:52:42.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:41 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:42.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:41 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:42.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:41 smithi042 ceph-mon[34481]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:52:42.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:41 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:52:42.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:41 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:42.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:41 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:43.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:42 smithi001 ceph-mon[31211]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:52:43.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:42 smithi193 ceph-mon[34660]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:52:43.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:42 smithi042 ceph-mon[34481]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:52:45.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:45.298+0000 7f677e7fc640 1 -- 172.21.15.193:0/3997575420 <== mgr.14150 v2:172.21.15.1:6800/2032980330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6788063800 con 0x7f67740b6510 2024-09-21T00:52:45.299 INFO:teuthology.orchestra.run.smithi193.stdout:Created osd(s) 8 on host 'smithi193' 2024-09-21T00:52:45.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:45.300+0000 7f678f7d5640 1 -- 172.21.15.193:0/3997575420 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f67740b6510 msgr2=0x7f67740b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:52:45.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:45.300+0000 7f678f7d5640 1 --2- 172.21.15.193:0/3997575420 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f67740b6510 0x7f67740b8a20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6784009fc0 tx=0x7f6784005f90 comp rx=0 tx=0).stop 2024-09-21T00:52:45.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:45.300+0000 7f678f7d5640 1 -- 172.21.15.193:0/3997575420 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6788105180 msgr2=0x7f678819b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:52:45.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:45.300+0000 7f678f7d5640 1 --2- 172.21.15.193:0/3997575420 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6788105180 0x7f678819b210 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6780009fd0 tx=0x7f678000b260 comp rx=0 tx=0).stop 2024-09-21T00:52:45.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:45.300+0000 7f678f7d5640 1 -- 172.21.15.193:0/3997575420 shutdown_connections 2024-09-21T00:52:45.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:45.300+0000 7f678f7d5640 1 --2- 172.21.15.193:0/3997575420 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6788105180 0x7f678819b210 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:45.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:45.300+0000 7f678f7d5640 1 --2- 172.21.15.193:0/3997575420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67881047e0 0x7f678819a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:45.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:45.300+0000 7f678f7d5640 1 --2- 172.21.15.193:0/3997575420 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f67740b6510 0x7f67740b8a20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:45.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:45.300+0000 7f678f7d5640 1 --2- 172.21.15.193:0/3997575420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6788103750 0x7f678819a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:45.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:45.300+0000 7f678f7d5640 1 -- 172.21.15.193:0/3997575420 >> 172.21.15.193:0/3997575420 conn(0x7f67880ff0e0 msgr2=0x7f6788107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:52:45.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:45.301+0000 7f678f7d5640 1 -- 172.21.15.193:0/3997575420 shutdown_connections 2024-09-21T00:52:45.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:52:45.301+0000 7f678f7d5640 1 -- 172.21.15.193:0/3997575420 wait complete. 2024-09-21T00:52:45.649 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:45 smithi193 ceph-mon[34660]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:52:45.649 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:45 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:45.649 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:45 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:45.649 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:45 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:45.649 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:45 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:52:45.649 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:45 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:45.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:45 smithi001 ceph-mon[31211]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:52:45.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:45 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:45.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:45 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:45.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:45 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:45.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:45 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:52:45.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:45 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:45.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:45 smithi042 ceph-mon[34481]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:52:45.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:45 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:45.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:45 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:45.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:45 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:45.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:45 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:52:45.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:45 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:46.025 DEBUG:teuthology.orchestra.run.smithi193:osd.8> sudo journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@osd.8.service 2024-09-21T00:52:46.027 INFO:tasks.cephadm:Deploying osd.9 on smithi001 with /dev/vg_nvme/lv_1... 2024-09-21T00:52:46.027 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T00:52:46.297 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:52:46.418 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:46 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:52:46.418 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:46 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:46.418 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:46 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:46.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:46 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:52:46.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:46 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:46.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:46 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:46.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:46 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:52:46.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:46 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:46.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:46 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:47.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:47 smithi193 ceph-mon[34660]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:52:47.480 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 00:52:47 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T00:52:47.426+0000 7efdb0d12640 -1 osd.8 0 log_to_monitors true 2024-09-21T00:52:47.681 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:47 smithi001 ceph-mon[31211]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:52:47.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:47 smithi042 ceph-mon[34481]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:52:48.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:48 smithi193 ceph-mon[34660]: from='osd.8 [v2:172.21.15.193:6816/2277449259,v1:172.21.15.193:6817/2277449259]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T00:52:48.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:48 smithi193 ceph-mon[34660]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T00:52:48.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:48 smithi001 ceph-mon[31211]: from='osd.8 [v2:172.21.15.193:6816/2277449259,v1:172.21.15.193:6817/2277449259]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T00:52:48.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:48 smithi001 ceph-mon[31211]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T00:52:48.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:48 smithi042 ceph-mon[34481]: from='osd.8 [v2:172.21.15.193:6816/2277449259,v1:172.21.15.193:6817/2277449259]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T00:52:48.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:48 smithi042 ceph-mon[34481]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T00:52:49.244 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:52:49.272 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi001:vg_nvme/lv_1 2024-09-21T00:52:49.540 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:52:49.662 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:49 smithi001 ceph-mon[31211]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:52:49.662 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:49 smithi001 ceph-mon[31211]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T00:52:49.662 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:49 smithi001 ceph-mon[31211]: osdmap e48: 9 total, 8 up, 9 in 2024-09-21T00:52:49.662 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:49 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:52:49.663 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:49 smithi001 ceph-mon[31211]: from='osd.8 [v2:172.21.15.193:6816/2277449259,v1:172.21.15.193:6817/2277449259]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi193", "root=default"]} : dispatch 2024-09-21T00:52:49.663 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:49 smithi001 ceph-mon[31211]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi193", "root=default"]} : dispatch 2024-09-21T00:52:49.663 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:49 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:49.663 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:49 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:49.663 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:49 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T00:52:49.663 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:49 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T00:52:49.663 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:49 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T00:52:49.663 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:49 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:49.663 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:49 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:49.663 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:49 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:52:49.663 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:49 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:49.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:49 smithi193 ceph-mon[34660]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:52:49.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:49 smithi193 ceph-mon[34660]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T00:52:49.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:49 smithi193 ceph-mon[34660]: osdmap e48: 9 total, 8 up, 9 in 2024-09-21T00:52:49.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:49 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:52:49.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:49 smithi193 ceph-mon[34660]: from='osd.8 [v2:172.21.15.193:6816/2277449259,v1:172.21.15.193:6817/2277449259]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi193", "root=default"]} : dispatch 2024-09-21T00:52:49.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:49 smithi193 ceph-mon[34660]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi193", "root=default"]} : dispatch 2024-09-21T00:52:49.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:49 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:49.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:49 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:49.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:49 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T00:52:49.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:49 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T00:52:49.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:49 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T00:52:49.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:49 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:49.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:49 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:49.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:49 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:52:49.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:49 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:49.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:49 smithi042 ceph-mon[34481]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:52:49.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:49 smithi042 ceph-mon[34481]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T00:52:49.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:49 smithi042 ceph-mon[34481]: osdmap e48: 9 total, 8 up, 9 in 2024-09-21T00:52:49.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:49 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:52:49.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:49 smithi042 ceph-mon[34481]: from='osd.8 [v2:172.21.15.193:6816/2277449259,v1:172.21.15.193:6817/2277449259]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi193", "root=default"]} : dispatch 2024-09-21T00:52:49.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:49 smithi042 ceph-mon[34481]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi193", "root=default"]} : dispatch 2024-09-21T00:52:49.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:49 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:49.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:49 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:49.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:49 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T00:52:49.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:49 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T00:52:49.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:49 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T00:52:49.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:49 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:49.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:49 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:49.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:49 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:52:49.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:49 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:52:50.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.117+0000 7fa61f4ad640 1 -- 172.21.15.1:0/971285714 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa61810b6b0 msgr2=0x7fa61810dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:52:50.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.117+0000 7fa61f4ad640 1 --2- 172.21.15.1:0/971285714 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa61810b6b0 0x7fa61810dbc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa610009ca0 tx=0x7fa61002a8c0 comp rx=0 tx=0).stop 2024-09-21T00:52:50.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.118+0000 7fa61f4ad640 1 -- 172.21.15.1:0/971285714 shutdown_connections 2024-09-21T00:52:50.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.118+0000 7fa61f4ad640 1 --2- 172.21.15.1:0/971285714 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa61810b6b0 0x7fa61810dbc0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:50.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.118+0000 7fa61f4ad640 1 --2- 172.21.15.1:0/971285714 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa618108d00 0x7fa61810b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:50.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.118+0000 7fa61f4ad640 1 --2- 172.21.15.1:0/971285714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa61806c490 0x7fa6181087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:50.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.118+0000 7fa61f4ad640 1 -- 172.21.15.1:0/971285714 >> 172.21.15.1:0/971285714 conn(0x7fa6180fdfe0 msgr2=0x7fa618100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:52:50.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.118+0000 7fa61f4ad640 1 -- 172.21.15.1:0/971285714 shutdown_connections 2024-09-21T00:52:50.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.118+0000 7fa61f4ad640 1 -- 172.21.15.1:0/971285714 wait complete. 2024-09-21T00:52:50.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.118+0000 7fa61f4ad640 1 Processor -- start 2024-09-21T00:52:50.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.118+0000 7fa61f4ad640 1 -- start start 2024-09-21T00:52:50.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.119+0000 7fa61f4ad640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa61806c490 0x7fa61819c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:52:50.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.119+0000 7fa61f4ad640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa618108d00 0x7fa61819c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:52:50.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.119+0000 7fa61f4ad640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa61810b6b0 0x7fa61819d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:52:50.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.119+0000 7fa61f4ad640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa6181115a0 con 0x7fa618108d00 2024-09-21T00:52:50.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.119+0000 7fa61f4ad640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa618111420 con 0x7fa61806c490 2024-09-21T00:52:50.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.119+0000 7fa61f4ad640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa618111720 con 0x7fa61810b6b0 2024-09-21T00:52:50.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.119+0000 7fa61ca48640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa618108d00 0x7fa61819c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:52:50.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.119+0000 7fa61ca48640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa618108d00 0x7fa61819c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56566/0 (socket says 172.21.15.1:56566) 2024-09-21T00:52:50.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.119+0000 7fa61ca48640 1 -- 172.21.15.1:0/2822544440 learned_addr learned my addr 172.21.15.1:0/2822544440 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:52:50.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.119+0000 7fa61da4a640 1 --2- 172.21.15.1:0/2822544440 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa61810b6b0 0x7fa61819d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:52:50.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.119+0000 7fa61d249640 1 --2- 172.21.15.1:0/2822544440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa61806c490 0x7fa61819c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:52:50.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.119+0000 7fa61ca48640 1 -- 172.21.15.1:0/2822544440 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa61810b6b0 msgr2=0x7fa61819d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:52:50.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.119+0000 7fa61ca48640 1 --2- 172.21.15.1:0/2822544440 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa61810b6b0 0x7fa61819d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:50.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.119+0000 7fa61ca48640 1 -- 172.21.15.1:0/2822544440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa61806c490 msgr2=0x7fa61819c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:52:50.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.119+0000 7fa61ca48640 1 --2- 172.21.15.1:0/2822544440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa61806c490 0x7fa61819c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:50.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.119+0000 7fa61ca48640 1 -- 172.21.15.1:0/2822544440 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa61819db90 con 0x7fa618108d00 2024-09-21T00:52:50.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.119+0000 7fa61ca48640 1 --2- 172.21.15.1:0/2822544440 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa618108d00 0x7fa61819c7d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa60800d950 tx=0x7fa60800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:52:50.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.120+0000 7fa60e7fc640 1 -- 172.21.15.1:0/2822544440 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa608017030 con 0x7fa618108d00 2024-09-21T00:52:50.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.120+0000 7fa60e7fc640 1 -- 172.21.15.1:0/2822544440 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa608004020 con 0x7fa618108d00 2024-09-21T00:52:50.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.120+0000 7fa61f4ad640 1 -- 172.21.15.1:0/2822544440 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa61819de80 con 0x7fa618108d00 2024-09-21T00:52:50.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.120+0000 7fa60e7fc640 1 -- 172.21.15.1:0/2822544440 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6080047a0 con 0x7fa618108d00 2024-09-21T00:52:50.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.120+0000 7fa61f4ad640 1 -- 172.21.15.1:0/2822544440 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6181a4580 con 0x7fa618108d00 2024-09-21T00:52:50.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.121+0000 7fa61f4ad640 1 -- 172.21.15.1:0/2822544440 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6180ffb00 con 0x7fa618108d00 2024-09-21T00:52:50.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.122+0000 7fa60e7fc640 1 -- 172.21.15.1:0/2822544440 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 154511+0+0 (secure 0 0 0) 0x7fa608009a30 con 0x7fa618108d00 2024-09-21T00:52:50.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.123+0000 7fa60e7fc640 1 --2- 172.21.15.1:0/2822544440 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa6040b6590 0x7fa6040b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:52:50.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.123+0000 7fa61d249640 1 --2- 172.21.15.1:0/2822544440 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa6040b6590 0x7fa6040b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:52:50.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.123+0000 7fa60e7fc640 1 -- 172.21.15.1:0/2822544440 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5582+0+0 (secure 0 0 0) 0x7fa6080e6220 con 0x7fa618108d00 2024-09-21T00:52:50.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.124+0000 7fa61d249640 1 --2- 172.21.15.1:0/2822544440 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa6040b6590 0x7fa6040b8aa0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa61400bbe0 tx=0x7fa61400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:52:50.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.127+0000 7fa60e7fc640 1 -- 172.21.15.1:0/2822544440 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa6080ad4c0 con 0x7fa618108d00 2024-09-21T00:52:50.229 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 00:52:49 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T00:52:49.748+0000 7efdacc94640 -1 osd.8 0 waiting for initial osdmap 2024-09-21T00:52:50.230 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 00:52:49 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T00:52:49.758+0000 7efda4a8a640 -1 osd.8 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:52:50.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:52:50.330+0000 7fa61f4ad640 1 -- 172.21.15.1:0/2822544440 --> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fa618063800 con 0x7fa6040b6590 2024-09-21T00:52:50.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:50 smithi001 ceph-mon[31211]: Detected new or changed devices on smithi193 2024-09-21T00:52:50.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:50 smithi001 ceph-mon[31211]: Adjusting osd_memory_target on smithi193 to 5696M 2024-09-21T00:52:50.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:50 smithi001 ceph-mon[31211]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-21T00:52:50.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:50 smithi001 ceph-mon[31211]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T00:52:50.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:50 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:52:50.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:50 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:52:50.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:50 smithi001 ceph-mon[31211]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T00:52:50.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:50 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:52:50.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:50 smithi001 ceph-mon[31211]: from='osd.8 ' entity='osd.8' 2024-09-21T00:52:50.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:50 smithi193 ceph-mon[34660]: Detected new or changed devices on smithi193 2024-09-21T00:52:50.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:50 smithi193 ceph-mon[34660]: Adjusting osd_memory_target on smithi193 to 5696M 2024-09-21T00:52:50.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:50 smithi193 ceph-mon[34660]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-21T00:52:50.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:50 smithi193 ceph-mon[34660]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T00:52:50.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:50 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:52:50.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:50 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:52:50.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:50 smithi193 ceph-mon[34660]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T00:52:50.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:50 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:52:50.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:50 smithi193 ceph-mon[34660]: from='osd.8 ' entity='osd.8' 2024-09-21T00:52:50.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:50 smithi042 ceph-mon[34481]: Detected new or changed devices on smithi193 2024-09-21T00:52:50.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:50 smithi042 ceph-mon[34481]: Adjusting osd_memory_target on smithi193 to 5696M 2024-09-21T00:52:50.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:50 smithi042 ceph-mon[34481]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-21T00:52:50.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:50 smithi042 ceph-mon[34481]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T00:52:50.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:50 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:52:50.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:50 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:52:50.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:50 smithi042 ceph-mon[34481]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T00:52:50.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:50 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:52:50.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:50 smithi042 ceph-mon[34481]: from='osd.8 ' entity='osd.8' 2024-09-21T00:52:51.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:51 smithi193 ceph-mon[34660]: purged_snaps scrub starts 2024-09-21T00:52:51.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:51 smithi193 ceph-mon[34660]: purged_snaps scrub ok 2024-09-21T00:52:51.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:51 smithi193 ceph-mon[34660]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:52:51.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:51 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:52:51.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:51 smithi193 ceph-mon[34660]: from='client.14607 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:51.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:51 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:52:51.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:51 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:52:51.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:51 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:51.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:51 smithi193 ceph-mon[34660]: osd.8 [v2:172.21.15.193:6816/2277449259,v1:172.21.15.193:6817/2277449259] boot 2024-09-21T00:52:51.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:51 smithi193 ceph-mon[34660]: osdmap e51: 9 total, 9 up, 9 in 2024-09-21T00:52:51.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:51 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:52:51.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:51 smithi001 ceph-mon[31211]: purged_snaps scrub starts 2024-09-21T00:52:51.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:51 smithi001 ceph-mon[31211]: purged_snaps scrub ok 2024-09-21T00:52:51.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:51 smithi001 ceph-mon[31211]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:52:51.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:51 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:52:51.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:51 smithi001 ceph-mon[31211]: from='client.14607 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:51.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:51 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:52:51.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:51 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:52:51.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:51 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:51.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:51 smithi001 ceph-mon[31211]: osd.8 [v2:172.21.15.193:6816/2277449259,v1:172.21.15.193:6817/2277449259] boot 2024-09-21T00:52:51.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:51 smithi001 ceph-mon[31211]: osdmap e51: 9 total, 9 up, 9 in 2024-09-21T00:52:51.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:51 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:52:51.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:51 smithi042 ceph-mon[34481]: purged_snaps scrub starts 2024-09-21T00:52:51.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:51 smithi042 ceph-mon[34481]: purged_snaps scrub ok 2024-09-21T00:52:51.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:51 smithi042 ceph-mon[34481]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:52:51.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:51 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:52:51.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:51 smithi042 ceph-mon[34481]: from='client.14607 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:51.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:51 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:52:51.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:51 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:52:51.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:51 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:51.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:51 smithi042 ceph-mon[34481]: osd.8 [v2:172.21.15.193:6816/2277449259,v1:172.21.15.193:6817/2277449259] boot 2024-09-21T00:52:51.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:51 smithi042 ceph-mon[34481]: osdmap e51: 9 total, 9 up, 9 in 2024-09-21T00:52:51.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:51 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:52:52.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:52 smithi001 ceph-mon[31211]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T00:52:52.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:52 smithi042 ceph-mon[34481]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T00:52:52.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:52 smithi193 ceph-mon[34660]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T00:52:53.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:53 smithi001 ceph-mon[31211]: pgmap v205: 1 pgs: 1 remapped+peering; 577 KiB data, 282 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:52:53.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:53 smithi001 ceph-mon[31211]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T00:52:53.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:53 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/475955083' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9e03e00b-0015-4aa8-adce-0d3352d2ca1d"} : dispatch 2024-09-21T00:52:53.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:53 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/475955083' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e03e00b-0015-4aa8-adce-0d3352d2ca1d"}]': finished 2024-09-21T00:52:53.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:53 smithi001 ceph-mon[31211]: osdmap e54: 10 total, 9 up, 10 in 2024-09-21T00:52:53.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:53 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:52:53.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:53 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/466338772' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:52:53.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:53 smithi193 ceph-mon[34660]: pgmap v205: 1 pgs: 1 remapped+peering; 577 KiB data, 282 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:52:53.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:53 smithi193 ceph-mon[34660]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T00:52:53.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:53 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/475955083' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9e03e00b-0015-4aa8-adce-0d3352d2ca1d"} : dispatch 2024-09-21T00:52:53.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:53 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/475955083' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e03e00b-0015-4aa8-adce-0d3352d2ca1d"}]': finished 2024-09-21T00:52:53.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:53 smithi193 ceph-mon[34660]: osdmap e54: 10 total, 9 up, 10 in 2024-09-21T00:52:53.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:53 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:52:53.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:53 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/466338772' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:52:53.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:53 smithi042 ceph-mon[34481]: pgmap v205: 1 pgs: 1 remapped+peering; 577 KiB data, 282 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:52:53.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:53 smithi042 ceph-mon[34481]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T00:52:53.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:53 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/475955083' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9e03e00b-0015-4aa8-adce-0d3352d2ca1d"} : dispatch 2024-09-21T00:52:53.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:53 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/475955083' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e03e00b-0015-4aa8-adce-0d3352d2ca1d"}]': finished 2024-09-21T00:52:53.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:53 smithi042 ceph-mon[34481]: osdmap e54: 10 total, 9 up, 10 in 2024-09-21T00:52:53.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:53 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:52:53.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:53 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/466338772' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:52:55.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:55 smithi001 ceph-mon[31211]: pgmap v208: 1 pgs: 1 remapped+peering; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:52:55.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:55 smithi193 ceph-mon[34660]: pgmap v208: 1 pgs: 1 remapped+peering; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:52:55.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:55 smithi042 ceph-mon[34481]: pgmap v208: 1 pgs: 1 remapped+peering; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:52:57.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:57 smithi001 ceph-mon[31211]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-21T00:52:57.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:57 smithi193 ceph-mon[34660]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-21T00:52:57.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:57 smithi042 ceph-mon[34481]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-21T00:52:59.955 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:52:59 smithi001 ceph-mon[31211]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-21T00:52:59.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:52:59 smithi193 ceph-mon[34660]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-21T00:52:59.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:52:59 smithi042 ceph-mon[34481]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-21T00:53:01.886 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:01 smithi001 ceph-mon[31211]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T00:53:01.887 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:01 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T00:53:01.887 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:01 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:01.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:01 smithi193 ceph-mon[34660]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T00:53:01.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:01 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T00:53:01.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:01 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:01.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:01 smithi042 ceph-mon[34481]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T00:53:01.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:01 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T00:53:01.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:01 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:02.780 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:02 smithi001 ceph-mon[31211]: Deploying daemon osd.9 on smithi001 2024-09-21T00:53:02.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:02 smithi193 ceph-mon[34660]: Deploying daemon osd.9 on smithi001 2024-09-21T00:53:02.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:02 smithi042 ceph-mon[34481]: Deploying daemon osd.9 on smithi001 2024-09-21T00:53:03.863 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:03 smithi001 ceph-mon[31211]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-21T00:53:03.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:03 smithi193 ceph-mon[34660]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-21T00:53:03.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:03 smithi042 ceph-mon[34481]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-21T00:53:05.889 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:05 smithi001 ceph-mon[31211]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T00:53:05.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:05 smithi193 ceph-mon[34660]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T00:53:05.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:05 smithi042 ceph-mon[34481]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T00:53:07.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:07 smithi001 ceph-mon[31211]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:53:07.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:07 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:53:07.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:07 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:07.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:07 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:07.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:07 smithi193 ceph-mon[34660]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:53:07.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:07 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:53:07.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:07 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:07.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:07 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:07.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:07 smithi042 ceph-mon[34481]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:53:07.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:07 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:53:07.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:07 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:07.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:07 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:09.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:09 smithi001 ceph-mon[31211]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:53:09.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:09 smithi193 ceph-mon[34660]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:53:09.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:09 smithi042 ceph-mon[34481]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:53:11.233 INFO:teuthology.orchestra.run.smithi001.stdout:Created osd(s) 9 on host 'smithi001' 2024-09-21T00:53:11.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:53:11.232+0000 7fa60e7fc640 1 -- 172.21.15.1:0/2822544440 <== mgr.14150 v2:172.21.15.1:6800/2032980330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa618063800 con 0x7fa6040b6590 2024-09-21T00:53:11.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:53:11.235+0000 7fa61f4ad640 1 -- 172.21.15.1:0/2822544440 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa6040b6590 msgr2=0x7fa6040b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:11.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:53:11.235+0000 7fa61f4ad640 1 --2- 172.21.15.1:0/2822544440 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa6040b6590 0x7fa6040b8aa0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa61400bbe0 tx=0x7fa61400b390 comp rx=0 tx=0).stop 2024-09-21T00:53:11.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:53:11.235+0000 7fa61f4ad640 1 -- 172.21.15.1:0/2822544440 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa618108d00 msgr2=0x7fa61819c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:11.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:53:11.235+0000 7fa61f4ad640 1 --2- 172.21.15.1:0/2822544440 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa618108d00 0x7fa61819c7d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa60800d950 tx=0x7fa60800de10 comp rx=0 tx=0).stop 2024-09-21T00:53:11.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:53:11.235+0000 7fa61f4ad640 1 -- 172.21.15.1:0/2822544440 shutdown_connections 2024-09-21T00:53:11.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:53:11.235+0000 7fa61f4ad640 1 --2- 172.21.15.1:0/2822544440 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa61810b6b0 0x7fa61819d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:11.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:53:11.235+0000 7fa61f4ad640 1 --2- 172.21.15.1:0/2822544440 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa6040b6590 0x7fa6040b8aa0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:11.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:53:11.235+0000 7fa61f4ad640 1 --2- 172.21.15.1:0/2822544440 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa618108d00 0x7fa61819c7d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:11.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:53:11.235+0000 7fa61f4ad640 1 --2- 172.21.15.1:0/2822544440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa61806c490 0x7fa61819c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:11.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:53:11.235+0000 7fa61f4ad640 1 -- 172.21.15.1:0/2822544440 >> 172.21.15.1:0/2822544440 conn(0x7fa6180fdfe0 msgr2=0x7fa618109b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:11.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:53:11.235+0000 7fa61f4ad640 1 -- 172.21.15.1:0/2822544440 shutdown_connections 2024-09-21T00:53:11.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:53:11.235+0000 7fa61f4ad640 1 -- 172.21.15.1:0/2822544440 wait complete. 2024-09-21T00:53:11.782 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:11 smithi193 ceph-mon[34660]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:53:11.782 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:11 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:11.782 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:11 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:11.782 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:11 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:11.782 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:11 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:53:11.782 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:11 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:11.782 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:11 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:53:11.783 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:11 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:11.783 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:11 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:11.794 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:11 smithi042 ceph-mon[34481]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:53:11.795 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:11.795 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:11.795 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:11.795 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:53:11.795 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:11.795 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:53:11.795 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:11.795 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:11.903 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:11 smithi001 ceph-mon[31211]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:53:11.903 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:11 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:11.903 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:11 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:11.903 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:11 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:11.903 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:11 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:53:11.903 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:11 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:11.903 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:11 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:53:11.904 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:11 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:11.904 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:11 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:11.930 DEBUG:teuthology.orchestra.run.smithi001:osd.9> sudo journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@osd.9.service 2024-09-21T00:53:11.932 INFO:tasks.cephadm:Deploying osd.10 on smithi042 with /dev/vg_nvme/lv_1... 2024-09-21T00:53:11.932 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T00:53:12.193 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T00:53:13.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:13 smithi001 ceph-mon[31211]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:53:13.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 00:53:13 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T00:53:13.600+0000 7fb0ddef5640 -1 osd.9 0 log_to_monitors true 2024-09-21T00:53:13.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:13 smithi042 ceph-mon[34481]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:53:13.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:13 smithi193 ceph-mon[34660]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:53:14.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:14 smithi001 ceph-mon[31211]: from='osd.9 [v2:172.21.15.1:6826/1369323215,v1:172.21.15.1:6827/1369323215]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T00:53:14.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:14 smithi193 ceph-mon[34660]: from='osd.9 [v2:172.21.15.1:6826/1369323215,v1:172.21.15.1:6827/1369323215]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T00:53:14.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:14 smithi042 ceph-mon[34481]: from='osd.9 [v2:172.21.15.1:6826/1369323215,v1:172.21.15.1:6827/1369323215]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T00:53:15.009 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-21T00:53:15.037 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi042:vg_nvme/lv_1 2024-09-21T00:53:15.291 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T00:53:15.696 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:15 smithi042 ceph-mon[34481]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:53:15.697 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:15 smithi042 ceph-mon[34481]: from='osd.9 [v2:172.21.15.1:6826/1369323215,v1:172.21.15.1:6827/1369323215]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T00:53:15.697 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:15 smithi042 ceph-mon[34481]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T00:53:15.697 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:15 smithi042 ceph-mon[34481]: from='osd.9 [v2:172.21.15.1:6826/1369323215,v1:172.21.15.1:6827/1369323215]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]} : dispatch 2024-09-21T00:53:15.697 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:15 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:53:15.697 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:15 smithi042 ceph-mon[34481]: Detected new or changed devices on smithi001 2024-09-21T00:53:15.697 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:15 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:15.697 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:15 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:15.697 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:15 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:15.697 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:15 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:15.697 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:15 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:15.697 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:15 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:15.697 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:15 smithi042 ceph-mon[34481]: Adjusting osd_memory_target on smithi001 to 4273M 2024-09-21T00:53:15.697 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:15 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:15.697 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:15 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:15.698 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:15 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:53:15.698 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:15 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:15.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.790+0000 7f483d2f7640 1 -- 172.21.15.42:0/934365149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4838101b80 msgr2=0x7f4838101f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:15.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.790+0000 7f483d2f7640 1 --2- 172.21.15.42:0/934365149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4838101b80 0x7f4838101f90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4828009900 tx=0x7f482802a410 comp rx=0 tx=0).stop 2024-09-21T00:53:15.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.790+0000 7f483d2f7640 1 -- 172.21.15.42:0/934365149 shutdown_connections 2024-09-21T00:53:15.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.790+0000 7f483d2f7640 1 --2- 172.21.15.42:0/934365149 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f48381094b0 0x7f483810b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:15.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.790+0000 7f483d2f7640 1 --2- 172.21.15.42:0/934365149 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48381025b0 0x7f4838108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:15.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.790+0000 7f483d2f7640 1 --2- 172.21.15.42:0/934365149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4838101b80 0x7f4838101f90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:15.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.790+0000 7f483d2f7640 1 -- 172.21.15.42:0/934365149 >> 172.21.15.42:0/934365149 conn(0x7f48380fd770 msgr2=0x7f48380ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:15.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.790+0000 7f483d2f7640 1 -- 172.21.15.42:0/934365149 shutdown_connections 2024-09-21T00:53:15.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.790+0000 7f483d2f7640 1 -- 172.21.15.42:0/934365149 wait complete. 2024-09-21T00:53:15.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.791+0000 7f483d2f7640 1 Processor -- start 2024-09-21T00:53:15.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.791+0000 7f483d2f7640 1 -- start start 2024-09-21T00:53:15.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.791+0000 7f483d2f7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4838101b80 0x7f483819a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:15.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.791+0000 7f483d2f7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f48381025b0 0x7f483819a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:15.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.791+0000 7f483d2f7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48381094b0 0x7f483819b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:15.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.791+0000 7f483d2f7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f483810f410 con 0x7f48381094b0 2024-09-21T00:53:15.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.791+0000 7f483d2f7640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f483810f290 con 0x7f4838101b80 2024-09-21T00:53:15.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.791+0000 7f483d2f7640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f483810f590 con 0x7f48381025b0 2024-09-21T00:53:15.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.791+0000 7f4836ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4838101b80 0x7f483819a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:15.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.791+0000 7f4836ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4838101b80 0x7f483819a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52214/0 (socket says 172.21.15.42:52214) 2024-09-21T00:53:15.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.791+0000 7f4836ffd640 1 -- 172.21.15.42:0/2413504040 learned_addr learned my addr 172.21.15.42:0/2413504040 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-21T00:53:15.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.791+0000 7f48377fe640 1 --2- 172.21.15.42:0/2413504040 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48381094b0 0x7f483819b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:15.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.791+0000 7f482ffff640 1 --2- 172.21.15.42:0/2413504040 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f48381025b0 0x7f483819a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:15.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.792+0000 7f4836ffd640 1 -- 172.21.15.42:0/2413504040 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f48381025b0 msgr2=0x7f483819a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:15.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.792+0000 7f4836ffd640 1 --2- 172.21.15.42:0/2413504040 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f48381025b0 0x7f483819a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:15.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.792+0000 7f4836ffd640 1 -- 172.21.15.42:0/2413504040 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48381094b0 msgr2=0x7f483819b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:15.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.792+0000 7f4836ffd640 1 --2- 172.21.15.42:0/2413504040 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48381094b0 0x7f483819b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:15.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.792+0000 7f4836ffd640 1 -- 172.21.15.42:0/2413504040 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f483819ba30 con 0x7f4838101b80 2024-09-21T00:53:15.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.792+0000 7f48377fe640 1 --2- 172.21.15.42:0/2413504040 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48381094b0 0x7f483819b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:53:15.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.792+0000 7f4836ffd640 1 --2- 172.21.15.42:0/2413504040 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4838101b80 0x7f483819a000 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4828006010 tx=0x7f48280043b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:15.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.792+0000 7f4834ff9640 1 -- 172.21.15.42:0/2413504040 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f482803f030 con 0x7f4838101b80 2024-09-21T00:53:15.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.792+0000 7f483d2f7640 1 -- 172.21.15.42:0/2413504040 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f483819bcc0 con 0x7f4838101b80 2024-09-21T00:53:15.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.792+0000 7f4834ff9640 1 -- 172.21.15.42:0/2413504040 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4828003cb0 con 0x7f4838101b80 2024-09-21T00:53:15.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.792+0000 7f4834ff9640 1 -- 172.21.15.42:0/2413504040 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4828035070 con 0x7f4838101b80 2024-09-21T00:53:15.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.792+0000 7f483d2f7640 1 -- 172.21.15.42:0/2413504040 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48381a22d0 con 0x7f4838101b80 2024-09-21T00:53:15.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.793+0000 7f483d2f7640 1 -- 172.21.15.42:0/2413504040 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48380ff290 con 0x7f4838101b80 2024-09-21T00:53:15.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.795+0000 7f4834ff9640 1 -- 172.21.15.42:0/2413504040 <== mon.2 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 154511+0+0 (secure 0 0 0) 0x7f4828042030 con 0x7f4838101b80 2024-09-21T00:53:15.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.795+0000 7f4834ff9640 1 --2- 172.21.15.42:0/2413504040 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f48240b6510 0x7f48240b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:15.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.795+0000 7f4834ff9640 1 -- 172.21.15.42:0/2413504040 <== mon.2 v2:172.21.15.42:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5981+0+0 (secure 0 0 0) 0x7f4828107900 con 0x7f4838101b80 2024-09-21T00:53:15.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.796+0000 7f482ffff640 1 --2- 172.21.15.42:0/2413504040 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f48240b6510 0x7f48240b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:15.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.796+0000 7f482ffff640 1 --2- 172.21.15.42:0/2413504040 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f48240b6510 0x7f48240b8a20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f48200058c0 tx=0x7f482000a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:15.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.799+0000 7f4834ff9640 1 -- 172.21.15.42:0/2413504040 <== mon.2 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f48280ceab0 con 0x7f4838101b80 2024-09-21T00:53:15.960 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 00:53:15 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T00:53:15.539+0000 7fb0d9e77640 -1 osd.9 0 waiting for initial osdmap 2024-09-21T00:53:15.960 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 00:53:15 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T00:53:15.552+0000 7fb0d5c75640 -1 osd.9 56 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:53:15.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:15 smithi001 ceph-mon[31211]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:53:15.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:15 smithi001 ceph-mon[31211]: from='osd.9 [v2:172.21.15.1:6826/1369323215,v1:172.21.15.1:6827/1369323215]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T00:53:15.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:15 smithi001 ceph-mon[31211]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T00:53:15.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:15 smithi001 ceph-mon[31211]: from='osd.9 [v2:172.21.15.1:6826/1369323215,v1:172.21.15.1:6827/1369323215]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]} : dispatch 2024-09-21T00:53:15.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:15 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:53:15.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:15 smithi001 ceph-mon[31211]: Detected new or changed devices on smithi001 2024-09-21T00:53:15.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:15 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:15.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:15 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:15.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:15 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:15.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:15 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:15.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:15 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:15.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:15 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:15.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:15 smithi001 ceph-mon[31211]: Adjusting osd_memory_target on smithi001 to 4273M 2024-09-21T00:53:15.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:15 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:15.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:15 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:15.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:15 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:53:15.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:15 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:15.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:15 smithi193 ceph-mon[34660]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:53:15.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:15 smithi193 ceph-mon[34660]: from='osd.9 [v2:172.21.15.1:6826/1369323215,v1:172.21.15.1:6827/1369323215]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T00:53:15.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:15 smithi193 ceph-mon[34660]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T00:53:15.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:15 smithi193 ceph-mon[34660]: from='osd.9 [v2:172.21.15.1:6826/1369323215,v1:172.21.15.1:6827/1369323215]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]} : dispatch 2024-09-21T00:53:15.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:15 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:53:15.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:15 smithi193 ceph-mon[34660]: Detected new or changed devices on smithi001 2024-09-21T00:53:15.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:15 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:15.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:15 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:15.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:15 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:15.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:15 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:15.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:15 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:15.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:15 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:15.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:15 smithi193 ceph-mon[34660]: Adjusting osd_memory_target on smithi001 to 4273M 2024-09-21T00:53:15.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:15 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:15.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:15 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:15.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:15 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:53:15.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:15 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:15.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:15.998+0000 7f483d2f7640 1 -- 172.21.15.42:0/2413504040 --> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f4838063800 con 0x7f48240b6510 2024-09-21T00:53:16.650 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:16 smithi042 ceph-mon[34481]: from='osd.9 [v2:172.21.15.1:6826/1369323215,v1:172.21.15.1:6827/1369323215]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-21T00:53:16.650 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:16 smithi042 ceph-mon[34481]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T00:53:16.650 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:16 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:53:16.651 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:16 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:53:16.651 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:16 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:53:16.651 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:16 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:53:16.651 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:16 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:16.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:16 smithi001 ceph-mon[31211]: from='osd.9 [v2:172.21.15.1:6826/1369323215,v1:172.21.15.1:6827/1369323215]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-21T00:53:16.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:16 smithi001 ceph-mon[31211]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T00:53:16.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:16 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:53:16.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:16 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:53:16.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:16 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:53:16.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:16 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:53:16.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:16 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:16.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:16 smithi193 ceph-mon[34660]: from='osd.9 [v2:172.21.15.1:6826/1369323215,v1:172.21.15.1:6827/1369323215]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-21T00:53:16.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:16 smithi193 ceph-mon[34660]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T00:53:16.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:16 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:53:16.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:16 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:53:16.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:16 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:53:16.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:16 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:53:16.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:16 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:17.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:17 smithi042 ceph-mon[34481]: purged_snaps scrub starts 2024-09-21T00:53:17.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:17 smithi042 ceph-mon[34481]: purged_snaps scrub ok 2024-09-21T00:53:17.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:17 smithi042 ceph-mon[34481]: from='client.24488 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:17.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:17 smithi042 ceph-mon[34481]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:53:17.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:17 smithi042 ceph-mon[34481]: osd.9 [v2:172.21.15.1:6826/1369323215,v1:172.21.15.1:6827/1369323215] boot 2024-09-21T00:53:17.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:17 smithi042 ceph-mon[34481]: osdmap e57: 10 total, 10 up, 10 in 2024-09-21T00:53:17.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:53:17.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:17 smithi001 ceph-mon[31211]: purged_snaps scrub starts 2024-09-21T00:53:17.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:17 smithi001 ceph-mon[31211]: purged_snaps scrub ok 2024-09-21T00:53:17.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:17 smithi001 ceph-mon[31211]: from='client.24488 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:17.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:17 smithi001 ceph-mon[31211]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:53:17.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:17 smithi001 ceph-mon[31211]: osd.9 [v2:172.21.15.1:6826/1369323215,v1:172.21.15.1:6827/1369323215] boot 2024-09-21T00:53:17.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:17 smithi001 ceph-mon[31211]: osdmap e57: 10 total, 10 up, 10 in 2024-09-21T00:53:17.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:53:17.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:17 smithi193 ceph-mon[34660]: purged_snaps scrub starts 2024-09-21T00:53:17.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:17 smithi193 ceph-mon[34660]: purged_snaps scrub ok 2024-09-21T00:53:17.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:17 smithi193 ceph-mon[34660]: from='client.24488 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:17.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:17 smithi193 ceph-mon[34660]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:53:17.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:17 smithi193 ceph-mon[34660]: osd.9 [v2:172.21.15.1:6826/1369323215,v1:172.21.15.1:6827/1369323215] boot 2024-09-21T00:53:17.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:17 smithi193 ceph-mon[34660]: osdmap e57: 10 total, 10 up, 10 in 2024-09-21T00:53:17.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:53:18.867 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:18 smithi042 ceph-mon[34481]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T00:53:18.867 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:18 smithi042 ceph-mon[34481]: from='client.? 172.21.15.42:0/900568723' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "de55a908-b049-4f40-865f-cfa2ae6e461f"} : dispatch 2024-09-21T00:53:18.867 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:18 smithi042 ceph-mon[34481]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "de55a908-b049-4f40-865f-cfa2ae6e461f"} : dispatch 2024-09-21T00:53:18.867 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:18 smithi042 ceph-mon[34481]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de55a908-b049-4f40-865f-cfa2ae6e461f"}]': finished 2024-09-21T00:53:18.867 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:18 smithi042 ceph-mon[34481]: osdmap e59: 11 total, 10 up, 11 in 2024-09-21T00:53:18.867 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:18 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:53:18.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:18 smithi001 ceph-mon[31211]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T00:53:18.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:18 smithi001 ceph-mon[31211]: from='client.? 172.21.15.42:0/900568723' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "de55a908-b049-4f40-865f-cfa2ae6e461f"} : dispatch 2024-09-21T00:53:18.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:18 smithi001 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "de55a908-b049-4f40-865f-cfa2ae6e461f"} : dispatch 2024-09-21T00:53:18.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:18 smithi001 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de55a908-b049-4f40-865f-cfa2ae6e461f"}]': finished 2024-09-21T00:53:18.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:18 smithi001 ceph-mon[31211]: osdmap e59: 11 total, 10 up, 11 in 2024-09-21T00:53:18.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:18 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:53:18.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:18 smithi193 ceph-mon[34660]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T00:53:18.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:18 smithi193 ceph-mon[34660]: from='client.? 172.21.15.42:0/900568723' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "de55a908-b049-4f40-865f-cfa2ae6e461f"} : dispatch 2024-09-21T00:53:18.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:18 smithi193 ceph-mon[34660]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "de55a908-b049-4f40-865f-cfa2ae6e461f"} : dispatch 2024-09-21T00:53:18.982 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:18 smithi193 ceph-mon[34660]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de55a908-b049-4f40-865f-cfa2ae6e461f"}]': finished 2024-09-21T00:53:18.982 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:18 smithi193 ceph-mon[34660]: osdmap e59: 11 total, 10 up, 11 in 2024-09-21T00:53:18.982 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:18 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:53:19.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:19 smithi001 ceph-mon[31211]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:19.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:19 smithi001 ceph-mon[31211]: from='client.? 172.21.15.42:0/179426388' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:53:19.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:19 smithi193 ceph-mon[34660]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:19.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:19 smithi193 ceph-mon[34660]: from='client.? 172.21.15.42:0/179426388' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:53:19.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:19 smithi042 ceph-mon[34481]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:19.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:19 smithi042 ceph-mon[34481]: from='client.? 172.21.15.42:0/179426388' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:53:21.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:21 smithi001 ceph-mon[31211]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:21.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:21 smithi193 ceph-mon[34660]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:21.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:21 smithi042 ceph-mon[34481]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:23.907 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:23 smithi042 ceph-mon[34481]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:23.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:23 smithi001 ceph-mon[31211]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:23.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:23 smithi193 ceph-mon[34660]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:25.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:25 smithi042 ceph-mon[34481]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:25.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:25 smithi001 ceph-mon[31211]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:25.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:25 smithi193 ceph-mon[34660]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:27.871 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:27 smithi042 ceph-mon[34481]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:27.871 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:27 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T00:53:27.871 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:27 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:27.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:27 smithi001 ceph-mon[31211]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:27.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:27 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T00:53:27.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:27 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:27.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:27 smithi193 ceph-mon[34660]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:27.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:27 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T00:53:27.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:27 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:28.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:28 smithi042 ceph-mon[34481]: Deploying daemon osd.10 on smithi042 2024-09-21T00:53:28.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:28 smithi001 ceph-mon[31211]: Deploying daemon osd.10 on smithi042 2024-09-21T00:53:28.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:28 smithi193 ceph-mon[34660]: Deploying daemon osd.10 on smithi042 2024-09-21T00:53:29.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:29 smithi042 ceph-mon[34481]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:29.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:29 smithi001 ceph-mon[31211]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:29.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:29 smithi193 ceph-mon[34660]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:31.869 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:31 smithi042 ceph-mon[34481]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:31.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:31 smithi001 ceph-mon[31211]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:31.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:31 smithi193 ceph-mon[34660]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:33.872 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:33 smithi042 ceph-mon[34481]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:33.872 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:33 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:53:33.872 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:33 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:33.872 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:33 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:33.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:33 smithi001 ceph-mon[31211]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:33.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:33 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:53:33.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:33 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:33.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:33 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:33.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:33 smithi193 ceph-mon[34660]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:33.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:33 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:53:33.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:33 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:33.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:33 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:35.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:35 smithi001 ceph-mon[31211]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:35.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:35 smithi193 ceph-mon[34660]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:35.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:35 smithi042 ceph-mon[34481]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:37.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:37.199+0000 7f4834ff9640 1 -- 172.21.15.42:0/2413504040 <== mgr.14150 v2:172.21.15.1:6800/2032980330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f4838063800 con 0x7f48240b6510 2024-09-21T00:53:37.200 INFO:teuthology.orchestra.run.smithi042.stdout:Created osd(s) 10 on host 'smithi042' 2024-09-21T00:53:37.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:37.202+0000 7f483d2f7640 1 -- 172.21.15.42:0/2413504040 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f48240b6510 msgr2=0x7f48240b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:37.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:37.202+0000 7f483d2f7640 1 --2- 172.21.15.42:0/2413504040 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f48240b6510 0x7f48240b8a20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f48200058c0 tx=0x7f482000a4c0 comp rx=0 tx=0).stop 2024-09-21T00:53:37.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:37.202+0000 7f483d2f7640 1 -- 172.21.15.42:0/2413504040 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4838101b80 msgr2=0x7f483819a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:37.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:37.202+0000 7f483d2f7640 1 --2- 172.21.15.42:0/2413504040 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4838101b80 0x7f483819a000 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4828006010 tx=0x7f48280043b0 comp rx=0 tx=0).stop 2024-09-21T00:53:37.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:37.202+0000 7f483d2f7640 1 -- 172.21.15.42:0/2413504040 shutdown_connections 2024-09-21T00:53:37.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:37.202+0000 7f483d2f7640 1 --2- 172.21.15.42:0/2413504040 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f48240b6510 0x7f48240b8a20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:37.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:37.202+0000 7f483d2f7640 1 --2- 172.21.15.42:0/2413504040 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48381094b0 0x7f483819b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:37.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:37.202+0000 7f483d2f7640 1 --2- 172.21.15.42:0/2413504040 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f48381025b0 0x7f483819a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:37.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:37.202+0000 7f483d2f7640 1 --2- 172.21.15.42:0/2413504040 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4838101b80 0x7f483819a000 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:37.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:37.202+0000 7f483d2f7640 1 -- 172.21.15.42:0/2413504040 >> 172.21.15.42:0/2413504040 conn(0x7f48380fd770 msgr2=0x7f4838107750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:37.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:37.202+0000 7f483d2f7640 1 -- 172.21.15.42:0/2413504040 shutdown_connections 2024-09-21T00:53:37.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-21T00:53:37.202+0000 7f483d2f7640 1 -- 172.21.15.42:0/2413504040 wait complete. 2024-09-21T00:53:37.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:37 smithi042 ceph-mon[34481]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:37.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:37 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:37.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:37 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:37.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:37 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:37.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:37 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:53:37.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:37 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:37.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:37 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:53:37.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:37 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:37.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:37 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:37.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:37 smithi001 ceph-mon[31211]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:37.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:37 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:37.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:37 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:37.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:37 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:37.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:37 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:53:37.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:37 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:37.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:37 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:53:37.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:37 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:37.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:37 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:37.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:37 smithi193 ceph-mon[34660]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:37.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:37 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:37.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:37 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:37.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:37 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:37.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:37 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:53:37.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:37 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:37.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:37 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:53:37.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:37 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:37.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:37 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:37.913 DEBUG:teuthology.orchestra.run.smithi042:osd.10> sudo journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@osd.10.service 2024-09-21T00:53:37.915 INFO:tasks.cephadm:Deploying osd.11 on smithi193 with /dev/vg_nvme/lv_1... 2024-09-21T00:53:37.915 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T00:53:38.170 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:53:39.486 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:39 smithi042 ceph-mon[34481]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:39.673 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:39 smithi193 ceph-mon[34660]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:39.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:39 smithi001 ceph-mon[31211]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:39.742 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 00:53:39 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T00:53:39.535+0000 7f221b40f640 -1 osd.10 0 log_to_monitors true 2024-09-21T00:53:40.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:40 smithi042 ceph-mon[34481]: from='osd.10 [v2:172.21.15.42:6824/3182218295,v1:172.21.15.42:6825/3182218295]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T00:53:40.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:40 smithi042 ceph-mon[34481]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T00:53:40.651 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:40 smithi193 ceph-mon[34660]: from='osd.10 [v2:172.21.15.42:6824/3182218295,v1:172.21.15.42:6825/3182218295]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T00:53:40.651 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:40 smithi193 ceph-mon[34660]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T00:53:40.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:40 smithi001 ceph-mon[31211]: from='osd.10 [v2:172.21.15.42:6824/3182218295,v1:172.21.15.42:6825/3182218295]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T00:53:40.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:40 smithi001 ceph-mon[31211]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T00:53:40.780 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-21T00:53:40.807 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi193:vg_nvme/lv_1 2024-09-21T00:53:41.059 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:53:41.440 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:41 smithi193 ceph-mon[34660]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:41.440 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:41 smithi193 ceph-mon[34660]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T00:53:41.441 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:41 smithi193 ceph-mon[34660]: from='osd.10 [v2:172.21.15.42:6824/3182218295,v1:172.21.15.42:6825/3182218295]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T00:53:41.441 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:41 smithi193 ceph-mon[34660]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T00:53:41.441 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:41 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:53:41.441 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:41 smithi193 ceph-mon[34660]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T00:53:41.441 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:41 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:41.441 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:41 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:41.441 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:41 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:41.441 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:41 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:41.441 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:41 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:41.441 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:41 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:41.441 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:41 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:41.441 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:41 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:41.441 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:41 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:53:41.441 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:41 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:41.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.532+0000 7f19f17fd640 1 -- 172.21.15.193:0/1391607072 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19ec06c340 msgr2=0x7f19ec1063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:41.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.532+0000 7f19f17fd640 1 --2- 172.21.15.193:0/1391607072 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19ec06c340 0x7f19ec1063b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f19d4009900 tx=0x7f19d402a410 comp rx=0 tx=0).stop 2024-09-21T00:53:41.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.532+0000 7f19f17fd640 1 -- 172.21.15.193:0/1391607072 shutdown_connections 2024-09-21T00:53:41.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.532+0000 7f19f17fd640 1 --2- 172.21.15.193:0/1391607072 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19ec109490 0x7f19ec10b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:41.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.532+0000 7f19f17fd640 1 --2- 172.21.15.193:0/1391607072 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19ec1068f0 0x7f19ec108d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:41.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.532+0000 7f19f17fd640 1 --2- 172.21.15.193:0/1391607072 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19ec06c340 0x7f19ec1063b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:41.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.532+0000 7f19f17fd640 1 -- 172.21.15.193:0/1391607072 >> 172.21.15.193:0/1391607072 conn(0x7f19ec0fdfd0 msgr2=0x7f19ec100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:41.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.532+0000 7f19f17fd640 1 -- 172.21.15.193:0/1391607072 shutdown_connections 2024-09-21T00:53:41.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.532+0000 7f19f17fd640 1 -- 172.21.15.193:0/1391607072 wait complete. 2024-09-21T00:53:41.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.533+0000 7f19f17fd640 1 Processor -- start 2024-09-21T00:53:41.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.533+0000 7f19f17fd640 1 -- start start 2024-09-21T00:53:41.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.533+0000 7f19f17fd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19ec06c340 0x7f19ec1039e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:41.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.533+0000 7f19f17fd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19ec1068f0 0x7f19ec1022b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:41.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.533+0000 7f19f17fd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19ec109490 0x7f19ec1027f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:41.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.533+0000 7f19f17fd640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f19ec10f3f0 con 0x7f19ec06c340 2024-09-21T00:53:41.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.533+0000 7f19f17fd640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f19ec10f270 con 0x7f19ec1068f0 2024-09-21T00:53:41.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.533+0000 7f19f17fd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f19ec10f570 con 0x7f19ec109490 2024-09-21T00:53:41.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.534+0000 7f19eb7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19ec109490 0x7f19ec1027f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:41.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.534+0000 7f19eb7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19ec109490 0x7f19ec1027f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.193:51604/0 (socket says 172.21.15.193:51604) 2024-09-21T00:53:41.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.534+0000 7f19eb7fe640 1 -- 172.21.15.193:0/1494193912 learned_addr learned my addr 172.21.15.193:0/1494193912 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-21T00:53:41.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.534+0000 7f19ea7fc640 1 --2- 172.21.15.193:0/1494193912 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19ec1068f0 0x7f19ec1022b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:41.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.534+0000 7f19eaffd640 1 --2- 172.21.15.193:0/1494193912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19ec06c340 0x7f19ec1039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:41.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.534+0000 7f19eb7fe640 1 -- 172.21.15.193:0/1494193912 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19ec1068f0 msgr2=0x7f19ec1022b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:41.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.534+0000 7f19eb7fe640 1 --2- 172.21.15.193:0/1494193912 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19ec1068f0 0x7f19ec1022b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:41.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.534+0000 7f19eb7fe640 1 -- 172.21.15.193:0/1494193912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19ec06c340 msgr2=0x7f19ec1039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:41.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.534+0000 7f19eb7fe640 1 --2- 172.21.15.193:0/1494193912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19ec06c340 0x7f19ec1039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:41.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.534+0000 7f19eb7fe640 1 -- 172.21.15.193:0/1494193912 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19ec102e60 con 0x7f19ec109490 2024-09-21T00:53:41.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.534+0000 7f19eb7fe640 1 --2- 172.21.15.193:0/1494193912 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19ec109490 0x7f19ec1027f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f19e400cce0 tx=0x7f19e400a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:41.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.534+0000 7f19e3fff640 1 -- 172.21.15.193:0/1494193912 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e400f450 con 0x7f19ec109490 2024-09-21T00:53:41.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.534+0000 7f19e3fff640 1 -- 172.21.15.193:0/1494193912 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19e400faa0 con 0x7f19ec109490 2024-09-21T00:53:41.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.534+0000 7f19f17fd640 1 -- 172.21.15.193:0/1494193912 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19ec1a4170 con 0x7f19ec109490 2024-09-21T00:53:41.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.534+0000 7f19e3fff640 1 -- 172.21.15.193:0/1494193912 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e4018a80 con 0x7f19ec109490 2024-09-21T00:53:41.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.534+0000 7f19f17fd640 1 -- 172.21.15.193:0/1494193912 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19ec1a4590 con 0x7f19ec109490 2024-09-21T00:53:41.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.535+0000 7f19f17fd640 1 -- 172.21.15.193:0/1494193912 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19ec106d40 con 0x7f19ec109490 2024-09-21T00:53:41.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.538+0000 7f19e3fff640 1 -- 172.21.15.193:0/1494193912 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 16) ==== 154511+0+0 (secure 0 0 0) 0x7f19e400fc50 con 0x7f19ec109490 2024-09-21T00:53:41.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.539+0000 7f19e3fff640 1 --2- 172.21.15.193:0/1494193912 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f19d80b6510 0x7f19d80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:41.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.539+0000 7f19e3fff640 1 -- 172.21.15.193:0/1494193912 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6414+0+0 (secure 0 0 0) 0x7f19e40e74e0 con 0x7f19ec109490 2024-09-21T00:53:41.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.539+0000 7f19eaffd640 1 --2- 172.21.15.193:0/1494193912 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f19d80b6510 0x7f19d80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:41.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.540+0000 7f19eaffd640 1 --2- 172.21.15.193:0/1494193912 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f19d80b6510 0x7f19d80b8a20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f19d4031440 tx=0x7f19d4009610 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:41.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.542+0000 7f19e3fff640 1 -- 172.21.15.193:0/1494193912 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f19e4014030 con 0x7f19ec109490 2024-09-21T00:53:41.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:41 smithi001 ceph-mon[31211]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:41.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:41 smithi001 ceph-mon[31211]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T00:53:41.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:41 smithi001 ceph-mon[31211]: from='osd.10 [v2:172.21.15.42:6824/3182218295,v1:172.21.15.42:6825/3182218295]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T00:53:41.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:41 smithi001 ceph-mon[31211]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T00:53:41.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:41 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:53:41.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:41 smithi001 ceph-mon[31211]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T00:53:41.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:41 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:41.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:41 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:41.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:41 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:41.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:41 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:41.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:41 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:41.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:41 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:41.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:41 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:41.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:41 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:41.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:41 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:53:41.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:41 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:41.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:53:41.729+0000 7f19f17fd640 1 -- 172.21.15.193:0/1494193912 --> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f19ec063800 con 0x7f19d80b6510 2024-09-21T00:53:41.742 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 00:53:41 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T00:53:41.389+0000 7f2217391640 -1 osd.10 0 waiting for initial osdmap 2024-09-21T00:53:41.742 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 00:53:41 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T00:53:41.403+0000 7f221318f640 -1 osd.10 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:53:41.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:41 smithi042 ceph-mon[34481]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:41.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:41 smithi042 ceph-mon[34481]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T00:53:41.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:41 smithi042 ceph-mon[34481]: from='osd.10 [v2:172.21.15.42:6824/3182218295,v1:172.21.15.42:6825/3182218295]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T00:53:41.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:41 smithi042 ceph-mon[34481]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T00:53:41.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:41 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:53:41.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:41 smithi042 ceph-mon[34481]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi042", "root=default"]} : dispatch 2024-09-21T00:53:41.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:41 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:41.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:41 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:41.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:41 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:41.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:41 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:41.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:41 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:41.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:41 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:41.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:41 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:41.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:41 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:41.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:41 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:53:41.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:41 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:42.537 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:42 smithi042 ceph-mon[34481]: Detected new or changed devices on smithi042 2024-09-21T00:53:42.537 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:42 smithi042 ceph-mon[34481]: Adjusting osd_memory_target on smithi042 to 4273M 2024-09-21T00:53:42.537 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:42 smithi042 ceph-mon[34481]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-21T00:53:42.537 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:42 smithi042 ceph-mon[34481]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T00:53:42.537 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:42 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:53:42.537 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:42 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:53:42.537 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:42 smithi042 ceph-mon[34481]: from='client.24511 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:42.537 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:42 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:53:42.538 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:42 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:53:42.538 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:42 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:42.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:42 smithi001 ceph-mon[31211]: Detected new or changed devices on smithi042 2024-09-21T00:53:42.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:42 smithi001 ceph-mon[31211]: Adjusting osd_memory_target on smithi042 to 4273M 2024-09-21T00:53:42.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:42 smithi001 ceph-mon[31211]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-21T00:53:42.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:42 smithi001 ceph-mon[31211]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T00:53:42.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:42 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:53:42.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:42 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:53:42.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:42 smithi001 ceph-mon[31211]: from='client.24511 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:42.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:42 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:53:42.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:42 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:53:42.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:42 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:42.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:42 smithi193 ceph-mon[34660]: Detected new or changed devices on smithi042 2024-09-21T00:53:42.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:42 smithi193 ceph-mon[34660]: Adjusting osd_memory_target on smithi042 to 4273M 2024-09-21T00:53:42.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:42 smithi193 ceph-mon[34660]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-21T00:53:42.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:42 smithi193 ceph-mon[34660]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T00:53:42.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:42 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:53:42.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:42 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:53:42.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:42 smithi193 ceph-mon[34660]: from='client.24511 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:42.731 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:42 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:53:42.731 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:42 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:53:42.731 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:42 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:43.651 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:43 smithi193 ceph-mon[34660]: purged_snaps scrub starts 2024-09-21T00:53:43.651 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:43 smithi193 ceph-mon[34660]: purged_snaps scrub ok 2024-09-21T00:53:43.651 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:43 smithi193 ceph-mon[34660]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:43.651 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:43 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:53:43.651 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:43 smithi193 ceph-mon[34660]: osd.10 [v2:172.21.15.42:6824/3182218295,v1:172.21.15.42:6825/3182218295] boot 2024-09-21T00:53:43.651 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:43 smithi193 ceph-mon[34660]: osdmap e62: 11 total, 11 up, 11 in 2024-09-21T00:53:43.651 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:43 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:53:43.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:43 smithi001 ceph-mon[31211]: purged_snaps scrub starts 2024-09-21T00:53:43.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:43 smithi001 ceph-mon[31211]: purged_snaps scrub ok 2024-09-21T00:53:43.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:43 smithi001 ceph-mon[31211]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:43.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:43 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:53:43.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:43 smithi001 ceph-mon[31211]: osd.10 [v2:172.21.15.42:6824/3182218295,v1:172.21.15.42:6825/3182218295] boot 2024-09-21T00:53:43.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:43 smithi001 ceph-mon[31211]: osdmap e62: 11 total, 11 up, 11 in 2024-09-21T00:53:43.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:43 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:53:43.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:43 smithi042 ceph-mon[34481]: purged_snaps scrub starts 2024-09-21T00:53:43.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:43 smithi042 ceph-mon[34481]: purged_snaps scrub ok 2024-09-21T00:53:43.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:43 smithi042 ceph-mon[34481]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:53:43.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:43 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:53:43.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:43 smithi042 ceph-mon[34481]: osd.10 [v2:172.21.15.42:6824/3182218295,v1:172.21.15.42:6825/3182218295] boot 2024-09-21T00:53:43.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:43 smithi042 ceph-mon[34481]: osdmap e62: 11 total, 11 up, 11 in 2024-09-21T00:53:43.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:43 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:53:44.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:44 smithi001 ceph-mon[31211]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T00:53:44.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:44 smithi001 ceph-mon[31211]: from='client.? 172.21.15.193:0/374163085' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1cac0c39-77aa-460b-92a0-39ed89cd6ce4"} : dispatch 2024-09-21T00:53:44.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:44 smithi001 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1cac0c39-77aa-460b-92a0-39ed89cd6ce4"} : dispatch 2024-09-21T00:53:44.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:44 smithi001 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1cac0c39-77aa-460b-92a0-39ed89cd6ce4"}]': finished 2024-09-21T00:53:44.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:44 smithi001 ceph-mon[31211]: osdmap e64: 12 total, 11 up, 12 in 2024-09-21T00:53:44.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:44 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:53:44.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:44 smithi193 ceph-mon[34660]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T00:53:44.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:44 smithi193 ceph-mon[34660]: from='client.? 172.21.15.193:0/374163085' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1cac0c39-77aa-460b-92a0-39ed89cd6ce4"} : dispatch 2024-09-21T00:53:44.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:44 smithi193 ceph-mon[34660]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1cac0c39-77aa-460b-92a0-39ed89cd6ce4"} : dispatch 2024-09-21T00:53:44.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:44 smithi193 ceph-mon[34660]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1cac0c39-77aa-460b-92a0-39ed89cd6ce4"}]': finished 2024-09-21T00:53:44.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:44 smithi193 ceph-mon[34660]: osdmap e64: 12 total, 11 up, 12 in 2024-09-21T00:53:44.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:44 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:53:44.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:44 smithi042 ceph-mon[34481]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T00:53:44.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:44 smithi042 ceph-mon[34481]: from='client.? 172.21.15.193:0/374163085' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1cac0c39-77aa-460b-92a0-39ed89cd6ce4"} : dispatch 2024-09-21T00:53:44.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:44 smithi042 ceph-mon[34481]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1cac0c39-77aa-460b-92a0-39ed89cd6ce4"} : dispatch 2024-09-21T00:53:44.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:44 smithi042 ceph-mon[34481]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1cac0c39-77aa-460b-92a0-39ed89cd6ce4"}]': finished 2024-09-21T00:53:44.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:44 smithi042 ceph-mon[34481]: osdmap e64: 12 total, 11 up, 12 in 2024-09-21T00:53:44.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:44 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:53:45.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:45 smithi001 ceph-mon[31211]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:53:45.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:45 smithi001 ceph-mon[31211]: from='client.? 172.21.15.193:0/2010362044' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:53:45.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:45 smithi193 ceph-mon[34660]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:53:45.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:45 smithi193 ceph-mon[34660]: from='client.? 172.21.15.193:0/2010362044' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:53:45.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:45 smithi042 ceph-mon[34481]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:53:45.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:45 smithi042 ceph-mon[34481]: from='client.? 172.21.15.193:0/2010362044' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:53:47.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:47 smithi001 ceph-mon[31211]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-09-21T00:53:47.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:47 smithi193 ceph-mon[34660]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-09-21T00:53:47.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:47 smithi042 ceph-mon[34481]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-09-21T00:53:49.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:49 smithi001 ceph-mon[31211]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T00:53:49.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:49 smithi193 ceph-mon[34660]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T00:53:49.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:49 smithi042 ceph-mon[34481]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T00:53:51.638 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:51 smithi193 ceph-mon[34660]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-21T00:53:51.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:51 smithi001 ceph-mon[31211]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-21T00:53:51.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:51 smithi042 ceph-mon[34481]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-21T00:53:53.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:53 smithi001 ceph-mon[31211]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T00:53:53.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:53 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T00:53:53.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:53 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:53.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:53 smithi001 ceph-mon[31211]: Deploying daemon osd.11 on smithi193 2024-09-21T00:53:53.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:53 smithi193 ceph-mon[34660]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T00:53:53.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:53 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T00:53:53.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:53 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:53.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:53 smithi193 ceph-mon[34660]: Deploying daemon osd.11 on smithi193 2024-09-21T00:53:53.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:53 smithi042 ceph-mon[34481]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T00:53:53.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:53 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T00:53:53.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:53 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:53.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:53 smithi042 ceph-mon[34481]: Deploying daemon osd.11 on smithi193 2024-09-21T00:53:55.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:55 smithi001 ceph-mon[31211]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T00:53:55.713 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:55 smithi193 ceph-mon[34660]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T00:53:55.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:55 smithi042 ceph-mon[34481]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T00:53:57.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:57 smithi001 ceph-mon[31211]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:53:57.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:57 smithi193 ceph-mon[34660]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:53:57.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:57 smithi042 ceph-mon[34481]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:53:59.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:59 smithi001 ceph-mon[31211]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:53:59.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:59 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:53:59.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:59 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:59.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:53:59 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:59.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:59 smithi193 ceph-mon[34660]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:53:59.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:59 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:53:59.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:59 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:59.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:53:59 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:59.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:59 smithi042 ceph-mon[34481]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:53:59.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:59 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:53:59.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:59 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:53:59.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:53:59 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:01.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:01 smithi193 ceph-mon[34660]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:54:01.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:01 smithi001 ceph-mon[31211]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:54:01.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:01 smithi042 ceph-mon[34481]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:54:02.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:02.307+0000 7f19e3fff640 1 -- 172.21.15.193:0/1494193912 <== mgr.14150 v2:172.21.15.1:6800/2032980330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f19ec063800 con 0x7f19d80b6510 2024-09-21T00:54:02.309 INFO:teuthology.orchestra.run.smithi193.stdout:Created osd(s) 11 on host 'smithi193' 2024-09-21T00:54:02.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:02.310+0000 7f19f17fd640 1 -- 172.21.15.193:0/1494193912 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f19d80b6510 msgr2=0x7f19d80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:02.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:02.310+0000 7f19f17fd640 1 --2- 172.21.15.193:0/1494193912 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f19d80b6510 0x7f19d80b8a20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f19d4031440 tx=0x7f19d4009610 comp rx=0 tx=0).stop 2024-09-21T00:54:02.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:02.310+0000 7f19f17fd640 1 -- 172.21.15.193:0/1494193912 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19ec109490 msgr2=0x7f19ec1027f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:02.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:02.310+0000 7f19f17fd640 1 --2- 172.21.15.193:0/1494193912 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19ec109490 0x7f19ec1027f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f19e400cce0 tx=0x7f19e400a620 comp rx=0 tx=0).stop 2024-09-21T00:54:02.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:02.310+0000 7f19f17fd640 1 -- 172.21.15.193:0/1494193912 shutdown_connections 2024-09-21T00:54:02.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:02.310+0000 7f19f17fd640 1 --2- 172.21.15.193:0/1494193912 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19ec109490 0x7f19ec1027f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:02.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:02.310+0000 7f19f17fd640 1 --2- 172.21.15.193:0/1494193912 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19ec1068f0 0x7f19ec1022b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:02.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:02.310+0000 7f19f17fd640 1 --2- 172.21.15.193:0/1494193912 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f19d80b6510 0x7f19d80b8a20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:02.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:02.310+0000 7f19f17fd640 1 --2- 172.21.15.193:0/1494193912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19ec06c340 0x7f19ec1039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:02.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:02.310+0000 7f19f17fd640 1 -- 172.21.15.193:0/1494193912 >> 172.21.15.193:0/1494193912 conn(0x7f19ec0fdfd0 msgr2=0x7f19ec104e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:02.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:02.310+0000 7f19f17fd640 1 -- 172.21.15.193:0/1494193912 shutdown_connections 2024-09-21T00:54:02.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:02.310+0000 7f19f17fd640 1 -- 172.21.15.193:0/1494193912 wait complete. 2024-09-21T00:54:02.917 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:02.918 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:02.918 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:02.918 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:54:02.918 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:02.918 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:54:02.918 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:02.918 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:02 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:02.946 DEBUG:teuthology.orchestra.run.smithi193:osd.11> sudo journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@osd.11.service 2024-09-21T00:54:02.948 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-21T00:54:02.948 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T00:54:02.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:02 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:02.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:02 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:02.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:02 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:02.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:02 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:54:02.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:02 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:02.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:02 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:54:02.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:02 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:02.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:02 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:02.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:02 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:02.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:02 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:02.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:02 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:02.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:02 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:54:02.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:02 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:02.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:02 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:54:02.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:02 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:02.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:02 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:03.215 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:54:03.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.684+0000 7f8a18013640 1 -- 172.21.15.1:0/3788647151 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a10105180 msgr2=0x7f8a1010bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:03.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.684+0000 7f8a18013640 1 --2- 172.21.15.1:0/3788647151 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a10105180 0x7f8a1010bb20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8a08009ca0 tx=0x7f8a0802a950 comp rx=0 tx=0).stop 2024-09-21T00:54:03.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.684+0000 7f8a18013640 1 -- 172.21.15.1:0/3788647151 shutdown_connections 2024-09-21T00:54:03.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.684+0000 7f8a18013640 1 --2- 172.21.15.1:0/3788647151 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a10105180 0x7f8a1010bb20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:03.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.684+0000 7f8a18013640 1 --2- 172.21.15.1:0/3788647151 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a101047e0 0x7f8a10104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:03.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.684+0000 7f8a18013640 1 --2- 172.21.15.1:0/3788647151 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8a10103750 0x7f8a10103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:03.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.684+0000 7f8a18013640 1 -- 172.21.15.1:0/3788647151 >> 172.21.15.1:0/3788647151 conn(0x7f8a100ff0e0 msgr2=0x7f8a10101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:03.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.684+0000 7f8a18013640 1 -- 172.21.15.1:0/3788647151 shutdown_connections 2024-09-21T00:54:03.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.684+0000 7f8a18013640 1 -- 172.21.15.1:0/3788647151 wait complete. 2024-09-21T00:54:03.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.684+0000 7f8a18013640 1 Processor -- start 2024-09-21T00:54:03.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.684+0000 7f8a18013640 1 -- start start 2024-09-21T00:54:03.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.685+0000 7f8a18013640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a10103750 0x7f8a10199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:03.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.685+0000 7f8a18013640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a101047e0 0x7f8a1019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:03.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.685+0000 7f8a18013640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8a10105180 0x7f8a1019b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:03.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.685+0000 7f8a18013640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8a1010f380 con 0x7f8a101047e0 2024-09-21T00:54:03.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.685+0000 7f8a18013640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8a1010f200 con 0x7f8a10103750 2024-09-21T00:54:03.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.685+0000 7f8a18013640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8a1010f500 con 0x7f8a10105180 2024-09-21T00:54:03.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.685+0000 7f8a155ae640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a101047e0 0x7f8a1019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:03.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.685+0000 7f8a155ae640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a101047e0 0x7f8a1019a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55384/0 (socket says 172.21.15.1:55384) 2024-09-21T00:54:03.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.685+0000 7f8a155ae640 1 -- 172.21.15.1:0/2415842979 learned_addr learned my addr 172.21.15.1:0/2415842979 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:54:03.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.685+0000 7f8a15daf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a10103750 0x7f8a10199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:03.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.685+0000 7f8a165b0640 1 --2- 172.21.15.1:0/2415842979 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8a10105180 0x7f8a1019b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:03.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.685+0000 7f8a155ae640 1 -- 172.21.15.1:0/2415842979 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8a10105180 msgr2=0x7f8a1019b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:03.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.685+0000 7f8a155ae640 1 --2- 172.21.15.1:0/2415842979 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8a10105180 0x7f8a1019b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:03.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.685+0000 7f8a155ae640 1 -- 172.21.15.1:0/2415842979 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a10103750 msgr2=0x7f8a10199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:03.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.685+0000 7f8a155ae640 1 --2- 172.21.15.1:0/2415842979 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a10103750 0x7f8a10199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:03.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.685+0000 7f8a155ae640 1 -- 172.21.15.1:0/2415842979 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a1019b8e0 con 0x7f8a101047e0 2024-09-21T00:54:03.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.685+0000 7f8a155ae640 1 --2- 172.21.15.1:0/2415842979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a101047e0 0x7f8a1019a620 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8a0000c920 tx=0x7f8a0000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:03.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.686+0000 7f8a06ffd640 1 -- 172.21.15.1:0/2415842979 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a00007c70 con 0x7f8a101047e0 2024-09-21T00:54:03.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.686+0000 7f8a06ffd640 1 -- 172.21.15.1:0/2415842979 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a00007e10 con 0x7f8a101047e0 2024-09-21T00:54:03.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.686+0000 7f8a06ffd640 1 -- 172.21.15.1:0/2415842979 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a00018820 con 0x7f8a101047e0 2024-09-21T00:54:03.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.686+0000 7f8a18013640 1 -- 172.21.15.1:0/2415842979 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a1019bbd0 con 0x7f8a101047e0 2024-09-21T00:54:03.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.686+0000 7f8a18013640 1 -- 172.21.15.1:0/2415842979 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a101a2190 con 0x7f8a101047e0 2024-09-21T00:54:03.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.687+0000 7f8a18013640 1 -- 172.21.15.1:0/2415842979 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a1010a910 con 0x7f8a101047e0 2024-09-21T00:54:03.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.690+0000 7f8a06ffd640 1 -- 172.21.15.1:0/2415842979 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 154511+0+0 (secure 0 0 0) 0x7f8a0000f450 con 0x7f8a101047e0 2024-09-21T00:54:03.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.690+0000 7f8a06ffd640 1 --2- 172.21.15.1:0/2415842979 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f89fc0b6510 0x7f89fc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:03.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.691+0000 7f8a15daf640 1 --2- 172.21.15.1:0/2415842979 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f89fc0b6510 0x7f89fc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:03.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.691+0000 7f8a06ffd640 1 -- 172.21.15.1:0/2415842979 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6809+0+0 (secure 0 0 0) 0x7f8a000e6fd0 con 0x7f8a101047e0 2024-09-21T00:54:03.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.691+0000 7f8a15daf640 1 --2- 172.21.15.1:0/2415842979 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f89fc0b6510 0x7f89fc0b8a20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c005d00 tx=0x7f8a0c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:03.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.692+0000 7f8a06ffd640 1 -- 172.21.15.1:0/2415842979 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8a00014030 con 0x7f8a101047e0 2024-09-21T00:54:03.866 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:03 smithi193 ceph-mon[34660]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:54:03.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.882+0000 7f8a18013640 1 -- 172.21.15.1:0/2415842979 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f8a10063fc0 con 0x7f8a101047e0 2024-09-21T00:54:03.883 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:03 smithi001 ceph-mon[31211]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:54:03.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.883+0000 7f8a06ffd640 1 -- 172.21.15.1:0/2415842979 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v64) ==== 74+0+133 (secure 0 0 0) 0x7f8a000aded0 con 0x7f8a101047e0 2024-09-21T00:54:03.884 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:54:03.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.885+0000 7f8a18013640 1 -- 172.21.15.1:0/2415842979 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f89fc0b6510 msgr2=0x7f89fc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:03.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.885+0000 7f8a18013640 1 --2- 172.21.15.1:0/2415842979 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f89fc0b6510 0x7f89fc0b8a20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c005d00 tx=0x7f8a0c00b410 comp rx=0 tx=0).stop 2024-09-21T00:54:03.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.885+0000 7f8a18013640 1 -- 172.21.15.1:0/2415842979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a101047e0 msgr2=0x7f8a1019a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:03.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.885+0000 7f8a18013640 1 --2- 172.21.15.1:0/2415842979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a101047e0 0x7f8a1019a620 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8a0000c920 tx=0x7f8a0000cde0 comp rx=0 tx=0).stop 2024-09-21T00:54:03.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.885+0000 7f8a18013640 1 -- 172.21.15.1:0/2415842979 shutdown_connections 2024-09-21T00:54:03.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.885+0000 7f8a18013640 1 --2- 172.21.15.1:0/2415842979 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8a10105180 0x7f8a1019b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:03.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.885+0000 7f8a18013640 1 --2- 172.21.15.1:0/2415842979 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f89fc0b6510 0x7f89fc0b8a20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:03.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.885+0000 7f8a18013640 1 --2- 172.21.15.1:0/2415842979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a101047e0 0x7f8a1019a620 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:03.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.885+0000 7f8a18013640 1 --2- 172.21.15.1:0/2415842979 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a10103750 0x7f8a10199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:03.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.885+0000 7f8a18013640 1 -- 172.21.15.1:0/2415842979 >> 172.21.15.1:0/2415842979 conn(0x7f8a100ff0e0 msgr2=0x7f8a10107ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:03.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.886+0000 7f8a18013640 1 -- 172.21.15.1:0/2415842979 shutdown_connections 2024-09-21T00:54:03.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:03.886+0000 7f8a18013640 1 -- 172.21.15.1:0/2415842979 wait complete. 2024-09-21T00:54:03.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:03 smithi042 ceph-mon[34481]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:54:04.674 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":64,"num_osds":12,"num_up_osds":11,"osd_up_since":1726880022,"num_in_osds":12,"osd_in_since":1726880024,"num_remapped_pgs":0} 2024-09-21T00:54:04.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:04 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/2415842979' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T00:54:04.730 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 00:54:04 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T00:54:04.689+0000 7f692a40c640 -1 osd.11 0 log_to_monitors true 2024-09-21T00:54:04.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:04 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/2415842979' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T00:54:04.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:04 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/2415842979' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T00:54:05.675 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T00:54:05.890 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:05 smithi193 ceph-mon[34660]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:54:05.890 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:05 smithi193 ceph-mon[34660]: from='osd.11 [v2:172.21.15.193:6824/2368815522,v1:172.21.15.193:6825/2368815522]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T00:54:05.890 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:05 smithi193 ceph-mon[34660]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T00:54:05.947 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:54:05.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:05 smithi001 ceph-mon[31211]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:54:05.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:05 smithi001 ceph-mon[31211]: from='osd.11 [v2:172.21.15.193:6824/2368815522,v1:172.21.15.193:6825/2368815522]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T00:54:05.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:05 smithi001 ceph-mon[31211]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T00:54:05.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:05 smithi042 ceph-mon[34481]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:54:05.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:05 smithi042 ceph-mon[34481]: from='osd.11 [v2:172.21.15.193:6824/2368815522,v1:172.21.15.193:6825/2368815522]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T00:54:05.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:05 smithi042 ceph-mon[34481]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T00:54:06.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.432+0000 7f9e37104640 1 -- 172.21.15.1:0/4109247246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e301051a0 msgr2=0x7f9e3010bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:06.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.432+0000 7f9e37104640 1 --2- 172.21.15.1:0/4109247246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e301051a0 0x7f9e3010bb40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9e28009ca0 tx=0x7f9e2802a950 comp rx=0 tx=0).stop 2024-09-21T00:54:06.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.433+0000 7f9e37104640 1 -- 172.21.15.1:0/4109247246 shutdown_connections 2024-09-21T00:54:06.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.433+0000 7f9e37104640 1 --2- 172.21.15.1:0/4109247246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e301051a0 0x7f9e3010bb40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:06.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.433+0000 7f9e37104640 1 --2- 172.21.15.1:0/4109247246 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e30104800 0x7f9e30104c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:06.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.433+0000 7f9e37104640 1 --2- 172.21.15.1:0/4109247246 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e30103770 0x7f9e30103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:06.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.433+0000 7f9e37104640 1 -- 172.21.15.1:0/4109247246 >> 172.21.15.1:0/4109247246 conn(0x7f9e300ff0c0 msgr2=0x7f9e30101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:06.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.433+0000 7f9e37104640 1 -- 172.21.15.1:0/4109247246 shutdown_connections 2024-09-21T00:54:06.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.433+0000 7f9e37104640 1 -- 172.21.15.1:0/4109247246 wait complete. 2024-09-21T00:54:06.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.433+0000 7f9e37104640 1 Processor -- start 2024-09-21T00:54:06.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.433+0000 7f9e37104640 1 -- start start 2024-09-21T00:54:06.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.433+0000 7f9e37104640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e30103770 0x7f9e30199f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:06.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.433+0000 7f9e37104640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e30104800 0x7f9e3019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:06.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.433+0000 7f9e37104640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e301051a0 0x7f9e3019b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:06.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.433+0000 7f9e37104640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9e3010f3c0 con 0x7f9e301051a0 2024-09-21T00:54:06.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.433+0000 7f9e37104640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9e3010f240 con 0x7f9e30103770 2024-09-21T00:54:06.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.433+0000 7f9e37104640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9e3010f540 con 0x7f9e30104800 2024-09-21T00:54:06.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.434+0000 7f9e356a1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e301051a0 0x7f9e3019b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:06.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.434+0000 7f9e356a1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e301051a0 0x7f9e3019b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55396/0 (socket says 172.21.15.1:55396) 2024-09-21T00:54:06.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.434+0000 7f9e34ea0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e30103770 0x7f9e30199f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:06.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.434+0000 7f9e356a1640 1 -- 172.21.15.1:0/7829109 learned_addr learned my addr 172.21.15.1:0/7829109 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:54:06.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.434+0000 7f9e356a1640 1 -- 172.21.15.1:0/7829109 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e30104800 msgr2=0x7f9e3019a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:06.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.434+0000 7f9e2ffff640 1 --2- 172.21.15.1:0/7829109 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e30104800 0x7f9e3019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:06.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.434+0000 7f9e356a1640 1 --2- 172.21.15.1:0/7829109 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e30104800 0x7f9e3019a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:06.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.434+0000 7f9e356a1640 1 -- 172.21.15.1:0/7829109 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e30103770 msgr2=0x7f9e30199f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:06.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.434+0000 7f9e356a1640 1 --2- 172.21.15.1:0/7829109 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e30103770 0x7f9e30199f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:06.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.434+0000 7f9e356a1640 1 -- 172.21.15.1:0/7829109 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e3019b980 con 0x7f9e301051a0 2024-09-21T00:54:06.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.434+0000 7f9e2ffff640 1 --2- 172.21.15.1:0/7829109 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e30104800 0x7f9e3019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:54:06.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.434+0000 7f9e356a1640 1 --2- 172.21.15.1:0/7829109 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e301051a0 0x7f9e3019b160 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9e28006010 tx=0x7f9e2802fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:06.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.434+0000 7f9e2dffb640 1 -- 172.21.15.1:0/7829109 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e28034040 con 0x7f9e301051a0 2024-09-21T00:54:06.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.434+0000 7f9e2dffb640 1 -- 172.21.15.1:0/7829109 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e280308f0 con 0x7f9e301051a0 2024-09-21T00:54:06.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.434+0000 7f9e37104640 1 -- 172.21.15.1:0/7829109 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e3019bc10 con 0x7f9e301051a0 2024-09-21T00:54:06.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.434+0000 7f9e2dffb640 1 -- 172.21.15.1:0/7829109 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e28039450 con 0x7f9e301051a0 2024-09-21T00:54:06.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.435+0000 7f9e37104640 1 -- 172.21.15.1:0/7829109 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e301a21a0 con 0x7f9e301051a0 2024-09-21T00:54:06.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.436+0000 7f9e37104640 1 -- 172.21.15.1:0/7829109 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e3010a930 con 0x7f9e301051a0 2024-09-21T00:54:06.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.437+0000 7f9e2dffb640 1 -- 172.21.15.1:0/7829109 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 154511+0+0 (secure 0 0 0) 0x7f9e28037020 con 0x7f9e301051a0 2024-09-21T00:54:06.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.438+0000 7f9e2dffb640 1 --2- 172.21.15.1:0/7829109 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f9e200b6510 0x7f9e200b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:06.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.438+0000 7f9e2dffb640 1 -- 172.21.15.1:0/7829109 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6831+0+0 (secure 0 0 0) 0x7f9e28108080 con 0x7f9e301051a0 2024-09-21T00:54:06.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.438+0000 7f9e34ea0640 1 --2- 172.21.15.1:0/7829109 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f9e200b6510 0x7f9e200b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:06.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.439+0000 7f9e34ea0640 1 --2- 172.21.15.1:0/7829109 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f9e200b6510 0x7f9e200b8a20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9e2400bbe0 tx=0x7f9e2400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:06.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.441+0000 7f9e2dffb640 1 -- 172.21.15.1:0/7829109 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9e280cee40 con 0x7f9e301051a0 2024-09-21T00:54:06.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.633+0000 7f9e37104640 1 -- 172.21.15.1:0/7829109 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f9e30063fc0 con 0x7f9e301051a0 2024-09-21T00:54:06.634 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:06 smithi001 ceph-mon[31211]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T00:54:06.635 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:06 smithi001 ceph-mon[31211]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T00:54:06.635 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:06 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:54:06.635 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:06 smithi001 ceph-mon[31211]: from='osd.11 [v2:172.21.15.193:6824/2368815522,v1:172.21.15.193:6825/2368815522]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi193", "root=default"]} : dispatch 2024-09-21T00:54:06.635 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:06 smithi001 ceph-mon[31211]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi193", "root=default"]} : dispatch 2024-09-21T00:54:06.635 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:06 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:06.635 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:06 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:06.635 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:06 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T00:54:06.635 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:06 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T00:54:06.635 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:06 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T00:54:06.635 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:06 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T00:54:06.635 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:06 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:06.635 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:06 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:06.636 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:06 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:54:06.636 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:06 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:06.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.634+0000 7f9e2dffb640 1 -- 172.21.15.1:0/7829109 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v66) ==== 74+0+133 (secure 0 0 0) 0x7f9e280d3220 con 0x7f9e301051a0 2024-09-21T00:54:06.636 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:54:06.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.636+0000 7f9e37104640 1 -- 172.21.15.1:0/7829109 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f9e200b6510 msgr2=0x7f9e200b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:06.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.636+0000 7f9e37104640 1 --2- 172.21.15.1:0/7829109 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f9e200b6510 0x7f9e200b8a20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9e2400bbe0 tx=0x7f9e2400b390 comp rx=0 tx=0).stop 2024-09-21T00:54:06.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.636+0000 7f9e37104640 1 -- 172.21.15.1:0/7829109 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e301051a0 msgr2=0x7f9e3019b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:06.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.636+0000 7f9e37104640 1 --2- 172.21.15.1:0/7829109 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e301051a0 0x7f9e3019b160 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9e28006010 tx=0x7f9e2802fc00 comp rx=0 tx=0).stop 2024-09-21T00:54:06.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.636+0000 7f9e37104640 1 -- 172.21.15.1:0/7829109 shutdown_connections 2024-09-21T00:54:06.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.636+0000 7f9e37104640 1 --2- 172.21.15.1:0/7829109 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f9e200b6510 0x7f9e200b8a20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:06.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.636+0000 7f9e37104640 1 --2- 172.21.15.1:0/7829109 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e301051a0 0x7f9e3019b160 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:06.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.636+0000 7f9e37104640 1 --2- 172.21.15.1:0/7829109 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e30104800 0x7f9e3019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:06.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.636+0000 7f9e37104640 1 --2- 172.21.15.1:0/7829109 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e30103770 0x7f9e30199f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:06.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.636+0000 7f9e37104640 1 -- 172.21.15.1:0/7829109 >> 172.21.15.1:0/7829109 conn(0x7f9e300ff0c0 msgr2=0x7f9e30107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:06.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.636+0000 7f9e37104640 1 -- 172.21.15.1:0/7829109 shutdown_connections 2024-09-21T00:54:06.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:06.636+0000 7f9e37104640 1 -- 172.21.15.1:0/7829109 wait complete. 2024-09-21T00:54:06.979 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 00:54:06 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T00:54:06.556+0000 7f692638e640 -1 osd.11 0 waiting for initial osdmap 2024-09-21T00:54:06.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 00:54:06 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T00:54:06.571+0000 7f692218c640 -1 osd.11 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:54:06.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:06 smithi193 ceph-mon[34660]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T00:54:06.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:06 smithi193 ceph-mon[34660]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T00:54:06.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:06 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:54:06.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:06 smithi193 ceph-mon[34660]: from='osd.11 [v2:172.21.15.193:6824/2368815522,v1:172.21.15.193:6825/2368815522]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi193", "root=default"]} : dispatch 2024-09-21T00:54:06.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:06 smithi193 ceph-mon[34660]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi193", "root=default"]} : dispatch 2024-09-21T00:54:06.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:06 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:06.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:06 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:06.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:06 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T00:54:06.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:06 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T00:54:06.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:06 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T00:54:06.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:06 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T00:54:06.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:06 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:06.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:06 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:06.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:06 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:54:06.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:06 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:06.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:06 smithi042 ceph-mon[34481]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T00:54:06.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:06 smithi042 ceph-mon[34481]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T00:54:06.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:06 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:54:06.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:06 smithi042 ceph-mon[34481]: from='osd.11 [v2:172.21.15.193:6824/2368815522,v1:172.21.15.193:6825/2368815522]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi193", "root=default"]} : dispatch 2024-09-21T00:54:06.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:06 smithi042 ceph-mon[34481]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi193", "root=default"]} : dispatch 2024-09-21T00:54:06.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:06 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:06.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:06 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:06.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:06 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T00:54:06.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:06 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T00:54:06.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:06 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T00:54:06.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:06 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T00:54:06.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:06 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:06.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:06 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:06.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:06 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:54:06.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:06 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:07.434 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":66,"num_osds":12,"num_up_osds":11,"osd_up_since":1726880022,"num_in_osds":12,"osd_in_since":1726880024,"num_remapped_pgs":0} 2024-09-21T00:54:07.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:07 smithi001 ceph-mon[31211]: Detected new or changed devices on smithi193 2024-09-21T00:54:07.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:07 smithi001 ceph-mon[31211]: Adjusting osd_memory_target on smithi193 to 4272M 2024-09-21T00:54:07.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:07 smithi001 ceph-mon[31211]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:54:07.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:07 smithi001 ceph-mon[31211]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-21T00:54:07.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:07 smithi001 ceph-mon[31211]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T00:54:07.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:07 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:54:07.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:07 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:54:07.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:07 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/7829109' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T00:54:07.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:07 smithi193 ceph-mon[34660]: Detected new or changed devices on smithi193 2024-09-21T00:54:07.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:07 smithi193 ceph-mon[34660]: Adjusting osd_memory_target on smithi193 to 4272M 2024-09-21T00:54:07.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:07 smithi193 ceph-mon[34660]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:54:07.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:07 smithi193 ceph-mon[34660]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-21T00:54:07.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:07 smithi193 ceph-mon[34660]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T00:54:07.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:07 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:54:07.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:07 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:54:07.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:07 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/7829109' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T00:54:07.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:07 smithi042 ceph-mon[34481]: Detected new or changed devices on smithi193 2024-09-21T00:54:07.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:07 smithi042 ceph-mon[34481]: Adjusting osd_memory_target on smithi193 to 4272M 2024-09-21T00:54:07.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:07 smithi042 ceph-mon[34481]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:54:07.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:07 smithi042 ceph-mon[34481]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-21T00:54:07.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:07 smithi042 ceph-mon[34481]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T00:54:07.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:07 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:54:07.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:07 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:54:07.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:07 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/7829109' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T00:54:08.435 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T00:54:08.703 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:54:08.825 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:08 smithi001 ceph-mon[31211]: purged_snaps scrub starts 2024-09-21T00:54:08.825 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:08 smithi001 ceph-mon[31211]: purged_snaps scrub ok 2024-09-21T00:54:08.825 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:08 smithi001 ceph-mon[31211]: osd.11 [v2:172.21.15.193:6824/2368815522,v1:172.21.15.193:6825/2368815522] boot 2024-09-21T00:54:08.825 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:08 smithi001 ceph-mon[31211]: osdmap e67: 12 total, 12 up, 12 in 2024-09-21T00:54:08.825 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:08 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:54:08.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:08 smithi193 ceph-mon[34660]: purged_snaps scrub starts 2024-09-21T00:54:08.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:08 smithi193 ceph-mon[34660]: purged_snaps scrub ok 2024-09-21T00:54:08.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:08 smithi193 ceph-mon[34660]: osd.11 [v2:172.21.15.193:6824/2368815522,v1:172.21.15.193:6825/2368815522] boot 2024-09-21T00:54:08.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:08 smithi193 ceph-mon[34660]: osdmap e67: 12 total, 12 up, 12 in 2024-09-21T00:54:08.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:08 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:54:08.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:08 smithi042 ceph-mon[34481]: purged_snaps scrub starts 2024-09-21T00:54:08.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:08 smithi042 ceph-mon[34481]: purged_snaps scrub ok 2024-09-21T00:54:08.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:08 smithi042 ceph-mon[34481]: osd.11 [v2:172.21.15.193:6824/2368815522,v1:172.21.15.193:6825/2368815522] boot 2024-09-21T00:54:08.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:08 smithi042 ceph-mon[34481]: osdmap e67: 12 total, 12 up, 12 in 2024-09-21T00:54:08.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:08 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:54:09.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.166+0000 7fa38604b640 1 -- 172.21.15.1:0/2318792194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa380106900 msgr2=0x7fa380108d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:09.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.166+0000 7fa38604b640 1 --2- 172.21.15.1:0/2318792194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa380106900 0x7fa380108d60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa374009900 tx=0x7fa37402a410 comp rx=0 tx=0).stop 2024-09-21T00:54:09.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.166+0000 7fa38604b640 1 -- 172.21.15.1:0/2318792194 shutdown_connections 2024-09-21T00:54:09.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.166+0000 7fa38604b640 1 --2- 172.21.15.1:0/2318792194 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3801094a0 0x7fa38010b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:09.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.166+0000 7fa38604b640 1 --2- 172.21.15.1:0/2318792194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa380106900 0x7fa380108d60 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:09.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.166+0000 7fa38604b640 1 --2- 172.21.15.1:0/2318792194 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa38006c660 0x7fa3801063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:09.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.166+0000 7fa38604b640 1 -- 172.21.15.1:0/2318792194 >> 172.21.15.1:0/2318792194 conn(0x7fa3800fdfe0 msgr2=0x7fa380100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:09.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.166+0000 7fa38604b640 1 -- 172.21.15.1:0/2318792194 shutdown_connections 2024-09-21T00:54:09.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.166+0000 7fa38604b640 1 -- 172.21.15.1:0/2318792194 wait complete. 2024-09-21T00:54:09.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.167+0000 7fa38604b640 1 Processor -- start 2024-09-21T00:54:09.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.167+0000 7fa38604b640 1 -- start start 2024-09-21T00:54:09.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.167+0000 7fa38604b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa38006c660 0x7fa380199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:09.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.167+0000 7fa38604b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa380106900 0x7fa38019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:09.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.167+0000 7fa38604b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3801094a0 0x7fa38019b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:09.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.167+0000 7fa38604b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa38010f390 con 0x7fa38006c660 2024-09-21T00:54:09.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.167+0000 7fa38604b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa38010f210 con 0x7fa380106900 2024-09-21T00:54:09.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.167+0000 7fa38604b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa38010f510 con 0x7fa3801094a0 2024-09-21T00:54:09.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.167+0000 7fa37f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa38006c660 0x7fa380199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:09.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.167+0000 7fa37f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa38006c660 0x7fa380199ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55404/0 (socket says 172.21.15.1:55404) 2024-09-21T00:54:09.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.167+0000 7fa37f7fe640 1 -- 172.21.15.1:0/1253877110 learned_addr learned my addr 172.21.15.1:0/1253877110 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:54:09.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.167+0000 7fa37ffff640 1 --2- 172.21.15.1:0/1253877110 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3801094a0 0x7fa38019b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:09.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.167+0000 7fa37effd640 1 --2- 172.21.15.1:0/1253877110 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa380106900 0x7fa38019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:09.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.168+0000 7fa37f7fe640 1 -- 172.21.15.1:0/1253877110 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3801094a0 msgr2=0x7fa38019b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:09.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.168+0000 7fa37f7fe640 1 --2- 172.21.15.1:0/1253877110 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3801094a0 0x7fa38019b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:09.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.168+0000 7fa37f7fe640 1 -- 172.21.15.1:0/1253877110 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa380106900 msgr2=0x7fa38019a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:09.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.168+0000 7fa37f7fe640 1 --2- 172.21.15.1:0/1253877110 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa380106900 0x7fa38019a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:09.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.168+0000 7fa37f7fe640 1 -- 172.21.15.1:0/1253877110 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa38019b990 con 0x7fa38006c660 2024-09-21T00:54:09.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.168+0000 7fa37f7fe640 1 --2- 172.21.15.1:0/1253877110 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa38006c660 0x7fa380199ff0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa37000e9f0 tx=0x7fa37000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:09.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.168+0000 7fa37cff9640 1 -- 172.21.15.1:0/1253877110 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37000cd80 con 0x7fa38006c660 2024-09-21T00:54:09.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.168+0000 7fa38604b640 1 -- 172.21.15.1:0/1253877110 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa38019bc80 con 0x7fa38006c660 2024-09-21T00:54:09.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.168+0000 7fa37cff9640 1 -- 172.21.15.1:0/1253877110 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3700108e0 con 0x7fa38006c660 2024-09-21T00:54:09.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.168+0000 7fa37cff9640 1 -- 172.21.15.1:0/1253877110 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa370018980 con 0x7fa38006c660 2024-09-21T00:54:09.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.168+0000 7fa38604b640 1 -- 172.21.15.1:0/1253877110 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3801a2410 con 0x7fa38006c660 2024-09-21T00:54:09.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.169+0000 7fa38604b640 1 -- 172.21.15.1:0/1253877110 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa380106d50 con 0x7fa38006c660 2024-09-21T00:54:09.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.171+0000 7fa37cff9640 1 -- 172.21.15.1:0/1253877110 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 154511+0+0 (secure 0 0 0) 0x7fa370010430 con 0x7fa38006c660 2024-09-21T00:54:09.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.171+0000 7fa37cff9640 1 --2- 172.21.15.1:0/1253877110 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa3680b6510 0x7fa3680b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:09.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.171+0000 7fa37effd640 1 --2- 172.21.15.1:0/1253877110 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa3680b6510 0x7fa3680b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:09.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.171+0000 7fa37cff9640 1 -- 172.21.15.1:0/1253877110 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7fa3700e7630 con 0x7fa38006c660 2024-09-21T00:54:09.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.172+0000 7fa37effd640 1 --2- 172.21.15.1:0/1253877110 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa3680b6510 0x7fa3680b8a20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa374000c00 tx=0x7fa374031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:09.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.174+0000 7fa37cff9640 1 -- 172.21.15.1:0/1253877110 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa3700b2740 con 0x7fa38006c660 2024-09-21T00:54:09.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.362+0000 7fa38604b640 1 -- 172.21.15.1:0/1253877110 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fa38002e9f0 con 0x7fa38006c660 2024-09-21T00:54:09.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.362+0000 7fa37cff9640 1 -- 172.21.15.1:0/1253877110 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v68) ==== 74+0+133 (secure 0 0 0) 0x7fa38002e9f0 con 0x7fa38006c660 2024-09-21T00:54:09.363 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:54:09.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.365+0000 7fa38604b640 1 -- 172.21.15.1:0/1253877110 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa3680b6510 msgr2=0x7fa3680b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:09.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.365+0000 7fa38604b640 1 --2- 172.21.15.1:0/1253877110 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa3680b6510 0x7fa3680b8a20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa374000c00 tx=0x7fa374031400 comp rx=0 tx=0).stop 2024-09-21T00:54:09.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.365+0000 7fa38604b640 1 -- 172.21.15.1:0/1253877110 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa38006c660 msgr2=0x7fa380199ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:09.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.365+0000 7fa38604b640 1 --2- 172.21.15.1:0/1253877110 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa38006c660 0x7fa380199ff0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa37000e9f0 tx=0x7fa37000eeb0 comp rx=0 tx=0).stop 2024-09-21T00:54:09.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.365+0000 7fa38604b640 1 -- 172.21.15.1:0/1253877110 shutdown_connections 2024-09-21T00:54:09.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.365+0000 7fa38604b640 1 --2- 172.21.15.1:0/1253877110 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3801094a0 0x7fa38019b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:09.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.365+0000 7fa38604b640 1 --2- 172.21.15.1:0/1253877110 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa380106900 0x7fa38019a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:09.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.365+0000 7fa38604b640 1 --2- 172.21.15.1:0/1253877110 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa3680b6510 0x7fa3680b8a20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:09.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.365+0000 7fa38604b640 1 --2- 172.21.15.1:0/1253877110 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa38006c660 0x7fa380199ff0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:09.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.365+0000 7fa38604b640 1 -- 172.21.15.1:0/1253877110 >> 172.21.15.1:0/1253877110 conn(0x7fa3800fdfe0 msgr2=0x7fa380104d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:09.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.365+0000 7fa38604b640 1 -- 172.21.15.1:0/1253877110 shutdown_connections 2024-09-21T00:54:09.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:09.365+0000 7fa38604b640 1 -- 172.21.15.1:0/1253877110 wait complete. 2024-09-21T00:54:09.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:09 smithi001 ceph-mon[31211]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:54:09.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:09 smithi001 ceph-mon[31211]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T00:54:09.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:09 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1253877110' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T00:54:09.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:09 smithi193 ceph-mon[34660]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:54:09.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:09 smithi193 ceph-mon[34660]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T00:54:09.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:09 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/1253877110' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T00:54:09.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:09 smithi042 ceph-mon[34481]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:54:09.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:09 smithi042 ceph-mon[34481]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T00:54:09.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:09 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/1253877110' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T00:54:10.103 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":68,"num_osds":12,"num_up_osds":12,"osd_up_since":1726880047,"num_in_osds":12,"osd_in_since":1726880024,"num_remapped_pgs":0} 2024-09-21T00:54:10.104 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T00:54:10.359 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:54:10.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.859+0000 7fa43968c640 1 -- 172.21.15.1:0/1169178627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa434102ae0 msgr2=0x7fa434102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:10.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.859+0000 7fa43968c640 1 --2- 172.21.15.1:0/1169178627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa434102ae0 0x7fa434102ef0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa424009900 tx=0x7fa42402a410 comp rx=0 tx=0).stop 2024-09-21T00:54:10.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.859+0000 7fa43968c640 1 -- 172.21.15.1:0/1169178627 shutdown_connections 2024-09-21T00:54:10.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.859+0000 7fa43968c640 1 --2- 172.21.15.1:0/1169178627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa434108d20 0x7fa43410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:10.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.859+0000 7fa43968c640 1 --2- 172.21.15.1:0/1169178627 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4341083d0 0x7fa4341087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:10.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.859+0000 7fa43968c640 1 --2- 172.21.15.1:0/1169178627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa434102ae0 0x7fa434102ef0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:10.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.859+0000 7fa43968c640 1 -- 172.21.15.1:0/1169178627 >> 172.21.15.1:0/1169178627 conn(0x7fa434079760 msgr2=0x7fa434079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:10.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.859+0000 7fa43968c640 1 -- 172.21.15.1:0/1169178627 shutdown_connections 2024-09-21T00:54:10.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.859+0000 7fa43968c640 1 -- 172.21.15.1:0/1169178627 wait complete. 2024-09-21T00:54:10.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.860+0000 7fa43968c640 1 Processor -- start 2024-09-21T00:54:10.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.860+0000 7fa43968c640 1 -- start start 2024-09-21T00:54:10.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.861+0000 7fa43968c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa434102ae0 0x7fa43419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:10.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.861+0000 7fa43968c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4341083d0 0x7fa43419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:10.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.861+0000 7fa43968c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa434108d20 0x7fa43419fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:10.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.861+0000 7fa43968c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa434113ab0 con 0x7fa4341083d0 2024-09-21T00:54:10.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.861+0000 7fa43968c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa434113930 con 0x7fa434108d20 2024-09-21T00:54:10.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.861+0000 7fa43968c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa434113c30 con 0x7fa434102ae0 2024-09-21T00:54:10.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.861+0000 7fa4327fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4341083d0 0x7fa43419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:10.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.861+0000 7fa4327fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4341083d0 0x7fa43419aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43488/0 (socket says 172.21.15.1:43488) 2024-09-21T00:54:10.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.861+0000 7fa4327fc640 1 -- 172.21.15.1:0/1340565911 learned_addr learned my addr 172.21.15.1:0/1340565911 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:54:10.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.861+0000 7fa4337fe640 1 --2- 172.21.15.1:0/1340565911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa434108d20 0x7fa43419fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:10.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.861+0000 7fa432ffd640 1 --2- 172.21.15.1:0/1340565911 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa434102ae0 0x7fa43419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:10.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.861+0000 7fa4327fc640 1 -- 172.21.15.1:0/1340565911 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa434102ae0 msgr2=0x7fa43419a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:10.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.861+0000 7fa4327fc640 1 --2- 172.21.15.1:0/1340565911 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa434102ae0 0x7fa43419a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:10.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.861+0000 7fa4327fc640 1 -- 172.21.15.1:0/1340565911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa434108d20 msgr2=0x7fa43419fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:10.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.861+0000 7fa4327fc640 1 --2- 172.21.15.1:0/1340565911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa434108d20 0x7fa43419fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:10.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.861+0000 7fa4327fc640 1 -- 172.21.15.1:0/1340565911 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4341a03d0 con 0x7fa4341083d0 2024-09-21T00:54:10.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.861+0000 7fa4327fc640 1 --2- 172.21.15.1:0/1340565911 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4341083d0 0x7fa43419aa00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa42800e9f0 tx=0x7fa42800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:10.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.862+0000 7fa41bfff640 1 -- 172.21.15.1:0/1340565911 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa42800ccc0 con 0x7fa4341083d0 2024-09-21T00:54:10.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.862+0000 7fa41bfff640 1 -- 172.21.15.1:0/1340565911 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4280054d0 con 0x7fa4341083d0 2024-09-21T00:54:10.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.862+0000 7fa43968c640 1 -- 172.21.15.1:0/1340565911 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4341a06c0 con 0x7fa4341083d0 2024-09-21T00:54:10.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.862+0000 7fa41bfff640 1 -- 172.21.15.1:0/1340565911 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa428010430 con 0x7fa4341083d0 2024-09-21T00:54:10.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.862+0000 7fa43968c640 1 -- 172.21.15.1:0/1340565911 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4341a6e20 con 0x7fa4341083d0 2024-09-21T00:54:10.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.863+0000 7fa43968c640 1 -- 172.21.15.1:0/1340565911 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa434103d10 con 0x7fa4341083d0 2024-09-21T00:54:10.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.865+0000 7fa41bfff640 1 -- 172.21.15.1:0/1340565911 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 154511+0+0 (secure 0 0 0) 0x7fa4280046c0 con 0x7fa4341083d0 2024-09-21T00:54:10.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.866+0000 7fa41bfff640 1 --2- 172.21.15.1:0/1340565911 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa41c0b6510 0x7fa41c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:10.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.866+0000 7fa432ffd640 1 --2- 172.21.15.1:0/1340565911 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa41c0b6510 0x7fa41c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:10.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.866+0000 7fa41bfff640 1 -- 172.21.15.1:0/1340565911 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7fa4280e7430 con 0x7fa4341083d0 2024-09-21T00:54:10.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.867+0000 7fa432ffd640 1 --2- 172.21.15.1:0/1340565911 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa41c0b6510 0x7fa41c0b8a20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa424031440 tx=0x7fa424009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:10.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:10.870+0000 7fa41bfff640 1 -- 172.21.15.1:0/1340565911 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa428056710 con 0x7fa4341083d0 2024-09-21T00:54:11.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:11.057+0000 7fa43968c640 1 -- 172.21.15.1:0/1340565911 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa43419b590 con 0x7fa4341083d0 2024-09-21T00:54:11.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:11.058+0000 7fa41bfff640 1 -- 172.21.15.1:0/1340565911 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+18382 (secure 0 0 0) 0x7fa4280ae0c0 con 0x7fa4341083d0 2024-09-21T00:54:11.060 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:54:11.060 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":68,"fsid":"d3972c20-77b2-11ef-baf5-efdc52797490","created":"2024-09-21T00:46:29.745963+0000","modified":"2024-09-21T00:54:08.560535+0000","last_up_change":"2024-09-21T00:54:07.552837+0000","last_in_change":"2024-09-21T00:53:44.164415+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:50:16.456462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5bf09a34-4d6e-401c-8cef-29bbe72de68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6803","nonce":4067586847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6805","nonce":4067586847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6809","nonce":4067586847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6807","nonce":4067586847}]},"public_addr":"172.21.15.1:6803/4067586847","cluster_addr":"172.21.15.1:6805/4067586847","heartbeat_back_addr":"172.21.15.1:6809/4067586847","heartbeat_front_addr":"172.21.15.1:6807/4067586847","state":["exists","up"]},{"osd":1,"uuid":"195f9109-ef61-46be-a59a-d72e3a1b5b45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6801","nonce":436964633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6803","nonce":436964633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6807","nonce":436964633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6805","nonce":436964633}]},"public_addr":"172.21.15.42:6801/436964633","cluster_addr":"172.21.15.42:6803/436964633","heartbeat_back_addr":"172.21.15.42:6807/436964633","heartbeat_front_addr":"172.21.15.42:6805/436964633","state":["exists","up"]},{"osd":2,"uuid":"47cf90a7-6db6-464a-84ef-9f509f89a46b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6801","nonce":3495400570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6803","nonce":3495400570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6807","nonce":3495400570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6805","nonce":3495400570}]},"public_addr":"172.21.15.193:6801/3495400570","cluster_addr":"172.21.15.193:6803/3495400570","heartbeat_back_addr":"172.21.15.193:6807/3495400570","heartbeat_front_addr":"172.21.15.193:6805/3495400570","state":["exists","up"]},{"osd":3,"uuid":"a5230a66-3c74-41a7-9353-5650780ed25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6811","nonce":3221661671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6813","nonce":3221661671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6817","nonce":3221661671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6815","nonce":3221661671}]},"public_addr":"172.21.15.1:6811/3221661671","cluster_addr":"172.21.15.1:6813/3221661671","heartbeat_back_addr":"172.21.15.1:6817/3221661671","heartbeat_front_addr":"172.21.15.1:6815/3221661671","state":["exists","up"]},{"osd":4,"uuid":"b0476b9b-3257-46d4-aff7-1f038286ed43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6809","nonce":2066388104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6811","nonce":2066388104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6815","nonce":2066388104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6813","nonce":2066388104}]},"public_addr":"172.21.15.42:6809/2066388104","cluster_addr":"172.21.15.42:6811/2066388104","heartbeat_back_addr":"172.21.15.42:6815/2066388104","heartbeat_front_addr":"172.21.15.42:6813/2066388104","state":["exists","up"]},{"osd":5,"uuid":"96701ced-a55a-4ad9-be62-7f102c00697d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6809","nonce":732336675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6811","nonce":732336675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6815","nonce":732336675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6813","nonce":732336675}]},"public_addr":"172.21.15.193:6809/732336675","cluster_addr":"172.21.15.193:6811/732336675","heartbeat_back_addr":"172.21.15.193:6815/732336675","heartbeat_front_addr":"172.21.15.193:6813/732336675","state":["exists","up"]},{"osd":6,"uuid":"72d76017-e2e3-4118-8316-2c5da01c87b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6819","nonce":3201517067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6821","nonce":3201517067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6825","nonce":3201517067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6823","nonce":3201517067}]},"public_addr":"172.21.15.1:6819/3201517067","cluster_addr":"172.21.15.1:6821/3201517067","heartbeat_back_addr":"172.21.15.1:6825/3201517067","heartbeat_front_addr":"172.21.15.1:6823/3201517067","state":["exists","up"]},{"osd":7,"uuid":"8b239f96-2455-41b6-a905-9ed92078b890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6817","nonce":2124927218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6819","nonce":2124927218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6823","nonce":2124927218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6821","nonce":2124927218}]},"public_addr":"172.21.15.42:6817/2124927218","cluster_addr":"172.21.15.42:6819/2124927218","heartbeat_back_addr":"172.21.15.42:6823/2124927218","heartbeat_front_addr":"172.21.15.42:6821/2124927218","state":["exists","up"]},{"osd":8,"uuid":"8cd93aeb-fe00-4291-9f72-171d01893819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6817","nonce":2277449259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6819","nonce":2277449259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6823","nonce":2277449259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6821","nonce":2277449259}]},"public_addr":"172.21.15.193:6817/2277449259","cluster_addr":"172.21.15.193:6819/2277449259","heartbeat_back_addr":"172.21.15.193:6823/2277449259","heartbeat_front_addr":"172.21.15.193:6821/2277449259","state":["exists","up"]},{"osd":9,"uuid":"9e03e00b-0015-4aa8-adce-0d3352d2ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6827","nonce":1369323215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6829","nonce":1369323215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6833","nonce":1369323215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6831","nonce":1369323215}]},"public_addr":"172.21.15.1:6827/1369323215","cluster_addr":"172.21.15.1:6829/1369323215","heartbeat_back_addr":"172.21.15.1:6833/1369323215","heartbeat_front_addr":"172.21.15.1:6831/1369323215","state":["exists","up"]},{"osd":10,"uuid":"de55a908-b049-4f40-865f-cfa2ae6e461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6825","nonce":3182218295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6827","nonce":3182218295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6831","nonce":3182218295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6829","nonce":3182218295}]},"public_addr":"172.21.15.42:6825/3182218295","cluster_addr":"172.21.15.42:6827/3182218295","heartbeat_back_addr":"172.21.15.42:6831/3182218295","heartbeat_front_addr":"172.21.15.42:6829/3182218295","state":["exists","up"]},{"osd":11,"uuid":"1cac0c39-77aa-460b-92a0-39ed89cd6ce4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6825","nonce":2368815522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6827","nonce":2368815522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6831","nonce":2368815522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6829","nonce":2368815522}]},"public_addr":"172.21.15.193:6825/2368815522","cluster_addr":"172.21.15.193:6827/2368815522","heartbeat_back_addr":"172.21.15.193:6831/2368815522","heartbeat_front_addr":"172.21.15.193:6829/2368815522","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:49:21.491443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:49:47.486846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:50:12.757383+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:50:39.127690+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:05.545277+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:30.617491+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:57.612088+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:24.001953+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:48.447388+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:14.620538+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:40.503576+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:54:05.668236+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6801/59685083":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/309615464":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/1722941514":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/1199175740":"2024-09-22T00:47:25.985486+0000","172.21.15.1:6800/59685083":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/2811453932":"2024-09-22T00:46:58.953779+0000","172.21.15.1:0/3748689057":"2024-09-22T00:46:58.953779+0000","172.21.15.1:0/265697975":"2024-09-22T00:46:58.953779+0000","172.21.15.1:6801/1968786311":"2024-09-22T00:46:58.953779+0000","172.21.15.1:6800/1968786311":"2024-09-22T00:46:58.953779+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:54:11.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:11.060+0000 7fa43968c640 1 -- 172.21.15.1:0/1340565911 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa41c0b6510 msgr2=0x7fa41c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:11.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:11.060+0000 7fa43968c640 1 --2- 172.21.15.1:0/1340565911 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa41c0b6510 0x7fa41c0b8a20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa424031440 tx=0x7fa424009560 comp rx=0 tx=0).stop 2024-09-21T00:54:11.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:11.060+0000 7fa43968c640 1 -- 172.21.15.1:0/1340565911 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4341083d0 msgr2=0x7fa43419aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:11.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:11.060+0000 7fa43968c640 1 --2- 172.21.15.1:0/1340565911 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4341083d0 0x7fa43419aa00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa42800e9f0 tx=0x7fa42800eeb0 comp rx=0 tx=0).stop 2024-09-21T00:54:11.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:11.060+0000 7fa43968c640 1 -- 172.21.15.1:0/1340565911 shutdown_connections 2024-09-21T00:54:11.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:11.060+0000 7fa43968c640 1 --2- 172.21.15.1:0/1340565911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa434108d20 0x7fa43419fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:11.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:11.060+0000 7fa43968c640 1 --2- 172.21.15.1:0/1340565911 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa41c0b6510 0x7fa41c0b8a20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:11.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:11.060+0000 7fa43968c640 1 --2- 172.21.15.1:0/1340565911 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4341083d0 0x7fa43419aa00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:11.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:11.060+0000 7fa43968c640 1 --2- 172.21.15.1:0/1340565911 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa434102ae0 0x7fa43419a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:11.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:11.060+0000 7fa43968c640 1 -- 172.21.15.1:0/1340565911 >> 172.21.15.1:0/1340565911 conn(0x7fa434079760 msgr2=0x7fa434101520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:11.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:11.061+0000 7fa43968c640 1 -- 172.21.15.1:0/1340565911 shutdown_connections 2024-09-21T00:54:11.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:11.061+0000 7fa43968c640 1 -- 172.21.15.1:0/1340565911 wait complete. 2024-09-21T00:54:11.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:11 smithi001 ceph-mon[31211]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:11.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:11 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1340565911' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:54:11.857 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T00:50:16.456462+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T00:54:11.857 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-21T00:54:11.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:11 smithi193 ceph-mon[34660]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:11.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:11 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/1340565911' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:54:11.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:11 smithi042 ceph-mon[34481]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:11.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:11 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/1340565911' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:54:12.114 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:54:12.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.614+0000 7feab1b40640 1 -- 172.21.15.1:0/680610682 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feaac1094a0 msgr2=0x7feaac1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:12.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.614+0000 7feab1b40640 1 --2- 172.21.15.1:0/680610682 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feaac1094a0 0x7feaac1098b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fea94009900 tx=0x7fea9402a410 comp rx=0 tx=0).stop 2024-09-21T00:54:12.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.614+0000 7feab1b40640 1 -- 172.21.15.1:0/680610682 shutdown_connections 2024-09-21T00:54:12.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.614+0000 7feab1b40640 1 --2- 172.21.15.1:0/680610682 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feaac109df0 0x7feaac110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:12.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.614+0000 7feab1b40640 1 --2- 172.21.15.1:0/680610682 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feaac1094a0 0x7feaac1098b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:12.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.614+0000 7feab1b40640 1 --2- 172.21.15.1:0/680610682 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feaac103b60 0x7feaac103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:12.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.614+0000 7feab1b40640 1 -- 172.21.15.1:0/680610682 >> 172.21.15.1:0/680610682 conn(0x7feaac07b850 msgr2=0x7feaac07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:12.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.614+0000 7feab1b40640 1 -- 172.21.15.1:0/680610682 shutdown_connections 2024-09-21T00:54:12.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.614+0000 7feab1b40640 1 -- 172.21.15.1:0/680610682 wait complete. 2024-09-21T00:54:12.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.614+0000 7feab1b40640 1 Processor -- start 2024-09-21T00:54:12.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.614+0000 7feab1b40640 1 -- start start 2024-09-21T00:54:12.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.615+0000 7feab1b40640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feaac103b60 0x7feaac19a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:12.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.615+0000 7feab1b40640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feaac1094a0 0x7feaac19aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:12.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.615+0000 7feab1b40640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feaac109df0 0x7feaac19fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:12.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.615+0000 7feab1b40640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7feaac113ab0 con 0x7feaac109df0 2024-09-21T00:54:12.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.615+0000 7feab1b40640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7feaac113930 con 0x7feaac1094a0 2024-09-21T00:54:12.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.615+0000 7feab1b40640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7feaac113c30 con 0x7feaac103b60 2024-09-21T00:54:12.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.615+0000 7feaabfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feaac109df0 0x7feaac19fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:12.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.615+0000 7feaab7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feaac103b60 0x7feaac19a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:12.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.615+0000 7feaabfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feaac109df0 0x7feaac19fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43508/0 (socket says 172.21.15.1:43508) 2024-09-21T00:54:12.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.615+0000 7feaabfff640 1 -- 172.21.15.1:0/2471282646 learned_addr learned my addr 172.21.15.1:0/2471282646 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:54:12.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.615+0000 7feaa2ffd640 1 --2- 172.21.15.1:0/2471282646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feaac1094a0 0x7feaac19aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:12.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.615+0000 7feaabfff640 1 -- 172.21.15.1:0/2471282646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feaac103b60 msgr2=0x7feaac19a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:12.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.615+0000 7feaabfff640 1 --2- 172.21.15.1:0/2471282646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feaac103b60 0x7feaac19a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:12.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.615+0000 7feaabfff640 1 -- 172.21.15.1:0/2471282646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feaac1094a0 msgr2=0x7feaac19aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:12.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.615+0000 7feaabfff640 1 --2- 172.21.15.1:0/2471282646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feaac1094a0 0x7feaac19aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:12.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.615+0000 7feaabfff640 1 -- 172.21.15.1:0/2471282646 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaac1a0430 con 0x7feaac109df0 2024-09-21T00:54:12.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.615+0000 7feaab7fe640 1 --2- 172.21.15.1:0/2471282646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feaac103b60 0x7feaac19a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:54:12.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.616+0000 7feaabfff640 1 --2- 172.21.15.1:0/2471282646 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feaac109df0 0x7feaac19fd00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7feaa400eb10 tx=0x7feaa400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:12.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.616+0000 7feaa97fa640 1 -- 172.21.15.1:0/2471282646 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa4004b20 con 0x7feaac109df0 2024-09-21T00:54:12.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.616+0000 7feab1b40640 1 -- 172.21.15.1:0/2471282646 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaac1a0720 con 0x7feaac109df0 2024-09-21T00:54:12.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.616+0000 7feaa97fa640 1 -- 172.21.15.1:0/2471282646 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feaa4004cc0 con 0x7feaac109df0 2024-09-21T00:54:12.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.616+0000 7feaa97fa640 1 -- 172.21.15.1:0/2471282646 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa4010670 con 0x7feaac109df0 2024-09-21T00:54:12.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.616+0000 7feab1b40640 1 -- 172.21.15.1:0/2471282646 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaac1a6e80 con 0x7feaac109df0 2024-09-21T00:54:12.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.617+0000 7feab1b40640 1 -- 172.21.15.1:0/2471282646 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaac103f70 con 0x7feaac109df0 2024-09-21T00:54:12.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.619+0000 7feaa97fa640 1 -- 172.21.15.1:0/2471282646 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 154511+0+0 (secure 0 0 0) 0x7feaa4005020 con 0x7feaac109df0 2024-09-21T00:54:12.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.619+0000 7feaa97fa640 1 --2- 172.21.15.1:0/2471282646 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fea980b6510 0x7fea980b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:12.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.620+0000 7feaa97fa640 1 -- 172.21.15.1:0/2471282646 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7feaa40e7430 con 0x7feaac109df0 2024-09-21T00:54:12.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.620+0000 7feaab7fe640 1 --2- 172.21.15.1:0/2471282646 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fea980b6510 0x7fea980b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:12.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.620+0000 7feaab7fe640 1 --2- 172.21.15.1:0/2471282646 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fea980b6510 0x7fea980b8a20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fea9c00bfd0 tx=0x7fea9c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:12.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.624+0000 7feaa97fa640 1 -- 172.21.15.1:0/2471282646 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feaa40ae160 con 0x7feaac109df0 2024-09-21T00:54:12.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.809+0000 7feab1b40640 1 -- 172.21.15.1:0/2471282646 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7feaac02e640 con 0x7feaac109df0 2024-09-21T00:54:12.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.810+0000 7feaa97fa640 1 -- 172.21.15.1:0/2471282646 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) ==== 93+0+10 (secure 0 0 0) 0x7feaa40b2540 con 0x7feaac109df0 2024-09-21T00:54:12.811 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2024-09-21T00:54:12.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.812+0000 7feab1b40640 1 -- 172.21.15.1:0/2471282646 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fea980b6510 msgr2=0x7fea980b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:12.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.812+0000 7feab1b40640 1 --2- 172.21.15.1:0/2471282646 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fea980b6510 0x7fea980b8a20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fea9c00bfd0 tx=0x7fea9c00b390 comp rx=0 tx=0).stop 2024-09-21T00:54:12.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.812+0000 7feab1b40640 1 -- 172.21.15.1:0/2471282646 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feaac109df0 msgr2=0x7feaac19fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:12.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.812+0000 7feab1b40640 1 --2- 172.21.15.1:0/2471282646 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feaac109df0 0x7feaac19fd00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7feaa400eb10 tx=0x7feaa400c2d0 comp rx=0 tx=0).stop 2024-09-21T00:54:12.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.812+0000 7feab1b40640 1 -- 172.21.15.1:0/2471282646 shutdown_connections 2024-09-21T00:54:12.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.812+0000 7feab1b40640 1 --2- 172.21.15.1:0/2471282646 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fea980b6510 0x7fea980b8a20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:12.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.812+0000 7feab1b40640 1 --2- 172.21.15.1:0/2471282646 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feaac109df0 0x7feaac19fd00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:12.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.812+0000 7feab1b40640 1 --2- 172.21.15.1:0/2471282646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feaac1094a0 0x7feaac19aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:12.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.812+0000 7feab1b40640 1 --2- 172.21.15.1:0/2471282646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feaac103b60 0x7feaac19a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:12.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.812+0000 7feab1b40640 1 -- 172.21.15.1:0/2471282646 >> 172.21.15.1:0/2471282646 conn(0x7feaac07b850 msgr2=0x7feaac107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:12.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.812+0000 7feab1b40640 1 -- 172.21.15.1:0/2471282646 shutdown_connections 2024-09-21T00:54:12.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:12.812+0000 7feab1b40640 1 -- 172.21.15.1:0/2471282646 wait complete. 2024-09-21T00:54:13.595 INFO:tasks.cephadm:Adding mds.a on smithi001 2024-09-21T00:54:13.595 INFO:tasks.cephadm:Adding mds.d on smithi001 2024-09-21T00:54:13.596 INFO:tasks.cephadm:Adding mds.g on smithi001 2024-09-21T00:54:13.596 INFO:tasks.cephadm:Adding mds.j on smithi001 2024-09-21T00:54:13.596 INFO:tasks.cephadm:Adding mds.b on smithi042 2024-09-21T00:54:13.596 INFO:tasks.cephadm:Adding mds.e on smithi042 2024-09-21T00:54:13.596 INFO:tasks.cephadm:Adding mds.h on smithi042 2024-09-21T00:54:13.596 INFO:tasks.cephadm:Adding mds.k on smithi042 2024-09-21T00:54:13.596 INFO:tasks.cephadm:Adding mds.c on smithi193 2024-09-21T00:54:13.596 INFO:tasks.cephadm:Adding mds.f on smithi193 2024-09-21T00:54:13.596 INFO:tasks.cephadm:Adding mds.i on smithi193 2024-09-21T00:54:13.596 INFO:tasks.cephadm:Adding mds.l on smithi193 2024-09-21T00:54:13.596 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph orch apply mds all '12;smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi042=b;smithi042=e;smithi042=h;smithi042=k;smithi193=c;smithi193=f;smithi193=i;smithi193=l' 2024-09-21T00:54:13.835 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:13 smithi001 ceph-mon[31211]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:13.836 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:13 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/2471282646' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T00:54:13.844 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:54:13.965 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:13 smithi193 ceph-mon[34660]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:13.965 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:13 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/2471282646' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T00:54:13.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:13 smithi042 ceph-mon[34481]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:13.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:13 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/2471282646' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T00:54:14.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.337+0000 7f6349596640 1 -- 172.21.15.193:0/4235247030 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63441047e0 msgr2=0x7f6344104bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:14.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.337+0000 7f6349596640 1 --2- 172.21.15.193:0/4235247030 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63441047e0 0x7f6344104bf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f632c009900 tx=0x7f632c02a480 comp rx=0 tx=0).stop 2024-09-21T00:54:14.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.337+0000 7f6349596640 1 -- 172.21.15.193:0/4235247030 shutdown_connections 2024-09-21T00:54:14.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.337+0000 7f6349596640 1 --2- 172.21.15.193:0/4235247030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6344105180 0x7f634410bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:14.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.337+0000 7f6349596640 1 --2- 172.21.15.193:0/4235247030 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63441047e0 0x7f6344104bf0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:14.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.337+0000 7f6349596640 1 --2- 172.21.15.193:0/4235247030 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6344103750 0x7f6344103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:14.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.337+0000 7f6349596640 1 -- 172.21.15.193:0/4235247030 >> 172.21.15.193:0/4235247030 conn(0x7f63440ff0e0 msgr2=0x7f6344101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:14.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.337+0000 7f6349596640 1 -- 172.21.15.193:0/4235247030 shutdown_connections 2024-09-21T00:54:14.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.337+0000 7f6349596640 1 -- 172.21.15.193:0/4235247030 wait complete. 2024-09-21T00:54:14.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.338+0000 7f6349596640 1 Processor -- start 2024-09-21T00:54:14.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.338+0000 7f6349596640 1 -- start start 2024-09-21T00:54:14.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.338+0000 7f6349596640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6344103750 0x7f634419a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:14.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.338+0000 7f6349596640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63441047e0 0x7f634419a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:14.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.338+0000 7f6349596640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6344105180 0x7f634419b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:14.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.338+0000 7f6349596640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f634410f3a0 con 0x7f6344103750 2024-09-21T00:54:14.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.338+0000 7f6349596640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f634410f220 con 0x7f6344105180 2024-09-21T00:54:14.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.338+0000 7f6349596640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f634410f520 con 0x7f63441047e0 2024-09-21T00:54:14.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.338+0000 7f63427fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63441047e0 0x7f634419a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:14.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.338+0000 7f63427fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63441047e0 0x7f634419a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.193:51348/0 (socket says 172.21.15.193:51348) 2024-09-21T00:54:14.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.338+0000 7f63427fc640 1 -- 172.21.15.193:0/740082410 learned_addr learned my addr 172.21.15.193:0/740082410 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-21T00:54:14.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.338+0000 7f63437fe640 1 --2- 172.21.15.193:0/740082410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6344105180 0x7f634419b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:14.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.338+0000 7f6342ffd640 1 --2- 172.21.15.193:0/740082410 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6344103750 0x7f634419a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:14.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.338+0000 7f63427fc640 1 -- 172.21.15.193:0/740082410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6344105180 msgr2=0x7f634419b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:14.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.338+0000 7f63427fc640 1 --2- 172.21.15.193:0/740082410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6344105180 0x7f634419b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:14.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.338+0000 7f63427fc640 1 -- 172.21.15.193:0/740082410 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6344103750 msgr2=0x7f634419a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:14.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.338+0000 7f63427fc640 1 --2- 172.21.15.193:0/740082410 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6344103750 0x7f634419a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:14.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.339+0000 7f63427fc640 1 -- 172.21.15.193:0/740082410 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f634419b9a0 con 0x7f63441047e0 2024-09-21T00:54:14.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.339+0000 7f63427fc640 1 --2- 172.21.15.193:0/740082410 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63441047e0 0x7f634419a670 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f632c006010 tx=0x7f632c004340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:14.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.339+0000 7f633bfff640 1 -- 172.21.15.193:0/740082410 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c03f030 con 0x7f63441047e0 2024-09-21T00:54:14.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.339+0000 7f6349596640 1 -- 172.21.15.193:0/740082410 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f634419bc30 con 0x7f63441047e0 2024-09-21T00:54:14.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.339+0000 7f633bfff640 1 -- 172.21.15.193:0/740082410 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f632c003cb0 con 0x7f63441047e0 2024-09-21T00:54:14.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.339+0000 7f633bfff640 1 -- 172.21.15.193:0/740082410 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c035070 con 0x7f63441047e0 2024-09-21T00:54:14.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.339+0000 7f6349596640 1 -- 172.21.15.193:0/740082410 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63441a2250 con 0x7f63441047e0 2024-09-21T00:54:14.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.340+0000 7f6349596640 1 -- 172.21.15.193:0/740082410 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f634410a930 con 0x7f63441047e0 2024-09-21T00:54:14.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.341+0000 7f633bfff640 1 -- 172.21.15.193:0/740082410 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 16) ==== 154511+0+0 (secure 0 0 0) 0x7f632c042030 con 0x7f63441047e0 2024-09-21T00:54:14.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.342+0000 7f633bfff640 1 --2- 172.21.15.193:0/740082410 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f63300b6510 0x7f63300b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:14.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.343+0000 7f6342ffd640 1 --2- 172.21.15.193:0/740082410 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f63300b6510 0x7f63300b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:14.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.343+0000 7f633bfff640 1 -- 172.21.15.193:0/740082410 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f632c107bf0 con 0x7f63441047e0 2024-09-21T00:54:14.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.343+0000 7f6342ffd640 1 --2- 172.21.15.193:0/740082410 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f63300b6510 0x7f63300b8a20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6334005fd0 tx=0x7f6334009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:14.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.346+0000 7f633bfff640 1 -- 172.21.15.193:0/740082410 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f632c003e60 con 0x7f63441047e0 2024-09-21T00:54:14.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.535+0000 7f6349596640 1 -- 172.21.15.193:0/740082410 --> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi042=b;smithi042=e;smithi042=h;smithi042=k;smithi193=c;smithi193=f;smithi193=i;smithi193=l", "target": ["mon-mgr", ""]}) -- 0x7f63440639c0 con 0x7f63300b6510 2024-09-21T00:54:14.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.544+0000 7f633bfff640 1 -- 172.21.15.193:0/740082410 <== mgr.14150 v2:172.21.15.1:6800/2032980330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f63440639c0 con 0x7f63300b6510 2024-09-21T00:54:14.545 INFO:teuthology.orchestra.run.smithi193.stdout:Scheduled mds.all update... 2024-09-21T00:54:14.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.546+0000 7f6349596640 1 -- 172.21.15.193:0/740082410 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f63300b6510 msgr2=0x7f63300b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:14.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.546+0000 7f6349596640 1 --2- 172.21.15.193:0/740082410 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f63300b6510 0x7f63300b8a20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6334005fd0 tx=0x7f6334009680 comp rx=0 tx=0).stop 2024-09-21T00:54:14.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.546+0000 7f6349596640 1 -- 172.21.15.193:0/740082410 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63441047e0 msgr2=0x7f634419a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:14.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.546+0000 7f6349596640 1 --2- 172.21.15.193:0/740082410 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63441047e0 0x7f634419a670 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f632c006010 tx=0x7f632c004340 comp rx=0 tx=0).stop 2024-09-21T00:54:14.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.546+0000 7f6349596640 1 -- 172.21.15.193:0/740082410 shutdown_connections 2024-09-21T00:54:14.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.546+0000 7f6349596640 1 --2- 172.21.15.193:0/740082410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6344105180 0x7f634419b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:14.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.546+0000 7f6349596640 1 --2- 172.21.15.193:0/740082410 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63441047e0 0x7f634419a670 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:14.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.546+0000 7f6349596640 1 --2- 172.21.15.193:0/740082410 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f63300b6510 0x7f63300b8a20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:14.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.546+0000 7f6349596640 1 --2- 172.21.15.193:0/740082410 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6344103750 0x7f634419a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:14.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.546+0000 7f6349596640 1 -- 172.21.15.193:0/740082410 >> 172.21.15.193:0/740082410 conn(0x7f63440ff0e0 msgr2=0x7f6344107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:14.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.546+0000 7f6349596640 1 -- 172.21.15.193:0/740082410 shutdown_connections 2024-09-21T00:54:14.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-21T00:54:14.546+0000 7f6349596640 1 -- 172.21.15.193:0/740082410 wait complete. 2024-09-21T00:54:15.221 DEBUG:teuthology.orchestra.run.smithi001:mds.a> sudo journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.a.service 2024-09-21T00:54:15.223 DEBUG:teuthology.orchestra.run.smithi001:mds.d> sudo journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.d.service 2024-09-21T00:54:15.268 DEBUG:teuthology.orchestra.run.smithi001:mds.g> sudo journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.g.service 2024-09-21T00:54:15.311 DEBUG:teuthology.orchestra.run.smithi001:mds.j> sudo journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.j.service 2024-09-21T00:54:15.355 DEBUG:teuthology.orchestra.run.smithi042:mds.b> sudo journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.b.service 2024-09-21T00:54:15.358 DEBUG:teuthology.orchestra.run.smithi042:mds.e> sudo journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.e.service 2024-09-21T00:54:15.402 DEBUG:teuthology.orchestra.run.smithi042:mds.h> sudo journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.h.service 2024-09-21T00:54:15.445 DEBUG:teuthology.orchestra.run.smithi042:mds.k> sudo journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.k.service 2024-09-21T00:54:15.488 DEBUG:teuthology.orchestra.run.smithi193:mds.c> sudo journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.c.service 2024-09-21T00:54:15.490 DEBUG:teuthology.orchestra.run.smithi193:mds.f> sudo journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.f.service 2024-09-21T00:54:15.533 DEBUG:teuthology.orchestra.run.smithi193:mds.i> sudo journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.i.service 2024-09-21T00:54:15.576 DEBUG:teuthology.orchestra.run.smithi193:mds.l> sudo journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.l.service 2024-09-21T00:54:15.621 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-21T00:54:15.621 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:54:15.627 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:15 smithi193 ceph-mon[34660]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:15.628 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:15 smithi193 ceph-mon[34660]: from='client.24559 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi042=b;smithi042=e;smithi042=h;smithi042=k;smithi193=c;smithi193=f;smithi193=i;smithi193=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:15.628 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:15 smithi193 ceph-mon[34660]: Saving service mds.all spec with placement smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi042=b;smithi042=e;smithi042=h;smithi042=k;smithi193=c;smithi193=f;smithi193=i;smithi193=l;count:12 2024-09-21T00:54:15.628 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:15 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:15.628 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:15 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:54:15.628 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:15 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:15.628 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:15 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:54:15.628 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:15 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:15.628 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:15 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:54:15.628 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:15 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:15.628 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:15 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:15.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:15 smithi042 ceph-mon[34481]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:15.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:15 smithi042 ceph-mon[34481]: from='client.24559 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi042=b;smithi042=e;smithi042=h;smithi042=k;smithi193=c;smithi193=f;smithi193=i;smithi193=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:15.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:15 smithi042 ceph-mon[34481]: Saving service mds.all spec with placement smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi042=b;smithi042=e;smithi042=h;smithi042=k;smithi193=c;smithi193=f;smithi193=i;smithi193=l;count:12 2024-09-21T00:54:15.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:15 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:15.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:15 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:54:15.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:15 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:15.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:15 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:54:15.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:15 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:15.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:15 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:54:15.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:15 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:15.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:15 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:15.877 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:54:15.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:15 smithi001 ceph-mon[31211]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:15.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:15 smithi001 ceph-mon[31211]: from='client.24559 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi042=b;smithi042=e;smithi042=h;smithi042=k;smithi193=c;smithi193=f;smithi193=i;smithi193=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:15.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:15 smithi001 ceph-mon[31211]: Saving service mds.all spec with placement smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi042=b;smithi042=e;smithi042=h;smithi042=k;smithi193=c;smithi193=f;smithi193=i;smithi193=l;count:12 2024-09-21T00:54:15.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:15 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:15.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:15 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:54:15.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:15 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:15.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:15 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:54:15.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:15 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:15.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:15 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:54:15.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:15 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:15.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:15 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:16.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.344+0000 7f88775f4640 1 -- 172.21.15.1:0/2922320543 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8870102f50 msgr2=0x7f887010fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:16.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.344+0000 7f88775f4640 1 --2- 172.21.15.1:0/2922320543 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8870102f50 0x7f887010fc70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8860009900 tx=0x7f886002a480 comp rx=0 tx=0).stop 2024-09-21T00:54:16.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.345+0000 7f88775f4640 1 -- 172.21.15.1:0/2922320543 shutdown_connections 2024-09-21T00:54:16.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.345+0000 7f88775f4640 1 --2- 172.21.15.1:0/2922320543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88701101b0 0x7f88701125d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:16.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.345+0000 7f88775f4640 1 --2- 172.21.15.1:0/2922320543 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8870102f50 0x7f887010fc70 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:16.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.345+0000 7f88775f4640 1 --2- 172.21.15.1:0/2922320543 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8870102600 0x7f8870102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:16.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.345+0000 7f88775f4640 1 -- 172.21.15.1:0/2922320543 >> 172.21.15.1:0/2922320543 conn(0x7f8870079750 msgr2=0x7f8870079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:16.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.345+0000 7f88775f4640 1 -- 172.21.15.1:0/2922320543 shutdown_connections 2024-09-21T00:54:16.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.345+0000 7f88775f4640 1 -- 172.21.15.1:0/2922320543 wait complete. 2024-09-21T00:54:16.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.345+0000 7f88775f4640 1 Processor -- start 2024-09-21T00:54:16.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.345+0000 7f88775f4640 1 -- start start 2024-09-21T00:54:16.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.346+0000 7f88775f4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8870102600 0x7f887019c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:16.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.346+0000 7f88775f4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8870102f50 0x7f887019cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:16.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.346+0000 7f88775f4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88701101b0 0x7f88701a1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:16.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.346+0000 7f88775f4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8870115ca0 con 0x7f88701101b0 2024-09-21T00:54:16.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.346+0000 7f88775f4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8870115b20 con 0x7f8870102f50 2024-09-21T00:54:16.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.346+0000 7f88775f4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8870115e20 con 0x7f8870102600 2024-09-21T00:54:16.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.346+0000 7f8875b91640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88701101b0 0x7f88701a1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:16.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.346+0000 7f8875b91640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88701101b0 0x7f88701a1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43526/0 (socket says 172.21.15.1:43526) 2024-09-21T00:54:16.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.346+0000 7f8875b91640 1 -- 172.21.15.1:0/709392990 learned_addr learned my addr 172.21.15.1:0/709392990 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:54:16.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.346+0000 7f8874b8f640 1 --2- 172.21.15.1:0/709392990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8870102f50 0x7f887019cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:16.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.346+0000 7f8875390640 1 --2- 172.21.15.1:0/709392990 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8870102600 0x7f887019c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:16.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.346+0000 7f8875b91640 1 -- 172.21.15.1:0/709392990 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8870102600 msgr2=0x7f887019c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:16.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.346+0000 7f8875b91640 1 --2- 172.21.15.1:0/709392990 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8870102600 0x7f887019c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:16.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.346+0000 7f8875b91640 1 -- 172.21.15.1:0/709392990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8870102f50 msgr2=0x7f887019cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:16.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.346+0000 7f8875b91640 1 --2- 172.21.15.1:0/709392990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8870102f50 0x7f887019cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:16.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.346+0000 7f8875b91640 1 -- 172.21.15.1:0/709392990 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88701a2620 con 0x7f88701101b0 2024-09-21T00:54:16.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.346+0000 7f8875b91640 1 --2- 172.21.15.1:0/709392990 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88701101b0 0x7f88701a1ef0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f886800eaa0 tx=0x7f886800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:16.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.346+0000 7f88667fc640 1 -- 172.21.15.1:0/709392990 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886800cdb0 con 0x7f88701101b0 2024-09-21T00:54:16.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.346+0000 7f88667fc640 1 -- 172.21.15.1:0/709392990 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8868005020 con 0x7f88701101b0 2024-09-21T00:54:16.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.346+0000 7f88775f4640 1 -- 172.21.15.1:0/709392990 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88701a2910 con 0x7f88701101b0 2024-09-21T00:54:16.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.347+0000 7f88667fc640 1 -- 172.21.15.1:0/709392990 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88680116d0 con 0x7f88701101b0 2024-09-21T00:54:16.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.347+0000 7f88775f4640 1 -- 172.21.15.1:0/709392990 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88701a9070 con 0x7f88701101b0 2024-09-21T00:54:16.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.348+0000 7f88775f4640 1 -- 172.21.15.1:0/709392990 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f887006c280 con 0x7f88701101b0 2024-09-21T00:54:16.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.350+0000 7f88667fc640 1 -- 172.21.15.1:0/709392990 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 154511+0+0 (secure 0 0 0) 0x7f88680051d0 con 0x7f88701101b0 2024-09-21T00:54:16.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.350+0000 7f88667fc640 1 --2- 172.21.15.1:0/709392990 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f885c0b6510 0x7f885c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:16.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.351+0000 7f8875390640 1 --2- 172.21.15.1:0/709392990 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f885c0b6510 0x7f885c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:16.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.351+0000 7f88667fc640 1 -- 172.21.15.1:0/709392990 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f88680e7340 con 0x7f88701101b0 2024-09-21T00:54:16.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.351+0000 7f8875390640 1 --2- 172.21.15.1:0/709392990 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f885c0b6510 0x7f885c0b8a20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f886c005fd0 tx=0x7f886c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:16.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.353+0000 7f88667fc640 1 -- 172.21.15.1:0/709392990 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8868016030 con 0x7f88701101b0 2024-09-21T00:54:16.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.584+0000 7f88775f4640 1 -- 172.21.15.1:0/709392990 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8870102a10 con 0x7f88701101b0 2024-09-21T00:54:16.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.585+0000 7f88667fc640 1 -- 172.21.15.1:0/709392990 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f8870102a10 con 0x7f88701101b0 2024-09-21T00:54:16.586 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:54:16.586 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":1,"btime":"2024-09-21T00:46:29:745789+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-21T00:54:16.586 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 1 2024-09-21T00:54:16.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.587+0000 7f88775f4640 1 -- 172.21.15.1:0/709392990 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f885c0b6510 msgr2=0x7f885c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:16.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.587+0000 7f88775f4640 1 --2- 172.21.15.1:0/709392990 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f885c0b6510 0x7f885c0b8a20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f886c005fd0 tx=0x7f886c00b390 comp rx=0 tx=0).stop 2024-09-21T00:54:16.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.587+0000 7f88775f4640 1 -- 172.21.15.1:0/709392990 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88701101b0 msgr2=0x7f88701a1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:16.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.587+0000 7f88775f4640 1 --2- 172.21.15.1:0/709392990 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88701101b0 0x7f88701a1ef0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f886800eaa0 tx=0x7f886800ef60 comp rx=0 tx=0).stop 2024-09-21T00:54:16.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.587+0000 7f88775f4640 1 -- 172.21.15.1:0/709392990 shutdown_connections 2024-09-21T00:54:16.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.587+0000 7f88775f4640 1 --2- 172.21.15.1:0/709392990 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f885c0b6510 0x7f885c0b8a20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:16.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.587+0000 7f88775f4640 1 --2- 172.21.15.1:0/709392990 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88701101b0 0x7f88701a1ef0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:16.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.587+0000 7f88775f4640 1 --2- 172.21.15.1:0/709392990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8870102f50 0x7f887019cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:16.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.587+0000 7f88775f4640 1 --2- 172.21.15.1:0/709392990 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8870102600 0x7f887019c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:16.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.587+0000 7f88775f4640 1 -- 172.21.15.1:0/709392990 >> 172.21.15.1:0/709392990 conn(0x7f8870079750 msgr2=0x7f8870108c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:16.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.587+0000 7f88775f4640 1 -- 172.21.15.1:0/709392990 shutdown_connections 2024-09-21T00:54:16.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:16.587+0000 7f88775f4640 1 -- 172.21.15.1:0/709392990 wait complete. 2024-09-21T00:54:16.787 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:16 smithi193 ceph-mon[34660]: Deploying daemon mds.l on smithi193 2024-09-21T00:54:16.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:16 smithi001 ceph-mon[31211]: Deploying daemon mds.l on smithi193 2024-09-21T00:54:16.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:16 smithi042 ceph-mon[34481]: Deploying daemon mds.l on smithi193 2024-09-21T00:54:17.174 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 21 00:54:16 smithi193 systemd[1]: Starting Ceph mds.l for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T00:54:17.442 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 21 00:54:17 smithi193 podman[62704]: 2024-09-21 00:54:17.076075423 +0000 UTC m=+0.015638264 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:54:17.442 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 21 00:54:17 smithi193 podman[62704]: 2024-09-21 00:54:17.194584207 +0000 UTC m=+0.134147081 container create 5d6c26317024e67a15252d387c31c4e65d5e7bd9a2edfe8a5808f48c4594afbb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T00:54:17.442 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 21 00:54:17 smithi193 podman[62704]: 2024-09-21 00:54:17.405395572 +0000 UTC m=+0.344958407 container init 5d6c26317024e67a15252d387c31c4e65d5e7bd9a2edfe8a5808f48c4594afbb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-21T00:54:17.442 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 21 00:54:17 smithi193 podman[62704]: 2024-09-21 00:54:17.408492987 +0000 UTC m=+0.348055821 container start 5d6c26317024e67a15252d387c31c4e65d5e7bd9a2edfe8a5808f48c4594afbb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-l, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T00:54:17.442 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 21 00:54:17 smithi193 ceph-mds[62724]: -- 172.21.15.193:0/2638228693 <== mon.1 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b0f7b8f860 con 0x55b0fbd37a80 2024-09-21T00:54:17.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:17 smithi193 ceph-mon[34660]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:17.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:17 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/709392990' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:54:17.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:17 smithi193 ceph-mon[34660]: mds.? [v2:172.21.15.193:6832/712170939,v1:172.21.15.193:6833/712170939] up:boot 2024-09-21T00:54:17.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:17 smithi193 ceph-mon[34660]: fsmap 1 up:standby 2024-09-21T00:54:17.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T00:54:17.730 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 21 00:54:17 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-l[62720]: starting mds.l at 2024-09-21T00:54:17.730 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 21 00:54:17 smithi193 bash[62704]: 5d6c26317024e67a15252d387c31c4e65d5e7bd9a2edfe8a5808f48c4594afbb 2024-09-21T00:54:17.730 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 21 00:54:17 smithi193 systemd[1]: Started Ceph mds.l for d3972c20-77b2-11ef-baf5-efdc52797490. 2024-09-21T00:54:17.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:17 smithi001 ceph-mon[31211]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:17.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:17 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/709392990' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:54:17.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:17 smithi001 ceph-mon[31211]: mds.? [v2:172.21.15.193:6832/712170939,v1:172.21.15.193:6833/712170939] up:boot 2024-09-21T00:54:17.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:17 smithi001 ceph-mon[31211]: fsmap 1 up:standby 2024-09-21T00:54:17.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T00:54:17.978 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:17 smithi042 ceph-mon[34481]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:17.978 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:17 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/709392990' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:54:17.978 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:17 smithi042 ceph-mon[34481]: mds.? [v2:172.21.15.193:6832/712170939,v1:172.21.15.193:6833/712170939] up:boot 2024-09-21T00:54:17.978 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:17 smithi042 ceph-mon[34481]: fsmap 1 up:standby 2024-09-21T00:54:17.978 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T00:54:18.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:18 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:18.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:18 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:18.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:18 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:18.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:18 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:54:18.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:18 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:18.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:18 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:18.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:18 smithi001 ceph-mon[31211]: Deploying daemon mds.k on smithi042 2024-09-21T00:54:18.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:18 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:18.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:18 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:18.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:18 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:18.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:18 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:54:18.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:18 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:18.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:18 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:18.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:18 smithi193 ceph-mon[34660]: Deploying daemon mds.k on smithi042 2024-09-21T00:54:18.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:18 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:18.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:18 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:18.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:18 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:18.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:18 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:54:18.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:18 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:18.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:18 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:18.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:18 smithi042 ceph-mon[34481]: Deploying daemon mds.k on smithi042 2024-09-21T00:54:19.519 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:54:19.581 INFO:journalctl@ceph.mds.k.smithi042.stdout:Sep 21 00:54:19 smithi042 systemd[1]: Starting Ceph mds.k for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T00:54:19.788 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:54:19.905 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:19 smithi042 ceph-mon[34481]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:19.906 INFO:journalctl@ceph.mds.k.smithi042.stdout:Sep 21 00:54:19 smithi042 podman[62601]: 2024-09-21 00:54:19.619612788 +0000 UTC m=+0.015738339 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:54:19.906 INFO:journalctl@ceph.mds.k.smithi042.stdout:Sep 21 00:54:19 smithi042 podman[62601]: 2024-09-21 00:54:19.781456049 +0000 UTC m=+0.177581589 container create 6434f40b0814a7bb4737c3f96121125ab0b6e84e54da6d4373246a67f69f246f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-k, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T00:54:19.909 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:19 smithi001 ceph-mon[31211]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:19.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:19 smithi193 ceph-mon[34660]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:20.242 INFO:journalctl@ceph.mds.k.smithi042.stdout:Sep 21 00:54:20 smithi042 podman[62601]: 2024-09-21 00:54:20.034544151 +0000 UTC m=+0.430669702 container init 6434f40b0814a7bb4737c3f96121125ab0b6e84e54da6d4373246a67f69f246f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-k, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-21T00:54:20.243 INFO:journalctl@ceph.mds.k.smithi042.stdout:Sep 21 00:54:20 smithi042 podman[62601]: 2024-09-21 00:54:20.037488482 +0000 UTC m=+0.433614021 container start 6434f40b0814a7bb4737c3f96121125ab0b6e84e54da6d4373246a67f69f246f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-k, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T00:54:20.243 INFO:journalctl@ceph.mds.k.smithi042.stdout:Sep 21 00:54:20 smithi042 ceph-mds[62620]: -- 172.21.15.42:0/3612783911 <== mon.2 v2:172.21.15.42:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f3caab7860 con 0x55f3cec5f180 2024-09-21T00:54:20.243 INFO:journalctl@ceph.mds.k.smithi042.stdout:Sep 21 00:54:20 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-k[62615]: starting mds.k at 2024-09-21T00:54:20.243 INFO:journalctl@ceph.mds.k.smithi042.stdout:Sep 21 00:54:20 smithi042 bash[62601]: 6434f40b0814a7bb4737c3f96121125ab0b6e84e54da6d4373246a67f69f246f 2024-09-21T00:54:20.243 INFO:journalctl@ceph.mds.k.smithi042.stdout:Sep 21 00:54:20 smithi042 systemd[1]: Started Ceph mds.k for d3972c20-77b2-11ef-baf5-efdc52797490. 2024-09-21T00:54:20.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.269+0000 7ff9730bf640 1 -- 172.21.15.1:0/957458467 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff96c102a60 msgr2=0x7ff96c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:20.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.269+0000 7ff9730bf640 1 --2- 172.21.15.1:0/957458467 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff96c102a60 0x7ff96c102e70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff954009900 tx=0x7ff95402a410 comp rx=0 tx=0).stop 2024-09-21T00:54:20.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.269+0000 7ff9730bf640 1 -- 172.21.15.1:0/957458467 shutdown_connections 2024-09-21T00:54:20.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.269+0000 7ff9730bf640 1 --2- 172.21.15.1:0/957458467 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff96c108cf0 0x7ff96c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:20.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.269+0000 7ff9730bf640 1 --2- 172.21.15.1:0/957458467 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff96c1083a0 0x7ff96c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:20.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.269+0000 7ff9730bf640 1 --2- 172.21.15.1:0/957458467 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff96c102a60 0x7ff96c102e70 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:20.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.269+0000 7ff9730bf640 1 -- 172.21.15.1:0/957458467 >> 172.21.15.1:0/957458467 conn(0x7ff96c079730 msgr2=0x7ff96c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:20.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.269+0000 7ff9730bf640 1 -- 172.21.15.1:0/957458467 shutdown_connections 2024-09-21T00:54:20.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.269+0000 7ff9730bf640 1 -- 172.21.15.1:0/957458467 wait complete. 2024-09-21T00:54:20.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.270+0000 7ff9730bf640 1 Processor -- start 2024-09-21T00:54:20.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.270+0000 7ff9730bf640 1 -- start start 2024-09-21T00:54:20.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.270+0000 7ff9730bf640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff96c102a60 0x7ff96c104410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:20.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.270+0000 7ff9730bf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff96c1083a0 0x7ff96c104950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:20.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.270+0000 7ff9730bf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff96c108cf0 0x7ff96c104e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:20.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.270+0000 7ff9730bf640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff96c112960 con 0x7ff96c108cf0 2024-09-21T00:54:20.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.270+0000 7ff9730bf640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff96c1127e0 con 0x7ff96c1083a0 2024-09-21T00:54:20.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.270+0000 7ff9730bf640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff96c112ae0 con 0x7ff96c102a60 2024-09-21T00:54:20.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.270+0000 7ff97165c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff96c108cf0 0x7ff96c104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:20.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.270+0000 7ff96bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff96c1083a0 0x7ff96c104950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:20.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.270+0000 7ff97165c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff96c108cf0 0x7ff96c104e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47344/0 (socket says 172.21.15.1:47344) 2024-09-21T00:54:20.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.270+0000 7ff97165c640 1 -- 172.21.15.1:0/1337943311 learned_addr learned my addr 172.21.15.1:0/1337943311 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:54:20.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.271+0000 7ff970e5b640 1 --2- 172.21.15.1:0/1337943311 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff96c102a60 0x7ff96c104410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:20.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.271+0000 7ff97165c640 1 -- 172.21.15.1:0/1337943311 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff96c102a60 msgr2=0x7ff96c104410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:20.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.271+0000 7ff97165c640 1 --2- 172.21.15.1:0/1337943311 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff96c102a60 0x7ff96c104410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:20.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.271+0000 7ff97165c640 1 -- 172.21.15.1:0/1337943311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff96c1083a0 msgr2=0x7ff96c104950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:20.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.271+0000 7ff97165c640 1 --2- 172.21.15.1:0/1337943311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff96c1083a0 0x7ff96c104950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:20.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.271+0000 7ff97165c640 1 -- 172.21.15.1:0/1337943311 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff96c1a8740 con 0x7ff96c108cf0 2024-09-21T00:54:20.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.271+0000 7ff96bfff640 1 --2- 172.21.15.1:0/1337943311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff96c1083a0 0x7ff96c104950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:54:20.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.271+0000 7ff97165c640 1 --2- 172.21.15.1:0/1337943311 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff96c108cf0 0x7ff96c104e90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff964009fd0 tx=0x7ff96400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:20.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.271+0000 7ff969ffb640 1 -- 172.21.15.1:0/1337943311 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff964017070 con 0x7ff96c108cf0 2024-09-21T00:54:20.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.271+0000 7ff9730bf640 1 -- 172.21.15.1:0/1337943311 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff96c1a8a30 con 0x7ff96c108cf0 2024-09-21T00:54:20.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.271+0000 7ff969ffb640 1 -- 172.21.15.1:0/1337943311 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff964003e20 con 0x7ff96c108cf0 2024-09-21T00:54:20.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.271+0000 7ff969ffb640 1 -- 172.21.15.1:0/1337943311 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff964010460 con 0x7ff96c108cf0 2024-09-21T00:54:20.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.272+0000 7ff9730bf640 1 -- 172.21.15.1:0/1337943311 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff96c1a8f70 con 0x7ff96c108cf0 2024-09-21T00:54:20.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.273+0000 7ff9730bf640 1 -- 172.21.15.1:0/1337943311 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff96c102e70 con 0x7ff96c108cf0 2024-09-21T00:54:20.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.275+0000 7ff969ffb640 1 -- 172.21.15.1:0/1337943311 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 154511+0+0 (secure 0 0 0) 0x7ff964003970 con 0x7ff96c108cf0 2024-09-21T00:54:20.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.276+0000 7ff969ffb640 1 --2- 172.21.15.1:0/1337943311 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff9580b6510 0x7ff9580b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:20.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.276+0000 7ff969ffb640 1 -- 172.21.15.1:0/1337943311 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7ff9640e6c10 con 0x7ff96c108cf0 2024-09-21T00:54:20.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.276+0000 7ff970e5b640 1 --2- 172.21.15.1:0/1337943311 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff9580b6510 0x7ff9580b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:20.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.277+0000 7ff970e5b640 1 --2- 172.21.15.1:0/1337943311 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff9580b6510 0x7ff9580b8a20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff954000c00 tx=0x7ff954031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:20.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.278+0000 7ff969ffb640 1 -- 172.21.15.1:0/1337943311 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff9640ad940 con 0x7ff96c108cf0 2024-09-21T00:54:20.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.519+0000 7ff9730bf640 1 -- 172.21.15.1:0/1337943311 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff96c1a9340 con 0x7ff96c108cf0 2024-09-21T00:54:20.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.519+0000 7ff969ffb640 1 -- 172.21.15.1:0/1337943311 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1435 (secure 0 0 0) 0x7ff9640b1d20 con 0x7ff96c108cf0 2024-09-21T00:54:20.520 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:54:20.520 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":2,"btime":"2024-09-21T00:54:17:446987+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/712170939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":712170939},{"type":"v1","addr":"172.21.15.193:6833","nonce":712170939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T00:54:20.521 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 2 2024-09-21T00:54:20.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.522+0000 7ff9730bf640 1 -- 172.21.15.1:0/1337943311 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff9580b6510 msgr2=0x7ff9580b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:20.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.522+0000 7ff9730bf640 1 --2- 172.21.15.1:0/1337943311 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff9580b6510 0x7ff9580b8a20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff954000c00 tx=0x7ff954031400 comp rx=0 tx=0).stop 2024-09-21T00:54:20.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.522+0000 7ff9730bf640 1 -- 172.21.15.1:0/1337943311 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff96c108cf0 msgr2=0x7ff96c104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:20.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.522+0000 7ff9730bf640 1 --2- 172.21.15.1:0/1337943311 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff96c108cf0 0x7ff96c104e90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff964009fd0 tx=0x7ff96400b260 comp rx=0 tx=0).stop 2024-09-21T00:54:20.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.522+0000 7ff9730bf640 1 -- 172.21.15.1:0/1337943311 shutdown_connections 2024-09-21T00:54:20.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.522+0000 7ff9730bf640 1 --2- 172.21.15.1:0/1337943311 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff9580b6510 0x7ff9580b8a20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:20.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.522+0000 7ff9730bf640 1 --2- 172.21.15.1:0/1337943311 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff96c108cf0 0x7ff96c104e90 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:20.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.522+0000 7ff9730bf640 1 --2- 172.21.15.1:0/1337943311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff96c1083a0 0x7ff96c104950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:20.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.522+0000 7ff9730bf640 1 --2- 172.21.15.1:0/1337943311 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff96c102a60 0x7ff96c104410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:20.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.522+0000 7ff9730bf640 1 -- 172.21.15.1:0/1337943311 >> 172.21.15.1:0/1337943311 conn(0x7ff96c079730 msgr2=0x7ff96c106740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:20.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.522+0000 7ff9730bf640 1 -- 172.21.15.1:0/1337943311 shutdown_connections 2024-09-21T00:54:20.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:20.522+0000 7ff9730bf640 1 -- 172.21.15.1:0/1337943311 wait complete. 2024-09-21T00:54:21.269 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:21 smithi001 ceph-mon[31211]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:21.269 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:21 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:21.269 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:21 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:21.269 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:21 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:21.269 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:21 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:54:21.269 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:21 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:21.269 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:21 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:21.270 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:21 smithi001 ceph-mon[31211]: Deploying daemon mds.j on smithi001 2024-09-21T00:54:21.270 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:21 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1337943311' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:54:21.270 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:21 smithi001 ceph-mon[31211]: mds.? [v2:172.21.15.42:6832/1653911656,v1:172.21.15.42:6833/1653911656] up:boot 2024-09-21T00:54:21.270 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:21 smithi001 ceph-mon[31211]: fsmap 2 up:standby 2024-09-21T00:54:21.270 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:21 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T00:54:21.467 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:21 smithi042 ceph-mon[34481]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:21.467 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:21 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:21.467 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:21 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:21.467 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:21 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:21.467 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:21 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:54:21.467 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:21 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:21.467 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:21 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:21.468 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:21 smithi042 ceph-mon[34481]: Deploying daemon mds.j on smithi001 2024-09-21T00:54:21.468 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:21 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/1337943311' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:54:21.468 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:21 smithi042 ceph-mon[34481]: mds.? [v2:172.21.15.42:6832/1653911656,v1:172.21.15.42:6833/1653911656] up:boot 2024-09-21T00:54:21.468 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:21 smithi042 ceph-mon[34481]: fsmap 2 up:standby 2024-09-21T00:54:21.468 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:21 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T00:54:21.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:21 smithi193 ceph-mon[34660]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:21.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:21 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:21.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:21 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:21.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:21 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:21.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:21 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:54:21.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:21 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:21.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:21 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:21.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:21 smithi193 ceph-mon[34660]: Deploying daemon mds.j on smithi001 2024-09-21T00:54:21.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:21 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/1337943311' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:54:21.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:21 smithi193 ceph-mon[34660]: mds.? [v2:172.21.15.42:6832/1653911656,v1:172.21.15.42:6833/1653911656] up:boot 2024-09-21T00:54:21.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:21 smithi193 ceph-mon[34660]: fsmap 2 up:standby 2024-09-21T00:54:21.481 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:21 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T00:54:23.364 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:23 smithi001 ceph-mon[31211]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:23.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:23 smithi193 ceph-mon[34660]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:23.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:23 smithi042 ceph-mon[34481]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:23.960 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 21 00:54:23 smithi001 systemd[1]: Started Ceph mds.j for d3972c20-77b2-11ef-baf5-efdc52797490. 2024-09-21T00:54:24.094 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:54:24.771 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:54:25.152 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:24 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:25.153 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:24 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:25.153 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:24 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:25.153 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:24 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:54:25.153 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:24 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:25.153 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:24 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:25.153 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:24 smithi001 ceph-mon[31211]: Deploying daemon mds.d on smithi001 2024-09-21T00:54:25.153 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:24 smithi001 ceph-mon[31211]: mds.? [v2:172.21.15.1:6834/2810186677,v1:172.21.15.1:6835/2810186677] up:boot 2024-09-21T00:54:25.153 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:24 smithi001 ceph-mon[31211]: fsmap 3 up:standby 2024-09-21T00:54:25.153 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:24 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T00:54:25.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:24 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:25.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:24 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:25.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:24 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:25.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:24 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:54:25.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:24 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:25.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:24 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:25.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:24 smithi193 ceph-mon[34660]: Deploying daemon mds.d on smithi001 2024-09-21T00:54:25.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:24 smithi193 ceph-mon[34660]: mds.? [v2:172.21.15.1:6834/2810186677,v1:172.21.15.1:6835/2810186677] up:boot 2024-09-21T00:54:25.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:24 smithi193 ceph-mon[34660]: fsmap 3 up:standby 2024-09-21T00:54:25.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:24 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T00:54:25.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:24 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:25.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:24 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:25.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:24 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:25.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:24 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:54:25.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:24 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:25.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:24 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:25.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:24 smithi042 ceph-mon[34481]: Deploying daemon mds.d on smithi001 2024-09-21T00:54:25.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:24 smithi042 ceph-mon[34481]: mds.? [v2:172.21.15.1:6834/2810186677,v1:172.21.15.1:6835/2810186677] up:boot 2024-09-21T00:54:25.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:24 smithi042 ceph-mon[34481]: fsmap 3 up:standby 2024-09-21T00:54:25.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:24 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T00:54:25.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.854+0000 7f92c48c3640 1 -- 172.21.15.1:0/1561801381 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92c0102a80 msgr2=0x7f92c0102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:25.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.854+0000 7f92c48c3640 1 --2- 172.21.15.1:0/1561801381 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92c0102a80 0x7f92c0102e90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f92b0009900 tx=0x7f92b002a410 comp rx=0 tx=0).stop 2024-09-21T00:54:25.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.854+0000 7f92c48c3640 1 -- 172.21.15.1:0/1561801381 shutdown_connections 2024-09-21T00:54:25.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.854+0000 7f92c48c3640 1 --2- 172.21.15.1:0/1561801381 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92c0108d10 0x7f92c010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:25.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.854+0000 7f92c48c3640 1 --2- 172.21.15.1:0/1561801381 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92c01083c0 0x7f92c01087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:25.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.854+0000 7f92c48c3640 1 --2- 172.21.15.1:0/1561801381 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92c0102a80 0x7f92c0102e90 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:25.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.854+0000 7f92c48c3640 1 -- 172.21.15.1:0/1561801381 >> 172.21.15.1:0/1561801381 conn(0x7f92c0079740 msgr2=0x7f92c0079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:25.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.854+0000 7f92c48c3640 1 -- 172.21.15.1:0/1561801381 shutdown_connections 2024-09-21T00:54:25.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.854+0000 7f92c48c3640 1 -- 172.21.15.1:0/1561801381 wait complete. 2024-09-21T00:54:25.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.855+0000 7f92c48c3640 1 Processor -- start 2024-09-21T00:54:25.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.855+0000 7f92c48c3640 1 -- start start 2024-09-21T00:54:25.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.856+0000 7f92c48c3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92c0102a80 0x7f92c019b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:25.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.856+0000 7f92c48c3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92c01083c0 0x7f92c019b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:25.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.856+0000 7f92c48c3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92c0108d10 0x7f92c019bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:25.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.856+0000 7f92c48c3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f92c0112980 con 0x7f92c0108d10 2024-09-21T00:54:25.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.856+0000 7f92c48c3640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f92c0112800 con 0x7f92c01083c0 2024-09-21T00:54:25.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.856+0000 7f92c48c3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f92c0112b00 con 0x7f92c0102a80 2024-09-21T00:54:25.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.856+0000 7f92bed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92c0108d10 0x7f92c019bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:25.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.856+0000 7f92bed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92c0108d10 0x7f92c019bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47374/0 (socket says 172.21.15.1:47374) 2024-09-21T00:54:25.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.856+0000 7f92bed9d640 1 -- 172.21.15.1:0/250564825 learned_addr learned my addr 172.21.15.1:0/250564825 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:54:25.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.856+0000 7f92bdd9b640 1 --2- 172.21.15.1:0/250564825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92c01083c0 0x7f92c019b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:25.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.856+0000 7f92be59c640 1 --2- 172.21.15.1:0/250564825 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92c0102a80 0x7f92c019b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:25.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.856+0000 7f92bed9d640 1 -- 172.21.15.1:0/250564825 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92c0102a80 msgr2=0x7f92c019b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:25.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.856+0000 7f92bed9d640 1 --2- 172.21.15.1:0/250564825 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92c0102a80 0x7f92c019b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:25.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.856+0000 7f92bed9d640 1 -- 172.21.15.1:0/250564825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92c01083c0 msgr2=0x7f92c019b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:25.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.856+0000 7f92bed9d640 1 --2- 172.21.15.1:0/250564825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92c01083c0 0x7f92c019b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:25.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.856+0000 7f92bed9d640 1 -- 172.21.15.1:0/250564825 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92c01a6590 con 0x7f92c0108d10 2024-09-21T00:54:25.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.856+0000 7f92be59c640 1 --2- 172.21.15.1:0/250564825 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92c0102a80 0x7f92c019b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:54:25.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.856+0000 7f92bed9d640 1 --2- 172.21.15.1:0/250564825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92c0108d10 0x7f92c019bd50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f92b800eaa0 tx=0x7f92b800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:25.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.857+0000 7f92af7fe640 1 -- 172.21.15.1:0/250564825 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b800cdb0 con 0x7f92c0108d10 2024-09-21T00:54:25.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.857+0000 7f92af7fe640 1 -- 172.21.15.1:0/250564825 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92b8005020 con 0x7f92c0108d10 2024-09-21T00:54:25.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.857+0000 7f92c48c3640 1 -- 172.21.15.1:0/250564825 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92c01a6880 con 0x7f92c0108d10 2024-09-21T00:54:25.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.857+0000 7f92af7fe640 1 -- 172.21.15.1:0/250564825 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b80116d0 con 0x7f92c0108d10 2024-09-21T00:54:25.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.857+0000 7f92c48c3640 1 -- 172.21.15.1:0/250564825 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92c01a6d70 con 0x7f92c0108d10 2024-09-21T00:54:25.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.858+0000 7f92c48c3640 1 -- 172.21.15.1:0/250564825 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92c0103d00 con 0x7f92c0108d10 2024-09-21T00:54:25.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.860+0000 7f92af7fe640 1 -- 172.21.15.1:0/250564825 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 154511+0+0 (secure 0 0 0) 0x7f92b80051d0 con 0x7f92c0108d10 2024-09-21T00:54:25.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.861+0000 7f92af7fe640 1 --2- 172.21.15.1:0/250564825 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f92a80b6510 0x7f92a80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:25.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.861+0000 7f92be59c640 1 --2- 172.21.15.1:0/250564825 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f92a80b6510 0x7f92a80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:25.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.861+0000 7f92af7fe640 1 -- 172.21.15.1:0/250564825 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f92b80e7510 con 0x7f92c0108d10 2024-09-21T00:54:25.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.862+0000 7f92be59c640 1 --2- 172.21.15.1:0/250564825 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f92a80b6510 0x7f92a80b8a20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f92b0000c00 tx=0x7f92b0009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:25.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:25.864+0000 7f92af7fe640 1 -- 172.21.15.1:0/250564825 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f92b8016030 con 0x7f92c0108d10 2024-09-21T00:54:26.078 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:25 smithi001 ceph-mon[31211]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:26.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:26.099+0000 7f92c48c3640 1 -- 172.21.15.1:0/250564825 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92c0102e90 con 0x7f92c0108d10 2024-09-21T00:54:26.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:26.100+0000 7f92af7fe640 1 -- 172.21.15.1:0/250564825 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3082 (secure 0 0 0) 0x7f92b80ae1a0 con 0x7f92c0108d10 2024-09-21T00:54:26.101 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:54:26.101 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":4,"btime":"2024-09-21T00:54:24:187234+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2810186677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2810186677},{"type":"v1","addr":"172.21.15.1:6835","nonce":2810186677}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/712170939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":712170939},{"type":"v1","addr":"172.21.15.193:6833","nonce":712170939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24578,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1653911656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1653911656},{"type":"v1","addr":"172.21.15.42:6833","nonce":1653911656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-21T00:54:26.101 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 4 2024-09-21T00:54:26.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:26.102+0000 7f92c48c3640 1 -- 172.21.15.1:0/250564825 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f92a80b6510 msgr2=0x7f92a80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:26.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:26.102+0000 7f92c48c3640 1 --2- 172.21.15.1:0/250564825 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f92a80b6510 0x7f92a80b8a20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f92b0000c00 tx=0x7f92b0009680 comp rx=0 tx=0).stop 2024-09-21T00:54:26.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:26.102+0000 7f92c48c3640 1 -- 172.21.15.1:0/250564825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92c0108d10 msgr2=0x7f92c019bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:26.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:26.102+0000 7f92c48c3640 1 --2- 172.21.15.1:0/250564825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92c0108d10 0x7f92c019bd50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f92b800eaa0 tx=0x7f92b800ef60 comp rx=0 tx=0).stop 2024-09-21T00:54:26.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:26.102+0000 7f92c48c3640 1 -- 172.21.15.1:0/250564825 shutdown_connections 2024-09-21T00:54:26.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:26.102+0000 7f92c48c3640 1 --2- 172.21.15.1:0/250564825 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f92a80b6510 0x7f92a80b8a20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:26.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:26.102+0000 7f92c48c3640 1 --2- 172.21.15.1:0/250564825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92c0108d10 0x7f92c019bd50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:26.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:26.102+0000 7f92c48c3640 1 --2- 172.21.15.1:0/250564825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92c01083c0 0x7f92c019b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:26.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:26.102+0000 7f92c48c3640 1 --2- 172.21.15.1:0/250564825 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92c0102a80 0x7f92c019b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:26.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:26.102+0000 7f92c48c3640 1 -- 172.21.15.1:0/250564825 >> 172.21.15.1:0/250564825 conn(0x7f92c0079740 msgr2=0x7f92c0101470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:26.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:26.102+0000 7f92c48c3640 1 -- 172.21.15.1:0/250564825 shutdown_connections 2024-09-21T00:54:26.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:26.102+0000 7f92c48c3640 1 -- 172.21.15.1:0/250564825 wait complete. 2024-09-21T00:54:26.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:25 smithi193 ceph-mon[34660]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:26.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:25 smithi042 ceph-mon[34481]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:27.052 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:26 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/250564825' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:54:27.053 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:26 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:27.053 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:26 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:27.053 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:26 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:27.053 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:26 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:54:27.053 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:26 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:27.053 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:26 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:27.170 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:26 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/250564825' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:54:27.170 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:26 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:27.170 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:26 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:27.170 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:26 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:27.171 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:26 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:54:27.171 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:26 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:27.171 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:26 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:27.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:26 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/250564825' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:54:27.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:26 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:27.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:26 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:27.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:26 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:27.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:26 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:54:27.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:26 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:27.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:26 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:28.178 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:27 smithi042 ceph-mon[34481]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:28.178 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:27 smithi042 ceph-mon[34481]: Deploying daemon mds.e on smithi042 2024-09-21T00:54:28.178 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:27 smithi042 ceph-mon[34481]: mds.? [v2:172.21.15.1:6836/3935320478,v1:172.21.15.1:6837/3935320478] up:boot 2024-09-21T00:54:28.178 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:27 smithi042 ceph-mon[34481]: fsmap 4 up:standby 2024-09-21T00:54:28.179 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:27 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T00:54:28.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:27 smithi001 ceph-mon[31211]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:28.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:27 smithi001 ceph-mon[31211]: Deploying daemon mds.e on smithi042 2024-09-21T00:54:28.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:27 smithi001 ceph-mon[31211]: mds.? [v2:172.21.15.1:6836/3935320478,v1:172.21.15.1:6837/3935320478] up:boot 2024-09-21T00:54:28.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:27 smithi001 ceph-mon[31211]: fsmap 4 up:standby 2024-09-21T00:54:28.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:27 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T00:54:28.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:27 smithi193 ceph-mon[34660]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:28.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:27 smithi193 ceph-mon[34660]: Deploying daemon mds.e on smithi042 2024-09-21T00:54:28.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:27 smithi193 ceph-mon[34660]: mds.? [v2:172.21.15.1:6836/3935320478,v1:172.21.15.1:6837/3935320478] up:boot 2024-09-21T00:54:28.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:27 smithi193 ceph-mon[34660]: fsmap 4 up:standby 2024-09-21T00:54:28.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:27 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T00:54:28.742 INFO:journalctl@ceph.mds.e.smithi042.stdout:Sep 21 00:54:28 smithi042 systemd[1]: Starting Ceph mds.e for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T00:54:29.150 INFO:journalctl@ceph.mds.e.smithi042.stdout:Sep 21 00:54:28 smithi042 podman[62888]: 2024-09-21 00:54:28.774985485 +0000 UTC m=+0.016054670 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:54:29.151 INFO:journalctl@ceph.mds.e.smithi042.stdout:Sep 21 00:54:28 smithi042 podman[62888]: 2024-09-21 00:54:28.905789344 +0000 UTC m=+0.146858519 container create 6281cb41bb65dce26e68a6f9ae69d0484f4c0a2f7f2881609a4d58e517429db9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-e, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T00:54:29.151 INFO:journalctl@ceph.mds.e.smithi042.stdout:Sep 21 00:54:29 smithi042 podman[62888]: 2024-09-21 00:54:29.150475594 +0000 UTC m=+0.391544780 container init 6281cb41bb65dce26e68a6f9ae69d0484f4c0a2f7f2881609a4d58e517429db9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T00:54:29.369 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:54:29.492 INFO:journalctl@ceph.mds.e.smithi042.stdout:Sep 21 00:54:29 smithi042 podman[62888]: 2024-09-21 00:54:29.153378834 +0000 UTC m=+0.394448010 container start 6281cb41bb65dce26e68a6f9ae69d0484f4c0a2f7f2881609a4d58e517429db9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-e, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T00:54:29.492 INFO:journalctl@ceph.mds.e.smithi042.stdout:Sep 21 00:54:29 smithi042 ceph-mds[62907]: -- 172.21.15.42:0/2472120861 <== mon.2 v2:172.21.15.42:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557576571860 con 0x55757a719180 2024-09-21T00:54:29.492 INFO:journalctl@ceph.mds.e.smithi042.stdout:Sep 21 00:54:29 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-e[62903]: starting mds.e at 2024-09-21T00:54:29.493 INFO:journalctl@ceph.mds.e.smithi042.stdout:Sep 21 00:54:29 smithi042 bash[62888]: 6281cb41bb65dce26e68a6f9ae69d0484f4c0a2f7f2881609a4d58e517429db9 2024-09-21T00:54:29.493 INFO:journalctl@ceph.mds.e.smithi042.stdout:Sep 21 00:54:29 smithi042 systemd[1]: Started Ceph mds.e for d3972c20-77b2-11ef-baf5-efdc52797490. 2024-09-21T00:54:29.637 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:54:29.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:29 smithi193 ceph-mon[34660]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:29.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:29 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:29.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:29 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:29.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:29 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:29.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:29 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:54:29.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:29 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:29.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:29 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:30.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:29 smithi001 ceph-mon[31211]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:30.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:29 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:30.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:29 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:30.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:29 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:30.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:29 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:54:30.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:29 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:30.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:29 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:30.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.141+0000 7f6157fad640 1 -- 172.21.15.1:0/2739261872 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6150110190 msgr2=0x7f61501125b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:30.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.141+0000 7f6157fad640 1 --2- 172.21.15.1:0/2739261872 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6150110190 0x7f61501125b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6148009ca0 tx=0x7f614802a950 comp rx=0 tx=0).stop 2024-09-21T00:54:30.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.141+0000 7f6157fad640 1 -- 172.21.15.1:0/2739261872 shutdown_connections 2024-09-21T00:54:30.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.141+0000 7f6157fad640 1 --2- 172.21.15.1:0/2739261872 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6150110190 0x7f61501125b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:30.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.141+0000 7f6157fad640 1 --2- 172.21.15.1:0/2739261872 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6150102f30 0x7f615010fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:30.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.141+0000 7f6157fad640 1 --2- 172.21.15.1:0/2739261872 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f61501025e0 0x7f61501029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:30.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.141+0000 7f6157fad640 1 -- 172.21.15.1:0/2739261872 >> 172.21.15.1:0/2739261872 conn(0x7f6150079710 msgr2=0x7f6150079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:30.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.141+0000 7f6157fad640 1 -- 172.21.15.1:0/2739261872 shutdown_connections 2024-09-21T00:54:30.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.141+0000 7f6157fad640 1 -- 172.21.15.1:0/2739261872 wait complete. 2024-09-21T00:54:30.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.142+0000 7f6157fad640 1 Processor -- start 2024-09-21T00:54:30.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.142+0000 7f6157fad640 1 -- start start 2024-09-21T00:54:30.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.142+0000 7f6157fad640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61501025e0 0x7f615019c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:30.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.142+0000 7f6157fad640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6150102f30 0x7f615019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:30.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.142+0000 7f6157fad640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6150110190 0x7f61501a1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:30.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.142+0000 7f6157fad640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6150115c80 con 0x7f61501025e0 2024-09-21T00:54:30.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.142+0000 7f6157fad640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6150115b00 con 0x7f6150110190 2024-09-21T00:54:30.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.142+0000 7f6157fad640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6150115e00 con 0x7f6150102f30 2024-09-21T00:54:30.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.142+0000 7f6155d49640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61501025e0 0x7f615019c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:30.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.142+0000 7f6155d49640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61501025e0 0x7f615019c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35458/0 (socket says 172.21.15.1:35458) 2024-09-21T00:54:30.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.142+0000 7f6155d49640 1 -- 172.21.15.1:0/219717433 learned_addr learned my addr 172.21.15.1:0/219717433 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:54:30.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.142+0000 7f6155548640 1 --2- 172.21.15.1:0/219717433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6150102f30 0x7f615019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:30.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.142+0000 7f615654a640 1 --2- 172.21.15.1:0/219717433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6150110190 0x7f61501a1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:30.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.142+0000 7f6155d49640 1 -- 172.21.15.1:0/219717433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6150102f30 msgr2=0x7f615019cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:30.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.142+0000 7f6155d49640 1 --2- 172.21.15.1:0/219717433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6150102f30 0x7f615019cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:30.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.142+0000 7f6155d49640 1 -- 172.21.15.1:0/219717433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6150110190 msgr2=0x7f61501a1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:30.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.142+0000 7f6155d49640 1 --2- 172.21.15.1:0/219717433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6150110190 0x7f61501a1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:30.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.142+0000 7f6155d49640 1 -- 172.21.15.1:0/219717433 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61501a25c0 con 0x7f61501025e0 2024-09-21T00:54:30.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.142+0000 7f615654a640 1 --2- 172.21.15.1:0/219717433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6150110190 0x7f61501a1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:54:30.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.143+0000 7f6155d49640 1 --2- 172.21.15.1:0/219717433 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61501025e0 0x7f615019c650 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f614c00d950 tx=0x7f614c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:30.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.143+0000 7f6146ffd640 1 -- 172.21.15.1:0/219717433 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f614c017030 con 0x7f61501025e0 2024-09-21T00:54:30.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.143+0000 7f6146ffd640 1 -- 172.21.15.1:0/219717433 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f614c004020 con 0x7f61501025e0 2024-09-21T00:54:30.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.143+0000 7f6146ffd640 1 -- 172.21.15.1:0/219717433 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f614c0047a0 con 0x7f61501025e0 2024-09-21T00:54:30.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.143+0000 7f6157fad640 1 -- 172.21.15.1:0/219717433 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61501a28b0 con 0x7f61501025e0 2024-09-21T00:54:30.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.143+0000 7f6157fad640 1 -- 172.21.15.1:0/219717433 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61501a9010 con 0x7f61501025e0 2024-09-21T00:54:30.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.144+0000 7f6157fad640 1 -- 172.21.15.1:0/219717433 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f615006c280 con 0x7f61501025e0 2024-09-21T00:54:30.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.145+0000 7f6146ffd640 1 -- 172.21.15.1:0/219717433 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 154511+0+0 (secure 0 0 0) 0x7f614c009a30 con 0x7f61501025e0 2024-09-21T00:54:30.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.146+0000 7f6146ffd640 1 --2- 172.21.15.1:0/219717433 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f613c0b6590 0x7f613c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:30.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.146+0000 7f6155548640 1 --2- 172.21.15.1:0/219717433 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f613c0b6590 0x7f613c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:30.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.146+0000 7f6146ffd640 1 -- 172.21.15.1:0/219717433 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f614c0e6990 con 0x7f61501025e0 2024-09-21T00:54:30.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.147+0000 7f6155548640 1 --2- 172.21.15.1:0/219717433 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f613c0b6590 0x7f613c0b8aa0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6140005d70 tx=0x7f6140005d00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:30.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.151+0000 7f6146ffd640 1 -- 172.21.15.1:0/219717433 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f614c0ad620 con 0x7f61501025e0 2024-09-21T00:54:30.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:29 smithi042 ceph-mon[34481]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:30.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:29 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:30.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:29 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:30.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:29 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:30.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:29 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:54:30.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:29 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:30.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:29 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:30.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.377+0000 7f6157fad640 1 -- 172.21.15.1:0/219717433 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61501029f0 con 0x7f61501025e0 2024-09-21T00:54:30.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.377+0000 7f6146ffd640 1 -- 172.21.15.1:0/219717433 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4726 (secure 0 0 0) 0x7f614c0b1a00 con 0x7f61501025e0 2024-09-21T00:54:30.378 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:54:30.379 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":6,"btime":"2024-09-21T00:54:29:799799+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2810186677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2810186677},{"type":"v1","addr":"172.21.15.1:6835","nonce":2810186677}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14736,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3935320478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3935320478},{"type":"v1","addr":"172.21.15.1:6837","nonce":3935320478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/712170939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":712170939},{"type":"v1","addr":"172.21.15.193:6833","nonce":712170939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24578,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1653911656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1653911656},{"type":"v1","addr":"172.21.15.42:6833","nonce":1653911656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24605,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/793085918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":793085918},{"type":"v1","addr":"172.21.15.42:6835","nonce":793085918}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-21T00:54:30.379 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 6 2024-09-21T00:54:30.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.380+0000 7f6157fad640 1 -- 172.21.15.1:0/219717433 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f613c0b6590 msgr2=0x7f613c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:30.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.380+0000 7f6157fad640 1 --2- 172.21.15.1:0/219717433 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f613c0b6590 0x7f613c0b8aa0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6140005d70 tx=0x7f6140005d00 comp rx=0 tx=0).stop 2024-09-21T00:54:30.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.380+0000 7f6157fad640 1 -- 172.21.15.1:0/219717433 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61501025e0 msgr2=0x7f615019c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:30.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.380+0000 7f6157fad640 1 --2- 172.21.15.1:0/219717433 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61501025e0 0x7f615019c650 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f614c00d950 tx=0x7f614c00de10 comp rx=0 tx=0).stop 2024-09-21T00:54:30.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.380+0000 7f6157fad640 1 -- 172.21.15.1:0/219717433 shutdown_connections 2024-09-21T00:54:30.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.380+0000 7f6157fad640 1 --2- 172.21.15.1:0/219717433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6150110190 0x7f61501a1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:30.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.380+0000 7f6157fad640 1 --2- 172.21.15.1:0/219717433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6150102f30 0x7f615019cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:30.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.380+0000 7f6157fad640 1 --2- 172.21.15.1:0/219717433 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f613c0b6590 0x7f613c0b8aa0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:30.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.380+0000 7f6157fad640 1 --2- 172.21.15.1:0/219717433 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61501025e0 0x7f615019c650 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:30.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.380+0000 7f6157fad640 1 -- 172.21.15.1:0/219717433 >> 172.21.15.1:0/219717433 conn(0x7f6150079710 msgr2=0x7f6150109d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:30.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.380+0000 7f6157fad640 1 -- 172.21.15.1:0/219717433 shutdown_connections 2024-09-21T00:54:30.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:30.380+0000 7f6157fad640 1 -- 172.21.15.1:0/219717433 wait complete. 2024-09-21T00:54:30.964 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:30 smithi193 ceph-mon[34660]: Deploying daemon mds.f on smithi193 2024-09-21T00:54:30.964 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:30 smithi193 ceph-mon[34660]: mds.? [v2:172.21.15.42:6834/793085918,v1:172.21.15.42:6835/793085918] up:boot 2024-09-21T00:54:30.964 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:30 smithi193 ceph-mon[34660]: fsmap 5 up:standby 2024-09-21T00:54:30.964 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:30 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T00:54:30.964 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:30 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/219717433' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:54:31.021 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:30 smithi001 ceph-mon[31211]: Deploying daemon mds.f on smithi193 2024-09-21T00:54:31.021 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:30 smithi001 ceph-mon[31211]: mds.? [v2:172.21.15.42:6834/793085918,v1:172.21.15.42:6835/793085918] up:boot 2024-09-21T00:54:31.021 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:30 smithi001 ceph-mon[31211]: fsmap 5 up:standby 2024-09-21T00:54:31.022 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:30 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T00:54:31.022 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:30 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/219717433' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:54:31.230 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 21 00:54:31 smithi193 systemd[1]: Starting Ceph mds.f for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T00:54:31.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:30 smithi042 ceph-mon[34481]: Deploying daemon mds.f on smithi193 2024-09-21T00:54:31.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:30 smithi042 ceph-mon[34481]: mds.? [v2:172.21.15.42:6834/793085918,v1:172.21.15.42:6835/793085918] up:boot 2024-09-21T00:54:31.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:30 smithi042 ceph-mon[34481]: fsmap 5 up:standby 2024-09-21T00:54:31.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:30 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T00:54:31.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:30 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/219717433' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:54:31.630 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 21 00:54:31 smithi193 podman[62975]: 2024-09-21 00:54:31.357078258 +0000 UTC m=+0.113099302 container create b5d5aaba5429aba0227c1cc97a7cdb1aae154f36a70266e9288b7a4ae651b92f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-f, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T00:54:31.630 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 21 00:54:31 smithi193 podman[62975]: 2024-09-21 00:54:31.25963913 +0000 UTC m=+0.015660174 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:54:31.630 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 21 00:54:31 smithi193 podman[62975]: 2024-09-21 00:54:31.593553978 +0000 UTC m=+0.349575022 container init b5d5aaba5429aba0227c1cc97a7cdb1aae154f36a70266e9288b7a4ae651b92f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-f, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T00:54:31.631 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 21 00:54:31 smithi193 podman[62975]: 2024-09-21 00:54:31.596388908 +0000 UTC m=+0.352409953 container start b5d5aaba5429aba0227c1cc97a7cdb1aae154f36a70266e9288b7a4ae651b92f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-f, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T00:54:31.979 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 21 00:54:31 smithi193 ceph-mds[62994]: -- 172.21.15.193:0/3010102615 <== mon.1 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55806530f860 con 0x5580694b7600 2024-09-21T00:54:31.979 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 21 00:54:31 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-f[62990]: starting mds.f at 2024-09-21T00:54:31.979 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 21 00:54:31 smithi193 bash[62975]: b5d5aaba5429aba0227c1cc97a7cdb1aae154f36a70266e9288b7a4ae651b92f 2024-09-21T00:54:31.980 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 21 00:54:31 smithi193 systemd[1]: Started Ceph mds.f for d3972c20-77b2-11ef-baf5-efdc52797490. 2024-09-21T00:54:31.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:31 smithi193 ceph-mon[34660]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:31.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:31 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:31.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:31 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:31.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:31 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:31.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:31 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:54:31.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:31 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:31.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:31 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:32.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:31 smithi001 ceph-mon[31211]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:32.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:31 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:32.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:31 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:32.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:31 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:32.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:31 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:54:32.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:31 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:32.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:31 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:32.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:31 smithi042 ceph-mon[34481]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:32.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:31 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:32.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:31 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:32.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:31 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:32.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:31 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:54:32.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:31 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:32.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:31 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:33.054 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:54:33.083 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:32 smithi001 ceph-mon[31211]: Deploying daemon mds.c on smithi193 2024-09-21T00:54:33.083 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:32 smithi001 ceph-mon[31211]: mds.? [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] up:boot 2024-09-21T00:54:33.083 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:32 smithi001 ceph-mon[31211]: fsmap 6 up:standby 2024-09-21T00:54:33.083 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:32 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T00:54:33.173 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:32 smithi193 ceph-mon[34660]: Deploying daemon mds.c on smithi193 2024-09-21T00:54:33.173 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:32 smithi193 ceph-mon[34660]: mds.? [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] up:boot 2024-09-21T00:54:33.173 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:32 smithi193 ceph-mon[34660]: fsmap 6 up:standby 2024-09-21T00:54:33.173 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:32 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T00:54:33.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:32 smithi042 ceph-mon[34481]: Deploying daemon mds.c on smithi193 2024-09-21T00:54:33.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:32 smithi042 ceph-mon[34481]: mds.? [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] up:boot 2024-09-21T00:54:33.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:32 smithi042 ceph-mon[34481]: fsmap 6 up:standby 2024-09-21T00:54:33.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:32 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T00:54:33.324 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:54:33.829 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 21 00:54:33 smithi193 systemd[1]: Starting Ceph mds.c for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T00:54:33.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.827+0000 7facdbcf3640 1 -- 172.21.15.1:0/479343439 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facd4102a60 msgr2=0x7facd4102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:33.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.827+0000 7facdbcf3640 1 --2- 172.21.15.1:0/479343439 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facd4102a60 0x7facd4102e70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7facd0009900 tx=0x7facd002a410 comp rx=0 tx=0).stop 2024-09-21T00:54:33.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.828+0000 7facdbcf3640 1 -- 172.21.15.1:0/479343439 shutdown_connections 2024-09-21T00:54:33.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.828+0000 7facdbcf3640 1 --2- 172.21.15.1:0/479343439 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facd4108cf0 0x7facd410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:33.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.828+0000 7facdbcf3640 1 --2- 172.21.15.1:0/479343439 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7facd41083a0 0x7facd41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:33.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.828+0000 7facdbcf3640 1 --2- 172.21.15.1:0/479343439 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facd4102a60 0x7facd4102e70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:33.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.828+0000 7facdbcf3640 1 -- 172.21.15.1:0/479343439 >> 172.21.15.1:0/479343439 conn(0x7facd4079730 msgr2=0x7facd4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:33.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.828+0000 7facdbcf3640 1 -- 172.21.15.1:0/479343439 shutdown_connections 2024-09-21T00:54:33.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.828+0000 7facdbcf3640 1 -- 172.21.15.1:0/479343439 wait complete. 2024-09-21T00:54:33.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.828+0000 7facdbcf3640 1 Processor -- start 2024-09-21T00:54:33.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.828+0000 7facdbcf3640 1 -- start start 2024-09-21T00:54:33.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.829+0000 7facdbcf3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facd4102a60 0x7facd419a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:33.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.829+0000 7facdbcf3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facd41083a0 0x7facd419a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:33.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.829+0000 7facdbcf3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7facd4108cf0 0x7facd419fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:33.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.829+0000 7facdbcf3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7facd4112960 con 0x7facd4102a60 2024-09-21T00:54:33.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.829+0000 7facdbcf3640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7facd41127e0 con 0x7facd41083a0 2024-09-21T00:54:33.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.829+0000 7facdbcf3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7facd4112ae0 con 0x7facd4108cf0 2024-09-21T00:54:33.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.829+0000 7facd9a8f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facd4102a60 0x7facd419a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:33.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.829+0000 7facd9a8f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facd4102a60 0x7facd419a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35490/0 (socket says 172.21.15.1:35490) 2024-09-21T00:54:33.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.829+0000 7facd9a8f640 1 -- 172.21.15.1:0/716379991 learned_addr learned my addr 172.21.15.1:0/716379991 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:54:33.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.829+0000 7facda290640 1 --2- 172.21.15.1:0/716379991 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7facd4108cf0 0x7facd419fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:33.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.829+0000 7facd928e640 1 --2- 172.21.15.1:0/716379991 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facd41083a0 0x7facd419a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:33.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.829+0000 7facd9a8f640 1 -- 172.21.15.1:0/716379991 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7facd4108cf0 msgr2=0x7facd419fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:33.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.829+0000 7facd9a8f640 1 --2- 172.21.15.1:0/716379991 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7facd4108cf0 0x7facd419fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:33.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.829+0000 7facd9a8f640 1 -- 172.21.15.1:0/716379991 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facd41083a0 msgr2=0x7facd419a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:33.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.829+0000 7facd9a8f640 1 --2- 172.21.15.1:0/716379991 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facd41083a0 0x7facd419a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:33.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.829+0000 7facd9a8f640 1 -- 172.21.15.1:0/716379991 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facd41a03b0 con 0x7facd4102a60 2024-09-21T00:54:33.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.829+0000 7facd9a8f640 1 --2- 172.21.15.1:0/716379991 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facd4102a60 0x7facd419a440 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7facd0005940 tx=0x7facd00040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:33.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.832+0000 7facc6ffd640 1 -- 172.21.15.1:0/716379991 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd003f030 con 0x7facd4102a60 2024-09-21T00:54:33.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.832+0000 7facdbcf3640 1 -- 172.21.15.1:0/716379991 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facd41a0640 con 0x7facd4102a60 2024-09-21T00:54:33.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.832+0000 7facc6ffd640 1 -- 172.21.15.1:0/716379991 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facd00044c0 con 0x7facd4102a60 2024-09-21T00:54:33.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.832+0000 7facc6ffd640 1 -- 172.21.15.1:0/716379991 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd0035070 con 0x7facd4102a60 2024-09-21T00:54:33.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.832+0000 7facdbcf3640 1 -- 172.21.15.1:0/716379991 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facd41a6e00 con 0x7facd4102a60 2024-09-21T00:54:33.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.833+0000 7facdbcf3640 1 -- 172.21.15.1:0/716379991 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facd4102e70 con 0x7facd4102a60 2024-09-21T00:54:33.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.835+0000 7facc6ffd640 1 -- 172.21.15.1:0/716379991 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 154511+0+0 (secure 0 0 0) 0x7facd0042030 con 0x7facd4102a60 2024-09-21T00:54:33.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.836+0000 7facc6ffd640 1 --2- 172.21.15.1:0/716379991 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7facc00b6610 0x7facc00b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:33.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.836+0000 7facd928e640 1 --2- 172.21.15.1:0/716379991 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7facc00b6610 0x7facc00b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:33.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.836+0000 7facc6ffd640 1 -- 172.21.15.1:0/716379991 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7facd0107450 con 0x7facd4102a60 2024-09-21T00:54:33.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.836+0000 7facd928e640 1 --2- 172.21.15.1:0/716379991 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7facc00b6610 0x7facc00b8b20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7facd4100b70 tx=0x7facc8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:33.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:33.839+0000 7facc6ffd640 1 -- 172.21.15.1:0/716379991 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7facd00d24c0 con 0x7facd4102a60 2024-09-21T00:54:33.986 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:33 smithi001 ceph-mon[31211]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:34.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:34.067+0000 7facdbcf3640 1 -- 172.21.15.1:0/716379991 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7facd419b570 con 0x7facd4102a60 2024-09-21T00:54:34.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:34.068+0000 7facc6ffd640 1 -- 172.21.15.1:0/716379991 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5554 (secure 0 0 0) 0x7facd419b570 con 0x7facd4102a60 2024-09-21T00:54:34.069 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:54:34.069 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":7,"btime":"2024-09-21T00:54:31:815793+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2810186677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2810186677},{"type":"v1","addr":"172.21.15.1:6835","nonce":2810186677}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14736,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3935320478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3935320478},{"type":"v1","addr":"172.21.15.1:6837","nonce":3935320478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/712170939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":712170939},{"type":"v1","addr":"172.21.15.193:6833","nonce":712170939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24578,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1653911656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1653911656},{"type":"v1","addr":"172.21.15.42:6833","nonce":1653911656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24605,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/793085918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":793085918},{"type":"v1","addr":"172.21.15.42:6835","nonce":793085918}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24610,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6835/3631682268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":3631682268},{"type":"v1","addr":"172.21.15.193:6835","nonce":3631682268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-21T00:54:34.069 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 7 2024-09-21T00:54:34.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:34.070+0000 7facdbcf3640 1 -- 172.21.15.1:0/716379991 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7facc00b6610 msgr2=0x7facc00b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:34.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:34.070+0000 7facdbcf3640 1 --2- 172.21.15.1:0/716379991 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7facc00b6610 0x7facc00b8b20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7facd4100b70 tx=0x7facc8005f90 comp rx=0 tx=0).stop 2024-09-21T00:54:34.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:34.070+0000 7facdbcf3640 1 -- 172.21.15.1:0/716379991 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facd4102a60 msgr2=0x7facd419a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:34.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:34.070+0000 7facdbcf3640 1 --2- 172.21.15.1:0/716379991 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facd4102a60 0x7facd419a440 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7facd0005940 tx=0x7facd00040c0 comp rx=0 tx=0).stop 2024-09-21T00:54:34.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:34.070+0000 7facdbcf3640 1 -- 172.21.15.1:0/716379991 shutdown_connections 2024-09-21T00:54:34.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:34.070+0000 7facdbcf3640 1 --2- 172.21.15.1:0/716379991 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7facd4108cf0 0x7facd419fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:34.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:34.070+0000 7facdbcf3640 1 --2- 172.21.15.1:0/716379991 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facd41083a0 0x7facd419a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:34.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:34.070+0000 7facdbcf3640 1 --2- 172.21.15.1:0/716379991 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7facc00b6610 0x7facc00b8b20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:34.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:34.070+0000 7facdbcf3640 1 --2- 172.21.15.1:0/716379991 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facd4102a60 0x7facd419a440 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:34.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:34.070+0000 7facdbcf3640 1 -- 172.21.15.1:0/716379991 >> 172.21.15.1:0/716379991 conn(0x7facd4079730 msgr2=0x7facd4101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:34.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:34.070+0000 7facdbcf3640 1 -- 172.21.15.1:0/716379991 shutdown_connections 2024-09-21T00:54:34.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:34.070+0000 7facdbcf3640 1 -- 172.21.15.1:0/716379991 wait complete. 2024-09-21T00:54:34.174 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:33 smithi193 ceph-mon[34660]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:34.174 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 21 00:54:33 smithi193 podman[63244]: 2024-09-21 00:54:33.783353014 +0000 UTC m=+0.015502438 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:54:34.174 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 21 00:54:33 smithi193 podman[63244]: 2024-09-21 00:54:33.912824296 +0000 UTC m=+0.144973710 container create 49e476775e4b106f07091c097ad19ce307d45d839d1a094f7c2c1805c27c07ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-c, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-21T00:54:34.174 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 21 00:54:34 smithi193 podman[63244]: 2024-09-21 00:54:34.173914096 +0000 UTC m=+0.406063520 container init 49e476775e4b106f07091c097ad19ce307d45d839d1a094f7c2c1805c27c07ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-c, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T00:54:34.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:33 smithi042 ceph-mon[34481]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:34.480 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 21 00:54:34 smithi193 podman[63244]: 2024-09-21 00:54:34.177020526 +0000 UTC m=+0.409169940 container start 49e476775e4b106f07091c097ad19ce307d45d839d1a094f7c2c1805c27c07ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-c, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-21T00:54:34.480 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 21 00:54:34 smithi193 ceph-mds[63263]: -- 172.21.15.193:0/1579374857 <== mon.1 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563aeee4d860 con 0x563af2ff5a80 2024-09-21T00:54:34.480 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 21 00:54:34 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-c[63259]: starting mds.c at 2024-09-21T00:54:34.480 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 21 00:54:34 smithi193 bash[63244]: 49e476775e4b106f07091c097ad19ce307d45d839d1a094f7c2c1805c27c07ed 2024-09-21T00:54:34.480 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 21 00:54:34 smithi193 systemd[1]: Started Ceph mds.c for d3972c20-77b2-11ef-baf5-efdc52797490. 2024-09-21T00:54:34.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:34 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/716379991' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:54:34.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:34 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:34.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:34 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:34.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:34 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:34.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:34 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:54:34.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:34 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:34.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:34 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:34.980 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:34 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/716379991' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:54:34.980 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:34 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:34.980 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:34 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:34.980 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:34 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:34.980 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:34 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:54:34.980 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:34 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:34.981 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:34 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:35.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:34 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/716379991' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:54:35.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:34 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:35.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:34 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:35.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:34 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:35.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:34 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:54:35.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:34 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:35.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:34 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:35.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:35 smithi042 ceph-mon[34481]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:35.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:35 smithi042 ceph-mon[34481]: Deploying daemon mds.h on smithi042 2024-09-21T00:54:35.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:35 smithi042 ceph-mon[34481]: mds.? [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] up:boot 2024-09-21T00:54:35.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:35 smithi042 ceph-mon[34481]: fsmap 7 up:standby 2024-09-21T00:54:35.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:35 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T00:54:36.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:35 smithi001 ceph-mon[31211]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:36.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:35 smithi001 ceph-mon[31211]: Deploying daemon mds.h on smithi042 2024-09-21T00:54:36.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:35 smithi001 ceph-mon[31211]: mds.? [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] up:boot 2024-09-21T00:54:36.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:35 smithi001 ceph-mon[31211]: fsmap 7 up:standby 2024-09-21T00:54:36.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:35 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T00:54:36.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:35 smithi193 ceph-mon[34660]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:36.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:35 smithi193 ceph-mon[34660]: Deploying daemon mds.h on smithi042 2024-09-21T00:54:36.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:35 smithi193 ceph-mon[34660]: mds.? [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] up:boot 2024-09-21T00:54:36.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:35 smithi193 ceph-mon[34660]: fsmap 7 up:standby 2024-09-21T00:54:36.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:35 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T00:54:36.493 INFO:journalctl@ceph.mds.h.smithi042.stdout:Sep 21 00:54:36 smithi042 systemd[1]: Starting Ceph mds.h for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T00:54:36.726 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:54:36.800 INFO:journalctl@ceph.mds.h.smithi042.stdout:Sep 21 00:54:36 smithi042 podman[63155]: 2024-09-21 00:54:36.405620623 +0000 UTC m=+0.015996665 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:54:36.800 INFO:journalctl@ceph.mds.h.smithi042.stdout:Sep 21 00:54:36 smithi042 podman[63155]: 2024-09-21 00:54:36.538779564 +0000 UTC m=+0.149155598 container create 4ec141cac7f5507dadb4fcd55686fa1931abadf3ec0de54e142a74c0f2844c69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-h, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T00:54:36.800 INFO:journalctl@ceph.mds.h.smithi042.stdout:Sep 21 00:54:36 smithi042 podman[63155]: 2024-09-21 00:54:36.800223603 +0000 UTC m=+0.410599636 container init 4ec141cac7f5507dadb4fcd55686fa1931abadf3ec0de54e142a74c0f2844c69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-h, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T00:54:37.007 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:54:37.129 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:36 smithi001 ceph-mon[31211]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:37.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:36 smithi193 ceph-mon[34660]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:37.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:36 smithi042 ceph-mon[34481]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:37.243 INFO:journalctl@ceph.mds.h.smithi042.stdout:Sep 21 00:54:36 smithi042 podman[63155]: 2024-09-21 00:54:36.802946591 +0000 UTC m=+0.413322625 container start 4ec141cac7f5507dadb4fcd55686fa1931abadf3ec0de54e142a74c0f2844c69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-h, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T00:54:37.243 INFO:journalctl@ceph.mds.h.smithi042.stdout:Sep 21 00:54:36 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-h[63170]: starting mds.h at 2024-09-21T00:54:37.243 INFO:journalctl@ceph.mds.h.smithi042.stdout:Sep 21 00:54:36 smithi042 bash[63155]: 4ec141cac7f5507dadb4fcd55686fa1931abadf3ec0de54e142a74c0f2844c69 2024-09-21T00:54:37.243 INFO:journalctl@ceph.mds.h.smithi042.stdout:Sep 21 00:54:36 smithi042 systemd[1]: Started Ceph mds.h for d3972c20-77b2-11ef-baf5-efdc52797490. 2024-09-21T00:54:37.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.543+0000 7f5668794640 1 -- 172.21.15.1:0/2611380535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5660102ae0 msgr2=0x7f5660102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:37.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.543+0000 7f5668794640 1 --2- 172.21.15.1:0/2611380535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5660102ae0 0x7f5660102ef0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5650009ca0 tx=0x7f565002a8c0 comp rx=0 tx=0).stop 2024-09-21T00:54:37.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.543+0000 7f5668794640 1 -- 172.21.15.1:0/2611380535 shutdown_connections 2024-09-21T00:54:37.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.543+0000 7f5668794640 1 --2- 172.21.15.1:0/2611380535 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5660108d20 0x7f566010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:37.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.543+0000 7f5668794640 1 --2- 172.21.15.1:0/2611380535 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f56601083d0 0x7f56601087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:37.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.543+0000 7f5668794640 1 --2- 172.21.15.1:0/2611380535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5660102ae0 0x7f5660102ef0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:37.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.543+0000 7f5668794640 1 -- 172.21.15.1:0/2611380535 >> 172.21.15.1:0/2611380535 conn(0x7f5660079760 msgr2=0x7f5660079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:37.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.543+0000 7f5668794640 1 -- 172.21.15.1:0/2611380535 shutdown_connections 2024-09-21T00:54:37.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.543+0000 7f5668794640 1 -- 172.21.15.1:0/2611380535 wait complete. 2024-09-21T00:54:37.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.544+0000 7f5668794640 1 Processor -- start 2024-09-21T00:54:37.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.544+0000 7f5668794640 1 -- start start 2024-09-21T00:54:37.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.544+0000 7f5668794640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5660102ae0 0x7f5660199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:37.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.544+0000 7f5668794640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56601083d0 0x7f56601998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:37.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.544+0000 7f5668794640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5660108d20 0x7f566019eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:37.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.544+0000 7f5668794640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5660112990 con 0x7f56601083d0 2024-09-21T00:54:37.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.544+0000 7f5668794640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5660112810 con 0x7f5660102ae0 2024-09-21T00:54:37.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.544+0000 7f5668794640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5660112b10 con 0x7f5660108d20 2024-09-21T00:54:37.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.545+0000 7f5665d2f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56601083d0 0x7f56601998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:37.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.545+0000 7f5665d2f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56601083d0 0x7f56601998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35520/0 (socket says 172.21.15.1:35520) 2024-09-21T00:54:37.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.545+0000 7f5665d2f640 1 -- 172.21.15.1:0/500956384 learned_addr learned my addr 172.21.15.1:0/500956384 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:54:37.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.545+0000 7f5666d31640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5660108d20 0x7f566019eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:37.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.545+0000 7f5666530640 1 --2- 172.21.15.1:0/500956384 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5660102ae0 0x7f5660199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:37.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.545+0000 7f5665d2f640 1 -- 172.21.15.1:0/500956384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5660108d20 msgr2=0x7f566019eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:37.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.545+0000 7f5665d2f640 1 --2- 172.21.15.1:0/500956384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5660108d20 0x7f566019eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:37.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.545+0000 7f5665d2f640 1 -- 172.21.15.1:0/500956384 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5660102ae0 msgr2=0x7f5660199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:37.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.545+0000 7f5665d2f640 1 --2- 172.21.15.1:0/500956384 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5660102ae0 0x7f5660199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:37.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.545+0000 7f5665d2f640 1 -- 172.21.15.1:0/500956384 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f566019f2b0 con 0x7f56601083d0 2024-09-21T00:54:37.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.545+0000 7f5666530640 1 --2- 172.21.15.1:0/500956384 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5660102ae0 0x7f5660199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:54:37.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.545+0000 7f5666d31640 1 --2- 172.21.15.1:0/500956384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5660108d20 0x7f566019eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:54:37.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.545+0000 7f5665d2f640 1 --2- 172.21.15.1:0/500956384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56601083d0 0x7f56601998e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f565400eb00 tx=0x7f5654009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:37.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.545+0000 7f565f7fe640 1 -- 172.21.15.1:0/500956384 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f565400bc30 con 0x7f56601083d0 2024-09-21T00:54:37.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.545+0000 7f565f7fe640 1 -- 172.21.15.1:0/500956384 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f565400bdd0 con 0x7f56601083d0 2024-09-21T00:54:37.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.545+0000 7f5668794640 1 -- 172.21.15.1:0/500956384 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f566019f5a0 con 0x7f56601083d0 2024-09-21T00:54:37.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.545+0000 7f565f7fe640 1 -- 172.21.15.1:0/500956384 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5654017410 con 0x7f56601083d0 2024-09-21T00:54:37.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.545+0000 7f5668794640 1 -- 172.21.15.1:0/500956384 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f566006bb40 con 0x7f56601083d0 2024-09-21T00:54:37.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.546+0000 7f5668794640 1 -- 172.21.15.1:0/500956384 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5660103d10 con 0x7f56601083d0 2024-09-21T00:54:37.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.548+0000 7f565f7fe640 1 -- 172.21.15.1:0/500956384 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 154511+0+0 (secure 0 0 0) 0x7f5654004f20 con 0x7f56601083d0 2024-09-21T00:54:37.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.549+0000 7f565f7fe640 1 --2- 172.21.15.1:0/500956384 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f56480b6510 0x7f56480b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:37.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.549+0000 7f5666530640 1 --2- 172.21.15.1:0/500956384 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f56480b6510 0x7f56480b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:37.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.549+0000 7f565f7fe640 1 -- 172.21.15.1:0/500956384 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f56540e9030 con 0x7f56601083d0 2024-09-21T00:54:37.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.549+0000 7f5666530640 1 --2- 172.21.15.1:0/500956384 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f56480b6510 0x7f56480b8a20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f56500094e0 tx=0x7f56500093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:37.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.552+0000 7f565f7fe640 1 -- 172.21.15.1:0/500956384 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f56540afd60 con 0x7f56601083d0 2024-09-21T00:54:37.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.777+0000 7f5668794640 1 -- 172.21.15.1:0/500956384 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5660102ef0 con 0x7f56601083d0 2024-09-21T00:54:37.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.778+0000 7f565f7fe640 1 -- 172.21.15.1:0/500956384 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6379 (secure 0 0 0) 0x7f56540b4140 con 0x7f56601083d0 2024-09-21T00:54:37.779 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:54:37.779 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":8,"btime":"2024-09-21T00:54:34:829089+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2810186677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2810186677},{"type":"v1","addr":"172.21.15.1:6835","nonce":2810186677}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14736,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3935320478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3935320478},{"type":"v1","addr":"172.21.15.1:6837","nonce":3935320478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/712170939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":712170939},{"type":"v1","addr":"172.21.15.193:6833","nonce":712170939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24578,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1653911656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1653911656},{"type":"v1","addr":"172.21.15.42:6833","nonce":1653911656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24605,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/793085918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":793085918},{"type":"v1","addr":"172.21.15.42:6835","nonce":793085918}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24610,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6835/3631682268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":3631682268},{"type":"v1","addr":"172.21.15.193:6835","nonce":3631682268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/909252228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":909252228},{"type":"v1","addr":"172.21.15.193:6837","nonce":909252228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-21T00:54:37.779 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 8 2024-09-21T00:54:37.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.780+0000 7f5668794640 1 -- 172.21.15.1:0/500956384 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f56480b6510 msgr2=0x7f56480b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:37.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.780+0000 7f5668794640 1 --2- 172.21.15.1:0/500956384 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f56480b6510 0x7f56480b8a20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f56500094e0 tx=0x7f56500093f0 comp rx=0 tx=0).stop 2024-09-21T00:54:37.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.780+0000 7f5668794640 1 -- 172.21.15.1:0/500956384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56601083d0 msgr2=0x7f56601998e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:37.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.780+0000 7f5668794640 1 --2- 172.21.15.1:0/500956384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56601083d0 0x7f56601998e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f565400eb00 tx=0x7f5654009ee0 comp rx=0 tx=0).stop 2024-09-21T00:54:37.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.780+0000 7f5668794640 1 -- 172.21.15.1:0/500956384 shutdown_connections 2024-09-21T00:54:37.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.780+0000 7f5668794640 1 --2- 172.21.15.1:0/500956384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5660108d20 0x7f566019eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:37.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.780+0000 7f5668794640 1 --2- 172.21.15.1:0/500956384 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f56480b6510 0x7f56480b8a20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:37.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.780+0000 7f5668794640 1 --2- 172.21.15.1:0/500956384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56601083d0 0x7f56601998e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:37.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.780+0000 7f5668794640 1 --2- 172.21.15.1:0/500956384 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5660102ae0 0x7f5660199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:37.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.780+0000 7f5668794640 1 -- 172.21.15.1:0/500956384 >> 172.21.15.1:0/500956384 conn(0x7f5660079760 msgr2=0x7f5660101500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:37.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.780+0000 7f5668794640 1 -- 172.21.15.1:0/500956384 shutdown_connections 2024-09-21T00:54:37.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:37.780+0000 7f5668794640 1 -- 172.21.15.1:0/500956384 wait complete. 2024-09-21T00:54:38.104 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:37 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:38.104 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:37 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:38.104 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:37 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:38.104 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:37 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:54:38.104 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:37 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:38.104 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:37 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:38.104 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:37 smithi001 ceph-mon[31211]: Deploying daemon mds.i on smithi193 2024-09-21T00:54:38.104 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:37 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/500956384' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:54:38.105 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:37 smithi001 ceph-mon[31211]: mds.? [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] up:boot 2024-09-21T00:54:38.105 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:37 smithi001 ceph-mon[31211]: fsmap 8 up:standby 2024-09-21T00:54:38.105 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:37 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T00:54:38.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:37 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:38.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:37 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:38.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:37 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:38.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:37 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:54:38.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:37 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:38.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:37 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:38.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:37 smithi193 ceph-mon[34660]: Deploying daemon mds.i on smithi193 2024-09-21T00:54:38.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:37 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/500956384' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:54:38.231 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:37 smithi193 ceph-mon[34660]: mds.? [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] up:boot 2024-09-21T00:54:38.231 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:37 smithi193 ceph-mon[34660]: fsmap 8 up:standby 2024-09-21T00:54:38.231 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:37 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T00:54:38.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:37 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:38.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:37 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:38.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:37 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:38.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:37 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:54:38.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:37 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:38.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:37 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:38.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:37 smithi042 ceph-mon[34481]: Deploying daemon mds.i on smithi193 2024-09-21T00:54:38.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:37 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/500956384' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:54:38.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:37 smithi042 ceph-mon[34481]: mds.? [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] up:boot 2024-09-21T00:54:38.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:37 smithi042 ceph-mon[34481]: fsmap 8 up:standby 2024-09-21T00:54:38.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:37 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T00:54:38.955 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 21 00:54:38 smithi193 systemd[1]: Starting Ceph mds.i for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T00:54:39.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:38 smithi001 ceph-mon[31211]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:39.212 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:38 smithi193 ceph-mon[34660]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:39.212 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 21 00:54:39 smithi193 podman[63510]: 2024-09-21 00:54:38.947665788 +0000 UTC m=+0.015998606 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:54:39.212 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 21 00:54:39 smithi193 podman[63510]: 2024-09-21 00:54:39.084891084 +0000 UTC m=+0.153223898 container create c9451e7e9718fc360b923464a7f023885eddc397f23546952791400fc4527abb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-i, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T00:54:39.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:38 smithi042 ceph-mon[34481]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:39.479 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 21 00:54:39 smithi193 podman[63510]: 2024-09-21 00:54:39.34648296 +0000 UTC m=+0.414815785 container init c9451e7e9718fc360b923464a7f023885eddc397f23546952791400fc4527abb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-21T00:54:39.480 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 21 00:54:39 smithi193 podman[63510]: 2024-09-21 00:54:39.349403823 +0000 UTC m=+0.417736639 container start c9451e7e9718fc360b923464a7f023885eddc397f23546952791400fc4527abb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-i, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS) 2024-09-21T00:54:39.480 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 21 00:54:39 smithi193 ceph-mds[63529]: -- 172.21.15.193:0/60736632 <== mon.1 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559450bcb860 con 0x559454d73600 2024-09-21T00:54:39.480 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 21 00:54:39 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-i[63525]: starting mds.i at 2024-09-21T00:54:39.480 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 21 00:54:39 smithi193 bash[63510]: c9451e7e9718fc360b923464a7f023885eddc397f23546952791400fc4527abb 2024-09-21T00:54:39.480 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 21 00:54:39 smithi193 systemd[1]: Started Ceph mds.i for d3972c20-77b2-11ef-baf5-efdc52797490. 2024-09-21T00:54:40.469 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:54:40.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:40 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:40.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:40 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:40.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:40 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:40.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:40 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:54:40.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:40 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:40.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:40 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:40.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:40 smithi042 ceph-mon[34481]: Deploying daemon mds.g on smithi001 2024-09-21T00:54:40.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:40 smithi042 ceph-mon[34481]: mds.? [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] up:boot 2024-09-21T00:54:40.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:40 smithi042 ceph-mon[34481]: fsmap 9 up:standby 2024-09-21T00:54:40.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:40 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T00:54:40.942 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:40 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:40.942 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:40 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:40.942 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:40 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:40.943 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:40 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:54:40.943 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:40 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:40.943 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:40 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:40.943 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:40 smithi001 ceph-mon[31211]: Deploying daemon mds.g on smithi001 2024-09-21T00:54:40.943 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:40 smithi001 ceph-mon[31211]: mds.? [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] up:boot 2024-09-21T00:54:40.943 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:40 smithi001 ceph-mon[31211]: fsmap 9 up:standby 2024-09-21T00:54:40.943 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:40 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T00:54:40.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:40 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:40.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:40 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:40.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:40 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:40.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:40 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:54:40.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:40 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:40.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:40 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:40.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:40 smithi193 ceph-mon[34660]: Deploying daemon mds.g on smithi001 2024-09-21T00:54:40.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:40 smithi193 ceph-mon[34660]: mds.? [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] up:boot 2024-09-21T00:54:40.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:40 smithi193 ceph-mon[34660]: fsmap 9 up:standby 2024-09-21T00:54:40.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:40 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T00:54:41.064 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:54:41.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.696+0000 7f708cbe6640 1 -- 172.21.15.1:0/135181699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7088106c30 msgr2=0x7f7088110680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:41.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.696+0000 7f708cbe6640 1 --2- 172.21.15.1:0/135181699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7088106c30 0x7f7088110680 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7080009ca0 tx=0x7f708002a8c0 comp rx=0 tx=0).stop 2024-09-21T00:54:41.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.696+0000 7f708cbe6640 1 -- 172.21.15.1:0/135181699 shutdown_connections 2024-09-21T00:54:41.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.696+0000 7f708cbe6640 1 --2- 172.21.15.1:0/135181699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7088106c30 0x7f7088110680 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:41.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.696+0000 7f708cbe6640 1 --2- 172.21.15.1:0/135181699 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f70881062e0 0x7f70881066f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:41.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.696+0000 7f708cbe6640 1 --2- 172.21.15.1:0/135181699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7088102000 0x7f7088102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:41.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.696+0000 7f708cbe6640 1 -- 172.21.15.1:0/135181699 >> 172.21.15.1:0/135181699 conn(0x7f7088079e40 msgr2=0x7f708807a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:41.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.696+0000 7f708cbe6640 1 -- 172.21.15.1:0/135181699 shutdown_connections 2024-09-21T00:54:41.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.696+0000 7f708cbe6640 1 -- 172.21.15.1:0/135181699 wait complete. 2024-09-21T00:54:41.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.697+0000 7f708cbe6640 1 Processor -- start 2024-09-21T00:54:41.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.697+0000 7f708cbe6640 1 -- start start 2024-09-21T00:54:41.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.697+0000 7f708cbe6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7088102000 0x7f708819c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:41.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.697+0000 7f708cbe6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70881062e0 0x7f708819cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:41.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.697+0000 7f708cbe6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7088106c30 0x7f70881a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:41.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.697+0000 7f708cbe6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7088113ad0 con 0x7f7088106c30 2024-09-21T00:54:41.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.697+0000 7f708cbe6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7088113950 con 0x7f70881062e0 2024-09-21T00:54:41.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.697+0000 7f708cbe6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7088113c50 con 0x7f7088102000 2024-09-21T00:54:41.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.697+0000 7f7086d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7088106c30 0x7f70881a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:41.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.697+0000 7f7086d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7088106c30 0x7f70881a1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38574/0 (socket says 172.21.15.1:38574) 2024-09-21T00:54:41.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.697+0000 7f7086d9d640 1 -- 172.21.15.1:0/917660797 learned_addr learned my addr 172.21.15.1:0/917660797 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:54:41.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.697+0000 7f7085d9b640 1 --2- 172.21.15.1:0/917660797 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70881062e0 0x7f708819cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:41.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.698+0000 7f708659c640 1 --2- 172.21.15.1:0/917660797 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7088102000 0x7f708819c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:41.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.698+0000 7f7086d9d640 1 -- 172.21.15.1:0/917660797 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7088102000 msgr2=0x7f708819c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:41.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.698+0000 7f7086d9d640 1 --2- 172.21.15.1:0/917660797 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7088102000 0x7f708819c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:41.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.698+0000 7f7086d9d640 1 -- 172.21.15.1:0/917660797 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70881062e0 msgr2=0x7f708819cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:41.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.698+0000 7f7086d9d640 1 --2- 172.21.15.1:0/917660797 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70881062e0 0x7f708819cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:41.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.698+0000 7f7086d9d640 1 -- 172.21.15.1:0/917660797 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70881a25b0 con 0x7f7088106c30 2024-09-21T00:54:41.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.698+0000 7f7086d9d640 1 --2- 172.21.15.1:0/917660797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7088106c30 0x7f70881a1e80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f70800098d0 tx=0x7f70800317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:41.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.698+0000 7f70777fe640 1 -- 172.21.15.1:0/917660797 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7080003b70 con 0x7f7088106c30 2024-09-21T00:54:41.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.698+0000 7f708cbe6640 1 -- 172.21.15.1:0/917660797 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70881a2840 con 0x7f7088106c30 2024-09-21T00:54:41.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.698+0000 7f70777fe640 1 -- 172.21.15.1:0/917660797 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7080003d10 con 0x7f7088106c30 2024-09-21T00:54:41.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.698+0000 7f70777fe640 1 -- 172.21.15.1:0/917660797 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708002fa20 con 0x7f7088106c30 2024-09-21T00:54:41.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.698+0000 7f708cbe6640 1 -- 172.21.15.1:0/917660797 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70881a9000 con 0x7f7088106c30 2024-09-21T00:54:41.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.699+0000 7f708cbe6640 1 -- 172.21.15.1:0/917660797 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7088102410 con 0x7f7088106c30 2024-09-21T00:54:41.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.702+0000 7f70777fe640 1 -- 172.21.15.1:0/917660797 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 154511+0+0 (secure 0 0 0) 0x7f708002fc20 con 0x7f7088106c30 2024-09-21T00:54:41.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.703+0000 7f70777fe640 1 --2- 172.21.15.1:0/917660797 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f70700b6510 0x7f70700b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:41.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.703+0000 7f708659c640 1 --2- 172.21.15.1:0/917660797 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f70700b6510 0x7f70700b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:41.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.703+0000 7f70777fe640 1 -- 172.21.15.1:0/917660797 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f7080108270 con 0x7f7088106c30 2024-09-21T00:54:41.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.703+0000 7f708659c640 1 --2- 172.21.15.1:0/917660797 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f70700b6510 0x7f70700b8a20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7078005d00 tx=0x7f707800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:41.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.706+0000 7f70777fe640 1 -- 172.21.15.1:0/917660797 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f70800cefa0 con 0x7f7088106c30 2024-09-21T00:54:41.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:41 smithi042 ceph-mon[34481]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:41.881 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:41 smithi193 ceph-mon[34660]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:41.914 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:41 smithi001 ceph-mon[31211]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:41.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.939+0000 7f708cbe6640 1 -- 172.21.15.1:0/917660797 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f708819d770 con 0x7f7088106c30 2024-09-21T00:54:41.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.939+0000 7f70777fe640 1 -- 172.21.15.1:0/917660797 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8034 (secure 0 0 0) 0x7f708819d770 con 0x7f7088106c30 2024-09-21T00:54:41.940 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:54:41.940 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":10,"btime":"2024-09-21T00:54:39:955000+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2810186677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2810186677},{"type":"v1","addr":"172.21.15.1:6835","nonce":2810186677}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14736,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3935320478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3935320478},{"type":"v1","addr":"172.21.15.1:6837","nonce":3935320478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/712170939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":712170939},{"type":"v1","addr":"172.21.15.193:6833","nonce":712170939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24578,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1653911656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1653911656},{"type":"v1","addr":"172.21.15.42:6833","nonce":1653911656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24605,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/793085918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":793085918},{"type":"v1","addr":"172.21.15.42:6835","nonce":793085918}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24610,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6835/3631682268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":3631682268},{"type":"v1","addr":"172.21.15.193:6835","nonce":3631682268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/909252228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":909252228},{"type":"v1","addr":"172.21.15.193:6837","nonce":909252228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/2395608508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2395608508},{"type":"v1","addr":"172.21.15.42:6837","nonce":2395608508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24637,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6839/1365361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1365361177},{"type":"v1","addr":"172.21.15.193:6839","nonce":1365361177}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T00:54:41.940 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 10 2024-09-21T00:54:41.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.942+0000 7f708cbe6640 1 -- 172.21.15.1:0/917660797 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f70700b6510 msgr2=0x7f70700b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:41.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.942+0000 7f708cbe6640 1 --2- 172.21.15.1:0/917660797 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f70700b6510 0x7f70700b8a20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7078005d00 tx=0x7f707800b410 comp rx=0 tx=0).stop 2024-09-21T00:54:41.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.942+0000 7f708cbe6640 1 -- 172.21.15.1:0/917660797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7088106c30 msgr2=0x7f70881a1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:41.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.942+0000 7f708cbe6640 1 --2- 172.21.15.1:0/917660797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7088106c30 0x7f70881a1e80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f70800098d0 tx=0x7f70800317b0 comp rx=0 tx=0).stop 2024-09-21T00:54:41.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.942+0000 7f708cbe6640 1 -- 172.21.15.1:0/917660797 shutdown_connections 2024-09-21T00:54:41.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.942+0000 7f708cbe6640 1 --2- 172.21.15.1:0/917660797 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f70700b6510 0x7f70700b8a20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:41.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.942+0000 7f708cbe6640 1 --2- 172.21.15.1:0/917660797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7088106c30 0x7f70881a1e80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:41.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.942+0000 7f708cbe6640 1 --2- 172.21.15.1:0/917660797 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70881062e0 0x7f708819cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:41.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.942+0000 7f708cbe6640 1 --2- 172.21.15.1:0/917660797 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7088102000 0x7f708819c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:41.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.942+0000 7f708cbe6640 1 -- 172.21.15.1:0/917660797 >> 172.21.15.1:0/917660797 conn(0x7f7088079e40 msgr2=0x7f7088107310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:41.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.942+0000 7f708cbe6640 1 -- 172.21.15.1:0/917660797 shutdown_connections 2024-09-21T00:54:41.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:41.942+0000 7f708cbe6640 1 -- 172.21.15.1:0/917660797 wait complete. 2024-09-21T00:54:42.652 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:42 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/917660797' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:54:42.898 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:42 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/917660797' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:54:42.914 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:42 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/917660797' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:54:42.960 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 21 00:54:42 smithi001 systemd[1]: Started Ceph mds.g for d3972c20-77b2-11ef-baf5-efdc52797490. 2024-09-21T00:54:43.611 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:43 smithi001 ceph-mon[31211]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:43.611 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:43 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:43.611 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:43 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:43.611 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:43 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:43.611 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:43 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:54:43.611 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:43 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:43.611 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:43 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:43.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:43 smithi193 ceph-mon[34660]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:43.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:43 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:43.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:43 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:43.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:43 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:43.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:43 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:54:43.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:43 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:43.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:43 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:43.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:43 smithi042 ceph-mon[34481]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:43.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:43 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:43.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:43 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:43.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:43 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:43.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:43 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:54:43.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:43 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:43.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:43 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:44.650 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:44 smithi001 ceph-mon[31211]: Deploying daemon mds.a on smithi001 2024-09-21T00:54:44.650 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:44 smithi001 ceph-mon[31211]: mds.? [v2:172.21.15.1:6838/2125703572,v1:172.21.15.1:6839/2125703572] up:boot 2024-09-21T00:54:44.650 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:44 smithi001 ceph-mon[31211]: fsmap 10 up:standby 2024-09-21T00:54:44.650 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:44 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T00:54:44.684 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:54:44.960 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 21 00:54:44 smithi001 systemd[1]: Starting Ceph mds.a for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T00:54:44.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:44 smithi193 ceph-mon[34660]: Deploying daemon mds.a on smithi001 2024-09-21T00:54:44.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:44 smithi193 ceph-mon[34660]: mds.? [v2:172.21.15.1:6838/2125703572,v1:172.21.15.1:6839/2125703572] up:boot 2024-09-21T00:54:44.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:44 smithi193 ceph-mon[34660]: fsmap 10 up:standby 2024-09-21T00:54:44.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:44 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T00:54:44.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:44 smithi042 ceph-mon[34481]: Deploying daemon mds.a on smithi001 2024-09-21T00:54:44.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:44 smithi042 ceph-mon[34481]: mds.? [v2:172.21.15.1:6838/2125703572,v1:172.21.15.1:6839/2125703572] up:boot 2024-09-21T00:54:44.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:44 smithi042 ceph-mon[34481]: fsmap 10 up:standby 2024-09-21T00:54:44.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:44 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T00:54:45.362 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 21 00:54:45 smithi001 podman[72366]: 2024-09-21 00:54:45.004814375 +0000 UTC m=+0.016312720 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:54:45.362 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 21 00:54:45 smithi001 podman[72366]: 2024-09-21 00:54:45.124735457 +0000 UTC m=+0.136233784 container create a4ca57f3ea3f3ffcf073d346669d0172cc6a0703d2def87427d654e67b75174c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-a, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-21T00:54:45.362 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 21 00:54:45 smithi001 podman[72366]: 2024-09-21 00:54:45.361730587 +0000 UTC m=+0.373228924 container init a4ca57f3ea3f3ffcf073d346669d0172cc6a0703d2def87427d654e67b75174c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-a, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T00:54:45.640 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:54:45.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:45 smithi001 ceph-mon[31211]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:45.710 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 21 00:54:45 smithi001 podman[72366]: 2024-09-21 00:54:45.364801864 +0000 UTC m=+0.376300191 container start a4ca57f3ea3f3ffcf073d346669d0172cc6a0703d2def87427d654e67b75174c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-a, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T00:54:45.710 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 21 00:54:45 smithi001 ceph-mds[72398]: -- 172.21.15.1:0/1983180172 <== mon.0 v2:172.21.15.1:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557aaafad860 con 0x557aaf155a80 2024-09-21T00:54:45.710 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 21 00:54:45 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-a[72394]: starting mds.a at 2024-09-21T00:54:45.710 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 21 00:54:45 smithi001 bash[72366]: a4ca57f3ea3f3ffcf073d346669d0172cc6a0703d2def87427d654e67b75174c 2024-09-21T00:54:45.710 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 21 00:54:45 smithi001 systemd[1]: Started Ceph mds.a for d3972c20-77b2-11ef-baf5-efdc52797490. 2024-09-21T00:54:45.953 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:45 smithi042 ceph-mon[34481]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:45.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:45 smithi193 ceph-mon[34660]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.147+0000 7f912ddeb640 1 -- 172.21.15.1:0/2712009340 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9128102a60 msgr2=0x7f9128102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.147+0000 7f912ddeb640 1 --2- 172.21.15.1:0/2712009340 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9128102a60 0x7f9128102e70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9118009900 tx=0x7f911802a410 comp rx=0 tx=0).stop 2024-09-21T00:54:46.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.147+0000 7f912ddeb640 1 -- 172.21.15.1:0/2712009340 shutdown_connections 2024-09-21T00:54:46.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.147+0000 7f912ddeb640 1 --2- 172.21.15.1:0/2712009340 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9128108cf0 0x7f912810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:46.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.147+0000 7f912ddeb640 1 --2- 172.21.15.1:0/2712009340 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91281083a0 0x7f91281087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:46.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.147+0000 7f912ddeb640 1 --2- 172.21.15.1:0/2712009340 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9128102a60 0x7f9128102e70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:46.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.147+0000 7f912ddeb640 1 -- 172.21.15.1:0/2712009340 >> 172.21.15.1:0/2712009340 conn(0x7f9128079730 msgr2=0x7f9128079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:46.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.147+0000 7f912ddeb640 1 -- 172.21.15.1:0/2712009340 shutdown_connections 2024-09-21T00:54:46.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.147+0000 7f912ddeb640 1 -- 172.21.15.1:0/2712009340 wait complete. 2024-09-21T00:54:46.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.148+0000 7f912ddeb640 1 Processor -- start 2024-09-21T00:54:46.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.148+0000 7f912ddeb640 1 -- start start 2024-09-21T00:54:46.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.148+0000 7f912ddeb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9128102a60 0x7f91281119c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:46.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.148+0000 7f912ddeb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91281083a0 0x7f912810ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:46.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.148+0000 7f912ddeb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9128108cf0 0x7f91281104f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:46.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.148+0000 7f912ddeb640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9128113b40 con 0x7f9128102a60 2024-09-21T00:54:46.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.148+0000 7f912ddeb640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f91281139c0 con 0x7f9128108cf0 2024-09-21T00:54:46.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.148+0000 7f912ddeb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9128113cc0 con 0x7f91281083a0 2024-09-21T00:54:46.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.148+0000 7f91277fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9128102a60 0x7f91281119c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:46.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.149+0000 7f91277fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9128102a60 0x7f91281119c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38614/0 (socket says 172.21.15.1:38614) 2024-09-21T00:54:46.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.149+0000 7f91277fe640 1 -- 172.21.15.1:0/3367608487 learned_addr learned my addr 172.21.15.1:0/3367608487 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:54:46.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.149+0000 7f9127fff640 1 --2- 172.21.15.1:0/3367608487 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9128108cf0 0x7f91281104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:46.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.149+0000 7f911effd640 1 --2- 172.21.15.1:0/3367608487 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91281083a0 0x7f912810ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:46.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.149+0000 7f91277fe640 1 -- 172.21.15.1:0/3367608487 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91281083a0 msgr2=0x7f912810ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:46.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.149+0000 7f91277fe640 1 --2- 172.21.15.1:0/3367608487 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91281083a0 0x7f912810ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:46.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.149+0000 7f91277fe640 1 -- 172.21.15.1:0/3367608487 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9128108cf0 msgr2=0x7f91281104f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:46.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.149+0000 7f91277fe640 1 --2- 172.21.15.1:0/3367608487 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9128108cf0 0x7f91281104f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:46.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.149+0000 7f91277fe640 1 -- 172.21.15.1:0/3367608487 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9128110d10 con 0x7f9128102a60 2024-09-21T00:54:46.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.149+0000 7f91277fe640 1 --2- 172.21.15.1:0/3367608487 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9128102a60 0x7f91281119c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9118006010 tx=0x7f91180042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:46.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.149+0000 7f91257fa640 1 -- 172.21.15.1:0/3367608487 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911803f030 con 0x7f9128102a60 2024-09-21T00:54:46.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.149+0000 7f91257fa640 1 -- 172.21.15.1:0/3367608487 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9118003800 con 0x7f9128102a60 2024-09-21T00:54:46.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.149+0000 7f912ddeb640 1 -- 172.21.15.1:0/3367608487 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91281acf10 con 0x7f9128102a60 2024-09-21T00:54:46.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.149+0000 7f91257fa640 1 -- 172.21.15.1:0/3367608487 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9118035070 con 0x7f9128102a60 2024-09-21T00:54:46.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.149+0000 7f912ddeb640 1 -- 172.21.15.1:0/3367608487 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91281ad440 con 0x7f9128102a60 2024-09-21T00:54:46.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.150+0000 7f912ddeb640 1 -- 172.21.15.1:0/3367608487 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9128102ef0 con 0x7f9128102a60 2024-09-21T00:54:46.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.153+0000 7f91257fa640 1 -- 172.21.15.1:0/3367608487 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 154511+0+0 (secure 0 0 0) 0x7f9118003cb0 con 0x7f9128102a60 2024-09-21T00:54:46.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.154+0000 7f91257fa640 1 --2- 172.21.15.1:0/3367608487 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f91140b6590 0x7f91140b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:46.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.154+0000 7f911effd640 1 --2- 172.21.15.1:0/3367608487 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f91140b6590 0x7f91140b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:46.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.154+0000 7f91257fa640 1 -- 172.21.15.1:0/3367608487 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f9118107a10 con 0x7f9128102a60 2024-09-21T00:54:46.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.154+0000 7f911effd640 1 --2- 172.21.15.1:0/3367608487 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f91140b6590 0x7f91140b8aa0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9128079e30 tx=0x7f9110008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:46.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.157+0000 7f91257fa640 1 -- 172.21.15.1:0/3367608487 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f91180ce6a0 con 0x7f9128102a60 2024-09-21T00:54:46.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.385+0000 7f912ddeb640 1 -- 172.21.15.1:0/3367608487 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f912802e640 con 0x7f9128102a60 2024-09-21T00:54:46.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.386+0000 7f91257fa640 1 -- 172.21.15.1:0/3367608487 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9680 (secure 0 0 0) 0x7f91180d2a80 con 0x7f9128102a60 2024-09-21T00:54:46.387 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:54:46.387 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":12,"btime":"2024-09-21T00:54:45:507162+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2810186677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2810186677},{"type":"v1","addr":"172.21.15.1:6835","nonce":2810186677}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14736,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3935320478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3935320478},{"type":"v1","addr":"172.21.15.1:6837","nonce":3935320478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2125703572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2125703572},{"type":"v1","addr":"172.21.15.1:6839","nonce":2125703572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860445313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860445313},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860445313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/712170939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":712170939},{"type":"v1","addr":"172.21.15.193:6833","nonce":712170939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24578,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1653911656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1653911656},{"type":"v1","addr":"172.21.15.42:6833","nonce":1653911656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24605,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/793085918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":793085918},{"type":"v1","addr":"172.21.15.42:6835","nonce":793085918}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24610,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6835/3631682268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":3631682268},{"type":"v1","addr":"172.21.15.193:6835","nonce":3631682268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/909252228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":909252228},{"type":"v1","addr":"172.21.15.193:6837","nonce":909252228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/2395608508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2395608508},{"type":"v1","addr":"172.21.15.42:6837","nonce":2395608508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24637,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6839/1365361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1365361177},{"type":"v1","addr":"172.21.15.193:6839","nonce":1365361177}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T00:54:46.387 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 12 2024-09-21T00:54:46.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.388+0000 7f912ddeb640 1 -- 172.21.15.1:0/3367608487 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f91140b6590 msgr2=0x7f91140b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:46.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.388+0000 7f912ddeb640 1 --2- 172.21.15.1:0/3367608487 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f91140b6590 0x7f91140b8aa0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9128079e30 tx=0x7f9110008040 comp rx=0 tx=0).stop 2024-09-21T00:54:46.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.388+0000 7f912ddeb640 1 -- 172.21.15.1:0/3367608487 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9128102a60 msgr2=0x7f91281119c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:46.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.388+0000 7f912ddeb640 1 --2- 172.21.15.1:0/3367608487 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9128102a60 0x7f91281119c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9118006010 tx=0x7f91180042f0 comp rx=0 tx=0).stop 2024-09-21T00:54:46.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.389+0000 7f912ddeb640 1 -- 172.21.15.1:0/3367608487 shutdown_connections 2024-09-21T00:54:46.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.389+0000 7f912ddeb640 1 --2- 172.21.15.1:0/3367608487 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9128108cf0 0x7f91281104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:46.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.389+0000 7f912ddeb640 1 --2- 172.21.15.1:0/3367608487 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91281083a0 0x7f912810ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:46.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.389+0000 7f912ddeb640 1 --2- 172.21.15.1:0/3367608487 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f91140b6590 0x7f91140b8aa0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:46.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.389+0000 7f912ddeb640 1 --2- 172.21.15.1:0/3367608487 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9128102a60 0x7f91281119c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:46.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.389+0000 7f912ddeb640 1 -- 172.21.15.1:0/3367608487 >> 172.21.15.1:0/3367608487 conn(0x7f9128079730 msgr2=0x7f9128101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:46.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.389+0000 7f912ddeb640 1 -- 172.21.15.1:0/3367608487 shutdown_connections 2024-09-21T00:54:46.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:46.389+0000 7f912ddeb640 1 -- 172.21.15.1:0/3367608487 wait complete. 2024-09-21T00:54:46.692 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:46 smithi001 ceph-mon[31211]: mds.? [v2:172.21.15.1:6840/3860445313,v1:172.21.15.1:6841/3860445313] up:boot 2024-09-21T00:54:46.692 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:46 smithi001 ceph-mon[31211]: fsmap 11 up:standby 2024-09-21T00:54:46.692 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:46 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T00:54:46.692 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:46 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:46.692 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:46 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:46.692 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:46 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:46.693 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:46 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:54:46.693 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:46 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:46.693 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:46 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:46.693 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:46 smithi001 ceph-mon[31211]: Deploying daemon mds.b on smithi042 2024-09-21T00:54:46.693 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:46 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/3367608487' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:54:46.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:46 smithi193 ceph-mon[34660]: mds.? [v2:172.21.15.1:6840/3860445313,v1:172.21.15.1:6841/3860445313] up:boot 2024-09-21T00:54:46.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:46 smithi193 ceph-mon[34660]: fsmap 11 up:standby 2024-09-21T00:54:46.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:46 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T00:54:46.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:46 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:46.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:46 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:46.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:46 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:46.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:46 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:54:46.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:46 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:46.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:46 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:46.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:46 smithi193 ceph-mon[34660]: Deploying daemon mds.b on smithi042 2024-09-21T00:54:46.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:46 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/3367608487' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:54:46.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:46 smithi042 ceph-mon[34481]: mds.? [v2:172.21.15.1:6840/3860445313,v1:172.21.15.1:6841/3860445313] up:boot 2024-09-21T00:54:46.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:46 smithi042 ceph-mon[34481]: fsmap 11 up:standby 2024-09-21T00:54:46.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:46 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T00:54:46.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:46 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:46.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:46 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:46.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:46 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:46.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:46 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:54:46.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:46 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:46.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:46 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:46.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:46 smithi042 ceph-mon[34481]: Deploying daemon mds.b on smithi042 2024-09-21T00:54:46.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:46 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/3367608487' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:54:47.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:47 smithi042 ceph-mon[34481]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:47.743 INFO:journalctl@ceph.mds.b.smithi042.stdout:Sep 21 00:54:47 smithi042 systemd[1]: Starting Ceph mds.b for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T00:54:47.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:47 smithi001 ceph-mon[31211]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:47.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:47 smithi193 ceph-mon[34660]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:48.083 INFO:journalctl@ceph.mds.b.smithi042.stdout:Sep 21 00:54:47 smithi042 podman[63437]: 2024-09-21 00:54:47.713996139 +0000 UTC m=+0.015889911 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:54:48.083 INFO:journalctl@ceph.mds.b.smithi042.stdout:Sep 21 00:54:47 smithi042 podman[63437]: 2024-09-21 00:54:47.838163978 +0000 UTC m=+0.140057778 container create 5092db6112c6e6abe2705acf0716689f6254206a9a8eba01d5cbeeac9c2df8b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-b, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T00:54:48.083 INFO:journalctl@ceph.mds.b.smithi042.stdout:Sep 21 00:54:48 smithi042 podman[63437]: 2024-09-21 00:54:48.082854107 +0000 UTC m=+0.384747866 container init 5092db6112c6e6abe2705acf0716689f6254206a9a8eba01d5cbeeac9c2df8b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-21T00:54:48.492 INFO:journalctl@ceph.mds.b.smithi042.stdout:Sep 21 00:54:48 smithi042 podman[63437]: 2024-09-21 00:54:48.085814075 +0000 UTC m=+0.387707851 container start 5092db6112c6e6abe2705acf0716689f6254206a9a8eba01d5cbeeac9c2df8b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-b, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, ceph=True) 2024-09-21T00:54:48.492 INFO:journalctl@ceph.mds.b.smithi042.stdout:Sep 21 00:54:48 smithi042 ceph-mds[63456]: -- 172.21.15.42:0/2037422840 <== mon.2 v2:172.21.15.42:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562539da1860 con 0x56253df49a80 2024-09-21T00:54:48.492 INFO:journalctl@ceph.mds.b.smithi042.stdout:Sep 21 00:54:48 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-b[63452]: starting mds.b at 2024-09-21T00:54:48.492 INFO:journalctl@ceph.mds.b.smithi042.stdout:Sep 21 00:54:48 smithi042 bash[63437]: 5092db6112c6e6abe2705acf0716689f6254206a9a8eba01d5cbeeac9c2df8b7 2024-09-21T00:54:48.492 INFO:journalctl@ceph.mds.b.smithi042.stdout:Sep 21 00:54:48 smithi042 systemd[1]: Started Ceph mds.b for d3972c20-77b2-11ef-baf5-efdc52797490. 2024-09-21T00:54:48.991 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:54:49.443 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:54:49.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:49 smithi042 ceph-mon[34481]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:49.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:49 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:49.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:49 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:49.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:49 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:49.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:49 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:49.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:49 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:49.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:49 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:54:49.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:49 smithi042 ceph-mon[34481]: mds.? [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] up:boot 2024-09-21T00:54:49.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:49 smithi042 ceph-mon[34481]: fsmap 12 up:standby 2024-09-21T00:54:49.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:49 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T00:54:49.566 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:49 smithi001 ceph-mon[31211]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:49.566 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:49 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:49.566 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:49 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:49.566 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:49 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:49.566 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:49 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:49.566 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:49 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:49.566 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:49 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:54:49.567 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:49 smithi001 ceph-mon[31211]: mds.? [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] up:boot 2024-09-21T00:54:49.567 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:49 smithi001 ceph-mon[31211]: fsmap 12 up:standby 2024-09-21T00:54:49.567 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:49 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T00:54:49.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:49 smithi193 ceph-mon[34660]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:49.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:49 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:49.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:49 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:49.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:49 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:49.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:49 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:49.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:49 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:49.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:49 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:54:49.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:49 smithi193 ceph-mon[34660]: mds.? [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] up:boot 2024-09-21T00:54:49.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:49 smithi193 ceph-mon[34660]: fsmap 12 up:standby 2024-09-21T00:54:49.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:49 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T00:54:50.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:49.995+0000 7f928f1fd640 1 -- 172.21.15.1:0/961409037 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9288102a80 msgr2=0x7f9288102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:50.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:49.995+0000 7f928f1fd640 1 --2- 172.21.15.1:0/961409037 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9288102a80 0x7f9288102e90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9278009900 tx=0x7f927802a410 comp rx=0 tx=0).stop 2024-09-21T00:54:50.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:49.995+0000 7f928f1fd640 1 -- 172.21.15.1:0/961409037 shutdown_connections 2024-09-21T00:54:50.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:49.995+0000 7f928f1fd640 1 --2- 172.21.15.1:0/961409037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9288108d10 0x7f928810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:50.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:49.995+0000 7f928f1fd640 1 --2- 172.21.15.1:0/961409037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92881083c0 0x7f92881087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:50.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:49.995+0000 7f928f1fd640 1 --2- 172.21.15.1:0/961409037 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9288102a80 0x7f9288102e90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:50.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:49.995+0000 7f928f1fd640 1 -- 172.21.15.1:0/961409037 >> 172.21.15.1:0/961409037 conn(0x7f9288079740 msgr2=0x7f9288079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:50.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:49.995+0000 7f928f1fd640 1 -- 172.21.15.1:0/961409037 shutdown_connections 2024-09-21T00:54:50.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:49.995+0000 7f928f1fd640 1 -- 172.21.15.1:0/961409037 wait complete. 2024-09-21T00:54:50.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:49.996+0000 7f928f1fd640 1 Processor -- start 2024-09-21T00:54:50.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:49.996+0000 7f928f1fd640 1 -- start start 2024-09-21T00:54:50.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:49.996+0000 7f928f1fd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9288102a80 0x7f928819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:50.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:49.996+0000 7f928f1fd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92881083c0 0x7f928819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:50.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:49.996+0000 7f928f1fd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9288108d10 0x7f928819fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:50.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:49.996+0000 7f928f1fd640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9288112980 con 0x7f9288102a80 2024-09-21T00:54:50.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:49.996+0000 7f928f1fd640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9288112800 con 0x7f9288108d10 2024-09-21T00:54:50.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:49.996+0000 7f928f1fd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9288112b00 con 0x7f92881083c0 2024-09-21T00:54:50.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:49.996+0000 7f928cf99640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9288102a80 0x7f928819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:50.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:49.996+0000 7f928cf99640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9288102a80 0x7f928819a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47436/0 (socket says 172.21.15.1:47436) 2024-09-21T00:54:50.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:49.996+0000 7f928cf99640 1 -- 172.21.15.1:0/828016039 learned_addr learned my addr 172.21.15.1:0/828016039 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:54:50.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:49.996+0000 7f9287fff640 1 --2- 172.21.15.1:0/828016039 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92881083c0 0x7f928819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:50.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:49.996+0000 7f928d79a640 1 --2- 172.21.15.1:0/828016039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9288108d10 0x7f928819fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:50.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:49.996+0000 7f928cf99640 1 -- 172.21.15.1:0/828016039 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92881083c0 msgr2=0x7f928819aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:50.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:49.997+0000 7f928cf99640 1 --2- 172.21.15.1:0/828016039 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92881083c0 0x7f928819aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:50.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:49.997+0000 7f928cf99640 1 -- 172.21.15.1:0/828016039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9288108d10 msgr2=0x7f928819fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:50.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:49.997+0000 7f928cf99640 1 --2- 172.21.15.1:0/828016039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9288108d10 0x7f928819fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:50.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:49.997+0000 7f928cf99640 1 -- 172.21.15.1:0/828016039 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92881a03f0 con 0x7f9288102a80 2024-09-21T00:54:50.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:49.997+0000 7f928d79a640 1 --2- 172.21.15.1:0/828016039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9288108d10 0x7f928819fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:54:50.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:49.997+0000 7f928cf99640 1 --2- 172.21.15.1:0/828016039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9288102a80 0x7f928819a480 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9278005940 tx=0x7f9278004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:50.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:49.997+0000 7f9285ffb640 1 -- 172.21.15.1:0/828016039 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f927803f030 con 0x7f9288102a80 2024-09-21T00:54:50.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:49.997+0000 7f9285ffb640 1 -- 172.21.15.1:0/828016039 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9278003aa0 con 0x7f9288102a80 2024-09-21T00:54:50.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:49.997+0000 7f9285ffb640 1 -- 172.21.15.1:0/828016039 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9278035070 con 0x7f9288102a80 2024-09-21T00:54:50.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:49.997+0000 7f928f1fd640 1 -- 172.21.15.1:0/828016039 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92881a0680 con 0x7f9288102a80 2024-09-21T00:54:50.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:49.997+0000 7f928f1fd640 1 -- 172.21.15.1:0/828016039 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92881a6e40 con 0x7f9288102a80 2024-09-21T00:54:50.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:49.998+0000 7f928f1fd640 1 -- 172.21.15.1:0/828016039 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9288103d00 con 0x7f9288102a80 2024-09-21T00:54:50.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:50.000+0000 7f9285ffb640 1 -- 172.21.15.1:0/828016039 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 154511+0+0 (secure 0 0 0) 0x7f9278042030 con 0x7f9288102a80 2024-09-21T00:54:50.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:50.001+0000 7f9285ffb640 1 --2- 172.21.15.1:0/828016039 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f92700b6510 0x7f92700b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:50.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:50.001+0000 7f9287fff640 1 --2- 172.21.15.1:0/828016039 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f92700b6510 0x7f92700b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:50.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:50.001+0000 7f9285ffb640 1 -- 172.21.15.1:0/828016039 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f9278107900 con 0x7f9288102a80 2024-09-21T00:54:50.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:50.001+0000 7f9287fff640 1 --2- 172.21.15.1:0/828016039 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f92700b6510 0x7f92700b8a20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9288100c70 tx=0x7f927c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:50.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:50.004+0000 7f9285ffb640 1 -- 172.21.15.1:0/828016039 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f92780ce590 con 0x7f9288102a80 2024-09-21T00:54:50.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:50.264+0000 7f928f1fd640 1 -- 172.21.15.1:0/828016039 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9288102e90 con 0x7f9288102a80 2024-09-21T00:54:50.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:50.265+0000 7f9285ffb640 1 -- 172.21.15.1:0/828016039 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10506 (secure 0 0 0) 0x7f9288102e90 con 0x7f9288102a80 2024-09-21T00:54:50.266 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:54:50.266 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":13,"btime":"2024-09-21T00:54:48:557175+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2810186677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2810186677},{"type":"v1","addr":"172.21.15.1:6835","nonce":2810186677}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14736,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3935320478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3935320478},{"type":"v1","addr":"172.21.15.1:6837","nonce":3935320478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2125703572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2125703572},{"type":"v1","addr":"172.21.15.1:6839","nonce":2125703572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860445313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860445313},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860445313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/712170939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":712170939},{"type":"v1","addr":"172.21.15.193:6833","nonce":712170939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24578,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1653911656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1653911656},{"type":"v1","addr":"172.21.15.42:6833","nonce":1653911656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24605,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/793085918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":793085918},{"type":"v1","addr":"172.21.15.42:6835","nonce":793085918}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24610,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6835/3631682268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":3631682268},{"type":"v1","addr":"172.21.15.193:6835","nonce":3631682268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/909252228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":909252228},{"type":"v1","addr":"172.21.15.193:6837","nonce":909252228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/2395608508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2395608508},{"type":"v1","addr":"172.21.15.42:6837","nonce":2395608508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24637,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6839/1365361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1365361177},{"type":"v1","addr":"172.21.15.193:6839","nonce":1365361177}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24653,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6839/2526476666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2526476666},{"type":"v1","addr":"172.21.15.42:6839","nonce":2526476666}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-21T00:54:50.266 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 13 2024-09-21T00:54:50.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:50.267+0000 7f928f1fd640 1 -- 172.21.15.1:0/828016039 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f92700b6510 msgr2=0x7f92700b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:50.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:50.267+0000 7f928f1fd640 1 --2- 172.21.15.1:0/828016039 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f92700b6510 0x7f92700b8a20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9288100c70 tx=0x7f927c005f90 comp rx=0 tx=0).stop 2024-09-21T00:54:50.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:50.267+0000 7f928f1fd640 1 -- 172.21.15.1:0/828016039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9288102a80 msgr2=0x7f928819a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:50.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:50.267+0000 7f928f1fd640 1 --2- 172.21.15.1:0/828016039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9288102a80 0x7f928819a480 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9278005940 tx=0x7f9278004270 comp rx=0 tx=0).stop 2024-09-21T00:54:50.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:50.267+0000 7f928f1fd640 1 -- 172.21.15.1:0/828016039 shutdown_connections 2024-09-21T00:54:50.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:50.267+0000 7f928f1fd640 1 --2- 172.21.15.1:0/828016039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9288108d10 0x7f928819fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:50.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:50.267+0000 7f928f1fd640 1 --2- 172.21.15.1:0/828016039 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92881083c0 0x7f928819aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:50.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:50.267+0000 7f928f1fd640 1 --2- 172.21.15.1:0/828016039 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f92700b6510 0x7f92700b8a20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:50.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:50.267+0000 7f928f1fd640 1 --2- 172.21.15.1:0/828016039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9288102a80 0x7f928819a480 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:50.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:50.267+0000 7f928f1fd640 1 -- 172.21.15.1:0/828016039 >> 172.21.15.1:0/828016039 conn(0x7f9288079740 msgr2=0x7f9288101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:50.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:50.267+0000 7f928f1fd640 1 -- 172.21.15.1:0/828016039 shutdown_connections 2024-09-21T00:54:50.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:50.268+0000 7f928f1fd640 1 -- 172.21.15.1:0/828016039 wait complete. 2024-09-21T00:54:50.943 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:50 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:50.943 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:50 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:50.943 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:50 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:50.943 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:50 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:50.943 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:50 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/828016039' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:54:50.943 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:50 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:50.943 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:50 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:50.943 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:50 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:50.943 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:50 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:54:50.943 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:50 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:50.943 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:50 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:54:50.970 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph --format=json-pretty osd lspools 2024-09-21T00:54:51.089 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:50 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:51.089 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:50 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:51.089 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:50 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:51.089 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:50 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:51.089 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:50 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/828016039' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:54:51.089 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:50 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:51.089 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:50 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:51.090 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:50 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:51.090 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:50 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:54:51.090 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:50 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:51.090 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:50 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:54:51.114 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:50 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:51.114 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:50 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:51.114 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:50 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:51.114 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:50 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:51.114 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:50 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/828016039' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:54:51.114 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:50 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:51.114 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:50 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:51.114 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:50 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:51.114 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:50 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:54:51.114 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:50 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:51.114 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:50 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:54:51.863 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:54:51.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:51 smithi001 ceph-mon[31211]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:51.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:51 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:52.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:51 smithi193 ceph-mon[34660]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:52.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:51 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:52.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:51 smithi042 ceph-mon[34481]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:52.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:51 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:52.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.371+0000 7fd2295ac640 1 -- 172.21.15.1:0/2992656437 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2241083b0 msgr2=0x7fd2241087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:52.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.371+0000 7fd2295ac640 1 --2- 172.21.15.1:0/2992656437 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2241083b0 0x7fd2241087c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd20c009900 tx=0x7fd20c02a410 comp rx=0 tx=0).stop 2024-09-21T00:54:52.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.371+0000 7fd2295ac640 1 -- 172.21.15.1:0/2992656437 shutdown_connections 2024-09-21T00:54:52.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.371+0000 7fd2295ac640 1 --2- 172.21.15.1:0/2992656437 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd224108d00 0x7fd22410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:52.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.371+0000 7fd2295ac640 1 --2- 172.21.15.1:0/2992656437 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2241083b0 0x7fd2241087c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:52.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.371+0000 7fd2295ac640 1 --2- 172.21.15.1:0/2992656437 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd224102a70 0x7fd224102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:52.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.371+0000 7fd2295ac640 1 -- 172.21.15.1:0/2992656437 >> 172.21.15.1:0/2992656437 conn(0x7fd224079710 msgr2=0x7fd224079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:52.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.371+0000 7fd2295ac640 1 -- 172.21.15.1:0/2992656437 shutdown_connections 2024-09-21T00:54:52.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.371+0000 7fd2295ac640 1 -- 172.21.15.1:0/2992656437 wait complete. 2024-09-21T00:54:52.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.372+0000 7fd2295ac640 1 Processor -- start 2024-09-21T00:54:52.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.373+0000 7fd2295ac640 1 -- start start 2024-09-21T00:54:52.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.373+0000 7fd2295ac640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd224102a70 0x7fd22419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:52.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.373+0000 7fd2295ac640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd2241083b0 0x7fd22419aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:52.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.373+0000 7fd2295ac640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd224108d00 0x7fd22419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:52.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.373+0000 7fd2295ac640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd224113ae0 con 0x7fd224102a70 2024-09-21T00:54:52.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.373+0000 7fd2295ac640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd224113960 con 0x7fd224108d00 2024-09-21T00:54:52.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.373+0000 7fd2295ac640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd224113c60 con 0x7fd2241083b0 2024-09-21T00:54:52.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.373+0000 7fd222ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd224102a70 0x7fd22419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:52.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.373+0000 7fd222ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd224102a70 0x7fd22419a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47448/0 (socket says 172.21.15.1:47448) 2024-09-21T00:54:52.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.373+0000 7fd222ffd640 1 -- 172.21.15.1:0/2119065174 learned_addr learned my addr 172.21.15.1:0/2119065174 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:54:52.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.373+0000 7fd21a7fc640 1 --2- 172.21.15.1:0/2119065174 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd2241083b0 0x7fd22419aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:52.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.373+0000 7fd2237fe640 1 --2- 172.21.15.1:0/2119065174 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd224108d00 0x7fd22419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:52.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.373+0000 7fd222ffd640 1 -- 172.21.15.1:0/2119065174 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd2241083b0 msgr2=0x7fd22419aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:52.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.373+0000 7fd222ffd640 1 --2- 172.21.15.1:0/2119065174 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd2241083b0 0x7fd22419aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:52.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.373+0000 7fd222ffd640 1 -- 172.21.15.1:0/2119065174 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd224108d00 msgr2=0x7fd22419fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:52.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.374+0000 7fd222ffd640 1 --2- 172.21.15.1:0/2119065174 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd224108d00 0x7fd22419fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:52.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.374+0000 7fd222ffd640 1 -- 172.21.15.1:0/2119065174 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2241a0460 con 0x7fd224102a70 2024-09-21T00:54:52.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.374+0000 7fd222ffd640 1 --2- 172.21.15.1:0/2119065174 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd224102a70 0x7fd22419a4f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd21400d950 tx=0x7fd21400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:52.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.374+0000 7fd220ff9640 1 -- 172.21.15.1:0/2119065174 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd214017030 con 0x7fd224102a70 2024-09-21T00:54:52.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.374+0000 7fd220ff9640 1 -- 172.21.15.1:0/2119065174 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd214004020 con 0x7fd224102a70 2024-09-21T00:54:52.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.374+0000 7fd2295ac640 1 -- 172.21.15.1:0/2119065174 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2241a0750 con 0x7fd224102a70 2024-09-21T00:54:52.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.374+0000 7fd220ff9640 1 -- 172.21.15.1:0/2119065174 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2140047a0 con 0x7fd224102a70 2024-09-21T00:54:52.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.374+0000 7fd2295ac640 1 -- 172.21.15.1:0/2119065174 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2241a6eb0 con 0x7fd224102a70 2024-09-21T00:54:52.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.375+0000 7fd2295ac640 1 -- 172.21.15.1:0/2119065174 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd224103cf0 con 0x7fd224102a70 2024-09-21T00:54:52.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.378+0000 7fd220ff9640 1 -- 172.21.15.1:0/2119065174 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 154511+0+0 (secure 0 0 0) 0x7fd214009a30 con 0x7fd224102a70 2024-09-21T00:54:52.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.379+0000 7fd220ff9640 1 --2- 172.21.15.1:0/2119065174 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd2100b6510 0x7fd2100b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:52.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.379+0000 7fd21a7fc640 1 --2- 172.21.15.1:0/2119065174 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd2100b6510 0x7fd2100b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:52.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.379+0000 7fd220ff9640 1 -- 172.21.15.1:0/2119065174 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7fd2140e6ee0 con 0x7fd224102a70 2024-09-21T00:54:52.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.379+0000 7fd21a7fc640 1 --2- 172.21.15.1:0/2119065174 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd2100b6510 0x7fd2100b8a20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd20c009230 tx=0x7fd20c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:52.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.381+0000 7fd220ff9640 1 -- 172.21.15.1:0/2119065174 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd2140adb70 con 0x7fd224102a70 2024-09-21T00:54:52.578 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:54:52.578 INFO:teuthology.orchestra.run.smithi001.stdout:[ 2024-09-21T00:54:52.578 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T00:54:52.578 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 1, 2024-09-21T00:54:52.578 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": ".mgr" 2024-09-21T00:54:52.578 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T00:54:52.579 INFO:teuthology.orchestra.run.smithi001.stdout:] 2024-09-21T00:54:52.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.577+0000 7fd2295ac640 1 -- 172.21.15.1:0/2119065174 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd224102e80 con 0x7fd224102a70 2024-09-21T00:54:52.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.577+0000 7fd220ff9640 1 -- 172.21.15.1:0/2119065174 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v68) ==== 84+0+65 (secure 0 0 0) 0x7fd2140b1f50 con 0x7fd224102a70 2024-09-21T00:54:52.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.580+0000 7fd2295ac640 1 -- 172.21.15.1:0/2119065174 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd2100b6510 msgr2=0x7fd2100b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:52.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.580+0000 7fd2295ac640 1 --2- 172.21.15.1:0/2119065174 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd2100b6510 0x7fd2100b8a20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd20c009230 tx=0x7fd20c031400 comp rx=0 tx=0).stop 2024-09-21T00:54:52.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.580+0000 7fd2295ac640 1 -- 172.21.15.1:0/2119065174 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd224102a70 msgr2=0x7fd22419a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:52.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.580+0000 7fd2295ac640 1 --2- 172.21.15.1:0/2119065174 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd224102a70 0x7fd22419a4f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd21400d950 tx=0x7fd21400de10 comp rx=0 tx=0).stop 2024-09-21T00:54:52.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.580+0000 7fd2295ac640 1 -- 172.21.15.1:0/2119065174 shutdown_connections 2024-09-21T00:54:52.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.580+0000 7fd2295ac640 1 --2- 172.21.15.1:0/2119065174 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd224108d00 0x7fd22419fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:52.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.580+0000 7fd2295ac640 1 --2- 172.21.15.1:0/2119065174 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd2241083b0 0x7fd22419aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:52.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.580+0000 7fd2295ac640 1 --2- 172.21.15.1:0/2119065174 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd2100b6510 0x7fd2100b8a20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:52.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.580+0000 7fd2295ac640 1 --2- 172.21.15.1:0/2119065174 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd224102a70 0x7fd22419a4f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:52.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.580+0000 7fd2295ac640 1 -- 172.21.15.1:0/2119065174 >> 172.21.15.1:0/2119065174 conn(0x7fd224079710 msgr2=0x7fd2241064c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:52.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.580+0000 7fd2295ac640 1 -- 172.21.15.1:0/2119065174 shutdown_connections 2024-09-21T00:54:52.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:52.580+0000 7fd2295ac640 1 -- 172.21.15.1:0/2119065174 wait complete. 2024-09-21T00:54:52.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:52 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:52.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:52 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:52.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:52 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:52.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:52 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:52.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:52 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/2119065174' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T00:54:53.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:52 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:53.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:52 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:53.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:52 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:53.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:52 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:53.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:52 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/2119065174' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T00:54:53.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:52 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:53.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:52 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:53.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:52 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:53.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:52 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:53.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:52 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/2119065174' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T00:54:53.305 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T00:54:53.305 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T00:54:53.580 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:54:53.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:53 smithi001 ceph-mon[31211]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:53.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:53 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:53.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:53 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:53.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:53 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:53.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:53 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:54:53.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:53 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:53.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:53 smithi193 ceph-mon[34660]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:53.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:53 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:53.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:53 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:53.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:53 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:53.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:53 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:54:53.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:53 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:54.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.101+0000 7f83e9903640 1 -- 172.21.15.1:0/1597226848 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83e41083c0 msgr2=0x7f83e41087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:54.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.101+0000 7f83e9903640 1 --2- 172.21.15.1:0/1597226848 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83e41083c0 0x7f83e41087d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f83d8009900 tx=0x7f83d802a410 comp rx=0 tx=0).stop 2024-09-21T00:54:54.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.101+0000 7f83e9903640 1 -- 172.21.15.1:0/1597226848 shutdown_connections 2024-09-21T00:54:54.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.101+0000 7f83e9903640 1 --2- 172.21.15.1:0/1597226848 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83e4108d10 0x7f83e410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:54.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.101+0000 7f83e9903640 1 --2- 172.21.15.1:0/1597226848 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83e41083c0 0x7f83e41087d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:54.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.101+0000 7f83e9903640 1 --2- 172.21.15.1:0/1597226848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83e4102a80 0x7f83e4102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:54.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.101+0000 7f83e9903640 1 -- 172.21.15.1:0/1597226848 >> 172.21.15.1:0/1597226848 conn(0x7f83e4079740 msgr2=0x7f83e4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:54.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.101+0000 7f83e9903640 1 -- 172.21.15.1:0/1597226848 shutdown_connections 2024-09-21T00:54:54.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.101+0000 7f83e9903640 1 -- 172.21.15.1:0/1597226848 wait complete. 2024-09-21T00:54:54.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.101+0000 7f83e9903640 1 Processor -- start 2024-09-21T00:54:54.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.102+0000 7f83e9903640 1 -- start start 2024-09-21T00:54:54.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.102+0000 7f83e9903640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83e4102a80 0x7f83e40ff690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:54.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.102+0000 7f83e9903640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83e41083c0 0x7f83e40ffbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:54.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.102+0000 7f83e9903640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83e4108d10 0x7f83e4100110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:54.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.102+0000 7f83e9903640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f83e4112980 con 0x7f83e4102a80 2024-09-21T00:54:54.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.102+0000 7f83e9903640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f83e4112800 con 0x7f83e4108d10 2024-09-21T00:54:54.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.102+0000 7f83e9903640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f83e4112b00 con 0x7f83e41083c0 2024-09-21T00:54:54.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.102+0000 7f83e2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83e4102a80 0x7f83e40ff690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:54.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.102+0000 7f83e2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83e4102a80 0x7f83e40ff690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47468/0 (socket says 172.21.15.1:47468) 2024-09-21T00:54:54.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.102+0000 7f83e2ffd640 1 -- 172.21.15.1:0/1219696474 learned_addr learned my addr 172.21.15.1:0/1219696474 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:54:54.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.102+0000 7f83e27fc640 1 --2- 172.21.15.1:0/1219696474 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83e41083c0 0x7f83e40ffbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:54.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.102+0000 7f83e37fe640 1 --2- 172.21.15.1:0/1219696474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83e4108d10 0x7f83e4100110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:54.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.102+0000 7f83e2ffd640 1 -- 172.21.15.1:0/1219696474 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83e41083c0 msgr2=0x7f83e40ffbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:54.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.102+0000 7f83e2ffd640 1 --2- 172.21.15.1:0/1219696474 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83e41083c0 0x7f83e40ffbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:54.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.102+0000 7f83e2ffd640 1 -- 172.21.15.1:0/1219696474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83e4108d10 msgr2=0x7f83e4100110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:54.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.102+0000 7f83e2ffd640 1 --2- 172.21.15.1:0/1219696474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83e4108d10 0x7f83e4100110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:54.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.102+0000 7f83e2ffd640 1 -- 172.21.15.1:0/1219696474 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e41a86f0 con 0x7f83e4102a80 2024-09-21T00:54:54.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.102+0000 7f83e37fe640 1 --2- 172.21.15.1:0/1219696474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83e4108d10 0x7f83e4100110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:54:54.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.103+0000 7f83e2ffd640 1 --2- 172.21.15.1:0/1219696474 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83e4102a80 0x7f83e40ff690 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f83d400d950 tx=0x7f83d400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:54.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.103+0000 7f83e8901640 1 -- 172.21.15.1:0/1219696474 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d4017070 con 0x7f83e4102a80 2024-09-21T00:54:54.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.103+0000 7f83e9903640 1 -- 172.21.15.1:0/1219696474 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83e41a89e0 con 0x7f83e4102a80 2024-09-21T00:54:54.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.103+0000 7f83e8901640 1 -- 172.21.15.1:0/1219696474 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83d4009c30 con 0x7f83e4102a80 2024-09-21T00:54:54.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.103+0000 7f83e8901640 1 -- 172.21.15.1:0/1219696474 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d400f620 con 0x7f83e4102a80 2024-09-21T00:54:54.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.103+0000 7f83e9903640 1 -- 172.21.15.1:0/1219696474 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83e41a8ef0 con 0x7f83e4102a80 2024-09-21T00:54:54.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.104+0000 7f83e9903640 1 -- 172.21.15.1:0/1219696474 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83e4103d00 con 0x7f83e4102a80 2024-09-21T00:54:54.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.107+0000 7f83e8901640 1 -- 172.21.15.1:0/1219696474 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 154511+0+0 (secure 0 0 0) 0x7f83d4005030 con 0x7f83e4102a80 2024-09-21T00:54:54.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.107+0000 7f83e8901640 1 --2- 172.21.15.1:0/1219696474 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f83cc0b6510 0x7f83cc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:54.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.107+0000 7f83e27fc640 1 --2- 172.21.15.1:0/1219696474 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f83cc0b6510 0x7f83cc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:54.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.108+0000 7f83e8901640 1 -- 172.21.15.1:0/1219696474 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f83d40e6a60 con 0x7f83e4102a80 2024-09-21T00:54:54.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.108+0000 7f83e27fc640 1 --2- 172.21.15.1:0/1219696474 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f83cc0b6510 0x7f83cc0b8a20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f83d8000c00 tx=0x7f83d8031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:54.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.111+0000 7f83e8901640 1 -- 172.21.15.1:0/1219696474 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f83d40ad790 con 0x7f83e4102a80 2024-09-21T00:54:54.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:53 smithi042 ceph-mon[34481]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:54.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:53 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:54.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:53 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:54.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:53 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:54.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:53 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:54:54.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:53 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:54:54.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.300+0000 7f83e9903640 1 -- 172.21.15.1:0/1219696474 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f83e4100990 con 0x7f83e4102a80 2024-09-21T00:54:54.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.842+0000 7f83e8901640 1 -- 172.21.15.1:0/1219696474 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v69) ==== 138+0+0 (secure 0 0 0) 0x7f83d40e4e20 con 0x7f83e4102a80 2024-09-21T00:54:54.844 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' created 2024-09-21T00:54:54.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.846+0000 7f83e9903640 1 -- 172.21.15.1:0/1219696474 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f83cc0b6510 msgr2=0x7f83cc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:54.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.846+0000 7f83e9903640 1 --2- 172.21.15.1:0/1219696474 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f83cc0b6510 0x7f83cc0b8a20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f83d8000c00 tx=0x7f83d8031400 comp rx=0 tx=0).stop 2024-09-21T00:54:54.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.846+0000 7f83e9903640 1 -- 172.21.15.1:0/1219696474 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83e4102a80 msgr2=0x7f83e40ff690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:54.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.846+0000 7f83e9903640 1 --2- 172.21.15.1:0/1219696474 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83e4102a80 0x7f83e40ff690 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f83d400d950 tx=0x7f83d400de10 comp rx=0 tx=0).stop 2024-09-21T00:54:54.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.846+0000 7f83e9903640 1 -- 172.21.15.1:0/1219696474 shutdown_connections 2024-09-21T00:54:54.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.846+0000 7f83e9903640 1 --2- 172.21.15.1:0/1219696474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83e4108d10 0x7f83e4100110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:54.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.846+0000 7f83e9903640 1 --2- 172.21.15.1:0/1219696474 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83e41083c0 0x7f83e40ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:54.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.846+0000 7f83e9903640 1 --2- 172.21.15.1:0/1219696474 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f83cc0b6510 0x7f83cc0b8a20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:54.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.846+0000 7f83e9903640 1 --2- 172.21.15.1:0/1219696474 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83e4102a80 0x7f83e40ff690 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:54.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.846+0000 7f83e9903640 1 -- 172.21.15.1:0/1219696474 >> 172.21.15.1:0/1219696474 conn(0x7f83e4079740 msgr2=0x7f83e406bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:54.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.846+0000 7f83e9903640 1 -- 172.21.15.1:0/1219696474 shutdown_connections 2024-09-21T00:54:54.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:54.846+0000 7f83e9903640 1 -- 172.21.15.1:0/1219696474 wait complete. 2024-09-21T00:54:55.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:54 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1219696474' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T00:54:55.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:54 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/1219696474' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T00:54:55.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:54 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/1219696474' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T00:54:55.512 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T00:54:55.778 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:54:56.206 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:55 smithi001 ceph-mon[31211]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:56.206 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:55 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1219696474' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T00:54:56.206 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:55 smithi001 ceph-mon[31211]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T00:54:56.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:55 smithi193 ceph-mon[34660]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:56.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:55 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/1219696474' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T00:54:56.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:55 smithi193 ceph-mon[34660]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T00:54:56.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:55 smithi042 ceph-mon[34481]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:56.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:55 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/1219696474' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T00:54:56.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:55 smithi042 ceph-mon[34481]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T00:54:56.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.304+0000 7fe0dcae4640 1 -- 172.21.15.1:0/3344427835 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0d81094a0 msgr2=0x7fe0d81098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:56.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.304+0000 7fe0dcae4640 1 --2- 172.21.15.1:0/3344427835 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0d81094a0 0x7fe0d81098b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc009900 tx=0x7fe0cc02a410 comp rx=0 tx=0).stop 2024-09-21T00:54:56.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.304+0000 7fe0dcae4640 1 -- 172.21.15.1:0/3344427835 shutdown_connections 2024-09-21T00:54:56.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.304+0000 7fe0dcae4640 1 --2- 172.21.15.1:0/3344427835 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0d8109df0 0x7fe0d8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:56.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.304+0000 7fe0dcae4640 1 --2- 172.21.15.1:0/3344427835 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0d81094a0 0x7fe0d81098b0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:56.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.304+0000 7fe0dcae4640 1 --2- 172.21.15.1:0/3344427835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0d8103b60 0x7fe0d8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:56.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.304+0000 7fe0dcae4640 1 -- 172.21.15.1:0/3344427835 >> 172.21.15.1:0/3344427835 conn(0x7fe0d807b850 msgr2=0x7fe0d807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:56.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.304+0000 7fe0dcae4640 1 -- 172.21.15.1:0/3344427835 shutdown_connections 2024-09-21T00:54:56.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.304+0000 7fe0dcae4640 1 -- 172.21.15.1:0/3344427835 wait complete. 2024-09-21T00:54:56.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.305+0000 7fe0dcae4640 1 Processor -- start 2024-09-21T00:54:56.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.305+0000 7fe0dcae4640 1 -- start start 2024-09-21T00:54:56.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.305+0000 7fe0dcae4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0d8103b60 0x7fe0d819a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:56.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.305+0000 7fe0dcae4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0d81094a0 0x7fe0d819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:56.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.305+0000 7fe0dcae4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0d8109df0 0x7fe0d819fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:56.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.305+0000 7fe0dcae4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d8113ad0 con 0x7fe0d8109df0 2024-09-21T00:54:56.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.305+0000 7fe0dcae4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d8113950 con 0x7fe0d8103b60 2024-09-21T00:54:56.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.305+0000 7fe0dcae4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d8113c50 con 0x7fe0d81094a0 2024-09-21T00:54:56.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.305+0000 7fe0d6d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0d8109df0 0x7fe0d819fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:56.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.305+0000 7fe0d6d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0d8109df0 0x7fe0d819fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47488/0 (socket says 172.21.15.1:47488) 2024-09-21T00:54:56.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.305+0000 7fe0d6d9d640 1 -- 172.21.15.1:0/3197887895 learned_addr learned my addr 172.21.15.1:0/3197887895 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:54:56.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.305+0000 7fe0d5d9b640 1 --2- 172.21.15.1:0/3197887895 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0d81094a0 0x7fe0d819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:56.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.306+0000 7fe0d5d9b640 1 -- 172.21.15.1:0/3197887895 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0d8103b60 msgr2=0x7fe0d819a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:56.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.306+0000 7fe0d5d9b640 1 --2- 172.21.15.1:0/3197887895 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0d8103b60 0x7fe0d819a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:56.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.306+0000 7fe0d5d9b640 1 -- 172.21.15.1:0/3197887895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0d8109df0 msgr2=0x7fe0d819fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:56.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.306+0000 7fe0d5d9b640 1 --2- 172.21.15.1:0/3197887895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0d8109df0 0x7fe0d819fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:56.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.306+0000 7fe0d5d9b640 1 -- 172.21.15.1:0/3197887895 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0d81a04d0 con 0x7fe0d81094a0 2024-09-21T00:54:56.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.306+0000 7fe0d5d9b640 1 --2- 172.21.15.1:0/3197887895 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0d81094a0 0x7fe0d819ab00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc02a930 tx=0x7fe0cc004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:56.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.306+0000 7fe0c77fe640 1 -- 172.21.15.1:0/3197887895 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc03f070 con 0x7fe0d81094a0 2024-09-21T00:54:56.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.307+0000 7fe0dcae4640 1 -- 172.21.15.1:0/3197887895 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0d81a0760 con 0x7fe0d81094a0 2024-09-21T00:54:56.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.307+0000 7fe0c77fe640 1 -- 172.21.15.1:0/3197887895 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0cc003ca0 con 0x7fe0d81094a0 2024-09-21T00:54:56.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.307+0000 7fe0c77fe640 1 -- 172.21.15.1:0/3197887895 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc035070 con 0x7fe0d81094a0 2024-09-21T00:54:56.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.307+0000 7fe0dcae4640 1 -- 172.21.15.1:0/3197887895 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0d81a6f20 con 0x7fe0d81094a0 2024-09-21T00:54:56.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.308+0000 7fe0dcae4640 1 -- 172.21.15.1:0/3197887895 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0d8104de0 con 0x7fe0d81094a0 2024-09-21T00:54:56.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.310+0000 7fe0c77fe640 1 -- 172.21.15.1:0/3197887895 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 16) ==== 154511+0+0 (secure 0 0 0) 0x7fe0cc03b460 con 0x7fe0d81094a0 2024-09-21T00:54:56.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.310+0000 7fe0c77fe640 1 --2- 172.21.15.1:0/3197887895 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe0c00b6510 0x7fe0c00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:56.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.311+0000 7fe0d659c640 1 --2- 172.21.15.1:0/3197887895 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe0c00b6510 0x7fe0c00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:56.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.311+0000 7fe0c77fe640 1 -- 172.21.15.1:0/3197887895 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7497+0+0 (secure 0 0 0) 0x7fe0cc107940 con 0x7fe0d81094a0 2024-09-21T00:54:56.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.311+0000 7fe0d659c640 1 --2- 172.21.15.1:0/3197887895 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe0c00b6510 0x7fe0c00b8a20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8005fd0 tx=0x7fe0c8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:56.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.314+0000 7fe0c77fe640 1 -- 172.21.15.1:0/3197887895 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe0cc0ce4e0 con 0x7fe0d81094a0 2024-09-21T00:54:56.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.501+0000 7fe0dcae4640 1 -- 172.21.15.1:0/3197887895 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe0d8103f70 con 0x7fe0d81094a0 2024-09-21T00:54:56.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.855+0000 7fe0c77fe640 1 -- 172.21.15.1:0/3197887895 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v71) ==== 170+0+0 (secure 0 0 0) 0x7fe0cc0d28c0 con 0x7fe0d81094a0 2024-09-21T00:54:56.857 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' created 2024-09-21T00:54:56.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.860+0000 7fe0dcae4640 1 -- 172.21.15.1:0/3197887895 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe0c00b6510 msgr2=0x7fe0c00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:56.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.860+0000 7fe0dcae4640 1 --2- 172.21.15.1:0/3197887895 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe0c00b6510 0x7fe0c00b8a20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8005fd0 tx=0x7fe0c8005850 comp rx=0 tx=0).stop 2024-09-21T00:54:56.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.860+0000 7fe0dcae4640 1 -- 172.21.15.1:0/3197887895 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0d81094a0 msgr2=0x7fe0d819ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:56.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.860+0000 7fe0dcae4640 1 --2- 172.21.15.1:0/3197887895 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0d81094a0 0x7fe0d819ab00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc02a930 tx=0x7fe0cc004270 comp rx=0 tx=0).stop 2024-09-21T00:54:56.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.861+0000 7fe0dcae4640 1 -- 172.21.15.1:0/3197887895 shutdown_connections 2024-09-21T00:54:56.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.861+0000 7fe0dcae4640 1 --2- 172.21.15.1:0/3197887895 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe0c00b6510 0x7fe0c00b8a20 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:56.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.861+0000 7fe0dcae4640 1 --2- 172.21.15.1:0/3197887895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0d8109df0 0x7fe0d819fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:56.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.861+0000 7fe0dcae4640 1 --2- 172.21.15.1:0/3197887895 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0d81094a0 0x7fe0d819ab00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:56.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.861+0000 7fe0dcae4640 1 --2- 172.21.15.1:0/3197887895 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0d8103b60 0x7fe0d819a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:56.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.861+0000 7fe0dcae4640 1 -- 172.21.15.1:0/3197887895 >> 172.21.15.1:0/3197887895 conn(0x7fe0d807b850 msgr2=0x7fe0d81075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:56.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.861+0000 7fe0dcae4640 1 -- 172.21.15.1:0/3197887895 shutdown_connections 2024-09-21T00:54:56.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:56.861+0000 7fe0dcae4640 1 -- 172.21.15.1:0/3197887895 wait complete. 2024-09-21T00:54:57.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:56 smithi001 ceph-mon[31211]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T00:54:57.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:56 smithi001 ceph-mon[31211]: pgmap v285: 33 pgs: 10 creating+peering, 1 active+clean, 22 unknown; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:57.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:56 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/3197887895' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T00:54:57.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:56 smithi001 ceph-mon[31211]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T00:54:57.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:56 smithi001 ceph-mon[31211]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T00:54:57.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:56 smithi001 ceph-mon[31211]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T00:54:57.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:56 smithi193 ceph-mon[34660]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T00:54:57.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:56 smithi193 ceph-mon[34660]: pgmap v285: 33 pgs: 10 creating+peering, 1 active+clean, 22 unknown; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:57.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:56 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/3197887895' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T00:54:57.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:56 smithi193 ceph-mon[34660]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T00:54:57.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:56 smithi193 ceph-mon[34660]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T00:54:57.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:56 smithi193 ceph-mon[34660]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T00:54:57.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:56 smithi042 ceph-mon[34481]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T00:54:57.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:56 smithi042 ceph-mon[34481]: pgmap v285: 33 pgs: 10 creating+peering, 1 active+clean, 22 unknown; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:57.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:56 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/3197887895' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T00:54:57.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:56 smithi042 ceph-mon[34481]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T00:54:57.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:56 smithi042 ceph-mon[34481]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T00:54:57.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:56 smithi042 ceph-mon[34481]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T00:54:57.598 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T00:54:57.880 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:54:58.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.352+0000 7f93d8410640 1 -- 172.21.15.1:0/160241242 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93d0102a60 msgr2=0x7f93d0102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:58.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.352+0000 7f93d8410640 1 --2- 172.21.15.1:0/160241242 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93d0102a60 0x7f93d0102e70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f93c4009900 tx=0x7f93c402a410 comp rx=0 tx=0).stop 2024-09-21T00:54:58.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.352+0000 7f93d8410640 1 -- 172.21.15.1:0/160241242 shutdown_connections 2024-09-21T00:54:58.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.352+0000 7f93d8410640 1 --2- 172.21.15.1:0/160241242 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f93d0108cf0 0x7f93d010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:58.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.352+0000 7f93d8410640 1 --2- 172.21.15.1:0/160241242 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93d01083a0 0x7f93d01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:58.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.352+0000 7f93d8410640 1 --2- 172.21.15.1:0/160241242 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93d0102a60 0x7f93d0102e70 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:58.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.352+0000 7f93d8410640 1 -- 172.21.15.1:0/160241242 >> 172.21.15.1:0/160241242 conn(0x7f93d0079730 msgr2=0x7f93d0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:58.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.352+0000 7f93d8410640 1 -- 172.21.15.1:0/160241242 shutdown_connections 2024-09-21T00:54:58.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.352+0000 7f93d8410640 1 -- 172.21.15.1:0/160241242 wait complete. 2024-09-21T00:54:58.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.353+0000 7f93d8410640 1 Processor -- start 2024-09-21T00:54:58.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.353+0000 7f93d8410640 1 -- start start 2024-09-21T00:54:58.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.353+0000 7f93d8410640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93d0102a60 0x7f93d01993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:58.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.353+0000 7f93d8410640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93d01083a0 0x7f93d0199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:58.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.353+0000 7f93d8410640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f93d0108cf0 0x7f93d019ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:58.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.353+0000 7f93d8410640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f93d01129c0 con 0x7f93d0102a60 2024-09-21T00:54:58.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.353+0000 7f93d8410640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f93d0112840 con 0x7f93d01083a0 2024-09-21T00:54:58.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.353+0000 7f93d8410640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f93d0112b40 con 0x7f93d0108cf0 2024-09-21T00:54:58.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.353+0000 7f93d61ac640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93d0102a60 0x7f93d01993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:58.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.353+0000 7f93d61ac640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93d0102a60 0x7f93d01993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47502/0 (socket says 172.21.15.1:47502) 2024-09-21T00:54:58.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.353+0000 7f93d61ac640 1 -- 172.21.15.1:0/3820656124 learned_addr learned my addr 172.21.15.1:0/3820656124 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:54:58.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.353+0000 7f93d59ab640 1 --2- 172.21.15.1:0/3820656124 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93d01083a0 0x7f93d0199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:58.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.353+0000 7f93d69ad640 1 --2- 172.21.15.1:0/3820656124 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f93d0108cf0 0x7f93d019ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:58.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.353+0000 7f93d61ac640 1 -- 172.21.15.1:0/3820656124 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f93d0108cf0 msgr2=0x7f93d019ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:58.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.353+0000 7f93d61ac640 1 --2- 172.21.15.1:0/3820656124 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f93d0108cf0 0x7f93d019ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:58.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.353+0000 7f93d61ac640 1 -- 172.21.15.1:0/3820656124 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93d01083a0 msgr2=0x7f93d0199950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:58.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.353+0000 7f93d61ac640 1 --2- 172.21.15.1:0/3820656124 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93d01083a0 0x7f93d0199950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:58.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.353+0000 7f93d61ac640 1 -- 172.21.15.1:0/3820656124 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93d019f320 con 0x7f93d0102a60 2024-09-21T00:54:58.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.353+0000 7f93d69ad640 1 --2- 172.21.15.1:0/3820656124 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f93d0108cf0 0x7f93d019ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:54:58.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.354+0000 7f93d61ac640 1 --2- 172.21.15.1:0/3820656124 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93d0102a60 0x7f93d01993b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f93c4005940 tx=0x7f93c40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:58.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.354+0000 7f93c37fe640 1 -- 172.21.15.1:0/3820656124 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c403f030 con 0x7f93d0102a60 2024-09-21T00:54:58.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.354+0000 7f93d8410640 1 -- 172.21.15.1:0/3820656124 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93d019f5b0 con 0x7f93d0102a60 2024-09-21T00:54:58.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.354+0000 7f93c37fe640 1 -- 172.21.15.1:0/3820656124 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93c4003cb0 con 0x7f93d0102a60 2024-09-21T00:54:58.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.354+0000 7f93c37fe640 1 -- 172.21.15.1:0/3820656124 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c4035070 con 0x7f93d0102a60 2024-09-21T00:54:58.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.354+0000 7f93d8410640 1 -- 172.21.15.1:0/3820656124 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93d01a5d70 con 0x7f93d0102a60 2024-09-21T00:54:58.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.355+0000 7f93d8410640 1 -- 172.21.15.1:0/3820656124 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93d0102e70 con 0x7f93d0102a60 2024-09-21T00:54:58.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.357+0000 7f93c37fe640 1 -- 172.21.15.1:0/3820656124 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 154511+0+0 (secure 0 0 0) 0x7f93c4042030 con 0x7f93d0102a60 2024-09-21T00:54:58.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.358+0000 7f93c37fe640 1 --2- 172.21.15.1:0/3820656124 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f93bc0b6510 0x7f93bc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:58.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.358+0000 7f93d59ab640 1 --2- 172.21.15.1:0/3820656124 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f93bc0b6510 0x7f93bc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:58.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.358+0000 7f93c37fe640 1 -- 172.21.15.1:0/3820656124 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7879+0+0 (secure 0 0 0) 0x7f93c4107d30 con 0x7f93d0102a60 2024-09-21T00:54:58.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.358+0000 7f93d59ab640 1 --2- 172.21.15.1:0/3820656124 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f93bc0b6510 0x7f93bc0b8a20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f93d0100cc0 tx=0x7f93cc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:58.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.361+0000 7f93c37fe640 1 -- 172.21.15.1:0/3820656124 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f93c40ce6d0 con 0x7f93d0102a60 2024-09-21T00:54:58.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.591+0000 7f93d8410640 1 -- 172.21.15.1:0/3820656124 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f93d019a4e0 con 0x7f93d0102a60 2024-09-21T00:54:58.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.856+0000 7f93c37fe640 1 -- 172.21.15.1:0/3820656124 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f93c40d2ab0 con 0x7f93d0102a60 2024-09-21T00:54:58.857 INFO:teuthology.orchestra.run.smithi001.stderr:new fs with metadata pool 2 and data pool 3 2024-09-21T00:54:58.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.859+0000 7f93d8410640 1 -- 172.21.15.1:0/3820656124 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f93bc0b6510 msgr2=0x7f93bc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:58.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.859+0000 7f93d8410640 1 --2- 172.21.15.1:0/3820656124 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f93bc0b6510 0x7f93bc0b8a20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f93d0100cc0 tx=0x7f93cc00b390 comp rx=0 tx=0).stop 2024-09-21T00:54:58.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.859+0000 7f93d8410640 1 -- 172.21.15.1:0/3820656124 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93d0102a60 msgr2=0x7f93d01993b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:58.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.859+0000 7f93d8410640 1 --2- 172.21.15.1:0/3820656124 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93d0102a60 0x7f93d01993b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f93c4005940 tx=0x7f93c40042f0 comp rx=0 tx=0).stop 2024-09-21T00:54:58.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.859+0000 7f93d8410640 1 -- 172.21.15.1:0/3820656124 shutdown_connections 2024-09-21T00:54:58.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.859+0000 7f93d8410640 1 --2- 172.21.15.1:0/3820656124 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f93d0108cf0 0x7f93d019ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:58.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.859+0000 7f93d8410640 1 --2- 172.21.15.1:0/3820656124 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93d01083a0 0x7f93d0199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:58.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.859+0000 7f93d8410640 1 --2- 172.21.15.1:0/3820656124 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f93bc0b6510 0x7f93bc0b8a20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:58.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.859+0000 7f93d8410640 1 --2- 172.21.15.1:0/3820656124 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93d0102a60 0x7f93d01993b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:58.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.859+0000 7f93d8410640 1 -- 172.21.15.1:0/3820656124 >> 172.21.15.1:0/3820656124 conn(0x7f93d0079730 msgr2=0x7f93d0101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:58.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.859+0000 7f93d8410640 1 -- 172.21.15.1:0/3820656124 shutdown_connections 2024-09-21T00:54:58.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:54:58.859+0000 7f93d8410640 1 -- 172.21.15.1:0/3820656124 wait complete. 2024-09-21T00:54:59.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:58 smithi001 ceph-mon[31211]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T00:54:59.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:58 smithi001 ceph-mon[31211]: pgmap v288: 97 pgs: 23 creating+peering, 17 active+clean, 57 unknown; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:59.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:58 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/3820656124' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T00:54:59.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:58 smithi001 ceph-mon[31211]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T00:54:59.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:58 smithi193 ceph-mon[34660]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T00:54:59.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:58 smithi193 ceph-mon[34660]: pgmap v288: 97 pgs: 23 creating+peering, 17 active+clean, 57 unknown; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:59.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:58 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/3820656124' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T00:54:59.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:58 smithi193 ceph-mon[34660]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T00:54:59.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:58 smithi042 ceph-mon[34481]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T00:54:59.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:58 smithi042 ceph-mon[34481]: pgmap v288: 97 pgs: 23 creating+peering, 17 active+clean, 57 unknown; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:54:59.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:58 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/3820656124' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T00:54:59.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:58 smithi042 ceph-mon[34481]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T00:54:59.565 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T00:54:59.828 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:00.115 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:59 smithi001 ceph-mon[31211]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T00:55:00.115 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:59 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/3820656124' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T00:55:00.115 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:59 smithi001 ceph-mon[31211]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T00:55:00.115 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:59 smithi001 ceph-mon[31211]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T00:55:00.115 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:59 smithi001 ceph-mon[31211]: mds.? [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] up:active 2024-09-21T00:55:00.115 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:54:59 smithi001 ceph-mon[31211]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T00:55:00.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:59 smithi193 ceph-mon[34660]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T00:55:00.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:59 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/3820656124' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T00:55:00.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:59 smithi193 ceph-mon[34660]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T00:55:00.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:59 smithi193 ceph-mon[34660]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T00:55:00.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:59 smithi193 ceph-mon[34660]: mds.? [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] up:active 2024-09-21T00:55:00.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:54:59 smithi193 ceph-mon[34660]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T00:55:00.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:59 smithi042 ceph-mon[34481]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T00:55:00.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:59 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/3820656124' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T00:55:00.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:59 smithi042 ceph-mon[34481]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T00:55:00.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:59 smithi042 ceph-mon[34481]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T00:55:00.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:59 smithi042 ceph-mon[34481]: mds.? [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] up:active 2024-09-21T00:55:00.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:54:59 smithi042 ceph-mon[34481]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T00:55:00.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.301+0000 7f6663296640 1 -- 172.21.15.1:0/3828138614 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f665c105380 msgr2=0x7f665c10d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:00.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.301+0000 7f6663296640 1 --2- 172.21.15.1:0/3828138614 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f665c105380 0x7f665c10d8d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f664c009900 tx=0x7f664c02a410 comp rx=0 tx=0).stop 2024-09-21T00:55:00.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.301+0000 7f6663296640 1 -- 172.21.15.1:0/3828138614 shutdown_connections 2024-09-21T00:55:00.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.301+0000 7f6663296640 1 --2- 172.21.15.1:0/3828138614 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f665c10de60 0x7f665c110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:00.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.301+0000 7f6663296640 1 --2- 172.21.15.1:0/3828138614 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f665c105380 0x7f665c10d8d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:00.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.301+0000 7f6663296640 1 --2- 172.21.15.1:0/3828138614 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f665c104a30 0x7f665c104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:00.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.301+0000 7f6663296640 1 -- 172.21.15.1:0/3828138614 >> 172.21.15.1:0/3828138614 conn(0x7f665c079760 msgr2=0x7f665c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:00.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.301+0000 7f6663296640 1 -- 172.21.15.1:0/3828138614 shutdown_connections 2024-09-21T00:55:00.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.301+0000 7f6663296640 1 -- 172.21.15.1:0/3828138614 wait complete. 2024-09-21T00:55:00.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.301+0000 7f6663296640 1 Processor -- start 2024-09-21T00:55:00.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.302+0000 7f6663296640 1 -- start start 2024-09-21T00:55:00.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.302+0000 7f6663296640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f665c104a30 0x7f665c19a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:00.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.302+0000 7f6663296640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f665c105380 0x7f665c19aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:00.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.302+0000 7f6663296640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f665c10de60 0x7f665c19fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:00.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.302+0000 7f6663296640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f665c113aa0 con 0x7f665c104a30 2024-09-21T00:55:00.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.302+0000 7f6663296640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f665c113920 con 0x7f665c105380 2024-09-21T00:55:00.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.302+0000 7f6663296640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f665c113c20 con 0x7f665c10de60 2024-09-21T00:55:00.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.302+0000 7f6661032640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f665c104a30 0x7f665c19a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:00.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.302+0000 7f6661032640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f665c104a30 0x7f665c19a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35992/0 (socket says 172.21.15.1:35992) 2024-09-21T00:55:00.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.302+0000 7f6661032640 1 -- 172.21.15.1:0/2605603580 learned_addr learned my addr 172.21.15.1:0/2605603580 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:00.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.302+0000 7f6660831640 1 --2- 172.21.15.1:0/2605603580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f665c105380 0x7f665c19aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:00.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.302+0000 7f6661833640 1 --2- 172.21.15.1:0/2605603580 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f665c10de60 0x7f665c19fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:00.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.302+0000 7f6661032640 1 -- 172.21.15.1:0/2605603580 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f665c10de60 msgr2=0x7f665c19fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:00.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.302+0000 7f6661032640 1 --2- 172.21.15.1:0/2605603580 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f665c10de60 0x7f665c19fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:00.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.302+0000 7f6661032640 1 -- 172.21.15.1:0/2605603580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f665c105380 msgr2=0x7f665c19aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:00.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.302+0000 7f6661032640 1 --2- 172.21.15.1:0/2605603580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f665c105380 0x7f665c19aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:00.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.302+0000 7f6661032640 1 -- 172.21.15.1:0/2605603580 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f665c1a0440 con 0x7f665c104a30 2024-09-21T00:55:00.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.302+0000 7f6661032640 1 --2- 172.21.15.1:0/2605603580 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f665c104a30 0x7f665c19a4d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f665800d770 tx=0x7f665800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:00.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.303+0000 7f66527fc640 1 -- 172.21.15.1:0/2605603580 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6658017070 con 0x7f665c104a30 2024-09-21T00:55:00.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.303+0000 7f66527fc640 1 -- 172.21.15.1:0/2605603580 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6658009c30 con 0x7f665c104a30 2024-09-21T00:55:00.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.303+0000 7f66527fc640 1 -- 172.21.15.1:0/2605603580 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6658003cc0 con 0x7f665c104a30 2024-09-21T00:55:00.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.303+0000 7f6663296640 1 -- 172.21.15.1:0/2605603580 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f665c1a0730 con 0x7f665c104a30 2024-09-21T00:55:00.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.303+0000 7f6663296640 1 -- 172.21.15.1:0/2605603580 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f665c1a6e90 con 0x7f665c104a30 2024-09-21T00:55:00.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.304+0000 7f6663296640 1 -- 172.21.15.1:0/2605603580 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f665c06c1f0 con 0x7f665c104a30 2024-09-21T00:55:00.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.305+0000 7f66527fc640 1 -- 172.21.15.1:0/2605603580 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 154511+0+0 (secure 0 0 0) 0x7f6658003e60 con 0x7f665c104a30 2024-09-21T00:55:00.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.306+0000 7f66527fc640 1 --2- 172.21.15.1:0/2605603580 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f66480b6590 0x7f66480b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:00.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.306+0000 7f6660831640 1 --2- 172.21.15.1:0/2605603580 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f66480b6590 0x7f66480b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:00.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.306+0000 7f66527fc640 1 -- 172.21.15.1:0/2605603580 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f66580e6ed0 con 0x7f665c104a30 2024-09-21T00:55:00.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.307+0000 7f6660831640 1 --2- 172.21.15.1:0/2605603580 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f66480b6590 0x7f66480b8aa0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f664c009230 tx=0x7f664c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:00.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.309+0000 7f66527fc640 1 -- 172.21.15.1:0/2605603580 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6658009de0 con 0x7f665c104a30 2024-09-21T00:55:00.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.498+0000 7f6663296640 1 -- 172.21.15.1:0/2605603580 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f665c104e40 con 0x7f665c104a30 2024-09-21T00:55:00.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.500+0000 7f66527fc640 1 -- 172.21.15.1:0/2605603580 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+22193 (secure 0 0 0) 0x7f66580ad930 con 0x7f665c104a30 2024-09-21T00:55:00.500 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:55:00.501 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":73,"fsid":"d3972c20-77b2-11ef-baf5-efdc52797490","created":"2024-09-21T00:46:29.745963+0000","modified":"2024-09-21T00:54:58.592898+0000","last_up_change":"2024-09-21T00:54:07.552837+0000","last_in_change":"2024-09-21T00:53:44.164415+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:50:16.456462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:54:54.305306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:54:56.506872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5bf09a34-4d6e-401c-8cef-29bbe72de68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6803","nonce":4067586847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6805","nonce":4067586847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6809","nonce":4067586847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6807","nonce":4067586847}]},"public_addr":"172.21.15.1:6803/4067586847","cluster_addr":"172.21.15.1:6805/4067586847","heartbeat_back_addr":"172.21.15.1:6809/4067586847","heartbeat_front_addr":"172.21.15.1:6807/4067586847","state":["exists","up"]},{"osd":1,"uuid":"195f9109-ef61-46be-a59a-d72e3a1b5b45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6801","nonce":436964633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6803","nonce":436964633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6807","nonce":436964633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6805","nonce":436964633}]},"public_addr":"172.21.15.42:6801/436964633","cluster_addr":"172.21.15.42:6803/436964633","heartbeat_back_addr":"172.21.15.42:6807/436964633","heartbeat_front_addr":"172.21.15.42:6805/436964633","state":["exists","up"]},{"osd":2,"uuid":"47cf90a7-6db6-464a-84ef-9f509f89a46b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6801","nonce":3495400570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6803","nonce":3495400570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6807","nonce":3495400570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6805","nonce":3495400570}]},"public_addr":"172.21.15.193:6801/3495400570","cluster_addr":"172.21.15.193:6803/3495400570","heartbeat_back_addr":"172.21.15.193:6807/3495400570","heartbeat_front_addr":"172.21.15.193:6805/3495400570","state":["exists","up"]},{"osd":3,"uuid":"a5230a66-3c74-41a7-9353-5650780ed25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6811","nonce":3221661671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6813","nonce":3221661671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6817","nonce":3221661671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6815","nonce":3221661671}]},"public_addr":"172.21.15.1:6811/3221661671","cluster_addr":"172.21.15.1:6813/3221661671","heartbeat_back_addr":"172.21.15.1:6817/3221661671","heartbeat_front_addr":"172.21.15.1:6815/3221661671","state":["exists","up"]},{"osd":4,"uuid":"b0476b9b-3257-46d4-aff7-1f038286ed43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6809","nonce":2066388104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6811","nonce":2066388104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6815","nonce":2066388104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6813","nonce":2066388104}]},"public_addr":"172.21.15.42:6809/2066388104","cluster_addr":"172.21.15.42:6811/2066388104","heartbeat_back_addr":"172.21.15.42:6815/2066388104","heartbeat_front_addr":"172.21.15.42:6813/2066388104","state":["exists","up"]},{"osd":5,"uuid":"96701ced-a55a-4ad9-be62-7f102c00697d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6809","nonce":732336675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6811","nonce":732336675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6815","nonce":732336675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6813","nonce":732336675}]},"public_addr":"172.21.15.193:6809/732336675","cluster_addr":"172.21.15.193:6811/732336675","heartbeat_back_addr":"172.21.15.193:6815/732336675","heartbeat_front_addr":"172.21.15.193:6813/732336675","state":["exists","up"]},{"osd":6,"uuid":"72d76017-e2e3-4118-8316-2c5da01c87b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6819","nonce":3201517067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6821","nonce":3201517067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6825","nonce":3201517067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6823","nonce":3201517067}]},"public_addr":"172.21.15.1:6819/3201517067","cluster_addr":"172.21.15.1:6821/3201517067","heartbeat_back_addr":"172.21.15.1:6825/3201517067","heartbeat_front_addr":"172.21.15.1:6823/3201517067","state":["exists","up"]},{"osd":7,"uuid":"8b239f96-2455-41b6-a905-9ed92078b890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6817","nonce":2124927218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6819","nonce":2124927218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6823","nonce":2124927218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6821","nonce":2124927218}]},"public_addr":"172.21.15.42:6817/2124927218","cluster_addr":"172.21.15.42:6819/2124927218","heartbeat_back_addr":"172.21.15.42:6823/2124927218","heartbeat_front_addr":"172.21.15.42:6821/2124927218","state":["exists","up"]},{"osd":8,"uuid":"8cd93aeb-fe00-4291-9f72-171d01893819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6817","nonce":2277449259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6819","nonce":2277449259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6823","nonce":2277449259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6821","nonce":2277449259}]},"public_addr":"172.21.15.193:6817/2277449259","cluster_addr":"172.21.15.193:6819/2277449259","heartbeat_back_addr":"172.21.15.193:6823/2277449259","heartbeat_front_addr":"172.21.15.193:6821/2277449259","state":["exists","up"]},{"osd":9,"uuid":"9e03e00b-0015-4aa8-adce-0d3352d2ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6827","nonce":1369323215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6829","nonce":1369323215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6833","nonce":1369323215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6831","nonce":1369323215}]},"public_addr":"172.21.15.1:6827/1369323215","cluster_addr":"172.21.15.1:6829/1369323215","heartbeat_back_addr":"172.21.15.1:6833/1369323215","heartbeat_front_addr":"172.21.15.1:6831/1369323215","state":["exists","up"]},{"osd":10,"uuid":"de55a908-b049-4f40-865f-cfa2ae6e461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6825","nonce":3182218295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6827","nonce":3182218295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6831","nonce":3182218295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6829","nonce":3182218295}]},"public_addr":"172.21.15.42:6825/3182218295","cluster_addr":"172.21.15.42:6827/3182218295","heartbeat_back_addr":"172.21.15.42:6831/3182218295","heartbeat_front_addr":"172.21.15.42:6829/3182218295","state":["exists","up"]},{"osd":11,"uuid":"1cac0c39-77aa-460b-92a0-39ed89cd6ce4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6825","nonce":2368815522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6827","nonce":2368815522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6831","nonce":2368815522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6829","nonce":2368815522}]},"public_addr":"172.21.15.193:6825/2368815522","cluster_addr":"172.21.15.193:6827/2368815522","heartbeat_back_addr":"172.21.15.193:6831/2368815522","heartbeat_front_addr":"172.21.15.193:6829/2368815522","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:49:21.491443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:49:47.486846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:50:12.757383+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:50:39.127690+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:05.545277+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:30.617491+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:57.612088+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:24.001953+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:48.447388+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:14.620538+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:40.503576+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:54:05.668236+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6801/59685083":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/309615464":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/1722941514":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/1199175740":"2024-09-22T00:47:25.985486+0000","172.21.15.1:6800/59685083":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/2811453932":"2024-09-22T00:46:58.953779+0000","172.21.15.1:0/3748689057":"2024-09-22T00:46:58.953779+0000","172.21.15.1:0/265697975":"2024-09-22T00:46:58.953779+0000","172.21.15.1:6801/1968786311":"2024-09-22T00:46:58.953779+0000","172.21.15.1:6800/1968786311":"2024-09-22T00:46:58.953779+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:55:00.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.502+0000 7f6663296640 1 -- 172.21.15.1:0/2605603580 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f66480b6590 msgr2=0x7f66480b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:00.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.502+0000 7f6663296640 1 --2- 172.21.15.1:0/2605603580 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f66480b6590 0x7f66480b8aa0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f664c009230 tx=0x7f664c031400 comp rx=0 tx=0).stop 2024-09-21T00:55:00.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.502+0000 7f6663296640 1 -- 172.21.15.1:0/2605603580 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f665c104a30 msgr2=0x7f665c19a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:00.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.502+0000 7f6663296640 1 --2- 172.21.15.1:0/2605603580 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f665c104a30 0x7f665c19a4d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f665800d770 tx=0x7f665800dc30 comp rx=0 tx=0).stop 2024-09-21T00:55:00.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.502+0000 7f6663296640 1 -- 172.21.15.1:0/2605603580 shutdown_connections 2024-09-21T00:55:00.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.502+0000 7f6663296640 1 --2- 172.21.15.1:0/2605603580 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f665c10de60 0x7f665c19fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:00.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.502+0000 7f6663296640 1 --2- 172.21.15.1:0/2605603580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f665c105380 0x7f665c19aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:00.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.502+0000 7f6663296640 1 --2- 172.21.15.1:0/2605603580 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f66480b6590 0x7f66480b8aa0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:00.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.502+0000 7f6663296640 1 --2- 172.21.15.1:0/2605603580 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f665c104a30 0x7f665c19a4d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:00.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.502+0000 7f6663296640 1 -- 172.21.15.1:0/2605603580 >> 172.21.15.1:0/2605603580 conn(0x7f665c079760 msgr2=0x7f665c1008b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:00.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.502+0000 7f6663296640 1 -- 172.21.15.1:0/2605603580 shutdown_connections 2024-09-21T00:55:00.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:00.502+0000 7f6663296640 1 -- 172.21.15.1:0/2605603580 wait complete. 2024-09-21T00:55:01.181 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:00 smithi001 ceph-mon[31211]: pgmap v290: 97 pgs: 23 creating+peering, 44 active+clean, 30 unknown; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:55:01.181 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:00 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/2605603580' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:55:01.210 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T00:55:01.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:00 smithi193 ceph-mon[34660]: pgmap v290: 97 pgs: 23 creating+peering, 44 active+clean, 30 unknown; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:55:01.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:00 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/2605603580' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:55:01.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:00 smithi042 ceph-mon[34481]: pgmap v290: 97 pgs: 23 creating+peering, 44 active+clean, 30 unknown; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:55:01.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:00 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/2605603580' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:55:01.466 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:01.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.977+0000 7f8715a07640 1 -- 172.21.15.1:0/2659374114 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8710102a60 msgr2=0x7f8710102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:01.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.977+0000 7f8715a07640 1 --2- 172.21.15.1:0/2659374114 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8710102a60 0x7f8710102e70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8700009ca0 tx=0x7f870002a8c0 comp rx=0 tx=0).stop 2024-09-21T00:55:01.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.977+0000 7f8715a07640 1 -- 172.21.15.1:0/2659374114 shutdown_connections 2024-09-21T00:55:01.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.977+0000 7f8715a07640 1 --2- 172.21.15.1:0/2659374114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8710108cf0 0x7f871010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:01.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.977+0000 7f8715a07640 1 --2- 172.21.15.1:0/2659374114 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87101083a0 0x7f87101087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:01.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.977+0000 7f8715a07640 1 --2- 172.21.15.1:0/2659374114 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8710102a60 0x7f8710102e70 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:01.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.977+0000 7f8715a07640 1 -- 172.21.15.1:0/2659374114 >> 172.21.15.1:0/2659374114 conn(0x7f8710079730 msgr2=0x7f8710079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:01.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.977+0000 7f8715a07640 1 -- 172.21.15.1:0/2659374114 shutdown_connections 2024-09-21T00:55:01.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.977+0000 7f8715a07640 1 -- 172.21.15.1:0/2659374114 wait complete. 2024-09-21T00:55:01.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.977+0000 7f8715a07640 1 Processor -- start 2024-09-21T00:55:01.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.978+0000 7f8715a07640 1 -- start start 2024-09-21T00:55:01.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.978+0000 7f8715a07640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8710102a60 0x7f8710104250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:01.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.978+0000 7f8715a07640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87101083a0 0x7f8710104790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:01.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.978+0000 7f8715a07640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8710108cf0 0x7f8710104cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:01.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.978+0000 7f8715a07640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8710112960 con 0x7f8710102a60 2024-09-21T00:55:01.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.978+0000 7f8715a07640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f87101127e0 con 0x7f8710108cf0 2024-09-21T00:55:01.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.978+0000 7f8715a07640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8710112ae0 con 0x7f87101083a0 2024-09-21T00:55:01.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.978+0000 7f870effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8710102a60 0x7f8710104250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:01.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.978+0000 7f870effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8710102a60 0x7f8710104250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36006/0 (socket says 172.21.15.1:36006) 2024-09-21T00:55:01.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.978+0000 7f870effd640 1 -- 172.21.15.1:0/4202332949 learned_addr learned my addr 172.21.15.1:0/4202332949 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:01.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.978+0000 7f870f7fe640 1 --2- 172.21.15.1:0/4202332949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8710108cf0 0x7f8710104cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:01.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.978+0000 7f870e7fc640 1 --2- 172.21.15.1:0/4202332949 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87101083a0 0x7f8710104790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:01.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.978+0000 7f870effd640 1 -- 172.21.15.1:0/4202332949 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87101083a0 msgr2=0x7f8710104790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:01.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.978+0000 7f870effd640 1 --2- 172.21.15.1:0/4202332949 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87101083a0 0x7f8710104790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:01.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.978+0000 7f870effd640 1 -- 172.21.15.1:0/4202332949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8710108cf0 msgr2=0x7f8710104cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:01.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.978+0000 7f870effd640 1 --2- 172.21.15.1:0/4202332949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8710108cf0 0x7f8710104cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:01.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.978+0000 7f870effd640 1 -- 172.21.15.1:0/4202332949 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87101a8630 con 0x7f8710102a60 2024-09-21T00:55:01.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.978+0000 7f870e7fc640 1 --2- 172.21.15.1:0/4202332949 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87101083a0 0x7f8710104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:55:01.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.979+0000 7f870effd640 1 --2- 172.21.15.1:0/4202332949 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8710102a60 0x7f8710104250 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8700006010 tx=0x7f87000319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:01.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.979+0000 7f8714a05640 1 -- 172.21.15.1:0/4202332949 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8700003bf0 con 0x7f8710102a60 2024-09-21T00:55:01.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.979+0000 7f8715a07640 1 -- 172.21.15.1:0/4202332949 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87101a88c0 con 0x7f8710102a60 2024-09-21T00:55:01.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.979+0000 7f8714a05640 1 -- 172.21.15.1:0/4202332949 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8700003d90 con 0x7f8710102a60 2024-09-21T00:55:01.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.979+0000 7f8714a05640 1 -- 172.21.15.1:0/4202332949 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870002fc20 con 0x7f8710102a60 2024-09-21T00:55:01.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.979+0000 7f8715a07640 1 -- 172.21.15.1:0/4202332949 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87101a8e50 con 0x7f8710102a60 2024-09-21T00:55:01.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.980+0000 7f8715a07640 1 -- 172.21.15.1:0/4202332949 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8710102e70 con 0x7f8710102a60 2024-09-21T00:55:01.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.982+0000 7f8714a05640 1 -- 172.21.15.1:0/4202332949 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 154511+0+0 (secure 0 0 0) 0x7f87000046a0 con 0x7f8710102a60 2024-09-21T00:55:01.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.982+0000 7f8714a05640 1 --2- 172.21.15.1:0/4202332949 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f86fc0b6510 0x7f86fc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:01.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.982+0000 7f870e7fc640 1 --2- 172.21.15.1:0/4202332949 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f86fc0b6510 0x7f86fc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:01.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.983+0000 7f8714a05640 1 -- 172.21.15.1:0/4202332949 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f8700108690 con 0x7f8710102a60 2024-09-21T00:55:01.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.983+0000 7f870e7fc640 1 --2- 172.21.15.1:0/4202332949 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f86fc0b6510 0x7f86fc0b8a20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8710100e00 tx=0x7f86f800a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:01.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:01.986+0000 7f8714a05640 1 -- 172.21.15.1:0/4202332949 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f87000cf070 con 0x7f8710102a60 2024-09-21T00:55:02.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:02.176+0000 7f8715a07640 1 -- 172.21.15.1:0/4202332949 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f87101a9220 con 0x7f8710102a60 2024-09-21T00:55:02.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:02.178+0000 7f8714a05640 1 -- 172.21.15.1:0/4202332949 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+22193 (secure 0 0 0) 0x7f87000d3450 con 0x7f8710102a60 2024-09-21T00:55:02.179 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:55:02.179 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":73,"fsid":"d3972c20-77b2-11ef-baf5-efdc52797490","created":"2024-09-21T00:46:29.745963+0000","modified":"2024-09-21T00:54:58.592898+0000","last_up_change":"2024-09-21T00:54:07.552837+0000","last_in_change":"2024-09-21T00:53:44.164415+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:50:16.456462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:54:54.305306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:54:56.506872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5bf09a34-4d6e-401c-8cef-29bbe72de68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6803","nonce":4067586847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6805","nonce":4067586847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6809","nonce":4067586847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6807","nonce":4067586847}]},"public_addr":"172.21.15.1:6803/4067586847","cluster_addr":"172.21.15.1:6805/4067586847","heartbeat_back_addr":"172.21.15.1:6809/4067586847","heartbeat_front_addr":"172.21.15.1:6807/4067586847","state":["exists","up"]},{"osd":1,"uuid":"195f9109-ef61-46be-a59a-d72e3a1b5b45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6801","nonce":436964633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6803","nonce":436964633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6807","nonce":436964633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6805","nonce":436964633}]},"public_addr":"172.21.15.42:6801/436964633","cluster_addr":"172.21.15.42:6803/436964633","heartbeat_back_addr":"172.21.15.42:6807/436964633","heartbeat_front_addr":"172.21.15.42:6805/436964633","state":["exists","up"]},{"osd":2,"uuid":"47cf90a7-6db6-464a-84ef-9f509f89a46b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6801","nonce":3495400570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6803","nonce":3495400570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6807","nonce":3495400570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6805","nonce":3495400570}]},"public_addr":"172.21.15.193:6801/3495400570","cluster_addr":"172.21.15.193:6803/3495400570","heartbeat_back_addr":"172.21.15.193:6807/3495400570","heartbeat_front_addr":"172.21.15.193:6805/3495400570","state":["exists","up"]},{"osd":3,"uuid":"a5230a66-3c74-41a7-9353-5650780ed25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6811","nonce":3221661671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6813","nonce":3221661671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6817","nonce":3221661671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6815","nonce":3221661671}]},"public_addr":"172.21.15.1:6811/3221661671","cluster_addr":"172.21.15.1:6813/3221661671","heartbeat_back_addr":"172.21.15.1:6817/3221661671","heartbeat_front_addr":"172.21.15.1:6815/3221661671","state":["exists","up"]},{"osd":4,"uuid":"b0476b9b-3257-46d4-aff7-1f038286ed43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6809","nonce":2066388104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6811","nonce":2066388104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6815","nonce":2066388104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6813","nonce":2066388104}]},"public_addr":"172.21.15.42:6809/2066388104","cluster_addr":"172.21.15.42:6811/2066388104","heartbeat_back_addr":"172.21.15.42:6815/2066388104","heartbeat_front_addr":"172.21.15.42:6813/2066388104","state":["exists","up"]},{"osd":5,"uuid":"96701ced-a55a-4ad9-be62-7f102c00697d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6809","nonce":732336675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6811","nonce":732336675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6815","nonce":732336675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6813","nonce":732336675}]},"public_addr":"172.21.15.193:6809/732336675","cluster_addr":"172.21.15.193:6811/732336675","heartbeat_back_addr":"172.21.15.193:6815/732336675","heartbeat_front_addr":"172.21.15.193:6813/732336675","state":["exists","up"]},{"osd":6,"uuid":"72d76017-e2e3-4118-8316-2c5da01c87b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6819","nonce":3201517067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6821","nonce":3201517067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6825","nonce":3201517067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6823","nonce":3201517067}]},"public_addr":"172.21.15.1:6819/3201517067","cluster_addr":"172.21.15.1:6821/3201517067","heartbeat_back_addr":"172.21.15.1:6825/3201517067","heartbeat_front_addr":"172.21.15.1:6823/3201517067","state":["exists","up"]},{"osd":7,"uuid":"8b239f96-2455-41b6-a905-9ed92078b890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6817","nonce":2124927218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6819","nonce":2124927218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6823","nonce":2124927218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6821","nonce":2124927218}]},"public_addr":"172.21.15.42:6817/2124927218","cluster_addr":"172.21.15.42:6819/2124927218","heartbeat_back_addr":"172.21.15.42:6823/2124927218","heartbeat_front_addr":"172.21.15.42:6821/2124927218","state":["exists","up"]},{"osd":8,"uuid":"8cd93aeb-fe00-4291-9f72-171d01893819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6817","nonce":2277449259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6819","nonce":2277449259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6823","nonce":2277449259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6821","nonce":2277449259}]},"public_addr":"172.21.15.193:6817/2277449259","cluster_addr":"172.21.15.193:6819/2277449259","heartbeat_back_addr":"172.21.15.193:6823/2277449259","heartbeat_front_addr":"172.21.15.193:6821/2277449259","state":["exists","up"]},{"osd":9,"uuid":"9e03e00b-0015-4aa8-adce-0d3352d2ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6827","nonce":1369323215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6829","nonce":1369323215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6833","nonce":1369323215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6831","nonce":1369323215}]},"public_addr":"172.21.15.1:6827/1369323215","cluster_addr":"172.21.15.1:6829/1369323215","heartbeat_back_addr":"172.21.15.1:6833/1369323215","heartbeat_front_addr":"172.21.15.1:6831/1369323215","state":["exists","up"]},{"osd":10,"uuid":"de55a908-b049-4f40-865f-cfa2ae6e461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6825","nonce":3182218295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6827","nonce":3182218295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6831","nonce":3182218295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6829","nonce":3182218295}]},"public_addr":"172.21.15.42:6825/3182218295","cluster_addr":"172.21.15.42:6827/3182218295","heartbeat_back_addr":"172.21.15.42:6831/3182218295","heartbeat_front_addr":"172.21.15.42:6829/3182218295","state":["exists","up"]},{"osd":11,"uuid":"1cac0c39-77aa-460b-92a0-39ed89cd6ce4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6825","nonce":2368815522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6827","nonce":2368815522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6831","nonce":2368815522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6829","nonce":2368815522}]},"public_addr":"172.21.15.193:6825/2368815522","cluster_addr":"172.21.15.193:6827/2368815522","heartbeat_back_addr":"172.21.15.193:6831/2368815522","heartbeat_front_addr":"172.21.15.193:6829/2368815522","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:49:21.491443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:49:47.486846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:50:12.757383+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:50:39.127690+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:05.545277+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:30.617491+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:57.612088+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:24.001953+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:48.447388+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:14.620538+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:40.503576+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:54:05.668236+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6801/59685083":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/309615464":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/1722941514":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/1199175740":"2024-09-22T00:47:25.985486+0000","172.21.15.1:6800/59685083":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/2811453932":"2024-09-22T00:46:58.953779+0000","172.21.15.1:0/3748689057":"2024-09-22T00:46:58.953779+0000","172.21.15.1:0/265697975":"2024-09-22T00:46:58.953779+0000","172.21.15.1:6801/1968786311":"2024-09-22T00:46:58.953779+0000","172.21.15.1:6800/1968786311":"2024-09-22T00:46:58.953779+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:55:02.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:02.181+0000 7f8715a07640 1 -- 172.21.15.1:0/4202332949 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f86fc0b6510 msgr2=0x7f86fc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:02.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:02.181+0000 7f8715a07640 1 --2- 172.21.15.1:0/4202332949 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f86fc0b6510 0x7f86fc0b8a20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8710100e00 tx=0x7f86f800a5c0 comp rx=0 tx=0).stop 2024-09-21T00:55:02.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:02.181+0000 7f8715a07640 1 -- 172.21.15.1:0/4202332949 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8710102a60 msgr2=0x7f8710104250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:02.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:02.181+0000 7f8715a07640 1 --2- 172.21.15.1:0/4202332949 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8710102a60 0x7f8710104250 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8700006010 tx=0x7f87000319f0 comp rx=0 tx=0).stop 2024-09-21T00:55:02.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:02.181+0000 7f8715a07640 1 -- 172.21.15.1:0/4202332949 shutdown_connections 2024-09-21T00:55:02.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:02.181+0000 7f8715a07640 1 --2- 172.21.15.1:0/4202332949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8710108cf0 0x7f8710104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:02.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:02.181+0000 7f8715a07640 1 --2- 172.21.15.1:0/4202332949 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87101083a0 0x7f8710104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:02.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:02.181+0000 7f8715a07640 1 --2- 172.21.15.1:0/4202332949 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f86fc0b6510 0x7f86fc0b8a20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:02.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:02.181+0000 7f8715a07640 1 --2- 172.21.15.1:0/4202332949 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8710102a60 0x7f8710104250 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:02.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:02.181+0000 7f8715a07640 1 -- 172.21.15.1:0/4202332949 >> 172.21.15.1:0/4202332949 conn(0x7f8710079730 msgr2=0x7f8710101970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:02.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:02.181+0000 7f8715a07640 1 -- 172.21.15.1:0/4202332949 shutdown_connections 2024-09-21T00:55:02.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:02.181+0000 7f8715a07640 1 -- 172.21.15.1:0/4202332949 wait complete. 2024-09-21T00:55:02.821 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs set cephfs standby_count_wanted 0 2024-09-21T00:55:03.090 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:03.235 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:03 smithi001 ceph-mon[31211]: pgmap v291: 97 pgs: 13 creating+peering, 84 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 5 op/s 2024-09-21T00:55:03.235 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:03 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/4202332949' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:55:03.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:03 smithi193 ceph-mon[34660]: pgmap v291: 97 pgs: 13 creating+peering, 84 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 5 op/s 2024-09-21T00:55:03.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:03 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/4202332949' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:55:03.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:03 smithi042 ceph-mon[34481]: pgmap v291: 97 pgs: 13 creating+peering, 84 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 5 op/s 2024-09-21T00:55:03.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:03 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/4202332949' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:55:03.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.610+0000 7fef878c9640 1 -- 172.21.15.1:0/4134036691 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef801083a0 msgr2=0x7fef801087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:03.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.610+0000 7fef878c9640 1 --2- 172.21.15.1:0/4134036691 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef801083a0 0x7fef801087b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fef74009ca0 tx=0x7fef7402a8c0 comp rx=0 tx=0).stop 2024-09-21T00:55:03.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.610+0000 7fef878c9640 1 -- 172.21.15.1:0/4134036691 shutdown_connections 2024-09-21T00:55:03.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.610+0000 7fef878c9640 1 --2- 172.21.15.1:0/4134036691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef80108cf0 0x7fef8010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:03.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.610+0000 7fef878c9640 1 --2- 172.21.15.1:0/4134036691 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef801083a0 0x7fef801087b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:03.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.610+0000 7fef878c9640 1 --2- 172.21.15.1:0/4134036691 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef80102a60 0x7fef80102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:03.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.610+0000 7fef878c9640 1 -- 172.21.15.1:0/4134036691 >> 172.21.15.1:0/4134036691 conn(0x7fef80079730 msgr2=0x7fef80079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:03.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.610+0000 7fef878c9640 1 -- 172.21.15.1:0/4134036691 shutdown_connections 2024-09-21T00:55:03.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.610+0000 7fef878c9640 1 -- 172.21.15.1:0/4134036691 wait complete. 2024-09-21T00:55:03.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.611+0000 7fef878c9640 1 Processor -- start 2024-09-21T00:55:03.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.611+0000 7fef878c9640 1 -- start start 2024-09-21T00:55:03.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.611+0000 7fef878c9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef80102a60 0x7fef8019a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:03.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.611+0000 7fef878c9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef801083a0 0x7fef8019aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:03.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.611+0000 7fef878c9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef80108cf0 0x7fef8019fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:03.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.611+0000 7fef878c9640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fef801129a0 con 0x7fef80102a60 2024-09-21T00:55:03.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.611+0000 7fef878c9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fef80112820 con 0x7fef80108cf0 2024-09-21T00:55:03.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.611+0000 7fef878c9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fef80112b20 con 0x7fef801083a0 2024-09-21T00:55:03.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.611+0000 7fef85665640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef80102a60 0x7fef8019a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:03.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.611+0000 7fef85665640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef80102a60 0x7fef8019a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36014/0 (socket says 172.21.15.1:36014) 2024-09-21T00:55:03.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.611+0000 7fef85665640 1 -- 172.21.15.1:0/1770173868 learned_addr learned my addr 172.21.15.1:0/1770173868 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:03.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.611+0000 7fef84e64640 1 --2- 172.21.15.1:0/1770173868 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef801083a0 0x7fef8019aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:03.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.611+0000 7fef85e66640 1 --2- 172.21.15.1:0/1770173868 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef80108cf0 0x7fef8019fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:03.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.611+0000 7fef85665640 1 -- 172.21.15.1:0/1770173868 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef801083a0 msgr2=0x7fef8019aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:03.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.611+0000 7fef85665640 1 --2- 172.21.15.1:0/1770173868 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef801083a0 0x7fef8019aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:03.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.611+0000 7fef85665640 1 -- 172.21.15.1:0/1770173868 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef80108cf0 msgr2=0x7fef8019fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:03.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.611+0000 7fef85665640 1 --2- 172.21.15.1:0/1770173868 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef80108cf0 0x7fef8019fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:03.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.611+0000 7fef85665640 1 -- 172.21.15.1:0/1770173868 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef801a04b0 con 0x7fef80102a60 2024-09-21T00:55:03.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.612+0000 7fef85665640 1 --2- 172.21.15.1:0/1770173868 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef80102a60 0x7fef8019a540 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fef7800c890 tx=0x7fef7800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:03.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.612+0000 7fef7e7fc640 1 -- 172.21.15.1:0/1770173868 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef78004220 con 0x7fef80102a60 2024-09-21T00:55:03.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.612+0000 7fef7e7fc640 1 -- 172.21.15.1:0/1770173868 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef780043c0 con 0x7fef80102a60 2024-09-21T00:55:03.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.612+0000 7fef7e7fc640 1 -- 172.21.15.1:0/1770173868 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef78004a00 con 0x7fef80102a60 2024-09-21T00:55:03.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.612+0000 7fef878c9640 1 -- 172.21.15.1:0/1770173868 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef801a07a0 con 0x7fef80102a60 2024-09-21T00:55:03.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.612+0000 7fef878c9640 1 -- 172.21.15.1:0/1770173868 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef801a6f00 con 0x7fef80102a60 2024-09-21T00:55:03.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.613+0000 7fef878c9640 1 -- 172.21.15.1:0/1770173868 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef80102e70 con 0x7fef80102a60 2024-09-21T00:55:03.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.615+0000 7fef7e7fc640 1 -- 172.21.15.1:0/1770173868 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 154511+0+0 (secure 0 0 0) 0x7fef780079b0 con 0x7fef80102a60 2024-09-21T00:55:03.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.615+0000 7fef7e7fc640 1 --2- 172.21.15.1:0/1770173868 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fef680b6590 0x7fef680b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:03.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.616+0000 7fef84e64640 1 --2- 172.21.15.1:0/1770173868 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fef680b6590 0x7fef680b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:03.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.616+0000 7fef7e7fc640 1 -- 172.21.15.1:0/1770173868 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fef780e71f0 con 0x7fef80102a60 2024-09-21T00:55:03.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.616+0000 7fef84e64640 1 --2- 172.21.15.1:0/1770173868 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fef680b6590 0x7fef680b8aa0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fef740098d0 tx=0x7fef740093e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:03.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.619+0000 7fef7e7fc640 1 -- 172.21.15.1:0/1770173868 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fef78014030 con 0x7fef80102a60 2024-09-21T00:55:03.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:03.848+0000 7fef878c9640 1 -- 172.21.15.1:0/1770173868 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fef8010baf0 con 0x7fef80102a60 2024-09-21T00:55:03.992 INFO:journalctl@ceph.mds.b.smithi042.stdout:Sep 21 00:55:03 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-b[63452]: 2024-09-21T00:55:03.570+0000 7f5d222de640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T00:55:04.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:04.143+0000 7fef7e7fc640 1 -- 172.21.15.1:0/1770173868 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7fef780b2030 con 0x7fef80102a60 2024-09-21T00:55:04.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:04.145+0000 7fef878c9640 1 -- 172.21.15.1:0/1770173868 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fef680b6590 msgr2=0x7fef680b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:04.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:04.145+0000 7fef878c9640 1 --2- 172.21.15.1:0/1770173868 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fef680b6590 0x7fef680b8aa0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fef740098d0 tx=0x7fef740093e0 comp rx=0 tx=0).stop 2024-09-21T00:55:04.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:04.145+0000 7fef878c9640 1 -- 172.21.15.1:0/1770173868 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef80102a60 msgr2=0x7fef8019a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:04.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:04.145+0000 7fef878c9640 1 --2- 172.21.15.1:0/1770173868 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef80102a60 0x7fef8019a540 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fef7800c890 tx=0x7fef7800cd50 comp rx=0 tx=0).stop 2024-09-21T00:55:04.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:04.145+0000 7fef878c9640 1 -- 172.21.15.1:0/1770173868 shutdown_connections 2024-09-21T00:55:04.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:04.145+0000 7fef878c9640 1 --2- 172.21.15.1:0/1770173868 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef80108cf0 0x7fef8019fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:04.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:04.145+0000 7fef878c9640 1 --2- 172.21.15.1:0/1770173868 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef801083a0 0x7fef8019aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:04.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:04.145+0000 7fef878c9640 1 --2- 172.21.15.1:0/1770173868 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fef680b6590 0x7fef680b8aa0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:04.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:04.145+0000 7fef878c9640 1 --2- 172.21.15.1:0/1770173868 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef80102a60 0x7fef8019a540 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:04.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:04.145+0000 7fef878c9640 1 -- 172.21.15.1:0/1770173868 >> 172.21.15.1:0/1770173868 conn(0x7fef80079730 msgr2=0x7fef8006b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:04.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:04.145+0000 7fef878c9640 1 -- 172.21.15.1:0/1770173868 shutdown_connections 2024-09-21T00:55:04.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:04.145+0000 7fef878c9640 1 -- 172.21.15.1:0/1770173868 wait complete. 2024-09-21T00:55:04.448 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:04 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1770173868' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T00:55:04.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:04 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/1770173868' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T00:55:04.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:04 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/1770173868' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T00:55:04.807 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-21T00:55:04.807 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs set cephfs max_mds 5 2024-09-21T00:55:05.068 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:05.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:05 smithi001 ceph-mon[31211]: pgmap v292: 97 pgs: 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-21T00:55:05.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:05 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1770173868' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T00:55:05.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:05 smithi001 ceph-mon[31211]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T00:55:05.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:05 smithi193 ceph-mon[34660]: pgmap v292: 97 pgs: 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-21T00:55:05.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:05 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/1770173868' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T00:55:05.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:05 smithi193 ceph-mon[34660]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T00:55:05.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:05 smithi042 ceph-mon[34481]: pgmap v292: 97 pgs: 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-21T00:55:05.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:05 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/1770173868' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T00:55:05.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:05 smithi042 ceph-mon[34481]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T00:55:05.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.567+0000 7f2de676d640 1 -- 172.21.15.1:0/3969806284 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2de0102000 msgr2=0x7f2de0102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:05.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.567+0000 7f2de676d640 1 --2- 172.21.15.1:0/3969806284 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2de0102000 0x7f2de0102410 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0009900 tx=0x7f2dd002a410 comp rx=0 tx=0).stop 2024-09-21T00:55:05.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.567+0000 7f2de676d640 1 -- 172.21.15.1:0/3969806284 shutdown_connections 2024-09-21T00:55:05.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.567+0000 7f2de676d640 1 --2- 172.21.15.1:0/3969806284 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2de0106c30 0x7f2de0110680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:05.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.567+0000 7f2de676d640 1 --2- 172.21.15.1:0/3969806284 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2de01062e0 0x7f2de01066f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:05.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.567+0000 7f2de676d640 1 --2- 172.21.15.1:0/3969806284 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2de0102000 0x7f2de0102410 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:05.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.567+0000 7f2de676d640 1 -- 172.21.15.1:0/3969806284 >> 172.21.15.1:0/3969806284 conn(0x7f2de0079e40 msgr2=0x7f2de007a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:05.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.567+0000 7f2de676d640 1 -- 172.21.15.1:0/3969806284 shutdown_connections 2024-09-21T00:55:05.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.567+0000 7f2de676d640 1 -- 172.21.15.1:0/3969806284 wait complete. 2024-09-21T00:55:05.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.568+0000 7f2de676d640 1 Processor -- start 2024-09-21T00:55:05.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.568+0000 7f2de676d640 1 -- start start 2024-09-21T00:55:05.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.568+0000 7f2de676d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2de0102000 0x7f2de019a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:05.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.568+0000 7f2de676d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2de01062e0 0x7f2de019ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:05.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.568+0000 7f2de676d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2de0106c30 0x7f2de019fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:05.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.568+0000 7f2de676d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2de0113b30 con 0x7f2de0106c30 2024-09-21T00:55:05.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.568+0000 7f2de676d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2de01139b0 con 0x7f2de0102000 2024-09-21T00:55:05.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.568+0000 7f2de676d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2de0113cb0 con 0x7f2de01062e0 2024-09-21T00:55:05.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.568+0000 7f2de4d0a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2de0106c30 0x7f2de019fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:05.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.569+0000 7f2de4d0a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2de0106c30 0x7f2de019fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36040/0 (socket says 172.21.15.1:36040) 2024-09-21T00:55:05.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.569+0000 7f2de4d0a640 1 -- 172.21.15.1:0/2065941630 learned_addr learned my addr 172.21.15.1:0/2065941630 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:05.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.569+0000 7f2ddf7fe640 1 --2- 172.21.15.1:0/2065941630 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2de01062e0 0x7f2de019ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:05.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.569+0000 7f2ddffff640 1 --2- 172.21.15.1:0/2065941630 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2de0102000 0x7f2de019a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:05.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.569+0000 7f2de4d0a640 1 -- 172.21.15.1:0/2065941630 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2de01062e0 msgr2=0x7f2de019ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:05.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.569+0000 7f2de4d0a640 1 --2- 172.21.15.1:0/2065941630 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2de01062e0 0x7f2de019ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:05.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.569+0000 7f2de4d0a640 1 -- 172.21.15.1:0/2065941630 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2de0102000 msgr2=0x7f2de019a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:05.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.569+0000 7f2de4d0a640 1 --2- 172.21.15.1:0/2065941630 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2de0102000 0x7f2de019a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:05.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.569+0000 7f2de4d0a640 1 -- 172.21.15.1:0/2065941630 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de01a04d0 con 0x7f2de0106c30 2024-09-21T00:55:05.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.569+0000 7f2ddf7fe640 1 --2- 172.21.15.1:0/2065941630 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2de01062e0 0x7f2de019ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:55:05.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.569+0000 7f2ddffff640 1 --2- 172.21.15.1:0/2065941630 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2de0102000 0x7f2de019a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:55:05.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.569+0000 7f2de4d0a640 1 --2- 172.21.15.1:0/2065941630 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2de0106c30 0x7f2de019fda0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2dd800b970 tx=0x7f2dd800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:05.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.569+0000 7f2ddd7fa640 1 -- 172.21.15.1:0/2065941630 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8019070 con 0x7f2de0106c30 2024-09-21T00:55:05.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.569+0000 7f2ddd7fa640 1 -- 172.21.15.1:0/2065941630 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2dd8014440 con 0x7f2de0106c30 2024-09-21T00:55:05.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.569+0000 7f2de676d640 1 -- 172.21.15.1:0/2065941630 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2de01a07c0 con 0x7f2de0106c30 2024-09-21T00:55:05.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.569+0000 7f2ddd7fa640 1 -- 172.21.15.1:0/2065941630 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd80075d0 con 0x7f2de0106c30 2024-09-21T00:55:05.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.569+0000 7f2de676d640 1 -- 172.21.15.1:0/2065941630 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2de01a6f20 con 0x7f2de0106c30 2024-09-21T00:55:05.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.570+0000 7f2de676d640 1 -- 172.21.15.1:0/2065941630 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2de019b690 con 0x7f2de0106c30 2024-09-21T00:55:05.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.573+0000 7f2ddd7fa640 1 -- 172.21.15.1:0/2065941630 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 154511+0+0 (secure 0 0 0) 0x7f2dd801c070 con 0x7f2de0106c30 2024-09-21T00:55:05.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.574+0000 7f2ddd7fa640 1 --2- 172.21.15.1:0/2065941630 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f2dc80b6510 0x7f2dc80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:05.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.574+0000 7f2ddffff640 1 --2- 172.21.15.1:0/2065941630 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f2dc80b6510 0x7f2dc80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:05.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.574+0000 7f2ddd7fa640 1 -- 172.21.15.1:0/2065941630 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f2dd80e6bb0 con 0x7f2de0106c30 2024-09-21T00:55:05.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.574+0000 7f2ddffff640 1 --2- 172.21.15.1:0/2065941630 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f2dc80b6510 0x7f2dc80b8a20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0031440 tx=0x7f2dd0005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:05.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.577+0000 7f2ddd7fa640 1 -- 172.21.15.1:0/2065941630 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2dd80ad590 con 0x7f2de0106c30 2024-09-21T00:55:05.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:05.804+0000 7f2de676d640 1 -- 172.21.15.1:0/2065941630 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f2de006b990 con 0x7f2de0106c30 2024-09-21T00:55:06.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:06.152+0000 7f2ddd7fa640 1 -- 172.21.15.1:0/2065941630 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v17) ==== 105+0+0 (secure 0 0 0) 0x7f2dd80b1970 con 0x7f2de0106c30 2024-09-21T00:55:06.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:06.155+0000 7f2de676d640 1 -- 172.21.15.1:0/2065941630 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f2dc80b6510 msgr2=0x7f2dc80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:06.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:06.155+0000 7f2de676d640 1 --2- 172.21.15.1:0/2065941630 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f2dc80b6510 0x7f2dc80b8a20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0031440 tx=0x7f2dd0005d50 comp rx=0 tx=0).stop 2024-09-21T00:55:06.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:06.155+0000 7f2de676d640 1 -- 172.21.15.1:0/2065941630 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2de0106c30 msgr2=0x7f2de019fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:06.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:06.155+0000 7f2de676d640 1 --2- 172.21.15.1:0/2065941630 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2de0106c30 0x7f2de019fda0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2dd800b970 tx=0x7f2dd800be30 comp rx=0 tx=0).stop 2024-09-21T00:55:06.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:06.155+0000 7f2de676d640 1 -- 172.21.15.1:0/2065941630 shutdown_connections 2024-09-21T00:55:06.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:06.155+0000 7f2de676d640 1 --2- 172.21.15.1:0/2065941630 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f2dc80b6510 0x7f2dc80b8a20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:06.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:06.155+0000 7f2de676d640 1 --2- 172.21.15.1:0/2065941630 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2de0106c30 0x7f2de019fda0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:06.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:06.155+0000 7f2de676d640 1 --2- 172.21.15.1:0/2065941630 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2de01062e0 0x7f2de019ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:06.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:06.155+0000 7f2de676d640 1 --2- 172.21.15.1:0/2065941630 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2de0102000 0x7f2de019a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:06.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:06.155+0000 7f2de676d640 1 -- 172.21.15.1:0/2065941630 >> 172.21.15.1:0/2065941630 conn(0x7f2de0079e40 msgr2=0x7f2de0108050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:06.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:06.155+0000 7f2de676d640 1 -- 172.21.15.1:0/2065941630 shutdown_connections 2024-09-21T00:55:06.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:06.155+0000 7f2de676d640 1 -- 172.21.15.1:0/2065941630 wait complete. 2024-09-21T00:55:06.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:06 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/2065941630' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-09-21T00:55:06.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:06 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/2065941630' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-09-21T00:55:06.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:06 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/2065941630' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-09-21T00:55:06.899 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs set cephfs allow_standby_replay true 2024-09-21T00:55:07.166 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:07.420 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:07 smithi001 ceph-mon[31211]: pgmap v293: 97 pgs: 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T00:55:07.420 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:07 smithi001 ceph-mon[31211]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T00:55:07.420 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:07 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/2065941630' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-21T00:55:07.420 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:07 smithi001 ceph-mon[31211]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T00:55:07.420 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:07 smithi001 ceph-mon[31211]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T00:55:07.420 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:07 smithi001 ceph-mon[31211]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-21T00:55:07.420 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:07 smithi001 ceph-mon[31211]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-21T00:55:07.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:07 smithi193 ceph-mon[34660]: pgmap v293: 97 pgs: 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T00:55:07.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:07 smithi193 ceph-mon[34660]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T00:55:07.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:07 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/2065941630' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-21T00:55:07.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:07 smithi193 ceph-mon[34660]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T00:55:07.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:07 smithi193 ceph-mon[34660]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T00:55:07.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:07 smithi193 ceph-mon[34660]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-21T00:55:07.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:07 smithi193 ceph-mon[34660]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-21T00:55:07.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:07 smithi042 ceph-mon[34481]: pgmap v293: 97 pgs: 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T00:55:07.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:07 smithi042 ceph-mon[34481]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T00:55:07.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:07 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/2065941630' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-21T00:55:07.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:07 smithi042 ceph-mon[34481]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T00:55:07.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:07 smithi042 ceph-mon[34481]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T00:55:07.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:07 smithi042 ceph-mon[34481]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-21T00:55:07.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:07 smithi042 ceph-mon[34481]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-21T00:55:07.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.676+0000 7fa7c2587640 1 -- 172.21.15.1:0/3609627505 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7bc105b10 msgr2=0x7fa7bc10f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:07.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.676+0000 7fa7c2587640 1 --2- 172.21.15.1:0/3609627505 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7bc105b10 0x7fa7bc10f5a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4009ca0 tx=0x7fa7b402a8c0 comp rx=0 tx=0).stop 2024-09-21T00:55:07.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.676+0000 7fa7c2587640 1 -- 172.21.15.1:0/3609627505 shutdown_connections 2024-09-21T00:55:07.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.676+0000 7fa7c2587640 1 --2- 172.21.15.1:0/3609627505 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7bc105b10 0x7fa7bc10f5a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:07.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.676+0000 7fa7c2587640 1 --2- 172.21.15.1:0/3609627505 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7bc1051c0 0x7fa7bc1055d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:07.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.676+0000 7fa7c2587640 1 --2- 172.21.15.1:0/3609627505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7bc1031b0 0x7fa7bc1035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:07.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.676+0000 7fa7c2587640 1 -- 172.21.15.1:0/3609627505 >> 172.21.15.1:0/3609627505 conn(0x7fa7bc079e40 msgr2=0x7fa7bc07a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:07.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.676+0000 7fa7c2587640 1 -- 172.21.15.1:0/3609627505 shutdown_connections 2024-09-21T00:55:07.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.676+0000 7fa7c2587640 1 -- 172.21.15.1:0/3609627505 wait complete. 2024-09-21T00:55:07.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.677+0000 7fa7c2587640 1 Processor -- start 2024-09-21T00:55:07.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.677+0000 7fa7c2587640 1 -- start start 2024-09-21T00:55:07.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.677+0000 7fa7c2587640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7bc1031b0 0x7fa7bc19a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:07.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.677+0000 7fa7c2587640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7bc1051c0 0x7fa7bc19aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:07.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.677+0000 7fa7c2587640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7bc105b10 0x7fa7bc19fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:07.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.677+0000 7fa7c2587640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc113b10 con 0x7fa7bc105b10 2024-09-21T00:55:07.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.677+0000 7fa7c2587640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc113990 con 0x7fa7bc1031b0 2024-09-21T00:55:07.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.677+0000 7fa7c2587640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc113c90 con 0x7fa7bc1051c0 2024-09-21T00:55:07.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.678+0000 7fa7c0b24640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7bc105b10 0x7fa7bc19fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:07.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.678+0000 7fa7c0b24640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7bc105b10 0x7fa7bc19fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36054/0 (socket says 172.21.15.1:36054) 2024-09-21T00:55:07.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.678+0000 7fa7c0b24640 1 -- 172.21.15.1:0/1353648412 learned_addr learned my addr 172.21.15.1:0/1353648412 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:07.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.678+0000 7fa7bb7fe640 1 --2- 172.21.15.1:0/1353648412 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7bc1051c0 0x7fa7bc19aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:07.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.678+0000 7fa7bbfff640 1 --2- 172.21.15.1:0/1353648412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7bc1031b0 0x7fa7bc19a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:07.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.678+0000 7fa7c0b24640 1 -- 172.21.15.1:0/1353648412 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7bc1051c0 msgr2=0x7fa7bc19aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:07.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.678+0000 7fa7c0b24640 1 --2- 172.21.15.1:0/1353648412 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7bc1051c0 0x7fa7bc19aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:07.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.678+0000 7fa7c0b24640 1 -- 172.21.15.1:0/1353648412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7bc1031b0 msgr2=0x7fa7bc19a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:07.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.678+0000 7fa7c0b24640 1 --2- 172.21.15.1:0/1353648412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7bc1031b0 0x7fa7bc19a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:07.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.678+0000 7fa7c0b24640 1 -- 172.21.15.1:0/1353648412 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7bc1a0470 con 0x7fa7bc105b10 2024-09-21T00:55:07.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.678+0000 7fa7c0b24640 1 --2- 172.21.15.1:0/1353648412 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7bc105b10 0x7fa7bc19fd40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4005cc0 tx=0x7fa7b4031840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:07.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.678+0000 7fa7b97fa640 1 -- 172.21.15.1:0/1353648412 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4003b70 con 0x7fa7bc105b10 2024-09-21T00:55:07.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.678+0000 7fa7c2587640 1 -- 172.21.15.1:0/1353648412 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7bc1a0700 con 0x7fa7bc105b10 2024-09-21T00:55:07.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.678+0000 7fa7b97fa640 1 -- 172.21.15.1:0/1353648412 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7b4003d10 con 0x7fa7bc105b10 2024-09-21T00:55:07.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.678+0000 7fa7b97fa640 1 -- 172.21.15.1:0/1353648412 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b402fb20 con 0x7fa7bc105b10 2024-09-21T00:55:07.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.678+0000 7fa7c2587640 1 -- 172.21.15.1:0/1353648412 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7bc1a6ec0 con 0x7fa7bc105b10 2024-09-21T00:55:07.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.679+0000 7fa7c2587640 1 -- 172.21.15.1:0/1353648412 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7bc103f30 con 0x7fa7bc105b10 2024-09-21T00:55:07.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.681+0000 7fa7b97fa640 1 -- 172.21.15.1:0/1353648412 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 154511+0+0 (secure 0 0 0) 0x7fa7b4004580 con 0x7fa7bc105b10 2024-09-21T00:55:07.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.682+0000 7fa7b97fa640 1 --2- 172.21.15.1:0/1353648412 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa7a40b6510 0x7fa7a40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:07.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.682+0000 7fa7bbfff640 1 --2- 172.21.15.1:0/1353648412 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa7a40b6510 0x7fa7a40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:07.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.683+0000 7fa7b97fa640 1 -- 172.21.15.1:0/1353648412 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fa7b4108720 con 0x7fa7bc105b10 2024-09-21T00:55:07.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.683+0000 7fa7bbfff640 1 --2- 172.21.15.1:0/1353648412 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa7a40b6510 0x7fa7a40b8a20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac005fd0 tx=0x7fa7ac00b5b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:07.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.686+0000 7fa7b97fa640 1 -- 172.21.15.1:0/1353648412 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa7b40cf100 con 0x7fa7bc105b10 2024-09-21T00:55:07.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:07.913+0000 7fa7c2587640 1 -- 172.21.15.1:0/1353648412 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fa7bc1035c0 con 0x7fa7bc105b10 2024-09-21T00:55:08.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:08.169+0000 7fa7b97fa640 1 -- 172.21.15.1:0/1353648412 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7fa7b40d34e0 con 0x7fa7bc105b10 2024-09-21T00:55:08.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:08.172+0000 7fa7c2587640 1 -- 172.21.15.1:0/1353648412 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa7a40b6510 msgr2=0x7fa7a40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:08.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:08.172+0000 7fa7c2587640 1 --2- 172.21.15.1:0/1353648412 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa7a40b6510 0x7fa7a40b8a20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac005fd0 tx=0x7fa7ac00b5b0 comp rx=0 tx=0).stop 2024-09-21T00:55:08.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:08.172+0000 7fa7c2587640 1 -- 172.21.15.1:0/1353648412 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7bc105b10 msgr2=0x7fa7bc19fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:08.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:08.172+0000 7fa7c2587640 1 --2- 172.21.15.1:0/1353648412 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7bc105b10 0x7fa7bc19fd40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4005cc0 tx=0x7fa7b4031840 comp rx=0 tx=0).stop 2024-09-21T00:55:08.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:08.172+0000 7fa7c2587640 1 -- 172.21.15.1:0/1353648412 shutdown_connections 2024-09-21T00:55:08.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:08.172+0000 7fa7c2587640 1 --2- 172.21.15.1:0/1353648412 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa7a40b6510 0x7fa7a40b8a20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:08.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:08.172+0000 7fa7c2587640 1 --2- 172.21.15.1:0/1353648412 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7bc105b10 0x7fa7bc19fd40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:08.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:08.172+0000 7fa7c2587640 1 --2- 172.21.15.1:0/1353648412 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7bc1051c0 0x7fa7bc19aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:08.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:08.172+0000 7fa7c2587640 1 --2- 172.21.15.1:0/1353648412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7bc1031b0 0x7fa7bc19a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:08.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:08.172+0000 7fa7c2587640 1 -- 172.21.15.1:0/1353648412 >> 172.21.15.1:0/1353648412 conn(0x7fa7bc079e40 msgr2=0x7fa7bc106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:08.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:08.172+0000 7fa7c2587640 1 -- 172.21.15.1:0/1353648412 shutdown_connections 2024-09-21T00:55:08.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:08.172+0000 7fa7c2587640 1 -- 172.21.15.1:0/1353648412 wait complete. 2024-09-21T00:55:08.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:08 smithi001 ceph-mon[31211]: mds.? [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] up:active 2024-09-21T00:55:08.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:08 smithi001 ceph-mon[31211]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T00:55:08.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:08 smithi001 ceph-mon[31211]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-21T00:55:08.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:08 smithi001 ceph-mon[31211]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-21T00:55:08.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:08 smithi001 ceph-mon[31211]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-21T00:55:08.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:08 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1353648412' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T00:55:08.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:08 smithi193 ceph-mon[34660]: mds.? [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] up:active 2024-09-21T00:55:08.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:08 smithi193 ceph-mon[34660]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T00:55:08.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:08 smithi193 ceph-mon[34660]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-21T00:55:08.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:08 smithi193 ceph-mon[34660]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-21T00:55:08.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:08 smithi193 ceph-mon[34660]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-21T00:55:08.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:08 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/1353648412' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T00:55:08.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:08 smithi042 ceph-mon[34481]: mds.? [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] up:active 2024-09-21T00:55:08.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:08 smithi042 ceph-mon[34481]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T00:55:08.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:08 smithi042 ceph-mon[34481]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-21T00:55:08.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:08 smithi042 ceph-mon[34481]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-21T00:55:08.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:08 smithi042 ceph-mon[34481]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-21T00:55:08.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:08 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/1353648412' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T00:55:08.875 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs set cephfs session_timeout 300 2024-09-21T00:55:08.992 INFO:journalctl@ceph.mds.b.smithi042.stdout:Sep 21 00:55:08 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-b[63452]: 2024-09-21T00:55:08.571+0000 7f5d222de640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-21T00:55:08.992 INFO:journalctl@ceph.mds.b.smithi042.stdout:Sep 21 00:55:08 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-b[63452]: 2024-09-21T00:55:08.571+0000 7f5d222de640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-21T00:55:09.132 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:09.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:09 smithi001 ceph-mon[31211]: pgmap v294: 97 pgs: 97 active+clean; 580 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-21T00:55:09.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:09 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1353648412' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T00:55:09.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:09 smithi001 ceph-mon[31211]: mds.? [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] up:active 2024-09-21T00:55:09.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:09 smithi001 ceph-mon[31211]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-21T00:55:09.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:09 smithi001 ceph-mon[31211]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-21T00:55:09.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:09 smithi001 ceph-mon[31211]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-21T00:55:09.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:09 smithi001 ceph-mon[31211]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-21T00:55:09.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:09 smithi193 ceph-mon[34660]: pgmap v294: 97 pgs: 97 active+clean; 580 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-21T00:55:09.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:09 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/1353648412' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T00:55:09.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:09 smithi193 ceph-mon[34660]: mds.? [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] up:active 2024-09-21T00:55:09.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:09 smithi193 ceph-mon[34660]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-21T00:55:09.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:09 smithi193 ceph-mon[34660]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-21T00:55:09.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:09 smithi193 ceph-mon[34660]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-21T00:55:09.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:09 smithi193 ceph-mon[34660]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-21T00:55:09.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:09 smithi042 ceph-mon[34481]: pgmap v294: 97 pgs: 97 active+clean; 580 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-21T00:55:09.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:09 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/1353648412' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T00:55:09.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:09 smithi042 ceph-mon[34481]: mds.? [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] up:active 2024-09-21T00:55:09.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:09 smithi042 ceph-mon[34481]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-21T00:55:09.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:09 smithi042 ceph-mon[34481]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-21T00:55:09.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:09 smithi042 ceph-mon[34481]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-21T00:55:09.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:09 smithi042 ceph-mon[34481]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-21T00:55:09.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.602+0000 7f1308777640 1 -- 172.21.15.1:0/3428564760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13001094f0 msgr2=0x7f1300109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:09.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.602+0000 7f1308777640 1 --2- 172.21.15.1:0/3428564760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13001094f0 0x7f1300109900 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f12f4009900 tx=0x7f12f402a410 comp rx=0 tx=0).stop 2024-09-21T00:55:09.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.602+0000 7f1308777640 1 -- 172.21.15.1:0/3428564760 shutdown_connections 2024-09-21T00:55:09.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.602+0000 7f1308777640 1 --2- 172.21.15.1:0/3428564760 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1300109e40 0x7f1300110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:09.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.602+0000 7f1308777640 1 --2- 172.21.15.1:0/3428564760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13001094f0 0x7f1300109900 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:09.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.602+0000 7f1308777640 1 --2- 172.21.15.1:0/3428564760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13001020a0 0x7f13001024b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:09.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.602+0000 7f1308777640 1 -- 172.21.15.1:0/3428564760 >> 172.21.15.1:0/3428564760 conn(0x7f1300079e40 msgr2=0x7f130007a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:09.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.603+0000 7f1308777640 1 -- 172.21.15.1:0/3428564760 shutdown_connections 2024-09-21T00:55:09.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.603+0000 7f1308777640 1 -- 172.21.15.1:0/3428564760 wait complete. 2024-09-21T00:55:09.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.603+0000 7f1308777640 1 Processor -- start 2024-09-21T00:55:09.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.603+0000 7f1308777640 1 -- start start 2024-09-21T00:55:09.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.604+0000 7f1308777640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13001020a0 0x7f130019a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:09.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.604+0000 7f1308777640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13001094f0 0x7f130019aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:09.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.604+0000 7f1308777640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1300109e40 0x7f130019fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:09.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.604+0000 7f1308777640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1300113b00 con 0x7f13001020a0 2024-09-21T00:55:09.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.604+0000 7f1308777640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1300113980 con 0x7f1300109e40 2024-09-21T00:55:09.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.604+0000 7f1308777640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1300113c80 con 0x7f13001094f0 2024-09-21T00:55:09.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.604+0000 7f1306513640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13001020a0 0x7f130019a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:09.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.604+0000 7f1306513640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13001020a0 0x7f130019a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53188/0 (socket says 172.21.15.1:53188) 2024-09-21T00:55:09.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.604+0000 7f1306513640 1 -- 172.21.15.1:0/2269142070 learned_addr learned my addr 172.21.15.1:0/2269142070 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:09.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.604+0000 7f1306d14640 1 --2- 172.21.15.1:0/2269142070 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1300109e40 0x7f130019fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:09.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.604+0000 7f1305d12640 1 --2- 172.21.15.1:0/2269142070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13001094f0 0x7f130019aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:09.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.604+0000 7f1306513640 1 -- 172.21.15.1:0/2269142070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13001094f0 msgr2=0x7f130019aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:09.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.604+0000 7f1306513640 1 --2- 172.21.15.1:0/2269142070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13001094f0 0x7f130019aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:09.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.604+0000 7f1306513640 1 -- 172.21.15.1:0/2269142070 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1300109e40 msgr2=0x7f130019fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:09.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.604+0000 7f1306513640 1 --2- 172.21.15.1:0/2269142070 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1300109e40 0x7f130019fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:09.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.604+0000 7f1306513640 1 -- 172.21.15.1:0/2269142070 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13001a03a0 con 0x7f13001020a0 2024-09-21T00:55:09.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.604+0000 7f1306513640 1 --2- 172.21.15.1:0/2269142070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13001020a0 0x7f130019a4f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f12f000eab0 tx=0x7f12f000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:09.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.604+0000 7f12ff7fe640 1 -- 172.21.15.1:0/2269142070 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f000ce40 con 0x7f13001020a0 2024-09-21T00:55:09.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.604+0000 7f12ff7fe640 1 -- 172.21.15.1:0/2269142070 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12f0011920 con 0x7f13001020a0 2024-09-21T00:55:09.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.604+0000 7f1308777640 1 -- 172.21.15.1:0/2269142070 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13001a0690 con 0x7f13001020a0 2024-09-21T00:55:09.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.605+0000 7f12ff7fe640 1 -- 172.21.15.1:0/2269142070 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f0010a30 con 0x7f13001020a0 2024-09-21T00:55:09.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.605+0000 7f1308777640 1 -- 172.21.15.1:0/2269142070 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13001a6eb0 con 0x7f13001020a0 2024-09-21T00:55:09.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.606+0000 7f1308777640 1 -- 172.21.15.1:0/2269142070 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13001024b0 con 0x7f13001020a0 2024-09-21T00:55:09.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.607+0000 7f12ff7fe640 1 -- 172.21.15.1:0/2269142070 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 154511+0+0 (secure 0 0 0) 0x7f12f0010bd0 con 0x7f13001020a0 2024-09-21T00:55:09.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.608+0000 7f12ff7fe640 1 --2- 172.21.15.1:0/2269142070 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f12e80b65c0 0x7f12e80b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:09.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.608+0000 7f1305d12640 1 --2- 172.21.15.1:0/2269142070 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f12e80b65c0 0x7f12e80b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:09.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.608+0000 7f12ff7fe640 1 -- 172.21.15.1:0/2269142070 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f12f00e7700 con 0x7f13001020a0 2024-09-21T00:55:09.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.609+0000 7f1305d12640 1 --2- 172.21.15.1:0/2269142070 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f12e80b65c0 0x7f12e80b8ad0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f12f4009230 tx=0x7f12f4031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:09.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.611+0000 7f12ff7fe640 1 -- 172.21.15.1:0/2269142070 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f12f0016030 con 0x7f13001020a0 2024-09-21T00:55:09.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:09.835+0000 7f1308777640 1 -- 172.21.15.1:0/2269142070 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f130010bc10 con 0x7f13001020a0 2024-09-21T00:55:10.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:10 smithi001 ceph-mon[31211]: mds.? [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] up:active 2024-09-21T00:55:10.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:10 smithi001 ceph-mon[31211]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-21T00:55:10.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:10 smithi001 ceph-mon[31211]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T00:55:10.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:10 smithi001 ceph-mon[31211]: Cluster is now healthy 2024-09-21T00:55:10.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:10 smithi001 ceph-mon[31211]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-09-21T00:55:10.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:10 smithi001 ceph-mon[31211]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-21T00:55:10.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:10 smithi001 ceph-mon[31211]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-21T00:55:10.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:10 smithi001 ceph-mon[31211]: mds.? [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] up:active 2024-09-21T00:55:10.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:10 smithi001 ceph-mon[31211]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T00:55:10.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:10 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/2269142070' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T00:55:10.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:10 smithi193 ceph-mon[34660]: mds.? [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] up:active 2024-09-21T00:55:10.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:10 smithi193 ceph-mon[34660]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-21T00:55:10.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:10 smithi193 ceph-mon[34660]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T00:55:10.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:10 smithi193 ceph-mon[34660]: Cluster is now healthy 2024-09-21T00:55:10.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:10 smithi193 ceph-mon[34660]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-09-21T00:55:10.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:10 smithi193 ceph-mon[34660]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-21T00:55:10.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:10 smithi193 ceph-mon[34660]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-21T00:55:10.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:10 smithi193 ceph-mon[34660]: mds.? [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] up:active 2024-09-21T00:55:10.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:10 smithi193 ceph-mon[34660]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T00:55:10.480 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:10 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/2269142070' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T00:55:10.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:10 smithi042 ceph-mon[34481]: mds.? [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] up:active 2024-09-21T00:55:10.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:10 smithi042 ceph-mon[34481]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-21T00:55:10.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:10 smithi042 ceph-mon[34481]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T00:55:10.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:10 smithi042 ceph-mon[34481]: Cluster is now healthy 2024-09-21T00:55:10.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:10 smithi042 ceph-mon[34481]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-09-21T00:55:10.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:10 smithi042 ceph-mon[34481]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-21T00:55:10.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:10 smithi042 ceph-mon[34481]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-21T00:55:10.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:10 smithi042 ceph-mon[34481]: mds.? [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] up:active 2024-09-21T00:55:10.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:10 smithi042 ceph-mon[34481]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T00:55:10.493 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:10 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/2269142070' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T00:55:10.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:10.586+0000 7f12ff7fe640 1 -- 172.21.15.1:0/2269142070 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7f12f00ae160 con 0x7f13001020a0 2024-09-21T00:55:10.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:10.589+0000 7f1308777640 1 -- 172.21.15.1:0/2269142070 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f12e80b65c0 msgr2=0x7f12e80b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:10.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:10.589+0000 7f1308777640 1 --2- 172.21.15.1:0/2269142070 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f12e80b65c0 0x7f12e80b8ad0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f12f4009230 tx=0x7f12f4031400 comp rx=0 tx=0).stop 2024-09-21T00:55:10.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:10.589+0000 7f1308777640 1 -- 172.21.15.1:0/2269142070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13001020a0 msgr2=0x7f130019a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:10.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:10.589+0000 7f1308777640 1 --2- 172.21.15.1:0/2269142070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13001020a0 0x7f130019a4f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f12f000eab0 tx=0x7f12f000ef70 comp rx=0 tx=0).stop 2024-09-21T00:55:10.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:10.589+0000 7f1308777640 1 -- 172.21.15.1:0/2269142070 shutdown_connections 2024-09-21T00:55:10.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:10.589+0000 7f1308777640 1 --2- 172.21.15.1:0/2269142070 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1300109e40 0x7f130019fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:10.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:10.589+0000 7f1308777640 1 --2- 172.21.15.1:0/2269142070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13001094f0 0x7f130019aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:10.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:10.589+0000 7f1308777640 1 --2- 172.21.15.1:0/2269142070 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f12e80b65c0 0x7f12e80b8ad0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:10.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:10.589+0000 7f1308777640 1 --2- 172.21.15.1:0/2269142070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13001020a0 0x7f130019a4f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:10.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:10.589+0000 7f1308777640 1 -- 172.21.15.1:0/2269142070 >> 172.21.15.1:0/2269142070 conn(0x7f1300079e40 msgr2=0x7f1300105560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:10.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:10.589+0000 7f1308777640 1 -- 172.21.15.1:0/2269142070 shutdown_connections 2024-09-21T00:55:10.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:10.589+0000 7f1308777640 1 -- 172.21.15.1:0/2269142070 wait complete. 2024-09-21T00:55:11.410 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-09-21T00:55:11.410 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs subvolumegroup create cephfs qa 2024-09-21T00:55:11.676 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:11.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:11 smithi001 ceph-mon[31211]: pgmap v295: 97 pgs: 97 active+clean; 581 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 8 op/s 2024-09-21T00:55:11.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:11 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/2269142070' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T00:55:11.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:11 smithi001 ceph-mon[31211]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T00:55:11.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:11 smithi193 ceph-mon[34660]: pgmap v295: 97 pgs: 97 active+clean; 581 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 8 op/s 2024-09-21T00:55:11.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:11 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/2269142070' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T00:55:11.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:11 smithi193 ceph-mon[34660]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T00:55:11.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:11 smithi042 ceph-mon[34481]: pgmap v295: 97 pgs: 97 active+clean; 581 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 8 op/s 2024-09-21T00:55:11.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:11 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/2269142070' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T00:55:11.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:11 smithi042 ceph-mon[34481]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T00:55:12.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.164+0000 7f423324e640 1 -- 172.21.15.1:0/1281199434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f422c1083a0 msgr2=0x7f422c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:12.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.164+0000 7f423324e640 1 --2- 172.21.15.1:0/1281199434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f422c1083a0 0x7f422c1087b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4218009900 tx=0x7f421802a410 comp rx=0 tx=0).stop 2024-09-21T00:55:12.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.164+0000 7f423324e640 1 -- 172.21.15.1:0/1281199434 shutdown_connections 2024-09-21T00:55:12.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.164+0000 7f423324e640 1 --2- 172.21.15.1:0/1281199434 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f422c108cf0 0x7f422c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:12.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.164+0000 7f423324e640 1 --2- 172.21.15.1:0/1281199434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f422c1083a0 0x7f422c1087b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:12.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.164+0000 7f423324e640 1 --2- 172.21.15.1:0/1281199434 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f422c102a60 0x7f422c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:12.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.164+0000 7f423324e640 1 -- 172.21.15.1:0/1281199434 >> 172.21.15.1:0/1281199434 conn(0x7f422c079730 msgr2=0x7f422c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:12.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.164+0000 7f423324e640 1 -- 172.21.15.1:0/1281199434 shutdown_connections 2024-09-21T00:55:12.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.164+0000 7f423324e640 1 -- 172.21.15.1:0/1281199434 wait complete. 2024-09-21T00:55:12.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.164+0000 7f423324e640 1 Processor -- start 2024-09-21T00:55:12.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.164+0000 7f423324e640 1 -- start start 2024-09-21T00:55:12.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.165+0000 7f423324e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f422c102a60 0x7f422c19b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:12.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.165+0000 7f423324e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f422c1083a0 0x7f422c19b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:12.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.165+0000 7f423324e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f422c108cf0 0x7f422c19bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:12.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.165+0000 7f423324e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f422c112960 con 0x7f422c1083a0 2024-09-21T00:55:12.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.165+0000 7f423324e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f422c1127e0 con 0x7f422c102a60 2024-09-21T00:55:12.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.165+0000 7f423324e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f422c112ae0 con 0x7f422c108cf0 2024-09-21T00:55:12.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.165+0000 7f422bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f422c1083a0 0x7f422c19b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:12.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.165+0000 7f4230fea640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f422c102a60 0x7f422c19b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:12.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.165+0000 7f422bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f422c1083a0 0x7f422c19b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53214/0 (socket says 172.21.15.1:53214) 2024-09-21T00:55:12.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.165+0000 7f422bfff640 1 -- 172.21.15.1:0/4210529008 learned_addr learned my addr 172.21.15.1:0/4210529008 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:12.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.165+0000 7f42317eb640 1 --2- 172.21.15.1:0/4210529008 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f422c108cf0 0x7f422c19bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:12.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.165+0000 7f422bfff640 1 -- 172.21.15.1:0/4210529008 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f422c108cf0 msgr2=0x7f422c19bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:12.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.165+0000 7f422bfff640 1 --2- 172.21.15.1:0/4210529008 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f422c108cf0 0x7f422c19bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:12.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.165+0000 7f422bfff640 1 -- 172.21.15.1:0/4210529008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f422c102a60 msgr2=0x7f422c19b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:12.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.165+0000 7f422bfff640 1 --2- 172.21.15.1:0/4210529008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f422c102a60 0x7f422c19b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:12.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.165+0000 7f422bfff640 1 -- 172.21.15.1:0/4210529008 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f422c1a6500 con 0x7f422c1083a0 2024-09-21T00:55:12.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.165+0000 7f422bfff640 1 --2- 172.21.15.1:0/4210529008 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f422c1083a0 0x7f422c19b7b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4218032fd0 tx=0x7f4218031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:12.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.166+0000 7f4229ffb640 1 -- 172.21.15.1:0/4210529008 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421803f030 con 0x7f422c1083a0 2024-09-21T00:55:12.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.166+0000 7f4229ffb640 1 -- 172.21.15.1:0/4210529008 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4218004490 con 0x7f422c1083a0 2024-09-21T00:55:12.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.166+0000 7f423324e640 1 -- 172.21.15.1:0/4210529008 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f422c1a6790 con 0x7f422c1083a0 2024-09-21T00:55:12.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.166+0000 7f4229ffb640 1 -- 172.21.15.1:0/4210529008 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4218035070 con 0x7f422c1083a0 2024-09-21T00:55:12.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.166+0000 7f423324e640 1 -- 172.21.15.1:0/4210529008 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f422c1a6c70 con 0x7f422c1083a0 2024-09-21T00:55:12.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.167+0000 7f423324e640 1 -- 172.21.15.1:0/4210529008 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f422c102e70 con 0x7f422c1083a0 2024-09-21T00:55:12.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.169+0000 7f4229ffb640 1 -- 172.21.15.1:0/4210529008 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 154511+0+0 (secure 0 0 0) 0x7f4218042030 con 0x7f422c1083a0 2024-09-21T00:55:12.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.170+0000 7f4229ffb640 1 --2- 172.21.15.1:0/4210529008 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f421c0b6540 0x7f421c0b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:12.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.170+0000 7f4230fea640 1 --2- 172.21.15.1:0/4210529008 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f421c0b6540 0x7f421c0b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:12.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.170+0000 7f4229ffb640 1 -- 172.21.15.1:0/4210529008 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f42181078b0 con 0x7f422c1083a0 2024-09-21T00:55:12.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.170+0000 7f4230fea640 1 --2- 172.21.15.1:0/4210529008 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f421c0b6540 0x7f421c0b8a50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f422c06b9c0 tx=0x7f4220005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:12.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.173+0000 7f4229ffb640 1 -- 172.21.15.1:0/4210529008 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f42180d2670 con 0x7f422c1083a0 2024-09-21T00:55:12.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.388+0000 7f423324e640 1 -- 172.21.15.1:0/4210529008 --> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f422c063800 con 0x7f421c0b6540 2024-09-21T00:55:12.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.415+0000 7f4229ffb640 1 -- 172.21.15.1:0/4210529008 <== mgr.14150 v2:172.21.15.1:6800/2032980330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f422c063800 con 0x7f421c0b6540 2024-09-21T00:55:12.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.418+0000 7f423324e640 1 -- 172.21.15.1:0/4210529008 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f421c0b6540 msgr2=0x7f421c0b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:12.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.418+0000 7f423324e640 1 --2- 172.21.15.1:0/4210529008 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f421c0b6540 0x7f421c0b8a50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f422c06b9c0 tx=0x7f4220005f90 comp rx=0 tx=0).stop 2024-09-21T00:55:12.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.418+0000 7f423324e640 1 -- 172.21.15.1:0/4210529008 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f422c1083a0 msgr2=0x7f422c19b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:12.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.418+0000 7f423324e640 1 --2- 172.21.15.1:0/4210529008 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f422c1083a0 0x7f422c19b7b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4218032fd0 tx=0x7f4218031a20 comp rx=0 tx=0).stop 2024-09-21T00:55:12.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.418+0000 7f423324e640 1 -- 172.21.15.1:0/4210529008 shutdown_connections 2024-09-21T00:55:12.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.418+0000 7f423324e640 1 --2- 172.21.15.1:0/4210529008 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f422c108cf0 0x7f422c19bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:12.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.418+0000 7f423324e640 1 --2- 172.21.15.1:0/4210529008 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f421c0b6540 0x7f421c0b8a50 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:12.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.418+0000 7f423324e640 1 --2- 172.21.15.1:0/4210529008 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f422c1083a0 0x7f422c19b7b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:12.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.418+0000 7f423324e640 1 --2- 172.21.15.1:0/4210529008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f422c102a60 0x7f422c19b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:12.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.418+0000 7f423324e640 1 -- 172.21.15.1:0/4210529008 >> 172.21.15.1:0/4210529008 conn(0x7f422c079730 msgr2=0x7f422c104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:12.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.418+0000 7f423324e640 1 -- 172.21.15.1:0/4210529008 shutdown_connections 2024-09-21T00:55:12.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:12.418+0000 7f423324e640 1 -- 172.21.15.1:0/4210529008 wait complete. 2024-09-21T00:55:12.710 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:55:12 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: 2024-09-21T00:55:12.393+0000 7fdd85ceb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T00:55:12.710 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:55:12 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: 2024-09-21T00:55:12.393+0000 7fdd85ceb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T00:55:12.710 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:55:12 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: 2024-09-21T00:55:12.393+0000 7fdd85ceb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T00:55:12.710 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:55:12 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: 2024-09-21T00:55:12.393+0000 7fdd85ceb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T00:55:12.710 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:55:12 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: 2024-09-21T00:55:12.393+0000 7fdd85ceb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T00:55:13.222 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-21T00:55:13.478 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:13.847 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:13 smithi001 ceph-mon[31211]: pgmap v296: 97 pgs: 97 active+clean; 584 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 4.4 KiB/s wr, 17 op/s 2024-09-21T00:55:13.847 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:13 smithi001 ceph-mon[31211]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:13.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.945+0000 7fa3f563e640 1 -- 172.21.15.1:0/2051557394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3f010ddf0 msgr2=0x7fa3f0110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:13.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.945+0000 7fa3f563e640 1 --2- 172.21.15.1:0/2051557394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3f010ddf0 0x7fa3f0110300 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0009ca0 tx=0x7fa3e002a8c0 comp rx=0 tx=0).stop 2024-09-21T00:55:13.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.945+0000 7fa3f563e640 1 -- 172.21.15.1:0/2051557394 shutdown_connections 2024-09-21T00:55:13.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.945+0000 7fa3f563e640 1 --2- 172.21.15.1:0/2051557394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3f010ddf0 0x7fa3f0110300 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:13.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.945+0000 7fa3f563e640 1 --2- 172.21.15.1:0/2051557394 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3f0105270 0x7fa3f010d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:13.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.945+0000 7fa3f563e640 1 --2- 172.21.15.1:0/2051557394 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3f0104840 0x7fa3f0104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:13.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.945+0000 7fa3f563e640 1 -- 172.21.15.1:0/2051557394 >> 172.21.15.1:0/2051557394 conn(0x7fa3f0079730 msgr2=0x7fa3f0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:13.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.945+0000 7fa3f563e640 1 -- 172.21.15.1:0/2051557394 shutdown_connections 2024-09-21T00:55:13.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.945+0000 7fa3f563e640 1 -- 172.21.15.1:0/2051557394 wait complete. 2024-09-21T00:55:13.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.946+0000 7fa3f563e640 1 Processor -- start 2024-09-21T00:55:13.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.946+0000 7fa3f563e640 1 -- start start 2024-09-21T00:55:13.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.946+0000 7fa3f563e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3f0104840 0x7fa3f019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:13.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.946+0000 7fa3f563e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3f0105270 0x7fa3f019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:13.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.946+0000 7fa3f563e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3f010ddf0 0x7fa3f019fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:13.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.946+0000 7fa3f563e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f0113a70 con 0x7fa3f0105270 2024-09-21T00:55:13.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.946+0000 7fa3f563e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f01138f0 con 0x7fa3f010ddf0 2024-09-21T00:55:13.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.946+0000 7fa3f563e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f0113bf0 con 0x7fa3f0104840 2024-09-21T00:55:13.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.947+0000 7fa3ee7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3f0105270 0x7fa3f019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:13.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.947+0000 7fa3ee7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3f0105270 0x7fa3f019aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53254/0 (socket says 172.21.15.1:53254) 2024-09-21T00:55:13.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.947+0000 7fa3ee7fc640 1 -- 172.21.15.1:0/346476731 learned_addr learned my addr 172.21.15.1:0/346476731 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:13.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.947+0000 7fa3ef7fe640 1 --2- 172.21.15.1:0/346476731 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3f010ddf0 0x7fa3f019fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:13.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.947+0000 7fa3eeffd640 1 --2- 172.21.15.1:0/346476731 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3f0104840 0x7fa3f019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:13.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.947+0000 7fa3ee7fc640 1 -- 172.21.15.1:0/346476731 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3f0104840 msgr2=0x7fa3f019a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:13.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.947+0000 7fa3ee7fc640 1 --2- 172.21.15.1:0/346476731 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3f0104840 0x7fa3f019a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:13.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.947+0000 7fa3ee7fc640 1 -- 172.21.15.1:0/346476731 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3f010ddf0 msgr2=0x7fa3f019fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:13.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.947+0000 7fa3ee7fc640 1 --2- 172.21.15.1:0/346476731 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3f010ddf0 0x7fa3f019fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:13.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.947+0000 7fa3ee7fc640 1 -- 172.21.15.1:0/346476731 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3f01a0410 con 0x7fa3f0105270 2024-09-21T00:55:13.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.947+0000 7fa3eeffd640 1 --2- 172.21.15.1:0/346476731 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3f0104840 0x7fa3f019a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:55:13.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.947+0000 7fa3ee7fc640 1 --2- 172.21.15.1:0/346476731 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3f0105270 0x7fa3f019aa40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa3d800d950 tx=0x7fa3d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:13.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.947+0000 7fa3e7fff640 1 -- 172.21.15.1:0/346476731 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8017070 con 0x7fa3f0105270 2024-09-21T00:55:13.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.947+0000 7fa3f563e640 1 -- 172.21.15.1:0/346476731 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3f01a0700 con 0x7fa3f0105270 2024-09-21T00:55:13.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.947+0000 7fa3e7fff640 1 -- 172.21.15.1:0/346476731 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3d8009c30 con 0x7fa3f0105270 2024-09-21T00:55:13.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.947+0000 7fa3e7fff640 1 -- 172.21.15.1:0/346476731 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d80047a0 con 0x7fa3f0105270 2024-09-21T00:55:13.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.948+0000 7fa3f563e640 1 -- 172.21.15.1:0/346476731 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3f01a6e60 con 0x7fa3f0105270 2024-09-21T00:55:13.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.949+0000 7fa3f563e640 1 -- 172.21.15.1:0/346476731 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3f0104c50 con 0x7fa3f0105270 2024-09-21T00:55:13.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.950+0000 7fa3e7fff640 1 -- 172.21.15.1:0/346476731 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 154511+0+0 (secure 0 0 0) 0x7fa3d8004020 con 0x7fa3f0105270 2024-09-21T00:55:13.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.951+0000 7fa3e7fff640 1 --2- 172.21.15.1:0/346476731 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa3dc0b6510 0x7fa3dc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:13.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.951+0000 7fa3eeffd640 1 --2- 172.21.15.1:0/346476731 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa3dc0b6510 0x7fa3dc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:13.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.951+0000 7fa3e7fff640 1 -- 172.21.15.1:0/346476731 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fa3d80e6e80 con 0x7fa3f0105270 2024-09-21T00:55:13.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.951+0000 7fa3eeffd640 1 --2- 172.21.15.1:0/346476731 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa3dc0b6510 0x7fa3dc0b8a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa3f006bc00 tx=0x7fa3e8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:13.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:13.955+0000 7fa3e7fff640 1 -- 172.21.15.1:0/346476731 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa3d8020020 con 0x7fa3f0105270 2024-09-21T00:55:13.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:13 smithi193 ceph-mon[34660]: pgmap v296: 97 pgs: 97 active+clean; 584 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 4.4 KiB/s wr, 17 op/s 2024-09-21T00:55:13.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:13 smithi193 ceph-mon[34660]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:13.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:13 smithi042 ceph-mon[34481]: pgmap v296: 97 pgs: 97 active+clean; 584 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 4.4 KiB/s wr, 17 op/s 2024-09-21T00:55:13.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:13 smithi042 ceph-mon[34481]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:13.993 INFO:journalctl@ceph.mds.b.smithi042.stdout:Sep 21 00:55:13 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-b[63452]: 2024-09-21T00:55:13.571+0000 7f5d222de640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-21T00:55:14.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:14.171+0000 7fa3f563e640 1 -- 172.21.15.1:0/346476731 --> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fa3f01080a0 con 0x7fa3dc0b6510 2024-09-21T00:55:14.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:14.200+0000 7fa3e7fff640 1 -- 172.21.15.1:0/346476731 <== mgr.14150 v2:172.21.15.1:6800/2032980330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa3f01080a0 con 0x7fa3dc0b6510 2024-09-21T00:55:14.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:14.202+0000 7fa3f563e640 1 -- 172.21.15.1:0/346476731 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa3dc0b6510 msgr2=0x7fa3dc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:14.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:14.202+0000 7fa3f563e640 1 --2- 172.21.15.1:0/346476731 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa3dc0b6510 0x7fa3dc0b8a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa3f006bc00 tx=0x7fa3e8005f90 comp rx=0 tx=0).stop 2024-09-21T00:55:14.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:14.202+0000 7fa3f563e640 1 -- 172.21.15.1:0/346476731 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3f0105270 msgr2=0x7fa3f019aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:14.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:14.202+0000 7fa3f563e640 1 --2- 172.21.15.1:0/346476731 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3f0105270 0x7fa3f019aa40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa3d800d950 tx=0x7fa3d800de10 comp rx=0 tx=0).stop 2024-09-21T00:55:14.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:14.202+0000 7fa3f563e640 1 -- 172.21.15.1:0/346476731 shutdown_connections 2024-09-21T00:55:14.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:14.202+0000 7fa3f563e640 1 --2- 172.21.15.1:0/346476731 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3f010ddf0 0x7fa3f019fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:14.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:14.202+0000 7fa3f563e640 1 --2- 172.21.15.1:0/346476731 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa3dc0b6510 0x7fa3dc0b8a20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:14.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:14.202+0000 7fa3f563e640 1 --2- 172.21.15.1:0/346476731 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3f0105270 0x7fa3f019aa40 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:14.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:14.202+0000 7fa3f563e640 1 --2- 172.21.15.1:0/346476731 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3f0104840 0x7fa3f019a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:14.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:14.202+0000 7fa3f563e640 1 -- 172.21.15.1:0/346476731 >> 172.21.15.1:0/346476731 conn(0x7fa3f0079730 msgr2=0x7fa3f0107990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:14.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:14.202+0000 7fa3f563e640 1 -- 172.21.15.1:0/346476731 shutdown_connections 2024-09-21T00:55:14.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:14.202+0000 7fa3f563e640 1 -- 172.21.15.1:0/346476731 wait complete. 2024-09-21T00:55:14.948 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-21T00:55:15.208 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:15.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.693+0000 7fa520131640 1 -- 172.21.15.1:0/3363102637 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa518102a80 msgr2=0x7fa518102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:15.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.693+0000 7fa520131640 1 --2- 172.21.15.1:0/3363102637 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa518102a80 0x7fa518102e90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa514009900 tx=0x7fa51402a410 comp rx=0 tx=0).stop 2024-09-21T00:55:15.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.693+0000 7fa520131640 1 -- 172.21.15.1:0/3363102637 shutdown_connections 2024-09-21T00:55:15.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.693+0000 7fa520131640 1 --2- 172.21.15.1:0/3363102637 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa518108d10 0x7fa51810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:15.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.693+0000 7fa520131640 1 --2- 172.21.15.1:0/3363102637 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5181083c0 0x7fa5181087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:15.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.693+0000 7fa520131640 1 --2- 172.21.15.1:0/3363102637 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa518102a80 0x7fa518102e90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:15.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.693+0000 7fa520131640 1 -- 172.21.15.1:0/3363102637 >> 172.21.15.1:0/3363102637 conn(0x7fa518079740 msgr2=0x7fa518079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:15.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.693+0000 7fa520131640 1 -- 172.21.15.1:0/3363102637 shutdown_connections 2024-09-21T00:55:15.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.693+0000 7fa520131640 1 -- 172.21.15.1:0/3363102637 wait complete. 2024-09-21T00:55:15.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.694+0000 7fa520131640 1 Processor -- start 2024-09-21T00:55:15.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.694+0000 7fa520131640 1 -- start start 2024-09-21T00:55:15.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.694+0000 7fa520131640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa518102a80 0x7fa51819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:15.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.694+0000 7fa520131640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa5181083c0 0x7fa51819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:15.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.694+0000 7fa520131640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa518108d10 0x7fa51819fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:15.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.694+0000 7fa520131640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa5181129e0 con 0x7fa518102a80 2024-09-21T00:55:15.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.694+0000 7fa520131640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa518112860 con 0x7fa518108d10 2024-09-21T00:55:15.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.694+0000 7fa520131640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa518112b60 con 0x7fa5181083c0 2024-09-21T00:55:15.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.694+0000 7fa51decd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa518102a80 0x7fa51819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:15.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.695+0000 7fa51decd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa518102a80 0x7fa51819a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53258/0 (socket says 172.21.15.1:53258) 2024-09-21T00:55:15.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.695+0000 7fa51decd640 1 -- 172.21.15.1:0/2253349556 learned_addr learned my addr 172.21.15.1:0/2253349556 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:15.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.695+0000 7fa51e6ce640 1 --2- 172.21.15.1:0/2253349556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa518108d10 0x7fa51819fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:15.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.695+0000 7fa51d6cc640 1 --2- 172.21.15.1:0/2253349556 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa5181083c0 0x7fa51819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:15.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.695+0000 7fa51decd640 1 -- 172.21.15.1:0/2253349556 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa5181083c0 msgr2=0x7fa51819aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:15.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.695+0000 7fa51decd640 1 --2- 172.21.15.1:0/2253349556 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa5181083c0 0x7fa51819aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:15.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.695+0000 7fa51decd640 1 -- 172.21.15.1:0/2253349556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa518108d10 msgr2=0x7fa51819fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:15.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.695+0000 7fa51decd640 1 --2- 172.21.15.1:0/2253349556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa518108d10 0x7fa51819fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:15.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.695+0000 7fa51decd640 1 -- 172.21.15.1:0/2253349556 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5181a03f0 con 0x7fa518102a80 2024-09-21T00:55:15.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.695+0000 7fa51d6cc640 1 --2- 172.21.15.1:0/2253349556 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa5181083c0 0x7fa51819aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:55:15.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.695+0000 7fa51decd640 1 --2- 172.21.15.1:0/2253349556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa518102a80 0x7fa51819a480 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa514005940 tx=0x7fa5140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:15.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.695+0000 7fa50effd640 1 -- 172.21.15.1:0/2253349556 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51403f030 con 0x7fa518102a80 2024-09-21T00:55:15.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.695+0000 7fa50effd640 1 -- 172.21.15.1:0/2253349556 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa514003cb0 con 0x7fa518102a80 2024-09-21T00:55:15.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.695+0000 7fa520131640 1 -- 172.21.15.1:0/2253349556 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5181a0680 con 0x7fa518102a80 2024-09-21T00:55:15.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.695+0000 7fa50effd640 1 -- 172.21.15.1:0/2253349556 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa514035070 con 0x7fa518102a80 2024-09-21T00:55:15.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.695+0000 7fa520131640 1 -- 172.21.15.1:0/2253349556 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5181a6e40 con 0x7fa518102a80 2024-09-21T00:55:15.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.697+0000 7fa520131640 1 -- 172.21.15.1:0/2253349556 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa518102e90 con 0x7fa518102a80 2024-09-21T00:55:15.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.698+0000 7fa50effd640 1 -- 172.21.15.1:0/2253349556 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7fa514042030 con 0x7fa518102a80 2024-09-21T00:55:15.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.699+0000 7fa50effd640 1 --2- 172.21.15.1:0/2253349556 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa5040b65a0 0x7fa5040b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:15.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.699+0000 7fa51d6cc640 1 --2- 172.21.15.1:0/2253349556 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa5040b65a0 0x7fa5040b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:15.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.699+0000 7fa50effd640 1 -- 172.21.15.1:0/2253349556 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fa514107de0 con 0x7fa518102a80 2024-09-21T00:55:15.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.700+0000 7fa51d6cc640 1 --2- 172.21.15.1:0/2253349556 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa5040b65a0 0x7fa5040b8ab0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa518079c00 tx=0x7fa508005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:15.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.702+0000 7fa50effd640 1 -- 172.21.15.1:0/2253349556 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa5140ce6c0 con 0x7fa518102a80 2024-09-21T00:55:15.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.921+0000 7fa520131640 1 -- 172.21.15.1:0/2253349556 --> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fa518101720 con 0x7fa5040b65a0 2024-09-21T00:55:15.923 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:15 smithi001 ceph-mon[31211]: pgmap v297: 97 pgs: 97 active+clean; 591 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 5.2 KiB/s wr, 20 op/s 2024-09-21T00:55:15.923 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:15 smithi001 ceph-mon[31211]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:15.923 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:15 smithi001 ceph-mon[31211]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-21T00:55:15.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.927+0000 7fa50effd640 1 -- 172.21.15.1:0/2253349556 <== mgr.14150 v2:172.21.15.1:6800/2032980330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fa518101720 con 0x7fa5040b65a0 2024-09-21T00:55:15.929 INFO:teuthology.orchestra.run.smithi001.stdout:/volumes/qa/sv_0/74f68341-3049-47d6-a005-3f44603ab5ed 2024-09-21T00:55:15.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.929+0000 7fa520131640 1 -- 172.21.15.1:0/2253349556 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa5040b65a0 msgr2=0x7fa5040b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:15.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.929+0000 7fa520131640 1 --2- 172.21.15.1:0/2253349556 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa5040b65a0 0x7fa5040b8ab0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa518079c00 tx=0x7fa508005e50 comp rx=0 tx=0).stop 2024-09-21T00:55:15.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.930+0000 7fa520131640 1 -- 172.21.15.1:0/2253349556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa518102a80 msgr2=0x7fa51819a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:15.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.930+0000 7fa520131640 1 --2- 172.21.15.1:0/2253349556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa518102a80 0x7fa51819a480 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa514005940 tx=0x7fa5140042f0 comp rx=0 tx=0).stop 2024-09-21T00:55:15.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.930+0000 7fa520131640 1 -- 172.21.15.1:0/2253349556 shutdown_connections 2024-09-21T00:55:15.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.930+0000 7fa520131640 1 --2- 172.21.15.1:0/2253349556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa518108d10 0x7fa51819fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:15.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.930+0000 7fa520131640 1 --2- 172.21.15.1:0/2253349556 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa5181083c0 0x7fa51819aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:15.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.930+0000 7fa520131640 1 --2- 172.21.15.1:0/2253349556 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa5040b65a0 0x7fa5040b8ab0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:15.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.930+0000 7fa520131640 1 --2- 172.21.15.1:0/2253349556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa518102a80 0x7fa51819a480 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:15.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.930+0000 7fa520131640 1 -- 172.21.15.1:0/2253349556 >> 172.21.15.1:0/2253349556 conn(0x7fa518079740 msgr2=0x7fa518106730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:15.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.930+0000 7fa520131640 1 -- 172.21.15.1:0/2253349556 shutdown_connections 2024-09-21T00:55:15.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:15.930+0000 7fa520131640 1 -- 172.21.15.1:0/2253349556 wait complete. 2024-09-21T00:55:15.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:15 smithi193 ceph-mon[34660]: pgmap v297: 97 pgs: 97 active+clean; 591 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 5.2 KiB/s wr, 20 op/s 2024-09-21T00:55:15.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:15 smithi193 ceph-mon[34660]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:15.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:15 smithi193 ceph-mon[34660]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-21T00:55:15.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:15 smithi042 ceph-mon[34481]: pgmap v297: 97 pgs: 97 active+clean; 591 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 5.2 KiB/s wr, 20 op/s 2024-09-21T00:55:15.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:15 smithi042 ceph-mon[34481]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:15.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:15 smithi042 ceph-mon[34481]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-21T00:55:16.782 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-21T00:55:17.043 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:17.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.580+0000 7fe7309a5640 1 -- 172.21.15.1:0/3187340941 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe72c108d30 msgr2=0x7fe72c10f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:17.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.580+0000 7fe7309a5640 1 --2- 172.21.15.1:0/3187340941 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe72c108d30 0x7fe72c10f560 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe724009ca0 tx=0x7fe72402a8c0 comp rx=0 tx=0).stop 2024-09-21T00:55:17.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.580+0000 7fe7309a5640 1 -- 172.21.15.1:0/3187340941 shutdown_connections 2024-09-21T00:55:17.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.580+0000 7fe7309a5640 1 --2- 172.21.15.1:0/3187340941 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe72c108d30 0x7fe72c10f560 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:17.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.580+0000 7fe7309a5640 1 --2- 172.21.15.1:0/3187340941 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe72c1083e0 0x7fe72c1087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:17.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.580+0000 7fe7309a5640 1 --2- 172.21.15.1:0/3187340941 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe72c102aa0 0x7fe72c102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:17.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.580+0000 7fe7309a5640 1 -- 172.21.15.1:0/3187340941 >> 172.21.15.1:0/3187340941 conn(0x7fe72c079750 msgr2=0x7fe72c079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:17.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.580+0000 7fe7309a5640 1 -- 172.21.15.1:0/3187340941 shutdown_connections 2024-09-21T00:55:17.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.580+0000 7fe7309a5640 1 -- 172.21.15.1:0/3187340941 wait complete. 2024-09-21T00:55:17.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.581+0000 7fe7309a5640 1 Processor -- start 2024-09-21T00:55:17.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.581+0000 7fe7309a5640 1 -- start start 2024-09-21T00:55:17.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.581+0000 7fe7309a5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe72c102aa0 0x7fe72c19b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:17.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.581+0000 7fe7309a5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe72c1083e0 0x7fe72c19b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:17.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.581+0000 7fe7309a5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe72c108d30 0x7fe72c19bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:17.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.581+0000 7fe7309a5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe72c112a40 con 0x7fe72c102aa0 2024-09-21T00:55:17.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.581+0000 7fe7309a5640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe72c1128c0 con 0x7fe72c108d30 2024-09-21T00:55:17.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.581+0000 7fe7309a5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe72c112bc0 con 0x7fe72c1083e0 2024-09-21T00:55:17.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.581+0000 7fe72a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe72c102aa0 0x7fe72c19b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:17.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.581+0000 7fe72a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe72c102aa0 0x7fe72c19b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53272/0 (socket says 172.21.15.1:53272) 2024-09-21T00:55:17.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.581+0000 7fe72a59c640 1 -- 172.21.15.1:0/2076260715 learned_addr learned my addr 172.21.15.1:0/2076260715 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:17.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.581+0000 7fe729d9b640 1 --2- 172.21.15.1:0/2076260715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe72c1083e0 0x7fe72c19b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:17.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.581+0000 7fe72ad9d640 1 --2- 172.21.15.1:0/2076260715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe72c108d30 0x7fe72c19bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:17.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.581+0000 7fe72a59c640 1 -- 172.21.15.1:0/2076260715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe72c1083e0 msgr2=0x7fe72c19b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:17.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.581+0000 7fe72a59c640 1 --2- 172.21.15.1:0/2076260715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe72c1083e0 0x7fe72c19b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:17.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.581+0000 7fe72a59c640 1 -- 172.21.15.1:0/2076260715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe72c108d30 msgr2=0x7fe72c19bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:17.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.582+0000 7fe72a59c640 1 --2- 172.21.15.1:0/2076260715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe72c108d30 0x7fe72c19bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:17.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.582+0000 7fe72a59c640 1 -- 172.21.15.1:0/2076260715 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe72c1a6570 con 0x7fe72c102aa0 2024-09-21T00:55:17.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.582+0000 7fe72ad9d640 1 --2- 172.21.15.1:0/2076260715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe72c108d30 0x7fe72c19bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:55:17.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.582+0000 7fe72a59c640 1 --2- 172.21.15.1:0/2076260715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe72c102aa0 0x7fe72c19b2b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe71c00c890 tx=0x7fe71c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:17.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.582+0000 7fe7237fe640 1 -- 172.21.15.1:0/2076260715 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71c004220 con 0x7fe72c102aa0 2024-09-21T00:55:17.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.582+0000 7fe7309a5640 1 -- 172.21.15.1:0/2076260715 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe72c1a6860 con 0x7fe72c102aa0 2024-09-21T00:55:17.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.582+0000 7fe7237fe640 1 -- 172.21.15.1:0/2076260715 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe71c0043c0 con 0x7fe72c102aa0 2024-09-21T00:55:17.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.582+0000 7fe7237fe640 1 -- 172.21.15.1:0/2076260715 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71c004a00 con 0x7fe72c102aa0 2024-09-21T00:55:17.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.582+0000 7fe7309a5640 1 -- 172.21.15.1:0/2076260715 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe72c1a6df0 con 0x7fe72c102aa0 2024-09-21T00:55:17.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.583+0000 7fe7309a5640 1 -- 172.21.15.1:0/2076260715 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe72c103d20 con 0x7fe72c102aa0 2024-09-21T00:55:17.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.585+0000 7fe7237fe640 1 -- 172.21.15.1:0/2076260715 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7fe71c0079b0 con 0x7fe72c102aa0 2024-09-21T00:55:17.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.586+0000 7fe7237fe640 1 --2- 172.21.15.1:0/2076260715 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe7180b65a0 0x7fe7180b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:17.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.586+0000 7fe729d9b640 1 --2- 172.21.15.1:0/2076260715 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe7180b65a0 0x7fe7180b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:17.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.586+0000 7fe7237fe640 1 -- 172.21.15.1:0/2076260715 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fe71c0e7520 con 0x7fe72c102aa0 2024-09-21T00:55:17.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.587+0000 7fe729d9b640 1 --2- 172.21.15.1:0/2076260715 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe7180b65a0 0x7fe7180b8ab0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe714005fd0 tx=0x7fe714005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:17.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.589+0000 7fe7237fe640 1 -- 172.21.15.1:0/2076260715 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe71c014030 con 0x7fe72c102aa0 2024-09-21T00:55:17.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.805+0000 7fe7309a5640 1 -- 172.21.15.1:0/2076260715 --> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fe72c063800 con 0x7fe7180b65a0 2024-09-21T00:55:17.811 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:17 smithi001 ceph-mon[31211]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:17.811 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:17 smithi001 ceph-mon[31211]: pgmap v298: 97 pgs: 97 active+clean; 592 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.8 KiB/s wr, 20 op/s 2024-09-21T00:55:17.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.834+0000 7fe7237fe640 1 -- 172.21.15.1:0/2076260715 <== mgr.14150 v2:172.21.15.1:6800/2032980330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe72c063800 con 0x7fe7180b65a0 2024-09-21T00:55:17.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.836+0000 7fe7309a5640 1 -- 172.21.15.1:0/2076260715 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe7180b65a0 msgr2=0x7fe7180b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:17.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.836+0000 7fe7309a5640 1 --2- 172.21.15.1:0/2076260715 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe7180b65a0 0x7fe7180b8ab0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe714005fd0 tx=0x7fe714005850 comp rx=0 tx=0).stop 2024-09-21T00:55:17.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.836+0000 7fe7309a5640 1 -- 172.21.15.1:0/2076260715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe72c102aa0 msgr2=0x7fe72c19b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:17.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.836+0000 7fe7309a5640 1 --2- 172.21.15.1:0/2076260715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe72c102aa0 0x7fe72c19b2b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe71c00c890 tx=0x7fe71c00cd50 comp rx=0 tx=0).stop 2024-09-21T00:55:17.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.836+0000 7fe7309a5640 1 -- 172.21.15.1:0/2076260715 shutdown_connections 2024-09-21T00:55:17.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.836+0000 7fe7309a5640 1 --2- 172.21.15.1:0/2076260715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe72c108d30 0x7fe72c19bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:17.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.836+0000 7fe7309a5640 1 --2- 172.21.15.1:0/2076260715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe72c1083e0 0x7fe72c19b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:17.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.836+0000 7fe7309a5640 1 --2- 172.21.15.1:0/2076260715 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe7180b65a0 0x7fe7180b8ab0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:17.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.836+0000 7fe7309a5640 1 --2- 172.21.15.1:0/2076260715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe72c102aa0 0x7fe72c19b2b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:17.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.836+0000 7fe7309a5640 1 -- 172.21.15.1:0/2076260715 >> 172.21.15.1:0/2076260715 conn(0x7fe72c079750 msgr2=0x7fe72c1063d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:17.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.836+0000 7fe7309a5640 1 -- 172.21.15.1:0/2076260715 shutdown_connections 2024-09-21T00:55:17.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:17.836+0000 7fe7309a5640 1 -- 172.21.15.1:0/2076260715 wait complete. 2024-09-21T00:55:17.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:17 smithi193 ceph-mon[34660]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:17.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:17 smithi193 ceph-mon[34660]: pgmap v298: 97 pgs: 97 active+clean; 592 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.8 KiB/s wr, 20 op/s 2024-09-21T00:55:17.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:17 smithi042 ceph-mon[34481]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:17.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:17 smithi042 ceph-mon[34481]: pgmap v298: 97 pgs: 97 active+clean; 592 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.8 KiB/s wr, 20 op/s 2024-09-21T00:55:18.545 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-21T00:55:18.807 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:18.922 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:18 smithi001 ceph-mon[31211]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:18.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:18 smithi193 ceph-mon[34660]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:18.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:18 smithi042 ceph-mon[34481]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:19.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.270+0000 7fcebf9c5640 1 -- 172.21.15.1:0/331973960 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fceb8103b70 msgr2=0x7fceb8103f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:19.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.270+0000 7fcebf9c5640 1 --2- 172.21.15.1:0/331973960 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fceb8103b70 0x7fceb8103f80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fceb4009900 tx=0x7fceb402a410 comp rx=0 tx=0).stop 2024-09-21T00:55:19.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.270+0000 7fcebf9c5640 1 -- 172.21.15.1:0/331973960 shutdown_connections 2024-09-21T00:55:19.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.270+0000 7fcebf9c5640 1 --2- 172.21.15.1:0/331973960 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fceb8109e00 0x7fceb8110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:19.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.270+0000 7fcebf9c5640 1 --2- 172.21.15.1:0/331973960 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fceb81094b0 0x7fceb81098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:19.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.270+0000 7fcebf9c5640 1 --2- 172.21.15.1:0/331973960 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fceb8103b70 0x7fceb8103f80 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:19.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.270+0000 7fcebf9c5640 1 -- 172.21.15.1:0/331973960 >> 172.21.15.1:0/331973960 conn(0x7fceb80ff5e0 msgr2=0x7fceb8101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:19.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.270+0000 7fcebf9c5640 1 -- 172.21.15.1:0/331973960 shutdown_connections 2024-09-21T00:55:19.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.270+0000 7fcebf9c5640 1 -- 172.21.15.1:0/331973960 wait complete. 2024-09-21T00:55:19.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.271+0000 7fcebf9c5640 1 Processor -- start 2024-09-21T00:55:19.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.271+0000 7fcebf9c5640 1 -- start start 2024-09-21T00:55:19.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.271+0000 7fcebf9c5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fceb8103b70 0x7fceb819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:19.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.271+0000 7fcebf9c5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fceb81094b0 0x7fceb819aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:19.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.271+0000 7fcebf9c5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fceb8109e00 0x7fceb819fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:19.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.271+0000 7fcebf9c5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fceb8113ac0 con 0x7fceb8103b70 2024-09-21T00:55:19.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.271+0000 7fcebf9c5640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fceb8113940 con 0x7fceb8109e00 2024-09-21T00:55:19.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.271+0000 7fcebf9c5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fceb8113c40 con 0x7fceb81094b0 2024-09-21T00:55:19.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.271+0000 7fcebd761640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fceb8103b70 0x7fceb819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:19.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.271+0000 7fcebd761640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fceb8103b70 0x7fceb819a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57646/0 (socket says 172.21.15.1:57646) 2024-09-21T00:55:19.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.272+0000 7fcebd761640 1 -- 172.21.15.1:0/2589249337 learned_addr learned my addr 172.21.15.1:0/2589249337 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:19.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.272+0000 7fcebcf60640 1 --2- 172.21.15.1:0/2589249337 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fceb81094b0 0x7fceb819aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:19.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.272+0000 7fcebdf62640 1 --2- 172.21.15.1:0/2589249337 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fceb8109e00 0x7fceb819fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:19.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.272+0000 7fcebd761640 1 -- 172.21.15.1:0/2589249337 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fceb81094b0 msgr2=0x7fceb819aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:19.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.272+0000 7fcebd761640 1 --2- 172.21.15.1:0/2589249337 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fceb81094b0 0x7fceb819aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:19.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.272+0000 7fcebd761640 1 -- 172.21.15.1:0/2589249337 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fceb8109e00 msgr2=0x7fceb819fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:19.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.272+0000 7fcebd761640 1 --2- 172.21.15.1:0/2589249337 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fceb8109e00 0x7fceb819fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:19.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.272+0000 7fcebd761640 1 -- 172.21.15.1:0/2589249337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceb81a03e0 con 0x7fceb8103b70 2024-09-21T00:55:19.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.272+0000 7fcebcf60640 1 --2- 172.21.15.1:0/2589249337 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fceb81094b0 0x7fceb819aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:55:19.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.272+0000 7fcebdf62640 1 --2- 172.21.15.1:0/2589249337 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fceb8109e00 0x7fceb819fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:55:19.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.272+0000 7fcebd761640 1 --2- 172.21.15.1:0/2589249337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fceb8103b70 0x7fceb819a470 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fceb4005940 tx=0x7fceb4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:19.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.272+0000 7fceae7fc640 1 -- 172.21.15.1:0/2589249337 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb403f030 con 0x7fceb8103b70 2024-09-21T00:55:19.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.272+0000 7fceae7fc640 1 -- 172.21.15.1:0/2589249337 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fceb4003aa0 con 0x7fceb8103b70 2024-09-21T00:55:19.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.272+0000 7fcebf9c5640 1 -- 172.21.15.1:0/2589249337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fceb81a0670 con 0x7fceb8103b70 2024-09-21T00:55:19.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.272+0000 7fceae7fc640 1 -- 172.21.15.1:0/2589249337 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb4035070 con 0x7fceb8103b70 2024-09-21T00:55:19.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.272+0000 7fcebf9c5640 1 -- 172.21.15.1:0/2589249337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fceb81a6e30 con 0x7fceb8103b70 2024-09-21T00:55:19.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.273+0000 7fcebf9c5640 1 -- 172.21.15.1:0/2589249337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fceb8104df0 con 0x7fceb8103b70 2024-09-21T00:55:19.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.276+0000 7fceae7fc640 1 -- 172.21.15.1:0/2589249337 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7fceb4042030 con 0x7fceb8103b70 2024-09-21T00:55:19.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.276+0000 7fceae7fc640 1 --2- 172.21.15.1:0/2589249337 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fcea40b6620 0x7fcea40b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:19.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.277+0000 7fcebcf60640 1 --2- 172.21.15.1:0/2589249337 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fcea40b6620 0x7fcea40b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:19.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.277+0000 7fceae7fc640 1 -- 172.21.15.1:0/2589249337 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fceb4107d00 con 0x7fceb8103b70 2024-09-21T00:55:19.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.277+0000 7fcebcf60640 1 --2- 172.21.15.1:0/2589249337 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fcea40b6620 0x7fcea40b8b30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcea8005d00 tx=0x7fcea8005ed0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:19.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.280+0000 7fceae7fc640 1 -- 172.21.15.1:0/2589249337 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fceb40ce5e0 con 0x7fceb8103b70 2024-09-21T00:55:19.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.497+0000 7fcebf9c5640 1 -- 172.21.15.1:0/2589249337 --> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fceb8063800 con 0x7fcea40b6620 2024-09-21T00:55:19.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.503+0000 7fceae7fc640 1 -- 172.21.15.1:0/2589249337 <== mgr.14150 v2:172.21.15.1:6800/2032980330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fceb8063800 con 0x7fcea40b6620 2024-09-21T00:55:19.505 INFO:teuthology.orchestra.run.smithi001.stdout:/volumes/qa/sv_1/8951b59d-e05c-4790-b838-6f047983b9c5 2024-09-21T00:55:19.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.505+0000 7fcebf9c5640 1 -- 172.21.15.1:0/2589249337 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fcea40b6620 msgr2=0x7fcea40b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:19.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.505+0000 7fcebf9c5640 1 --2- 172.21.15.1:0/2589249337 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fcea40b6620 0x7fcea40b8b30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcea8005d00 tx=0x7fcea8005ed0 comp rx=0 tx=0).stop 2024-09-21T00:55:19.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.505+0000 7fcebf9c5640 1 -- 172.21.15.1:0/2589249337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fceb8103b70 msgr2=0x7fceb819a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:19.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.505+0000 7fcebf9c5640 1 --2- 172.21.15.1:0/2589249337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fceb8103b70 0x7fceb819a470 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fceb4005940 tx=0x7fceb4004270 comp rx=0 tx=0).stop 2024-09-21T00:55:19.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.505+0000 7fcebf9c5640 1 -- 172.21.15.1:0/2589249337 shutdown_connections 2024-09-21T00:55:19.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.506+0000 7fcebf9c5640 1 --2- 172.21.15.1:0/2589249337 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fceb8109e00 0x7fceb819fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:19.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.506+0000 7fcebf9c5640 1 --2- 172.21.15.1:0/2589249337 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fceb81094b0 0x7fceb819aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:19.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.506+0000 7fcebf9c5640 1 --2- 172.21.15.1:0/2589249337 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fcea40b6620 0x7fcea40b8b30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:19.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.506+0000 7fcebf9c5640 1 --2- 172.21.15.1:0/2589249337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fceb8103b70 0x7fceb819a470 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:19.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.506+0000 7fcebf9c5640 1 -- 172.21.15.1:0/2589249337 >> 172.21.15.1:0/2589249337 conn(0x7fceb80ff5e0 msgr2=0x7fceb8101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:19.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.506+0000 7fcebf9c5640 1 -- 172.21.15.1:0/2589249337 shutdown_connections 2024-09-21T00:55:19.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:19.506+0000 7fcebf9c5640 1 -- 172.21.15.1:0/2589249337 wait complete. 2024-09-21T00:55:19.870 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:19 smithi001 ceph-mon[31211]: pgmap v299: 97 pgs: 97 active+clean; 592 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.0 KiB/s wr, 21 op/s 2024-09-21T00:55:19.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:19 smithi193 ceph-mon[34660]: pgmap v299: 97 pgs: 97 active+clean; 592 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.0 KiB/s wr, 21 op/s 2024-09-21T00:55:19.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:19 smithi042 ceph-mon[34481]: pgmap v299: 97 pgs: 97 active+clean; 592 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.0 KiB/s wr, 21 op/s 2024-09-21T00:55:20.195 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:55:20.452 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:20.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:20 smithi001 ceph-mon[31211]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:20.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.932+0000 7fd051e8b640 1 -- 172.21.15.1:0/2407846023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd04c103b60 msgr2=0x7fd04c103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:20.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.932+0000 7fd051e8b640 1 --2- 172.21.15.1:0/2407846023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd04c103b60 0x7fd04c103f70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd03c009900 tx=0x7fd03c02a410 comp rx=0 tx=0).stop 2024-09-21T00:55:20.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.932+0000 7fd051e8b640 1 -- 172.21.15.1:0/2407846023 shutdown_connections 2024-09-21T00:55:20.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.932+0000 7fd051e8b640 1 --2- 172.21.15.1:0/2407846023 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd04c109df0 0x7fd04c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:20.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.932+0000 7fd051e8b640 1 --2- 172.21.15.1:0/2407846023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd04c1094a0 0x7fd04c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:20.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.932+0000 7fd051e8b640 1 --2- 172.21.15.1:0/2407846023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd04c103b60 0x7fd04c103f70 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:20.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.932+0000 7fd051e8b640 1 -- 172.21.15.1:0/2407846023 >> 172.21.15.1:0/2407846023 conn(0x7fd04c07b850 msgr2=0x7fd04c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:20.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.932+0000 7fd051e8b640 1 -- 172.21.15.1:0/2407846023 shutdown_connections 2024-09-21T00:55:20.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.932+0000 7fd051e8b640 1 -- 172.21.15.1:0/2407846023 wait complete. 2024-09-21T00:55:20.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.932+0000 7fd051e8b640 1 Processor -- start 2024-09-21T00:55:20.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.933+0000 7fd051e8b640 1 -- start start 2024-09-21T00:55:20.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.933+0000 7fd051e8b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd04c103b60 0x7fd04c19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:20.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.933+0000 7fd051e8b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd04c1094a0 0x7fd04c19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:20.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.933+0000 7fd051e8b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd04c109df0 0x7fd04c19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:20.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.933+0000 7fd051e8b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd04c113ab0 con 0x7fd04c109df0 2024-09-21T00:55:20.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.933+0000 7fd051e8b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd04c113930 con 0x7fd04c1094a0 2024-09-21T00:55:20.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.933+0000 7fd051e8b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd04c113c30 con 0x7fd04c103b60 2024-09-21T00:55:20.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.933+0000 7fd04bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd04c109df0 0x7fd04c19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:20.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.933+0000 7fd04bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd04c109df0 0x7fd04c19fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57662/0 (socket says 172.21.15.1:57662) 2024-09-21T00:55:20.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.933+0000 7fd04bfff640 1 -- 172.21.15.1:0/1536969370 learned_addr learned my addr 172.21.15.1:0/1536969370 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:20.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.933+0000 7fd04b7fe640 1 --2- 172.21.15.1:0/1536969370 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd04c103b60 0x7fd04c19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:20.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.933+0000 7fd04affd640 1 --2- 172.21.15.1:0/1536969370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd04c1094a0 0x7fd04c19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:20.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.933+0000 7fd04bfff640 1 -- 172.21.15.1:0/1536969370 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd04c103b60 msgr2=0x7fd04c19a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:20.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.933+0000 7fd04bfff640 1 --2- 172.21.15.1:0/1536969370 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd04c103b60 0x7fd04c19a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:20.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.933+0000 7fd04bfff640 1 -- 172.21.15.1:0/1536969370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd04c1094a0 msgr2=0x7fd04c19aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:20.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.933+0000 7fd04bfff640 1 --2- 172.21.15.1:0/1536969370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd04c1094a0 0x7fd04c19aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:20.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.933+0000 7fd04bfff640 1 -- 172.21.15.1:0/1536969370 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd04c1a03f0 con 0x7fd04c109df0 2024-09-21T00:55:20.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.934+0000 7fd04affd640 1 --2- 172.21.15.1:0/1536969370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd04c1094a0 0x7fd04c19aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:55:20.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.934+0000 7fd04bfff640 1 --2- 172.21.15.1:0/1536969370 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd04c109df0 0x7fd04c19fcc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd04400eaa0 tx=0x7fd04400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:20.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.934+0000 7fd048ff9640 1 -- 172.21.15.1:0/1536969370 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04400cdb0 con 0x7fd04c109df0 2024-09-21T00:55:20.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.934+0000 7fd048ff9640 1 -- 172.21.15.1:0/1536969370 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd044005020 con 0x7fd04c109df0 2024-09-21T00:55:20.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.934+0000 7fd051e8b640 1 -- 172.21.15.1:0/1536969370 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd04c1a06e0 con 0x7fd04c109df0 2024-09-21T00:55:20.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.934+0000 7fd048ff9640 1 -- 172.21.15.1:0/1536969370 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0440116d0 con 0x7fd04c109df0 2024-09-21T00:55:20.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.934+0000 7fd051e8b640 1 -- 172.21.15.1:0/1536969370 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd04c1a6e40 con 0x7fd04c109df0 2024-09-21T00:55:20.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.935+0000 7fd051e8b640 1 -- 172.21.15.1:0/1536969370 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd04c103f70 con 0x7fd04c109df0 2024-09-21T00:55:20.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.937+0000 7fd048ff9640 1 -- 172.21.15.1:0/1536969370 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7fd0440051d0 con 0x7fd04c109df0 2024-09-21T00:55:20.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.937+0000 7fd048ff9640 1 --2- 172.21.15.1:0/1536969370 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd0340b65a0 0x7fd0340b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:20.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.938+0000 7fd04b7fe640 1 --2- 172.21.15.1:0/1536969370 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd0340b65a0 0x7fd0340b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:20.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.938+0000 7fd048ff9640 1 -- 172.21.15.1:0/1536969370 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fd0440e7970 con 0x7fd04c109df0 2024-09-21T00:55:20.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.938+0000 7fd04b7fe640 1 --2- 172.21.15.1:0/1536969370 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd0340b65a0 0x7fd0340b8ab0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd03c031440 tx=0x7fd03c005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:20.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:20.940+0000 7fd048ff9640 1 -- 172.21.15.1:0/1536969370 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd044016030 con 0x7fd04c109df0 2024-09-21T00:55:20.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:20 smithi193 ceph-mon[34660]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:20.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:20 smithi042 ceph-mon[34481]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:21.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:21.169+0000 7fd051e8b640 1 -- 172.21.15.1:0/1536969370 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd04c19b5b0 con 0x7fd04c109df0 2024-09-21T00:55:21.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:21.170+0000 7fd048ff9640 1 -- 172.21.15.1:0/1536969370 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11955 (secure 0 0 0) 0x7fd04c19b5b0 con 0x7fd04c109df0 2024-09-21T00:55:21.172 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:55:21.172 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":26,"btime":"2024-09-21T00:55:10:582235+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2810186677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2810186677},{"type":"v1","addr":"172.21.15.1:6835","nonce":2810186677}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14736,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3935320478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3935320478},{"type":"v1","addr":"172.21.15.1:6837","nonce":3935320478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:54:58.592853+0000","modified":"2024-09-21T00:55:09.837567+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24653,"mds_1":24637,"mds_2":24626,"mds_3":24622,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/2125703572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2125703572},{"type":"v1","addr":"172.21.15.1:6839","nonce":2125703572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/3860445313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860445313},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860445313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6833/712170939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":712170939},{"type":"v1","addr":"172.21.15.193:6833","nonce":712170939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6833/1653911656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1653911656},{"type":"v1","addr":"172.21.15.42:6833","nonce":1653911656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6835/793085918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":793085918},{"type":"v1","addr":"172.21.15.42:6835","nonce":793085918}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6835/3631682268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":3631682268},{"type":"v1","addr":"172.21.15.193:6835","nonce":3631682268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.193:6837/909252228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":909252228},{"type":"v1","addr":"172.21.15.193:6837","nonce":909252228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.42:6837/2395608508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2395608508},{"type":"v1","addr":"172.21.15.42:6837","nonce":2395608508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.193:6839/1365361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1365361177},{"type":"v1","addr":"172.21.15.193:6839","nonce":1365361177}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6839/2526476666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2526476666},{"type":"v1","addr":"172.21.15.42:6839","nonce":2526476666}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653,24637,24626,24622,24610]},"id":1}]} 2024-09-21T00:55:21.172 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 26 2024-09-21T00:55:21.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:21.172+0000 7fd051e8b640 1 -- 172.21.15.1:0/1536969370 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd0340b65a0 msgr2=0x7fd0340b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:21.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:21.172+0000 7fd051e8b640 1 --2- 172.21.15.1:0/1536969370 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd0340b65a0 0x7fd0340b8ab0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd03c031440 tx=0x7fd03c005d50 comp rx=0 tx=0).stop 2024-09-21T00:55:21.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:21.172+0000 7fd051e8b640 1 -- 172.21.15.1:0/1536969370 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd04c109df0 msgr2=0x7fd04c19fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:21.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:21.172+0000 7fd051e8b640 1 --2- 172.21.15.1:0/1536969370 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd04c109df0 0x7fd04c19fcc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd04400eaa0 tx=0x7fd04400ef60 comp rx=0 tx=0).stop 2024-09-21T00:55:21.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:21.173+0000 7fd051e8b640 1 -- 172.21.15.1:0/1536969370 shutdown_connections 2024-09-21T00:55:21.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:21.173+0000 7fd051e8b640 1 --2- 172.21.15.1:0/1536969370 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd0340b65a0 0x7fd0340b8ab0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:21.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:21.173+0000 7fd051e8b640 1 --2- 172.21.15.1:0/1536969370 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd04c109df0 0x7fd04c19fcc0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:21.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:21.173+0000 7fd051e8b640 1 --2- 172.21.15.1:0/1536969370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd04c1094a0 0x7fd04c19aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:21.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:21.173+0000 7fd051e8b640 1 --2- 172.21.15.1:0/1536969370 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd04c103b60 0x7fd04c19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:21.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:21.173+0000 7fd051e8b640 1 -- 172.21.15.1:0/1536969370 >> 172.21.15.1:0/1536969370 conn(0x7fd04c07b850 msgr2=0x7fd04c107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:21.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:21.173+0000 7fd051e8b640 1 -- 172.21.15.1:0/1536969370 shutdown_connections 2024-09-21T00:55:21.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:21.173+0000 7fd051e8b640 1 -- 172.21.15.1:0/1536969370 wait complete. 2024-09-21T00:55:21.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:21 smithi001 ceph-mon[31211]: pgmap v300: 97 pgs: 97 active+clean; 633 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 8.6 KiB/s wr, 23 op/s 2024-09-21T00:55:21.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:21 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1536969370' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:55:21.819 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T00:55:21.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:21 smithi193 ceph-mon[34660]: pgmap v300: 97 pgs: 97 active+clean; 633 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 8.6 KiB/s wr, 23 op/s 2024-09-21T00:55:21.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:21 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/1536969370' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:55:21.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:21 smithi042 ceph-mon[34481]: pgmap v300: 97 pgs: 97 active+clean; 633 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 8.6 KiB/s wr, 23 op/s 2024-09-21T00:55:21.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:21 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/1536969370' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:55:22.086 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:22.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.620+0000 7f42178a4640 1 -- 172.21.15.1:0/1951071428 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f421010de30 msgr2=0x7f4210110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:22.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.620+0000 7f42178a4640 1 --2- 172.21.15.1:0/1951071428 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f421010de30 0x7f4210110300 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4208009ca0 tx=0x7f420802a8c0 comp rx=0 tx=0).stop 2024-09-21T00:55:22.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.620+0000 7f42178a4640 1 -- 172.21.15.1:0/1951071428 shutdown_connections 2024-09-21T00:55:22.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.620+0000 7f42178a4640 1 --2- 172.21.15.1:0/1951071428 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f421010de30 0x7f4210110300 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:22.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.620+0000 7f42178a4640 1 --2- 172.21.15.1:0/1951071428 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42101052b0 0x7f421010d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:22.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.620+0000 7f42178a4640 1 --2- 172.21.15.1:0/1951071428 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4210104880 0x7f4210104c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:22.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.620+0000 7f42178a4640 1 -- 172.21.15.1:0/1951071428 >> 172.21.15.1:0/1951071428 conn(0x7f4210079730 msgr2=0x7f4210079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:22.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.620+0000 7f42178a4640 1 -- 172.21.15.1:0/1951071428 shutdown_connections 2024-09-21T00:55:22.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.620+0000 7f42178a4640 1 -- 172.21.15.1:0/1951071428 wait complete. 2024-09-21T00:55:22.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.621+0000 7f42178a4640 1 Processor -- start 2024-09-21T00:55:22.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.621+0000 7f42178a4640 1 -- start start 2024-09-21T00:55:22.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.622+0000 7f42178a4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4210104880 0x7f421019a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:22.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.622+0000 7f42178a4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42101052b0 0x7f421019a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:22.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.622+0000 7f42178a4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f421010de30 0x7f421019fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:22.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.622+0000 7f42178a4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4210113a70 con 0x7f421010de30 2024-09-21T00:55:22.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.622+0000 7f42178a4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f42101138f0 con 0x7f4210104880 2024-09-21T00:55:22.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.622+0000 7f42178a4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4210113bf0 con 0x7f42101052b0 2024-09-21T00:55:22.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.622+0000 7f4215e41640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f421010de30 0x7f421019fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:22.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.622+0000 7f4215e41640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f421010de30 0x7f421019fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57676/0 (socket says 172.21.15.1:57676) 2024-09-21T00:55:22.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.622+0000 7f4215e41640 1 -- 172.21.15.1:0/861117456 learned_addr learned my addr 172.21.15.1:0/861117456 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:22.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.622+0000 7f4215640640 1 --2- 172.21.15.1:0/861117456 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4210104880 0x7f421019a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:22.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.622+0000 7f4214e3f640 1 --2- 172.21.15.1:0/861117456 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42101052b0 0x7f421019a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:22.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.622+0000 7f4215e41640 1 -- 172.21.15.1:0/861117456 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42101052b0 msgr2=0x7f421019a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:22.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.622+0000 7f4215e41640 1 --2- 172.21.15.1:0/861117456 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42101052b0 0x7f421019a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:22.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.622+0000 7f4215e41640 1 -- 172.21.15.1:0/861117456 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4210104880 msgr2=0x7f421019a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:22.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.622+0000 7f4215e41640 1 --2- 172.21.15.1:0/861117456 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4210104880 0x7f421019a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:22.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.622+0000 7f4215e41640 1 -- 172.21.15.1:0/861117456 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42101a0350 con 0x7f421010de30 2024-09-21T00:55:22.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.622+0000 7f4215e41640 1 --2- 172.21.15.1:0/861117456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f421010de30 0x7f421019fc20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4208005cc0 tx=0x7f420802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:22.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.622+0000 7f42067fc640 1 -- 172.21.15.1:0/861117456 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4208003bf0 con 0x7f421010de30 2024-09-21T00:55:22.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.623+0000 7f42067fc640 1 -- 172.21.15.1:0/861117456 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4208003d90 con 0x7f421010de30 2024-09-21T00:55:22.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.623+0000 7f42178a4640 1 -- 172.21.15.1:0/861117456 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42101a05e0 con 0x7f421010de30 2024-09-21T00:55:22.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.623+0000 7f42067fc640 1 -- 172.21.15.1:0/861117456 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f420802fbc0 con 0x7f421010de30 2024-09-21T00:55:22.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.623+0000 7f42178a4640 1 -- 172.21.15.1:0/861117456 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42101a6da0 con 0x7f421010de30 2024-09-21T00:55:22.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.624+0000 7f42178a4640 1 -- 172.21.15.1:0/861117456 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4210104c90 con 0x7f421010de30 2024-09-21T00:55:22.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.625+0000 7f42067fc640 1 -- 172.21.15.1:0/861117456 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7f420802fd60 con 0x7f421010de30 2024-09-21T00:55:22.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.626+0000 7f42067fc640 1 --2- 172.21.15.1:0/861117456 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f41fc0b65a0 0x7f41fc0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:22.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.626+0000 7f4215640640 1 --2- 172.21.15.1:0/861117456 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f41fc0b65a0 0x7f41fc0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:22.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.626+0000 7f42067fc640 1 -- 172.21.15.1:0/861117456 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f42081089d0 con 0x7f421010de30 2024-09-21T00:55:22.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.626+0000 7f4215640640 1 --2- 172.21.15.1:0/861117456 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f41fc0b65a0 0x7f41fc0b8ab0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f420c005fd0 tx=0x7f420c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:22.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.629+0000 7f42067fc640 1 -- 172.21.15.1:0/861117456 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f42080cf1b0 con 0x7f421010de30 2024-09-21T00:55:22.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.816+0000 7f42178a4640 1 -- 172.21.15.1:0/861117456 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f42101a6fd0 con 0x7f421010de30 2024-09-21T00:55:22.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.819+0000 7f42067fc640 1 -- 172.21.15.1:0/861117456 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+22193 (secure 0 0 0) 0x7f42080ca070 con 0x7f421010de30 2024-09-21T00:55:22.821 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:55:22.821 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":73,"fsid":"d3972c20-77b2-11ef-baf5-efdc52797490","created":"2024-09-21T00:46:29.745963+0000","modified":"2024-09-21T00:54:58.592898+0000","last_up_change":"2024-09-21T00:54:07.552837+0000","last_in_change":"2024-09-21T00:53:44.164415+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:50:16.456462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:54:54.305306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:54:56.506872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5bf09a34-4d6e-401c-8cef-29bbe72de68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6803","nonce":4067586847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6805","nonce":4067586847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6809","nonce":4067586847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6807","nonce":4067586847}]},"public_addr":"172.21.15.1:6803/4067586847","cluster_addr":"172.21.15.1:6805/4067586847","heartbeat_back_addr":"172.21.15.1:6809/4067586847","heartbeat_front_addr":"172.21.15.1:6807/4067586847","state":["exists","up"]},{"osd":1,"uuid":"195f9109-ef61-46be-a59a-d72e3a1b5b45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6801","nonce":436964633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6803","nonce":436964633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6807","nonce":436964633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6805","nonce":436964633}]},"public_addr":"172.21.15.42:6801/436964633","cluster_addr":"172.21.15.42:6803/436964633","heartbeat_back_addr":"172.21.15.42:6807/436964633","heartbeat_front_addr":"172.21.15.42:6805/436964633","state":["exists","up"]},{"osd":2,"uuid":"47cf90a7-6db6-464a-84ef-9f509f89a46b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6801","nonce":3495400570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6803","nonce":3495400570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6807","nonce":3495400570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6805","nonce":3495400570}]},"public_addr":"172.21.15.193:6801/3495400570","cluster_addr":"172.21.15.193:6803/3495400570","heartbeat_back_addr":"172.21.15.193:6807/3495400570","heartbeat_front_addr":"172.21.15.193:6805/3495400570","state":["exists","up"]},{"osd":3,"uuid":"a5230a66-3c74-41a7-9353-5650780ed25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6811","nonce":3221661671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6813","nonce":3221661671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6817","nonce":3221661671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6815","nonce":3221661671}]},"public_addr":"172.21.15.1:6811/3221661671","cluster_addr":"172.21.15.1:6813/3221661671","heartbeat_back_addr":"172.21.15.1:6817/3221661671","heartbeat_front_addr":"172.21.15.1:6815/3221661671","state":["exists","up"]},{"osd":4,"uuid":"b0476b9b-3257-46d4-aff7-1f038286ed43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6809","nonce":2066388104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6811","nonce":2066388104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6815","nonce":2066388104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6813","nonce":2066388104}]},"public_addr":"172.21.15.42:6809/2066388104","cluster_addr":"172.21.15.42:6811/2066388104","heartbeat_back_addr":"172.21.15.42:6815/2066388104","heartbeat_front_addr":"172.21.15.42:6813/2066388104","state":["exists","up"]},{"osd":5,"uuid":"96701ced-a55a-4ad9-be62-7f102c00697d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6809","nonce":732336675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6811","nonce":732336675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6815","nonce":732336675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6813","nonce":732336675}]},"public_addr":"172.21.15.193:6809/732336675","cluster_addr":"172.21.15.193:6811/732336675","heartbeat_back_addr":"172.21.15.193:6815/732336675","heartbeat_front_addr":"172.21.15.193:6813/732336675","state":["exists","up"]},{"osd":6,"uuid":"72d76017-e2e3-4118-8316-2c5da01c87b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6819","nonce":3201517067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6821","nonce":3201517067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6825","nonce":3201517067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6823","nonce":3201517067}]},"public_addr":"172.21.15.1:6819/3201517067","cluster_addr":"172.21.15.1:6821/3201517067","heartbeat_back_addr":"172.21.15.1:6825/3201517067","heartbeat_front_addr":"172.21.15.1:6823/3201517067","state":["exists","up"]},{"osd":7,"uuid":"8b239f96-2455-41b6-a905-9ed92078b890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6817","nonce":2124927218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6819","nonce":2124927218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6823","nonce":2124927218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6821","nonce":2124927218}]},"public_addr":"172.21.15.42:6817/2124927218","cluster_addr":"172.21.15.42:6819/2124927218","heartbeat_back_addr":"172.21.15.42:6823/2124927218","heartbeat_front_addr":"172.21.15.42:6821/2124927218","state":["exists","up"]},{"osd":8,"uuid":"8cd93aeb-fe00-4291-9f72-171d01893819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6817","nonce":2277449259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6819","nonce":2277449259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6823","nonce":2277449259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6821","nonce":2277449259}]},"public_addr":"172.21.15.193:6817/2277449259","cluster_addr":"172.21.15.193:6819/2277449259","heartbeat_back_addr":"172.21.15.193:6823/2277449259","heartbeat_front_addr":"172.21.15.193:6821/2277449259","state":["exists","up"]},{"osd":9,"uuid":"9e03e00b-0015-4aa8-adce-0d3352d2ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6827","nonce":1369323215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6829","nonce":1369323215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6833","nonce":1369323215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6831","nonce":1369323215}]},"public_addr":"172.21.15.1:6827/1369323215","cluster_addr":"172.21.15.1:6829/1369323215","heartbeat_back_addr":"172.21.15.1:6833/1369323215","heartbeat_front_addr":"172.21.15.1:6831/1369323215","state":["exists","up"]},{"osd":10,"uuid":"de55a908-b049-4f40-865f-cfa2ae6e461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6825","nonce":3182218295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6827","nonce":3182218295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6831","nonce":3182218295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6829","nonce":3182218295}]},"public_addr":"172.21.15.42:6825/3182218295","cluster_addr":"172.21.15.42:6827/3182218295","heartbeat_back_addr":"172.21.15.42:6831/3182218295","heartbeat_front_addr":"172.21.15.42:6829/3182218295","state":["exists","up"]},{"osd":11,"uuid":"1cac0c39-77aa-460b-92a0-39ed89cd6ce4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6825","nonce":2368815522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6827","nonce":2368815522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6831","nonce":2368815522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6829","nonce":2368815522}]},"public_addr":"172.21.15.193:6825/2368815522","cluster_addr":"172.21.15.193:6827/2368815522","heartbeat_back_addr":"172.21.15.193:6831/2368815522","heartbeat_front_addr":"172.21.15.193:6829/2368815522","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:49:21.491443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:49:47.486846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:50:12.757383+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:50:39.127690+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:05.545277+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:30.617491+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:57.612088+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:24.001953+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:48.447388+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:14.620538+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:40.503576+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:54:05.668236+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6801/59685083":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/309615464":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/1722941514":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/1199175740":"2024-09-22T00:47:25.985486+0000","172.21.15.1:6800/59685083":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/2811453932":"2024-09-22T00:46:58.953779+0000","172.21.15.1:0/3748689057":"2024-09-22T00:46:58.953779+0000","172.21.15.1:0/265697975":"2024-09-22T00:46:58.953779+0000","172.21.15.1:6801/1968786311":"2024-09-22T00:46:58.953779+0000","172.21.15.1:6800/1968786311":"2024-09-22T00:46:58.953779+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:55:22.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.821+0000 7f42178a4640 1 -- 172.21.15.1:0/861117456 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f41fc0b65a0 msgr2=0x7f41fc0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:22.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.821+0000 7f42178a4640 1 --2- 172.21.15.1:0/861117456 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f41fc0b65a0 0x7f41fc0b8ab0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f420c005fd0 tx=0x7f420c00b390 comp rx=0 tx=0).stop 2024-09-21T00:55:22.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.821+0000 7f42178a4640 1 -- 172.21.15.1:0/861117456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f421010de30 msgr2=0x7f421019fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:22.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.821+0000 7f42178a4640 1 --2- 172.21.15.1:0/861117456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f421010de30 0x7f421019fc20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4208005cc0 tx=0x7f420802f380 comp rx=0 tx=0).stop 2024-09-21T00:55:22.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.821+0000 7f42178a4640 1 -- 172.21.15.1:0/861117456 shutdown_connections 2024-09-21T00:55:22.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.821+0000 7f42178a4640 1 --2- 172.21.15.1:0/861117456 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f41fc0b65a0 0x7f41fc0b8ab0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:22.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.821+0000 7f42178a4640 1 --2- 172.21.15.1:0/861117456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f421010de30 0x7f421019fc20 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:22.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.821+0000 7f42178a4640 1 --2- 172.21.15.1:0/861117456 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42101052b0 0x7f421019a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:22.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.821+0000 7f42178a4640 1 --2- 172.21.15.1:0/861117456 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4210104880 0x7f421019a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:22.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.821+0000 7f42178a4640 1 -- 172.21.15.1:0/861117456 >> 172.21.15.1:0/861117456 conn(0x7f4210079730 msgr2=0x7f4210107960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:22.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.822+0000 7f42178a4640 1 -- 172.21.15.1:0/861117456 shutdown_connections 2024-09-21T00:55:22.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:22.822+0000 7f42178a4640 1 -- 172.21.15.1:0/861117456 wait complete. 2024-09-21T00:55:23.601 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T00:55:23.601 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T00:55:23.866 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:23.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:23 smithi001 ceph-mon[31211]: pgmap v301: 97 pgs: 97 active+clean; 634 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 7.9 KiB/s wr, 22 op/s 2024-09-21T00:55:23.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:23 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/861117456' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:55:23.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:23 smithi193 ceph-mon[34660]: pgmap v301: 97 pgs: 97 active+clean; 634 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 7.9 KiB/s wr, 22 op/s 2024-09-21T00:55:23.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:23 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/861117456' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:55:23.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:23 smithi042 ceph-mon[34481]: pgmap v301: 97 pgs: 97 active+clean; 634 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 7.9 KiB/s wr, 22 op/s 2024-09-21T00:55:23.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:23 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/861117456' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:55:24.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.377+0000 7fe5064d6640 1 -- 172.21.15.1:0/390240698 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe500103b60 msgr2=0x7fe500103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:24.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.377+0000 7fe5064d6640 1 --2- 172.21.15.1:0/390240698 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe500103b60 0x7fe500103f70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0009900 tx=0x7fe4f002a410 comp rx=0 tx=0).stop 2024-09-21T00:55:24.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.377+0000 7fe5064d6640 1 -- 172.21.15.1:0/390240698 shutdown_connections 2024-09-21T00:55:24.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.377+0000 7fe5064d6640 1 --2- 172.21.15.1:0/390240698 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe500109df0 0x7fe500110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:24.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.377+0000 7fe5064d6640 1 --2- 172.21.15.1:0/390240698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5001094a0 0x7fe5001098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:24.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.377+0000 7fe5064d6640 1 --2- 172.21.15.1:0/390240698 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe500103b60 0x7fe500103f70 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:24.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.377+0000 7fe5064d6640 1 -- 172.21.15.1:0/390240698 >> 172.21.15.1:0/390240698 conn(0x7fe50007b850 msgr2=0x7fe50007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:24.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.377+0000 7fe5064d6640 1 -- 172.21.15.1:0/390240698 shutdown_connections 2024-09-21T00:55:24.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.377+0000 7fe5064d6640 1 -- 172.21.15.1:0/390240698 wait complete. 2024-09-21T00:55:24.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.378+0000 7fe5064d6640 1 Processor -- start 2024-09-21T00:55:24.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.378+0000 7fe5064d6640 1 -- start start 2024-09-21T00:55:24.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.379+0000 7fe5064d6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe500103b60 0x7fe500075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:24.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.379+0000 7fe5064d6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5001094a0 0x7fe500075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:24.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.379+0000 7fe5064d6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe500109df0 0x7fe500076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:24.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.379+0000 7fe5064d6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe500113b00 con 0x7fe5001094a0 2024-09-21T00:55:24.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.379+0000 7fe5064d6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe500113980 con 0x7fe500103b60 2024-09-21T00:55:24.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.379+0000 7fe5064d6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe500113c80 con 0x7fe500109df0 2024-09-21T00:55:24.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.379+0000 7fe4f7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5001094a0 0x7fe500075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:24.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.379+0000 7fe4f7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5001094a0 0x7fe500075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57700/0 (socket says 172.21.15.1:57700) 2024-09-21T00:55:24.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.379+0000 7fe4f7fff640 1 -- 172.21.15.1:0/2730706403 learned_addr learned my addr 172.21.15.1:0/2730706403 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:24.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.379+0000 7fe4fffff640 1 --2- 172.21.15.1:0/2730706403 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe500103b60 0x7fe500075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:24.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.379+0000 7fe4f7fff640 1 -- 172.21.15.1:0/2730706403 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe500109df0 msgr2=0x7fe500076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:24.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.379+0000 7fe4f7fff640 1 --2- 172.21.15.1:0/2730706403 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe500109df0 0x7fe500076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:24.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.379+0000 7fe4f7fff640 1 -- 172.21.15.1:0/2730706403 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe500103b60 msgr2=0x7fe500075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:24.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.379+0000 7fe4f7fff640 1 --2- 172.21.15.1:0/2730706403 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe500103b60 0x7fe500075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:24.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.379+0000 7fe4f7fff640 1 -- 172.21.15.1:0/2730706403 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5001a86c0 con 0x7fe5001094a0 2024-09-21T00:55:24.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.379+0000 7fe4f7fff640 1 --2- 172.21.15.1:0/2730706403 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5001094a0 0x7fe500075c50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe4e800d740 tx=0x7fe4e800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:24.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.379+0000 7fe4fdffb640 1 -- 172.21.15.1:0/2730706403 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8017070 con 0x7fe5001094a0 2024-09-21T00:55:24.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.379+0000 7fe4fdffb640 1 -- 172.21.15.1:0/2730706403 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4e800de50 con 0x7fe5001094a0 2024-09-21T00:55:24.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.379+0000 7fe4fdffb640 1 -- 172.21.15.1:0/2730706403 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e800f620 con 0x7fe5001094a0 2024-09-21T00:55:24.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.380+0000 7fe5064d6640 1 -- 172.21.15.1:0/2730706403 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5001a89b0 con 0x7fe5001094a0 2024-09-21T00:55:24.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.380+0000 7fe5064d6640 1 -- 172.21.15.1:0/2730706403 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5001a8ea0 con 0x7fe5001094a0 2024-09-21T00:55:24.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.381+0000 7fe5064d6640 1 -- 172.21.15.1:0/2730706403 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe500103f70 con 0x7fe5001094a0 2024-09-21T00:55:24.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.382+0000 7fe4fdffb640 1 -- 172.21.15.1:0/2730706403 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7fe4e801a070 con 0x7fe5001094a0 2024-09-21T00:55:24.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.383+0000 7fe4fdffb640 1 --2- 172.21.15.1:0/2730706403 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe4ec0b6620 0x7fe4ec0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:24.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.383+0000 7fe4fffff640 1 --2- 172.21.15.1:0/2730706403 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe4ec0b6620 0x7fe4ec0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:24.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.383+0000 7fe4fdffb640 1 -- 172.21.15.1:0/2730706403 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fe4e80e6e70 con 0x7fe5001094a0 2024-09-21T00:55:24.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.383+0000 7fe4fffff640 1 --2- 172.21.15.1:0/2730706403 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe4ec0b6620 0x7fe4ec0b8b30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0006010 tx=0x7fe4f0031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:24.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.388+0000 7fe4fdffb640 1 -- 172.21.15.1:0/2730706403 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe4e80ad650 con 0x7fe5001094a0 2024-09-21T00:55:24.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.572+0000 7fe5064d6640 1 -- 172.21.15.1:0/2730706403 --> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe50002e6a0 con 0x7fe4ec0b6620 2024-09-21T00:55:24.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.576+0000 7fe4fdffb640 1 -- 172.21.15.1:0/2730706403 <== mgr.14150 v2:172.21.15.1:6800/2032980330 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258957 (secure 0 0 0) 0x7fe50002e6a0 con 0x7fe4ec0b6620 2024-09-21T00:55:24.580 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:55:24.581 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-21T00:55:24.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.582+0000 7fe5064d6640 1 -- 172.21.15.1:0/2730706403 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe4ec0b6620 msgr2=0x7fe4ec0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:24.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.582+0000 7fe5064d6640 1 --2- 172.21.15.1:0/2730706403 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe4ec0b6620 0x7fe4ec0b8b30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0006010 tx=0x7fe4f0031400 comp rx=0 tx=0).stop 2024-09-21T00:55:24.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.582+0000 7fe5064d6640 1 -- 172.21.15.1:0/2730706403 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5001094a0 msgr2=0x7fe500075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:24.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.582+0000 7fe5064d6640 1 --2- 172.21.15.1:0/2730706403 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5001094a0 0x7fe500075c50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe4e800d740 tx=0x7fe4e800dc00 comp rx=0 tx=0).stop 2024-09-21T00:55:24.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.582+0000 7fe5064d6640 1 -- 172.21.15.1:0/2730706403 shutdown_connections 2024-09-21T00:55:24.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.582+0000 7fe5064d6640 1 --2- 172.21.15.1:0/2730706403 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe500109df0 0x7fe500076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:24.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.582+0000 7fe5064d6640 1 --2- 172.21.15.1:0/2730706403 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe4ec0b6620 0x7fe4ec0b8b30 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:24.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.582+0000 7fe5064d6640 1 --2- 172.21.15.1:0/2730706403 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5001094a0 0x7fe500075c50 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:24.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.582+0000 7fe5064d6640 1 --2- 172.21.15.1:0/2730706403 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe500103b60 0x7fe500075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:24.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.582+0000 7fe5064d6640 1 -- 172.21.15.1:0/2730706403 >> 172.21.15.1:0/2730706403 conn(0x7fe50007b850 msgr2=0x7fe500107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:24.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.582+0000 7fe5064d6640 1 -- 172.21.15.1:0/2730706403 shutdown_connections 2024-09-21T00:55:24.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:24.582+0000 7fe5064d6640 1 -- 172.21.15.1:0/2730706403 wait complete. 2024-09-21T00:55:25.434 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":302,"stamp":"2024-09-21T00:55:24.089494+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656898,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":243,"num_read_kb":212,"num_write":359,"num_write_kb":2285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":297,"ondisk_log_size":297,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":379900,"kb_used_data":9852,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124561924,"statfs":{"total":1151940427776,"available":1151551410176,"internally_reserved":0,"allocated":10088448,"data_stored":6470082,"data_compressed":113910,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":59202,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":145,"num_read_kb":130,"num_write":49,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003326"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.870914+0000","last_change":"2024-09-21T00:54:57.879464+0000","last_active":"2024-09-21T00:54:58.870914+0000","last_peered":"2024-09-21T00:54:58.870914+0000","last_clean":"2024-09-21T00:54:58.870914+0000","last_became_active":"2024-09-21T00:54:57.878480+0000","last_became_peered":"2024-09-21T00:54:57.878480+0000","last_unstale":"2024-09-21T00:54:58.870914+0000","last_undegraded":"2024-09-21T00:54:58.870914+0000","last_fullsized":"2024-09-21T00:54:58.870914+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:28.056410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.869678+0000","last_change":"2024-09-21T00:54:57.866876+0000","last_active":"2024-09-21T00:54:58.869678+0000","last_peered":"2024-09-21T00:54:58.869678+0000","last_clean":"2024-09-21T00:54:58.869678+0000","last_became_active":"2024-09-21T00:54:57.866532+0000","last_became_peered":"2024-09-21T00:54:57.866532+0000","last_unstale":"2024-09-21T00:54:58.869678+0000","last_undegraded":"2024-09-21T00:54:58.869678+0000","last_fullsized":"2024-09-21T00:54:58.869678+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:15:58.881955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.870027+0000","last_change":"2024-09-21T00:54:57.874814+0000","last_active":"2024-09-21T00:54:58.870027+0000","last_peered":"2024-09-21T00:54:58.870027+0000","last_clean":"2024-09-21T00:54:58.870027+0000","last_became_active":"2024-09-21T00:54:57.873918+0000","last_became_peered":"2024-09-21T00:54:57.873918+0000","last_unstale":"2024-09-21T00:54:58.870027+0000","last_undegraded":"2024-09-21T00:54:58.870027+0000","last_fullsized":"2024-09-21T00:54:58.870027+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:14.677826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.854427+0000","last_change":"2024-09-21T00:54:57.877268+0000","last_active":"2024-09-21T00:54:58.854427+0000","last_peered":"2024-09-21T00:54:58.854427+0000","last_clean":"2024-09-21T00:54:58.854427+0000","last_became_active":"2024-09-21T00:54:57.876769+0000","last_became_peered":"2024-09-21T00:54:57.876769+0000","last_unstale":"2024-09-21T00:54:58.854427+0000","last_undegraded":"2024-09-21T00:54:58.854427+0000","last_fullsized":"2024-09-21T00:54:58.854427+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:27:02.534562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.868065+0000","last_change":"2024-09-21T00:54:57.872956+0000","last_active":"2024-09-21T00:54:58.868065+0000","last_peered":"2024-09-21T00:54:58.868065+0000","last_clean":"2024-09-21T00:54:58.868065+0000","last_became_active":"2024-09-21T00:54:57.872563+0000","last_became_peered":"2024-09-21T00:54:57.872563+0000","last_unstale":"2024-09-21T00:54:58.868065+0000","last_undegraded":"2024-09-21T00:54:58.868065+0000","last_fullsized":"2024-09-21T00:54:58.868065+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:47.776888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.866215+0000","last_change":"2024-09-21T00:54:57.870285+0000","last_active":"2024-09-21T00:54:58.866215+0000","last_peered":"2024-09-21T00:54:58.866215+0000","last_clean":"2024-09-21T00:54:58.866215+0000","last_became_active":"2024-09-21T00:54:57.869689+0000","last_became_peered":"2024-09-21T00:54:57.869689+0000","last_unstale":"2024-09-21T00:54:58.866215+0000","last_undegraded":"2024-09-21T00:54:58.866215+0000","last_fullsized":"2024-09-21T00:54:58.866215+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:54.304589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.868369+0000","last_change":"2024-09-21T00:54:57.868515+0000","last_active":"2024-09-21T00:54:58.868369+0000","last_peered":"2024-09-21T00:54:58.868369+0000","last_clean":"2024-09-21T00:54:58.868369+0000","last_became_active":"2024-09-21T00:54:57.868130+0000","last_became_peered":"2024-09-21T00:54:57.868130+0000","last_unstale":"2024-09-21T00:54:58.868369+0000","last_undegraded":"2024-09-21T00:54:58.868369+0000","last_fullsized":"2024-09-21T00:54:58.868369+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:45.482119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.866873+0000","last_change":"2024-09-21T00:54:57.869386+0000","last_active":"2024-09-21T00:54:58.866873+0000","last_peered":"2024-09-21T00:54:58.866873+0000","last_clean":"2024-09-21T00:54:58.866873+0000","last_became_active":"2024-09-21T00:54:57.869033+0000","last_became_peered":"2024-09-21T00:54:57.869033+0000","last_unstale":"2024-09-21T00:54:58.866873+0000","last_undegraded":"2024-09-21T00:54:58.866873+0000","last_fullsized":"2024-09-21T00:54:58.866873+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:39:01.305815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.872691+0000","last_change":"2024-09-21T00:54:57.870703+0000","last_active":"2024-09-21T00:54:58.872691+0000","last_peered":"2024-09-21T00:54:58.872691+0000","last_clean":"2024-09-21T00:54:58.872691+0000","last_became_active":"2024-09-21T00:54:57.870324+0000","last_became_peered":"2024-09-21T00:54:57.870324+0000","last_unstale":"2024-09-21T00:54:58.872691+0000","last_undegraded":"2024-09-21T00:54:58.872691+0000","last_fullsized":"2024-09-21T00:54:58.872691+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:50.548296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.867533+0000","last_change":"2024-09-21T00:54:57.869803+0000","last_active":"2024-09-21T00:54:58.867533+0000","last_peered":"2024-09-21T00:54:58.867533+0000","last_clean":"2024-09-21T00:54:58.867533+0000","last_became_active":"2024-09-21T00:54:57.869092+0000","last_became_peered":"2024-09-21T00:54:57.869092+0000","last_unstale":"2024-09-21T00:54:58.867533+0000","last_undegraded":"2024-09-21T00:54:58.867533+0000","last_fullsized":"2024-09-21T00:54:58.867533+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:05:27.727914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.869023+0000","last_change":"2024-09-21T00:54:57.873700+0000","last_active":"2024-09-21T00:54:58.869023+0000","last_peered":"2024-09-21T00:54:58.869023+0000","last_clean":"2024-09-21T00:54:58.869023+0000","last_became_active":"2024-09-21T00:54:57.873336+0000","last_became_peered":"2024-09-21T00:54:57.873336+0000","last_unstale":"2024-09-21T00:54:58.869023+0000","last_undegraded":"2024-09-21T00:54:58.869023+0000","last_fullsized":"2024-09-21T00:54:58.869023+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:28:17.520669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.854634+0000","last_change":"2024-09-21T00:54:57.877686+0000","last_active":"2024-09-21T00:54:58.854634+0000","last_peered":"2024-09-21T00:54:58.854634+0000","last_clean":"2024-09-21T00:54:58.854634+0000","last_became_active":"2024-09-21T00:54:57.876711+0000","last_became_peered":"2024-09-21T00:54:57.876711+0000","last_unstale":"2024-09-21T00:54:58.854634+0000","last_undegraded":"2024-09-21T00:54:58.854634+0000","last_fullsized":"2024-09-21T00:54:58.854634+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:20:11.254680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.853485+0000","last_change":"2024-09-21T00:54:57.880660+0000","last_active":"2024-09-21T00:54:58.853485+0000","last_peered":"2024-09-21T00:54:58.853485+0000","last_clean":"2024-09-21T00:54:58.853485+0000","last_became_active":"2024-09-21T00:54:57.880270+0000","last_became_peered":"2024-09-21T00:54:57.880270+0000","last_unstale":"2024-09-21T00:54:58.853485+0000","last_undegraded":"2024-09-21T00:54:58.853485+0000","last_fullsized":"2024-09-21T00:54:58.853485+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:50:16.260484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.869633+0000","last_change":"2024-09-21T00:54:57.869626+0000","last_active":"2024-09-21T00:54:58.869633+0000","last_peered":"2024-09-21T00:54:58.869633+0000","last_clean":"2024-09-21T00:54:58.869633+0000","last_became_active":"2024-09-21T00:54:57.869230+0000","last_became_peered":"2024-09-21T00:54:57.869230+0000","last_unstale":"2024-09-21T00:54:58.869633+0000","last_undegraded":"2024-09-21T00:54:58.869633+0000","last_fullsized":"2024-09-21T00:54:58.869633+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:49.131237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.869198+0000","last_change":"2024-09-21T00:54:57.874917+0000","last_active":"2024-09-21T00:54:58.869198+0000","last_peered":"2024-09-21T00:54:58.869198+0000","last_clean":"2024-09-21T00:54:58.869198+0000","last_became_active":"2024-09-21T00:54:57.873787+0000","last_became_peered":"2024-09-21T00:54:57.873787+0000","last_unstale":"2024-09-21T00:54:58.869198+0000","last_undegraded":"2024-09-21T00:54:58.869198+0000","last_fullsized":"2024-09-21T00:54:58.869198+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:44.226734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.871422+0000","last_change":"2024-09-21T00:54:57.877479+0000","last_active":"2024-09-21T00:54:58.871422+0000","last_peered":"2024-09-21T00:54:58.871422+0000","last_clean":"2024-09-21T00:54:58.871422+0000","last_became_active":"2024-09-21T00:54:57.877110+0000","last_became_peered":"2024-09-21T00:54:57.877110+0000","last_unstale":"2024-09-21T00:54:58.871422+0000","last_undegraded":"2024-09-21T00:54:58.871422+0000","last_fullsized":"2024-09-21T00:54:58.871422+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:18.547970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.871192+0000","last_change":"2024-09-21T00:54:57.878701+0000","last_active":"2024-09-21T00:54:58.871192+0000","last_peered":"2024-09-21T00:54:58.871192+0000","last_clean":"2024-09-21T00:54:58.871192+0000","last_became_active":"2024-09-21T00:54:57.878254+0000","last_became_peered":"2024-09-21T00:54:57.878254+0000","last_unstale":"2024-09-21T00:54:58.871192+0000","last_undegraded":"2024-09-21T00:54:58.871192+0000","last_fullsized":"2024-09-21T00:54:58.871192+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:51.309956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.867057+0000","last_change":"2024-09-21T00:54:57.869571+0000","last_active":"2024-09-21T00:54:58.867057+0000","last_peered":"2024-09-21T00:54:58.867057+0000","last_clean":"2024-09-21T00:54:58.867057+0000","last_became_active":"2024-09-21T00:54:57.868907+0000","last_became_peered":"2024-09-21T00:54:57.868907+0000","last_unstale":"2024-09-21T00:54:58.867057+0000","last_undegraded":"2024-09-21T00:54:58.867057+0000","last_fullsized":"2024-09-21T00:54:58.867057+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:14.951885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.868295+0000","last_change":"2024-09-21T00:54:57.869277+0000","last_active":"2024-09-21T00:54:58.868295+0000","last_peered":"2024-09-21T00:54:58.868295+0000","last_clean":"2024-09-21T00:54:58.868295+0000","last_became_active":"2024-09-21T00:54:57.868777+0000","last_became_peered":"2024-09-21T00:54:57.868777+0000","last_unstale":"2024-09-21T00:54:58.868295+0000","last_undegraded":"2024-09-21T00:54:58.868295+0000","last_fullsized":"2024-09-21T00:54:58.868295+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:09:04.766266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.870263+0000","last_change":"2024-09-21T00:54:57.875895+0000","last_active":"2024-09-21T00:54:58.870263+0000","last_peered":"2024-09-21T00:54:58.870263+0000","last_clean":"2024-09-21T00:54:58.870263+0000","last_became_active":"2024-09-21T00:54:57.875505+0000","last_became_peered":"2024-09-21T00:54:57.875505+0000","last_unstale":"2024-09-21T00:54:58.870263+0000","last_undegraded":"2024-09-21T00:54:58.870263+0000","last_fullsized":"2024-09-21T00:54:58.870263+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:19:29.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.853432+0000","last_change":"2024-09-21T00:54:57.871236+0000","last_active":"2024-09-21T00:54:58.853432+0000","last_peered":"2024-09-21T00:54:58.853432+0000","last_clean":"2024-09-21T00:54:58.853432+0000","last_became_active":"2024-09-21T00:54:57.870131+0000","last_became_peered":"2024-09-21T00:54:57.870131+0000","last_unstale":"2024-09-21T00:54:58.853432+0000","last_undegraded":"2024-09-21T00:54:58.853432+0000","last_fullsized":"2024-09-21T00:54:58.853432+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:45.067436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.871125+0000","last_change":"2024-09-21T00:54:57.878710+0000","last_active":"2024-09-21T00:54:58.871125+0000","last_peered":"2024-09-21T00:54:58.871125+0000","last_clean":"2024-09-21T00:54:58.871125+0000","last_became_active":"2024-09-21T00:54:57.878352+0000","last_became_peered":"2024-09-21T00:54:57.878352+0000","last_unstale":"2024-09-21T00:54:58.871125+0000","last_undegraded":"2024-09-21T00:54:58.871125+0000","last_fullsized":"2024-09-21T00:54:58.871125+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:32:40.561028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.868269+0000","last_change":"2024-09-21T00:54:57.873226+0000","last_active":"2024-09-21T00:54:58.868269+0000","last_peered":"2024-09-21T00:54:58.868269+0000","last_clean":"2024-09-21T00:54:58.868269+0000","last_became_active":"2024-09-21T00:54:57.872840+0000","last_became_peered":"2024-09-21T00:54:57.872840+0000","last_unstale":"2024-09-21T00:54:58.868269+0000","last_undegraded":"2024-09-21T00:54:58.868269+0000","last_fullsized":"2024-09-21T00:54:58.868269+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:41.259070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.854298+0000","last_change":"2024-09-21T00:54:57.872249+0000","last_active":"2024-09-21T00:54:58.854298+0000","last_peered":"2024-09-21T00:54:58.854298+0000","last_clean":"2024-09-21T00:54:58.854298+0000","last_became_active":"2024-09-21T00:54:57.871868+0000","last_became_peered":"2024-09-21T00:54:57.871868+0000","last_unstale":"2024-09-21T00:54:58.854298+0000","last_undegraded":"2024-09-21T00:54:58.854298+0000","last_fullsized":"2024-09-21T00:54:58.854298+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:27.428549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.868792+0000","last_change":"2024-09-21T00:54:57.878534+0000","last_active":"2024-09-21T00:54:58.868792+0000","last_peered":"2024-09-21T00:54:58.868792+0000","last_clean":"2024-09-21T00:54:58.868792+0000","last_became_active":"2024-09-21T00:54:57.878189+0000","last_became_peered":"2024-09-21T00:54:57.878189+0000","last_unstale":"2024-09-21T00:54:58.868792+0000","last_undegraded":"2024-09-21T00:54:58.868792+0000","last_fullsized":"2024-09-21T00:54:58.868792+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:29.668779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.868464+0000","last_change":"2024-09-21T00:54:57.870994+0000","last_active":"2024-09-21T00:54:58.868464+0000","last_peered":"2024-09-21T00:54:58.868464+0000","last_clean":"2024-09-21T00:54:58.868464+0000","last_became_active":"2024-09-21T00:54:57.867939+0000","last_became_peered":"2024-09-21T00:54:57.867939+0000","last_unstale":"2024-09-21T00:54:58.868464+0000","last_undegraded":"2024-09-21T00:54:58.868464+0000","last_fullsized":"2024-09-21T00:54:58.868464+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:44.858289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.872943+0000","last_change":"2024-09-21T00:54:57.870568+0000","last_active":"2024-09-21T00:54:58.872943+0000","last_peered":"2024-09-21T00:54:58.872943+0000","last_clean":"2024-09-21T00:54:58.872943+0000","last_became_active":"2024-09-21T00:54:57.870208+0000","last_became_peered":"2024-09-21T00:54:57.870208+0000","last_unstale":"2024-09-21T00:54:58.872943+0000","last_undegraded":"2024-09-21T00:54:58.872943+0000","last_fullsized":"2024-09-21T00:54:58.872943+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:28:09.824385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.853290+0000","last_change":"2024-09-21T00:54:57.870228+0000","last_active":"2024-09-21T00:54:58.853290+0000","last_peered":"2024-09-21T00:54:58.853290+0000","last_clean":"2024-09-21T00:54:58.853290+0000","last_became_active":"2024-09-21T00:54:57.869866+0000","last_became_peered":"2024-09-21T00:54:57.869866+0000","last_unstale":"2024-09-21T00:54:58.853290+0000","last_undegraded":"2024-09-21T00:54:58.853290+0000","last_fullsized":"2024-09-21T00:54:58.853290+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:20.073393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.869526+0000","last_change":"2024-09-21T00:54:57.867602+0000","last_active":"2024-09-21T00:54:58.869526+0000","last_peered":"2024-09-21T00:54:58.869526+0000","last_clean":"2024-09-21T00:54:58.869526+0000","last_became_active":"2024-09-21T00:54:57.867104+0000","last_became_peered":"2024-09-21T00:54:57.867104+0000","last_unstale":"2024-09-21T00:54:58.869526+0000","last_undegraded":"2024-09-21T00:54:58.869526+0000","last_fullsized":"2024-09-21T00:54:58.869526+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:29:37.403384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.867414+0000","last_change":"2024-09-21T00:54:57.869400+0000","last_active":"2024-09-21T00:54:58.867414+0000","last_peered":"2024-09-21T00:54:58.867414+0000","last_clean":"2024-09-21T00:54:58.867414+0000","last_became_active":"2024-09-21T00:54:57.868997+0000","last_became_peered":"2024-09-21T00:54:57.868997+0000","last_unstale":"2024-09-21T00:54:58.867414+0000","last_undegraded":"2024-09-21T00:54:58.867414+0000","last_fullsized":"2024-09-21T00:54:58.867414+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:00.117559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.868966+0000","last_change":"2024-09-21T00:54:57.867392+0000","last_active":"2024-09-21T00:54:58.868966+0000","last_peered":"2024-09-21T00:54:58.868966+0000","last_clean":"2024-09-21T00:54:58.868966+0000","last_became_active":"2024-09-21T00:54:57.867001+0000","last_became_peered":"2024-09-21T00:54:57.867001+0000","last_unstale":"2024-09-21T00:54:58.868966+0000","last_undegraded":"2024-09-21T00:54:58.868966+0000","last_fullsized":"2024-09-21T00:54:58.868966+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:05.090149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.869967+0000","last_change":"2024-09-21T00:54:57.867620+0000","last_active":"2024-09-21T00:54:58.869967+0000","last_peered":"2024-09-21T00:54:58.869967+0000","last_clean":"2024-09-21T00:54:58.869967+0000","last_became_active":"2024-09-21T00:54:57.867190+0000","last_became_peered":"2024-09-21T00:54:57.867190+0000","last_unstale":"2024-09-21T00:54:58.869967+0000","last_undegraded":"2024-09-21T00:54:58.869967+0000","last_fullsized":"2024-09-21T00:54:58.869967+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:36.432368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.867351+0000","last_change":"2024-09-21T00:54:57.880526+0000","last_active":"2024-09-21T00:54:58.867351+0000","last_peered":"2024-09-21T00:54:58.867351+0000","last_clean":"2024-09-21T00:54:58.867351+0000","last_became_active":"2024-09-21T00:54:57.880154+0000","last_became_peered":"2024-09-21T00:54:57.880154+0000","last_unstale":"2024-09-21T00:54:58.867351+0000","last_undegraded":"2024-09-21T00:54:58.867351+0000","last_fullsized":"2024-09-21T00:54:58.867351+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:56.179127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'5","reported_seq":39,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:20.608470+0000","last_change":"2024-09-21T00:54:55.867717+0000","last_active":"2024-09-21T00:55:20.608470+0000","last_peered":"2024-09-21T00:55:20.608470+0000","last_clean":"2024-09-21T00:55:20.608470+0000","last_became_active":"2024-09-21T00:54:55.867306+0000","last_became_peered":"2024-09-21T00:54:55.867306+0000","last_unstale":"2024-09-21T00:55:20.608470+0000","last_undegraded":"2024-09-21T00:55:20.608470+0000","last_fullsized":"2024-09-21T00:55:20.608470+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:25.192109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.854790+0000","last_change":"2024-09-21T00:54:57.879034+0000","last_active":"2024-09-21T00:54:58.854790+0000","last_peered":"2024-09-21T00:54:58.854790+0000","last_clean":"2024-09-21T00:54:58.854790+0000","last_became_active":"2024-09-21T00:54:57.878673+0000","last_became_peered":"2024-09-21T00:54:57.878673+0000","last_unstale":"2024-09-21T00:54:58.854790+0000","last_undegraded":"2024-09-21T00:54:58.854790+0000","last_fullsized":"2024-09-21T00:54:58.854790+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:39:12.467465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'7","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:08.186536+0000","last_change":"2024-09-21T00:54:55.867451+0000","last_active":"2024-09-21T00:55:08.186536+0000","last_peered":"2024-09-21T00:55:08.186536+0000","last_clean":"2024-09-21T00:55:08.186536+0000","last_became_active":"2024-09-21T00:54:55.866998+0000","last_became_peered":"2024-09-21T00:54:55.866998+0000","last_unstale":"2024-09-21T00:55:08.186536+0000","last_undegraded":"2024-09-21T00:55:08.186536+0000","last_fullsized":"2024-09-21T00:55:08.186536+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:40.878647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:07.177052+0000","last_change":"2024-09-21T00:54:55.853055+0000","last_active":"2024-09-21T00:55:07.177052+0000","last_peered":"2024-09-21T00:55:07.177052+0000","last_clean":"2024-09-21T00:55:07.177052+0000","last_became_active":"2024-09-21T00:54:55.852672+0000","last_became_peered":"2024-09-21T00:54:55.852672+0000","last_unstale":"2024-09-21T00:55:07.177052+0000","last_undegraded":"2024-09-21T00:55:07.177052+0000","last_fullsized":"2024-09-21T00:55:07.177052+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:17.082588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.867131+0000","last_change":"2024-09-21T00:54:57.875024+0000","last_active":"2024-09-21T00:54:58.867131+0000","last_peered":"2024-09-21T00:54:58.867131+0000","last_clean":"2024-09-21T00:54:58.867131+0000","last_became_active":"2024-09-21T00:54:57.870027+0000","last_became_peered":"2024-09-21T00:54:57.870027+0000","last_unstale":"2024-09-21T00:54:58.867131+0000","last_undegraded":"2024-09-21T00:54:58.867131+0000","last_fullsized":"2024-09-21T00:54:58.867131+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:37:48.880686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'3","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:09.195254+0000","last_change":"2024-09-21T00:54:55.864527+0000","last_active":"2024-09-21T00:55:09.195254+0000","last_peered":"2024-09-21T00:55:09.195254+0000","last_clean":"2024-09-21T00:55:09.195254+0000","last_became_active":"2024-09-21T00:54:55.864191+0000","last_became_peered":"2024-09-21T00:54:55.864191+0000","last_unstale":"2024-09-21T00:55:09.195254+0000","last_undegraded":"2024-09-21T00:55:09.195254+0000","last_fullsized":"2024-09-21T00:55:09.195254+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:43.781116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.868587+0000","last_change":"2024-09-21T00:54:57.865671+0000","last_active":"2024-09-21T00:54:58.868587+0000","last_peered":"2024-09-21T00:54:58.868587+0000","last_clean":"2024-09-21T00:54:58.868587+0000","last_became_active":"2024-09-21T00:54:57.865196+0000","last_became_peered":"2024-09-21T00:54:57.865196+0000","last_unstale":"2024-09-21T00:54:58.868587+0000","last_undegraded":"2024-09-21T00:54:58.868587+0000","last_fullsized":"2024-09-21T00:54:58.868587+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:16.524866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'4","reported_seq":51,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:22.610594+0000","last_change":"2024-09-21T00:54:55.862504+0000","last_active":"2024-09-21T00:55:22.610594+0000","last_peered":"2024-09-21T00:55:22.610594+0000","last_clean":"2024-09-21T00:55:22.610594+0000","last_became_active":"2024-09-21T00:54:55.862065+0000","last_became_peered":"2024-09-21T00:54:55.862065+0000","last_unstale":"2024-09-21T00:55:22.610594+0000","last_undegraded":"2024-09-21T00:55:22.610594+0000","last_fullsized":"2024-09-21T00:55:22.610594+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:16.497313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.872463+0000","last_change":"2024-09-21T00:54:57.873444+0000","last_active":"2024-09-21T00:54:58.872463+0000","last_peered":"2024-09-21T00:54:58.872463+0000","last_clean":"2024-09-21T00:54:58.872463+0000","last_became_active":"2024-09-21T00:54:57.873058+0000","last_became_peered":"2024-09-21T00:54:57.873058+0000","last_unstale":"2024-09-21T00:54:58.872463+0000","last_undegraded":"2024-09-21T00:54:58.872463+0000","last_fullsized":"2024-09-21T00:54:58.872463+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:36:40.603285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'4","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:09.193694+0000","last_change":"2024-09-21T00:54:55.865900+0000","last_active":"2024-09-21T00:55:09.193694+0000","last_peered":"2024-09-21T00:55:09.193694+0000","last_clean":"2024-09-21T00:55:09.193694+0000","last_became_active":"2024-09-21T00:54:55.865507+0000","last_became_peered":"2024-09-21T00:54:55.865507+0000","last_unstale":"2024-09-21T00:55:09.193694+0000","last_undegraded":"2024-09-21T00:55:09.193694+0000","last_fullsized":"2024-09-21T00:55:09.193694+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:27.615143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.870147+0000","last_change":"2024-09-21T00:54:57.868570+0000","last_active":"2024-09-21T00:54:58.870147+0000","last_peered":"2024-09-21T00:54:58.870147+0000","last_clean":"2024-09-21T00:54:58.870147+0000","last_became_active":"2024-09-21T00:54:57.868242+0000","last_became_peered":"2024-09-21T00:54:57.868242+0000","last_unstale":"2024-09-21T00:54:58.870147+0000","last_undegraded":"2024-09-21T00:54:58.870147+0000","last_fullsized":"2024-09-21T00:54:58.870147+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:37.845984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'5","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:08.185808+0000","last_change":"2024-09-21T00:54:55.968782+0000","last_active":"2024-09-21T00:55:08.185808+0000","last_peered":"2024-09-21T00:55:08.185808+0000","last_clean":"2024-09-21T00:55:08.185808+0000","last_became_active":"2024-09-21T00:54:55.968421+0000","last_became_peered":"2024-09-21T00:54:55.968421+0000","last_unstale":"2024-09-21T00:55:08.185808+0000","last_undegraded":"2024-09-21T00:55:08.185808+0000","last_fullsized":"2024-09-21T00:55:08.185808+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:28.680764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.872187+0000","last_change":"2024-09-21T00:54:57.877610+0000","last_active":"2024-09-21T00:54:58.872187+0000","last_peered":"2024-09-21T00:54:58.872187+0000","last_clean":"2024-09-21T00:54:58.872187+0000","last_became_active":"2024-09-21T00:54:57.877225+0000","last_became_peered":"2024-09-21T00:54:57.877225+0000","last_unstale":"2024-09-21T00:54:58.872187+0000","last_undegraded":"2024-09-21T00:54:58.872187+0000","last_fullsized":"2024-09-21T00:54:58.872187+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:08.294366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"73'27","reported_seq":79,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:23.127532+0000","last_change":"2024-09-21T00:54:55.866982+0000","last_active":"2024-09-21T00:55:23.127532+0000","last_peered":"2024-09-21T00:55:23.127532+0000","last_clean":"2024-09-21T00:55:23.127532+0000","last_became_active":"2024-09-21T00:54:55.866277+0000","last_became_peered":"2024-09-21T00:54:55.866277+0000","last_unstale":"2024-09-21T00:55:23.127532+0000","last_undegraded":"2024-09-21T00:55:23.127532+0000","last_fullsized":"2024-09-21T00:55:23.127532+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:59.737625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59092,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":33,"num_read_kb":65,"num_write":29,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.872454+0000","last_change":"2024-09-21T00:54:57.875575+0000","last_active":"2024-09-21T00:54:58.872454+0000","last_peered":"2024-09-21T00:54:58.872454+0000","last_clean":"2024-09-21T00:54:58.872454+0000","last_became_active":"2024-09-21T00:54:57.874975+0000","last_became_peered":"2024-09-21T00:54:57.874975+0000","last_unstale":"2024-09-21T00:54:58.872454+0000","last_undegraded":"2024-09-21T00:54:58.872454+0000","last_fullsized":"2024-09-21T00:54:58.872454+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:34:36.089068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'9","reported_seq":30,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:09.587831+0000","last_change":"2024-09-21T00:54:55.863532+0000","last_active":"2024-09-21T00:55:09.587831+0000","last_peered":"2024-09-21T00:55:09.587831+0000","last_clean":"2024-09-21T00:55:09.587831+0000","last_became_active":"2024-09-21T00:54:55.863124+0000","last_became_peered":"2024-09-21T00:54:55.863124+0000","last_unstale":"2024-09-21T00:55:09.587831+0000","last_undegraded":"2024-09-21T00:55:09.587831+0000","last_fullsized":"2024-09-21T00:55:09.587831+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:41:07.996906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.853015+0000","last_change":"2024-09-21T00:54:57.866126+0000","last_active":"2024-09-21T00:54:58.853015+0000","last_peered":"2024-09-21T00:54:58.853015+0000","last_clean":"2024-09-21T00:54:58.853015+0000","last_became_active":"2024-09-21T00:54:57.865775+0000","last_became_peered":"2024-09-21T00:54:57.865775+0000","last_unstale":"2024-09-21T00:54:58.853015+0000","last_undegraded":"2024-09-21T00:54:58.853015+0000","last_fullsized":"2024-09-21T00:54:58.853015+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:28.261632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'5","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:09.194338+0000","last_change":"2024-09-21T00:54:55.864593+0000","last_active":"2024-09-21T00:55:09.194338+0000","last_peered":"2024-09-21T00:55:09.194338+0000","last_clean":"2024-09-21T00:55:09.194338+0000","last_became_active":"2024-09-21T00:54:55.864202+0000","last_became_peered":"2024-09-21T00:54:55.864202+0000","last_unstale":"2024-09-21T00:55:09.194338+0000","last_undegraded":"2024-09-21T00:55:09.194338+0000","last_fullsized":"2024-09-21T00:55:09.194338+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:06.976588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.869694+0000","last_change":"2024-09-21T00:54:57.877892+0000","last_active":"2024-09-21T00:54:58.869694+0000","last_peered":"2024-09-21T00:54:58.869694+0000","last_clean":"2024-09-21T00:54:58.869694+0000","last_became_active":"2024-09-21T00:54:57.877510+0000","last_became_peered":"2024-09-21T00:54:57.877510+0000","last_unstale":"2024-09-21T00:54:58.869694+0000","last_undegraded":"2024-09-21T00:54:58.869694+0000","last_fullsized":"2024-09-21T00:54:58.869694+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:05.238100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'6","reported_seq":42,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:21.610634+0000","last_change":"2024-09-21T00:54:55.856707+0000","last_active":"2024-09-21T00:55:21.610634+0000","last_peered":"2024-09-21T00:55:21.610634+0000","last_clean":"2024-09-21T00:55:21.610634+0000","last_became_active":"2024-09-21T00:54:55.856095+0000","last_became_peered":"2024-09-21T00:54:55.856095+0000","last_unstale":"2024-09-21T00:55:21.610634+0000","last_undegraded":"2024-09-21T00:55:21.610634+0000","last_fullsized":"2024-09-21T00:55:21.610634+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:48.332764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.869482+0000","last_change":"2024-09-21T00:54:57.868398+0000","last_active":"2024-09-21T00:54:58.869482+0000","last_peered":"2024-09-21T00:54:58.869482+0000","last_clean":"2024-09-21T00:54:58.869482+0000","last_became_active":"2024-09-21T00:54:57.867963+0000","last_became_peered":"2024-09-21T00:54:57.867963+0000","last_unstale":"2024-09-21T00:54:58.869482+0000","last_undegraded":"2024-09-21T00:54:58.869482+0000","last_fullsized":"2024-09-21T00:54:58.869482+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:59:31.527713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'17","reported_seq":37,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:09.193687+0000","last_change":"2024-09-21T00:54:55.969105+0000","last_active":"2024-09-21T00:55:09.193687+0000","last_peered":"2024-09-21T00:55:09.193687+0000","last_clean":"2024-09-21T00:55:09.193687+0000","last_became_active":"2024-09-21T00:54:55.968699+0000","last_became_peered":"2024-09-21T00:54:55.968699+0000","last_unstale":"2024-09-21T00:55:09.193687+0000","last_undegraded":"2024-09-21T00:55:09.193687+0000","last_fullsized":"2024-09-21T00:55:09.193687+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:53.901106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.854418+0000","last_change":"2024-09-21T00:54:57.872256+0000","last_active":"2024-09-21T00:54:58.854418+0000","last_peered":"2024-09-21T00:54:58.854418+0000","last_clean":"2024-09-21T00:54:58.854418+0000","last_became_active":"2024-09-21T00:54:57.871848+0000","last_became_peered":"2024-09-21T00:54:57.871848+0000","last_unstale":"2024-09-21T00:54:58.854418+0000","last_undegraded":"2024-09-21T00:54:58.854418+0000","last_fullsized":"2024-09-21T00:54:58.854418+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:24:11.314693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:09.172505+0000","last_change":"2024-09-21T00:54:55.870096+0000","last_active":"2024-09-21T00:55:09.172505+0000","last_peered":"2024-09-21T00:55:09.172505+0000","last_clean":"2024-09-21T00:55:09.172505+0000","last_became_active":"2024-09-21T00:54:55.869616+0000","last_became_peered":"2024-09-21T00:54:55.869616+0000","last_unstale":"2024-09-21T00:55:09.172505+0000","last_undegraded":"2024-09-21T00:55:09.172505+0000","last_fullsized":"2024-09-21T00:55:09.172505+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:53:48.036499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.870011+0000","last_change":"2024-09-21T00:54:57.875761+0000","last_active":"2024-09-21T00:54:58.870011+0000","last_peered":"2024-09-21T00:54:58.870011+0000","last_clean":"2024-09-21T00:54:58.870011+0000","last_became_active":"2024-09-21T00:54:57.875416+0000","last_became_peered":"2024-09-21T00:54:57.875416+0000","last_unstale":"2024-09-21T00:54:58.870011+0000","last_undegraded":"2024-09-21T00:54:58.870011+0000","last_fullsized":"2024-09-21T00:54:58.870011+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:35.118999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'5","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:09.192253+0000","last_change":"2024-09-21T00:54:55.866393+0000","last_active":"2024-09-21T00:55:09.192253+0000","last_peered":"2024-09-21T00:55:09.192253+0000","last_clean":"2024-09-21T00:55:09.192253+0000","last_became_active":"2024-09-21T00:54:55.865980+0000","last_became_peered":"2024-09-21T00:54:55.865980+0000","last_unstale":"2024-09-21T00:55:09.192253+0000","last_undegraded":"2024-09-21T00:55:09.192253+0000","last_fullsized":"2024-09-21T00:55:09.192253+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:56.471011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.870082+0000","last_change":"2024-09-21T00:54:57.875177+0000","last_active":"2024-09-21T00:54:58.870082+0000","last_peered":"2024-09-21T00:54:58.870082+0000","last_clean":"2024-09-21T00:54:58.870082+0000","last_became_active":"2024-09-21T00:54:57.874819+0000","last_became_peered":"2024-09-21T00:54:57.874819+0000","last_unstale":"2024-09-21T00:54:58.870082+0000","last_undegraded":"2024-09-21T00:54:58.870082+0000","last_fullsized":"2024-09-21T00:54:58.870082+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:43.942703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'3","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:09.194583+0000","last_change":"2024-09-21T00:54:55.864668+0000","last_active":"2024-09-21T00:55:09.194583+0000","last_peered":"2024-09-21T00:55:09.194583+0000","last_clean":"2024-09-21T00:55:09.194583+0000","last_became_active":"2024-09-21T00:54:55.864330+0000","last_became_peered":"2024-09-21T00:54:55.864330+0000","last_unstale":"2024-09-21T00:55:09.194583+0000","last_undegraded":"2024-09-21T00:55:09.194583+0000","last_fullsized":"2024-09-21T00:55:09.194583+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:45:50.751390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:00.801166+0000","last_change":"2024-09-21T00:54:57.871093+0000","last_active":"2024-09-21T00:55:00.801166+0000","last_peered":"2024-09-21T00:55:00.801166+0000","last_clean":"2024-09-21T00:55:00.801166+0000","last_became_active":"2024-09-21T00:54:57.870457+0000","last_became_peered":"2024-09-21T00:54:57.870457+0000","last_unstale":"2024-09-21T00:55:00.801166+0000","last_undegraded":"2024-09-21T00:55:00.801166+0000","last_fullsized":"2024-09-21T00:55:00.801166+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:19.810575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'6","reported_seq":40,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:19.606852+0000","last_change":"2024-09-21T00:54:55.968156+0000","last_active":"2024-09-21T00:55:19.606852+0000","last_peered":"2024-09-21T00:55:19.606852+0000","last_clean":"2024-09-21T00:55:19.606852+0000","last_became_active":"2024-09-21T00:54:55.967668+0000","last_became_peered":"2024-09-21T00:54:55.967668+0000","last_unstale":"2024-09-21T00:55:19.606852+0000","last_undegraded":"2024-09-21T00:55:19.606852+0000","last_fullsized":"2024-09-21T00:55:19.606852+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:28.854249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.869318+0000","last_change":"2024-09-21T00:54:57.868187+0000","last_active":"2024-09-21T00:54:58.869318+0000","last_peered":"2024-09-21T00:54:58.869318+0000","last_clean":"2024-09-21T00:54:58.869318+0000","last_became_active":"2024-09-21T00:54:57.867709+0000","last_became_peered":"2024-09-21T00:54:57.867709+0000","last_unstale":"2024-09-21T00:54:58.869318+0000","last_undegraded":"2024-09-21T00:54:58.869318+0000","last_fullsized":"2024-09-21T00:54:58.869318+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:40.123030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":92,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.869566+0000","last_change":"2024-09-21T00:53:44.515787+0000","last_active":"2024-09-21T00:54:58.869566+0000","last_peered":"2024-09-21T00:54:58.869566+0000","last_clean":"2024-09-21T00:54:58.869566+0000","last_became_active":"2024-09-21T00:53:44.510106+0000","last_became_peered":"2024-09-21T00:53:44.510106+0000","last_unstale":"2024-09-21T00:54:58.869566+0000","last_undegraded":"2024-09-21T00:54:58.869566+0000","last_fullsized":"2024-09-21T00:54:58.869566+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:50:16.598790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:50:16.598790+0000","last_clean_scrub_stamp":"2024-09-21T00:50:16.598790+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:04:14.481212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'6","reported_seq":28,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:09.589312+0000","last_change":"2024-09-21T00:54:55.854929+0000","last_active":"2024-09-21T00:55:09.589312+0000","last_peered":"2024-09-21T00:55:09.589312+0000","last_clean":"2024-09-21T00:55:09.589312+0000","last_became_active":"2024-09-21T00:54:55.854489+0000","last_became_peered":"2024-09-21T00:54:55.854489+0000","last_unstale":"2024-09-21T00:55:09.589312+0000","last_undegraded":"2024-09-21T00:55:09.589312+0000","last_fullsized":"2024-09-21T00:55:09.589312+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:03.067142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.867535+0000","last_change":"2024-09-21T00:54:57.881371+0000","last_active":"2024-09-21T00:54:58.867535+0000","last_peered":"2024-09-21T00:54:58.867535+0000","last_clean":"2024-09-21T00:54:58.867535+0000","last_became_active":"2024-09-21T00:54:57.881028+0000","last_became_peered":"2024-09-21T00:54:57.881028+0000","last_unstale":"2024-09-21T00:54:58.867535+0000","last_undegraded":"2024-09-21T00:54:58.867535+0000","last_fullsized":"2024-09-21T00:54:58.867535+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:04.241676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'4","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:07.176601+0000","last_change":"2024-09-21T00:54:55.863265+0000","last_active":"2024-09-21T00:55:07.176601+0000","last_peered":"2024-09-21T00:55:07.176601+0000","last_clean":"2024-09-21T00:55:07.176601+0000","last_became_active":"2024-09-21T00:54:55.862613+0000","last_became_peered":"2024-09-21T00:54:55.862613+0000","last_unstale":"2024-09-21T00:55:07.176601+0000","last_undegraded":"2024-09-21T00:55:07.176601+0000","last_fullsized":"2024-09-21T00:55:07.176601+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:56.707143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.853001+0000","last_change":"2024-09-21T00:54:57.855249+0000","last_active":"2024-09-21T00:54:58.853001+0000","last_peered":"2024-09-21T00:54:58.853001+0000","last_clean":"2024-09-21T00:54:58.853001+0000","last_became_active":"2024-09-21T00:54:57.854879+0000","last_became_peered":"2024-09-21T00:54:57.854879+0000","last_unstale":"2024-09-21T00:54:58.853001+0000","last_undegraded":"2024-09-21T00:54:58.853001+0000","last_fullsized":"2024-09-21T00:54:58.853001+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:15.733514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'5","reported_seq":36,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:18.605951+0000","last_change":"2024-09-21T00:54:55.968078+0000","last_active":"2024-09-21T00:55:18.605951+0000","last_peered":"2024-09-21T00:55:18.605951+0000","last_clean":"2024-09-21T00:55:18.605951+0000","last_became_active":"2024-09-21T00:54:55.967700+0000","last_became_peered":"2024-09-21T00:54:55.967700+0000","last_unstale":"2024-09-21T00:55:18.605951+0000","last_undegraded":"2024-09-21T00:55:18.605951+0000","last_fullsized":"2024-09-21T00:55:18.605951+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:35.121889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.854421+0000","last_change":"2024-09-21T00:54:57.873224+0000","last_active":"2024-09-21T00:54:58.854421+0000","last_peered":"2024-09-21T00:54:58.854421+0000","last_clean":"2024-09-21T00:54:58.854421+0000","last_became_active":"2024-09-21T00:54:57.872828+0000","last_became_peered":"2024-09-21T00:54:57.872828+0000","last_unstale":"2024-09-21T00:54:58.854421+0000","last_undegraded":"2024-09-21T00:54:58.854421+0000","last_fullsized":"2024-09-21T00:54:58.854421+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:58:55.758620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'5","reported_seq":37,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:19.605262+0000","last_change":"2024-09-21T00:54:55.859887+0000","last_active":"2024-09-21T00:55:19.605262+0000","last_peered":"2024-09-21T00:55:19.605262+0000","last_clean":"2024-09-21T00:55:19.605262+0000","last_became_active":"2024-09-21T00:54:55.859351+0000","last_became_peered":"2024-09-21T00:54:55.859351+0000","last_unstale":"2024-09-21T00:55:19.605262+0000","last_undegraded":"2024-09-21T00:55:19.605262+0000","last_fullsized":"2024-09-21T00:55:19.605262+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:31.407409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.866423+0000","last_change":"2024-09-21T00:54:57.882568+0000","last_active":"2024-09-21T00:54:58.866423+0000","last_peered":"2024-09-21T00:54:58.866423+0000","last_clean":"2024-09-21T00:54:58.866423+0000","last_became_active":"2024-09-21T00:54:57.882190+0000","last_became_peered":"2024-09-21T00:54:57.882190+0000","last_unstale":"2024-09-21T00:54:58.866423+0000","last_undegraded":"2024-09-21T00:54:58.866423+0000","last_fullsized":"2024-09-21T00:54:58.866423+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:19.339490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"73'1","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.866493+0000","last_change":"2024-09-21T00:54:55.970154+0000","last_active":"2024-09-21T00:54:58.866493+0000","last_peered":"2024-09-21T00:54:58.866493+0000","last_clean":"2024-09-21T00:54:58.866493+0000","last_became_active":"2024-09-21T00:54:55.969774+0000","last_became_peered":"2024-09-21T00:54:55.969774+0000","last_unstale":"2024-09-21T00:54:58.866493+0000","last_undegraded":"2024-09-21T00:54:58.866493+0000","last_fullsized":"2024-09-21T00:54:58.866493+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:05.241455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.866876+0000","last_change":"2024-09-21T00:54:57.873452+0000","last_active":"2024-09-21T00:54:58.866876+0000","last_peered":"2024-09-21T00:54:58.866876+0000","last_clean":"2024-09-21T00:54:58.866876+0000","last_became_active":"2024-09-21T00:54:57.872592+0000","last_became_peered":"2024-09-21T00:54:57.872592+0000","last_unstale":"2024-09-21T00:54:58.866876+0000","last_undegraded":"2024-09-21T00:54:58.866876+0000","last_fullsized":"2024-09-21T00:54:58.866876+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:25.196491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'4","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:09.194044+0000","last_change":"2024-09-21T00:54:55.968563+0000","last_active":"2024-09-21T00:55:09.194044+0000","last_peered":"2024-09-21T00:55:09.194044+0000","last_clean":"2024-09-21T00:55:09.194044+0000","last_became_active":"2024-09-21T00:54:55.968176+0000","last_became_peered":"2024-09-21T00:54:55.968176+0000","last_unstale":"2024-09-21T00:55:09.194044+0000","last_undegraded":"2024-09-21T00:55:09.194044+0000","last_fullsized":"2024-09-21T00:55:09.194044+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:35.120595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.853429+0000","last_change":"2024-09-21T00:54:57.862128+0000","last_active":"2024-09-21T00:54:58.853429+0000","last_peered":"2024-09-21T00:54:58.853429+0000","last_clean":"2024-09-21T00:54:58.853429+0000","last_became_active":"2024-09-21T00:54:57.861692+0000","last_became_peered":"2024-09-21T00:54:57.861692+0000","last_unstale":"2024-09-21T00:54:58.853429+0000","last_undegraded":"2024-09-21T00:54:58.853429+0000","last_fullsized":"2024-09-21T00:54:58.853429+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:58:29.364344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"73'12","reported_seq":31,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:18.866923+0000","last_change":"2024-09-21T00:54:55.866240+0000","last_active":"2024-09-21T00:55:18.866923+0000","last_peered":"2024-09-21T00:55:18.866923+0000","last_clean":"2024-09-21T00:55:18.866923+0000","last_became_active":"2024-09-21T00:54:55.865192+0000","last_became_peered":"2024-09-21T00:54:55.865192+0000","last_unstale":"2024-09-21T00:55:18.866923+0000","last_undegraded":"2024-09-21T00:55:18.866923+0000","last_fullsized":"2024-09-21T00:55:18.866923+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:53:17.599528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.869359+0000","last_change":"2024-09-21T00:54:57.878847+0000","last_active":"2024-09-21T00:54:58.869359+0000","last_peered":"2024-09-21T00:54:58.869359+0000","last_clean":"2024-09-21T00:54:58.869359+0000","last_became_active":"2024-09-21T00:54:57.878117+0000","last_became_peered":"2024-09-21T00:54:57.878117+0000","last_unstale":"2024-09-21T00:54:58.869359+0000","last_undegraded":"2024-09-21T00:54:58.869359+0000","last_fullsized":"2024-09-21T00:54:58.869359+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:46.090963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'7","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:09.192301+0000","last_change":"2024-09-21T00:54:55.854035+0000","last_active":"2024-09-21T00:55:09.192301+0000","last_peered":"2024-09-21T00:55:09.192301+0000","last_clean":"2024-09-21T00:55:09.192301+0000","last_became_active":"2024-09-21T00:54:55.853301+0000","last_became_peered":"2024-09-21T00:54:55.853301+0000","last_unstale":"2024-09-21T00:55:09.192301+0000","last_undegraded":"2024-09-21T00:55:09.192301+0000","last_fullsized":"2024-09-21T00:55:09.192301+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:11.498865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.870487+0000","last_change":"2024-09-21T00:54:57.875093+0000","last_active":"2024-09-21T00:54:58.870487+0000","last_peered":"2024-09-21T00:54:58.870487+0000","last_clean":"2024-09-21T00:54:58.870487+0000","last_became_active":"2024-09-21T00:54:57.873996+0000","last_became_peered":"2024-09-21T00:54:57.873996+0000","last_unstale":"2024-09-21T00:54:58.870487+0000","last_undegraded":"2024-09-21T00:54:58.870487+0000","last_fullsized":"2024-09-21T00:54:58.870487+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:17:55.990167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:06.173193+0000","last_change":"2024-09-21T00:54:55.968507+0000","last_active":"2024-09-21T00:55:06.173193+0000","last_peered":"2024-09-21T00:55:06.173193+0000","last_clean":"2024-09-21T00:55:06.173193+0000","last_became_active":"2024-09-21T00:54:55.968084+0000","last_became_peered":"2024-09-21T00:54:55.968084+0000","last_unstale":"2024-09-21T00:55:06.173193+0000","last_undegraded":"2024-09-21T00:55:06.173193+0000","last_fullsized":"2024-09-21T00:55:06.173193+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:34:06.325264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.867774+0000","last_change":"2024-09-21T00:54:57.870500+0000","last_active":"2024-09-21T00:54:58.867774+0000","last_peered":"2024-09-21T00:54:58.867774+0000","last_clean":"2024-09-21T00:54:58.867774+0000","last_became_active":"2024-09-21T00:54:57.870103+0000","last_became_peered":"2024-09-21T00:54:57.870103+0000","last_unstale":"2024-09-21T00:54:58.867774+0000","last_undegraded":"2024-09-21T00:54:58.867774+0000","last_fullsized":"2024-09-21T00:54:58.867774+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:31:03.469863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'7","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:09.194167+0000","last_change":"2024-09-21T00:54:55.856185+0000","last_active":"2024-09-21T00:55:09.194167+0000","last_peered":"2024-09-21T00:55:09.194167+0000","last_clean":"2024-09-21T00:55:09.194167+0000","last_became_active":"2024-09-21T00:54:55.855738+0000","last_became_peered":"2024-09-21T00:54:55.855738+0000","last_unstale":"2024-09-21T00:55:09.194167+0000","last_undegraded":"2024-09-21T00:55:09.194167+0000","last_fullsized":"2024-09-21T00:55:09.194167+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:02.870874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.869840+0000","last_change":"2024-09-21T00:54:57.877828+0000","last_active":"2024-09-21T00:54:58.869840+0000","last_peered":"2024-09-21T00:54:58.869840+0000","last_clean":"2024-09-21T00:54:58.869840+0000","last_became_active":"2024-09-21T00:54:57.877414+0000","last_became_peered":"2024-09-21T00:54:57.877414+0000","last_unstale":"2024-09-21T00:54:58.869840+0000","last_undegraded":"2024-09-21T00:54:58.869840+0000","last_fullsized":"2024-09-21T00:54:58.869840+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:27.485830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:08.185928+0000","last_change":"2024-09-21T00:54:55.868014+0000","last_active":"2024-09-21T00:55:08.185928+0000","last_peered":"2024-09-21T00:55:08.185928+0000","last_clean":"2024-09-21T00:55:08.185928+0000","last_became_active":"2024-09-21T00:54:55.867640+0000","last_became_peered":"2024-09-21T00:54:55.867640+0000","last_unstale":"2024-09-21T00:55:08.185928+0000","last_undegraded":"2024-09-21T00:55:08.185928+0000","last_fullsized":"2024-09-21T00:55:08.185928+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:24:57.118238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.867151+0000","last_change":"2024-09-21T00:54:57.881935+0000","last_active":"2024-09-21T00:54:58.867151+0000","last_peered":"2024-09-21T00:54:58.867151+0000","last_clean":"2024-09-21T00:54:58.867151+0000","last_became_active":"2024-09-21T00:54:57.881598+0000","last_became_peered":"2024-09-21T00:54:57.881598+0000","last_unstale":"2024-09-21T00:54:58.867151+0000","last_undegraded":"2024-09-21T00:54:58.867151+0000","last_fullsized":"2024-09-21T00:54:58.867151+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:44:19.893961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:06.175042+0000","last_change":"2024-09-21T00:54:55.867314+0000","last_active":"2024-09-21T00:55:06.175042+0000","last_peered":"2024-09-21T00:55:06.175042+0000","last_clean":"2024-09-21T00:55:06.175042+0000","last_became_active":"2024-09-21T00:54:55.866751+0000","last_became_peered":"2024-09-21T00:54:55.866751+0000","last_unstale":"2024-09-21T00:55:06.175042+0000","last_undegraded":"2024-09-21T00:55:06.175042+0000","last_fullsized":"2024-09-21T00:55:06.175042+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:44.656789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.869393+0000","last_change":"2024-09-21T00:54:57.867972+0000","last_active":"2024-09-21T00:54:58.869393+0000","last_peered":"2024-09-21T00:54:58.869393+0000","last_clean":"2024-09-21T00:54:58.869393+0000","last_became_active":"2024-09-21T00:54:57.867586+0000","last_became_peered":"2024-09-21T00:54:57.867586+0000","last_unstale":"2024-09-21T00:54:58.869393+0000","last_undegraded":"2024-09-21T00:54:58.869393+0000","last_fullsized":"2024-09-21T00:54:58.869393+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:27.066795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.854927+0000","last_change":"2024-09-21T00:54:57.881014+0000","last_active":"2024-09-21T00:54:58.854927+0000","last_peered":"2024-09-21T00:54:58.854927+0000","last_clean":"2024-09-21T00:54:58.854927+0000","last_became_active":"2024-09-21T00:54:57.880608+0000","last_became_peered":"2024-09-21T00:54:57.880608+0000","last_unstale":"2024-09-21T00:54:58.854927+0000","last_undegraded":"2024-09-21T00:54:58.854927+0000","last_fullsized":"2024-09-21T00:54:58.854927+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:48:31.848315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'5","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:09.195302+0000","last_change":"2024-09-21T00:54:55.865031+0000","last_active":"2024-09-21T00:55:09.195302+0000","last_peered":"2024-09-21T00:55:09.195302+0000","last_clean":"2024-09-21T00:55:09.195302+0000","last_became_active":"2024-09-21T00:54:55.864576+0000","last_became_peered":"2024-09-21T00:54:55.864576+0000","last_unstale":"2024-09-21T00:55:09.195302+0000","last_undegraded":"2024-09-21T00:55:09.195302+0000","last_fullsized":"2024-09-21T00:55:09.195302+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:13.125491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.871622+0000","last_change":"2024-09-21T00:54:57.875878+0000","last_active":"2024-09-21T00:54:58.871622+0000","last_peered":"2024-09-21T00:54:58.871622+0000","last_clean":"2024-09-21T00:54:58.871622+0000","last_became_active":"2024-09-21T00:54:57.874177+0000","last_became_peered":"2024-09-21T00:54:57.874177+0000","last_unstale":"2024-09-21T00:54:58.871622+0000","last_undegraded":"2024-09-21T00:54:58.871622+0000","last_fullsized":"2024-09-21T00:54:58.871622+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:25.333036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'12","reported_seq":32,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:09.587263+0000","last_change":"2024-09-21T00:54:55.868698+0000","last_active":"2024-09-21T00:55:09.587263+0000","last_peered":"2024-09-21T00:55:09.587263+0000","last_clean":"2024-09-21T00:55:09.587263+0000","last_became_active":"2024-09-21T00:54:55.868282+0000","last_became_peered":"2024-09-21T00:54:55.868282+0000","last_unstale":"2024-09-21T00:55:09.587263+0000","last_undegraded":"2024-09-21T00:55:09.587263+0000","last_fullsized":"2024-09-21T00:55:09.587263+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:50.253638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.870038+0000","last_change":"2024-09-21T00:54:57.867726+0000","last_active":"2024-09-21T00:54:58.870038+0000","last_peered":"2024-09-21T00:54:58.870038+0000","last_clean":"2024-09-21T00:54:58.870038+0000","last_became_active":"2024-09-21T00:54:57.866090+0000","last_became_peered":"2024-09-21T00:54:57.866090+0000","last_unstale":"2024-09-21T00:54:58.870038+0000","last_undegraded":"2024-09-21T00:54:58.870038+0000","last_fullsized":"2024-09-21T00:54:58.870038+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:57.938078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.872122+0000","last_change":"2024-09-21T00:54:55.968155+0000","last_active":"2024-09-21T00:54:58.872122+0000","last_peered":"2024-09-21T00:54:58.872122+0000","last_clean":"2024-09-21T00:54:58.872122+0000","last_became_active":"2024-09-21T00:54:55.967718+0000","last_became_peered":"2024-09-21T00:54:55.967718+0000","last_unstale":"2024-09-21T00:54:58.872122+0000","last_undegraded":"2024-09-21T00:54:58.872122+0000","last_fullsized":"2024-09-21T00:54:58.872122+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:18.160380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.867503+0000","last_change":"2024-09-21T00:54:57.873102+0000","last_active":"2024-09-21T00:54:58.867503+0000","last_peered":"2024-09-21T00:54:58.867503+0000","last_clean":"2024-09-21T00:54:58.867503+0000","last_became_active":"2024-09-21T00:54:57.872323+0000","last_became_peered":"2024-09-21T00:54:57.872323+0000","last_unstale":"2024-09-21T00:54:58.867503+0000","last_undegraded":"2024-09-21T00:54:58.867503+0000","last_fullsized":"2024-09-21T00:54:58.867503+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:18.087601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'13","reported_seq":45,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:19.604784+0000","last_change":"2024-09-21T00:54:55.865559+0000","last_active":"2024-09-21T00:55:19.604784+0000","last_peered":"2024-09-21T00:55:19.604784+0000","last_clean":"2024-09-21T00:55:19.604784+0000","last_became_active":"2024-09-21T00:54:55.865157+0000","last_became_peered":"2024-09-21T00:54:55.865157+0000","last_unstale":"2024-09-21T00:55:19.604784+0000","last_undegraded":"2024-09-21T00:55:19.604784+0000","last_fullsized":"2024-09-21T00:55:19.604784+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:53.113970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66296,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":167,"num_read_kb":148,"num_write":234,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":536576,"data_stored":182584,"data_compressed":5685,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":203,"ondisk_log_size":203,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":283734,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808849,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27800,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717352,"statfs":{"total":95995035648,"available":95966568448,"internally_reserved":0,"allocated":794624,"data_stored":378570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972375,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":1020539,"data_compressed":37970,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135899,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":819200,"data_stored":378109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332129,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31980,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713172,"statfs":{"total":95995035648,"available":95962288128,"internally_reserved":0,"allocated":815104,"data_stored":378487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528357,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":868352,"data_stored":971005,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691882,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36128,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709024,"statfs":{"total":95995035648,"available":95958040576,"internally_reserved":0,"allocated":802816,"data_stored":377826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888112,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":970292,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018934,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36128,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709024,"statfs":{"total":95995035648,"available":95958040576,"internally_reserved":0,"allocated":802816,"data_stored":378078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215163,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":819200,"data_stored":377651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411392,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36196,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708956,"statfs":{"total":95995035648,"available":95957970944,"internally_reserved":0,"allocated":872448,"data_stored":430290,"data_compressed":1895,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36176,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708976,"statfs":{"total":95995035648,"available":95957991424,"internally_reserved":0,"allocated":851968,"data_stored":429679,"data_compressed":1895,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36148,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709004,"statfs":{"total":95995035648,"available":95958020096,"internally_reserved":0,"allocated":823296,"data_stored":379556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":52692,"data_compressed":1895,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":53303,"data_compressed":1895,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":61219,"data_compressed":1895,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:55:25.438 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T00:55:25.702 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:25.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:25 smithi001 ceph-mon[31211]: pgmap v302: 97 pgs: 97 active+clean; 642 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 KiB/s wr, 16 op/s 2024-09-21T00:55:25.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:25 smithi001 ceph-mon[31211]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:55:25.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:25 smithi193 ceph-mon[34660]: pgmap v302: 97 pgs: 97 active+clean; 642 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 KiB/s wr, 16 op/s 2024-09-21T00:55:25.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:25 smithi193 ceph-mon[34660]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:55:25.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:25 smithi042 ceph-mon[34481]: pgmap v302: 97 pgs: 97 active+clean; 642 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 KiB/s wr, 16 op/s 2024-09-21T00:55:25.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:25 smithi042 ceph-mon[34481]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:55:26.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.172+0000 7fdba99bb640 1 -- 172.21.15.1:0/1217884883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdba4103bb0 msgr2=0x7fdba4103fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:26.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.172+0000 7fdba99bb640 1 --2- 172.21.15.1:0/1217884883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdba4103bb0 0x7fdba4103fc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdb94009ca0 tx=0x7fdb9402a8c0 comp rx=0 tx=0).stop 2024-09-21T00:55:26.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.172+0000 7fdba99bb640 1 -- 172.21.15.1:0/1217884883 shutdown_connections 2024-09-21T00:55:26.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.172+0000 7fdba99bb640 1 --2- 172.21.15.1:0/1217884883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdba4109e40 0x7fdba4110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:26.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.172+0000 7fdba99bb640 1 --2- 172.21.15.1:0/1217884883 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdba41094f0 0x7fdba4109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:26.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.172+0000 7fdba99bb640 1 --2- 172.21.15.1:0/1217884883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdba4103bb0 0x7fdba4103fc0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:26.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.172+0000 7fdba99bb640 1 -- 172.21.15.1:0/1217884883 >> 172.21.15.1:0/1217884883 conn(0x7fdba40ff600 msgr2=0x7fdba4101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:26.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.172+0000 7fdba99bb640 1 -- 172.21.15.1:0/1217884883 shutdown_connections 2024-09-21T00:55:26.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.172+0000 7fdba99bb640 1 -- 172.21.15.1:0/1217884883 wait complete. 2024-09-21T00:55:26.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.172+0000 7fdba99bb640 1 Processor -- start 2024-09-21T00:55:26.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.173+0000 7fdba99bb640 1 -- start start 2024-09-21T00:55:26.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.173+0000 7fdba99bb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdba4103bb0 0x7fdba4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:26.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.173+0000 7fdba99bb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdba41094f0 0x7fdba4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:26.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.173+0000 7fdba99bb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdba4109e40 0x7fdba4076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:26.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.173+0000 7fdba99bb640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdba4113b00 con 0x7fdba4109e40 2024-09-21T00:55:26.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.173+0000 7fdba99bb640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fdba4113980 con 0x7fdba41094f0 2024-09-21T00:55:26.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.173+0000 7fdba99bb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdba4113c80 con 0x7fdba4103bb0 2024-09-21T00:55:26.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.173+0000 7fdba37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdba4109e40 0x7fdba4076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:26.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.173+0000 7fdba37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdba4109e40 0x7fdba4076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57722/0 (socket says 172.21.15.1:57722) 2024-09-21T00:55:26.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.173+0000 7fdba37fe640 1 -- 172.21.15.1:0/223374385 learned_addr learned my addr 172.21.15.1:0/223374385 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:26.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.173+0000 7fdba27fc640 1 --2- 172.21.15.1:0/223374385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdba41094f0 0x7fdba4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:26.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.173+0000 7fdba2ffd640 1 --2- 172.21.15.1:0/223374385 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdba4103bb0 0x7fdba4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:26.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.173+0000 7fdba37fe640 1 -- 172.21.15.1:0/223374385 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdba4103bb0 msgr2=0x7fdba4075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:26.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.173+0000 7fdba37fe640 1 --2- 172.21.15.1:0/223374385 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdba4103bb0 0x7fdba4075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:26.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.173+0000 7fdba37fe640 1 -- 172.21.15.1:0/223374385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdba41094f0 msgr2=0x7fdba4075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:26.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.173+0000 7fdba37fe640 1 --2- 172.21.15.1:0/223374385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdba41094f0 0x7fdba4075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:26.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.173+0000 7fdba37fe640 1 -- 172.21.15.1:0/223374385 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdba41a87b0 con 0x7fdba4109e40 2024-09-21T00:55:26.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.174+0000 7fdba37fe640 1 --2- 172.21.15.1:0/223374385 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdba4109e40 0x7fdba4076190 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c00c970 tx=0x7fdb9c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:26.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.174+0000 7fdba89b9640 1 -- 172.21.15.1:0/223374385 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c007bb0 con 0x7fdba4109e40 2024-09-21T00:55:26.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.174+0000 7fdba89b9640 1 -- 172.21.15.1:0/223374385 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb9c007d50 con 0x7fdba4109e40 2024-09-21T00:55:26.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.174+0000 7fdba89b9640 1 -- 172.21.15.1:0/223374385 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c004e60 con 0x7fdba4109e40 2024-09-21T00:55:26.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.174+0000 7fdba99bb640 1 -- 172.21.15.1:0/223374385 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdba41a8aa0 con 0x7fdba4109e40 2024-09-21T00:55:26.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.174+0000 7fdba99bb640 1 -- 172.21.15.1:0/223374385 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdba41a8f90 con 0x7fdba4109e40 2024-09-21T00:55:26.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.175+0000 7fdba99bb640 1 -- 172.21.15.1:0/223374385 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdba4103fc0 con 0x7fdba4109e40 2024-09-21T00:55:26.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.177+0000 7fdba89b9640 1 -- 172.21.15.1:0/223374385 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7fdb9c005000 con 0x7fdba4109e40 2024-09-21T00:55:26.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.177+0000 7fdba89b9640 1 --2- 172.21.15.1:0/223374385 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fdb8c0b65a0 0x7fdb8c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:26.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.178+0000 7fdba2ffd640 1 --2- 172.21.15.1:0/223374385 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fdb8c0b65a0 0x7fdb8c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:26.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.178+0000 7fdba89b9640 1 -- 172.21.15.1:0/223374385 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fdb9c0e7310 con 0x7fdba4109e40 2024-09-21T00:55:26.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.178+0000 7fdba2ffd640 1 --2- 172.21.15.1:0/223374385 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fdb8c0b65a0 0x7fdb8c0b8ab0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdb940098d0 tx=0x7fdb940093e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:26.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.181+0000 7fdba89b9640 1 -- 172.21.15.1:0/223374385 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdb9c014030 con 0x7fdba4109e40 2024-09-21T00:55:26.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.365+0000 7fdba99bb640 1 -- 172.21.15.1:0/223374385 --> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdba4063800 con 0x7fdb8c0b65a0 2024-09-21T00:55:26.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.369+0000 7fdba89b9640 1 -- 172.21.15.1:0/223374385 <== mgr.14150 v2:172.21.15.1:6800/2032980330 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258953 (secure 0 0 0) 0x7fdba4063800 con 0x7fdb8c0b65a0 2024-09-21T00:55:26.372 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:55:26.373 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-21T00:55:26.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.373+0000 7fdba99bb640 1 -- 172.21.15.1:0/223374385 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fdb8c0b65a0 msgr2=0x7fdb8c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:26.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.373+0000 7fdba99bb640 1 --2- 172.21.15.1:0/223374385 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fdb8c0b65a0 0x7fdb8c0b8ab0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdb940098d0 tx=0x7fdb940093e0 comp rx=0 tx=0).stop 2024-09-21T00:55:26.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.373+0000 7fdba99bb640 1 -- 172.21.15.1:0/223374385 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdba4109e40 msgr2=0x7fdba4076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:26.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.373+0000 7fdba99bb640 1 --2- 172.21.15.1:0/223374385 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdba4109e40 0x7fdba4076190 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c00c970 tx=0x7fdb9c00ce30 comp rx=0 tx=0).stop 2024-09-21T00:55:26.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.373+0000 7fdba99bb640 1 -- 172.21.15.1:0/223374385 shutdown_connections 2024-09-21T00:55:26.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.373+0000 7fdba99bb640 1 --2- 172.21.15.1:0/223374385 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fdb8c0b65a0 0x7fdb8c0b8ab0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:26.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.373+0000 7fdba99bb640 1 --2- 172.21.15.1:0/223374385 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdba4109e40 0x7fdba4076190 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:26.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.373+0000 7fdba99bb640 1 --2- 172.21.15.1:0/223374385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdba41094f0 0x7fdba4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:26.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.373+0000 7fdba99bb640 1 --2- 172.21.15.1:0/223374385 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdba4103bb0 0x7fdba4075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:26.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.373+0000 7fdba99bb640 1 -- 172.21.15.1:0/223374385 >> 172.21.15.1:0/223374385 conn(0x7fdba40ff600 msgr2=0x7fdba4101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:26.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.373+0000 7fdba99bb640 1 -- 172.21.15.1:0/223374385 shutdown_connections 2024-09-21T00:55:26.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:26.373+0000 7fdba99bb640 1 -- 172.21.15.1:0/223374385 wait complete. 2024-09-21T00:55:26.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:26 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]} : dispatch 2024-09-21T00:55:26.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:26 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]} : dispatch 2024-09-21T00:55:26.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:26 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]} : dispatch 2024-09-21T00:55:26.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:26 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]} : dispatch 2024-09-21T00:55:26.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:26 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]} : dispatch 2024-09-21T00:55:26.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:26 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]} : dispatch 2024-09-21T00:55:26.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:26 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]} : dispatch 2024-09-21T00:55:26.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:26 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]} : dispatch 2024-09-21T00:55:26.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:26 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]} : dispatch 2024-09-21T00:55:26.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:26 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2024-09-21T00:55:26.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:26 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]} : dispatch 2024-09-21T00:55:26.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:26 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]} : dispatch 2024-09-21T00:55:26.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:26 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]} : dispatch 2024-09-21T00:55:26.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:26 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]} : dispatch 2024-09-21T00:55:26.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:26 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]} : dispatch 2024-09-21T00:55:26.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:26 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]} : dispatch 2024-09-21T00:55:26.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:26 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]} : dispatch 2024-09-21T00:55:26.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:26 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]} : dispatch 2024-09-21T00:55:26.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:26 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]} : dispatch 2024-09-21T00:55:26.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:26 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2024-09-21T00:55:26.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:26 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]} : dispatch 2024-09-21T00:55:26.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:26 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]} : dispatch 2024-09-21T00:55:26.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:26 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]} : dispatch 2024-09-21T00:55:26.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:26 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]} : dispatch 2024-09-21T00:55:26.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:26 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]} : dispatch 2024-09-21T00:55:26.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:26 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]} : dispatch 2024-09-21T00:55:26.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:26 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]} : dispatch 2024-09-21T00:55:26.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:26 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]} : dispatch 2024-09-21T00:55:26.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:26 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]} : dispatch 2024-09-21T00:55:26.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:26 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2024-09-21T00:55:27.177 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2024-09-21T00:55:26.090116+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656898,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":258,"num_read_kb":217,"num_write":359,"num_write_kb":2285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":297,"ondisk_log_size":297,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":379916,"kb_used_data":9868,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124561908,"statfs":{"total":1151940427776,"available":1151551393792,"internally_reserved":0,"allocated":10104832,"data_stored":6486386,"data_compressed":113910,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":51505,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":98,"num_write":27,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003435"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.870914+0000","last_change":"2024-09-21T00:54:57.879464+0000","last_active":"2024-09-21T00:54:58.870914+0000","last_peered":"2024-09-21T00:54:58.870914+0000","last_clean":"2024-09-21T00:54:58.870914+0000","last_became_active":"2024-09-21T00:54:57.878480+0000","last_became_peered":"2024-09-21T00:54:57.878480+0000","last_unstale":"2024-09-21T00:54:58.870914+0000","last_undegraded":"2024-09-21T00:54:58.870914+0000","last_fullsized":"2024-09-21T00:54:58.870914+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:28.056410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.869678+0000","last_change":"2024-09-21T00:54:57.866876+0000","last_active":"2024-09-21T00:54:58.869678+0000","last_peered":"2024-09-21T00:54:58.869678+0000","last_clean":"2024-09-21T00:54:58.869678+0000","last_became_active":"2024-09-21T00:54:57.866532+0000","last_became_peered":"2024-09-21T00:54:57.866532+0000","last_unstale":"2024-09-21T00:54:58.869678+0000","last_undegraded":"2024-09-21T00:54:58.869678+0000","last_fullsized":"2024-09-21T00:54:58.869678+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:15:58.881955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.870027+0000","last_change":"2024-09-21T00:54:57.874814+0000","last_active":"2024-09-21T00:54:58.870027+0000","last_peered":"2024-09-21T00:54:58.870027+0000","last_clean":"2024-09-21T00:54:58.870027+0000","last_became_active":"2024-09-21T00:54:57.873918+0000","last_became_peered":"2024-09-21T00:54:57.873918+0000","last_unstale":"2024-09-21T00:54:58.870027+0000","last_undegraded":"2024-09-21T00:54:58.870027+0000","last_fullsized":"2024-09-21T00:54:58.870027+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:14.677826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.854427+0000","last_change":"2024-09-21T00:54:57.877268+0000","last_active":"2024-09-21T00:54:58.854427+0000","last_peered":"2024-09-21T00:54:58.854427+0000","last_clean":"2024-09-21T00:54:58.854427+0000","last_became_active":"2024-09-21T00:54:57.876769+0000","last_became_peered":"2024-09-21T00:54:57.876769+0000","last_unstale":"2024-09-21T00:54:58.854427+0000","last_undegraded":"2024-09-21T00:54:58.854427+0000","last_fullsized":"2024-09-21T00:54:58.854427+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:27:02.534562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.868065+0000","last_change":"2024-09-21T00:54:57.872956+0000","last_active":"2024-09-21T00:54:58.868065+0000","last_peered":"2024-09-21T00:54:58.868065+0000","last_clean":"2024-09-21T00:54:58.868065+0000","last_became_active":"2024-09-21T00:54:57.872563+0000","last_became_peered":"2024-09-21T00:54:57.872563+0000","last_unstale":"2024-09-21T00:54:58.868065+0000","last_undegraded":"2024-09-21T00:54:58.868065+0000","last_fullsized":"2024-09-21T00:54:58.868065+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:47.776888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.866215+0000","last_change":"2024-09-21T00:54:57.870285+0000","last_active":"2024-09-21T00:54:58.866215+0000","last_peered":"2024-09-21T00:54:58.866215+0000","last_clean":"2024-09-21T00:54:58.866215+0000","last_became_active":"2024-09-21T00:54:57.869689+0000","last_became_peered":"2024-09-21T00:54:57.869689+0000","last_unstale":"2024-09-21T00:54:58.866215+0000","last_undegraded":"2024-09-21T00:54:58.866215+0000","last_fullsized":"2024-09-21T00:54:58.866215+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:54.304589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.868369+0000","last_change":"2024-09-21T00:54:57.868515+0000","last_active":"2024-09-21T00:54:58.868369+0000","last_peered":"2024-09-21T00:54:58.868369+0000","last_clean":"2024-09-21T00:54:58.868369+0000","last_became_active":"2024-09-21T00:54:57.868130+0000","last_became_peered":"2024-09-21T00:54:57.868130+0000","last_unstale":"2024-09-21T00:54:58.868369+0000","last_undegraded":"2024-09-21T00:54:58.868369+0000","last_fullsized":"2024-09-21T00:54:58.868369+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:45.482119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.866873+0000","last_change":"2024-09-21T00:54:57.869386+0000","last_active":"2024-09-21T00:54:58.866873+0000","last_peered":"2024-09-21T00:54:58.866873+0000","last_clean":"2024-09-21T00:54:58.866873+0000","last_became_active":"2024-09-21T00:54:57.869033+0000","last_became_peered":"2024-09-21T00:54:57.869033+0000","last_unstale":"2024-09-21T00:54:58.866873+0000","last_undegraded":"2024-09-21T00:54:58.866873+0000","last_fullsized":"2024-09-21T00:54:58.866873+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:39:01.305815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.872691+0000","last_change":"2024-09-21T00:54:57.870703+0000","last_active":"2024-09-21T00:54:58.872691+0000","last_peered":"2024-09-21T00:54:58.872691+0000","last_clean":"2024-09-21T00:54:58.872691+0000","last_became_active":"2024-09-21T00:54:57.870324+0000","last_became_peered":"2024-09-21T00:54:57.870324+0000","last_unstale":"2024-09-21T00:54:58.872691+0000","last_undegraded":"2024-09-21T00:54:58.872691+0000","last_fullsized":"2024-09-21T00:54:58.872691+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:50.548296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.867533+0000","last_change":"2024-09-21T00:54:57.869803+0000","last_active":"2024-09-21T00:54:58.867533+0000","last_peered":"2024-09-21T00:54:58.867533+0000","last_clean":"2024-09-21T00:54:58.867533+0000","last_became_active":"2024-09-21T00:54:57.869092+0000","last_became_peered":"2024-09-21T00:54:57.869092+0000","last_unstale":"2024-09-21T00:54:58.867533+0000","last_undegraded":"2024-09-21T00:54:58.867533+0000","last_fullsized":"2024-09-21T00:54:58.867533+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:05:27.727914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.869023+0000","last_change":"2024-09-21T00:54:57.873700+0000","last_active":"2024-09-21T00:54:58.869023+0000","last_peered":"2024-09-21T00:54:58.869023+0000","last_clean":"2024-09-21T00:54:58.869023+0000","last_became_active":"2024-09-21T00:54:57.873336+0000","last_became_peered":"2024-09-21T00:54:57.873336+0000","last_unstale":"2024-09-21T00:54:58.869023+0000","last_undegraded":"2024-09-21T00:54:58.869023+0000","last_fullsized":"2024-09-21T00:54:58.869023+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:28:17.520669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.854634+0000","last_change":"2024-09-21T00:54:57.877686+0000","last_active":"2024-09-21T00:54:58.854634+0000","last_peered":"2024-09-21T00:54:58.854634+0000","last_clean":"2024-09-21T00:54:58.854634+0000","last_became_active":"2024-09-21T00:54:57.876711+0000","last_became_peered":"2024-09-21T00:54:57.876711+0000","last_unstale":"2024-09-21T00:54:58.854634+0000","last_undegraded":"2024-09-21T00:54:58.854634+0000","last_fullsized":"2024-09-21T00:54:58.854634+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:20:11.254680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.853485+0000","last_change":"2024-09-21T00:54:57.880660+0000","last_active":"2024-09-21T00:54:58.853485+0000","last_peered":"2024-09-21T00:54:58.853485+0000","last_clean":"2024-09-21T00:54:58.853485+0000","last_became_active":"2024-09-21T00:54:57.880270+0000","last_became_peered":"2024-09-21T00:54:57.880270+0000","last_unstale":"2024-09-21T00:54:58.853485+0000","last_undegraded":"2024-09-21T00:54:58.853485+0000","last_fullsized":"2024-09-21T00:54:58.853485+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:50:16.260484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.869633+0000","last_change":"2024-09-21T00:54:57.869626+0000","last_active":"2024-09-21T00:54:58.869633+0000","last_peered":"2024-09-21T00:54:58.869633+0000","last_clean":"2024-09-21T00:54:58.869633+0000","last_became_active":"2024-09-21T00:54:57.869230+0000","last_became_peered":"2024-09-21T00:54:57.869230+0000","last_unstale":"2024-09-21T00:54:58.869633+0000","last_undegraded":"2024-09-21T00:54:58.869633+0000","last_fullsized":"2024-09-21T00:54:58.869633+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:49.131237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.869198+0000","last_change":"2024-09-21T00:54:57.874917+0000","last_active":"2024-09-21T00:54:58.869198+0000","last_peered":"2024-09-21T00:54:58.869198+0000","last_clean":"2024-09-21T00:54:58.869198+0000","last_became_active":"2024-09-21T00:54:57.873787+0000","last_became_peered":"2024-09-21T00:54:57.873787+0000","last_unstale":"2024-09-21T00:54:58.869198+0000","last_undegraded":"2024-09-21T00:54:58.869198+0000","last_fullsized":"2024-09-21T00:54:58.869198+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:44.226734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.871422+0000","last_change":"2024-09-21T00:54:57.877479+0000","last_active":"2024-09-21T00:54:58.871422+0000","last_peered":"2024-09-21T00:54:58.871422+0000","last_clean":"2024-09-21T00:54:58.871422+0000","last_became_active":"2024-09-21T00:54:57.877110+0000","last_became_peered":"2024-09-21T00:54:57.877110+0000","last_unstale":"2024-09-21T00:54:58.871422+0000","last_undegraded":"2024-09-21T00:54:58.871422+0000","last_fullsized":"2024-09-21T00:54:58.871422+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:18.547970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.871192+0000","last_change":"2024-09-21T00:54:57.878701+0000","last_active":"2024-09-21T00:54:58.871192+0000","last_peered":"2024-09-21T00:54:58.871192+0000","last_clean":"2024-09-21T00:54:58.871192+0000","last_became_active":"2024-09-21T00:54:57.878254+0000","last_became_peered":"2024-09-21T00:54:57.878254+0000","last_unstale":"2024-09-21T00:54:58.871192+0000","last_undegraded":"2024-09-21T00:54:58.871192+0000","last_fullsized":"2024-09-21T00:54:58.871192+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:51.309956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.867057+0000","last_change":"2024-09-21T00:54:57.869571+0000","last_active":"2024-09-21T00:54:58.867057+0000","last_peered":"2024-09-21T00:54:58.867057+0000","last_clean":"2024-09-21T00:54:58.867057+0000","last_became_active":"2024-09-21T00:54:57.868907+0000","last_became_peered":"2024-09-21T00:54:57.868907+0000","last_unstale":"2024-09-21T00:54:58.867057+0000","last_undegraded":"2024-09-21T00:54:58.867057+0000","last_fullsized":"2024-09-21T00:54:58.867057+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:14.951885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.868295+0000","last_change":"2024-09-21T00:54:57.869277+0000","last_active":"2024-09-21T00:54:58.868295+0000","last_peered":"2024-09-21T00:54:58.868295+0000","last_clean":"2024-09-21T00:54:58.868295+0000","last_became_active":"2024-09-21T00:54:57.868777+0000","last_became_peered":"2024-09-21T00:54:57.868777+0000","last_unstale":"2024-09-21T00:54:58.868295+0000","last_undegraded":"2024-09-21T00:54:58.868295+0000","last_fullsized":"2024-09-21T00:54:58.868295+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:09:04.766266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.870263+0000","last_change":"2024-09-21T00:54:57.875895+0000","last_active":"2024-09-21T00:54:58.870263+0000","last_peered":"2024-09-21T00:54:58.870263+0000","last_clean":"2024-09-21T00:54:58.870263+0000","last_became_active":"2024-09-21T00:54:57.875505+0000","last_became_peered":"2024-09-21T00:54:57.875505+0000","last_unstale":"2024-09-21T00:54:58.870263+0000","last_undegraded":"2024-09-21T00:54:58.870263+0000","last_fullsized":"2024-09-21T00:54:58.870263+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:19:29.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.853432+0000","last_change":"2024-09-21T00:54:57.871236+0000","last_active":"2024-09-21T00:54:58.853432+0000","last_peered":"2024-09-21T00:54:58.853432+0000","last_clean":"2024-09-21T00:54:58.853432+0000","last_became_active":"2024-09-21T00:54:57.870131+0000","last_became_peered":"2024-09-21T00:54:57.870131+0000","last_unstale":"2024-09-21T00:54:58.853432+0000","last_undegraded":"2024-09-21T00:54:58.853432+0000","last_fullsized":"2024-09-21T00:54:58.853432+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:45.067436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.871125+0000","last_change":"2024-09-21T00:54:57.878710+0000","last_active":"2024-09-21T00:54:58.871125+0000","last_peered":"2024-09-21T00:54:58.871125+0000","last_clean":"2024-09-21T00:54:58.871125+0000","last_became_active":"2024-09-21T00:54:57.878352+0000","last_became_peered":"2024-09-21T00:54:57.878352+0000","last_unstale":"2024-09-21T00:54:58.871125+0000","last_undegraded":"2024-09-21T00:54:58.871125+0000","last_fullsized":"2024-09-21T00:54:58.871125+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:32:40.561028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.868269+0000","last_change":"2024-09-21T00:54:57.873226+0000","last_active":"2024-09-21T00:54:58.868269+0000","last_peered":"2024-09-21T00:54:58.868269+0000","last_clean":"2024-09-21T00:54:58.868269+0000","last_became_active":"2024-09-21T00:54:57.872840+0000","last_became_peered":"2024-09-21T00:54:57.872840+0000","last_unstale":"2024-09-21T00:54:58.868269+0000","last_undegraded":"2024-09-21T00:54:58.868269+0000","last_fullsized":"2024-09-21T00:54:58.868269+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:41.259070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.854298+0000","last_change":"2024-09-21T00:54:57.872249+0000","last_active":"2024-09-21T00:54:58.854298+0000","last_peered":"2024-09-21T00:54:58.854298+0000","last_clean":"2024-09-21T00:54:58.854298+0000","last_became_active":"2024-09-21T00:54:57.871868+0000","last_became_peered":"2024-09-21T00:54:57.871868+0000","last_unstale":"2024-09-21T00:54:58.854298+0000","last_undegraded":"2024-09-21T00:54:58.854298+0000","last_fullsized":"2024-09-21T00:54:58.854298+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:27.428549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.868792+0000","last_change":"2024-09-21T00:54:57.878534+0000","last_active":"2024-09-21T00:54:58.868792+0000","last_peered":"2024-09-21T00:54:58.868792+0000","last_clean":"2024-09-21T00:54:58.868792+0000","last_became_active":"2024-09-21T00:54:57.878189+0000","last_became_peered":"2024-09-21T00:54:57.878189+0000","last_unstale":"2024-09-21T00:54:58.868792+0000","last_undegraded":"2024-09-21T00:54:58.868792+0000","last_fullsized":"2024-09-21T00:54:58.868792+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:29.668779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.868464+0000","last_change":"2024-09-21T00:54:57.870994+0000","last_active":"2024-09-21T00:54:58.868464+0000","last_peered":"2024-09-21T00:54:58.868464+0000","last_clean":"2024-09-21T00:54:58.868464+0000","last_became_active":"2024-09-21T00:54:57.867939+0000","last_became_peered":"2024-09-21T00:54:57.867939+0000","last_unstale":"2024-09-21T00:54:58.868464+0000","last_undegraded":"2024-09-21T00:54:58.868464+0000","last_fullsized":"2024-09-21T00:54:58.868464+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:44.858289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.872943+0000","last_change":"2024-09-21T00:54:57.870568+0000","last_active":"2024-09-21T00:54:58.872943+0000","last_peered":"2024-09-21T00:54:58.872943+0000","last_clean":"2024-09-21T00:54:58.872943+0000","last_became_active":"2024-09-21T00:54:57.870208+0000","last_became_peered":"2024-09-21T00:54:57.870208+0000","last_unstale":"2024-09-21T00:54:58.872943+0000","last_undegraded":"2024-09-21T00:54:58.872943+0000","last_fullsized":"2024-09-21T00:54:58.872943+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:28:09.824385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.853290+0000","last_change":"2024-09-21T00:54:57.870228+0000","last_active":"2024-09-21T00:54:58.853290+0000","last_peered":"2024-09-21T00:54:58.853290+0000","last_clean":"2024-09-21T00:54:58.853290+0000","last_became_active":"2024-09-21T00:54:57.869866+0000","last_became_peered":"2024-09-21T00:54:57.869866+0000","last_unstale":"2024-09-21T00:54:58.853290+0000","last_undegraded":"2024-09-21T00:54:58.853290+0000","last_fullsized":"2024-09-21T00:54:58.853290+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:20.073393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.869526+0000","last_change":"2024-09-21T00:54:57.867602+0000","last_active":"2024-09-21T00:54:58.869526+0000","last_peered":"2024-09-21T00:54:58.869526+0000","last_clean":"2024-09-21T00:54:58.869526+0000","last_became_active":"2024-09-21T00:54:57.867104+0000","last_became_peered":"2024-09-21T00:54:57.867104+0000","last_unstale":"2024-09-21T00:54:58.869526+0000","last_undegraded":"2024-09-21T00:54:58.869526+0000","last_fullsized":"2024-09-21T00:54:58.869526+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:29:37.403384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.867414+0000","last_change":"2024-09-21T00:54:57.869400+0000","last_active":"2024-09-21T00:54:58.867414+0000","last_peered":"2024-09-21T00:54:58.867414+0000","last_clean":"2024-09-21T00:54:58.867414+0000","last_became_active":"2024-09-21T00:54:57.868997+0000","last_became_peered":"2024-09-21T00:54:57.868997+0000","last_unstale":"2024-09-21T00:54:58.867414+0000","last_undegraded":"2024-09-21T00:54:58.867414+0000","last_fullsized":"2024-09-21T00:54:58.867414+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:00.117559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.868966+0000","last_change":"2024-09-21T00:54:57.867392+0000","last_active":"2024-09-21T00:54:58.868966+0000","last_peered":"2024-09-21T00:54:58.868966+0000","last_clean":"2024-09-21T00:54:58.868966+0000","last_became_active":"2024-09-21T00:54:57.867001+0000","last_became_peered":"2024-09-21T00:54:57.867001+0000","last_unstale":"2024-09-21T00:54:58.868966+0000","last_undegraded":"2024-09-21T00:54:58.868966+0000","last_fullsized":"2024-09-21T00:54:58.868966+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:05.090149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.869967+0000","last_change":"2024-09-21T00:54:57.867620+0000","last_active":"2024-09-21T00:54:58.869967+0000","last_peered":"2024-09-21T00:54:58.869967+0000","last_clean":"2024-09-21T00:54:58.869967+0000","last_became_active":"2024-09-21T00:54:57.867190+0000","last_became_peered":"2024-09-21T00:54:57.867190+0000","last_unstale":"2024-09-21T00:54:58.869967+0000","last_undegraded":"2024-09-21T00:54:58.869967+0000","last_fullsized":"2024-09-21T00:54:58.869967+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:36.432368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.867351+0000","last_change":"2024-09-21T00:54:57.880526+0000","last_active":"2024-09-21T00:54:58.867351+0000","last_peered":"2024-09-21T00:54:58.867351+0000","last_clean":"2024-09-21T00:54:58.867351+0000","last_became_active":"2024-09-21T00:54:57.880154+0000","last_became_peered":"2024-09-21T00:54:57.880154+0000","last_unstale":"2024-09-21T00:54:58.867351+0000","last_undegraded":"2024-09-21T00:54:58.867351+0000","last_fullsized":"2024-09-21T00:54:58.867351+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:56.179127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'5","reported_seq":39,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:20.608470+0000","last_change":"2024-09-21T00:54:55.867717+0000","last_active":"2024-09-21T00:55:20.608470+0000","last_peered":"2024-09-21T00:55:20.608470+0000","last_clean":"2024-09-21T00:55:20.608470+0000","last_became_active":"2024-09-21T00:54:55.867306+0000","last_became_peered":"2024-09-21T00:54:55.867306+0000","last_unstale":"2024-09-21T00:55:20.608470+0000","last_undegraded":"2024-09-21T00:55:20.608470+0000","last_fullsized":"2024-09-21T00:55:20.608470+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:25.192109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.854790+0000","last_change":"2024-09-21T00:54:57.879034+0000","last_active":"2024-09-21T00:54:58.854790+0000","last_peered":"2024-09-21T00:54:58.854790+0000","last_clean":"2024-09-21T00:54:58.854790+0000","last_became_active":"2024-09-21T00:54:57.878673+0000","last_became_peered":"2024-09-21T00:54:57.878673+0000","last_unstale":"2024-09-21T00:54:58.854790+0000","last_undegraded":"2024-09-21T00:54:58.854790+0000","last_fullsized":"2024-09-21T00:54:58.854790+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:39:12.467465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'7","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:08.186536+0000","last_change":"2024-09-21T00:54:55.867451+0000","last_active":"2024-09-21T00:55:08.186536+0000","last_peered":"2024-09-21T00:55:08.186536+0000","last_clean":"2024-09-21T00:55:08.186536+0000","last_became_active":"2024-09-21T00:54:55.866998+0000","last_became_peered":"2024-09-21T00:54:55.866998+0000","last_unstale":"2024-09-21T00:55:08.186536+0000","last_undegraded":"2024-09-21T00:55:08.186536+0000","last_fullsized":"2024-09-21T00:55:08.186536+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:40.878647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:07.177052+0000","last_change":"2024-09-21T00:54:55.853055+0000","last_active":"2024-09-21T00:55:07.177052+0000","last_peered":"2024-09-21T00:55:07.177052+0000","last_clean":"2024-09-21T00:55:07.177052+0000","last_became_active":"2024-09-21T00:54:55.852672+0000","last_became_peered":"2024-09-21T00:54:55.852672+0000","last_unstale":"2024-09-21T00:55:07.177052+0000","last_undegraded":"2024-09-21T00:55:07.177052+0000","last_fullsized":"2024-09-21T00:55:07.177052+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:17.082588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.867131+0000","last_change":"2024-09-21T00:54:57.875024+0000","last_active":"2024-09-21T00:54:58.867131+0000","last_peered":"2024-09-21T00:54:58.867131+0000","last_clean":"2024-09-21T00:54:58.867131+0000","last_became_active":"2024-09-21T00:54:57.870027+0000","last_became_peered":"2024-09-21T00:54:57.870027+0000","last_unstale":"2024-09-21T00:54:58.867131+0000","last_undegraded":"2024-09-21T00:54:58.867131+0000","last_fullsized":"2024-09-21T00:54:58.867131+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:37:48.880686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'3","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:09.195254+0000","last_change":"2024-09-21T00:54:55.864527+0000","last_active":"2024-09-21T00:55:09.195254+0000","last_peered":"2024-09-21T00:55:09.195254+0000","last_clean":"2024-09-21T00:55:09.195254+0000","last_became_active":"2024-09-21T00:54:55.864191+0000","last_became_peered":"2024-09-21T00:54:55.864191+0000","last_unstale":"2024-09-21T00:55:09.195254+0000","last_undegraded":"2024-09-21T00:55:09.195254+0000","last_fullsized":"2024-09-21T00:55:09.195254+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:43.781116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.868587+0000","last_change":"2024-09-21T00:54:57.865671+0000","last_active":"2024-09-21T00:54:58.868587+0000","last_peered":"2024-09-21T00:54:58.868587+0000","last_clean":"2024-09-21T00:54:58.868587+0000","last_became_active":"2024-09-21T00:54:57.865196+0000","last_became_peered":"2024-09-21T00:54:57.865196+0000","last_unstale":"2024-09-21T00:54:58.868587+0000","last_undegraded":"2024-09-21T00:54:58.868587+0000","last_fullsized":"2024-09-21T00:54:58.868587+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:16.524866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'4","reported_seq":51,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:22.610594+0000","last_change":"2024-09-21T00:54:55.862504+0000","last_active":"2024-09-21T00:55:22.610594+0000","last_peered":"2024-09-21T00:55:22.610594+0000","last_clean":"2024-09-21T00:55:22.610594+0000","last_became_active":"2024-09-21T00:54:55.862065+0000","last_became_peered":"2024-09-21T00:54:55.862065+0000","last_unstale":"2024-09-21T00:55:22.610594+0000","last_undegraded":"2024-09-21T00:55:22.610594+0000","last_fullsized":"2024-09-21T00:55:22.610594+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:16.497313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.872463+0000","last_change":"2024-09-21T00:54:57.873444+0000","last_active":"2024-09-21T00:54:58.872463+0000","last_peered":"2024-09-21T00:54:58.872463+0000","last_clean":"2024-09-21T00:54:58.872463+0000","last_became_active":"2024-09-21T00:54:57.873058+0000","last_became_peered":"2024-09-21T00:54:57.873058+0000","last_unstale":"2024-09-21T00:54:58.872463+0000","last_undegraded":"2024-09-21T00:54:58.872463+0000","last_fullsized":"2024-09-21T00:54:58.872463+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:36:40.603285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'4","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:09.193694+0000","last_change":"2024-09-21T00:54:55.865900+0000","last_active":"2024-09-21T00:55:09.193694+0000","last_peered":"2024-09-21T00:55:09.193694+0000","last_clean":"2024-09-21T00:55:09.193694+0000","last_became_active":"2024-09-21T00:54:55.865507+0000","last_became_peered":"2024-09-21T00:54:55.865507+0000","last_unstale":"2024-09-21T00:55:09.193694+0000","last_undegraded":"2024-09-21T00:55:09.193694+0000","last_fullsized":"2024-09-21T00:55:09.193694+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:27.615143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.870147+0000","last_change":"2024-09-21T00:54:57.868570+0000","last_active":"2024-09-21T00:54:58.870147+0000","last_peered":"2024-09-21T00:54:58.870147+0000","last_clean":"2024-09-21T00:54:58.870147+0000","last_became_active":"2024-09-21T00:54:57.868242+0000","last_became_peered":"2024-09-21T00:54:57.868242+0000","last_unstale":"2024-09-21T00:54:58.870147+0000","last_undegraded":"2024-09-21T00:54:58.870147+0000","last_fullsized":"2024-09-21T00:54:58.870147+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:37.845984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'5","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:08.185808+0000","last_change":"2024-09-21T00:54:55.968782+0000","last_active":"2024-09-21T00:55:08.185808+0000","last_peered":"2024-09-21T00:55:08.185808+0000","last_clean":"2024-09-21T00:55:08.185808+0000","last_became_active":"2024-09-21T00:54:55.968421+0000","last_became_peered":"2024-09-21T00:54:55.968421+0000","last_unstale":"2024-09-21T00:55:08.185808+0000","last_undegraded":"2024-09-21T00:55:08.185808+0000","last_fullsized":"2024-09-21T00:55:08.185808+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:28.680764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.872187+0000","last_change":"2024-09-21T00:54:57.877610+0000","last_active":"2024-09-21T00:54:58.872187+0000","last_peered":"2024-09-21T00:54:58.872187+0000","last_clean":"2024-09-21T00:54:58.872187+0000","last_became_active":"2024-09-21T00:54:57.877225+0000","last_became_peered":"2024-09-21T00:54:57.877225+0000","last_unstale":"2024-09-21T00:54:58.872187+0000","last_undegraded":"2024-09-21T00:54:58.872187+0000","last_fullsized":"2024-09-21T00:54:58.872187+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:08.294366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"73'27","reported_seq":79,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:23.127532+0000","last_change":"2024-09-21T00:54:55.866982+0000","last_active":"2024-09-21T00:55:23.127532+0000","last_peered":"2024-09-21T00:55:23.127532+0000","last_clean":"2024-09-21T00:55:23.127532+0000","last_became_active":"2024-09-21T00:54:55.866277+0000","last_became_peered":"2024-09-21T00:54:55.866277+0000","last_unstale":"2024-09-21T00:55:23.127532+0000","last_undegraded":"2024-09-21T00:55:23.127532+0000","last_fullsized":"2024-09-21T00:55:23.127532+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:59.737625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59092,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":33,"num_read_kb":65,"num_write":29,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.872454+0000","last_change":"2024-09-21T00:54:57.875575+0000","last_active":"2024-09-21T00:54:58.872454+0000","last_peered":"2024-09-21T00:54:58.872454+0000","last_clean":"2024-09-21T00:54:58.872454+0000","last_became_active":"2024-09-21T00:54:57.874975+0000","last_became_peered":"2024-09-21T00:54:57.874975+0000","last_unstale":"2024-09-21T00:54:58.872454+0000","last_undegraded":"2024-09-21T00:54:58.872454+0000","last_fullsized":"2024-09-21T00:54:58.872454+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:34:36.089068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'9","reported_seq":30,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:09.587831+0000","last_change":"2024-09-21T00:54:55.863532+0000","last_active":"2024-09-21T00:55:09.587831+0000","last_peered":"2024-09-21T00:55:09.587831+0000","last_clean":"2024-09-21T00:55:09.587831+0000","last_became_active":"2024-09-21T00:54:55.863124+0000","last_became_peered":"2024-09-21T00:54:55.863124+0000","last_unstale":"2024-09-21T00:55:09.587831+0000","last_undegraded":"2024-09-21T00:55:09.587831+0000","last_fullsized":"2024-09-21T00:55:09.587831+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:41:07.996906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.853015+0000","last_change":"2024-09-21T00:54:57.866126+0000","last_active":"2024-09-21T00:54:58.853015+0000","last_peered":"2024-09-21T00:54:58.853015+0000","last_clean":"2024-09-21T00:54:58.853015+0000","last_became_active":"2024-09-21T00:54:57.865775+0000","last_became_peered":"2024-09-21T00:54:57.865775+0000","last_unstale":"2024-09-21T00:54:58.853015+0000","last_undegraded":"2024-09-21T00:54:58.853015+0000","last_fullsized":"2024-09-21T00:54:58.853015+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:28.261632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'5","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:09.194338+0000","last_change":"2024-09-21T00:54:55.864593+0000","last_active":"2024-09-21T00:55:09.194338+0000","last_peered":"2024-09-21T00:55:09.194338+0000","last_clean":"2024-09-21T00:55:09.194338+0000","last_became_active":"2024-09-21T00:54:55.864202+0000","last_became_peered":"2024-09-21T00:54:55.864202+0000","last_unstale":"2024-09-21T00:55:09.194338+0000","last_undegraded":"2024-09-21T00:55:09.194338+0000","last_fullsized":"2024-09-21T00:55:09.194338+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:06.976588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.869694+0000","last_change":"2024-09-21T00:54:57.877892+0000","last_active":"2024-09-21T00:54:58.869694+0000","last_peered":"2024-09-21T00:54:58.869694+0000","last_clean":"2024-09-21T00:54:58.869694+0000","last_became_active":"2024-09-21T00:54:57.877510+0000","last_became_peered":"2024-09-21T00:54:57.877510+0000","last_unstale":"2024-09-21T00:54:58.869694+0000","last_undegraded":"2024-09-21T00:54:58.869694+0000","last_fullsized":"2024-09-21T00:54:58.869694+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:05.238100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'6","reported_seq":42,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:21.610634+0000","last_change":"2024-09-21T00:54:55.856707+0000","last_active":"2024-09-21T00:55:21.610634+0000","last_peered":"2024-09-21T00:55:21.610634+0000","last_clean":"2024-09-21T00:55:21.610634+0000","last_became_active":"2024-09-21T00:54:55.856095+0000","last_became_peered":"2024-09-21T00:54:55.856095+0000","last_unstale":"2024-09-21T00:55:21.610634+0000","last_undegraded":"2024-09-21T00:55:21.610634+0000","last_fullsized":"2024-09-21T00:55:21.610634+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:48.332764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.869482+0000","last_change":"2024-09-21T00:54:57.868398+0000","last_active":"2024-09-21T00:54:58.869482+0000","last_peered":"2024-09-21T00:54:58.869482+0000","last_clean":"2024-09-21T00:54:58.869482+0000","last_became_active":"2024-09-21T00:54:57.867963+0000","last_became_peered":"2024-09-21T00:54:57.867963+0000","last_unstale":"2024-09-21T00:54:58.869482+0000","last_undegraded":"2024-09-21T00:54:58.869482+0000","last_fullsized":"2024-09-21T00:54:58.869482+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:59:31.527713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'17","reported_seq":37,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:09.193687+0000","last_change":"2024-09-21T00:54:55.969105+0000","last_active":"2024-09-21T00:55:09.193687+0000","last_peered":"2024-09-21T00:55:09.193687+0000","last_clean":"2024-09-21T00:55:09.193687+0000","last_became_active":"2024-09-21T00:54:55.968699+0000","last_became_peered":"2024-09-21T00:54:55.968699+0000","last_unstale":"2024-09-21T00:55:09.193687+0000","last_undegraded":"2024-09-21T00:55:09.193687+0000","last_fullsized":"2024-09-21T00:55:09.193687+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:53.901106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.854418+0000","last_change":"2024-09-21T00:54:57.872256+0000","last_active":"2024-09-21T00:54:58.854418+0000","last_peered":"2024-09-21T00:54:58.854418+0000","last_clean":"2024-09-21T00:54:58.854418+0000","last_became_active":"2024-09-21T00:54:57.871848+0000","last_became_peered":"2024-09-21T00:54:57.871848+0000","last_unstale":"2024-09-21T00:54:58.854418+0000","last_undegraded":"2024-09-21T00:54:58.854418+0000","last_fullsized":"2024-09-21T00:54:58.854418+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:24:11.314693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:09.172505+0000","last_change":"2024-09-21T00:54:55.870096+0000","last_active":"2024-09-21T00:55:09.172505+0000","last_peered":"2024-09-21T00:55:09.172505+0000","last_clean":"2024-09-21T00:55:09.172505+0000","last_became_active":"2024-09-21T00:54:55.869616+0000","last_became_peered":"2024-09-21T00:54:55.869616+0000","last_unstale":"2024-09-21T00:55:09.172505+0000","last_undegraded":"2024-09-21T00:55:09.172505+0000","last_fullsized":"2024-09-21T00:55:09.172505+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:53:48.036499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.870011+0000","last_change":"2024-09-21T00:54:57.875761+0000","last_active":"2024-09-21T00:54:58.870011+0000","last_peered":"2024-09-21T00:54:58.870011+0000","last_clean":"2024-09-21T00:54:58.870011+0000","last_became_active":"2024-09-21T00:54:57.875416+0000","last_became_peered":"2024-09-21T00:54:57.875416+0000","last_unstale":"2024-09-21T00:54:58.870011+0000","last_undegraded":"2024-09-21T00:54:58.870011+0000","last_fullsized":"2024-09-21T00:54:58.870011+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:35.118999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'5","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:09.192253+0000","last_change":"2024-09-21T00:54:55.866393+0000","last_active":"2024-09-21T00:55:09.192253+0000","last_peered":"2024-09-21T00:55:09.192253+0000","last_clean":"2024-09-21T00:55:09.192253+0000","last_became_active":"2024-09-21T00:54:55.865980+0000","last_became_peered":"2024-09-21T00:54:55.865980+0000","last_unstale":"2024-09-21T00:55:09.192253+0000","last_undegraded":"2024-09-21T00:55:09.192253+0000","last_fullsized":"2024-09-21T00:55:09.192253+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:56.471011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.870082+0000","last_change":"2024-09-21T00:54:57.875177+0000","last_active":"2024-09-21T00:54:58.870082+0000","last_peered":"2024-09-21T00:54:58.870082+0000","last_clean":"2024-09-21T00:54:58.870082+0000","last_became_active":"2024-09-21T00:54:57.874819+0000","last_became_peered":"2024-09-21T00:54:57.874819+0000","last_unstale":"2024-09-21T00:54:58.870082+0000","last_undegraded":"2024-09-21T00:54:58.870082+0000","last_fullsized":"2024-09-21T00:54:58.870082+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:43.942703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'3","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:09.194583+0000","last_change":"2024-09-21T00:54:55.864668+0000","last_active":"2024-09-21T00:55:09.194583+0000","last_peered":"2024-09-21T00:55:09.194583+0000","last_clean":"2024-09-21T00:55:09.194583+0000","last_became_active":"2024-09-21T00:54:55.864330+0000","last_became_peered":"2024-09-21T00:54:55.864330+0000","last_unstale":"2024-09-21T00:55:09.194583+0000","last_undegraded":"2024-09-21T00:55:09.194583+0000","last_fullsized":"2024-09-21T00:55:09.194583+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:45:50.751390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:00.801166+0000","last_change":"2024-09-21T00:54:57.871093+0000","last_active":"2024-09-21T00:55:00.801166+0000","last_peered":"2024-09-21T00:55:00.801166+0000","last_clean":"2024-09-21T00:55:00.801166+0000","last_became_active":"2024-09-21T00:54:57.870457+0000","last_became_peered":"2024-09-21T00:54:57.870457+0000","last_unstale":"2024-09-21T00:55:00.801166+0000","last_undegraded":"2024-09-21T00:55:00.801166+0000","last_fullsized":"2024-09-21T00:55:00.801166+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:19.810575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'6","reported_seq":45,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:24.614202+0000","last_change":"2024-09-21T00:54:55.968156+0000","last_active":"2024-09-21T00:55:24.614202+0000","last_peered":"2024-09-21T00:55:24.614202+0000","last_clean":"2024-09-21T00:55:24.614202+0000","last_became_active":"2024-09-21T00:54:55.967668+0000","last_became_peered":"2024-09-21T00:54:55.967668+0000","last_unstale":"2024-09-21T00:55:24.614202+0000","last_undegraded":"2024-09-21T00:55:24.614202+0000","last_fullsized":"2024-09-21T00:55:24.614202+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:28.854249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.869318+0000","last_change":"2024-09-21T00:54:57.868187+0000","last_active":"2024-09-21T00:54:58.869318+0000","last_peered":"2024-09-21T00:54:58.869318+0000","last_clean":"2024-09-21T00:54:58.869318+0000","last_became_active":"2024-09-21T00:54:57.867709+0000","last_became_peered":"2024-09-21T00:54:57.867709+0000","last_unstale":"2024-09-21T00:54:58.869318+0000","last_undegraded":"2024-09-21T00:54:58.869318+0000","last_fullsized":"2024-09-21T00:54:58.869318+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:40.123030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":92,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.869566+0000","last_change":"2024-09-21T00:53:44.515787+0000","last_active":"2024-09-21T00:54:58.869566+0000","last_peered":"2024-09-21T00:54:58.869566+0000","last_clean":"2024-09-21T00:54:58.869566+0000","last_became_active":"2024-09-21T00:53:44.510106+0000","last_became_peered":"2024-09-21T00:53:44.510106+0000","last_unstale":"2024-09-21T00:54:58.869566+0000","last_undegraded":"2024-09-21T00:54:58.869566+0000","last_fullsized":"2024-09-21T00:54:58.869566+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:50:16.598790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:50:16.598790+0000","last_clean_scrub_stamp":"2024-09-21T00:50:16.598790+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:04:14.481212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'6","reported_seq":28,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:09.589312+0000","last_change":"2024-09-21T00:54:55.854929+0000","last_active":"2024-09-21T00:55:09.589312+0000","last_peered":"2024-09-21T00:55:09.589312+0000","last_clean":"2024-09-21T00:55:09.589312+0000","last_became_active":"2024-09-21T00:54:55.854489+0000","last_became_peered":"2024-09-21T00:54:55.854489+0000","last_unstale":"2024-09-21T00:55:09.589312+0000","last_undegraded":"2024-09-21T00:55:09.589312+0000","last_fullsized":"2024-09-21T00:55:09.589312+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:03.067142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.867535+0000","last_change":"2024-09-21T00:54:57.881371+0000","last_active":"2024-09-21T00:54:58.867535+0000","last_peered":"2024-09-21T00:54:58.867535+0000","last_clean":"2024-09-21T00:54:58.867535+0000","last_became_active":"2024-09-21T00:54:57.881028+0000","last_became_peered":"2024-09-21T00:54:57.881028+0000","last_unstale":"2024-09-21T00:54:58.867535+0000","last_undegraded":"2024-09-21T00:54:58.867535+0000","last_fullsized":"2024-09-21T00:54:58.867535+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:04.241676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'4","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:07.176601+0000","last_change":"2024-09-21T00:54:55.863265+0000","last_active":"2024-09-21T00:55:07.176601+0000","last_peered":"2024-09-21T00:55:07.176601+0000","last_clean":"2024-09-21T00:55:07.176601+0000","last_became_active":"2024-09-21T00:54:55.862613+0000","last_became_peered":"2024-09-21T00:54:55.862613+0000","last_unstale":"2024-09-21T00:55:07.176601+0000","last_undegraded":"2024-09-21T00:55:07.176601+0000","last_fullsized":"2024-09-21T00:55:07.176601+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:56.707143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.853001+0000","last_change":"2024-09-21T00:54:57.855249+0000","last_active":"2024-09-21T00:54:58.853001+0000","last_peered":"2024-09-21T00:54:58.853001+0000","last_clean":"2024-09-21T00:54:58.853001+0000","last_became_active":"2024-09-21T00:54:57.854879+0000","last_became_peered":"2024-09-21T00:54:57.854879+0000","last_unstale":"2024-09-21T00:54:58.853001+0000","last_undegraded":"2024-09-21T00:54:58.853001+0000","last_fullsized":"2024-09-21T00:54:58.853001+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:15.733514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'5","reported_seq":41,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:23.612814+0000","last_change":"2024-09-21T00:54:55.968078+0000","last_active":"2024-09-21T00:55:23.612814+0000","last_peered":"2024-09-21T00:55:23.612814+0000","last_clean":"2024-09-21T00:55:23.612814+0000","last_became_active":"2024-09-21T00:54:55.967700+0000","last_became_peered":"2024-09-21T00:54:55.967700+0000","last_unstale":"2024-09-21T00:55:23.612814+0000","last_undegraded":"2024-09-21T00:55:23.612814+0000","last_fullsized":"2024-09-21T00:55:23.612814+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:35.121889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.854421+0000","last_change":"2024-09-21T00:54:57.873224+0000","last_active":"2024-09-21T00:54:58.854421+0000","last_peered":"2024-09-21T00:54:58.854421+0000","last_clean":"2024-09-21T00:54:58.854421+0000","last_became_active":"2024-09-21T00:54:57.872828+0000","last_became_peered":"2024-09-21T00:54:57.872828+0000","last_unstale":"2024-09-21T00:54:58.854421+0000","last_undegraded":"2024-09-21T00:54:58.854421+0000","last_fullsized":"2024-09-21T00:54:58.854421+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:58:55.758620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'5","reported_seq":42,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:24.612308+0000","last_change":"2024-09-21T00:54:55.859887+0000","last_active":"2024-09-21T00:55:24.612308+0000","last_peered":"2024-09-21T00:55:24.612308+0000","last_clean":"2024-09-21T00:55:24.612308+0000","last_became_active":"2024-09-21T00:54:55.859351+0000","last_became_peered":"2024-09-21T00:54:55.859351+0000","last_unstale":"2024-09-21T00:55:24.612308+0000","last_undegraded":"2024-09-21T00:55:24.612308+0000","last_fullsized":"2024-09-21T00:55:24.612308+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:31.407409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.866423+0000","last_change":"2024-09-21T00:54:57.882568+0000","last_active":"2024-09-21T00:54:58.866423+0000","last_peered":"2024-09-21T00:54:58.866423+0000","last_clean":"2024-09-21T00:54:58.866423+0000","last_became_active":"2024-09-21T00:54:57.882190+0000","last_became_peered":"2024-09-21T00:54:57.882190+0000","last_unstale":"2024-09-21T00:54:58.866423+0000","last_undegraded":"2024-09-21T00:54:58.866423+0000","last_fullsized":"2024-09-21T00:54:58.866423+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:19.339490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"73'1","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.866493+0000","last_change":"2024-09-21T00:54:55.970154+0000","last_active":"2024-09-21T00:54:58.866493+0000","last_peered":"2024-09-21T00:54:58.866493+0000","last_clean":"2024-09-21T00:54:58.866493+0000","last_became_active":"2024-09-21T00:54:55.969774+0000","last_became_peered":"2024-09-21T00:54:55.969774+0000","last_unstale":"2024-09-21T00:54:58.866493+0000","last_undegraded":"2024-09-21T00:54:58.866493+0000","last_fullsized":"2024-09-21T00:54:58.866493+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:05.241455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.866876+0000","last_change":"2024-09-21T00:54:57.873452+0000","last_active":"2024-09-21T00:54:58.866876+0000","last_peered":"2024-09-21T00:54:58.866876+0000","last_clean":"2024-09-21T00:54:58.866876+0000","last_became_active":"2024-09-21T00:54:57.872592+0000","last_became_peered":"2024-09-21T00:54:57.872592+0000","last_unstale":"2024-09-21T00:54:58.866876+0000","last_undegraded":"2024-09-21T00:54:58.866876+0000","last_fullsized":"2024-09-21T00:54:58.866876+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:25.196491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'4","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:09.194044+0000","last_change":"2024-09-21T00:54:55.968563+0000","last_active":"2024-09-21T00:55:09.194044+0000","last_peered":"2024-09-21T00:55:09.194044+0000","last_clean":"2024-09-21T00:55:09.194044+0000","last_became_active":"2024-09-21T00:54:55.968176+0000","last_became_peered":"2024-09-21T00:54:55.968176+0000","last_unstale":"2024-09-21T00:55:09.194044+0000","last_undegraded":"2024-09-21T00:55:09.194044+0000","last_fullsized":"2024-09-21T00:55:09.194044+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:35.120595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.853429+0000","last_change":"2024-09-21T00:54:57.862128+0000","last_active":"2024-09-21T00:54:58.853429+0000","last_peered":"2024-09-21T00:54:58.853429+0000","last_clean":"2024-09-21T00:54:58.853429+0000","last_became_active":"2024-09-21T00:54:57.861692+0000","last_became_peered":"2024-09-21T00:54:57.861692+0000","last_unstale":"2024-09-21T00:54:58.853429+0000","last_undegraded":"2024-09-21T00:54:58.853429+0000","last_fullsized":"2024-09-21T00:54:58.853429+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:58:29.364344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"73'12","reported_seq":31,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:18.866923+0000","last_change":"2024-09-21T00:54:55.866240+0000","last_active":"2024-09-21T00:55:18.866923+0000","last_peered":"2024-09-21T00:55:18.866923+0000","last_clean":"2024-09-21T00:55:18.866923+0000","last_became_active":"2024-09-21T00:54:55.865192+0000","last_became_peered":"2024-09-21T00:54:55.865192+0000","last_unstale":"2024-09-21T00:55:18.866923+0000","last_undegraded":"2024-09-21T00:55:18.866923+0000","last_fullsized":"2024-09-21T00:55:18.866923+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:53:17.599528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.869359+0000","last_change":"2024-09-21T00:54:57.878847+0000","last_active":"2024-09-21T00:54:58.869359+0000","last_peered":"2024-09-21T00:54:58.869359+0000","last_clean":"2024-09-21T00:54:58.869359+0000","last_became_active":"2024-09-21T00:54:57.878117+0000","last_became_peered":"2024-09-21T00:54:57.878117+0000","last_unstale":"2024-09-21T00:54:58.869359+0000","last_undegraded":"2024-09-21T00:54:58.869359+0000","last_fullsized":"2024-09-21T00:54:58.869359+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:46.090963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'7","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:09.192301+0000","last_change":"2024-09-21T00:54:55.854035+0000","last_active":"2024-09-21T00:55:09.192301+0000","last_peered":"2024-09-21T00:55:09.192301+0000","last_clean":"2024-09-21T00:55:09.192301+0000","last_became_active":"2024-09-21T00:54:55.853301+0000","last_became_peered":"2024-09-21T00:54:55.853301+0000","last_unstale":"2024-09-21T00:55:09.192301+0000","last_undegraded":"2024-09-21T00:55:09.192301+0000","last_fullsized":"2024-09-21T00:55:09.192301+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:11.498865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.870487+0000","last_change":"2024-09-21T00:54:57.875093+0000","last_active":"2024-09-21T00:54:58.870487+0000","last_peered":"2024-09-21T00:54:58.870487+0000","last_clean":"2024-09-21T00:54:58.870487+0000","last_became_active":"2024-09-21T00:54:57.873996+0000","last_became_peered":"2024-09-21T00:54:57.873996+0000","last_unstale":"2024-09-21T00:54:58.870487+0000","last_undegraded":"2024-09-21T00:54:58.870487+0000","last_fullsized":"2024-09-21T00:54:58.870487+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:17:55.990167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:06.173193+0000","last_change":"2024-09-21T00:54:55.968507+0000","last_active":"2024-09-21T00:55:06.173193+0000","last_peered":"2024-09-21T00:55:06.173193+0000","last_clean":"2024-09-21T00:55:06.173193+0000","last_became_active":"2024-09-21T00:54:55.968084+0000","last_became_peered":"2024-09-21T00:54:55.968084+0000","last_unstale":"2024-09-21T00:55:06.173193+0000","last_undegraded":"2024-09-21T00:55:06.173193+0000","last_fullsized":"2024-09-21T00:55:06.173193+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:34:06.325264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.867774+0000","last_change":"2024-09-21T00:54:57.870500+0000","last_active":"2024-09-21T00:54:58.867774+0000","last_peered":"2024-09-21T00:54:58.867774+0000","last_clean":"2024-09-21T00:54:58.867774+0000","last_became_active":"2024-09-21T00:54:57.870103+0000","last_became_peered":"2024-09-21T00:54:57.870103+0000","last_unstale":"2024-09-21T00:54:58.867774+0000","last_undegraded":"2024-09-21T00:54:58.867774+0000","last_fullsized":"2024-09-21T00:54:58.867774+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:31:03.469863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'7","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:09.194167+0000","last_change":"2024-09-21T00:54:55.856185+0000","last_active":"2024-09-21T00:55:09.194167+0000","last_peered":"2024-09-21T00:55:09.194167+0000","last_clean":"2024-09-21T00:55:09.194167+0000","last_became_active":"2024-09-21T00:54:55.855738+0000","last_became_peered":"2024-09-21T00:54:55.855738+0000","last_unstale":"2024-09-21T00:55:09.194167+0000","last_undegraded":"2024-09-21T00:55:09.194167+0000","last_fullsized":"2024-09-21T00:55:09.194167+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:02.870874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.869840+0000","last_change":"2024-09-21T00:54:57.877828+0000","last_active":"2024-09-21T00:54:58.869840+0000","last_peered":"2024-09-21T00:54:58.869840+0000","last_clean":"2024-09-21T00:54:58.869840+0000","last_became_active":"2024-09-21T00:54:57.877414+0000","last_became_peered":"2024-09-21T00:54:57.877414+0000","last_unstale":"2024-09-21T00:54:58.869840+0000","last_undegraded":"2024-09-21T00:54:58.869840+0000","last_fullsized":"2024-09-21T00:54:58.869840+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:27.485830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:08.185928+0000","last_change":"2024-09-21T00:54:55.868014+0000","last_active":"2024-09-21T00:55:08.185928+0000","last_peered":"2024-09-21T00:55:08.185928+0000","last_clean":"2024-09-21T00:55:08.185928+0000","last_became_active":"2024-09-21T00:54:55.867640+0000","last_became_peered":"2024-09-21T00:54:55.867640+0000","last_unstale":"2024-09-21T00:55:08.185928+0000","last_undegraded":"2024-09-21T00:55:08.185928+0000","last_fullsized":"2024-09-21T00:55:08.185928+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:24:57.118238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.867151+0000","last_change":"2024-09-21T00:54:57.881935+0000","last_active":"2024-09-21T00:54:58.867151+0000","last_peered":"2024-09-21T00:54:58.867151+0000","last_clean":"2024-09-21T00:54:58.867151+0000","last_became_active":"2024-09-21T00:54:57.881598+0000","last_became_peered":"2024-09-21T00:54:57.881598+0000","last_unstale":"2024-09-21T00:54:58.867151+0000","last_undegraded":"2024-09-21T00:54:58.867151+0000","last_fullsized":"2024-09-21T00:54:58.867151+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:44:19.893961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:06.175042+0000","last_change":"2024-09-21T00:54:55.867314+0000","last_active":"2024-09-21T00:55:06.175042+0000","last_peered":"2024-09-21T00:55:06.175042+0000","last_clean":"2024-09-21T00:55:06.175042+0000","last_became_active":"2024-09-21T00:54:55.866751+0000","last_became_peered":"2024-09-21T00:54:55.866751+0000","last_unstale":"2024-09-21T00:55:06.175042+0000","last_undegraded":"2024-09-21T00:55:06.175042+0000","last_fullsized":"2024-09-21T00:55:06.175042+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:44.656789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.869393+0000","last_change":"2024-09-21T00:54:57.867972+0000","last_active":"2024-09-21T00:54:58.869393+0000","last_peered":"2024-09-21T00:54:58.869393+0000","last_clean":"2024-09-21T00:54:58.869393+0000","last_became_active":"2024-09-21T00:54:57.867586+0000","last_became_peered":"2024-09-21T00:54:57.867586+0000","last_unstale":"2024-09-21T00:54:58.869393+0000","last_undegraded":"2024-09-21T00:54:58.869393+0000","last_fullsized":"2024-09-21T00:54:58.869393+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:27.066795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.854927+0000","last_change":"2024-09-21T00:54:57.881014+0000","last_active":"2024-09-21T00:54:58.854927+0000","last_peered":"2024-09-21T00:54:58.854927+0000","last_clean":"2024-09-21T00:54:58.854927+0000","last_became_active":"2024-09-21T00:54:57.880608+0000","last_became_peered":"2024-09-21T00:54:57.880608+0000","last_unstale":"2024-09-21T00:54:58.854927+0000","last_undegraded":"2024-09-21T00:54:58.854927+0000","last_fullsized":"2024-09-21T00:54:58.854927+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:48:31.848315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'5","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:09.195302+0000","last_change":"2024-09-21T00:54:55.865031+0000","last_active":"2024-09-21T00:55:09.195302+0000","last_peered":"2024-09-21T00:55:09.195302+0000","last_clean":"2024-09-21T00:55:09.195302+0000","last_became_active":"2024-09-21T00:54:55.864576+0000","last_became_peered":"2024-09-21T00:54:55.864576+0000","last_unstale":"2024-09-21T00:55:09.195302+0000","last_undegraded":"2024-09-21T00:55:09.195302+0000","last_fullsized":"2024-09-21T00:55:09.195302+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:13.125491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.871622+0000","last_change":"2024-09-21T00:54:57.875878+0000","last_active":"2024-09-21T00:54:58.871622+0000","last_peered":"2024-09-21T00:54:58.871622+0000","last_clean":"2024-09-21T00:54:58.871622+0000","last_became_active":"2024-09-21T00:54:57.874177+0000","last_became_peered":"2024-09-21T00:54:57.874177+0000","last_unstale":"2024-09-21T00:54:58.871622+0000","last_undegraded":"2024-09-21T00:54:58.871622+0000","last_fullsized":"2024-09-21T00:54:58.871622+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:25.333036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'12","reported_seq":32,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:09.587263+0000","last_change":"2024-09-21T00:54:55.868698+0000","last_active":"2024-09-21T00:55:09.587263+0000","last_peered":"2024-09-21T00:55:09.587263+0000","last_clean":"2024-09-21T00:55:09.587263+0000","last_became_active":"2024-09-21T00:54:55.868282+0000","last_became_peered":"2024-09-21T00:54:55.868282+0000","last_unstale":"2024-09-21T00:55:09.587263+0000","last_undegraded":"2024-09-21T00:55:09.587263+0000","last_fullsized":"2024-09-21T00:55:09.587263+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:50.253638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.870038+0000","last_change":"2024-09-21T00:54:57.867726+0000","last_active":"2024-09-21T00:54:58.870038+0000","last_peered":"2024-09-21T00:54:58.870038+0000","last_clean":"2024-09-21T00:54:58.870038+0000","last_became_active":"2024-09-21T00:54:57.866090+0000","last_became_peered":"2024-09-21T00:54:57.866090+0000","last_unstale":"2024-09-21T00:54:58.870038+0000","last_undegraded":"2024-09-21T00:54:58.870038+0000","last_fullsized":"2024-09-21T00:54:58.870038+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:57.938078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.872122+0000","last_change":"2024-09-21T00:54:55.968155+0000","last_active":"2024-09-21T00:54:58.872122+0000","last_peered":"2024-09-21T00:54:58.872122+0000","last_clean":"2024-09-21T00:54:58.872122+0000","last_became_active":"2024-09-21T00:54:55.967718+0000","last_became_peered":"2024-09-21T00:54:55.967718+0000","last_unstale":"2024-09-21T00:54:58.872122+0000","last_undegraded":"2024-09-21T00:54:58.872122+0000","last_fullsized":"2024-09-21T00:54:58.872122+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:18.160380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:54:58.867503+0000","last_change":"2024-09-21T00:54:57.873102+0000","last_active":"2024-09-21T00:54:58.867503+0000","last_peered":"2024-09-21T00:54:58.867503+0000","last_clean":"2024-09-21T00:54:58.867503+0000","last_became_active":"2024-09-21T00:54:57.872323+0000","last_became_peered":"2024-09-21T00:54:57.872323+0000","last_unstale":"2024-09-21T00:54:58.867503+0000","last_undegraded":"2024-09-21T00:54:58.867503+0000","last_fullsized":"2024-09-21T00:54:58.867503+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:18.087601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'13","reported_seq":45,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:55:19.604784+0000","last_change":"2024-09-21T00:54:55.865559+0000","last_active":"2024-09-21T00:55:19.604784+0000","last_peered":"2024-09-21T00:55:19.604784+0000","last_clean":"2024-09-21T00:55:19.604784+0000","last_became_active":"2024-09-21T00:54:55.865157+0000","last_became_peered":"2024-09-21T00:54:55.865157+0000","last_unstale":"2024-09-21T00:55:19.604784+0000","last_undegraded":"2024-09-21T00:55:19.604784+0000","last_fullsized":"2024-09-21T00:55:19.604784+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:53.113970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66296,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":182,"num_read_kb":153,"num_write":234,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":198888,"data_compressed":5685,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":203,"ondisk_log_size":203,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":283734,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808849,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27800,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717352,"statfs":{"total":95995035648,"available":95966568448,"internally_reserved":0,"allocated":794624,"data_stored":378570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972375,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":1020539,"data_compressed":37970,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135899,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":819200,"data_stored":378109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332129,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31980,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713172,"statfs":{"total":95995035648,"available":95962288128,"internally_reserved":0,"allocated":815104,"data_stored":378487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528358,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":868352,"data_stored":971005,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691883,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36128,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709024,"statfs":{"total":95995035648,"available":95958040576,"internally_reserved":0,"allocated":802816,"data_stored":377826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888112,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":970292,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018934,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36128,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709024,"statfs":{"total":95995035648,"available":95958040576,"internally_reserved":0,"allocated":802816,"data_stored":378078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215163,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":819200,"data_stored":377651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411393,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36204,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708948,"statfs":{"total":95995035648,"available":95957962752,"internally_reserved":0,"allocated":880640,"data_stored":438442,"data_compressed":1895,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36184,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708968,"statfs":{"total":95995035648,"available":95957983232,"internally_reserved":0,"allocated":860160,"data_stored":437831,"data_compressed":1895,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738443,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36148,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709004,"statfs":{"total":95995035648,"available":95958020096,"internally_reserved":0,"allocated":823296,"data_stored":379556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":60844,"data_compressed":1895,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":61455,"data_compressed":1895,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":61219,"data_compressed":1895,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:55:27.181 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T00:55:27.181 INFO:tasks.cephadm:Setting up client nodes... 2024-09-21T00:55:27.181 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T00:55:27.439 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:27.856 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:27 smithi001 ceph-mon[31211]: pgmap v303: 97 pgs: 97 active+clean; 642 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.3 KiB/s wr, 12 op/s 2024-09-21T00:55:27.857 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:27 smithi001 ceph-mon[31211]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:55:27.857 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:27 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-21T00:55:27.857 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:27 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-21T00:55:27.857 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:27 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-21T00:55:27.857 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:27 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-21T00:55:27.857 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:27 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-21T00:55:27.857 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:27 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]': finished 2024-09-21T00:55:27.857 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:27 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]}]': finished 2024-09-21T00:55:27.857 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:27 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2024-09-21T00:55:27.857 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:27 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]': finished 2024-09-21T00:55:27.857 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:27 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-21T00:55:27.857 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:27 smithi001 ceph-mon[31211]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T00:55:27.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.956+0000 7f753eb25640 1 -- 172.21.15.1:0/4260733831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75381040a0 msgr2=0x7f753810aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:27.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.956+0000 7f753eb25640 1 --2- 172.21.15.1:0/4260733831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75381040a0 0x7f753810aa40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7530009ca0 tx=0x7f753002a950 comp rx=0 tx=0).stop 2024-09-21T00:55:27.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.956+0000 7f753eb25640 1 -- 172.21.15.1:0/4260733831 shutdown_connections 2024-09-21T00:55:27.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.956+0000 7f753eb25640 1 --2- 172.21.15.1:0/4260733831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75381040a0 0x7f753810aa40 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:27.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.956+0000 7f753eb25640 1 --2- 172.21.15.1:0/4260733831 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7538103700 0x7f7538103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:27.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.956+0000 7f753eb25640 1 --2- 172.21.15.1:0/4260733831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7538102670 0x7f7538102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:27.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.956+0000 7f753eb25640 1 -- 172.21.15.1:0/4260733831 >> 172.21.15.1:0/4260733831 conn(0x7f75380fdfe0 msgr2=0x7f7538100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:27.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.957+0000 7f753eb25640 1 -- 172.21.15.1:0/4260733831 shutdown_connections 2024-09-21T00:55:27.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.957+0000 7f753eb25640 1 -- 172.21.15.1:0/4260733831 wait complete. 2024-09-21T00:55:27.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.957+0000 7f753eb25640 1 Processor -- start 2024-09-21T00:55:27.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.957+0000 7f753eb25640 1 -- start start 2024-09-21T00:55:27.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.957+0000 7f753eb25640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7538102670 0x7f753819a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:27.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.957+0000 7f753eb25640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7538103700 0x7f753819a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:27.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.957+0000 7f753eb25640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75381040a0 0x7f753819b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:27.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.957+0000 7f753eb25640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f753810e330 con 0x7f75381040a0 2024-09-21T00:55:27.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.957+0000 7f753eb25640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f753810e1b0 con 0x7f7538102670 2024-09-21T00:55:27.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.957+0000 7f753eb25640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f753810e4b0 con 0x7f7538103700 2024-09-21T00:55:27.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.958+0000 7f753d0c2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75381040a0 0x7f753819b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:27.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.958+0000 7f753d0c2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75381040a0 0x7f753819b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57744/0 (socket says 172.21.15.1:57744) 2024-09-21T00:55:27.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.958+0000 7f753d0c2640 1 -- 172.21.15.1:0/1773721461 learned_addr learned my addr 172.21.15.1:0/1773721461 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:27.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.958+0000 7f753c8c1640 1 --2- 172.21.15.1:0/1773721461 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7538102670 0x7f753819a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:27.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.958+0000 7f7537fff640 1 --2- 172.21.15.1:0/1773721461 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7538103700 0x7f753819a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:27.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.958+0000 7f753d0c2640 1 -- 172.21.15.1:0/1773721461 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7538103700 msgr2=0x7f753819a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:27.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.958+0000 7f753d0c2640 1 --2- 172.21.15.1:0/1773721461 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7538103700 0x7f753819a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:27.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.958+0000 7f753d0c2640 1 -- 172.21.15.1:0/1773721461 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7538102670 msgr2=0x7f753819a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:27.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.958+0000 7f753d0c2640 1 --2- 172.21.15.1:0/1773721461 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7538102670 0x7f753819a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:27.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.958+0000 7f753d0c2640 1 -- 172.21.15.1:0/1773721461 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f753819ba40 con 0x7f75381040a0 2024-09-21T00:55:27.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.958+0000 7f7537fff640 1 --2- 172.21.15.1:0/1773721461 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7538103700 0x7f753819a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:55:27.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.958+0000 7f753d0c2640 1 --2- 172.21.15.1:0/1773721461 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75381040a0 0x7f753819b220 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7530006010 tx=0x7f753002fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:27.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.959+0000 7f7535ffb640 1 -- 172.21.15.1:0/1773721461 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7530034040 con 0x7f75381040a0 2024-09-21T00:55:27.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.959+0000 7f7535ffb640 1 -- 172.21.15.1:0/1773721461 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75300308f0 con 0x7f75381040a0 2024-09-21T00:55:27.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.959+0000 7f7535ffb640 1 -- 172.21.15.1:0/1773721461 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7530039450 con 0x7f75381040a0 2024-09-21T00:55:27.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.959+0000 7f753eb25640 1 -- 172.21.15.1:0/1773721461 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f753819bcd0 con 0x7f75381040a0 2024-09-21T00:55:27.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.959+0000 7f753eb25640 1 -- 172.21.15.1:0/1773721461 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75381a2430 con 0x7f75381040a0 2024-09-21T00:55:27.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.960+0000 7f753eb25640 1 -- 172.21.15.1:0/1773721461 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75381a2600 con 0x7f75381040a0 2024-09-21T00:55:27.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.962+0000 7f7535ffb640 1 -- 172.21.15.1:0/1773721461 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7f7530037020 con 0x7f75381040a0 2024-09-21T00:55:27.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.962+0000 7f7535ffb640 1 --2- 172.21.15.1:0/1773721461 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f75240b6620 0x7f75240b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:27.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.963+0000 7f753c8c1640 1 --2- 172.21.15.1:0/1773721461 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f75240b6620 0x7f75240b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:27.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.963+0000 7f7535ffb640 1 -- 172.21.15.1:0/1773721461 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f7530108980 con 0x7f75381040a0 2024-09-21T00:55:27.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.963+0000 7f753c8c1640 1 --2- 172.21.15.1:0/1773721461 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f75240b6620 0x7f75240b8b30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7520009990 tx=0x7f7520009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:27.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:27.966+0000 7f7535ffb640 1 -- 172.21.15.1:0/1773721461 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f75300cf090 con 0x7f75381040a0 2024-09-21T00:55:27.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:27 smithi193 ceph-mon[34660]: pgmap v303: 97 pgs: 97 active+clean; 642 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.3 KiB/s wr, 12 op/s 2024-09-21T00:55:27.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:27 smithi193 ceph-mon[34660]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:55:27.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:27 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-21T00:55:27.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:27 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-21T00:55:27.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:27 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-21T00:55:27.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:27 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-21T00:55:27.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:27 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-21T00:55:27.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:27 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]': finished 2024-09-21T00:55:27.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:27 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]}]': finished 2024-09-21T00:55:27.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:27 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2024-09-21T00:55:27.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:27 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]': finished 2024-09-21T00:55:27.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:27 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-21T00:55:27.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:27 smithi193 ceph-mon[34660]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T00:55:27.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:27 smithi042 ceph-mon[34481]: pgmap v303: 97 pgs: 97 active+clean; 642 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.3 KiB/s wr, 12 op/s 2024-09-21T00:55:27.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:27 smithi042 ceph-mon[34481]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:55:27.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:27 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-21T00:55:27.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:27 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-21T00:55:27.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:27 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-21T00:55:27.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:27 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-21T00:55:27.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:27 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-21T00:55:27.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:27 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]': finished 2024-09-21T00:55:27.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:27 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]}]': finished 2024-09-21T00:55:27.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:27 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2024-09-21T00:55:27.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:27 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]': finished 2024-09-21T00:55:27.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:27 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-21T00:55:27.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:27 smithi042 ceph-mon[34481]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T00:55:28.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:28.232+0000 7f753eb25640 1 -- 172.21.15.1:0/1773721461 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f75381a28b0 con 0x7f75381040a0 2024-09-21T00:55:28.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:28.235+0000 7f7535ffb640 1 -- 172.21.15.1:0/1773721461 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f75300d3470 con 0x7f75381040a0 2024-09-21T00:55:28.236 INFO:teuthology.orchestra.run.smithi001.stdout:[client.0] 2024-09-21T00:55:28.236 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQCAGe5mnYrrDRAAciJscpKbSJtoAun43eChBw== 2024-09-21T00:55:28.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:28.237+0000 7f753eb25640 1 -- 172.21.15.1:0/1773721461 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f75240b6620 msgr2=0x7f75240b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:28.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:28.237+0000 7f753eb25640 1 --2- 172.21.15.1:0/1773721461 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f75240b6620 0x7f75240b8b30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7520009990 tx=0x7f7520009110 comp rx=0 tx=0).stop 2024-09-21T00:55:28.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:28.237+0000 7f753eb25640 1 -- 172.21.15.1:0/1773721461 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75381040a0 msgr2=0x7f753819b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:28.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:28.237+0000 7f753eb25640 1 --2- 172.21.15.1:0/1773721461 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75381040a0 0x7f753819b220 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7530006010 tx=0x7f753002fc00 comp rx=0 tx=0).stop 2024-09-21T00:55:28.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:28.237+0000 7f753eb25640 1 -- 172.21.15.1:0/1773721461 shutdown_connections 2024-09-21T00:55:28.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:28.237+0000 7f753eb25640 1 --2- 172.21.15.1:0/1773721461 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f75240b6620 0x7f75240b8b30 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:28.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:28.237+0000 7f753eb25640 1 --2- 172.21.15.1:0/1773721461 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75381040a0 0x7f753819b220 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:28.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:28.237+0000 7f753eb25640 1 --2- 172.21.15.1:0/1773721461 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7538103700 0x7f753819a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:28.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:28.237+0000 7f753eb25640 1 --2- 172.21.15.1:0/1773721461 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7538102670 0x7f753819a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:28.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:28.237+0000 7f753eb25640 1 -- 172.21.15.1:0/1773721461 >> 172.21.15.1:0/1773721461 conn(0x7f75380fdfe0 msgr2=0x7f75380ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:28.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:28.237+0000 7f753eb25640 1 -- 172.21.15.1:0/1773721461 shutdown_connections 2024-09-21T00:55:28.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:28.237+0000 7f753eb25640 1 -- 172.21.15.1:0/1773721461 wait complete. 2024-09-21T00:55:28.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:28 smithi001 ceph-mon[31211]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T00:55:28.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:28 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1773721461' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T00:55:28.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:28 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1773721461' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T00:55:28.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:28 smithi193 ceph-mon[34660]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T00:55:28.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:28 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/1773721461' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T00:55:28.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:28 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/1773721461' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T00:55:28.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:28 smithi042 ceph-mon[34481]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T00:55:28.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:28 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/1773721461' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T00:55:28.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:28 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/1773721461' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T00:55:29.023 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-21T00:55:29.023 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-21T00:55:29.023 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T00:55:29.061 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph config log 1 --format=json 2024-09-21T00:55:29.355 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:29.783 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:29 smithi001 ceph-mon[31211]: pgmap v306: 97 pgs: 97 active+clean; 642 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-21T00:55:29.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.877+0000 7faca5fa5640 1 -- 172.21.15.1:0/3017190067 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faca0103180 msgr2=0x7faca0103590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:29.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.877+0000 7faca5fa5640 1 --2- 172.21.15.1:0/3017190067 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faca0103180 0x7faca0103590 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fac90009900 tx=0x7fac9002a410 comp rx=0 tx=0).stop 2024-09-21T00:55:29.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.877+0000 7faca5fa5640 1 -- 172.21.15.1:0/3017190067 shutdown_connections 2024-09-21T00:55:29.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.877+0000 7faca5fa5640 1 --2- 172.21.15.1:0/3017190067 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faca0108d00 0x7faca010f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:29.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.877+0000 7faca5fa5640 1 --2- 172.21.15.1:0/3017190067 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faca01083b0 0x7faca01087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:29.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.877+0000 7faca5fa5640 1 --2- 172.21.15.1:0/3017190067 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faca0103180 0x7faca0103590 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:29.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.877+0000 7faca5fa5640 1 -- 172.21.15.1:0/3017190067 >> 172.21.15.1:0/3017190067 conn(0x7faca0077c60 msgr2=0x7faca00780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:29.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.877+0000 7faca5fa5640 1 -- 172.21.15.1:0/3017190067 shutdown_connections 2024-09-21T00:55:29.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.877+0000 7faca5fa5640 1 -- 172.21.15.1:0/3017190067 wait complete. 2024-09-21T00:55:29.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.878+0000 7faca5fa5640 1 Processor -- start 2024-09-21T00:55:29.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.878+0000 7faca5fa5640 1 -- start start 2024-09-21T00:55:29.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.878+0000 7faca5fa5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faca0103180 0x7faca00fede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:29.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.878+0000 7faca5fa5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faca01083b0 0x7faca00ff320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:29.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.878+0000 7faca5fa5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faca0108d00 0x7faca00ff860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:29.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.878+0000 7faca5fa5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faca01129c0 con 0x7faca0103180 2024-09-21T00:55:29.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.878+0000 7faca5fa5640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7faca0112840 con 0x7faca01083b0 2024-09-21T00:55:29.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.878+0000 7faca5fa5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faca0112b40 con 0x7faca0108d00 2024-09-21T00:55:29.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.879+0000 7fac9f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faca0103180 0x7faca00fede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:29.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.879+0000 7fac9f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faca0103180 0x7faca00fede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45176/0 (socket says 172.21.15.1:45176) 2024-09-21T00:55:29.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.879+0000 7fac9f7fe640 1 -- 172.21.15.1:0/3075997435 learned_addr learned my addr 172.21.15.1:0/3075997435 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:29.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.879+0000 7fac97fff640 1 --2- 172.21.15.1:0/3075997435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faca01083b0 0x7faca00ff320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:29.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.879+0000 7fac9ffff640 1 --2- 172.21.15.1:0/3075997435 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faca0108d00 0x7faca00ff860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:29.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.879+0000 7fac9f7fe640 1 -- 172.21.15.1:0/3075997435 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faca0108d00 msgr2=0x7faca00ff860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:29.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.879+0000 7fac9f7fe640 1 --2- 172.21.15.1:0/3075997435 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faca0108d00 0x7faca00ff860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:29.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.879+0000 7fac9f7fe640 1 -- 172.21.15.1:0/3075997435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faca01083b0 msgr2=0x7faca00ff320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:29.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.879+0000 7fac9f7fe640 1 --2- 172.21.15.1:0/3075997435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faca01083b0 0x7faca00ff320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:29.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.879+0000 7fac9f7fe640 1 -- 172.21.15.1:0/3075997435 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca01a87a0 con 0x7faca0103180 2024-09-21T00:55:29.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.879+0000 7fac9f7fe640 1 --2- 172.21.15.1:0/3075997435 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faca0103180 0x7faca00fede0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fac90005940 tx=0x7fac900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:29.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.879+0000 7fac9d7fa640 1 -- 172.21.15.1:0/3075997435 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac9003f030 con 0x7faca0103180 2024-09-21T00:55:29.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.879+0000 7fac9d7fa640 1 -- 172.21.15.1:0/3075997435 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac90003cb0 con 0x7faca0103180 2024-09-21T00:55:29.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.879+0000 7faca5fa5640 1 -- 172.21.15.1:0/3075997435 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faca01a8a30 con 0x7faca0103180 2024-09-21T00:55:29.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.879+0000 7fac9d7fa640 1 -- 172.21.15.1:0/3075997435 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac90035070 con 0x7faca0103180 2024-09-21T00:55:29.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.880+0000 7faca5fa5640 1 -- 172.21.15.1:0/3075997435 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faca01a8f10 con 0x7faca0103180 2024-09-21T00:55:29.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.881+0000 7faca5fa5640 1 -- 172.21.15.1:0/3075997435 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faca0103590 con 0x7faca0103180 2024-09-21T00:55:29.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.882+0000 7fac9d7fa640 1 -- 172.21.15.1:0/3075997435 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7fac90042030 con 0x7faca0103180 2024-09-21T00:55:29.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.883+0000 7fac9d7fa640 1 --2- 172.21.15.1:0/3075997435 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fac8c0b65a0 0x7fac8c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:29.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.884+0000 7fac97fff640 1 --2- 172.21.15.1:0/3075997435 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fac8c0b65a0 0x7fac8c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:29.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.884+0000 7fac9d7fa640 1 -- 172.21.15.1:0/3075997435 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fac90108000 con 0x7faca0103180 2024-09-21T00:55:29.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.884+0000 7fac97fff640 1 --2- 172.21.15.1:0/3075997435 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fac8c0b65a0 0x7fac8c0b8ab0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faca0105210 tx=0x7fac8800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:29.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:29.887+0000 7fac9d7fa640 1 -- 172.21.15.1:0/3075997435 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fac900d2af0 con 0x7faca0103180 2024-09-21T00:55:29.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:29 smithi193 ceph-mon[34660]: pgmap v306: 97 pgs: 97 active+clean; 642 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-21T00:55:29.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:29 smithi042 ceph-mon[34481]: pgmap v306: 97 pgs: 97 active+clean; 642 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-21T00:55:30.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:30.077+0000 7faca5fa5640 1 -- 172.21.15.1:0/3075997435 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7faca002e640 con 0x7faca0103180 2024-09-21T00:55:30.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:30.078+0000 7fac9d7fa640 1 -- 172.21.15.1:0/3075997435 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v52) ==== 86+0+133 (secure 0 0 0) 0x7fac900d7a30 con 0x7faca0103180 2024-09-21T00:55:30.079 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:55:30.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:30.081+0000 7faca5fa5640 1 -- 172.21.15.1:0/3075997435 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fac8c0b65a0 msgr2=0x7fac8c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:30.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:30.081+0000 7faca5fa5640 1 --2- 172.21.15.1:0/3075997435 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fac8c0b65a0 0x7fac8c0b8ab0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faca0105210 tx=0x7fac8800b410 comp rx=0 tx=0).stop 2024-09-21T00:55:30.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:30.081+0000 7faca5fa5640 1 -- 172.21.15.1:0/3075997435 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faca0103180 msgr2=0x7faca00fede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:30.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:30.081+0000 7faca5fa5640 1 --2- 172.21.15.1:0/3075997435 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faca0103180 0x7faca00fede0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fac90005940 tx=0x7fac900042f0 comp rx=0 tx=0).stop 2024-09-21T00:55:30.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:30.081+0000 7faca5fa5640 1 -- 172.21.15.1:0/3075997435 shutdown_connections 2024-09-21T00:55:30.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:30.081+0000 7faca5fa5640 1 --2- 172.21.15.1:0/3075997435 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faca0108d00 0x7faca00ff860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:30.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:30.081+0000 7faca5fa5640 1 --2- 172.21.15.1:0/3075997435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faca01083b0 0x7faca00ff320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:30.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:30.081+0000 7faca5fa5640 1 --2- 172.21.15.1:0/3075997435 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fac8c0b65a0 0x7fac8c0b8ab0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:30.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:30.081+0000 7faca5fa5640 1 --2- 172.21.15.1:0/3075997435 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faca0103180 0x7faca00fede0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:30.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:30.081+0000 7faca5fa5640 1 -- 172.21.15.1:0/3075997435 >> 172.21.15.1:0/3075997435 conn(0x7faca0077c60 msgr2=0x7faca01012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:30.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:30.081+0000 7faca5fa5640 1 -- 172.21.15.1:0/3075997435 shutdown_connections 2024-09-21T00:55:30.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:30.081+0000 7faca5fa5640 1 -- 172.21.15.1:0/3075997435 wait complete. 2024-09-21T00:55:30.822 INFO:teuthology.orchestra.run.smithi001.stdout:[{"version":52,"timestamp":"2024-09-21T00:54:48.254533+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-21T00:55:30.822 INFO:tasks.ceph_manager:config epoch is 52 2024-09-21T00:55:30.822 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T00:55:30.823 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-21T00:55:30.823 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph mgr dump --format=json 2024-09-21T00:55:30.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:30 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/3075997435' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T00:55:30.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:30 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/3075997435' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T00:55:30.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:30 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/3075997435' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T00:55:31.082 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:31.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.545+0000 7f5b79b43640 1 -- 172.21.15.1:0/4060989936 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b74103000 msgr2=0x7f5b74103410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:31.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.545+0000 7f5b79b43640 1 --2- 172.21.15.1:0/4060989936 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b74103000 0x7f5b74103410 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5b68009900 tx=0x7f5b6802a410 comp rx=0 tx=0).stop 2024-09-21T00:55:31.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.545+0000 7f5b79b43640 1 -- 172.21.15.1:0/4060989936 shutdown_connections 2024-09-21T00:55:31.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.545+0000 7f5b79b43640 1 --2- 172.21.15.1:0/4060989936 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b74103950 0x7f5b7410f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:31.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.545+0000 7f5b79b43640 1 --2- 172.21.15.1:0/4060989936 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b74103000 0x7f5b74103410 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:31.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.545+0000 7f5b79b43640 1 --2- 172.21.15.1:0/4060989936 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5b74107690 0x7f5b74107aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:31.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.545+0000 7f5b79b43640 1 -- 172.21.15.1:0/4060989936 >> 172.21.15.1:0/4060989936 conn(0x7f5b74079ea0 msgr2=0x7f5b7407a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:31.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.545+0000 7f5b79b43640 1 -- 172.21.15.1:0/4060989936 shutdown_connections 2024-09-21T00:55:31.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.545+0000 7f5b79b43640 1 -- 172.21.15.1:0/4060989936 wait complete. 2024-09-21T00:55:31.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.546+0000 7f5b79b43640 1 Processor -- start 2024-09-21T00:55:31.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.546+0000 7f5b79b43640 1 -- start start 2024-09-21T00:55:31.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.546+0000 7f5b79b43640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5b74103000 0x7f5b74110090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:31.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.547+0000 7f5b79b43640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b74103950 0x7f5b741105d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:31.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.547+0000 7f5b79b43640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b74107690 0x7f5b74110b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:31.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.547+0000 7f5b79b43640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5b74113b60 con 0x7f5b74107690 2024-09-21T00:55:31.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.547+0000 7f5b79b43640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5b741139e0 con 0x7f5b74103950 2024-09-21T00:55:31.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.547+0000 7f5b79b43640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5b74113ce0 con 0x7f5b74103000 2024-09-21T00:55:31.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.547+0000 7f5b73fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b74107690 0x7f5b74110b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:31.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.547+0000 7f5b73fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b74107690 0x7f5b74110b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45190/0 (socket says 172.21.15.1:45190) 2024-09-21T00:55:31.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.547+0000 7f5b73fff640 1 -- 172.21.15.1:0/1000757766 learned_addr learned my addr 172.21.15.1:0/1000757766 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:31.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.547+0000 7f5b737fe640 1 --2- 172.21.15.1:0/1000757766 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5b74103000 0x7f5b74110090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:31.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.547+0000 7f5b72ffd640 1 --2- 172.21.15.1:0/1000757766 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b74103950 0x7f5b741105d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:31.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.547+0000 7f5b73fff640 1 -- 172.21.15.1:0/1000757766 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5b74103000 msgr2=0x7f5b74110090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:31.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.547+0000 7f5b73fff640 1 --2- 172.21.15.1:0/1000757766 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5b74103000 0x7f5b74110090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:31.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.547+0000 7f5b73fff640 1 -- 172.21.15.1:0/1000757766 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b74103950 msgr2=0x7f5b741105d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:31.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.547+0000 7f5b73fff640 1 --2- 172.21.15.1:0/1000757766 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b74103950 0x7f5b741105d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:31.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.547+0000 7f5b73fff640 1 -- 172.21.15.1:0/1000757766 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b741a8870 con 0x7f5b74107690 2024-09-21T00:55:31.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.547+0000 7f5b72ffd640 1 --2- 172.21.15.1:0/1000757766 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b74103950 0x7f5b741105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:55:31.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.547+0000 7f5b73fff640 1 --2- 172.21.15.1:0/1000757766 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b74107690 0x7f5b74110b10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c009fd0 tx=0x7f5b6c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:31.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.547+0000 7f5b70ff9640 1 -- 172.21.15.1:0/1000757766 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c017070 con 0x7f5b74107690 2024-09-21T00:55:31.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.547+0000 7f5b79b43640 1 -- 172.21.15.1:0/1000757766 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b741a8b60 con 0x7f5b74107690 2024-09-21T00:55:31.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.547+0000 7f5b70ff9640 1 -- 172.21.15.1:0/1000757766 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b6c003e20 con 0x7f5b74107690 2024-09-21T00:55:31.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.547+0000 7f5b70ff9640 1 -- 172.21.15.1:0/1000757766 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c010460 con 0x7f5b74107690 2024-09-21T00:55:31.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.547+0000 7f5b79b43640 1 -- 172.21.15.1:0/1000757766 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b741a9070 con 0x7f5b74107690 2024-09-21T00:55:31.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.549+0000 7f5b79b43640 1 -- 172.21.15.1:0/1000757766 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b74103410 con 0x7f5b74107690 2024-09-21T00:55:31.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.550+0000 7f5b70ff9640 1 -- 172.21.15.1:0/1000757766 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7f5b6c003970 con 0x7f5b74107690 2024-09-21T00:55:31.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.551+0000 7f5b70ff9640 1 --2- 172.21.15.1:0/1000757766 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5b5c0b65a0 0x7f5b5c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:31.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.551+0000 7f5b737fe640 1 --2- 172.21.15.1:0/1000757766 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5b5c0b65a0 0x7f5b5c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:31.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.551+0000 7f5b70ff9640 1 -- 172.21.15.1:0/1000757766 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f5b6c0e72b0 con 0x7f5b74107690 2024-09-21T00:55:31.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.552+0000 7f5b737fe640 1 --2- 172.21.15.1:0/1000757766 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5b5c0b65a0 0x7f5b5c0b8ab0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5b74111ae0 tx=0x7f5b6400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:31.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.554+0000 7f5b70ff9640 1 -- 172.21.15.1:0/1000757766 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5b6c0ad9c0 con 0x7f5b74107690 2024-09-21T00:55:31.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:31 smithi001 ceph-mon[31211]: pgmap v307: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.9 KiB/s wr, 9 op/s; 7.2 KiB/s, 1 objects/s recovering 2024-09-21T00:55:31.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.793+0000 7f5b79b43640 1 -- 172.21.15.1:0/1000757766 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f5b7402e640 con 0x7f5b74107690 2024-09-21T00:55:31.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.798+0000 7f5b70ff9640 1 -- 172.21.15.1:0/1000757766 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+296427 (secure 0 0 0) 0x7f5b6c0b1da0 con 0x7f5b74107690 2024-09-21T00:55:31.802 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:55:31.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.801+0000 7f5b79b43640 1 -- 172.21.15.1:0/1000757766 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5b5c0b65a0 msgr2=0x7f5b5c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:31.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.801+0000 7f5b79b43640 1 --2- 172.21.15.1:0/1000757766 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5b5c0b65a0 0x7f5b5c0b8ab0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5b74111ae0 tx=0x7f5b6400b390 comp rx=0 tx=0).stop 2024-09-21T00:55:31.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.801+0000 7f5b79b43640 1 -- 172.21.15.1:0/1000757766 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b74107690 msgr2=0x7f5b74110b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:31.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.801+0000 7f5b79b43640 1 --2- 172.21.15.1:0/1000757766 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b74107690 0x7f5b74110b10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c009fd0 tx=0x7f5b6c00b260 comp rx=0 tx=0).stop 2024-09-21T00:55:31.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.801+0000 7f5b79b43640 1 -- 172.21.15.1:0/1000757766 shutdown_connections 2024-09-21T00:55:31.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.801+0000 7f5b79b43640 1 --2- 172.21.15.1:0/1000757766 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5b5c0b65a0 0x7f5b5c0b8ab0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:31.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.801+0000 7f5b79b43640 1 --2- 172.21.15.1:0/1000757766 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b74107690 0x7f5b74110b10 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:31.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.801+0000 7f5b79b43640 1 --2- 172.21.15.1:0/1000757766 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b74103950 0x7f5b741105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:31.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.801+0000 7f5b79b43640 1 --2- 172.21.15.1:0/1000757766 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5b74103000 0x7f5b74110090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:31.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.801+0000 7f5b79b43640 1 -- 172.21.15.1:0/1000757766 >> 172.21.15.1:0/1000757766 conn(0x7f5b74079ea0 msgr2=0x7f5b74104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:31.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.801+0000 7f5b79b43640 1 -- 172.21.15.1:0/1000757766 shutdown_connections 2024-09-21T00:55:31.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:31.801+0000 7f5b79b43640 1 -- 172.21.15.1:0/1000757766 wait complete. 2024-09-21T00:55:31.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:31 smithi193 ceph-mon[34660]: pgmap v307: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.9 KiB/s wr, 9 op/s; 7.2 KiB/s, 1 objects/s recovering 2024-09-21T00:55:31.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:31 smithi042 ceph-mon[34481]: pgmap v307: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.9 KiB/s wr, 9 op/s; 7.2 KiB/s, 1 objects/s recovering 2024-09-21T00:55:32.564 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2032980330},{"type":"v1","addr":"172.21.15.1:6801","nonce":2032980330}]},"active_addr":"172.21.15.1:6801/2032980330","active_change":"2024-09-21T00:47:25.985608+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24127,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24134,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.1:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":639934325}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":363039868}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":1692608402}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":2224988228}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":1984782998}]}]} 2024-09-21T00:55:32.569 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-21T00:55:32.569 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-21T00:55:32.570 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T00:55:32.825 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:32.946 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:32 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1000757766' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T00:55:32.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:32 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/1000757766' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T00:55:32.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:32 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/1000757766' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T00:55:33.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.340+0000 7fde4d781640 1 -- 172.21.15.1:0/3359021216 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde481048c0 msgr2=0x7fde48104cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:33.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.340+0000 7fde4d781640 1 --2- 172.21.15.1:0/3359021216 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde481048c0 0x7fde48104cd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fde38009900 tx=0x7fde3802a410 comp rx=0 tx=0).stop 2024-09-21T00:55:33.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.340+0000 7fde4d781640 1 -- 172.21.15.1:0/3359021216 shutdown_connections 2024-09-21T00:55:33.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.340+0000 7fde4d781640 1 --2- 172.21.15.1:0/3359021216 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fde4810de70 0x7fde48110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:33.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.340+0000 7fde4d781640 1 --2- 172.21.15.1:0/3359021216 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde481052a0 0x7fde4810d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:33.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.340+0000 7fde4d781640 1 --2- 172.21.15.1:0/3359021216 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde481048c0 0x7fde48104cd0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:33.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.340+0000 7fde4d781640 1 -- 172.21.15.1:0/3359021216 >> 172.21.15.1:0/3359021216 conn(0x7fde48079760 msgr2=0x7fde48079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:33.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.340+0000 7fde4d781640 1 -- 172.21.15.1:0/3359021216 shutdown_connections 2024-09-21T00:55:33.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.340+0000 7fde4d781640 1 -- 172.21.15.1:0/3359021216 wait complete. 2024-09-21T00:55:33.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.341+0000 7fde4d781640 1 Processor -- start 2024-09-21T00:55:33.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.341+0000 7fde4d781640 1 -- start start 2024-09-21T00:55:33.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.341+0000 7fde4d781640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde481048c0 0x7fde481027d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:33.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.341+0000 7fde4d781640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fde481052a0 0x7fde48102d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:33.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.341+0000 7fde4d781640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde4810de70 0x7fde48103250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:33.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.341+0000 7fde4d781640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fde48113ad0 con 0x7fde4810de70 2024-09-21T00:55:33.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.341+0000 7fde4d781640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fde48113950 con 0x7fde481048c0 2024-09-21T00:55:33.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.341+0000 7fde4d781640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fde48113c50 con 0x7fde481052a0 2024-09-21T00:55:33.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.341+0000 7fde477fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde4810de70 0x7fde48103250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:33.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.341+0000 7fde477fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde4810de70 0x7fde48103250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45218/0 (socket says 172.21.15.1:45218) 2024-09-21T00:55:33.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.341+0000 7fde477fe640 1 -- 172.21.15.1:0/4002853163 learned_addr learned my addr 172.21.15.1:0/4002853163 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:33.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.341+0000 7fde46ffd640 1 --2- 172.21.15.1:0/4002853163 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde481048c0 0x7fde481027d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:33.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.342+0000 7fde467fc640 1 --2- 172.21.15.1:0/4002853163 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fde481052a0 0x7fde48102d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:33.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.342+0000 7fde477fe640 1 -- 172.21.15.1:0/4002853163 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fde481052a0 msgr2=0x7fde48102d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:33.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.342+0000 7fde477fe640 1 --2- 172.21.15.1:0/4002853163 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fde481052a0 0x7fde48102d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:33.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.342+0000 7fde477fe640 1 -- 172.21.15.1:0/4002853163 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde481048c0 msgr2=0x7fde481027d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:33.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.342+0000 7fde477fe640 1 --2- 172.21.15.1:0/4002853163 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde481048c0 0x7fde481027d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:33.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.342+0000 7fde477fe640 1 -- 172.21.15.1:0/4002853163 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde481a87a0 con 0x7fde4810de70 2024-09-21T00:55:33.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.342+0000 7fde477fe640 1 --2- 172.21.15.1:0/4002853163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde4810de70 0x7fde48103250 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fde4000eb10 tx=0x7fde4000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:33.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.342+0000 7fde2ffff640 1 -- 172.21.15.1:0/4002853163 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde40004b20 con 0x7fde4810de70 2024-09-21T00:55:33.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.342+0000 7fde2ffff640 1 -- 172.21.15.1:0/4002853163 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde40004cc0 con 0x7fde4810de70 2024-09-21T00:55:33.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.342+0000 7fde4d781640 1 -- 172.21.15.1:0/4002853163 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde481a8a90 con 0x7fde4810de70 2024-09-21T00:55:33.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.342+0000 7fde2ffff640 1 -- 172.21.15.1:0/4002853163 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde40010670 con 0x7fde4810de70 2024-09-21T00:55:33.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.342+0000 7fde4d781640 1 -- 172.21.15.1:0/4002853163 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde481a9020 con 0x7fde4810de70 2024-09-21T00:55:33.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.343+0000 7fde4d781640 1 -- 172.21.15.1:0/4002853163 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde4806c190 con 0x7fde4810de70 2024-09-21T00:55:33.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.345+0000 7fde2ffff640 1 -- 172.21.15.1:0/4002853163 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7fde40005000 con 0x7fde4810de70 2024-09-21T00:55:33.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.346+0000 7fde2ffff640 1 --2- 172.21.15.1:0/4002853163 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fde300b6620 0x7fde300b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:33.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.346+0000 7fde46ffd640 1 --2- 172.21.15.1:0/4002853163 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fde300b6620 0x7fde300b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:33.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.346+0000 7fde2ffff640 1 -- 172.21.15.1:0/4002853163 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fde400e7c70 con 0x7fde4810de70 2024-09-21T00:55:33.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.346+0000 7fde46ffd640 1 --2- 172.21.15.1:0/4002853163 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fde300b6620 0x7fde300b8b30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fde38009230 tx=0x7fde38031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:33.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.353+0000 7fde2ffff640 1 -- 172.21.15.1:0/4002853163 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fde40056710 con 0x7fde4810de70 2024-09-21T00:55:33.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.546+0000 7fde4d781640 1 -- 172.21.15.1:0/4002853163 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fde48104cd0 con 0x7fde4810de70 2024-09-21T00:55:33.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.548+0000 7fde2ffff640 1 -- 172.21.15.1:0/4002853163 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22720 (secure 0 0 0) 0x7fde48104cd0 con 0x7fde4810de70 2024-09-21T00:55:33.549 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:55:33.549 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":75,"fsid":"d3972c20-77b2-11ef-baf5-efdc52797490","created":"2024-09-21T00:46:29.745963+0000","modified":"2024-09-21T00:55:27.629379+0000","last_up_change":"2024-09-21T00:54:07.552837+0000","last_in_change":"2024-09-21T00:53:44.164415+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:50:16.456462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:54:54.305306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:54:56.506872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5bf09a34-4d6e-401c-8cef-29bbe72de68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6803","nonce":4067586847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6805","nonce":4067586847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6809","nonce":4067586847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6807","nonce":4067586847}]},"public_addr":"172.21.15.1:6803/4067586847","cluster_addr":"172.21.15.1:6805/4067586847","heartbeat_back_addr":"172.21.15.1:6809/4067586847","heartbeat_front_addr":"172.21.15.1:6807/4067586847","state":["exists","up"]},{"osd":1,"uuid":"195f9109-ef61-46be-a59a-d72e3a1b5b45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6801","nonce":436964633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6803","nonce":436964633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6807","nonce":436964633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6805","nonce":436964633}]},"public_addr":"172.21.15.42:6801/436964633","cluster_addr":"172.21.15.42:6803/436964633","heartbeat_back_addr":"172.21.15.42:6807/436964633","heartbeat_front_addr":"172.21.15.42:6805/436964633","state":["exists","up"]},{"osd":2,"uuid":"47cf90a7-6db6-464a-84ef-9f509f89a46b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6801","nonce":3495400570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6803","nonce":3495400570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6807","nonce":3495400570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6805","nonce":3495400570}]},"public_addr":"172.21.15.193:6801/3495400570","cluster_addr":"172.21.15.193:6803/3495400570","heartbeat_back_addr":"172.21.15.193:6807/3495400570","heartbeat_front_addr":"172.21.15.193:6805/3495400570","state":["exists","up"]},{"osd":3,"uuid":"a5230a66-3c74-41a7-9353-5650780ed25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6811","nonce":3221661671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6813","nonce":3221661671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6817","nonce":3221661671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6815","nonce":3221661671}]},"public_addr":"172.21.15.1:6811/3221661671","cluster_addr":"172.21.15.1:6813/3221661671","heartbeat_back_addr":"172.21.15.1:6817/3221661671","heartbeat_front_addr":"172.21.15.1:6815/3221661671","state":["exists","up"]},{"osd":4,"uuid":"b0476b9b-3257-46d4-aff7-1f038286ed43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6809","nonce":2066388104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6811","nonce":2066388104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6815","nonce":2066388104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6813","nonce":2066388104}]},"public_addr":"172.21.15.42:6809/2066388104","cluster_addr":"172.21.15.42:6811/2066388104","heartbeat_back_addr":"172.21.15.42:6815/2066388104","heartbeat_front_addr":"172.21.15.42:6813/2066388104","state":["exists","up"]},{"osd":5,"uuid":"96701ced-a55a-4ad9-be62-7f102c00697d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6809","nonce":732336675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6811","nonce":732336675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6815","nonce":732336675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6813","nonce":732336675}]},"public_addr":"172.21.15.193:6809/732336675","cluster_addr":"172.21.15.193:6811/732336675","heartbeat_back_addr":"172.21.15.193:6815/732336675","heartbeat_front_addr":"172.21.15.193:6813/732336675","state":["exists","up"]},{"osd":6,"uuid":"72d76017-e2e3-4118-8316-2c5da01c87b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6819","nonce":3201517067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6821","nonce":3201517067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6825","nonce":3201517067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6823","nonce":3201517067}]},"public_addr":"172.21.15.1:6819/3201517067","cluster_addr":"172.21.15.1:6821/3201517067","heartbeat_back_addr":"172.21.15.1:6825/3201517067","heartbeat_front_addr":"172.21.15.1:6823/3201517067","state":["exists","up"]},{"osd":7,"uuid":"8b239f96-2455-41b6-a905-9ed92078b890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6817","nonce":2124927218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6819","nonce":2124927218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6823","nonce":2124927218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6821","nonce":2124927218}]},"public_addr":"172.21.15.42:6817/2124927218","cluster_addr":"172.21.15.42:6819/2124927218","heartbeat_back_addr":"172.21.15.42:6823/2124927218","heartbeat_front_addr":"172.21.15.42:6821/2124927218","state":["exists","up"]},{"osd":8,"uuid":"8cd93aeb-fe00-4291-9f72-171d01893819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6817","nonce":2277449259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6819","nonce":2277449259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6823","nonce":2277449259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6821","nonce":2277449259}]},"public_addr":"172.21.15.193:6817/2277449259","cluster_addr":"172.21.15.193:6819/2277449259","heartbeat_back_addr":"172.21.15.193:6823/2277449259","heartbeat_front_addr":"172.21.15.193:6821/2277449259","state":["exists","up"]},{"osd":9,"uuid":"9e03e00b-0015-4aa8-adce-0d3352d2ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6827","nonce":1369323215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6829","nonce":1369323215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6833","nonce":1369323215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6831","nonce":1369323215}]},"public_addr":"172.21.15.1:6827/1369323215","cluster_addr":"172.21.15.1:6829/1369323215","heartbeat_back_addr":"172.21.15.1:6833/1369323215","heartbeat_front_addr":"172.21.15.1:6831/1369323215","state":["exists","up"]},{"osd":10,"uuid":"de55a908-b049-4f40-865f-cfa2ae6e461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6825","nonce":3182218295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6827","nonce":3182218295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6831","nonce":3182218295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6829","nonce":3182218295}]},"public_addr":"172.21.15.42:6825/3182218295","cluster_addr":"172.21.15.42:6827/3182218295","heartbeat_back_addr":"172.21.15.42:6831/3182218295","heartbeat_front_addr":"172.21.15.42:6829/3182218295","state":["exists","up"]},{"osd":11,"uuid":"1cac0c39-77aa-460b-92a0-39ed89cd6ce4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6825","nonce":2368815522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6827","nonce":2368815522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6831","nonce":2368815522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6829","nonce":2368815522}]},"public_addr":"172.21.15.193:6825/2368815522","cluster_addr":"172.21.15.193:6827/2368815522","heartbeat_back_addr":"172.21.15.193:6831/2368815522","heartbeat_front_addr":"172.21.15.193:6829/2368815522","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:49:21.491443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:49:47.486846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:50:12.757383+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:50:39.127690+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:05.545277+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:30.617491+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:57.612088+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:24.001953+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:48.447388+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:14.620538+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:40.503576+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:54:05.668236+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6801/59685083":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/309615464":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/1722941514":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/1199175740":"2024-09-22T00:47:25.985486+0000","172.21.15.1:6800/59685083":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/2811453932":"2024-09-22T00:46:58.953779+0000","172.21.15.1:0/3748689057":"2024-09-22T00:46:58.953779+0000","172.21.15.1:0/265697975":"2024-09-22T00:46:58.953779+0000","172.21.15.1:6801/1968786311":"2024-09-22T00:46:58.953779+0000","172.21.15.1:6800/1968786311":"2024-09-22T00:46:58.953779+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:55:33.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.550+0000 7fde4d781640 1 -- 172.21.15.1:0/4002853163 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fde300b6620 msgr2=0x7fde300b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:33.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.550+0000 7fde4d781640 1 --2- 172.21.15.1:0/4002853163 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fde300b6620 0x7fde300b8b30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fde38009230 tx=0x7fde38031400 comp rx=0 tx=0).stop 2024-09-21T00:55:33.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.550+0000 7fde4d781640 1 -- 172.21.15.1:0/4002853163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde4810de70 msgr2=0x7fde48103250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:33.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.550+0000 7fde4d781640 1 --2- 172.21.15.1:0/4002853163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde4810de70 0x7fde48103250 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fde4000eb10 tx=0x7fde4000c2d0 comp rx=0 tx=0).stop 2024-09-21T00:55:33.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.550+0000 7fde4d781640 1 -- 172.21.15.1:0/4002853163 shutdown_connections 2024-09-21T00:55:33.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.550+0000 7fde4d781640 1 --2- 172.21.15.1:0/4002853163 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fde300b6620 0x7fde300b8b30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:33.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.550+0000 7fde4d781640 1 --2- 172.21.15.1:0/4002853163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde4810de70 0x7fde48103250 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:33.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.550+0000 7fde4d781640 1 --2- 172.21.15.1:0/4002853163 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fde481052a0 0x7fde48102d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:33.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.551+0000 7fde4d781640 1 --2- 172.21.15.1:0/4002853163 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde481048c0 0x7fde481027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:33.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.551+0000 7fde4d781640 1 -- 172.21.15.1:0/4002853163 >> 172.21.15.1:0/4002853163 conn(0x7fde48079760 msgr2=0x7fde48100890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:33.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.551+0000 7fde4d781640 1 -- 172.21.15.1:0/4002853163 shutdown_connections 2024-09-21T00:55:33.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:33.551+0000 7fde4d781640 1 -- 172.21.15.1:0/4002853163 wait complete. 2024-09-21T00:55:33.901 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:33 smithi001 ceph-mon[31211]: pgmap v308: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 639 B/s wr, 8 op/s; 7.2 KiB/s, 2 objects/s recovering 2024-09-21T00:55:33.901 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:33 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/4002853163' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:55:33.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:33 smithi193 ceph-mon[34660]: pgmap v308: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 639 B/s wr, 8 op/s; 7.2 KiB/s, 2 objects/s recovering 2024-09-21T00:55:33.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:33 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/4002853163' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:55:33.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:33 smithi042 ceph-mon[34481]: pgmap v308: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 639 B/s wr, 8 op/s; 7.2 KiB/s, 2 objects/s recovering 2024-09-21T00:55:33.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:33 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/4002853163' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:55:34.264 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-21T00:55:34.264 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T00:55:34.527 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:35.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.066+0000 7fef5bcff640 1 -- 172.21.15.1:0/1069489516 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef541100c0 msgr2=0x7fef54112500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:35.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.066+0000 7fef5bcff640 1 --2- 172.21.15.1:0/1069489516 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef541100c0 0x7fef54112500 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fef4c009ca0 tx=0x7fef4c02a8c0 comp rx=0 tx=0).stop 2024-09-21T00:55:35.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.066+0000 7fef5bcff640 1 -- 172.21.15.1:0/1069489516 shutdown_connections 2024-09-21T00:55:35.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.066+0000 7fef5bcff640 1 --2- 172.21.15.1:0/1069489516 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef541100c0 0x7fef54112500 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:35.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.067+0000 7fef5bcff640 1 --2- 172.21.15.1:0/1069489516 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef54076100 0x7fef5410fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:35.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.067+0000 7fef5bcff640 1 --2- 172.21.15.1:0/1069489516 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef540757b0 0x7fef54075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:35.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.067+0000 7fef5bcff640 1 -- 172.21.15.1:0/1069489516 >> 172.21.15.1:0/1069489516 conn(0x7fef5407b850 msgr2=0x7fef5407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:35.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.067+0000 7fef5bcff640 1 -- 172.21.15.1:0/1069489516 shutdown_connections 2024-09-21T00:55:35.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.067+0000 7fef5bcff640 1 -- 172.21.15.1:0/1069489516 wait complete. 2024-09-21T00:55:35.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.067+0000 7fef5bcff640 1 Processor -- start 2024-09-21T00:55:35.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.067+0000 7fef5bcff640 1 -- start start 2024-09-21T00:55:35.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.068+0000 7fef5bcff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef540757b0 0x7fef5419c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:35.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.068+0000 7fef5bcff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef54076100 0x7fef5419cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:35.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.068+0000 7fef5bcff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef541100c0 0x7fef541a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:35.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.068+0000 7fef5bcff640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fef54115cd0 con 0x7fef54076100 2024-09-21T00:55:35.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.068+0000 7fef5bcff640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fef54115b50 con 0x7fef541100c0 2024-09-21T00:55:35.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.068+0000 7fef5bcff640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fef54115e50 con 0x7fef540757b0 2024-09-21T00:55:35.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.068+0000 7fef5929a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef54076100 0x7fef5419cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:35.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.068+0000 7fef5929a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef54076100 0x7fef5419cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45238/0 (socket says 172.21.15.1:45238) 2024-09-21T00:55:35.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.068+0000 7fef5929a640 1 -- 172.21.15.1:0/3887330876 learned_addr learned my addr 172.21.15.1:0/3887330876 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:35.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.068+0000 7fef5a29c640 1 --2- 172.21.15.1:0/3887330876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef541100c0 0x7fef541a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:35.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.068+0000 7fef59a9b640 1 --2- 172.21.15.1:0/3887330876 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef540757b0 0x7fef5419c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:35.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.068+0000 7fef5929a640 1 -- 172.21.15.1:0/3887330876 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef540757b0 msgr2=0x7fef5419c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:35.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.068+0000 7fef5929a640 1 --2- 172.21.15.1:0/3887330876 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef540757b0 0x7fef5419c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:35.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.068+0000 7fef5929a640 1 -- 172.21.15.1:0/3887330876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef541100c0 msgr2=0x7fef541a1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:35.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.068+0000 7fef5929a640 1 --2- 172.21.15.1:0/3887330876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef541100c0 0x7fef541a1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:35.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.068+0000 7fef5929a640 1 -- 172.21.15.1:0/3887330876 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef541a2510 con 0x7fef54076100 2024-09-21T00:55:35.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.068+0000 7fef59a9b640 1 --2- 172.21.15.1:0/3887330876 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef540757b0 0x7fef5419c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:55:35.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.068+0000 7fef5a29c640 1 --2- 172.21.15.1:0/3887330876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef541100c0 0x7fef541a1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:55:35.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.068+0000 7fef5929a640 1 --2- 172.21.15.1:0/3887330876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef54076100 0x7fef5419cc00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fef4800b450 tx=0x7fef4800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:35.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.068+0000 7fef46ffd640 1 -- 172.21.15.1:0/3887330876 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef48015020 con 0x7fef54076100 2024-09-21T00:55:35.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.068+0000 7fef5bcff640 1 -- 172.21.15.1:0/3887330876 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef541a2800 con 0x7fef54076100 2024-09-21T00:55:35.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.068+0000 7fef46ffd640 1 -- 172.21.15.1:0/3887330876 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef48011d40 con 0x7fef54076100 2024-09-21T00:55:35.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.068+0000 7fef46ffd640 1 -- 172.21.15.1:0/3887330876 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4800f340 con 0x7fef54076100 2024-09-21T00:55:35.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.069+0000 7fef5bcff640 1 -- 172.21.15.1:0/3887330876 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef541a9020 con 0x7fef54076100 2024-09-21T00:55:35.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.070+0000 7fef5bcff640 1 -- 172.21.15.1:0/3887330876 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef54075bc0 con 0x7fef54076100 2024-09-21T00:55:35.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.072+0000 7fef46ffd640 1 -- 172.21.15.1:0/3887330876 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7fef48018020 con 0x7fef54076100 2024-09-21T00:55:35.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.073+0000 7fef46ffd640 1 --2- 172.21.15.1:0/3887330876 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fef400b65d0 0x7fef400b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:35.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.073+0000 7fef59a9b640 1 --2- 172.21.15.1:0/3887330876 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fef400b65d0 0x7fef400b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:35.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.073+0000 7fef46ffd640 1 -- 172.21.15.1:0/3887330876 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fef480e7460 con 0x7fef54076100 2024-09-21T00:55:35.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.073+0000 7fef59a9b640 1 --2- 172.21.15.1:0/3887330876 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fef400b65d0 0x7fef400b8ae0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fef5000baa0 tx=0x7fef50005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:35.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.076+0000 7fef46ffd640 1 -- 172.21.15.1:0/3887330876 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fef4801f020 con 0x7fef54076100 2024-09-21T00:55:35.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.265+0000 7fef5bcff640 1 -- 172.21.15.1:0/3887330876 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fef541a9280 con 0x7fef54076100 2024-09-21T00:55:35.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.266+0000 7fef46ffd640 1 -- 172.21.15.1:0/3887330876 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22720 (secure 0 0 0) 0x7fef4800d040 con 0x7fef54076100 2024-09-21T00:55:35.267 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:55:35.267 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":75,"fsid":"d3972c20-77b2-11ef-baf5-efdc52797490","created":"2024-09-21T00:46:29.745963+0000","modified":"2024-09-21T00:55:27.629379+0000","last_up_change":"2024-09-21T00:54:07.552837+0000","last_in_change":"2024-09-21T00:53:44.164415+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:50:16.456462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:54:54.305306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:54:56.506872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5bf09a34-4d6e-401c-8cef-29bbe72de68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6803","nonce":4067586847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6805","nonce":4067586847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6809","nonce":4067586847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6807","nonce":4067586847}]},"public_addr":"172.21.15.1:6803/4067586847","cluster_addr":"172.21.15.1:6805/4067586847","heartbeat_back_addr":"172.21.15.1:6809/4067586847","heartbeat_front_addr":"172.21.15.1:6807/4067586847","state":["exists","up"]},{"osd":1,"uuid":"195f9109-ef61-46be-a59a-d72e3a1b5b45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6801","nonce":436964633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6803","nonce":436964633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6807","nonce":436964633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6805","nonce":436964633}]},"public_addr":"172.21.15.42:6801/436964633","cluster_addr":"172.21.15.42:6803/436964633","heartbeat_back_addr":"172.21.15.42:6807/436964633","heartbeat_front_addr":"172.21.15.42:6805/436964633","state":["exists","up"]},{"osd":2,"uuid":"47cf90a7-6db6-464a-84ef-9f509f89a46b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6801","nonce":3495400570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6803","nonce":3495400570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6807","nonce":3495400570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6805","nonce":3495400570}]},"public_addr":"172.21.15.193:6801/3495400570","cluster_addr":"172.21.15.193:6803/3495400570","heartbeat_back_addr":"172.21.15.193:6807/3495400570","heartbeat_front_addr":"172.21.15.193:6805/3495400570","state":["exists","up"]},{"osd":3,"uuid":"a5230a66-3c74-41a7-9353-5650780ed25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6811","nonce":3221661671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6813","nonce":3221661671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6817","nonce":3221661671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6815","nonce":3221661671}]},"public_addr":"172.21.15.1:6811/3221661671","cluster_addr":"172.21.15.1:6813/3221661671","heartbeat_back_addr":"172.21.15.1:6817/3221661671","heartbeat_front_addr":"172.21.15.1:6815/3221661671","state":["exists","up"]},{"osd":4,"uuid":"b0476b9b-3257-46d4-aff7-1f038286ed43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6809","nonce":2066388104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6811","nonce":2066388104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6815","nonce":2066388104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6813","nonce":2066388104}]},"public_addr":"172.21.15.42:6809/2066388104","cluster_addr":"172.21.15.42:6811/2066388104","heartbeat_back_addr":"172.21.15.42:6815/2066388104","heartbeat_front_addr":"172.21.15.42:6813/2066388104","state":["exists","up"]},{"osd":5,"uuid":"96701ced-a55a-4ad9-be62-7f102c00697d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6809","nonce":732336675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6811","nonce":732336675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6815","nonce":732336675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6813","nonce":732336675}]},"public_addr":"172.21.15.193:6809/732336675","cluster_addr":"172.21.15.193:6811/732336675","heartbeat_back_addr":"172.21.15.193:6815/732336675","heartbeat_front_addr":"172.21.15.193:6813/732336675","state":["exists","up"]},{"osd":6,"uuid":"72d76017-e2e3-4118-8316-2c5da01c87b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6819","nonce":3201517067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6821","nonce":3201517067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6825","nonce":3201517067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6823","nonce":3201517067}]},"public_addr":"172.21.15.1:6819/3201517067","cluster_addr":"172.21.15.1:6821/3201517067","heartbeat_back_addr":"172.21.15.1:6825/3201517067","heartbeat_front_addr":"172.21.15.1:6823/3201517067","state":["exists","up"]},{"osd":7,"uuid":"8b239f96-2455-41b6-a905-9ed92078b890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6817","nonce":2124927218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6819","nonce":2124927218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6823","nonce":2124927218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6821","nonce":2124927218}]},"public_addr":"172.21.15.42:6817/2124927218","cluster_addr":"172.21.15.42:6819/2124927218","heartbeat_back_addr":"172.21.15.42:6823/2124927218","heartbeat_front_addr":"172.21.15.42:6821/2124927218","state":["exists","up"]},{"osd":8,"uuid":"8cd93aeb-fe00-4291-9f72-171d01893819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6817","nonce":2277449259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6819","nonce":2277449259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6823","nonce":2277449259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6821","nonce":2277449259}]},"public_addr":"172.21.15.193:6817/2277449259","cluster_addr":"172.21.15.193:6819/2277449259","heartbeat_back_addr":"172.21.15.193:6823/2277449259","heartbeat_front_addr":"172.21.15.193:6821/2277449259","state":["exists","up"]},{"osd":9,"uuid":"9e03e00b-0015-4aa8-adce-0d3352d2ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6827","nonce":1369323215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6829","nonce":1369323215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6833","nonce":1369323215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6831","nonce":1369323215}]},"public_addr":"172.21.15.1:6827/1369323215","cluster_addr":"172.21.15.1:6829/1369323215","heartbeat_back_addr":"172.21.15.1:6833/1369323215","heartbeat_front_addr":"172.21.15.1:6831/1369323215","state":["exists","up"]},{"osd":10,"uuid":"de55a908-b049-4f40-865f-cfa2ae6e461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6825","nonce":3182218295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6827","nonce":3182218295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6831","nonce":3182218295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6829","nonce":3182218295}]},"public_addr":"172.21.15.42:6825/3182218295","cluster_addr":"172.21.15.42:6827/3182218295","heartbeat_back_addr":"172.21.15.42:6831/3182218295","heartbeat_front_addr":"172.21.15.42:6829/3182218295","state":["exists","up"]},{"osd":11,"uuid":"1cac0c39-77aa-460b-92a0-39ed89cd6ce4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6825","nonce":2368815522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6827","nonce":2368815522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6831","nonce":2368815522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6829","nonce":2368815522}]},"public_addr":"172.21.15.193:6825/2368815522","cluster_addr":"172.21.15.193:6827/2368815522","heartbeat_back_addr":"172.21.15.193:6831/2368815522","heartbeat_front_addr":"172.21.15.193:6829/2368815522","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:49:21.491443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:49:47.486846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:50:12.757383+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:50:39.127690+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:05.545277+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:30.617491+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:57.612088+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:24.001953+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:48.447388+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:14.620538+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:40.503576+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:54:05.668236+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6801/59685083":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/309615464":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/1722941514":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/1199175740":"2024-09-22T00:47:25.985486+0000","172.21.15.1:6800/59685083":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/2811453932":"2024-09-22T00:46:58.953779+0000","172.21.15.1:0/3748689057":"2024-09-22T00:46:58.953779+0000","172.21.15.1:0/265697975":"2024-09-22T00:46:58.953779+0000","172.21.15.1:6801/1968786311":"2024-09-22T00:46:58.953779+0000","172.21.15.1:6800/1968786311":"2024-09-22T00:46:58.953779+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:55:35.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.268+0000 7fef5bcff640 1 -- 172.21.15.1:0/3887330876 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fef400b65d0 msgr2=0x7fef400b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:35.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.268+0000 7fef5bcff640 1 --2- 172.21.15.1:0/3887330876 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fef400b65d0 0x7fef400b8ae0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fef5000baa0 tx=0x7fef50005d90 comp rx=0 tx=0).stop 2024-09-21T00:55:35.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.268+0000 7fef5bcff640 1 -- 172.21.15.1:0/3887330876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef54076100 msgr2=0x7fef5419cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:35.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.268+0000 7fef5bcff640 1 --2- 172.21.15.1:0/3887330876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef54076100 0x7fef5419cc00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fef4800b450 tx=0x7fef4800b910 comp rx=0 tx=0).stop 2024-09-21T00:55:35.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.268+0000 7fef5bcff640 1 -- 172.21.15.1:0/3887330876 shutdown_connections 2024-09-21T00:55:35.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.268+0000 7fef5bcff640 1 --2- 172.21.15.1:0/3887330876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef541100c0 0x7fef541a1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:35.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.268+0000 7fef5bcff640 1 --2- 172.21.15.1:0/3887330876 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fef400b65d0 0x7fef400b8ae0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:35.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.268+0000 7fef5bcff640 1 --2- 172.21.15.1:0/3887330876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef54076100 0x7fef5419cc00 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:35.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.268+0000 7fef5bcff640 1 --2- 172.21.15.1:0/3887330876 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef540757b0 0x7fef5419c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:35.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.268+0000 7fef5bcff640 1 -- 172.21.15.1:0/3887330876 >> 172.21.15.1:0/3887330876 conn(0x7fef5407b850 msgr2=0x7fef54100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:35.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.269+0000 7fef5bcff640 1 -- 172.21.15.1:0/3887330876 shutdown_connections 2024-09-21T00:55:35.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:35.269+0000 7fef5bcff640 1 -- 172.21.15.1:0/3887330876 wait complete. 2024-09-21T00:55:35.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:35 smithi001 ceph-mon[31211]: pgmap v309: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 639 B/s wr, 10 op/s; 7.2 KiB/s, 2 objects/s recovering 2024-09-21T00:55:35.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:35 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/3887330876' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:55:35.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:35 smithi193 ceph-mon[34660]: pgmap v309: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 639 B/s wr, 10 op/s; 7.2 KiB/s, 2 objects/s recovering 2024-09-21T00:55:35.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:35 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/3887330876' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:55:35.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:35 smithi042 ceph-mon[34481]: pgmap v309: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 639 B/s wr, 10 op/s; 7.2 KiB/s, 2 objects/s recovering 2024-09-21T00:55:35.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:35 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/3887330876' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:55:36.096 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-21T00:55:36.097 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-21T00:55:36.097 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-21T00:55:36.097 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-21T00:55:36.098 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-21T00:55:36.098 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-21T00:55:36.099 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell osd.6 flush_pg_stats 2024-09-21T00:55:36.099 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell osd.7 flush_pg_stats 2024-09-21T00:55:36.100 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell osd.8 flush_pg_stats 2024-09-21T00:55:36.100 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell osd.9 flush_pg_stats 2024-09-21T00:55:36.100 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell osd.10 flush_pg_stats 2024-09-21T00:55:36.101 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell osd.11 flush_pg_stats 2024-09-21T00:55:36.773 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:36.902 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:36.906 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:36.906 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:36.906 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:36.906 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:36.911 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:36.912 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:36.924 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:36.925 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:37.823 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:37 smithi001 ceph-mon[31211]: pgmap v310: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 541 B/s wr, 9 op/s; 6.1 KiB/s, 1 objects/s recovering 2024-09-21T00:55:37.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:37 smithi193 ceph-mon[34660]: pgmap v310: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 541 B/s wr, 9 op/s; 6.1 KiB/s, 1 objects/s recovering 2024-09-21T00:55:37.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:37 smithi042 ceph-mon[34481]: pgmap v310: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 541 B/s wr, 9 op/s; 6.1 KiB/s, 1 objects/s recovering 2024-09-21T00:55:38.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.036+0000 7fa391997640 1 -- 172.21.15.1:0/4017687339 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa38c1094a0 msgr2=0x7fa38c1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:38.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.036+0000 7fa391997640 1 --2- 172.21.15.1:0/4017687339 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa38c1094a0 0x7fa38c1098b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa374009900 tx=0x7fa37402a410 comp rx=0 tx=0).stop 2024-09-21T00:55:38.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.036+0000 7fa391997640 1 -- 172.21.15.1:0/4017687339 shutdown_connections 2024-09-21T00:55:38.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.036+0000 7fa391997640 1 --2- 172.21.15.1:0/4017687339 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa38c109df0 0x7fa38c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:38.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.036+0000 7fa391997640 1 --2- 172.21.15.1:0/4017687339 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa38c1094a0 0x7fa38c1098b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:38.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.036+0000 7fa391997640 1 --2- 172.21.15.1:0/4017687339 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa38c103b60 0x7fa38c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:38.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.036+0000 7fa391997640 1 -- 172.21.15.1:0/4017687339 >> 172.21.15.1:0/4017687339 conn(0x7fa38c07b850 msgr2=0x7fa38c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:38.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.036+0000 7fa391997640 1 -- 172.21.15.1:0/4017687339 shutdown_connections 2024-09-21T00:55:38.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.036+0000 7fa391997640 1 -- 172.21.15.1:0/4017687339 wait complete. 2024-09-21T00:55:38.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.037+0000 7fa391997640 1 Processor -- start 2024-09-21T00:55:38.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.037+0000 7fa391997640 1 -- start start 2024-09-21T00:55:38.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.037+0000 7fa391997640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa38c103b60 0x7fa38c19a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:38.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.037+0000 7fa391997640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa38c1094a0 0x7fa38c19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:38.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.037+0000 7fa391997640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa38c109df0 0x7fa38c19fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:38.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.037+0000 7fa391997640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa38c113ab0 con 0x7fa38c103b60 2024-09-21T00:55:38.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.037+0000 7fa391997640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa38c113930 con 0x7fa38c109df0 2024-09-21T00:55:38.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.037+0000 7fa391997640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa38c113c30 con 0x7fa38c1094a0 2024-09-21T00:55:38.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.037+0000 7fa38affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa38c103b60 0x7fa38c19a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:38.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.037+0000 7fa38affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa38c103b60 0x7fa38c19a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45258/0 (socket says 172.21.15.1:45258) 2024-09-21T00:55:38.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.037+0000 7fa38affd640 1 -- 172.21.15.1:0/2270334814 learned_addr learned my addr 172.21.15.1:0/2270334814 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:38.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.038+0000 7fa383fff640 1 --2- 172.21.15.1:0/2270334814 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa38c1094a0 0x7fa38c19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:38.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.038+0000 7fa38b7fe640 1 --2- 172.21.15.1:0/2270334814 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa38c109df0 0x7fa38c19fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:38.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.038+0000 7fa38affd640 1 -- 172.21.15.1:0/2270334814 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa38c1094a0 msgr2=0x7fa38c19ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:38.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.038+0000 7fa38affd640 1 --2- 172.21.15.1:0/2270334814 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa38c1094a0 0x7fa38c19ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:38.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.038+0000 7fa38affd640 1 -- 172.21.15.1:0/2270334814 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa38c109df0 msgr2=0x7fa38c19fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:38.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.038+0000 7fa38affd640 1 --2- 172.21.15.1:0/2270334814 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa38c109df0 0x7fa38c19fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:38.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.038+0000 7fa38affd640 1 -- 172.21.15.1:0/2270334814 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa38c1a0450 con 0x7fa38c103b60 2024-09-21T00:55:38.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.038+0000 7fa383fff640 1 --2- 172.21.15.1:0/2270334814 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa38c1094a0 0x7fa38c19ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:55:38.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.038+0000 7fa38affd640 1 --2- 172.21.15.1:0/2270334814 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa38c103b60 0x7fa38c19a5a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa37c00c890 tx=0x7fa37c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:38.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.038+0000 7fa390995640 1 -- 172.21.15.1:0/2270334814 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37c004220 con 0x7fa38c103b60 2024-09-21T00:55:38.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.038+0000 7fa391997640 1 -- 172.21.15.1:0/2270334814 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa38c1a0740 con 0x7fa38c103b60 2024-09-21T00:55:38.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.038+0000 7fa390995640 1 -- 172.21.15.1:0/2270334814 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa37c0043c0 con 0x7fa38c103b60 2024-09-21T00:55:38.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.038+0000 7fa390995640 1 -- 172.21.15.1:0/2270334814 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37c004a00 con 0x7fa38c103b60 2024-09-21T00:55:38.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.038+0000 7fa391997640 1 -- 172.21.15.1:0/2270334814 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa38c0755f0 con 0x7fa38c103b60 2024-09-21T00:55:38.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.039+0000 7fa391997640 1 -- 172.21.15.1:0/2270334814 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa38c063b50 con 0x7fa38c103b60 2024-09-21T00:55:38.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.041+0000 7fa390995640 1 -- 172.21.15.1:0/2270334814 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7fa37c0079b0 con 0x7fa38c103b60 2024-09-21T00:55:38.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.042+0000 7fa390995640 1 --2- 172.21.15.1:0/2270334814 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa3780b65d0 0x7fa3780b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:38.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.042+0000 7fa383fff640 1 --2- 172.21.15.1:0/2270334814 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa3780b65d0 0x7fa3780b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:38.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.042+0000 7fa390995640 1 -- 172.21.15.1:0/2270334814 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fa37c0e7840 con 0x7fa38c103b60 2024-09-21T00:55:38.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.042+0000 7fa390995640 1 --2- 172.21.15.1:0/2270334814 >> [v2:172.21.15.1:6818/3201517067,v1:172.21.15.1:6819/3201517067] conn(0x7fa3780c01c0 0x7fa3780c26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:38.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.042+0000 7fa390995640 1 -- 172.21.15.1:0/2270334814 --> [v2:172.21.15.1:6818/3201517067,v1:172.21.15.1:6819/3201517067] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa37c012ec0 con 0x7fa3780c01c0 2024-09-21T00:55:38.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.042+0000 7fa390995640 1 -- 172.21.15.1:0/2270334814 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fa37c0e7c90 con 0x7fa38c103b60 2024-09-21T00:55:38.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.042+0000 7fa38b7fe640 1 --2- 172.21.15.1:0/2270334814 >> [v2:172.21.15.1:6818/3201517067,v1:172.21.15.1:6819/3201517067] conn(0x7fa3780c01c0 0x7fa3780c26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:38.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.042+0000 7fa383fff640 1 --2- 172.21.15.1:0/2270334814 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa3780b65d0 0x7fa3780b8ae0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa374009230 tx=0x7fa374000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:38.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.043+0000 7fa38b7fe640 1 --2- 172.21.15.1:0/2270334814 >> [v2:172.21.15.1:6818/3201517067,v1:172.21.15.1:6819/3201517067] conn(0x7fa3780c01c0 0x7fa3780c26b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:38.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.043+0000 7fa390995640 1 -- 172.21.15.1:0/2270334814 <== osd.6 v2:172.21.15.1:6818/3201517067 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa37c012ec0 con 0x7fa3780c01c0 2024-09-21T00:55:38.055 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:38.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.057+0000 7fa391997640 1 -- 172.21.15.1:0/2270334814 --> [v2:172.21.15.1:6818/3201517067,v1:172.21.15.1:6819/3201517067] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa38c063f50 con 0x7fa3780c01c0 2024-09-21T00:55:38.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.058+0000 7fa390995640 1 -- 172.21.15.1:0/2270334814 <== osd.6 v2:172.21.15.1:6818/3201517067 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa38c063f50 con 0x7fa3780c01c0 2024-09-21T00:55:38.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.058+0000 7fa391997640 1 -- 172.21.15.1:0/2270334814 >> [v2:172.21.15.1:6818/3201517067,v1:172.21.15.1:6819/3201517067] conn(0x7fa3780c01c0 msgr2=0x7fa3780c26b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:38.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.058+0000 7fa391997640 1 --2- 172.21.15.1:0/2270334814 >> [v2:172.21.15.1:6818/3201517067,v1:172.21.15.1:6819/3201517067] conn(0x7fa3780c01c0 0x7fa3780c26b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:38.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.058+0000 7fa391997640 1 -- 172.21.15.1:0/2270334814 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa3780b65d0 msgr2=0x7fa3780b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:38.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.058+0000 7fa391997640 1 --2- 172.21.15.1:0/2270334814 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa3780b65d0 0x7fa3780b8ae0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa374009230 tx=0x7fa374000bc0 comp rx=0 tx=0).stop 2024-09-21T00:55:38.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.058+0000 7fa391997640 1 -- 172.21.15.1:0/2270334814 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa38c103b60 msgr2=0x7fa38c19a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:38.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.058+0000 7fa391997640 1 --2- 172.21.15.1:0/2270334814 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa38c103b60 0x7fa38c19a5a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa37c00c890 tx=0x7fa37c00cd50 comp rx=0 tx=0).stop 2024-09-21T00:55:38.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.059+0000 7fa38b7fe640 1 -- 172.21.15.1:0/2270334814 reap_dead start 2024-09-21T00:55:38.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.059+0000 7fa391997640 1 -- 172.21.15.1:0/2270334814 shutdown_connections 2024-09-21T00:55:38.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.059+0000 7fa391997640 1 -- 172.21.15.1:0/2270334814 >> 172.21.15.1:0/2270334814 conn(0x7fa38c07b850 msgr2=0x7fa38c105620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:38.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.059+0000 7fa391997640 1 -- 172.21.15.1:0/2270334814 shutdown_connections 2024-09-21T00:55:38.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.059+0000 7fa391997640 1 -- 172.21.15.1:0/2270334814 wait complete. 2024-09-21T00:55:38.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.227+0000 7f031a518640 1 -- 172.21.15.1:0/2683128976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03141094a0 msgr2=0x7f03141098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:38.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.227+0000 7f031a518640 1 --2- 172.21.15.1:0/2683128976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03141094a0 0x7f03141098b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0308009900 tx=0x7f030802a410 comp rx=0 tx=0).stop 2024-09-21T00:55:38.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.227+0000 7f031a518640 1 -- 172.21.15.1:0/2683128976 shutdown_connections 2024-09-21T00:55:38.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.227+0000 7f031a518640 1 --2- 172.21.15.1:0/2683128976 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0314109df0 0x7f0314110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:38.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.227+0000 7f031a518640 1 --2- 172.21.15.1:0/2683128976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03141094a0 0x7f03141098b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:38.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.227+0000 7f031a518640 1 --2- 172.21.15.1:0/2683128976 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0314103b60 0x7f0314103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:38.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.227+0000 7f031a518640 1 -- 172.21.15.1:0/2683128976 >> 172.21.15.1:0/2683128976 conn(0x7f031407b850 msgr2=0x7f031407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:38.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.227+0000 7f031a518640 1 -- 172.21.15.1:0/2683128976 shutdown_connections 2024-09-21T00:55:38.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.227+0000 7f031a518640 1 -- 172.21.15.1:0/2683128976 wait complete. 2024-09-21T00:55:38.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.227+0000 7f031a518640 1 Processor -- start 2024-09-21T00:55:38.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.227+0000 7f031a518640 1 -- start start 2024-09-21T00:55:38.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.228+0000 7f031a518640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0314103b60 0x7f031419a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:38.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.228+0000 7f031a518640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f03141094a0 0x7f031419a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:38.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.228+0000 7f031a518640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0314109df0 0x7f031419fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:38.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.228+0000 7f031a518640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0314113ab0 con 0x7f0314109df0 2024-09-21T00:55:38.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.228+0000 7f031a518640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0314113930 con 0x7f0314103b60 2024-09-21T00:55:38.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.228+0000 7f031a518640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0314113c30 con 0x7f03141094a0 2024-09-21T00:55:38.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.228+0000 7f0318ab5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0314109df0 0x7f031419fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:38.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.228+0000 7f03137fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f03141094a0 0x7f031419a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:38.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.228+0000 7f0318ab5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0314109df0 0x7f031419fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45284/0 (socket says 172.21.15.1:45284) 2024-09-21T00:55:38.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.228+0000 7f0318ab5640 1 -- 172.21.15.1:0/2864841354 learned_addr learned my addr 172.21.15.1:0/2864841354 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:38.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.228+0000 7f0313fff640 1 --2- 172.21.15.1:0/2864841354 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0314103b60 0x7f031419a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:38.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.228+0000 7f0318ab5640 1 -- 172.21.15.1:0/2864841354 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f03141094a0 msgr2=0x7f031419a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:38.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.228+0000 7f0318ab5640 1 --2- 172.21.15.1:0/2864841354 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f03141094a0 0x7f031419a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:38.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.228+0000 7f0318ab5640 1 -- 172.21.15.1:0/2864841354 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0314103b60 msgr2=0x7f031419a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:38.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.228+0000 7f0318ab5640 1 --2- 172.21.15.1:0/2864841354 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0314103b60 0x7f031419a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:38.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.228+0000 7f0318ab5640 1 -- 172.21.15.1:0/2864841354 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03141a02b0 con 0x7f0314109df0 2024-09-21T00:55:38.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.229+0000 7f0318ab5640 1 --2- 172.21.15.1:0/2864841354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0314109df0 0x7f031419fc40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f030c00cce0 tx=0x7f030c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:38.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.229+0000 7f03117fa640 1 -- 172.21.15.1:0/2864841354 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f030c00f450 con 0x7f0314109df0 2024-09-21T00:55:38.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.229+0000 7f03117fa640 1 -- 172.21.15.1:0/2864841354 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f030c00faa0 con 0x7f0314109df0 2024-09-21T00:55:38.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.229+0000 7f03117fa640 1 -- 172.21.15.1:0/2864841354 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f030c018b70 con 0x7f0314109df0 2024-09-21T00:55:38.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.229+0000 7f031a518640 1 -- 172.21.15.1:0/2864841354 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03141a05a0 con 0x7f0314109df0 2024-09-21T00:55:38.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.229+0000 7f031a518640 1 -- 172.21.15.1:0/2864841354 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03141a0a60 con 0x7f0314109df0 2024-09-21T00:55:38.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.230+0000 7f031a518640 1 -- 172.21.15.1:0/2864841354 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0314063b50 con 0x7f0314109df0 2024-09-21T00:55:38.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.232+0000 7f03117fa640 1 -- 172.21.15.1:0/2864841354 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7f030c018d10 con 0x7f0314109df0 2024-09-21T00:55:38.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.233+0000 7f03117fa640 1 --2- 172.21.15.1:0/2864841354 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f02fc0b6650 0x7f02fc0b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:38.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.233+0000 7f0313fff640 1 --2- 172.21.15.1:0/2864841354 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f02fc0b6650 0x7f02fc0b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:38.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.233+0000 7f03117fa640 1 -- 172.21.15.1:0/2864841354 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f030c0e7ce0 con 0x7f0314109df0 2024-09-21T00:55:38.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.233+0000 7f03117fa640 1 --2- 172.21.15.1:0/2864841354 >> [v2:172.21.15.1:6802/4067586847,v1:172.21.15.1:6803/4067586847] conn(0x7f02fc0c0240 0x7f02fc0c2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:38.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.233+0000 7f03117fa640 1 -- 172.21.15.1:0/2864841354 --> [v2:172.21.15.1:6802/4067586847,v1:172.21.15.1:6803/4067586847] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f030c01ee50 con 0x7f02fc0c0240 2024-09-21T00:55:38.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.233+0000 7f03117fa640 1 -- 172.21.15.1:0/2864841354 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f030c0e8130 con 0x7f0314109df0 2024-09-21T00:55:38.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.233+0000 7f03137fe640 1 --2- 172.21.15.1:0/2864841354 >> [v2:172.21.15.1:6802/4067586847,v1:172.21.15.1:6803/4067586847] conn(0x7f02fc0c0240 0x7f02fc0c2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:38.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.233+0000 7f0313fff640 1 --2- 172.21.15.1:0/2864841354 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f02fc0b6650 0x7f02fc0b8b60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0304005e10 tx=0x7f0304005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:38.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.234+0000 7f03137fe640 1 --2- 172.21.15.1:0/2864841354 >> [v2:172.21.15.1:6802/4067586847,v1:172.21.15.1:6803/4067586847] conn(0x7f02fc0c0240 0x7f02fc0c2730 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:38.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.235+0000 7f03117fa640 1 -- 172.21.15.1:0/2864841354 <== osd.0 v2:172.21.15.1:6802/4067586847 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f030c01ee50 con 0x7f02fc0c0240 2024-09-21T00:55:38.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.248+0000 7f031a518640 1 -- 172.21.15.1:0/2864841354 --> [v2:172.21.15.1:6802/4067586847,v1:172.21.15.1:6803/4067586847] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0314063fd0 con 0x7f02fc0c0240 2024-09-21T00:55:38.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.248+0000 7f03117fa640 1 -- 172.21.15.1:0/2864841354 <== osd.0 v2:172.21.15.1:6802/4067586847 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0314063fd0 con 0x7f02fc0c0240 2024-09-21T00:55:38.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.249+0000 7f031a518640 1 -- 172.21.15.1:0/2864841354 >> [v2:172.21.15.1:6802/4067586847,v1:172.21.15.1:6803/4067586847] conn(0x7f02fc0c0240 msgr2=0x7f02fc0c2730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:38.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.249+0000 7f031a518640 1 --2- 172.21.15.1:0/2864841354 >> [v2:172.21.15.1:6802/4067586847,v1:172.21.15.1:6803/4067586847] conn(0x7f02fc0c0240 0x7f02fc0c2730 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:38.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.249+0000 7f031a518640 1 -- 172.21.15.1:0/2864841354 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f02fc0b6650 msgr2=0x7f02fc0b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:38.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.249+0000 7f031a518640 1 --2- 172.21.15.1:0/2864841354 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f02fc0b6650 0x7f02fc0b8b60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0304005e10 tx=0x7f0304005da0 comp rx=0 tx=0).stop 2024-09-21T00:55:38.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.249+0000 7f031a518640 1 -- 172.21.15.1:0/2864841354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0314109df0 msgr2=0x7f031419fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:38.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.249+0000 7f031a518640 1 --2- 172.21.15.1:0/2864841354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0314109df0 0x7f031419fc40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f030c00cce0 tx=0x7f030c00a620 comp rx=0 tx=0).stop 2024-09-21T00:55:38.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.249+0000 7f0318ab5640 1 -- 172.21.15.1:0/2864841354 reap_dead start 2024-09-21T00:55:38.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.249+0000 7f031a518640 1 -- 172.21.15.1:0/2864841354 shutdown_connections 2024-09-21T00:55:38.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.249+0000 7f031a518640 1 -- 172.21.15.1:0/2864841354 >> 172.21.15.1:0/2864841354 conn(0x7f031407b850 msgr2=0x7f0314107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:38.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.249+0000 7f031a518640 1 -- 172.21.15.1:0/2864841354 shutdown_connections 2024-09-21T00:55:38.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.249+0000 7f031a518640 1 -- 172.21.15.1:0/2864841354 wait complete. 2024-09-21T00:55:38.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.905+0000 7feeea3e8640 1 -- 172.21.15.1:0/1133541520 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feee4108d20 msgr2=0x7feee410f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:38.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.905+0000 7feeea3e8640 1 --2- 172.21.15.1:0/1133541520 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feee4108d20 0x7feee410f550 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7feedc009ca0 tx=0x7feedc02a8c0 comp rx=0 tx=0).stop 2024-09-21T00:55:38.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.905+0000 7feeea3e8640 1 -- 172.21.15.1:0/1133541520 shutdown_connections 2024-09-21T00:55:38.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.905+0000 7feeea3e8640 1 --2- 172.21.15.1:0/1133541520 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feee4108d20 0x7feee410f550 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:38.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.905+0000 7feeea3e8640 1 --2- 172.21.15.1:0/1133541520 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feee41083d0 0x7feee41087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:38.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.905+0000 7feeea3e8640 1 --2- 172.21.15.1:0/1133541520 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feee4102ae0 0x7feee4102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:38.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.905+0000 7feeea3e8640 1 -- 172.21.15.1:0/1133541520 >> 172.21.15.1:0/1133541520 conn(0x7feee4079760 msgr2=0x7feee4079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:38.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.905+0000 7feeea3e8640 1 -- 172.21.15.1:0/1133541520 shutdown_connections 2024-09-21T00:55:38.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.905+0000 7feeea3e8640 1 -- 172.21.15.1:0/1133541520 wait complete. 2024-09-21T00:55:38.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.906+0000 7feeea3e8640 1 Processor -- start 2024-09-21T00:55:38.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.906+0000 7feeea3e8640 1 -- start start 2024-09-21T00:55:38.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.907+0000 7feeea3e8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feee4102ae0 0x7feee419a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:38.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.907+0000 7feeea3e8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feee41083d0 0x7feee419a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:38.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.907+0000 7feeea3e8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feee4108d20 0x7feee419fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:38.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.907+0000 7feeea3e8640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7feee4113ab0 con 0x7feee4102ae0 2024-09-21T00:55:38.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.907+0000 7feeea3e8640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7feee4113930 con 0x7feee4108d20 2024-09-21T00:55:38.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.907+0000 7feeea3e8640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7feee4113c30 con 0x7feee41083d0 2024-09-21T00:55:38.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.907+0000 7feee3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feee4102ae0 0x7feee419a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:38.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.907+0000 7feee3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feee4102ae0 0x7feee419a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45304/0 (socket says 172.21.15.1:45304) 2024-09-21T00:55:38.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.907+0000 7feee3fff640 1 -- 172.21.15.1:0/326010454 learned_addr learned my addr 172.21.15.1:0/326010454 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:38.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.907+0000 7feee8985640 1 --2- 172.21.15.1:0/326010454 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feee4108d20 0x7feee419fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:38.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.907+0000 7feee37fe640 1 --2- 172.21.15.1:0/326010454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feee41083d0 0x7feee419a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:38.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.907+0000 7feee3fff640 1 -- 172.21.15.1:0/326010454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feee41083d0 msgr2=0x7feee419a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:38.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.907+0000 7feee3fff640 1 --2- 172.21.15.1:0/326010454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feee41083d0 0x7feee419a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:38.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.907+0000 7feee3fff640 1 -- 172.21.15.1:0/326010454 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feee4108d20 msgr2=0x7feee419fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:38.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.907+0000 7feee3fff640 1 --2- 172.21.15.1:0/326010454 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feee4108d20 0x7feee419fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:38.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.907+0000 7feee3fff640 1 -- 172.21.15.1:0/326010454 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee41a0350 con 0x7feee4102ae0 2024-09-21T00:55:38.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.908+0000 7feee3fff640 1 --2- 172.21.15.1:0/326010454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feee4102ae0 0x7feee419a3e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7feed400e9f0 tx=0x7feed400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:38.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.908+0000 7feee17fa640 1 -- 172.21.15.1:0/326010454 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed400cd80 con 0x7feee4102ae0 2024-09-21T00:55:38.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.908+0000 7feeea3e8640 1 -- 172.21.15.1:0/326010454 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feee41a0640 con 0x7feee4102ae0 2024-09-21T00:55:38.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.908+0000 7feee17fa640 1 -- 172.21.15.1:0/326010454 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feed40108e0 con 0x7feee4102ae0 2024-09-21T00:55:38.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.908+0000 7feee17fa640 1 -- 172.21.15.1:0/326010454 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed40188e0 con 0x7feee4102ae0 2024-09-21T00:55:38.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.908+0000 7feeea3e8640 1 -- 172.21.15.1:0/326010454 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feee41a6da0 con 0x7feee4102ae0 2024-09-21T00:55:38.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.909+0000 7feeea3e8640 1 -- 172.21.15.1:0/326010454 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feee4063b50 con 0x7feee4102ae0 2024-09-21T00:55:38.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.911+0000 7feee17fa640 1 -- 172.21.15.1:0/326010454 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7feed4010430 con 0x7feee4102ae0 2024-09-21T00:55:38.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.912+0000 7feee17fa640 1 --2- 172.21.15.1:0/326010454 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7feecc0b65a0 0x7feecc0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:38.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.912+0000 7feee37fe640 1 --2- 172.21.15.1:0/326010454 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7feecc0b65a0 0x7feecc0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:38.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.912+0000 7feee17fa640 1 -- 172.21.15.1:0/326010454 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7feed40e7c70 con 0x7feee4102ae0 2024-09-21T00:55:38.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.912+0000 7feee17fa640 1 --2- 172.21.15.1:0/326010454 >> [v2:172.21.15.42:6808/2066388104,v1:172.21.15.42:6809/2066388104] conn(0x7feecc0c0190 0x7feecc0c2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:38.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.912+0000 7feee17fa640 1 -- 172.21.15.1:0/326010454 --> [v2:172.21.15.42:6808/2066388104,v1:172.21.15.42:6809/2066388104] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feed4027ea0 con 0x7feecc0c0190 2024-09-21T00:55:38.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.912+0000 7feee17fa640 1 -- 172.21.15.1:0/326010454 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7feed40e80c0 con 0x7feee4102ae0 2024-09-21T00:55:38.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.912+0000 7feee8985640 1 --2- 172.21.15.1:0/326010454 >> [v2:172.21.15.42:6808/2066388104,v1:172.21.15.42:6809/2066388104] conn(0x7feecc0c0190 0x7feecc0c2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:38.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.912+0000 7feee37fe640 1 --2- 172.21.15.1:0/326010454 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7feecc0b65a0 0x7feecc0b8ab0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7feee4105f70 tx=0x7feed800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:38.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.913+0000 7feee8985640 1 --2- 172.21.15.1:0/326010454 >> [v2:172.21.15.42:6808/2066388104,v1:172.21.15.42:6809/2066388104] conn(0x7feecc0c0190 0x7feecc0c2680 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:38.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.914+0000 7feee17fa640 1 -- 172.21.15.1:0/326010454 <== osd.4 v2:172.21.15.42:6808/2066388104 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feed4027ea0 con 0x7feecc0c0190 2024-09-21T00:55:38.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.929+0000 7feeea3e8640 1 -- 172.21.15.1:0/326010454 --> [v2:172.21.15.42:6808/2066388104,v1:172.21.15.42:6809/2066388104] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7feee4064000 con 0x7feecc0c0190 2024-09-21T00:55:38.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.929+0000 7feee17fa640 1 -- 172.21.15.1:0/326010454 <== osd.4 v2:172.21.15.42:6808/2066388104 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7feee4064000 con 0x7feecc0c0190 2024-09-21T00:55:38.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.929+0000 7feeea3e8640 1 -- 172.21.15.1:0/326010454 >> [v2:172.21.15.42:6808/2066388104,v1:172.21.15.42:6809/2066388104] conn(0x7feecc0c0190 msgr2=0x7feecc0c2680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:38.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.929+0000 7feeea3e8640 1 --2- 172.21.15.1:0/326010454 >> [v2:172.21.15.42:6808/2066388104,v1:172.21.15.42:6809/2066388104] conn(0x7feecc0c0190 0x7feecc0c2680 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:38.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.929+0000 7feeea3e8640 1 -- 172.21.15.1:0/326010454 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7feecc0b65a0 msgr2=0x7feecc0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:38.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.929+0000 7feeea3e8640 1 --2- 172.21.15.1:0/326010454 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7feecc0b65a0 0x7feecc0b8ab0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7feee4105f70 tx=0x7feed800b410 comp rx=0 tx=0).stop 2024-09-21T00:55:38.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.929+0000 7feeea3e8640 1 -- 172.21.15.1:0/326010454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feee4102ae0 msgr2=0x7feee419a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:38.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.929+0000 7feeea3e8640 1 --2- 172.21.15.1:0/326010454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feee4102ae0 0x7feee419a3e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7feed400e9f0 tx=0x7feed400eeb0 comp rx=0 tx=0).stop 2024-09-21T00:55:38.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.930+0000 7feee8985640 1 -- 172.21.15.1:0/326010454 reap_dead start 2024-09-21T00:55:38.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.930+0000 7feeea3e8640 1 -- 172.21.15.1:0/326010454 shutdown_connections 2024-09-21T00:55:38.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.930+0000 7feeea3e8640 1 -- 172.21.15.1:0/326010454 >> 172.21.15.1:0/326010454 conn(0x7feee4079760 msgr2=0x7feee41043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:38.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.930+0000 7feeea3e8640 1 -- 172.21.15.1:0/326010454 shutdown_connections 2024-09-21T00:55:38.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:38.930+0000 7feeea3e8640 1 -- 172.21.15.1:0/326010454 wait complete. 2024-09-21T00:55:39.886 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:39 smithi001 ceph-mon[31211]: pgmap v311: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 489 B/s wr, 8 op/s; 5.5 KiB/s, 1 objects/s recovering 2024-09-21T00:55:39.921 INFO:teuthology.orchestra.run.smithi001.stdout:128849018938 2024-09-21T00:55:39.922 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-21T00:55:39.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:39 smithi193 ceph-mon[34660]: pgmap v311: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 489 B/s wr, 8 op/s; 5.5 KiB/s, 1 objects/s recovering 2024-09-21T00:55:39.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:39 smithi042 ceph-mon[34481]: pgmap v311: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 489 B/s wr, 8 op/s; 5.5 KiB/s, 1 objects/s recovering 2024-09-21T00:55:40.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.416+0000 7f2558d18640 1 -- 172.21.15.1:0/2214591858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25541083c0 msgr2=0x7f25541087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:40.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.416+0000 7f2558d18640 1 --2- 172.21.15.1:0/2214591858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25541083c0 0x7f25541087d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2548009ca0 tx=0x7f254802a8c0 comp rx=0 tx=0).stop 2024-09-21T00:55:40.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.416+0000 7f2558d18640 1 -- 172.21.15.1:0/2214591858 shutdown_connections 2024-09-21T00:55:40.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.416+0000 7f2558d18640 1 --2- 172.21.15.1:0/2214591858 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2554108d10 0x7f255410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:40.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.416+0000 7f2558d18640 1 --2- 172.21.15.1:0/2214591858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25541083c0 0x7f25541087d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:40.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.416+0000 7f2558d18640 1 --2- 172.21.15.1:0/2214591858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2554102a80 0x7f2554102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:40.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.416+0000 7f2558d18640 1 -- 172.21.15.1:0/2214591858 >> 172.21.15.1:0/2214591858 conn(0x7f2554079740 msgr2=0x7f2554079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:40.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.416+0000 7f2558d18640 1 -- 172.21.15.1:0/2214591858 shutdown_connections 2024-09-21T00:55:40.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.416+0000 7f2558d18640 1 -- 172.21.15.1:0/2214591858 wait complete. 2024-09-21T00:55:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.417+0000 7f2558d18640 1 Processor -- start 2024-09-21T00:55:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.417+0000 7f2558d18640 1 -- start start 2024-09-21T00:55:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.418+0000 7f2558d18640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2554102a80 0x7f255419a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.418+0000 7f2558d18640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25541083c0 0x7f255419aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.418+0000 7f2558d18640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2554108d10 0x7f255419fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.418+0000 7f2558d18640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2554112980 con 0x7f2554108d10 2024-09-21T00:55:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.418+0000 7f2558d18640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2554112800 con 0x7f25541083c0 2024-09-21T00:55:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.418+0000 7f2558d18640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2554112b00 con 0x7f2554102a80 2024-09-21T00:55:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.418+0000 7f2552d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2554108d10 0x7f255419fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.418+0000 7f2552d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2554108d10 0x7f255419fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37598/0 (socket says 172.21.15.1:37598) 2024-09-21T00:55:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.418+0000 7f2552d9d640 1 -- 172.21.15.1:0/2277422391 learned_addr learned my addr 172.21.15.1:0/2277422391 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.418+0000 7f255259c640 1 --2- 172.21.15.1:0/2277422391 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2554102a80 0x7f255419a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.418+0000 7f2551d9b640 1 --2- 172.21.15.1:0/2277422391 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25541083c0 0x7f255419aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.418+0000 7f2552d9d640 1 -- 172.21.15.1:0/2277422391 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2554102a80 msgr2=0x7f255419a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.418+0000 7f2552d9d640 1 --2- 172.21.15.1:0/2277422391 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2554102a80 0x7f255419a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.418+0000 7f2552d9d640 1 -- 172.21.15.1:0/2277422391 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25541083c0 msgr2=0x7f255419aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.418+0000 7f2552d9d640 1 --2- 172.21.15.1:0/2277422391 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25541083c0 0x7f255419aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.418+0000 7f2552d9d640 1 -- 172.21.15.1:0/2277422391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25541a04b0 con 0x7f2554108d10 2024-09-21T00:55:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.418+0000 7f2551d9b640 1 --2- 172.21.15.1:0/2277422391 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25541083c0 0x7f255419aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:55:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.419+0000 7f2552d9d640 1 --2- 172.21.15.1:0/2277422391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2554108d10 0x7f255419fd80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f254c00c970 tx=0x7f254c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.419+0000 7f25437fe640 1 -- 172.21.15.1:0/2277422391 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254c007bb0 con 0x7f2554108d10 2024-09-21T00:55:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.419+0000 7f25437fe640 1 -- 172.21.15.1:0/2277422391 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f254c007d50 con 0x7f2554108d10 2024-09-21T00:55:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.419+0000 7f2558d18640 1 -- 172.21.15.1:0/2277422391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25541a07a0 con 0x7f2554108d10 2024-09-21T00:55:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.419+0000 7f25437fe640 1 -- 172.21.15.1:0/2277422391 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254c004e60 con 0x7f2554108d10 2024-09-21T00:55:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.419+0000 7f2558d18640 1 -- 172.21.15.1:0/2277422391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25541a6f00 con 0x7f2554108d10 2024-09-21T00:55:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.420+0000 7f2558d18640 1 -- 172.21.15.1:0/2277422391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2554063b50 con 0x7f2554108d10 2024-09-21T00:55:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.422+0000 7f25437fe640 1 -- 172.21.15.1:0/2277422391 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7f254c005020 con 0x7f2554108d10 2024-09-21T00:55:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.422+0000 7f25437fe640 1 --2- 172.21.15.1:0/2277422391 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f253c0b65a0 0x7f253c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.422+0000 7f255259c640 1 --2- 172.21.15.1:0/2277422391 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f253c0b65a0 0x7f253c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.422+0000 7f25437fe640 1 -- 172.21.15.1:0/2277422391 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f254c0e7660 con 0x7f2554108d10 2024-09-21T00:55:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.423+0000 7f25437fe640 1 --2- 172.21.15.1:0/2277422391 >> [v2:172.21.15.42:6800/436964633,v1:172.21.15.42:6801/436964633] conn(0x7f253c0c0190 0x7f253c0c2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:40.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.423+0000 7f25437fe640 1 -- 172.21.15.1:0/2277422391 --> [v2:172.21.15.42:6800/436964633,v1:172.21.15.42:6801/436964633] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f253c0c2d50 con 0x7f253c0c0190 2024-09-21T00:55:40.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.423+0000 7f25437fe640 1 -- 172.21.15.1:0/2277422391 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f254c0e7ab0 con 0x7f2554108d10 2024-09-21T00:55:40.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.423+0000 7f255259c640 1 --2- 172.21.15.1:0/2277422391 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f253c0b65a0 0x7f253c0b8ab0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f25440058c0 tx=0x7f254400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:40.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.423+0000 7f2551d9b640 1 --2- 172.21.15.1:0/2277422391 >> [v2:172.21.15.42:6800/436964633,v1:172.21.15.42:6801/436964633] conn(0x7f253c0c0190 0x7f253c0c2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:40.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.423+0000 7f2551d9b640 1 --2- 172.21.15.1:0/2277422391 >> [v2:172.21.15.42:6800/436964633,v1:172.21.15.42:6801/436964633] conn(0x7f253c0c0190 0x7f253c0c2680 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:40.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.424+0000 7f25437fe640 1 -- 172.21.15.1:0/2277422391 <== osd.1 v2:172.21.15.42:6800/436964633 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f253c0c2d50 con 0x7f253c0c0190 2024-09-21T00:55:40.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.439+0000 7f2558d18640 1 -- 172.21.15.1:0/2277422391 --> [v2:172.21.15.42:6800/436964633,v1:172.21.15.42:6801/436964633] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2554063f50 con 0x7f253c0c0190 2024-09-21T00:55:40.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.439+0000 7f25437fe640 1 -- 172.21.15.1:0/2277422391 <== osd.1 v2:172.21.15.42:6800/436964633 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2554063f50 con 0x7f253c0c0190 2024-09-21T00:55:40.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.440+0000 7f2558d18640 1 -- 172.21.15.1:0/2277422391 >> [v2:172.21.15.42:6800/436964633,v1:172.21.15.42:6801/436964633] conn(0x7f253c0c0190 msgr2=0x7f253c0c2680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:40.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.440+0000 7f2558d18640 1 --2- 172.21.15.1:0/2277422391 >> [v2:172.21.15.42:6800/436964633,v1:172.21.15.42:6801/436964633] conn(0x7f253c0c0190 0x7f253c0c2680 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:40.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.440+0000 7f2558d18640 1 -- 172.21.15.1:0/2277422391 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f253c0b65a0 msgr2=0x7f253c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:40.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.440+0000 7f2558d18640 1 --2- 172.21.15.1:0/2277422391 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f253c0b65a0 0x7f253c0b8ab0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f25440058c0 tx=0x7f254400a2d0 comp rx=0 tx=0).stop 2024-09-21T00:55:40.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.440+0000 7f2558d18640 1 -- 172.21.15.1:0/2277422391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2554108d10 msgr2=0x7f255419fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:40.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.440+0000 7f2558d18640 1 --2- 172.21.15.1:0/2277422391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2554108d10 0x7f255419fd80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f254c00c970 tx=0x7f254c00ce30 comp rx=0 tx=0).stop 2024-09-21T00:55:40.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.440+0000 7f2552d9d640 1 -- 172.21.15.1:0/2277422391 reap_dead start 2024-09-21T00:55:40.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.440+0000 7f2558d18640 1 -- 172.21.15.1:0/2277422391 shutdown_connections 2024-09-21T00:55:40.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.440+0000 7f2558d18640 1 -- 172.21.15.1:0/2277422391 >> 172.21.15.1:0/2277422391 conn(0x7f2554079740 msgr2=0x7f255406bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:40.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.440+0000 7f2558d18640 1 -- 172.21.15.1:0/2277422391 shutdown_connections 2024-09-21T00:55:40.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:40.440+0000 7f2558d18640 1 -- 172.21.15.1:0/2277422391 wait complete. 2024-09-21T00:55:41.104 INFO:teuthology.orchestra.run.smithi001.stdout:171798691886 2024-09-21T00:55:41.104 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.6 2024-09-21T00:55:41.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:41 smithi001 ceph-mon[31211]: pgmap v312: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 426 B/s wr, 9 op/s; 4.8 KiB/s, 1 objects/s recovering 2024-09-21T00:55:41.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:41 smithi193 ceph-mon[34660]: pgmap v312: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 426 B/s wr, 9 op/s; 4.8 KiB/s, 1 objects/s recovering 2024-09-21T00:55:41.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:41 smithi042 ceph-mon[34481]: pgmap v312: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 426 B/s wr, 9 op/s; 4.8 KiB/s, 1 objects/s recovering 2024-09-21T00:55:42.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.079+0000 7fe53f711640 1 -- 172.21.15.1:0/292668943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe538108cf0 msgr2=0x7fe53810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:42.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.079+0000 7fe53f711640 1 --2- 172.21.15.1:0/292668943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe538108cf0 0x7fe53810f520 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe530009900 tx=0x7fe53002a410 comp rx=0 tx=0).stop 2024-09-21T00:55:42.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.079+0000 7fe53f711640 1 -- 172.21.15.1:0/292668943 shutdown_connections 2024-09-21T00:55:42.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.079+0000 7fe53f711640 1 --2- 172.21.15.1:0/292668943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe538108cf0 0x7fe53810f520 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:42.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.079+0000 7fe53f711640 1 --2- 172.21.15.1:0/292668943 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe5381083a0 0x7fe5381087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:42.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.079+0000 7fe53f711640 1 --2- 172.21.15.1:0/292668943 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe538102a60 0x7fe538102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:42.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.079+0000 7fe53f711640 1 -- 172.21.15.1:0/292668943 >> 172.21.15.1:0/292668943 conn(0x7fe538079730 msgr2=0x7fe538079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:42.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.079+0000 7fe53f711640 1 -- 172.21.15.1:0/292668943 shutdown_connections 2024-09-21T00:55:42.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.079+0000 7fe53f711640 1 -- 172.21.15.1:0/292668943 wait complete. 2024-09-21T00:55:42.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.080+0000 7fe53f711640 1 Processor -- start 2024-09-21T00:55:42.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.080+0000 7fe53f711640 1 -- start start 2024-09-21T00:55:42.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.080+0000 7fe53f711640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe538102a60 0x7fe53819c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:42.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.080+0000 7fe53f711640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe5381083a0 0x7fe53819cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:42.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.080+0000 7fe53f711640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe538108cf0 0x7fe5381a1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:42.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.080+0000 7fe53f711640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe538112960 con 0x7fe538108cf0 2024-09-21T00:55:42.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.080+0000 7fe53f711640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe5381127e0 con 0x7fe538102a60 2024-09-21T00:55:42.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.080+0000 7fe53f711640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe538112ae0 con 0x7fe5381083a0 2024-09-21T00:55:42.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.080+0000 7fe53dcae640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe538108cf0 0x7fe5381a1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:42.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.080+0000 7fe53dcae640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe538108cf0 0x7fe5381a1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37616/0 (socket says 172.21.15.1:37616) 2024-09-21T00:55:42.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.080+0000 7fe53d4ad640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe538102a60 0x7fe53819c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:42.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.080+0000 7fe53dcae640 1 -- 172.21.15.1:0/2467728493 learned_addr learned my addr 172.21.15.1:0/2467728493 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:42.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.080+0000 7fe53ccac640 1 --2- 172.21.15.1:0/2467728493 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe5381083a0 0x7fe53819cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:42.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.080+0000 7fe53dcae640 1 -- 172.21.15.1:0/2467728493 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe5381083a0 msgr2=0x7fe53819cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:42.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.080+0000 7fe53dcae640 1 --2- 172.21.15.1:0/2467728493 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe5381083a0 0x7fe53819cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:42.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.080+0000 7fe53dcae640 1 -- 172.21.15.1:0/2467728493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe538102a60 msgr2=0x7fe53819c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:42.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.080+0000 7fe53dcae640 1 --2- 172.21.15.1:0/2467728493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe538102a60 0x7fe53819c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:42.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.080+0000 7fe53dcae640 1 -- 172.21.15.1:0/2467728493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5381a2560 con 0x7fe538108cf0 2024-09-21T00:55:42.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.080+0000 7fe53d4ad640 1 --2- 172.21.15.1:0/2467728493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe538102a60 0x7fe53819c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:55:42.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.081+0000 7fe53dcae640 1 --2- 172.21.15.1:0/2467728493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe538108cf0 0x7fe5381a1e30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe530004770 tx=0x7fe530004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:42.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.081+0000 7fe52a7fc640 1 -- 172.21.15.1:0/2467728493 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53003f030 con 0x7fe538108cf0 2024-09-21T00:55:42.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.081+0000 7fe53f711640 1 -- 172.21.15.1:0/2467728493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5381a27f0 con 0x7fe538108cf0 2024-09-21T00:55:42.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.081+0000 7fe52a7fc640 1 -- 172.21.15.1:0/2467728493 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe530003aa0 con 0x7fe538108cf0 2024-09-21T00:55:42.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.081+0000 7fe52a7fc640 1 -- 172.21.15.1:0/2467728493 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe530035070 con 0x7fe538108cf0 2024-09-21T00:55:42.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.081+0000 7fe53f711640 1 -- 172.21.15.1:0/2467728493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5381a8fb0 con 0x7fe538108cf0 2024-09-21T00:55:42.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.082+0000 7fe53f711640 1 -- 172.21.15.1:0/2467728493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe538105c80 con 0x7fe538108cf0 2024-09-21T00:55:42.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.084+0000 7fe52a7fc640 1 -- 172.21.15.1:0/2467728493 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7fe530042030 con 0x7fe538108cf0 2024-09-21T00:55:42.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.084+0000 7fe52a7fc640 1 --2- 172.21.15.1:0/2467728493 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe5240b65a0 0x7fe5240b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:42.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.085+0000 7fe53d4ad640 1 --2- 172.21.15.1:0/2467728493 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe5240b65a0 0x7fe5240b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:42.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.085+0000 7fe52a7fc640 1 -- 172.21.15.1:0/2467728493 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fe5301082b0 con 0x7fe538108cf0 2024-09-21T00:55:42.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.085+0000 7fe52a7fc640 1 --2- 172.21.15.1:0/2467728493 >> [v2:172.21.15.42:6824/3182218295,v1:172.21.15.42:6825/3182218295] conn(0x7fe5240c0190 0x7fe5240c2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:42.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.085+0000 7fe52a7fc640 1 -- 172.21.15.1:0/2467728493 --> [v2:172.21.15.42:6824/3182218295,v1:172.21.15.42:6825/3182218295] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe5240c2d50 con 0x7fe5240c0190 2024-09-21T00:55:42.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.085+0000 7fe52a7fc640 1 -- 172.21.15.1:0/2467728493 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fe530108700 con 0x7fe538108cf0 2024-09-21T00:55:42.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.085+0000 7fe53d4ad640 1 --2- 172.21.15.1:0/2467728493 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe5240b65a0 0x7fe5240b8ab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe534005c40 tx=0x7fe53400a590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:42.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.085+0000 7fe53ccac640 1 --2- 172.21.15.1:0/2467728493 >> [v2:172.21.15.42:6824/3182218295,v1:172.21.15.42:6825/3182218295] conn(0x7fe5240c0190 0x7fe5240c2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:42.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.086+0000 7fe53ccac640 1 --2- 172.21.15.1:0/2467728493 >> [v2:172.21.15.42:6824/3182218295,v1:172.21.15.42:6825/3182218295] conn(0x7fe5240c0190 0x7fe5240c2680 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:42.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.087+0000 7fe52a7fc640 1 -- 172.21.15.1:0/2467728493 <== osd.10 v2:172.21.15.42:6824/3182218295 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe5240c2d50 con 0x7fe5240c0190 2024-09-21T00:55:42.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.102+0000 7fe53f711640 1 -- 172.21.15.1:0/2467728493 --> [v2:172.21.15.42:6824/3182218295,v1:172.21.15.42:6825/3182218295] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe538103ce0 con 0x7fe5240c0190 2024-09-21T00:55:42.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.102+0000 7fe52a7fc640 1 -- 172.21.15.1:0/2467728493 <== osd.10 v2:172.21.15.42:6824/3182218295 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe538103ce0 con 0x7fe5240c0190 2024-09-21T00:55:42.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.103+0000 7fe53f711640 1 -- 172.21.15.1:0/2467728493 >> [v2:172.21.15.42:6824/3182218295,v1:172.21.15.42:6825/3182218295] conn(0x7fe5240c0190 msgr2=0x7fe5240c2680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:42.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.103+0000 7fe53f711640 1 --2- 172.21.15.1:0/2467728493 >> [v2:172.21.15.42:6824/3182218295,v1:172.21.15.42:6825/3182218295] conn(0x7fe5240c0190 0x7fe5240c2680 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:42.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.103+0000 7fe53f711640 1 -- 172.21.15.1:0/2467728493 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe5240b65a0 msgr2=0x7fe5240b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:42.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.103+0000 7fe53f711640 1 --2- 172.21.15.1:0/2467728493 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe5240b65a0 0x7fe5240b8ab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe534005c40 tx=0x7fe53400a590 comp rx=0 tx=0).stop 2024-09-21T00:55:42.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.103+0000 7fe53f711640 1 -- 172.21.15.1:0/2467728493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe538108cf0 msgr2=0x7fe5381a1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:42.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.103+0000 7fe53f711640 1 --2- 172.21.15.1:0/2467728493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe538108cf0 0x7fe5381a1e30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe530004770 tx=0x7fe530004270 comp rx=0 tx=0).stop 2024-09-21T00:55:42.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.103+0000 7fe53dcae640 1 -- 172.21.15.1:0/2467728493 reap_dead start 2024-09-21T00:55:42.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.103+0000 7fe53f711640 1 -- 172.21.15.1:0/2467728493 shutdown_connections 2024-09-21T00:55:42.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.103+0000 7fe53f711640 1 -- 172.21.15.1:0/2467728493 >> 172.21.15.1:0/2467728493 conn(0x7fe538079730 msgr2=0x7fe538104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:42.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.103+0000 7fe53f711640 1 -- 172.21.15.1:0/2467728493 shutdown_connections 2024-09-21T00:55:42.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.103+0000 7fe53f711640 1 -- 172.21.15.1:0/2467728493 wait complete. 2024-09-21T00:55:42.493 INFO:teuthology.orchestra.run.smithi001.stdout:34359738446 2024-09-21T00:55:42.494 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-21T00:55:42.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.683+0000 7fc04ee4e640 1 -- 172.21.15.1:0/3851071955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc048102ae0 msgr2=0x7fc048102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:42.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.683+0000 7fc04ee4e640 1 --2- 172.21.15.1:0/3851071955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc048102ae0 0x7fc048102ef0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc03c009900 tx=0x7fc03c02a410 comp rx=0 tx=0).stop 2024-09-21T00:55:42.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.684+0000 7fc04ee4e640 1 -- 172.21.15.1:0/3851071955 shutdown_connections 2024-09-21T00:55:42.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.684+0000 7fc04ee4e640 1 --2- 172.21.15.1:0/3851071955 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc048108d20 0x7fc04810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:42.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.684+0000 7fc04ee4e640 1 --2- 172.21.15.1:0/3851071955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0481083d0 0x7fc0481087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:42.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.684+0000 7fc04ee4e640 1 --2- 172.21.15.1:0/3851071955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc048102ae0 0x7fc048102ef0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:42.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.684+0000 7fc04ee4e640 1 -- 172.21.15.1:0/3851071955 >> 172.21.15.1:0/3851071955 conn(0x7fc0480797b0 msgr2=0x7fc048079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:42.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.684+0000 7fc04ee4e640 1 -- 172.21.15.1:0/3851071955 shutdown_connections 2024-09-21T00:55:42.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.684+0000 7fc04ee4e640 1 -- 172.21.15.1:0/3851071955 wait complete. 2024-09-21T00:55:42.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.684+0000 7fc04ee4e640 1 Processor -- start 2024-09-21T00:55:42.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.684+0000 7fc04ee4e640 1 -- start start 2024-09-21T00:55:42.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.685+0000 7fc04ee4e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc048102ae0 0x7fc04819a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:42.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.685+0000 7fc04ee4e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0481083d0 0x7fc04819ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:42.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.685+0000 7fc04ee4e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc048108d20 0x7fc04819ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:42.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.685+0000 7fc04ee4e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc0481129e0 con 0x7fc048102ae0 2024-09-21T00:55:42.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.685+0000 7fc04ee4e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc048112860 con 0x7fc0481083d0 2024-09-21T00:55:42.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.685+0000 7fc04ee4e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc048112b60 con 0x7fc048108d20 2024-09-21T00:55:42.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.685+0000 7fc04cbea640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc048102ae0 0x7fc04819a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:42.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.685+0000 7fc04cbea640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc048102ae0 0x7fc04819a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37620/0 (socket says 172.21.15.1:37620) 2024-09-21T00:55:42.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.685+0000 7fc04cbea640 1 -- 172.21.15.1:0/42845883 learned_addr learned my addr 172.21.15.1:0/42845883 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:42.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.685+0000 7fc047fff640 1 --2- 172.21.15.1:0/42845883 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0481083d0 0x7fc04819ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:42.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.685+0000 7fc04d3eb640 1 --2- 172.21.15.1:0/42845883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc048108d20 0x7fc04819ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:42.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.685+0000 7fc04cbea640 1 -- 172.21.15.1:0/42845883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc048108d20 msgr2=0x7fc04819ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:42.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.685+0000 7fc04cbea640 1 --2- 172.21.15.1:0/42845883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc048108d20 0x7fc04819ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:42.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.685+0000 7fc04cbea640 1 -- 172.21.15.1:0/42845883 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0481083d0 msgr2=0x7fc04819ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:42.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.685+0000 7fc04cbea640 1 --2- 172.21.15.1:0/42845883 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0481083d0 0x7fc04819ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:42.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.685+0000 7fc04cbea640 1 -- 172.21.15.1:0/42845883 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0481a0630 con 0x7fc048102ae0 2024-09-21T00:55:42.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.686+0000 7fc04cbea640 1 --2- 172.21.15.1:0/42845883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc048102ae0 0x7fc04819a6c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc03c005940 tx=0x7fc03c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:42.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.686+0000 7fc045ffb640 1 -- 172.21.15.1:0/42845883 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc03c03f030 con 0x7fc048102ae0 2024-09-21T00:55:42.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.686+0000 7fc045ffb640 1 -- 172.21.15.1:0/42845883 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc03c0044c0 con 0x7fc048102ae0 2024-09-21T00:55:42.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.686+0000 7fc045ffb640 1 -- 172.21.15.1:0/42845883 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc03c035070 con 0x7fc048102ae0 2024-09-21T00:55:42.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.686+0000 7fc04ee4e640 1 -- 172.21.15.1:0/42845883 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0481a08c0 con 0x7fc048102ae0 2024-09-21T00:55:42.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.686+0000 7fc04ee4e640 1 -- 172.21.15.1:0/42845883 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0481a7080 con 0x7fc048102ae0 2024-09-21T00:55:42.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.687+0000 7fc04ee4e640 1 -- 172.21.15.1:0/42845883 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc0481064b0 con 0x7fc048102ae0 2024-09-21T00:55:42.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.689+0000 7fc045ffb640 1 -- 172.21.15.1:0/42845883 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7fc03c042030 con 0x7fc048102ae0 2024-09-21T00:55:42.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.690+0000 7fc045ffb640 1 --2- 172.21.15.1:0/42845883 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc0380b6620 0x7fc0380b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:42.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.690+0000 7fc047fff640 1 --2- 172.21.15.1:0/42845883 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc0380b6620 0x7fc0380b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:42.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.690+0000 7fc045ffb640 1 -- 172.21.15.1:0/42845883 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fc03c107820 con 0x7fc048102ae0 2024-09-21T00:55:42.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.690+0000 7fc045ffb640 1 --2- 172.21.15.1:0/42845883 >> [v2:172.21.15.1:6810/3221661671,v1:172.21.15.1:6811/3221661671] conn(0x7fc0380c0210 0x7fc0380c2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:42.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.690+0000 7fc045ffb640 1 -- 172.21.15.1:0/42845883 --> [v2:172.21.15.1:6810/3221661671,v1:172.21.15.1:6811/3221661671] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc03c003b20 con 0x7fc0380c0210 2024-09-21T00:55:42.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.690+0000 7fc045ffb640 1 -- 172.21.15.1:0/42845883 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fc03c10e050 con 0x7fc048102ae0 2024-09-21T00:55:42.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.691+0000 7fc04d3eb640 1 --2- 172.21.15.1:0/42845883 >> [v2:172.21.15.1:6810/3221661671,v1:172.21.15.1:6811/3221661671] conn(0x7fc0380c0210 0x7fc0380c2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:42.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.691+0000 7fc047fff640 1 --2- 172.21.15.1:0/42845883 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc0380b6620 0x7fc0380b8b30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc048079cd0 tx=0x7fc034005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:42.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.691+0000 7fc04d3eb640 1 --2- 172.21.15.1:0/42845883 >> [v2:172.21.15.1:6810/3221661671,v1:172.21.15.1:6811/3221661671] conn(0x7fc0380c0210 0x7fc0380c2700 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:42.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.692+0000 7fc045ffb640 1 -- 172.21.15.1:0/42845883 <== osd.3 v2:172.21.15.1:6810/3221661671 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc03c003b20 con 0x7fc0380c0210 2024-09-21T00:55:42.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.706+0000 7fc04ee4e640 1 -- 172.21.15.1:0/42845883 --> [v2:172.21.15.1:6810/3221661671,v1:172.21.15.1:6811/3221661671] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc048103d10 con 0x7fc0380c0210 2024-09-21T00:55:42.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.707+0000 7fc045ffb640 1 -- 172.21.15.1:0/42845883 <== osd.3 v2:172.21.15.1:6810/3221661671 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc048103d10 con 0x7fc0380c0210 2024-09-21T00:55:42.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.707+0000 7fc04ee4e640 1 -- 172.21.15.1:0/42845883 >> [v2:172.21.15.1:6810/3221661671,v1:172.21.15.1:6811/3221661671] conn(0x7fc0380c0210 msgr2=0x7fc0380c2700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:42.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.707+0000 7fc04ee4e640 1 --2- 172.21.15.1:0/42845883 >> [v2:172.21.15.1:6810/3221661671,v1:172.21.15.1:6811/3221661671] conn(0x7fc0380c0210 0x7fc0380c2700 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:42.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.707+0000 7fc04ee4e640 1 -- 172.21.15.1:0/42845883 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc0380b6620 msgr2=0x7fc0380b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:42.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.707+0000 7fc04ee4e640 1 --2- 172.21.15.1:0/42845883 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc0380b6620 0x7fc0380b8b30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc048079cd0 tx=0x7fc034005f90 comp rx=0 tx=0).stop 2024-09-21T00:55:42.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.707+0000 7fc04ee4e640 1 -- 172.21.15.1:0/42845883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc048102ae0 msgr2=0x7fc04819a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:42.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.707+0000 7fc04ee4e640 1 --2- 172.21.15.1:0/42845883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc048102ae0 0x7fc04819a6c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc03c005940 tx=0x7fc03c0040c0 comp rx=0 tx=0).stop 2024-09-21T00:55:42.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.708+0000 7fc04d3eb640 1 -- 172.21.15.1:0/42845883 reap_dead start 2024-09-21T00:55:42.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.708+0000 7fc04ee4e640 1 -- 172.21.15.1:0/42845883 shutdown_connections 2024-09-21T00:55:42.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.708+0000 7fc04ee4e640 1 -- 172.21.15.1:0/42845883 >> 172.21.15.1:0/42845883 conn(0x7fc0480797b0 msgr2=0x7fc048101a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:42.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.708+0000 7fc04ee4e640 1 -- 172.21.15.1:0/42845883 shutdown_connections 2024-09-21T00:55:42.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.708+0000 7fc04ee4e640 1 -- 172.21.15.1:0/42845883 wait complete. 2024-09-21T00:55:43.518 INFO:teuthology.orchestra.run.smithi001.stdout:266287972379 2024-09-21T00:55:43.518 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.10 2024-09-21T00:55:43.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.699+0000 7f932eec7640 1 -- 172.21.15.1:0/1527981221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9328102a60 msgr2=0x7f9328102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:43.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.699+0000 7f932eec7640 1 --2- 172.21.15.1:0/1527981221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9328102a60 0x7f9328102e70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f931c009900 tx=0x7f931c02a410 comp rx=0 tx=0).stop 2024-09-21T00:55:43.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.699+0000 7f932eec7640 1 -- 172.21.15.1:0/1527981221 shutdown_connections 2024-09-21T00:55:43.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.699+0000 7f932eec7640 1 --2- 172.21.15.1:0/1527981221 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9328108cf0 0x7f932810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:43.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.699+0000 7f932eec7640 1 --2- 172.21.15.1:0/1527981221 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93281083a0 0x7f93281087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:43.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.699+0000 7f932eec7640 1 --2- 172.21.15.1:0/1527981221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9328102a60 0x7f9328102e70 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:43.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.699+0000 7f932eec7640 1 -- 172.21.15.1:0/1527981221 >> 172.21.15.1:0/1527981221 conn(0x7f9328079730 msgr2=0x7f9328079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:43.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.699+0000 7f932eec7640 1 -- 172.21.15.1:0/1527981221 shutdown_connections 2024-09-21T00:55:43.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.699+0000 7f932eec7640 1 -- 172.21.15.1:0/1527981221 wait complete. 2024-09-21T00:55:43.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.700+0000 7f932eec7640 1 Processor -- start 2024-09-21T00:55:43.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.700+0000 7f932eec7640 1 -- start start 2024-09-21T00:55:43.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.700+0000 7f932eec7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9328102a60 0x7f932819a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:43.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.700+0000 7f932eec7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93281083a0 0x7f932819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:43.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.701+0000 7f932eec7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9328108cf0 0x7f932819fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:43.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.701+0000 7f932eec7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9328112960 con 0x7f93281083a0 2024-09-21T00:55:43.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.701+0000 7f932eec7640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f93281127e0 con 0x7f9328108cf0 2024-09-21T00:55:43.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.701+0000 7f932eec7640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9328112ae0 con 0x7f9328102a60 2024-09-21T00:55:43.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.701+0000 7f9327fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93281083a0 0x7f932819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:43.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.701+0000 7f9327fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93281083a0 0x7f932819aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37656/0 (socket says 172.21.15.1:37656) 2024-09-21T00:55:43.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.701+0000 7f9327fff640 1 -- 172.21.15.1:0/1574620446 learned_addr learned my addr 172.21.15.1:0/1574620446 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:43.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.701+0000 7f932cc63640 1 --2- 172.21.15.1:0/1574620446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9328102a60 0x7f932819a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:43.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.701+0000 7f932d464640 1 --2- 172.21.15.1:0/1574620446 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9328108cf0 0x7f932819fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:43.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.701+0000 7f9327fff640 1 -- 172.21.15.1:0/1574620446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9328102a60 msgr2=0x7f932819a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:43.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.701+0000 7f9327fff640 1 --2- 172.21.15.1:0/1574620446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9328102a60 0x7f932819a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:43.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.701+0000 7f9327fff640 1 -- 172.21.15.1:0/1574620446 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9328108cf0 msgr2=0x7f932819fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:43.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.701+0000 7f9327fff640 1 --2- 172.21.15.1:0/1574620446 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9328108cf0 0x7f932819fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:43.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.701+0000 7f9327fff640 1 -- 172.21.15.1:0/1574620446 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93281a03d0 con 0x7f93281083a0 2024-09-21T00:55:43.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.701+0000 7f9327fff640 1 --2- 172.21.15.1:0/1574620446 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93281083a0 0x7f932819aa00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f931400e9c0 tx=0x7f931400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:43.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.701+0000 7f9325ffb640 1 -- 172.21.15.1:0/1574620446 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931400cd80 con 0x7f93281083a0 2024-09-21T00:55:43.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.702+0000 7f932eec7640 1 -- 172.21.15.1:0/1574620446 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93281a06c0 con 0x7f93281083a0 2024-09-21T00:55:43.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.702+0000 7f9325ffb640 1 -- 172.21.15.1:0/1574620446 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93140054d0 con 0x7f93281083a0 2024-09-21T00:55:43.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.702+0000 7f9325ffb640 1 -- 172.21.15.1:0/1574620446 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9314010430 con 0x7f93281083a0 2024-09-21T00:55:43.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.702+0000 7f932eec7640 1 -- 172.21.15.1:0/1574620446 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93281a6e20 con 0x7f93281083a0 2024-09-21T00:55:43.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.703+0000 7f932eec7640 1 -- 172.21.15.1:0/1574620446 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f932806b1e0 con 0x7f93281083a0 2024-09-21T00:55:43.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.704+0000 7f9325ffb640 1 -- 172.21.15.1:0/1574620446 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7f9314004f90 con 0x7f93281083a0 2024-09-21T00:55:43.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.705+0000 7f9325ffb640 1 --2- 172.21.15.1:0/1574620446 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f93180b65a0 0x7f93180b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:43.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.705+0000 7f932cc63640 1 --2- 172.21.15.1:0/1574620446 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f93180b65a0 0x7f93180b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:43.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.705+0000 7f9325ffb640 1 -- 172.21.15.1:0/1574620446 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f93140e7ce0 con 0x7f93281083a0 2024-09-21T00:55:43.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.706+0000 7f9325ffb640 1 --2- 172.21.15.1:0/1574620446 >> [v2:172.21.15.1:6826/1369323215,v1:172.21.15.1:6827/1369323215] conn(0x7f93180c0190 0x7f93180c2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:43.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.706+0000 7f9325ffb640 1 -- 172.21.15.1:0/1574620446 --> [v2:172.21.15.1:6826/1369323215,v1:172.21.15.1:6827/1369323215] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9314015e80 con 0x7f93180c0190 2024-09-21T00:55:43.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.706+0000 7f9325ffb640 1 -- 172.21.15.1:0/1574620446 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f93140e8130 con 0x7f93281083a0 2024-09-21T00:55:43.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.706+0000 7f932d464640 1 --2- 172.21.15.1:0/1574620446 >> [v2:172.21.15.1:6826/1369323215,v1:172.21.15.1:6827/1369323215] conn(0x7f93180c0190 0x7f93180c2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:43.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.706+0000 7f932cc63640 1 --2- 172.21.15.1:0/1574620446 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f93180b65a0 0x7f93180b8ab0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f931c031440 tx=0x7f931c009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:43.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.706+0000 7f932d464640 1 --2- 172.21.15.1:0/1574620446 >> [v2:172.21.15.1:6826/1369323215,v1:172.21.15.1:6827/1369323215] conn(0x7f93180c0190 0x7f93180c2680 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:43.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.708+0000 7f9325ffb640 1 -- 172.21.15.1:0/1574620446 <== osd.9 v2:172.21.15.1:6826/1369323215 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9314015e80 con 0x7f93180c0190 2024-09-21T00:55:43.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.728+0000 7f932eec7640 1 -- 172.21.15.1:0/1574620446 --> [v2:172.21.15.1:6826/1369323215,v1:172.21.15.1:6827/1369323215] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9328103ce0 con 0x7f93180c0190 2024-09-21T00:55:43.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.728+0000 7f9325ffb640 1 -- 172.21.15.1:0/1574620446 <== osd.9 v2:172.21.15.1:6826/1369323215 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9328103ce0 con 0x7f93180c0190 2024-09-21T00:55:43.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.728+0000 7f932eec7640 1 -- 172.21.15.1:0/1574620446 >> [v2:172.21.15.1:6826/1369323215,v1:172.21.15.1:6827/1369323215] conn(0x7f93180c0190 msgr2=0x7f93180c2680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:43.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.728+0000 7f932eec7640 1 --2- 172.21.15.1:0/1574620446 >> [v2:172.21.15.1:6826/1369323215,v1:172.21.15.1:6827/1369323215] conn(0x7f93180c0190 0x7f93180c2680 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:43.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.729+0000 7f932eec7640 1 -- 172.21.15.1:0/1574620446 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f93180b65a0 msgr2=0x7f93180b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:43.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.729+0000 7f932eec7640 1 --2- 172.21.15.1:0/1574620446 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f93180b65a0 0x7f93180b8ab0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f931c031440 tx=0x7f931c009560 comp rx=0 tx=0).stop 2024-09-21T00:55:43.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.729+0000 7f932eec7640 1 -- 172.21.15.1:0/1574620446 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93281083a0 msgr2=0x7f932819aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:43.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.729+0000 7f932eec7640 1 --2- 172.21.15.1:0/1574620446 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93281083a0 0x7f932819aa00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f931400e9c0 tx=0x7f931400ee80 comp rx=0 tx=0).stop 2024-09-21T00:55:43.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.729+0000 7f932d464640 1 -- 172.21.15.1:0/1574620446 reap_dead start 2024-09-21T00:55:43.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.729+0000 7f932eec7640 1 -- 172.21.15.1:0/1574620446 shutdown_connections 2024-09-21T00:55:43.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.729+0000 7f932eec7640 1 -- 172.21.15.1:0/1574620446 >> 172.21.15.1:0/1574620446 conn(0x7f9328079730 msgr2=0x7f9328101b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:43.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.729+0000 7f932eec7640 1 -- 172.21.15.1:0/1574620446 shutdown_connections 2024-09-21T00:55:43.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.729+0000 7f932eec7640 1 -- 172.21.15.1:0/1574620446 wait complete. 2024-09-21T00:55:43.738 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:43 smithi001 ceph-mon[31211]: pgmap v313: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T00:55:43.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:43 smithi193 ceph-mon[34660]: pgmap v313: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T00:55:43.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:43 smithi042 ceph-mon[34481]: pgmap v313: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T00:55:44.939 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:44.971 INFO:teuthology.orchestra.run.smithi001.stdout:55834574922 2024-09-21T00:55:44.972 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-21T00:55:45.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.131+0000 7f8532625640 1 -- 172.21.15.1:0/1298276786 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f852c1083d0 msgr2=0x7f852c1087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:45.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.131+0000 7f8532625640 1 --2- 172.21.15.1:0/1298276786 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f852c1083d0 0x7f852c1087e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8514009900 tx=0x7f851402a410 comp rx=0 tx=0).stop 2024-09-21T00:55:45.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.131+0000 7f8532625640 1 -- 172.21.15.1:0/1298276786 shutdown_connections 2024-09-21T00:55:45.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.131+0000 7f8532625640 1 --2- 172.21.15.1:0/1298276786 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f852c108d20 0x7f852c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:45.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.131+0000 7f8532625640 1 --2- 172.21.15.1:0/1298276786 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f852c1083d0 0x7f852c1087e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:45.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.131+0000 7f8532625640 1 --2- 172.21.15.1:0/1298276786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f852c102ae0 0x7f852c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:45.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.131+0000 7f8532625640 1 -- 172.21.15.1:0/1298276786 >> 172.21.15.1:0/1298276786 conn(0x7f852c079790 msgr2=0x7f852c079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:45.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.131+0000 7f8532625640 1 -- 172.21.15.1:0/1298276786 shutdown_connections 2024-09-21T00:55:45.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.131+0000 7f8532625640 1 -- 172.21.15.1:0/1298276786 wait complete. 2024-09-21T00:55:45.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.132+0000 7f8532625640 1 Processor -- start 2024-09-21T00:55:45.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.132+0000 7f8532625640 1 -- start start 2024-09-21T00:55:45.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.132+0000 7f8532625640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f852c102ae0 0x7f852c19c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:45.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.132+0000 7f8532625640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f852c1083d0 0x7f852c19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:45.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.132+0000 7f8532625640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f852c108d20 0x7f852c1a1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:45.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.132+0000 7f8532625640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f852c113b30 con 0x7f852c108d20 2024-09-21T00:55:45.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.132+0000 7f8532625640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f852c1139b0 con 0x7f852c102ae0 2024-09-21T00:55:45.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.132+0000 7f8532625640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f852c113cb0 con 0x7f852c1083d0 2024-09-21T00:55:45.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.132+0000 7f8530bc2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f852c108d20 0x7f852c1a1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:45.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.133+0000 7f8530bc2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f852c108d20 0x7f852c1a1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37708/0 (socket says 172.21.15.1:37708) 2024-09-21T00:55:45.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.133+0000 7f8530bc2640 1 -- 172.21.15.1:0/4116825447 learned_addr learned my addr 172.21.15.1:0/4116825447 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:45.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.133+0000 7f852bfff640 1 --2- 172.21.15.1:0/4116825447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f852c102ae0 0x7f852c19c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:45.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.133+0000 7f852b7fe640 1 --2- 172.21.15.1:0/4116825447 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f852c1083d0 0x7f852c19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:45.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.133+0000 7f8530bc2640 1 -- 172.21.15.1:0/4116825447 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f852c1083d0 msgr2=0x7f852c19cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:45.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.133+0000 7f8530bc2640 1 --2- 172.21.15.1:0/4116825447 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f852c1083d0 0x7f852c19cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:45.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.133+0000 7f8530bc2640 1 -- 172.21.15.1:0/4116825447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f852c102ae0 msgr2=0x7f852c19c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:45.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.133+0000 7f8530bc2640 1 --2- 172.21.15.1:0/4116825447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f852c102ae0 0x7f852c19c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:45.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.133+0000 7f8530bc2640 1 -- 172.21.15.1:0/4116825447 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f852c1a2670 con 0x7f852c108d20 2024-09-21T00:55:45.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.133+0000 7f852bfff640 1 --2- 172.21.15.1:0/4116825447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f852c102ae0 0x7f852c19c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:55:45.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.133+0000 7f8530bc2640 1 --2- 172.21.15.1:0/4116825447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f852c108d20 0x7f852c1a1f40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f852400cad0 tx=0x7f852400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:45.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.133+0000 7f85297fa640 1 -- 172.21.15.1:0/4116825447 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852400ae20 con 0x7f852c108d20 2024-09-21T00:55:45.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.133+0000 7f8532625640 1 -- 172.21.15.1:0/4116825447 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f852c1a2960 con 0x7f852c108d20 2024-09-21T00:55:45.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.133+0000 7f85297fa640 1 -- 172.21.15.1:0/4116825447 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8524005020 con 0x7f852c108d20 2024-09-21T00:55:45.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.133+0000 7f85297fa640 1 -- 172.21.15.1:0/4116825447 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852400f6b0 con 0x7f852c108d20 2024-09-21T00:55:45.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.133+0000 7f8532625640 1 -- 172.21.15.1:0/4116825447 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f852c1a90c0 con 0x7f852c108d20 2024-09-21T00:55:45.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.134+0000 7f8532625640 1 -- 172.21.15.1:0/4116825447 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f852c104c60 con 0x7f852c108d20 2024-09-21T00:55:45.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.136+0000 7f85297fa640 1 -- 172.21.15.1:0/4116825447 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7f85240051d0 con 0x7f852c108d20 2024-09-21T00:55:45.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.137+0000 7f85297fa640 1 --2- 172.21.15.1:0/4116825447 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f85180b65a0 0x7f85180b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:45.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.137+0000 7f85297fa640 1 -- 172.21.15.1:0/4116825447 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f85240e75a0 con 0x7f852c108d20 2024-09-21T00:55:45.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.137+0000 7f852bfff640 1 --2- 172.21.15.1:0/4116825447 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f85180b65a0 0x7f85180b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:45.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.137+0000 7f85297fa640 1 --2- 172.21.15.1:0/4116825447 >> [v2:172.21.15.42:6816/2124927218,v1:172.21.15.42:6817/2124927218] conn(0x7f85180c0190 0x7f85180c2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:45.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.137+0000 7f85297fa640 1 -- 172.21.15.1:0/4116825447 --> [v2:172.21.15.42:6816/2124927218,v1:172.21.15.42:6817/2124927218] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8524004810 con 0x7f85180c0190 2024-09-21T00:55:45.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.137+0000 7f85297fa640 1 -- 172.21.15.1:0/4116825447 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f85240ee050 con 0x7f852c108d20 2024-09-21T00:55:45.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.137+0000 7f852bfff640 1 --2- 172.21.15.1:0/4116825447 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f85180b65a0 0x7f85180b8ab0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f851c0058c0 tx=0x7f851c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:45.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.137+0000 7f852b7fe640 1 --2- 172.21.15.1:0/4116825447 >> [v2:172.21.15.42:6816/2124927218,v1:172.21.15.42:6817/2124927218] conn(0x7f85180c0190 0x7f85180c2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:45.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.138+0000 7f852b7fe640 1 --2- 172.21.15.1:0/4116825447 >> [v2:172.21.15.42:6816/2124927218,v1:172.21.15.42:6817/2124927218] conn(0x7f85180c0190 0x7f85180c2680 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:45.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.139+0000 7f85297fa640 1 -- 172.21.15.1:0/4116825447 <== osd.7 v2:172.21.15.42:6816/2124927218 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8524004810 con 0x7f85180c0190 2024-09-21T00:55:45.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.153+0000 7f8532625640 1 -- 172.21.15.1:0/4116825447 --> [v2:172.21.15.42:6816/2124927218,v1:172.21.15.42:6817/2124927218] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f852c103d10 con 0x7f85180c0190 2024-09-21T00:55:45.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.153+0000 7f85297fa640 1 -- 172.21.15.1:0/4116825447 <== osd.7 v2:172.21.15.42:6816/2124927218 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f852c103d10 con 0x7f85180c0190 2024-09-21T00:55:45.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.154+0000 7f8532625640 1 -- 172.21.15.1:0/4116825447 >> [v2:172.21.15.42:6816/2124927218,v1:172.21.15.42:6817/2124927218] conn(0x7f85180c0190 msgr2=0x7f85180c2680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:45.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.154+0000 7f8532625640 1 --2- 172.21.15.1:0/4116825447 >> [v2:172.21.15.42:6816/2124927218,v1:172.21.15.42:6817/2124927218] conn(0x7f85180c0190 0x7f85180c2680 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:45.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.154+0000 7f8532625640 1 -- 172.21.15.1:0/4116825447 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f85180b65a0 msgr2=0x7f85180b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:45.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.154+0000 7f8532625640 1 --2- 172.21.15.1:0/4116825447 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f85180b65a0 0x7f85180b8ab0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f851c0058c0 tx=0x7f851c005850 comp rx=0 tx=0).stop 2024-09-21T00:55:45.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.154+0000 7f8532625640 1 -- 172.21.15.1:0/4116825447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f852c108d20 msgr2=0x7f852c1a1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:45.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.154+0000 7f8532625640 1 --2- 172.21.15.1:0/4116825447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f852c108d20 0x7f852c1a1f40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f852400cad0 tx=0x7f852400cf90 comp rx=0 tx=0).stop 2024-09-21T00:55:45.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.154+0000 7f8530bc2640 1 -- 172.21.15.1:0/4116825447 reap_dead start 2024-09-21T00:55:45.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.154+0000 7f8532625640 1 -- 172.21.15.1:0/4116825447 shutdown_connections 2024-09-21T00:55:45.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.154+0000 7f8532625640 1 -- 172.21.15.1:0/4116825447 >> 172.21.15.1:0/4116825447 conn(0x7f852c079790 msgr2=0x7f852c104200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:45.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.154+0000 7f8532625640 1 -- 172.21.15.1:0/4116825447 shutdown_connections 2024-09-21T00:55:45.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.154+0000 7f8532625640 1 -- 172.21.15.1:0/4116825447 wait complete. 2024-09-21T00:55:45.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.812+0000 7f52db9e6640 1 -- 172.21.15.1:0/1207098023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52d4108d10 msgr2=0x7f52d410f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:45.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.812+0000 7f52db9e6640 1 --2- 172.21.15.1:0/1207098023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52d4108d10 0x7f52d410f540 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f52cc009ca0 tx=0x7f52cc02a8c0 comp rx=0 tx=0).stop 2024-09-21T00:55:45.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.812+0000 7f52db9e6640 1 -- 172.21.15.1:0/1207098023 shutdown_connections 2024-09-21T00:55:45.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.812+0000 7f52db9e6640 1 --2- 172.21.15.1:0/1207098023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52d4108d10 0x7f52d410f540 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:45.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.812+0000 7f52db9e6640 1 --2- 172.21.15.1:0/1207098023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52d41083c0 0x7f52d41087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:45.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.812+0000 7f52db9e6640 1 --2- 172.21.15.1:0/1207098023 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52d4102a80 0x7f52d4102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:45.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.812+0000 7f52db9e6640 1 -- 172.21.15.1:0/1207098023 >> 172.21.15.1:0/1207098023 conn(0x7f52d4079740 msgr2=0x7f52d4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:45.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.812+0000 7f52db9e6640 1 -- 172.21.15.1:0/1207098023 shutdown_connections 2024-09-21T00:55:45.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.812+0000 7f52db9e6640 1 -- 172.21.15.1:0/1207098023 wait complete. 2024-09-21T00:55:45.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.813+0000 7f52db9e6640 1 Processor -- start 2024-09-21T00:55:45.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.813+0000 7f52db9e6640 1 -- start start 2024-09-21T00:55:45.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.813+0000 7f52db9e6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52d4102a80 0x7f52d4199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:45.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.813+0000 7f52db9e6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52d41083c0 0x7f52d4199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:45.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.813+0000 7f52db9e6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52d4108d10 0x7f52d419ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:45.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.813+0000 7f52db9e6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f52d4112980 con 0x7f52d41083c0 2024-09-21T00:55:45.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.813+0000 7f52db9e6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f52d4112800 con 0x7f52d4108d10 2024-09-21T00:55:45.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.813+0000 7f52db9e6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f52d4112b00 con 0x7f52d4102a80 2024-09-21T00:55:45.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.814+0000 7f52d8f81640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52d41083c0 0x7f52d4199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:45.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.814+0000 7f52d8f81640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52d41083c0 0x7f52d4199930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37718/0 (socket says 172.21.15.1:37718) 2024-09-21T00:55:45.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.814+0000 7f52d8f81640 1 -- 172.21.15.1:0/597524627 learned_addr learned my addr 172.21.15.1:0/597524627 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:45.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.814+0000 7f52d9782640 1 --2- 172.21.15.1:0/597524627 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52d4102a80 0x7f52d4199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:45.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.814+0000 7f52d9f83640 1 --2- 172.21.15.1:0/597524627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52d4108d10 0x7f52d419ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:45.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.814+0000 7f52d8f81640 1 -- 172.21.15.1:0/597524627 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52d4102a80 msgr2=0x7f52d4199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:45.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.814+0000 7f52d8f81640 1 --2- 172.21.15.1:0/597524627 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52d4102a80 0x7f52d4199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:45.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.814+0000 7f52d8f81640 1 -- 172.21.15.1:0/597524627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52d4108d10 msgr2=0x7f52d419ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:45.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.814+0000 7f52d8f81640 1 --2- 172.21.15.1:0/597524627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52d4108d10 0x7f52d419ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:45.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.814+0000 7f52d8f81640 1 -- 172.21.15.1:0/597524627 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d419f240 con 0x7f52d41083c0 2024-09-21T00:55:45.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.814+0000 7f52d8f81640 1 --2- 172.21.15.1:0/597524627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52d41083c0 0x7f52d4199930 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f52c400c970 tx=0x7f52c400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:45.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.814+0000 7f52ca7fc640 1 -- 172.21.15.1:0/597524627 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c4014070 con 0x7f52d41083c0 2024-09-21T00:55:45.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.814+0000 7f52ca7fc640 1 -- 172.21.15.1:0/597524627 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52c4004440 con 0x7f52d41083c0 2024-09-21T00:55:45.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.814+0000 7f52ca7fc640 1 -- 172.21.15.1:0/597524627 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c4003e50 con 0x7f52d41083c0 2024-09-21T00:55:45.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.814+0000 7f52db9e6640 1 -- 172.21.15.1:0/597524627 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52d419f530 con 0x7f52d41083c0 2024-09-21T00:55:45.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.815+0000 7f52db9e6640 1 -- 172.21.15.1:0/597524627 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52d41a5d50 con 0x7f52d41083c0 2024-09-21T00:55:45.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.815+0000 7f52db9e6640 1 -- 172.21.15.1:0/597524627 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f52d4063b50 con 0x7f52d41083c0 2024-09-21T00:55:45.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.818+0000 7f52ca7fc640 1 -- 172.21.15.1:0/597524627 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7f52c4017070 con 0x7f52d41083c0 2024-09-21T00:55:45.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.818+0000 7f52ca7fc640 1 --2- 172.21.15.1:0/597524627 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f52c00b67f0 0x7f52c00b8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:45.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.818+0000 7f52d9782640 1 --2- 172.21.15.1:0/597524627 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f52c00b67f0 0x7f52c00b8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:45.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.818+0000 7f52ca7fc640 1 -- 172.21.15.1:0/597524627 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f52c40e7270 con 0x7f52d41083c0 2024-09-21T00:55:45.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.819+0000 7f52ca7fc640 1 --2- 172.21.15.1:0/597524627 >> [v2:172.21.15.193:6824/2368815522,v1:172.21.15.193:6825/2368815522] conn(0x7f52c00c03e0 0x7f52c00c28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:45.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.819+0000 7f52ca7fc640 1 -- 172.21.15.1:0/597524627 --> [v2:172.21.15.193:6824/2368815522,v1:172.21.15.193:6825/2368815522] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f52c4003e50 con 0x7f52c00c03e0 2024-09-21T00:55:45.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.819+0000 7f52ca7fc640 1 -- 172.21.15.1:0/597524627 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f52c40e76c0 con 0x7f52d41083c0 2024-09-21T00:55:45.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.819+0000 7f52d9782640 1 --2- 172.21.15.1:0/597524627 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f52c00b67f0 0x7f52c00b8d00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f52d0005d00 tx=0x7f52d000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:45.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.819+0000 7f52d9f83640 1 --2- 172.21.15.1:0/597524627 >> [v2:172.21.15.193:6824/2368815522,v1:172.21.15.193:6825/2368815522] conn(0x7f52c00c03e0 0x7f52c00c28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:45.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.819+0000 7f52d9f83640 1 --2- 172.21.15.1:0/597524627 >> [v2:172.21.15.193:6824/2368815522,v1:172.21.15.193:6825/2368815522] conn(0x7f52c00c03e0 0x7f52c00c28d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:45.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.820+0000 7f52ca7fc640 1 -- 172.21.15.1:0/597524627 <== osd.11 v2:172.21.15.193:6824/2368815522 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f52c4003e50 con 0x7f52c00c03e0 2024-09-21T00:55:45.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.835+0000 7f52db9e6640 1 -- 172.21.15.1:0/597524627 --> [v2:172.21.15.193:6824/2368815522,v1:172.21.15.193:6825/2368815522] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f52d4063fa0 con 0x7f52c00c03e0 2024-09-21T00:55:45.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.836+0000 7f52ca7fc640 1 -- 172.21.15.1:0/597524627 <== osd.11 v2:172.21.15.193:6824/2368815522 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f52d4063fa0 con 0x7f52c00c03e0 2024-09-21T00:55:45.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.836+0000 7f52db9e6640 1 -- 172.21.15.1:0/597524627 >> [v2:172.21.15.193:6824/2368815522,v1:172.21.15.193:6825/2368815522] conn(0x7f52c00c03e0 msgr2=0x7f52c00c28d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:45.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.836+0000 7f52db9e6640 1 --2- 172.21.15.1:0/597524627 >> [v2:172.21.15.193:6824/2368815522,v1:172.21.15.193:6825/2368815522] conn(0x7f52c00c03e0 0x7f52c00c28d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:45.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.836+0000 7f52db9e6640 1 -- 172.21.15.1:0/597524627 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f52c00b67f0 msgr2=0x7f52c00b8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:45.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.836+0000 7f52db9e6640 1 --2- 172.21.15.1:0/597524627 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f52c00b67f0 0x7f52c00b8d00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f52d0005d00 tx=0x7f52d000b410 comp rx=0 tx=0).stop 2024-09-21T00:55:45.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.836+0000 7f52db9e6640 1 -- 172.21.15.1:0/597524627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52d41083c0 msgr2=0x7f52d4199930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:45.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.836+0000 7f52db9e6640 1 --2- 172.21.15.1:0/597524627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52d41083c0 0x7f52d4199930 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f52c400c970 tx=0x7f52c400ce30 comp rx=0 tx=0).stop 2024-09-21T00:55:45.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.836+0000 7f52d9f83640 1 -- 172.21.15.1:0/597524627 reap_dead start 2024-09-21T00:55:45.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.837+0000 7f52db9e6640 1 -- 172.21.15.1:0/597524627 shutdown_connections 2024-09-21T00:55:45.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.837+0000 7f52db9e6640 1 -- 172.21.15.1:0/597524627 >> 172.21.15.1:0/597524627 conn(0x7f52d4079740 msgr2=0x7f52d4104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:45.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.837+0000 7f52db9e6640 1 -- 172.21.15.1:0/597524627 shutdown_connections 2024-09-21T00:55:45.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:45.837+0000 7f52db9e6640 1 -- 172.21.15.1:0/597524627 wait complete. 2024-09-21T00:55:45.959 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:45 smithi001 ceph-mon[31211]: pgmap v314: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2024-09-21T00:55:45.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:45 smithi193 ceph-mon[34660]: pgmap v314: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2024-09-21T00:55:45.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:45 smithi042 ceph-mon[34481]: pgmap v314: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2024-09-21T00:55:46.284 INFO:teuthology.orchestra.run.smithi001.stdout:193273528362 2024-09-21T00:55:46.285 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.7 2024-09-21T00:55:47.368 INFO:teuthology.orchestra.run.smithi001.stdout:103079215168 2024-09-21T00:55:47.369 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-21T00:55:47.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.935+0000 7f77efe7b640 1 -- 172.21.15.1:0/3564257310 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77e8108670 msgr2=0x7f77e8108a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:47.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.935+0000 7f77efe7b640 1 --2- 172.21.15.1:0/3564257310 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77e8108670 0x7f77e8108a80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f77d8009900 tx=0x7f77d802a410 comp rx=0 tx=0).stop 2024-09-21T00:55:47.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.935+0000 7f77efe7b640 1 -- 172.21.15.1:0/3564257310 shutdown_connections 2024-09-21T00:55:47.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.935+0000 7f77efe7b640 1 --2- 172.21.15.1:0/3564257310 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77e8108fc0 0x7f77e810f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:47.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.935+0000 7f77efe7b640 1 --2- 172.21.15.1:0/3564257310 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77e8108670 0x7f77e8108a80 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:47.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.935+0000 7f77efe7b640 1 --2- 172.21.15.1:0/3564257310 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77e8103230 0x7f77e8103640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:47.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.935+0000 7f77efe7b640 1 -- 172.21.15.1:0/3564257310 >> 172.21.15.1:0/3564257310 conn(0x7f77e8079ea0 msgr2=0x7f77e807a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:47.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.935+0000 7f77efe7b640 1 -- 172.21.15.1:0/3564257310 shutdown_connections 2024-09-21T00:55:47.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.935+0000 7f77efe7b640 1 -- 172.21.15.1:0/3564257310 wait complete. 2024-09-21T00:55:47.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.935+0000 7f77efe7b640 1 Processor -- start 2024-09-21T00:55:47.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.935+0000 7f77efe7b640 1 -- start start 2024-09-21T00:55:47.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.936+0000 7f77efe7b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77e8103230 0x7f77e819a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:47.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.936+0000 7f77efe7b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77e8108670 0x7f77e819ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:47.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.936+0000 7f77efe7b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77e8108fc0 0x7f77e81a0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:47.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.936+0000 7f77efe7b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f77e8112ca0 con 0x7f77e8108fc0 2024-09-21T00:55:47.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.936+0000 7f77efe7b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f77e8112b20 con 0x7f77e8103230 2024-09-21T00:55:47.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.936+0000 7f77efe7b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f77e8112e20 con 0x7f77e8108670 2024-09-21T00:55:47.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.936+0000 7f77ee418640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77e8108fc0 0x7f77e81a0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:47.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.936+0000 7f77edc17640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77e8103230 0x7f77e819a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:47.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.936+0000 7f77ee418640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77e8108fc0 0x7f77e81a0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37676/0 (socket says 172.21.15.1:37676) 2024-09-21T00:55:47.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.936+0000 7f77ee418640 1 -- 172.21.15.1:0/2284299506 learned_addr learned my addr 172.21.15.1:0/2284299506 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:47.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.936+0000 7f77ed416640 1 --2- 172.21.15.1:0/2284299506 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77e8108670 0x7f77e819ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:47.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.936+0000 7f77ee418640 1 -- 172.21.15.1:0/2284299506 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77e8108670 msgr2=0x7f77e819ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:47.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.936+0000 7f77ee418640 1 --2- 172.21.15.1:0/2284299506 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77e8108670 0x7f77e819ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:47.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.936+0000 7f77ee418640 1 -- 172.21.15.1:0/2284299506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77e8103230 msgr2=0x7f77e819a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:47.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.936+0000 7f77ee418640 1 --2- 172.21.15.1:0/2284299506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77e8103230 0x7f77e819a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:47.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.936+0000 7f77ee418640 1 -- 172.21.15.1:0/2284299506 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77e81a0750 con 0x7f77e8108fc0 2024-09-21T00:55:47.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.936+0000 7f77edc17640 1 --2- 172.21.15.1:0/2284299506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77e8103230 0x7f77e819a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:55:47.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.936+0000 7f77ed416640 1 --2- 172.21.15.1:0/2284299506 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77e8108670 0x7f77e819ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:55:47.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.937+0000 7f77ee418640 1 --2- 172.21.15.1:0/2284299506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77e8108fc0 0x7f77e81a0020 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f77e000b970 tx=0x7f77e000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:47.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.937+0000 7f77deffd640 1 -- 172.21.15.1:0/2284299506 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e0019070 con 0x7f77e8108fc0 2024-09-21T00:55:47.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.937+0000 7f77deffd640 1 -- 172.21.15.1:0/2284299506 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77e0014440 con 0x7f77e8108fc0 2024-09-21T00:55:47.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.937+0000 7f77deffd640 1 -- 172.21.15.1:0/2284299506 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e00075d0 con 0x7f77e8108fc0 2024-09-21T00:55:47.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.937+0000 7f77efe7b640 1 -- 172.21.15.1:0/2284299506 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77e81a0a40 con 0x7f77e8108fc0 2024-09-21T00:55:47.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.937+0000 7f77efe7b640 1 -- 172.21.15.1:0/2284299506 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77e81a71a0 con 0x7f77e8108fc0 2024-09-21T00:55:47.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.938+0000 7f77efe7b640 1 -- 172.21.15.1:0/2284299506 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f77e8063b50 con 0x7f77e8108fc0 2024-09-21T00:55:47.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.939+0000 7f77deffd640 1 -- 172.21.15.1:0/2284299506 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7f77e001c070 con 0x7f77e8108fc0 2024-09-21T00:55:47.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.940+0000 7f77deffd640 1 --2- 172.21.15.1:0/2284299506 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f77d40b65a0 0x7f77d40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:47.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.940+0000 7f77edc17640 1 --2- 172.21.15.1:0/2284299506 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f77d40b65a0 0x7f77d40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:47.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.940+0000 7f77deffd640 1 -- 172.21.15.1:0/2284299506 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f77e00e7170 con 0x7f77e8108fc0 2024-09-21T00:55:47.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.941+0000 7f77deffd640 1 --2- 172.21.15.1:0/2284299506 >> [v2:172.21.15.193:6808/732336675,v1:172.21.15.193:6809/732336675] conn(0x7f77d40c0190 0x7f77d40c2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:47.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.941+0000 7f77deffd640 1 -- 172.21.15.1:0/2284299506 --> [v2:172.21.15.193:6808/732336675,v1:172.21.15.193:6809/732336675] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f77d40c2d50 con 0x7f77d40c0190 2024-09-21T00:55:47.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.941+0000 7f77deffd640 1 -- 172.21.15.1:0/2284299506 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f77e00e7520 con 0x7f77e8108fc0 2024-09-21T00:55:47.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.941+0000 7f77edc17640 1 --2- 172.21.15.1:0/2284299506 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f77d40b65a0 0x7f77d40b8ab0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f77e400bfd0 tx=0x7f77e400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:47.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.941+0000 7f77ed416640 1 --2- 172.21.15.1:0/2284299506 >> [v2:172.21.15.193:6808/732336675,v1:172.21.15.193:6809/732336675] conn(0x7f77d40c0190 0x7f77d40c2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:47.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.942+0000 7f77ed416640 1 --2- 172.21.15.1:0/2284299506 >> [v2:172.21.15.193:6808/732336675,v1:172.21.15.193:6809/732336675] conn(0x7f77d40c0190 0x7f77d40c2680 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:47.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.942+0000 7f77deffd640 1 -- 172.21.15.1:0/2284299506 <== osd.5 v2:172.21.15.193:6808/732336675 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f77d40c2d50 con 0x7f77d40c0190 2024-09-21T00:55:47.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.956+0000 7f77efe7b640 1 -- 172.21.15.1:0/2284299506 --> [v2:172.21.15.193:6808/732336675,v1:172.21.15.193:6809/732336675] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f77e8064000 con 0x7f77d40c0190 2024-09-21T00:55:47.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.957+0000 7f77deffd640 1 -- 172.21.15.1:0/2284299506 <== osd.5 v2:172.21.15.193:6808/732336675 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f77e8064000 con 0x7f77d40c0190 2024-09-21T00:55:47.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.957+0000 7f77efe7b640 1 -- 172.21.15.1:0/2284299506 >> [v2:172.21.15.193:6808/732336675,v1:172.21.15.193:6809/732336675] conn(0x7f77d40c0190 msgr2=0x7f77d40c2680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:47.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.957+0000 7f77efe7b640 1 --2- 172.21.15.1:0/2284299506 >> [v2:172.21.15.193:6808/732336675,v1:172.21.15.193:6809/732336675] conn(0x7f77d40c0190 0x7f77d40c2680 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:47.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.957+0000 7f77efe7b640 1 -- 172.21.15.1:0/2284299506 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f77d40b65a0 msgr2=0x7f77d40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:47.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.957+0000 7f77efe7b640 1 --2- 172.21.15.1:0/2284299506 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f77d40b65a0 0x7f77d40b8ab0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f77e400bfd0 tx=0x7f77e400b390 comp rx=0 tx=0).stop 2024-09-21T00:55:47.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.957+0000 7f77efe7b640 1 -- 172.21.15.1:0/2284299506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77e8108fc0 msgr2=0x7f77e81a0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:47.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.957+0000 7f77efe7b640 1 --2- 172.21.15.1:0/2284299506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77e8108fc0 0x7f77e81a0020 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f77e000b970 tx=0x7f77e000be30 comp rx=0 tx=0).stop 2024-09-21T00:55:47.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.957+0000 7f77ee418640 1 -- 172.21.15.1:0/2284299506 reap_dead start 2024-09-21T00:55:47.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.957+0000 7f77efe7b640 1 -- 172.21.15.1:0/2284299506 shutdown_connections 2024-09-21T00:55:47.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.957+0000 7f77efe7b640 1 -- 172.21.15.1:0/2284299506 >> 172.21.15.1:0/2284299506 conn(0x7f77e8079ea0 msgr2=0x7f77e8101370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:47.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.957+0000 7f77efe7b640 1 -- 172.21.15.1:0/2284299506 shutdown_connections 2024-09-21T00:55:47.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:43.957+0000 7f77efe7b640 1 -- 172.21.15.1:0/2284299506 wait complete. 2024-09-21T00:55:47.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:47 smithi001 ceph-mon[31211]: pgmap v315: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2024-09-21T00:55:47.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:47 smithi193 ceph-mon[34660]: pgmap v315: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2024-09-21T00:55:47.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:47 smithi042 ceph-mon[34481]: pgmap v315: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2024-09-21T00:55:48.157 INFO:teuthology.orchestra.run.smithi001.stdout:146028888117 2024-09-21T00:55:48.158 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-21T00:55:48.568 INFO:teuthology.orchestra.run.smithi001.stdout:287762808854 2024-09-21T00:55:48.568 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.11 2024-09-21T00:55:48.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.933+0000 7f999d0af640 1 -- 172.21.15.1:0/658362724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99981083c0 msgr2=0x7f99981087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:48.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.933+0000 7f999d0af640 1 --2- 172.21.15.1:0/658362724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99981083c0 0x7f99981087d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f998c009900 tx=0x7f998c02a410 comp rx=0 tx=0).stop 2024-09-21T00:55:48.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.933+0000 7f999d0af640 1 -- 172.21.15.1:0/658362724 shutdown_connections 2024-09-21T00:55:48.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.933+0000 7f999d0af640 1 --2- 172.21.15.1:0/658362724 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9998108d10 0x7f999810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:48.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.933+0000 7f999d0af640 1 --2- 172.21.15.1:0/658362724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99981083c0 0x7f99981087d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:48.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.933+0000 7f999d0af640 1 --2- 172.21.15.1:0/658362724 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9998102a80 0x7f9998102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:48.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.933+0000 7f999d0af640 1 -- 172.21.15.1:0/658362724 >> 172.21.15.1:0/658362724 conn(0x7f9998079740 msgr2=0x7f9998079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:48.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.933+0000 7f999d0af640 1 -- 172.21.15.1:0/658362724 shutdown_connections 2024-09-21T00:55:48.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.933+0000 7f999d0af640 1 -- 172.21.15.1:0/658362724 wait complete. 2024-09-21T00:55:48.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.934+0000 7f999d0af640 1 Processor -- start 2024-09-21T00:55:48.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.934+0000 7f999d0af640 1 -- start start 2024-09-21T00:55:48.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.934+0000 7f999d0af640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9998102a80 0x7f999819a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:48.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.934+0000 7f999d0af640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99981083c0 0x7f999819aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:48.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.934+0000 7f999d0af640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9998108d10 0x7f999819fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:48.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.934+0000 7f999d0af640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9998113aa0 con 0x7f9998108d10 2024-09-21T00:55:48.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.934+0000 7f999d0af640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9998113920 con 0x7f99981083c0 2024-09-21T00:55:48.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.934+0000 7f999d0af640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9998113c20 con 0x7f9998102a80 2024-09-21T00:55:48.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.935+0000 7f999759e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9998108d10 0x7f999819fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:48.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.935+0000 7f999759e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9998108d10 0x7f999819fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37640/0 (socket says 172.21.15.1:37640) 2024-09-21T00:55:48.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.935+0000 7f999759e640 1 -- 172.21.15.1:0/2982364813 learned_addr learned my addr 172.21.15.1:0/2982364813 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:48.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.935+0000 7f999659c640 1 --2- 172.21.15.1:0/2982364813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99981083c0 0x7f999819aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:48.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.935+0000 7f9996d9d640 1 --2- 172.21.15.1:0/2982364813 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9998102a80 0x7f999819a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:48.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.935+0000 7f999759e640 1 -- 172.21.15.1:0/2982364813 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9998102a80 msgr2=0x7f999819a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:48.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.935+0000 7f999759e640 1 --2- 172.21.15.1:0/2982364813 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9998102a80 0x7f999819a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:48.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.935+0000 7f999759e640 1 -- 172.21.15.1:0/2982364813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99981083c0 msgr2=0x7f999819aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:48.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.935+0000 7f999759e640 1 --2- 172.21.15.1:0/2982364813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99981083c0 0x7f999819aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:48.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.935+0000 7f999759e640 1 -- 172.21.15.1:0/2982364813 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99981a0460 con 0x7f9998108d10 2024-09-21T00:55:48.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.935+0000 7f999659c640 1 --2- 172.21.15.1:0/2982364813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99981083c0 0x7f999819aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:55:48.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.935+0000 7f999759e640 1 --2- 172.21.15.1:0/2982364813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9998108d10 0x7f999819fd30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f999000eaa0 tx=0x7f999000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:48.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.935+0000 7f997ffff640 1 -- 172.21.15.1:0/2982364813 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999000cdb0 con 0x7f9998108d10 2024-09-21T00:55:48.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.935+0000 7f999d0af640 1 -- 172.21.15.1:0/2982364813 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99981a0750 con 0x7f9998108d10 2024-09-21T00:55:48.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.935+0000 7f997ffff640 1 -- 172.21.15.1:0/2982364813 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9990005020 con 0x7f9998108d10 2024-09-21T00:55:48.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.935+0000 7f997ffff640 1 -- 172.21.15.1:0/2982364813 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99900116d0 con 0x7f9998108d10 2024-09-21T00:55:48.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.936+0000 7f999d0af640 1 -- 172.21.15.1:0/2982364813 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99981a6eb0 con 0x7f9998108d10 2024-09-21T00:55:48.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.936+0000 7f999d0af640 1 -- 172.21.15.1:0/2982364813 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9998063b50 con 0x7f9998108d10 2024-09-21T00:55:48.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.938+0000 7f997ffff640 1 -- 172.21.15.1:0/2982364813 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7f99900054a0 con 0x7f9998108d10 2024-09-21T00:55:48.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.939+0000 7f997ffff640 1 --2- 172.21.15.1:0/2982364813 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f99800b65a0 0x7f99800b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:48.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.939+0000 7f9996d9d640 1 --2- 172.21.15.1:0/2982364813 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f99800b65a0 0x7f99800b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:48.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.939+0000 7f997ffff640 1 -- 172.21.15.1:0/2982364813 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f99900e7a10 con 0x7f9998108d10 2024-09-21T00:55:48.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.939+0000 7f997ffff640 1 --2- 172.21.15.1:0/2982364813 >> [v2:172.21.15.193:6816/2277449259,v1:172.21.15.193:6817/2277449259] conn(0x7f99800c0190 0x7f99800c2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:48.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.939+0000 7f997ffff640 1 -- 172.21.15.1:0/2982364813 --> [v2:172.21.15.193:6816/2277449259,v1:172.21.15.193:6817/2277449259] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f99800c2d50 con 0x7f99800c0190 2024-09-21T00:55:48.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.939+0000 7f997ffff640 1 -- 172.21.15.1:0/2982364813 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f99900e7dc0 con 0x7f9998108d10 2024-09-21T00:55:48.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.939+0000 7f9996d9d640 1 --2- 172.21.15.1:0/2982364813 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f99800b65a0 0x7f99800b8ab0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f998800bbe0 tx=0x7f998800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:48.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.940+0000 7f999659c640 1 --2- 172.21.15.1:0/2982364813 >> [v2:172.21.15.193:6816/2277449259,v1:172.21.15.193:6817/2277449259] conn(0x7f99800c0190 0x7f99800c2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:48.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.940+0000 7f999659c640 1 --2- 172.21.15.1:0/2982364813 >> [v2:172.21.15.193:6816/2277449259,v1:172.21.15.193:6817/2277449259] conn(0x7f99800c0190 0x7f99800c2680 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:48.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.941+0000 7f997ffff640 1 -- 172.21.15.1:0/2982364813 <== osd.8 v2:172.21.15.193:6816/2277449259 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f99800c2d50 con 0x7f99800c0190 2024-09-21T00:55:48.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.955+0000 7f999d0af640 1 -- 172.21.15.1:0/2982364813 --> [v2:172.21.15.193:6816/2277449259,v1:172.21.15.193:6817/2277449259] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9998064000 con 0x7f99800c0190 2024-09-21T00:55:48.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.955+0000 7f997ffff640 1 -- 172.21.15.1:0/2982364813 <== osd.8 v2:172.21.15.193:6816/2277449259 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9998064000 con 0x7f99800c0190 2024-09-21T00:55:48.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.956+0000 7f999d0af640 1 -- 172.21.15.1:0/2982364813 >> [v2:172.21.15.193:6816/2277449259,v1:172.21.15.193:6817/2277449259] conn(0x7f99800c0190 msgr2=0x7f99800c2680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:48.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.956+0000 7f999d0af640 1 --2- 172.21.15.1:0/2982364813 >> [v2:172.21.15.193:6816/2277449259,v1:172.21.15.193:6817/2277449259] conn(0x7f99800c0190 0x7f99800c2680 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:48.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.956+0000 7f999d0af640 1 -- 172.21.15.1:0/2982364813 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f99800b65a0 msgr2=0x7f99800b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:48.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.956+0000 7f999d0af640 1 --2- 172.21.15.1:0/2982364813 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f99800b65a0 0x7f99800b8ab0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f998800bbe0 tx=0x7f998800b390 comp rx=0 tx=0).stop 2024-09-21T00:55:48.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.956+0000 7f999d0af640 1 -- 172.21.15.1:0/2982364813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9998108d10 msgr2=0x7f999819fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:48.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.956+0000 7f999d0af640 1 --2- 172.21.15.1:0/2982364813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9998108d10 0x7f999819fd30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f999000eaa0 tx=0x7f999000ef60 comp rx=0 tx=0).stop 2024-09-21T00:55:48.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.956+0000 7f999759e640 1 -- 172.21.15.1:0/2982364813 reap_dead start 2024-09-21T00:55:48.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.956+0000 7f999d0af640 1 -- 172.21.15.1:0/2982364813 shutdown_connections 2024-09-21T00:55:48.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.956+0000 7f999d0af640 1 -- 172.21.15.1:0/2982364813 >> 172.21.15.1:0/2982364813 conn(0x7f9998079740 msgr2=0x7f9998104480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:48.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.956+0000 7f999d0af640 1 -- 172.21.15.1:0/2982364813 shutdown_connections 2024-09-21T00:55:48.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:42.956+0000 7f999d0af640 1 -- 172.21.15.1:0/2982364813 wait complete. 2024-09-21T00:55:49.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.769+0000 7fe942a3c640 1 -- 172.21.15.1:0/1983552598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe93c108cf0 msgr2=0x7fe93c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:49.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.769+0000 7fe942a3c640 1 --2- 172.21.15.1:0/1983552598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe93c108cf0 0x7fe93c10f520 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe934009ca0 tx=0x7fe93402a8c0 comp rx=0 tx=0).stop 2024-09-21T00:55:49.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.769+0000 7fe942a3c640 1 -- 172.21.15.1:0/1983552598 shutdown_connections 2024-09-21T00:55:49.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.769+0000 7fe942a3c640 1 --2- 172.21.15.1:0/1983552598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe93c108cf0 0x7fe93c10f520 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:49.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.769+0000 7fe942a3c640 1 --2- 172.21.15.1:0/1983552598 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe93c1083a0 0x7fe93c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:49.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.769+0000 7fe942a3c640 1 --2- 172.21.15.1:0/1983552598 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe93c102a60 0x7fe93c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:49.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.769+0000 7fe942a3c640 1 -- 172.21.15.1:0/1983552598 >> 172.21.15.1:0/1983552598 conn(0x7fe93c079730 msgr2=0x7fe93c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:49.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.769+0000 7fe942a3c640 1 -- 172.21.15.1:0/1983552598 shutdown_connections 2024-09-21T00:55:49.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.769+0000 7fe942a3c640 1 -- 172.21.15.1:0/1983552598 wait complete. 2024-09-21T00:55:49.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.770+0000 7fe942a3c640 1 Processor -- start 2024-09-21T00:55:49.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.770+0000 7fe942a3c640 1 -- start start 2024-09-21T00:55:49.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.770+0000 7fe942a3c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe93c102a60 0x7fe93c199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:49.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.770+0000 7fe942a3c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe93c1083a0 0x7fe93c1998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:49.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.770+0000 7fe942a3c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe93c108cf0 0x7fe93c19eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:49.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.770+0000 7fe942a3c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe93c112960 con 0x7fe93c108cf0 2024-09-21T00:55:49.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.770+0000 7fe942a3c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe93c1127e0 con 0x7fe93c102a60 2024-09-21T00:55:49.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.770+0000 7fe942a3c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe93c112ae0 con 0x7fe93c1083a0 2024-09-21T00:55:49.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.771+0000 7fe940fd9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe93c108cf0 0x7fe93c19eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:49.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.771+0000 7fe940fd9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe93c108cf0 0x7fe93c19eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37730/0 (socket says 172.21.15.1:37730) 2024-09-21T00:55:49.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.771+0000 7fe940fd9640 1 -- 172.21.15.1:0/2987954156 learned_addr learned my addr 172.21.15.1:0/2987954156 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:49.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.771+0000 7fe93bfff640 1 --2- 172.21.15.1:0/2987954156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe93c102a60 0x7fe93c199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:49.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.771+0000 7fe93b7fe640 1 --2- 172.21.15.1:0/2987954156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe93c1083a0 0x7fe93c1998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:49.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.771+0000 7fe940fd9640 1 -- 172.21.15.1:0/2987954156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe93c1083a0 msgr2=0x7fe93c1998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:49.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.771+0000 7fe940fd9640 1 --2- 172.21.15.1:0/2987954156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe93c1083a0 0x7fe93c1998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:49.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.771+0000 7fe940fd9640 1 -- 172.21.15.1:0/2987954156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe93c102a60 msgr2=0x7fe93c199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:49.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.771+0000 7fe940fd9640 1 --2- 172.21.15.1:0/2987954156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe93c102a60 0x7fe93c199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:49.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.771+0000 7fe940fd9640 1 -- 172.21.15.1:0/2987954156 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe93c19f280 con 0x7fe93c108cf0 2024-09-21T00:55:49.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.771+0000 7fe940fd9640 1 --2- 172.21.15.1:0/2987954156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe93c108cf0 0x7fe93c19eb50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe934005cc0 tx=0x7fe93402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:49.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.771+0000 7fe9397fa640 1 -- 172.21.15.1:0/2987954156 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe934003bf0 con 0x7fe93c108cf0 2024-09-21T00:55:49.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.771+0000 7fe942a3c640 1 -- 172.21.15.1:0/2987954156 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe93c19f510 con 0x7fe93c108cf0 2024-09-21T00:55:49.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.771+0000 7fe9397fa640 1 -- 172.21.15.1:0/2987954156 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe934003d90 con 0x7fe93c108cf0 2024-09-21T00:55:49.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.771+0000 7fe9397fa640 1 -- 172.21.15.1:0/2987954156 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe93402fbc0 con 0x7fe93c108cf0 2024-09-21T00:55:49.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.771+0000 7fe942a3c640 1 -- 172.21.15.1:0/2987954156 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe93c1a5cd0 con 0x7fe93c108cf0 2024-09-21T00:55:49.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.772+0000 7fe942a3c640 1 -- 172.21.15.1:0/2987954156 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe93c063b50 con 0x7fe93c108cf0 2024-09-21T00:55:49.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.774+0000 7fe9397fa640 1 -- 172.21.15.1:0/2987954156 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7fe93402fd60 con 0x7fe93c108cf0 2024-09-21T00:55:49.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.775+0000 7fe9397fa640 1 --2- 172.21.15.1:0/2987954156 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe9240b65a0 0x7fe9240b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:49.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.775+0000 7fe93bfff640 1 --2- 172.21.15.1:0/2987954156 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe9240b65a0 0x7fe9240b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:49.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.775+0000 7fe9397fa640 1 -- 172.21.15.1:0/2987954156 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fe934108b10 con 0x7fe93c108cf0 2024-09-21T00:55:49.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.775+0000 7fe9397fa640 1 --2- 172.21.15.1:0/2987954156 >> [v2:172.21.15.193:6800/3495400570,v1:172.21.15.193:6801/3495400570] conn(0x7fe9240c0190 0x7fe9240c2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:49.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.775+0000 7fe9397fa640 1 -- 172.21.15.1:0/2987954156 --> [v2:172.21.15.193:6800/3495400570,v1:172.21.15.193:6801/3495400570] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe9240c2d50 con 0x7fe9240c0190 2024-09-21T00:55:49.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.775+0000 7fe9397fa640 1 -- 172.21.15.1:0/2987954156 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fe934108ec0 con 0x7fe93c108cf0 2024-09-21T00:55:49.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.775+0000 7fe93bfff640 1 --2- 172.21.15.1:0/2987954156 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe9240b65a0 0x7fe9240b8ab0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe92c0058c0 tx=0x7fe92c00a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:49.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.776+0000 7fe93b7fe640 1 --2- 172.21.15.1:0/2987954156 >> [v2:172.21.15.193:6800/3495400570,v1:172.21.15.193:6801/3495400570] conn(0x7fe9240c0190 0x7fe9240c2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:49.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.776+0000 7fe93b7fe640 1 --2- 172.21.15.1:0/2987954156 >> [v2:172.21.15.193:6800/3495400570,v1:172.21.15.193:6801/3495400570] conn(0x7fe9240c0190 0x7fe9240c2680 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:49.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.777+0000 7fe9397fa640 1 -- 172.21.15.1:0/2987954156 <== osd.2 v2:172.21.15.193:6800/3495400570 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe9240c2d50 con 0x7fe9240c0190 2024-09-21T00:55:49.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.791+0000 7fe942a3c640 1 -- 172.21.15.1:0/2987954156 --> [v2:172.21.15.193:6800/3495400570,v1:172.21.15.193:6801/3495400570] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe93c063f50 con 0x7fe9240c0190 2024-09-21T00:55:49.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.791+0000 7fe9397fa640 1 -- 172.21.15.1:0/2987954156 <== osd.2 v2:172.21.15.193:6800/3495400570 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe93c063f50 con 0x7fe9240c0190 2024-09-21T00:55:49.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.792+0000 7fe942a3c640 1 -- 172.21.15.1:0/2987954156 >> [v2:172.21.15.193:6800/3495400570,v1:172.21.15.193:6801/3495400570] conn(0x7fe9240c0190 msgr2=0x7fe9240c2680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:49.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.792+0000 7fe942a3c640 1 --2- 172.21.15.1:0/2987954156 >> [v2:172.21.15.193:6800/3495400570,v1:172.21.15.193:6801/3495400570] conn(0x7fe9240c0190 0x7fe9240c2680 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:49.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.792+0000 7fe942a3c640 1 -- 172.21.15.1:0/2987954156 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe9240b65a0 msgr2=0x7fe9240b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:49.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.792+0000 7fe942a3c640 1 --2- 172.21.15.1:0/2987954156 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe9240b65a0 0x7fe9240b8ab0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe92c0058c0 tx=0x7fe92c00a250 comp rx=0 tx=0).stop 2024-09-21T00:55:49.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.792+0000 7fe942a3c640 1 -- 172.21.15.1:0/2987954156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe93c108cf0 msgr2=0x7fe93c19eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:49.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.792+0000 7fe942a3c640 1 --2- 172.21.15.1:0/2987954156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe93c108cf0 0x7fe93c19eb50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe934005cc0 tx=0x7fe93402f380 comp rx=0 tx=0).stop 2024-09-21T00:55:49.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.792+0000 7fe940fd9640 1 -- 172.21.15.1:0/2987954156 reap_dead start 2024-09-21T00:55:49.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.792+0000 7fe942a3c640 1 -- 172.21.15.1:0/2987954156 shutdown_connections 2024-09-21T00:55:49.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.792+0000 7fe942a3c640 1 -- 172.21.15.1:0/2987954156 >> 172.21.15.1:0/2987954156 conn(0x7fe93c079730 msgr2=0x7fe93c1043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:49.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.792+0000 7fe942a3c640 1 -- 172.21.15.1:0/2987954156 shutdown_connections 2024-09-21T00:55:49.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:46.792+0000 7fe942a3c640 1 -- 172.21.15.1:0/2987954156 wait complete. 2024-09-21T00:55:49.935 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:49 smithi001 ceph-mon[31211]: pgmap v316: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:55:49.969 INFO:teuthology.orchestra.run.smithi001.stdout:77309411398 2024-09-21T00:55:49.969 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-21T00:55:49.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:49 smithi193 ceph-mon[34660]: pgmap v316: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:55:49.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:49 smithi042 ceph-mon[34481]: pgmap v316: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:55:50.189 INFO:teuthology.orchestra.run.smithi001.stdout:219043332134 2024-09-21T00:55:50.190 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.8 2024-09-21T00:55:50.618 INFO:teuthology.orchestra.run.smithi001.stdout:244813135904 2024-09-21T00:55:50.619 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.9 2024-09-21T00:55:50.825 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:50.830 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:50.832 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:50.835 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:50.842 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:50.851 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:50.851 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:50.851 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:50.851 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:50.853 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:50.857 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:51.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.499+0000 7f5cd10cd640 1 -- 172.21.15.1:0/1245346370 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ccc102ae0 msgr2=0x7f5ccc102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:51.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.499+0000 7f5cd10cd640 1 --2- 172.21.15.1:0/1245346370 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ccc102ae0 0x7f5ccc102ef0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc009900 tx=0x7f5cbc02a410 comp rx=0 tx=0).stop 2024-09-21T00:55:51.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.499+0000 7f5cd10cd640 1 -- 172.21.15.1:0/1245346370 shutdown_connections 2024-09-21T00:55:51.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.499+0000 7f5cd10cd640 1 --2- 172.21.15.1:0/1245346370 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ccc108d20 0x7f5ccc10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:51.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.499+0000 7f5cd10cd640 1 --2- 172.21.15.1:0/1245346370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ccc1083d0 0x7f5ccc1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:51.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.499+0000 7f5cd10cd640 1 --2- 172.21.15.1:0/1245346370 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ccc102ae0 0x7f5ccc102ef0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:51.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.499+0000 7f5cd10cd640 1 -- 172.21.15.1:0/1245346370 >> 172.21.15.1:0/1245346370 conn(0x7f5ccc0797b0 msgr2=0x7f5ccc079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:51.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.499+0000 7f5cd10cd640 1 -- 172.21.15.1:0/1245346370 shutdown_connections 2024-09-21T00:55:51.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.499+0000 7f5cd10cd640 1 -- 172.21.15.1:0/1245346370 wait complete. 2024-09-21T00:55:51.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.500+0000 7f5cd10cd640 1 Processor -- start 2024-09-21T00:55:51.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.501+0000 7f5cd10cd640 1 -- start start 2024-09-21T00:55:51.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.501+0000 7f5cd10cd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ccc102ae0 0x7f5ccc19b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:51.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.501+0000 7f5cd10cd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ccc1083d0 0x7f5ccc19b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:51.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.501+0000 7f5cd10cd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ccc108d20 0x7f5ccc19bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:51.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.501+0000 7f5cd10cd640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5ccc1129e0 con 0x7f5ccc108d20 2024-09-21T00:55:51.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.501+0000 7f5cd10cd640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5ccc112860 con 0x7f5ccc102ae0 2024-09-21T00:55:51.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.501+0000 7f5cd10cd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5ccc112b60 con 0x7f5ccc1083d0 2024-09-21T00:55:51.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.501+0000 7f5ccb59e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ccc108d20 0x7f5ccc19bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:51.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.501+0000 7f5cca59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ccc1083d0 0x7f5ccc19b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:51.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.501+0000 7f5ccb59e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ccc108d20 0x7f5ccc19bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37776/0 (socket says 172.21.15.1:37776) 2024-09-21T00:55:51.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.501+0000 7f5ccb59e640 1 -- 172.21.15.1:0/3515547604 learned_addr learned my addr 172.21.15.1:0/3515547604 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:51.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.501+0000 7f5ccad9d640 1 --2- 172.21.15.1:0/3515547604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ccc102ae0 0x7f5ccc19b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:51.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.502+0000 7f5cca59c640 1 -- 172.21.15.1:0/3515547604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ccc102ae0 msgr2=0x7f5ccc19b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:51.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.502+0000 7f5cca59c640 1 --2- 172.21.15.1:0/3515547604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ccc102ae0 0x7f5ccc19b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:51.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.502+0000 7f5cca59c640 1 -- 172.21.15.1:0/3515547604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ccc108d20 msgr2=0x7f5ccc19bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:51.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.502+0000 7f5cca59c640 1 --2- 172.21.15.1:0/3515547604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ccc108d20 0x7f5ccc19bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:51.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.502+0000 7f5cca59c640 1 -- 172.21.15.1:0/3515547604 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ccc1a6560 con 0x7f5ccc1083d0 2024-09-21T00:55:51.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.502+0000 7f5ccb59e640 1 --2- 172.21.15.1:0/3515547604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ccc108d20 0x7f5ccc19bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:55:51.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.502+0000 7f5ccad9d640 1 --2- 172.21.15.1:0/3515547604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ccc102ae0 0x7f5ccc19b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:55:51.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.502+0000 7f5cca59c640 1 --2- 172.21.15.1:0/3515547604 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ccc1083d0 0x7f5ccc19b810 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc06ad30 tx=0x7f5cc000ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:51.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.502+0000 7f5cb3fff640 1 -- 172.21.15.1:0/3515547604 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc000cc40 con 0x7f5ccc1083d0 2024-09-21T00:55:51.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.502+0000 7f5cd10cd640 1 -- 172.21.15.1:0/3515547604 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ccc1a6850 con 0x7f5ccc1083d0 2024-09-21T00:55:51.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.502+0000 7f5cb3fff640 1 -- 172.21.15.1:0/3515547604 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5cc000cde0 con 0x7f5ccc1083d0 2024-09-21T00:55:51.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.502+0000 7f5cb3fff640 1 -- 172.21.15.1:0/3515547604 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc0018760 con 0x7f5ccc1083d0 2024-09-21T00:55:51.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.502+0000 7f5cd10cd640 1 -- 172.21.15.1:0/3515547604 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ccc1a6de0 con 0x7f5ccc1083d0 2024-09-21T00:55:51.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.503+0000 7f5cd10cd640 1 -- 172.21.15.1:0/3515547604 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ccc102ef0 con 0x7f5ccc1083d0 2024-09-21T00:55:51.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.505+0000 7f5cb3fff640 1 -- 172.21.15.1:0/3515547604 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7f5cc0010a90 con 0x7f5ccc1083d0 2024-09-21T00:55:51.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.506+0000 7f5cb3fff640 1 --2- 172.21.15.1:0/3515547604 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5cb40b65d0 0x7f5cb40b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:51.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.506+0000 7f5ccad9d640 1 --2- 172.21.15.1:0/3515547604 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5cb40b65d0 0x7f5cb40b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:51.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.506+0000 7f5cb3fff640 1 -- 172.21.15.1:0/3515547604 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f5cc00e7bc0 con 0x7f5ccc1083d0 2024-09-21T00:55:51.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.507+0000 7f5ccad9d640 1 --2- 172.21.15.1:0/3515547604 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5cb40b65d0 0x7f5cb40b8ae0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc000c00 tx=0x7f5cbc031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:51.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.509+0000 7f5cb3fff640 1 -- 172.21.15.1:0/3515547604 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5cc00b26b0 con 0x7f5ccc1083d0 2024-09-21T00:55:51.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.716+0000 7f5cd10cd640 1 -- 172.21.15.1:0/3515547604 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f5ccc06bc30 con 0x7f5ccc1083d0 2024-09-21T00:55:51.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.717+0000 7f5cb3fff640 1 -- 172.21.15.1:0/3515547604 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5ccc06bc30 con 0x7f5ccc1083d0 2024-09-21T00:55:51.718 INFO:teuthology.orchestra.run.smithi001.stdout:55834574923 2024-09-21T00:55:51.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.719+0000 7f5cd10cd640 1 -- 172.21.15.1:0/3515547604 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5cb40b65d0 msgr2=0x7f5cb40b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:51.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.719+0000 7f5cd10cd640 1 --2- 172.21.15.1:0/3515547604 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5cb40b65d0 0x7f5cb40b8ae0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc000c00 tx=0x7f5cbc031400 comp rx=0 tx=0).stop 2024-09-21T00:55:51.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.719+0000 7f5cd10cd640 1 -- 172.21.15.1:0/3515547604 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ccc1083d0 msgr2=0x7f5ccc19b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:51.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.720+0000 7f5cd10cd640 1 --2- 172.21.15.1:0/3515547604 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ccc1083d0 0x7f5ccc19b810 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc06ad30 tx=0x7f5cc000ee50 comp rx=0 tx=0).stop 2024-09-21T00:55:51.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.720+0000 7f5cd10cd640 1 -- 172.21.15.1:0/3515547604 shutdown_connections 2024-09-21T00:55:51.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.720+0000 7f5cd10cd640 1 --2- 172.21.15.1:0/3515547604 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5cb40b65d0 0x7f5cb40b8ae0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:51.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.720+0000 7f5cd10cd640 1 --2- 172.21.15.1:0/3515547604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ccc108d20 0x7f5ccc19bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:51.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.720+0000 7f5cd10cd640 1 --2- 172.21.15.1:0/3515547604 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ccc1083d0 0x7f5ccc19b810 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:51.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.720+0000 7f5cd10cd640 1 --2- 172.21.15.1:0/3515547604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ccc102ae0 0x7f5ccc19b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:51.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.720+0000 7f5cd10cd640 1 -- 172.21.15.1:0/3515547604 >> 172.21.15.1:0/3515547604 conn(0x7f5ccc0797b0 msgr2=0x7f5ccc106460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:51.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.720+0000 7f5cd10cd640 1 -- 172.21.15.1:0/3515547604 shutdown_connections 2024-09-21T00:55:51.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:51.720+0000 7f5cd10cd640 1 -- 172.21.15.1:0/3515547604 wait complete. 2024-09-21T00:55:51.751 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:51 smithi001 ceph-mon[31211]: pgmap v317: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-09-21T00:55:51.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:51 smithi193 ceph-mon[34660]: pgmap v317: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-09-21T00:55:51.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:51 smithi042 ceph-mon[34481]: pgmap v317: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-09-21T00:55:52.833 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:52 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/3515547604' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T00:55:52.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.688+0000 7f19b0fe6640 1 -- 172.21.15.1:0/3687182286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19ac10de90 msgr2=0x7f19ac110380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:52.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.688+0000 7f19b0fe6640 1 --2- 172.21.15.1:0/3687182286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19ac10de90 0x7f19ac110380 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f19a4009ca0 tx=0x7f19a402a8c0 comp rx=0 tx=0).stop 2024-09-21T00:55:52.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.689+0000 7f19b0fe6640 1 -- 172.21.15.1:0/3687182286 shutdown_connections 2024-09-21T00:55:52.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.689+0000 7f19b0fe6640 1 --2- 172.21.15.1:0/3687182286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19ac10de90 0x7f19ac110380 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:52.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.689+0000 7f19b0fe6640 1 --2- 172.21.15.1:0/3687182286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19ac105380 0x7f19ac10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:52.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.689+0000 7f19b0fe6640 1 --2- 172.21.15.1:0/3687182286 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19ac104a30 0x7f19ac104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:52.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.689+0000 7f19b0fe6640 1 -- 172.21.15.1:0/3687182286 >> 172.21.15.1:0/3687182286 conn(0x7f19ac079770 msgr2=0x7f19ac079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:52.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.689+0000 7f19b0fe6640 1 -- 172.21.15.1:0/3687182286 shutdown_connections 2024-09-21T00:55:52.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.689+0000 7f19b0fe6640 1 -- 172.21.15.1:0/3687182286 wait complete. 2024-09-21T00:55:52.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.689+0000 7f19b0fe6640 1 Processor -- start 2024-09-21T00:55:52.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.690+0000 7f19b0fe6640 1 -- start start 2024-09-21T00:55:52.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.690+0000 7f19b0fe6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19ac104a30 0x7f19ac19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:52.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.690+0000 7f19b0fe6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19ac105380 0x7f19ac19aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:52.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.690+0000 7f19b0fe6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19ac10de90 0x7f19ac19fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:52.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.690+0000 7f19b0fe6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f19ac113b10 con 0x7f19ac10de90 2024-09-21T00:55:52.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.690+0000 7f19b0fe6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f19ac113990 con 0x7f19ac105380 2024-09-21T00:55:52.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.690+0000 7f19b0fe6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f19ac113c90 con 0x7f19ac104a30 2024-09-21T00:55:52.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.690+0000 7f19aad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19ac10de90 0x7f19ac19fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:52.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.690+0000 7f19aad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19ac10de90 0x7f19ac19fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37798/0 (socket says 172.21.15.1:37798) 2024-09-21T00:55:52.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.690+0000 7f19aad9d640 1 -- 172.21.15.1:0/1441428009 learned_addr learned my addr 172.21.15.1:0/1441428009 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:52.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.690+0000 7f19aa59c640 1 --2- 172.21.15.1:0/1441428009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19ac104a30 0x7f19ac19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:52.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.690+0000 7f19a3fff640 1 --2- 172.21.15.1:0/1441428009 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19ac105380 0x7f19ac19aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:52.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.690+0000 7f19aad9d640 1 -- 172.21.15.1:0/1441428009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19ac104a30 msgr2=0x7f19ac19a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:52.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.690+0000 7f19aad9d640 1 --2- 172.21.15.1:0/1441428009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19ac104a30 0x7f19ac19a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:52.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.690+0000 7f19aad9d640 1 -- 172.21.15.1:0/1441428009 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19ac105380 msgr2=0x7f19ac19aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:52.940 INFO:teuthology.orchestra.run.smithi001.stdout:287762808855 2024-09-21T00:55:52.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.690+0000 7f19aad9d640 1 --2- 172.21.15.1:0/1441428009 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19ac105380 0x7f19ac19aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:52.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.690+0000 7f19aad9d640 1 -- 172.21.15.1:0/1441428009 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19ac1a0450 con 0x7f19ac10de90 2024-09-21T00:55:52.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.691+0000 7f19aad9d640 1 --2- 172.21.15.1:0/1441428009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19ac10de90 0x7f19ac19fd20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f19a4005cc0 tx=0x7f19a402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:52.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.691+0000 7f19a37fe640 1 -- 172.21.15.1:0/1441428009 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a4003bf0 con 0x7f19ac10de90 2024-09-21T00:55:52.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.691+0000 7f19a37fe640 1 -- 172.21.15.1:0/1441428009 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19a4003d90 con 0x7f19ac10de90 2024-09-21T00:55:52.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.691+0000 7f19a37fe640 1 -- 172.21.15.1:0/1441428009 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a402fbc0 con 0x7f19ac10de90 2024-09-21T00:55:52.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.691+0000 7f19b0fe6640 1 -- 172.21.15.1:0/1441428009 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19ac1a06e0 con 0x7f19ac10de90 2024-09-21T00:55:52.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.691+0000 7f19b0fe6640 1 -- 172.21.15.1:0/1441428009 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19ac1a6ea0 con 0x7f19ac10de90 2024-09-21T00:55:52.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.692+0000 7f19b0fe6640 1 -- 172.21.15.1:0/1441428009 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19ac06c260 con 0x7f19ac10de90 2024-09-21T00:55:52.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.695+0000 7f19a37fe640 1 -- 172.21.15.1:0/1441428009 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7f19a402fd60 con 0x7f19ac10de90 2024-09-21T00:55:52.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.695+0000 7f19a37fe640 1 --2- 172.21.15.1:0/1441428009 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f19980b65a0 0x7f19980b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:52.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.695+0000 7f19aa59c640 1 --2- 172.21.15.1:0/1441428009 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f19980b65a0 0x7f19980b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:52.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.696+0000 7f19aa59c640 1 --2- 172.21.15.1:0/1441428009 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f19980b65a0 0x7f19980b8ab0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f199c005fd0 tx=0x7f199c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:52.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.696+0000 7f19a37fe640 1 -- 172.21.15.1:0/1441428009 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f19a40cad30 con 0x7f19ac10de90 2024-09-21T00:55:52.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.701+0000 7f19a37fe640 1 -- 172.21.15.1:0/1441428009 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f19a40cf1c0 con 0x7f19ac10de90 2024-09-21T00:55:52.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.900+0000 7f19b0fe6640 1 -- 172.21.15.1:0/1441428009 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f19ac1a7070 con 0x7f19ac10de90 2024-09-21T00:55:52.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.900+0000 7f19a37fe640 1 -- 172.21.15.1:0/1441428009 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f19a40d35a0 con 0x7f19ac10de90 2024-09-21T00:55:52.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.902+0000 7f19b0fe6640 1 -- 172.21.15.1:0/1441428009 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f19980b65a0 msgr2=0x7f19980b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:52.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.902+0000 7f19b0fe6640 1 --2- 172.21.15.1:0/1441428009 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f19980b65a0 0x7f19980b8ab0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f199c005fd0 tx=0x7f199c00b390 comp rx=0 tx=0).stop 2024-09-21T00:55:52.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.902+0000 7f19b0fe6640 1 -- 172.21.15.1:0/1441428009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19ac10de90 msgr2=0x7f19ac19fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:52.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.902+0000 7f19b0fe6640 1 --2- 172.21.15.1:0/1441428009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19ac10de90 0x7f19ac19fd20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f19a4005cc0 tx=0x7f19a402f380 comp rx=0 tx=0).stop 2024-09-21T00:55:52.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.902+0000 7f19b0fe6640 1 -- 172.21.15.1:0/1441428009 shutdown_connections 2024-09-21T00:55:52.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.902+0000 7f19b0fe6640 1 --2- 172.21.15.1:0/1441428009 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f19980b65a0 0x7f19980b8ab0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:52.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.902+0000 7f19b0fe6640 1 --2- 172.21.15.1:0/1441428009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19ac10de90 0x7f19ac19fd20 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:52.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.902+0000 7f19b0fe6640 1 --2- 172.21.15.1:0/1441428009 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19ac105380 0x7f19ac19aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:52.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.902+0000 7f19b0fe6640 1 --2- 172.21.15.1:0/1441428009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19ac104a30 0x7f19ac19a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:52.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.902+0000 7f19b0fe6640 1 -- 172.21.15.1:0/1441428009 >> 172.21.15.1:0/1441428009 conn(0x7f19ac079770 msgr2=0x7f19ac1079b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:52.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.902+0000 7f19b0fe6640 1 -- 172.21.15.1:0/1441428009 shutdown_connections 2024-09-21T00:55:52.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:52.902+0000 7f19b0fe6640 1 -- 172.21.15.1:0/1441428009 wait complete. 2024-09-21T00:55:52.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:52 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/3515547604' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T00:55:52.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:52 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/3515547604' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T00:55:53.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.328+0000 7f77d5ac0640 1 -- 172.21.15.1:0/1732098994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77d0105330 msgr2=0x7f77d010d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:53.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.328+0000 7f77d5ac0640 1 --2- 172.21.15.1:0/1732098994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77d0105330 0x7f77d010d880 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f77c4009900 tx=0x7f77c402a3f0 comp rx=0 tx=0).stop 2024-09-21T00:55:53.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.328+0000 7f77d5ac0640 1 -- 172.21.15.1:0/1732098994 shutdown_connections 2024-09-21T00:55:53.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.328+0000 7f77d5ac0640 1 --2- 172.21.15.1:0/1732098994 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77d010de40 0x7f77d0110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:53.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.328+0000 7f77d5ac0640 1 --2- 172.21.15.1:0/1732098994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77d0105330 0x7f77d010d880 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:53.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.328+0000 7f77d5ac0640 1 --2- 172.21.15.1:0/1732098994 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77d01049e0 0x7f77d0104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:53.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.328+0000 7f77d5ac0640 1 -- 172.21.15.1:0/1732098994 >> 172.21.15.1:0/1732098994 conn(0x7f77d0079750 msgr2=0x7f77d0079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:53.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.328+0000 7f77d5ac0640 1 -- 172.21.15.1:0/1732098994 shutdown_connections 2024-09-21T00:55:53.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.328+0000 7f77d5ac0640 1 -- 172.21.15.1:0/1732098994 wait complete. 2024-09-21T00:55:53.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.329+0000 7f77d5ac0640 1 Processor -- start 2024-09-21T00:55:53.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.329+0000 7f77d5ac0640 1 -- start start 2024-09-21T00:55:53.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.329+0000 7f77d5ac0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77d01049e0 0x7f77d019a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:53.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.329+0000 7f77d5ac0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77d0105330 0x7f77d019aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:53.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.329+0000 7f77d5ac0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77d010de40 0x7f77d019fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:53.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.329+0000 7f77d5ac0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f77d0113aa0 con 0x7f77d010de40 2024-09-21T00:55:53.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.329+0000 7f77d5ac0640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f77d0113920 con 0x7f77d01049e0 2024-09-21T00:55:53.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.329+0000 7f77d5ac0640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f77d0113c20 con 0x7f77d0105330 2024-09-21T00:55:53.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.329+0000 7f77cffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77d010de40 0x7f77d019fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:53.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.329+0000 7f77cffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77d010de40 0x7f77d019fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37822/0 (socket says 172.21.15.1:37822) 2024-09-21T00:55:53.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.329+0000 7f77cffff640 1 -- 172.21.15.1:0/3986993265 learned_addr learned my addr 172.21.15.1:0/3986993265 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:53.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.329+0000 7f77ceffd640 1 --2- 172.21.15.1:0/3986993265 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77d0105330 0x7f77d019aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:53.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.329+0000 7f77cf7fe640 1 --2- 172.21.15.1:0/3986993265 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77d01049e0 0x7f77d019a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:53.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.330+0000 7f77cffff640 1 -- 172.21.15.1:0/3986993265 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77d0105330 msgr2=0x7f77d019aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:53.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.330+0000 7f77cffff640 1 --2- 172.21.15.1:0/3986993265 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77d0105330 0x7f77d019aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:53.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.330+0000 7f77cffff640 1 -- 172.21.15.1:0/3986993265 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77d01049e0 msgr2=0x7f77d019a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:53.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.330+0000 7f77cffff640 1 --2- 172.21.15.1:0/3986993265 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77d01049e0 0x7f77d019a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:53.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.330+0000 7f77cffff640 1 -- 172.21.15.1:0/3986993265 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d01a0340 con 0x7f77d010de40 2024-09-21T00:55:53.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.330+0000 7f77cffff640 1 --2- 172.21.15.1:0/3986993265 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77d010de40 0x7f77d019fcd0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f77c800eaa0 tx=0x7f77c800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:53.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.330+0000 7f77ccff9640 1 -- 172.21.15.1:0/3986993265 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c800cdb0 con 0x7f77d010de40 2024-09-21T00:55:53.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.330+0000 7f77d5ac0640 1 -- 172.21.15.1:0/3986993265 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77d01a0630 con 0x7f77d010de40 2024-09-21T00:55:53.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.330+0000 7f77ccff9640 1 -- 172.21.15.1:0/3986993265 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77c8005020 con 0x7f77d010de40 2024-09-21T00:55:53.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.330+0000 7f77ccff9640 1 -- 172.21.15.1:0/3986993265 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c80116d0 con 0x7f77d010de40 2024-09-21T00:55:53.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.330+0000 7f77d5ac0640 1 -- 172.21.15.1:0/3986993265 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77d01a6e50 con 0x7f77d010de40 2024-09-21T00:55:53.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.331+0000 7f77d5ac0640 1 -- 172.21.15.1:0/3986993265 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77d006c280 con 0x7f77d010de40 2024-09-21T00:55:53.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.333+0000 7f77ccff9640 1 -- 172.21.15.1:0/3986993265 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7f77c80054a0 con 0x7f77d010de40 2024-09-21T00:55:53.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.333+0000 7f77ccff9640 1 --2- 172.21.15.1:0/3986993265 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f77b80b65d0 0x7f77b80b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:53.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.333+0000 7f77cf7fe640 1 --2- 172.21.15.1:0/3986993265 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f77b80b65d0 0x7f77b80b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:53.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.334+0000 7f77ccff9640 1 -- 172.21.15.1:0/3986993265 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f77c80e7950 con 0x7f77d010de40 2024-09-21T00:55:53.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.334+0000 7f77cf7fe640 1 --2- 172.21.15.1:0/3986993265 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f77b80b65d0 0x7f77b80b8ae0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f77d006c980 tx=0x7f77c0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:53.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.337+0000 7f77ccff9640 1 -- 172.21.15.1:0/3986993265 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f77c8016030 con 0x7f77d010de40 2024-09-21T00:55:53.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.528+0000 7f77d5ac0640 1 -- 172.21.15.1:0/3986993265 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f77d0104df0 con 0x7f77d010de40 2024-09-21T00:55:53.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.529+0000 7f77ccff9640 1 -- 172.21.15.1:0/3986993265 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f77d0104df0 con 0x7f77d010de40 2024-09-21T00:55:53.530 INFO:teuthology.orchestra.run.smithi001.stdout:77309411399 2024-09-21T00:55:53.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.532+0000 7f77d5ac0640 1 -- 172.21.15.1:0/3986993265 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f77b80b65d0 msgr2=0x7f77b80b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:53.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.532+0000 7f77d5ac0640 1 --2- 172.21.15.1:0/3986993265 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f77b80b65d0 0x7f77b80b8ae0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f77d006c980 tx=0x7f77c0005f90 comp rx=0 tx=0).stop 2024-09-21T00:55:53.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.532+0000 7f77d5ac0640 1 -- 172.21.15.1:0/3986993265 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77d010de40 msgr2=0x7f77d019fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:53.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.532+0000 7f77d5ac0640 1 --2- 172.21.15.1:0/3986993265 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77d010de40 0x7f77d019fcd0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f77c800eaa0 tx=0x7f77c800ef60 comp rx=0 tx=0).stop 2024-09-21T00:55:53.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.532+0000 7f77d5ac0640 1 -- 172.21.15.1:0/3986993265 shutdown_connections 2024-09-21T00:55:53.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.532+0000 7f77d5ac0640 1 --2- 172.21.15.1:0/3986993265 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f77b80b65d0 0x7f77b80b8ae0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:53.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.532+0000 7f77d5ac0640 1 --2- 172.21.15.1:0/3986993265 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77d010de40 0x7f77d019fcd0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:53.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.532+0000 7f77d5ac0640 1 --2- 172.21.15.1:0/3986993265 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77d0105330 0x7f77d019aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:53.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.532+0000 7f77d5ac0640 1 --2- 172.21.15.1:0/3986993265 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77d01049e0 0x7f77d019a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:53.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.532+0000 7f77d5ac0640 1 -- 172.21.15.1:0/3986993265 >> 172.21.15.1:0/3986993265 conn(0x7f77d0079750 msgr2=0x7f77d0107960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:53.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.532+0000 7f77d5ac0640 1 -- 172.21.15.1:0/3986993265 shutdown_connections 2024-09-21T00:55:53.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:53.532+0000 7f77d5ac0640 1 -- 172.21.15.1:0/3986993265 wait complete. 2024-09-21T00:55:53.783 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:53 smithi001 ceph-mon[31211]: pgmap v318: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-21T00:55:53.783 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:53 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1441428009' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T00:55:53.783 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:53 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:55:53.783 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:53 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/3986993265' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T00:55:53.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:53 smithi193 ceph-mon[34660]: pgmap v318: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-21T00:55:53.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:53 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/1441428009' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T00:55:53.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:53 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:55:53.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:53 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/3986993265' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T00:55:53.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:53 smithi042 ceph-mon[34481]: pgmap v318: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-21T00:55:53.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:53 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/1441428009' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T00:55:53.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:53 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:55:53.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:53 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/3986993265' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T00:55:54.893 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808854 got 287762808855 for osd.11 2024-09-21T00:55:54.893 DEBUG:teuthology.parallel:result is None 2024-09-21T00:55:54.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:54 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1025904510' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T00:55:54.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:54 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/3164144275' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T00:55:54.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:54 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/1025904510' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T00:55:54.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:54 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/3164144275' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T00:55:54.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:54 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/1025904510' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T00:55:54.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:54 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/3164144275' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T00:55:55.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.059+0000 7f8f8f36b640 1 -- 172.21.15.1:0/2614297728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8f8810de60 msgr2=0x7f8f88110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:55.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.059+0000 7f8f8f36b640 1 --2- 172.21.15.1:0/2614297728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8f8810de60 0x7f8f88110330 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8f80009ca0 tx=0x7f8f8002a8c0 comp rx=0 tx=0).stop 2024-09-21T00:55:55.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.060+0000 7f8f8f36b640 1 -- 172.21.15.1:0/2614297728 shutdown_connections 2024-09-21T00:55:55.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.060+0000 7f8f8f36b640 1 --2- 172.21.15.1:0/2614297728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8f8810de60 0x7f8f88110330 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:55.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.060+0000 7f8f8f36b640 1 --2- 172.21.15.1:0/2614297728 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f88105380 0x7f8f8810d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:55.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.060+0000 7f8f8f36b640 1 --2- 172.21.15.1:0/2614297728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f88104a30 0x7f8f88104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:55.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.060+0000 7f8f8f36b640 1 -- 172.21.15.1:0/2614297728 >> 172.21.15.1:0/2614297728 conn(0x7f8f88079760 msgr2=0x7f8f88079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:55.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.060+0000 7f8f8f36b640 1 -- 172.21.15.1:0/2614297728 shutdown_connections 2024-09-21T00:55:55.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.060+0000 7f8f8f36b640 1 -- 172.21.15.1:0/2614297728 wait complete. 2024-09-21T00:55:55.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.061+0000 7f8f8f36b640 1 Processor -- start 2024-09-21T00:55:55.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.061+0000 7f8f8f36b640 1 -- start start 2024-09-21T00:55:55.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.061+0000 7f8f8f36b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8f88104a30 0x7f8f8819a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:55.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.061+0000 7f8f8f36b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f88105380 0x7f8f8819a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:55.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.061+0000 7f8f8f36b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f8810de60 0x7f8f8819fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:55.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.061+0000 7f8f8d107640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8f88104a30 0x7f8f8819a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:55.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.061+0000 7f8f8d107640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8f88104a30 0x7f8f8819a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37870/0 (socket says 172.21.15.1:37870) 2024-09-21T00:55:55.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.061+0000 7f8f8d107640 1 -- 172.21.15.1:0/1696396307 learned_addr learned my addr 172.21.15.1:0/1696396307 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:55.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.061+0000 7f8f8f36b640 1 -- 172.21.15.1:0/1696396307 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8f88113b10 con 0x7f8f88104a30 2024-09-21T00:55:55.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.061+0000 7f8f8f36b640 1 -- 172.21.15.1:0/1696396307 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8f88113990 con 0x7f8f8810de60 2024-09-21T00:55:55.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.061+0000 7f8f8f36b640 1 -- 172.21.15.1:0/1696396307 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8f88113c90 con 0x7f8f88105380 2024-09-21T00:55:55.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.061+0000 7f8f8c906640 1 --2- 172.21.15.1:0/1696396307 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f88105380 0x7f8f8819a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:55.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.061+0000 7f8f8d908640 1 --2- 172.21.15.1:0/1696396307 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f8810de60 0x7f8f8819fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:55.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.062+0000 7f8f8c906640 1 -- 172.21.15.1:0/1696396307 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f8810de60 msgr2=0x7f8f8819fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:55.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.062+0000 7f8f8c906640 1 --2- 172.21.15.1:0/1696396307 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f8810de60 0x7f8f8819fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:55.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.062+0000 7f8f8c906640 1 -- 172.21.15.1:0/1696396307 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8f88104a30 msgr2=0x7f8f8819a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:55.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.062+0000 7f8f8c906640 1 --2- 172.21.15.1:0/1696396307 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8f88104a30 0x7f8f8819a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:55.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.062+0000 7f8f8c906640 1 -- 172.21.15.1:0/1696396307 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f881a03b0 con 0x7f8f88105380 2024-09-21T00:55:55.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.062+0000 7f8f8d107640 1 --2- 172.21.15.1:0/1696396307 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8f88104a30 0x7f8f8819a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:55:55.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.062+0000 7f8f8c906640 1 --2- 172.21.15.1:0/1696396307 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f88105380 0x7f8f8819a9e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8f8806b910 tx=0x7f8f7800ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:55.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.062+0000 7f8f7e7fc640 1 -- 172.21.15.1:0/1696396307 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f7800cc40 con 0x7f8f88105380 2024-09-21T00:55:55.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.062+0000 7f8f7e7fc640 1 -- 172.21.15.1:0/1696396307 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f7800cde0 con 0x7f8f88105380 2024-09-21T00:55:55.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.062+0000 7f8f8f36b640 1 -- 172.21.15.1:0/1696396307 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f881a06a0 con 0x7f8f88105380 2024-09-21T00:55:55.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.062+0000 7f8f7e7fc640 1 -- 172.21.15.1:0/1696396307 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f78004a00 con 0x7f8f88105380 2024-09-21T00:55:55.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.062+0000 7f8f8f36b640 1 -- 172.21.15.1:0/1696396307 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f881a6e00 con 0x7f8f88105380 2024-09-21T00:55:55.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.063+0000 7f8f8f36b640 1 -- 172.21.15.1:0/1696396307 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f8806c1f0 con 0x7f8f88105380 2024-09-21T00:55:55.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.065+0000 7f8f7e7fc640 1 -- 172.21.15.1:0/1696396307 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7f8f78004ba0 con 0x7f8f88105380 2024-09-21T00:55:55.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.066+0000 7f8f7e7fc640 1 --2- 172.21.15.1:0/1696396307 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f8f740b65a0 0x7f8f740b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:55.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.066+0000 7f8f8d107640 1 --2- 172.21.15.1:0/1696396307 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f8f740b65a0 0x7f8f740b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:55.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.066+0000 7f8f7e7fc640 1 -- 172.21.15.1:0/1696396307 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f8f780e7810 con 0x7f8f88105380 2024-09-21T00:55:55.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.066+0000 7f8f8d107640 1 --2- 172.21.15.1:0/1696396307 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f8f740b65a0 0x7f8f740b8ab0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8f840058c0 tx=0x7f8f84005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:55.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.069+0000 7f8f7e7fc640 1 -- 172.21.15.1:0/1696396307 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8f780adec0 con 0x7f8f88105380 2024-09-21T00:55:55.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.281+0000 7f8f8f36b640 1 -- 172.21.15.1:0/1696396307 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f8f8819b570 con 0x7f8f88105380 2024-09-21T00:55:55.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.281+0000 7f8f7e7fc640 1 -- 172.21.15.1:0/1696396307 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f8f8819b570 con 0x7f8f88105380 2024-09-21T00:55:55.282 INFO:teuthology.orchestra.run.smithi001.stdout:219043332136 2024-09-21T00:55:55.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.283+0000 7f8f8f36b640 1 -- 172.21.15.1:0/1696396307 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f8f740b65a0 msgr2=0x7f8f740b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:55.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.283+0000 7f8f8f36b640 1 --2- 172.21.15.1:0/1696396307 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f8f740b65a0 0x7f8f740b8ab0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8f840058c0 tx=0x7f8f84005f90 comp rx=0 tx=0).stop 2024-09-21T00:55:55.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.284+0000 7f8f8f36b640 1 -- 172.21.15.1:0/1696396307 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f88105380 msgr2=0x7f8f8819a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:55.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.284+0000 7f8f8f36b640 1 --2- 172.21.15.1:0/1696396307 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f88105380 0x7f8f8819a9e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8f8806b910 tx=0x7f8f7800ee50 comp rx=0 tx=0).stop 2024-09-21T00:55:55.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.284+0000 7f8f8f36b640 1 -- 172.21.15.1:0/1696396307 shutdown_connections 2024-09-21T00:55:55.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.284+0000 7f8f8f36b640 1 --2- 172.21.15.1:0/1696396307 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f8810de60 0x7f8f8819fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:55.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.284+0000 7f8f8f36b640 1 --2- 172.21.15.1:0/1696396307 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f88105380 0x7f8f8819a9e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:55.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.284+0000 7f8f8f36b640 1 --2- 172.21.15.1:0/1696396307 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f8f740b65a0 0x7f8f740b8ab0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:55.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.284+0000 7f8f8f36b640 1 --2- 172.21.15.1:0/1696396307 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8f88104a30 0x7f8f8819a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:55.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.284+0000 7f8f8f36b640 1 -- 172.21.15.1:0/1696396307 >> 172.21.15.1:0/1696396307 conn(0x7f8f88079760 msgr2=0x7f8f88100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:55.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.284+0000 7f8f8f36b640 1 -- 172.21.15.1:0/1696396307 shutdown_connections 2024-09-21T00:55:55.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.284+0000 7f8f8f36b640 1 -- 172.21.15.1:0/1696396307 wait complete. 2024-09-21T00:55:55.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.756+0000 7ff7ceda7640 1 -- 172.21.15.1:0/2635685322 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7c8106c20 msgr2=0x7ff7c81106b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:55.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.756+0000 7ff7ceda7640 1 --2- 172.21.15.1:0/2635685322 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7c8106c20 0x7ff7c81106b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0009ca0 tx=0x7ff7c002a8c0 comp rx=0 tx=0).stop 2024-09-21T00:55:55.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.756+0000 7ff7ceda7640 1 -- 172.21.15.1:0/2635685322 shutdown_connections 2024-09-21T00:55:55.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.756+0000 7ff7ceda7640 1 --2- 172.21.15.1:0/2635685322 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7c8106c20 0x7ff7c81106b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:55.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.756+0000 7ff7ceda7640 1 --2- 172.21.15.1:0/2635685322 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7c81062d0 0x7ff7c81066e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:55.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.756+0000 7ff7ceda7640 1 --2- 172.21.15.1:0/2635685322 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7c8102080 0x7ff7c8102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:55.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.756+0000 7ff7ceda7640 1 -- 172.21.15.1:0/2635685322 >> 172.21.15.1:0/2635685322 conn(0x7ff7c8079f90 msgr2=0x7ff7c807a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:55.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.756+0000 7ff7ceda7640 1 -- 172.21.15.1:0/2635685322 shutdown_connections 2024-09-21T00:55:55.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.756+0000 7ff7ceda7640 1 -- 172.21.15.1:0/2635685322 wait complete. 2024-09-21T00:55:55.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.757+0000 7ff7ceda7640 1 Processor -- start 2024-09-21T00:55:55.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.757+0000 7ff7ceda7640 1 -- start start 2024-09-21T00:55:55.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.757+0000 7ff7ceda7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7c8102080 0x7ff7c819a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:55.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.757+0000 7ff7ceda7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7c81062d0 0x7ff7c819aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:55.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.757+0000 7ff7ceda7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7c8106c20 0x7ff7c819fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:55.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.757+0000 7ff7ceda7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c8113b10 con 0x7ff7c8102080 2024-09-21T00:55:55.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.757+0000 7ff7ceda7640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c8113990 con 0x7ff7c8106c20 2024-09-21T00:55:55.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.757+0000 7ff7ceda7640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c8113c90 con 0x7ff7c81062d0 2024-09-21T00:55:55.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.757+0000 7ff7ccb43640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7c8102080 0x7ff7c819a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:55.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.757+0000 7ff7ccb43640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7c8102080 0x7ff7c819a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37890/0 (socket says 172.21.15.1:37890) 2024-09-21T00:55:55.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.757+0000 7ff7ccb43640 1 -- 172.21.15.1:0/3928400582 learned_addr learned my addr 172.21.15.1:0/3928400582 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:55.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.757+0000 7ff7c7fff640 1 --2- 172.21.15.1:0/3928400582 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7c81062d0 0x7ff7c819aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:55.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.757+0000 7ff7cd344640 1 --2- 172.21.15.1:0/3928400582 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7c8106c20 0x7ff7c819fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:55.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.757+0000 7ff7ccb43640 1 -- 172.21.15.1:0/3928400582 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7c81062d0 msgr2=0x7ff7c819aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:55.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.757+0000 7ff7ccb43640 1 --2- 172.21.15.1:0/3928400582 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7c81062d0 0x7ff7c819aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:55.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.757+0000 7ff7ccb43640 1 -- 172.21.15.1:0/3928400582 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7c8106c20 msgr2=0x7ff7c819fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:55.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.757+0000 7ff7ccb43640 1 --2- 172.21.15.1:0/3928400582 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7c8106c20 0x7ff7c819fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:55.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.757+0000 7ff7ccb43640 1 -- 172.21.15.1:0/3928400582 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c81a0470 con 0x7ff7c8102080 2024-09-21T00:55:55.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.758+0000 7ff7ccb43640 1 --2- 172.21.15.1:0/3928400582 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7c8102080 0x7ff7c819a500 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc00e9c0 tx=0x7ff7bc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:55.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.758+0000 7ff7c5ffb640 1 -- 172.21.15.1:0/3928400582 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc00cd80 con 0x7ff7c8102080 2024-09-21T00:55:55.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.758+0000 7ff7c5ffb640 1 -- 172.21.15.1:0/3928400582 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7bc0035f0 con 0x7ff7c8102080 2024-09-21T00:55:55.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.758+0000 7ff7ceda7640 1 -- 172.21.15.1:0/3928400582 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7c81a0760 con 0x7ff7c8102080 2024-09-21T00:55:55.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.758+0000 7ff7c5ffb640 1 -- 172.21.15.1:0/3928400582 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc010690 con 0x7ff7c8102080 2024-09-21T00:55:55.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.758+0000 7ff7ceda7640 1 -- 172.21.15.1:0/3928400582 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7c81a6ec0 con 0x7ff7c8102080 2024-09-21T00:55:55.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.759+0000 7ff7ceda7640 1 -- 172.21.15.1:0/3928400582 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7c8102490 con 0x7ff7c8102080 2024-09-21T00:55:55.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.760+0000 7ff7c5ffb640 1 -- 172.21.15.1:0/3928400582 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7ff7bc004000 con 0x7ff7c8102080 2024-09-21T00:55:55.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.761+0000 7ff7c5ffb640 1 --2- 172.21.15.1:0/3928400582 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff7b80b6620 0x7ff7b80b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:55.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.761+0000 7ff7c7fff640 1 --2- 172.21.15.1:0/3928400582 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff7b80b6620 0x7ff7b80b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:55.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.761+0000 7ff7c5ffb640 1 -- 172.21.15.1:0/3928400582 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7ff7bc0e7a40 con 0x7ff7c8102080 2024-09-21T00:55:55.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.762+0000 7ff7c7fff640 1 --2- 172.21.15.1:0/3928400582 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff7b80b6620 0x7ff7b80b8b30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff7c810a290 tx=0x7ff7b4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:55.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.766+0000 7ff7c5ffb640 1 -- 172.21.15.1:0/3928400582 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff7bc0ae0f0 con 0x7ff7c8102080 2024-09-21T00:55:55.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:55 smithi001 ceph-mon[31211]: pgmap v319: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T00:55:55.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:55 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:55:55.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:55 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:55:55.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:55 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:55:55.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:55 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:55:55.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:55 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1696396307' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T00:55:55.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.962+0000 7ff7ceda7640 1 -- 172.21.15.1:0/3928400582 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7ff7c802e640 con 0x7ff7c8102080 2024-09-21T00:55:55.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.962+0000 7ff7c5ffb640 1 -- 172.21.15.1:0/3928400582 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff7bc0b24d0 con 0x7ff7c8102080 2024-09-21T00:55:55.963 INFO:teuthology.orchestra.run.smithi001.stdout:34359738449 2024-09-21T00:55:55.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.965+0000 7ff7ceda7640 1 -- 172.21.15.1:0/3928400582 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff7b80b6620 msgr2=0x7ff7b80b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:55.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.965+0000 7ff7ceda7640 1 --2- 172.21.15.1:0/3928400582 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff7b80b6620 0x7ff7b80b8b30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff7c810a290 tx=0x7ff7b4005f90 comp rx=0 tx=0).stop 2024-09-21T00:55:55.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.965+0000 7ff7ceda7640 1 -- 172.21.15.1:0/3928400582 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7c8102080 msgr2=0x7ff7c819a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:55.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.965+0000 7ff7ceda7640 1 --2- 172.21.15.1:0/3928400582 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7c8102080 0x7ff7c819a500 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc00e9c0 tx=0x7ff7bc00ee80 comp rx=0 tx=0).stop 2024-09-21T00:55:55.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.965+0000 7ff7ceda7640 1 -- 172.21.15.1:0/3928400582 shutdown_connections 2024-09-21T00:55:55.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.965+0000 7ff7ceda7640 1 --2- 172.21.15.1:0/3928400582 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7c8106c20 0x7ff7c819fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:55.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.965+0000 7ff7ceda7640 1 --2- 172.21.15.1:0/3928400582 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7c81062d0 0x7ff7c819aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:55.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.965+0000 7ff7ceda7640 1 --2- 172.21.15.1:0/3928400582 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff7b80b6620 0x7ff7b80b8b30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:55.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.965+0000 7ff7ceda7640 1 --2- 172.21.15.1:0/3928400582 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7c8102080 0x7ff7c819a500 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:55.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.965+0000 7ff7ceda7640 1 -- 172.21.15.1:0/3928400582 >> 172.21.15.1:0/3928400582 conn(0x7ff7c8079f90 msgr2=0x7ff7c8107500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:55.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.965+0000 7ff7ceda7640 1 -- 172.21.15.1:0/3928400582 shutdown_connections 2024-09-21T00:55:55.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.965+0000 7ff7ceda7640 1 -- 172.21.15.1:0/3928400582 wait complete. 2024-09-21T00:55:55.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.974+0000 7f7ff0634640 1 -- 172.21.15.1:0/2962527283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fe81049b0 msgr2=0x7f7fe8104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:55.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.974+0000 7f7ff0634640 1 --2- 172.21.15.1:0/2962527283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fe81049b0 0x7f7fe8104dc0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4009900 tx=0x7f7fe402a410 comp rx=0 tx=0).stop 2024-09-21T00:55:55.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.975+0000 7f7ff0634640 1 -- 172.21.15.1:0/2962527283 shutdown_connections 2024-09-21T00:55:55.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.975+0000 7f7ff0634640 1 --2- 172.21.15.1:0/2962527283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fe810de10 0x7f7fe8110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:55.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.975+0000 7f7ff0634640 1 --2- 172.21.15.1:0/2962527283 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7fe8105300 0x7f7fe810d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:55.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.975+0000 7f7ff0634640 1 --2- 172.21.15.1:0/2962527283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fe81049b0 0x7f7fe8104dc0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:55.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.975+0000 7f7ff0634640 1 -- 172.21.15.1:0/2962527283 >> 172.21.15.1:0/2962527283 conn(0x7f7fe8079730 msgr2=0x7f7fe8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:55.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.975+0000 7f7ff0634640 1 -- 172.21.15.1:0/2962527283 shutdown_connections 2024-09-21T00:55:55.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.975+0000 7f7ff0634640 1 -- 172.21.15.1:0/2962527283 wait complete. 2024-09-21T00:55:55.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.975+0000 7f7ff0634640 1 Processor -- start 2024-09-21T00:55:55.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.976+0000 7f7ff0634640 1 -- start start 2024-09-21T00:55:55.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.976+0000 7f7ff0634640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7fe81049b0 0x7f7fe81026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:55.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.976+0000 7f7ff0634640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fe8105300 0x7f7fe8102c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:55.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.976+0000 7f7ff0634640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fe810de10 0x7f7fe8103170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:55.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.976+0000 7f7ff0634640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe8113a70 con 0x7f7fe8105300 2024-09-21T00:55:55.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.976+0000 7f7ff0634640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe81138f0 con 0x7f7fe810de10 2024-09-21T00:55:55.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.976+0000 7f7ff0634640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe8113bf0 con 0x7f7fe81049b0 2024-09-21T00:55:55.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.976+0000 7f7fedbcf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fe8105300 0x7f7fe8102c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:55.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.976+0000 7f7fedbcf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fe8105300 0x7f7fe8102c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37914/0 (socket says 172.21.15.1:37914) 2024-09-21T00:55:55.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.976+0000 7f7fedbcf640 1 -- 172.21.15.1:0/1442208654 learned_addr learned my addr 172.21.15.1:0/1442208654 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:55.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.976+0000 7f7fee3d0640 1 --2- 172.21.15.1:0/1442208654 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7fe81049b0 0x7f7fe81026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:55.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.976+0000 7f7feebd1640 1 --2- 172.21.15.1:0/1442208654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fe810de10 0x7f7fe8103170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:55.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.977+0000 7f7feebd1640 1 -- 172.21.15.1:0/1442208654 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7fe81049b0 msgr2=0x7f7fe81026f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:55.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.977+0000 7f7feebd1640 1 --2- 172.21.15.1:0/1442208654 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7fe81049b0 0x7f7fe81026f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:55.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.977+0000 7f7feebd1640 1 -- 172.21.15.1:0/1442208654 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fe8105300 msgr2=0x7f7fe8102c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:55.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.977+0000 7f7feebd1640 1 --2- 172.21.15.1:0/1442208654 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fe8105300 0x7f7fe8102c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:55.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.977+0000 7f7feebd1640 1 -- 172.21.15.1:0/1442208654 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe81a8760 con 0x7f7fe810de10 2024-09-21T00:55:55.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.977+0000 7f7fee3d0640 1 --2- 172.21.15.1:0/1442208654 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7fe81049b0 0x7f7fe81026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:55:55.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.977+0000 7f7fedbcf640 1 --2- 172.21.15.1:0/1442208654 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fe8105300 0x7f7fe8102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:55:55.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.977+0000 7f7feebd1640 1 --2- 172.21.15.1:0/1442208654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fe810de10 0x7f7fe8103170 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7fe000e940 tx=0x7f7fe000ee00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:55.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.978+0000 7f7fdb7fe640 1 -- 172.21.15.1:0/1442208654 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe0004d20 con 0x7f7fe810de10 2024-09-21T00:55:55.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.978+0000 7f7fdb7fe640 1 -- 172.21.15.1:0/1442208654 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fe0005020 con 0x7f7fe810de10 2024-09-21T00:55:55.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.978+0000 7f7ff0634640 1 -- 172.21.15.1:0/1442208654 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fe81a8a50 con 0x7f7fe810de10 2024-09-21T00:55:55.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.978+0000 7f7fdb7fe640 1 -- 172.21.15.1:0/1442208654 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe00116d0 con 0x7f7fe810de10 2024-09-21T00:55:55.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.978+0000 7f7ff0634640 1 -- 172.21.15.1:0/1442208654 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fe81a8f90 con 0x7f7fe810de10 2024-09-21T00:55:55.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:55 smithi193 ceph-mon[34660]: pgmap v319: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T00:55:55.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:55 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:55:55.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:55 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:55:55.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:55 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:55:55.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:55 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:55:55.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:55 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/1696396307' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T00:55:55.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.979+0000 7f7ff0634640 1 -- 172.21.15.1:0/1442208654 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fe8104dc0 con 0x7f7fe810de10 2024-09-21T00:55:55.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.981+0000 7f7fdb7fe640 1 -- 172.21.15.1:0/1442208654 <== mon.2 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7f7fe0005460 con 0x7f7fe810de10 2024-09-21T00:55:55.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.982+0000 7f7fdb7fe640 1 --2- 172.21.15.1:0/1442208654 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f7fd40b6620 0x7f7fd40b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:55.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.982+0000 7f7fee3d0640 1 --2- 172.21.15.1:0/1442208654 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f7fd40b6620 0x7f7fd40b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:55.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.982+0000 7f7fdb7fe640 1 -- 172.21.15.1:0/1442208654 <== mon.2 v2:172.21.15.42:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f7fe00e7870 con 0x7f7fe810de10 2024-09-21T00:55:55.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.982+0000 7f7fee3d0640 1 --2- 172.21.15.1:0/1442208654 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f7fd40b6620 0x7f7fd40b8b30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4009230 tx=0x7f7fe4031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:55.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:55.985+0000 7f7fdb7fe640 1 -- 172.21.15.1:0/1442208654 <== mon.2 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7fe0016030 con 0x7f7fe810de10 2024-09-21T00:55:55.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:55 smithi042 ceph-mon[34481]: pgmap v319: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T00:55:55.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:55 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:55:55.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:55 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:55:55.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:55 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:55:55.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:55 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:55:55.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:55 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/1696396307' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T00:55:56.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:56.177+0000 7f7ff0634640 1 -- 172.21.15.1:0/1442208654 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f7fe81039f0 con 0x7f7fe810de10 2024-09-21T00:55:56.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:56.177+0000 7f7fdb7fe640 1 -- 172.21.15.1:0/1442208654 <== mon.2 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7fe81039f0 con 0x7f7fe810de10 2024-09-21T00:55:56.178 INFO:teuthology.orchestra.run.smithi001.stdout:103079215170 2024-09-21T00:55:56.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:56.181+0000 7f7ff0634640 1 -- 172.21.15.1:0/1442208654 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f7fd40b6620 msgr2=0x7f7fd40b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:56.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:56.181+0000 7f7ff0634640 1 --2- 172.21.15.1:0/1442208654 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f7fd40b6620 0x7f7fd40b8b30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4009230 tx=0x7f7fe4031400 comp rx=0 tx=0).stop 2024-09-21T00:55:56.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:56.181+0000 7f7ff0634640 1 -- 172.21.15.1:0/1442208654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fe810de10 msgr2=0x7f7fe8103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:56.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:56.181+0000 7f7ff0634640 1 --2- 172.21.15.1:0/1442208654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fe810de10 0x7f7fe8103170 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7fe000e940 tx=0x7f7fe000ee00 comp rx=0 tx=0).stop 2024-09-21T00:55:56.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:56.181+0000 7f7ff0634640 1 -- 172.21.15.1:0/1442208654 shutdown_connections 2024-09-21T00:55:56.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:56.181+0000 7f7ff0634640 1 --2- 172.21.15.1:0/1442208654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fe810de10 0x7f7fe8103170 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:56.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:56.181+0000 7f7ff0634640 1 --2- 172.21.15.1:0/1442208654 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f7fd40b6620 0x7f7fd40b8b30 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:56.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:56.181+0000 7f7ff0634640 1 --2- 172.21.15.1:0/1442208654 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fe8105300 0x7f7fe8102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:56.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:56.181+0000 7f7ff0634640 1 --2- 172.21.15.1:0/1442208654 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7fe81049b0 0x7f7fe81026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:56.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:56.181+0000 7f7ff0634640 1 -- 172.21.15.1:0/1442208654 >> 172.21.15.1:0/1442208654 conn(0x7f7fe8079730 msgr2=0x7f7fe80ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:56.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:56.181+0000 7f7ff0634640 1 -- 172.21.15.1:0/1442208654 shutdown_connections 2024-09-21T00:55:56.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:56.181+0000 7f7ff0634640 1 -- 172.21.15.1:0/1442208654 wait complete. 2024-09-21T00:55:56.625 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738446 got 34359738449 for osd.0 2024-09-21T00:55:56.625 DEBUG:teuthology.parallel:result is None 2024-09-21T00:55:56.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:56 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/3928400582' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T00:55:56.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:56 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1442208654' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T00:55:56.977 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411398 got 77309411399 for osd.2 2024-09-21T00:55:56.978 DEBUG:teuthology.parallel:result is None 2024-09-21T00:55:56.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:56 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/3928400582' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T00:55:56.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:56 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/1442208654' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T00:55:56.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:56 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/3928400582' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T00:55:56.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:56 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/1442208654' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T00:55:57.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.292+0000 7f2567593640 1 -- 172.21.15.1:0/2592632064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2560102a60 msgr2=0x7f2560102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.292+0000 7f2567593640 1 --2- 172.21.15.1:0/2592632064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2560102a60 0x7f2560102e70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f255c009900 tx=0x7f255c02a410 comp rx=0 tx=0).stop 2024-09-21T00:55:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.292+0000 7f2567593640 1 -- 172.21.15.1:0/2592632064 shutdown_connections 2024-09-21T00:55:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.292+0000 7f2567593640 1 --2- 172.21.15.1:0/2592632064 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2560108cf0 0x7f256010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.292+0000 7f2567593640 1 --2- 172.21.15.1:0/2592632064 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f25601083a0 0x7f25601087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.292+0000 7f2567593640 1 --2- 172.21.15.1:0/2592632064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2560102a60 0x7f2560102e70 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.292+0000 7f2567593640 1 -- 172.21.15.1:0/2592632064 >> 172.21.15.1:0/2592632064 conn(0x7f2560079730 msgr2=0x7f2560079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.292+0000 7f2567593640 1 -- 172.21.15.1:0/2592632064 shutdown_connections 2024-09-21T00:55:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.292+0000 7f2567593640 1 -- 172.21.15.1:0/2592632064 wait complete. 2024-09-21T00:55:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.293+0000 7f2567593640 1 Processor -- start 2024-09-21T00:55:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.293+0000 7f2567593640 1 -- start start 2024-09-21T00:55:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.293+0000 7f2567593640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2560102a60 0x7f256019a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.293+0000 7f2567593640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25601083a0 0x7f256019a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.293+0000 7f2567593640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2560108cf0 0x7f256019fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.293+0000 7f2567593640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2560113a80 con 0x7f25601083a0 2024-09-21T00:55:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.293+0000 7f2567593640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2560113900 con 0x7f2560102a60 2024-09-21T00:55:57.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.293+0000 7f2567593640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2560113c00 con 0x7f2560108cf0 2024-09-21T00:55:57.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.293+0000 7f2564b2e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25601083a0 0x7f256019a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:57.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.294+0000 7f2564b2e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25601083a0 0x7f256019a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37858/0 (socket says 172.21.15.1:37858) 2024-09-21T00:55:57.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.294+0000 7f2564b2e640 1 -- 172.21.15.1:0/3164144275 learned_addr learned my addr 172.21.15.1:0/3164144275 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:57.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.294+0000 7f256532f640 1 --2- 172.21.15.1:0/3164144275 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2560102a60 0x7f256019a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:57.336 INFO:teuthology.orchestra.run.smithi001.stdout:171798691889 2024-09-21T00:55:57.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.294+0000 7f2565b30640 1 --2- 172.21.15.1:0/3164144275 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2560108cf0 0x7f256019fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:57.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.294+0000 7f2564b2e640 1 -- 172.21.15.1:0/3164144275 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2560108cf0 msgr2=0x7f256019fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:57.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.294+0000 7f2564b2e640 1 --2- 172.21.15.1:0/3164144275 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2560108cf0 0x7f256019fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:57.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.294+0000 7f2564b2e640 1 -- 172.21.15.1:0/3164144275 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2560102a60 msgr2=0x7f256019a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:57.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.294+0000 7f2564b2e640 1 --2- 172.21.15.1:0/3164144275 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2560102a60 0x7f256019a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:57.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.294+0000 7f2564b2e640 1 -- 172.21.15.1:0/3164144275 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25601a0380 con 0x7f25601083a0 2024-09-21T00:55:57.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.294+0000 7f256532f640 1 --2- 172.21.15.1:0/3164144275 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2560102a60 0x7f256019a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:55:57.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.294+0000 7f2564b2e640 1 --2- 172.21.15.1:0/3164144275 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25601083a0 0x7f256019a9b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f255000e9c0 tx=0x7f255000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:57.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.294+0000 7f25567fc640 1 -- 172.21.15.1:0/3164144275 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255000cd80 con 0x7f25601083a0 2024-09-21T00:55:57.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.294+0000 7f25567fc640 1 -- 172.21.15.1:0/3164144275 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25500054d0 con 0x7f25601083a0 2024-09-21T00:55:57.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.294+0000 7f25567fc640 1 -- 172.21.15.1:0/3164144275 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2550010430 con 0x7f25601083a0 2024-09-21T00:55:57.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.294+0000 7f2567593640 1 -- 172.21.15.1:0/3164144275 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25601a0670 con 0x7f25601083a0 2024-09-21T00:55:57.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.294+0000 7f2567593640 1 -- 172.21.15.1:0/3164144275 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25601a6dd0 con 0x7f25601083a0 2024-09-21T00:55:57.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.295+0000 7f2567593640 1 -- 172.21.15.1:0/3164144275 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2560102e70 con 0x7f25601083a0 2024-09-21T00:55:57.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.297+0000 7f25567fc640 1 -- 172.21.15.1:0/3164144275 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7f2550004fb0 con 0x7f25601083a0 2024-09-21T00:55:57.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.298+0000 7f25567fc640 1 --2- 172.21.15.1:0/3164144275 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f254c0b6620 0x7f254c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:57.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.298+0000 7f256532f640 1 --2- 172.21.15.1:0/3164144275 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f254c0b6620 0x7f254c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:57.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.298+0000 7f25567fc640 1 -- 172.21.15.1:0/3164144275 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f25500e7b90 con 0x7f25601083a0 2024-09-21T00:55:57.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.299+0000 7f256532f640 1 --2- 172.21.15.1:0/3164144275 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f254c0b6620 0x7f254c0b8b30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f255c031440 tx=0x7f255c009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:57.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.302+0000 7f25567fc640 1 -- 172.21.15.1:0/3164144275 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2550056710 con 0x7f25601083a0 2024-09-21T00:55:57.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.506+0000 7f2567593640 1 -- 172.21.15.1:0/3164144275 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f256019b540 con 0x7f25601083a0 2024-09-21T00:55:57.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.506+0000 7f25567fc640 1 -- 172.21.15.1:0/3164144275 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f256019b540 con 0x7f25601083a0 2024-09-21T00:55:57.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.509+0000 7f2567593640 1 -- 172.21.15.1:0/3164144275 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f254c0b6620 msgr2=0x7f254c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:57.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.509+0000 7f2567593640 1 --2- 172.21.15.1:0/3164144275 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f254c0b6620 0x7f254c0b8b30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f255c031440 tx=0x7f255c009680 comp rx=0 tx=0).stop 2024-09-21T00:55:57.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.509+0000 7f2567593640 1 -- 172.21.15.1:0/3164144275 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25601083a0 msgr2=0x7f256019a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:57.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.509+0000 7f2567593640 1 --2- 172.21.15.1:0/3164144275 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25601083a0 0x7f256019a9b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f255000e9c0 tx=0x7f255000ee80 comp rx=0 tx=0).stop 2024-09-21T00:55:57.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.509+0000 7f2567593640 1 -- 172.21.15.1:0/3164144275 shutdown_connections 2024-09-21T00:55:57.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.509+0000 7f2567593640 1 --2- 172.21.15.1:0/3164144275 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2560108cf0 0x7f256019fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:57.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.509+0000 7f2567593640 1 --2- 172.21.15.1:0/3164144275 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f254c0b6620 0x7f254c0b8b30 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:57.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.509+0000 7f2567593640 1 --2- 172.21.15.1:0/3164144275 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25601083a0 0x7f256019a9b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:57.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.509+0000 7f2567593640 1 --2- 172.21.15.1:0/3164144275 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2560102a60 0x7f256019a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:57.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.509+0000 7f2567593640 1 -- 172.21.15.1:0/3164144275 >> 172.21.15.1:0/3164144275 conn(0x7f2560079730 msgr2=0x7f2560101450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:57.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.509+0000 7f2567593640 1 -- 172.21.15.1:0/3164144275 shutdown_connections 2024-09-21T00:55:57.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.509+0000 7f2567593640 1 -- 172.21.15.1:0/3164144275 wait complete. 2024-09-21T00:55:57.923 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:57 smithi001 ceph-mon[31211]: pgmap v320: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-09-21T00:55:57.923 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:57 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/2008147112' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T00:55:57.951 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691886 got 171798691889 for osd.6 2024-09-21T00:55:57.951 DEBUG:teuthology.parallel:result is None 2024-09-21T00:55:57.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:57 smithi193 ceph-mon[34660]: pgmap v320: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-09-21T00:55:57.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:57 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/2008147112' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T00:55:57.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:57 smithi042 ceph-mon[34481]: pgmap v320: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-09-21T00:55:57.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:57 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/2008147112' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T00:55:58.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.182+0000 7fa61436c640 1 -- 172.21.15.1:0/427307660 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa60c102a60 msgr2=0x7fa60c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:58.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.182+0000 7fa61436c640 1 --2- 172.21.15.1:0/427307660 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa60c102a60 0x7fa60c102e70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa608009900 tx=0x7fa60802a410 comp rx=0 tx=0).stop 2024-09-21T00:55:58.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.183+0000 7fa61436c640 1 -- 172.21.15.1:0/427307660 shutdown_connections 2024-09-21T00:55:58.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.183+0000 7fa61436c640 1 --2- 172.21.15.1:0/427307660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa60c108cf0 0x7fa60c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:58.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.183+0000 7fa61436c640 1 --2- 172.21.15.1:0/427307660 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa60c1083a0 0x7fa60c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:58.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.183+0000 7fa61436c640 1 --2- 172.21.15.1:0/427307660 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa60c102a60 0x7fa60c102e70 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:58.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.183+0000 7fa61436c640 1 -- 172.21.15.1:0/427307660 >> 172.21.15.1:0/427307660 conn(0x7fa60c079730 msgr2=0x7fa60c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:58.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.183+0000 7fa61436c640 1 -- 172.21.15.1:0/427307660 shutdown_connections 2024-09-21T00:55:58.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.183+0000 7fa61436c640 1 -- 172.21.15.1:0/427307660 wait complete. 2024-09-21T00:55:58.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.183+0000 7fa61436c640 1 Processor -- start 2024-09-21T00:55:58.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.184+0000 7fa61436c640 1 -- start start 2024-09-21T00:55:58.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.184+0000 7fa61436c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa60c102a60 0x7fa60c104480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:58.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.184+0000 7fa61436c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa60c1083a0 0x7fa60c1049c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:58.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.184+0000 7fa61436c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa60c108cf0 0x7fa60c104f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:58.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.184+0000 7fa61436c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c112960 con 0x7fa60c102a60 2024-09-21T00:55:58.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.184+0000 7fa61436c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c1127e0 con 0x7fa60c108cf0 2024-09-21T00:55:58.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.184+0000 7fa61436c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c112ae0 con 0x7fa60c1083a0 2024-09-21T00:55:58.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.184+0000 7fa612108640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa60c102a60 0x7fa60c104480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:58.238 INFO:teuthology.orchestra.run.smithi001.stdout:193273528364 2024-09-21T00:55:58.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.184+0000 7fa612108640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa60c102a60 0x7fa60c104480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37840/0 (socket says 172.21.15.1:37840) 2024-09-21T00:55:58.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.184+0000 7fa612108640 1 -- 172.21.15.1:0/1025904510 learned_addr learned my addr 172.21.15.1:0/1025904510 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:58.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.184+0000 7fa611907640 1 --2- 172.21.15.1:0/1025904510 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa60c1083a0 0x7fa60c1049c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:58.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.184+0000 7fa612909640 1 --2- 172.21.15.1:0/1025904510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa60c108cf0 0x7fa60c104f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:58.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.184+0000 7fa612108640 1 -- 172.21.15.1:0/1025904510 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa60c1083a0 msgr2=0x7fa60c1049c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:58.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.184+0000 7fa612108640 1 --2- 172.21.15.1:0/1025904510 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa60c1083a0 0x7fa60c1049c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:58.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.184+0000 7fa612108640 1 -- 172.21.15.1:0/1025904510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa60c108cf0 msgr2=0x7fa60c104f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:58.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.184+0000 7fa612108640 1 --2- 172.21.15.1:0/1025904510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa60c108cf0 0x7fa60c104f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:58.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.184+0000 7fa612108640 1 -- 172.21.15.1:0/1025904510 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa60c1a8720 con 0x7fa60c102a60 2024-09-21T00:55:58.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.184+0000 7fa612108640 1 --2- 172.21.15.1:0/1025904510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa60c102a60 0x7fa60c104480 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa608005940 tx=0x7fa608004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:58.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.185+0000 7fa6037fe640 1 -- 172.21.15.1:0/1025904510 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60803f030 con 0x7fa60c102a60 2024-09-21T00:55:58.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.185+0000 7fa61436c640 1 -- 172.21.15.1:0/1025904510 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa60c1a89b0 con 0x7fa60c102a60 2024-09-21T00:55:58.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.185+0000 7fa6037fe640 1 -- 172.21.15.1:0/1025904510 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa608003aa0 con 0x7fa60c102a60 2024-09-21T00:55:58.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.185+0000 7fa6037fe640 1 -- 172.21.15.1:0/1025904510 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa608035070 con 0x7fa60c102a60 2024-09-21T00:55:58.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.185+0000 7fa61436c640 1 -- 172.21.15.1:0/1025904510 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa60c1a8e90 con 0x7fa60c102a60 2024-09-21T00:55:58.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.186+0000 7fa61436c640 1 -- 172.21.15.1:0/1025904510 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa60c102e70 con 0x7fa60c102a60 2024-09-21T00:55:58.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.188+0000 7fa6037fe640 1 -- 172.21.15.1:0/1025904510 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7fa608042030 con 0x7fa60c102a60 2024-09-21T00:55:58.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.189+0000 7fa6037fe640 1 --2- 172.21.15.1:0/1025904510 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa5f80b65a0 0x7fa5f80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:58.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.189+0000 7fa611907640 1 --2- 172.21.15.1:0/1025904510 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa5f80b65a0 0x7fa5f80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:58.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.189+0000 7fa6037fe640 1 -- 172.21.15.1:0/1025904510 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fa608107e10 con 0x7fa60c102a60 2024-09-21T00:55:58.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.189+0000 7fa611907640 1 --2- 172.21.15.1:0/1025904510 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa5f80b65a0 0x7fa5f80b8ab0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa60c100b70 tx=0x7fa5fc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:58.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.192+0000 7fa6037fe640 1 -- 172.21.15.1:0/1025904510 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa6080d2900 con 0x7fa60c102a60 2024-09-21T00:55:58.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.385+0000 7fa61436c640 1 -- 172.21.15.1:0/1025904510 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fa60c1a9220 con 0x7fa60c102a60 2024-09-21T00:55:58.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.386+0000 7fa6037fe640 1 -- 172.21.15.1:0/1025904510 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa6080d7840 con 0x7fa60c102a60 2024-09-21T00:55:58.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.389+0000 7fa61436c640 1 -- 172.21.15.1:0/1025904510 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa5f80b65a0 msgr2=0x7fa5f80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:58.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.389+0000 7fa61436c640 1 --2- 172.21.15.1:0/1025904510 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa5f80b65a0 0x7fa5f80b8ab0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa60c100b70 tx=0x7fa5fc005f90 comp rx=0 tx=0).stop 2024-09-21T00:55:58.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.389+0000 7fa61436c640 1 -- 172.21.15.1:0/1025904510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa60c102a60 msgr2=0x7fa60c104480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:58.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.389+0000 7fa61436c640 1 --2- 172.21.15.1:0/1025904510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa60c102a60 0x7fa60c104480 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa608005940 tx=0x7fa608004270 comp rx=0 tx=0).stop 2024-09-21T00:55:58.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.389+0000 7fa61436c640 1 -- 172.21.15.1:0/1025904510 shutdown_connections 2024-09-21T00:55:58.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.389+0000 7fa61436c640 1 --2- 172.21.15.1:0/1025904510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa60c108cf0 0x7fa60c104f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:58.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.389+0000 7fa61436c640 1 --2- 172.21.15.1:0/1025904510 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa60c1083a0 0x7fa60c1049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:58.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.389+0000 7fa61436c640 1 --2- 172.21.15.1:0/1025904510 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa5f80b65a0 0x7fa5f80b8ab0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:58.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.389+0000 7fa61436c640 1 --2- 172.21.15.1:0/1025904510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa60c102a60 0x7fa60c104480 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:58.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.389+0000 7fa61436c640 1 -- 172.21.15.1:0/1025904510 >> 172.21.15.1:0/1025904510 conn(0x7fa60c079730 msgr2=0x7fa60c106850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:58.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.389+0000 7fa61436c640 1 -- 172.21.15.1:0/1025904510 shutdown_connections 2024-09-21T00:55:58.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:54.389+0000 7fa61436c640 1 -- 172.21.15.1:0/1025904510 wait complete. 2024-09-21T00:55:58.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.217+0000 7f2aa1240640 1 -- 172.21.15.1:0/3040434015 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a9c105300 msgr2=0x7f2a9c10d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:58.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.217+0000 7f2aa1240640 1 --2- 172.21.15.1:0/3040434015 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a9c105300 0x7f2a9c10d850 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2a90009900 tx=0x7f2a9002a410 comp rx=0 tx=0).stop 2024-09-21T00:55:58.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.217+0000 7f2aa1240640 1 -- 172.21.15.1:0/3040434015 shutdown_connections 2024-09-21T00:55:58.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.217+0000 7f2aa1240640 1 --2- 172.21.15.1:0/3040434015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a9c10de10 0x7f2a9c110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:58.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.217+0000 7f2aa1240640 1 --2- 172.21.15.1:0/3040434015 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a9c105300 0x7f2a9c10d850 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:58.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.217+0000 7f2aa1240640 1 --2- 172.21.15.1:0/3040434015 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2a9c1049b0 0x7f2a9c104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:58.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.217+0000 7f2aa1240640 1 -- 172.21.15.1:0/3040434015 >> 172.21.15.1:0/3040434015 conn(0x7f2a9c079730 msgr2=0x7f2a9c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:58.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.217+0000 7f2aa1240640 1 -- 172.21.15.1:0/3040434015 shutdown_connections 2024-09-21T00:55:58.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.217+0000 7f2aa1240640 1 -- 172.21.15.1:0/3040434015 wait complete. 2024-09-21T00:55:58.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.218+0000 7f2aa1240640 1 Processor -- start 2024-09-21T00:55:58.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.218+0000 7f2aa1240640 1 -- start start 2024-09-21T00:55:58.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.218+0000 7f2aa1240640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a9c1049b0 0x7f2a9c19a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:58.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.218+0000 7f2aa1240640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a9c105300 0x7f2a9c19aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:58.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.218+0000 7f2aa1240640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2a9c10de10 0x7f2a9c19fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:58.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.218+0000 7f2aa1240640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9c113a70 con 0x7f2a9c105300 2024-09-21T00:55:58.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.218+0000 7f2aa1240640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9c1138f0 con 0x7f2a9c1049b0 2024-09-21T00:55:58.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.218+0000 7f2aa1240640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9c113bf0 con 0x7f2a9c10de10 2024-09-21T00:55:58.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.218+0000 7f2a9a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a9c105300 0x7f2a9c19aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:58.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.218+0000 7f2a9a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a9c105300 0x7f2a9c19aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37940/0 (socket says 172.21.15.1:37940) 2024-09-21T00:55:58.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.218+0000 7f2a9a59c640 1 -- 172.21.15.1:0/3209182812 learned_addr learned my addr 172.21.15.1:0/3209182812 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:58.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.219+0000 7f2a9b59e640 1 --2- 172.21.15.1:0/3209182812 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2a9c10de10 0x7f2a9c19fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:58.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.219+0000 7f2a9ad9d640 1 --2- 172.21.15.1:0/3209182812 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a9c1049b0 0x7f2a9c19a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:58.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.219+0000 7f2a9a59c640 1 -- 172.21.15.1:0/3209182812 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2a9c10de10 msgr2=0x7f2a9c19fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:58.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.219+0000 7f2a9a59c640 1 --2- 172.21.15.1:0/3209182812 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2a9c10de10 0x7f2a9c19fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:58.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.219+0000 7f2a9a59c640 1 -- 172.21.15.1:0/3209182812 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a9c1049b0 msgr2=0x7f2a9c19a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:58.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.219+0000 7f2a9a59c640 1 --2- 172.21.15.1:0/3209182812 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a9c1049b0 0x7f2a9c19a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:58.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.219+0000 7f2a9a59c640 1 -- 172.21.15.1:0/3209182812 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a9c1a0430 con 0x7f2a9c105300 2024-09-21T00:55:58.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.219+0000 7f2a9ad9d640 1 --2- 172.21.15.1:0/3209182812 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a9c1049b0 0x7f2a9c19a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:55:58.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.219+0000 7f2a9a59c640 1 --2- 172.21.15.1:0/3209182812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a9c105300 0x7f2a9c19aa60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2a9002a930 tx=0x7f2a90004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:58.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.219+0000 7f2a83fff640 1 -- 172.21.15.1:0/3209182812 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9003f030 con 0x7f2a9c105300 2024-09-21T00:55:58.564 INFO:teuthology.orchestra.run.smithi001.stdout:146028888119 2024-09-21T00:55:58.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.219+0000 7f2aa1240640 1 -- 172.21.15.1:0/3209182812 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a9c1a06c0 con 0x7f2a9c105300 2024-09-21T00:55:58.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.219+0000 7f2a83fff640 1 -- 172.21.15.1:0/3209182812 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a90003aa0 con 0x7f2a9c105300 2024-09-21T00:55:58.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.219+0000 7f2a83fff640 1 -- 172.21.15.1:0/3209182812 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a90035070 con 0x7f2a9c105300 2024-09-21T00:55:58.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.219+0000 7f2aa1240640 1 -- 172.21.15.1:0/3209182812 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a9c1a6e80 con 0x7f2a9c105300 2024-09-21T00:55:58.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.220+0000 7f2aa1240640 1 -- 172.21.15.1:0/3209182812 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a9c06b560 con 0x7f2a9c105300 2024-09-21T00:55:58.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.223+0000 7f2a83fff640 1 -- 172.21.15.1:0/3209182812 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7f2a90042030 con 0x7f2a9c105300 2024-09-21T00:55:58.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.223+0000 7f2a83fff640 1 --2- 172.21.15.1:0/3209182812 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f2a840b65a0 0x7f2a840b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:58.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.224+0000 7f2a9ad9d640 1 --2- 172.21.15.1:0/3209182812 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f2a840b65a0 0x7f2a840b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:58.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.224+0000 7f2a83fff640 1 -- 172.21.15.1:0/3209182812 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f2a90107f50 con 0x7f2a9c105300 2024-09-21T00:55:58.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.224+0000 7f2a9ad9d640 1 --2- 172.21.15.1:0/3209182812 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f2a840b65a0 0x7f2a840b8ab0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c0058c0 tx=0x7f2a8c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:58.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.227+0000 7f2a83fff640 1 -- 172.21.15.1:0/3209182812 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2a900ce660 con 0x7f2a9c105300 2024-09-21T00:55:58.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.419+0000 7f2aa1240640 1 -- 172.21.15.1:0/3209182812 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f2a9c108f10 con 0x7f2a9c105300 2024-09-21T00:55:58.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.419+0000 7f2a83fff640 1 -- 172.21.15.1:0/3209182812 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f2a900d2a40 con 0x7f2a9c105300 2024-09-21T00:55:58.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.422+0000 7f2aa1240640 1 -- 172.21.15.1:0/3209182812 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f2a840b65a0 msgr2=0x7f2a840b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:58.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.422+0000 7f2aa1240640 1 --2- 172.21.15.1:0/3209182812 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f2a840b65a0 0x7f2a840b8ab0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c0058c0 tx=0x7f2a8c005850 comp rx=0 tx=0).stop 2024-09-21T00:55:58.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.422+0000 7f2aa1240640 1 -- 172.21.15.1:0/3209182812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a9c105300 msgr2=0x7f2a9c19aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:58.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.422+0000 7f2aa1240640 1 --2- 172.21.15.1:0/3209182812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a9c105300 0x7f2a9c19aa60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2a9002a930 tx=0x7f2a90004270 comp rx=0 tx=0).stop 2024-09-21T00:55:58.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.422+0000 7f2aa1240640 1 -- 172.21.15.1:0/3209182812 shutdown_connections 2024-09-21T00:55:58.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.422+0000 7f2aa1240640 1 --2- 172.21.15.1:0/3209182812 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2a9c10de10 0x7f2a9c19fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:58.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.422+0000 7f2aa1240640 1 --2- 172.21.15.1:0/3209182812 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f2a840b65a0 0x7f2a840b8ab0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:58.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.422+0000 7f2aa1240640 1 --2- 172.21.15.1:0/3209182812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a9c105300 0x7f2a9c19aa60 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:58.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.422+0000 7f2aa1240640 1 --2- 172.21.15.1:0/3209182812 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a9c1049b0 0x7f2a9c19a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:58.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.422+0000 7f2aa1240640 1 -- 172.21.15.1:0/3209182812 >> 172.21.15.1:0/3209182812 conn(0x7f2a9c079730 msgr2=0x7f2a9c100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:58.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.422+0000 7f2aa1240640 1 -- 172.21.15.1:0/3209182812 shutdown_connections 2024-09-21T00:55:58.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:58.422+0000 7f2aa1240640 1 -- 172.21.15.1:0/3209182812 wait complete. 2024-09-21T00:55:58.866 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:58 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/3209182812' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T00:55:58.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:58 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/3209182812' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T00:55:58.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:58 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/3209182812' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T00:55:59.165 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888117 got 146028888119 for osd.5 2024-09-21T00:55:59.166 DEBUG:teuthology.parallel:result is None 2024-09-21T00:55:59.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.719+0000 7feafd46d640 1 -- 172.21.15.1:0/128621178 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feaf81049c0 msgr2=0x7feaf8104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:59.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.719+0000 7feafd46d640 1 --2- 172.21.15.1:0/128621178 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feaf81049c0 0x7feaf8104dd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7feae8009ca0 tx=0x7feae802a8e0 comp rx=0 tx=0).stop 2024-09-21T00:55:59.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.719+0000 7feafd46d640 1 -- 172.21.15.1:0/128621178 shutdown_connections 2024-09-21T00:55:59.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.719+0000 7feafd46d640 1 --2- 172.21.15.1:0/128621178 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feaf810de20 0x7feaf8110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:59.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.719+0000 7feafd46d640 1 --2- 172.21.15.1:0/128621178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feaf8105310 0x7feaf810d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:59.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.719+0000 7feafd46d640 1 --2- 172.21.15.1:0/128621178 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feaf81049c0 0x7feaf8104dd0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:59.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.719+0000 7feafd46d640 1 -- 172.21.15.1:0/128621178 >> 172.21.15.1:0/128621178 conn(0x7feaf8079730 msgr2=0x7feaf8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:59.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.719+0000 7feafd46d640 1 -- 172.21.15.1:0/128621178 shutdown_connections 2024-09-21T00:55:59.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.719+0000 7feafd46d640 1 -- 172.21.15.1:0/128621178 wait complete. 2024-09-21T00:55:59.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.719+0000 7feafd46d640 1 Processor -- start 2024-09-21T00:55:59.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.720+0000 7feafd46d640 1 -- start start 2024-09-21T00:55:59.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.720+0000 7feafd46d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feaf81049c0 0x7feaf819a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:59.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.720+0000 7feafd46d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feaf8105310 0x7feaf819aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:59.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.720+0000 7feafd46d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feaf810de20 0x7feaf819fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:59.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.720+0000 7feafd46d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7feaf8113ae0 con 0x7feaf810de20 2024-09-21T00:55:59.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.720+0000 7feafd46d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7feaf8113960 con 0x7feaf8105310 2024-09-21T00:55:59.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.720+0000 7feafd46d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7feaf8113c60 con 0x7feaf81049c0 2024-09-21T00:55:59.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.720+0000 7feaf77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feaf810de20 0x7feaf819fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:59.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.720+0000 7feaf77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feaf810de20 0x7feaf819fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48116/0 (socket says 172.21.15.1:48116) 2024-09-21T00:55:59.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.720+0000 7feaf77fe640 1 -- 172.21.15.1:0/1610150591 learned_addr learned my addr 172.21.15.1:0/1610150591 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:59.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.720+0000 7feaf67fc640 1 --2- 172.21.15.1:0/1610150591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feaf8105310 0x7feaf819aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:59.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.720+0000 7feaf6ffd640 1 --2- 172.21.15.1:0/1610150591 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feaf81049c0 0x7feaf819a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:59.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.720+0000 7feaf77fe640 1 -- 172.21.15.1:0/1610150591 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feaf81049c0 msgr2=0x7feaf819a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:59.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.720+0000 7feaf77fe640 1 --2- 172.21.15.1:0/1610150591 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feaf81049c0 0x7feaf819a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:59.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.720+0000 7feaf77fe640 1 -- 172.21.15.1:0/1610150591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feaf8105310 msgr2=0x7feaf819aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:59.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.720+0000 7feaf77fe640 1 --2- 172.21.15.1:0/1610150591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feaf8105310 0x7feaf819aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:59.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.720+0000 7feaf77fe640 1 -- 172.21.15.1:0/1610150591 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf81a0420 con 0x7feaf810de20 2024-09-21T00:55:59.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.720+0000 7feaf67fc640 1 --2- 172.21.15.1:0/1610150591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feaf8105310 0x7feaf819aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:55:59.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.721+0000 7feaf77fe640 1 --2- 172.21.15.1:0/1610150591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feaf810de20 0x7feaf819fcf0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7feaf000d750 tx=0x7feaf000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:59.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.721+0000 7feadffff640 1 -- 172.21.15.1:0/1610150591 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf0017070 con 0x7feaf810de20 2024-09-21T00:55:59.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.721+0000 7feadffff640 1 -- 172.21.15.1:0/1610150591 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feaf00054d0 con 0x7feaf810de20 2024-09-21T00:55:59.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.721+0000 7feafd46d640 1 -- 172.21.15.1:0/1610150591 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaf81a0710 con 0x7feaf810de20 2024-09-21T00:55:59.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.721+0000 7feadffff640 1 -- 172.21.15.1:0/1610150591 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf0004c60 con 0x7feaf810de20 2024-09-21T00:55:59.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.721+0000 7feafd46d640 1 -- 172.21.15.1:0/1610150591 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaf81a6e70 con 0x7feaf810de20 2024-09-21T00:55:59.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.722+0000 7feafd46d640 1 -- 172.21.15.1:0/1610150591 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaf806c1e0 con 0x7feaf810de20 2024-09-21T00:55:59.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.724+0000 7feadffff640 1 -- 172.21.15.1:0/1610150591 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7feaf0009bd0 con 0x7feaf810de20 2024-09-21T00:55:59.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.725+0000 7feadffff640 1 --2- 172.21.15.1:0/1610150591 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7feae00b65a0 0x7feae00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:59.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.725+0000 7feaf6ffd640 1 --2- 172.21.15.1:0/1610150591 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7feae00b65a0 0x7feae00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:59.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.725+0000 7feadffff640 1 -- 172.21.15.1:0/1610150591 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7feaf00e7310 con 0x7feaf810de20 2024-09-21T00:55:59.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.725+0000 7feaf6ffd640 1 --2- 172.21.15.1:0/1610150591 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7feae00b65a0 0x7feae00b8ab0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7feae8000f80 tx=0x7feae80093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:59.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.728+0000 7feadffff640 1 -- 172.21.15.1:0/1610150591 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feaf00ada20 con 0x7feaf810de20 2024-09-21T00:55:59.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.327+0000 7f14cee70640 1 -- 172.21.15.1:0/1282647762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14c81083a0 msgr2=0x7f14c81087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:59.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.327+0000 7f14cee70640 1 --2- 172.21.15.1:0/1282647762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14c81083a0 0x7f14c81087b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f14b0009900 tx=0x7f14b002a410 comp rx=0 tx=0).stop 2024-09-21T00:55:59.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.327+0000 7f14cee70640 1 -- 172.21.15.1:0/1282647762 shutdown_connections 2024-09-21T00:55:59.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.327+0000 7f14cee70640 1 --2- 172.21.15.1:0/1282647762 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f14c8108cf0 0x7f14c810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:59.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.327+0000 7f14cee70640 1 --2- 172.21.15.1:0/1282647762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14c81083a0 0x7f14c81087b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:59.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.327+0000 7f14cee70640 1 --2- 172.21.15.1:0/1282647762 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14c8102a60 0x7f14c8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:59.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.327+0000 7f14cee70640 1 -- 172.21.15.1:0/1282647762 >> 172.21.15.1:0/1282647762 conn(0x7f14c8079730 msgr2=0x7f14c8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:59.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.327+0000 7f14cee70640 1 -- 172.21.15.1:0/1282647762 shutdown_connections 2024-09-21T00:55:59.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.327+0000 7f14cee70640 1 -- 172.21.15.1:0/1282647762 wait complete. 2024-09-21T00:55:59.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.328+0000 7f14cee70640 1 Processor -- start 2024-09-21T00:55:59.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.328+0000 7f14cee70640 1 -- start start 2024-09-21T00:55:59.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.328+0000 7f14cee70640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14c8102a60 0x7f14c819c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:59.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.328+0000 7f14cee70640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f14c81083a0 0x7f14c819ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:59.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.328+0000 7f14cee70640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14c8108cf0 0x7f14c81a1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:59.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.328+0000 7f14cee70640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f14c8113a80 con 0x7f14c8102a60 2024-09-21T00:55:59.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.328+0000 7f14cee70640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f14c8113900 con 0x7f14c81083a0 2024-09-21T00:55:59.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.328+0000 7f14cee70640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f14c8113c00 con 0x7f14c8108cf0 2024-09-21T00:55:59.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.328+0000 7f14ccc0c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14c8102a60 0x7f14c819c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:59.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.328+0000 7f14ccc0c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14c8102a60 0x7f14c819c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37926/0 (socket says 172.21.15.1:37926) 2024-09-21T00:55:59.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.328+0000 7f14ccc0c640 1 -- 172.21.15.1:0/2008147112 learned_addr learned my addr 172.21.15.1:0/2008147112 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:55:59.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.328+0000 7f14c7fff640 1 --2- 172.21.15.1:0/2008147112 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f14c81083a0 0x7f14c819ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:59.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.328+0000 7f14cd40d640 1 --2- 172.21.15.1:0/2008147112 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14c8108cf0 0x7f14c81a1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:59.873 INFO:teuthology.orchestra.run.smithi001.stdout:266287972382 2024-09-21T00:55:59.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.329+0000 7f14ccc0c640 1 -- 172.21.15.1:0/2008147112 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14c8108cf0 msgr2=0x7f14c81a1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:59.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.329+0000 7f14ccc0c640 1 --2- 172.21.15.1:0/2008147112 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14c8108cf0 0x7f14c81a1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:59.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.329+0000 7f14ccc0c640 1 -- 172.21.15.1:0/2008147112 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f14c81083a0 msgr2=0x7f14c819ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:59.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.329+0000 7f14ccc0c640 1 --2- 172.21.15.1:0/2008147112 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f14c81083a0 0x7f14c819ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:59.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.329+0000 7f14ccc0c640 1 -- 172.21.15.1:0/2008147112 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14c81a26a0 con 0x7f14c8102a60 2024-09-21T00:55:59.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.329+0000 7f14cd40d640 1 --2- 172.21.15.1:0/2008147112 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14c8108cf0 0x7f14c81a1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:55:59.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.329+0000 7f14ccc0c640 1 --2- 172.21.15.1:0/2008147112 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14c8102a60 0x7f14c819c730 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f14b800c970 tx=0x7f14b800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:59.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.329+0000 7f14c5ffb640 1 -- 172.21.15.1:0/2008147112 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b8007bb0 con 0x7f14c8102a60 2024-09-21T00:55:59.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.329+0000 7f14cee70640 1 -- 172.21.15.1:0/2008147112 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14c81a2990 con 0x7f14c8102a60 2024-09-21T00:55:59.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.329+0000 7f14c5ffb640 1 -- 172.21.15.1:0/2008147112 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14b8007d50 con 0x7f14c8102a60 2024-09-21T00:55:59.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.329+0000 7f14c5ffb640 1 -- 172.21.15.1:0/2008147112 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b800f450 con 0x7f14c8102a60 2024-09-21T00:55:59.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.329+0000 7f14cee70640 1 -- 172.21.15.1:0/2008147112 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14c81a90f0 con 0x7f14c8102a60 2024-09-21T00:55:59.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.330+0000 7f14cee70640 1 -- 172.21.15.1:0/2008147112 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14c8102e70 con 0x7f14c8102a60 2024-09-21T00:55:59.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.332+0000 7f14c5ffb640 1 -- 172.21.15.1:0/2008147112 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7f14b8004f20 con 0x7f14c8102a60 2024-09-21T00:55:59.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.332+0000 7f14c5ffb640 1 --2- 172.21.15.1:0/2008147112 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f14b40b65a0 0x7f14b40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:59.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.332+0000 7f14c7fff640 1 --2- 172.21.15.1:0/2008147112 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f14b40b65a0 0x7f14b40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:59.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.333+0000 7f14c5ffb640 1 -- 172.21.15.1:0/2008147112 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f14b80e7230 con 0x7f14c8102a60 2024-09-21T00:55:59.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.333+0000 7f14c7fff640 1 --2- 172.21.15.1:0/2008147112 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f14b40b65a0 0x7f14b40b8ab0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f14b0000c00 tx=0x7f14b0031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:59.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.337+0000 7f14c5ffb640 1 -- 172.21.15.1:0/2008147112 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f14b8014030 con 0x7f14c8102a60 2024-09-21T00:55:59.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.528+0000 7f14cee70640 1 -- 172.21.15.1:0/2008147112 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f14c81a9390 con 0x7f14c8102a60 2024-09-21T00:55:59.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.528+0000 7f14c5ffb640 1 -- 172.21.15.1:0/2008147112 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f14b80ad8e0 con 0x7f14c8102a60 2024-09-21T00:55:59.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.530+0000 7f14cee70640 1 -- 172.21.15.1:0/2008147112 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f14b40b65a0 msgr2=0x7f14b40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:59.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.530+0000 7f14cee70640 1 --2- 172.21.15.1:0/2008147112 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f14b40b65a0 0x7f14b40b8ab0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f14b0000c00 tx=0x7f14b0031400 comp rx=0 tx=0).stop 2024-09-21T00:55:59.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.530+0000 7f14cee70640 1 -- 172.21.15.1:0/2008147112 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14c8102a60 msgr2=0x7f14c819c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:59.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.530+0000 7f14cee70640 1 --2- 172.21.15.1:0/2008147112 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14c8102a60 0x7f14c819c730 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f14b800c970 tx=0x7f14b800ce30 comp rx=0 tx=0).stop 2024-09-21T00:55:59.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.530+0000 7f14cee70640 1 -- 172.21.15.1:0/2008147112 shutdown_connections 2024-09-21T00:55:59.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.530+0000 7f14cee70640 1 --2- 172.21.15.1:0/2008147112 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14c8108cf0 0x7f14c81a1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:59.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.530+0000 7f14cee70640 1 --2- 172.21.15.1:0/2008147112 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f14c81083a0 0x7f14c819ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:59.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.530+0000 7f14cee70640 1 --2- 172.21.15.1:0/2008147112 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f14b40b65a0 0x7f14b40b8ab0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:59.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.530+0000 7f14cee70640 1 --2- 172.21.15.1:0/2008147112 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14c8102a60 0x7f14c819c730 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:59.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.530+0000 7f14cee70640 1 -- 172.21.15.1:0/2008147112 >> 172.21.15.1:0/2008147112 conn(0x7f14c8079730 msgr2=0x7f14c810fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:59.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.530+0000 7f14cee70640 1 -- 172.21.15.1:0/2008147112 shutdown_connections 2024-09-21T00:55:59.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:57.530+0000 7f14cee70640 1 -- 172.21.15.1:0/2008147112 wait complete. 2024-09-21T00:55:59.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:55:59 smithi001 ceph-mon[31211]: pgmap v321: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-21T00:55:59.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.920+0000 7feafd46d640 1 -- 172.21.15.1:0/1610150591 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7feaf8104dd0 con 0x7feaf810de20 2024-09-21T00:55:59.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.920+0000 7feadffff640 1 -- 172.21.15.1:0/1610150591 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7feaf00b1e00 con 0x7feaf810de20 2024-09-21T00:55:59.921 INFO:teuthology.orchestra.run.smithi001.stdout:128849018941 2024-09-21T00:55:59.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.923+0000 7feafd46d640 1 -- 172.21.15.1:0/1610150591 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7feae00b65a0 msgr2=0x7feae00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:59.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.923+0000 7feafd46d640 1 --2- 172.21.15.1:0/1610150591 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7feae00b65a0 0x7feae00b8ab0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7feae8000f80 tx=0x7feae80093f0 comp rx=0 tx=0).stop 2024-09-21T00:55:59.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.923+0000 7feafd46d640 1 -- 172.21.15.1:0/1610150591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feaf810de20 msgr2=0x7feaf819fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:59.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.923+0000 7feafd46d640 1 --2- 172.21.15.1:0/1610150591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feaf810de20 0x7feaf819fcf0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7feaf000d750 tx=0x7feaf000dc10 comp rx=0 tx=0).stop 2024-09-21T00:55:59.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.923+0000 7feafd46d640 1 -- 172.21.15.1:0/1610150591 shutdown_connections 2024-09-21T00:55:59.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.923+0000 7feafd46d640 1 --2- 172.21.15.1:0/1610150591 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7feae00b65a0 0x7feae00b8ab0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:59.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.923+0000 7feafd46d640 1 --2- 172.21.15.1:0/1610150591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feaf810de20 0x7feaf819fcf0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:59.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.923+0000 7feafd46d640 1 --2- 172.21.15.1:0/1610150591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feaf8105310 0x7feaf819aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:59.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.923+0000 7feafd46d640 1 --2- 172.21.15.1:0/1610150591 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feaf81049c0 0x7feaf819a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:59.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.923+0000 7feafd46d640 1 -- 172.21.15.1:0/1610150591 >> 172.21.15.1:0/1610150591 conn(0x7feaf8079730 msgr2=0x7feaf81007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:59.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.923+0000 7feafd46d640 1 -- 172.21.15.1:0/1610150591 shutdown_connections 2024-09-21T00:55:59.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:55:59.923+0000 7feafd46d640 1 -- 172.21.15.1:0/1610150591 wait complete. 2024-09-21T00:55:59.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:55:59 smithi042 ceph-mon[34481]: pgmap v321: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-21T00:56:00.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:55:59 smithi193 ceph-mon[34660]: pgmap v321: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-21T00:56:00.660 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574922 got 55834574923 for osd.1 2024-09-21T00:56:00.660 DEBUG:teuthology.parallel:result is None 2024-09-21T00:56:00.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:00 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1610150591' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T00:56:00.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:00 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/1610150591' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T00:56:01.146 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018938 got 128849018941 for osd.4 2024-09-21T00:56:01.147 DEBUG:teuthology.parallel:result is None 2024-09-21T00:56:01.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:00 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/1610150591' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T00:56:01.798 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215168 got 103079215170 for osd.3 2024-09-21T00:56:01.798 DEBUG:teuthology.parallel:result is None 2024-09-21T00:56:01.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:01 smithi042 ceph-mon[34481]: pgmap v322: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T00:56:02.020 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:01 smithi001 ceph-mon[31211]: pgmap v322: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T00:56:02.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:01 smithi193 ceph-mon[34660]: pgmap v322: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T00:56:02.231 INFO:tasks.cephadm.ceph_manager.ceph:need seq 266287972379 got 266287972382 for osd.10 2024-09-21T00:56:02.231 DEBUG:teuthology.parallel:result is None 2024-09-21T00:56:02.347 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332134 got 219043332136 for osd.8 2024-09-21T00:56:02.348 DEBUG:teuthology.parallel:result is None 2024-09-21T00:56:02.362 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:02.816 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528362 got 193273528364 for osd.7 2024-09-21T00:56:02.816 DEBUG:teuthology.parallel:result is None 2024-09-21T00:56:03.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.282+0000 7ff6caefe640 1 -- 172.21.15.1:0/390677902 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6c4108d10 msgr2=0x7ff6c410f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:03.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.282+0000 7ff6caefe640 1 --2- 172.21.15.1:0/390677902 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6c4108d10 0x7ff6c410f540 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc009ca0 tx=0x7ff6bc02a8c0 comp rx=0 tx=0).stop 2024-09-21T00:56:03.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.282+0000 7ff6caefe640 1 -- 172.21.15.1:0/390677902 shutdown_connections 2024-09-21T00:56:03.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.282+0000 7ff6caefe640 1 --2- 172.21.15.1:0/390677902 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6c4108d10 0x7ff6c410f540 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:03.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.282+0000 7ff6caefe640 1 --2- 172.21.15.1:0/390677902 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6c41083c0 0x7ff6c41087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:03.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.282+0000 7ff6caefe640 1 --2- 172.21.15.1:0/390677902 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6c4102a80 0x7ff6c4102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:03.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.282+0000 7ff6caefe640 1 -- 172.21.15.1:0/390677902 >> 172.21.15.1:0/390677902 conn(0x7ff6c4079740 msgr2=0x7ff6c4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:03.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.282+0000 7ff6caefe640 1 -- 172.21.15.1:0/390677902 shutdown_connections 2024-09-21T00:56:03.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.282+0000 7ff6caefe640 1 -- 172.21.15.1:0/390677902 wait complete. 2024-09-21T00:56:03.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.283+0000 7ff6caefe640 1 Processor -- start 2024-09-21T00:56:03.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.283+0000 7ff6caefe640 1 -- start start 2024-09-21T00:56:03.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.283+0000 7ff6caefe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6c4102a80 0x7ff6c419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:03.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.283+0000 7ff6caefe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6c41083c0 0x7ff6c419aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:03.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.283+0000 7ff6caefe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6c4108d10 0x7ff6c419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:03.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.283+0000 7ff6caefe640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c4113aa0 con 0x7ff6c4108d10 2024-09-21T00:56:03.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.283+0000 7ff6caefe640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c4113920 con 0x7ff6c4102a80 2024-09-21T00:56:03.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.283+0000 7ff6caefe640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c4113c20 con 0x7ff6c41083c0 2024-09-21T00:56:03.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.284+0000 7ff6c949b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6c4108d10 0x7ff6c419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:03.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.284+0000 7ff6c949b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6c4108d10 0x7ff6c419fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48122/0 (socket says 172.21.15.1:48122) 2024-09-21T00:56:03.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.284+0000 7ff6c949b640 1 -- 172.21.15.1:0/3663784428 learned_addr learned my addr 172.21.15.1:0/3663784428 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:03.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.284+0000 7ff6c3fff640 1 --2- 172.21.15.1:0/3663784428 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6c41083c0 0x7ff6c419aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:03.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.284+0000 7ff6c8c9a640 1 --2- 172.21.15.1:0/3663784428 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6c4102a80 0x7ff6c419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:03.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.284+0000 7ff6c949b640 1 -- 172.21.15.1:0/3663784428 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6c41083c0 msgr2=0x7ff6c419aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:03.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.284+0000 7ff6c949b640 1 --2- 172.21.15.1:0/3663784428 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6c41083c0 0x7ff6c419aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:03.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.284+0000 7ff6c949b640 1 -- 172.21.15.1:0/3663784428 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6c4102a80 msgr2=0x7ff6c419a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:03.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.284+0000 7ff6c949b640 1 --2- 172.21.15.1:0/3663784428 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6c4102a80 0x7ff6c419a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:03.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.284+0000 7ff6c949b640 1 -- 172.21.15.1:0/3663784428 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6c41a0460 con 0x7ff6c4108d10 2024-09-21T00:56:03.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.284+0000 7ff6c8c9a640 1 --2- 172.21.15.1:0/3663784428 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6c4102a80 0x7ff6c419a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:56:03.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.284+0000 7ff6c949b640 1 --2- 172.21.15.1:0/3663784428 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6c4108d10 0x7ff6c419fd30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc005cc0 tx=0x7ff6bc02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:03.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.284+0000 7ff6c1ffb640 1 -- 172.21.15.1:0/3663784428 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc003bf0 con 0x7ff6c4108d10 2024-09-21T00:56:03.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.284+0000 7ff6c1ffb640 1 -- 172.21.15.1:0/3663784428 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6bc003d90 con 0x7ff6c4108d10 2024-09-21T00:56:03.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.284+0000 7ff6c1ffb640 1 -- 172.21.15.1:0/3663784428 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc02fbc0 con 0x7ff6c4108d10 2024-09-21T00:56:03.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.284+0000 7ff6caefe640 1 -- 172.21.15.1:0/3663784428 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6c41a06f0 con 0x7ff6c4108d10 2024-09-21T00:56:03.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.285+0000 7ff6caefe640 1 -- 172.21.15.1:0/3663784428 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6c41a6eb0 con 0x7ff6c4108d10 2024-09-21T00:56:03.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.286+0000 7ff6caefe640 1 -- 172.21.15.1:0/3663784428 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6c4103d00 con 0x7ff6c4108d10 2024-09-21T00:56:03.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.287+0000 7ff6c1ffb640 1 -- 172.21.15.1:0/3663784428 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7ff6bc02fd60 con 0x7ff6c4108d10 2024-09-21T00:56:03.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.288+0000 7ff6c1ffb640 1 --2- 172.21.15.1:0/3663784428 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff6ac0b65a0 0x7ff6ac0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:03.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.288+0000 7ff6c8c9a640 1 --2- 172.21.15.1:0/3663784428 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff6ac0b65a0 0x7ff6ac0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:03.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.288+0000 7ff6c1ffb640 1 -- 172.21.15.1:0/3663784428 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7ff6bc108bb0 con 0x7ff6c4108d10 2024-09-21T00:56:03.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.288+0000 7ff6c8c9a640 1 --2- 172.21.15.1:0/3663784428 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff6ac0b65a0 0x7ff6ac0b8ab0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4009b40 tx=0x7ff6b4005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:03.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.291+0000 7ff6c1ffb640 1 -- 172.21.15.1:0/3663784428 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff6bc0cf260 con 0x7ff6c4108d10 2024-09-21T00:56:03.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.483+0000 7ff6caefe640 1 -- 172.21.15.1:0/3663784428 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7ff6c4102e90 con 0x7ff6c4108d10 2024-09-21T00:56:03.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.484+0000 7ff6c1ffb640 1 -- 172.21.15.1:0/3663784428 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff6bc0d3640 con 0x7ff6c4108d10 2024-09-21T00:56:03.485 INFO:teuthology.orchestra.run.smithi001.stdout:244813135908 2024-09-21T00:56:03.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.486+0000 7ff6caefe640 1 -- 172.21.15.1:0/3663784428 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff6ac0b65a0 msgr2=0x7ff6ac0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:03.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.486+0000 7ff6caefe640 1 --2- 172.21.15.1:0/3663784428 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff6ac0b65a0 0x7ff6ac0b8ab0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4009b40 tx=0x7ff6b4005e50 comp rx=0 tx=0).stop 2024-09-21T00:56:03.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.486+0000 7ff6caefe640 1 -- 172.21.15.1:0/3663784428 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6c4108d10 msgr2=0x7ff6c419fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:03.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.486+0000 7ff6caefe640 1 --2- 172.21.15.1:0/3663784428 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6c4108d10 0x7ff6c419fd30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc005cc0 tx=0x7ff6bc02f380 comp rx=0 tx=0).stop 2024-09-21T00:56:03.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.486+0000 7ff6caefe640 1 -- 172.21.15.1:0/3663784428 shutdown_connections 2024-09-21T00:56:03.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.486+0000 7ff6caefe640 1 --2- 172.21.15.1:0/3663784428 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff6ac0b65a0 0x7ff6ac0b8ab0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:03.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.486+0000 7ff6caefe640 1 --2- 172.21.15.1:0/3663784428 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6c4108d10 0x7ff6c419fd30 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:03.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.486+0000 7ff6caefe640 1 --2- 172.21.15.1:0/3663784428 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6c41083c0 0x7ff6c419aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:03.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.486+0000 7ff6caefe640 1 --2- 172.21.15.1:0/3663784428 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6c4102a80 0x7ff6c419a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:03.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.486+0000 7ff6caefe640 1 -- 172.21.15.1:0/3663784428 >> 172.21.15.1:0/3663784428 conn(0x7ff6c4079740 msgr2=0x7ff6c4104490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:03.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.487+0000 7ff6caefe640 1 -- 172.21.15.1:0/3663784428 shutdown_connections 2024-09-21T00:56:03.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:03.487+0000 7ff6caefe640 1 -- 172.21.15.1:0/3663784428 wait complete. 2024-09-21T00:56:03.740 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:03 smithi001 ceph-mon[31211]: pgmap v323: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T00:56:03.740 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:03 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/3663784428' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T00:56:03.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:03 smithi042 ceph-mon[34481]: pgmap v323: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T00:56:03.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:03 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/3663784428' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T00:56:04.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:03 smithi193 ceph-mon[34660]: pgmap v323: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T00:56:04.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:03 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/3663784428' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T00:56:04.696 INFO:tasks.cephadm.ceph_manager.ceph:need seq 244813135904 got 244813135908 for osd.9 2024-09-21T00:56:04.696 DEBUG:teuthology.parallel:result is None 2024-09-21T00:56:04.696 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T00:56:04.696 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T00:56:04.988 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:05.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.513+0000 7fe3d8d62640 1 -- 172.21.15.1:0/3037562708 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3d4109e50 msgr2=0x7fe3d4110680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:05.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.514+0000 7fe3d8d62640 1 --2- 172.21.15.1:0/3037562708 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3d4109e50 0x7fe3d4110680 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc009ca0 tx=0x7fe3cc02a8c0 comp rx=0 tx=0).stop 2024-09-21T00:56:05.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.514+0000 7fe3d8d62640 1 -- 172.21.15.1:0/3037562708 shutdown_connections 2024-09-21T00:56:05.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.514+0000 7fe3d8d62640 1 --2- 172.21.15.1:0/3037562708 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3d4109e50 0x7fe3d4110680 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:05.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.514+0000 7fe3d8d62640 1 --2- 172.21.15.1:0/3037562708 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3d4109500 0x7fe3d4109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:05.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.514+0000 7fe3d8d62640 1 --2- 172.21.15.1:0/3037562708 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3d4101fc0 0x7fe3d41023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:05.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.514+0000 7fe3d8d62640 1 -- 172.21.15.1:0/3037562708 >> 172.21.15.1:0/3037562708 conn(0x7fe3d4079f90 msgr2=0x7fe3d407a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:05.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.514+0000 7fe3d8d62640 1 -- 172.21.15.1:0/3037562708 shutdown_connections 2024-09-21T00:56:05.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.514+0000 7fe3d8d62640 1 -- 172.21.15.1:0/3037562708 wait complete. 2024-09-21T00:56:05.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.515+0000 7fe3d8d62640 1 Processor -- start 2024-09-21T00:56:05.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.515+0000 7fe3d8d62640 1 -- start start 2024-09-21T00:56:05.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.515+0000 7fe3d8d62640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3d4101fc0 0x7fe3d419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:05.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.515+0000 7fe3d8d62640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3d4109500 0x7fe3d419aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:05.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.515+0000 7fe3d8d62640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3d4109e50 0x7fe3d419fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:05.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.515+0000 7fe3d8d62640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d4113b10 con 0x7fe3d4101fc0 2024-09-21T00:56:05.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.515+0000 7fe3d8d62640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d4113990 con 0x7fe3d4109500 2024-09-21T00:56:05.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.515+0000 7fe3d8d62640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d4113c90 con 0x7fe3d4109e50 2024-09-21T00:56:05.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.515+0000 7fe3d259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3d4101fc0 0x7fe3d419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:05.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.515+0000 7fe3d259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3d4101fc0 0x7fe3d419a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48140/0 (socket says 172.21.15.1:48140) 2024-09-21T00:56:05.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.515+0000 7fe3d259c640 1 -- 172.21.15.1:0/2956484511 learned_addr learned my addr 172.21.15.1:0/2956484511 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:05.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.515+0000 7fe3d2d9d640 1 --2- 172.21.15.1:0/2956484511 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3d4109e50 0x7fe3d419fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:05.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.515+0000 7fe3cbfff640 1 --2- 172.21.15.1:0/2956484511 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3d4109500 0x7fe3d419aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:05.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.516+0000 7fe3d259c640 1 -- 172.21.15.1:0/2956484511 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3d4109e50 msgr2=0x7fe3d419fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:05.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.516+0000 7fe3d259c640 1 --2- 172.21.15.1:0/2956484511 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3d4109e50 0x7fe3d419fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:05.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.516+0000 7fe3d259c640 1 -- 172.21.15.1:0/2956484511 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3d4109500 msgr2=0x7fe3d419aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:05.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.516+0000 7fe3d259c640 1 --2- 172.21.15.1:0/2956484511 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3d4109500 0x7fe3d419aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:05.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.516+0000 7fe3d259c640 1 -- 172.21.15.1:0/2956484511 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d41a03f0 con 0x7fe3d4101fc0 2024-09-21T00:56:05.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.516+0000 7fe3d259c640 1 --2- 172.21.15.1:0/2956484511 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3d4101fc0 0x7fe3d419a480 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe3c400d950 tx=0x7fe3c400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:05.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.516+0000 7fe3cb7fe640 1 -- 172.21.15.1:0/2956484511 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c4017030 con 0x7fe3d4101fc0 2024-09-21T00:56:05.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.516+0000 7fe3cb7fe640 1 -- 172.21.15.1:0/2956484511 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3c4004020 con 0x7fe3d4101fc0 2024-09-21T00:56:05.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.516+0000 7fe3d8d62640 1 -- 172.21.15.1:0/2956484511 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3d41a06e0 con 0x7fe3d4101fc0 2024-09-21T00:56:05.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.516+0000 7fe3cb7fe640 1 -- 172.21.15.1:0/2956484511 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c40047a0 con 0x7fe3d4101fc0 2024-09-21T00:56:05.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.516+0000 7fe3d8d62640 1 -- 172.21.15.1:0/2956484511 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3d41a6e40 con 0x7fe3d4101fc0 2024-09-21T00:56:05.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.517+0000 7fe3d8d62640 1 -- 172.21.15.1:0/2956484511 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3d41023d0 con 0x7fe3d4101fc0 2024-09-21T00:56:05.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.519+0000 7fe3cb7fe640 1 -- 172.21.15.1:0/2956484511 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7fe3c4009a30 con 0x7fe3d4101fc0 2024-09-21T00:56:05.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.519+0000 7fe3cb7fe640 1 --2- 172.21.15.1:0/2956484511 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe3c00b6620 0x7fe3c00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:05.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.520+0000 7fe3cbfff640 1 --2- 172.21.15.1:0/2956484511 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe3c00b6620 0x7fe3c00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:05.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.520+0000 7fe3cb7fe640 1 -- 172.21.15.1:0/2956484511 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fe3c40e7650 con 0x7fe3d4101fc0 2024-09-21T00:56:05.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.520+0000 7fe3cbfff640 1 --2- 172.21.15.1:0/2956484511 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe3c00b6620 0x7fe3c00b8b30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc005d90 tx=0x7fe3bc005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:05.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.523+0000 7fe3cb7fe640 1 -- 172.21.15.1:0/2956484511 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe3c40adde0 con 0x7fe3d4101fc0 2024-09-21T00:56:05.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.715+0000 7fe3d8d62640 1 -- 172.21.15.1:0/2956484511 --> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe3d4063800 con 0x7fe3c00b6620 2024-09-21T00:56:05.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.720+0000 7fe3cb7fe640 1 -- 172.21.15.1:0/2956484511 <== mgr.14150 v2:172.21.15.1:6800/2032980330 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259053 (secure 0 0 0) 0x7fe3d4063800 con 0x7fe3c00b6620 2024-09-21T00:56:05.723 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:56:05.724 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-21T00:56:05.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.723+0000 7fe3d8d62640 1 -- 172.21.15.1:0/2956484511 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe3c00b6620 msgr2=0x7fe3c00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:05.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.723+0000 7fe3d8d62640 1 --2- 172.21.15.1:0/2956484511 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe3c00b6620 0x7fe3c00b8b30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc005d90 tx=0x7fe3bc005d20 comp rx=0 tx=0).stop 2024-09-21T00:56:05.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.723+0000 7fe3d8d62640 1 -- 172.21.15.1:0/2956484511 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3d4101fc0 msgr2=0x7fe3d419a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:05.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.723+0000 7fe3d8d62640 1 --2- 172.21.15.1:0/2956484511 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3d4101fc0 0x7fe3d419a480 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe3c400d950 tx=0x7fe3c400de10 comp rx=0 tx=0).stop 2024-09-21T00:56:05.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.723+0000 7fe3d8d62640 1 -- 172.21.15.1:0/2956484511 shutdown_connections 2024-09-21T00:56:05.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.723+0000 7fe3d8d62640 1 --2- 172.21.15.1:0/2956484511 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3d4109e50 0x7fe3d419fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:05.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.723+0000 7fe3d8d62640 1 --2- 172.21.15.1:0/2956484511 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3d4109500 0x7fe3d419aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:05.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.723+0000 7fe3d8d62640 1 --2- 172.21.15.1:0/2956484511 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe3c00b6620 0x7fe3c00b8b30 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:05.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.723+0000 7fe3d8d62640 1 --2- 172.21.15.1:0/2956484511 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3d4101fc0 0x7fe3d419a480 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:05.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.723+0000 7fe3d8d62640 1 -- 172.21.15.1:0/2956484511 >> 172.21.15.1:0/2956484511 conn(0x7fe3d4079f90 msgr2=0x7fe3d4105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:05.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.723+0000 7fe3d8d62640 1 -- 172.21.15.1:0/2956484511 shutdown_connections 2024-09-21T00:56:05.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:05.723+0000 7fe3d8d62640 1 -- 172.21.15.1:0/2956484511 wait complete. 2024-09-21T00:56:06.024 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:05 smithi001 ceph-mon[31211]: pgmap v324: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T00:56:06.025 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:05 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:56:06.025 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:05 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:56:06.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:05 smithi193 ceph-mon[34660]: pgmap v324: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T00:56:06.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:05 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:56:06.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:05 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:56:06.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:05 smithi042 ceph-mon[34481]: pgmap v324: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T00:56:06.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:05 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:56:06.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:05 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:56:06.371 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":324,"stamp":"2024-09-21T00:56:04.100306+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661155,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":632,"num_read_kb":410,"num_write":366,"num_write_kb":2290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":3011044,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":301,"ondisk_log_size":301,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":380252,"kb_used_data":10136,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124561572,"statfs":{"total":1151940427776,"available":1151551049728,"internally_reserved":0,"allocated":10379264,"data_stored":6714621,"data_compressed":190923,"data_compressed_allocated":253952,"data_compressed_original":2039808,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":65,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003427"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.635082+0000","last_change":"2024-09-21T00:54:57.879464+0000","last_active":"2024-09-21T00:55:27.635082+0000","last_peered":"2024-09-21T00:55:27.635082+0000","last_clean":"2024-09-21T00:55:27.635082+0000","last_became_active":"2024-09-21T00:54:57.878480+0000","last_became_peered":"2024-09-21T00:54:57.878480+0000","last_unstale":"2024-09-21T00:55:27.635082+0000","last_undegraded":"2024-09-21T00:55:27.635082+0000","last_fullsized":"2024-09-21T00:55:27.635082+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:28.056410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636440+0000","last_change":"2024-09-21T00:54:57.866876+0000","last_active":"2024-09-21T00:55:27.636440+0000","last_peered":"2024-09-21T00:55:27.636440+0000","last_clean":"2024-09-21T00:55:27.636440+0000","last_became_active":"2024-09-21T00:54:57.866532+0000","last_became_peered":"2024-09-21T00:54:57.866532+0000","last_unstale":"2024-09-21T00:55:27.636440+0000","last_undegraded":"2024-09-21T00:55:27.636440+0000","last_fullsized":"2024-09-21T00:55:27.636440+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:15:58.881955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636427+0000","last_change":"2024-09-21T00:54:57.874814+0000","last_active":"2024-09-21T00:55:27.636427+0000","last_peered":"2024-09-21T00:55:27.636427+0000","last_clean":"2024-09-21T00:55:27.636427+0000","last_became_active":"2024-09-21T00:54:57.873918+0000","last_became_peered":"2024-09-21T00:54:57.873918+0000","last_unstale":"2024-09-21T00:55:27.636427+0000","last_undegraded":"2024-09-21T00:55:27.636427+0000","last_fullsized":"2024-09-21T00:55:27.636427+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:14.677826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.960913+0000","last_change":"2024-09-21T00:54:57.877268+0000","last_active":"2024-09-21T00:55:27.960913+0000","last_peered":"2024-09-21T00:55:27.960913+0000","last_clean":"2024-09-21T00:55:27.960913+0000","last_became_active":"2024-09-21T00:54:57.876769+0000","last_became_peered":"2024-09-21T00:54:57.876769+0000","last_unstale":"2024-09-21T00:55:27.960913+0000","last_undegraded":"2024-09-21T00:55:27.960913+0000","last_fullsized":"2024-09-21T00:55:27.960913+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:27:02.534562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.638292+0000","last_change":"2024-09-21T00:54:57.872956+0000","last_active":"2024-09-21T00:55:27.638292+0000","last_peered":"2024-09-21T00:55:27.638292+0000","last_clean":"2024-09-21T00:55:27.638292+0000","last_became_active":"2024-09-21T00:54:57.872563+0000","last_became_peered":"2024-09-21T00:54:57.872563+0000","last_unstale":"2024-09-21T00:55:27.638292+0000","last_undegraded":"2024-09-21T00:55:27.638292+0000","last_fullsized":"2024-09-21T00:55:27.638292+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:47.776888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.633746+0000","last_change":"2024-09-21T00:54:57.870285+0000","last_active":"2024-09-21T00:55:27.633746+0000","last_peered":"2024-09-21T00:55:27.633746+0000","last_clean":"2024-09-21T00:55:27.633746+0000","last_became_active":"2024-09-21T00:54:57.869689+0000","last_became_peered":"2024-09-21T00:54:57.869689+0000","last_unstale":"2024-09-21T00:55:27.633746+0000","last_undegraded":"2024-09-21T00:55:27.633746+0000","last_fullsized":"2024-09-21T00:55:27.633746+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:54.304589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636632+0000","last_change":"2024-09-21T00:54:57.868515+0000","last_active":"2024-09-21T00:55:27.636632+0000","last_peered":"2024-09-21T00:55:27.636632+0000","last_clean":"2024-09-21T00:55:27.636632+0000","last_became_active":"2024-09-21T00:54:57.868130+0000","last_became_peered":"2024-09-21T00:54:57.868130+0000","last_unstale":"2024-09-21T00:55:27.636632+0000","last_undegraded":"2024-09-21T00:55:27.636632+0000","last_fullsized":"2024-09-21T00:55:27.636632+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:45.482119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:28.428603+0000","last_change":"2024-09-21T00:54:57.869386+0000","last_active":"2024-09-21T00:55:28.428603+0000","last_peered":"2024-09-21T00:55:28.428603+0000","last_clean":"2024-09-21T00:55:28.428603+0000","last_became_active":"2024-09-21T00:54:57.869033+0000","last_became_peered":"2024-09-21T00:54:57.869033+0000","last_unstale":"2024-09-21T00:55:28.428603+0000","last_undegraded":"2024-09-21T00:55:28.428603+0000","last_fullsized":"2024-09-21T00:55:28.428603+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:39:01.305815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637964+0000","last_change":"2024-09-21T00:54:57.870703+0000","last_active":"2024-09-21T00:55:27.637964+0000","last_peered":"2024-09-21T00:55:27.637964+0000","last_clean":"2024-09-21T00:55:27.637964+0000","last_became_active":"2024-09-21T00:54:57.870324+0000","last_became_peered":"2024-09-21T00:54:57.870324+0000","last_unstale":"2024-09-21T00:55:27.637964+0000","last_undegraded":"2024-09-21T00:55:27.637964+0000","last_fullsized":"2024-09-21T00:55:27.637964+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:50.548296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.634338+0000","last_change":"2024-09-21T00:54:57.869803+0000","last_active":"2024-09-21T00:55:27.634338+0000","last_peered":"2024-09-21T00:55:27.634338+0000","last_clean":"2024-09-21T00:55:27.634338+0000","last_became_active":"2024-09-21T00:54:57.869092+0000","last_became_peered":"2024-09-21T00:54:57.869092+0000","last_unstale":"2024-09-21T00:55:27.634338+0000","last_undegraded":"2024-09-21T00:55:27.634338+0000","last_fullsized":"2024-09-21T00:55:27.634338+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:05:27.727914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637429+0000","last_change":"2024-09-21T00:54:57.873700+0000","last_active":"2024-09-21T00:55:27.637429+0000","last_peered":"2024-09-21T00:55:27.637429+0000","last_clean":"2024-09-21T00:55:27.637429+0000","last_became_active":"2024-09-21T00:54:57.873336+0000","last_became_peered":"2024-09-21T00:54:57.873336+0000","last_unstale":"2024-09-21T00:55:27.637429+0000","last_undegraded":"2024-09-21T00:55:27.637429+0000","last_fullsized":"2024-09-21T00:55:27.637429+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:28:17.520669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.960916+0000","last_change":"2024-09-21T00:54:57.877686+0000","last_active":"2024-09-21T00:55:27.960916+0000","last_peered":"2024-09-21T00:55:27.960916+0000","last_clean":"2024-09-21T00:55:27.960916+0000","last_became_active":"2024-09-21T00:54:57.876711+0000","last_became_peered":"2024-09-21T00:54:57.876711+0000","last_unstale":"2024-09-21T00:55:27.960916+0000","last_undegraded":"2024-09-21T00:55:27.960916+0000","last_fullsized":"2024-09-21T00:55:27.960916+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:20:11.254680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.634499+0000","last_change":"2024-09-21T00:54:57.880660+0000","last_active":"2024-09-21T00:55:27.634499+0000","last_peered":"2024-09-21T00:55:27.634499+0000","last_clean":"2024-09-21T00:55:27.634499+0000","last_became_active":"2024-09-21T00:54:57.880270+0000","last_became_peered":"2024-09-21T00:54:57.880270+0000","last_unstale":"2024-09-21T00:55:27.634499+0000","last_undegraded":"2024-09-21T00:55:27.634499+0000","last_fullsized":"2024-09-21T00:55:27.634499+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:50:16.260484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636217+0000","last_change":"2024-09-21T00:54:57.869626+0000","last_active":"2024-09-21T00:55:27.636217+0000","last_peered":"2024-09-21T00:55:27.636217+0000","last_clean":"2024-09-21T00:55:27.636217+0000","last_became_active":"2024-09-21T00:54:57.869230+0000","last_became_peered":"2024-09-21T00:54:57.869230+0000","last_unstale":"2024-09-21T00:55:27.636217+0000","last_undegraded":"2024-09-21T00:55:27.636217+0000","last_fullsized":"2024-09-21T00:55:27.636217+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:49.131237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636212+0000","last_change":"2024-09-21T00:54:57.874917+0000","last_active":"2024-09-21T00:55:27.636212+0000","last_peered":"2024-09-21T00:55:27.636212+0000","last_clean":"2024-09-21T00:55:27.636212+0000","last_became_active":"2024-09-21T00:54:57.873787+0000","last_became_peered":"2024-09-21T00:54:57.873787+0000","last_unstale":"2024-09-21T00:55:27.636212+0000","last_undegraded":"2024-09-21T00:55:27.636212+0000","last_fullsized":"2024-09-21T00:55:27.636212+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:44.226734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636350+0000","last_change":"2024-09-21T00:54:57.877479+0000","last_active":"2024-09-21T00:55:27.636350+0000","last_peered":"2024-09-21T00:55:27.636350+0000","last_clean":"2024-09-21T00:55:27.636350+0000","last_became_active":"2024-09-21T00:54:57.877110+0000","last_became_peered":"2024-09-21T00:54:57.877110+0000","last_unstale":"2024-09-21T00:55:27.636350+0000","last_undegraded":"2024-09-21T00:55:27.636350+0000","last_fullsized":"2024-09-21T00:55:27.636350+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:18.547970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.635124+0000","last_change":"2024-09-21T00:54:57.878701+0000","last_active":"2024-09-21T00:55:27.635124+0000","last_peered":"2024-09-21T00:55:27.635124+0000","last_clean":"2024-09-21T00:55:27.635124+0000","last_became_active":"2024-09-21T00:54:57.878254+0000","last_became_peered":"2024-09-21T00:54:57.878254+0000","last_unstale":"2024-09-21T00:55:27.635124+0000","last_undegraded":"2024-09-21T00:55:27.635124+0000","last_fullsized":"2024-09-21T00:55:27.635124+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:51.309956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.632830+0000","last_change":"2024-09-21T00:54:57.869571+0000","last_active":"2024-09-21T00:55:27.632830+0000","last_peered":"2024-09-21T00:55:27.632830+0000","last_clean":"2024-09-21T00:55:27.632830+0000","last_became_active":"2024-09-21T00:54:57.868907+0000","last_became_peered":"2024-09-21T00:54:57.868907+0000","last_unstale":"2024-09-21T00:55:27.632830+0000","last_undegraded":"2024-09-21T00:55:27.632830+0000","last_fullsized":"2024-09-21T00:55:27.632830+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:14.951885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637530+0000","last_change":"2024-09-21T00:54:57.869277+0000","last_active":"2024-09-21T00:55:27.637530+0000","last_peered":"2024-09-21T00:55:27.637530+0000","last_clean":"2024-09-21T00:55:27.637530+0000","last_became_active":"2024-09-21T00:54:57.868777+0000","last_became_peered":"2024-09-21T00:54:57.868777+0000","last_unstale":"2024-09-21T00:55:27.637530+0000","last_undegraded":"2024-09-21T00:55:27.637530+0000","last_fullsized":"2024-09-21T00:55:27.637530+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:09:04.766266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.641582+0000","last_change":"2024-09-21T00:55:27.641451+0000","last_active":"2024-09-21T00:55:27.641582+0000","last_peered":"2024-09-21T00:55:27.641582+0000","last_clean":"2024-09-21T00:55:27.641582+0000","last_became_active":"2024-09-21T00:55:27.640253+0000","last_became_peered":"2024-09-21T00:55:27.640253+0000","last_unstale":"2024-09-21T00:55:27.641582+0000","last_undegraded":"2024-09-21T00:55:27.641582+0000","last_fullsized":"2024-09-21T00:55:27.641582+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:34.064803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.634440+0000","last_change":"2024-09-21T00:54:57.871236+0000","last_active":"2024-09-21T00:55:27.634440+0000","last_peered":"2024-09-21T00:55:27.634440+0000","last_clean":"2024-09-21T00:55:27.634440+0000","last_became_active":"2024-09-21T00:54:57.870131+0000","last_became_peered":"2024-09-21T00:54:57.870131+0000","last_unstale":"2024-09-21T00:55:27.634440+0000","last_undegraded":"2024-09-21T00:55:27.634440+0000","last_fullsized":"2024-09-21T00:55:27.634440+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:45.067436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.638362+0000","last_change":"2024-09-21T00:54:57.878710+0000","last_active":"2024-09-21T00:55:27.638362+0000","last_peered":"2024-09-21T00:55:27.638362+0000","last_clean":"2024-09-21T00:55:27.638362+0000","last_became_active":"2024-09-21T00:54:57.878352+0000","last_became_peered":"2024-09-21T00:54:57.878352+0000","last_unstale":"2024-09-21T00:55:27.638362+0000","last_undegraded":"2024-09-21T00:55:27.638362+0000","last_fullsized":"2024-09-21T00:55:27.638362+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:32:40.561028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:28.428682+0000","last_change":"2024-09-21T00:54:57.873226+0000","last_active":"2024-09-21T00:55:28.428682+0000","last_peered":"2024-09-21T00:55:28.428682+0000","last_clean":"2024-09-21T00:55:28.428682+0000","last_became_active":"2024-09-21T00:54:57.872840+0000","last_became_peered":"2024-09-21T00:54:57.872840+0000","last_unstale":"2024-09-21T00:55:28.428682+0000","last_undegraded":"2024-09-21T00:55:28.428682+0000","last_fullsized":"2024-09-21T00:55:28.428682+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:41.259070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:28.430604+0000","last_change":"2024-09-21T00:55:28.430095+0000","last_active":"2024-09-21T00:55:28.430604+0000","last_peered":"2024-09-21T00:55:28.430604+0000","last_clean":"2024-09-21T00:55:28.430604+0000","last_became_active":"2024-09-21T00:55:28.429650+0000","last_became_peered":"2024-09-21T00:55:28.429650+0000","last_unstale":"2024-09-21T00:55:28.430604+0000","last_undegraded":"2024-09-21T00:55:28.430604+0000","last_fullsized":"2024-09-21T00:55:28.430604+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:18:14.994333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,3],"acting":[6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.961641+0000","last_change":"2024-09-21T00:55:27.961107+0000","last_active":"2024-09-21T00:55:27.961641+0000","last_peered":"2024-09-21T00:55:27.961641+0000","last_clean":"2024-09-21T00:55:27.961641+0000","last_became_active":"2024-09-21T00:55:27.960673+0000","last_became_peered":"2024-09-21T00:55:27.960673+0000","last_unstale":"2024-09-21T00:55:27.961641+0000","last_undegraded":"2024-09-21T00:55:27.961641+0000","last_fullsized":"2024-09-21T00:55:27.961641+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:30.418190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.638300+0000","last_change":"2024-09-21T00:54:57.870994+0000","last_active":"2024-09-21T00:55:27.638300+0000","last_peered":"2024-09-21T00:55:27.638300+0000","last_clean":"2024-09-21T00:55:27.638300+0000","last_became_active":"2024-09-21T00:54:57.867939+0000","last_became_peered":"2024-09-21T00:54:57.867939+0000","last_unstale":"2024-09-21T00:55:27.638300+0000","last_undegraded":"2024-09-21T00:55:27.638300+0000","last_fullsized":"2024-09-21T00:55:27.638300+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:44.858289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.634087+0000","last_change":"2024-09-21T00:54:57.870568+0000","last_active":"2024-09-21T00:55:27.634087+0000","last_peered":"2024-09-21T00:55:27.634087+0000","last_clean":"2024-09-21T00:55:27.634087+0000","last_became_active":"2024-09-21T00:54:57.870208+0000","last_became_peered":"2024-09-21T00:54:57.870208+0000","last_unstale":"2024-09-21T00:55:27.634087+0000","last_undegraded":"2024-09-21T00:55:27.634087+0000","last_fullsized":"2024-09-21T00:55:27.634087+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:28:09.824385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.634330+0000","last_change":"2024-09-21T00:54:57.870228+0000","last_active":"2024-09-21T00:55:27.634330+0000","last_peered":"2024-09-21T00:55:27.634330+0000","last_clean":"2024-09-21T00:55:27.634330+0000","last_became_active":"2024-09-21T00:54:57.869866+0000","last_became_peered":"2024-09-21T00:54:57.869866+0000","last_unstale":"2024-09-21T00:55:27.634330+0000","last_undegraded":"2024-09-21T00:55:27.634330+0000","last_fullsized":"2024-09-21T00:55:27.634330+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:20.073393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636427+0000","last_change":"2024-09-21T00:54:57.867602+0000","last_active":"2024-09-21T00:55:27.636427+0000","last_peered":"2024-09-21T00:55:27.636427+0000","last_clean":"2024-09-21T00:55:27.636427+0000","last_became_active":"2024-09-21T00:54:57.867104+0000","last_became_peered":"2024-09-21T00:54:57.867104+0000","last_unstale":"2024-09-21T00:55:27.636427+0000","last_undegraded":"2024-09-21T00:55:27.636427+0000","last_fullsized":"2024-09-21T00:55:27.636427+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:29:37.403384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636722+0000","last_change":"2024-09-21T00:54:57.869400+0000","last_active":"2024-09-21T00:55:27.636722+0000","last_peered":"2024-09-21T00:55:27.636722+0000","last_clean":"2024-09-21T00:55:27.636722+0000","last_became_active":"2024-09-21T00:54:57.868997+0000","last_became_peered":"2024-09-21T00:54:57.868997+0000","last_unstale":"2024-09-21T00:55:27.636722+0000","last_undegraded":"2024-09-21T00:55:27.636722+0000","last_fullsized":"2024-09-21T00:55:27.636722+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:00.117559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636562+0000","last_change":"2024-09-21T00:54:57.867392+0000","last_active":"2024-09-21T00:55:27.636562+0000","last_peered":"2024-09-21T00:55:27.636562+0000","last_clean":"2024-09-21T00:55:27.636562+0000","last_became_active":"2024-09-21T00:54:57.867001+0000","last_became_peered":"2024-09-21T00:54:57.867001+0000","last_unstale":"2024-09-21T00:55:27.636562+0000","last_undegraded":"2024-09-21T00:55:27.636562+0000","last_fullsized":"2024-09-21T00:55:27.636562+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:05.090149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.633807+0000","last_change":"2024-09-21T00:54:57.867620+0000","last_active":"2024-09-21T00:55:27.633807+0000","last_peered":"2024-09-21T00:55:27.633807+0000","last_clean":"2024-09-21T00:55:27.633807+0000","last_became_active":"2024-09-21T00:54:57.867190+0000","last_became_peered":"2024-09-21T00:54:57.867190+0000","last_unstale":"2024-09-21T00:55:27.633807+0000","last_undegraded":"2024-09-21T00:55:27.633807+0000","last_fullsized":"2024-09-21T00:55:27.633807+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:36.432368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637149+0000","last_change":"2024-09-21T00:54:57.880526+0000","last_active":"2024-09-21T00:55:27.637149+0000","last_peered":"2024-09-21T00:55:27.637149+0000","last_clean":"2024-09-21T00:55:27.637149+0000","last_became_active":"2024-09-21T00:54:57.880154+0000","last_became_peered":"2024-09-21T00:54:57.880154+0000","last_unstale":"2024-09-21T00:55:27.637149+0000","last_undegraded":"2024-09-21T00:55:27.637149+0000","last_fullsized":"2024-09-21T00:55:27.637149+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:56.179127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'5","reported_seq":83,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:00.665403+0000","last_change":"2024-09-21T00:54:55.867717+0000","last_active":"2024-09-21T00:56:00.665403+0000","last_peered":"2024-09-21T00:56:00.665403+0000","last_clean":"2024-09-21T00:56:00.665403+0000","last_became_active":"2024-09-21T00:54:55.867306+0000","last_became_peered":"2024-09-21T00:54:55.867306+0000","last_unstale":"2024-09-21T00:56:00.665403+0000","last_undegraded":"2024-09-21T00:56:00.665403+0000","last_fullsized":"2024-09-21T00:56:00.665403+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:25.192109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.651490+0000","last_change":"2024-09-21T00:54:57.879034+0000","last_active":"2024-09-21T00:55:27.651490+0000","last_peered":"2024-09-21T00:55:27.651490+0000","last_clean":"2024-09-21T00:55:27.651490+0000","last_became_active":"2024-09-21T00:54:57.878673+0000","last_became_peered":"2024-09-21T00:54:57.878673+0000","last_unstale":"2024-09-21T00:55:27.651490+0000","last_undegraded":"2024-09-21T00:55:27.651490+0000","last_fullsized":"2024-09-21T00:55:27.651490+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:39:12.467465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'7","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.633751+0000","last_change":"2024-09-21T00:54:55.867451+0000","last_active":"2024-09-21T00:55:27.633751+0000","last_peered":"2024-09-21T00:55:27.633751+0000","last_clean":"2024-09-21T00:55:27.633751+0000","last_became_active":"2024-09-21T00:54:55.866998+0000","last_became_peered":"2024-09-21T00:54:55.866998+0000","last_unstale":"2024-09-21T00:55:27.633751+0000","last_undegraded":"2024-09-21T00:55:27.633751+0000","last_fullsized":"2024-09-21T00:55:27.633751+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:40.878647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.634072+0000","last_change":"2024-09-21T00:54:55.853055+0000","last_active":"2024-09-21T00:55:27.634072+0000","last_peered":"2024-09-21T00:55:27.634072+0000","last_clean":"2024-09-21T00:55:27.634072+0000","last_became_active":"2024-09-21T00:54:55.852672+0000","last_became_peered":"2024-09-21T00:54:55.852672+0000","last_unstale":"2024-09-21T00:55:27.634072+0000","last_undegraded":"2024-09-21T00:55:27.634072+0000","last_fullsized":"2024-09-21T00:55:27.634072+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:17.082588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:28.428719+0000","last_change":"2024-09-21T00:54:57.875024+0000","last_active":"2024-09-21T00:55:28.428719+0000","last_peered":"2024-09-21T00:55:28.428719+0000","last_clean":"2024-09-21T00:55:28.428719+0000","last_became_active":"2024-09-21T00:54:57.870027+0000","last_became_peered":"2024-09-21T00:54:57.870027+0000","last_unstale":"2024-09-21T00:55:28.428719+0000","last_undegraded":"2024-09-21T00:55:28.428719+0000","last_fullsized":"2024-09-21T00:55:28.428719+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:37:48.880686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.650846+0000","last_change":"2024-09-21T00:54:55.864527+0000","last_active":"2024-09-21T00:55:27.650846+0000","last_peered":"2024-09-21T00:55:27.650846+0000","last_clean":"2024-09-21T00:55:27.650846+0000","last_became_active":"2024-09-21T00:54:55.864191+0000","last_became_peered":"2024-09-21T00:54:55.864191+0000","last_unstale":"2024-09-21T00:55:27.650846+0000","last_undegraded":"2024-09-21T00:55:27.650846+0000","last_fullsized":"2024-09-21T00:55:27.650846+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:43.781116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.632540+0000","last_change":"2024-09-21T00:54:57.865671+0000","last_active":"2024-09-21T00:55:27.632540+0000","last_peered":"2024-09-21T00:55:27.632540+0000","last_clean":"2024-09-21T00:55:27.632540+0000","last_became_active":"2024-09-21T00:54:57.865196+0000","last_became_peered":"2024-09-21T00:54:57.865196+0000","last_unstale":"2024-09-21T00:55:27.632540+0000","last_undegraded":"2024-09-21T00:55:27.632540+0000","last_fullsized":"2024-09-21T00:55:27.632540+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:16.524866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'4","reported_seq":135,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:02.667798+0000","last_change":"2024-09-21T00:54:55.862504+0000","last_active":"2024-09-21T00:56:02.667798+0000","last_peered":"2024-09-21T00:56:02.667798+0000","last_clean":"2024-09-21T00:56:02.667798+0000","last_became_active":"2024-09-21T00:54:55.862065+0000","last_became_peered":"2024-09-21T00:54:55.862065+0000","last_unstale":"2024-09-21T00:56:02.667798+0000","last_undegraded":"2024-09-21T00:56:02.667798+0000","last_fullsized":"2024-09-21T00:56:02.667798+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:16.497313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637951+0000","last_change":"2024-09-21T00:54:57.873444+0000","last_active":"2024-09-21T00:55:27.637951+0000","last_peered":"2024-09-21T00:55:27.637951+0000","last_clean":"2024-09-21T00:55:27.637951+0000","last_became_active":"2024-09-21T00:54:57.873058+0000","last_became_peered":"2024-09-21T00:54:57.873058+0000","last_unstale":"2024-09-21T00:55:27.637951+0000","last_undegraded":"2024-09-21T00:55:27.637951+0000","last_fullsized":"2024-09-21T00:55:27.637951+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:36:40.603285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'4","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.967374+0000","last_change":"2024-09-21T00:55:27.967238+0000","last_active":"2024-09-21T00:55:27.967374+0000","last_peered":"2024-09-21T00:55:27.967374+0000","last_clean":"2024-09-21T00:55:27.967374+0000","last_became_active":"2024-09-21T00:55:27.962082+0000","last_became_peered":"2024-09-21T00:55:27.962082+0000","last_unstale":"2024-09-21T00:55:27.967374+0000","last_undegraded":"2024-09-21T00:55:27.967374+0000","last_fullsized":"2024-09-21T00:55:27.967374+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:02.943108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.652946+0000","last_change":"2024-09-21T00:55:27.652838+0000","last_active":"2024-09-21T00:55:27.652946+0000","last_peered":"2024-09-21T00:55:27.652946+0000","last_clean":"2024-09-21T00:55:27.652946+0000","last_became_active":"2024-09-21T00:55:27.652401+0000","last_became_peered":"2024-09-21T00:55:27.652401+0000","last_unstale":"2024-09-21T00:55:27.652946+0000","last_undegraded":"2024-09-21T00:55:27.652946+0000","last_fullsized":"2024-09-21T00:55:27.652946+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:53:33.968079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.651540+0000","last_change":"2024-09-21T00:54:55.968782+0000","last_active":"2024-09-21T00:55:27.651540+0000","last_peered":"2024-09-21T00:55:27.651540+0000","last_clean":"2024-09-21T00:55:27.651540+0000","last_became_active":"2024-09-21T00:54:55.968421+0000","last_became_peered":"2024-09-21T00:54:55.968421+0000","last_unstale":"2024-09-21T00:55:27.651540+0000","last_undegraded":"2024-09-21T00:55:27.651540+0000","last_fullsized":"2024-09-21T00:55:27.651540+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:28.680764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637341+0000","last_change":"2024-09-21T00:54:57.877610+0000","last_active":"2024-09-21T00:55:27.637341+0000","last_peered":"2024-09-21T00:55:27.637341+0000","last_clean":"2024-09-21T00:55:27.637341+0000","last_became_active":"2024-09-21T00:54:57.877225+0000","last_became_peered":"2024-09-21T00:54:57.877225+0000","last_unstale":"2024-09-21T00:55:27.637341+0000","last_undegraded":"2024-09-21T00:55:27.637341+0000","last_fullsized":"2024-09-21T00:55:27.637341+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:08.294366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'28","reported_seq":187,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:03.022681+0000","last_change":"2024-09-21T00:55:27.975731+0000","last_active":"2024-09-21T00:56:03.022681+0000","last_peered":"2024-09-21T00:56:03.022681+0000","last_clean":"2024-09-21T00:56:03.022681+0000","last_became_active":"2024-09-21T00:55:27.961766+0000","last_became_peered":"2024-09-21T00:55:27.961766+0000","last_unstale":"2024-09-21T00:56:03.022681+0000","last_undegraded":"2024-09-21T00:56:03.022681+0000","last_fullsized":"2024-09-21T00:56:03.022681+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:42:32.442882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63349,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":30,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":59092,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637324+0000","last_change":"2024-09-21T00:54:57.875575+0000","last_active":"2024-09-21T00:55:27.637324+0000","last_peered":"2024-09-21T00:55:27.637324+0000","last_clean":"2024-09-21T00:55:27.637324+0000","last_became_active":"2024-09-21T00:54:57.874975+0000","last_became_peered":"2024-09-21T00:54:57.874975+0000","last_unstale":"2024-09-21T00:55:27.637324+0000","last_undegraded":"2024-09-21T00:55:27.637324+0000","last_fullsized":"2024-09-21T00:55:27.637324+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:34:36.089068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'9","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637272+0000","last_change":"2024-09-21T00:54:55.863532+0000","last_active":"2024-09-21T00:55:27.637272+0000","last_peered":"2024-09-21T00:55:27.637272+0000","last_clean":"2024-09-21T00:55:27.637272+0000","last_became_active":"2024-09-21T00:54:55.863124+0000","last_became_peered":"2024-09-21T00:54:55.863124+0000","last_unstale":"2024-09-21T00:55:27.637272+0000","last_undegraded":"2024-09-21T00:55:27.637272+0000","last_fullsized":"2024-09-21T00:55:27.637272+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:41:07.996906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.634099+0000","last_change":"2024-09-21T00:54:57.866126+0000","last_active":"2024-09-21T00:55:27.634099+0000","last_peered":"2024-09-21T00:55:27.634099+0000","last_clean":"2024-09-21T00:55:27.634099+0000","last_became_active":"2024-09-21T00:54:57.865775+0000","last_became_peered":"2024-09-21T00:54:57.865775+0000","last_unstale":"2024-09-21T00:55:27.634099+0000","last_undegraded":"2024-09-21T00:55:27.634099+0000","last_fullsized":"2024-09-21T00:55:27.634099+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:28.261632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.651370+0000","last_change":"2024-09-21T00:54:55.864593+0000","last_active":"2024-09-21T00:55:27.651370+0000","last_peered":"2024-09-21T00:55:27.651370+0000","last_clean":"2024-09-21T00:55:27.651370+0000","last_became_active":"2024-09-21T00:54:55.864202+0000","last_became_peered":"2024-09-21T00:54:55.864202+0000","last_unstale":"2024-09-21T00:55:27.651370+0000","last_undegraded":"2024-09-21T00:55:27.651370+0000","last_fullsized":"2024-09-21T00:55:27.651370+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:06.976588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636663+0000","last_change":"2024-09-21T00:54:57.877892+0000","last_active":"2024-09-21T00:55:27.636663+0000","last_peered":"2024-09-21T00:55:27.636663+0000","last_clean":"2024-09-21T00:55:27.636663+0000","last_became_active":"2024-09-21T00:54:57.877510+0000","last_became_peered":"2024-09-21T00:54:57.877510+0000","last_unstale":"2024-09-21T00:55:27.636663+0000","last_undegraded":"2024-09-21T00:55:27.636663+0000","last_fullsized":"2024-09-21T00:55:27.636663+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:05.238100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'6","reported_seq":86,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:01.667055+0000","last_change":"2024-09-21T00:54:55.856707+0000","last_active":"2024-09-21T00:56:01.667055+0000","last_peered":"2024-09-21T00:56:01.667055+0000","last_clean":"2024-09-21T00:56:01.667055+0000","last_became_active":"2024-09-21T00:54:55.856095+0000","last_became_peered":"2024-09-21T00:54:55.856095+0000","last_unstale":"2024-09-21T00:56:01.667055+0000","last_undegraded":"2024-09-21T00:56:01.667055+0000","last_fullsized":"2024-09-21T00:56:01.667055+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:48.332764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":58,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636231+0000","last_change":"2024-09-21T00:54:57.868398+0000","last_active":"2024-09-21T00:55:27.636231+0000","last_peered":"2024-09-21T00:55:27.636231+0000","last_clean":"2024-09-21T00:55:27.636231+0000","last_became_active":"2024-09-21T00:54:57.867963+0000","last_became_peered":"2024-09-21T00:54:57.867963+0000","last_unstale":"2024-09-21T00:55:27.636231+0000","last_undegraded":"2024-09-21T00:55:27.636231+0000","last_fullsized":"2024-09-21T00:55:27.636231+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:59:31.527713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'17","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.659007+0000","last_change":"2024-09-21T00:55:27.658543+0000","last_active":"2024-09-21T00:55:27.659007+0000","last_peered":"2024-09-21T00:55:27.659007+0000","last_clean":"2024-09-21T00:55:27.659007+0000","last_became_active":"2024-09-21T00:55:27.639915+0000","last_became_peered":"2024-09-21T00:55:27.639915+0000","last_unstale":"2024-09-21T00:55:27.659007+0000","last_undegraded":"2024-09-21T00:55:27.659007+0000","last_fullsized":"2024-09-21T00:55:27.659007+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:51.736732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.651146+0000","last_change":"2024-09-21T00:54:57.872256+0000","last_active":"2024-09-21T00:55:27.651146+0000","last_peered":"2024-09-21T00:55:27.651146+0000","last_clean":"2024-09-21T00:55:27.651146+0000","last_became_active":"2024-09-21T00:54:57.871848+0000","last_became_peered":"2024-09-21T00:54:57.871848+0000","last_unstale":"2024-09-21T00:55:27.651146+0000","last_undegraded":"2024-09-21T00:55:27.651146+0000","last_fullsized":"2024-09-21T00:55:27.651146+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:24:11.314693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636721+0000","last_change":"2024-09-21T00:54:55.870096+0000","last_active":"2024-09-21T00:55:27.636721+0000","last_peered":"2024-09-21T00:55:27.636721+0000","last_clean":"2024-09-21T00:55:27.636721+0000","last_became_active":"2024-09-21T00:54:55.869616+0000","last_became_peered":"2024-09-21T00:54:55.869616+0000","last_unstale":"2024-09-21T00:55:27.636721+0000","last_undegraded":"2024-09-21T00:55:27.636721+0000","last_fullsized":"2024-09-21T00:55:27.636721+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:53:48.036499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.653084+0000","last_change":"2024-09-21T00:55:27.652960+0000","last_active":"2024-09-21T00:55:27.653084+0000","last_peered":"2024-09-21T00:55:27.653084+0000","last_clean":"2024-09-21T00:55:27.653084+0000","last_became_active":"2024-09-21T00:55:27.652420+0000","last_became_peered":"2024-09-21T00:55:27.652420+0000","last_unstale":"2024-09-21T00:55:27.653084+0000","last_undegraded":"2024-09-21T00:55:27.653084+0000","last_fullsized":"2024-09-21T00:55:27.653084+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:24.436368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'5","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.634222+0000","last_change":"2024-09-21T00:54:55.866393+0000","last_active":"2024-09-21T00:55:27.634222+0000","last_peered":"2024-09-21T00:55:27.634222+0000","last_clean":"2024-09-21T00:55:27.634222+0000","last_became_active":"2024-09-21T00:54:55.865980+0000","last_became_peered":"2024-09-21T00:54:55.865980+0000","last_unstale":"2024-09-21T00:55:27.634222+0000","last_undegraded":"2024-09-21T00:55:27.634222+0000","last_fullsized":"2024-09-21T00:55:27.634222+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:56.471011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637771+0000","last_change":"2024-09-21T00:54:57.875177+0000","last_active":"2024-09-21T00:55:27.637771+0000","last_peered":"2024-09-21T00:55:27.637771+0000","last_clean":"2024-09-21T00:55:27.637771+0000","last_became_active":"2024-09-21T00:54:57.874819+0000","last_became_peered":"2024-09-21T00:54:57.874819+0000","last_unstale":"2024-09-21T00:55:27.637771+0000","last_undegraded":"2024-09-21T00:55:27.637771+0000","last_fullsized":"2024-09-21T00:55:27.637771+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:43.942703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.651656+0000","last_change":"2024-09-21T00:54:55.864668+0000","last_active":"2024-09-21T00:55:27.651656+0000","last_peered":"2024-09-21T00:55:27.651656+0000","last_clean":"2024-09-21T00:55:27.651656+0000","last_became_active":"2024-09-21T00:54:55.864330+0000","last_became_peered":"2024-09-21T00:54:55.864330+0000","last_unstale":"2024-09-21T00:55:27.651656+0000","last_undegraded":"2024-09-21T00:55:27.651656+0000","last_fullsized":"2024-09-21T00:55:27.651656+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:45:50.751390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637251+0000","last_change":"2024-09-21T00:54:57.871093+0000","last_active":"2024-09-21T00:55:27.637251+0000","last_peered":"2024-09-21T00:55:27.637251+0000","last_clean":"2024-09-21T00:55:27.637251+0000","last_became_active":"2024-09-21T00:54:57.870457+0000","last_became_peered":"2024-09-21T00:54:57.870457+0000","last_unstale":"2024-09-21T00:55:27.637251+0000","last_undegraded":"2024-09-21T00:55:27.637251+0000","last_fullsized":"2024-09-21T00:55:27.637251+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:19.810575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'6","reported_seq":83,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:58.662114+0000","last_change":"2024-09-21T00:54:55.968156+0000","last_active":"2024-09-21T00:55:58.662114+0000","last_peered":"2024-09-21T00:55:58.662114+0000","last_clean":"2024-09-21T00:55:58.662114+0000","last_became_active":"2024-09-21T00:54:55.967668+0000","last_became_peered":"2024-09-21T00:54:55.967668+0000","last_unstale":"2024-09-21T00:55:58.662114+0000","last_undegraded":"2024-09-21T00:55:58.662114+0000","last_fullsized":"2024-09-21T00:55:58.662114+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:28.854249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637573+0000","last_change":"2024-09-21T00:54:57.868187+0000","last_active":"2024-09-21T00:55:27.637573+0000","last_peered":"2024-09-21T00:55:27.637573+0000","last_clean":"2024-09-21T00:55:27.637573+0000","last_became_active":"2024-09-21T00:54:57.867709+0000","last_became_peered":"2024-09-21T00:54:57.867709+0000","last_unstale":"2024-09-21T00:55:27.637573+0000","last_undegraded":"2024-09-21T00:55:27.637573+0000","last_fullsized":"2024-09-21T00:55:27.637573+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:40.123030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":96,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636464+0000","last_change":"2024-09-21T00:53:44.515787+0000","last_active":"2024-09-21T00:55:27.636464+0000","last_peered":"2024-09-21T00:55:27.636464+0000","last_clean":"2024-09-21T00:55:27.636464+0000","last_became_active":"2024-09-21T00:53:44.510106+0000","last_became_peered":"2024-09-21T00:53:44.510106+0000","last_unstale":"2024-09-21T00:55:27.636464+0000","last_undegraded":"2024-09-21T00:55:27.636464+0000","last_fullsized":"2024-09-21T00:55:27.636464+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:50:16.598790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:50:16.598790+0000","last_clean_scrub_stamp":"2024-09-21T00:50:16.598790+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:04:14.481212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'6","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.958651+0000","last_change":"2024-09-21T00:54:55.854929+0000","last_active":"2024-09-21T00:55:27.958651+0000","last_peered":"2024-09-21T00:55:27.958651+0000","last_clean":"2024-09-21T00:55:27.958651+0000","last_became_active":"2024-09-21T00:54:55.854489+0000","last_became_peered":"2024-09-21T00:54:55.854489+0000","last_unstale":"2024-09-21T00:55:27.958651+0000","last_undegraded":"2024-09-21T00:55:27.958651+0000","last_fullsized":"2024-09-21T00:55:27.958651+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:03.067142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.653142+0000","last_change":"2024-09-21T00:55:27.652679+0000","last_active":"2024-09-21T00:55:27.653142+0000","last_peered":"2024-09-21T00:55:27.653142+0000","last_clean":"2024-09-21T00:55:27.653142+0000","last_became_active":"2024-09-21T00:55:27.652348+0000","last_became_peered":"2024-09-21T00:55:27.652348+0000","last_unstale":"2024-09-21T00:55:27.653142+0000","last_undegraded":"2024-09-21T00:55:27.653142+0000","last_fullsized":"2024-09-21T00:55:27.653142+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:11.974613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636380+0000","last_change":"2024-09-21T00:54:55.863265+0000","last_active":"2024-09-21T00:55:27.636380+0000","last_peered":"2024-09-21T00:55:27.636380+0000","last_clean":"2024-09-21T00:55:27.636380+0000","last_became_active":"2024-09-21T00:54:55.862613+0000","last_became_peered":"2024-09-21T00:54:55.862613+0000","last_unstale":"2024-09-21T00:55:27.636380+0000","last_undegraded":"2024-09-21T00:55:27.636380+0000","last_fullsized":"2024-09-21T00:55:27.636380+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:56.707143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.634062+0000","last_change":"2024-09-21T00:54:57.855249+0000","last_active":"2024-09-21T00:55:27.634062+0000","last_peered":"2024-09-21T00:55:27.634062+0000","last_clean":"2024-09-21T00:55:27.634062+0000","last_became_active":"2024-09-21T00:54:57.854879+0000","last_became_peered":"2024-09-21T00:54:57.854879+0000","last_unstale":"2024-09-21T00:55:27.634062+0000","last_undegraded":"2024-09-21T00:55:27.634062+0000","last_fullsized":"2024-09-21T00:55:27.634062+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:15.733514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'5","reported_seq":80,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:58.661689+0000","last_change":"2024-09-21T00:54:55.968078+0000","last_active":"2024-09-21T00:55:58.661689+0000","last_peered":"2024-09-21T00:55:58.661689+0000","last_clean":"2024-09-21T00:55:58.661689+0000","last_became_active":"2024-09-21T00:54:55.967700+0000","last_became_peered":"2024-09-21T00:54:55.967700+0000","last_unstale":"2024-09-21T00:55:58.661689+0000","last_undegraded":"2024-09-21T00:55:58.661689+0000","last_fullsized":"2024-09-21T00:55:58.661689+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:35.121889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.650675+0000","last_change":"2024-09-21T00:54:57.873224+0000","last_active":"2024-09-21T00:55:27.650675+0000","last_peered":"2024-09-21T00:55:27.650675+0000","last_clean":"2024-09-21T00:55:27.650675+0000","last_became_active":"2024-09-21T00:54:57.872828+0000","last_became_peered":"2024-09-21T00:54:57.872828+0000","last_unstale":"2024-09-21T00:55:27.650675+0000","last_undegraded":"2024-09-21T00:55:27.650675+0000","last_fullsized":"2024-09-21T00:55:27.650675+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:58:55.758620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'5","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:59.662960+0000","last_change":"2024-09-21T00:54:55.859887+0000","last_active":"2024-09-21T00:55:59.662960+0000","last_peered":"2024-09-21T00:55:59.662960+0000","last_clean":"2024-09-21T00:55:59.662960+0000","last_became_active":"2024-09-21T00:54:55.859351+0000","last_became_peered":"2024-09-21T00:54:55.859351+0000","last_unstale":"2024-09-21T00:55:59.662960+0000","last_undegraded":"2024-09-21T00:55:59.662960+0000","last_fullsized":"2024-09-21T00:55:59.662960+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:31.407409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.633851+0000","last_change":"2024-09-21T00:54:57.882568+0000","last_active":"2024-09-21T00:55:27.633851+0000","last_peered":"2024-09-21T00:55:27.633851+0000","last_clean":"2024-09-21T00:55:27.633851+0000","last_became_active":"2024-09-21T00:54:57.882190+0000","last_became_peered":"2024-09-21T00:54:57.882190+0000","last_unstale":"2024-09-21T00:55:27.633851+0000","last_undegraded":"2024-09-21T00:55:27.633851+0000","last_fullsized":"2024-09-21T00:55:27.633851+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:19.339490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.632817+0000","last_change":"2024-09-21T00:54:55.970154+0000","last_active":"2024-09-21T00:55:27.632817+0000","last_peered":"2024-09-21T00:55:27.632817+0000","last_clean":"2024-09-21T00:55:27.632817+0000","last_became_active":"2024-09-21T00:54:55.969774+0000","last_became_peered":"2024-09-21T00:54:55.969774+0000","last_unstale":"2024-09-21T00:55:27.632817+0000","last_undegraded":"2024-09-21T00:55:27.632817+0000","last_fullsized":"2024-09-21T00:55:27.632817+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:05.241455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.633985+0000","last_change":"2024-09-21T00:54:57.873452+0000","last_active":"2024-09-21T00:55:27.633985+0000","last_peered":"2024-09-21T00:55:27.633985+0000","last_clean":"2024-09-21T00:55:27.633985+0000","last_became_active":"2024-09-21T00:54:57.872592+0000","last_became_peered":"2024-09-21T00:54:57.872592+0000","last_unstale":"2024-09-21T00:55:27.633985+0000","last_undegraded":"2024-09-21T00:55:27.633985+0000","last_fullsized":"2024-09-21T00:55:27.633985+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:25.196491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637464+0000","last_change":"2024-09-21T00:54:55.968563+0000","last_active":"2024-09-21T00:55:27.637464+0000","last_peered":"2024-09-21T00:55:27.637464+0000","last_clean":"2024-09-21T00:55:27.637464+0000","last_became_active":"2024-09-21T00:54:55.968176+0000","last_became_peered":"2024-09-21T00:54:55.968176+0000","last_unstale":"2024-09-21T00:55:27.637464+0000","last_undegraded":"2024-09-21T00:55:27.637464+0000","last_fullsized":"2024-09-21T00:55:27.637464+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:35.120595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.634408+0000","last_change":"2024-09-21T00:54:57.862128+0000","last_active":"2024-09-21T00:55:27.634408+0000","last_peered":"2024-09-21T00:55:27.634408+0000","last_clean":"2024-09-21T00:55:27.634408+0000","last_became_active":"2024-09-21T00:54:57.861692+0000","last_became_peered":"2024-09-21T00:54:57.861692+0000","last_unstale":"2024-09-21T00:55:27.634408+0000","last_undegraded":"2024-09-21T00:55:27.634408+0000","last_fullsized":"2024-09-21T00:55:27.634408+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:58:29.364344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"73'15","reported_seq":38,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.632846+0000","last_change":"2024-09-21T00:54:55.866240+0000","last_active":"2024-09-21T00:55:27.632846+0000","last_peered":"2024-09-21T00:55:27.632846+0000","last_clean":"2024-09-21T00:55:27.632846+0000","last_became_active":"2024-09-21T00:54:55.865192+0000","last_became_peered":"2024-09-21T00:54:55.865192+0000","last_unstale":"2024-09-21T00:55:27.632846+0000","last_undegraded":"2024-09-21T00:55:27.632846+0000","last_fullsized":"2024-09-21T00:55:27.632846+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:53:17.599528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:28.429294+0000","last_change":"2024-09-21T00:54:57.878847+0000","last_active":"2024-09-21T00:55:28.429294+0000","last_peered":"2024-09-21T00:55:28.429294+0000","last_clean":"2024-09-21T00:55:28.429294+0000","last_became_active":"2024-09-21T00:54:57.878117+0000","last_became_peered":"2024-09-21T00:54:57.878117+0000","last_unstale":"2024-09-21T00:55:28.429294+0000","last_undegraded":"2024-09-21T00:55:28.429294+0000","last_fullsized":"2024-09-21T00:55:28.429294+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:46.090963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'7","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.958730+0000","last_change":"2024-09-21T00:54:55.854035+0000","last_active":"2024-09-21T00:55:27.958730+0000","last_peered":"2024-09-21T00:55:27.958730+0000","last_clean":"2024-09-21T00:55:27.958730+0000","last_became_active":"2024-09-21T00:54:55.853301+0000","last_became_peered":"2024-09-21T00:54:55.853301+0000","last_unstale":"2024-09-21T00:55:27.958730+0000","last_undegraded":"2024-09-21T00:55:27.958730+0000","last_fullsized":"2024-09-21T00:55:27.958730+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:11.498865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636479+0000","last_change":"2024-09-21T00:54:57.875093+0000","last_active":"2024-09-21T00:55:27.636479+0000","last_peered":"2024-09-21T00:55:27.636479+0000","last_clean":"2024-09-21T00:55:27.636479+0000","last_became_active":"2024-09-21T00:54:57.873996+0000","last_became_peered":"2024-09-21T00:54:57.873996+0000","last_unstale":"2024-09-21T00:55:27.636479+0000","last_undegraded":"2024-09-21T00:55:27.636479+0000","last_fullsized":"2024-09-21T00:55:27.636479+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:17:55.990167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637124+0000","last_change":"2024-09-21T00:54:55.968507+0000","last_active":"2024-09-21T00:55:27.637124+0000","last_peered":"2024-09-21T00:55:27.637124+0000","last_clean":"2024-09-21T00:55:27.637124+0000","last_became_active":"2024-09-21T00:54:55.968084+0000","last_became_peered":"2024-09-21T00:54:55.968084+0000","last_unstale":"2024-09-21T00:55:27.637124+0000","last_undegraded":"2024-09-21T00:55:27.637124+0000","last_fullsized":"2024-09-21T00:55:27.637124+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:34:06.325264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636905+0000","last_change":"2024-09-21T00:54:57.870500+0000","last_active":"2024-09-21T00:55:27.636905+0000","last_peered":"2024-09-21T00:55:27.636905+0000","last_clean":"2024-09-21T00:55:27.636905+0000","last_became_active":"2024-09-21T00:54:57.870103+0000","last_became_peered":"2024-09-21T00:54:57.870103+0000","last_unstale":"2024-09-21T00:55:27.636905+0000","last_undegraded":"2024-09-21T00:55:27.636905+0000","last_fullsized":"2024-09-21T00:55:27.636905+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:31:03.469863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'7","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:28.428026+0000","last_change":"2024-09-21T00:54:55.856185+0000","last_active":"2024-09-21T00:55:28.428026+0000","last_peered":"2024-09-21T00:55:28.428026+0000","last_clean":"2024-09-21T00:55:28.428026+0000","last_became_active":"2024-09-21T00:54:55.855738+0000","last_became_peered":"2024-09-21T00:54:55.855738+0000","last_unstale":"2024-09-21T00:55:28.428026+0000","last_undegraded":"2024-09-21T00:55:28.428026+0000","last_fullsized":"2024-09-21T00:55:28.428026+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:02.870874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.633969+0000","last_change":"2024-09-21T00:54:57.877828+0000","last_active":"2024-09-21T00:55:27.633969+0000","last_peered":"2024-09-21T00:55:27.633969+0000","last_clean":"2024-09-21T00:55:27.633969+0000","last_became_active":"2024-09-21T00:54:57.877414+0000","last_became_peered":"2024-09-21T00:54:57.877414+0000","last_unstale":"2024-09-21T00:55:27.633969+0000","last_undegraded":"2024-09-21T00:55:27.633969+0000","last_fullsized":"2024-09-21T00:55:27.633969+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:27.485830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636884+0000","last_change":"2024-09-21T00:54:55.868014+0000","last_active":"2024-09-21T00:55:27.636884+0000","last_peered":"2024-09-21T00:55:27.636884+0000","last_clean":"2024-09-21T00:55:27.636884+0000","last_became_active":"2024-09-21T00:54:55.867640+0000","last_became_peered":"2024-09-21T00:54:55.867640+0000","last_unstale":"2024-09-21T00:55:27.636884+0000","last_undegraded":"2024-09-21T00:55:27.636884+0000","last_fullsized":"2024-09-21T00:55:27.636884+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:24:57.118238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:28.428938+0000","last_change":"2024-09-21T00:54:57.881935+0000","last_active":"2024-09-21T00:55:28.428938+0000","last_peered":"2024-09-21T00:55:28.428938+0000","last_clean":"2024-09-21T00:55:28.428938+0000","last_became_active":"2024-09-21T00:54:57.881598+0000","last_became_peered":"2024-09-21T00:54:57.881598+0000","last_unstale":"2024-09-21T00:55:28.428938+0000","last_undegraded":"2024-09-21T00:55:28.428938+0000","last_fullsized":"2024-09-21T00:55:28.428938+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:44:19.893961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.645759+0000","last_change":"2024-09-21T00:55:27.645172+0000","last_active":"2024-09-21T00:55:27.645759+0000","last_peered":"2024-09-21T00:55:27.645759+0000","last_clean":"2024-09-21T00:55:27.645759+0000","last_became_active":"2024-09-21T00:55:27.639795+0000","last_became_peered":"2024-09-21T00:55:27.639795+0000","last_unstale":"2024-09-21T00:55:27.645759+0000","last_undegraded":"2024-09-21T00:55:27.645759+0000","last_fullsized":"2024-09-21T00:55:27.645759+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:20:50.639608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637202+0000","last_change":"2024-09-21T00:54:57.867972+0000","last_active":"2024-09-21T00:55:27.637202+0000","last_peered":"2024-09-21T00:55:27.637202+0000","last_clean":"2024-09-21T00:55:27.637202+0000","last_became_active":"2024-09-21T00:54:57.867586+0000","last_became_peered":"2024-09-21T00:54:57.867586+0000","last_unstale":"2024-09-21T00:55:27.637202+0000","last_undegraded":"2024-09-21T00:55:27.637202+0000","last_fullsized":"2024-09-21T00:55:27.637202+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:27.066795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.651495+0000","last_change":"2024-09-21T00:54:57.881014+0000","last_active":"2024-09-21T00:55:27.651495+0000","last_peered":"2024-09-21T00:55:27.651495+0000","last_clean":"2024-09-21T00:55:27.651495+0000","last_became_active":"2024-09-21T00:54:57.880608+0000","last_became_peered":"2024-09-21T00:54:57.880608+0000","last_unstale":"2024-09-21T00:55:27.651495+0000","last_undegraded":"2024-09-21T00:55:27.651495+0000","last_fullsized":"2024-09-21T00:55:27.651495+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:48:31.848315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.638999+0000","last_change":"2024-09-21T00:54:55.865031+0000","last_active":"2024-09-21T00:55:27.638999+0000","last_peered":"2024-09-21T00:55:27.638999+0000","last_clean":"2024-09-21T00:55:27.638999+0000","last_became_active":"2024-09-21T00:54:55.864576+0000","last_became_peered":"2024-09-21T00:54:55.864576+0000","last_unstale":"2024-09-21T00:55:27.638999+0000","last_undegraded":"2024-09-21T00:55:27.638999+0000","last_fullsized":"2024-09-21T00:55:27.638999+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:13.125491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637188+0000","last_change":"2024-09-21T00:54:57.875878+0000","last_active":"2024-09-21T00:55:27.637188+0000","last_peered":"2024-09-21T00:55:27.637188+0000","last_clean":"2024-09-21T00:55:27.637188+0000","last_became_active":"2024-09-21T00:54:57.874177+0000","last_became_peered":"2024-09-21T00:54:57.874177+0000","last_unstale":"2024-09-21T00:55:27.637188+0000","last_undegraded":"2024-09-21T00:55:27.637188+0000","last_fullsized":"2024-09-21T00:55:27.637188+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:25.333036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'12","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637565+0000","last_change":"2024-09-21T00:54:55.868698+0000","last_active":"2024-09-21T00:55:27.637565+0000","last_peered":"2024-09-21T00:55:27.637565+0000","last_clean":"2024-09-21T00:55:27.637565+0000","last_became_active":"2024-09-21T00:54:55.868282+0000","last_became_peered":"2024-09-21T00:54:55.868282+0000","last_unstale":"2024-09-21T00:55:27.637565+0000","last_undegraded":"2024-09-21T00:55:27.637565+0000","last_fullsized":"2024-09-21T00:55:27.637565+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:50.253638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636680+0000","last_change":"2024-09-21T00:54:57.867726+0000","last_active":"2024-09-21T00:55:27.636680+0000","last_peered":"2024-09-21T00:55:27.636680+0000","last_clean":"2024-09-21T00:55:27.636680+0000","last_became_active":"2024-09-21T00:54:57.866090+0000","last_became_peered":"2024-09-21T00:54:57.866090+0000","last_unstale":"2024-09-21T00:55:27.636680+0000","last_undegraded":"2024-09-21T00:55:27.636680+0000","last_fullsized":"2024-09-21T00:55:27.636680+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:57.938078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:28.428068+0000","last_change":"2024-09-21T00:54:55.968155+0000","last_active":"2024-09-21T00:55:28.428068+0000","last_peered":"2024-09-21T00:55:28.428068+0000","last_clean":"2024-09-21T00:55:28.428068+0000","last_became_active":"2024-09-21T00:54:55.967718+0000","last_became_peered":"2024-09-21T00:54:55.967718+0000","last_unstale":"2024-09-21T00:55:28.428068+0000","last_undegraded":"2024-09-21T00:55:28.428068+0000","last_fullsized":"2024-09-21T00:55:28.428068+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:18.160380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:28.429205+0000","last_change":"2024-09-21T00:54:57.873102+0000","last_active":"2024-09-21T00:55:28.429205+0000","last_peered":"2024-09-21T00:55:28.429205+0000","last_clean":"2024-09-21T00:55:28.429205+0000","last_became_active":"2024-09-21T00:54:57.872323+0000","last_became_peered":"2024-09-21T00:54:57.872323+0000","last_unstale":"2024-09-21T00:55:28.429205+0000","last_undegraded":"2024-09-21T00:55:28.429205+0000","last_fullsized":"2024-09-21T00:55:28.429205+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:18.087601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'13","reported_seq":89,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:59.662396+0000","last_change":"2024-09-21T00:54:55.865559+0000","last_active":"2024-09-21T00:55:59.662396+0000","last_peered":"2024-09-21T00:55:59.662396+0000","last_clean":"2024-09-21T00:55:59.662396+0000","last_became_active":"2024-09-21T00:54:55.865157+0000","last_became_peered":"2024-09-21T00:54:55.865157+0000","last_unstale":"2024-09-21T00:55:59.662396+0000","last_undegraded":"2024-09-21T00:55:59.662396+0000","last_fullsized":"2024-09-21T00:55:59.662396+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:53.113970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70553,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":556,"num_read_kb":346,"num_write":241,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":59204,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":524288,"data_stored":211659,"data_compressed":13542,"data_compressed_allocated":20480,"data_compressed_original":73728,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":283734,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808858,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":827392,"data_stored":395958,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972384,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":1050224,"data_compressed":43733,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135908,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":843776,"data_stored":395385,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332138,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":831488,"data_stored":395651,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528366,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":892928,"data_stored":988281,"data_compressed":41838,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691891,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":827392,"data_stored":395102,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888121,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":905216,"data_stored":987568,"data_compressed":41838,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018943,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36188,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708964,"statfs":{"total":95995035648,"available":95957979136,"internally_reserved":0,"allocated":856064,"data_stored":458703,"data_compressed":15515,"data_compressed_allocated":20480,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215172,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":843776,"data_stored":394927,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411401,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36164,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708988,"statfs":{"total":95995035648,"available":95958003712,"internally_reserved":0,"allocated":839680,"data_stored":396626,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36216,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708936,"statfs":{"total":95995035648,"available":95957950464,"internally_reserved":0,"allocated":888832,"data_stored":459364,"data_compressed":7658,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36180,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708972,"statfs":{"total":95995035648,"available":95957987328,"internally_reserved":0,"allocated":847872,"data_stored":396832,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":65101,"data_compressed":1895,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":64440,"data_compressed":9752,"data_compressed_allocated":12288,"data_compressed_original":57344,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":65476,"data_compressed":1895,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:56:06.375 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T00:56:06.634 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:07.055 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:06 smithi001 ceph-mon[31211]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:56:07.055 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:06 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:07.055 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:06 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:56:07.055 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:06 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:56:07.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.149+0000 7f131b1cf640 1 -- 172.21.15.1:0/1349103296 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1314109df0 msgr2=0x7f1314110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:07.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.149+0000 7f131b1cf640 1 --2- 172.21.15.1:0/1349103296 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1314109df0 0x7f1314110620 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f130c009ca0 tx=0x7f130c02a8c0 comp rx=0 tx=0).stop 2024-09-21T00:56:07.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.149+0000 7f131b1cf640 1 -- 172.21.15.1:0/1349103296 shutdown_connections 2024-09-21T00:56:07.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.149+0000 7f131b1cf640 1 --2- 172.21.15.1:0/1349103296 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1314109df0 0x7f1314110620 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:07.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.149+0000 7f131b1cf640 1 --2- 172.21.15.1:0/1349103296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13141094a0 0x7f13141098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:07.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.149+0000 7f131b1cf640 1 --2- 172.21.15.1:0/1349103296 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1314103b60 0x7f1314103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:07.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.149+0000 7f131b1cf640 1 -- 172.21.15.1:0/1349103296 >> 172.21.15.1:0/1349103296 conn(0x7f131407b850 msgr2=0x7f131407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:07.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.149+0000 7f131b1cf640 1 -- 172.21.15.1:0/1349103296 shutdown_connections 2024-09-21T00:56:07.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.149+0000 7f131b1cf640 1 -- 172.21.15.1:0/1349103296 wait complete. 2024-09-21T00:56:07.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.149+0000 7f131b1cf640 1 Processor -- start 2024-09-21T00:56:07.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.149+0000 7f131b1cf640 1 -- start start 2024-09-21T00:56:07.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.150+0000 7f131b1cf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1314103b60 0x7f131419a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:07.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.150+0000 7f131b1cf640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13141094a0 0x7f131419a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:07.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.150+0000 7f131b1cf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1314109df0 0x7f131419fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:07.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.150+0000 7f131b1cf640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1314113ab0 con 0x7f1314109df0 2024-09-21T00:56:07.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.150+0000 7f131b1cf640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1314113930 con 0x7f1314103b60 2024-09-21T00:56:07.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.150+0000 7f131b1cf640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1314113c30 con 0x7f13141094a0 2024-09-21T00:56:07.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.150+0000 7f131976c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1314109df0 0x7f131419fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:07.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.150+0000 7f131976c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1314109df0 0x7f131419fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48158/0 (socket says 172.21.15.1:48158) 2024-09-21T00:56:07.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.150+0000 7f131976c640 1 -- 172.21.15.1:0/246594153 learned_addr learned my addr 172.21.15.1:0/246594153 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:07.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.150+0000 7f1318f6b640 1 --2- 172.21.15.1:0/246594153 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1314103b60 0x7f131419a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:07.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.150+0000 7f1313fff640 1 --2- 172.21.15.1:0/246594153 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13141094a0 0x7f131419a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:07.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.150+0000 7f131976c640 1 -- 172.21.15.1:0/246594153 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13141094a0 msgr2=0x7f131419a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:07.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.150+0000 7f131976c640 1 --2- 172.21.15.1:0/246594153 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13141094a0 0x7f131419a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:07.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.150+0000 7f131976c640 1 -- 172.21.15.1:0/246594153 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1314103b60 msgr2=0x7f131419a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:07.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.150+0000 7f131976c640 1 --2- 172.21.15.1:0/246594153 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1314103b60 0x7f131419a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:07.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.150+0000 7f131976c640 1 -- 172.21.15.1:0/246594153 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13141a02f0 con 0x7f1314109df0 2024-09-21T00:56:07.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.150+0000 7f1313fff640 1 --2- 172.21.15.1:0/246594153 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13141094a0 0x7f131419a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:56:07.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.150+0000 7f131976c640 1 --2- 172.21.15.1:0/246594153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1314109df0 0x7f131419fc80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f130c005cc0 tx=0x7f130c02f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:07.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.151+0000 7f1311ffb640 1 -- 172.21.15.1:0/246594153 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f130c003cf0 con 0x7f1314109df0 2024-09-21T00:56:07.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.151+0000 7f1311ffb640 1 -- 172.21.15.1:0/246594153 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f130c0044f0 con 0x7f1314109df0 2024-09-21T00:56:07.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.151+0000 7f131b1cf640 1 -- 172.21.15.1:0/246594153 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13141a0580 con 0x7f1314109df0 2024-09-21T00:56:07.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.151+0000 7f1311ffb640 1 -- 172.21.15.1:0/246594153 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f130c02fc30 con 0x7f1314109df0 2024-09-21T00:56:07.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.151+0000 7f131b1cf640 1 -- 172.21.15.1:0/246594153 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13141a0ac0 con 0x7f1314109df0 2024-09-21T00:56:07.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.152+0000 7f131b1cf640 1 -- 172.21.15.1:0/246594153 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1314103f70 con 0x7f1314109df0 2024-09-21T00:56:07.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.154+0000 7f1311ffb640 1 -- 172.21.15.1:0/246594153 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7f130c0046a0 con 0x7f1314109df0 2024-09-21T00:56:07.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.154+0000 7f1311ffb640 1 --2- 172.21.15.1:0/246594153 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f13040b65d0 0x7f13040b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:07.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.155+0000 7f1318f6b640 1 --2- 172.21.15.1:0/246594153 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f13040b65d0 0x7f13040b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:07.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.155+0000 7f1311ffb640 1 -- 172.21.15.1:0/246594153 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f130c108b20 con 0x7f1314109df0 2024-09-21T00:56:07.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.155+0000 7f1318f6b640 1 --2- 172.21.15.1:0/246594153 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f13040b65d0 0x7f13040b8ae0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f130800abe0 tx=0x7f130800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:07.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.158+0000 7f1311ffb640 1 -- 172.21.15.1:0/246594153 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f130c0cf230 con 0x7f1314109df0 2024-09-21T00:56:07.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:06 smithi193 ceph-mon[34660]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:56:07.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:06 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:07.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:06 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:56:07.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:06 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:56:07.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:06 smithi042 ceph-mon[34481]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:56:07.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:06 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:07.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:06 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:56:07.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:06 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:56:07.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.344+0000 7f131b1cf640 1 -- 172.21.15.1:0/246594153 --> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f131410bc50 con 0x7f13040b65d0 2024-09-21T00:56:07.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.348+0000 7f1311ffb640 1 -- 172.21.15.1:0/246594153 <== mgr.14150 v2:172.21.15.1:6800/2032980330 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259053 (secure 0 0 0) 0x7f130800fc20 con 0x7f13040b65d0 2024-09-21T00:56:07.351 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:56:07.352 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-21T00:56:07.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.351+0000 7f131b1cf640 1 -- 172.21.15.1:0/246594153 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f13040b65d0 msgr2=0x7f13040b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:07.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.351+0000 7f131b1cf640 1 --2- 172.21.15.1:0/246594153 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f13040b65d0 0x7f13040b8ae0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f130800abe0 tx=0x7f130800a2d0 comp rx=0 tx=0).stop 2024-09-21T00:56:07.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.351+0000 7f131b1cf640 1 -- 172.21.15.1:0/246594153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1314109df0 msgr2=0x7f131419fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:07.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.351+0000 7f131b1cf640 1 --2- 172.21.15.1:0/246594153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1314109df0 0x7f131419fc80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f130c005cc0 tx=0x7f130c02f470 comp rx=0 tx=0).stop 2024-09-21T00:56:07.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.351+0000 7f131b1cf640 1 -- 172.21.15.1:0/246594153 shutdown_connections 2024-09-21T00:56:07.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.352+0000 7f131b1cf640 1 --2- 172.21.15.1:0/246594153 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f13040b65d0 0x7f13040b8ae0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:07.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.352+0000 7f131b1cf640 1 --2- 172.21.15.1:0/246594153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1314109df0 0x7f131419fc80 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:07.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.352+0000 7f131b1cf640 1 --2- 172.21.15.1:0/246594153 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13141094a0 0x7f131419a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:07.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.352+0000 7f131b1cf640 1 --2- 172.21.15.1:0/246594153 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1314103b60 0x7f131419a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:07.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.352+0000 7f131b1cf640 1 -- 172.21.15.1:0/246594153 >> 172.21.15.1:0/246594153 conn(0x7f131407b850 msgr2=0x7f13141074b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:07.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.352+0000 7f131b1cf640 1 -- 172.21.15.1:0/246594153 shutdown_connections 2024-09-21T00:56:07.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:07.352+0000 7f131b1cf640 1 -- 172.21.15.1:0/246594153 wait complete. 2024-09-21T00:56:08.010 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:07 smithi001 ceph-mon[31211]: pgmap v325: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:56:08.039 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":325,"stamp":"2024-09-21T00:56:06.100786+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661155,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":647,"num_read_kb":415,"num_write":366,"num_write_kb":2290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":3011044,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":301,"ondisk_log_size":301,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":380252,"kb_used_data":10136,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124561572,"statfs":{"total":1151940427776,"available":1151551049728,"internally_reserved":0,"allocated":10379264,"data_stored":6714621,"data_compressed":190923,"data_compressed_allocated":253952,"data_compressed_original":2039808,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003433"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.635082+0000","last_change":"2024-09-21T00:54:57.879464+0000","last_active":"2024-09-21T00:55:27.635082+0000","last_peered":"2024-09-21T00:55:27.635082+0000","last_clean":"2024-09-21T00:55:27.635082+0000","last_became_active":"2024-09-21T00:54:57.878480+0000","last_became_peered":"2024-09-21T00:54:57.878480+0000","last_unstale":"2024-09-21T00:55:27.635082+0000","last_undegraded":"2024-09-21T00:55:27.635082+0000","last_fullsized":"2024-09-21T00:55:27.635082+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:28.056410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636440+0000","last_change":"2024-09-21T00:54:57.866876+0000","last_active":"2024-09-21T00:55:27.636440+0000","last_peered":"2024-09-21T00:55:27.636440+0000","last_clean":"2024-09-21T00:55:27.636440+0000","last_became_active":"2024-09-21T00:54:57.866532+0000","last_became_peered":"2024-09-21T00:54:57.866532+0000","last_unstale":"2024-09-21T00:55:27.636440+0000","last_undegraded":"2024-09-21T00:55:27.636440+0000","last_fullsized":"2024-09-21T00:55:27.636440+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:15:58.881955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636427+0000","last_change":"2024-09-21T00:54:57.874814+0000","last_active":"2024-09-21T00:55:27.636427+0000","last_peered":"2024-09-21T00:55:27.636427+0000","last_clean":"2024-09-21T00:55:27.636427+0000","last_became_active":"2024-09-21T00:54:57.873918+0000","last_became_peered":"2024-09-21T00:54:57.873918+0000","last_unstale":"2024-09-21T00:55:27.636427+0000","last_undegraded":"2024-09-21T00:55:27.636427+0000","last_fullsized":"2024-09-21T00:55:27.636427+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:14.677826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.960913+0000","last_change":"2024-09-21T00:54:57.877268+0000","last_active":"2024-09-21T00:55:27.960913+0000","last_peered":"2024-09-21T00:55:27.960913+0000","last_clean":"2024-09-21T00:55:27.960913+0000","last_became_active":"2024-09-21T00:54:57.876769+0000","last_became_peered":"2024-09-21T00:54:57.876769+0000","last_unstale":"2024-09-21T00:55:27.960913+0000","last_undegraded":"2024-09-21T00:55:27.960913+0000","last_fullsized":"2024-09-21T00:55:27.960913+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:27:02.534562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.638292+0000","last_change":"2024-09-21T00:54:57.872956+0000","last_active":"2024-09-21T00:55:27.638292+0000","last_peered":"2024-09-21T00:55:27.638292+0000","last_clean":"2024-09-21T00:55:27.638292+0000","last_became_active":"2024-09-21T00:54:57.872563+0000","last_became_peered":"2024-09-21T00:54:57.872563+0000","last_unstale":"2024-09-21T00:55:27.638292+0000","last_undegraded":"2024-09-21T00:55:27.638292+0000","last_fullsized":"2024-09-21T00:55:27.638292+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:47.776888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.633746+0000","last_change":"2024-09-21T00:54:57.870285+0000","last_active":"2024-09-21T00:55:27.633746+0000","last_peered":"2024-09-21T00:55:27.633746+0000","last_clean":"2024-09-21T00:55:27.633746+0000","last_became_active":"2024-09-21T00:54:57.869689+0000","last_became_peered":"2024-09-21T00:54:57.869689+0000","last_unstale":"2024-09-21T00:55:27.633746+0000","last_undegraded":"2024-09-21T00:55:27.633746+0000","last_fullsized":"2024-09-21T00:55:27.633746+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:54.304589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636632+0000","last_change":"2024-09-21T00:54:57.868515+0000","last_active":"2024-09-21T00:55:27.636632+0000","last_peered":"2024-09-21T00:55:27.636632+0000","last_clean":"2024-09-21T00:55:27.636632+0000","last_became_active":"2024-09-21T00:54:57.868130+0000","last_became_peered":"2024-09-21T00:54:57.868130+0000","last_unstale":"2024-09-21T00:55:27.636632+0000","last_undegraded":"2024-09-21T00:55:27.636632+0000","last_fullsized":"2024-09-21T00:55:27.636632+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:45.482119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:28.428603+0000","last_change":"2024-09-21T00:54:57.869386+0000","last_active":"2024-09-21T00:55:28.428603+0000","last_peered":"2024-09-21T00:55:28.428603+0000","last_clean":"2024-09-21T00:55:28.428603+0000","last_became_active":"2024-09-21T00:54:57.869033+0000","last_became_peered":"2024-09-21T00:54:57.869033+0000","last_unstale":"2024-09-21T00:55:28.428603+0000","last_undegraded":"2024-09-21T00:55:28.428603+0000","last_fullsized":"2024-09-21T00:55:28.428603+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:39:01.305815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637964+0000","last_change":"2024-09-21T00:54:57.870703+0000","last_active":"2024-09-21T00:55:27.637964+0000","last_peered":"2024-09-21T00:55:27.637964+0000","last_clean":"2024-09-21T00:55:27.637964+0000","last_became_active":"2024-09-21T00:54:57.870324+0000","last_became_peered":"2024-09-21T00:54:57.870324+0000","last_unstale":"2024-09-21T00:55:27.637964+0000","last_undegraded":"2024-09-21T00:55:27.637964+0000","last_fullsized":"2024-09-21T00:55:27.637964+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:50.548296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.634338+0000","last_change":"2024-09-21T00:54:57.869803+0000","last_active":"2024-09-21T00:55:27.634338+0000","last_peered":"2024-09-21T00:55:27.634338+0000","last_clean":"2024-09-21T00:55:27.634338+0000","last_became_active":"2024-09-21T00:54:57.869092+0000","last_became_peered":"2024-09-21T00:54:57.869092+0000","last_unstale":"2024-09-21T00:55:27.634338+0000","last_undegraded":"2024-09-21T00:55:27.634338+0000","last_fullsized":"2024-09-21T00:55:27.634338+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:05:27.727914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637429+0000","last_change":"2024-09-21T00:54:57.873700+0000","last_active":"2024-09-21T00:55:27.637429+0000","last_peered":"2024-09-21T00:55:27.637429+0000","last_clean":"2024-09-21T00:55:27.637429+0000","last_became_active":"2024-09-21T00:54:57.873336+0000","last_became_peered":"2024-09-21T00:54:57.873336+0000","last_unstale":"2024-09-21T00:55:27.637429+0000","last_undegraded":"2024-09-21T00:55:27.637429+0000","last_fullsized":"2024-09-21T00:55:27.637429+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:28:17.520669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.960916+0000","last_change":"2024-09-21T00:54:57.877686+0000","last_active":"2024-09-21T00:55:27.960916+0000","last_peered":"2024-09-21T00:55:27.960916+0000","last_clean":"2024-09-21T00:55:27.960916+0000","last_became_active":"2024-09-21T00:54:57.876711+0000","last_became_peered":"2024-09-21T00:54:57.876711+0000","last_unstale":"2024-09-21T00:55:27.960916+0000","last_undegraded":"2024-09-21T00:55:27.960916+0000","last_fullsized":"2024-09-21T00:55:27.960916+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:20:11.254680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.634499+0000","last_change":"2024-09-21T00:54:57.880660+0000","last_active":"2024-09-21T00:55:27.634499+0000","last_peered":"2024-09-21T00:55:27.634499+0000","last_clean":"2024-09-21T00:55:27.634499+0000","last_became_active":"2024-09-21T00:54:57.880270+0000","last_became_peered":"2024-09-21T00:54:57.880270+0000","last_unstale":"2024-09-21T00:55:27.634499+0000","last_undegraded":"2024-09-21T00:55:27.634499+0000","last_fullsized":"2024-09-21T00:55:27.634499+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:50:16.260484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636217+0000","last_change":"2024-09-21T00:54:57.869626+0000","last_active":"2024-09-21T00:55:27.636217+0000","last_peered":"2024-09-21T00:55:27.636217+0000","last_clean":"2024-09-21T00:55:27.636217+0000","last_became_active":"2024-09-21T00:54:57.869230+0000","last_became_peered":"2024-09-21T00:54:57.869230+0000","last_unstale":"2024-09-21T00:55:27.636217+0000","last_undegraded":"2024-09-21T00:55:27.636217+0000","last_fullsized":"2024-09-21T00:55:27.636217+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:49.131237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636212+0000","last_change":"2024-09-21T00:54:57.874917+0000","last_active":"2024-09-21T00:55:27.636212+0000","last_peered":"2024-09-21T00:55:27.636212+0000","last_clean":"2024-09-21T00:55:27.636212+0000","last_became_active":"2024-09-21T00:54:57.873787+0000","last_became_peered":"2024-09-21T00:54:57.873787+0000","last_unstale":"2024-09-21T00:55:27.636212+0000","last_undegraded":"2024-09-21T00:55:27.636212+0000","last_fullsized":"2024-09-21T00:55:27.636212+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:44.226734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636350+0000","last_change":"2024-09-21T00:54:57.877479+0000","last_active":"2024-09-21T00:55:27.636350+0000","last_peered":"2024-09-21T00:55:27.636350+0000","last_clean":"2024-09-21T00:55:27.636350+0000","last_became_active":"2024-09-21T00:54:57.877110+0000","last_became_peered":"2024-09-21T00:54:57.877110+0000","last_unstale":"2024-09-21T00:55:27.636350+0000","last_undegraded":"2024-09-21T00:55:27.636350+0000","last_fullsized":"2024-09-21T00:55:27.636350+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:18.547970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.635124+0000","last_change":"2024-09-21T00:54:57.878701+0000","last_active":"2024-09-21T00:55:27.635124+0000","last_peered":"2024-09-21T00:55:27.635124+0000","last_clean":"2024-09-21T00:55:27.635124+0000","last_became_active":"2024-09-21T00:54:57.878254+0000","last_became_peered":"2024-09-21T00:54:57.878254+0000","last_unstale":"2024-09-21T00:55:27.635124+0000","last_undegraded":"2024-09-21T00:55:27.635124+0000","last_fullsized":"2024-09-21T00:55:27.635124+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:51.309956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.632830+0000","last_change":"2024-09-21T00:54:57.869571+0000","last_active":"2024-09-21T00:55:27.632830+0000","last_peered":"2024-09-21T00:55:27.632830+0000","last_clean":"2024-09-21T00:55:27.632830+0000","last_became_active":"2024-09-21T00:54:57.868907+0000","last_became_peered":"2024-09-21T00:54:57.868907+0000","last_unstale":"2024-09-21T00:55:27.632830+0000","last_undegraded":"2024-09-21T00:55:27.632830+0000","last_fullsized":"2024-09-21T00:55:27.632830+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:14.951885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637530+0000","last_change":"2024-09-21T00:54:57.869277+0000","last_active":"2024-09-21T00:55:27.637530+0000","last_peered":"2024-09-21T00:55:27.637530+0000","last_clean":"2024-09-21T00:55:27.637530+0000","last_became_active":"2024-09-21T00:54:57.868777+0000","last_became_peered":"2024-09-21T00:54:57.868777+0000","last_unstale":"2024-09-21T00:55:27.637530+0000","last_undegraded":"2024-09-21T00:55:27.637530+0000","last_fullsized":"2024-09-21T00:55:27.637530+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:09:04.766266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.641582+0000","last_change":"2024-09-21T00:55:27.641451+0000","last_active":"2024-09-21T00:55:27.641582+0000","last_peered":"2024-09-21T00:55:27.641582+0000","last_clean":"2024-09-21T00:55:27.641582+0000","last_became_active":"2024-09-21T00:55:27.640253+0000","last_became_peered":"2024-09-21T00:55:27.640253+0000","last_unstale":"2024-09-21T00:55:27.641582+0000","last_undegraded":"2024-09-21T00:55:27.641582+0000","last_fullsized":"2024-09-21T00:55:27.641582+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:34.064803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.634440+0000","last_change":"2024-09-21T00:54:57.871236+0000","last_active":"2024-09-21T00:55:27.634440+0000","last_peered":"2024-09-21T00:55:27.634440+0000","last_clean":"2024-09-21T00:55:27.634440+0000","last_became_active":"2024-09-21T00:54:57.870131+0000","last_became_peered":"2024-09-21T00:54:57.870131+0000","last_unstale":"2024-09-21T00:55:27.634440+0000","last_undegraded":"2024-09-21T00:55:27.634440+0000","last_fullsized":"2024-09-21T00:55:27.634440+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:45.067436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.638362+0000","last_change":"2024-09-21T00:54:57.878710+0000","last_active":"2024-09-21T00:55:27.638362+0000","last_peered":"2024-09-21T00:55:27.638362+0000","last_clean":"2024-09-21T00:55:27.638362+0000","last_became_active":"2024-09-21T00:54:57.878352+0000","last_became_peered":"2024-09-21T00:54:57.878352+0000","last_unstale":"2024-09-21T00:55:27.638362+0000","last_undegraded":"2024-09-21T00:55:27.638362+0000","last_fullsized":"2024-09-21T00:55:27.638362+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:32:40.561028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:28.428682+0000","last_change":"2024-09-21T00:54:57.873226+0000","last_active":"2024-09-21T00:55:28.428682+0000","last_peered":"2024-09-21T00:55:28.428682+0000","last_clean":"2024-09-21T00:55:28.428682+0000","last_became_active":"2024-09-21T00:54:57.872840+0000","last_became_peered":"2024-09-21T00:54:57.872840+0000","last_unstale":"2024-09-21T00:55:28.428682+0000","last_undegraded":"2024-09-21T00:55:28.428682+0000","last_fullsized":"2024-09-21T00:55:28.428682+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:41.259070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:28.430604+0000","last_change":"2024-09-21T00:55:28.430095+0000","last_active":"2024-09-21T00:55:28.430604+0000","last_peered":"2024-09-21T00:55:28.430604+0000","last_clean":"2024-09-21T00:55:28.430604+0000","last_became_active":"2024-09-21T00:55:28.429650+0000","last_became_peered":"2024-09-21T00:55:28.429650+0000","last_unstale":"2024-09-21T00:55:28.430604+0000","last_undegraded":"2024-09-21T00:55:28.430604+0000","last_fullsized":"2024-09-21T00:55:28.430604+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:18:14.994333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,3],"acting":[6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.961641+0000","last_change":"2024-09-21T00:55:27.961107+0000","last_active":"2024-09-21T00:55:27.961641+0000","last_peered":"2024-09-21T00:55:27.961641+0000","last_clean":"2024-09-21T00:55:27.961641+0000","last_became_active":"2024-09-21T00:55:27.960673+0000","last_became_peered":"2024-09-21T00:55:27.960673+0000","last_unstale":"2024-09-21T00:55:27.961641+0000","last_undegraded":"2024-09-21T00:55:27.961641+0000","last_fullsized":"2024-09-21T00:55:27.961641+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:30.418190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.638300+0000","last_change":"2024-09-21T00:54:57.870994+0000","last_active":"2024-09-21T00:55:27.638300+0000","last_peered":"2024-09-21T00:55:27.638300+0000","last_clean":"2024-09-21T00:55:27.638300+0000","last_became_active":"2024-09-21T00:54:57.867939+0000","last_became_peered":"2024-09-21T00:54:57.867939+0000","last_unstale":"2024-09-21T00:55:27.638300+0000","last_undegraded":"2024-09-21T00:55:27.638300+0000","last_fullsized":"2024-09-21T00:55:27.638300+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:44.858289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.634087+0000","last_change":"2024-09-21T00:54:57.870568+0000","last_active":"2024-09-21T00:55:27.634087+0000","last_peered":"2024-09-21T00:55:27.634087+0000","last_clean":"2024-09-21T00:55:27.634087+0000","last_became_active":"2024-09-21T00:54:57.870208+0000","last_became_peered":"2024-09-21T00:54:57.870208+0000","last_unstale":"2024-09-21T00:55:27.634087+0000","last_undegraded":"2024-09-21T00:55:27.634087+0000","last_fullsized":"2024-09-21T00:55:27.634087+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:28:09.824385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.634330+0000","last_change":"2024-09-21T00:54:57.870228+0000","last_active":"2024-09-21T00:55:27.634330+0000","last_peered":"2024-09-21T00:55:27.634330+0000","last_clean":"2024-09-21T00:55:27.634330+0000","last_became_active":"2024-09-21T00:54:57.869866+0000","last_became_peered":"2024-09-21T00:54:57.869866+0000","last_unstale":"2024-09-21T00:55:27.634330+0000","last_undegraded":"2024-09-21T00:55:27.634330+0000","last_fullsized":"2024-09-21T00:55:27.634330+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:20.073393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636427+0000","last_change":"2024-09-21T00:54:57.867602+0000","last_active":"2024-09-21T00:55:27.636427+0000","last_peered":"2024-09-21T00:55:27.636427+0000","last_clean":"2024-09-21T00:55:27.636427+0000","last_became_active":"2024-09-21T00:54:57.867104+0000","last_became_peered":"2024-09-21T00:54:57.867104+0000","last_unstale":"2024-09-21T00:55:27.636427+0000","last_undegraded":"2024-09-21T00:55:27.636427+0000","last_fullsized":"2024-09-21T00:55:27.636427+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:29:37.403384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636722+0000","last_change":"2024-09-21T00:54:57.869400+0000","last_active":"2024-09-21T00:55:27.636722+0000","last_peered":"2024-09-21T00:55:27.636722+0000","last_clean":"2024-09-21T00:55:27.636722+0000","last_became_active":"2024-09-21T00:54:57.868997+0000","last_became_peered":"2024-09-21T00:54:57.868997+0000","last_unstale":"2024-09-21T00:55:27.636722+0000","last_undegraded":"2024-09-21T00:55:27.636722+0000","last_fullsized":"2024-09-21T00:55:27.636722+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:00.117559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636562+0000","last_change":"2024-09-21T00:54:57.867392+0000","last_active":"2024-09-21T00:55:27.636562+0000","last_peered":"2024-09-21T00:55:27.636562+0000","last_clean":"2024-09-21T00:55:27.636562+0000","last_became_active":"2024-09-21T00:54:57.867001+0000","last_became_peered":"2024-09-21T00:54:57.867001+0000","last_unstale":"2024-09-21T00:55:27.636562+0000","last_undegraded":"2024-09-21T00:55:27.636562+0000","last_fullsized":"2024-09-21T00:55:27.636562+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:05.090149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.633807+0000","last_change":"2024-09-21T00:54:57.867620+0000","last_active":"2024-09-21T00:55:27.633807+0000","last_peered":"2024-09-21T00:55:27.633807+0000","last_clean":"2024-09-21T00:55:27.633807+0000","last_became_active":"2024-09-21T00:54:57.867190+0000","last_became_peered":"2024-09-21T00:54:57.867190+0000","last_unstale":"2024-09-21T00:55:27.633807+0000","last_undegraded":"2024-09-21T00:55:27.633807+0000","last_fullsized":"2024-09-21T00:55:27.633807+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:36.432368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637149+0000","last_change":"2024-09-21T00:54:57.880526+0000","last_active":"2024-09-21T00:55:27.637149+0000","last_peered":"2024-09-21T00:55:27.637149+0000","last_clean":"2024-09-21T00:55:27.637149+0000","last_became_active":"2024-09-21T00:54:57.880154+0000","last_became_peered":"2024-09-21T00:54:57.880154+0000","last_unstale":"2024-09-21T00:55:27.637149+0000","last_undegraded":"2024-09-21T00:55:27.637149+0000","last_fullsized":"2024-09-21T00:55:27.637149+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:56.179127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'5","reported_seq":83,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:00.665403+0000","last_change":"2024-09-21T00:54:55.867717+0000","last_active":"2024-09-21T00:56:00.665403+0000","last_peered":"2024-09-21T00:56:00.665403+0000","last_clean":"2024-09-21T00:56:00.665403+0000","last_became_active":"2024-09-21T00:54:55.867306+0000","last_became_peered":"2024-09-21T00:54:55.867306+0000","last_unstale":"2024-09-21T00:56:00.665403+0000","last_undegraded":"2024-09-21T00:56:00.665403+0000","last_fullsized":"2024-09-21T00:56:00.665403+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:25.192109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.651490+0000","last_change":"2024-09-21T00:54:57.879034+0000","last_active":"2024-09-21T00:55:27.651490+0000","last_peered":"2024-09-21T00:55:27.651490+0000","last_clean":"2024-09-21T00:55:27.651490+0000","last_became_active":"2024-09-21T00:54:57.878673+0000","last_became_peered":"2024-09-21T00:54:57.878673+0000","last_unstale":"2024-09-21T00:55:27.651490+0000","last_undegraded":"2024-09-21T00:55:27.651490+0000","last_fullsized":"2024-09-21T00:55:27.651490+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:39:12.467465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'7","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.633751+0000","last_change":"2024-09-21T00:54:55.867451+0000","last_active":"2024-09-21T00:55:27.633751+0000","last_peered":"2024-09-21T00:55:27.633751+0000","last_clean":"2024-09-21T00:55:27.633751+0000","last_became_active":"2024-09-21T00:54:55.866998+0000","last_became_peered":"2024-09-21T00:54:55.866998+0000","last_unstale":"2024-09-21T00:55:27.633751+0000","last_undegraded":"2024-09-21T00:55:27.633751+0000","last_fullsized":"2024-09-21T00:55:27.633751+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:40.878647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.634072+0000","last_change":"2024-09-21T00:54:55.853055+0000","last_active":"2024-09-21T00:55:27.634072+0000","last_peered":"2024-09-21T00:55:27.634072+0000","last_clean":"2024-09-21T00:55:27.634072+0000","last_became_active":"2024-09-21T00:54:55.852672+0000","last_became_peered":"2024-09-21T00:54:55.852672+0000","last_unstale":"2024-09-21T00:55:27.634072+0000","last_undegraded":"2024-09-21T00:55:27.634072+0000","last_fullsized":"2024-09-21T00:55:27.634072+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:17.082588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:28.428719+0000","last_change":"2024-09-21T00:54:57.875024+0000","last_active":"2024-09-21T00:55:28.428719+0000","last_peered":"2024-09-21T00:55:28.428719+0000","last_clean":"2024-09-21T00:55:28.428719+0000","last_became_active":"2024-09-21T00:54:57.870027+0000","last_became_peered":"2024-09-21T00:54:57.870027+0000","last_unstale":"2024-09-21T00:55:28.428719+0000","last_undegraded":"2024-09-21T00:55:28.428719+0000","last_fullsized":"2024-09-21T00:55:28.428719+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:37:48.880686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.650846+0000","last_change":"2024-09-21T00:54:55.864527+0000","last_active":"2024-09-21T00:55:27.650846+0000","last_peered":"2024-09-21T00:55:27.650846+0000","last_clean":"2024-09-21T00:55:27.650846+0000","last_became_active":"2024-09-21T00:54:55.864191+0000","last_became_peered":"2024-09-21T00:54:55.864191+0000","last_unstale":"2024-09-21T00:55:27.650846+0000","last_undegraded":"2024-09-21T00:55:27.650846+0000","last_fullsized":"2024-09-21T00:55:27.650846+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:43.781116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.632540+0000","last_change":"2024-09-21T00:54:57.865671+0000","last_active":"2024-09-21T00:55:27.632540+0000","last_peered":"2024-09-21T00:55:27.632540+0000","last_clean":"2024-09-21T00:55:27.632540+0000","last_became_active":"2024-09-21T00:54:57.865196+0000","last_became_peered":"2024-09-21T00:54:57.865196+0000","last_unstale":"2024-09-21T00:55:27.632540+0000","last_undegraded":"2024-09-21T00:55:27.632540+0000","last_fullsized":"2024-09-21T00:55:27.632540+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:16.524866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'4","reported_seq":135,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:02.667798+0000","last_change":"2024-09-21T00:54:55.862504+0000","last_active":"2024-09-21T00:56:02.667798+0000","last_peered":"2024-09-21T00:56:02.667798+0000","last_clean":"2024-09-21T00:56:02.667798+0000","last_became_active":"2024-09-21T00:54:55.862065+0000","last_became_peered":"2024-09-21T00:54:55.862065+0000","last_unstale":"2024-09-21T00:56:02.667798+0000","last_undegraded":"2024-09-21T00:56:02.667798+0000","last_fullsized":"2024-09-21T00:56:02.667798+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:16.497313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637951+0000","last_change":"2024-09-21T00:54:57.873444+0000","last_active":"2024-09-21T00:55:27.637951+0000","last_peered":"2024-09-21T00:55:27.637951+0000","last_clean":"2024-09-21T00:55:27.637951+0000","last_became_active":"2024-09-21T00:54:57.873058+0000","last_became_peered":"2024-09-21T00:54:57.873058+0000","last_unstale":"2024-09-21T00:55:27.637951+0000","last_undegraded":"2024-09-21T00:55:27.637951+0000","last_fullsized":"2024-09-21T00:55:27.637951+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:36:40.603285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'4","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.967374+0000","last_change":"2024-09-21T00:55:27.967238+0000","last_active":"2024-09-21T00:55:27.967374+0000","last_peered":"2024-09-21T00:55:27.967374+0000","last_clean":"2024-09-21T00:55:27.967374+0000","last_became_active":"2024-09-21T00:55:27.962082+0000","last_became_peered":"2024-09-21T00:55:27.962082+0000","last_unstale":"2024-09-21T00:55:27.967374+0000","last_undegraded":"2024-09-21T00:55:27.967374+0000","last_fullsized":"2024-09-21T00:55:27.967374+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:02.943108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.652946+0000","last_change":"2024-09-21T00:55:27.652838+0000","last_active":"2024-09-21T00:55:27.652946+0000","last_peered":"2024-09-21T00:55:27.652946+0000","last_clean":"2024-09-21T00:55:27.652946+0000","last_became_active":"2024-09-21T00:55:27.652401+0000","last_became_peered":"2024-09-21T00:55:27.652401+0000","last_unstale":"2024-09-21T00:55:27.652946+0000","last_undegraded":"2024-09-21T00:55:27.652946+0000","last_fullsized":"2024-09-21T00:55:27.652946+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:53:33.968079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.651540+0000","last_change":"2024-09-21T00:54:55.968782+0000","last_active":"2024-09-21T00:55:27.651540+0000","last_peered":"2024-09-21T00:55:27.651540+0000","last_clean":"2024-09-21T00:55:27.651540+0000","last_became_active":"2024-09-21T00:54:55.968421+0000","last_became_peered":"2024-09-21T00:54:55.968421+0000","last_unstale":"2024-09-21T00:55:27.651540+0000","last_undegraded":"2024-09-21T00:55:27.651540+0000","last_fullsized":"2024-09-21T00:55:27.651540+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:28.680764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637341+0000","last_change":"2024-09-21T00:54:57.877610+0000","last_active":"2024-09-21T00:55:27.637341+0000","last_peered":"2024-09-21T00:55:27.637341+0000","last_clean":"2024-09-21T00:55:27.637341+0000","last_became_active":"2024-09-21T00:54:57.877225+0000","last_became_peered":"2024-09-21T00:54:57.877225+0000","last_unstale":"2024-09-21T00:55:27.637341+0000","last_undegraded":"2024-09-21T00:55:27.637341+0000","last_fullsized":"2024-09-21T00:55:27.637341+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:08.294366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'28","reported_seq":187,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:03.022681+0000","last_change":"2024-09-21T00:55:27.975731+0000","last_active":"2024-09-21T00:56:03.022681+0000","last_peered":"2024-09-21T00:56:03.022681+0000","last_clean":"2024-09-21T00:56:03.022681+0000","last_became_active":"2024-09-21T00:55:27.961766+0000","last_became_peered":"2024-09-21T00:55:27.961766+0000","last_unstale":"2024-09-21T00:56:03.022681+0000","last_undegraded":"2024-09-21T00:56:03.022681+0000","last_fullsized":"2024-09-21T00:56:03.022681+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:42:32.442882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63349,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":30,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":59092,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637324+0000","last_change":"2024-09-21T00:54:57.875575+0000","last_active":"2024-09-21T00:55:27.637324+0000","last_peered":"2024-09-21T00:55:27.637324+0000","last_clean":"2024-09-21T00:55:27.637324+0000","last_became_active":"2024-09-21T00:54:57.874975+0000","last_became_peered":"2024-09-21T00:54:57.874975+0000","last_unstale":"2024-09-21T00:55:27.637324+0000","last_undegraded":"2024-09-21T00:55:27.637324+0000","last_fullsized":"2024-09-21T00:55:27.637324+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:34:36.089068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'9","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637272+0000","last_change":"2024-09-21T00:54:55.863532+0000","last_active":"2024-09-21T00:55:27.637272+0000","last_peered":"2024-09-21T00:55:27.637272+0000","last_clean":"2024-09-21T00:55:27.637272+0000","last_became_active":"2024-09-21T00:54:55.863124+0000","last_became_peered":"2024-09-21T00:54:55.863124+0000","last_unstale":"2024-09-21T00:55:27.637272+0000","last_undegraded":"2024-09-21T00:55:27.637272+0000","last_fullsized":"2024-09-21T00:55:27.637272+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:41:07.996906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.634099+0000","last_change":"2024-09-21T00:54:57.866126+0000","last_active":"2024-09-21T00:55:27.634099+0000","last_peered":"2024-09-21T00:55:27.634099+0000","last_clean":"2024-09-21T00:55:27.634099+0000","last_became_active":"2024-09-21T00:54:57.865775+0000","last_became_peered":"2024-09-21T00:54:57.865775+0000","last_unstale":"2024-09-21T00:55:27.634099+0000","last_undegraded":"2024-09-21T00:55:27.634099+0000","last_fullsized":"2024-09-21T00:55:27.634099+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:28.261632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.651370+0000","last_change":"2024-09-21T00:54:55.864593+0000","last_active":"2024-09-21T00:55:27.651370+0000","last_peered":"2024-09-21T00:55:27.651370+0000","last_clean":"2024-09-21T00:55:27.651370+0000","last_became_active":"2024-09-21T00:54:55.864202+0000","last_became_peered":"2024-09-21T00:54:55.864202+0000","last_unstale":"2024-09-21T00:55:27.651370+0000","last_undegraded":"2024-09-21T00:55:27.651370+0000","last_fullsized":"2024-09-21T00:55:27.651370+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:06.976588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636663+0000","last_change":"2024-09-21T00:54:57.877892+0000","last_active":"2024-09-21T00:55:27.636663+0000","last_peered":"2024-09-21T00:55:27.636663+0000","last_clean":"2024-09-21T00:55:27.636663+0000","last_became_active":"2024-09-21T00:54:57.877510+0000","last_became_peered":"2024-09-21T00:54:57.877510+0000","last_unstale":"2024-09-21T00:55:27.636663+0000","last_undegraded":"2024-09-21T00:55:27.636663+0000","last_fullsized":"2024-09-21T00:55:27.636663+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:05.238100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'6","reported_seq":86,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:01.667055+0000","last_change":"2024-09-21T00:54:55.856707+0000","last_active":"2024-09-21T00:56:01.667055+0000","last_peered":"2024-09-21T00:56:01.667055+0000","last_clean":"2024-09-21T00:56:01.667055+0000","last_became_active":"2024-09-21T00:54:55.856095+0000","last_became_peered":"2024-09-21T00:54:55.856095+0000","last_unstale":"2024-09-21T00:56:01.667055+0000","last_undegraded":"2024-09-21T00:56:01.667055+0000","last_fullsized":"2024-09-21T00:56:01.667055+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:48.332764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":58,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636231+0000","last_change":"2024-09-21T00:54:57.868398+0000","last_active":"2024-09-21T00:55:27.636231+0000","last_peered":"2024-09-21T00:55:27.636231+0000","last_clean":"2024-09-21T00:55:27.636231+0000","last_became_active":"2024-09-21T00:54:57.867963+0000","last_became_peered":"2024-09-21T00:54:57.867963+0000","last_unstale":"2024-09-21T00:55:27.636231+0000","last_undegraded":"2024-09-21T00:55:27.636231+0000","last_fullsized":"2024-09-21T00:55:27.636231+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:59:31.527713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'17","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.659007+0000","last_change":"2024-09-21T00:55:27.658543+0000","last_active":"2024-09-21T00:55:27.659007+0000","last_peered":"2024-09-21T00:55:27.659007+0000","last_clean":"2024-09-21T00:55:27.659007+0000","last_became_active":"2024-09-21T00:55:27.639915+0000","last_became_peered":"2024-09-21T00:55:27.639915+0000","last_unstale":"2024-09-21T00:55:27.659007+0000","last_undegraded":"2024-09-21T00:55:27.659007+0000","last_fullsized":"2024-09-21T00:55:27.659007+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:51.736732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.651146+0000","last_change":"2024-09-21T00:54:57.872256+0000","last_active":"2024-09-21T00:55:27.651146+0000","last_peered":"2024-09-21T00:55:27.651146+0000","last_clean":"2024-09-21T00:55:27.651146+0000","last_became_active":"2024-09-21T00:54:57.871848+0000","last_became_peered":"2024-09-21T00:54:57.871848+0000","last_unstale":"2024-09-21T00:55:27.651146+0000","last_undegraded":"2024-09-21T00:55:27.651146+0000","last_fullsized":"2024-09-21T00:55:27.651146+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:24:11.314693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636721+0000","last_change":"2024-09-21T00:54:55.870096+0000","last_active":"2024-09-21T00:55:27.636721+0000","last_peered":"2024-09-21T00:55:27.636721+0000","last_clean":"2024-09-21T00:55:27.636721+0000","last_became_active":"2024-09-21T00:54:55.869616+0000","last_became_peered":"2024-09-21T00:54:55.869616+0000","last_unstale":"2024-09-21T00:55:27.636721+0000","last_undegraded":"2024-09-21T00:55:27.636721+0000","last_fullsized":"2024-09-21T00:55:27.636721+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:53:48.036499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.653084+0000","last_change":"2024-09-21T00:55:27.652960+0000","last_active":"2024-09-21T00:55:27.653084+0000","last_peered":"2024-09-21T00:55:27.653084+0000","last_clean":"2024-09-21T00:55:27.653084+0000","last_became_active":"2024-09-21T00:55:27.652420+0000","last_became_peered":"2024-09-21T00:55:27.652420+0000","last_unstale":"2024-09-21T00:55:27.653084+0000","last_undegraded":"2024-09-21T00:55:27.653084+0000","last_fullsized":"2024-09-21T00:55:27.653084+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:24.436368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'5","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.634222+0000","last_change":"2024-09-21T00:54:55.866393+0000","last_active":"2024-09-21T00:55:27.634222+0000","last_peered":"2024-09-21T00:55:27.634222+0000","last_clean":"2024-09-21T00:55:27.634222+0000","last_became_active":"2024-09-21T00:54:55.865980+0000","last_became_peered":"2024-09-21T00:54:55.865980+0000","last_unstale":"2024-09-21T00:55:27.634222+0000","last_undegraded":"2024-09-21T00:55:27.634222+0000","last_fullsized":"2024-09-21T00:55:27.634222+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:56.471011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637771+0000","last_change":"2024-09-21T00:54:57.875177+0000","last_active":"2024-09-21T00:55:27.637771+0000","last_peered":"2024-09-21T00:55:27.637771+0000","last_clean":"2024-09-21T00:55:27.637771+0000","last_became_active":"2024-09-21T00:54:57.874819+0000","last_became_peered":"2024-09-21T00:54:57.874819+0000","last_unstale":"2024-09-21T00:55:27.637771+0000","last_undegraded":"2024-09-21T00:55:27.637771+0000","last_fullsized":"2024-09-21T00:55:27.637771+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:43.942703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.651656+0000","last_change":"2024-09-21T00:54:55.864668+0000","last_active":"2024-09-21T00:55:27.651656+0000","last_peered":"2024-09-21T00:55:27.651656+0000","last_clean":"2024-09-21T00:55:27.651656+0000","last_became_active":"2024-09-21T00:54:55.864330+0000","last_became_peered":"2024-09-21T00:54:55.864330+0000","last_unstale":"2024-09-21T00:55:27.651656+0000","last_undegraded":"2024-09-21T00:55:27.651656+0000","last_fullsized":"2024-09-21T00:55:27.651656+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:45:50.751390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637251+0000","last_change":"2024-09-21T00:54:57.871093+0000","last_active":"2024-09-21T00:55:27.637251+0000","last_peered":"2024-09-21T00:55:27.637251+0000","last_clean":"2024-09-21T00:55:27.637251+0000","last_became_active":"2024-09-21T00:54:57.870457+0000","last_became_peered":"2024-09-21T00:54:57.870457+0000","last_unstale":"2024-09-21T00:55:27.637251+0000","last_undegraded":"2024-09-21T00:55:27.637251+0000","last_fullsized":"2024-09-21T00:55:27.637251+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:19.810575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'6","reported_seq":88,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:03.670124+0000","last_change":"2024-09-21T00:54:55.968156+0000","last_active":"2024-09-21T00:56:03.670124+0000","last_peered":"2024-09-21T00:56:03.670124+0000","last_clean":"2024-09-21T00:56:03.670124+0000","last_became_active":"2024-09-21T00:54:55.967668+0000","last_became_peered":"2024-09-21T00:54:55.967668+0000","last_unstale":"2024-09-21T00:56:03.670124+0000","last_undegraded":"2024-09-21T00:56:03.670124+0000","last_fullsized":"2024-09-21T00:56:03.670124+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:28.854249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":59,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637573+0000","last_change":"2024-09-21T00:54:57.868187+0000","last_active":"2024-09-21T00:55:27.637573+0000","last_peered":"2024-09-21T00:55:27.637573+0000","last_clean":"2024-09-21T00:55:27.637573+0000","last_became_active":"2024-09-21T00:54:57.867709+0000","last_became_peered":"2024-09-21T00:54:57.867709+0000","last_unstale":"2024-09-21T00:55:27.637573+0000","last_undegraded":"2024-09-21T00:55:27.637573+0000","last_fullsized":"2024-09-21T00:55:27.637573+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:40.123030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":96,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636464+0000","last_change":"2024-09-21T00:53:44.515787+0000","last_active":"2024-09-21T00:55:27.636464+0000","last_peered":"2024-09-21T00:55:27.636464+0000","last_clean":"2024-09-21T00:55:27.636464+0000","last_became_active":"2024-09-21T00:53:44.510106+0000","last_became_peered":"2024-09-21T00:53:44.510106+0000","last_unstale":"2024-09-21T00:55:27.636464+0000","last_undegraded":"2024-09-21T00:55:27.636464+0000","last_fullsized":"2024-09-21T00:55:27.636464+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:50:16.598790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:50:16.598790+0000","last_clean_scrub_stamp":"2024-09-21T00:50:16.598790+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:04:14.481212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'6","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.958651+0000","last_change":"2024-09-21T00:54:55.854929+0000","last_active":"2024-09-21T00:55:27.958651+0000","last_peered":"2024-09-21T00:55:27.958651+0000","last_clean":"2024-09-21T00:55:27.958651+0000","last_became_active":"2024-09-21T00:54:55.854489+0000","last_became_peered":"2024-09-21T00:54:55.854489+0000","last_unstale":"2024-09-21T00:55:27.958651+0000","last_undegraded":"2024-09-21T00:55:27.958651+0000","last_fullsized":"2024-09-21T00:55:27.958651+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:03.067142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.653142+0000","last_change":"2024-09-21T00:55:27.652679+0000","last_active":"2024-09-21T00:55:27.653142+0000","last_peered":"2024-09-21T00:55:27.653142+0000","last_clean":"2024-09-21T00:55:27.653142+0000","last_became_active":"2024-09-21T00:55:27.652348+0000","last_became_peered":"2024-09-21T00:55:27.652348+0000","last_unstale":"2024-09-21T00:55:27.653142+0000","last_undegraded":"2024-09-21T00:55:27.653142+0000","last_fullsized":"2024-09-21T00:55:27.653142+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:11.974613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636380+0000","last_change":"2024-09-21T00:54:55.863265+0000","last_active":"2024-09-21T00:55:27.636380+0000","last_peered":"2024-09-21T00:55:27.636380+0000","last_clean":"2024-09-21T00:55:27.636380+0000","last_became_active":"2024-09-21T00:54:55.862613+0000","last_became_peered":"2024-09-21T00:54:55.862613+0000","last_unstale":"2024-09-21T00:55:27.636380+0000","last_undegraded":"2024-09-21T00:55:27.636380+0000","last_fullsized":"2024-09-21T00:55:27.636380+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:56.707143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.634062+0000","last_change":"2024-09-21T00:54:57.855249+0000","last_active":"2024-09-21T00:55:27.634062+0000","last_peered":"2024-09-21T00:55:27.634062+0000","last_clean":"2024-09-21T00:55:27.634062+0000","last_became_active":"2024-09-21T00:54:57.854879+0000","last_became_peered":"2024-09-21T00:54:57.854879+0000","last_unstale":"2024-09-21T00:55:27.634062+0000","last_undegraded":"2024-09-21T00:55:27.634062+0000","last_fullsized":"2024-09-21T00:55:27.634062+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:15.733514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'5","reported_seq":85,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:03.669524+0000","last_change":"2024-09-21T00:54:55.968078+0000","last_active":"2024-09-21T00:56:03.669524+0000","last_peered":"2024-09-21T00:56:03.669524+0000","last_clean":"2024-09-21T00:56:03.669524+0000","last_became_active":"2024-09-21T00:54:55.967700+0000","last_became_peered":"2024-09-21T00:54:55.967700+0000","last_unstale":"2024-09-21T00:56:03.669524+0000","last_undegraded":"2024-09-21T00:56:03.669524+0000","last_fullsized":"2024-09-21T00:56:03.669524+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:35.121889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.650675+0000","last_change":"2024-09-21T00:54:57.873224+0000","last_active":"2024-09-21T00:55:27.650675+0000","last_peered":"2024-09-21T00:55:27.650675+0000","last_clean":"2024-09-21T00:55:27.650675+0000","last_became_active":"2024-09-21T00:54:57.872828+0000","last_became_peered":"2024-09-21T00:54:57.872828+0000","last_unstale":"2024-09-21T00:55:27.650675+0000","last_undegraded":"2024-09-21T00:55:27.650675+0000","last_fullsized":"2024-09-21T00:55:27.650675+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:58:55.758620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'5","reported_seq":86,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:04.670472+0000","last_change":"2024-09-21T00:54:55.859887+0000","last_active":"2024-09-21T00:56:04.670472+0000","last_peered":"2024-09-21T00:56:04.670472+0000","last_clean":"2024-09-21T00:56:04.670472+0000","last_became_active":"2024-09-21T00:54:55.859351+0000","last_became_peered":"2024-09-21T00:54:55.859351+0000","last_unstale":"2024-09-21T00:56:04.670472+0000","last_undegraded":"2024-09-21T00:56:04.670472+0000","last_fullsized":"2024-09-21T00:56:04.670472+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:31.407409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.633851+0000","last_change":"2024-09-21T00:54:57.882568+0000","last_active":"2024-09-21T00:55:27.633851+0000","last_peered":"2024-09-21T00:55:27.633851+0000","last_clean":"2024-09-21T00:55:27.633851+0000","last_became_active":"2024-09-21T00:54:57.882190+0000","last_became_peered":"2024-09-21T00:54:57.882190+0000","last_unstale":"2024-09-21T00:55:27.633851+0000","last_undegraded":"2024-09-21T00:55:27.633851+0000","last_fullsized":"2024-09-21T00:55:27.633851+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:19.339490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.632817+0000","last_change":"2024-09-21T00:54:55.970154+0000","last_active":"2024-09-21T00:55:27.632817+0000","last_peered":"2024-09-21T00:55:27.632817+0000","last_clean":"2024-09-21T00:55:27.632817+0000","last_became_active":"2024-09-21T00:54:55.969774+0000","last_became_peered":"2024-09-21T00:54:55.969774+0000","last_unstale":"2024-09-21T00:55:27.632817+0000","last_undegraded":"2024-09-21T00:55:27.632817+0000","last_fullsized":"2024-09-21T00:55:27.632817+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:05.241455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.633985+0000","last_change":"2024-09-21T00:54:57.873452+0000","last_active":"2024-09-21T00:55:27.633985+0000","last_peered":"2024-09-21T00:55:27.633985+0000","last_clean":"2024-09-21T00:55:27.633985+0000","last_became_active":"2024-09-21T00:54:57.872592+0000","last_became_peered":"2024-09-21T00:54:57.872592+0000","last_unstale":"2024-09-21T00:55:27.633985+0000","last_undegraded":"2024-09-21T00:55:27.633985+0000","last_fullsized":"2024-09-21T00:55:27.633985+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:25.196491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637464+0000","last_change":"2024-09-21T00:54:55.968563+0000","last_active":"2024-09-21T00:55:27.637464+0000","last_peered":"2024-09-21T00:55:27.637464+0000","last_clean":"2024-09-21T00:55:27.637464+0000","last_became_active":"2024-09-21T00:54:55.968176+0000","last_became_peered":"2024-09-21T00:54:55.968176+0000","last_unstale":"2024-09-21T00:55:27.637464+0000","last_undegraded":"2024-09-21T00:55:27.637464+0000","last_fullsized":"2024-09-21T00:55:27.637464+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:35.120595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.634408+0000","last_change":"2024-09-21T00:54:57.862128+0000","last_active":"2024-09-21T00:55:27.634408+0000","last_peered":"2024-09-21T00:55:27.634408+0000","last_clean":"2024-09-21T00:55:27.634408+0000","last_became_active":"2024-09-21T00:54:57.861692+0000","last_became_peered":"2024-09-21T00:54:57.861692+0000","last_unstale":"2024-09-21T00:55:27.634408+0000","last_undegraded":"2024-09-21T00:55:27.634408+0000","last_fullsized":"2024-09-21T00:55:27.634408+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:58:29.364344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"73'15","reported_seq":38,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.632846+0000","last_change":"2024-09-21T00:54:55.866240+0000","last_active":"2024-09-21T00:55:27.632846+0000","last_peered":"2024-09-21T00:55:27.632846+0000","last_clean":"2024-09-21T00:55:27.632846+0000","last_became_active":"2024-09-21T00:54:55.865192+0000","last_became_peered":"2024-09-21T00:54:55.865192+0000","last_unstale":"2024-09-21T00:55:27.632846+0000","last_undegraded":"2024-09-21T00:55:27.632846+0000","last_fullsized":"2024-09-21T00:55:27.632846+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:53:17.599528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:28.429294+0000","last_change":"2024-09-21T00:54:57.878847+0000","last_active":"2024-09-21T00:55:28.429294+0000","last_peered":"2024-09-21T00:55:28.429294+0000","last_clean":"2024-09-21T00:55:28.429294+0000","last_became_active":"2024-09-21T00:54:57.878117+0000","last_became_peered":"2024-09-21T00:54:57.878117+0000","last_unstale":"2024-09-21T00:55:28.429294+0000","last_undegraded":"2024-09-21T00:55:28.429294+0000","last_fullsized":"2024-09-21T00:55:28.429294+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:46.090963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'7","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.958730+0000","last_change":"2024-09-21T00:54:55.854035+0000","last_active":"2024-09-21T00:55:27.958730+0000","last_peered":"2024-09-21T00:55:27.958730+0000","last_clean":"2024-09-21T00:55:27.958730+0000","last_became_active":"2024-09-21T00:54:55.853301+0000","last_became_peered":"2024-09-21T00:54:55.853301+0000","last_unstale":"2024-09-21T00:55:27.958730+0000","last_undegraded":"2024-09-21T00:55:27.958730+0000","last_fullsized":"2024-09-21T00:55:27.958730+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:11.498865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636479+0000","last_change":"2024-09-21T00:54:57.875093+0000","last_active":"2024-09-21T00:55:27.636479+0000","last_peered":"2024-09-21T00:55:27.636479+0000","last_clean":"2024-09-21T00:55:27.636479+0000","last_became_active":"2024-09-21T00:54:57.873996+0000","last_became_peered":"2024-09-21T00:54:57.873996+0000","last_unstale":"2024-09-21T00:55:27.636479+0000","last_undegraded":"2024-09-21T00:55:27.636479+0000","last_fullsized":"2024-09-21T00:55:27.636479+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:17:55.990167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637124+0000","last_change":"2024-09-21T00:54:55.968507+0000","last_active":"2024-09-21T00:55:27.637124+0000","last_peered":"2024-09-21T00:55:27.637124+0000","last_clean":"2024-09-21T00:55:27.637124+0000","last_became_active":"2024-09-21T00:54:55.968084+0000","last_became_peered":"2024-09-21T00:54:55.968084+0000","last_unstale":"2024-09-21T00:55:27.637124+0000","last_undegraded":"2024-09-21T00:55:27.637124+0000","last_fullsized":"2024-09-21T00:55:27.637124+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:34:06.325264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636905+0000","last_change":"2024-09-21T00:54:57.870500+0000","last_active":"2024-09-21T00:55:27.636905+0000","last_peered":"2024-09-21T00:55:27.636905+0000","last_clean":"2024-09-21T00:55:27.636905+0000","last_became_active":"2024-09-21T00:54:57.870103+0000","last_became_peered":"2024-09-21T00:54:57.870103+0000","last_unstale":"2024-09-21T00:55:27.636905+0000","last_undegraded":"2024-09-21T00:55:27.636905+0000","last_fullsized":"2024-09-21T00:55:27.636905+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:31:03.469863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'7","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:28.428026+0000","last_change":"2024-09-21T00:54:55.856185+0000","last_active":"2024-09-21T00:55:28.428026+0000","last_peered":"2024-09-21T00:55:28.428026+0000","last_clean":"2024-09-21T00:55:28.428026+0000","last_became_active":"2024-09-21T00:54:55.855738+0000","last_became_peered":"2024-09-21T00:54:55.855738+0000","last_unstale":"2024-09-21T00:55:28.428026+0000","last_undegraded":"2024-09-21T00:55:28.428026+0000","last_fullsized":"2024-09-21T00:55:28.428026+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:02.870874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.633969+0000","last_change":"2024-09-21T00:54:57.877828+0000","last_active":"2024-09-21T00:55:27.633969+0000","last_peered":"2024-09-21T00:55:27.633969+0000","last_clean":"2024-09-21T00:55:27.633969+0000","last_became_active":"2024-09-21T00:54:57.877414+0000","last_became_peered":"2024-09-21T00:54:57.877414+0000","last_unstale":"2024-09-21T00:55:27.633969+0000","last_undegraded":"2024-09-21T00:55:27.633969+0000","last_fullsized":"2024-09-21T00:55:27.633969+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:27.485830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636884+0000","last_change":"2024-09-21T00:54:55.868014+0000","last_active":"2024-09-21T00:55:27.636884+0000","last_peered":"2024-09-21T00:55:27.636884+0000","last_clean":"2024-09-21T00:55:27.636884+0000","last_became_active":"2024-09-21T00:54:55.867640+0000","last_became_peered":"2024-09-21T00:54:55.867640+0000","last_unstale":"2024-09-21T00:55:27.636884+0000","last_undegraded":"2024-09-21T00:55:27.636884+0000","last_fullsized":"2024-09-21T00:55:27.636884+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:24:57.118238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:28.428938+0000","last_change":"2024-09-21T00:54:57.881935+0000","last_active":"2024-09-21T00:55:28.428938+0000","last_peered":"2024-09-21T00:55:28.428938+0000","last_clean":"2024-09-21T00:55:28.428938+0000","last_became_active":"2024-09-21T00:54:57.881598+0000","last_became_peered":"2024-09-21T00:54:57.881598+0000","last_unstale":"2024-09-21T00:55:28.428938+0000","last_undegraded":"2024-09-21T00:55:28.428938+0000","last_fullsized":"2024-09-21T00:55:28.428938+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:44:19.893961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.645759+0000","last_change":"2024-09-21T00:55:27.645172+0000","last_active":"2024-09-21T00:55:27.645759+0000","last_peered":"2024-09-21T00:55:27.645759+0000","last_clean":"2024-09-21T00:55:27.645759+0000","last_became_active":"2024-09-21T00:55:27.639795+0000","last_became_peered":"2024-09-21T00:55:27.639795+0000","last_unstale":"2024-09-21T00:55:27.645759+0000","last_undegraded":"2024-09-21T00:55:27.645759+0000","last_fullsized":"2024-09-21T00:55:27.645759+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:20:50.639608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637202+0000","last_change":"2024-09-21T00:54:57.867972+0000","last_active":"2024-09-21T00:55:27.637202+0000","last_peered":"2024-09-21T00:55:27.637202+0000","last_clean":"2024-09-21T00:55:27.637202+0000","last_became_active":"2024-09-21T00:54:57.867586+0000","last_became_peered":"2024-09-21T00:54:57.867586+0000","last_unstale":"2024-09-21T00:55:27.637202+0000","last_undegraded":"2024-09-21T00:55:27.637202+0000","last_fullsized":"2024-09-21T00:55:27.637202+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:27.066795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.651495+0000","last_change":"2024-09-21T00:54:57.881014+0000","last_active":"2024-09-21T00:55:27.651495+0000","last_peered":"2024-09-21T00:55:27.651495+0000","last_clean":"2024-09-21T00:55:27.651495+0000","last_became_active":"2024-09-21T00:54:57.880608+0000","last_became_peered":"2024-09-21T00:54:57.880608+0000","last_unstale":"2024-09-21T00:55:27.651495+0000","last_undegraded":"2024-09-21T00:55:27.651495+0000","last_fullsized":"2024-09-21T00:55:27.651495+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:48:31.848315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.638999+0000","last_change":"2024-09-21T00:54:55.865031+0000","last_active":"2024-09-21T00:55:27.638999+0000","last_peered":"2024-09-21T00:55:27.638999+0000","last_clean":"2024-09-21T00:55:27.638999+0000","last_became_active":"2024-09-21T00:54:55.864576+0000","last_became_peered":"2024-09-21T00:54:55.864576+0000","last_unstale":"2024-09-21T00:55:27.638999+0000","last_undegraded":"2024-09-21T00:55:27.638999+0000","last_fullsized":"2024-09-21T00:55:27.638999+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:13.125491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637188+0000","last_change":"2024-09-21T00:54:57.875878+0000","last_active":"2024-09-21T00:55:27.637188+0000","last_peered":"2024-09-21T00:55:27.637188+0000","last_clean":"2024-09-21T00:55:27.637188+0000","last_became_active":"2024-09-21T00:54:57.874177+0000","last_became_peered":"2024-09-21T00:54:57.874177+0000","last_unstale":"2024-09-21T00:55:27.637188+0000","last_undegraded":"2024-09-21T00:55:27.637188+0000","last_fullsized":"2024-09-21T00:55:27.637188+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:25.333036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'12","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637565+0000","last_change":"2024-09-21T00:54:55.868698+0000","last_active":"2024-09-21T00:55:27.637565+0000","last_peered":"2024-09-21T00:55:27.637565+0000","last_clean":"2024-09-21T00:55:27.637565+0000","last_became_active":"2024-09-21T00:54:55.868282+0000","last_became_peered":"2024-09-21T00:54:55.868282+0000","last_unstale":"2024-09-21T00:55:27.637565+0000","last_undegraded":"2024-09-21T00:55:27.637565+0000","last_fullsized":"2024-09-21T00:55:27.637565+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:50.253638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636680+0000","last_change":"2024-09-21T00:54:57.867726+0000","last_active":"2024-09-21T00:55:27.636680+0000","last_peered":"2024-09-21T00:55:27.636680+0000","last_clean":"2024-09-21T00:55:27.636680+0000","last_became_active":"2024-09-21T00:54:57.866090+0000","last_became_peered":"2024-09-21T00:54:57.866090+0000","last_unstale":"2024-09-21T00:55:27.636680+0000","last_undegraded":"2024-09-21T00:55:27.636680+0000","last_fullsized":"2024-09-21T00:55:27.636680+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:57.938078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:28.428068+0000","last_change":"2024-09-21T00:54:55.968155+0000","last_active":"2024-09-21T00:55:28.428068+0000","last_peered":"2024-09-21T00:55:28.428068+0000","last_clean":"2024-09-21T00:55:28.428068+0000","last_became_active":"2024-09-21T00:54:55.967718+0000","last_became_peered":"2024-09-21T00:54:55.967718+0000","last_unstale":"2024-09-21T00:55:28.428068+0000","last_undegraded":"2024-09-21T00:55:28.428068+0000","last_fullsized":"2024-09-21T00:55:28.428068+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:18.160380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:28.429205+0000","last_change":"2024-09-21T00:54:57.873102+0000","last_active":"2024-09-21T00:55:28.429205+0000","last_peered":"2024-09-21T00:55:28.429205+0000","last_clean":"2024-09-21T00:55:28.429205+0000","last_became_active":"2024-09-21T00:54:57.872323+0000","last_became_peered":"2024-09-21T00:54:57.872323+0000","last_unstale":"2024-09-21T00:55:28.429205+0000","last_undegraded":"2024-09-21T00:55:28.429205+0000","last_fullsized":"2024-09-21T00:55:28.429205+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:18.087601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'13","reported_seq":89,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:59.662396+0000","last_change":"2024-09-21T00:54:55.865559+0000","last_active":"2024-09-21T00:55:59.662396+0000","last_peered":"2024-09-21T00:55:59.662396+0000","last_clean":"2024-09-21T00:55:59.662396+0000","last_became_active":"2024-09-21T00:54:55.865157+0000","last_became_peered":"2024-09-21T00:54:55.865157+0000","last_unstale":"2024-09-21T00:55:59.662396+0000","last_undegraded":"2024-09-21T00:55:59.662396+0000","last_fullsized":"2024-09-21T00:55:59.662396+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:53.113970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70553,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":571,"num_read_kb":351,"num_write":241,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":59204,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":524288,"data_stored":211659,"data_compressed":13542,"data_compressed_allocated":20480,"data_compressed_original":73728,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":283734,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808858,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":827392,"data_stored":395958,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972384,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":1050224,"data_compressed":43733,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135908,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":843776,"data_stored":395385,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332138,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":831488,"data_stored":395651,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528367,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":892928,"data_stored":988281,"data_compressed":41838,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691892,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":827392,"data_stored":395102,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888121,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":905216,"data_stored":987568,"data_compressed":41838,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018943,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36188,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708964,"statfs":{"total":95995035648,"available":95957979136,"internally_reserved":0,"allocated":856064,"data_stored":458703,"data_compressed":15515,"data_compressed_allocated":20480,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215172,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":843776,"data_stored":394927,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411402,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36164,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708988,"statfs":{"total":95995035648,"available":95958003712,"internally_reserved":0,"allocated":839680,"data_stored":396626,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36216,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708936,"statfs":{"total":95995035648,"available":95957950464,"internally_reserved":0,"allocated":888832,"data_stored":459364,"data_compressed":7658,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738452,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36180,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708972,"statfs":{"total":95995035648,"available":95957987328,"internally_reserved":0,"allocated":847872,"data_stored":396832,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":65101,"data_compressed":1895,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":64440,"data_compressed":9752,"data_compressed_allocated":12288,"data_compressed_original":57344,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":65476,"data_compressed":1895,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:56:08.042 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T00:56:08.042 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T00:56:08.043 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-21T00:56:08.043 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph health --format=json 2024-09-21T00:56:08.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:07 smithi193 ceph-mon[34660]: pgmap v325: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:56:08.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:07 smithi042 ceph-mon[34481]: pgmap v325: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:56:08.301 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:08.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.771+0000 7fae0c238640 1 -- 172.21.15.1:0/3311698422 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae041094b0 msgr2=0x7fae041098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:08.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.771+0000 7fae0c238640 1 --2- 172.21.15.1:0/3311698422 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae041094b0 0x7fae041098c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fadf4009900 tx=0x7fadf402a410 comp rx=0 tx=0).stop 2024-09-21T00:56:08.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.771+0000 7fae0c238640 1 -- 172.21.15.1:0/3311698422 shutdown_connections 2024-09-21T00:56:08.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.771+0000 7fae0c238640 1 --2- 172.21.15.1:0/3311698422 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fae04109e00 0x7fae04110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.771+0000 7fae0c238640 1 --2- 172.21.15.1:0/3311698422 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae041094b0 0x7fae041098c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.771+0000 7fae0c238640 1 --2- 172.21.15.1:0/3311698422 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae04103b70 0x7fae04103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.771+0000 7fae0c238640 1 -- 172.21.15.1:0/3311698422 >> 172.21.15.1:0/3311698422 conn(0x7fae040ff5e0 msgr2=0x7fae04101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:08.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.771+0000 7fae0c238640 1 -- 172.21.15.1:0/3311698422 shutdown_connections 2024-09-21T00:56:08.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.771+0000 7fae0c238640 1 -- 172.21.15.1:0/3311698422 wait complete. 2024-09-21T00:56:08.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.772+0000 7fae0c238640 1 Processor -- start 2024-09-21T00:56:08.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.772+0000 7fae0c238640 1 -- start start 2024-09-21T00:56:08.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.772+0000 7fae0c238640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae04103b70 0x7fae0419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:08.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.772+0000 7fae0c238640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fae041094b0 0x7fae0419aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:08.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.772+0000 7fae0c238640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae04109e00 0x7fae0419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:08.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.772+0000 7fae0c238640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fae04113ac0 con 0x7fae04103b70 2024-09-21T00:56:08.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.772+0000 7fae0c238640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fae04113940 con 0x7fae04109e00 2024-09-21T00:56:08.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.772+0000 7fae0c238640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fae04113c40 con 0x7fae041094b0 2024-09-21T00:56:08.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.773+0000 7fae09fd4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae04103b70 0x7fae0419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:08.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.773+0000 7fae09fd4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae04103b70 0x7fae0419a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48166/0 (socket says 172.21.15.1:48166) 2024-09-21T00:56:08.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.773+0000 7fae09fd4640 1 -- 172.21.15.1:0/216529168 learned_addr learned my addr 172.21.15.1:0/216529168 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:08.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.773+0000 7fae097d3640 1 --2- 172.21.15.1:0/216529168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fae041094b0 0x7fae0419aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:08.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.773+0000 7fae09fd4640 1 -- 172.21.15.1:0/216529168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fae041094b0 msgr2=0x7fae0419aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:08.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.773+0000 7fae09fd4640 1 --2- 172.21.15.1:0/216529168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fae041094b0 0x7fae0419aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.773+0000 7fae09fd4640 1 -- 172.21.15.1:0/216529168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae04109e00 msgr2=0x7fae0419fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:08.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.773+0000 7fae09fd4640 1 --2- 172.21.15.1:0/216529168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae04109e00 0x7fae0419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.773+0000 7fae09fd4640 1 -- 172.21.15.1:0/216529168 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae041a0460 con 0x7fae04103b70 2024-09-21T00:56:08.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.773+0000 7fae09fd4640 1 --2- 172.21.15.1:0/216529168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae04103b70 0x7fae0419a4f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fae0000c970 tx=0x7fae0000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:08.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.773+0000 7fadfaffd640 1 -- 172.21.15.1:0/216529168 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae00007bb0 con 0x7fae04103b70 2024-09-21T00:56:08.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.773+0000 7fadfaffd640 1 -- 172.21.15.1:0/216529168 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae00007d50 con 0x7fae04103b70 2024-09-21T00:56:08.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.773+0000 7fae0c238640 1 -- 172.21.15.1:0/216529168 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae041a0750 con 0x7fae04103b70 2024-09-21T00:56:08.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.773+0000 7fadfaffd640 1 -- 172.21.15.1:0/216529168 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0000f450 con 0x7fae04103b70 2024-09-21T00:56:08.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.773+0000 7fae0c238640 1 -- 172.21.15.1:0/216529168 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae041a6eb0 con 0x7fae04103b70 2024-09-21T00:56:08.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.774+0000 7fae0c238640 1 -- 172.21.15.1:0/216529168 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae04103f80 con 0x7fae04103b70 2024-09-21T00:56:08.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.776+0000 7fadfaffd640 1 -- 172.21.15.1:0/216529168 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7fae00004f00 con 0x7fae04103b70 2024-09-21T00:56:08.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.777+0000 7fadfaffd640 1 --2- 172.21.15.1:0/216529168 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fadf00b65a0 0x7fadf00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:08.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.777+0000 7fae097d3640 1 --2- 172.21.15.1:0/216529168 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fadf00b65a0 0x7fadf00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:08.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.777+0000 7fadfaffd640 1 -- 172.21.15.1:0/216529168 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fae000e7660 con 0x7fae04103b70 2024-09-21T00:56:08.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.778+0000 7fae097d3640 1 --2- 172.21.15.1:0/216529168 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fadf00b65a0 0x7fadf00b8ab0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fadf4006010 tx=0x7fadf4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:08.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:08.781+0000 7fadfaffd640 1 -- 172.21.15.1:0/216529168 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fae00014030 con 0x7fae04103b70 2024-09-21T00:56:08.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:08 smithi001 ceph-mon[31211]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:56:09.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:09.008+0000 7fae0c238640 1 -- 172.21.15.1:0/216529168 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fae0419b620 con 0x7fae04103b70 2024-09-21T00:56:09.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:09.008+0000 7fadfaffd640 1 -- 172.21.15.1:0/216529168 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fae000add70 con 0x7fae04103b70 2024-09-21T00:56:09.009 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:56:09.009 INFO:teuthology.orchestra.run.smithi001.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T00:56:09.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:09.010+0000 7fae0c238640 1 -- 172.21.15.1:0/216529168 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fadf00b65a0 msgr2=0x7fadf00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:09.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:09.010+0000 7fae0c238640 1 --2- 172.21.15.1:0/216529168 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fadf00b65a0 0x7fadf00b8ab0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fadf4006010 tx=0x7fadf4000bc0 comp rx=0 tx=0).stop 2024-09-21T00:56:09.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:09.010+0000 7fae0c238640 1 -- 172.21.15.1:0/216529168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae04103b70 msgr2=0x7fae0419a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:09.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:09.010+0000 7fae0c238640 1 --2- 172.21.15.1:0/216529168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae04103b70 0x7fae0419a4f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fae0000c970 tx=0x7fae0000ce30 comp rx=0 tx=0).stop 2024-09-21T00:56:09.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:09.011+0000 7fae0c238640 1 -- 172.21.15.1:0/216529168 shutdown_connections 2024-09-21T00:56:09.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:09.011+0000 7fae0c238640 1 --2- 172.21.15.1:0/216529168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae04109e00 0x7fae0419fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:09.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:09.011+0000 7fae0c238640 1 --2- 172.21.15.1:0/216529168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fae041094b0 0x7fae0419aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:09.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:09.011+0000 7fae0c238640 1 --2- 172.21.15.1:0/216529168 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fadf00b65a0 0x7fadf00b8ab0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:09.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:09.011+0000 7fae0c238640 1 --2- 172.21.15.1:0/216529168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae04103b70 0x7fae0419a4f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:09.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:09.011+0000 7fae0c238640 1 -- 172.21.15.1:0/216529168 >> 172.21.15.1:0/216529168 conn(0x7fae040ff5e0 msgr2=0x7fae04101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:09.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:09.011+0000 7fae0c238640 1 -- 172.21.15.1:0/216529168 shutdown_connections 2024-09-21T00:56:09.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:09.011+0000 7fae0c238640 1 -- 172.21.15.1:0/216529168 wait complete. 2024-09-21T00:56:09.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:08 smithi193 ceph-mon[34660]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:56:09.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:08 smithi042 ceph-mon[34481]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:56:09.640 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-21T00:56:09.640 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:56:09.899 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:09.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:09 smithi001 ceph-mon[31211]: pgmap v326: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:56:09.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:09 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/216529168' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T00:56:10.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:09 smithi193 ceph-mon[34660]: pgmap v326: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:56:10.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:09 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/216529168' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T00:56:10.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:09 smithi042 ceph-mon[34481]: pgmap v326: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:56:10.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:09 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/216529168' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T00:56:10.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.355+0000 7fcb29edb640 1 -- 172.21.15.1:0/1898007117 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb241094c0 msgr2=0x7fcb241098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:10.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.355+0000 7fcb29edb640 1 --2- 172.21.15.1:0/1898007117 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb241094c0 0x7fcb241098d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fcb18009900 tx=0x7fcb1802a410 comp rx=0 tx=0).stop 2024-09-21T00:56:10.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.355+0000 7fcb29edb640 1 -- 172.21.15.1:0/1898007117 shutdown_connections 2024-09-21T00:56:10.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.355+0000 7fcb29edb640 1 --2- 172.21.15.1:0/1898007117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb24109e10 0x7fcb24110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:10.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.355+0000 7fcb29edb640 1 --2- 172.21.15.1:0/1898007117 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb241094c0 0x7fcb241098d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:10.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.355+0000 7fcb29edb640 1 --2- 172.21.15.1:0/1898007117 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcb24101fe0 0x7fcb241023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:10.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.355+0000 7fcb29edb640 1 -- 172.21.15.1:0/1898007117 >> 172.21.15.1:0/1898007117 conn(0x7fcb24077bc0 msgr2=0x7fcb24078000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:10.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.355+0000 7fcb29edb640 1 -- 172.21.15.1:0/1898007117 shutdown_connections 2024-09-21T00:56:10.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.355+0000 7fcb29edb640 1 -- 172.21.15.1:0/1898007117 wait complete. 2024-09-21T00:56:10.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.356+0000 7fcb29edb640 1 Processor -- start 2024-09-21T00:56:10.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.356+0000 7fcb29edb640 1 -- start start 2024-09-21T00:56:10.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.356+0000 7fcb29edb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcb24101fe0 0x7fcb2419c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:10.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.357+0000 7fcb29edb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb241094c0 0x7fcb2419ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:10.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.357+0000 7fcb29edb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb24109e10 0x7fcb241a1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:10.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.357+0000 7fcb29edb640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcb24113ac0 con 0x7fcb24109e10 2024-09-21T00:56:10.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.357+0000 7fcb29edb640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcb24113940 con 0x7fcb241094c0 2024-09-21T00:56:10.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.357+0000 7fcb29edb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcb24113c40 con 0x7fcb24101fe0 2024-09-21T00:56:10.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.357+0000 7fcb23fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb24109e10 0x7fcb241a1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:10.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.357+0000 7fcb23fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb24109e10 0x7fcb241a1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47162/0 (socket says 172.21.15.1:47162) 2024-09-21T00:56:10.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.357+0000 7fcb23fff640 1 -- 172.21.15.1:0/1268683130 learned_addr learned my addr 172.21.15.1:0/1268683130 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:10.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.357+0000 7fcb22ffd640 1 --2- 172.21.15.1:0/1268683130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb241094c0 0x7fcb2419ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:10.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.357+0000 7fcb237fe640 1 --2- 172.21.15.1:0/1268683130 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcb24101fe0 0x7fcb2419c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:10.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.357+0000 7fcb23fff640 1 -- 172.21.15.1:0/1268683130 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcb24101fe0 msgr2=0x7fcb2419c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:10.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.357+0000 7fcb23fff640 1 --2- 172.21.15.1:0/1268683130 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcb24101fe0 0x7fcb2419c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:10.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.357+0000 7fcb23fff640 1 -- 172.21.15.1:0/1268683130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb241094c0 msgr2=0x7fcb2419ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:10.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.357+0000 7fcb23fff640 1 --2- 172.21.15.1:0/1268683130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb241094c0 0x7fcb2419ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:10.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.357+0000 7fcb23fff640 1 -- 172.21.15.1:0/1268683130 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb241a26a0 con 0x7fcb24109e10 2024-09-21T00:56:10.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.357+0000 7fcb237fe640 1 --2- 172.21.15.1:0/1268683130 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcb24101fe0 0x7fcb2419c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:56:10.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.357+0000 7fcb23fff640 1 --2- 172.21.15.1:0/1268683130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb24109e10 0x7fcb241a1f70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c00eaa0 tx=0x7fcb1c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:10.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.357+0000 7fcb20ff9640 1 -- 172.21.15.1:0/1268683130 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c00cdb0 con 0x7fcb24109e10 2024-09-21T00:56:10.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.358+0000 7fcb29edb640 1 -- 172.21.15.1:0/1268683130 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb241a2990 con 0x7fcb24109e10 2024-09-21T00:56:10.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.358+0000 7fcb20ff9640 1 -- 172.21.15.1:0/1268683130 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb1c005020 con 0x7fcb24109e10 2024-09-21T00:56:10.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.358+0000 7fcb20ff9640 1 -- 172.21.15.1:0/1268683130 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c0116d0 con 0x7fcb24109e10 2024-09-21T00:56:10.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.358+0000 7fcb29edb640 1 -- 172.21.15.1:0/1268683130 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb241a90f0 con 0x7fcb24109e10 2024-09-21T00:56:10.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.359+0000 7fcb29edb640 1 -- 172.21.15.1:0/1268683130 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb241023f0 con 0x7fcb24109e10 2024-09-21T00:56:10.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.361+0000 7fcb20ff9640 1 -- 172.21.15.1:0/1268683130 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7fcb1c0051d0 con 0x7fcb24109e10 2024-09-21T00:56:10.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.362+0000 7fcb20ff9640 1 --2- 172.21.15.1:0/1268683130 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fcb0c0b65a0 0x7fcb0c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:10.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.362+0000 7fcb237fe640 1 --2- 172.21.15.1:0/1268683130 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fcb0c0b65a0 0x7fcb0c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:10.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.362+0000 7fcb20ff9640 1 -- 172.21.15.1:0/1268683130 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fcb1c0e7ae0 con 0x7fcb24109e10 2024-09-21T00:56:10.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.362+0000 7fcb237fe640 1 --2- 172.21.15.1:0/1268683130 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fcb0c0b65a0 0x7fcb0c0b8ab0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcb14009930 tx=0x7fcb14008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:10.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.365+0000 7fcb20ff9640 1 -- 172.21.15.1:0/1268683130 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcb1c016030 con 0x7fcb24109e10 2024-09-21T00:56:10.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.590+0000 7fcb29edb640 1 -- 172.21.15.1:0/1268683130 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb2419d860 con 0x7fcb24109e10 2024-09-21T00:56:10.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.591+0000 7fcb20ff9640 1 -- 172.21.15.1:0/1268683130 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11955 (secure 0 0 0) 0x7fcb2419d860 con 0x7fcb24109e10 2024-09-21T00:56:10.592 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:56:10.592 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":26,"btime":"2024-09-21T00:55:10:582235+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2810186677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2810186677},{"type":"v1","addr":"172.21.15.1:6835","nonce":2810186677}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14736,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3935320478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3935320478},{"type":"v1","addr":"172.21.15.1:6837","nonce":3935320478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:54:58.592853+0000","modified":"2024-09-21T00:55:09.837567+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24653,"mds_1":24637,"mds_2":24626,"mds_3":24622,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/2125703572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2125703572},{"type":"v1","addr":"172.21.15.1:6839","nonce":2125703572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/3860445313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860445313},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860445313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6833/712170939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":712170939},{"type":"v1","addr":"172.21.15.193:6833","nonce":712170939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6833/1653911656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1653911656},{"type":"v1","addr":"172.21.15.42:6833","nonce":1653911656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6835/793085918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":793085918},{"type":"v1","addr":"172.21.15.42:6835","nonce":793085918}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6835/3631682268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":3631682268},{"type":"v1","addr":"172.21.15.193:6835","nonce":3631682268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.193:6837/909252228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":909252228},{"type":"v1","addr":"172.21.15.193:6837","nonce":909252228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.42:6837/2395608508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2395608508},{"type":"v1","addr":"172.21.15.42:6837","nonce":2395608508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.193:6839/1365361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1365361177},{"type":"v1","addr":"172.21.15.193:6839","nonce":1365361177}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6839/2526476666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2526476666},{"type":"v1","addr":"172.21.15.42:6839","nonce":2526476666}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653,24637,24626,24622,24610]},"id":1}]} 2024-09-21T00:56:10.592 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 26 2024-09-21T00:56:10.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.593+0000 7fcb29edb640 1 -- 172.21.15.1:0/1268683130 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fcb0c0b65a0 msgr2=0x7fcb0c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:10.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.593+0000 7fcb29edb640 1 --2- 172.21.15.1:0/1268683130 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fcb0c0b65a0 0x7fcb0c0b8ab0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcb14009930 tx=0x7fcb14008040 comp rx=0 tx=0).stop 2024-09-21T00:56:10.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.593+0000 7fcb29edb640 1 -- 172.21.15.1:0/1268683130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb24109e10 msgr2=0x7fcb241a1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:10.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.593+0000 7fcb29edb640 1 --2- 172.21.15.1:0/1268683130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb24109e10 0x7fcb241a1f70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c00eaa0 tx=0x7fcb1c00ef60 comp rx=0 tx=0).stop 2024-09-21T00:56:10.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.593+0000 7fcb29edb640 1 -- 172.21.15.1:0/1268683130 shutdown_connections 2024-09-21T00:56:10.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.593+0000 7fcb29edb640 1 --2- 172.21.15.1:0/1268683130 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fcb0c0b65a0 0x7fcb0c0b8ab0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:10.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.593+0000 7fcb29edb640 1 --2- 172.21.15.1:0/1268683130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb24109e10 0x7fcb241a1f70 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:10.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.593+0000 7fcb29edb640 1 --2- 172.21.15.1:0/1268683130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb241094c0 0x7fcb2419ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:10.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.593+0000 7fcb29edb640 1 --2- 172.21.15.1:0/1268683130 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcb24101fe0 0x7fcb2419c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:10.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.593+0000 7fcb29edb640 1 -- 172.21.15.1:0/1268683130 >> 172.21.15.1:0/1268683130 conn(0x7fcb24077bc0 msgr2=0x7fcb241072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:10.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.594+0000 7fcb29edb640 1 -- 172.21.15.1:0/1268683130 shutdown_connections 2024-09-21T00:56:10.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:10.594+0000 7fcb29edb640 1 -- 172.21.15.1:0/1268683130 wait complete. 2024-09-21T00:56:10.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:10 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1268683130' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:11.130 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:10 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/1268683130' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:11.143 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:10 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/1268683130' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:11.287 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:56:11.546 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:11.940 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:11 smithi001 ceph-mon[31211]: pgmap v327: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T00:56:12.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.032+0000 7f4b9e5df640 1 -- 172.21.15.1:0/2099514418 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b98108cf0 msgr2=0x7f4b9810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:12.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.032+0000 7f4b9e5df640 1 --2- 172.21.15.1:0/2099514418 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b98108cf0 0x7f4b9810f520 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4b90009ca0 tx=0x7f4b9002a8c0 comp rx=0 tx=0).stop 2024-09-21T00:56:12.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.032+0000 7f4b9e5df640 1 -- 172.21.15.1:0/2099514418 shutdown_connections 2024-09-21T00:56:12.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.032+0000 7f4b9e5df640 1 --2- 172.21.15.1:0/2099514418 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b98108cf0 0x7f4b9810f520 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:12.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.032+0000 7f4b9e5df640 1 --2- 172.21.15.1:0/2099514418 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b981083a0 0x7f4b981087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:12.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.032+0000 7f4b9e5df640 1 --2- 172.21.15.1:0/2099514418 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b98102a60 0x7f4b98102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:12.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.032+0000 7f4b9e5df640 1 -- 172.21.15.1:0/2099514418 >> 172.21.15.1:0/2099514418 conn(0x7f4b98079760 msgr2=0x7f4b98079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:12.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.032+0000 7f4b9e5df640 1 -- 172.21.15.1:0/2099514418 shutdown_connections 2024-09-21T00:56:12.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.032+0000 7f4b9e5df640 1 -- 172.21.15.1:0/2099514418 wait complete. 2024-09-21T00:56:12.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.033+0000 7f4b9e5df640 1 Processor -- start 2024-09-21T00:56:12.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.033+0000 7f4b9e5df640 1 -- start start 2024-09-21T00:56:12.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.033+0000 7f4b9e5df640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b98102a60 0x7f4b9819b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:12.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.034+0000 7f4b9e5df640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b981083a0 0x7f4b9819b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:12.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.034+0000 7f4b9e5df640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b98108cf0 0x7f4b9819bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:12.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.034+0000 7f4b9e5df640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4b98112a10 con 0x7f4b981083a0 2024-09-21T00:56:12.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.034+0000 7f4b9e5df640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4b98112890 con 0x7f4b98108cf0 2024-09-21T00:56:12.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.034+0000 7f4b9e5df640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4b98112b90 con 0x7f4b98102a60 2024-09-21T00:56:12.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.034+0000 7f4b8ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b981083a0 0x7f4b9819b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:12.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.034+0000 7f4b8ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b981083a0 0x7f4b9819b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47182/0 (socket says 172.21.15.1:47182) 2024-09-21T00:56:12.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.034+0000 7f4b8ffff640 1 -- 172.21.15.1:0/404317198 learned_addr learned my addr 172.21.15.1:0/404317198 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:12.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.034+0000 7f4b9cb7c640 1 --2- 172.21.15.1:0/404317198 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b98108cf0 0x7f4b9819bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:12.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.034+0000 7f4b97fff640 1 --2- 172.21.15.1:0/404317198 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b98102a60 0x7f4b9819b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:12.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.034+0000 7f4b8ffff640 1 -- 172.21.15.1:0/404317198 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b98102a60 msgr2=0x7f4b9819b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:12.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.034+0000 7f4b8ffff640 1 --2- 172.21.15.1:0/404317198 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b98102a60 0x7f4b9819b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:12.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.034+0000 7f4b8ffff640 1 -- 172.21.15.1:0/404317198 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b98108cf0 msgr2=0x7f4b9819bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:12.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.034+0000 7f4b8ffff640 1 --2- 172.21.15.1:0/404317198 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b98108cf0 0x7f4b9819bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:12.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.034+0000 7f4b8ffff640 1 -- 172.21.15.1:0/404317198 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b98198f70 con 0x7f4b981083a0 2024-09-21T00:56:12.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.034+0000 7f4b8ffff640 1 --2- 172.21.15.1:0/404317198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b981083a0 0x7f4b9819b640 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4b8000c970 tx=0x7f4b8000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:12.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.034+0000 7f4b95ffb640 1 -- 172.21.15.1:0/404317198 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b80007bb0 con 0x7f4b981083a0 2024-09-21T00:56:12.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.035+0000 7f4b9e5df640 1 -- 172.21.15.1:0/404317198 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b98199260 con 0x7f4b981083a0 2024-09-21T00:56:12.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.035+0000 7f4b95ffb640 1 -- 172.21.15.1:0/404317198 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b80007d50 con 0x7f4b981083a0 2024-09-21T00:56:12.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.035+0000 7f4b95ffb640 1 -- 172.21.15.1:0/404317198 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b80004d90 con 0x7f4b981083a0 2024-09-21T00:56:12.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.035+0000 7f4b9e5df640 1 -- 172.21.15.1:0/404317198 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b98199820 con 0x7f4b981083a0 2024-09-21T00:56:12.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.036+0000 7f4b9e5df640 1 -- 172.21.15.1:0/404317198 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b98103ce0 con 0x7f4b981083a0 2024-09-21T00:56:12.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.037+0000 7f4b95ffb640 1 -- 172.21.15.1:0/404317198 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7f4b80005000 con 0x7f4b981083a0 2024-09-21T00:56:12.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.038+0000 7f4b95ffb640 1 --2- 172.21.15.1:0/404317198 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4b840b65d0 0x7f4b840b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:12.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.038+0000 7f4b97fff640 1 --2- 172.21.15.1:0/404317198 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4b840b65d0 0x7f4b840b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:12.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.038+0000 7f4b95ffb640 1 -- 172.21.15.1:0/404317198 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f4b800e7540 con 0x7f4b981083a0 2024-09-21T00:56:12.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.039+0000 7f4b97fff640 1 --2- 172.21.15.1:0/404317198 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4b840b65d0 0x7f4b840b8ae0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4b9806c720 tx=0x7f4b88009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:12.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.041+0000 7f4b95ffb640 1 -- 172.21.15.1:0/404317198 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4b80014030 con 0x7f4b981083a0 2024-09-21T00:56:12.147 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:11 smithi193 ceph-mon[34660]: pgmap v327: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T00:56:12.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:11 smithi042 ceph-mon[34481]: pgmap v327: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T00:56:12.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.271+0000 7f4b9e5df640 1 -- 172.21.15.1:0/404317198 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4b98199ae0 con 0x7f4b981083a0 2024-09-21T00:56:12.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.271+0000 7f4b95ffb640 1 -- 172.21.15.1:0/404317198 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11955 (secure 0 0 0) 0x7f4b800adbf0 con 0x7f4b981083a0 2024-09-21T00:56:12.272 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:56:12.272 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":26,"btime":"2024-09-21T00:55:10:582235+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2810186677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2810186677},{"type":"v1","addr":"172.21.15.1:6835","nonce":2810186677}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14736,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3935320478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3935320478},{"type":"v1","addr":"172.21.15.1:6837","nonce":3935320478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:54:58.592853+0000","modified":"2024-09-21T00:55:09.837567+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24653,"mds_1":24637,"mds_2":24626,"mds_3":24622,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/2125703572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2125703572},{"type":"v1","addr":"172.21.15.1:6839","nonce":2125703572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/3860445313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860445313},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860445313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6833/712170939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":712170939},{"type":"v1","addr":"172.21.15.193:6833","nonce":712170939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6833/1653911656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1653911656},{"type":"v1","addr":"172.21.15.42:6833","nonce":1653911656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6835/793085918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":793085918},{"type":"v1","addr":"172.21.15.42:6835","nonce":793085918}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6835/3631682268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":3631682268},{"type":"v1","addr":"172.21.15.193:6835","nonce":3631682268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.193:6837/909252228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":909252228},{"type":"v1","addr":"172.21.15.193:6837","nonce":909252228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.42:6837/2395608508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2395608508},{"type":"v1","addr":"172.21.15.42:6837","nonce":2395608508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.193:6839/1365361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1365361177},{"type":"v1","addr":"172.21.15.193:6839","nonce":1365361177}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6839/2526476666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2526476666},{"type":"v1","addr":"172.21.15.42:6839","nonce":2526476666}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653,24637,24626,24622,24610]},"id":1}]} 2024-09-21T00:56:12.272 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 26 2024-09-21T00:56:12.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.274+0000 7f4b9e5df640 1 -- 172.21.15.1:0/404317198 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4b840b65d0 msgr2=0x7f4b840b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:12.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.274+0000 7f4b9e5df640 1 --2- 172.21.15.1:0/404317198 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4b840b65d0 0x7f4b840b8ae0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4b9806c720 tx=0x7f4b88009110 comp rx=0 tx=0).stop 2024-09-21T00:56:12.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.274+0000 7f4b9e5df640 1 -- 172.21.15.1:0/404317198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b981083a0 msgr2=0x7f4b9819b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:12.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.274+0000 7f4b9e5df640 1 --2- 172.21.15.1:0/404317198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b981083a0 0x7f4b9819b640 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4b8000c970 tx=0x7f4b8000cd70 comp rx=0 tx=0).stop 2024-09-21T00:56:12.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.274+0000 7f4b9e5df640 1 -- 172.21.15.1:0/404317198 shutdown_connections 2024-09-21T00:56:12.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.274+0000 7f4b9e5df640 1 --2- 172.21.15.1:0/404317198 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b98108cf0 0x7f4b9819bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:12.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.274+0000 7f4b9e5df640 1 --2- 172.21.15.1:0/404317198 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4b840b65d0 0x7f4b840b8ae0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:12.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.274+0000 7f4b9e5df640 1 --2- 172.21.15.1:0/404317198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b981083a0 0x7f4b9819b640 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:12.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.274+0000 7f4b9e5df640 1 --2- 172.21.15.1:0/404317198 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b98102a60 0x7f4b9819b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:12.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.274+0000 7f4b9e5df640 1 -- 172.21.15.1:0/404317198 >> 172.21.15.1:0/404317198 conn(0x7f4b98079760 msgr2=0x7f4b98106210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:12.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.274+0000 7f4b9e5df640 1 -- 172.21.15.1:0/404317198 shutdown_connections 2024-09-21T00:56:12.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:12.274+0000 7f4b9e5df640 1 -- 172.21.15.1:0/404317198 wait complete. 2024-09-21T00:56:12.957 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:12 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/404317198' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:12.986 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T00:56:13.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:12 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/404317198' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:13.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:12 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/404317198' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:13.243 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:13.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.640+0000 7f4bb12a7640 1 -- 172.21.15.1:0/1380721073 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bac109df0 msgr2=0x7f4bac110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:13.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.640+0000 7f4bb12a7640 1 --2- 172.21.15.1:0/1380721073 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bac109df0 0x7f4bac110620 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4009ca0 tx=0x7f4ba402a8c0 comp rx=0 tx=0).stop 2024-09-21T00:56:13.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.641+0000 7f4bb12a7640 1 -- 172.21.15.1:0/1380721073 shutdown_connections 2024-09-21T00:56:13.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.641+0000 7f4bb12a7640 1 --2- 172.21.15.1:0/1380721073 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bac109df0 0x7f4bac110620 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:13.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.641+0000 7f4bb12a7640 1 --2- 172.21.15.1:0/1380721073 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bac1094a0 0x7f4bac1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:13.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.641+0000 7f4bb12a7640 1 --2- 172.21.15.1:0/1380721073 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bac103b60 0x7f4bac103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:13.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.641+0000 7f4bb12a7640 1 -- 172.21.15.1:0/1380721073 >> 172.21.15.1:0/1380721073 conn(0x7f4bac07b850 msgr2=0x7f4bac07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:13.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.641+0000 7f4bb12a7640 1 -- 172.21.15.1:0/1380721073 shutdown_connections 2024-09-21T00:56:13.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.641+0000 7f4bb12a7640 1 -- 172.21.15.1:0/1380721073 wait complete. 2024-09-21T00:56:13.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.641+0000 7f4bb12a7640 1 Processor -- start 2024-09-21T00:56:13.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.642+0000 7f4bb12a7640 1 -- start start 2024-09-21T00:56:13.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.642+0000 7f4bb12a7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bac103b60 0x7f4bac19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:13.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.642+0000 7f4bb12a7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bac1094a0 0x7f4bac19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:13.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.642+0000 7f4bb12a7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bac109df0 0x7f4bac19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:13.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.642+0000 7f4bb12a7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4bac113ab0 con 0x7f4bac1094a0 2024-09-21T00:56:13.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.642+0000 7f4bb12a7640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4bac113930 con 0x7f4bac109df0 2024-09-21T00:56:13.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.642+0000 7f4bb12a7640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4bac113c30 con 0x7f4bac103b60 2024-09-21T00:56:13.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.642+0000 7f4ba27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bac1094a0 0x7f4bac19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:13.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.642+0000 7f4baaffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bac103b60 0x7f4bac19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:13.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.642+0000 7f4ba27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bac1094a0 0x7f4bac19aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47198/0 (socket says 172.21.15.1:47198) 2024-09-21T00:56:13.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.642+0000 7f4ba27fc640 1 -- 172.21.15.1:0/3012420931 learned_addr learned my addr 172.21.15.1:0/3012420931 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:13.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.642+0000 7f4baaffd640 1 --2- 172.21.15.1:0/3012420931 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bac103b60 0x7f4bac19a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:52986/0 (socket says 172.21.15.1:52986) 2024-09-21T00:56:13.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.642+0000 7f4bab7fe640 1 --2- 172.21.15.1:0/3012420931 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bac109df0 0x7f4bac19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:13.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.642+0000 7f4ba27fc640 1 -- 172.21.15.1:0/3012420931 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bac103b60 msgr2=0x7f4bac19a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:13.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.642+0000 7f4ba27fc640 1 --2- 172.21.15.1:0/3012420931 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bac103b60 0x7f4bac19a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:13.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.642+0000 7f4ba27fc640 1 -- 172.21.15.1:0/3012420931 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bac109df0 msgr2=0x7f4bac19fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:13.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.642+0000 7f4ba27fc640 1 --2- 172.21.15.1:0/3012420931 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bac109df0 0x7f4bac19fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:13.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.642+0000 7f4ba27fc640 1 -- 172.21.15.1:0/3012420931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bac1a03f0 con 0x7f4bac1094a0 2024-09-21T00:56:13.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.643+0000 7f4baaffd640 1 --2- 172.21.15.1:0/3012420931 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bac103b60 0x7f4bac19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:56:13.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.643+0000 7f4ba27fc640 1 --2- 172.21.15.1:0/3012420931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bac1094a0 0x7f4bac19aa20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4b9400e9c0 tx=0x7f4b9400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:13.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.643+0000 7f4ba8ff9640 1 -- 172.21.15.1:0/3012420931 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9400ccc0 con 0x7f4bac1094a0 2024-09-21T00:56:13.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.643+0000 7f4ba8ff9640 1 -- 172.21.15.1:0/3012420931 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b940054d0 con 0x7f4bac1094a0 2024-09-21T00:56:13.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.643+0000 7f4bb12a7640 1 -- 172.21.15.1:0/3012420931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bac1a06e0 con 0x7f4bac1094a0 2024-09-21T00:56:13.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.643+0000 7f4ba8ff9640 1 -- 172.21.15.1:0/3012420931 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b94010430 con 0x7f4bac1094a0 2024-09-21T00:56:13.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.643+0000 7f4bb12a7640 1 -- 172.21.15.1:0/3012420931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bac0755f0 con 0x7f4bac1094a0 2024-09-21T00:56:13.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.644+0000 7f4bb12a7640 1 -- 172.21.15.1:0/3012420931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bac104de0 con 0x7f4bac1094a0 2024-09-21T00:56:13.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.645+0000 7f4ba8ff9640 1 -- 172.21.15.1:0/3012420931 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7f4b94005000 con 0x7f4bac1094a0 2024-09-21T00:56:13.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.646+0000 7f4ba8ff9640 1 --2- 172.21.15.1:0/3012420931 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4b980b65a0 0x7f4b980b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:13.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.647+0000 7f4baaffd640 1 --2- 172.21.15.1:0/3012420931 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4b980b65a0 0x7f4b980b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:13.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.647+0000 7f4ba8ff9640 1 -- 172.21.15.1:0/3012420931 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f4b940e79c0 con 0x7f4bac1094a0 2024-09-21T00:56:13.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.647+0000 7f4baaffd640 1 --2- 172.21.15.1:0/3012420931 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4b980b65a0 0x7f4b980b8ab0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c009690 tx=0x7f4b9c00f7a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:13.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.649+0000 7f4ba8ff9640 1 -- 172.21.15.1:0/3012420931 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4b94056710 con 0x7f4bac1094a0 2024-09-21T00:56:13.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.837+0000 7f4bb12a7640 1 -- 172.21.15.1:0/3012420931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4bac10bbe0 con 0x7f4bac1094a0 2024-09-21T00:56:13.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.839+0000 7f4ba8ff9640 1 -- 172.21.15.1:0/3012420931 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22720 (secure 0 0 0) 0x7f4b940052f0 con 0x7f4bac1094a0 2024-09-21T00:56:13.840 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:56:13.840 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":75,"fsid":"d3972c20-77b2-11ef-baf5-efdc52797490","created":"2024-09-21T00:46:29.745963+0000","modified":"2024-09-21T00:55:27.629379+0000","last_up_change":"2024-09-21T00:54:07.552837+0000","last_in_change":"2024-09-21T00:53:44.164415+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:50:16.456462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:54:54.305306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:54:56.506872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5bf09a34-4d6e-401c-8cef-29bbe72de68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6803","nonce":4067586847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6805","nonce":4067586847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6809","nonce":4067586847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6807","nonce":4067586847}]},"public_addr":"172.21.15.1:6803/4067586847","cluster_addr":"172.21.15.1:6805/4067586847","heartbeat_back_addr":"172.21.15.1:6809/4067586847","heartbeat_front_addr":"172.21.15.1:6807/4067586847","state":["exists","up"]},{"osd":1,"uuid":"195f9109-ef61-46be-a59a-d72e3a1b5b45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6801","nonce":436964633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6803","nonce":436964633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6807","nonce":436964633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6805","nonce":436964633}]},"public_addr":"172.21.15.42:6801/436964633","cluster_addr":"172.21.15.42:6803/436964633","heartbeat_back_addr":"172.21.15.42:6807/436964633","heartbeat_front_addr":"172.21.15.42:6805/436964633","state":["exists","up"]},{"osd":2,"uuid":"47cf90a7-6db6-464a-84ef-9f509f89a46b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6801","nonce":3495400570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6803","nonce":3495400570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6807","nonce":3495400570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6805","nonce":3495400570}]},"public_addr":"172.21.15.193:6801/3495400570","cluster_addr":"172.21.15.193:6803/3495400570","heartbeat_back_addr":"172.21.15.193:6807/3495400570","heartbeat_front_addr":"172.21.15.193:6805/3495400570","state":["exists","up"]},{"osd":3,"uuid":"a5230a66-3c74-41a7-9353-5650780ed25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6811","nonce":3221661671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6813","nonce":3221661671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6817","nonce":3221661671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6815","nonce":3221661671}]},"public_addr":"172.21.15.1:6811/3221661671","cluster_addr":"172.21.15.1:6813/3221661671","heartbeat_back_addr":"172.21.15.1:6817/3221661671","heartbeat_front_addr":"172.21.15.1:6815/3221661671","state":["exists","up"]},{"osd":4,"uuid":"b0476b9b-3257-46d4-aff7-1f038286ed43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6809","nonce":2066388104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6811","nonce":2066388104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6815","nonce":2066388104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6813","nonce":2066388104}]},"public_addr":"172.21.15.42:6809/2066388104","cluster_addr":"172.21.15.42:6811/2066388104","heartbeat_back_addr":"172.21.15.42:6815/2066388104","heartbeat_front_addr":"172.21.15.42:6813/2066388104","state":["exists","up"]},{"osd":5,"uuid":"96701ced-a55a-4ad9-be62-7f102c00697d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6809","nonce":732336675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6811","nonce":732336675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6815","nonce":732336675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6813","nonce":732336675}]},"public_addr":"172.21.15.193:6809/732336675","cluster_addr":"172.21.15.193:6811/732336675","heartbeat_back_addr":"172.21.15.193:6815/732336675","heartbeat_front_addr":"172.21.15.193:6813/732336675","state":["exists","up"]},{"osd":6,"uuid":"72d76017-e2e3-4118-8316-2c5da01c87b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6819","nonce":3201517067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6821","nonce":3201517067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6825","nonce":3201517067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6823","nonce":3201517067}]},"public_addr":"172.21.15.1:6819/3201517067","cluster_addr":"172.21.15.1:6821/3201517067","heartbeat_back_addr":"172.21.15.1:6825/3201517067","heartbeat_front_addr":"172.21.15.1:6823/3201517067","state":["exists","up"]},{"osd":7,"uuid":"8b239f96-2455-41b6-a905-9ed92078b890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6817","nonce":2124927218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6819","nonce":2124927218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6823","nonce":2124927218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6821","nonce":2124927218}]},"public_addr":"172.21.15.42:6817/2124927218","cluster_addr":"172.21.15.42:6819/2124927218","heartbeat_back_addr":"172.21.15.42:6823/2124927218","heartbeat_front_addr":"172.21.15.42:6821/2124927218","state":["exists","up"]},{"osd":8,"uuid":"8cd93aeb-fe00-4291-9f72-171d01893819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6817","nonce":2277449259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6819","nonce":2277449259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6823","nonce":2277449259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6821","nonce":2277449259}]},"public_addr":"172.21.15.193:6817/2277449259","cluster_addr":"172.21.15.193:6819/2277449259","heartbeat_back_addr":"172.21.15.193:6823/2277449259","heartbeat_front_addr":"172.21.15.193:6821/2277449259","state":["exists","up"]},{"osd":9,"uuid":"9e03e00b-0015-4aa8-adce-0d3352d2ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6827","nonce":1369323215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6829","nonce":1369323215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6833","nonce":1369323215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6831","nonce":1369323215}]},"public_addr":"172.21.15.1:6827/1369323215","cluster_addr":"172.21.15.1:6829/1369323215","heartbeat_back_addr":"172.21.15.1:6833/1369323215","heartbeat_front_addr":"172.21.15.1:6831/1369323215","state":["exists","up"]},{"osd":10,"uuid":"de55a908-b049-4f40-865f-cfa2ae6e461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6825","nonce":3182218295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6827","nonce":3182218295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6831","nonce":3182218295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6829","nonce":3182218295}]},"public_addr":"172.21.15.42:6825/3182218295","cluster_addr":"172.21.15.42:6827/3182218295","heartbeat_back_addr":"172.21.15.42:6831/3182218295","heartbeat_front_addr":"172.21.15.42:6829/3182218295","state":["exists","up"]},{"osd":11,"uuid":"1cac0c39-77aa-460b-92a0-39ed89cd6ce4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6825","nonce":2368815522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6827","nonce":2368815522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6831","nonce":2368815522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6829","nonce":2368815522}]},"public_addr":"172.21.15.193:6825/2368815522","cluster_addr":"172.21.15.193:6827/2368815522","heartbeat_back_addr":"172.21.15.193:6831/2368815522","heartbeat_front_addr":"172.21.15.193:6829/2368815522","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:49:21.491443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:49:47.486846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:50:12.757383+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:50:39.127690+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:05.545277+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:30.617491+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:57.612088+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:24.001953+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:48.447388+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:14.620538+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:40.503576+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:54:05.668236+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6801/59685083":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/309615464":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/1722941514":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/1199175740":"2024-09-22T00:47:25.985486+0000","172.21.15.1:6800/59685083":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/2811453932":"2024-09-22T00:46:58.953779+0000","172.21.15.1:0/3748689057":"2024-09-22T00:46:58.953779+0000","172.21.15.1:0/265697975":"2024-09-22T00:46:58.953779+0000","172.21.15.1:6801/1968786311":"2024-09-22T00:46:58.953779+0000","172.21.15.1:6800/1968786311":"2024-09-22T00:46:58.953779+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:56:13.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.841+0000 7f4bb12a7640 1 -- 172.21.15.1:0/3012420931 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4b980b65a0 msgr2=0x7f4b980b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:13.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.841+0000 7f4bb12a7640 1 --2- 172.21.15.1:0/3012420931 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4b980b65a0 0x7f4b980b8ab0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c009690 tx=0x7f4b9c00f7a0 comp rx=0 tx=0).stop 2024-09-21T00:56:13.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.841+0000 7f4bb12a7640 1 -- 172.21.15.1:0/3012420931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bac1094a0 msgr2=0x7f4bac19aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:13.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.841+0000 7f4bb12a7640 1 --2- 172.21.15.1:0/3012420931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bac1094a0 0x7f4bac19aa20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4b9400e9c0 tx=0x7f4b9400ee80 comp rx=0 tx=0).stop 2024-09-21T00:56:13.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.841+0000 7f4bb12a7640 1 -- 172.21.15.1:0/3012420931 shutdown_connections 2024-09-21T00:56:13.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.841+0000 7f4bb12a7640 1 --2- 172.21.15.1:0/3012420931 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bac109df0 0x7f4bac19fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:13.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.841+0000 7f4bb12a7640 1 --2- 172.21.15.1:0/3012420931 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4b980b65a0 0x7f4b980b8ab0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:13.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.841+0000 7f4bb12a7640 1 --2- 172.21.15.1:0/3012420931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bac1094a0 0x7f4bac19aa20 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:13.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.841+0000 7f4bb12a7640 1 --2- 172.21.15.1:0/3012420931 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bac103b60 0x7f4bac19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:13.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.841+0000 7f4bb12a7640 1 -- 172.21.15.1:0/3012420931 >> 172.21.15.1:0/3012420931 conn(0x7f4bac07b850 msgr2=0x7f4bac107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:13.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.841+0000 7f4bb12a7640 1 -- 172.21.15.1:0/3012420931 shutdown_connections 2024-09-21T00:56:13.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:13.841+0000 7f4bb12a7640 1 -- 172.21.15.1:0/3012420931 wait complete. 2024-09-21T00:56:13.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:13 smithi001 ceph-mon[31211]: pgmap v328: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T00:56:14.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:13 smithi193 ceph-mon[34660]: pgmap v328: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T00:56:14.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:13 smithi042 ceph-mon[34481]: pgmap v328: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T00:56:14.518 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:56:14.776 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:15.024 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:14 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/3012420931' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:56:15.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:14 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/3012420931' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:56:15.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:14 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/3012420931' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:56:15.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.233+0000 7fa7f8132640 1 -- 172.21.15.1:0/1487149175 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7f0105380 msgr2=0x7fa7f010d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:15.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.233+0000 7fa7f8132640 1 --2- 172.21.15.1:0/1487149175 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7f0105380 0x7fa7f010d8d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009900 tx=0x7fa7ec02a410 comp rx=0 tx=0).stop 2024-09-21T00:56:15.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.233+0000 7fa7f8132640 1 -- 172.21.15.1:0/1487149175 shutdown_connections 2024-09-21T00:56:15.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.233+0000 7fa7f8132640 1 --2- 172.21.15.1:0/1487149175 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7f010de60 0x7fa7f0110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:15.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.233+0000 7fa7f8132640 1 --2- 172.21.15.1:0/1487149175 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7f0105380 0x7fa7f010d8d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:15.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.233+0000 7fa7f8132640 1 --2- 172.21.15.1:0/1487149175 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7f0104a30 0x7fa7f0104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:15.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.233+0000 7fa7f8132640 1 -- 172.21.15.1:0/1487149175 >> 172.21.15.1:0/1487149175 conn(0x7fa7f0079760 msgr2=0x7fa7f0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:15.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.233+0000 7fa7f8132640 1 -- 172.21.15.1:0/1487149175 shutdown_connections 2024-09-21T00:56:15.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.233+0000 7fa7f8132640 1 -- 172.21.15.1:0/1487149175 wait complete. 2024-09-21T00:56:15.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.233+0000 7fa7f8132640 1 Processor -- start 2024-09-21T00:56:15.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.234+0000 7fa7f8132640 1 -- start start 2024-09-21T00:56:15.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.234+0000 7fa7f8132640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7f0104a30 0x7fa7f019a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:15.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.234+0000 7fa7f8132640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7f0105380 0x7fa7f019aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:15.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.234+0000 7fa7f8132640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7f010de60 0x7fa7f019fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:15.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.234+0000 7fa7f8132640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f0113aa0 con 0x7fa7f0105380 2024-09-21T00:56:15.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.234+0000 7fa7f8132640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f0113920 con 0x7fa7f010de60 2024-09-21T00:56:15.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.234+0000 7fa7f8132640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f0113c20 con 0x7fa7f0104a30 2024-09-21T00:56:15.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.234+0000 7fa7f56cd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7f0105380 0x7fa7f019aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:15.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.234+0000 7fa7f56cd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7f0105380 0x7fa7f019aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47220/0 (socket says 172.21.15.1:47220) 2024-09-21T00:56:15.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.234+0000 7fa7f56cd640 1 -- 172.21.15.1:0/2038989215 learned_addr learned my addr 172.21.15.1:0/2038989215 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:15.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.234+0000 7fa7f5ece640 1 --2- 172.21.15.1:0/2038989215 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7f0104a30 0x7fa7f019a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:15.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.234+0000 7fa7f66cf640 1 --2- 172.21.15.1:0/2038989215 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7f010de60 0x7fa7f019fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:15.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.234+0000 7fa7f56cd640 1 -- 172.21.15.1:0/2038989215 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7f0104a30 msgr2=0x7fa7f019a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:15.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.234+0000 7fa7f56cd640 1 --2- 172.21.15.1:0/2038989215 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7f0104a30 0x7fa7f019a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:15.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.234+0000 7fa7f56cd640 1 -- 172.21.15.1:0/2038989215 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7f010de60 msgr2=0x7fa7f019fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:15.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.234+0000 7fa7f56cd640 1 --2- 172.21.15.1:0/2038989215 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7f010de60 0x7fa7f019fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:15.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.234+0000 7fa7f56cd640 1 -- 172.21.15.1:0/2038989215 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f01a0440 con 0x7fa7f0105380 2024-09-21T00:56:15.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.234+0000 7fa7f56cd640 1 --2- 172.21.15.1:0/2038989215 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7f0105380 0x7fa7f019aa70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec02a930 tx=0x7fa7ec004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:15.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.235+0000 7fa7e6ffd640 1 -- 172.21.15.1:0/2038989215 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec03f030 con 0x7fa7f0105380 2024-09-21T00:56:15.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.235+0000 7fa7e6ffd640 1 -- 172.21.15.1:0/2038989215 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7ec003aa0 con 0x7fa7f0105380 2024-09-21T00:56:15.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.235+0000 7fa7f8132640 1 -- 172.21.15.1:0/2038989215 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7f01a06d0 con 0x7fa7f0105380 2024-09-21T00:56:15.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.235+0000 7fa7e6ffd640 1 -- 172.21.15.1:0/2038989215 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec035070 con 0x7fa7f0105380 2024-09-21T00:56:15.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.235+0000 7fa7f8132640 1 -- 172.21.15.1:0/2038989215 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7f01a6e90 con 0x7fa7f0105380 2024-09-21T00:56:15.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.236+0000 7fa7f8132640 1 -- 172.21.15.1:0/2038989215 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7f006c1f0 con 0x7fa7f0105380 2024-09-21T00:56:15.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.237+0000 7fa7e6ffd640 1 -- 172.21.15.1:0/2038989215 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7fa7ec042030 con 0x7fa7f0105380 2024-09-21T00:56:15.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.238+0000 7fa7e6ffd640 1 --2- 172.21.15.1:0/2038989215 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa7dc0b6620 0x7fa7dc0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:15.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.239+0000 7fa7f5ece640 1 --2- 172.21.15.1:0/2038989215 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa7dc0b6620 0x7fa7dc0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:15.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.239+0000 7fa7e6ffd640 1 -- 172.21.15.1:0/2038989215 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fa7ec107f30 con 0x7fa7f0105380 2024-09-21T00:56:15.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.239+0000 7fa7f5ece640 1 --2- 172.21.15.1:0/2038989215 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa7dc0b6620 0x7fa7dc0b8b30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0005fd0 tx=0x7fa7e000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:15.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.242+0000 7fa7e6ffd640 1 -- 172.21.15.1:0/2038989215 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa7ec139710 con 0x7fa7f0105380 2024-09-21T00:56:15.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.470+0000 7fa7f8132640 1 -- 172.21.15.1:0/2038989215 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7f0104e40 con 0x7fa7f0105380 2024-09-21T00:56:15.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.471+0000 7fa7e6ffd640 1 -- 172.21.15.1:0/2038989215 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11955 (secure 0 0 0) 0x7fa7ec0ce5e0 con 0x7fa7f0105380 2024-09-21T00:56:15.471 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:56:15.471 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":26,"btime":"2024-09-21T00:55:10:582235+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2810186677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2810186677},{"type":"v1","addr":"172.21.15.1:6835","nonce":2810186677}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14736,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3935320478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3935320478},{"type":"v1","addr":"172.21.15.1:6837","nonce":3935320478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:54:58.592853+0000","modified":"2024-09-21T00:55:09.837567+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24653,"mds_1":24637,"mds_2":24626,"mds_3":24622,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/2125703572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2125703572},{"type":"v1","addr":"172.21.15.1:6839","nonce":2125703572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/3860445313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860445313},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860445313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6833/712170939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":712170939},{"type":"v1","addr":"172.21.15.193:6833","nonce":712170939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6833/1653911656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1653911656},{"type":"v1","addr":"172.21.15.42:6833","nonce":1653911656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6835/793085918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":793085918},{"type":"v1","addr":"172.21.15.42:6835","nonce":793085918}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6835/3631682268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":3631682268},{"type":"v1","addr":"172.21.15.193:6835","nonce":3631682268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.193:6837/909252228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":909252228},{"type":"v1","addr":"172.21.15.193:6837","nonce":909252228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.42:6837/2395608508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2395608508},{"type":"v1","addr":"172.21.15.42:6837","nonce":2395608508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.193:6839/1365361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1365361177},{"type":"v1","addr":"172.21.15.193:6839","nonce":1365361177}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6839/2526476666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2526476666},{"type":"v1","addr":"172.21.15.42:6839","nonce":2526476666}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653,24637,24626,24622,24610]},"id":1}]} 2024-09-21T00:56:15.472 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 26 2024-09-21T00:56:15.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.473+0000 7fa7f8132640 1 -- 172.21.15.1:0/2038989215 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa7dc0b6620 msgr2=0x7fa7dc0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:15.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.473+0000 7fa7f8132640 1 --2- 172.21.15.1:0/2038989215 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa7dc0b6620 0x7fa7dc0b8b30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0005fd0 tx=0x7fa7e000b390 comp rx=0 tx=0).stop 2024-09-21T00:56:15.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.473+0000 7fa7f8132640 1 -- 172.21.15.1:0/2038989215 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7f0105380 msgr2=0x7fa7f019aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:15.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.473+0000 7fa7f8132640 1 --2- 172.21.15.1:0/2038989215 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7f0105380 0x7fa7f019aa70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec02a930 tx=0x7fa7ec004270 comp rx=0 tx=0).stop 2024-09-21T00:56:15.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.473+0000 7fa7f8132640 1 -- 172.21.15.1:0/2038989215 shutdown_connections 2024-09-21T00:56:15.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.473+0000 7fa7f8132640 1 --2- 172.21.15.1:0/2038989215 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7f010de60 0x7fa7f019fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:15.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.473+0000 7fa7f8132640 1 --2- 172.21.15.1:0/2038989215 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa7dc0b6620 0x7fa7dc0b8b30 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:15.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.473+0000 7fa7f8132640 1 --2- 172.21.15.1:0/2038989215 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7f0105380 0x7fa7f019aa70 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:15.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.473+0000 7fa7f8132640 1 --2- 172.21.15.1:0/2038989215 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7f0104a30 0x7fa7f019a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:15.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.473+0000 7fa7f8132640 1 -- 172.21.15.1:0/2038989215 >> 172.21.15.1:0/2038989215 conn(0x7fa7f0079760 msgr2=0x7fa7f01008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:15.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.473+0000 7fa7f8132640 1 -- 172.21.15.1:0/2038989215 shutdown_connections 2024-09-21T00:56:15.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:15.473+0000 7fa7f8132640 1 -- 172.21.15.1:0/2038989215 wait complete. 2024-09-21T00:56:16.206 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:15 smithi001 ceph-mon[31211]: pgmap v329: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T00:56:16.206 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:15 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/2038989215' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:16.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:15 smithi193 ceph-mon[34660]: pgmap v329: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T00:56:16.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:15 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/2038989215' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:16.235 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T00:54:58.592853+0000', 'modified': '2024-09-21T00:55:09.837567+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24653, 'mds_1': 24637, 'mds_2': 24626, 'mds_3': 24622, 'mds_4': 24610}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14787': {'gid': 14787, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.1:6839/2125703572', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.1:6838', 'nonce': 2125703572}, {'type': 'v1', 'addr': '172.21.15.1:6839', 'nonce': 2125703572}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14793': {'gid': 14793, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.1:6841/3860445313', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.1:6840', 'nonce': 3860445313}, {'type': 'v1', 'addr': '172.21.15.1:6841', 'nonce': 3860445313}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24571': {'gid': 24571, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.193:6833/712170939', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6832', 'nonce': 712170939}, {'type': 'v1', 'addr': '172.21.15.193:6833', 'nonce': 712170939}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24578': {'gid': 24578, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.42:6833/1653911656', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6832', 'nonce': 1653911656}, {'type': 'v1', 'addr': '172.21.15.42:6833', 'nonce': 1653911656}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24605': {'gid': 24605, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.42:6835/793085918', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6834', 'nonce': 793085918}, {'type': 'v1', 'addr': '172.21.15.42:6835', 'nonce': 793085918}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24610': {'gid': 24610, 'name': 'f', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.193:6835/3631682268', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6834', 'nonce': 3631682268}, {'type': 'v1', 'addr': '172.21.15.193:6835', 'nonce': 3631682268}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24622': {'gid': 24622, 'name': 'c', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.193:6837/909252228', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6836', 'nonce': 909252228}, {'type': 'v1', 'addr': '172.21.15.193:6837', 'nonce': 909252228}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24626': {'gid': 24626, 'name': 'h', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.42:6837/2395608508', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6836', 'nonce': 2395608508}, {'type': 'v1', 'addr': '172.21.15.42:6837', 'nonce': 2395608508}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24637': {'gid': 24637, 'name': 'i', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.193:6839/1365361177', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6838', 'nonce': 1365361177}, {'type': 'v1', 'addr': '172.21.15.193:6839', 'nonce': 1365361177}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24653': {'gid': 24653, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.42:6839/2526476666', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6838', 'nonce': 2526476666}, {'type': 'v1', 'addr': '172.21.15.42:6839', 'nonce': 2526476666}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24653, 'qdb_cluster': [24653, 24637, 24626, 24622, 24610]} 2024-09-21T00:56:16.235 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-21T00:56:16.235 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.f status 2024-09-21T00:56:16.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:15 smithi042 ceph-mon[34481]: pgmap v329: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T00:56:16.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:15 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/2038989215' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:16.491 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:16.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.951+0000 7f7079556640 1 -- 172.21.15.1:0/512261156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7074108d20 msgr2=0x7f707410f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:16.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.951+0000 7f7079556640 1 --2- 172.21.15.1:0/512261156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7074108d20 0x7f707410f550 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f706c009ca0 tx=0x7f706c02a8c0 comp rx=0 tx=0).stop 2024-09-21T00:56:16.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.951+0000 7f7079556640 1 -- 172.21.15.1:0/512261156 shutdown_connections 2024-09-21T00:56:16.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.951+0000 7f7079556640 1 --2- 172.21.15.1:0/512261156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7074108d20 0x7f707410f550 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:16.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.951+0000 7f7079556640 1 --2- 172.21.15.1:0/512261156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f70741083d0 0x7f70741087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:16.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.951+0000 7f7079556640 1 --2- 172.21.15.1:0/512261156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7074102ae0 0x7f7074102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:16.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.951+0000 7f7079556640 1 -- 172.21.15.1:0/512261156 >> 172.21.15.1:0/512261156 conn(0x7f7074079760 msgr2=0x7f7074079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:16.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.951+0000 7f7079556640 1 -- 172.21.15.1:0/512261156 shutdown_connections 2024-09-21T00:56:16.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.951+0000 7f7079556640 1 -- 172.21.15.1:0/512261156 wait complete. 2024-09-21T00:56:16.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.952+0000 7f7079556640 1 Processor -- start 2024-09-21T00:56:16.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.952+0000 7f7079556640 1 -- start start 2024-09-21T00:56:16.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.952+0000 7f7079556640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7074102ae0 0x7f707419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:16.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.952+0000 7f7079556640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70741083d0 0x7f707419aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:16.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.952+0000 7f7079556640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7074108d20 0x7f707419fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:16.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.952+0000 7f7079556640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f70741129f0 con 0x7f7074108d20 2024-09-21T00:56:16.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.952+0000 7f7079556640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7074112870 con 0x7f70741083d0 2024-09-21T00:56:16.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.952+0000 7f7079556640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7074112b70 con 0x7f7074102ae0 2024-09-21T00:56:16.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.953+0000 7f70737fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7074108d20 0x7f707419fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:16.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.953+0000 7f70737fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7074108d20 0x7f707419fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47238/0 (socket says 172.21.15.1:47238) 2024-09-21T00:56:16.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.953+0000 7f70737fe640 1 -- 172.21.15.1:0/2682004504 learned_addr learned my addr 172.21.15.1:0/2682004504 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:16.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.953+0000 7f7072ffd640 1 --2- 172.21.15.1:0/2682004504 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7074102ae0 0x7f707419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:16.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.953+0000 7f70727fc640 1 --2- 172.21.15.1:0/2682004504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70741083d0 0x7f707419aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:16.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.953+0000 7f70737fe640 1 -- 172.21.15.1:0/2682004504 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7074102ae0 msgr2=0x7f707419a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:16.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.953+0000 7f70737fe640 1 --2- 172.21.15.1:0/2682004504 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7074102ae0 0x7f707419a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:16.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.953+0000 7f70737fe640 1 -- 172.21.15.1:0/2682004504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70741083d0 msgr2=0x7f707419aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:16.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.953+0000 7f70737fe640 1 --2- 172.21.15.1:0/2682004504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70741083d0 0x7f707419aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:16.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.953+0000 7f70737fe640 1 -- 172.21.15.1:0/2682004504 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70741a0400 con 0x7f7074108d20 2024-09-21T00:56:16.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.953+0000 7f7072ffd640 1 --2- 172.21.15.1:0/2682004504 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7074102ae0 0x7f707419a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:56:16.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.953+0000 7f70737fe640 1 --2- 172.21.15.1:0/2682004504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7074108d20 0x7f707419fcd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f706c005cc0 tx=0x7f706c02f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:16.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.953+0000 7f705bfff640 1 -- 172.21.15.1:0/2682004504 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706c003cf0 con 0x7f7074108d20 2024-09-21T00:56:16.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.953+0000 7f705bfff640 1 -- 172.21.15.1:0/2682004504 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f706c0044f0 con 0x7f7074108d20 2024-09-21T00:56:16.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.953+0000 7f7079556640 1 -- 172.21.15.1:0/2682004504 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70741a0690 con 0x7f7074108d20 2024-09-21T00:56:16.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.953+0000 7f705bfff640 1 -- 172.21.15.1:0/2682004504 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706c02fd10 con 0x7f7074108d20 2024-09-21T00:56:16.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.953+0000 7f7079556640 1 -- 172.21.15.1:0/2682004504 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70741a6e50 con 0x7f7074108d20 2024-09-21T00:56:16.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.956+0000 7f707faca740 1 Processor -- start 2024-09-21T00:56:16.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.956+0000 7f705bfff640 1 -- 172.21.15.1:0/2682004504 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7f706c004040 con 0x7f7074108d20 2024-09-21T00:56:16.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.956+0000 7f707faca740 1 -- start start 2024-09-21T00:56:16.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.956+0000 7f707faca740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563cd868ff60 0x563cd8a35f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:16.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.956+0000 7f707faca740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563cd86670a0 0x563cd8a36440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:16.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.956+0000 7f707faca740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd866f280 0x563cd8a36980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:16.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.956+0000 7f707faca740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563cd89adc10 con 0x563cd866f280 2024-09-21T00:56:16.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.956+0000 7f707faca740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563cd899d040 con 0x563cd86670a0 2024-09-21T00:56:16.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.956+0000 7f707faca740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563cd89a0e50 con 0x563cd868ff60 2024-09-21T00:56:16.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.957+0000 7f70727fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd866f280 0x563cd8a36980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:16.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.957+0000 7f70727fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd866f280 0x563cd8a36980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47250/0 (socket says 172.21.15.1:47250) 2024-09-21T00:56:16.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.957+0000 7f70727fc640 1 -- 172.21.15.1:0/938360842 learned_addr learned my addr 172.21.15.1:0/938360842 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:16.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.957+0000 7f7072ffd640 1 --2- 172.21.15.1:0/938360842 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563cd86670a0 0x563cd8a36440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:16.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.957+0000 7f70727fc640 1 --2- 172.21.15.1:0/938360842 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563cd868ff60 0x563cd8a35f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:16.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.957+0000 7f70727fc640 1 -- 172.21.15.1:0/938360842 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563cd868ff60 msgr2=0x563cd8a35f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:16.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.957+0000 7f70727fc640 1 --2- 172.21.15.1:0/938360842 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563cd868ff60 0x563cd8a35f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:16.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.957+0000 7f70727fc640 1 -- 172.21.15.1:0/938360842 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563cd86670a0 msgr2=0x563cd8a36440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:16.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.957+0000 7f70727fc640 1 --2- 172.21.15.1:0/938360842 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563cd86670a0 0x563cd8a36440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:16.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.957+0000 7f70727fc640 1 -- 172.21.15.1:0/938360842 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cd86fb540 con 0x563cd866f280 2024-09-21T00:56:16.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.957+0000 7f705bfff640 1 --2- 172.21.15.1:0/2682004504 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f705c0b65a0 0x7f705c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:16.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.957+0000 7f7072ffd640 1 --2- 172.21.15.1:0/2682004504 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f705c0b65a0 0x7f705c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:16.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.957+0000 7f70727fc640 1 --2- 172.21.15.1:0/938360842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd866f280 0x563cd8a36980 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f706800ad50 tx=0x7f706800a470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e6511f8016a811c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:16.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.957+0000 7f705bfff640 1 -- 172.21.15.1:0/2682004504 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f706c108b90 con 0x7f7074108d20 2024-09-21T00:56:16.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.957+0000 7f70597fa640 1 -- 172.21.15.1:0/938360842 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706801c070 con 0x563cd866f280 2024-09-21T00:56:16.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.958+0000 7f70597fa640 1 -- 172.21.15.1:0/938360842 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f706800fdf0 con 0x563cd866f280 2024-09-21T00:56:16.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.958+0000 7f70597fa640 1 -- 172.21.15.1:0/938360842 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7068014650 con 0x563cd866f280 2024-09-21T00:56:16.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.958+0000 7f707faca740 1 -- 172.21.15.1:0/938360842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd866f280 msgr2=0x563cd8a36980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:16.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.958+0000 7f7072ffd640 1 --2- 172.21.15.1:0/2682004504 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f705c0b65a0 0x7f705c0b8ab0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x563cd8a34b80 tx=0x7f706400c4f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:16.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.958+0000 7f707faca740 1 --2- 172.21.15.1:0/938360842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd866f280 0x563cd8a36980 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f706800ad50 tx=0x7f706800a470 comp rx=0 tx=0).stop 2024-09-21T00:56:16.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.959+0000 7f707faca740 1 -- 172.21.15.1:0/938360842 shutdown_connections 2024-09-21T00:56:16.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.959+0000 7f707faca740 1 --2- 172.21.15.1:0/938360842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd866f280 0x563cd8a36980 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:16.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.959+0000 7f707faca740 1 --2- 172.21.15.1:0/938360842 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563cd86670a0 0x563cd8a36440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:16.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.959+0000 7f707faca740 1 --2- 172.21.15.1:0/938360842 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563cd868ff60 0x563cd8a35f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:16.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.959+0000 7f707faca740 1 -- 172.21.15.1:0/938360842 >> 172.21.15.1:0/938360842 conn(0x563cd8684350 msgr2=0x563cd8a33df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:16.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.959+0000 7f707faca740 1 -- 172.21.15.1:0/938360842 shutdown_connections 2024-09-21T00:56:16.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.959+0000 7f707faca740 1 -- 172.21.15.1:0/938360842 wait complete. 2024-09-21T00:56:16.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.959+0000 7f707faca740 1 -- start start 2024-09-21T00:56:16.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.959+0000 7f707faca740 1 Processor -- start 2024-09-21T00:56:16.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.960+0000 7f707faca740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563cd86670a0 0x563cd8a41a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:16.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.960+0000 7f707faca740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd866f280 0x563cd8a41f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:16.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.960+0000 7f707faca740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563cd868ff60 0x563cd8a4da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:16.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.960+0000 7f707faca740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563cd87fe5f0 con 0x563cd866f280 2024-09-21T00:56:16.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.960+0000 7f707faca740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563cd8938010 con 0x563cd86670a0 2024-09-21T00:56:16.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.960+0000 7f707faca740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563cd8a446e0 con 0x563cd868ff60 2024-09-21T00:56:16.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.960+0000 7f707faca740 10 client.0 _ll_register_callbacks cb 0x563cd8997340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:56:16.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.960+0000 7f70727fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd866f280 0x563cd8a41f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:16.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.960+0000 7f70727fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd866f280 0x563cd8a41f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47262/0 (socket says 172.21.15.1:47262) 2024-09-21T00:56:16.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.960+0000 7f70727fc640 1 -- 172.21.15.1:0/3814227658 learned_addr learned my addr 172.21.15.1:0/3814227658 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:16.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.960+0000 7f7072ffd640 1 --2- 172.21.15.1:0/3814227658 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563cd86670a0 0x563cd8a41a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:16.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.960+0000 7f70727fc640 1 -- 172.21.15.1:0/3814227658 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563cd868ff60 msgr2=0x563cd8a4da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:16.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.960+0000 7f70737fe640 1 --2- 172.21.15.1:0/3814227658 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563cd868ff60 0x563cd8a4da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:16.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.960+0000 7f70727fc640 1 --2- 172.21.15.1:0/3814227658 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563cd868ff60 0x563cd8a4da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:16.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.960+0000 7f70727fc640 1 -- 172.21.15.1:0/3814227658 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563cd86670a0 msgr2=0x563cd8a41a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:16.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.960+0000 7f70727fc640 1 --2- 172.21.15.1:0/3814227658 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563cd86670a0 0x563cd8a41a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:16.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.960+0000 7f70727fc640 1 -- 172.21.15.1:0/3814227658 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cd8965a00 con 0x563cd866f280 2024-09-21T00:56:16.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.960+0000 7f7072ffd640 1 --2- 172.21.15.1:0/3814227658 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563cd86670a0 0x563cd8a41a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:56:16.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.960+0000 7f70737fe640 1 --2- 172.21.15.1:0/3814227658 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563cd868ff60 0x563cd8a4da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:56:16.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.960+0000 7f70727fc640 1 --2- 172.21.15.1:0/3814227658 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd866f280 0x563cd8a41f90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7068017840 tx=0x7f7068017870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b113b9184780028 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:16.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.960+0000 7f7056ff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:56:16.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.960+0000 7f7056ff5640 1 -- 172.21.15.1:0/3814227658 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7068024020 con 0x563cd866f280 2024-09-21T00:56:16.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.961+0000 7f7056ff5640 1 -- 172.21.15.1:0/3814227658 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f7068017a10 con 0x563cd866f280 2024-09-21T00:56:16.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.961+0000 7f707faca740 1 -- 172.21.15.1:0/3814227658 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f706800fdf0 con 0x563cd866f280 2024-09-21T00:56:16.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.961+0000 7f7056ff5640 1 -- 172.21.15.1:0/3814227658 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f706802f050 con 0x563cd866f280 2024-09-21T00:56:16.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.961+0000 7f707faca740 10 client.15156 fetch_fsmap learned FSMap version 26 2024-09-21T00:56:16.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.961+0000 7f707faca740 1 -- 172.21.15.1:0/3814227658 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563cd8a506d0 con 0x563cd866f280 2024-09-21T00:56:16.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.961+0000 7f7056ff5640 1 -- 172.21.15.1:0/3814227658 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f706800fdf0 con 0x563cd866f280 2024-09-21T00:56:16.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.961+0000 7f7056ff5640 1 -- 172.21.15.1:0/3814227658 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f7068015040 con 0x563cd866f280 2024-09-21T00:56:16.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.961+0000 7f707faca740 10 client.15156 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T00:56:16.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.961+0000 7f707faca740 10 client.15156 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-21T00:56:16.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.961+0000 7f707faca740 20 client.15156 populate_metadata read hostname 'smithi001' 2024-09-21T00:56:16.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.961+0000 7f707faca740 1 --2- 172.21.15.1:0/3814227658 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x563cd864e8e0 0x563cd8a53d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:16.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.961+0000 7f707faca740 4 client.15156 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:56:16.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.961+0000 7f707faca740 1 -- 172.21.15.1:0/3814227658 --> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563cd89afb60 con 0x563cd864e8e0 2024-09-21T00:56:16.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.962+0000 7f7072ffd640 1 --2- 172.21.15.1:0/3814227658 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x563cd864e8e0 0x563cd8a53d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:16.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.962+0000 7f7056ff5640 10 client.15156 ms_handle_connect on v2:172.21.15.193:6834/3631682268 2024-09-21T00:56:16.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.962+0000 7f7072ffd640 1 --2- 172.21.15.1:0/3814227658 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x563cd864e8e0 0x563cd8a53d70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ced938e672ebcacb server_cookie=80b6b39832b90182 in_seq=0 out_seq=0 2024-09-21T00:56:16.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.963+0000 7f7056ff5640 1 -- 172.21.15.1:0/3814227658 <== mds.4 v2:172.21.15.193:6834/3631682268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563cd89afb60 con 0x563cd864e8e0 2024-09-21T00:56:16.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.963+0000 7f7056ff5640 10 client.15156 handle_command_reply: tid=0 2024-09-21T00:56:16.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.963+0000 7f707faca740 1 client.15156 shutdown 2024-09-21T00:56:16.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.963+0000 7f707faca740 1 -- 172.21.15.1:0/3814227658 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd866f280 msgr2=0x563cd8a41f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:16.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.963+0000 7f707faca740 1 --2- 172.21.15.1:0/3814227658 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd866f280 0x563cd8a41f90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7068017840 tx=0x7f7068017870 comp rx=0 tx=0).stop 2024-09-21T00:56:16.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.964+0000 7f707faca740 1 -- 172.21.15.1:0/3814227658 shutdown_connections 2024-09-21T00:56:16.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.964+0000 7f707faca740 1 --2- 172.21.15.1:0/3814227658 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x563cd864e8e0 0x563cd8a53d70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:16.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.964+0000 7f707faca740 1 --2- 172.21.15.1:0/3814227658 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563cd868ff60 0x563cd8a4da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:16.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.964+0000 7f707faca740 1 --2- 172.21.15.1:0/3814227658 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd866f280 0x563cd8a41f90 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:16.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.964+0000 7f707faca740 1 --2- 172.21.15.1:0/3814227658 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563cd86670a0 0x563cd8a41a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:16.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.964+0000 7f707faca740 1 -- 172.21.15.1:0/3814227658 >> 172.21.15.1:0/3814227658 conn(0x563cd8684350 msgr2=0x563cd8a39090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:16.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.964+0000 7f7056ff5640 0 client.15156 ms_handle_reset on v2:172.21.15.193:6834/3631682268 2024-09-21T00:56:16.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.964+0000 7f707faca740 1 -- 172.21.15.1:0/3814227658 shutdown_connections 2024-09-21T00:56:16.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.964+0000 7f707faca740 1 -- 172.21.15.1:0/3814227658 wait complete. 2024-09-21T00:56:16.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.964+0000 7f707faca740 20 client.15156 trim_cache size 0 max 16384 2024-09-21T00:56:16.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.982+0000 7f707faca740 1 Processor -- start 2024-09-21T00:56:16.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.982+0000 7f707faca740 1 -- start start 2024-09-21T00:56:16.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.982+0000 7f707faca740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563cd86670a0 0x563cd8a2ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:16.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.982+0000 7f707faca740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563cd866f280 0x563cd8a33d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:16.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.982+0000 7f707faca740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd868ff60 0x563cd8a3c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:16.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.982+0000 7f707faca740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563cd8a520b0 con 0x563cd868ff60 2024-09-21T00:56:16.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.982+0000 7f707faca740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563cd8a52780 con 0x563cd86670a0 2024-09-21T00:56:16.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.982+0000 7f707faca740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563cd8a52e50 con 0x563cd866f280 2024-09-21T00:56:16.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.983+0000 7f70737fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd868ff60 0x563cd8a3c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:16.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.983+0000 7f70737fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd868ff60 0x563cd8a3c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47266/0 (socket says 172.21.15.1:47266) 2024-09-21T00:56:16.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.983+0000 7f70737fe640 1 -- 172.21.15.1:0/2965746097 learned_addr learned my addr 172.21.15.1:0/2965746097 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:16.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.983+0000 7f7072ffd640 1 --2- 172.21.15.1:0/2965746097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563cd86670a0 0x563cd8a2ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:16.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.983+0000 7f70727fc640 1 --2- 172.21.15.1:0/2965746097 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563cd866f280 0x563cd8a33d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:16.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.983+0000 7f70737fe640 1 -- 172.21.15.1:0/2965746097 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563cd866f280 msgr2=0x563cd8a33d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:16.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.983+0000 7f70737fe640 1 --2- 172.21.15.1:0/2965746097 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563cd866f280 0x563cd8a33d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:16.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.983+0000 7f70737fe640 1 -- 172.21.15.1:0/2965746097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563cd86670a0 msgr2=0x563cd8a2ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:16.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.983+0000 7f70737fe640 1 --2- 172.21.15.1:0/2965746097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563cd86670a0 0x563cd8a2ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:16.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.983+0000 7f70737fe640 1 -- 172.21.15.1:0/2965746097 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cd8a3c560 con 0x563cd868ff60 2024-09-21T00:56:16.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.983+0000 7f70737fe640 1 --2- 172.21.15.1:0/2965746097 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd868ff60 0x563cd8a3c020 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f706c0096a0 tx=0x7f706c02feb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1b4e206edf6b517 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:16.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.983+0000 7f7058ff9640 1 -- 172.21.15.1:0/2965746097 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706c0098d0 con 0x563cd868ff60 2024-09-21T00:56:16.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.983+0000 7f7058ff9640 1 -- 172.21.15.1:0/2965746097 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f706c036070 con 0x563cd868ff60 2024-09-21T00:56:16.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.983+0000 7f7058ff9640 1 -- 172.21.15.1:0/2965746097 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706c0d85c0 con 0x563cd868ff60 2024-09-21T00:56:16.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.984+0000 7f707faca740 1 -- 172.21.15.1:0/2965746097 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd868ff60 msgr2=0x563cd8a3c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:16.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.984+0000 7f707faca740 1 --2- 172.21.15.1:0/2965746097 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd868ff60 0x563cd8a3c020 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f706c0096a0 tx=0x7f706c02feb0 comp rx=0 tx=0).stop 2024-09-21T00:56:16.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.984+0000 7f707faca740 1 -- 172.21.15.1:0/2965746097 shutdown_connections 2024-09-21T00:56:16.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.984+0000 7f707faca740 1 --2- 172.21.15.1:0/2965746097 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd868ff60 0x563cd8a3c020 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:16.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.984+0000 7f707faca740 1 --2- 172.21.15.1:0/2965746097 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563cd866f280 0x563cd8a33d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:16.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.984+0000 7f707faca740 1 --2- 172.21.15.1:0/2965746097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563cd86670a0 0x563cd8a2ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:16.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.984+0000 7f707faca740 1 -- 172.21.15.1:0/2965746097 >> 172.21.15.1:0/2965746097 conn(0x563cd8684350 msgr2=0x563cd8a33600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:16.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.984+0000 7f707faca740 1 -- 172.21.15.1:0/2965746097 shutdown_connections 2024-09-21T00:56:16.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.984+0000 7f707faca740 1 -- 172.21.15.1:0/2965746097 wait complete. 2024-09-21T00:56:16.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.985+0000 7f707faca740 1 -- start start 2024-09-21T00:56:16.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.985+0000 7f707faca740 1 Processor -- start 2024-09-21T00:56:16.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.985+0000 7f707faca740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563cd86670a0 0x563cd8a55320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:16.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.985+0000 7f707faca740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd866f280 0x563cd8a558e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:16.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.985+0000 7f707faca740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563cd868ff60 0x563cd8a5a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:16.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.985+0000 7f707faca740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563cd8a53bf0 con 0x563cd866f280 2024-09-21T00:56:16.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.985+0000 7f707faca740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563cd8a53520 con 0x563cd868ff60 2024-09-21T00:56:16.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.985+0000 7f707faca740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563cd8a542c0 con 0x563cd86670a0 2024-09-21T00:56:16.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.985+0000 7f707faca740 10 client.0 _ll_register_callbacks cb 0x7f706801a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:56:16.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.985+0000 7f70727fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd866f280 0x563cd8a558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:16.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.985+0000 7f70727fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd866f280 0x563cd8a558e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47268/0 (socket says 172.21.15.1:47268) 2024-09-21T00:56:16.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.985+0000 7f70727fc640 1 -- 172.21.15.1:0/1800165611 learned_addr learned my addr 172.21.15.1:0/1800165611 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:16.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.985+0000 7f70737fe640 1 --2- 172.21.15.1:0/1800165611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563cd868ff60 0x563cd8a5a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:16.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.985+0000 7f7072ffd640 1 --2- 172.21.15.1:0/1800165611 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563cd86670a0 0x563cd8a55320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:16.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.985+0000 7f70727fc640 1 -- 172.21.15.1:0/1800165611 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563cd86670a0 msgr2=0x563cd8a55320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:16.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.985+0000 7f70727fc640 1 --2- 172.21.15.1:0/1800165611 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563cd86670a0 0x563cd8a55320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:16.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.985+0000 7f70727fc640 1 -- 172.21.15.1:0/1800165611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563cd868ff60 msgr2=0x563cd8a5a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:16.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.985+0000 7f70727fc640 1 --2- 172.21.15.1:0/1800165611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563cd868ff60 0x563cd8a5a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:16.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.985+0000 7f70727fc640 1 -- 172.21.15.1:0/1800165611 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cd8a5af90 con 0x563cd866f280 2024-09-21T00:56:16.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.985+0000 7f70737fe640 1 --2- 172.21.15.1:0/1800165611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563cd868ff60 0x563cd8a5a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:56:16.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.986+0000 7f70727fc640 1 --2- 172.21.15.1:0/1800165611 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd866f280 0x563cd8a558e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7068017c10 tx=0x7f7068017c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea16f05a67a38bea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:16.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.986+0000 7f7056ff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:56:16.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.986+0000 7f7056ff5640 1 -- 172.21.15.1:0/1800165611 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7068024040 con 0x563cd866f280 2024-09-21T00:56:16.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.986+0000 7f707faca740 1 -- 172.21.15.1:0/1800165611 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f706c036070 con 0x563cd866f280 2024-09-21T00:56:16.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.986+0000 7f7056ff5640 1 -- 172.21.15.1:0/1800165611 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f70680059c0 con 0x563cd866f280 2024-09-21T00:56:16.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.986+0000 7f7056ff5640 1 -- 172.21.15.1:0/1800165611 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f706801c040 con 0x563cd866f280 2024-09-21T00:56:16.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.986+0000 7f707faca740 10 client.15162 fetch_fsmap learned FSMap version 26 2024-09-21T00:56:16.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.986+0000 7f707faca740 1 -- 172.21.15.1:0/1800165611 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563cd8a5c350 con 0x563cd866f280 2024-09-21T00:56:16.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.986+0000 7f7056ff5640 1 -- 172.21.15.1:0/1800165611 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f706c036070 con 0x563cd866f280 2024-09-21T00:56:16.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.986+0000 7f7056ff5640 1 -- 172.21.15.1:0/1800165611 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f7068005bc0 con 0x563cd866f280 2024-09-21T00:56:16.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.987+0000 7f707faca740 10 client.15162 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T00:56:16.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.987+0000 7f707faca740 10 client.15162 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-21T00:56:16.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.987+0000 7f707faca740 20 client.15162 populate_metadata read hostname 'smithi001' 2024-09-21T00:56:16.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.987+0000 7f707faca740 1 --2- 172.21.15.1:0/1800165611 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x563cd8623c90 0x563cd8ac1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:16.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.987+0000 7f707faca740 4 client.15162 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T00:56:16.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.987+0000 7f707faca740 1 -- 172.21.15.1:0/1800165611 --> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] -- command(tid 0: {"prefix": "status"}) -- 0x563cd89ab610 con 0x563cd8623c90 2024-09-21T00:56:16.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.987+0000 7f7072ffd640 1 --2- 172.21.15.1:0/1800165611 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x563cd8623c90 0x563cd8ac1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:16.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.987+0000 7f7056ff5640 10 client.15162 ms_handle_connect on v2:172.21.15.193:6834/3631682268 2024-09-21T00:56:16.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.987+0000 7f7072ffd640 1 --2- 172.21.15.1:0/1800165611 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x563cd8623c90 0x563cd8ac1db0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f29c5426a043d19f server_cookie=aa81eb55c4fd834d in_seq=0 out_seq=0 2024-09-21T00:56:16.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.988+0000 7f7056ff5640 1 -- 172.21.15.1:0/1800165611 <== mds.4 v2:172.21.15.193:6834/3631682268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x563cd89ab610 con 0x563cd8623c90 2024-09-21T00:56:16.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.988+0000 7f7056ff5640 10 client.15162 handle_command_reply: tid=0 2024-09-21T00:56:16.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.988+0000 7f707faca740 1 client.15162 shutdown 2024-09-21T00:56:16.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.988+0000 7f707faca740 1 -- 172.21.15.1:0/1800165611 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd866f280 msgr2=0x563cd8a558e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:16.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.988+0000 7f707faca740 1 --2- 172.21.15.1:0/1800165611 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd866f280 0x563cd8a558e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7068017c10 tx=0x7f7068017c40 comp rx=0 tx=0).stop 2024-09-21T00:56:16.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.988+0000 7f707faca740 1 -- 172.21.15.1:0/1800165611 shutdown_connections 2024-09-21T00:56:16.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.988+0000 7f707faca740 1 --2- 172.21.15.1:0/1800165611 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x563cd8623c90 0x563cd8ac1db0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:16.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.988+0000 7f707faca740 1 --2- 172.21.15.1:0/1800165611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563cd868ff60 0x563cd8a5a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:16.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.988+0000 7f7056ff5640 0 client.15162 ms_handle_reset on v2:172.21.15.193:6834/3631682268 2024-09-21T00:56:16.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.988+0000 7f707faca740 1 --2- 172.21.15.1:0/1800165611 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd866f280 0x563cd8a558e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:16.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.988+0000 7f707faca740 1 --2- 172.21.15.1:0/1800165611 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563cd86670a0 0x563cd8a55320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:16.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.988+0000 7f707faca740 1 -- 172.21.15.1:0/1800165611 >> 172.21.15.1:0/1800165611 conn(0x563cd8684350 msgr2=0x563cd8a323b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:16.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.988+0000 7f707faca740 1 -- 172.21.15.1:0/1800165611 shutdown_connections 2024-09-21T00:56:16.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.988+0000 7f707faca740 1 -- 172.21.15.1:0/1800165611 wait complete. 2024-09-21T00:56:16.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.988+0000 7f707faca740 20 client.15162 trim_cache size 0 max 16384 2024-09-21T00:56:16.993 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T00:56:16.994 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "d3972c20-77b2-11ef-baf5-efdc52797490", 2024-09-21T00:56:16.994 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 4, 2024-09-21T00:56:16.994 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24610, 2024-09-21T00:56:16.994 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-21T00:56:16.994 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-21T00:56:16.994 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-21T00:56:16.994 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 67.805138216000003, 2024-09-21T00:56:16.994 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 26, 2024-09-21T00:56:16.994 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 75, 2024-09-21T00:56:16.994 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 73, 2024-09-21T00:56:16.994 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 105.355664523 2024-09-21T00:56:16.994 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T00:56:16.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.988+0000 7f7079556640 1 -- 172.21.15.1:0/2682004504 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f705c0b65a0 msgr2=0x7f705c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:16.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.988+0000 7f7079556640 1 --2- 172.21.15.1:0/2682004504 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f705c0b65a0 0x7f705c0b8ab0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x563cd8a34b80 tx=0x7f706400c4f0 comp rx=0 tx=0).stop 2024-09-21T00:56:16.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.989+0000 7f7079556640 1 -- 172.21.15.1:0/2682004504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7074108d20 msgr2=0x7f707419fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:16.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.989+0000 7f7079556640 1 --2- 172.21.15.1:0/2682004504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7074108d20 0x7f707419fcd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f706c005cc0 tx=0x7f706c02f470 comp rx=0 tx=0).stop 2024-09-21T00:56:16.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.989+0000 7f7079556640 1 -- 172.21.15.1:0/2682004504 shutdown_connections 2024-09-21T00:56:16.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.989+0000 7f7079556640 1 --2- 172.21.15.1:0/2682004504 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f705c0b65a0 0x7f705c0b8ab0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:16.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.989+0000 7f7079556640 1 --2- 172.21.15.1:0/2682004504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7074108d20 0x7f707419fcd0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:16.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.989+0000 7f7079556640 1 --2- 172.21.15.1:0/2682004504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70741083d0 0x7f707419aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:16.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.989+0000 7f7079556640 1 --2- 172.21.15.1:0/2682004504 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7074102ae0 0x7f707419a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:16.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.989+0000 7f7079556640 1 -- 172.21.15.1:0/2682004504 >> 172.21.15.1:0/2682004504 conn(0x7f7074079760 msgr2=0x7f707406bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:16.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.989+0000 7f7079556640 1 -- 172.21.15.1:0/2682004504 shutdown_connections 2024-09-21T00:56:16.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:16.989+0000 7f7079556640 1 -- 172.21.15.1:0/2682004504 wait complete. 2024-09-21T00:56:17.669 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.c status 2024-09-21T00:56:17.931 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:17.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:17 smithi001 ceph-mon[31211]: pgmap v330: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:56:18.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:17 smithi193 ceph-mon[34660]: pgmap v330: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:56:18.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:17 smithi042 ceph-mon[34481]: pgmap v330: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:56:18.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.411+0000 7fc349e73640 1 -- 172.21.15.1:0/3058207876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3441094a0 msgr2=0x7fc3441098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:18.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.411+0000 7fc349e73640 1 --2- 172.21.15.1:0/3058207876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3441094a0 0x7fc3441098b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc338009900 tx=0x7fc33802a410 comp rx=0 tx=0).stop 2024-09-21T00:56:18.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.411+0000 7fc349e73640 1 -- 172.21.15.1:0/3058207876 shutdown_connections 2024-09-21T00:56:18.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.411+0000 7fc349e73640 1 --2- 172.21.15.1:0/3058207876 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc344109df0 0x7fc344110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:18.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.411+0000 7fc349e73640 1 --2- 172.21.15.1:0/3058207876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3441094a0 0x7fc3441098b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:18.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.411+0000 7fc349e73640 1 --2- 172.21.15.1:0/3058207876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc344103b60 0x7fc344103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:18.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.411+0000 7fc349e73640 1 -- 172.21.15.1:0/3058207876 >> 172.21.15.1:0/3058207876 conn(0x7fc34407b850 msgr2=0x7fc34407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:18.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.411+0000 7fc349e73640 1 -- 172.21.15.1:0/3058207876 shutdown_connections 2024-09-21T00:56:18.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.411+0000 7fc349e73640 1 -- 172.21.15.1:0/3058207876 wait complete. 2024-09-21T00:56:18.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.411+0000 7fc349e73640 1 Processor -- start 2024-09-21T00:56:18.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.412+0000 7fc349e73640 1 -- start start 2024-09-21T00:56:18.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.412+0000 7fc349e73640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc344103b60 0x7fc34419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:18.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.412+0000 7fc349e73640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc3441094a0 0x7fc34419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:18.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.412+0000 7fc349e73640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc344109df0 0x7fc34419fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:18.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.412+0000 7fc349e73640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc344113ab0 con 0x7fc344109df0 2024-09-21T00:56:18.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.412+0000 7fc349e73640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc344113930 con 0x7fc344103b60 2024-09-21T00:56:18.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.412+0000 7fc349e73640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc344113c30 con 0x7fc3441094a0 2024-09-21T00:56:18.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.412+0000 7fc343fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc344109df0 0x7fc34419fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:18.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.412+0000 7fc343fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc344109df0 0x7fc34419fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47284/0 (socket says 172.21.15.1:47284) 2024-09-21T00:56:18.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.412+0000 7fc343fff640 1 -- 172.21.15.1:0/2089839994 learned_addr learned my addr 172.21.15.1:0/2089839994 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:18.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.412+0000 7fc3437fe640 1 --2- 172.21.15.1:0/2089839994 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc344103b60 0x7fc34419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:18.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.412+0000 7fc342ffd640 1 --2- 172.21.15.1:0/2089839994 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc3441094a0 0x7fc34419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:18.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.412+0000 7fc343fff640 1 -- 172.21.15.1:0/2089839994 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc3441094a0 msgr2=0x7fc34419aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:18.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.412+0000 7fc343fff640 1 --2- 172.21.15.1:0/2089839994 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc3441094a0 0x7fc34419aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:18.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.412+0000 7fc343fff640 1 -- 172.21.15.1:0/2089839994 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc344103b60 msgr2=0x7fc34419a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:18.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.412+0000 7fc343fff640 1 --2- 172.21.15.1:0/2089839994 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc344103b60 0x7fc34419a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:18.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.412+0000 7fc343fff640 1 -- 172.21.15.1:0/2089839994 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3441a0370 con 0x7fc344109df0 2024-09-21T00:56:18.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.413+0000 7fc343fff640 1 --2- 172.21.15.1:0/2089839994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc344109df0 0x7fc34419fd00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc33c00cad0 tx=0x7fc33c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:18.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.413+0000 7fc340ff9640 1 -- 172.21.15.1:0/2089839994 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33c00ad60 con 0x7fc344109df0 2024-09-21T00:56:18.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.413+0000 7fc340ff9640 1 -- 172.21.15.1:0/2089839994 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc33c005020 con 0x7fc344109df0 2024-09-21T00:56:18.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.413+0000 7fc349e73640 1 -- 172.21.15.1:0/2089839994 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3441a0660 con 0x7fc344109df0 2024-09-21T00:56:18.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.413+0000 7fc340ff9640 1 -- 172.21.15.1:0/2089839994 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33c00f6b0 con 0x7fc344109df0 2024-09-21T00:56:18.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.413+0000 7fc349e73640 1 -- 172.21.15.1:0/2089839994 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3441a6e80 con 0x7fc344109df0 2024-09-21T00:56:18.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.416+0000 7fc3503e7740 1 Processor -- start 2024-09-21T00:56:18.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.416+0000 7fc340ff9640 1 -- 172.21.15.1:0/2089839994 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7fc33c0051d0 con 0x7fc344109df0 2024-09-21T00:56:18.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.416+0000 7fc3503e7740 1 -- start start 2024-09-21T00:56:18.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.416+0000 7fc3503e7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c0d9efef60 0x55c0da2a4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:18.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.416+0000 7fc3503e7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0d9ed60a0 0x55c0da2a5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:18.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.416+0000 7fc3503e7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d9ede280 0x55c0da2a5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:18.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.416+0000 7fc3503e7740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c0da21cc10 con 0x55c0d9ede280 2024-09-21T00:56:18.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.416+0000 7fc3503e7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c0da20c040 con 0x55c0d9efef60 2024-09-21T00:56:18.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.416+0000 7fc3503e7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55c0da20fe50 con 0x55c0d9ed60a0 2024-09-21T00:56:18.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.416+0000 7fc342ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d9ede280 0x55c0da2a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:18.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.416+0000 7fc342ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d9ede280 0x55c0da2a5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47294/0 (socket says 172.21.15.1:47294) 2024-09-21T00:56:18.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.416+0000 7fc342ffd640 1 -- 172.21.15.1:0/1053802589 learned_addr learned my addr 172.21.15.1:0/1053802589 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:18.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.416+0000 7fc342ffd640 1 --2- 172.21.15.1:0/1053802589 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c0d9efef60 0x55c0da2a4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:18.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.416+0000 7fc3437fe640 1 --2- 172.21.15.1:0/1053802589 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0d9ed60a0 0x55c0da2a5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:18.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.417+0000 7fc342ffd640 1 -- 172.21.15.1:0/1053802589 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0d9ed60a0 msgr2=0x55c0da2a5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:18.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.417+0000 7fc342ffd640 1 --2- 172.21.15.1:0/1053802589 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0d9ed60a0 0x55c0da2a5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:18.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.417+0000 7fc342ffd640 1 -- 172.21.15.1:0/1053802589 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c0d9efef60 msgr2=0x55c0da2a4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:18.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.417+0000 7fc342ffd640 1 --2- 172.21.15.1:0/1053802589 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c0d9efef60 0x55c0da2a4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:18.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.417+0000 7fc342ffd640 1 -- 172.21.15.1:0/1053802589 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0d9f6a540 con 0x55c0d9ede280 2024-09-21T00:56:18.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.417+0000 7fc340ff9640 1 --2- 172.21.15.1:0/2089839994 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc32c0b65d0 0x7fc32c0b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:18.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.417+0000 7fc342ffd640 1 --2- 172.21.15.1:0/1053802589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d9ede280 0x55c0da2a5980 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc34406c9f0 tx=0x7fc338000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b17736d44d875a27 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:18.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.417+0000 7fc3437fe640 1 --2- 172.21.15.1:0/2089839994 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc32c0b65d0 0x7fc32c0b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:18.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.417+0000 7fc340ff9640 1 -- 172.21.15.1:0/2089839994 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fc33c0e7400 con 0x7fc344109df0 2024-09-21T00:56:18.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.417+0000 7fc329ffb640 1 -- 172.21.15.1:0/1053802589 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc338035070 con 0x55c0d9ede280 2024-09-21T00:56:18.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.417+0000 7fc329ffb640 1 -- 172.21.15.1:0/1053802589 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3380318e0 con 0x55c0d9ede280 2024-09-21T00:56:18.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.417+0000 7fc329ffb640 1 -- 172.21.15.1:0/1053802589 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc338003ac0 con 0x55c0d9ede280 2024-09-21T00:56:18.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.418+0000 7fc3503e7740 1 -- 172.21.15.1:0/1053802589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d9ede280 msgr2=0x55c0da2a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:18.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.418+0000 7fc3437fe640 1 --2- 172.21.15.1:0/2089839994 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc32c0b65d0 0x7fc32c0b8ae0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55c0da2a3b80 tx=0x7fc33400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:18.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.418+0000 7fc3503e7740 1 --2- 172.21.15.1:0/1053802589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d9ede280 0x55c0da2a5980 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc34406c9f0 tx=0x7fc338000bc0 comp rx=0 tx=0).stop 2024-09-21T00:56:18.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.418+0000 7fc3503e7740 1 -- 172.21.15.1:0/1053802589 shutdown_connections 2024-09-21T00:56:18.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.418+0000 7fc3503e7740 1 --2- 172.21.15.1:0/1053802589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d9ede280 0x55c0da2a5980 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:18.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.418+0000 7fc3503e7740 1 --2- 172.21.15.1:0/1053802589 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0d9ed60a0 0x55c0da2a5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:18.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.418+0000 7fc3503e7740 1 --2- 172.21.15.1:0/1053802589 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c0d9efef60 0x55c0da2a4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:18.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.418+0000 7fc3503e7740 1 -- 172.21.15.1:0/1053802589 >> 172.21.15.1:0/1053802589 conn(0x55c0d9ef3350 msgr2=0x55c0da2a2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:18.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.418+0000 7fc3503e7740 1 -- 172.21.15.1:0/1053802589 shutdown_connections 2024-09-21T00:56:18.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.418+0000 7fc3503e7740 1 -- 172.21.15.1:0/1053802589 wait complete. 2024-09-21T00:56:18.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.418+0000 7fc3503e7740 1 -- start start 2024-09-21T00:56:18.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.419+0000 7fc3503e7740 1 Processor -- start 2024-09-21T00:56:18.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.419+0000 7fc3503e7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d9ed60a0 0x55c0da2b0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:18.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.419+0000 7fc3503e7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0d9ede280 0x55c0da2b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:18.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.419+0000 7fc3503e7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c0d9efef60 0x55c0da2bc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:18.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.419+0000 7fc3503e7740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c0da06d5f0 con 0x55c0d9ed60a0 2024-09-21T00:56:18.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.419+0000 7fc3503e7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c0da1a7010 con 0x55c0d9efef60 2024-09-21T00:56:18.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.419+0000 7fc3503e7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55c0da2b3680 con 0x55c0d9ede280 2024-09-21T00:56:18.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.419+0000 7fc3503e7740 10 client.0 _ll_register_callbacks cb 0x55c0da206340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:56:18.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.419+0000 7fc3437fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d9ed60a0 0x55c0da2b0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:18.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.419+0000 7fc3437fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d9ed60a0 0x55c0da2b0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47306/0 (socket says 172.21.15.1:47306) 2024-09-21T00:56:18.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.419+0000 7fc3437fe640 1 -- 172.21.15.1:0/4275333455 learned_addr learned my addr 172.21.15.1:0/4275333455 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:18.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.419+0000 7fc343fff640 1 --2- 172.21.15.1:0/4275333455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c0d9efef60 0x55c0da2bc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:18.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.419+0000 7fc342ffd640 1 --2- 172.21.15.1:0/4275333455 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0d9ede280 0x55c0da2b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:18.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.419+0000 7fc3437fe640 1 -- 172.21.15.1:0/4275333455 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0d9ede280 msgr2=0x55c0da2b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:18.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.419+0000 7fc3437fe640 1 --2- 172.21.15.1:0/4275333455 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0d9ede280 0x55c0da2b0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:18.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.419+0000 7fc3437fe640 1 -- 172.21.15.1:0/4275333455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c0d9efef60 msgr2=0x55c0da2bc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:18.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.419+0000 7fc3437fe640 1 --2- 172.21.15.1:0/4275333455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c0d9efef60 0x55c0da2bc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:18.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.419+0000 7fc3437fe640 1 -- 172.21.15.1:0/4275333455 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0da1d4a00 con 0x55c0d9ed60a0 2024-09-21T00:56:18.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.419+0000 7fc343fff640 1 --2- 172.21.15.1:0/4275333455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c0d9efef60 0x55c0da2bc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:56:18.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.420+0000 7fc342ffd640 1 --2- 172.21.15.1:0/4275333455 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0d9ede280 0x55c0da2b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:56:18.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.420+0000 7fc3437fe640 1 --2- 172.21.15.1:0/4275333455 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d9ed60a0 0x55c0da2b0980 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc334010e30 tx=0x7fc3340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e117f0005375cb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:18.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.420+0000 7fc322ffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:56:18.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.420+0000 7fc322ffd640 1 -- 172.21.15.1:0/4275333455 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33400f8c0 con 0x55c0d9ed60a0 2024-09-21T00:56:18.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.420+0000 7fc322ffd640 1 -- 172.21.15.1:0/4275333455 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fc33400fa60 con 0x55c0d9ed60a0 2024-09-21T00:56:18.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.420+0000 7fc3503e7740 1 -- 172.21.15.1:0/4275333455 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3380318e0 con 0x55c0d9ed60a0 2024-09-21T00:56:18.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.420+0000 7fc322ffd640 1 -- 172.21.15.1:0/4275333455 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc33400fc60 con 0x55c0d9ed60a0 2024-09-21T00:56:18.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.420+0000 7fc3503e7740 10 client.15174 fetch_fsmap learned FSMap version 26 2024-09-21T00:56:18.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.420+0000 7fc3503e7740 1 -- 172.21.15.1:0/4275333455 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c0da2bf5e0 con 0x55c0d9ed60a0 2024-09-21T00:56:18.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.420+0000 7fc322ffd640 1 -- 172.21.15.1:0/4275333455 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3380318e0 con 0x55c0d9ed60a0 2024-09-21T00:56:18.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.420+0000 7fc322ffd640 1 -- 172.21.15.1:0/4275333455 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7fc334031420 con 0x55c0d9ed60a0 2024-09-21T00:56:18.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.421+0000 7fc3503e7740 10 client.15174 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T00:56:18.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.421+0000 7fc3503e7740 10 client.15174 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T00:56:18.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.421+0000 7fc3503e7740 20 client.15174 populate_metadata read hostname 'smithi001' 2024-09-21T00:56:18.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.421+0000 7fc3503e7740 1 --2- 172.21.15.1:0/4275333455 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x55c0d9ebd8e0 0x55c0da2c3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:18.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.421+0000 7fc3503e7740 4 client.15174 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:56:18.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.421+0000 7fc3503e7740 1 -- 172.21.15.1:0/4275333455 --> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c0da21eb60 con 0x55c0d9ebd8e0 2024-09-21T00:56:18.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.421+0000 7fc342ffd640 1 --2- 172.21.15.1:0/4275333455 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x55c0d9ebd8e0 0x55c0da2c3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:18.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.421+0000 7fc322ffd640 10 client.15174 ms_handle_connect on v2:172.21.15.193:6836/909252228 2024-09-21T00:56:18.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.421+0000 7fc342ffd640 1 --2- 172.21.15.1:0/4275333455 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x55c0d9ebd8e0 0x55c0da2c3090 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=31c284bbec2748af server_cookie=c0ebf11a009755e5 in_seq=0 out_seq=0 2024-09-21T00:56:18.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.422+0000 7fc322ffd640 1 -- 172.21.15.1:0/4275333455 <== mds.3 v2:172.21.15.193:6836/909252228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c0da21eb60 con 0x55c0d9ebd8e0 2024-09-21T00:56:18.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.422+0000 7fc322ffd640 10 client.15174 handle_command_reply: tid=0 2024-09-21T00:56:18.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.422+0000 7fc3503e7740 1 client.15174 shutdown 2024-09-21T00:56:18.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.422+0000 7fc3503e7740 1 -- 172.21.15.1:0/4275333455 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d9ed60a0 msgr2=0x55c0da2b0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:18.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.422+0000 7fc3503e7740 1 --2- 172.21.15.1:0/4275333455 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d9ed60a0 0x55c0da2b0980 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc334010e30 tx=0x7fc3340046c0 comp rx=0 tx=0).stop 2024-09-21T00:56:18.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.423+0000 7fc3503e7740 1 -- 172.21.15.1:0/4275333455 shutdown_connections 2024-09-21T00:56:18.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.423+0000 7fc3503e7740 1 --2- 172.21.15.1:0/4275333455 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x55c0d9ebd8e0 0x55c0da2c3090 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:18.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.423+0000 7fc3503e7740 1 --2- 172.21.15.1:0/4275333455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c0d9efef60 0x55c0da2bc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:18.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.423+0000 7fc3503e7740 1 --2- 172.21.15.1:0/4275333455 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0d9ede280 0x55c0da2b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:18.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.423+0000 7fc322ffd640 0 client.15174 ms_handle_reset on v2:172.21.15.193:6836/909252228 2024-09-21T00:56:18.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.423+0000 7fc3503e7740 1 --2- 172.21.15.1:0/4275333455 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d9ed60a0 0x55c0da2b0980 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:18.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.423+0000 7fc3503e7740 1 -- 172.21.15.1:0/4275333455 >> 172.21.15.1:0/4275333455 conn(0x55c0d9ef3350 msgr2=0x55c0da2a8090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:18.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.423+0000 7fc3503e7740 1 -- 172.21.15.1:0/4275333455 shutdown_connections 2024-09-21T00:56:18.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.423+0000 7fc3503e7740 1 -- 172.21.15.1:0/4275333455 wait complete. 2024-09-21T00:56:18.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.423+0000 7fc3503e7740 20 client.15174 trim_cache size 0 max 16384 2024-09-21T00:56:18.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.441+0000 7fc3503e7740 1 Processor -- start 2024-09-21T00:56:18.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.441+0000 7fc3503e7740 1 -- start start 2024-09-21T00:56:18.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.441+0000 7fc3503e7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c0d9ed60a0 0x55c0da2bc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:18.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.441+0000 7fc3503e7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d9ede280 0x55c0da2bce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:18.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.441+0000 7fc3503e7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0d9efef60 0x55c0da2ab930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:18.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.441+0000 7fc3503e7740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c0da2c13d0 con 0x55c0d9ede280 2024-09-21T00:56:18.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.441+0000 7fc3503e7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c0da2c1aa0 con 0x55c0d9ed60a0 2024-09-21T00:56:18.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.441+0000 7fc3503e7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55c0da2c2170 con 0x55c0d9efef60 2024-09-21T00:56:18.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.441+0000 7fc342ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d9ede280 0x55c0da2bce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:18.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.441+0000 7fc342ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d9ede280 0x55c0da2bce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47316/0 (socket says 172.21.15.1:47316) 2024-09-21T00:56:18.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.441+0000 7fc342ffd640 1 -- 172.21.15.1:0/1003395282 learned_addr learned my addr 172.21.15.1:0/1003395282 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:18.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.442+0000 7fc343fff640 1 --2- 172.21.15.1:0/1003395282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0d9efef60 0x55c0da2ab930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:18.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.442+0000 7fc342ffd640 1 -- 172.21.15.1:0/1003395282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0d9efef60 msgr2=0x55c0da2ab930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:18.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.442+0000 7fc3437fe640 1 --2- 172.21.15.1:0/1003395282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c0d9ed60a0 0x55c0da2bc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:18.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.442+0000 7fc342ffd640 1 --2- 172.21.15.1:0/1003395282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0d9efef60 0x55c0da2ab930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:18.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.442+0000 7fc342ffd640 1 -- 172.21.15.1:0/1003395282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c0d9ed60a0 msgr2=0x55c0da2bc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:18.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.442+0000 7fc342ffd640 1 --2- 172.21.15.1:0/1003395282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c0d9ed60a0 0x55c0da2bc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:18.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.442+0000 7fc342ffd640 1 -- 172.21.15.1:0/1003395282 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0da2b1620 con 0x55c0d9ede280 2024-09-21T00:56:18.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.442+0000 7fc342ffd640 1 --2- 172.21.15.1:0/1003395282 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d9ede280 0x55c0da2bce50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc33802a930 tx=0x7fc338031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d28313926ceb0845 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:18.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.442+0000 7fc3297fa640 1 -- 172.21.15.1:0/1003395282 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc338035040 con 0x55c0d9ede280 2024-09-21T00:56:18.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.442+0000 7fc3297fa640 1 -- 172.21.15.1:0/1003395282 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc338054030 con 0x55c0d9ede280 2024-09-21T00:56:18.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.442+0000 7fc3297fa640 1 -- 172.21.15.1:0/1003395282 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3380049c0 con 0x55c0d9ede280 2024-09-21T00:56:18.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.443+0000 7fc3503e7740 1 -- 172.21.15.1:0/1003395282 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d9ede280 msgr2=0x55c0da2bce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:18.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.443+0000 7fc3503e7740 1 --2- 172.21.15.1:0/1003395282 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d9ede280 0x55c0da2bce50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc33802a930 tx=0x7fc338031400 comp rx=0 tx=0).stop 2024-09-21T00:56:18.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.443+0000 7fc3503e7740 1 -- 172.21.15.1:0/1003395282 shutdown_connections 2024-09-21T00:56:18.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.443+0000 7fc3503e7740 1 --2- 172.21.15.1:0/1003395282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0d9efef60 0x55c0da2ab930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:18.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.443+0000 7fc3503e7740 1 --2- 172.21.15.1:0/1003395282 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d9ede280 0x55c0da2bce50 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:18.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.443+0000 7fc3503e7740 1 --2- 172.21.15.1:0/1003395282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c0d9ed60a0 0x55c0da2bc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:18.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.443+0000 7fc3503e7740 1 -- 172.21.15.1:0/1003395282 >> 172.21.15.1:0/1003395282 conn(0x55c0d9ef3350 msgr2=0x55c0da2b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:18.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.443+0000 7fc3503e7740 1 -- 172.21.15.1:0/1003395282 shutdown_connections 2024-09-21T00:56:18.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.443+0000 7fc3503e7740 1 -- 172.21.15.1:0/1003395282 wait complete. 2024-09-21T00:56:18.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.443+0000 7fc3503e7740 1 -- start start 2024-09-21T00:56:18.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.444+0000 7fc3503e7740 1 Processor -- start 2024-09-21T00:56:18.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.444+0000 7fc3503e7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d9ed60a0 0x55c0da2cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:18.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.444+0000 7fc3503e7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0d9ede280 0x55c0da2cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:18.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.444+0000 7fc3503e7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c0d9efef60 0x55c0da2c4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:18.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.444+0000 7fc3503e7740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c0da2c2f10 con 0x55c0d9ed60a0 2024-09-21T00:56:18.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.444+0000 7fc3503e7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c0da2c2840 con 0x55c0d9efef60 2024-09-21T00:56:18.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.444+0000 7fc3503e7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55c0da2c35e0 con 0x55c0d9ede280 2024-09-21T00:56:18.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.444+0000 7fc3503e7740 10 client.0 _ll_register_callbacks cb 0x7fc33400a970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:56:18.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.444+0000 7fc3437fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d9ed60a0 0x55c0da2cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:18.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.444+0000 7fc3437fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d9ed60a0 0x55c0da2cb6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47330/0 (socket says 172.21.15.1:47330) 2024-09-21T00:56:18.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.444+0000 7fc3437fe640 1 -- 172.21.15.1:0/118861011 learned_addr learned my addr 172.21.15.1:0/118861011 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:18.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.444+0000 7fc343fff640 1 --2- 172.21.15.1:0/118861011 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c0d9efef60 0x55c0da2c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:18.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.444+0000 7fc342ffd640 1 --2- 172.21.15.1:0/118861011 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0d9ede280 0x55c0da2cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:18.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.444+0000 7fc3437fe640 1 -- 172.21.15.1:0/118861011 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0d9ede280 msgr2=0x55c0da2cbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:18.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.444+0000 7fc3437fe640 1 --2- 172.21.15.1:0/118861011 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0d9ede280 0x55c0da2cbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:18.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.445+0000 7fc3437fe640 1 -- 172.21.15.1:0/118861011 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c0d9efef60 msgr2=0x55c0da2c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:18.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.445+0000 7fc3437fe640 1 --2- 172.21.15.1:0/118861011 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c0d9efef60 0x55c0da2c4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:18.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.445+0000 7fc3437fe640 1 -- 172.21.15.1:0/118861011 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0da2c53e0 con 0x55c0d9ed60a0 2024-09-21T00:56:18.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.445+0000 7fc3437fe640 1 --2- 172.21.15.1:0/118861011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d9ed60a0 0x55c0da2cb6b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc334010b80 tx=0x7fc33400fed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2f2c70b960bc448 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:18.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.445+0000 7fc322ffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:56:18.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.445+0000 7fc322ffd640 1 -- 172.21.15.1:0/118861011 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc334031620 con 0x55c0d9ed60a0 2024-09-21T00:56:18.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.445+0000 7fc3503e7740 1 -- 172.21.15.1:0/118861011 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc338054030 con 0x55c0d9ed60a0 2024-09-21T00:56:18.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.445+0000 7fc322ffd640 1 -- 172.21.15.1:0/118861011 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fc33400f790 con 0x55c0d9ed60a0 2024-09-21T00:56:18.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.445+0000 7fc322ffd640 1 -- 172.21.15.1:0/118861011 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc33400f990 con 0x55c0d9ed60a0 2024-09-21T00:56:18.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.445+0000 7fc3503e7740 10 client.15180 fetch_fsmap learned FSMap version 26 2024-09-21T00:56:18.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.445+0000 7fc3503e7740 1 -- 172.21.15.1:0/118861011 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c0da2cae30 con 0x55c0d9ed60a0 2024-09-21T00:56:18.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.445+0000 7fc322ffd640 1 -- 172.21.15.1:0/118861011 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc338054030 con 0x55c0d9ed60a0 2024-09-21T00:56:18.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.446+0000 7fc322ffd640 1 -- 172.21.15.1:0/118861011 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7fc334004b20 con 0x55c0d9ed60a0 2024-09-21T00:56:18.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.446+0000 7fc3503e7740 10 client.15180 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T00:56:18.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.446+0000 7fc3503e7740 10 client.15180 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T00:56:18.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.446+0000 7fc3503e7740 20 client.15180 populate_metadata read hostname 'smithi001' 2024-09-21T00:56:18.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.446+0000 7fc3503e7740 1 --2- 172.21.15.1:0/118861011 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x55c0d9e92c90 0x55c0da331960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:18.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.446+0000 7fc3503e7740 4 client.15180 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T00:56:18.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.446+0000 7fc3503e7740 1 -- 172.21.15.1:0/118861011 --> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] -- command(tid 0: {"prefix": "status"}) -- 0x55c0da2c1220 con 0x55c0d9e92c90 2024-09-21T00:56:18.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.446+0000 7fc342ffd640 1 --2- 172.21.15.1:0/118861011 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x55c0d9e92c90 0x55c0da331960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:18.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.446+0000 7fc342ffd640 1 --2- 172.21.15.1:0/118861011 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x55c0d9e92c90 0x55c0da331960 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=abb4399edb9a52d server_cookie=dcef01ef2b1790d8 in_seq=0 out_seq=0 2024-09-21T00:56:18.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.446+0000 7fc322ffd640 10 client.15180 ms_handle_connect on v2:172.21.15.193:6836/909252228 2024-09-21T00:56:18.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.447+0000 7fc322ffd640 1 -- 172.21.15.1:0/118861011 <== mds.3 v2:172.21.15.193:6836/909252228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55c0da2c1220 con 0x55c0d9e92c90 2024-09-21T00:56:18.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.447+0000 7fc322ffd640 10 client.15180 handle_command_reply: tid=0 2024-09-21T00:56:18.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.447+0000 7fc3503e7740 1 client.15180 shutdown 2024-09-21T00:56:18.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.447+0000 7fc3503e7740 1 -- 172.21.15.1:0/118861011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d9ed60a0 msgr2=0x55c0da2cb6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:18.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.447+0000 7fc3503e7740 1 --2- 172.21.15.1:0/118861011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d9ed60a0 0x55c0da2cb6b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc334010b80 tx=0x7fc33400fed0 comp rx=0 tx=0).stop 2024-09-21T00:56:18.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.447+0000 7fc3503e7740 1 -- 172.21.15.1:0/118861011 shutdown_connections 2024-09-21T00:56:18.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.447+0000 7fc3503e7740 1 --2- 172.21.15.1:0/118861011 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x55c0d9e92c90 0x55c0da331960 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:18.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.447+0000 7fc3503e7740 1 --2- 172.21.15.1:0/118861011 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c0d9efef60 0x55c0da2c4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:18.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.447+0000 7fc3503e7740 1 --2- 172.21.15.1:0/118861011 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0d9ede280 0x55c0da2cbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:18.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.447+0000 7fc322ffd640 0 client.15180 ms_handle_reset on v2:172.21.15.193:6836/909252228 2024-09-21T00:56:18.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.447+0000 7fc3503e7740 1 --2- 172.21.15.1:0/118861011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d9ed60a0 0x55c0da2cb6b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:18.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.447+0000 7fc3503e7740 1 -- 172.21.15.1:0/118861011 >> 172.21.15.1:0/118861011 conn(0x55c0d9ef3350 msgr2=0x55c0da2ab930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:18.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.447+0000 7fc3503e7740 1 -- 172.21.15.1:0/118861011 shutdown_connections 2024-09-21T00:56:18.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.447+0000 7fc3503e7740 1 -- 172.21.15.1:0/118861011 wait complete. 2024-09-21T00:56:18.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.447+0000 7fc3503e7740 20 client.15180 trim_cache size 0 max 16384 2024-09-21T00:56:18.453 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T00:56:18.453 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "d3972c20-77b2-11ef-baf5-efdc52797490", 2024-09-21T00:56:18.453 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 3, 2024-09-21T00:56:18.454 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24622, 2024-09-21T00:56:18.454 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-21T00:56:18.454 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-21T00:56:18.454 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-21T00:56:18.454 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 70.271175274000001, 2024-09-21T00:56:18.454 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 26, 2024-09-21T00:56:18.454 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 75, 2024-09-21T00:56:18.454 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 73, 2024-09-21T00:56:18.454 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 104.234520432 2024-09-21T00:56:18.454 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T00:56:18.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.448+0000 7fc349e73640 1 -- 172.21.15.1:0/2089839994 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc32c0b65d0 msgr2=0x7fc32c0b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:18.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.448+0000 7fc349e73640 1 --2- 172.21.15.1:0/2089839994 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc32c0b65d0 0x7fc32c0b8ae0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55c0da2a3b80 tx=0x7fc33400a2d0 comp rx=0 tx=0).stop 2024-09-21T00:56:18.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.448+0000 7fc349e73640 1 -- 172.21.15.1:0/2089839994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc344109df0 msgr2=0x7fc34419fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:18.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.448+0000 7fc349e73640 1 --2- 172.21.15.1:0/2089839994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc344109df0 0x7fc34419fd00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc33c00cad0 tx=0x7fc33c00ced0 comp rx=0 tx=0).stop 2024-09-21T00:56:18.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.448+0000 7fc349e73640 1 -- 172.21.15.1:0/2089839994 shutdown_connections 2024-09-21T00:56:18.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.448+0000 7fc349e73640 1 --2- 172.21.15.1:0/2089839994 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc32c0b65d0 0x7fc32c0b8ae0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:18.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.448+0000 7fc349e73640 1 --2- 172.21.15.1:0/2089839994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc344109df0 0x7fc34419fd00 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:18.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.448+0000 7fc349e73640 1 --2- 172.21.15.1:0/2089839994 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc3441094a0 0x7fc34419aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:18.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.448+0000 7fc349e73640 1 --2- 172.21.15.1:0/2089839994 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc344103b60 0x7fc34419a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:18.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.448+0000 7fc349e73640 1 -- 172.21.15.1:0/2089839994 >> 172.21.15.1:0/2089839994 conn(0x7fc34407b850 msgr2=0x7fc344107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:18.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.448+0000 7fc349e73640 1 -- 172.21.15.1:0/2089839994 shutdown_connections 2024-09-21T00:56:18.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:18.448+0000 7fc349e73640 1 -- 172.21.15.1:0/2089839994 wait complete. 2024-09-21T00:56:19.145 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.h status 2024-09-21T00:56:19.401 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:19.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.920+0000 7fdaaa8a7640 1 -- 172.21.15.1:0/3462870106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdaa4109e00 msgr2=0x7fdaa4110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:19.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.920+0000 7fdaaa8a7640 1 --2- 172.21.15.1:0/3462870106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdaa4109e00 0x7fdaa4110630 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fda9c009ca0 tx=0x7fda9c02a8c0 comp rx=0 tx=0).stop 2024-09-21T00:56:19.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.921+0000 7fdaaa8a7640 1 -- 172.21.15.1:0/3462870106 shutdown_connections 2024-09-21T00:56:19.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.921+0000 7fdaaa8a7640 1 --2- 172.21.15.1:0/3462870106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdaa4109e00 0x7fdaa4110630 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:19.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.921+0000 7fdaaa8a7640 1 --2- 172.21.15.1:0/3462870106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdaa41094b0 0x7fdaa41098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:19.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.921+0000 7fdaaa8a7640 1 --2- 172.21.15.1:0/3462870106 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdaa4103bc0 0x7fdaa4103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:19.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.921+0000 7fdaaa8a7640 1 -- 172.21.15.1:0/3462870106 >> 172.21.15.1:0/3462870106 conn(0x7fdaa407b910 msgr2=0x7fdaa407bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:19.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.921+0000 7fdaaa8a7640 1 -- 172.21.15.1:0/3462870106 shutdown_connections 2024-09-21T00:56:19.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.921+0000 7fdaaa8a7640 1 -- 172.21.15.1:0/3462870106 wait complete. 2024-09-21T00:56:19.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.921+0000 7fdaaa8a7640 1 Processor -- start 2024-09-21T00:56:19.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.921+0000 7fdaaa8a7640 1 -- start start 2024-09-21T00:56:19.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.922+0000 7fdaaa8a7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdaa4103bc0 0x7fdaa4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:19.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.922+0000 7fdaaa8a7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdaa41094b0 0x7fdaa4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:19.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.922+0000 7fdaaa8a7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdaa4109e00 0x7fdaa4076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:19.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.922+0000 7fdaaa8a7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa4113ac0 con 0x7fdaa4103bc0 2024-09-21T00:56:19.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.922+0000 7fdaaa8a7640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa4113940 con 0x7fdaa4109e00 2024-09-21T00:56:19.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.922+0000 7fdaaa8a7640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa4113c40 con 0x7fdaa41094b0 2024-09-21T00:56:19.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.922+0000 7fdaa3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdaa4103bc0 0x7fdaa4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:19.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.922+0000 7fdaa3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdaa4103bc0 0x7fdaa4075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51246/0 (socket says 172.21.15.1:51246) 2024-09-21T00:56:19.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.922+0000 7fdaa3fff640 1 -- 172.21.15.1:0/1781550359 learned_addr learned my addr 172.21.15.1:0/1781550359 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:19.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.922+0000 7fdaa37fe640 1 --2- 172.21.15.1:0/1781550359 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdaa41094b0 0x7fdaa4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:19.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.922+0000 7fdaa8e44640 1 --2- 172.21.15.1:0/1781550359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdaa4109e00 0x7fdaa4076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:19.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.922+0000 7fdaa3fff640 1 -- 172.21.15.1:0/1781550359 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdaa41094b0 msgr2=0x7fdaa4075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:19.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.922+0000 7fdaa3fff640 1 --2- 172.21.15.1:0/1781550359 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdaa41094b0 0x7fdaa4075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:19.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.922+0000 7fdaa3fff640 1 -- 172.21.15.1:0/1781550359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdaa4109e00 msgr2=0x7fdaa4076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:19.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.922+0000 7fdaa3fff640 1 --2- 172.21.15.1:0/1781550359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdaa4109e00 0x7fdaa4076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:19.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.922+0000 7fdaa3fff640 1 -- 172.21.15.1:0/1781550359 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa41a86f0 con 0x7fdaa4103bc0 2024-09-21T00:56:19.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.923+0000 7fdaa3fff640 1 --2- 172.21.15.1:0/1781550359 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdaa4103bc0 0x7fdaa4075710 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fda9400d950 tx=0x7fda9400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:19.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.923+0000 7fdaa17fa640 1 -- 172.21.15.1:0/1781550359 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda94017030 con 0x7fdaa4103bc0 2024-09-21T00:56:19.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.923+0000 7fdaaa8a7640 1 -- 172.21.15.1:0/1781550359 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaa41a89e0 con 0x7fdaa4103bc0 2024-09-21T00:56:19.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.923+0000 7fdaa17fa640 1 -- 172.21.15.1:0/1781550359 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda94004020 con 0x7fdaa4103bc0 2024-09-21T00:56:19.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.923+0000 7fdaa17fa640 1 -- 172.21.15.1:0/1781550359 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda940047a0 con 0x7fdaa4103bc0 2024-09-21T00:56:19.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.923+0000 7fdaaa8a7640 1 -- 172.21.15.1:0/1781550359 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaa41a8f20 con 0x7fdaa4103bc0 2024-09-21T00:56:19.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.926+0000 7fdab0e1b740 1 Processor -- start 2024-09-21T00:56:19.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.926+0000 7fdab0e1b740 1 -- start start 2024-09-21T00:56:19.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.926+0000 7fdaa17fa640 1 -- 172.21.15.1:0/1781550359 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7fda94004940 con 0x7fdaa4103bc0 2024-09-21T00:56:19.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.926+0000 7fdab0e1b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a35e10f60 0x563a361b6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:19.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.926+0000 7fdab0e1b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a35de80a0 0x563a361b7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:19.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.926+0000 7fdab0e1b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563a35df0280 0x563a361b7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:19.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.926+0000 7fdab0e1b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563a3612ec10 con 0x563a35df0280 2024-09-21T00:56:19.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.926+0000 7fdab0e1b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563a3611e040 con 0x563a35e10f60 2024-09-21T00:56:19.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.926+0000 7fdab0e1b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563a36121e50 con 0x563a35de80a0 2024-09-21T00:56:19.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.926+0000 7fdaa37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563a35df0280 0x563a361b7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:19.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.927+0000 7fdaa37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563a35df0280 0x563a361b7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51252/0 (socket says 172.21.15.1:51252) 2024-09-21T00:56:19.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.927+0000 7fdaa8e44640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a35e10f60 0x563a361b6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:19.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.927+0000 7fdaa37fe640 1 -- 172.21.15.1:0/3561920248 learned_addr learned my addr 172.21.15.1:0/3561920248 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:19.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.927+0000 7fdaa3fff640 1 --2- 172.21.15.1:0/3561920248 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a35de80a0 0x563a361b7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:19.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.927+0000 7fdaa8e44640 1 -- 172.21.15.1:0/3561920248 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a35de80a0 msgr2=0x563a361b7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:19.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.927+0000 7fdaa8e44640 1 --2- 172.21.15.1:0/3561920248 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a35de80a0 0x563a361b7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:19.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.927+0000 7fdaa8e44640 1 -- 172.21.15.1:0/3561920248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563a35df0280 msgr2=0x563a361b7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:19.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.927+0000 7fdaa8e44640 1 --2- 172.21.15.1:0/3561920248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563a35df0280 0x563a361b7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:19.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.927+0000 7fdaa8e44640 1 -- 172.21.15.1:0/3561920248 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a35e7c540 con 0x563a35e10f60 2024-09-21T00:56:19.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.927+0000 7fdaa3fff640 1 --2- 172.21.15.1:0/3561920248 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a35de80a0 0x563a361b7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:56:19.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.927+0000 7fdaa37fe640 1 --2- 172.21.15.1:0/3561920248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563a35df0280 0x563a361b7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:56:19.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.927+0000 7fdaa17fa640 1 --2- 172.21.15.1:0/1781550359 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fda8c0b65a0 0x7fda8c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:19.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.927+0000 7fdaa8e44640 1 --2- 172.21.15.1:0/3561920248 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a35e10f60 0x563a361b6f00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fda9c005e30 tx=0x7fda9c0098b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de5f005664a5d117 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:19.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.927+0000 7fdaa3fff640 1 --2- 172.21.15.1:0/1781550359 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fda8c0b65a0 0x7fda8c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:19.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.928+0000 7fdaa17fa640 1 -- 172.21.15.1:0/1781550359 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fda940e6f10 con 0x7fdaa4103bc0 2024-09-21T00:56:19.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.928+0000 7fda8a7fc640 1 -- 172.21.15.1:0/3561920248 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9c031db0 con 0x563a35e10f60 2024-09-21T00:56:19.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.928+0000 7fda8a7fc640 1 -- 172.21.15.1:0/3561920248 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda9c036030 con 0x563a35e10f60 2024-09-21T00:56:19.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.928+0000 7fda8a7fc640 1 -- 172.21.15.1:0/3561920248 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9c0042a0 con 0x563a35e10f60 2024-09-21T00:56:19.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.929+0000 7fdab0e1b740 1 -- 172.21.15.1:0/3561920248 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a35e10f60 msgr2=0x563a361b6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:19.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.929+0000 7fdaa3fff640 1 --2- 172.21.15.1:0/1781550359 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fda8c0b65a0 0x7fda8c0b8ab0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x563a361b5b80 tx=0x7fda940e71d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:19.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.929+0000 7fdab0e1b740 1 --2- 172.21.15.1:0/3561920248 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a35e10f60 0x563a361b6f00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fda9c005e30 tx=0x7fda9c0098b0 comp rx=0 tx=0).stop 2024-09-21T00:56:19.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.929+0000 7fdab0e1b740 1 -- 172.21.15.1:0/3561920248 shutdown_connections 2024-09-21T00:56:19.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.929+0000 7fdab0e1b740 1 --2- 172.21.15.1:0/3561920248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563a35df0280 0x563a361b7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:19.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.929+0000 7fdab0e1b740 1 --2- 172.21.15.1:0/3561920248 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a35de80a0 0x563a361b7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:19.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.929+0000 7fdab0e1b740 1 --2- 172.21.15.1:0/3561920248 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a35e10f60 0x563a361b6f00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:19.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.929+0000 7fdab0e1b740 1 -- 172.21.15.1:0/3561920248 >> 172.21.15.1:0/3561920248 conn(0x563a35e05350 msgr2=0x563a361b4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:19.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.929+0000 7fdab0e1b740 1 -- 172.21.15.1:0/3561920248 shutdown_connections 2024-09-21T00:56:19.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.929+0000 7fdab0e1b740 1 -- 172.21.15.1:0/3561920248 wait complete. 2024-09-21T00:56:19.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.929+0000 7fdab0e1b740 1 -- start start 2024-09-21T00:56:19.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.929+0000 7fdab0e1b740 1 Processor -- start 2024-09-21T00:56:19.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.930+0000 7fdab0e1b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a35de80a0 0x563a361c29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:19.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.930+0000 7fdab0e1b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563a35df0280 0x563a361c2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:19.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.930+0000 7fdab0e1b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a35e10f60 0x563a361ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:19.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.930+0000 7fdab0e1b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563a35f7f5f0 con 0x563a35df0280 2024-09-21T00:56:19.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.930+0000 7fdab0e1b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563a360b9010 con 0x563a35de80a0 2024-09-21T00:56:19.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.930+0000 7fdab0e1b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563a361c5500 con 0x563a35e10f60 2024-09-21T00:56:19.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.930+0000 7fdab0e1b740 10 client.0 _ll_register_callbacks cb 0x563a36118340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:56:19.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.930+0000 7fdaa37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563a35df0280 0x563a361c2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:19.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.930+0000 7fdaa8e44640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a35de80a0 0x563a361c29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:19.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.930+0000 7fdaa8e44640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a35de80a0 0x563a361c29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:56582/0 (socket says 172.21.15.1:56582) 2024-09-21T00:56:19.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.930+0000 7fdaa8e44640 1 -- 172.21.15.1:0/2323053966 learned_addr learned my addr 172.21.15.1:0/2323053966 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:19.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.930+0000 7fdaa8e44640 1 --2- 172.21.15.1:0/2323053966 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a35e10f60 0x563a361ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:19.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.930+0000 7fdaa37fe640 1 -- 172.21.15.1:0/2323053966 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a35e10f60 msgr2=0x563a361ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:19.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.930+0000 7fdaa37fe640 1 --2- 172.21.15.1:0/2323053966 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a35e10f60 0x563a361ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:19.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.930+0000 7fdaa37fe640 1 -- 172.21.15.1:0/2323053966 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a35de80a0 msgr2=0x563a361c29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:19.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.930+0000 7fdaa37fe640 1 --2- 172.21.15.1:0/2323053966 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a35de80a0 0x563a361c29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:19.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.930+0000 7fdaa37fe640 1 -- 172.21.15.1:0/2323053966 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a360e6a00 con 0x563a35df0280 2024-09-21T00:56:19.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.930+0000 7fdaa8e44640 1 --2- 172.21.15.1:0/2323053966 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a35de80a0 0x563a361c29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:56:19.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.931+0000 7fdaa37fe640 1 --2- 172.21.15.1:0/2323053966 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563a35df0280 0x563a361c2f00 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fda98005d00 tx=0x7fda9800bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=695a2217138153f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:19.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.931+0000 7fda837fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:56:19.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.931+0000 7fda837fe640 1 -- 172.21.15.1:0/2323053966 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda98004020 con 0x563a35df0280 2024-09-21T00:56:19.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.931+0000 7fda837fe640 1 -- 172.21.15.1:0/2323053966 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fda980041c0 con 0x563a35df0280 2024-09-21T00:56:19.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.931+0000 7fdab0e1b740 1 -- 172.21.15.1:0/2323053966 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda9c036030 con 0x563a35df0280 2024-09-21T00:56:19.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.931+0000 7fda837fe640 1 -- 172.21.15.1:0/2323053966 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fda980043c0 con 0x563a35df0280 2024-09-21T00:56:19.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.931+0000 7fdab0e1b740 10 client.15192 fetch_fsmap learned FSMap version 26 2024-09-21T00:56:19.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.931+0000 7fdab0e1b740 1 -- 172.21.15.1:0/2323053966 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563a361d1450 con 0x563a35df0280 2024-09-21T00:56:19.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.931+0000 7fda837fe640 1 -- 172.21.15.1:0/2323053966 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda9c036030 con 0x563a35df0280 2024-09-21T00:56:19.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.931+0000 7fda837fe640 1 -- 172.21.15.1:0/2323053966 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7fda98003920 con 0x563a35df0280 2024-09-21T00:56:19.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.932+0000 7fdab0e1b740 10 client.15192 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T00:56:19.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.932+0000 7fdab0e1b740 10 client.15192 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T00:56:19.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.932+0000 7fdab0e1b740 20 client.15192 populate_metadata read hostname 'smithi001' 2024-09-21T00:56:19.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.932+0000 7fdab0e1b740 1 --2- 172.21.15.1:0/2323053966 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x563a35dcf8e0 0x563a361d4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:19.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.932+0000 7fdab0e1b740 4 client.15192 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:56:19.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.932+0000 7fdab0e1b740 1 -- 172.21.15.1:0/2323053966 --> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a36130b60 con 0x563a35dcf8e0 2024-09-21T00:56:19.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.932+0000 7fdaa8e44640 1 --2- 172.21.15.1:0/2323053966 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x563a35dcf8e0 0x563a361d4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:19.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.932+0000 7fdaa8e44640 1 --2- 172.21.15.1:0/2323053966 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x563a35dcf8e0 0x563a361d4ef0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d14329dddbda1b50 server_cookie=32a568e3487d7383 in_seq=0 out_seq=0 2024-09-21T00:56:19.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.932+0000 7fda837fe640 10 client.15192 ms_handle_connect on v2:172.21.15.42:6836/2395608508 2024-09-21T00:56:19.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.933+0000 7fda837fe640 1 -- 172.21.15.1:0/2323053966 <== mds.2 v2:172.21.15.42:6836/2395608508 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563a36130b60 con 0x563a35dcf8e0 2024-09-21T00:56:19.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.933+0000 7fda837fe640 10 client.15192 handle_command_reply: tid=0 2024-09-21T00:56:19.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.933+0000 7fdab0e1b740 1 client.15192 shutdown 2024-09-21T00:56:19.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.934+0000 7fdab0e1b740 1 -- 172.21.15.1:0/2323053966 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563a35df0280 msgr2=0x563a361c2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:19.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.934+0000 7fdab0e1b740 1 --2- 172.21.15.1:0/2323053966 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563a35df0280 0x563a361c2f00 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fda98005d00 tx=0x7fda9800bf90 comp rx=0 tx=0).stop 2024-09-21T00:56:19.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.934+0000 7fdab0e1b740 1 -- 172.21.15.1:0/2323053966 shutdown_connections 2024-09-21T00:56:19.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.934+0000 7fdab0e1b740 1 --2- 172.21.15.1:0/2323053966 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x563a35dcf8e0 0x563a361d4ef0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:19.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.934+0000 7fdab0e1b740 1 --2- 172.21.15.1:0/2323053966 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a35e10f60 0x563a361ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:19.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.934+0000 7fdab0e1b740 1 --2- 172.21.15.1:0/2323053966 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563a35df0280 0x563a361c2f00 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:19.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.934+0000 7fdab0e1b740 1 --2- 172.21.15.1:0/2323053966 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a35de80a0 0x563a361c29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:19.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.934+0000 7fdab0e1b740 1 -- 172.21.15.1:0/2323053966 >> 172.21.15.1:0/2323053966 conn(0x563a35e05350 msgr2=0x563a361ba090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:19.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.934+0000 7fda837fe640 0 client.15192 ms_handle_reset on v2:172.21.15.42:6836/2395608508 2024-09-21T00:56:19.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.934+0000 7fdab0e1b740 1 -- 172.21.15.1:0/2323053966 shutdown_connections 2024-09-21T00:56:19.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.934+0000 7fdab0e1b740 1 -- 172.21.15.1:0/2323053966 wait complete. 2024-09-21T00:56:19.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.934+0000 7fdab0e1b740 20 client.15192 trim_cache size 0 max 16384 2024-09-21T00:56:19.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.952+0000 7fdab0e1b740 1 Processor -- start 2024-09-21T00:56:19.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.952+0000 7fdab0e1b740 1 -- start start 2024-09-21T00:56:19.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.952+0000 7fdab0e1b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a35de80a0 0x563a361d3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:19.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.952+0000 7fdab0e1b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563a35df0280 0x563a361ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:19.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.952+0000 7fdab0e1b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a35e10f60 0x563a361bd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:19.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.952+0000 7fdab0e1b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563a361d3230 con 0x563a35df0280 2024-09-21T00:56:19.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.952+0000 7fdab0e1b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563a361d3900 con 0x563a35e10f60 2024-09-21T00:56:19.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.952+0000 7fdab0e1b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563a361d3fd0 con 0x563a35de80a0 2024-09-21T00:56:19.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.952+0000 7fdaa37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563a35df0280 0x563a361ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:19.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.952+0000 7fdaa37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563a35df0280 0x563a361ce9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51270/0 (socket says 172.21.15.1:51270) 2024-09-21T00:56:19.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.952+0000 7fdaa37fe640 1 -- 172.21.15.1:0/1884213448 learned_addr learned my addr 172.21.15.1:0/1884213448 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:19.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.952+0000 7fdaa8e44640 1 --2- 172.21.15.1:0/1884213448 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a35de80a0 0x563a361d3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:19.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.953+0000 7fdaa8e44640 1 --2- 172.21.15.1:0/1884213448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a35e10f60 0x563a361bd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:19.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.953+0000 7fdaa37fe640 1 -- 172.21.15.1:0/1884213448 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a35de80a0 msgr2=0x563a361d3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:19.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.953+0000 7fdaa37fe640 1 --2- 172.21.15.1:0/1884213448 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a35de80a0 0x563a361d3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:19.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.953+0000 7fdaa37fe640 1 -- 172.21.15.1:0/1884213448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a35e10f60 msgr2=0x563a361bd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:19.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.953+0000 7fdaa37fe640 1 --2- 172.21.15.1:0/1884213448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a35e10f60 0x563a361bd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:19.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.953+0000 7fdaa37fe640 1 -- 172.21.15.1:0/1884213448 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a361b9420 con 0x563a35df0280 2024-09-21T00:56:19.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.953+0000 7fdaa37fe640 1 --2- 172.21.15.1:0/1884213448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563a35df0280 0x563a361ce9a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fda9800ba30 tx=0x7fda98005b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1eb6a5e25b93c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:19.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.953+0000 7fda89ffb640 1 -- 172.21.15.1:0/1884213448 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9802b070 con 0x563a35df0280 2024-09-21T00:56:19.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.953+0000 7fda89ffb640 1 -- 172.21.15.1:0/1884213448 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda98003aa0 con 0x563a35df0280 2024-09-21T00:56:19.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.953+0000 7fda89ffb640 1 -- 172.21.15.1:0/1884213448 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda98010700 con 0x563a35df0280 2024-09-21T00:56:19.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.954+0000 7fdab0e1b740 1 -- 172.21.15.1:0/1884213448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563a35df0280 msgr2=0x563a361ce9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:19.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.954+0000 7fdab0e1b740 1 --2- 172.21.15.1:0/1884213448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563a35df0280 0x563a361ce9a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fda9800ba30 tx=0x7fda98005b90 comp rx=0 tx=0).stop 2024-09-21T00:56:19.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.954+0000 7fdab0e1b740 1 -- 172.21.15.1:0/1884213448 shutdown_connections 2024-09-21T00:56:19.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.954+0000 7fdab0e1b740 1 --2- 172.21.15.1:0/1884213448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a35e10f60 0x563a361bd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:19.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.954+0000 7fdab0e1b740 1 --2- 172.21.15.1:0/1884213448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563a35df0280 0x563a361ce9a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:19.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.954+0000 7fdab0e1b740 1 --2- 172.21.15.1:0/1884213448 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a35de80a0 0x563a361d3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:19.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.954+0000 7fdab0e1b740 1 -- 172.21.15.1:0/1884213448 >> 172.21.15.1:0/1884213448 conn(0x563a35e05350 msgr2=0x563a361d28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:19.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.954+0000 7fdab0e1b740 1 -- 172.21.15.1:0/1884213448 shutdown_connections 2024-09-21T00:56:19.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.954+0000 7fdab0e1b740 1 -- 172.21.15.1:0/1884213448 wait complete. 2024-09-21T00:56:19.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.954+0000 7fdab0e1b740 1 -- start start 2024-09-21T00:56:19.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.954+0000 7fdab0e1b740 1 Processor -- start 2024-09-21T00:56:19.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.955+0000 7fdab0e1b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a35de80a0 0x563a361d76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:19.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.955+0000 7fdab0e1b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a35df0280 0x563a361d7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:19.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.955+0000 7fdab0e1b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563a35e10f60 0x563a361d8150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:19.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.955+0000 7fdab0e1b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563a361d4d70 con 0x563a35e10f60 2024-09-21T00:56:19.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.955+0000 7fdab0e1b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563a361d46a0 con 0x563a35de80a0 2024-09-21T00:56:19.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.955+0000 7fdab0e1b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563a361d5440 con 0x563a35df0280 2024-09-21T00:56:19.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.955+0000 7fdab0e1b740 10 client.0 _ll_register_callbacks cb 0x7fda9800bb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:56:19.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.955+0000 7fdaa8e44640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563a35e10f60 0x563a361d8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:19.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.955+0000 7fdaa8e44640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563a35e10f60 0x563a361d8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51272/0 (socket says 172.21.15.1:51272) 2024-09-21T00:56:19.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.955+0000 7fdaa8e44640 1 -- 172.21.15.1:0/270958009 learned_addr learned my addr 172.21.15.1:0/270958009 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:19.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.955+0000 7fdaa37fe640 1 --2- 172.21.15.1:0/270958009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a35df0280 0x563a361d7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:19.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.955+0000 7fdaa8e44640 1 --2- 172.21.15.1:0/270958009 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a35de80a0 0x563a361d76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:19.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.955+0000 7fdaa8e44640 1 -- 172.21.15.1:0/270958009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a35df0280 msgr2=0x563a361d7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:19.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.955+0000 7fdaa8e44640 1 --2- 172.21.15.1:0/270958009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a35df0280 0x563a361d7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:19.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.955+0000 7fdaa8e44640 1 -- 172.21.15.1:0/270958009 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a35de80a0 msgr2=0x563a361d76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:19.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.955+0000 7fdaa8e44640 1 --2- 172.21.15.1:0/270958009 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a35de80a0 0x563a361d76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:19.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.955+0000 7fdaa8e44640 1 -- 172.21.15.1:0/270958009 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a361dc720 con 0x563a35e10f60 2024-09-21T00:56:19.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.955+0000 7fdaa8e44640 1 --2- 172.21.15.1:0/270958009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563a35e10f60 0x563a361d8150 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fda9c000f80 tx=0x7fda9800ba80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be45653082e1d50 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:19.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.955+0000 7fda837fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:56:19.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.956+0000 7fda837fe640 1 -- 172.21.15.1:0/270958009 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9c0314d0 con 0x563a35e10f60 2024-09-21T00:56:19.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.956+0000 7fda837fe640 1 -- 172.21.15.1:0/270958009 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fda9c04a040 con 0x563a35e10f60 2024-09-21T00:56:19.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.956+0000 7fdab0e1b740 1 -- 172.21.15.1:0/270958009 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda98003aa0 con 0x563a35e10f60 2024-09-21T00:56:19.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.956+0000 7fda837fe640 1 -- 172.21.15.1:0/270958009 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fda9c031670 con 0x563a35e10f60 2024-09-21T00:56:19.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.956+0000 7fdab0e1b740 10 client.15198 fetch_fsmap learned FSMap version 26 2024-09-21T00:56:19.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.956+0000 7fdab0e1b740 1 -- 172.21.15.1:0/270958009 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563a361dd9a0 con 0x563a35e10f60 2024-09-21T00:56:19.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.956+0000 7fda837fe640 1 -- 172.21.15.1:0/270958009 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda98003aa0 con 0x563a35e10f60 2024-09-21T00:56:19.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.956+0000 7fda837fe640 1 -- 172.21.15.1:0/270958009 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7fda9c043070 con 0x563a35e10f60 2024-09-21T00:56:19.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.956+0000 7fdab0e1b740 10 client.15198 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T00:56:19.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.956+0000 7fdab0e1b740 10 client.15198 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T00:56:19.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.956+0000 7fdab0e1b740 20 client.15198 populate_metadata read hostname 'smithi001' 2024-09-21T00:56:19.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.956+0000 7fdab0e1b740 1 --2- 172.21.15.1:0/270958009 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x563a35da4c90 0x563a362430f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:19.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.956+0000 7fdab0e1b740 4 client.15198 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T00:56:19.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.956+0000 7fdab0e1b740 1 -- 172.21.15.1:0/270958009 --> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] -- command(tid 0: {"prefix": "status"}) -- 0x563a3612c610 con 0x563a35da4c90 2024-09-21T00:56:19.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.957+0000 7fdaa37fe640 1 --2- 172.21.15.1:0/270958009 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x563a35da4c90 0x563a362430f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:19.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.957+0000 7fda837fe640 10 client.15198 ms_handle_connect on v2:172.21.15.42:6836/2395608508 2024-09-21T00:56:19.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.957+0000 7fdaa37fe640 1 --2- 172.21.15.1:0/270958009 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x563a35da4c90 0x563a362430f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=28fe0705570643ca server_cookie=a24bab37227f5690 in_seq=0 out_seq=0 2024-09-21T00:56:19.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.957+0000 7fda837fe640 1 -- 172.21.15.1:0/270958009 <== mds.2 v2:172.21.15.42:6836/2395608508 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x563a3612c610 con 0x563a35da4c90 2024-09-21T00:56:19.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.957+0000 7fda837fe640 10 client.15198 handle_command_reply: tid=0 2024-09-21T00:56:19.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.957+0000 7fdab0e1b740 1 client.15198 shutdown 2024-09-21T00:56:19.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.958+0000 7fdab0e1b740 1 -- 172.21.15.1:0/270958009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563a35e10f60 msgr2=0x563a361d8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:19.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.958+0000 7fdab0e1b740 1 --2- 172.21.15.1:0/270958009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563a35e10f60 0x563a361d8150 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fda9c000f80 tx=0x7fda9800ba80 comp rx=0 tx=0).stop 2024-09-21T00:56:19.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.958+0000 7fdab0e1b740 1 -- 172.21.15.1:0/270958009 shutdown_connections 2024-09-21T00:56:19.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.958+0000 7fdab0e1b740 1 --2- 172.21.15.1:0/270958009 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x563a35da4c90 0x563a362430f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:19.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.958+0000 7fdab0e1b740 1 --2- 172.21.15.1:0/270958009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563a35e10f60 0x563a361d8150 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:19.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.958+0000 7fda837fe640 0 client.15198 ms_handle_reset on v2:172.21.15.42:6836/2395608508 2024-09-21T00:56:19.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.958+0000 7fdab0e1b740 1 --2- 172.21.15.1:0/270958009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a35df0280 0x563a361d7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:19.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.958+0000 7fdab0e1b740 1 --2- 172.21.15.1:0/270958009 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a35de80a0 0x563a361d76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:19.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.958+0000 7fdab0e1b740 1 -- 172.21.15.1:0/270958009 >> 172.21.15.1:0/270958009 conn(0x563a35e05350 msgr2=0x563a361bd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:19.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.958+0000 7fdab0e1b740 1 -- 172.21.15.1:0/270958009 shutdown_connections 2024-09-21T00:56:19.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.958+0000 7fdab0e1b740 1 -- 172.21.15.1:0/270958009 wait complete. 2024-09-21T00:56:19.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.958+0000 7fdab0e1b740 20 client.15198 trim_cache size 0 max 16384 2024-09-21T00:56:19.963 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T00:56:19.963 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "d3972c20-77b2-11ef-baf5-efdc52797490", 2024-09-21T00:56:19.963 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 2, 2024-09-21T00:56:19.963 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24626, 2024-09-21T00:56:19.964 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-21T00:56:19.964 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-21T00:56:19.964 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-21T00:56:19.964 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 72.791306340000006, 2024-09-21T00:56:19.964 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 26, 2024-09-21T00:56:19.964 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 75, 2024-09-21T00:56:19.964 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 73, 2024-09-21T00:56:19.964 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 103.119021749 2024-09-21T00:56:19.964 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T00:56:19.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.958+0000 7fdaaa8a7640 1 -- 172.21.15.1:0/1781550359 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fda8c0b65a0 msgr2=0x7fda8c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:19.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.958+0000 7fdaaa8a7640 1 --2- 172.21.15.1:0/1781550359 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fda8c0b65a0 0x7fda8c0b8ab0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x563a361b5b80 tx=0x7fda940e71d0 comp rx=0 tx=0).stop 2024-09-21T00:56:19.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.958+0000 7fdaaa8a7640 1 -- 172.21.15.1:0/1781550359 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdaa4103bc0 msgr2=0x7fdaa4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:19.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.958+0000 7fdaaa8a7640 1 --2- 172.21.15.1:0/1781550359 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdaa4103bc0 0x7fdaa4075710 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fda9400d950 tx=0x7fda9400de10 comp rx=0 tx=0).stop 2024-09-21T00:56:19.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.959+0000 7fdaaa8a7640 1 -- 172.21.15.1:0/1781550359 shutdown_connections 2024-09-21T00:56:19.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.959+0000 7fdaaa8a7640 1 --2- 172.21.15.1:0/1781550359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdaa4109e00 0x7fdaa4076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:19.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.959+0000 7fdaaa8a7640 1 --2- 172.21.15.1:0/1781550359 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdaa41094b0 0x7fdaa4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:19.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.959+0000 7fdaaa8a7640 1 --2- 172.21.15.1:0/1781550359 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fda8c0b65a0 0x7fda8c0b8ab0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:19.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.959+0000 7fdaaa8a7640 1 --2- 172.21.15.1:0/1781550359 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdaa4103bc0 0x7fdaa4075710 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:19.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.959+0000 7fdaaa8a7640 1 -- 172.21.15.1:0/1781550359 >> 172.21.15.1:0/1781550359 conn(0x7fdaa407b910 msgr2=0x7fdaa4107500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:19.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.959+0000 7fdaaa8a7640 1 -- 172.21.15.1:0/1781550359 shutdown_connections 2024-09-21T00:56:19.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:19.959+0000 7fdaaa8a7640 1 -- 172.21.15.1:0/1781550359 wait complete. 2024-09-21T00:56:20.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:19 smithi001 ceph-mon[31211]: pgmap v331: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:56:20.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:19 smithi193 ceph-mon[34660]: pgmap v331: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:56:20.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:19 smithi042 ceph-mon[34481]: pgmap v331: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:56:20.834 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T00:56:21.095 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:21.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.589+0000 7f5ca0493640 1 -- 172.21.15.1:0/3259954531 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c981049c0 msgr2=0x7f5c98104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:21.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.589+0000 7f5ca0493640 1 --2- 172.21.15.1:0/3259954531 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c981049c0 0x7f5c98104dd0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5c94009900 tx=0x7f5c9402a410 comp rx=0 tx=0).stop 2024-09-21T00:56:21.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.589+0000 7f5ca0493640 1 -- 172.21.15.1:0/3259954531 shutdown_connections 2024-09-21T00:56:21.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.589+0000 7f5ca0493640 1 --2- 172.21.15.1:0/3259954531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c9810de20 0x7f5c98110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.589+0000 7f5ca0493640 1 --2- 172.21.15.1:0/3259954531 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c98105310 0x7f5c9810d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.589+0000 7f5ca0493640 1 --2- 172.21.15.1:0/3259954531 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c981049c0 0x7f5c98104dd0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.589+0000 7f5ca0493640 1 -- 172.21.15.1:0/3259954531 >> 172.21.15.1:0/3259954531 conn(0x7f5c98079730 msgr2=0x7f5c98079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:21.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.590+0000 7f5ca0493640 1 -- 172.21.15.1:0/3259954531 shutdown_connections 2024-09-21T00:56:21.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.590+0000 7f5ca0493640 1 -- 172.21.15.1:0/3259954531 wait complete. 2024-09-21T00:56:21.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.590+0000 7f5ca0493640 1 Processor -- start 2024-09-21T00:56:21.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.590+0000 7f5ca0493640 1 -- start start 2024-09-21T00:56:21.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.591+0000 7f5ca0493640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c981049c0 0x7f5c9819a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:21.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.591+0000 7f5ca0493640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c98105310 0x7f5c9819aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:21.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.591+0000 7f5ca0493640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c9810de20 0x7f5c9819fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:21.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.591+0000 7f5ca0493640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5c98113af0 con 0x7f5c9810de20 2024-09-21T00:56:21.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.591+0000 7f5ca0493640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5c98113970 con 0x7f5c98105310 2024-09-21T00:56:21.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.591+0000 7f5ca0493640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5c98113c70 con 0x7f5c981049c0 2024-09-21T00:56:21.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.591+0000 7f5c9ea30640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c9810de20 0x7f5c9819fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:21.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.591+0000 7f5c9ea30640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c9810de20 0x7f5c9819fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51292/0 (socket says 172.21.15.1:51292) 2024-09-21T00:56:21.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.591+0000 7f5c9ea30640 1 -- 172.21.15.1:0/2536951753 learned_addr learned my addr 172.21.15.1:0/2536951753 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:21.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.591+0000 7f5c9da2e640 1 --2- 172.21.15.1:0/2536951753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c98105310 0x7f5c9819aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:21.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.591+0000 7f5c9e22f640 1 --2- 172.21.15.1:0/2536951753 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c981049c0 0x7f5c9819a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:21.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.591+0000 7f5c9ea30640 1 -- 172.21.15.1:0/2536951753 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c981049c0 msgr2=0x7f5c9819a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:21.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.591+0000 7f5c9ea30640 1 --2- 172.21.15.1:0/2536951753 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c981049c0 0x7f5c9819a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.591+0000 7f5c9ea30640 1 -- 172.21.15.1:0/2536951753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c98105310 msgr2=0x7f5c9819aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:21.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.591+0000 7f5c9ea30640 1 --2- 172.21.15.1:0/2536951753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c98105310 0x7f5c9819aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.591+0000 7f5c9ea30640 1 -- 172.21.15.1:0/2536951753 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c981a0450 con 0x7f5c9810de20 2024-09-21T00:56:21.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.591+0000 7f5c9ea30640 1 --2- 172.21.15.1:0/2536951753 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c9810de20 0x7f5c9819fd20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5c9000cad0 tx=0x7f5c9000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:21.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.592+0000 7f5c8f7fe640 1 -- 172.21.15.1:0/2536951753 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9000ae20 con 0x7f5c9810de20 2024-09-21T00:56:21.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.592+0000 7f5c8f7fe640 1 -- 172.21.15.1:0/2536951753 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c90005020 con 0x7f5c9810de20 2024-09-21T00:56:21.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.592+0000 7f5c8f7fe640 1 -- 172.21.15.1:0/2536951753 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9000f6b0 con 0x7f5c9810de20 2024-09-21T00:56:21.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.592+0000 7f5ca0493640 1 -- 172.21.15.1:0/2536951753 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c981a0740 con 0x7f5c9810de20 2024-09-21T00:56:21.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.592+0000 7f5ca0493640 1 -- 172.21.15.1:0/2536951753 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c981a6ea0 con 0x7f5c9810de20 2024-09-21T00:56:21.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.594+0000 7f5ca6a07740 1 Processor -- start 2024-09-21T00:56:21.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.595+0000 7f5c8f7fe640 1 -- 172.21.15.1:0/2536951753 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7f5c900051d0 con 0x7f5c9810de20 2024-09-21T00:56:21.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.595+0000 7f5ca6a07740 1 -- start start 2024-09-21T00:56:21.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.596+0000 7f5ca6a07740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556faf596f60 0x556faf93cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:21.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.596+0000 7f5ca6a07740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556faf56e0a0 0x556faf93d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:21.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.596+0000 7f5ca6a07740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556faf576280 0x556faf93d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:21.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.596+0000 7f5ca6a07740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556faf8b4c10 con 0x556faf576280 2024-09-21T00:56:21.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.596+0000 7f5ca6a07740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556faf8a4040 con 0x556faf596f60 2024-09-21T00:56:21.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.596+0000 7f5ca6a07740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556faf8a7e50 con 0x556faf56e0a0 2024-09-21T00:56:21.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.596+0000 7f5c9da2e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556faf576280 0x556faf93d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:21.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.596+0000 7f5c9da2e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556faf576280 0x556faf93d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51302/0 (socket says 172.21.15.1:51302) 2024-09-21T00:56:21.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.596+0000 7f5c9da2e640 1 -- 172.21.15.1:0/2377854131 learned_addr learned my addr 172.21.15.1:0/2377854131 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:21.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.596+0000 7f5c9da2e640 1 --2- 172.21.15.1:0/2377854131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556faf596f60 0x556faf93cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:21.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.596+0000 7f5c8f7fe640 1 --2- 172.21.15.1:0/2536951753 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5c840b6620 0x7f5c840b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:21.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.596+0000 7f5c9e22f640 1 --2- 172.21.15.1:0/2377854131 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556faf56e0a0 0x556faf93d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:21.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.596+0000 7f5c9ea30640 1 --2- 172.21.15.1:0/2536951753 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5c840b6620 0x7f5c840b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:21.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.596+0000 7f5c9da2e640 1 -- 172.21.15.1:0/2377854131 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556faf56e0a0 msgr2=0x556faf93d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:21.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.596+0000 7f5c9da2e640 1 --2- 172.21.15.1:0/2377854131 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556faf56e0a0 0x556faf93d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.596+0000 7f5c9da2e640 1 -- 172.21.15.1:0/2377854131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556faf596f60 msgr2=0x556faf93cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:21.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.596+0000 7f5c9da2e640 1 --2- 172.21.15.1:0/2377854131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556faf596f60 0x556faf93cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.596+0000 7f5c9da2e640 1 -- 172.21.15.1:0/2377854131 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556faf602540 con 0x556faf576280 2024-09-21T00:56:21.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.596+0000 7f5c8f7fe640 1 -- 172.21.15.1:0/2536951753 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f5c900e7350 con 0x7f5c9810de20 2024-09-21T00:56:21.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.597+0000 7f5c9da2e640 1 --2- 172.21.15.1:0/2377854131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556faf576280 0x556faf93d980 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5c9806b8f0 tx=0x7f5c8800b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b9d65fda6b0e3d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:21.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.597+0000 7f5c9ea30640 1 --2- 172.21.15.1:0/2536951753 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5c840b6620 0x7f5c840b8b30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5c90075f50 tx=0x7f5c90078040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:21.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.597+0000 7f5c8cd9a640 1 -- 172.21.15.1:0/2377854131 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c88012e00 con 0x556faf576280 2024-09-21T00:56:21.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.597+0000 7f5c8cd9a640 1 -- 172.21.15.1:0/2377854131 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c88005020 con 0x556faf576280 2024-09-21T00:56:21.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.597+0000 7f5c8cd9a640 1 -- 172.21.15.1:0/2377854131 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c88004a90 con 0x556faf576280 2024-09-21T00:56:21.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.598+0000 7f5ca6a07740 1 -- 172.21.15.1:0/2377854131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556faf576280 msgr2=0x556faf93d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:21.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.598+0000 7f5ca6a07740 1 --2- 172.21.15.1:0/2377854131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556faf576280 0x556faf93d980 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5c9806b8f0 tx=0x7f5c8800b650 comp rx=0 tx=0).stop 2024-09-21T00:56:21.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.598+0000 7f5ca6a07740 1 -- 172.21.15.1:0/2377854131 shutdown_connections 2024-09-21T00:56:21.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.598+0000 7f5ca6a07740 1 --2- 172.21.15.1:0/2377854131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556faf576280 0x556faf93d980 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.598+0000 7f5ca6a07740 1 --2- 172.21.15.1:0/2377854131 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556faf56e0a0 0x556faf93d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.598+0000 7f5ca6a07740 1 --2- 172.21.15.1:0/2377854131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556faf596f60 0x556faf93cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.598+0000 7f5ca6a07740 1 -- 172.21.15.1:0/2377854131 >> 172.21.15.1:0/2377854131 conn(0x556faf58b350 msgr2=0x556faf93adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:21.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.598+0000 7f5ca6a07740 1 -- 172.21.15.1:0/2377854131 shutdown_connections 2024-09-21T00:56:21.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.598+0000 7f5ca6a07740 1 -- 172.21.15.1:0/2377854131 wait complete. 2024-09-21T00:56:21.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.599+0000 7f5ca6a07740 1 -- start start 2024-09-21T00:56:21.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.599+0000 7f5ca6a07740 1 Processor -- start 2024-09-21T00:56:21.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.599+0000 7f5ca6a07740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556faf56e0a0 0x556faf948a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:21.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.599+0000 7f5ca6a07740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556faf576280 0x556faf948f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:21.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.599+0000 7f5ca6a07740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556faf596f60 0x556faf9549f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:21.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.599+0000 7f5ca6a07740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556faf7055f0 con 0x556faf596f60 2024-09-21T00:56:21.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.599+0000 7f5ca6a07740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556faf83f010 con 0x556faf56e0a0 2024-09-21T00:56:21.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.599+0000 7f5ca6a07740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556faf94b680 con 0x556faf576280 2024-09-21T00:56:21.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.599+0000 7f5ca6a07740 10 client.0 _ll_register_callbacks cb 0x556faf89e340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:56:21.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.599+0000 7f5c9da2e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556faf596f60 0x556faf9549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:21.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.600+0000 7f5c9e22f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556faf576280 0x556faf948f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:21.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.600+0000 7f5c9e22f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556faf576280 0x556faf948f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:50998/0 (socket says 172.21.15.1:50998) 2024-09-21T00:56:21.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.600+0000 7f5c9e22f640 1 -- 172.21.15.1:0/3120220543 learned_addr learned my addr 172.21.15.1:0/3120220543 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:21.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.600+0000 7f5c9da2e640 1 --2- 172.21.15.1:0/3120220543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556faf56e0a0 0x556faf948a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:21.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.600+0000 7f5c9e22f640 1 -- 172.21.15.1:0/3120220543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556faf56e0a0 msgr2=0x556faf948a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:21.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.600+0000 7f5c9e22f640 1 --2- 172.21.15.1:0/3120220543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556faf56e0a0 0x556faf948a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.600+0000 7f5c9e22f640 1 -- 172.21.15.1:0/3120220543 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556faf596f60 msgr2=0x556faf9549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:21.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.600+0000 7f5c9e22f640 1 --2- 172.21.15.1:0/3120220543 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556faf596f60 0x556faf9549f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.600+0000 7f5c9e22f640 1 -- 172.21.15.1:0/3120220543 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556faf86ca00 con 0x556faf576280 2024-09-21T00:56:21.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.600+0000 7f5c9e22f640 1 --2- 172.21.15.1:0/3120220543 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556faf576280 0x556faf948f70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5c94005ab0 tx=0x7f5c940044d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea14bdfbc73a5f71 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:21.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.600+0000 7f5c81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T00:56:21.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.600+0000 7f5c81ffb640 1 -- 172.21.15.1:0/3120220543 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c94035040 con 0x556faf576280 2024-09-21T00:56:21.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.601+0000 7f5ca6a07740 1 -- 172.21.15.1:0/3120220543 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c88005020 con 0x556faf576280 2024-09-21T00:56:21.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.601+0000 7f5c81ffb640 1 -- 172.21.15.1:0/3120220543 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f5c94005450 con 0x556faf576280 2024-09-21T00:56:21.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.601+0000 7f5c81ffb640 1 -- 172.21.15.1:0/3120220543 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5c9404b070 con 0x556faf576280 2024-09-21T00:56:21.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.601+0000 7f5ca6a07740 10 client.24958 fetch_fsmap learned FSMap version 26 2024-09-21T00:56:21.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.601+0000 7f5ca6a07740 1 -- 172.21.15.1:0/3120220543 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556faf9576e0 con 0x556faf576280 2024-09-21T00:56:21.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.601+0000 7f5c81ffb640 1 -- 172.21.15.1:0/3120220543 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c88005020 con 0x556faf576280 2024-09-21T00:56:21.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.601+0000 7f5c81ffb640 1 -- 172.21.15.1:0/3120220543 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f5c940039d0 con 0x556faf576280 2024-09-21T00:56:21.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.601+0000 7f5ca6a07740 10 client.24958 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T00:56:21.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.601+0000 7f5ca6a07740 10 client.24958 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T00:56:21.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.601+0000 7f5ca6a07740 20 client.24958 populate_metadata read hostname 'smithi001' 2024-09-21T00:56:21.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.601+0000 7f5ca6a07740 1 --2- 172.21.15.1:0/3120220543 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x556faf5558e0 0x556faf95b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:21.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.601+0000 7f5ca6a07740 4 client.24958 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:56:21.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.601+0000 7f5ca6a07740 1 -- 172.21.15.1:0/3120220543 --> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556faf8b6b60 con 0x556faf5558e0 2024-09-21T00:56:21.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.602+0000 7f5c9da2e640 1 --2- 172.21.15.1:0/3120220543 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x556faf5558e0 0x556faf95b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:21.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.602+0000 7f5c81ffb640 10 client.24958 ms_handle_connect on v2:172.21.15.193:6838/1365361177 2024-09-21T00:56:21.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.602+0000 7f5c9da2e640 1 --2- 172.21.15.1:0/3120220543 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x556faf5558e0 0x556faf95b0d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fd1f88854dfd9cde server_cookie=abf27cf34a0b34ce in_seq=0 out_seq=0 2024-09-21T00:56:21.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.603+0000 7f5c81ffb640 1 -- 172.21.15.1:0/3120220543 <== mds.1 v2:172.21.15.193:6838/1365361177 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556faf8b6b60 con 0x556faf5558e0 2024-09-21T00:56:21.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.603+0000 7f5c81ffb640 10 client.24958 handle_command_reply: tid=0 2024-09-21T00:56:21.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.603+0000 7f5ca6a07740 1 client.24958 shutdown 2024-09-21T00:56:21.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.603+0000 7f5ca6a07740 1 -- 172.21.15.1:0/3120220543 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556faf576280 msgr2=0x556faf948f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:21.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.603+0000 7f5ca6a07740 1 --2- 172.21.15.1:0/3120220543 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556faf576280 0x556faf948f70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5c94005ab0 tx=0x7f5c940044d0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.603+0000 7f5ca6a07740 1 -- 172.21.15.1:0/3120220543 shutdown_connections 2024-09-21T00:56:21.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.603+0000 7f5ca6a07740 1 --2- 172.21.15.1:0/3120220543 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x556faf5558e0 0x556faf95b0d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.603+0000 7f5ca6a07740 1 --2- 172.21.15.1:0/3120220543 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556faf596f60 0x556faf9549f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.603+0000 7f5ca6a07740 1 --2- 172.21.15.1:0/3120220543 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556faf576280 0x556faf948f70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.603+0000 7f5ca6a07740 1 --2- 172.21.15.1:0/3120220543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556faf56e0a0 0x556faf948a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.603+0000 7f5ca6a07740 1 -- 172.21.15.1:0/3120220543 >> 172.21.15.1:0/3120220543 conn(0x556faf58b350 msgr2=0x556faf940090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:21.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.603+0000 7f5c81ffb640 0 client.24958 ms_handle_reset on v2:172.21.15.193:6838/1365361177 2024-09-21T00:56:21.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.603+0000 7f5ca6a07740 1 -- 172.21.15.1:0/3120220543 shutdown_connections 2024-09-21T00:56:21.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.603+0000 7f5ca6a07740 1 -- 172.21.15.1:0/3120220543 wait complete. 2024-09-21T00:56:21.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.603+0000 7f5ca6a07740 20 client.24958 trim_cache size 0 max 16384 2024-09-21T00:56:21.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.621+0000 7f5ca6a07740 1 Processor -- start 2024-09-21T00:56:21.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.621+0000 7f5ca6a07740 1 -- start start 2024-09-21T00:56:21.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.622+0000 7f5ca6a07740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556faf56e0a0 0x556faf943020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:21.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.622+0000 7f5ca6a07740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556faf576280 0x556faf954960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:21.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.622+0000 7f5ca6a07740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556faf596f60 0x556faf954ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:21.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.622+0000 7f5ca6a07740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556faf959410 con 0x556faf596f60 2024-09-21T00:56:21.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.622+0000 7f5ca6a07740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556faf959ae0 con 0x556faf576280 2024-09-21T00:56:21.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.622+0000 7f5ca6a07740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556faf95a1b0 con 0x556faf56e0a0 2024-09-21T00:56:21.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.622+0000 7f5c9da2e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556faf596f60 0x556faf954ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:21.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.622+0000 7f5c9da2e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556faf596f60 0x556faf954ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51316/0 (socket says 172.21.15.1:51316) 2024-09-21T00:56:21.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.622+0000 7f5c9da2e640 1 -- 172.21.15.1:0/958337260 learned_addr learned my addr 172.21.15.1:0/958337260 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:21.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.622+0000 7f5c9e22f640 1 --2- 172.21.15.1:0/958337260 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556faf576280 0x556faf954960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:21.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.622+0000 7f5c9da2e640 1 --2- 172.21.15.1:0/958337260 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556faf56e0a0 0x556faf943020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:21.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.622+0000 7f5c9da2e640 1 -- 172.21.15.1:0/958337260 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556faf56e0a0 msgr2=0x556faf943020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:21.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.622+0000 7f5c9da2e640 1 --2- 172.21.15.1:0/958337260 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556faf56e0a0 0x556faf943020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.622+0000 7f5c9da2e640 1 -- 172.21.15.1:0/958337260 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556faf576280 msgr2=0x556faf954960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:21.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.622+0000 7f5c9da2e640 1 --2- 172.21.15.1:0/958337260 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556faf576280 0x556faf954960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.622+0000 7f5c9da2e640 1 -- 172.21.15.1:0/958337260 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556faf936520 con 0x556faf596f60 2024-09-21T00:56:21.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.623+0000 7f5c9da2e640 1 --2- 172.21.15.1:0/958337260 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556faf596f60 0x556faf954ea0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5c880057c0 tx=0x7f5c8802f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9977e8eab91947e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:21.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.623+0000 7f5c83fff640 1 -- 172.21.15.1:0/958337260 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c880229e0 con 0x556faf596f60 2024-09-21T00:56:21.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.623+0000 7f5c83fff640 1 -- 172.21.15.1:0/958337260 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c88005520 con 0x556faf596f60 2024-09-21T00:56:21.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.623+0000 7f5c83fff640 1 -- 172.21.15.1:0/958337260 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c88010be0 con 0x556faf596f60 2024-09-21T00:56:21.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.624+0000 7f5ca6a07740 1 -- 172.21.15.1:0/958337260 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556faf596f60 msgr2=0x556faf954ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:21.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.624+0000 7f5ca6a07740 1 --2- 172.21.15.1:0/958337260 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556faf596f60 0x556faf954ea0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5c880057c0 tx=0x7f5c8802f040 comp rx=0 tx=0).stop 2024-09-21T00:56:21.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.624+0000 7f5ca6a07740 1 -- 172.21.15.1:0/958337260 shutdown_connections 2024-09-21T00:56:21.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.624+0000 7f5ca6a07740 1 --2- 172.21.15.1:0/958337260 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556faf596f60 0x556faf954ea0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.624+0000 7f5ca6a07740 1 --2- 172.21.15.1:0/958337260 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556faf576280 0x556faf954960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.624+0000 7f5ca6a07740 1 --2- 172.21.15.1:0/958337260 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556faf56e0a0 0x556faf943020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.624+0000 7f5ca6a07740 1 -- 172.21.15.1:0/958337260 >> 172.21.15.1:0/958337260 conn(0x556faf58b350 msgr2=0x556faf9470b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:21.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.624+0000 7f5ca6a07740 1 -- 172.21.15.1:0/958337260 shutdown_connections 2024-09-21T00:56:21.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.624+0000 7f5ca6a07740 1 -- 172.21.15.1:0/958337260 wait complete. 2024-09-21T00:56:21.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.624+0000 7f5ca6a07740 1 -- start start 2024-09-21T00:56:21.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.624+0000 7f5ca6a07740 1 Processor -- start 2024-09-21T00:56:21.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.625+0000 7f5ca6a07740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556faf56e0a0 0x556faf9639e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:21.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.625+0000 7f5ca6a07740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556faf576280 0x556faf95ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:21.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.625+0000 7f5ca6a07740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556faf596f60 0x556faf95d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:21.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.625+0000 7f5ca6a07740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556faf95af50 con 0x556faf596f60 2024-09-21T00:56:21.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.625+0000 7f5ca6a07740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556faf95a880 con 0x556faf576280 2024-09-21T00:56:21.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.625+0000 7f5ca6a07740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556faf95b620 con 0x556faf56e0a0 2024-09-21T00:56:21.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.625+0000 7f5ca6a07740 10 client.0 _ll_register_callbacks cb 0x7f5c94004160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:56:21.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.625+0000 7f5c9da2e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556faf596f60 0x556faf95d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:21.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.625+0000 7f5c9da2e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556faf596f60 0x556faf95d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51324/0 (socket says 172.21.15.1:51324) 2024-09-21T00:56:21.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.625+0000 7f5c9da2e640 1 -- 172.21.15.1:0/3441545880 learned_addr learned my addr 172.21.15.1:0/3441545880 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:21.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.625+0000 7f5c9e22f640 1 --2- 172.21.15.1:0/3441545880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556faf576280 0x556faf95ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:21.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.625+0000 7f5c9da2e640 1 --2- 172.21.15.1:0/3441545880 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556faf56e0a0 0x556faf9639e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:21.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.625+0000 7f5c9da2e640 1 -- 172.21.15.1:0/3441545880 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556faf56e0a0 msgr2=0x556faf9639e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:21.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.625+0000 7f5c9da2e640 1 --2- 172.21.15.1:0/3441545880 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556faf56e0a0 0x556faf9639e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.625+0000 7f5c9da2e640 1 -- 172.21.15.1:0/3441545880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556faf576280 msgr2=0x556faf95ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:21.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.625+0000 7f5c9da2e640 1 --2- 172.21.15.1:0/3441545880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556faf576280 0x556faf95ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.625+0000 7f5c9da2e640 1 -- 172.21.15.1:0/3441545880 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556faf95d9e0 con 0x556faf596f60 2024-09-21T00:56:21.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.625+0000 7f5c9da2e640 1 --2- 172.21.15.1:0/3441545880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556faf596f60 0x556faf95d3d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5c88024040 tx=0x7f5c880107e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf09b562b0a2e8c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:21.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.625+0000 7f5c81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:56:21.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.626+0000 7f5c81ffb640 1 -- 172.21.15.1:0/3441545880 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c88010a90 con 0x556faf596f60 2024-09-21T00:56:21.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.626+0000 7f5c81ffb640 1 -- 172.21.15.1:0/3441545880 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f5c88010c30 con 0x556faf596f60 2024-09-21T00:56:21.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.626+0000 7f5ca6a07740 1 -- 172.21.15.1:0/3441545880 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c88005520 con 0x556faf596f60 2024-09-21T00:56:21.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.626+0000 7f5c81ffb640 1 -- 172.21.15.1:0/3441545880 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5c88010e30 con 0x556faf596f60 2024-09-21T00:56:21.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.626+0000 7f5ca6a07740 10 client.15216 fetch_fsmap learned FSMap version 26 2024-09-21T00:56:21.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.626+0000 7f5ca6a07740 1 -- 172.21.15.1:0/3441545880 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556faf9633f0 con 0x556faf596f60 2024-09-21T00:56:21.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.626+0000 7f5c81ffb640 1 -- 172.21.15.1:0/3441545880 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c88005520 con 0x556faf596f60 2024-09-21T00:56:21.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.626+0000 7f5c81ffb640 1 -- 172.21.15.1:0/3441545880 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f5c88003a70 con 0x556faf596f60 2024-09-21T00:56:21.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.626+0000 7f5ca6a07740 10 client.15216 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T00:56:21.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.626+0000 7f5ca6a07740 10 client.15216 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T00:56:21.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.627+0000 7f5ca6a07740 20 client.15216 populate_metadata read hostname 'smithi001' 2024-09-21T00:56:21.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.627+0000 7f5ca6a07740 1 --2- 172.21.15.1:0/3441545880 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x556faf52ac90 0x556faf9c9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:21.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.627+0000 7f5ca6a07740 4 client.15216 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T00:56:21.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.627+0000 7f5ca6a07740 1 -- 172.21.15.1:0/3441545880 --> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] -- command(tid 0: {"prefix": "status"}) -- 0x556faf8b2610 con 0x556faf52ac90 2024-09-21T00:56:21.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.627+0000 7f5c9e22f640 1 --2- 172.21.15.1:0/3441545880 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x556faf52ac90 0x556faf9c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:21.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.627+0000 7f5c9e22f640 1 --2- 172.21.15.1:0/3441545880 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x556faf52ac90 0x556faf9c9450 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e24592b482327fe9 server_cookie=22ff7bf85a4a64e2 in_seq=0 out_seq=0 2024-09-21T00:56:21.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.627+0000 7f5c81ffb640 10 client.15216 ms_handle_connect on v2:172.21.15.193:6838/1365361177 2024-09-21T00:56:21.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.628+0000 7f5c81ffb640 1 -- 172.21.15.1:0/3441545880 <== mds.1 v2:172.21.15.193:6838/1365361177 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x556faf8b2610 con 0x556faf52ac90 2024-09-21T00:56:21.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.628+0000 7f5c81ffb640 10 client.15216 handle_command_reply: tid=0 2024-09-21T00:56:21.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.628+0000 7f5ca6a07740 1 client.15216 shutdown 2024-09-21T00:56:21.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.628+0000 7f5ca6a07740 1 -- 172.21.15.1:0/3441545880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556faf596f60 msgr2=0x556faf95d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:21.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.628+0000 7f5ca6a07740 1 --2- 172.21.15.1:0/3441545880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556faf596f60 0x556faf95d3d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5c88024040 tx=0x7f5c880107e0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.628+0000 7f5ca6a07740 1 -- 172.21.15.1:0/3441545880 shutdown_connections 2024-09-21T00:56:21.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.628+0000 7f5ca6a07740 1 --2- 172.21.15.1:0/3441545880 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x556faf52ac90 0x556faf9c9450 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.628+0000 7f5ca6a07740 1 --2- 172.21.15.1:0/3441545880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556faf596f60 0x556faf95d3d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.628+0000 7f5ca6a07740 1 --2- 172.21.15.1:0/3441545880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556faf576280 0x556faf95ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.628+0000 7f5ca6a07740 1 --2- 172.21.15.1:0/3441545880 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556faf56e0a0 0x556faf9639e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.628+0000 7f5ca6a07740 1 -- 172.21.15.1:0/3441545880 >> 172.21.15.1:0/3441545880 conn(0x556faf58b350 msgr2=0x556faf93df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:21.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.628+0000 7f5c81ffb640 0 client.15216 ms_handle_reset on v2:172.21.15.193:6838/1365361177 2024-09-21T00:56:21.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.628+0000 7f5ca6a07740 1 -- 172.21.15.1:0/3441545880 shutdown_connections 2024-09-21T00:56:21.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.628+0000 7f5ca6a07740 1 -- 172.21.15.1:0/3441545880 wait complete. 2024-09-21T00:56:21.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.628+0000 7f5ca6a07740 20 client.15216 trim_cache size 0 max 16384 2024-09-21T00:56:21.633 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T00:56:21.633 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "d3972c20-77b2-11ef-baf5-efdc52797490", 2024-09-21T00:56:21.634 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 1, 2024-09-21T00:56:21.634 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24637, 2024-09-21T00:56:21.634 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-21T00:56:21.634 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-21T00:56:21.634 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-21T00:56:21.634 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 75.465126491999996, 2024-09-21T00:56:21.634 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 26, 2024-09-21T00:56:21.634 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 75, 2024-09-21T00:56:21.634 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 73, 2024-09-21T00:56:21.634 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 102.243547717 2024-09-21T00:56:21.634 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T00:56:21.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.629+0000 7f5ca0493640 1 -- 172.21.15.1:0/2536951753 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5c840b6620 msgr2=0x7f5c840b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:21.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.629+0000 7f5ca0493640 1 --2- 172.21.15.1:0/2536951753 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5c840b6620 0x7f5c840b8b30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5c90075f50 tx=0x7f5c90078040 comp rx=0 tx=0).stop 2024-09-21T00:56:21.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.629+0000 7f5ca0493640 1 -- 172.21.15.1:0/2536951753 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c9810de20 msgr2=0x7f5c9819fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:21.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.629+0000 7f5ca0493640 1 --2- 172.21.15.1:0/2536951753 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c9810de20 0x7f5c9819fd20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5c9000cad0 tx=0x7f5c9000cf90 comp rx=0 tx=0).stop 2024-09-21T00:56:21.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.629+0000 7f5ca0493640 1 -- 172.21.15.1:0/2536951753 shutdown_connections 2024-09-21T00:56:21.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.629+0000 7f5ca0493640 1 --2- 172.21.15.1:0/2536951753 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5c840b6620 0x7f5c840b8b30 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.629+0000 7f5ca0493640 1 --2- 172.21.15.1:0/2536951753 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c9810de20 0x7f5c9819fd20 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.629+0000 7f5ca0493640 1 --2- 172.21.15.1:0/2536951753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c98105310 0x7f5c9819aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.629+0000 7f5ca0493640 1 --2- 172.21.15.1:0/2536951753 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c981049c0 0x7f5c9819a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.629+0000 7f5ca0493640 1 -- 172.21.15.1:0/2536951753 >> 172.21.15.1:0/2536951753 conn(0x7f5c98079730 msgr2=0x7f5c98100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:21.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.629+0000 7f5ca0493640 1 -- 172.21.15.1:0/2536951753 shutdown_connections 2024-09-21T00:56:21.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:21.629+0000 7f5ca0493640 1 -- 172.21.15.1:0/2536951753 wait complete. 2024-09-21T00:56:22.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:21 smithi001 ceph-mon[31211]: pgmap v332: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T00:56:22.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:21 smithi193 ceph-mon[34660]: pgmap v332: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T00:56:22.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:21 smithi042 ceph-mon[34481]: pgmap v332: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T00:56:22.318 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T00:56:22.586 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:23.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.061+0000 7f27fb7ca640 1 -- 172.21.15.1:0/2926317366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27f41094d0 msgr2=0x7f27f41098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:23.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.061+0000 7f27fb7ca640 1 --2- 172.21.15.1:0/2926317366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27f41094d0 0x7f27f41098e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f27e8009900 tx=0x7f27e802a410 comp rx=0 tx=0).stop 2024-09-21T00:56:23.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.061+0000 7f27fb7ca640 1 -- 172.21.15.1:0/2926317366 shutdown_connections 2024-09-21T00:56:23.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.061+0000 7f27fb7ca640 1 --2- 172.21.15.1:0/2926317366 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27f4109e20 0x7f27f4110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:23.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.061+0000 7f27fb7ca640 1 --2- 172.21.15.1:0/2926317366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27f41094d0 0x7f27f41098e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:23.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.061+0000 7f27fb7ca640 1 --2- 172.21.15.1:0/2926317366 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27f4103b90 0x7f27f4103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:23.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.061+0000 7f27fb7ca640 1 -- 172.21.15.1:0/2926317366 >> 172.21.15.1:0/2926317366 conn(0x7f27f40ff600 msgr2=0x7f27f4101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:23.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.061+0000 7f27fb7ca640 1 -- 172.21.15.1:0/2926317366 shutdown_connections 2024-09-21T00:56:23.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.061+0000 7f27fb7ca640 1 -- 172.21.15.1:0/2926317366 wait complete. 2024-09-21T00:56:23.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.062+0000 7f27fb7ca640 1 Processor -- start 2024-09-21T00:56:23.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.062+0000 7f27fb7ca640 1 -- start start 2024-09-21T00:56:23.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.062+0000 7f27fb7ca640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27f4103b90 0x7f27f419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:23.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.062+0000 7f27fb7ca640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27f41094d0 0x7f27f419aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:23.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.062+0000 7f27fb7ca640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27f4109e20 0x7f27f419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:23.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.062+0000 7f27fb7ca640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f27f4113ae0 con 0x7f27f4109e20 2024-09-21T00:56:23.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.062+0000 7f27fb7ca640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f27f4113960 con 0x7f27f4103b90 2024-09-21T00:56:23.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.062+0000 7f27fb7ca640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f27f4113c60 con 0x7f27f41094d0 2024-09-21T00:56:23.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.063+0000 7f27f9d67640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27f4109e20 0x7f27f419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:23.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.063+0000 7f27f9d67640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27f4109e20 0x7f27f419fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51352/0 (socket says 172.21.15.1:51352) 2024-09-21T00:56:23.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.063+0000 7f27f9d67640 1 -- 172.21.15.1:0/1316273884 learned_addr learned my addr 172.21.15.1:0/1316273884 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:23.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.063+0000 7f27f9566640 1 --2- 172.21.15.1:0/1316273884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27f4103b90 0x7f27f419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:23.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.063+0000 7f27f8d65640 1 --2- 172.21.15.1:0/1316273884 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27f41094d0 0x7f27f419aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:23.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.063+0000 7f27f9d67640 1 -- 172.21.15.1:0/1316273884 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27f41094d0 msgr2=0x7f27f419aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:23.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.063+0000 7f27f9d67640 1 --2- 172.21.15.1:0/1316273884 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27f41094d0 0x7f27f419aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:23.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.063+0000 7f27f9d67640 1 -- 172.21.15.1:0/1316273884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27f4103b90 msgr2=0x7f27f419a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:23.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.063+0000 7f27f9d67640 1 --2- 172.21.15.1:0/1316273884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27f4103b90 0x7f27f419a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:23.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.063+0000 7f27f9d67640 1 -- 172.21.15.1:0/1316273884 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27f41a0460 con 0x7f27f4109e20 2024-09-21T00:56:23.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.063+0000 7f27f8d65640 1 --2- 172.21.15.1:0/1316273884 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27f41094d0 0x7f27f419aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:56:23.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.063+0000 7f27f9d67640 1 --2- 172.21.15.1:0/1316273884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27f4109e20 0x7f27f419fd30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f27e400eb10 tx=0x7f27e400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:23.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.063+0000 7f27f27fc640 1 -- 172.21.15.1:0/1316273884 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e4004b20 con 0x7f27f4109e20 2024-09-21T00:56:23.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.063+0000 7f27f27fc640 1 -- 172.21.15.1:0/1316273884 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27e4004cc0 con 0x7f27f4109e20 2024-09-21T00:56:23.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.063+0000 7f27f27fc640 1 -- 172.21.15.1:0/1316273884 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e4010670 con 0x7f27f4109e20 2024-09-21T00:56:23.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.063+0000 7f27fb7ca640 1 -- 172.21.15.1:0/1316273884 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27f41a0750 con 0x7f27f4109e20 2024-09-21T00:56:23.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.063+0000 7f27fb7ca640 1 -- 172.21.15.1:0/1316273884 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27f41a6eb0 con 0x7f27f4109e20 2024-09-21T00:56:23.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.066+0000 7f2801d3e740 1 Processor -- start 2024-09-21T00:56:23.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.066+0000 7f27f27fc640 1 -- 172.21.15.1:0/1316273884 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7f27e4005020 con 0x7f27f4109e20 2024-09-21T00:56:23.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.066+0000 7f2801d3e740 1 -- start start 2024-09-21T00:56:23.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.067+0000 7f2801d3e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef1e0f8f60 0x55ef1e49ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:23.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.067+0000 7f2801d3e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef1e0d00a0 0x55ef1e49f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:23.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.067+0000 7f2801d3e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef1e0d8280 0x55ef1e49f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:23.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.067+0000 7f2801d3e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ef1e416c10 con 0x55ef1e0f8f60 2024-09-21T00:56:23.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.067+0000 7f2801d3e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ef1e406040 con 0x55ef1e0d8280 2024-09-21T00:56:23.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.067+0000 7f2801d3e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ef1e409e50 con 0x55ef1e0d00a0 2024-09-21T00:56:23.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.067+0000 7f27f8d65640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef1e0f8f60 0x55ef1e49ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:23.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.067+0000 7f27f8d65640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef1e0f8f60 0x55ef1e49ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51354/0 (socket says 172.21.15.1:51354) 2024-09-21T00:56:23.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.067+0000 7f27f8d65640 1 -- 172.21.15.1:0/975099958 learned_addr learned my addr 172.21.15.1:0/975099958 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:23.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.067+0000 7f27f9566640 1 --2- 172.21.15.1:0/975099958 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef1e0d00a0 0x55ef1e49f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:23.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.067+0000 7f27f8d65640 1 --2- 172.21.15.1:0/975099958 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef1e0d8280 0x55ef1e49f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:23.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.067+0000 7f27f8d65640 1 -- 172.21.15.1:0/975099958 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef1e0d00a0 msgr2=0x55ef1e49f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:23.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.067+0000 7f27f8d65640 1 --2- 172.21.15.1:0/975099958 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef1e0d00a0 0x55ef1e49f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:23.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.067+0000 7f27f8d65640 1 -- 172.21.15.1:0/975099958 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef1e0d8280 msgr2=0x55ef1e49f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:23.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.067+0000 7f27f8d65640 1 --2- 172.21.15.1:0/975099958 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef1e0d8280 0x55ef1e49f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:23.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.067+0000 7f27f8d65640 1 -- 172.21.15.1:0/975099958 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef1e164540 con 0x55ef1e0f8f60 2024-09-21T00:56:23.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.067+0000 7f27f27fc640 1 --2- 172.21.15.1:0/1316273884 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f27dc0b6620 0x7f27dc0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:23.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.068+0000 7f27f9566640 1 --2- 172.21.15.1:0/1316273884 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f27dc0b6620 0x7f27dc0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:23.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.068+0000 7f27f8d65640 1 --2- 172.21.15.1:0/975099958 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef1e0f8f60 0x55ef1e49ef00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f27e80096c0 tx=0x7f27e8031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c718db214560e66 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:23.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.068+0000 7f27f27fc640 1 -- 172.21.15.1:0/1316273884 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f27e40e7a70 con 0x7f27f4109e20 2024-09-21T00:56:23.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.068+0000 7f27db7fe640 1 -- 172.21.15.1:0/975099958 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e8045070 con 0x55ef1e0f8f60 2024-09-21T00:56:23.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.068+0000 7f27db7fe640 1 -- 172.21.15.1:0/975099958 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27e8031d10 con 0x55ef1e0f8f60 2024-09-21T00:56:23.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.068+0000 7f27db7fe640 1 -- 172.21.15.1:0/975099958 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e8035070 con 0x55ef1e0f8f60 2024-09-21T00:56:23.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.069+0000 7f2801d3e740 1 -- 172.21.15.1:0/975099958 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef1e0f8f60 msgr2=0x55ef1e49ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:23.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.069+0000 7f27f9566640 1 --2- 172.21.15.1:0/1316273884 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f27dc0b6620 0x7f27dc0b8b30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55ef1e49db80 tx=0x7f27ec00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:23.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.069+0000 7f2801d3e740 1 --2- 172.21.15.1:0/975099958 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef1e0f8f60 0x55ef1e49ef00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f27e80096c0 tx=0x7f27e8031400 comp rx=0 tx=0).stop 2024-09-21T00:56:23.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.069+0000 7f2801d3e740 1 -- 172.21.15.1:0/975099958 shutdown_connections 2024-09-21T00:56:23.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.069+0000 7f2801d3e740 1 --2- 172.21.15.1:0/975099958 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef1e0d8280 0x55ef1e49f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:23.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.069+0000 7f2801d3e740 1 --2- 172.21.15.1:0/975099958 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef1e0d00a0 0x55ef1e49f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:23.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.069+0000 7f2801d3e740 1 --2- 172.21.15.1:0/975099958 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef1e0f8f60 0x55ef1e49ef00 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:23.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.069+0000 7f2801d3e740 1 -- 172.21.15.1:0/975099958 >> 172.21.15.1:0/975099958 conn(0x55ef1e0ed350 msgr2=0x55ef1e49cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:23.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.069+0000 7f2801d3e740 1 -- 172.21.15.1:0/975099958 shutdown_connections 2024-09-21T00:56:23.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.069+0000 7f2801d3e740 1 -- 172.21.15.1:0/975099958 wait complete. 2024-09-21T00:56:23.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.069+0000 7f2801d3e740 1 -- start start 2024-09-21T00:56:23.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.069+0000 7f2801d3e740 1 Processor -- start 2024-09-21T00:56:23.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.070+0000 7f2801d3e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef1e0d00a0 0x55ef1e4aab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:23.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.070+0000 7f2801d3e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef1e0d8280 0x55ef1e4ab070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:23.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.070+0000 7f2801d3e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef1e0f8f60 0x55ef1e4b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:23.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.070+0000 7f2801d3e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ef1e2675f0 con 0x55ef1e0f8f60 2024-09-21T00:56:23.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.070+0000 7f2801d3e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ef1e3a1010 con 0x55ef1e0d00a0 2024-09-21T00:56:23.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.070+0000 7f2801d3e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ef1e4ad680 con 0x55ef1e0d8280 2024-09-21T00:56:23.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.070+0000 7f2801d3e740 10 client.0 _ll_register_callbacks cb 0x55ef1e400340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:56:23.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.070+0000 7f27f9d67640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef1e0f8f60 0x55ef1e4b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:23.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.070+0000 7f27f9d67640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef1e0f8f60 0x55ef1e4b69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51360/0 (socket says 172.21.15.1:51360) 2024-09-21T00:56:23.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.070+0000 7f27f9d67640 1 -- 172.21.15.1:0/1439109115 learned_addr learned my addr 172.21.15.1:0/1439109115 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:23.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.070+0000 7f27f9566640 1 --2- 172.21.15.1:0/1439109115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef1e0d00a0 0x55ef1e4aab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:23.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.070+0000 7f27f8d65640 1 --2- 172.21.15.1:0/1439109115 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef1e0d8280 0x55ef1e4ab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:23.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.070+0000 7f27f9d67640 1 -- 172.21.15.1:0/1439109115 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef1e0d8280 msgr2=0x55ef1e4ab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:23.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.070+0000 7f27f9d67640 1 --2- 172.21.15.1:0/1439109115 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef1e0d8280 0x55ef1e4ab070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:23.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.070+0000 7f27f9d67640 1 -- 172.21.15.1:0/1439109115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef1e0d00a0 msgr2=0x55ef1e4aab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:23.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.070+0000 7f27f9d67640 1 --2- 172.21.15.1:0/1439109115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef1e0d00a0 0x55ef1e4aab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:23.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.070+0000 7f27f9d67640 1 -- 172.21.15.1:0/1439109115 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef1e3cea00 con 0x55ef1e0f8f60 2024-09-21T00:56:23.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.070+0000 7f27f8d65640 1 --2- 172.21.15.1:0/1439109115 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef1e0d8280 0x55ef1e4ab070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:56:23.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.071+0000 7f27f9d67640 1 --2- 172.21.15.1:0/1439109115 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef1e0f8f60 0x55ef1e4b69a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f27e40ada10 tx=0x7f27e40e5880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=764e0c4ca2dc7535 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:23.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.071+0000 7f27d8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:56:23.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.071+0000 7f27d8ff9640 1 -- 172.21.15.1:0/1439109115 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e40b2020 con 0x55ef1e0f8f60 2024-09-21T00:56:23.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.071+0000 7f27d8ff9640 1 -- 172.21.15.1:0/1439109115 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f27e40b21c0 con 0x55ef1e0f8f60 2024-09-21T00:56:23.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.071+0000 7f2801d3e740 1 -- 172.21.15.1:0/1439109115 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27e8031d10 con 0x55ef1e0f8f60 2024-09-21T00:56:23.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.071+0000 7f27d8ff9640 1 -- 172.21.15.1:0/1439109115 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f27e40ae180 con 0x55ef1e0f8f60 2024-09-21T00:56:23.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.071+0000 7f2801d3e740 10 client.15228 fetch_fsmap learned FSMap version 26 2024-09-21T00:56:23.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.071+0000 7f2801d3e740 1 -- 172.21.15.1:0/1439109115 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ef1e4b96d0 con 0x55ef1e0f8f60 2024-09-21T00:56:23.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.071+0000 7f27d8ff9640 1 -- 172.21.15.1:0/1439109115 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27e8031d10 con 0x55ef1e0f8f60 2024-09-21T00:56:23.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.071+0000 7f27d8ff9640 1 -- 172.21.15.1:0/1439109115 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f27e40a94f0 con 0x55ef1e0f8f60 2024-09-21T00:56:23.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.071+0000 7f2801d3e740 10 client.15228 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T00:56:23.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.072+0000 7f2801d3e740 10 client.15228 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T00:56:23.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.072+0000 7f2801d3e740 20 client.15228 populate_metadata read hostname 'smithi001' 2024-09-21T00:56:23.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.072+0000 7f2801d3e740 1 --2- 172.21.15.1:0/1439109115 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55ef1e0b78e0 0x55ef1e4bd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:23.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.072+0000 7f2801d3e740 4 client.15228 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:56:23.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.072+0000 7f2801d3e740 1 -- 172.21.15.1:0/1439109115 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ef1e418b60 con 0x55ef1e0b78e0 2024-09-21T00:56:23.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.072+0000 7f27f9566640 1 --2- 172.21.15.1:0/1439109115 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55ef1e0b78e0 0x55ef1e4bd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:23.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.072+0000 7f27d8ff9640 10 client.15228 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:56:23.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.072+0000 7f27f9566640 1 --2- 172.21.15.1:0/1439109115 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55ef1e0b78e0 0x55ef1e4bd180 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76ec963f7147af16 server_cookie=2cdd2357a102af1c in_seq=0 out_seq=0 2024-09-21T00:56:23.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.073+0000 7f27d8ff9640 1 -- 172.21.15.1:0/1439109115 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ef1e418b60 con 0x55ef1e0b78e0 2024-09-21T00:56:23.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.073+0000 7f27d8ff9640 10 client.15228 handle_command_reply: tid=0 2024-09-21T00:56:23.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.073+0000 7f2801d3e740 1 client.15228 shutdown 2024-09-21T00:56:23.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.073+0000 7f2801d3e740 1 -- 172.21.15.1:0/1439109115 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef1e0f8f60 msgr2=0x55ef1e4b69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:23.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.073+0000 7f2801d3e740 1 --2- 172.21.15.1:0/1439109115 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef1e0f8f60 0x55ef1e4b69a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f27e40ada10 tx=0x7f27e40e5880 comp rx=0 tx=0).stop 2024-09-21T00:56:23.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.073+0000 7f2801d3e740 1 -- 172.21.15.1:0/1439109115 shutdown_connections 2024-09-21T00:56:23.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.073+0000 7f2801d3e740 1 --2- 172.21.15.1:0/1439109115 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55ef1e0b78e0 0x55ef1e4bd180 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:23.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.073+0000 7f2801d3e740 1 --2- 172.21.15.1:0/1439109115 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef1e0f8f60 0x55ef1e4b69a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:23.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.073+0000 7f2801d3e740 1 --2- 172.21.15.1:0/1439109115 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef1e0d8280 0x55ef1e4ab070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:23.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.073+0000 7f2801d3e740 1 --2- 172.21.15.1:0/1439109115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef1e0d00a0 0x55ef1e4aab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:23.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.073+0000 7f27d8ff9640 0 client.15228 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:56:23.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.073+0000 7f2801d3e740 1 -- 172.21.15.1:0/1439109115 >> 172.21.15.1:0/1439109115 conn(0x55ef1e0ed350 msgr2=0x55ef1e4a20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:23.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.074+0000 7f2801d3e740 1 -- 172.21.15.1:0/1439109115 shutdown_connections 2024-09-21T00:56:23.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.074+0000 7f2801d3e740 1 -- 172.21.15.1:0/1439109115 wait complete. 2024-09-21T00:56:23.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.074+0000 7f2801d3e740 20 client.15228 trim_cache size 0 max 16384 2024-09-21T00:56:23.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.092+0000 7f2801d3e740 1 Processor -- start 2024-09-21T00:56:23.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.092+0000 7f2801d3e740 1 -- start start 2024-09-21T00:56:23.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.092+0000 7f2801d3e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef1e0b78e0 0x55ef1e49c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:23.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.092+0000 7f2801d3e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef1e0d00a0 0x55ef1e49cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:23.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.092+0000 7f2801d3e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef1e0d8280 0x55ef1e4a5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:23.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.092+0000 7f2801d3e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ef1e4bb4c0 con 0x55ef1e0b78e0 2024-09-21T00:56:23.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.092+0000 7f2801d3e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ef1e4bbb90 con 0x55ef1e0d00a0 2024-09-21T00:56:23.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.092+0000 7f2801d3e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ef1e4bc260 con 0x55ef1e0d8280 2024-09-21T00:56:23.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.092+0000 7f27f9566640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef1e0b78e0 0x55ef1e49c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:23.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.092+0000 7f27f9566640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef1e0b78e0 0x55ef1e49c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51376/0 (socket says 172.21.15.1:51376) 2024-09-21T00:56:23.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.092+0000 7f27f9566640 1 -- 172.21.15.1:0/1579168250 learned_addr learned my addr 172.21.15.1:0/1579168250 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:23.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.092+0000 7f27f8d65640 1 --2- 172.21.15.1:0/1579168250 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef1e0d00a0 0x55ef1e49cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:23.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.092+0000 7f27f9d67640 1 --2- 172.21.15.1:0/1579168250 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef1e0d8280 0x55ef1e4a5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:23.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.093+0000 7f27f9566640 1 -- 172.21.15.1:0/1579168250 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef1e0d8280 msgr2=0x55ef1e4a5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:23.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.093+0000 7f27f9566640 1 --2- 172.21.15.1:0/1579168250 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef1e0d8280 0x55ef1e4a5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:23.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.093+0000 7f27f9566640 1 -- 172.21.15.1:0/1579168250 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef1e0d00a0 msgr2=0x55ef1e49cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:23.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.093+0000 7f27f9566640 1 --2- 172.21.15.1:0/1579168250 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef1e0d00a0 0x55ef1e49cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:23.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.093+0000 7f27f9566640 1 -- 172.21.15.1:0/1579168250 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef1e4a1420 con 0x55ef1e0b78e0 2024-09-21T00:56:23.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.093+0000 7f27f8d65640 1 --2- 172.21.15.1:0/1579168250 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef1e0d00a0 0x55ef1e49cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:56:23.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.093+0000 7f27f9566640 1 --2- 172.21.15.1:0/1579168250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef1e0b78e0 0x55ef1e49c730 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f27ec005d00 tx=0x7f27ec019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785fb6c6c6346e3e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:23.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.093+0000 7f27daffd640 1 -- 172.21.15.1:0/1579168250 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ec005020 con 0x55ef1e0b78e0 2024-09-21T00:56:23.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.093+0000 7f27daffd640 1 -- 172.21.15.1:0/1579168250 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27ec0047a0 con 0x55ef1e0b78e0 2024-09-21T00:56:23.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.093+0000 7f27daffd640 1 -- 172.21.15.1:0/1579168250 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ec02a6e0 con 0x55ef1e0b78e0 2024-09-21T00:56:23.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.094+0000 7f2801d3e740 1 -- 172.21.15.1:0/1579168250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef1e0b78e0 msgr2=0x55ef1e49c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:23.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.094+0000 7f2801d3e740 1 --2- 172.21.15.1:0/1579168250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef1e0b78e0 0x55ef1e49c730 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f27ec005d00 tx=0x7f27ec019000 comp rx=0 tx=0).stop 2024-09-21T00:56:23.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.094+0000 7f2801d3e740 1 -- 172.21.15.1:0/1579168250 shutdown_connections 2024-09-21T00:56:23.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.094+0000 7f2801d3e740 1 --2- 172.21.15.1:0/1579168250 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef1e0d8280 0x55ef1e4a5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:23.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.094+0000 7f2801d3e740 1 --2- 172.21.15.1:0/1579168250 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef1e0d00a0 0x55ef1e49cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:23.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.094+0000 7f2801d3e740 1 --2- 172.21.15.1:0/1579168250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef1e0b78e0 0x55ef1e49c730 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:23.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.094+0000 7f2801d3e740 1 -- 172.21.15.1:0/1579168250 >> 172.21.15.1:0/1579168250 conn(0x55ef1e0ed350 msgr2=0x55ef1e497ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:23.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.094+0000 7f2801d3e740 1 -- 172.21.15.1:0/1579168250 shutdown_connections 2024-09-21T00:56:23.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.094+0000 7f2801d3e740 1 -- 172.21.15.1:0/1579168250 wait complete. 2024-09-21T00:56:23.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.094+0000 7f2801d3e740 1 -- start start 2024-09-21T00:56:23.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.094+0000 7f2801d3e740 1 Processor -- start 2024-09-21T00:56:23.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.095+0000 7f2801d3e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef1e0b78e0 0x55ef1e4bf450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:23.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.095+0000 7f2801d3e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef1e0d00a0 0x55ef1e4bf990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:23.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.095+0000 7f2801d3e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef1e0d8280 0x55ef1e4bfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:23.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.095+0000 7f2801d3e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ef1e4bd000 con 0x55ef1e0d00a0 2024-09-21T00:56:23.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.095+0000 7f2801d3e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ef1e4bc930 con 0x55ef1e0d8280 2024-09-21T00:56:23.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.095+0000 7f2801d3e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ef1e4bd6d0 con 0x55ef1e0b78e0 2024-09-21T00:56:23.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.095+0000 7f2801d3e740 10 client.0 _ll_register_callbacks cb 0x7f27e40a9990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:56:23.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.095+0000 7f27f8d65640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef1e0d00a0 0x55ef1e4bf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:23.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.095+0000 7f27f8d65640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef1e0d00a0 0x55ef1e4bf990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51384/0 (socket says 172.21.15.1:51384) 2024-09-21T00:56:23.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.095+0000 7f27f8d65640 1 -- 172.21.15.1:0/1638406058 learned_addr learned my addr 172.21.15.1:0/1638406058 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:23.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.095+0000 7f27f9566640 1 --2- 172.21.15.1:0/1638406058 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef1e0b78e0 0x55ef1e4bf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:23.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.095+0000 7f27f9d67640 1 --2- 172.21.15.1:0/1638406058 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef1e0d8280 0x55ef1e4bfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:23.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.095+0000 7f27f8d65640 1 -- 172.21.15.1:0/1638406058 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef1e0b78e0 msgr2=0x55ef1e4bf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:23.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.095+0000 7f27f8d65640 1 --2- 172.21.15.1:0/1638406058 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef1e0b78e0 0x55ef1e4bf450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:23.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.095+0000 7f27f8d65640 1 -- 172.21.15.1:0/1638406058 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef1e0d8280 msgr2=0x55ef1e4bfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:23.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.095+0000 7f27f8d65640 1 --2- 172.21.15.1:0/1638406058 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef1e0d8280 0x55ef1e4bfed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:23.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.095+0000 7f27f8d65640 1 -- 172.21.15.1:0/1638406058 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef1e4c4c30 con 0x55ef1e0d00a0 2024-09-21T00:56:23.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.095+0000 7f27f8d65640 1 --2- 172.21.15.1:0/1638406058 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef1e0d00a0 0x55ef1e4bf990 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f27e8009900 tx=0x7f27e8005680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cd2a2dcbe3a9a83 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:23.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.095+0000 7f27d8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:56:23.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.096+0000 7f27d8ff9640 1 -- 172.21.15.1:0/1638406058 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e8035070 con 0x55ef1e0d00a0 2024-09-21T00:56:23.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.096+0000 7f2801d3e740 1 -- 172.21.15.1:0/1638406058 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27ec0047a0 con 0x55ef1e0d00a0 2024-09-21T00:56:23.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.096+0000 7f27d8ff9640 1 -- 172.21.15.1:0/1638406058 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f27e8004230 con 0x55ef1e0d00a0 2024-09-21T00:56:23.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.096+0000 7f27d8ff9640 1 -- 172.21.15.1:0/1638406058 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f27e8045040 con 0x55ef1e0d00a0 2024-09-21T00:56:23.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.096+0000 7f2801d3e740 10 client.15234 fetch_fsmap learned FSMap version 26 2024-09-21T00:56:23.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.096+0000 7f2801d3e740 1 -- 172.21.15.1:0/1638406058 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ef1e528880 con 0x55ef1e0d00a0 2024-09-21T00:56:23.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.096+0000 7f27d8ff9640 1 -- 172.21.15.1:0/1638406058 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27ec0047a0 con 0x55ef1e0d00a0 2024-09-21T00:56:23.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.096+0000 7f27d8ff9640 1 -- 172.21.15.1:0/1638406058 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f27e803a070 con 0x55ef1e0d00a0 2024-09-21T00:56:23.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.096+0000 7f2801d3e740 10 client.15234 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T00:56:23.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.096+0000 7f2801d3e740 10 client.15234 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T00:56:23.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.096+0000 7f2801d3e740 20 client.15234 populate_metadata read hostname 'smithi001' 2024-09-21T00:56:23.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.096+0000 7f2801d3e740 1 --2- 172.21.15.1:0/1638406058 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55ef1e0f8f60 0x55ef1e52bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:23.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.096+0000 7f2801d3e740 4 client.15234 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T00:56:23.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.096+0000 7f2801d3e740 1 -- 172.21.15.1:0/1638406058 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "status"}) -- 0x55ef1e414610 con 0x55ef1e0f8f60 2024-09-21T00:56:23.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.097+0000 7f27f9566640 1 --2- 172.21.15.1:0/1638406058 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55ef1e0f8f60 0x55ef1e52bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:23.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.097+0000 7f27f9566640 1 --2- 172.21.15.1:0/1638406058 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55ef1e0f8f60 0x55ef1e52bc00 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67be5b35e5b4b245 server_cookie=f15c273d6cbb99fd in_seq=0 out_seq=0 2024-09-21T00:56:23.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.097+0000 7f27d8ff9640 10 client.15234 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:56:23.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.097+0000 7f27d8ff9640 1 -- 172.21.15.1:0/1638406058 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55ef1e414610 con 0x55ef1e0f8f60 2024-09-21T00:56:23.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.097+0000 7f27d8ff9640 10 client.15234 handle_command_reply: tid=0 2024-09-21T00:56:23.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.097+0000 7f2801d3e740 1 client.15234 shutdown 2024-09-21T00:56:23.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.097+0000 7f2801d3e740 1 -- 172.21.15.1:0/1638406058 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef1e0d00a0 msgr2=0x55ef1e4bf990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:23.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.097+0000 7f2801d3e740 1 --2- 172.21.15.1:0/1638406058 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef1e0d00a0 0x55ef1e4bf990 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f27e8009900 tx=0x7f27e8005680 comp rx=0 tx=0).stop 2024-09-21T00:56:23.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.098+0000 7f2801d3e740 1 -- 172.21.15.1:0/1638406058 shutdown_connections 2024-09-21T00:56:23.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.098+0000 7f2801d3e740 1 --2- 172.21.15.1:0/1638406058 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55ef1e0f8f60 0x55ef1e52bc00 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:23.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.098+0000 7f27d8ff9640 0 client.15234 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:56:23.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.098+0000 7f2801d3e740 1 --2- 172.21.15.1:0/1638406058 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef1e0d8280 0x55ef1e4bfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:23.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.098+0000 7f2801d3e740 1 --2- 172.21.15.1:0/1638406058 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef1e0d00a0 0x55ef1e4bf990 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:23.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.098+0000 7f2801d3e740 1 --2- 172.21.15.1:0/1638406058 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef1e0b78e0 0x55ef1e4bf450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:23.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.098+0000 7f2801d3e740 1 -- 172.21.15.1:0/1638406058 >> 172.21.15.1:0/1638406058 conn(0x55ef1e0ed350 msgr2=0x55ef1e497ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:23.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.098+0000 7f2801d3e740 1 -- 172.21.15.1:0/1638406058 shutdown_connections 2024-09-21T00:56:23.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.098+0000 7f2801d3e740 1 -- 172.21.15.1:0/1638406058 wait complete. 2024-09-21T00:56:23.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.098+0000 7f2801d3e740 20 client.15234 trim_cache size 0 max 16384 2024-09-21T00:56:23.116 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T00:56:23.116 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "d3972c20-77b2-11ef-baf5-efdc52797490", 2024-09-21T00:56:23.117 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2024-09-21T00:56:23.117 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24653, 2024-09-21T00:56:23.117 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-21T00:56:23.117 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-21T00:56:23.117 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-21T00:56:23.117 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 84.239581013000006, 2024-09-21T00:56:23.117 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 26, 2024-09-21T00:56:23.117 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 75, 2024-09-21T00:56:23.118 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 73, 2024-09-21T00:56:23.118 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 94.976788317 2024-09-21T00:56:23.118 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T00:56:23.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.098+0000 7f27fb7ca640 1 -- 172.21.15.1:0/1316273884 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f27dc0b6620 msgr2=0x7f27dc0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:23.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.098+0000 7f27fb7ca640 1 --2- 172.21.15.1:0/1316273884 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f27dc0b6620 0x7f27dc0b8b30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55ef1e49db80 tx=0x7f27ec00b410 comp rx=0 tx=0).stop 2024-09-21T00:56:23.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.098+0000 7f27fb7ca640 1 -- 172.21.15.1:0/1316273884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27f4109e20 msgr2=0x7f27f419fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:23.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.098+0000 7f27fb7ca640 1 --2- 172.21.15.1:0/1316273884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27f4109e20 0x7f27f419fd30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f27e400eb10 tx=0x7f27e400c2d0 comp rx=0 tx=0).stop 2024-09-21T00:56:23.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.099+0000 7f27fb7ca640 1 -- 172.21.15.1:0/1316273884 shutdown_connections 2024-09-21T00:56:23.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.099+0000 7f27fb7ca640 1 --2- 172.21.15.1:0/1316273884 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f27dc0b6620 0x7f27dc0b8b30 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:23.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.099+0000 7f27fb7ca640 1 --2- 172.21.15.1:0/1316273884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27f4109e20 0x7f27f419fd30 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:23.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.099+0000 7f27fb7ca640 1 --2- 172.21.15.1:0/1316273884 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27f41094d0 0x7f27f419aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:23.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.099+0000 7f27fb7ca640 1 --2- 172.21.15.1:0/1316273884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27f4103b90 0x7f27f419a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:23.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.099+0000 7f27fb7ca640 1 -- 172.21.15.1:0/1316273884 >> 172.21.15.1:0/1316273884 conn(0x7f27f40ff600 msgr2=0x7f27f4101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:23.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.099+0000 7f27fb7ca640 1 -- 172.21.15.1:0/1316273884 shutdown_connections 2024-09-21T00:56:23.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:23.099+0000 7f27fb7ca640 1 -- 172.21.15.1:0/1316273884 wait complete. 2024-09-21T00:56:23.918 INFO:tasks.cephadm:Setup complete, yielding 2024-09-21T00:56:23.918 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T00:56:23.929 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi001.front.sepia.ceph.com 2024-09-21T00:56:23.929 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- bash -c 'ceph orch status' 2024-09-21T00:56:24.192 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:24.209 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:23 smithi001 ceph-mon[31211]: pgmap v333: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T00:56:24.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:23 smithi193 ceph-mon[34660]: pgmap v333: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T00:56:24.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:23 smithi042 ceph-mon[34481]: pgmap v333: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T00:56:24.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.673+0000 7fd47fc61640 1 -- 172.21.15.1:0/4011786475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd478109480 msgr2=0x7fd47810b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:24.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.673+0000 7fd47fc61640 1 --2- 172.21.15.1:0/4011786475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd478109480 0x7fd47810b990 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd470009ca0 tx=0x7fd47002a8c0 comp rx=0 tx=0).stop 2024-09-21T00:56:24.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.673+0000 7fd47fc61640 1 -- 172.21.15.1:0/4011786475 shutdown_connections 2024-09-21T00:56:24.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.673+0000 7fd47fc61640 1 --2- 172.21.15.1:0/4011786475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd478109480 0x7fd47810b990 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:24.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.673+0000 7fd47fc61640 1 --2- 172.21.15.1:0/4011786475 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4781068e0 0x7fd478108d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:24.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.673+0000 7fd47fc61640 1 --2- 172.21.15.1:0/4011786475 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd47806c660 0x7fd4781063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:24.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.673+0000 7fd47fc61640 1 -- 172.21.15.1:0/4011786475 >> 172.21.15.1:0/4011786475 conn(0x7fd4780fdfe0 msgr2=0x7fd478100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:24.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.673+0000 7fd47fc61640 1 -- 172.21.15.1:0/4011786475 shutdown_connections 2024-09-21T00:56:24.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.673+0000 7fd47fc61640 1 -- 172.21.15.1:0/4011786475 wait complete. 2024-09-21T00:56:24.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.674+0000 7fd47fc61640 1 Processor -- start 2024-09-21T00:56:24.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.674+0000 7fd47fc61640 1 -- start start 2024-09-21T00:56:24.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.674+0000 7fd47fc61640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd47806c660 0x7fd478199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:24.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.674+0000 7fd47fc61640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4781068e0 0x7fd47819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:24.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.674+0000 7fd47fc61640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd478109480 0x7fd47819b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:24.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.674+0000 7fd47fc61640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd47810f380 con 0x7fd47806c660 2024-09-21T00:56:24.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.674+0000 7fd47fc61640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd47810f200 con 0x7fd4781068e0 2024-09-21T00:56:24.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.674+0000 7fd47fc61640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd47810f500 con 0x7fd478109480 2024-09-21T00:56:24.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.674+0000 7fd47d9fd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd47806c660 0x7fd478199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:24.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.674+0000 7fd47d9fd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd47806c660 0x7fd478199f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51414/0 (socket says 172.21.15.1:51414) 2024-09-21T00:56:24.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.674+0000 7fd47d9fd640 1 -- 172.21.15.1:0/4241729106 learned_addr learned my addr 172.21.15.1:0/4241729106 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:24.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.674+0000 7fd47d1fc640 1 --2- 172.21.15.1:0/4241729106 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4781068e0 0x7fd47819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:24.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.674+0000 7fd47d9fd640 1 -- 172.21.15.1:0/4241729106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd478109480 msgr2=0x7fd47819b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:24.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.674+0000 7fd47e1fe640 1 --2- 172.21.15.1:0/4241729106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd478109480 0x7fd47819b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:24.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.674+0000 7fd47d9fd640 1 --2- 172.21.15.1:0/4241729106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd478109480 0x7fd47819b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:24.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.675+0000 7fd47d9fd640 1 -- 172.21.15.1:0/4241729106 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4781068e0 msgr2=0x7fd47819a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:24.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.675+0000 7fd47d9fd640 1 --2- 172.21.15.1:0/4241729106 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4781068e0 0x7fd47819a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:24.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.675+0000 7fd47d9fd640 1 -- 172.21.15.1:0/4241729106 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd47819b970 con 0x7fd47806c660 2024-09-21T00:56:24.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.675+0000 7fd47d1fc640 1 --2- 172.21.15.1:0/4241729106 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4781068e0 0x7fd47819a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:56:24.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.675+0000 7fd47e1fe640 1 --2- 172.21.15.1:0/4241729106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd478109480 0x7fd47819b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:56:24.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.675+0000 7fd47d9fd640 1 --2- 172.21.15.1:0/4241729106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd47806c660 0x7fd478199f40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd47400d950 tx=0x7fd47400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:24.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.675+0000 7fd46effd640 1 -- 172.21.15.1:0/4241729106 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd474017070 con 0x7fd47806c660 2024-09-21T00:56:24.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.675+0000 7fd46effd640 1 -- 172.21.15.1:0/4241729106 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd474009c30 con 0x7fd47806c660 2024-09-21T00:56:24.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.675+0000 7fd46effd640 1 -- 172.21.15.1:0/4241729106 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47400f620 con 0x7fd47806c660 2024-09-21T00:56:24.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.675+0000 7fd47fc61640 1 -- 172.21.15.1:0/4241729106 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd47819bc60 con 0x7fd47806c660 2024-09-21T00:56:24.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.675+0000 7fd47fc61640 1 -- 172.21.15.1:0/4241729106 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4781a2360 con 0x7fd47806c660 2024-09-21T00:56:24.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.676+0000 7fd47fc61640 1 -- 172.21.15.1:0/4241729106 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4780ffb00 con 0x7fd47806c660 2024-09-21T00:56:24.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.678+0000 7fd46effd640 1 -- 172.21.15.1:0/4241729106 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7fd474010460 con 0x7fd47806c660 2024-09-21T00:56:24.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.678+0000 7fd46effd640 1 --2- 172.21.15.1:0/4241729106 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd4640b6620 0x7fd4640b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:24.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.678+0000 7fd47d1fc640 1 --2- 172.21.15.1:0/4241729106 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd4640b6620 0x7fd4640b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:24.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.679+0000 7fd46effd640 1 -- 172.21.15.1:0/4241729106 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fd4740e7150 con 0x7fd47806c660 2024-09-21T00:56:24.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.679+0000 7fd47d1fc640 1 --2- 172.21.15.1:0/4241729106 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd4640b6620 0x7fd4640b8b30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd468009b40 tx=0x7fd468005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:24.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.682+0000 7fd46effd640 1 -- 172.21.15.1:0/4241729106 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd4740ad8e0 con 0x7fd47806c660 2024-09-21T00:56:24.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.888+0000 7fd47fc61640 1 -- 172.21.15.1:0/4241729106 --> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fd478063800 con 0x7fd4640b6620 2024-09-21T00:56:24.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.889+0000 7fd46effd640 1 -- 172.21.15.1:0/4241729106 <== mgr.14150 v2:172.21.15.1:6800/2032980330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fd478063800 con 0x7fd4640b6620 2024-09-21T00:56:24.890 INFO:teuthology.orchestra.run.smithi001.stdout:Backend: cephadm 2024-09-21T00:56:24.890 INFO:teuthology.orchestra.run.smithi001.stdout:Available: Yes 2024-09-21T00:56:24.890 INFO:teuthology.orchestra.run.smithi001.stdout:Paused: No 2024-09-21T00:56:24.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.891+0000 7fd47fc61640 1 -- 172.21.15.1:0/4241729106 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd4640b6620 msgr2=0x7fd4640b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:24.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.891+0000 7fd47fc61640 1 --2- 172.21.15.1:0/4241729106 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd4640b6620 0x7fd4640b8b30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd468009b40 tx=0x7fd468005e50 comp rx=0 tx=0).stop 2024-09-21T00:56:24.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.891+0000 7fd47fc61640 1 -- 172.21.15.1:0/4241729106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd47806c660 msgr2=0x7fd478199f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:24.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.891+0000 7fd47fc61640 1 --2- 172.21.15.1:0/4241729106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd47806c660 0x7fd478199f40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd47400d950 tx=0x7fd47400de10 comp rx=0 tx=0).stop 2024-09-21T00:56:24.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.891+0000 7fd47fc61640 1 -- 172.21.15.1:0/4241729106 shutdown_connections 2024-09-21T00:56:24.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.891+0000 7fd47fc61640 1 --2- 172.21.15.1:0/4241729106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd478109480 0x7fd47819b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:24.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.891+0000 7fd47fc61640 1 --2- 172.21.15.1:0/4241729106 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4781068e0 0x7fd47819a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:24.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.891+0000 7fd47fc61640 1 --2- 172.21.15.1:0/4241729106 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd4640b6620 0x7fd4640b8b30 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:24.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.891+0000 7fd47fc61640 1 --2- 172.21.15.1:0/4241729106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd47806c660 0x7fd478199f40 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:24.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.891+0000 7fd47fc61640 1 -- 172.21.15.1:0/4241729106 >> 172.21.15.1:0/4241729106 conn(0x7fd4780fdfe0 msgr2=0x7fd478104d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:24.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.891+0000 7fd47fc61640 1 -- 172.21.15.1:0/4241729106 shutdown_connections 2024-09-21T00:56:24.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:24.891+0000 7fd47fc61640 1 -- 172.21.15.1:0/4241729106 wait complete. 2024-09-21T00:56:25.563 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ps' 2024-09-21T00:56:25.830 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:26.067 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:25 smithi001 ceph-mon[31211]: pgmap v334: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T00:56:26.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:25 smithi193 ceph-mon[34660]: pgmap v334: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T00:56:26.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:25 smithi042 ceph-mon[34481]: pgmap v334: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T00:56:26.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.306+0000 7f7ed3346640 1 -- 172.21.15.1:0/3761116657 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ecc1047e0 msgr2=0x7f7ecc104bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:26.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.306+0000 7f7ed3346640 1 --2- 172.21.15.1:0/3761116657 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ecc1047e0 0x7f7ecc104bf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc009900 tx=0x7f7ebc02a480 comp rx=0 tx=0).stop 2024-09-21T00:56:26.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.306+0000 7f7ed3346640 1 -- 172.21.15.1:0/3761116657 shutdown_connections 2024-09-21T00:56:26.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.306+0000 7f7ed3346640 1 --2- 172.21.15.1:0/3761116657 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ecc105180 0x7f7ecc10bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:26.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.306+0000 7f7ed3346640 1 --2- 172.21.15.1:0/3761116657 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ecc1047e0 0x7f7ecc104bf0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:26.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.306+0000 7f7ed3346640 1 --2- 172.21.15.1:0/3761116657 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ecc103750 0x7f7ecc103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:26.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.306+0000 7f7ed3346640 1 -- 172.21.15.1:0/3761116657 >> 172.21.15.1:0/3761116657 conn(0x7f7ecc0ff0c0 msgr2=0x7f7ecc101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:26.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.306+0000 7f7ed3346640 1 -- 172.21.15.1:0/3761116657 shutdown_connections 2024-09-21T00:56:26.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.307+0000 7f7ed3346640 1 -- 172.21.15.1:0/3761116657 wait complete. 2024-09-21T00:56:26.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.307+0000 7f7ed3346640 1 Processor -- start 2024-09-21T00:56:26.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.307+0000 7f7ed3346640 1 -- start start 2024-09-21T00:56:26.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.307+0000 7f7ed3346640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ecc103750 0x7f7ecc199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:26.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.307+0000 7f7ed3346640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ecc1047e0 0x7f7ecc19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:26.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.307+0000 7f7ed3346640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ecc105180 0x7f7ecc19b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:26.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.308+0000 7f7ed3346640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7ecc10f3d0 con 0x7f7ecc105180 2024-09-21T00:56:26.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.308+0000 7f7ed3346640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7ecc10f250 con 0x7f7ecc103750 2024-09-21T00:56:26.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.308+0000 7f7ed3346640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7ecc10f550 con 0x7f7ecc1047e0 2024-09-21T00:56:26.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.308+0000 7f7ed18e3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ecc105180 0x7f7ecc19b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:26.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.308+0000 7f7ed18e3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ecc105180 0x7f7ecc19b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51420/0 (socket says 172.21.15.1:51420) 2024-09-21T00:56:26.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.308+0000 7f7ed18e3640 1 -- 172.21.15.1:0/721352897 learned_addr learned my addr 172.21.15.1:0/721352897 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:26.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.308+0000 7f7ed10e2640 1 --2- 172.21.15.1:0/721352897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ecc103750 0x7f7ecc199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:26.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.308+0000 7f7ed08e1640 1 --2- 172.21.15.1:0/721352897 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ecc1047e0 0x7f7ecc19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:26.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.308+0000 7f7ed18e3640 1 -- 172.21.15.1:0/721352897 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ecc1047e0 msgr2=0x7f7ecc19a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:26.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.308+0000 7f7ed18e3640 1 --2- 172.21.15.1:0/721352897 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ecc1047e0 0x7f7ecc19a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:26.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.308+0000 7f7ed18e3640 1 -- 172.21.15.1:0/721352897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ecc103750 msgr2=0x7f7ecc199fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:26.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.308+0000 7f7ed18e3640 1 --2- 172.21.15.1:0/721352897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ecc103750 0x7f7ecc199fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:26.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.308+0000 7f7ed18e3640 1 -- 172.21.15.1:0/721352897 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ecc19b9f0 con 0x7f7ecc105180 2024-09-21T00:56:26.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.308+0000 7f7ed18e3640 1 --2- 172.21.15.1:0/721352897 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ecc105180 0x7f7ecc19b1d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7ec400eaa0 tx=0x7f7ec400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:26.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.308+0000 7f7ec27fc640 1 -- 172.21.15.1:0/721352897 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec400cdb0 con 0x7f7ecc105180 2024-09-21T00:56:26.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.308+0000 7f7ec27fc640 1 -- 172.21.15.1:0/721352897 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ec4005020 con 0x7f7ecc105180 2024-09-21T00:56:26.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.308+0000 7f7ed3346640 1 -- 172.21.15.1:0/721352897 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ecc19bce0 con 0x7f7ecc105180 2024-09-21T00:56:26.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.308+0000 7f7ec27fc640 1 -- 172.21.15.1:0/721352897 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec40116d0 con 0x7f7ecc105180 2024-09-21T00:56:26.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.308+0000 7f7ed3346640 1 -- 172.21.15.1:0/721352897 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ecc1a23e0 con 0x7f7ecc105180 2024-09-21T00:56:26.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.309+0000 7f7ed3346640 1 -- 172.21.15.1:0/721352897 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ecc10a910 con 0x7f7ecc105180 2024-09-21T00:56:26.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.311+0000 7f7ec27fc640 1 -- 172.21.15.1:0/721352897 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7f7ec40051d0 con 0x7f7ecc105180 2024-09-21T00:56:26.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.312+0000 7f7ec27fc640 1 --2- 172.21.15.1:0/721352897 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f7eb80b65a0 0x7f7eb80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:26.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.312+0000 7f7ed10e2640 1 --2- 172.21.15.1:0/721352897 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f7eb80b65a0 0x7f7eb80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:26.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.312+0000 7f7ec27fc640 1 -- 172.21.15.1:0/721352897 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f7ec40e7a30 con 0x7f7ecc105180 2024-09-21T00:56:26.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.312+0000 7f7ed10e2640 1 --2- 172.21.15.1:0/721352897 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f7eb80b65a0 0x7f7eb80b8ab0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7ec800bbe0 tx=0x7f7ec800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:26.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.315+0000 7f7ec27fc640 1 -- 172.21.15.1:0/721352897 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7ec4016030 con 0x7f7ecc105180 2024-09-21T00:56:26.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.547+0000 7f7ed3346640 1 -- 172.21.15.1:0/721352897 --> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f7ecc063800 con 0x7f7eb80b65a0 2024-09-21T00:56:26.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.560+0000 7f7ec27fc640 1 -- 172.21.15.1:0/721352897 <== mgr.14150 v2:172.21.15.1:6800/2032980330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7f7ecc063800 con 0x7f7eb80b65a0 2024-09-21T00:56:26.561 INFO:teuthology.orchestra.run.smithi001.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T00:56:26.561 INFO:teuthology.orchestra.run.smithi001.stdout:mds.a smithi001 running (101s) 20s ago 101s 85.0M - 19.3.0-5120-g18432218 ddce307e1f32 a4ca57f3ea3f 2024-09-21T00:56:26.561 INFO:teuthology.orchestra.run.smithi001.stdout:mds.b smithi042 running (98s) 31s ago 98s 94.1M - 19.3.0-5120-g18432218 ddce307e1f32 5092db6112c6 2024-09-21T00:56:26.561 INFO:teuthology.orchestra.run.smithi001.stdout:mds.c smithi193 running (112s) 31s ago 112s 85.8M - 19.3.0-5120-g18432218 ddce307e1f32 49e476775e4b 2024-09-21T00:56:26.561 INFO:teuthology.orchestra.run.smithi001.stdout:mds.d smithi001 running (2m) 20s ago 2m 84.4M - 19.3.0-5120-g18432218 ddce307e1f32 5e6e99b06976 2024-09-21T00:56:26.561 INFO:teuthology.orchestra.run.smithi001.stdout:mds.e smithi042 running (117s) 31s ago 117s 85.9M - 19.3.0-5120-g18432218 ddce307e1f32 6281cb41bb65 2024-09-21T00:56:26.561 INFO:teuthology.orchestra.run.smithi001.stdout:mds.f smithi193 running (115s) 31s ago 114s 85.1M - 19.3.0-5120-g18432218 ddce307e1f32 b5d5aaba5429 2024-09-21T00:56:26.561 INFO:teuthology.orchestra.run.smithi001.stdout:mds.g smithi001 running (104s) 20s ago 103s 85.1M - 19.3.0-5120-g18432218 ddce307e1f32 2cb12d8a8843 2024-09-21T00:56:26.561 INFO:teuthology.orchestra.run.smithi001.stdout:mds.h smithi042 running (110s) 31s ago 109s 85.9M - 19.3.0-5120-g18432218 ddce307e1f32 4ec141cac7f5 2024-09-21T00:56:26.561 INFO:teuthology.orchestra.run.smithi001.stdout:mds.i smithi193 running (107s) 31s ago 107s 88.0M - 19.3.0-5120-g18432218 ddce307e1f32 c9451e7e9718 2024-09-21T00:56:26.561 INFO:teuthology.orchestra.run.smithi001.stdout:mds.j smithi001 running (2m) 20s ago 2m 82.2M - 19.3.0-5120-g18432218 ddce307e1f32 c37e4c83fc0f 2024-09-21T00:56:26.561 INFO:teuthology.orchestra.run.smithi001.stdout:mds.k smithi042 running (2m) 31s ago 2m 84.2M - 19.3.0-5120-g18432218 ddce307e1f32 6434f40b0814 2024-09-21T00:56:26.562 INFO:teuthology.orchestra.run.smithi001.stdout:mds.l smithi193 running (2m) 31s ago 2m 84.8M - 19.3.0-5120-g18432218 ddce307e1f32 5d6c26317024 2024-09-21T00:56:26.562 INFO:teuthology.orchestra.run.smithi001.stdout:mgr.x smithi001 *:9283,8765 running (9m) 20s ago 9m 591M - 19.3.0-5120-g18432218 ddce307e1f32 107c19e3a41f 2024-09-21T00:56:26.562 INFO:teuthology.orchestra.run.smithi001.stdout:mgr.y smithi042 *:8443,8765 running (7m) 31s ago 7m 526M - 19.3.0-5120-g18432218 ddce307e1f32 67d58454386d 2024-09-21T00:56:26.562 INFO:teuthology.orchestra.run.smithi001.stdout:mgr.z smithi193 *:8443,8765 running (8m) 31s ago 8m 524M - 19.3.0-5120-g18432218 ddce307e1f32 e589e006b115 2024-09-21T00:56:26.562 INFO:teuthology.orchestra.run.smithi001.stdout:mon.a smithi001 running (9m) 20s ago 9m 120M 2048M 19.3.0-5120-g18432218 ddce307e1f32 cf9589d85186 2024-09-21T00:56:26.562 INFO:teuthology.orchestra.run.smithi001.stdout:mon.b smithi042 running (8m) 31s ago 8m 109M 2048M 19.3.0-5120-g18432218 ddce307e1f32 966868c6dd90 2024-09-21T00:56:26.562 INFO:teuthology.orchestra.run.smithi001.stdout:mon.c smithi193 running (8m) 31s ago 8m 108M 2048M 19.3.0-5120-g18432218 ddce307e1f32 9ad1b23dd6cd 2024-09-21T00:56:26.562 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0 smithi001 running (7m) 20s ago 7m 124M 4273M 19.3.0-5120-g18432218 ddce307e1f32 31158983a3b4 2024-09-21T00:56:26.562 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1 smithi042 running (6m) 31s ago 6m 123M 4273M 19.3.0-5120-g18432218 ddce307e1f32 448f656725e0 2024-09-21T00:56:26.562 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2 smithi193 running (6m) 31s ago 6m 123M 4272M 19.3.0-5120-g18432218 ddce307e1f32 a32da94b7928 2024-09-21T00:56:26.562 INFO:teuthology.orchestra.run.smithi001.stdout:osd.3 smithi001 running (5m) 20s ago 5m 113M 4273M 19.3.0-5120-g18432218 ddce307e1f32 013897fb6c04 2024-09-21T00:56:26.562 INFO:teuthology.orchestra.run.smithi001.stdout:osd.4 smithi042 running (5m) 31s ago 5m 121M 4273M 19.3.0-5120-g18432218 ddce307e1f32 dee95218a2de 2024-09-21T00:56:26.562 INFO:teuthology.orchestra.run.smithi001.stdout:osd.5 smithi193 running (5m) 31s ago 5m 110M 4272M 19.3.0-5120-g18432218 ddce307e1f32 17556c2233ca 2024-09-21T00:56:26.562 INFO:teuthology.orchestra.run.smithi001.stdout:osd.6 smithi001 running (4m) 20s ago 4m 120M 4273M 19.3.0-5120-g18432218 ddce307e1f32 3a7aa5000f7f 2024-09-21T00:56:26.563 INFO:teuthology.orchestra.run.smithi001.stdout:osd.7 smithi042 running (4m) 31s ago 4m 111M 4273M 19.3.0-5120-g18432218 ddce307e1f32 c1d6dbf567f5 2024-09-21T00:56:26.563 INFO:teuthology.orchestra.run.smithi001.stdout:osd.8 smithi193 running (3m) 31s ago 3m 121M 4272M 19.3.0-5120-g18432218 ddce307e1f32 8b59632f0a3a 2024-09-21T00:56:26.563 INFO:teuthology.orchestra.run.smithi001.stdout:osd.9 smithi001 running (3m) 20s ago 3m 110M 4273M 19.3.0-5120-g18432218 ddce307e1f32 3a9546a27a63 2024-09-21T00:56:26.563 INFO:teuthology.orchestra.run.smithi001.stdout:osd.10 smithi042 running (2m) 31s ago 2m 109M 4273M 19.3.0-5120-g18432218 ddce307e1f32 0a4d906df39c 2024-09-21T00:56:26.563 INFO:teuthology.orchestra.run.smithi001.stdout:osd.11 smithi193 running (2m) 31s ago 2m 107M 4272M 19.3.0-5120-g18432218 ddce307e1f32 ffbab4785aed 2024-09-21T00:56:26.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.562+0000 7f7ed3346640 1 -- 172.21.15.1:0/721352897 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f7eb80b65a0 msgr2=0x7f7eb80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:26.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.562+0000 7f7ed3346640 1 --2- 172.21.15.1:0/721352897 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f7eb80b65a0 0x7f7eb80b8ab0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7ec800bbe0 tx=0x7f7ec800b390 comp rx=0 tx=0).stop 2024-09-21T00:56:26.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.562+0000 7f7ed3346640 1 -- 172.21.15.1:0/721352897 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ecc105180 msgr2=0x7f7ecc19b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:26.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.562+0000 7f7ed3346640 1 --2- 172.21.15.1:0/721352897 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ecc105180 0x7f7ecc19b1d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7ec400eaa0 tx=0x7f7ec400ef60 comp rx=0 tx=0).stop 2024-09-21T00:56:26.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.562+0000 7f7ed3346640 1 -- 172.21.15.1:0/721352897 shutdown_connections 2024-09-21T00:56:26.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.562+0000 7f7ed3346640 1 --2- 172.21.15.1:0/721352897 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f7eb80b65a0 0x7f7eb80b8ab0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:26.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.562+0000 7f7ed3346640 1 --2- 172.21.15.1:0/721352897 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ecc105180 0x7f7ecc19b1d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:26.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.562+0000 7f7ed3346640 1 --2- 172.21.15.1:0/721352897 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ecc1047e0 0x7f7ecc19a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:26.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.562+0000 7f7ed3346640 1 --2- 172.21.15.1:0/721352897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ecc103750 0x7f7ecc199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:26.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.562+0000 7f7ed3346640 1 -- 172.21.15.1:0/721352897 >> 172.21.15.1:0/721352897 conn(0x7f7ecc0ff0c0 msgr2=0x7f7ecc107ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:26.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.562+0000 7f7ed3346640 1 -- 172.21.15.1:0/721352897 shutdown_connections 2024-09-21T00:56:26.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:26.562+0000 7f7ed3346640 1 -- 172.21.15.1:0/721352897 wait complete. 2024-09-21T00:56:27.186 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:26 smithi001 ceph-mon[31211]: from='client.15240 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:27.213 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ls' 2024-09-21T00:56:27.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:26 smithi193 ceph-mon[34660]: from='client.15240 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:27.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:26 smithi042 ceph-mon[34481]: from='client.15240 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:27.468 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:27.898 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:27 smithi001 ceph-mon[31211]: pgmap v335: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:56:27.898 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:27 smithi001 ceph-mon[31211]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:27.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.990+0000 7fa834112640 1 -- 172.21.15.1:0/3032523095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa82c103750 msgr2=0x7fa82c103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:27.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.990+0000 7fa834112640 1 --2- 172.21.15.1:0/3032523095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa82c103750 0x7fa82c103bc0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa828009ca0 tx=0x7fa82802a950 comp rx=0 tx=0).stop 2024-09-21T00:56:27.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.990+0000 7fa834112640 1 -- 172.21.15.1:0/3032523095 shutdown_connections 2024-09-21T00:56:27.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.990+0000 7fa834112640 1 --2- 172.21.15.1:0/3032523095 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa82c105180 0x7fa82c10bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:27.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.990+0000 7fa834112640 1 --2- 172.21.15.1:0/3032523095 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa82c1047e0 0x7fa82c104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:27.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.990+0000 7fa834112640 1 --2- 172.21.15.1:0/3032523095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa82c103750 0x7fa82c103bc0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:27.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.990+0000 7fa834112640 1 -- 172.21.15.1:0/3032523095 >> 172.21.15.1:0/3032523095 conn(0x7fa82c0ff0c0 msgr2=0x7fa82c101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:27.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.990+0000 7fa834112640 1 -- 172.21.15.1:0/3032523095 shutdown_connections 2024-09-21T00:56:27.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.990+0000 7fa834112640 1 -- 172.21.15.1:0/3032523095 wait complete. 2024-09-21T00:56:27.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.991+0000 7fa834112640 1 Processor -- start 2024-09-21T00:56:27.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.991+0000 7fa834112640 1 -- start start 2024-09-21T00:56:27.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.991+0000 7fa834112640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa82c103750 0x7fa82c076dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:27.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.991+0000 7fa834112640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa82c1047e0 0x7fa82c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:27.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.991+0000 7fa834112640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa82c105180 0x7fa82c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:27.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.991+0000 7fa834112640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c10f370 con 0x7fa82c1047e0 2024-09-21T00:56:27.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.991+0000 7fa834112640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c10f1f0 con 0x7fa82c103750 2024-09-21T00:56:27.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.991+0000 7fa834112640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c10f4f0 con 0x7fa82c105180 2024-09-21T00:56:27.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.991+0000 7fa8316ad640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa82c1047e0 0x7fa82c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:27.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.991+0000 7fa831eae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa82c103750 0x7fa82c076dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:27.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.991+0000 7fa8316ad640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa82c1047e0 0x7fa82c075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51430/0 (socket says 172.21.15.1:51430) 2024-09-21T00:56:27.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.991+0000 7fa8316ad640 1 -- 172.21.15.1:0/4186939879 learned_addr learned my addr 172.21.15.1:0/4186939879 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:27.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.991+0000 7fa8326af640 1 --2- 172.21.15.1:0/4186939879 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa82c105180 0x7fa82c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:27.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.991+0000 7fa8316ad640 1 -- 172.21.15.1:0/4186939879 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa82c105180 msgr2=0x7fa82c075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:27.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.991+0000 7fa8316ad640 1 --2- 172.21.15.1:0/4186939879 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa82c105180 0x7fa82c075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:27.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.991+0000 7fa8316ad640 1 -- 172.21.15.1:0/4186939879 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa82c103750 msgr2=0x7fa82c076dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:27.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.991+0000 7fa8316ad640 1 --2- 172.21.15.1:0/4186939879 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa82c103750 0x7fa82c076dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:27.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.991+0000 7fa8316ad640 1 -- 172.21.15.1:0/4186939879 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa82c0762f0 con 0x7fa82c1047e0 2024-09-21T00:56:27.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.991+0000 7fa8326af640 1 --2- 172.21.15.1:0/4186939879 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa82c105180 0x7fa82c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:56:27.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.992+0000 7fa8316ad640 1 --2- 172.21.15.1:0/4186939879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa82c1047e0 0x7fa82c075710 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa81c00c890 tx=0x7fa81c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:27.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.992+0000 7fa822ffd640 1 -- 172.21.15.1:0/4186939879 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81c004220 con 0x7fa82c1047e0 2024-09-21T00:56:27.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.992+0000 7fa822ffd640 1 -- 172.21.15.1:0/4186939879 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa81c0043c0 con 0x7fa82c1047e0 2024-09-21T00:56:27.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.992+0000 7fa834112640 1 -- 172.21.15.1:0/4186939879 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa82c1a40b0 con 0x7fa82c1047e0 2024-09-21T00:56:27.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.992+0000 7fa822ffd640 1 -- 172.21.15.1:0/4186939879 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81c004a00 con 0x7fa82c1047e0 2024-09-21T00:56:27.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.992+0000 7fa834112640 1 -- 172.21.15.1:0/4186939879 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa82c1a44b0 con 0x7fa82c1047e0 2024-09-21T00:56:27.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.993+0000 7fa834112640 1 -- 172.21.15.1:0/4186939879 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa82c10a930 con 0x7fa82c1047e0 2024-09-21T00:56:27.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.994+0000 7fa822ffd640 1 -- 172.21.15.1:0/4186939879 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 154562+0+0 (secure 0 0 0) 0x7fa81c0079b0 con 0x7fa82c1047e0 2024-09-21T00:56:27.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.995+0000 7fa822ffd640 1 --2- 172.21.15.1:0/4186939879 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa8180b65a0 0x7fa8180b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:27.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.996+0000 7fa831eae640 1 --2- 172.21.15.1:0/4186939879 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa8180b65a0 0x7fa8180b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:27.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.996+0000 7fa822ffd640 1 -- 172.21.15.1:0/4186939879 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fa81c0e7330 con 0x7fa82c1047e0 2024-09-21T00:56:27.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:27.996+0000 7fa831eae640 1 --2- 172.21.15.1:0/4186939879 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa8180b65a0 0x7fa8180b8ab0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa82802f8d0 tx=0x7fa828009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:28.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:28.000+0000 7fa822ffd640 1 -- 172.21.15.1:0/4186939879 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa81c014030 con 0x7fa82c1047e0 2024-09-21T00:56:28.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:28.198+0000 7fa834112640 1 -- 172.21.15.1:0/4186939879 --> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fa82c063800 con 0x7fa8180b65a0 2024-09-21T00:56:28.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:28.205+0000 7fa822ffd640 1 -- 172.21.15.1:0/4186939879 <== mgr.14150 v2:172.21.15.1:6800/2032980330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fa82c063800 con 0x7fa8180b65a0 2024-09-21T00:56:28.205 INFO:teuthology.orchestra.run.smithi001.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-21T00:56:28.205 INFO:teuthology.orchestra.run.smithi001.stdout:mds.all 12/12 33s ago 2m smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi042=b;smithi042=e;smithi042=h;smithi042=k;smithi193=c;smithi193=f;smithi193=i;smithi193=l;count:12 2024-09-21T00:56:28.205 INFO:teuthology.orchestra.run.smithi001.stdout:mgr 3/3 33s ago 8m smithi001=x;smithi042=y;smithi193=z;count:3 2024-09-21T00:56:28.205 INFO:teuthology.orchestra.run.smithi001.stdout:mon 3/3 33s ago 8m smithi001:172.21.15.1=a;smithi042:172.21.15.42=b;smithi193:172.21.15.193=c;count:3 2024-09-21T00:56:28.206 INFO:teuthology.orchestra.run.smithi001.stdout:osd 12 33s ago - 2024-09-21T00:56:28.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:28.207+0000 7fa834112640 1 -- 172.21.15.1:0/4186939879 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa8180b65a0 msgr2=0x7fa8180b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:28.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:28.207+0000 7fa834112640 1 --2- 172.21.15.1:0/4186939879 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa8180b65a0 0x7fa8180b8ab0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa82802f8d0 tx=0x7fa828009360 comp rx=0 tx=0).stop 2024-09-21T00:56:28.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:28.207+0000 7fa834112640 1 -- 172.21.15.1:0/4186939879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa82c1047e0 msgr2=0x7fa82c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:28.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:28.207+0000 7fa834112640 1 --2- 172.21.15.1:0/4186939879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa82c1047e0 0x7fa82c075710 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa81c00c890 tx=0x7fa81c00cd50 comp rx=0 tx=0).stop 2024-09-21T00:56:28.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:28.207+0000 7fa834112640 1 -- 172.21.15.1:0/4186939879 shutdown_connections 2024-09-21T00:56:28.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:28.207+0000 7fa834112640 1 --2- 172.21.15.1:0/4186939879 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa82c105180 0x7fa82c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:28.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:28.207+0000 7fa834112640 1 --2- 172.21.15.1:0/4186939879 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa8180b65a0 0x7fa8180b8ab0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:28.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:28.207+0000 7fa834112640 1 --2- 172.21.15.1:0/4186939879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa82c1047e0 0x7fa82c075710 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:28.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:28.207+0000 7fa834112640 1 --2- 172.21.15.1:0/4186939879 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa82c103750 0x7fa82c076dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:28.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:28.207+0000 7fa834112640 1 -- 172.21.15.1:0/4186939879 >> 172.21.15.1:0/4186939879 conn(0x7fa82c0ff0c0 msgr2=0x7fa82c107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:28.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:28.207+0000 7fa834112640 1 -- 172.21.15.1:0/4186939879 shutdown_connections 2024-09-21T00:56:28.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:28.207+0000 7fa834112640 1 -- 172.21.15.1:0/4186939879 wait complete. 2024-09-21T00:56:28.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:27 smithi193 ceph-mon[34660]: pgmap v335: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:56:28.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:27 smithi193 ceph-mon[34660]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:28.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:27 smithi042 ceph-mon[34481]: pgmap v335: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:56:28.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:27 smithi042 ceph-mon[34481]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:28.893 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- bash -c 'ceph orch host ls' 2024-09-21T00:56:29.151 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:29.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.641+0000 7f3513b78640 1 -- 172.21.15.1:0/534866646 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f350c108cf0 msgr2=0x7f350c10b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:29.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.641+0000 7f3513b78640 1 --2- 172.21.15.1:0/534866646 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f350c108cf0 0x7f350c10b110 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f34fc009900 tx=0x7f34fc02a410 comp rx=0 tx=0).stop 2024-09-21T00:56:29.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.641+0000 7f3513b78640 1 -- 172.21.15.1:0/534866646 shutdown_connections 2024-09-21T00:56:29.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.641+0000 7f3513b78640 1 --2- 172.21.15.1:0/534866646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f350c10b6a0 0x7f350c10dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:29.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.641+0000 7f3513b78640 1 --2- 172.21.15.1:0/534866646 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f350c108cf0 0x7f350c10b110 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:29.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.641+0000 7f3513b78640 1 --2- 172.21.15.1:0/534866646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f350c06c4d0 0x7f350c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:29.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.641+0000 7f3513b78640 1 -- 172.21.15.1:0/534866646 >> 172.21.15.1:0/534866646 conn(0x7f350c0fdfd0 msgr2=0x7f350c100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:29.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.641+0000 7f3513b78640 1 -- 172.21.15.1:0/534866646 shutdown_connections 2024-09-21T00:56:29.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.641+0000 7f3513b78640 1 -- 172.21.15.1:0/534866646 wait complete. 2024-09-21T00:56:29.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.642+0000 7f3513b78640 1 Processor -- start 2024-09-21T00:56:29.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.642+0000 7f3513b78640 1 -- start start 2024-09-21T00:56:29.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.642+0000 7f3513b78640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f350c06c4d0 0x7f350c19c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:29.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.642+0000 7f3513b78640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f350c108cf0 0x7f350c19c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:29.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.642+0000 7f3513b78640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f350c10b6a0 0x7f350c19d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:29.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.642+0000 7f3513b78640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f350c111590 con 0x7f350c06c4d0 2024-09-21T00:56:29.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.642+0000 7f3513b78640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f350c111410 con 0x7f350c108cf0 2024-09-21T00:56:29.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.642+0000 7f3513b78640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f350c111710 con 0x7f350c10b6a0 2024-09-21T00:56:29.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.642+0000 7f3511914640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f350c06c4d0 0x7f350c19c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:29.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.642+0000 7f3511113640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f350c108cf0 0x7f350c19c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:29.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.642+0000 7f3511914640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f350c06c4d0 0x7f350c19c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58496/0 (socket says 172.21.15.1:58496) 2024-09-21T00:56:29.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.642+0000 7f3511914640 1 -- 172.21.15.1:0/3348651992 learned_addr learned my addr 172.21.15.1:0/3348651992 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:29.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.642+0000 7f3512115640 1 --2- 172.21.15.1:0/3348651992 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f350c10b6a0 0x7f350c19d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:29.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.642+0000 7f3511914640 1 -- 172.21.15.1:0/3348651992 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f350c10b6a0 msgr2=0x7f350c19d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:29.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.642+0000 7f3511914640 1 --2- 172.21.15.1:0/3348651992 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f350c10b6a0 0x7f350c19d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:29.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.642+0000 7f3511914640 1 -- 172.21.15.1:0/3348651992 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f350c108cf0 msgr2=0x7f350c19c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:29.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.642+0000 7f3511914640 1 --2- 172.21.15.1:0/3348651992 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f350c108cf0 0x7f350c19c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:29.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.642+0000 7f3511914640 1 -- 172.21.15.1:0/3348651992 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f350c19dbe0 con 0x7f350c06c4d0 2024-09-21T00:56:29.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.642+0000 7f3512115640 1 --2- 172.21.15.1:0/3348651992 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f350c10b6a0 0x7f350c19d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:56:29.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.643+0000 7f3511113640 1 --2- 172.21.15.1:0/3348651992 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f350c108cf0 0x7f350c19c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:56:29.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.643+0000 7f3511914640 1 --2- 172.21.15.1:0/3348651992 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f350c06c4d0 0x7f350c19c240 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f350800c920 tx=0x7f350800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:29.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.643+0000 7f3502ffd640 1 -- 172.21.15.1:0/3348651992 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3508007c70 con 0x7f350c06c4d0 2024-09-21T00:56:29.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.643+0000 7f3502ffd640 1 -- 172.21.15.1:0/3348651992 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3508007e10 con 0x7f350c06c4d0 2024-09-21T00:56:29.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.643+0000 7f3513b78640 1 -- 172.21.15.1:0/3348651992 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f350c19ded0 con 0x7f350c06c4d0 2024-09-21T00:56:29.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.643+0000 7f3502ffd640 1 -- 172.21.15.1:0/3348651992 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3508018820 con 0x7f350c06c4d0 2024-09-21T00:56:29.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.643+0000 7f3513b78640 1 -- 172.21.15.1:0/3348651992 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f350c1a4660 con 0x7f350c06c4d0 2024-09-21T00:56:29.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.644+0000 7f3513b78640 1 -- 172.21.15.1:0/3348651992 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f350c0ffaf0 con 0x7f350c06c4d0 2024-09-21T00:56:29.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.646+0000 7f3502ffd640 1 -- 172.21.15.1:0/3348651992 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 154511+0+0 (secure 0 0 0) 0x7f350800f450 con 0x7f350c06c4d0 2024-09-21T00:56:29.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.647+0000 7f3502ffd640 1 --2- 172.21.15.1:0/3348651992 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f34f80b6590 0x7f34f80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:29.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.647+0000 7f3511113640 1 --2- 172.21.15.1:0/3348651992 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f34f80b6590 0x7f34f80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:29.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.647+0000 7f3502ffd640 1 -- 172.21.15.1:0/3348651992 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f35080e7710 con 0x7f350c06c4d0 2024-09-21T00:56:29.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.648+0000 7f3511113640 1 --2- 172.21.15.1:0/3348651992 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f34f80b6590 0x7f34f80b8aa0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f34fc000c00 tx=0x7f34fc031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:29.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.651+0000 7f3502ffd640 1 -- 172.21.15.1:0/3348651992 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3508014030 con 0x7f350c06c4d0 2024-09-21T00:56:29.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.848+0000 7f3513b78640 1 -- 172.21.15.1:0/3348651992 --> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f350c063800 con 0x7f34f80b6590 2024-09-21T00:56:29.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.850+0000 7f3502ffd640 1 -- 172.21.15.1:0/3348651992 <== mgr.14150 v2:172.21.15.1:6800/2032980330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f350c063800 con 0x7f34f80b6590 2024-09-21T00:56:29.851 INFO:teuthology.orchestra.run.smithi001.stdout:HOST ADDR LABELS STATUS 2024-09-21T00:56:29.852 INFO:teuthology.orchestra.run.smithi001.stdout:smithi001 172.21.15.1 2024-09-21T00:56:29.852 INFO:teuthology.orchestra.run.smithi001.stdout:smithi042 172.21.15.42 2024-09-21T00:56:29.852 INFO:teuthology.orchestra.run.smithi001.stdout:smithi193 172.21.15.193 2024-09-21T00:56:29.852 INFO:teuthology.orchestra.run.smithi001.stdout:3 hosts in cluster 2024-09-21T00:56:29.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.852+0000 7f3513b78640 1 -- 172.21.15.1:0/3348651992 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f34f80b6590 msgr2=0x7f34f80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:29.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.852+0000 7f3513b78640 1 --2- 172.21.15.1:0/3348651992 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f34f80b6590 0x7f34f80b8aa0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f34fc000c00 tx=0x7f34fc031400 comp rx=0 tx=0).stop 2024-09-21T00:56:29.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.852+0000 7f3513b78640 1 -- 172.21.15.1:0/3348651992 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f350c06c4d0 msgr2=0x7f350c19c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:29.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.852+0000 7f3513b78640 1 --2- 172.21.15.1:0/3348651992 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f350c06c4d0 0x7f350c19c240 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f350800c920 tx=0x7f350800cde0 comp rx=0 tx=0).stop 2024-09-21T00:56:29.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.852+0000 7f3513b78640 1 -- 172.21.15.1:0/3348651992 shutdown_connections 2024-09-21T00:56:29.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.852+0000 7f3513b78640 1 --2- 172.21.15.1:0/3348651992 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f350c10b6a0 0x7f350c19d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:29.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.852+0000 7f3513b78640 1 --2- 172.21.15.1:0/3348651992 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f350c108cf0 0x7f350c19c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:29.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.852+0000 7f3513b78640 1 --2- 172.21.15.1:0/3348651992 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f34f80b6590 0x7f34f80b8aa0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:29.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.852+0000 7f3513b78640 1 --2- 172.21.15.1:0/3348651992 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f350c06c4d0 0x7f350c19c240 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:29.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.852+0000 7f3513b78640 1 -- 172.21.15.1:0/3348651992 >> 172.21.15.1:0/3348651992 conn(0x7f350c0fdfd0 msgr2=0x7f350c109b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:29.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.853+0000 7f3513b78640 1 -- 172.21.15.1:0/3348651992 shutdown_connections 2024-09-21T00:56:29.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:29.853+0000 7f3513b78640 1 -- 172.21.15.1:0/3348651992 wait complete. 2024-09-21T00:56:30.169 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:29 smithi001 ceph-mon[31211]: pgmap v336: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:56:30.169 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:29 smithi001 ceph-mon[31211]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:30.169 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:29 smithi001 ceph-mon[31211]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-21T00:56:30.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:29 smithi193 ceph-mon[34660]: pgmap v336: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:56:30.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:29 smithi193 ceph-mon[34660]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:30.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:29 smithi193 ceph-mon[34660]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-21T00:56:30.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:29 smithi042 ceph-mon[34481]: pgmap v336: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:56:30.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:29 smithi042 ceph-mon[34481]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:30.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:29 smithi042 ceph-mon[34481]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-21T00:56:30.610 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- bash -c 'ceph orch device ls' 2024-09-21T00:56:30.867 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:30.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:30 smithi001 ceph-mon[31211]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:31.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:30 smithi193 ceph-mon[34660]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:31.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:30 smithi042 ceph-mon[34481]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:31.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.384+0000 7f6d3c610640 1 -- 172.21.15.1:0/3214669340 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d34102640 msgr2=0x7f6d34102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:31.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.384+0000 7f6d3c610640 1 --2- 172.21.15.1:0/3214669340 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d34102640 0x7f6d34102ab0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6d30009900 tx=0x7f6d3002a480 comp rx=0 tx=0).stop 2024-09-21T00:56:31.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.384+0000 7f6d3c610640 1 -- 172.21.15.1:0/3214669340 shutdown_connections 2024-09-21T00:56:31.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.384+0000 7f6d3c610640 1 --2- 172.21.15.1:0/3214669340 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d34104070 0x7f6d3410aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:31.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.384+0000 7f6d3c610640 1 --2- 172.21.15.1:0/3214669340 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d341036d0 0x7f6d34103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:31.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.384+0000 7f6d3c610640 1 --2- 172.21.15.1:0/3214669340 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d34102640 0x7f6d34102ab0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:31.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.384+0000 7f6d3c610640 1 -- 172.21.15.1:0/3214669340 >> 172.21.15.1:0/3214669340 conn(0x7f6d340fdfb0 msgr2=0x7f6d34100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:31.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.384+0000 7f6d3c610640 1 -- 172.21.15.1:0/3214669340 shutdown_connections 2024-09-21T00:56:31.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.384+0000 7f6d3c610640 1 -- 172.21.15.1:0/3214669340 wait complete. 2024-09-21T00:56:31.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.385+0000 7f6d3c610640 1 Processor -- start 2024-09-21T00:56:31.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.385+0000 7f6d3c610640 1 -- start start 2024-09-21T00:56:31.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.385+0000 7f6d3c610640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d34102640 0x7f6d3406b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:31.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.385+0000 7f6d3c610640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d341036d0 0x7f6d3419ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:31.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.385+0000 7f6d3c610640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d34104070 0x7f6d341a1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:31.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.385+0000 7f6d3c610640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3410e280 con 0x7f6d34102640 2024-09-21T00:56:31.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.385+0000 7f6d3c610640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3410e100 con 0x7f6d34104070 2024-09-21T00:56:31.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.385+0000 7f6d3c610640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3410e400 con 0x7f6d341036d0 2024-09-21T00:56:31.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.385+0000 7f6d3a3ac640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d34102640 0x7f6d3406b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:31.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.385+0000 7f6d3a3ac640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d34102640 0x7f6d3406b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58504/0 (socket says 172.21.15.1:58504) 2024-09-21T00:56:31.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.385+0000 7f6d3a3ac640 1 -- 172.21.15.1:0/2816445560 learned_addr learned my addr 172.21.15.1:0/2816445560 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:31.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.386+0000 7f6d39bab640 1 --2- 172.21.15.1:0/2816445560 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d341036d0 0x7f6d3419ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:31.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.386+0000 7f6d3abad640 1 --2- 172.21.15.1:0/2816445560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d34104070 0x7f6d341a1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:31.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.386+0000 7f6d3a3ac640 1 -- 172.21.15.1:0/2816445560 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d341036d0 msgr2=0x7f6d3419ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:31.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.386+0000 7f6d3a3ac640 1 --2- 172.21.15.1:0/2816445560 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d341036d0 0x7f6d3419ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:31.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.386+0000 7f6d3a3ac640 1 -- 172.21.15.1:0/2816445560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d34104070 msgr2=0x7f6d341a1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:31.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.386+0000 7f6d3a3ac640 1 --2- 172.21.15.1:0/2816445560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d34104070 0x7f6d341a1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:31.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.386+0000 7f6d3a3ac640 1 -- 172.21.15.1:0/2816445560 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d341a1a50 con 0x7f6d34102640 2024-09-21T00:56:31.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.386+0000 7f6d3abad640 1 --2- 172.21.15.1:0/2816445560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d34104070 0x7f6d341a1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:56:31.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.386+0000 7f6d3a3ac640 1 --2- 172.21.15.1:0/2816445560 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d34102640 0x7f6d3406b6a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6d30006010 tx=0x7f6d30031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:31.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.386+0000 7f6d2b7fe640 1 -- 172.21.15.1:0/2816445560 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3003f030 con 0x7f6d34102640 2024-09-21T00:56:31.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.386+0000 7f6d3c610640 1 -- 172.21.15.1:0/2816445560 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d341a1ce0 con 0x7f6d34102640 2024-09-21T00:56:31.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.386+0000 7f6d2b7fe640 1 -- 172.21.15.1:0/2816445560 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d30003aa0 con 0x7f6d34102640 2024-09-21T00:56:31.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.386+0000 7f6d2b7fe640 1 -- 172.21.15.1:0/2816445560 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d30035070 con 0x7f6d34102640 2024-09-21T00:56:31.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.386+0000 7f6d3c610640 1 -- 172.21.15.1:0/2816445560 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d341a21c0 con 0x7f6d34102640 2024-09-21T00:56:31.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.387+0000 7f6d3c610640 1 -- 172.21.15.1:0/2816445560 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d34109820 con 0x7f6d34102640 2024-09-21T00:56:31.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.389+0000 7f6d2b7fe640 1 -- 172.21.15.1:0/2816445560 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 154511+0+0 (secure 0 0 0) 0x7f6d30042030 con 0x7f6d34102640 2024-09-21T00:56:31.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.390+0000 7f6d2b7fe640 1 --2- 172.21.15.1:0/2816445560 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6d200b6510 0x7f6d200b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:31.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.390+0000 7f6d39bab640 1 --2- 172.21.15.1:0/2816445560 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6d200b6510 0x7f6d200b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:31.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.390+0000 7f6d2b7fe640 1 -- 172.21.15.1:0/2816445560 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f6d301080e0 con 0x7f6d34102640 2024-09-21T00:56:31.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.390+0000 7f6d39bab640 1 --2- 172.21.15.1:0/2816445560 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6d200b6510 0x7f6d200b8a20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6d24005fd0 tx=0x7f6d24005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:31.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.393+0000 7f6d2b7fe640 1 -- 172.21.15.1:0/2816445560 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6d300ce8f0 con 0x7f6d34102640 2024-09-21T00:56:31.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.588+0000 7f6d3c610640 1 -- 172.21.15.1:0/2816445560 --> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f6d34063800 con 0x7f6d200b6510 2024-09-21T00:56:31.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.590+0000 7f6d2b7fe640 1 -- 172.21.15.1:0/2816445560 <== mgr.14150 v2:172.21.15.1:6800/2032980330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f6d34063800 con 0x7f6d200b6510 2024-09-21T00:56:31.592 INFO:teuthology.orchestra.run.smithi001.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-21T00:56:31.592 INFO:teuthology.orchestra.run.smithi001.stdout:smithi001 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7513000D480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-21T00:56:31.592 INFO:teuthology.orchestra.run.smithi001.stdout:smithi042 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB75130021480DGN 447G No 2m ago Has a FileSystem, LVM detected 2024-09-21T00:56:31.592 INFO:teuthology.orchestra.run.smithi001.stdout:smithi193 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620500HB400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-21T00:56:31.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.593+0000 7f6d3c610640 1 -- 172.21.15.1:0/2816445560 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6d200b6510 msgr2=0x7f6d200b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:31.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.593+0000 7f6d3c610640 1 --2- 172.21.15.1:0/2816445560 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6d200b6510 0x7f6d200b8a20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6d24005fd0 tx=0x7f6d24005850 comp rx=0 tx=0).stop 2024-09-21T00:56:31.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.593+0000 7f6d3c610640 1 -- 172.21.15.1:0/2816445560 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d34102640 msgr2=0x7f6d3406b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:31.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.593+0000 7f6d3c610640 1 --2- 172.21.15.1:0/2816445560 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d34102640 0x7f6d3406b6a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6d30006010 tx=0x7f6d30031a50 comp rx=0 tx=0).stop 2024-09-21T00:56:31.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.593+0000 7f6d3c610640 1 -- 172.21.15.1:0/2816445560 shutdown_connections 2024-09-21T00:56:31.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.593+0000 7f6d3c610640 1 --2- 172.21.15.1:0/2816445560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d34104070 0x7f6d341a1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:31.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.593+0000 7f6d3c610640 1 --2- 172.21.15.1:0/2816445560 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d341036d0 0x7f6d3419ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:31.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.593+0000 7f6d3c610640 1 --2- 172.21.15.1:0/2816445560 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6d200b6510 0x7f6d200b8a20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:31.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.593+0000 7f6d3c610640 1 --2- 172.21.15.1:0/2816445560 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d34102640 0x7f6d3406b6a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:31.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.593+0000 7f6d3c610640 1 -- 172.21.15.1:0/2816445560 >> 172.21.15.1:0/2816445560 conn(0x7f6d340fdfb0 msgr2=0x7f6d341069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:31.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.594+0000 7f6d3c610640 1 -- 172.21.15.1:0/2816445560 shutdown_connections 2024-09-21T00:56:31.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:31.594+0000 7f6d3c610640 1 -- 172.21.15.1:0/2816445560 wait complete. 2024-09-21T00:56:31.896 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:31 smithi001 ceph-mon[31211]: pgmap v337: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-21T00:56:32.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:31 smithi193 ceph-mon[34660]: pgmap v337: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-21T00:56:32.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:31 smithi042 ceph-mon[34481]: pgmap v337: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-21T00:56:32.351 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T00:56:32.360 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi001.front.sepia.ceph.com 2024-09-21T00:56:32.360 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T00:56:32.617 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:32.866 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:32 smithi001 ceph-mon[31211]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:33.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.095+0000 7fa38e692640 1 -- 172.21.15.1:0/2095339847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa388105180 msgr2=0x7fa38810bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:33.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.095+0000 7fa38e692640 1 --2- 172.21.15.1:0/2095339847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa388105180 0x7fa38810bb20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa380009ca0 tx=0x7fa38002a950 comp rx=0 tx=0).stop 2024-09-21T00:56:33.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.095+0000 7fa38e692640 1 -- 172.21.15.1:0/2095339847 shutdown_connections 2024-09-21T00:56:33.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.095+0000 7fa38e692640 1 --2- 172.21.15.1:0/2095339847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa388105180 0x7fa38810bb20 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:33.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.095+0000 7fa38e692640 1 --2- 172.21.15.1:0/2095339847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3881047e0 0x7fa388104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:33.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.095+0000 7fa38e692640 1 --2- 172.21.15.1:0/2095339847 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa388103750 0x7fa388103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:33.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.095+0000 7fa38e692640 1 -- 172.21.15.1:0/2095339847 >> 172.21.15.1:0/2095339847 conn(0x7fa3880ff0c0 msgr2=0x7fa388101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:33.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.095+0000 7fa38e692640 1 -- 172.21.15.1:0/2095339847 shutdown_connections 2024-09-21T00:56:33.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.095+0000 7fa38e692640 1 -- 172.21.15.1:0/2095339847 wait complete. 2024-09-21T00:56:33.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.095+0000 7fa38e692640 1 Processor -- start 2024-09-21T00:56:33.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.095+0000 7fa38e692640 1 -- start start 2024-09-21T00:56:33.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.096+0000 7fa38e692640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa388103750 0x7fa388199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:33.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.096+0000 7fa38e692640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3881047e0 0x7fa38819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:33.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.096+0000 7fa38e692640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa388105180 0x7fa38819b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:33.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.096+0000 7fa38e692640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa38810f3a0 con 0x7fa388103750 2024-09-21T00:56:33.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.096+0000 7fa38e692640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa38810f220 con 0x7fa3881047e0 2024-09-21T00:56:33.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.096+0000 7fa38e692640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa38810f520 con 0x7fa388105180 2024-09-21T00:56:33.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.096+0000 7fa387fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa388103750 0x7fa388199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:33.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.096+0000 7fa387fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa388103750 0x7fa388199f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58522/0 (socket says 172.21.15.1:58522) 2024-09-21T00:56:33.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.096+0000 7fa387fff640 1 -- 172.21.15.1:0/3579629098 learned_addr learned my addr 172.21.15.1:0/3579629098 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:33.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.096+0000 7fa38cc2f640 1 --2- 172.21.15.1:0/3579629098 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa388105180 0x7fa38819b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:33.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.096+0000 7fa3877fe640 1 --2- 172.21.15.1:0/3579629098 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3881047e0 0x7fa38819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:33.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.096+0000 7fa387fff640 1 -- 172.21.15.1:0/3579629098 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa388105180 msgr2=0x7fa38819b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:33.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.096+0000 7fa387fff640 1 --2- 172.21.15.1:0/3579629098 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa388105180 0x7fa38819b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:33.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.096+0000 7fa387fff640 1 -- 172.21.15.1:0/3579629098 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3881047e0 msgr2=0x7fa38819a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:33.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.096+0000 7fa387fff640 1 --2- 172.21.15.1:0/3579629098 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3881047e0 0x7fa38819a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:33.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.096+0000 7fa387fff640 1 -- 172.21.15.1:0/3579629098 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa38819b9c0 con 0x7fa388103750 2024-09-21T00:56:33.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.096+0000 7fa3877fe640 1 --2- 172.21.15.1:0/3579629098 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3881047e0 0x7fa38819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:56:33.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.097+0000 7fa387fff640 1 --2- 172.21.15.1:0/3579629098 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa388103750 0x7fa388199f90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa37800d770 tx=0x7fa37800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:33.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.097+0000 7fa3857fa640 1 -- 172.21.15.1:0/3579629098 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa378017070 con 0x7fa388103750 2024-09-21T00:56:33.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.097+0000 7fa38e692640 1 -- 172.21.15.1:0/3579629098 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa38819bcb0 con 0x7fa388103750 2024-09-21T00:56:33.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.097+0000 7fa3857fa640 1 -- 172.21.15.1:0/3579629098 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3780054d0 con 0x7fa388103750 2024-09-21T00:56:33.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.097+0000 7fa3857fa640 1 -- 172.21.15.1:0/3579629098 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa378004c30 con 0x7fa388103750 2024-09-21T00:56:33.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.097+0000 7fa38e692640 1 -- 172.21.15.1:0/3579629098 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3881a23b0 con 0x7fa388103750 2024-09-21T00:56:33.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.098+0000 7fa38e692640 1 -- 172.21.15.1:0/3579629098 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa388103bc0 con 0x7fa388103750 2024-09-21T00:56:33.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.099+0000 7fa3857fa640 1 -- 172.21.15.1:0/3579629098 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 154511+0+0 (secure 0 0 0) 0x7fa378004dd0 con 0x7fa388103750 2024-09-21T00:56:33.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.100+0000 7fa3857fa640 1 --2- 172.21.15.1:0/3579629098 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa3700b6510 0x7fa3700b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:33.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.100+0000 7fa3877fe640 1 --2- 172.21.15.1:0/3579629098 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa3700b6510 0x7fa3700b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:33.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.100+0000 7fa3857fa640 1 -- 172.21.15.1:0/3579629098 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fa3780e7280 con 0x7fa388103750 2024-09-21T00:56:33.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.101+0000 7fa3877fe640 1 --2- 172.21.15.1:0/3579629098 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa3700b6510 0x7fa3700b8a20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa37c009c20 tx=0x7fa37c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:33.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.103+0000 7fa3857fa640 1 -- 172.21.15.1:0/3579629098 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa3780ada90 con 0x7fa388103750 2024-09-21T00:56:33.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:32 smithi193 ceph-mon[34660]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:33.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:32 smithi042 ceph-mon[34481]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:33.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.333+0000 7fa38e692640 1 -- 172.21.15.1:0/3579629098 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fa38810a930 con 0x7fa388103750 2024-09-21T00:56:33.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.334+0000 7fa3857fa640 1 -- 172.21.15.1:0/3579629098 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+3116 (secure 0 0 0) 0x7fa38810a930 con 0x7fa388103750 2024-09-21T00:56:33.336 INFO:teuthology.orchestra.run.smithi001.stdout:e26 2024-09-21T00:56:33.336 INFO:teuthology.orchestra.run.smithi001.stdout:btime 2024-09-21T00:55:10:582235+0000 2024-09-21T00:56:33.336 INFO:teuthology.orchestra.run.smithi001.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T00:56:33.336 INFO:teuthology.orchestra.run.smithi001.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T00:56:33.336 INFO:teuthology.orchestra.run.smithi001.stdout:legacy client fscid: 1 2024-09-21T00:56:33.336 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:56:33.336 INFO:teuthology.orchestra.run.smithi001.stdout:Filesystem 'cephfs' (1) 2024-09-21T00:56:33.336 INFO:teuthology.orchestra.run.smithi001.stdout:fs_name cephfs 2024-09-21T00:56:33.336 INFO:teuthology.orchestra.run.smithi001.stdout:epoch 26 2024-09-21T00:56:33.336 INFO:teuthology.orchestra.run.smithi001.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T00:56:33.337 INFO:teuthology.orchestra.run.smithi001.stdout:created 2024-09-21T00:54:58.592853+0000 2024-09-21T00:56:33.337 INFO:teuthology.orchestra.run.smithi001.stdout:modified 2024-09-21T00:55:09.837567+0000 2024-09-21T00:56:33.337 INFO:teuthology.orchestra.run.smithi001.stdout:tableserver 0 2024-09-21T00:56:33.337 INFO:teuthology.orchestra.run.smithi001.stdout:root 0 2024-09-21T00:56:33.337 INFO:teuthology.orchestra.run.smithi001.stdout:session_timeout 300 2024-09-21T00:56:33.337 INFO:teuthology.orchestra.run.smithi001.stdout:session_autoclose 300 2024-09-21T00:56:33.337 INFO:teuthology.orchestra.run.smithi001.stdout:max_file_size 1099511627776 2024-09-21T00:56:33.337 INFO:teuthology.orchestra.run.smithi001.stdout:max_xattr_size 65536 2024-09-21T00:56:33.337 INFO:teuthology.orchestra.run.smithi001.stdout:required_client_features {} 2024-09-21T00:56:33.337 INFO:teuthology.orchestra.run.smithi001.stdout:last_failure 0 2024-09-21T00:56:33.337 INFO:teuthology.orchestra.run.smithi001.stdout:last_failure_osd_epoch 0 2024-09-21T00:56:33.337 INFO:teuthology.orchestra.run.smithi001.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T00:56:33.338 INFO:teuthology.orchestra.run.smithi001.stdout:max_mds 5 2024-09-21T00:56:33.338 INFO:teuthology.orchestra.run.smithi001.stdout:in 0,1,2,3,4 2024-09-21T00:56:33.338 INFO:teuthology.orchestra.run.smithi001.stdout:up {0=24653,1=24637,2=24626,3=24622,4=24610} 2024-09-21T00:56:33.338 INFO:teuthology.orchestra.run.smithi001.stdout:failed 2024-09-21T00:56:33.338 INFO:teuthology.orchestra.run.smithi001.stdout:damaged 2024-09-21T00:56:33.338 INFO:teuthology.orchestra.run.smithi001.stdout:stopped 2024-09-21T00:56:33.338 INFO:teuthology.orchestra.run.smithi001.stdout:data_pools [3] 2024-09-21T00:56:33.338 INFO:teuthology.orchestra.run.smithi001.stdout:metadata_pool 2 2024-09-21T00:56:33.338 INFO:teuthology.orchestra.run.smithi001.stdout:inline_data disabled 2024-09-21T00:56:33.338 INFO:teuthology.orchestra.run.smithi001.stdout:balancer 2024-09-21T00:56:33.338 INFO:teuthology.orchestra.run.smithi001.stdout:bal_rank_mask -1 2024-09-21T00:56:33.338 INFO:teuthology.orchestra.run.smithi001.stdout:standby_count_wanted 0 2024-09-21T00:56:33.339 INFO:teuthology.orchestra.run.smithi001.stdout:qdb_cluster leader: 24653 members: 24653,24637,24626,24622,24610 2024-09-21T00:56:33.339 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.b{0:24653} state up:active seq 4 addr [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:56:33.339 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.e{0:24605} state up:standby-replay seq 1 addr [v2:172.21.15.42:6834/793085918,v1:172.21.15.42:6835/793085918] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:56:33.339 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.i{1:24637} state up:active seq 8 addr [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:56:33.339 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.k{1:24578} state up:standby-replay seq 1 addr [v2:172.21.15.42:6832/1653911656,v1:172.21.15.42:6833/1653911656] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:56:33.339 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.h{2:24626} state up:active seq 9 addr [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:56:33.339 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.l{2:24571} state up:standby-replay seq 1 addr [v2:172.21.15.193:6832/712170939,v1:172.21.15.193:6833/712170939] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:56:33.339 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.c{3:24622} state up:active seq 10 addr [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:56:33.339 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.a{3:14793} state up:standby-replay seq 1 addr [v2:172.21.15.1:6840/3860445313,v1:172.21.15.1:6841/3860445313] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:56:33.339 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.f{4:24610} state up:active seq 11 addr [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:56:33.339 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.g{4:14787} state up:standby-replay seq 1 addr [v2:172.21.15.1:6838/2125703572,v1:172.21.15.1:6839/2125703572] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:56:33.339 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:56:33.340 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:56:33.340 INFO:teuthology.orchestra.run.smithi001.stdout:Standby daemons: 2024-09-21T00:56:33.340 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:56:33.340 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.j{-1:14724} state up:standby seq 1 addr [v2:172.21.15.1:6834/2810186677,v1:172.21.15.1:6835/2810186677] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:56:33.340 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.d{-1:14736} state up:standby seq 1 addr [v2:172.21.15.1:6836/3935320478,v1:172.21.15.1:6837/3935320478] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:56:33.340 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 26 2024-09-21T00:56:33.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.336+0000 7fa38e692640 1 -- 172.21.15.1:0/3579629098 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa3700b6510 msgr2=0x7fa3700b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:33.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.336+0000 7fa38e692640 1 --2- 172.21.15.1:0/3579629098 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa3700b6510 0x7fa3700b8a20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa37c009c20 tx=0x7fa37c005f90 comp rx=0 tx=0).stop 2024-09-21T00:56:33.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.336+0000 7fa38e692640 1 -- 172.21.15.1:0/3579629098 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa388103750 msgr2=0x7fa388199f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:33.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.336+0000 7fa38e692640 1 --2- 172.21.15.1:0/3579629098 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa388103750 0x7fa388199f90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa37800d770 tx=0x7fa37800dc30 comp rx=0 tx=0).stop 2024-09-21T00:56:33.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.336+0000 7fa38e692640 1 -- 172.21.15.1:0/3579629098 shutdown_connections 2024-09-21T00:56:33.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.336+0000 7fa38e692640 1 --2- 172.21.15.1:0/3579629098 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa388105180 0x7fa38819b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:33.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.336+0000 7fa38e692640 1 --2- 172.21.15.1:0/3579629098 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3881047e0 0x7fa38819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:33.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.336+0000 7fa38e692640 1 --2- 172.21.15.1:0/3579629098 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa3700b6510 0x7fa3700b8a20 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:33.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.336+0000 7fa38e692640 1 --2- 172.21.15.1:0/3579629098 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa388103750 0x7fa388199f90 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:33.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.336+0000 7fa38e692640 1 -- 172.21.15.1:0/3579629098 >> 172.21.15.1:0/3579629098 conn(0x7fa3880ff0c0 msgr2=0x7fa388107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:33.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.336+0000 7fa38e692640 1 -- 172.21.15.1:0/3579629098 shutdown_connections 2024-09-21T00:56:33.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:33.336+0000 7fa38e692640 1 -- 172.21.15.1:0/3579629098 wait complete. 2024-09-21T00:56:34.043 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- bash -c 'ceph osd dump' 2024-09-21T00:56:34.067 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:33 smithi001 ceph-mon[31211]: pgmap v338: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T00:56:34.067 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:33 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/3579629098' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T00:56:34.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:33 smithi193 ceph-mon[34660]: pgmap v338: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T00:56:34.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:33 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/3579629098' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T00:56:34.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:33 smithi042 ceph-mon[34481]: pgmap v338: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T00:56:34.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:33 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/3579629098' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T00:56:34.304 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:34.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.798+0000 7fd6b5e36640 1 -- 172.21.15.1:0/4109355817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6b01036d0 msgr2=0x7fd6b0103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:34.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.798+0000 7fd6b5e36640 1 --2- 172.21.15.1:0/4109355817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6b01036d0 0x7fd6b0103ae0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4009900 tx=0x7fd6a402a480 comp rx=0 tx=0).stop 2024-09-21T00:56:34.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.798+0000 7fd6b5e36640 1 -- 172.21.15.1:0/4109355817 shutdown_connections 2024-09-21T00:56:34.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.798+0000 7fd6b5e36640 1 --2- 172.21.15.1:0/4109355817 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6b0104070 0x7fd6b010aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:34.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.798+0000 7fd6b5e36640 1 --2- 172.21.15.1:0/4109355817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6b01036d0 0x7fd6b0103ae0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:34.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.798+0000 7fd6b5e36640 1 --2- 172.21.15.1:0/4109355817 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6b0102640 0x7fd6b0102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:34.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.798+0000 7fd6b5e36640 1 -- 172.21.15.1:0/4109355817 >> 172.21.15.1:0/4109355817 conn(0x7fd6b00fdfb0 msgr2=0x7fd6b0100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:34.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.798+0000 7fd6b5e36640 1 -- 172.21.15.1:0/4109355817 shutdown_connections 2024-09-21T00:56:34.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.798+0000 7fd6b5e36640 1 -- 172.21.15.1:0/4109355817 wait complete. 2024-09-21T00:56:34.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.799+0000 7fd6b5e36640 1 Processor -- start 2024-09-21T00:56:34.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.799+0000 7fd6b5e36640 1 -- start start 2024-09-21T00:56:34.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.799+0000 7fd6b5e36640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6b0102640 0x7fd6b0199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:34.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.799+0000 7fd6b5e36640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6b01036d0 0x7fd6b019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:34.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.799+0000 7fd6b5e36640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6b0104070 0x7fd6b019b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:34.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.799+0000 7fd6b5e36640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b010f410 con 0x7fd6b0102640 2024-09-21T00:56:34.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.799+0000 7fd6b5e36640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b010f290 con 0x7fd6b01036d0 2024-09-21T00:56:34.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.799+0000 7fd6b5e36640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b010f590 con 0x7fd6b0104070 2024-09-21T00:56:34.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.800+0000 7fd6af7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6b0102640 0x7fd6b0199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:34.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.800+0000 7fd6af7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6b0102640 0x7fd6b0199fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58538/0 (socket says 172.21.15.1:58538) 2024-09-21T00:56:34.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.800+0000 7fd6af7fe640 1 -- 172.21.15.1:0/3879773789 learned_addr learned my addr 172.21.15.1:0/3879773789 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:34.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.800+0000 7fd6aeffd640 1 --2- 172.21.15.1:0/3879773789 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6b01036d0 0x7fd6b019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:34.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.800+0000 7fd6affff640 1 --2- 172.21.15.1:0/3879773789 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6b0104070 0x7fd6b019b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:34.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.800+0000 7fd6af7fe640 1 -- 172.21.15.1:0/3879773789 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6b0104070 msgr2=0x7fd6b019b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:34.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.800+0000 7fd6af7fe640 1 --2- 172.21.15.1:0/3879773789 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6b0104070 0x7fd6b019b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:34.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.800+0000 7fd6af7fe640 1 -- 172.21.15.1:0/3879773789 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6b01036d0 msgr2=0x7fd6b019a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:34.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.800+0000 7fd6af7fe640 1 --2- 172.21.15.1:0/3879773789 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6b01036d0 0x7fd6b019a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:34.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.800+0000 7fd6af7fe640 1 -- 172.21.15.1:0/3879773789 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6b019b9f0 con 0x7fd6b0102640 2024-09-21T00:56:34.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.800+0000 7fd6af7fe640 1 --2- 172.21.15.1:0/3879773789 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6b0102640 0x7fd6b0199fc0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd6a000eab0 tx=0x7fd6a000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:34.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.800+0000 7fd6acff9640 1 -- 172.21.15.1:0/3879773789 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a000ce40 con 0x7fd6b0102640 2024-09-21T00:56:34.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.800+0000 7fd6acff9640 1 -- 172.21.15.1:0/3879773789 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6a0011920 con 0x7fd6b0102640 2024-09-21T00:56:34.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.800+0000 7fd6b5e36640 1 -- 172.21.15.1:0/3879773789 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6b019bce0 con 0x7fd6b0102640 2024-09-21T00:56:34.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.800+0000 7fd6acff9640 1 -- 172.21.15.1:0/3879773789 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a0010a30 con 0x7fd6b0102640 2024-09-21T00:56:34.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.800+0000 7fd6b5e36640 1 -- 172.21.15.1:0/3879773789 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6b01a23e0 con 0x7fd6b0102640 2024-09-21T00:56:34.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.802+0000 7fd6b5e36640 1 -- 172.21.15.1:0/3879773789 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6b0109820 con 0x7fd6b0102640 2024-09-21T00:56:34.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.803+0000 7fd6acff9640 1 -- 172.21.15.1:0/3879773789 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 154511+0+0 (secure 0 0 0) 0x7fd6a0010bd0 con 0x7fd6b0102640 2024-09-21T00:56:34.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.804+0000 7fd6acff9640 1 --2- 172.21.15.1:0/3879773789 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd6980b6590 0x7fd6980b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:34.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.804+0000 7fd6aeffd640 1 --2- 172.21.15.1:0/3879773789 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd6980b6590 0x7fd6980b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:34.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.804+0000 7fd6acff9640 1 -- 172.21.15.1:0/3879773789 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fd6a00e78b0 con 0x7fd6b0102640 2024-09-21T00:56:34.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.804+0000 7fd6aeffd640 1 --2- 172.21.15.1:0/3879773789 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd6980b6590 0x7fd6980b8aa0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4004770 tx=0x7fd6a40314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:34.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.807+0000 7fd6acff9640 1 -- 172.21.15.1:0/3879773789 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd6a0016030 con 0x7fd6b0102640 2024-09-21T00:56:34.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.997+0000 7fd6b5e36640 1 -- 172.21.15.1:0/3879773789 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fd6b002e640 con 0x7fd6b0102640 2024-09-21T00:56:34.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:34.998+0000 7fd6acff9640 1 -- 172.21.15.1:0/3879773789 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v75) ==== 56+0+5293 (secure 0 0 0) 0x7fd6a00ae1a0 con 0x7fd6b0102640 2024-09-21T00:56:35.000 INFO:teuthology.orchestra.run.smithi001.stdout:epoch 75 2024-09-21T00:56:35.000 INFO:teuthology.orchestra.run.smithi001.stdout:fsid d3972c20-77b2-11ef-baf5-efdc52797490 2024-09-21T00:56:35.000 INFO:teuthology.orchestra.run.smithi001.stdout:created 2024-09-21T00:46:29.745963+0000 2024-09-21T00:56:35.000 INFO:teuthology.orchestra.run.smithi001.stdout:modified 2024-09-21T00:55:27.629379+0000 2024-09-21T00:56:35.000 INFO:teuthology.orchestra.run.smithi001.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-21T00:56:35.000 INFO:teuthology.orchestra.run.smithi001.stdout:crush_version 26 2024-09-21T00:56:35.000 INFO:teuthology.orchestra.run.smithi001.stdout:full_ratio 0.95 2024-09-21T00:56:35.000 INFO:teuthology.orchestra.run.smithi001.stdout:backfillfull_ratio 0.9 2024-09-21T00:56:35.000 INFO:teuthology.orchestra.run.smithi001.stdout:nearfull_ratio 0.85 2024-09-21T00:56:35.000 INFO:teuthology.orchestra.run.smithi001.stdout:require_min_compat_client luminous 2024-09-21T00:56:35.000 INFO:teuthology.orchestra.run.smithi001.stdout:min_compat_client luminous 2024-09-21T00:56:35.000 INFO:teuthology.orchestra.run.smithi001.stdout:require_osd_release squid 2024-09-21T00:56:35.000 INFO:teuthology.orchestra.run.smithi001.stdout:stretch_mode_enabled false 2024-09-21T00:56:35.000 INFO:teuthology.orchestra.run.smithi001.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-21T00:56:35.001 INFO:teuthology.orchestra.run.smithi001.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 73 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-21T00:56:35.001 INFO:teuthology.orchestra.run.smithi001.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 73 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-21T00:56:35.001 INFO:teuthology.orchestra.run.smithi001.stdout:max_osd 12 2024-09-21T00:56:35.001 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0 up in weight 1 up_from 8 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.1:6802/4067586847,v1:172.21.15.1:6803/4067586847] [v2:172.21.15.1:6804/4067586847,v1:172.21.15.1:6805/4067586847] exists,up 5bf09a34-4d6e-401c-8cef-29bbe72de68d 2024-09-21T00:56:35.001 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1 up in weight 1 up_from 13 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.42:6800/436964633,v1:172.21.15.42:6801/436964633] [v2:172.21.15.42:6802/436964633,v1:172.21.15.42:6803/436964633] exists,up 195f9109-ef61-46be-a59a-d72e3a1b5b45 2024-09-21T00:56:35.001 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2 up in weight 1 up_from 18 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.193:6800/3495400570,v1:172.21.15.193:6801/3495400570] [v2:172.21.15.193:6802/3495400570,v1:172.21.15.193:6803/3495400570] exists,up 47cf90a7-6db6-464a-84ef-9f509f89a46b 2024-09-21T00:56:35.001 INFO:teuthology.orchestra.run.smithi001.stdout:osd.3 up in weight 1 up_from 24 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.1:6810/3221661671,v1:172.21.15.1:6811/3221661671] [v2:172.21.15.1:6812/3221661671,v1:172.21.15.1:6813/3221661671] exists,up a5230a66-3c74-41a7-9353-5650780ed25f 2024-09-21T00:56:35.001 INFO:teuthology.orchestra.run.smithi001.stdout:osd.4 up in weight 1 up_from 30 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.42:6808/2066388104,v1:172.21.15.42:6809/2066388104] [v2:172.21.15.42:6810/2066388104,v1:172.21.15.42:6811/2066388104] exists,up b0476b9b-3257-46d4-aff7-1f038286ed43 2024-09-21T00:56:35.001 INFO:teuthology.orchestra.run.smithi001.stdout:osd.5 up in weight 1 up_from 34 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.193:6808/732336675,v1:172.21.15.193:6809/732336675] [v2:172.21.15.193:6810/732336675,v1:172.21.15.193:6811/732336675] exists,up 96701ced-a55a-4ad9-be62-7f102c00697d 2024-09-21T00:56:35.001 INFO:teuthology.orchestra.run.smithi001.stdout:osd.6 up in weight 1 up_from 40 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.1:6818/3201517067,v1:172.21.15.1:6819/3201517067] [v2:172.21.15.1:6820/3201517067,v1:172.21.15.1:6821/3201517067] exists,up 72d76017-e2e3-4118-8316-2c5da01c87b9 2024-09-21T00:56:35.001 INFO:teuthology.orchestra.run.smithi001.stdout:osd.7 up in weight 1 up_from 45 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.42:6816/2124927218,v1:172.21.15.42:6817/2124927218] [v2:172.21.15.42:6818/2124927218,v1:172.21.15.42:6819/2124927218] exists,up 8b239f96-2455-41b6-a905-9ed92078b890 2024-09-21T00:56:35.001 INFO:teuthology.orchestra.run.smithi001.stdout:osd.8 up in weight 1 up_from 51 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.193:6816/2277449259,v1:172.21.15.193:6817/2277449259] [v2:172.21.15.193:6818/2277449259,v1:172.21.15.193:6819/2277449259] exists,up 8cd93aeb-fe00-4291-9f72-171d01893819 2024-09-21T00:56:35.001 INFO:teuthology.orchestra.run.smithi001.stdout:osd.9 up in weight 1 up_from 57 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.1:6826/1369323215,v1:172.21.15.1:6827/1369323215] [v2:172.21.15.1:6828/1369323215,v1:172.21.15.1:6829/1369323215] exists,up 9e03e00b-0015-4aa8-adce-0d3352d2ca1d 2024-09-21T00:56:35.001 INFO:teuthology.orchestra.run.smithi001.stdout:osd.10 up in weight 1 up_from 62 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.42:6824/3182218295,v1:172.21.15.42:6825/3182218295] [v2:172.21.15.42:6826/3182218295,v1:172.21.15.42:6827/3182218295] exists,up de55a908-b049-4f40-865f-cfa2ae6e461f 2024-09-21T00:56:35.002 INFO:teuthology.orchestra.run.smithi001.stdout:osd.11 up in weight 1 up_from 67 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.193:6824/2368815522,v1:172.21.15.193:6825/2368815522] [v2:172.21.15.193:6826/2368815522,v1:172.21.15.193:6827/2368815522] exists,up 1cac0c39-77aa-460b-92a0-39ed89cd6ce4 2024-09-21T00:56:35.002 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 2.b [8,11] 2024-09-21T00:56:35.002 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 2.10 [8,11] 2024-09-21T00:56:35.002 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 2.14 [2,4] 2024-09-21T00:56:35.002 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 2.16 [2,4] 2024-09-21T00:56:35.002 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.2 [3,9] 2024-09-21T00:56:35.002 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.e [4,8] 2024-09-21T00:56:35.002 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.17 [4,7] 2024-09-21T00:56:35.002 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.27 [3,9] 2024-09-21T00:56:35.002 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.28 [5,6] 2024-09-21T00:56:35.002 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.2c [4,9] 2024-09-21T00:56:35.002 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:6801/59685083 expires 2024-09-22T00:47:25.985486+0000 2024-09-21T00:56:35.002 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/309615464 expires 2024-09-22T00:47:25.985486+0000 2024-09-21T00:56:35.002 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/1722941514 expires 2024-09-22T00:47:25.985486+0000 2024-09-21T00:56:35.002 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/1199175740 expires 2024-09-22T00:47:25.985486+0000 2024-09-21T00:56:35.003 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:6800/59685083 expires 2024-09-22T00:47:25.985486+0000 2024-09-21T00:56:35.003 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/2811453932 expires 2024-09-22T00:46:58.953779+0000 2024-09-21T00:56:35.003 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/3748689057 expires 2024-09-22T00:46:58.953779+0000 2024-09-21T00:56:35.003 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/265697975 expires 2024-09-22T00:46:58.953779+0000 2024-09-21T00:56:35.003 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:6801/1968786311 expires 2024-09-22T00:46:58.953779+0000 2024-09-21T00:56:35.003 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:6800/1968786311 expires 2024-09-22T00:46:58.953779+0000 2024-09-21T00:56:35.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:35.001+0000 7fd6b5e36640 1 -- 172.21.15.1:0/3879773789 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd6980b6590 msgr2=0x7fd6980b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:35.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:35.001+0000 7fd6b5e36640 1 --2- 172.21.15.1:0/3879773789 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd6980b6590 0x7fd6980b8aa0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4004770 tx=0x7fd6a40314a0 comp rx=0 tx=0).stop 2024-09-21T00:56:35.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:35.001+0000 7fd6b5e36640 1 -- 172.21.15.1:0/3879773789 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6b0102640 msgr2=0x7fd6b0199fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:35.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:35.001+0000 7fd6b5e36640 1 --2- 172.21.15.1:0/3879773789 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6b0102640 0x7fd6b0199fc0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd6a000eab0 tx=0x7fd6a000ef70 comp rx=0 tx=0).stop 2024-09-21T00:56:35.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:35.001+0000 7fd6b5e36640 1 -- 172.21.15.1:0/3879773789 shutdown_connections 2024-09-21T00:56:35.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:35.001+0000 7fd6b5e36640 1 --2- 172.21.15.1:0/3879773789 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6b0104070 0x7fd6b019b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:35.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:35.001+0000 7fd6b5e36640 1 --2- 172.21.15.1:0/3879773789 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6b01036d0 0x7fd6b019a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:35.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:35.001+0000 7fd6b5e36640 1 --2- 172.21.15.1:0/3879773789 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd6980b6590 0x7fd6980b8aa0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:35.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:35.001+0000 7fd6b5e36640 1 --2- 172.21.15.1:0/3879773789 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6b0102640 0x7fd6b0199fc0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:35.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:35.001+0000 7fd6b5e36640 1 -- 172.21.15.1:0/3879773789 >> 172.21.15.1:0/3879773789 conn(0x7fd6b00fdfb0 msgr2=0x7fd6b01069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:35.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:35.001+0000 7fd6b5e36640 1 -- 172.21.15.1:0/3879773789 shutdown_connections 2024-09-21T00:56:35.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:35.001+0000 7fd6b5e36640 1 -- 172.21.15.1:0/3879773789 wait complete. 2024-09-21T00:56:35.728 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-21T00:56:35.740 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:56:35.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:35 smithi001 ceph-mon[31211]: pgmap v339: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-21T00:56:35.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:35 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/3879773789' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T00:56:36.033 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:36.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:35 smithi193 ceph-mon[34660]: pgmap v339: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-21T00:56:36.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:35 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/3879773789' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T00:56:36.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:35 smithi042 ceph-mon[34481]: pgmap v339: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-21T00:56:36.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:35 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/3879773789' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T00:56:36.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.513+0000 7fddb8b73640 1 -- 172.21.15.1:0/2553324574 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddb41094f0 msgr2=0x7fddb4109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:36.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.513+0000 7fddb8b73640 1 --2- 172.21.15.1:0/2553324574 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddb41094f0 0x7fddb4109900 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fdda8009900 tx=0x7fdda802a410 comp rx=0 tx=0).stop 2024-09-21T00:56:36.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.513+0000 7fddb8b73640 1 -- 172.21.15.1:0/2553324574 shutdown_connections 2024-09-21T00:56:36.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.513+0000 7fddb8b73640 1 --2- 172.21.15.1:0/2553324574 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddb4109e40 0x7fddb4110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:36.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.513+0000 7fddb8b73640 1 --2- 172.21.15.1:0/2553324574 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddb41094f0 0x7fddb4109900 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:36.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.513+0000 7fddb8b73640 1 --2- 172.21.15.1:0/2553324574 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fddb4103bb0 0x7fddb4103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:36.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.513+0000 7fddb8b73640 1 -- 172.21.15.1:0/2553324574 >> 172.21.15.1:0/2553324574 conn(0x7fddb40ff600 msgr2=0x7fddb4101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:36.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.513+0000 7fddb8b73640 1 -- 172.21.15.1:0/2553324574 shutdown_connections 2024-09-21T00:56:36.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.513+0000 7fddb8b73640 1 -- 172.21.15.1:0/2553324574 wait complete. 2024-09-21T00:56:36.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.514+0000 7fddb8b73640 1 Processor -- start 2024-09-21T00:56:36.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.514+0000 7fddb8b73640 1 -- start start 2024-09-21T00:56:36.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.514+0000 7fddb8b73640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddb4103bb0 0x7fddb419a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:36.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.514+0000 7fddb8b73640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddb41094f0 0x7fddb419aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:36.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.514+0000 7fddb8b73640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fddb4109e40 0x7fddb419fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:36.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.514+0000 7fddb8b73640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fddb4113b00 con 0x7fddb4103bb0 2024-09-21T00:56:36.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.514+0000 7fddb8b73640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fddb4113980 con 0x7fddb4109e40 2024-09-21T00:56:36.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.514+0000 7fddb8b73640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fddb4113c80 con 0x7fddb41094f0 2024-09-21T00:56:36.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.514+0000 7fddb259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddb4103bb0 0x7fddb419a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:36.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.514+0000 7fddb259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddb4103bb0 0x7fddb419a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58558/0 (socket says 172.21.15.1:58558) 2024-09-21T00:56:36.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.514+0000 7fddb259c640 1 -- 172.21.15.1:0/2445876488 learned_addr learned my addr 172.21.15.1:0/2445876488 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:36.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.514+0000 7fddb2d9d640 1 --2- 172.21.15.1:0/2445876488 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fddb4109e40 0x7fddb419fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:36.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.514+0000 7fddb1d9b640 1 --2- 172.21.15.1:0/2445876488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddb41094f0 0x7fddb419aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:36.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.515+0000 7fddb259c640 1 -- 172.21.15.1:0/2445876488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddb41094f0 msgr2=0x7fddb419aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:36.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.515+0000 7fddb259c640 1 --2- 172.21.15.1:0/2445876488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddb41094f0 0x7fddb419aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:36.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.515+0000 7fddb259c640 1 -- 172.21.15.1:0/2445876488 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fddb4109e40 msgr2=0x7fddb419fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:36.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.515+0000 7fddb259c640 1 --2- 172.21.15.1:0/2445876488 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fddb4109e40 0x7fddb419fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:36.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.515+0000 7fddb259c640 1 -- 172.21.15.1:0/2445876488 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddb41a0380 con 0x7fddb4103bb0 2024-09-21T00:56:36.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.515+0000 7fddb259c640 1 --2- 172.21.15.1:0/2445876488 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddb4103bb0 0x7fddb419a4d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fdda400d950 tx=0x7fdda400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:36.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.515+0000 7fdda37fe640 1 -- 172.21.15.1:0/2445876488 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda4017070 con 0x7fddb4103bb0 2024-09-21T00:56:36.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.515+0000 7fddb8b73640 1 -- 172.21.15.1:0/2445876488 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddb41a0670 con 0x7fddb4103bb0 2024-09-21T00:56:36.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.515+0000 7fdda37fe640 1 -- 172.21.15.1:0/2445876488 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdda4009c30 con 0x7fddb4103bb0 2024-09-21T00:56:36.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.515+0000 7fdda37fe640 1 -- 172.21.15.1:0/2445876488 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda400f620 con 0x7fddb4103bb0 2024-09-21T00:56:36.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.515+0000 7fddb8b73640 1 -- 172.21.15.1:0/2445876488 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddb41a6e90 con 0x7fddb4103bb0 2024-09-21T00:56:36.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.516+0000 7fddb8b73640 1 -- 172.21.15.1:0/2445876488 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddb4103fc0 con 0x7fddb4103bb0 2024-09-21T00:56:36.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.519+0000 7fdda37fe640 1 -- 172.21.15.1:0/2445876488 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 154511+0+0 (secure 0 0 0) 0x7fdda4010460 con 0x7fddb4103bb0 2024-09-21T00:56:36.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.519+0000 7fdda37fe640 1 --2- 172.21.15.1:0/2445876488 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fdd9c0b6540 0x7fdd9c0b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:36.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.520+0000 7fddb1d9b640 1 --2- 172.21.15.1:0/2445876488 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fdd9c0b6540 0x7fdd9c0b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:36.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.520+0000 7fdda37fe640 1 -- 172.21.15.1:0/2445876488 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fdda40e6ea0 con 0x7fddb4103bb0 2024-09-21T00:56:36.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.520+0000 7fddb1d9b640 1 --2- 172.21.15.1:0/2445876488 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fdd9c0b6540 0x7fdd9c0b8a50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdda8009230 tx=0x7fdda8031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:36.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.523+0000 7fdda37fe640 1 -- 172.21.15.1:0/2445876488 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdda4009de0 con 0x7fddb4103bb0 2024-09-21T00:56:36.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.748+0000 7fddb8b73640 1 -- 172.21.15.1:0/2445876488 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fddb410bc10 con 0x7fddb4103bb0 2024-09-21T00:56:36.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.749+0000 7fdda37fe640 1 -- 172.21.15.1:0/2445876488 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11955 (secure 0 0 0) 0x7fdda40b1a90 con 0x7fddb4103bb0 2024-09-21T00:56:36.750 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:56:36.751 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":26,"btime":"2024-09-21T00:55:10:582235+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2810186677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2810186677},{"type":"v1","addr":"172.21.15.1:6835","nonce":2810186677}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14736,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3935320478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3935320478},{"type":"v1","addr":"172.21.15.1:6837","nonce":3935320478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:54:58.592853+0000","modified":"2024-09-21T00:55:09.837567+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24653,"mds_1":24637,"mds_2":24626,"mds_3":24622,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/2125703572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2125703572},{"type":"v1","addr":"172.21.15.1:6839","nonce":2125703572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/3860445313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860445313},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860445313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6833/712170939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":712170939},{"type":"v1","addr":"172.21.15.193:6833","nonce":712170939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6833/1653911656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1653911656},{"type":"v1","addr":"172.21.15.42:6833","nonce":1653911656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6835/793085918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":793085918},{"type":"v1","addr":"172.21.15.42:6835","nonce":793085918}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6835/3631682268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":3631682268},{"type":"v1","addr":"172.21.15.193:6835","nonce":3631682268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.193:6837/909252228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":909252228},{"type":"v1","addr":"172.21.15.193:6837","nonce":909252228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.42:6837/2395608508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2395608508},{"type":"v1","addr":"172.21.15.42:6837","nonce":2395608508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.193:6839/1365361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1365361177},{"type":"v1","addr":"172.21.15.193:6839","nonce":1365361177}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6839/2526476666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2526476666},{"type":"v1","addr":"172.21.15.42:6839","nonce":2526476666}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653,24637,24626,24622,24610]},"id":1}]} 2024-09-21T00:56:36.751 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 26 2024-09-21T00:56:36.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.751+0000 7fddb8b73640 1 -- 172.21.15.1:0/2445876488 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fdd9c0b6540 msgr2=0x7fdd9c0b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:36.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.751+0000 7fddb8b73640 1 --2- 172.21.15.1:0/2445876488 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fdd9c0b6540 0x7fdd9c0b8a50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdda8009230 tx=0x7fdda8031400 comp rx=0 tx=0).stop 2024-09-21T00:56:36.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.751+0000 7fddb8b73640 1 -- 172.21.15.1:0/2445876488 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddb4103bb0 msgr2=0x7fddb419a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:36.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.751+0000 7fddb8b73640 1 --2- 172.21.15.1:0/2445876488 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddb4103bb0 0x7fddb419a4d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fdda400d950 tx=0x7fdda400de10 comp rx=0 tx=0).stop 2024-09-21T00:56:36.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.751+0000 7fddb8b73640 1 -- 172.21.15.1:0/2445876488 shutdown_connections 2024-09-21T00:56:36.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.751+0000 7fddb8b73640 1 --2- 172.21.15.1:0/2445876488 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fddb4109e40 0x7fddb419fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:36.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.751+0000 7fddb8b73640 1 --2- 172.21.15.1:0/2445876488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddb41094f0 0x7fddb419aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:36.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.751+0000 7fddb8b73640 1 --2- 172.21.15.1:0/2445876488 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fdd9c0b6540 0x7fdd9c0b8a50 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:36.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.751+0000 7fddb8b73640 1 --2- 172.21.15.1:0/2445876488 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddb4103bb0 0x7fddb419a4d0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:36.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.751+0000 7fddb8b73640 1 -- 172.21.15.1:0/2445876488 >> 172.21.15.1:0/2445876488 conn(0x7fddb40ff600 msgr2=0x7fddb4101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:36.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.751+0000 7fddb8b73640 1 -- 172.21.15.1:0/2445876488 shutdown_connections 2024-09-21T00:56:36.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:36.751+0000 7fddb8b73640 1 -- 172.21.15.1:0/2445876488 wait complete. 2024-09-21T00:56:37.118 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:36 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/2445876488' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:37.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:36 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/2445876488' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:37.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:36 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/2445876488' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:37.436 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:56:37.698 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:38.106 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:37 smithi001 ceph-mon[31211]: pgmap v340: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T00:56:38.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.197+0000 7efde93bb640 1 -- 172.21.15.1:0/1562464682 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efde4105300 msgr2=0x7efde410d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:38.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.197+0000 7efde93bb640 1 --2- 172.21.15.1:0/1562464682 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efde4105300 0x7efde410d850 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7efdd8009900 tx=0x7efdd802a410 comp rx=0 tx=0).stop 2024-09-21T00:56:38.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.197+0000 7efde93bb640 1 -- 172.21.15.1:0/1562464682 shutdown_connections 2024-09-21T00:56:38.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.197+0000 7efde93bb640 1 --2- 172.21.15.1:0/1562464682 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efde410de10 0x7efde4110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:38.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.197+0000 7efde93bb640 1 --2- 172.21.15.1:0/1562464682 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efde4105300 0x7efde410d850 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:38.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.197+0000 7efde93bb640 1 --2- 172.21.15.1:0/1562464682 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efde41049b0 0x7efde4104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:38.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.197+0000 7efde93bb640 1 -- 172.21.15.1:0/1562464682 >> 172.21.15.1:0/1562464682 conn(0x7efde4079730 msgr2=0x7efde4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:38.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.197+0000 7efde93bb640 1 -- 172.21.15.1:0/1562464682 shutdown_connections 2024-09-21T00:56:38.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.197+0000 7efde93bb640 1 -- 172.21.15.1:0/1562464682 wait complete. 2024-09-21T00:56:38.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.197+0000 7efde93bb640 1 Processor -- start 2024-09-21T00:56:38.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.198+0000 7efde93bb640 1 -- start start 2024-09-21T00:56:38.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.198+0000 7efde93bb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efde41049b0 0x7efde419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:38.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.198+0000 7efde93bb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efde4105300 0x7efde419aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:38.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.198+0000 7efde93bb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efde410de10 0x7efde419fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:38.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.198+0000 7efde93bb640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efde4113a70 con 0x7efde4105300 2024-09-21T00:56:38.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.198+0000 7efde93bb640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efde41138f0 con 0x7efde41049b0 2024-09-21T00:56:38.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.198+0000 7efde93bb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efde4113bf0 con 0x7efde410de10 2024-09-21T00:56:38.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.198+0000 7efde27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efde4105300 0x7efde419aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:38.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.198+0000 7efde27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efde4105300 0x7efde419aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58570/0 (socket says 172.21.15.1:58570) 2024-09-21T00:56:38.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.198+0000 7efde27fc640 1 -- 172.21.15.1:0/4090777926 learned_addr learned my addr 172.21.15.1:0/4090777926 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:38.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.198+0000 7efde37fe640 1 --2- 172.21.15.1:0/4090777926 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efde410de10 0x7efde419fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:38.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.198+0000 7efde2ffd640 1 --2- 172.21.15.1:0/4090777926 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efde41049b0 0x7efde419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:38.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.198+0000 7efde27fc640 1 -- 172.21.15.1:0/4090777926 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efde410de10 msgr2=0x7efde419fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:38.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.198+0000 7efde27fc640 1 --2- 172.21.15.1:0/4090777926 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efde410de10 0x7efde419fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:38.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.198+0000 7efde27fc640 1 -- 172.21.15.1:0/4090777926 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efde41049b0 msgr2=0x7efde419a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:38.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.198+0000 7efde27fc640 1 --2- 172.21.15.1:0/4090777926 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efde41049b0 0x7efde419a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:38.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.198+0000 7efde27fc640 1 -- 172.21.15.1:0/4090777926 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde41a0410 con 0x7efde4105300 2024-09-21T00:56:38.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.198+0000 7efde37fe640 1 --2- 172.21.15.1:0/4090777926 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efde410de10 0x7efde419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:56:38.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.199+0000 7efde27fc640 1 --2- 172.21.15.1:0/4090777926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efde4105300 0x7efde419aa40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7efdd802a930 tx=0x7efdd8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:38.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.199+0000 7efdcbfff640 1 -- 172.21.15.1:0/4090777926 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd803f030 con 0x7efde4105300 2024-09-21T00:56:38.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.199+0000 7efdcbfff640 1 -- 172.21.15.1:0/4090777926 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efdd8003aa0 con 0x7efde4105300 2024-09-21T00:56:38.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.199+0000 7efde93bb640 1 -- 172.21.15.1:0/4090777926 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efde41a06a0 con 0x7efde4105300 2024-09-21T00:56:38.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.199+0000 7efdcbfff640 1 -- 172.21.15.1:0/4090777926 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd8035070 con 0x7efde4105300 2024-09-21T00:56:38.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.199+0000 7efde93bb640 1 -- 172.21.15.1:0/4090777926 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efde41a6e60 con 0x7efde4105300 2024-09-21T00:56:38.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.200+0000 7efde93bb640 1 -- 172.21.15.1:0/4090777926 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efde406b560 con 0x7efde4105300 2024-09-21T00:56:38.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.201+0000 7efdcbfff640 1 -- 172.21.15.1:0/4090777926 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 154511+0+0 (secure 0 0 0) 0x7efdd8042030 con 0x7efde4105300 2024-09-21T00:56:38.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.202+0000 7efdcbfff640 1 --2- 172.21.15.1:0/4090777926 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7efdcc0b6510 0x7efdcc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:38.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.202+0000 7efde2ffd640 1 --2- 172.21.15.1:0/4090777926 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7efdcc0b6510 0x7efdcc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:38.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.202+0000 7efdcbfff640 1 -- 172.21.15.1:0/4090777926 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7efdd8107e60 con 0x7efde4105300 2024-09-21T00:56:38.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.203+0000 7efde2ffd640 1 --2- 172.21.15.1:0/4090777926 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7efdcc0b6510 0x7efdcc0b8a20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7efde406bc60 tx=0x7efdd4009870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:38.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.206+0000 7efdcbfff640 1 -- 172.21.15.1:0/4090777926 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efdd80ce6d0 con 0x7efde4105300 2024-09-21T00:56:38.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:37 smithi193 ceph-mon[34660]: pgmap v340: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T00:56:38.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:37 smithi042 ceph-mon[34481]: pgmap v340: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T00:56:38.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.433+0000 7efde93bb640 1 -- 172.21.15.1:0/4090777926 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efde4108f10 con 0x7efde4105300 2024-09-21T00:56:38.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.433+0000 7efdcbfff640 1 -- 172.21.15.1:0/4090777926 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11955 (secure 0 0 0) 0x7efdd80d2ab0 con 0x7efde4105300 2024-09-21T00:56:38.435 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:56:38.435 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":26,"btime":"2024-09-21T00:55:10:582235+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2810186677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2810186677},{"type":"v1","addr":"172.21.15.1:6835","nonce":2810186677}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14736,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3935320478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3935320478},{"type":"v1","addr":"172.21.15.1:6837","nonce":3935320478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:54:58.592853+0000","modified":"2024-09-21T00:55:09.837567+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24653,"mds_1":24637,"mds_2":24626,"mds_3":24622,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/2125703572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2125703572},{"type":"v1","addr":"172.21.15.1:6839","nonce":2125703572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/3860445313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860445313},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860445313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6833/712170939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":712170939},{"type":"v1","addr":"172.21.15.193:6833","nonce":712170939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6833/1653911656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1653911656},{"type":"v1","addr":"172.21.15.42:6833","nonce":1653911656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6835/793085918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":793085918},{"type":"v1","addr":"172.21.15.42:6835","nonce":793085918}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6835/3631682268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":3631682268},{"type":"v1","addr":"172.21.15.193:6835","nonce":3631682268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.193:6837/909252228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":909252228},{"type":"v1","addr":"172.21.15.193:6837","nonce":909252228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.42:6837/2395608508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2395608508},{"type":"v1","addr":"172.21.15.42:6837","nonce":2395608508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.193:6839/1365361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1365361177},{"type":"v1","addr":"172.21.15.193:6839","nonce":1365361177}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6839/2526476666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2526476666},{"type":"v1","addr":"172.21.15.42:6839","nonce":2526476666}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653,24637,24626,24622,24610]},"id":1}]} 2024-09-21T00:56:38.436 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 26 2024-09-21T00:56:38.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.436+0000 7efde93bb640 1 -- 172.21.15.1:0/4090777926 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7efdcc0b6510 msgr2=0x7efdcc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:38.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.436+0000 7efde93bb640 1 --2- 172.21.15.1:0/4090777926 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7efdcc0b6510 0x7efdcc0b8a20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7efde406bc60 tx=0x7efdd4009870 comp rx=0 tx=0).stop 2024-09-21T00:56:38.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.436+0000 7efde93bb640 1 -- 172.21.15.1:0/4090777926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efde4105300 msgr2=0x7efde419aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:38.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.436+0000 7efde93bb640 1 --2- 172.21.15.1:0/4090777926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efde4105300 0x7efde419aa40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7efdd802a930 tx=0x7efdd8004270 comp rx=0 tx=0).stop 2024-09-21T00:56:38.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.436+0000 7efde93bb640 1 -- 172.21.15.1:0/4090777926 shutdown_connections 2024-09-21T00:56:38.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.436+0000 7efde93bb640 1 --2- 172.21.15.1:0/4090777926 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efde410de10 0x7efde419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:38.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.436+0000 7efde93bb640 1 --2- 172.21.15.1:0/4090777926 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7efdcc0b6510 0x7efdcc0b8a20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:38.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.436+0000 7efde93bb640 1 --2- 172.21.15.1:0/4090777926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efde4105300 0x7efde419aa40 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:38.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.436+0000 7efde93bb640 1 --2- 172.21.15.1:0/4090777926 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efde41049b0 0x7efde419a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:38.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.436+0000 7efde93bb640 1 -- 172.21.15.1:0/4090777926 >> 172.21.15.1:0/4090777926 conn(0x7efde4079730 msgr2=0x7efde40ff730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:38.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.437+0000 7efde93bb640 1 -- 172.21.15.1:0/4090777926 shutdown_connections 2024-09-21T00:56:38.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:38.437+0000 7efde93bb640 1 -- 172.21.15.1:0/4090777926 wait complete. 2024-09-21T00:56:39.086 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:38 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/4090777926' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:39.116 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T00:56:39.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:38 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/4090777926' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:39.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:38 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/4090777926' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:39.372 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:39.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.883+0000 7f688639a640 1 -- 172.21.15.1:0/3620675600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6880102a60 msgr2=0x7f6880102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:39.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.883+0000 7f688639a640 1 --2- 172.21.15.1:0/3620675600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6880102a60 0x7f6880102e70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6870009900 tx=0x7f687002a410 comp rx=0 tx=0).stop 2024-09-21T00:56:39.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.883+0000 7f688639a640 1 -- 172.21.15.1:0/3620675600 shutdown_connections 2024-09-21T00:56:39.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.883+0000 7f688639a640 1 --2- 172.21.15.1:0/3620675600 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6880108cf0 0x7f688010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:39.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.883+0000 7f688639a640 1 --2- 172.21.15.1:0/3620675600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68801083a0 0x7f68801087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:39.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.883+0000 7f688639a640 1 --2- 172.21.15.1:0/3620675600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6880102a60 0x7f6880102e70 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:39.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.883+0000 7f688639a640 1 -- 172.21.15.1:0/3620675600 >> 172.21.15.1:0/3620675600 conn(0x7f6880079730 msgr2=0x7f6880079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:39.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.883+0000 7f688639a640 1 -- 172.21.15.1:0/3620675600 shutdown_connections 2024-09-21T00:56:39.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.883+0000 7f688639a640 1 -- 172.21.15.1:0/3620675600 wait complete. 2024-09-21T00:56:39.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.884+0000 7f688639a640 1 Processor -- start 2024-09-21T00:56:39.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.884+0000 7f688639a640 1 -- start start 2024-09-21T00:56:39.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.884+0000 7f688639a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6880102a60 0x7f688010ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:39.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.884+0000 7f688639a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68801083a0 0x7f68801104f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:39.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.884+0000 7f688639a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6880108cf0 0x7f6880110a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:39.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.884+0000 7f688639a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6880113ac0 con 0x7f6880108cf0 2024-09-21T00:56:39.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.884+0000 7f688639a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6880113940 con 0x7f68801083a0 2024-09-21T00:56:39.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.884+0000 7f688639a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6880113c40 con 0x7f6880102a60 2024-09-21T00:56:39.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.884+0000 7f6884937640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6880108cf0 0x7f6880110a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:39.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.885+0000 7f6884937640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6880108cf0 0x7f6880110a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34518/0 (socket says 172.21.15.1:34518) 2024-09-21T00:56:39.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.885+0000 7f6884937640 1 -- 172.21.15.1:0/2747219908 learned_addr learned my addr 172.21.15.1:0/2747219908 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:39.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.885+0000 7f687ffff640 1 --2- 172.21.15.1:0/2747219908 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6880102a60 0x7f688010ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:39.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.885+0000 7f687f7fe640 1 --2- 172.21.15.1:0/2747219908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68801083a0 0x7f68801104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:39.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.885+0000 7f6884937640 1 -- 172.21.15.1:0/2747219908 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6880102a60 msgr2=0x7f688010ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:39.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.885+0000 7f6884937640 1 --2- 172.21.15.1:0/2747219908 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6880102a60 0x7f688010ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:39.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.885+0000 7f6884937640 1 -- 172.21.15.1:0/2747219908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68801083a0 msgr2=0x7f68801104f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:39.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.885+0000 7f6884937640 1 --2- 172.21.15.1:0/2747219908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68801083a0 0x7f68801104f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:39.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.885+0000 7f6884937640 1 -- 172.21.15.1:0/2747219908 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68801a8770 con 0x7f6880108cf0 2024-09-21T00:56:39.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.885+0000 7f6884937640 1 --2- 172.21.15.1:0/2747219908 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6880108cf0 0x7f6880110a30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f687800b970 tx=0x7f687800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:39.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.885+0000 7f687d7fa640 1 -- 172.21.15.1:0/2747219908 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6878019070 con 0x7f6880108cf0 2024-09-21T00:56:39.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.885+0000 7f688639a640 1 -- 172.21.15.1:0/2747219908 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68801a8a60 con 0x7f6880108cf0 2024-09-21T00:56:39.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.885+0000 7f687d7fa640 1 -- 172.21.15.1:0/2747219908 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6878014440 con 0x7f6880108cf0 2024-09-21T00:56:39.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.885+0000 7f687d7fa640 1 -- 172.21.15.1:0/2747219908 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68780075d0 con 0x7f6880108cf0 2024-09-21T00:56:39.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.885+0000 7f688639a640 1 -- 172.21.15.1:0/2747219908 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68801a9070 con 0x7f6880108cf0 2024-09-21T00:56:39.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.886+0000 7f688639a640 1 -- 172.21.15.1:0/2747219908 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6880102e70 con 0x7f6880108cf0 2024-09-21T00:56:39.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.888+0000 7f687d7fa640 1 -- 172.21.15.1:0/2747219908 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 154511+0+0 (secure 0 0 0) 0x7f687801c070 con 0x7f6880108cf0 2024-09-21T00:56:39.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.889+0000 7f687d7fa640 1 --2- 172.21.15.1:0/2747219908 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f68680b6510 0x7f68680b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:39.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.889+0000 7f687ffff640 1 --2- 172.21.15.1:0/2747219908 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f68680b6510 0x7f68680b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:39.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.889+0000 7f687d7fa640 1 -- 172.21.15.1:0/2747219908 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f68780e6d10 con 0x7f6880108cf0 2024-09-21T00:56:39.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.890+0000 7f687ffff640 1 --2- 172.21.15.1:0/2747219908 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f68680b6510 0x7f68680b8a20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6870000c00 tx=0x7f6870031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:39.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:39.892+0000 7f687d7fa640 1 -- 172.21.15.1:0/2747219908 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f68780ad580 con 0x7f6880108cf0 2024-09-21T00:56:40.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:40.080+0000 7f688639a640 1 -- 172.21.15.1:0/2747219908 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f688002e640 con 0x7f6880108cf0 2024-09-21T00:56:40.082 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:39 smithi001 ceph-mon[31211]: pgmap v341: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T00:56:40.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:40.081+0000 7f687d7fa640 1 -- 172.21.15.1:0/2747219908 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22720 (secure 0 0 0) 0x7f68780b1960 con 0x7f6880108cf0 2024-09-21T00:56:40.083 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:56:40.083 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":75,"fsid":"d3972c20-77b2-11ef-baf5-efdc52797490","created":"2024-09-21T00:46:29.745963+0000","modified":"2024-09-21T00:55:27.629379+0000","last_up_change":"2024-09-21T00:54:07.552837+0000","last_in_change":"2024-09-21T00:53:44.164415+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:50:16.456462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:54:54.305306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:54:56.506872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5bf09a34-4d6e-401c-8cef-29bbe72de68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6803","nonce":4067586847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6805","nonce":4067586847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6809","nonce":4067586847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6807","nonce":4067586847}]},"public_addr":"172.21.15.1:6803/4067586847","cluster_addr":"172.21.15.1:6805/4067586847","heartbeat_back_addr":"172.21.15.1:6809/4067586847","heartbeat_front_addr":"172.21.15.1:6807/4067586847","state":["exists","up"]},{"osd":1,"uuid":"195f9109-ef61-46be-a59a-d72e3a1b5b45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6801","nonce":436964633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6803","nonce":436964633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6807","nonce":436964633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6805","nonce":436964633}]},"public_addr":"172.21.15.42:6801/436964633","cluster_addr":"172.21.15.42:6803/436964633","heartbeat_back_addr":"172.21.15.42:6807/436964633","heartbeat_front_addr":"172.21.15.42:6805/436964633","state":["exists","up"]},{"osd":2,"uuid":"47cf90a7-6db6-464a-84ef-9f509f89a46b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6801","nonce":3495400570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6803","nonce":3495400570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6807","nonce":3495400570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6805","nonce":3495400570}]},"public_addr":"172.21.15.193:6801/3495400570","cluster_addr":"172.21.15.193:6803/3495400570","heartbeat_back_addr":"172.21.15.193:6807/3495400570","heartbeat_front_addr":"172.21.15.193:6805/3495400570","state":["exists","up"]},{"osd":3,"uuid":"a5230a66-3c74-41a7-9353-5650780ed25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6811","nonce":3221661671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6813","nonce":3221661671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6817","nonce":3221661671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6815","nonce":3221661671}]},"public_addr":"172.21.15.1:6811/3221661671","cluster_addr":"172.21.15.1:6813/3221661671","heartbeat_back_addr":"172.21.15.1:6817/3221661671","heartbeat_front_addr":"172.21.15.1:6815/3221661671","state":["exists","up"]},{"osd":4,"uuid":"b0476b9b-3257-46d4-aff7-1f038286ed43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6809","nonce":2066388104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6811","nonce":2066388104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6815","nonce":2066388104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6813","nonce":2066388104}]},"public_addr":"172.21.15.42:6809/2066388104","cluster_addr":"172.21.15.42:6811/2066388104","heartbeat_back_addr":"172.21.15.42:6815/2066388104","heartbeat_front_addr":"172.21.15.42:6813/2066388104","state":["exists","up"]},{"osd":5,"uuid":"96701ced-a55a-4ad9-be62-7f102c00697d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6809","nonce":732336675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6811","nonce":732336675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6815","nonce":732336675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6813","nonce":732336675}]},"public_addr":"172.21.15.193:6809/732336675","cluster_addr":"172.21.15.193:6811/732336675","heartbeat_back_addr":"172.21.15.193:6815/732336675","heartbeat_front_addr":"172.21.15.193:6813/732336675","state":["exists","up"]},{"osd":6,"uuid":"72d76017-e2e3-4118-8316-2c5da01c87b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6819","nonce":3201517067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6821","nonce":3201517067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6825","nonce":3201517067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6823","nonce":3201517067}]},"public_addr":"172.21.15.1:6819/3201517067","cluster_addr":"172.21.15.1:6821/3201517067","heartbeat_back_addr":"172.21.15.1:6825/3201517067","heartbeat_front_addr":"172.21.15.1:6823/3201517067","state":["exists","up"]},{"osd":7,"uuid":"8b239f96-2455-41b6-a905-9ed92078b890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6817","nonce":2124927218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6819","nonce":2124927218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6823","nonce":2124927218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6821","nonce":2124927218}]},"public_addr":"172.21.15.42:6817/2124927218","cluster_addr":"172.21.15.42:6819/2124927218","heartbeat_back_addr":"172.21.15.42:6823/2124927218","heartbeat_front_addr":"172.21.15.42:6821/2124927218","state":["exists","up"]},{"osd":8,"uuid":"8cd93aeb-fe00-4291-9f72-171d01893819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6817","nonce":2277449259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6819","nonce":2277449259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6823","nonce":2277449259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6821","nonce":2277449259}]},"public_addr":"172.21.15.193:6817/2277449259","cluster_addr":"172.21.15.193:6819/2277449259","heartbeat_back_addr":"172.21.15.193:6823/2277449259","heartbeat_front_addr":"172.21.15.193:6821/2277449259","state":["exists","up"]},{"osd":9,"uuid":"9e03e00b-0015-4aa8-adce-0d3352d2ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6827","nonce":1369323215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6829","nonce":1369323215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6833","nonce":1369323215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6831","nonce":1369323215}]},"public_addr":"172.21.15.1:6827/1369323215","cluster_addr":"172.21.15.1:6829/1369323215","heartbeat_back_addr":"172.21.15.1:6833/1369323215","heartbeat_front_addr":"172.21.15.1:6831/1369323215","state":["exists","up"]},{"osd":10,"uuid":"de55a908-b049-4f40-865f-cfa2ae6e461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6825","nonce":3182218295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6827","nonce":3182218295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6831","nonce":3182218295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6829","nonce":3182218295}]},"public_addr":"172.21.15.42:6825/3182218295","cluster_addr":"172.21.15.42:6827/3182218295","heartbeat_back_addr":"172.21.15.42:6831/3182218295","heartbeat_front_addr":"172.21.15.42:6829/3182218295","state":["exists","up"]},{"osd":11,"uuid":"1cac0c39-77aa-460b-92a0-39ed89cd6ce4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6825","nonce":2368815522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6827","nonce":2368815522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6831","nonce":2368815522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6829","nonce":2368815522}]},"public_addr":"172.21.15.193:6825/2368815522","cluster_addr":"172.21.15.193:6827/2368815522","heartbeat_back_addr":"172.21.15.193:6831/2368815522","heartbeat_front_addr":"172.21.15.193:6829/2368815522","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:49:21.491443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:49:47.486846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:50:12.757383+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:50:39.127690+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:05.545277+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:30.617491+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:57.612088+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:24.001953+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:48.447388+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:14.620538+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:40.503576+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:54:05.668236+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6801/59685083":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/309615464":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/1722941514":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/1199175740":"2024-09-22T00:47:25.985486+0000","172.21.15.1:6800/59685083":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/2811453932":"2024-09-22T00:46:58.953779+0000","172.21.15.1:0/3748689057":"2024-09-22T00:46:58.953779+0000","172.21.15.1:0/265697975":"2024-09-22T00:46:58.953779+0000","172.21.15.1:6801/1968786311":"2024-09-22T00:46:58.953779+0000","172.21.15.1:6800/1968786311":"2024-09-22T00:46:58.953779+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:56:40.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:40.084+0000 7f688639a640 1 -- 172.21.15.1:0/2747219908 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f68680b6510 msgr2=0x7f68680b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:40.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:40.084+0000 7f688639a640 1 --2- 172.21.15.1:0/2747219908 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f68680b6510 0x7f68680b8a20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6870000c00 tx=0x7f6870031400 comp rx=0 tx=0).stop 2024-09-21T00:56:40.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:40.084+0000 7f688639a640 1 -- 172.21.15.1:0/2747219908 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6880108cf0 msgr2=0x7f6880110a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:40.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:40.084+0000 7f688639a640 1 --2- 172.21.15.1:0/2747219908 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6880108cf0 0x7f6880110a30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f687800b970 tx=0x7f687800be30 comp rx=0 tx=0).stop 2024-09-21T00:56:40.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:40.084+0000 7f688639a640 1 -- 172.21.15.1:0/2747219908 shutdown_connections 2024-09-21T00:56:40.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:40.084+0000 7f688639a640 1 --2- 172.21.15.1:0/2747219908 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f68680b6510 0x7f68680b8a20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:40.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:40.084+0000 7f688639a640 1 --2- 172.21.15.1:0/2747219908 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6880108cf0 0x7f6880110a30 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:40.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:40.084+0000 7f688639a640 1 --2- 172.21.15.1:0/2747219908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68801083a0 0x7f68801104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:40.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:40.084+0000 7f688639a640 1 --2- 172.21.15.1:0/2747219908 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6880102a60 0x7f688010ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:40.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:40.084+0000 7f688639a640 1 -- 172.21.15.1:0/2747219908 >> 172.21.15.1:0/2747219908 conn(0x7f6880079730 msgr2=0x7f6880101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:40.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:40.084+0000 7f688639a640 1 -- 172.21.15.1:0/2747219908 shutdown_connections 2024-09-21T00:56:40.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:40.084+0000 7f688639a640 1 -- 172.21.15.1:0/2747219908 wait complete. 2024-09-21T00:56:40.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:39 smithi193 ceph-mon[34660]: pgmap v341: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T00:56:40.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:39 smithi042 ceph-mon[34481]: pgmap v341: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T00:56:40.870 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T00:54:58.592853+0000', 'modified': '2024-09-21T00:55:09.837567+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24653, 'mds_1': 24637, 'mds_2': 24626, 'mds_3': 24622, 'mds_4': 24610}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14787': {'gid': 14787, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.1:6839/2125703572', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.1:6838', 'nonce': 2125703572}, {'type': 'v1', 'addr': '172.21.15.1:6839', 'nonce': 2125703572}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14793': {'gid': 14793, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.1:6841/3860445313', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.1:6840', 'nonce': 3860445313}, {'type': 'v1', 'addr': '172.21.15.1:6841', 'nonce': 3860445313}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24571': {'gid': 24571, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.193:6833/712170939', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6832', 'nonce': 712170939}, {'type': 'v1', 'addr': '172.21.15.193:6833', 'nonce': 712170939}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24578': {'gid': 24578, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.42:6833/1653911656', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6832', 'nonce': 1653911656}, {'type': 'v1', 'addr': '172.21.15.42:6833', 'nonce': 1653911656}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24605': {'gid': 24605, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.42:6835/793085918', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6834', 'nonce': 793085918}, {'type': 'v1', 'addr': '172.21.15.42:6835', 'nonce': 793085918}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24610': {'gid': 24610, 'name': 'f', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.193:6835/3631682268', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6834', 'nonce': 3631682268}, {'type': 'v1', 'addr': '172.21.15.193:6835', 'nonce': 3631682268}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24622': {'gid': 24622, 'name': 'c', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.193:6837/909252228', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6836', 'nonce': 909252228}, {'type': 'v1', 'addr': '172.21.15.193:6837', 'nonce': 909252228}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24626': {'gid': 24626, 'name': 'h', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.42:6837/2395608508', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6836', 'nonce': 2395608508}, {'type': 'v1', 'addr': '172.21.15.42:6837', 'nonce': 2395608508}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24637': {'gid': 24637, 'name': 'i', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.193:6839/1365361177', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6838', 'nonce': 1365361177}, {'type': 'v1', 'addr': '172.21.15.193:6839', 'nonce': 1365361177}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24653': {'gid': 24653, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.42:6839/2526476666', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6838', 'nonce': 2526476666}, {'type': 'v1', 'addr': '172.21.15.42:6839', 'nonce': 2526476666}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24653, 'qdb_cluster': [24653, 24637, 24626, 24622, 24610]} 2024-09-21T00:56:40.870 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-21T00:56:40.871 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.f status 2024-09-21T00:56:41.126 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:41.130 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:40 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/2747219908' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:56:41.144 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:40 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/2747219908' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:56:41.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:40 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/2747219908' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:56:41.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.626+0000 7fc3a801d640 1 -- 172.21.15.1:0/2819249783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3a0103bb0 msgr2=0x7fc3a0103fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:41.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.626+0000 7fc3a801d640 1 --2- 172.21.15.1:0/2819249783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3a0103bb0 0x7fc3a0103fc0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc39c009900 tx=0x7fc39c02a410 comp rx=0 tx=0).stop 2024-09-21T00:56:41.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.626+0000 7fc3a801d640 1 -- 172.21.15.1:0/2819249783 shutdown_connections 2024-09-21T00:56:41.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.626+0000 7fc3a801d640 1 --2- 172.21.15.1:0/2819249783 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc3a0109e40 0x7fc3a0110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.626+0000 7fc3a801d640 1 --2- 172.21.15.1:0/2819249783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3a01094f0 0x7fc3a0109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.626+0000 7fc3a801d640 1 --2- 172.21.15.1:0/2819249783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3a0103bb0 0x7fc3a0103fc0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.626+0000 7fc3a801d640 1 -- 172.21.15.1:0/2819249783 >> 172.21.15.1:0/2819249783 conn(0x7fc3a00ff600 msgr2=0x7fc3a0101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:41.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.626+0000 7fc3a801d640 1 -- 172.21.15.1:0/2819249783 shutdown_connections 2024-09-21T00:56:41.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.626+0000 7fc3a801d640 1 -- 172.21.15.1:0/2819249783 wait complete. 2024-09-21T00:56:41.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.627+0000 7fc3a801d640 1 Processor -- start 2024-09-21T00:56:41.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.627+0000 7fc3a801d640 1 -- start start 2024-09-21T00:56:41.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.628+0000 7fc3a801d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3a0103bb0 0x7fc3a019a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:41.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.628+0000 7fc3a801d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc3a01094f0 0x7fc3a019aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:41.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.628+0000 7fc3a801d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3a0109e40 0x7fc3a019fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:41.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.628+0000 7fc3a801d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a0113b00 con 0x7fc3a0103bb0 2024-09-21T00:56:41.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.628+0000 7fc3a801d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a0113980 con 0x7fc3a0109e40 2024-09-21T00:56:41.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.628+0000 7fc3a801d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a0113c80 con 0x7fc3a01094f0 2024-09-21T00:56:41.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.628+0000 7fc3a5db9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3a0103bb0 0x7fc3a019a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:41.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.628+0000 7fc3a5db9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3a0103bb0 0x7fc3a019a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34536/0 (socket says 172.21.15.1:34536) 2024-09-21T00:56:41.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.628+0000 7fc3a5db9640 1 -- 172.21.15.1:0/2835395602 learned_addr learned my addr 172.21.15.1:0/2835395602 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:41.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.628+0000 7fc3a65ba640 1 --2- 172.21.15.1:0/2835395602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3a0109e40 0x7fc3a019fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:41.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.628+0000 7fc3a55b8640 1 --2- 172.21.15.1:0/2835395602 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc3a01094f0 0x7fc3a019aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:41.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.628+0000 7fc3a5db9640 1 -- 172.21.15.1:0/2835395602 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc3a01094f0 msgr2=0x7fc3a019aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:41.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.628+0000 7fc3a5db9640 1 --2- 172.21.15.1:0/2835395602 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc3a01094f0 0x7fc3a019aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.628+0000 7fc3a5db9640 1 -- 172.21.15.1:0/2835395602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3a0109e40 msgr2=0x7fc3a019fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:41.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.628+0000 7fc3a5db9640 1 --2- 172.21.15.1:0/2835395602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3a0109e40 0x7fc3a019fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.628+0000 7fc3a5db9640 1 -- 172.21.15.1:0/2835395602 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3a01a0460 con 0x7fc3a0103bb0 2024-09-21T00:56:41.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.628+0000 7fc3a65ba640 1 --2- 172.21.15.1:0/2835395602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3a0109e40 0x7fc3a019fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:56:41.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.628+0000 7fc3a5db9640 1 --2- 172.21.15.1:0/2835395602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3a0103bb0 0x7fc3a019a4f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc39c005940 tx=0x7fc39c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:41.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.628+0000 7fc396ffd640 1 -- 172.21.15.1:0/2835395602 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39c03f030 con 0x7fc3a0103bb0 2024-09-21T00:56:41.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.629+0000 7fc3a801d640 1 -- 172.21.15.1:0/2835395602 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3a01a06f0 con 0x7fc3a0103bb0 2024-09-21T00:56:41.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.629+0000 7fc396ffd640 1 -- 172.21.15.1:0/2835395602 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc39c003cb0 con 0x7fc3a0103bb0 2024-09-21T00:56:41.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.629+0000 7fc396ffd640 1 -- 172.21.15.1:0/2835395602 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39c035070 con 0x7fc3a0103bb0 2024-09-21T00:56:41.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.629+0000 7fc3a801d640 1 -- 172.21.15.1:0/2835395602 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3a01a6eb0 con 0x7fc3a0103bb0 2024-09-21T00:56:41.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.631+0000 7fc3ae591740 1 Processor -- start 2024-09-21T00:56:41.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.631+0000 7fc3ae591740 1 -- start start 2024-09-21T00:56:41.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.631+0000 7fc396ffd640 1 -- 172.21.15.1:0/2835395602 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 154511+0+0 (secure 0 0 0) 0x7fc39c042030 con 0x7fc3a0103bb0 2024-09-21T00:56:41.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.632+0000 7fc3ae591740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570e2782f60 0x5570e2b28f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:41.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.632+0000 7fc3ae591740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5570e275a0a0 0x5570e2b29440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:41.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.632+0000 7fc3ae591740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2762280 0x5570e2b29980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:41.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.632+0000 7fc3ae591740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5570e2aa0c10 con 0x5570e2782f60 2024-09-21T00:56:41.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.632+0000 7fc3ae591740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5570e2a90040 con 0x5570e2762280 2024-09-21T00:56:41.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.632+0000 7fc3ae591740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5570e2a93e50 con 0x5570e275a0a0 2024-09-21T00:56:41.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.632+0000 7fc3a65ba640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570e2782f60 0x5570e2b28f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:41.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.632+0000 7fc3a65ba640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570e2782f60 0x5570e2b28f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34546/0 (socket says 172.21.15.1:34546) 2024-09-21T00:56:41.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.632+0000 7fc3a65ba640 1 -- 172.21.15.1:0/503588417 learned_addr learned my addr 172.21.15.1:0/503588417 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:41.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.632+0000 7fc3a55b8640 1 --2- 172.21.15.1:0/503588417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2762280 0x5570e2b29980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:41.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.632+0000 7fc3a5db9640 1 --2- 172.21.15.1:0/503588417 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5570e275a0a0 0x5570e2b29440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:41.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.632+0000 7fc3a65ba640 1 -- 172.21.15.1:0/503588417 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5570e275a0a0 msgr2=0x5570e2b29440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:41.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.632+0000 7fc3a65ba640 1 --2- 172.21.15.1:0/503588417 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5570e275a0a0 0x5570e2b29440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.632+0000 7fc3a65ba640 1 -- 172.21.15.1:0/503588417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2762280 msgr2=0x5570e2b29980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:41.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.632+0000 7fc3a65ba640 1 --2- 172.21.15.1:0/503588417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2762280 0x5570e2b29980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.632+0000 7fc3a65ba640 1 -- 172.21.15.1:0/503588417 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570e27ee540 con 0x5570e2782f60 2024-09-21T00:56:41.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.632+0000 7fc3a55b8640 1 --2- 172.21.15.1:0/503588417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2762280 0x5570e2b29980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:56:41.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.632+0000 7fc3a5db9640 1 --2- 172.21.15.1:0/503588417 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5570e275a0a0 0x5570e2b29440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:56:41.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.632+0000 7fc396ffd640 1 --2- 172.21.15.1:0/2835395602 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc38c0b6510 0x7fc38c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:41.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.632+0000 7fc3a65ba640 1 --2- 172.21.15.1:0/503588417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570e2782f60 0x5570e2b28f00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc39800f410 tx=0x7fc39800f8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1953c8c131f36811 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:41.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.633+0000 7fc396ffd640 1 -- 172.21.15.1:0/2835395602 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fc39c107ce0 con 0x7fc3a0103bb0 2024-09-21T00:56:41.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.633+0000 7fc3a5db9640 1 --2- 172.21.15.1:0/2835395602 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc38c0b6510 0x7fc38c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:41.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.633+0000 7fc38bfff640 1 -- 172.21.15.1:0/503588417 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc398015070 con 0x5570e2782f60 2024-09-21T00:56:41.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.633+0000 7fc38bfff640 1 -- 172.21.15.1:0/503588417 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc398011bb0 con 0x5570e2782f60 2024-09-21T00:56:41.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.633+0000 7fc38bfff640 1 -- 172.21.15.1:0/503588417 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc398010c70 con 0x5570e2782f60 2024-09-21T00:56:41.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.634+0000 7fc3ae591740 1 -- 172.21.15.1:0/503588417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570e2782f60 msgr2=0x5570e2b28f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:41.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.634+0000 7fc3a5db9640 1 --2- 172.21.15.1:0/2835395602 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc38c0b6510 0x7fc38c0b8a20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc39c004650 tx=0x7fc39c0045a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:41.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.634+0000 7fc3ae591740 1 --2- 172.21.15.1:0/503588417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570e2782f60 0x5570e2b28f00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc39800f410 tx=0x7fc39800f8d0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.634+0000 7fc3ae591740 1 -- 172.21.15.1:0/503588417 shutdown_connections 2024-09-21T00:56:41.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.634+0000 7fc3ae591740 1 --2- 172.21.15.1:0/503588417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2762280 0x5570e2b29980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.634+0000 7fc3ae591740 1 --2- 172.21.15.1:0/503588417 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5570e275a0a0 0x5570e2b29440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.634+0000 7fc3ae591740 1 --2- 172.21.15.1:0/503588417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570e2782f60 0x5570e2b28f00 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.634+0000 7fc3ae591740 1 -- 172.21.15.1:0/503588417 >> 172.21.15.1:0/503588417 conn(0x5570e2777350 msgr2=0x5570e2b26df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:41.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.634+0000 7fc3ae591740 1 -- 172.21.15.1:0/503588417 shutdown_connections 2024-09-21T00:56:41.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.634+0000 7fc3ae591740 1 -- 172.21.15.1:0/503588417 wait complete. 2024-09-21T00:56:41.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.635+0000 7fc3ae591740 1 -- start start 2024-09-21T00:56:41.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.635+0000 7fc3ae591740 1 Processor -- start 2024-09-21T00:56:41.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.635+0000 7fc3ae591740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570e275a0a0 0x5570e2b34a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:41.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.635+0000 7fc3ae591740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5570e2762280 0x5570e2b34fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:41.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.635+0000 7fc3ae591740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2782f60 0x5570e2b40a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:41.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.635+0000 7fc3ae591740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5570e28f15f0 con 0x5570e275a0a0 2024-09-21T00:56:41.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.635+0000 7fc3ae591740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5570e2a2b010 con 0x5570e2782f60 2024-09-21T00:56:41.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.635+0000 7fc3ae591740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5570e2b37730 con 0x5570e2762280 2024-09-21T00:56:41.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.635+0000 7fc3ae591740 10 client.0 _ll_register_callbacks cb 0x5570e2a8a340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:56:41.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.636+0000 7fc3a65ba640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570e275a0a0 0x5570e2b34a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:41.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.636+0000 7fc3a65ba640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570e275a0a0 0x5570e2b34a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34560/0 (socket says 172.21.15.1:34560) 2024-09-21T00:56:41.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.636+0000 7fc3a65ba640 1 -- 172.21.15.1:0/2749904027 learned_addr learned my addr 172.21.15.1:0/2749904027 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:41.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.636+0000 7fc3a55b8640 1 --2- 172.21.15.1:0/2749904027 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5570e2762280 0x5570e2b34fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:41.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.636+0000 7fc3a65ba640 1 --2- 172.21.15.1:0/2749904027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2782f60 0x5570e2b40a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:41.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.636+0000 7fc3a65ba640 1 -- 172.21.15.1:0/2749904027 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5570e2762280 msgr2=0x5570e2b34fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:41.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.636+0000 7fc3a65ba640 1 --2- 172.21.15.1:0/2749904027 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5570e2762280 0x5570e2b34fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.636+0000 7fc3a65ba640 1 -- 172.21.15.1:0/2749904027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2782f60 msgr2=0x5570e2b40a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:41.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.636+0000 7fc3a65ba640 1 --2- 172.21.15.1:0/2749904027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2782f60 0x5570e2b40a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.636+0000 7fc3a65ba640 1 -- 172.21.15.1:0/2749904027 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570e2a58a00 con 0x5570e275a0a0 2024-09-21T00:56:41.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.636+0000 7fc3a65ba640 1 --2- 172.21.15.1:0/2749904027 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570e275a0a0 0x5570e2b34a80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc398012fa0 tx=0x7fc398010690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1481bab15009227f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:41.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.636+0000 7fc3897fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:56:41.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.636+0000 7fc3897fa640 1 -- 172.21.15.1:0/2749904027 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc398015050 con 0x5570e275a0a0 2024-09-21T00:56:41.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.636+0000 7fc3897fa640 1 -- 172.21.15.1:0/2749904027 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fc398010bf0 con 0x5570e275a0a0 2024-09-21T00:56:41.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.636+0000 7fc3ae591740 1 -- 172.21.15.1:0/2749904027 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc398011bb0 con 0x5570e275a0a0 2024-09-21T00:56:41.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.637+0000 7fc3897fa640 1 -- 172.21.15.1:0/2749904027 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc398004e10 con 0x5570e275a0a0 2024-09-21T00:56:41.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.637+0000 7fc3ae591740 10 client.15306 fetch_fsmap learned FSMap version 26 2024-09-21T00:56:41.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.637+0000 7fc3ae591740 1 -- 172.21.15.1:0/2749904027 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5570e2b43640 con 0x5570e275a0a0 2024-09-21T00:56:41.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.637+0000 7fc3897fa640 1 -- 172.21.15.1:0/2749904027 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc398011bb0 con 0x5570e275a0a0 2024-09-21T00:56:41.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.637+0000 7fc3897fa640 1 -- 172.21.15.1:0/2749904027 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7fc398027020 con 0x5570e275a0a0 2024-09-21T00:56:41.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.637+0000 7fc3ae591740 10 client.15306 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T00:56:41.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.637+0000 7fc3ae591740 10 client.15306 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-21T00:56:41.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.637+0000 7fc3ae591740 20 client.15306 populate_metadata read hostname 'smithi001' 2024-09-21T00:56:41.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.637+0000 7fc3ae591740 1 --2- 172.21.15.1:0/2749904027 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x5570e27418e0 0x5570e2b46bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:41.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.637+0000 7fc3ae591740 4 client.15306 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:56:41.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.637+0000 7fc3ae591740 1 -- 172.21.15.1:0/2749904027 --> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5570e2aa2b60 con 0x5570e27418e0 2024-09-21T00:56:41.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.637+0000 7fc3a55b8640 1 --2- 172.21.15.1:0/2749904027 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x5570e27418e0 0x5570e2b46bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:41.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.638+0000 7fc3a55b8640 1 --2- 172.21.15.1:0/2749904027 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x5570e27418e0 0x5570e2b46bc0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7c48463668d3f6fb server_cookie=a0113d5a9763bd0a in_seq=0 out_seq=0 2024-09-21T00:56:41.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.638+0000 7fc3897fa640 10 client.15306 ms_handle_connect on v2:172.21.15.193:6834/3631682268 2024-09-21T00:56:41.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.639+0000 7fc3897fa640 1 -- 172.21.15.1:0/2749904027 <== mds.4 v2:172.21.15.193:6834/3631682268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5570e2aa2b60 con 0x5570e27418e0 2024-09-21T00:56:41.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.639+0000 7fc3897fa640 10 client.15306 handle_command_reply: tid=0 2024-09-21T00:56:41.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.639+0000 7fc3ae591740 1 client.15306 shutdown 2024-09-21T00:56:41.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.639+0000 7fc3ae591740 1 -- 172.21.15.1:0/2749904027 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570e275a0a0 msgr2=0x5570e2b34a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:41.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.639+0000 7fc3ae591740 1 --2- 172.21.15.1:0/2749904027 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570e275a0a0 0x5570e2b34a80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc398012fa0 tx=0x7fc398010690 comp rx=0 tx=0).stop 2024-09-21T00:56:41.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.639+0000 7fc3ae591740 1 -- 172.21.15.1:0/2749904027 shutdown_connections 2024-09-21T00:56:41.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.639+0000 7fc3ae591740 1 --2- 172.21.15.1:0/2749904027 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x5570e27418e0 0x5570e2b46bc0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.639+0000 7fc3ae591740 1 --2- 172.21.15.1:0/2749904027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2782f60 0x5570e2b40a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.639+0000 7fc3ae591740 1 --2- 172.21.15.1:0/2749904027 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5570e2762280 0x5570e2b34fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.639+0000 7fc3ae591740 1 --2- 172.21.15.1:0/2749904027 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570e275a0a0 0x5570e2b34a80 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.639+0000 7fc3897fa640 0 client.15306 ms_handle_reset on v2:172.21.15.193:6834/3631682268 2024-09-21T00:56:41.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.639+0000 7fc3ae591740 1 -- 172.21.15.1:0/2749904027 >> 172.21.15.1:0/2749904027 conn(0x5570e2777350 msgr2=0x5570e2b2c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:41.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.639+0000 7fc3ae591740 1 -- 172.21.15.1:0/2749904027 shutdown_connections 2024-09-21T00:56:41.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.639+0000 7fc3ae591740 1 -- 172.21.15.1:0/2749904027 wait complete. 2024-09-21T00:56:41.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.639+0000 7fc3ae591740 20 client.15306 trim_cache size 0 max 16384 2024-09-21T00:56:41.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.657+0000 7fc3ae591740 1 Processor -- start 2024-09-21T00:56:41.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.657+0000 7fc3ae591740 1 -- start start 2024-09-21T00:56:41.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.658+0000 7fc3ae591740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570e275a0a0 0x5570e2b2fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:41.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.658+0000 7fc3ae591740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2762280 0x5570e2b2ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:41.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.658+0000 7fc3ae591740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5570e2782f60 0x5570e2b33100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:41.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.658+0000 7fc3ae591740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5570e2b44f00 con 0x5570e275a0a0 2024-09-21T00:56:41.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.658+0000 7fc3ae591740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5570e2b455d0 con 0x5570e2762280 2024-09-21T00:56:41.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.658+0000 7fc3ae591740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5570e2b45ca0 con 0x5570e2782f60 2024-09-21T00:56:41.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.658+0000 7fc3a65ba640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570e275a0a0 0x5570e2b2fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:41.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.658+0000 7fc3a65ba640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570e275a0a0 0x5570e2b2fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34572/0 (socket says 172.21.15.1:34572) 2024-09-21T00:56:41.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.658+0000 7fc3a65ba640 1 -- 172.21.15.1:0/2179883787 learned_addr learned my addr 172.21.15.1:0/2179883787 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:41.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.658+0000 7fc3a55b8640 1 --2- 172.21.15.1:0/2179883787 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2762280 0x5570e2b2ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:41.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.658+0000 7fc3a65ba640 1 -- 172.21.15.1:0/2179883787 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5570e2782f60 msgr2=0x5570e2b33100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:41.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.658+0000 7fc3a65ba640 1 --2- 172.21.15.1:0/2179883787 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5570e2782f60 0x5570e2b33100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.658+0000 7fc3a65ba640 1 -- 172.21.15.1:0/2179883787 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2762280 msgr2=0x5570e2b2ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:41.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.658+0000 7fc3a65ba640 1 --2- 172.21.15.1:0/2179883787 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2762280 0x5570e2b2ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.658+0000 7fc3a65ba640 1 -- 172.21.15.1:0/2179883787 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570e2b2bd60 con 0x5570e275a0a0 2024-09-21T00:56:41.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.658+0000 7fc3a55b8640 1 --2- 172.21.15.1:0/2179883787 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2762280 0x5570e2b2ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:56:41.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.658+0000 7fc3a65ba640 1 --2- 172.21.15.1:0/2179883787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570e275a0a0 0x5570e2b2fa30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc398004fb0 tx=0x7fc398005f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=436d59baf287ecd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:41.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.658+0000 7fc38b7fe640 1 -- 172.21.15.1:0/2179883787 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc398015070 con 0x5570e275a0a0 2024-09-21T00:56:41.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.659+0000 7fc38b7fe640 1 -- 172.21.15.1:0/2179883787 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc39801e030 con 0x5570e275a0a0 2024-09-21T00:56:41.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.659+0000 7fc38b7fe640 1 -- 172.21.15.1:0/2179883787 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc398005280 con 0x5570e275a0a0 2024-09-21T00:56:41.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.659+0000 7fc3ae591740 1 -- 172.21.15.1:0/2179883787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570e275a0a0 msgr2=0x5570e2b2fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:41.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.659+0000 7fc3ae591740 1 --2- 172.21.15.1:0/2179883787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570e275a0a0 0x5570e2b2fa30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc398004fb0 tx=0x7fc398005f70 comp rx=0 tx=0).stop 2024-09-21T00:56:41.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.659+0000 7fc3ae591740 1 -- 172.21.15.1:0/2179883787 shutdown_connections 2024-09-21T00:56:41.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.659+0000 7fc3ae591740 1 --2- 172.21.15.1:0/2179883787 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5570e2782f60 0x5570e2b33100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.659+0000 7fc3ae591740 1 --2- 172.21.15.1:0/2179883787 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e2762280 0x5570e2b2ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.659+0000 7fc3ae591740 1 --2- 172.21.15.1:0/2179883787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570e275a0a0 0x5570e2b2fa30 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.659+0000 7fc3ae591740 1 -- 172.21.15.1:0/2179883787 >> 172.21.15.1:0/2179883787 conn(0x5570e2777350 msgr2=0x5570e2b21ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:41.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.659+0000 7fc3ae591740 1 -- 172.21.15.1:0/2179883787 shutdown_connections 2024-09-21T00:56:41.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.659+0000 7fc3ae591740 1 -- 172.21.15.1:0/2179883787 wait complete. 2024-09-21T00:56:41.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.660+0000 7fc3ae591740 1 -- start start 2024-09-21T00:56:41.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.660+0000 7fc3ae591740 1 Processor -- start 2024-09-21T00:56:41.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.660+0000 7fc3ae591740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e275a0a0 0x5570e2b4c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:41.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.660+0000 7fc3ae591740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570e2762280 0x5570e2b4cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:41.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.660+0000 7fc3ae591740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5570e2782f60 0x5570e2b4d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:41.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.660+0000 7fc3ae591740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5570e2b46a40 con 0x5570e2762280 2024-09-21T00:56:41.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.660+0000 7fc3ae591740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5570e2b46370 con 0x5570e275a0a0 2024-09-21T00:56:41.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.660+0000 7fc3ae591740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5570e2b47110 con 0x5570e2782f60 2024-09-21T00:56:41.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.660+0000 7fc3ae591740 10 client.0 _ll_register_callbacks cb 0x7fc398009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:56:41.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.660+0000 7fc3a55b8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570e2762280 0x5570e2b4cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:41.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.661+0000 7fc3a55b8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570e2762280 0x5570e2b4cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34588/0 (socket says 172.21.15.1:34588) 2024-09-21T00:56:41.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.661+0000 7fc3a55b8640 1 -- 172.21.15.1:0/1434113130 learned_addr learned my addr 172.21.15.1:0/1434113130 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:41.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.661+0000 7fc3a65ba640 1 --2- 172.21.15.1:0/1434113130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e275a0a0 0x5570e2b4c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:41.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.661+0000 7fc3a65ba640 1 --2- 172.21.15.1:0/1434113130 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5570e2782f60 0x5570e2b4d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:41.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.661+0000 7fc3a55b8640 1 -- 172.21.15.1:0/1434113130 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5570e2782f60 msgr2=0x5570e2b4d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:41.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.661+0000 7fc3a55b8640 1 --2- 172.21.15.1:0/1434113130 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5570e2782f60 0x5570e2b4d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.661+0000 7fc3a55b8640 1 -- 172.21.15.1:0/1434113130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e275a0a0 msgr2=0x5570e2b4c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:41.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.661+0000 7fc3a55b8640 1 --2- 172.21.15.1:0/1434113130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e275a0a0 0x5570e2b4c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.661+0000 7fc3a55b8640 1 -- 172.21.15.1:0/1434113130 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570e2b21080 con 0x5570e2762280 2024-09-21T00:56:41.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.661+0000 7fc3a65ba640 1 --2- 172.21.15.1:0/1434113130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e275a0a0 0x5570e2b4c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:56:41.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.661+0000 7fc3a55b8640 1 --2- 172.21.15.1:0/1434113130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570e2762280 0x5570e2b4cb10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc3a006c930 tx=0x7fc390005410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5899fb746868d7b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:41.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.661+0000 7fc3897fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:56:41.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.661+0000 7fc3897fa640 1 -- 172.21.15.1:0/1434113130 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc390012650 con 0x5570e2762280 2024-09-21T00:56:41.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.661+0000 7fc3897fa640 1 -- 172.21.15.1:0/1434113130 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fc3900127f0 con 0x5570e2762280 2024-09-21T00:56:41.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.661+0000 7fc3ae591740 1 -- 172.21.15.1:0/1434113130 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc39801e030 con 0x5570e2762280 2024-09-21T00:56:41.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.661+0000 7fc3897fa640 1 -- 172.21.15.1:0/1434113130 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc390004e70 con 0x5570e2762280 2024-09-21T00:56:41.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.661+0000 7fc3ae591740 10 client.15312 fetch_fsmap learned FSMap version 26 2024-09-21T00:56:41.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.661+0000 7fc3ae591740 1 -- 172.21.15.1:0/1434113130 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5570e2bb2350 con 0x5570e2762280 2024-09-21T00:56:41.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.662+0000 7fc3897fa640 1 -- 172.21.15.1:0/1434113130 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc39801e030 con 0x5570e2762280 2024-09-21T00:56:41.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.662+0000 7fc3897fa640 1 -- 172.21.15.1:0/1434113130 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7fc39000f040 con 0x5570e2762280 2024-09-21T00:56:41.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.662+0000 7fc3ae591740 10 client.15312 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T00:56:41.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.662+0000 7fc3ae591740 10 client.15312 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-21T00:56:41.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.662+0000 7fc3ae591740 20 client.15312 populate_metadata read hostname 'smithi001' 2024-09-21T00:56:41.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.662+0000 7fc3ae591740 1 --2- 172.21.15.1:0/1434113130 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x5570e2716c90 0x5570e2bb5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:41.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.662+0000 7fc3ae591740 4 client.15312 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T00:56:41.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.662+0000 7fc3ae591740 1 -- 172.21.15.1:0/1434113130 --> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] -- command(tid 0: {"prefix": "status"}) -- 0x5570e2a9e610 con 0x5570e2716c90 2024-09-21T00:56:41.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.662+0000 7fc3a65ba640 1 --2- 172.21.15.1:0/1434113130 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x5570e2716c90 0x5570e2bb5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:41.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.663+0000 7fc3897fa640 10 client.15312 ms_handle_connect on v2:172.21.15.193:6834/3631682268 2024-09-21T00:56:41.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.663+0000 7fc3a65ba640 1 --2- 172.21.15.1:0/1434113130 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x5570e2716c90 0x5570e2bb5ca0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9909d1e1c33fb9da server_cookie=8b58a1ea227be61e in_seq=0 out_seq=0 2024-09-21T00:56:41.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.663+0000 7fc3897fa640 1 -- 172.21.15.1:0/1434113130 <== mds.4 v2:172.21.15.193:6834/3631682268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x5570e2a9e610 con 0x5570e2716c90 2024-09-21T00:56:41.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.663+0000 7fc3897fa640 10 client.15312 handle_command_reply: tid=0 2024-09-21T00:56:41.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.663+0000 7fc3ae591740 1 client.15312 shutdown 2024-09-21T00:56:41.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.663+0000 7fc3ae591740 1 -- 172.21.15.1:0/1434113130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570e2762280 msgr2=0x5570e2b4cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:41.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.663+0000 7fc3ae591740 1 --2- 172.21.15.1:0/1434113130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570e2762280 0x5570e2b4cb10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc3a006c930 tx=0x7fc390005410 comp rx=0 tx=0).stop 2024-09-21T00:56:41.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.663+0000 7fc3ae591740 1 -- 172.21.15.1:0/1434113130 shutdown_connections 2024-09-21T00:56:41.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.663+0000 7fc3ae591740 1 --2- 172.21.15.1:0/1434113130 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x5570e2716c90 0x5570e2bb5ca0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.663+0000 7fc3ae591740 1 --2- 172.21.15.1:0/1434113130 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5570e2782f60 0x5570e2b4d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.663+0000 7fc3ae591740 1 --2- 172.21.15.1:0/1434113130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570e2762280 0x5570e2b4cb10 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.663+0000 7fc3ae591740 1 --2- 172.21.15.1:0/1434113130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5570e275a0a0 0x5570e2b4c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.663+0000 7fc3897fa640 0 client.15312 ms_handle_reset on v2:172.21.15.193:6834/3631682268 2024-09-21T00:56:41.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.663+0000 7fc3ae591740 1 -- 172.21.15.1:0/1434113130 >> 172.21.15.1:0/1434113130 conn(0x5570e2777350 msgr2=0x5570e2b34a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:41.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.663+0000 7fc3ae591740 1 -- 172.21.15.1:0/1434113130 shutdown_connections 2024-09-21T00:56:41.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.663+0000 7fc3ae591740 1 -- 172.21.15.1:0/1434113130 wait complete. 2024-09-21T00:56:41.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.663+0000 7fc3ae591740 20 client.15312 trim_cache size 0 max 16384 2024-09-21T00:56:41.670 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T00:56:41.670 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "d3972c20-77b2-11ef-baf5-efdc52797490", 2024-09-21T00:56:41.670 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 4, 2024-09-21T00:56:41.670 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24610, 2024-09-21T00:56:41.670 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-21T00:56:41.670 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-21T00:56:41.670 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-21T00:56:41.670 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 92.481290332, 2024-09-21T00:56:41.670 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 26, 2024-09-21T00:56:41.670 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 75, 2024-09-21T00:56:41.670 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 73, 2024-09-21T00:56:41.671 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 130.03181615299999 2024-09-21T00:56:41.671 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T00:56:41.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.664+0000 7fc3a801d640 1 -- 172.21.15.1:0/2835395602 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc38c0b6510 msgr2=0x7fc38c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:41.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.664+0000 7fc3a801d640 1 --2- 172.21.15.1:0/2835395602 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc38c0b6510 0x7fc38c0b8a20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc39c004650 tx=0x7fc39c0045a0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.664+0000 7fc3a801d640 1 -- 172.21.15.1:0/2835395602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3a0103bb0 msgr2=0x7fc3a019a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:41.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.664+0000 7fc3a801d640 1 --2- 172.21.15.1:0/2835395602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3a0103bb0 0x7fc3a019a4f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc39c005940 tx=0x7fc39c0042f0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.664+0000 7fc3a801d640 1 -- 172.21.15.1:0/2835395602 shutdown_connections 2024-09-21T00:56:41.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.664+0000 7fc3a801d640 1 --2- 172.21.15.1:0/2835395602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3a0109e40 0x7fc3a019fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.664+0000 7fc3a801d640 1 --2- 172.21.15.1:0/2835395602 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc3a01094f0 0x7fc3a019aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.664+0000 7fc3a801d640 1 --2- 172.21.15.1:0/2835395602 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc38c0b6510 0x7fc38c0b8a20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.664+0000 7fc3a801d640 1 --2- 172.21.15.1:0/2835395602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3a0103bb0 0x7fc3a019a4f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.664+0000 7fc3a801d640 1 -- 172.21.15.1:0/2835395602 >> 172.21.15.1:0/2835395602 conn(0x7fc3a00ff600 msgr2=0x7fc3a0101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:41.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.664+0000 7fc3a801d640 1 -- 172.21.15.1:0/2835395602 shutdown_connections 2024-09-21T00:56:41.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:41.664+0000 7fc3a801d640 1 -- 172.21.15.1:0/2835395602 wait complete. 2024-09-21T00:56:42.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:41 smithi001 ceph-mon[31211]: pgmap v342: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-21T00:56:42.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:41 smithi193 ceph-mon[34660]: pgmap v342: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-21T00:56:42.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:41 smithi042 ceph-mon[34481]: pgmap v342: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-21T00:56:42.435 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.c status 2024-09-21T00:56:42.690 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:43.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.160+0000 7f9302c4b640 1 -- 172.21.15.1:0/2423955855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92fc1094a0 msgr2=0x7f92fc1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:43.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.160+0000 7f9302c4b640 1 --2- 172.21.15.1:0/2423955855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92fc1094a0 0x7f92fc1098b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f92ec009900 tx=0x7f92ec02a410 comp rx=0 tx=0).stop 2024-09-21T00:56:43.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.160+0000 7f9302c4b640 1 -- 172.21.15.1:0/2423955855 shutdown_connections 2024-09-21T00:56:43.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.160+0000 7f9302c4b640 1 --2- 172.21.15.1:0/2423955855 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92fc109df0 0x7f92fc110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.160+0000 7f9302c4b640 1 --2- 172.21.15.1:0/2423955855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92fc1094a0 0x7f92fc1098b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.160+0000 7f9302c4b640 1 --2- 172.21.15.1:0/2423955855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92fc103b60 0x7f92fc103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.160+0000 7f9302c4b640 1 -- 172.21.15.1:0/2423955855 >> 172.21.15.1:0/2423955855 conn(0x7f92fc07b850 msgr2=0x7f92fc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:43.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.160+0000 7f9302c4b640 1 -- 172.21.15.1:0/2423955855 shutdown_connections 2024-09-21T00:56:43.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.160+0000 7f9302c4b640 1 -- 172.21.15.1:0/2423955855 wait complete. 2024-09-21T00:56:43.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.161+0000 7f9302c4b640 1 Processor -- start 2024-09-21T00:56:43.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.161+0000 7f9302c4b640 1 -- start start 2024-09-21T00:56:43.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.161+0000 7f9302c4b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92fc103b60 0x7f92fc19a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:43.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.161+0000 7f9302c4b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92fc1094a0 0x7f92fc19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:43.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.161+0000 7f9302c4b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92fc109df0 0x7f92fc19fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:43.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.161+0000 7f9302c4b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc113ab0 con 0x7f92fc1094a0 2024-09-21T00:56:43.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.161+0000 7f9302c4b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc113930 con 0x7f92fc109df0 2024-09-21T00:56:43.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.161+0000 7f9302c4b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc113c30 con 0x7f92fc103b60 2024-09-21T00:56:43.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.161+0000 7f92f3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92fc1094a0 0x7f92fc19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:43.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.161+0000 7f92f3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92fc1094a0 0x7f92fc19ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34612/0 (socket says 172.21.15.1:34612) 2024-09-21T00:56:43.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.161+0000 7f92f3fff640 1 -- 172.21.15.1:0/3031963778 learned_addr learned my addr 172.21.15.1:0/3031963778 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:43.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.161+0000 7f93009e7640 1 --2- 172.21.15.1:0/3031963778 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92fc103b60 0x7f92fc19a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:43.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.161+0000 7f93011e8640 1 --2- 172.21.15.1:0/3031963778 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92fc109df0 0x7f92fc19fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:43.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.161+0000 7f92f3fff640 1 -- 172.21.15.1:0/3031963778 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92fc103b60 msgr2=0x7f92fc19a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:43.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.161+0000 7f92f3fff640 1 --2- 172.21.15.1:0/3031963778 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92fc103b60 0x7f92fc19a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.161+0000 7f92f3fff640 1 -- 172.21.15.1:0/3031963778 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92fc109df0 msgr2=0x7f92fc19fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:43.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.161+0000 7f92f3fff640 1 --2- 172.21.15.1:0/3031963778 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92fc109df0 0x7f92fc19fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.161+0000 7f92f3fff640 1 -- 172.21.15.1:0/3031963778 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92fc1a0450 con 0x7f92fc1094a0 2024-09-21T00:56:43.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.162+0000 7f92f3fff640 1 --2- 172.21.15.1:0/3031963778 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92fc1094a0 0x7f92fc19ab40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f92ec02a930 tx=0x7f92ec004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:43.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.162+0000 7f92f1ffb640 1 -- 172.21.15.1:0/3031963778 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ec03f030 con 0x7f92fc1094a0 2024-09-21T00:56:43.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.162+0000 7f92f1ffb640 1 -- 172.21.15.1:0/3031963778 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92ec003aa0 con 0x7f92fc1094a0 2024-09-21T00:56:43.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.162+0000 7f9302c4b640 1 -- 172.21.15.1:0/3031963778 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92fc1a06e0 con 0x7f92fc1094a0 2024-09-21T00:56:43.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.162+0000 7f92f1ffb640 1 -- 172.21.15.1:0/3031963778 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ec035070 con 0x7f92fc1094a0 2024-09-21T00:56:43.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.162+0000 7f9302c4b640 1 -- 172.21.15.1:0/3031963778 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92fc1a0c10 con 0x7f92fc1094a0 2024-09-21T00:56:43.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.165+0000 7f92f1ffb640 1 -- 172.21.15.1:0/3031963778 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 154511+0+0 (secure 0 0 0) 0x7f92ec042030 con 0x7f92fc1094a0 2024-09-21T00:56:43.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.165+0000 7f93091bf740 1 Processor -- start 2024-09-21T00:56:43.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.165+0000 7f93091bf740 1 -- start start 2024-09-21T00:56:43.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.165+0000 7f93091bf740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b2c54ff60 0x564b2c8f5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:43.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.165+0000 7f93091bf740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b2c5270a0 0x564b2c8f6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:43.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.165+0000 7f93091bf740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b2c52f280 0x564b2c8f6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:43.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.165+0000 7f93091bf740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564b2c86dc10 con 0x564b2c52f280 2024-09-21T00:56:43.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.165+0000 7f93091bf740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564b2c85d040 con 0x564b2c5270a0 2024-09-21T00:56:43.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.165+0000 7f93091bf740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564b2c860e50 con 0x564b2c54ff60 2024-09-21T00:56:43.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.166+0000 7f92f3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b2c52f280 0x564b2c8f6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:43.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.166+0000 7f92f3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b2c52f280 0x564b2c8f6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34624/0 (socket says 172.21.15.1:34624) 2024-09-21T00:56:43.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.166+0000 7f92f3fff640 1 -- 172.21.15.1:0/2729335168 learned_addr learned my addr 172.21.15.1:0/2729335168 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:43.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.166+0000 7f92f1ffb640 1 --2- 172.21.15.1:0/3031963778 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f92e40b65c0 0x7f92e40b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:43.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.166+0000 7f93011e8640 1 --2- 172.21.15.1:0/2729335168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b2c54ff60 0x564b2c8f5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:43.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.166+0000 7f93009e7640 1 --2- 172.21.15.1:0/2729335168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b2c5270a0 0x564b2c8f6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:43.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.166+0000 7f92f3fff640 1 -- 172.21.15.1:0/2729335168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b2c54ff60 msgr2=0x564b2c8f5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:43.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.166+0000 7f92f3fff640 1 --2- 172.21.15.1:0/2729335168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b2c54ff60 0x564b2c8f5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.166+0000 7f92f3fff640 1 -- 172.21.15.1:0/2729335168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b2c5270a0 msgr2=0x564b2c8f6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:43.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.166+0000 7f92f3fff640 1 --2- 172.21.15.1:0/2729335168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b2c5270a0 0x564b2c8f6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.166+0000 7f92f3fff640 1 -- 172.21.15.1:0/2729335168 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b2c5bb540 con 0x564b2c52f280 2024-09-21T00:56:43.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.166+0000 7f93011e8640 1 --2- 172.21.15.1:0/2729335168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b2c54ff60 0x564b2c8f5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:56:43.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.166+0000 7f93009e7640 1 --2- 172.21.15.1:0/2729335168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b2c5270a0 0x564b2c8f6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:56:43.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.166+0000 7f93011e8640 1 --2- 172.21.15.1:0/3031963778 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f92e40b65c0 0x7f92e40b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:43.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.166+0000 7f92f1ffb640 1 -- 172.21.15.1:0/3031963778 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f92ec107a00 con 0x7f92fc1094a0 2024-09-21T00:56:43.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.166+0000 7f92f3fff640 1 --2- 172.21.15.1:0/2729335168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b2c52f280 0x564b2c8f6980 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f92ec0c66e0 tx=0x7f92ec04b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d78d2e4d0d8436d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:43.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.167+0000 7f92e2ffd640 1 -- 172.21.15.1:0/2729335168 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ec0cd280 con 0x564b2c52f280 2024-09-21T00:56:43.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.167+0000 7f92e2ffd640 1 -- 172.21.15.1:0/2729335168 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92ec109e50 con 0x564b2c52f280 2024-09-21T00:56:43.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.167+0000 7f93011e8640 1 --2- 172.21.15.1:0/3031963778 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f92e40b65c0 0x7f92e40b8ad0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f92f4007e90 tx=0x7f92f4004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:43.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.167+0000 7f92e2ffd640 1 -- 172.21.15.1:0/2729335168 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ec0c62e0 con 0x564b2c52f280 2024-09-21T00:56:43.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.167+0000 7f93091bf740 1 -- 172.21.15.1:0/2729335168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b2c52f280 msgr2=0x564b2c8f6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:43.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.167+0000 7f93091bf740 1 --2- 172.21.15.1:0/2729335168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b2c52f280 0x564b2c8f6980 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f92ec0c66e0 tx=0x7f92ec04b000 comp rx=0 tx=0).stop 2024-09-21T00:56:43.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.167+0000 7f93091bf740 1 -- 172.21.15.1:0/2729335168 shutdown_connections 2024-09-21T00:56:43.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.167+0000 7f93091bf740 1 --2- 172.21.15.1:0/2729335168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b2c52f280 0x564b2c8f6980 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.167+0000 7f93091bf740 1 --2- 172.21.15.1:0/2729335168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b2c5270a0 0x564b2c8f6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.168+0000 7f93091bf740 1 --2- 172.21.15.1:0/2729335168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b2c54ff60 0x564b2c8f5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.168+0000 7f93091bf740 1 -- 172.21.15.1:0/2729335168 >> 172.21.15.1:0/2729335168 conn(0x564b2c544350 msgr2=0x564b2c8f3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:43.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.168+0000 7f93091bf740 1 -- 172.21.15.1:0/2729335168 shutdown_connections 2024-09-21T00:56:43.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.168+0000 7f93091bf740 1 -- 172.21.15.1:0/2729335168 wait complete. 2024-09-21T00:56:43.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.168+0000 7f93091bf740 1 -- start start 2024-09-21T00:56:43.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.168+0000 7f93091bf740 1 Processor -- start 2024-09-21T00:56:43.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.169+0000 7f93091bf740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b2c5270a0 0x564b2c901730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:43.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.169+0000 7f93091bf740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b2c52f280 0x564b2c901cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:43.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.169+0000 7f93091bf740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b2c54ff60 0x564b2c90d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:43.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.169+0000 7f93091bf740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564b2c6be5f0 con 0x564b2c54ff60 2024-09-21T00:56:43.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.169+0000 7f93091bf740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564b2c7f8010 con 0x564b2c5270a0 2024-09-21T00:56:43.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.169+0000 7f93091bf740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564b2c9044a0 con 0x564b2c52f280 2024-09-21T00:56:43.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.169+0000 7f93091bf740 10 client.0 _ll_register_callbacks cb 0x564b2c857340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:56:43.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.169+0000 7f93011e8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b2c54ff60 0x564b2c90d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:43.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.169+0000 7f93011e8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b2c54ff60 0x564b2c90d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34628/0 (socket says 172.21.15.1:34628) 2024-09-21T00:56:43.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.169+0000 7f93011e8640 1 -- 172.21.15.1:0/3614680125 learned_addr learned my addr 172.21.15.1:0/3614680125 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:43.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.169+0000 7f93009e7640 1 --2- 172.21.15.1:0/3614680125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b2c5270a0 0x564b2c901730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:43.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.169+0000 7f92f3fff640 1 --2- 172.21.15.1:0/3614680125 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b2c52f280 0x564b2c901cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:43.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.169+0000 7f93011e8640 1 -- 172.21.15.1:0/3614680125 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b2c52f280 msgr2=0x564b2c901cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:43.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.169+0000 7f93011e8640 1 --2- 172.21.15.1:0/3614680125 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b2c52f280 0x564b2c901cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.169+0000 7f93011e8640 1 -- 172.21.15.1:0/3614680125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b2c5270a0 msgr2=0x564b2c901730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:43.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.169+0000 7f93011e8640 1 --2- 172.21.15.1:0/3614680125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b2c5270a0 0x564b2c901730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.169+0000 7f93011e8640 1 -- 172.21.15.1:0/3614680125 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b2c825a00 con 0x564b2c54ff60 2024-09-21T00:56:43.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.169+0000 7f92f3fff640 1 --2- 172.21.15.1:0/3614680125 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b2c52f280 0x564b2c901cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:56:43.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.169+0000 7f93011e8640 1 --2- 172.21.15.1:0/3614680125 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b2c54ff60 0x564b2c90d6c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f92f40129d0 tx=0x7f92f4007470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=656f9530eb9ae375 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:43.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.169+0000 7f92dbfff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:56:43.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.169+0000 7f92dbfff640 1 -- 172.21.15.1:0/3614680125 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f4010ea0 con 0x564b2c54ff60 2024-09-21T00:56:43.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.169+0000 7f92dbfff640 1 -- 172.21.15.1:0/3614680125 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f92f401dd00 con 0x564b2c54ff60 2024-09-21T00:56:43.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.169+0000 7f93091bf740 1 -- 172.21.15.1:0/3614680125 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92ec109e50 con 0x564b2c54ff60 2024-09-21T00:56:43.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.170+0000 7f92dbfff640 1 -- 172.21.15.1:0/3614680125 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f92f401b450 con 0x564b2c54ff60 2024-09-21T00:56:43.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.170+0000 7f93091bf740 10 client.15324 fetch_fsmap learned FSMap version 26 2024-09-21T00:56:43.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.170+0000 7f93091bf740 1 -- 172.21.15.1:0/3614680125 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564b2c9102c0 con 0x564b2c54ff60 2024-09-21T00:56:43.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.170+0000 7f92dbfff640 1 -- 172.21.15.1:0/3614680125 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92ec109e50 con 0x564b2c54ff60 2024-09-21T00:56:43.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.170+0000 7f92dbfff640 1 -- 172.21.15.1:0/3614680125 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f92f4024070 con 0x564b2c54ff60 2024-09-21T00:56:43.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.170+0000 7f93091bf740 10 client.15324 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T00:56:43.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.170+0000 7f93091bf740 10 client.15324 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T00:56:43.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.170+0000 7f93091bf740 20 client.15324 populate_metadata read hostname 'smithi001' 2024-09-21T00:56:43.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.170+0000 7f93091bf740 1 --2- 172.21.15.1:0/3614680125 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x564b2c50e8e0 0x564b2c913db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:43.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.170+0000 7f93091bf740 4 client.15324 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:56:43.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.170+0000 7f93091bf740 1 -- 172.21.15.1:0/3614680125 --> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b2c86fb60 con 0x564b2c50e8e0 2024-09-21T00:56:43.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.170+0000 7f93009e7640 1 --2- 172.21.15.1:0/3614680125 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x564b2c50e8e0 0x564b2c913db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:43.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.171+0000 7f92dbfff640 10 client.15324 ms_handle_connect on v2:172.21.15.193:6836/909252228 2024-09-21T00:56:43.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.171+0000 7f93009e7640 1 --2- 172.21.15.1:0/3614680125 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x564b2c50e8e0 0x564b2c913db0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8bf1851c0af0292f server_cookie=36c51d8fb31bf71b in_seq=0 out_seq=0 2024-09-21T00:56:43.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.172+0000 7f92dbfff640 1 -- 172.21.15.1:0/3614680125 <== mds.3 v2:172.21.15.193:6836/909252228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564b2c86fb60 con 0x564b2c50e8e0 2024-09-21T00:56:43.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.172+0000 7f92dbfff640 10 client.15324 handle_command_reply: tid=0 2024-09-21T00:56:43.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.172+0000 7f93091bf740 1 client.15324 shutdown 2024-09-21T00:56:43.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.172+0000 7f93091bf740 1 -- 172.21.15.1:0/3614680125 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b2c54ff60 msgr2=0x564b2c90d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:43.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.172+0000 7f93091bf740 1 --2- 172.21.15.1:0/3614680125 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b2c54ff60 0x564b2c90d6c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f92f40129d0 tx=0x7f92f4007470 comp rx=0 tx=0).stop 2024-09-21T00:56:43.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.172+0000 7f93091bf740 1 -- 172.21.15.1:0/3614680125 shutdown_connections 2024-09-21T00:56:43.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.172+0000 7f93091bf740 1 --2- 172.21.15.1:0/3614680125 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x564b2c50e8e0 0x564b2c913db0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.172+0000 7f92dbfff640 0 client.15324 ms_handle_reset on v2:172.21.15.193:6836/909252228 2024-09-21T00:56:43.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.172+0000 7f93091bf740 1 --2- 172.21.15.1:0/3614680125 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b2c54ff60 0x564b2c90d6c0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.172+0000 7f93091bf740 1 --2- 172.21.15.1:0/3614680125 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b2c52f280 0x564b2c901cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.172+0000 7f93091bf740 1 --2- 172.21.15.1:0/3614680125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b2c5270a0 0x564b2c901730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.172+0000 7f93091bf740 1 -- 172.21.15.1:0/3614680125 >> 172.21.15.1:0/3614680125 conn(0x564b2c544350 msgr2=0x564b2c8f78f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:43.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.172+0000 7f93091bf740 1 -- 172.21.15.1:0/3614680125 shutdown_connections 2024-09-21T00:56:43.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.172+0000 7f93091bf740 1 -- 172.21.15.1:0/3614680125 wait complete. 2024-09-21T00:56:43.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.172+0000 7f93091bf740 20 client.15324 trim_cache size 0 max 16384 2024-09-21T00:56:43.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.190+0000 7f93091bf740 1 Processor -- start 2024-09-21T00:56:43.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.190+0000 7f93091bf740 1 -- start start 2024-09-21T00:56:43.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.190+0000 7f93091bf740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b2c50e8e0 0x564b2c8fffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:43.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.190+0000 7f93091bf740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b2c5270a0 0x564b2c9004f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:43.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.190+0000 7f93091bf740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b2c52f280 0x564b2c8f33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:43.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.190+0000 7f93091bf740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564b2c9120f0 con 0x564b2c50e8e0 2024-09-21T00:56:43.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.191+0000 7f93091bf740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564b2c9127c0 con 0x564b2c52f280 2024-09-21T00:56:43.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.191+0000 7f93091bf740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564b2c912e90 con 0x564b2c5270a0 2024-09-21T00:56:43.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.191+0000 7f93009e7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b2c50e8e0 0x564b2c8fffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:43.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.191+0000 7f93009e7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b2c50e8e0 0x564b2c8fffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34630/0 (socket says 172.21.15.1:34630) 2024-09-21T00:56:43.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.191+0000 7f93009e7640 1 -- 172.21.15.1:0/1278942174 learned_addr learned my addr 172.21.15.1:0/1278942174 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:43.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.191+0000 7f92f3fff640 1 --2- 172.21.15.1:0/1278942174 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b2c5270a0 0x564b2c9004f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:43.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.191+0000 7f93011e8640 1 --2- 172.21.15.1:0/1278942174 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b2c52f280 0x564b2c8f33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:43.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.191+0000 7f93009e7640 1 -- 172.21.15.1:0/1278942174 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b2c5270a0 msgr2=0x564b2c9004f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:43.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.191+0000 7f93009e7640 1 --2- 172.21.15.1:0/1278942174 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b2c5270a0 0x564b2c9004f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.191+0000 7f93009e7640 1 -- 172.21.15.1:0/1278942174 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b2c52f280 msgr2=0x564b2c8f33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:43.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.191+0000 7f93009e7640 1 --2- 172.21.15.1:0/1278942174 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b2c52f280 0x564b2c8f33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.191+0000 7f93009e7640 1 -- 172.21.15.1:0/1278942174 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b2c8f8790 con 0x564b2c50e8e0 2024-09-21T00:56:43.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.191+0000 7f93011e8640 1 --2- 172.21.15.1:0/1278942174 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b2c52f280 0x564b2c8f33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:56:43.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.191+0000 7f93009e7640 1 --2- 172.21.15.1:0/1278942174 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b2c50e8e0 0x564b2c8fffb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f92f800b620 tx=0x7f92f800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af6e273a13ecc5e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:43.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.191+0000 7f92e27fc640 1 -- 172.21.15.1:0/1278942174 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f8003b20 con 0x564b2c50e8e0 2024-09-21T00:56:43.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.191+0000 7f92e27fc640 1 -- 172.21.15.1:0/1278942174 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92f80054d0 con 0x564b2c50e8e0 2024-09-21T00:56:43.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.191+0000 7f92e27fc640 1 -- 172.21.15.1:0/1278942174 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f8004d60 con 0x564b2c50e8e0 2024-09-21T00:56:43.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.192+0000 7f93091bf740 1 -- 172.21.15.1:0/1278942174 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b2c50e8e0 msgr2=0x564b2c8fffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:43.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.192+0000 7f93091bf740 1 --2- 172.21.15.1:0/1278942174 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b2c50e8e0 0x564b2c8fffb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f92f800b620 tx=0x7f92f800bc80 comp rx=0 tx=0).stop 2024-09-21T00:56:43.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.192+0000 7f93091bf740 1 -- 172.21.15.1:0/1278942174 shutdown_connections 2024-09-21T00:56:43.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.192+0000 7f93091bf740 1 --2- 172.21.15.1:0/1278942174 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b2c52f280 0x564b2c8f33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.192+0000 7f93091bf740 1 --2- 172.21.15.1:0/1278942174 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b2c5270a0 0x564b2c9004f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.192+0000 7f93091bf740 1 --2- 172.21.15.1:0/1278942174 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b2c50e8e0 0x564b2c8fffb0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.192+0000 7f93091bf740 1 -- 172.21.15.1:0/1278942174 >> 172.21.15.1:0/1278942174 conn(0x564b2c544350 msgr2=0x564b2c8fc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.192+0000 7f93091bf740 1 -- 172.21.15.1:0/1278942174 shutdown_connections 2024-09-21T00:56:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.192+0000 7f93091bf740 1 -- 172.21.15.1:0/1278942174 wait complete. 2024-09-21T00:56:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.193+0000 7f93091bf740 1 -- start start 2024-09-21T00:56:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.193+0000 7f93091bf740 1 Processor -- start 2024-09-21T00:56:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.193+0000 7f93091bf740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b2c50e8e0 0x564b2c916580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.193+0000 7f93091bf740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b2c5270a0 0x564b2c916b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.193+0000 7f93091bf740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b2c52f280 0x564b2c91bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.193+0000 7f93091bf740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564b2c913c30 con 0x564b2c52f280 2024-09-21T00:56:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.193+0000 7f93091bf740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564b2c913560 con 0x564b2c50e8e0 2024-09-21T00:56:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.193+0000 7f93091bf740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564b2c914300 con 0x564b2c5270a0 2024-09-21T00:56:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.193+0000 7f93091bf740 10 client.0 _ll_register_callbacks cb 0x7f92f4005bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:56:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.193+0000 7f93011e8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b2c52f280 0x564b2c91bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:43.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.193+0000 7f93011e8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b2c52f280 0x564b2c91bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34632/0 (socket says 172.21.15.1:34632) 2024-09-21T00:56:43.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.193+0000 7f93011e8640 1 -- 172.21.15.1:0/844288602 learned_addr learned my addr 172.21.15.1:0/844288602 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:43.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.193+0000 7f92f3fff640 1 --2- 172.21.15.1:0/844288602 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b2c5270a0 0x564b2c916b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:43.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.193+0000 7f93009e7640 1 --2- 172.21.15.1:0/844288602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b2c50e8e0 0x564b2c916580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:43.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.194+0000 7f93011e8640 1 -- 172.21.15.1:0/844288602 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b2c5270a0 msgr2=0x564b2c916b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:43.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.194+0000 7f93011e8640 1 --2- 172.21.15.1:0/844288602 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b2c5270a0 0x564b2c916b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.194+0000 7f93011e8640 1 -- 172.21.15.1:0/844288602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b2c50e8e0 msgr2=0x564b2c916580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:43.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.194+0000 7f93011e8640 1 --2- 172.21.15.1:0/844288602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b2c50e8e0 0x564b2c916580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.194+0000 7f93011e8640 1 -- 172.21.15.1:0/844288602 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b2c91c190 con 0x564b2c52f280 2024-09-21T00:56:43.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.194+0000 7f93011e8640 1 --2- 172.21.15.1:0/844288602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b2c52f280 0x564b2c91bc50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f92f4014020 tx=0x7f92f4026dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99e2d25f8d3a177f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:43.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.194+0000 7f92dbfff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:56:43.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.194+0000 7f92dbfff640 1 -- 172.21.15.1:0/844288602 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f4010c50 con 0x564b2c52f280 2024-09-21T00:56:43.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.194+0000 7f92dbfff640 1 -- 172.21.15.1:0/844288602 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f92f401db00 con 0x564b2c52f280 2024-09-21T00:56:43.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.194+0000 7f93091bf740 1 -- 172.21.15.1:0/844288602 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92f80054d0 con 0x564b2c52f280 2024-09-21T00:56:43.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.194+0000 7f92dbfff640 1 -- 172.21.15.1:0/844288602 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f92f403f050 con 0x564b2c52f280 2024-09-21T00:56:43.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.194+0000 7f93091bf740 10 client.15330 fetch_fsmap learned FSMap version 26 2024-09-21T00:56:43.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.194+0000 7f93091bf740 1 -- 172.21.15.1:0/844288602 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564b2c97f9a0 con 0x564b2c52f280 2024-09-21T00:56:43.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.194+0000 7f92dbfff640 1 -- 172.21.15.1:0/844288602 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92f80054d0 con 0x564b2c52f280 2024-09-21T00:56:43.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.195+0000 7f92dbfff640 1 -- 172.21.15.1:0/844288602 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f92f4024070 con 0x564b2c52f280 2024-09-21T00:56:43.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.195+0000 7f93091bf740 10 client.15330 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T00:56:43.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.195+0000 7f93091bf740 10 client.15330 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T00:56:43.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.195+0000 7f93091bf740 20 client.15330 populate_metadata read hostname 'smithi001' 2024-09-21T00:56:43.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.195+0000 7f93091bf740 1 --2- 172.21.15.1:0/844288602 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x564b2c54ff60 0x564b2c983310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:43.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.195+0000 7f93091bf740 4 client.15330 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T00:56:43.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.195+0000 7f93091bf740 1 -- 172.21.15.1:0/844288602 --> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] -- command(tid 0: {"prefix": "status"}) -- 0x564b2c86b610 con 0x564b2c54ff60 2024-09-21T00:56:43.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.195+0000 7f93009e7640 1 --2- 172.21.15.1:0/844288602 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x564b2c54ff60 0x564b2c983310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:43.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.196+0000 7f92dbfff640 10 client.15330 ms_handle_connect on v2:172.21.15.193:6836/909252228 2024-09-21T00:56:43.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.196+0000 7f93009e7640 1 --2- 172.21.15.1:0/844288602 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x564b2c54ff60 0x564b2c983310 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=889d455a77f5b356 server_cookie=8fce9db84c736d2 in_seq=0 out_seq=0 2024-09-21T00:56:43.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.196+0000 7f92dbfff640 1 -- 172.21.15.1:0/844288602 <== mds.3 v2:172.21.15.193:6836/909252228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x564b2c86b610 con 0x564b2c54ff60 2024-09-21T00:56:43.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.196+0000 7f92dbfff640 10 client.15330 handle_command_reply: tid=0 2024-09-21T00:56:43.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.196+0000 7f93091bf740 1 client.15330 shutdown 2024-09-21T00:56:43.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.196+0000 7f93091bf740 1 -- 172.21.15.1:0/844288602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b2c52f280 msgr2=0x564b2c91bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:43.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.196+0000 7f93091bf740 1 --2- 172.21.15.1:0/844288602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b2c52f280 0x564b2c91bc50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f92f4014020 tx=0x7f92f4026dc0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.196+0000 7f93091bf740 1 -- 172.21.15.1:0/844288602 shutdown_connections 2024-09-21T00:56:43.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.196+0000 7f93091bf740 1 --2- 172.21.15.1:0/844288602 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x564b2c54ff60 0x564b2c983310 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.196+0000 7f92dbfff640 0 client.15330 ms_handle_reset on v2:172.21.15.193:6836/909252228 2024-09-21T00:56:43.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.196+0000 7f93091bf740 1 --2- 172.21.15.1:0/844288602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b2c52f280 0x564b2c91bc50 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.196+0000 7f93091bf740 1 --2- 172.21.15.1:0/844288602 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b2c5270a0 0x564b2c916b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.196+0000 7f93091bf740 1 --2- 172.21.15.1:0/844288602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b2c50e8e0 0x564b2c916580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.196+0000 7f93091bf740 1 -- 172.21.15.1:0/844288602 >> 172.21.15.1:0/844288602 conn(0x564b2c544350 msgr2=0x564b2c8ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:43.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.196+0000 7f93091bf740 1 -- 172.21.15.1:0/844288602 shutdown_connections 2024-09-21T00:56:43.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.196+0000 7f93091bf740 1 -- 172.21.15.1:0/844288602 wait complete. 2024-09-21T00:56:43.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.196+0000 7f93091bf740 20 client.15330 trim_cache size 0 max 16384 2024-09-21T00:56:43.203 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T00:56:43.203 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "d3972c20-77b2-11ef-baf5-efdc52797490", 2024-09-21T00:56:43.203 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 3, 2024-09-21T00:56:43.203 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24622, 2024-09-21T00:56:43.203 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-21T00:56:43.203 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-21T00:56:43.204 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-21T00:56:43.204 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 95.021515796000003, 2024-09-21T00:56:43.204 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 26, 2024-09-21T00:56:43.204 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 75, 2024-09-21T00:56:43.204 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 73, 2024-09-21T00:56:43.204 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 128.98486073000001 2024-09-21T00:56:43.204 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T00:56:43.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.197+0000 7f9302c4b640 1 -- 172.21.15.1:0/3031963778 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f92e40b65c0 msgr2=0x7f92e40b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:43.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.197+0000 7f9302c4b640 1 --2- 172.21.15.1:0/3031963778 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f92e40b65c0 0x7f92e40b8ad0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f92f4007e90 tx=0x7f92f4004a40 comp rx=0 tx=0).stop 2024-09-21T00:56:43.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.197+0000 7f9302c4b640 1 -- 172.21.15.1:0/3031963778 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92fc1094a0 msgr2=0x7f92fc19ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:43.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.197+0000 7f9302c4b640 1 --2- 172.21.15.1:0/3031963778 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92fc1094a0 0x7f92fc19ab40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f92ec02a930 tx=0x7f92ec004270 comp rx=0 tx=0).stop 2024-09-21T00:56:43.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.197+0000 7f9302c4b640 1 -- 172.21.15.1:0/3031963778 shutdown_connections 2024-09-21T00:56:43.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.197+0000 7f9302c4b640 1 --2- 172.21.15.1:0/3031963778 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92fc109df0 0x7f92fc19fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.197+0000 7f9302c4b640 1 --2- 172.21.15.1:0/3031963778 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f92e40b65c0 0x7f92e40b8ad0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.197+0000 7f9302c4b640 1 --2- 172.21.15.1:0/3031963778 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92fc1094a0 0x7f92fc19ab40 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.197+0000 7f9302c4b640 1 --2- 172.21.15.1:0/3031963778 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92fc103b60 0x7f92fc19a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.197+0000 7f9302c4b640 1 -- 172.21.15.1:0/3031963778 >> 172.21.15.1:0/3031963778 conn(0x7f92fc07b850 msgr2=0x7f92fc105620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:43.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.197+0000 7f9302c4b640 1 -- 172.21.15.1:0/3031963778 shutdown_connections 2024-09-21T00:56:43.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:43.197+0000 7f9302c4b640 1 -- 172.21.15.1:0/3031963778 wait complete. 2024-09-21T00:56:44.005 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.h status 2024-09-21T00:56:44.209 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:43 smithi001 ceph-mon[31211]: pgmap v343: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T00:56:44.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:43 smithi193 ceph-mon[34660]: pgmap v343: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T00:56:44.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:43 smithi042 ceph-mon[34481]: pgmap v343: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T00:56:44.261 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:44.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.754+0000 7f26a905c640 1 -- 172.21.15.1:0/1473706650 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26a410deb0 msgr2=0x7f26a4110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:44.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.754+0000 7f26a905c640 1 --2- 172.21.15.1:0/1473706650 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26a410deb0 0x7f26a4110330 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f269c009ca0 tx=0x7f269c02a8c0 comp rx=0 tx=0).stop 2024-09-21T00:56:44.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.754+0000 7f26a905c640 1 -- 172.21.15.1:0/1473706650 shutdown_connections 2024-09-21T00:56:44.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.754+0000 7f26a905c640 1 --2- 172.21.15.1:0/1473706650 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26a410deb0 0x7f26a4110330 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:44.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.754+0000 7f26a905c640 1 --2- 172.21.15.1:0/1473706650 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26a4105250 0x7f26a410d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:44.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.754+0000 7f26a905c640 1 --2- 172.21.15.1:0/1473706650 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26a4104900 0x7f26a4104d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:44.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.754+0000 7f26a905c640 1 -- 172.21.15.1:0/1473706650 >> 172.21.15.1:0/1473706650 conn(0x7f26a4079760 msgr2=0x7f26a4079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:44.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.754+0000 7f26a905c640 1 -- 172.21.15.1:0/1473706650 shutdown_connections 2024-09-21T00:56:44.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.754+0000 7f26a905c640 1 -- 172.21.15.1:0/1473706650 wait complete. 2024-09-21T00:56:44.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.755+0000 7f26a905c640 1 Processor -- start 2024-09-21T00:56:44.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.755+0000 7f26a905c640 1 -- start start 2024-09-21T00:56:44.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.756+0000 7f26a905c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26a4104900 0x7f26a419a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:44.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.756+0000 7f26a905c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26a4105250 0x7f26a419a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:44.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.756+0000 7f26a905c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26a410deb0 0x7f26a419fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:44.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.756+0000 7f26a905c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f26a4113aa0 con 0x7f26a410deb0 2024-09-21T00:56:44.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.756+0000 7f26a905c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f26a4113920 con 0x7f26a4104900 2024-09-21T00:56:44.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.756+0000 7f26a905c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f26a4113c20 con 0x7f26a4105250 2024-09-21T00:56:44.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.756+0000 7f26a359e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26a410deb0 0x7f26a419fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:44.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.756+0000 7f26a359e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26a410deb0 0x7f26a419fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34654/0 (socket says 172.21.15.1:34654) 2024-09-21T00:56:44.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.756+0000 7f26a359e640 1 -- 172.21.15.1:0/1251988173 learned_addr learned my addr 172.21.15.1:0/1251988173 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:44.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.756+0000 7f26a2d9d640 1 --2- 172.21.15.1:0/1251988173 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26a4104900 0x7f26a419a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:44.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.756+0000 7f26a259c640 1 --2- 172.21.15.1:0/1251988173 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26a4105250 0x7f26a419a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:44.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.756+0000 7f26a359e640 1 -- 172.21.15.1:0/1251988173 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26a4105250 msgr2=0x7f26a419a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:44.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.756+0000 7f26a359e640 1 --2- 172.21.15.1:0/1251988173 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26a4105250 0x7f26a419a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:44.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.756+0000 7f26a359e640 1 -- 172.21.15.1:0/1251988173 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26a4104900 msgr2=0x7f26a419a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:44.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.756+0000 7f26a359e640 1 --2- 172.21.15.1:0/1251988173 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26a4104900 0x7f26a419a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:44.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.756+0000 7f26a359e640 1 -- 172.21.15.1:0/1251988173 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26a41a03a0 con 0x7f26a410deb0 2024-09-21T00:56:44.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.756+0000 7f26a359e640 1 --2- 172.21.15.1:0/1251988173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26a410deb0 0x7f26a419fc70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f269c0319f0 tx=0x7f269c031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:44.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.757+0000 7f268bfff640 1 -- 172.21.15.1:0/1251988173 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c003bf0 con 0x7f26a410deb0 2024-09-21T00:56:44.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.757+0000 7f26a905c640 1 -- 172.21.15.1:0/1251988173 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26a41a0630 con 0x7f26a410deb0 2024-09-21T00:56:44.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.757+0000 7f268bfff640 1 -- 172.21.15.1:0/1251988173 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f269c003d90 con 0x7f26a410deb0 2024-09-21T00:56:44.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.757+0000 7f268bfff640 1 -- 172.21.15.1:0/1251988173 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c02fc00 con 0x7f26a410deb0 2024-09-21T00:56:44.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.757+0000 7f26a905c640 1 -- 172.21.15.1:0/1251988173 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26a41a6df0 con 0x7f26a410deb0 2024-09-21T00:56:44.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.759+0000 7f26af5d0740 1 Processor -- start 2024-09-21T00:56:44.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.760+0000 7f268bfff640 1 -- 172.21.15.1:0/1251988173 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 154511+0+0 (secure 0 0 0) 0x7f269c004610 con 0x7f26a410deb0 2024-09-21T00:56:44.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.760+0000 7f26af5d0740 1 -- start start 2024-09-21T00:56:44.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.760+0000 7f26af5d0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5637d246bf60 0x5637d2811f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:44.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.760+0000 7f26af5d0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637d24430a0 0x5637d2812440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:44.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.760+0000 7f26af5d0740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5637d244b280 0x5637d2812980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:44.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.760+0000 7f26af5d0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5637d2789c10 con 0x5637d24430a0 2024-09-21T00:56:44.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.760+0000 7f26af5d0740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5637d2779040 con 0x5637d244b280 2024-09-21T00:56:44.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.760+0000 7f26af5d0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5637d277ce50 con 0x5637d246bf60 2024-09-21T00:56:44.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.760+0000 7f26a2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637d24430a0 0x5637d2812440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:44.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.760+0000 7f26a2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637d24430a0 0x5637d2812440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34670/0 (socket says 172.21.15.1:34670) 2024-09-21T00:56:44.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.760+0000 7f26a2d9d640 1 -- 172.21.15.1:0/3813263482 learned_addr learned my addr 172.21.15.1:0/3813263482 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:44.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.760+0000 7f26a259c640 1 --2- 172.21.15.1:0/3813263482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5637d244b280 0x5637d2812980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:44.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.760+0000 7f26a259c640 1 --2- 172.21.15.1:0/3813263482 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5637d246bf60 0x5637d2811f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:44.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.760+0000 7f26a2d9d640 1 -- 172.21.15.1:0/3813263482 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5637d246bf60 msgr2=0x5637d2811f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:44.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.760+0000 7f26a2d9d640 1 --2- 172.21.15.1:0/3813263482 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5637d246bf60 0x5637d2811f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:44.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.760+0000 7f26a2d9d640 1 -- 172.21.15.1:0/3813263482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5637d244b280 msgr2=0x5637d2812980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:44.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.760+0000 7f26a2d9d640 1 --2- 172.21.15.1:0/3813263482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5637d244b280 0x5637d2812980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:44.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.760+0000 7f26a2d9d640 1 -- 172.21.15.1:0/3813263482 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637d24d7540 con 0x5637d24430a0 2024-09-21T00:56:44.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.760+0000 7f268bfff640 1 --2- 172.21.15.1:0/1251988173 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f268c0b6510 0x7f268c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:44.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.761+0000 7f26a259c640 1 --2- 172.21.15.1:0/1251988173 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f268c0b6510 0x7f268c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:44.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.761+0000 7f26a2d9d640 1 --2- 172.21.15.1:0/3813263482 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637d24430a0 0x5637d2812440 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f269400abf0 tx=0x7f269400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77b5e91830dead9f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:44.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.761+0000 7f268bfff640 1 -- 172.21.15.1:0/1251988173 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f269c108680 con 0x7f26a410deb0 2024-09-21T00:56:44.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.761+0000 7f26897fa640 1 -- 172.21.15.1:0/3813263482 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2694005220 con 0x5637d24430a0 2024-09-21T00:56:44.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.761+0000 7f26897fa640 1 -- 172.21.15.1:0/3813263482 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26940047a0 con 0x5637d24430a0 2024-09-21T00:56:44.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.761+0000 7f26897fa640 1 -- 172.21.15.1:0/3813263482 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2694018730 con 0x5637d24430a0 2024-09-21T00:56:44.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.762+0000 7f26af5d0740 1 -- 172.21.15.1:0/3813263482 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637d24430a0 msgr2=0x5637d2812440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:44.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.762+0000 7f26a259c640 1 --2- 172.21.15.1:0/1251988173 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f268c0b6510 0x7f268c0b8a20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2698005d00 tx=0x7f2698005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:44.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.762+0000 7f26af5d0740 1 --2- 172.21.15.1:0/3813263482 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637d24430a0 0x5637d2812440 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f269400abf0 tx=0x7f269400f790 comp rx=0 tx=0).stop 2024-09-21T00:56:44.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.762+0000 7f26af5d0740 1 -- 172.21.15.1:0/3813263482 shutdown_connections 2024-09-21T00:56:44.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.762+0000 7f26af5d0740 1 --2- 172.21.15.1:0/3813263482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5637d244b280 0x5637d2812980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:44.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.762+0000 7f26af5d0740 1 --2- 172.21.15.1:0/3813263482 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637d24430a0 0x5637d2812440 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:44.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.762+0000 7f26af5d0740 1 --2- 172.21.15.1:0/3813263482 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5637d246bf60 0x5637d2811f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:44.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.762+0000 7f26af5d0740 1 -- 172.21.15.1:0/3813263482 >> 172.21.15.1:0/3813263482 conn(0x5637d2460350 msgr2=0x5637d280fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:44.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.762+0000 7f26af5d0740 1 -- 172.21.15.1:0/3813263482 shutdown_connections 2024-09-21T00:56:44.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.762+0000 7f26af5d0740 1 -- 172.21.15.1:0/3813263482 wait complete. 2024-09-21T00:56:44.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.762+0000 7f26af5d0740 1 -- start start 2024-09-21T00:56:44.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.762+0000 7f26af5d0740 1 Processor -- start 2024-09-21T00:56:44.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.763+0000 7f26af5d0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637d24430a0 0x5637d281d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:44.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.763+0000 7f26af5d0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5637d244b280 0x5637d281dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:44.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.763+0000 7f26af5d0740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5637d246bf60 0x5637d2829a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:44.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.763+0000 7f26af5d0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5637d25da5f0 con 0x5637d24430a0 2024-09-21T00:56:44.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.763+0000 7f26af5d0740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5637d2714010 con 0x5637d246bf60 2024-09-21T00:56:44.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.763+0000 7f26af5d0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5637d28206e0 con 0x5637d244b280 2024-09-21T00:56:44.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.763+0000 7f26af5d0740 10 client.0 _ll_register_callbacks cb 0x5637d2773340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:56:44.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.763+0000 7f26a2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637d24430a0 0x5637d281d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:44.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.763+0000 7f26a2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637d24430a0 0x5637d281d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34684/0 (socket says 172.21.15.1:34684) 2024-09-21T00:56:44.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.763+0000 7f26a2d9d640 1 -- 172.21.15.1:0/4050845027 learned_addr learned my addr 172.21.15.1:0/4050845027 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:44.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.763+0000 7f26a359e640 1 --2- 172.21.15.1:0/4050845027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5637d246bf60 0x5637d2829a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:44.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.763+0000 7f26a259c640 1 --2- 172.21.15.1:0/4050845027 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5637d244b280 0x5637d281dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:44.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.763+0000 7f26a2d9d640 1 -- 172.21.15.1:0/4050845027 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5637d244b280 msgr2=0x5637d281dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:44.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.763+0000 7f26a2d9d640 1 --2- 172.21.15.1:0/4050845027 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5637d244b280 0x5637d281dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:44.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.763+0000 7f26a2d9d640 1 -- 172.21.15.1:0/4050845027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5637d246bf60 msgr2=0x5637d2829a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:44.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.763+0000 7f26a2d9d640 1 --2- 172.21.15.1:0/4050845027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5637d246bf60 0x5637d2829a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:44.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.763+0000 7f26a2d9d640 1 -- 172.21.15.1:0/4050845027 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637d2741a00 con 0x5637d24430a0 2024-09-21T00:56:44.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.763+0000 7f26a259c640 1 --2- 172.21.15.1:0/4050845027 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5637d244b280 0x5637d281dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:56:44.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.763+0000 7f26a2d9d640 1 --2- 172.21.15.1:0/4050845027 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637d24430a0 0x5637d281d730 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f26940042f0 tx=0x7f2694004320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3774f346e0787f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:44.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.763+0000 7f2686ff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:56:44.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.764+0000 7f2686ff5640 1 -- 172.21.15.1:0/4050845027 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2694027020 con 0x5637d24430a0 2024-09-21T00:56:44.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.764+0000 7f26af5d0740 1 -- 172.21.15.1:0/4050845027 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26940047a0 con 0x5637d24430a0 2024-09-21T00:56:44.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.764+0000 7f2686ff5640 1 -- 172.21.15.1:0/4050845027 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f269400a7b0 con 0x5637d24430a0 2024-09-21T00:56:44.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.764+0000 7f2686ff5640 1 -- 172.21.15.1:0/4050845027 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2694032050 con 0x5637d24430a0 2024-09-21T00:56:44.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.764+0000 7f26af5d0740 10 client.15342 fetch_fsmap learned FSMap version 26 2024-09-21T00:56:44.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.764+0000 7f26af5d0740 1 -- 172.21.15.1:0/4050845027 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5637d282c570 con 0x5637d24430a0 2024-09-21T00:56:44.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.764+0000 7f2686ff5640 1 -- 172.21.15.1:0/4050845027 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26940047a0 con 0x5637d24430a0 2024-09-21T00:56:44.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.764+0000 7f2686ff5640 1 -- 172.21.15.1:0/4050845027 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f2694003ac0 con 0x5637d24430a0 2024-09-21T00:56:44.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.764+0000 7f26af5d0740 10 client.15342 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T00:56:44.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.764+0000 7f26af5d0740 10 client.15342 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T00:56:44.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.764+0000 7f26af5d0740 20 client.15342 populate_metadata read hostname 'smithi001' 2024-09-21T00:56:44.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.764+0000 7f26af5d0740 1 --2- 172.21.15.1:0/4050845027 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x5637d242a8e0 0x5637d282fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:44.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.764+0000 7f26af5d0740 4 client.15342 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:56:44.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.764+0000 7f26af5d0740 1 -- 172.21.15.1:0/4050845027 --> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637d278bb60 con 0x5637d242a8e0 2024-09-21T00:56:44.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.765+0000 7f26a259c640 1 --2- 172.21.15.1:0/4050845027 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x5637d242a8e0 0x5637d282fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:44.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.765+0000 7f2686ff5640 10 client.15342 ms_handle_connect on v2:172.21.15.42:6836/2395608508 2024-09-21T00:56:44.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.765+0000 7f26a259c640 1 --2- 172.21.15.1:0/4050845027 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x5637d242a8e0 0x5637d282fd00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1f86440cd1a2b4bf server_cookie=f770af96307094f4 in_seq=0 out_seq=0 2024-09-21T00:56:44.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.766+0000 7f2686ff5640 1 -- 172.21.15.1:0/4050845027 <== mds.2 v2:172.21.15.42:6836/2395608508 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5637d278bb60 con 0x5637d242a8e0 2024-09-21T00:56:44.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.766+0000 7f2686ff5640 10 client.15342 handle_command_reply: tid=0 2024-09-21T00:56:44.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.766+0000 7f26af5d0740 1 client.15342 shutdown 2024-09-21T00:56:44.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.766+0000 7f26af5d0740 1 -- 172.21.15.1:0/4050845027 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637d24430a0 msgr2=0x5637d281d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:44.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.766+0000 7f26af5d0740 1 --2- 172.21.15.1:0/4050845027 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637d24430a0 0x5637d281d730 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f26940042f0 tx=0x7f2694004320 comp rx=0 tx=0).stop 2024-09-21T00:56:44.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.766+0000 7f26af5d0740 1 -- 172.21.15.1:0/4050845027 shutdown_connections 2024-09-21T00:56:44.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.766+0000 7f26af5d0740 1 --2- 172.21.15.1:0/4050845027 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x5637d242a8e0 0x5637d282fd00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:44.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.766+0000 7f26af5d0740 1 --2- 172.21.15.1:0/4050845027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5637d246bf60 0x5637d2829a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:44.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.766+0000 7f26af5d0740 1 --2- 172.21.15.1:0/4050845027 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5637d244b280 0x5637d281dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:44.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.766+0000 7f2686ff5640 0 client.15342 ms_handle_reset on v2:172.21.15.42:6836/2395608508 2024-09-21T00:56:44.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.766+0000 7f26af5d0740 1 --2- 172.21.15.1:0/4050845027 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637d24430a0 0x5637d281d730 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:44.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.766+0000 7f26af5d0740 1 -- 172.21.15.1:0/4050845027 >> 172.21.15.1:0/4050845027 conn(0x5637d2460350 msgr2=0x5637d2815090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:44.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.767+0000 7f26af5d0740 1 -- 172.21.15.1:0/4050845027 shutdown_connections 2024-09-21T00:56:44.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.767+0000 7f26af5d0740 1 -- 172.21.15.1:0/4050845027 wait complete. 2024-09-21T00:56:44.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.767+0000 7f26af5d0740 20 client.15342 trim_cache size 0 max 16384 2024-09-21T00:56:44.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.785+0000 7f26af5d0740 1 Processor -- start 2024-09-21T00:56:44.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.785+0000 7f26af5d0740 1 -- start start 2024-09-21T00:56:44.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.786+0000 7f26af5d0740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5637d242a8e0 0x5637d2818020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:44.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.786+0000 7f26af5d0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637d24430a0 0x5637d281cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:44.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.786+0000 7f26af5d0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5637d244b280 0x5637d2829970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:44.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.786+0000 7f26af5d0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5637d282e040 con 0x5637d24430a0 2024-09-21T00:56:44.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.786+0000 7f26af5d0740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5637d282e710 con 0x5637d242a8e0 2024-09-21T00:56:44.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.786+0000 7f26af5d0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5637d282ede0 con 0x5637d244b280 2024-09-21T00:56:44.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.786+0000 7f26a259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637d24430a0 0x5637d281cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:44.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.786+0000 7f26a259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637d24430a0 0x5637d281cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34694/0 (socket says 172.21.15.1:34694) 2024-09-21T00:56:44.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.786+0000 7f26a259c640 1 -- 172.21.15.1:0/1120271581 learned_addr learned my addr 172.21.15.1:0/1120271581 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:44.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.786+0000 7f26a2d9d640 1 --2- 172.21.15.1:0/1120271581 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5637d242a8e0 0x5637d2818020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:44.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.786+0000 7f26a359e640 1 --2- 172.21.15.1:0/1120271581 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5637d244b280 0x5637d2829970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:44.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.786+0000 7f26a259c640 1 -- 172.21.15.1:0/1120271581 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5637d244b280 msgr2=0x5637d2829970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:44.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.786+0000 7f26a259c640 1 --2- 172.21.15.1:0/1120271581 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5637d244b280 0x5637d2829970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:44.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.786+0000 7f26a259c640 1 -- 172.21.15.1:0/1120271581 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5637d242a8e0 msgr2=0x5637d2818020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:44.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.786+0000 7f26a259c640 1 --2- 172.21.15.1:0/1120271581 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5637d242a8e0 0x5637d2818020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:44.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.786+0000 7f26a259c640 1 -- 172.21.15.1:0/1120271581 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637d2818fc0 con 0x5637d24430a0 2024-09-21T00:56:44.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.786+0000 7f26a259c640 1 --2- 172.21.15.1:0/1120271581 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637d24430a0 0x5637d281cc20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f26a406b680 tx=0x7f26980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d010b895b34d41a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:44.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.786+0000 7f2688ff9640 1 -- 172.21.15.1:0/1120271581 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2698024190 con 0x5637d24430a0 2024-09-21T00:56:44.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.786+0000 7f2688ff9640 1 -- 172.21.15.1:0/1120271581 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2698024df0 con 0x5637d24430a0 2024-09-21T00:56:44.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.786+0000 7f2688ff9640 1 -- 172.21.15.1:0/1120271581 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2698004a00 con 0x5637d24430a0 2024-09-21T00:56:44.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.787+0000 7f26af5d0740 1 -- 172.21.15.1:0/1120271581 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637d24430a0 msgr2=0x5637d281cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:44.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.787+0000 7f26af5d0740 1 --2- 172.21.15.1:0/1120271581 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637d24430a0 0x5637d281cc20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f26a406b680 tx=0x7f26980046c0 comp rx=0 tx=0).stop 2024-09-21T00:56:44.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.787+0000 7f26af5d0740 1 -- 172.21.15.1:0/1120271581 shutdown_connections 2024-09-21T00:56:44.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.787+0000 7f26af5d0740 1 --2- 172.21.15.1:0/1120271581 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5637d244b280 0x5637d2829970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:44.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.787+0000 7f26af5d0740 1 --2- 172.21.15.1:0/1120271581 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637d24430a0 0x5637d281cc20 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:44.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.787+0000 7f26af5d0740 1 --2- 172.21.15.1:0/1120271581 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5637d242a8e0 0x5637d2818020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:44.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.787+0000 7f26af5d0740 1 -- 172.21.15.1:0/1120271581 >> 172.21.15.1:0/1120271581 conn(0x5637d2460350 msgr2=0x5637d281bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:44.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.787+0000 7f26af5d0740 1 -- 172.21.15.1:0/1120271581 shutdown_connections 2024-09-21T00:56:44.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.787+0000 7f26af5d0740 1 -- 172.21.15.1:0/1120271581 wait complete. 2024-09-21T00:56:44.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.788+0000 7f26af5d0740 1 -- start start 2024-09-21T00:56:44.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.788+0000 7f26af5d0740 1 Processor -- start 2024-09-21T00:56:44.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.788+0000 7f26af5d0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637d242a8e0 0x5637d2832550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:44.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.788+0000 7f26af5d0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5637d24430a0 0x5637d28291c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:44.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.788+0000 7f26af5d0740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5637d244b280 0x5637d2829700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:44.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.788+0000 7f26af5d0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5637d282fb80 con 0x5637d242a8e0 2024-09-21T00:56:44.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.788+0000 7f26af5d0740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5637d282f4b0 con 0x5637d244b280 2024-09-21T00:56:44.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.788+0000 7f26af5d0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5637d2830250 con 0x5637d24430a0 2024-09-21T00:56:44.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.788+0000 7f26af5d0740 10 client.0 _ll_register_callbacks cb 0x7f269800ba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:56:44.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.788+0000 7f26a2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637d242a8e0 0x5637d2832550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:44.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.788+0000 7f26a2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637d242a8e0 0x5637d2832550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34702/0 (socket says 172.21.15.1:34702) 2024-09-21T00:56:44.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.788+0000 7f26a2d9d640 1 -- 172.21.15.1:0/2998388876 learned_addr learned my addr 172.21.15.1:0/2998388876 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:44.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.789+0000 7f26a359e640 1 --2- 172.21.15.1:0/2998388876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5637d244b280 0x5637d2829700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:44.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.789+0000 7f26a259c640 1 --2- 172.21.15.1:0/2998388876 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5637d24430a0 0x5637d28291c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:44.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.789+0000 7f26a2d9d640 1 -- 172.21.15.1:0/2998388876 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5637d24430a0 msgr2=0x5637d28291c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:44.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.789+0000 7f26a2d9d640 1 --2- 172.21.15.1:0/2998388876 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5637d24430a0 0x5637d28291c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:44.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.789+0000 7f26a2d9d640 1 -- 172.21.15.1:0/2998388876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5637d244b280 msgr2=0x5637d2829700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:44.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.789+0000 7f26a2d9d640 1 --2- 172.21.15.1:0/2998388876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5637d244b280 0x5637d2829700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:44.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.789+0000 7f26a2d9d640 1 -- 172.21.15.1:0/2998388876 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637d2829c40 con 0x5637d242a8e0 2024-09-21T00:56:44.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.789+0000 7f26a2d9d640 1 --2- 172.21.15.1:0/2998388876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637d242a8e0 0x5637d2832550 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2694004fd0 tx=0x7f269400aab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1489613f3c79f193 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:44.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.789+0000 7f2686ff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:56:44.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.789+0000 7f2686ff5640 1 -- 172.21.15.1:0/2998388876 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269403b060 con 0x5637d242a8e0 2024-09-21T00:56:44.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.789+0000 7f2686ff5640 1 -- 172.21.15.1:0/2998388876 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f2694004390 con 0x5637d242a8e0 2024-09-21T00:56:44.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.789+0000 7f26af5d0740 1 -- 172.21.15.1:0/2998388876 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2698024df0 con 0x5637d242a8e0 2024-09-21T00:56:44.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.789+0000 7f2686ff5640 1 -- 172.21.15.1:0/2998388876 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2694027040 con 0x5637d242a8e0 2024-09-21T00:56:44.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.789+0000 7f26af5d0740 10 client.15348 fetch_fsmap learned FSMap version 26 2024-09-21T00:56:44.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.789+0000 7f26af5d0740 1 -- 172.21.15.1:0/2998388876 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5637d289ee70 con 0x5637d242a8e0 2024-09-21T00:56:44.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.790+0000 7f2686ff5640 1 -- 172.21.15.1:0/2998388876 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2698024df0 con 0x5637d242a8e0 2024-09-21T00:56:44.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.790+0000 7f2686ff5640 1 -- 172.21.15.1:0/2998388876 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f2694003870 con 0x5637d242a8e0 2024-09-21T00:56:44.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.790+0000 7f26af5d0740 10 client.15348 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T00:56:44.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.790+0000 7f26af5d0740 10 client.15348 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T00:56:44.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.790+0000 7f26af5d0740 20 client.15348 populate_metadata read hostname 'smithi001' 2024-09-21T00:56:44.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.790+0000 7f26af5d0740 1 --2- 172.21.15.1:0/2998388876 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x5637d246bf60 0x5637d28a26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:44.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.790+0000 7f26af5d0740 4 client.15348 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T00:56:44.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.790+0000 7f26af5d0740 1 -- 172.21.15.1:0/2998388876 --> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] -- command(tid 0: {"prefix": "status"}) -- 0x5637d2787610 con 0x5637d246bf60 2024-09-21T00:56:44.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.790+0000 7f26a259c640 1 --2- 172.21.15.1:0/2998388876 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x5637d246bf60 0x5637d28a26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:44.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.791+0000 7f2686ff5640 10 client.15348 ms_handle_connect on v2:172.21.15.42:6836/2395608508 2024-09-21T00:56:44.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.791+0000 7f26a259c640 1 --2- 172.21.15.1:0/2998388876 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x5637d246bf60 0x5637d28a26a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5d88a1f97462e529 server_cookie=b7fd402ac70d5759 in_seq=0 out_seq=0 2024-09-21T00:56:44.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.791+0000 7f2686ff5640 1 -- 172.21.15.1:0/2998388876 <== mds.2 v2:172.21.15.42:6836/2395608508 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x5637d2787610 con 0x5637d246bf60 2024-09-21T00:56:44.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.791+0000 7f2686ff5640 10 client.15348 handle_command_reply: tid=0 2024-09-21T00:56:44.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.791+0000 7f26af5d0740 1 client.15348 shutdown 2024-09-21T00:56:44.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.791+0000 7f26af5d0740 1 -- 172.21.15.1:0/2998388876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637d242a8e0 msgr2=0x5637d2832550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:44.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.791+0000 7f26af5d0740 1 --2- 172.21.15.1:0/2998388876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637d242a8e0 0x5637d2832550 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2694004fd0 tx=0x7f269400aab0 comp rx=0 tx=0).stop 2024-09-21T00:56:44.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.791+0000 7f26af5d0740 1 -- 172.21.15.1:0/2998388876 shutdown_connections 2024-09-21T00:56:44.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.791+0000 7f26af5d0740 1 --2- 172.21.15.1:0/2998388876 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x5637d246bf60 0x5637d28a26a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:44.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.791+0000 7f26af5d0740 1 --2- 172.21.15.1:0/2998388876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5637d244b280 0x5637d2829700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:44.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.791+0000 7f26af5d0740 1 --2- 172.21.15.1:0/2998388876 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5637d24430a0 0x5637d28291c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:44.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.791+0000 7f2686ff5640 0 client.15348 ms_handle_reset on v2:172.21.15.42:6836/2395608508 2024-09-21T00:56:44.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.791+0000 7f26af5d0740 1 --2- 172.21.15.1:0/2998388876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637d242a8e0 0x5637d2832550 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:44.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.791+0000 7f26af5d0740 1 -- 172.21.15.1:0/2998388876 >> 172.21.15.1:0/2998388876 conn(0x5637d2460350 msgr2=0x5637d281d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:44.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.791+0000 7f26af5d0740 1 -- 172.21.15.1:0/2998388876 shutdown_connections 2024-09-21T00:56:44.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.791+0000 7f26af5d0740 1 -- 172.21.15.1:0/2998388876 wait complete. 2024-09-21T00:56:44.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.791+0000 7f26af5d0740 20 client.15348 trim_cache size 0 max 16384 2024-09-21T00:56:44.798 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T00:56:44.798 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "d3972c20-77b2-11ef-baf5-efdc52797490", 2024-09-21T00:56:44.798 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 2, 2024-09-21T00:56:44.798 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24626, 2024-09-21T00:56:44.798 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-21T00:56:44.798 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-21T00:56:44.798 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-21T00:56:44.798 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 97.625798304, 2024-09-21T00:56:44.798 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 26, 2024-09-21T00:56:44.798 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 75, 2024-09-21T00:56:44.798 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 73, 2024-09-21T00:56:44.798 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 127.953513962 2024-09-21T00:56:44.798 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T00:56:44.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.792+0000 7f26a905c640 1 -- 172.21.15.1:0/1251988173 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f268c0b6510 msgr2=0x7f268c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:44.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.792+0000 7f26a905c640 1 --2- 172.21.15.1:0/1251988173 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f268c0b6510 0x7f268c0b8a20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2698005d00 tx=0x7f2698005c90 comp rx=0 tx=0).stop 2024-09-21T00:56:44.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.792+0000 7f26a905c640 1 -- 172.21.15.1:0/1251988173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26a410deb0 msgr2=0x7f26a419fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:44.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.792+0000 7f26a905c640 1 --2- 172.21.15.1:0/1251988173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26a410deb0 0x7f26a419fc70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f269c0319f0 tx=0x7f269c031a20 comp rx=0 tx=0).stop 2024-09-21T00:56:44.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.792+0000 7f26a905c640 1 -- 172.21.15.1:0/1251988173 shutdown_connections 2024-09-21T00:56:44.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.792+0000 7f26a905c640 1 --2- 172.21.15.1:0/1251988173 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f268c0b6510 0x7f268c0b8a20 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:44.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.792+0000 7f26a905c640 1 --2- 172.21.15.1:0/1251988173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26a410deb0 0x7f26a419fc70 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:44.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.792+0000 7f26a905c640 1 --2- 172.21.15.1:0/1251988173 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26a4105250 0x7f26a419a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:44.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.792+0000 7f26a905c640 1 --2- 172.21.15.1:0/1251988173 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26a4104900 0x7f26a419a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:44.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.792+0000 7f26a905c640 1 -- 172.21.15.1:0/1251988173 >> 172.21.15.1:0/1251988173 conn(0x7f26a4079760 msgr2=0x7f26a4105910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:44.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.792+0000 7f26a905c640 1 -- 172.21.15.1:0/1251988173 shutdown_connections 2024-09-21T00:56:44.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:44.792+0000 7f26a905c640 1 -- 172.21.15.1:0/1251988173 wait complete. 2024-09-21T00:56:45.531 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T00:56:45.787 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:46.173 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:45 smithi001 ceph-mon[31211]: pgmap v344: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T00:56:46.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:45 smithi193 ceph-mon[34660]: pgmap v344: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T00:56:46.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:45 smithi042 ceph-mon[34481]: pgmap v344: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T00:56:46.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.265+0000 7f394fd3f640 1 -- 172.21.15.1:0/2228012343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39480757b0 msgr2=0x7f3948075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:46.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.265+0000 7f394fd3f640 1 --2- 172.21.15.1:0/2228012343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39480757b0 0x7f3948075bc0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3938009ca0 tx=0x7f393802a8c0 comp rx=0 tx=0).stop 2024-09-21T00:56:46.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.265+0000 7f394fd3f640 1 -- 172.21.15.1:0/2228012343 shutdown_connections 2024-09-21T00:56:46.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.265+0000 7f394fd3f640 1 --2- 172.21.15.1:0/2228012343 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39481100e0 0x7f3948112520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:46.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.265+0000 7f394fd3f640 1 --2- 172.21.15.1:0/2228012343 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3948076100 0x7f394810fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:46.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.265+0000 7f394fd3f640 1 --2- 172.21.15.1:0/2228012343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39480757b0 0x7f3948075bc0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:46.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.265+0000 7f394fd3f640 1 -- 172.21.15.1:0/2228012343 >> 172.21.15.1:0/2228012343 conn(0x7f39480ff5b0 msgr2=0x7f3948101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:46.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.265+0000 7f394fd3f640 1 -- 172.21.15.1:0/2228012343 shutdown_connections 2024-09-21T00:56:46.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.265+0000 7f394fd3f640 1 -- 172.21.15.1:0/2228012343 wait complete. 2024-09-21T00:56:46.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.266+0000 7f394fd3f640 1 Processor -- start 2024-09-21T00:56:46.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.266+0000 7f394fd3f640 1 -- start start 2024-09-21T00:56:46.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.266+0000 7f394fd3f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f39480757b0 0x7f394819c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:46.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.266+0000 7f394fd3f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3948076100 0x7f394819cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:46.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.266+0000 7f394fd3f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39481100e0 0x7f39481a1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:46.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.266+0000 7f394fd3f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3948115c90 con 0x7f39481100e0 2024-09-21T00:56:46.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.266+0000 7f394fd3f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3948115b10 con 0x7f3948076100 2024-09-21T00:56:46.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.266+0000 7f394fd3f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3948115e10 con 0x7f39480757b0 2024-09-21T00:56:46.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.266+0000 7f394e2dc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39481100e0 0x7f39481a1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:46.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.266+0000 7f394e2dc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39481100e0 0x7f39481a1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34712/0 (socket says 172.21.15.1:34712) 2024-09-21T00:56:46.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.266+0000 7f394e2dc640 1 -- 172.21.15.1:0/1666050541 learned_addr learned my addr 172.21.15.1:0/1666050541 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:46.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.266+0000 7f394d2da640 1 --2- 172.21.15.1:0/1666050541 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3948076100 0x7f394819cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:46.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.267+0000 7f394dadb640 1 --2- 172.21.15.1:0/1666050541 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f39480757b0 0x7f394819c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:46.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.267+0000 7f394e2dc640 1 -- 172.21.15.1:0/1666050541 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f39480757b0 msgr2=0x7f394819c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:46.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.267+0000 7f394e2dc640 1 --2- 172.21.15.1:0/1666050541 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f39480757b0 0x7f394819c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:46.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.267+0000 7f394e2dc640 1 -- 172.21.15.1:0/1666050541 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3948076100 msgr2=0x7f394819cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:46.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.267+0000 7f394e2dc640 1 --2- 172.21.15.1:0/1666050541 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3948076100 0x7f394819cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:46.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.267+0000 7f394e2dc640 1 -- 172.21.15.1:0/1666050541 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39481a2590 con 0x7f39481100e0 2024-09-21T00:56:46.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.267+0000 7f394e2dc640 1 --2- 172.21.15.1:0/1666050541 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39481100e0 0x7f39481a1e60 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f394000d750 tx=0x7f394000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:46.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.267+0000 7f3946ffd640 1 -- 172.21.15.1:0/1666050541 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3940017070 con 0x7f39481100e0 2024-09-21T00:56:46.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.267+0000 7f3946ffd640 1 -- 172.21.15.1:0/1666050541 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39400054d0 con 0x7f39481100e0 2024-09-21T00:56:46.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.267+0000 7f394fd3f640 1 -- 172.21.15.1:0/1666050541 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39481a2880 con 0x7f39481100e0 2024-09-21T00:56:46.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.267+0000 7f3946ffd640 1 -- 172.21.15.1:0/1666050541 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3940004c60 con 0x7f39481100e0 2024-09-21T00:56:46.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.267+0000 7f394fd3f640 1 -- 172.21.15.1:0/1666050541 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39481a8fe0 con 0x7f39481100e0 2024-09-21T00:56:46.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.270+0000 7f39562b3740 1 Processor -- start 2024-09-21T00:56:46.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.271+0000 7f3946ffd640 1 -- 172.21.15.1:0/1666050541 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 154511+0+0 (secure 0 0 0) 0x7f3940004e00 con 0x7f39481100e0 2024-09-21T00:56:46.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.271+0000 7f39562b3740 1 -- start start 2024-09-21T00:56:46.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.271+0000 7f39562b3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f4bd891f60 0x55f4bdc37f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:46.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.271+0000 7f39562b3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4bd8690a0 0x55f4bdc38440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:46.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.271+0000 7f39562b3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4bd871280 0x55f4bdc38980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:46.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.271+0000 7f39562b3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f4bdbafc10 con 0x55f4bd8690a0 2024-09-21T00:56:46.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.271+0000 7f39562b3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f4bdb9f040 con 0x55f4bd891f60 2024-09-21T00:56:46.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.271+0000 7f39562b3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f4bdba2e50 con 0x55f4bd871280 2024-09-21T00:56:46.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.272+0000 7f394dadb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4bd8690a0 0x55f4bdc38440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:46.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.272+0000 7f394dadb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4bd8690a0 0x55f4bdc38440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34724/0 (socket says 172.21.15.1:34724) 2024-09-21T00:56:46.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.272+0000 7f394dadb640 1 -- 172.21.15.1:0/1555743523 learned_addr learned my addr 172.21.15.1:0/1555743523 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:46.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.272+0000 7f394d2da640 1 --2- 172.21.15.1:0/1555743523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f4bd891f60 0x55f4bdc37f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:46.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.272+0000 7f3946ffd640 1 --2- 172.21.15.1:0/1666050541 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f39300b6510 0x7f39300b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:46.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.272+0000 7f394d2da640 1 --2- 172.21.15.1:0/1555743523 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4bd871280 0x55f4bdc38980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:46.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.272+0000 7f394dadb640 1 -- 172.21.15.1:0/1555743523 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4bd871280 msgr2=0x55f4bdc38980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:46.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.272+0000 7f394dadb640 1 --2- 172.21.15.1:0/1555743523 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4bd871280 0x55f4bdc38980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:46.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.272+0000 7f394dadb640 1 -- 172.21.15.1:0/1555743523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f4bd891f60 msgr2=0x55f4bdc37f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:46.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.272+0000 7f394dadb640 1 --2- 172.21.15.1:0/1555743523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f4bd891f60 0x55f4bdc37f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:46.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.272+0000 7f394dadb640 1 -- 172.21.15.1:0/1555743523 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4bd8fd540 con 0x55f4bd8690a0 2024-09-21T00:56:46.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.272+0000 7f394d2da640 1 --2- 172.21.15.1:0/1555743523 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4bd871280 0x55f4bdc38980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:56:46.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.272+0000 7f394e2dc640 1 --2- 172.21.15.1:0/1666050541 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f39300b6510 0x7f39300b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:46.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.272+0000 7f3946ffd640 1 -- 172.21.15.1:0/1666050541 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f39400e6d60 con 0x7f39481100e0 2024-09-21T00:56:46.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.272+0000 7f394dadb640 1 --2- 172.21.15.1:0/1555743523 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4bd8690a0 0x55f4bdc38440 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3938035000 tx=0x7f393802f4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a5306fd38953170 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:46.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.272+0000 7f392ffff640 1 -- 172.21.15.1:0/1555743523 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3938031cf0 con 0x55f4bd8690a0 2024-09-21T00:56:46.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.273+0000 7f392ffff640 1 -- 172.21.15.1:0/1555743523 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3938036040 con 0x55f4bd8690a0 2024-09-21T00:56:46.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.273+0000 7f392ffff640 1 -- 172.21.15.1:0/1555743523 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3938003e60 con 0x55f4bd8690a0 2024-09-21T00:56:46.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.273+0000 7f39562b3740 1 -- 172.21.15.1:0/1555743523 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4bd8690a0 msgr2=0x55f4bdc38440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:46.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.273+0000 7f394e2dc640 1 --2- 172.21.15.1:0/1666050541 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f39300b6510 0x7f39300b8a20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f394000d720 tx=0x7f39400dd910 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:46.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.273+0000 7f39562b3740 1 --2- 172.21.15.1:0/1555743523 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4bd8690a0 0x55f4bdc38440 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3938035000 tx=0x7f393802f4c0 comp rx=0 tx=0).stop 2024-09-21T00:56:46.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.273+0000 7f39562b3740 1 -- 172.21.15.1:0/1555743523 shutdown_connections 2024-09-21T00:56:46.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.273+0000 7f39562b3740 1 --2- 172.21.15.1:0/1555743523 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4bd871280 0x55f4bdc38980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:46.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.273+0000 7f39562b3740 1 --2- 172.21.15.1:0/1555743523 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4bd8690a0 0x55f4bdc38440 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:46.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.273+0000 7f39562b3740 1 --2- 172.21.15.1:0/1555743523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f4bd891f60 0x55f4bdc37f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:46.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.274+0000 7f39562b3740 1 -- 172.21.15.1:0/1555743523 >> 172.21.15.1:0/1555743523 conn(0x55f4bd886350 msgr2=0x55f4bdc35df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:46.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.274+0000 7f39562b3740 1 -- 172.21.15.1:0/1555743523 shutdown_connections 2024-09-21T00:56:46.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.274+0000 7f39562b3740 1 -- 172.21.15.1:0/1555743523 wait complete. 2024-09-21T00:56:46.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.274+0000 7f39562b3740 1 -- start start 2024-09-21T00:56:46.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.274+0000 7f39562b3740 1 Processor -- start 2024-09-21T00:56:46.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.275+0000 7f39562b3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4bd8690a0 0x55f4bdc437b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:46.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.275+0000 7f39562b3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f4bd871280 0x55f4bdc43d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:46.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.275+0000 7f39562b3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4bd891f60 0x55f4bdc4f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:46.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.275+0000 7f39562b3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f4bda005f0 con 0x55f4bd8690a0 2024-09-21T00:56:46.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.275+0000 7f39562b3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f4bdb3a010 con 0x55f4bd871280 2024-09-21T00:56:46.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.275+0000 7f39562b3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f4bdc46680 con 0x55f4bd891f60 2024-09-21T00:56:46.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.275+0000 7f39562b3740 10 client.0 _ll_register_callbacks cb 0x55f4bdb99340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:56:46.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.275+0000 7f394d2da640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4bd8690a0 0x55f4bdc437b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:46.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.275+0000 7f394d2da640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4bd8690a0 0x55f4bdc437b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34726/0 (socket says 172.21.15.1:34726) 2024-09-21T00:56:46.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.275+0000 7f394d2da640 1 -- 172.21.15.1:0/1165897169 learned_addr learned my addr 172.21.15.1:0/1165897169 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:46.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.275+0000 7f394dadb640 1 --2- 172.21.15.1:0/1165897169 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f4bd871280 0x55f4bdc43d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:46.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.275+0000 7f394d2da640 1 --2- 172.21.15.1:0/1165897169 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4bd891f60 0x55f4bdc4f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:46.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.275+0000 7f394d2da640 1 -- 172.21.15.1:0/1165897169 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4bd891f60 msgr2=0x55f4bdc4f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:46.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.275+0000 7f394d2da640 1 --2- 172.21.15.1:0/1165897169 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4bd891f60 0x55f4bdc4f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:46.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.275+0000 7f394d2da640 1 -- 172.21.15.1:0/1165897169 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f4bd871280 msgr2=0x55f4bdc43d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:46.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.275+0000 7f394d2da640 1 --2- 172.21.15.1:0/1165897169 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f4bd871280 0x55f4bdc43d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:46.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.275+0000 7f394d2da640 1 -- 172.21.15.1:0/1165897169 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4bdb67a00 con 0x55f4bd8690a0 2024-09-21T00:56:46.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.275+0000 7f394d2da640 1 --2- 172.21.15.1:0/1165897169 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4bd8690a0 0x55f4bdc437b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f393c00bfb0 tx=0x7f393c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f1ccf091c4fc51 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:46.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.275+0000 7f392d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:56:46.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.276+0000 7f392d7fa640 1 -- 172.21.15.1:0/1165897169 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393c01b040 con 0x55f4bd8690a0 2024-09-21T00:56:46.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.276+0000 7f392d7fa640 1 -- 172.21.15.1:0/1165897169 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f393c011d70 con 0x55f4bd8690a0 2024-09-21T00:56:46.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.276+0000 7f39562b3740 1 -- 172.21.15.1:0/1165897169 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3938036040 con 0x55f4bd8690a0 2024-09-21T00:56:46.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.276+0000 7f392d7fa640 1 -- 172.21.15.1:0/1165897169 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f393c026070 con 0x55f4bd8690a0 2024-09-21T00:56:46.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.276+0000 7f39562b3740 10 client.15360 fetch_fsmap learned FSMap version 26 2024-09-21T00:56:46.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.276+0000 7f39562b3740 1 -- 172.21.15.1:0/1165897169 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f4bdc52570 con 0x55f4bd8690a0 2024-09-21T00:56:46.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.276+0000 7f392d7fa640 1 -- 172.21.15.1:0/1165897169 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3938036040 con 0x55f4bd8690a0 2024-09-21T00:56:46.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.276+0000 7f392d7fa640 1 -- 172.21.15.1:0/1165897169 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f393c010550 con 0x55f4bd8690a0 2024-09-21T00:56:46.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.276+0000 7f39562b3740 10 client.15360 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T00:56:46.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.276+0000 7f39562b3740 10 client.15360 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T00:56:46.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.276+0000 7f39562b3740 20 client.15360 populate_metadata read hostname 'smithi001' 2024-09-21T00:56:46.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.276+0000 7f39562b3740 1 --2- 172.21.15.1:0/1165897169 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x55f4bd8508e0 0x55f4bdc55fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:46.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.276+0000 7f39562b3740 4 client.15360 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:56:46.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.276+0000 7f39562b3740 1 -- 172.21.15.1:0/1165897169 --> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f4bdbb1b60 con 0x55f4bd8508e0 2024-09-21T00:56:46.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.277+0000 7f394dadb640 1 --2- 172.21.15.1:0/1165897169 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x55f4bd8508e0 0x55f4bdc55fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:46.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.277+0000 7f394dadb640 1 --2- 172.21.15.1:0/1165897169 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x55f4bd8508e0 0x55f4bdc55fe0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a0ff01b107984c7 server_cookie=2b4c37908477b0fb in_seq=0 out_seq=0 2024-09-21T00:56:46.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.277+0000 7f392d7fa640 10 client.15360 ms_handle_connect on v2:172.21.15.193:6838/1365361177 2024-09-21T00:56:46.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.278+0000 7f392d7fa640 1 -- 172.21.15.1:0/1165897169 <== mds.1 v2:172.21.15.193:6838/1365361177 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f4bdbb1b60 con 0x55f4bd8508e0 2024-09-21T00:56:46.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.278+0000 7f392d7fa640 10 client.15360 handle_command_reply: tid=0 2024-09-21T00:56:46.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.278+0000 7f39562b3740 1 client.15360 shutdown 2024-09-21T00:56:46.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.278+0000 7f39562b3740 1 -- 172.21.15.1:0/1165897169 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4bd8690a0 msgr2=0x55f4bdc437b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:46.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.278+0000 7f39562b3740 1 --2- 172.21.15.1:0/1165897169 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4bd8690a0 0x55f4bdc437b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f393c00bfb0 tx=0x7f393c004730 comp rx=0 tx=0).stop 2024-09-21T00:56:46.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.278+0000 7f39562b3740 1 -- 172.21.15.1:0/1165897169 shutdown_connections 2024-09-21T00:56:46.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.278+0000 7f39562b3740 1 --2- 172.21.15.1:0/1165897169 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x55f4bd8508e0 0x55f4bdc55fe0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:46.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.278+0000 7f39562b3740 1 --2- 172.21.15.1:0/1165897169 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4bd891f60 0x55f4bdc4f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:46.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.278+0000 7f39562b3740 1 --2- 172.21.15.1:0/1165897169 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f4bd871280 0x55f4bdc43d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:46.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.278+0000 7f39562b3740 1 --2- 172.21.15.1:0/1165897169 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4bd8690a0 0x55f4bdc437b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:46.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.278+0000 7f392d7fa640 0 client.15360 ms_handle_reset on v2:172.21.15.193:6838/1365361177 2024-09-21T00:56:46.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.278+0000 7f39562b3740 1 -- 172.21.15.1:0/1165897169 >> 172.21.15.1:0/1165897169 conn(0x55f4bd886350 msgr2=0x55f4bdc3b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:46.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.278+0000 7f39562b3740 1 -- 172.21.15.1:0/1165897169 shutdown_connections 2024-09-21T00:56:46.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.278+0000 7f39562b3740 1 -- 172.21.15.1:0/1165897169 wait complete. 2024-09-21T00:56:46.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.279+0000 7f39562b3740 20 client.15360 trim_cache size 0 max 16384 2024-09-21T00:56:46.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.297+0000 7f39562b3740 1 Processor -- start 2024-09-21T00:56:46.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.297+0000 7f39562b3740 1 -- start start 2024-09-21T00:56:46.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.297+0000 7f39562b3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4bd8690a0 0x55f4bdc43e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:46.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.297+0000 7f39562b3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4bd871280 0x55f4bdc3e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:46.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.297+0000 7f39562b3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f4bd891f60 0x55f4bdc4f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:46.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.297+0000 7f39562b3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f4bdc54320 con 0x55f4bd8690a0 2024-09-21T00:56:46.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.297+0000 7f39562b3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f4bdc549f0 con 0x55f4bd891f60 2024-09-21T00:56:46.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.297+0000 7f39562b3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f4bdc550c0 con 0x55f4bd871280 2024-09-21T00:56:46.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.297+0000 7f394d2da640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4bd8690a0 0x55f4bdc43e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:46.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.297+0000 7f394d2da640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4bd8690a0 0x55f4bdc43e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34734/0 (socket says 172.21.15.1:34734) 2024-09-21T00:56:46.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.297+0000 7f394d2da640 1 -- 172.21.15.1:0/2986537098 learned_addr learned my addr 172.21.15.1:0/2986537098 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:46.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.297+0000 7f394d2da640 1 -- 172.21.15.1:0/2986537098 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4bd871280 msgr2=0x55f4bdc3e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:46.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.297+0000 7f394dadb640 1 --2- 172.21.15.1:0/2986537098 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4bd871280 0x55f4bdc3e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:46.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.297+0000 7f394d2da640 1 --2- 172.21.15.1:0/2986537098 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4bd871280 0x55f4bdc3e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:46.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.297+0000 7f394d2da640 1 -- 172.21.15.1:0/2986537098 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f4bd891f60 msgr2=0x55f4bdc4f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:46.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.297+0000 7f394d2da640 1 --2- 172.21.15.1:0/2986537098 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f4bd891f60 0x55f4bdc4f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:46.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.297+0000 7f394d2da640 1 -- 172.21.15.1:0/2986537098 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4bdc3ad60 con 0x55f4bd8690a0 2024-09-21T00:56:46.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.298+0000 7f394d2da640 1 --2- 172.21.15.1:0/2986537098 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4bd8690a0 0x55f4bdc43e30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f393c00b970 tx=0x7f393c012500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a60dd9cd167793c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:46.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.298+0000 7f392f7fe640 1 -- 172.21.15.1:0/2986537098 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393c010630 con 0x55f4bd8690a0 2024-09-21T00:56:46.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.298+0000 7f392f7fe640 1 -- 172.21.15.1:0/2986537098 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f393c010b90 con 0x55f4bd8690a0 2024-09-21T00:56:46.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.298+0000 7f392f7fe640 1 -- 172.21.15.1:0/2986537098 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393c02b6c0 con 0x55f4bd8690a0 2024-09-21T00:56:46.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.298+0000 7f39562b3740 1 -- 172.21.15.1:0/2986537098 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4bd8690a0 msgr2=0x55f4bdc43e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:46.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.298+0000 7f39562b3740 1 --2- 172.21.15.1:0/2986537098 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4bd8690a0 0x55f4bdc43e30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f393c00b970 tx=0x7f393c012500 comp rx=0 tx=0).stop 2024-09-21T00:56:46.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.298+0000 7f39562b3740 1 -- 172.21.15.1:0/2986537098 shutdown_connections 2024-09-21T00:56:46.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.298+0000 7f39562b3740 1 --2- 172.21.15.1:0/2986537098 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f4bd891f60 0x55f4bdc4f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:46.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.298+0000 7f39562b3740 1 --2- 172.21.15.1:0/2986537098 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4bd871280 0x55f4bdc3e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:46.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.298+0000 7f39562b3740 1 --2- 172.21.15.1:0/2986537098 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4bd8690a0 0x55f4bdc43e30 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:46.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.299+0000 7f39562b3740 1 -- 172.21.15.1:0/2986537098 >> 172.21.15.1:0/2986537098 conn(0x55f4bd886350 msgr2=0x55f4bdc43720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:46.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.299+0000 7f39562b3740 1 -- 172.21.15.1:0/2986537098 shutdown_connections 2024-09-21T00:56:46.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.299+0000 7f39562b3740 1 -- 172.21.15.1:0/2986537098 wait complete. 2024-09-21T00:56:46.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.299+0000 7f39562b3740 1 -- start start 2024-09-21T00:56:46.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.299+0000 7f39562b3740 1 Processor -- start 2024-09-21T00:56:46.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.300+0000 7f39562b3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f4bd8690a0 0x55f4bdc583b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:46.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.300+0000 7f39562b3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4bd871280 0x55f4bdc588f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:46.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.300+0000 7f39562b3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4bd891f60 0x55f4bdc58e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:46.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.300+0000 7f39562b3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f4bdc55e60 con 0x55f4bd891f60 2024-09-21T00:56:46.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.300+0000 7f39562b3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f4bdc55790 con 0x55f4bd8690a0 2024-09-21T00:56:46.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.300+0000 7f39562b3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f4bdc56530 con 0x55f4bd871280 2024-09-21T00:56:46.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.300+0000 7f39562b3740 10 client.0 _ll_register_callbacks cb 0x7f393c00b7c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:56:46.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.300+0000 7f394d2da640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4bd891f60 0x55f4bdc58e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:46.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.300+0000 7f394d2da640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4bd891f60 0x55f4bdc58e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34746/0 (socket says 172.21.15.1:34746) 2024-09-21T00:56:46.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.300+0000 7f394d2da640 1 -- 172.21.15.1:0/4112202605 learned_addr learned my addr 172.21.15.1:0/4112202605 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:46.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.300+0000 7f394dadb640 1 --2- 172.21.15.1:0/4112202605 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4bd871280 0x55f4bdc588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:46.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.300+0000 7f394d2da640 1 --2- 172.21.15.1:0/4112202605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f4bd8690a0 0x55f4bdc583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:46.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.300+0000 7f394d2da640 1 -- 172.21.15.1:0/4112202605 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4bd871280 msgr2=0x55f4bdc588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:46.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.300+0000 7f394d2da640 1 --2- 172.21.15.1:0/4112202605 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4bd871280 0x55f4bdc588f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:46.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.300+0000 7f394d2da640 1 -- 172.21.15.1:0/4112202605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f4bd8690a0 msgr2=0x55f4bdc583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:46.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.300+0000 7f394d2da640 1 --2- 172.21.15.1:0/4112202605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f4bd8690a0 0x55f4bdc583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:46.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.300+0000 7f394d2da640 1 -- 172.21.15.1:0/4112202605 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4bdc5dca0 con 0x55f4bd891f60 2024-09-21T00:56:46.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.300+0000 7f394d2da640 1 --2- 172.21.15.1:0/4112202605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4bd891f60 0x55f4bdc58e30 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f393c00be30 tx=0x7f393c00b450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdcd06c847bf5f56 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:46.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.300+0000 7f392d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:56:46.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.300+0000 7f392d7fa640 1 -- 172.21.15.1:0/4112202605 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393c011b70 con 0x55f4bd891f60 2024-09-21T00:56:46.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.301+0000 7f392d7fa640 1 -- 172.21.15.1:0/4112202605 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f393c011d10 con 0x55f4bd891f60 2024-09-21T00:56:46.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.301+0000 7f39562b3740 1 -- 172.21.15.1:0/4112202605 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f393c010b90 con 0x55f4bd891f60 2024-09-21T00:56:46.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.301+0000 7f392d7fa640 1 -- 172.21.15.1:0/4112202605 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f393c010d40 con 0x55f4bd891f60 2024-09-21T00:56:46.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.301+0000 7f39562b3740 10 client.15366 fetch_fsmap learned FSMap version 26 2024-09-21T00:56:46.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.301+0000 7f39562b3740 1 -- 172.21.15.1:0/4112202605 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f4bdcc1880 con 0x55f4bd891f60 2024-09-21T00:56:46.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.301+0000 7f392d7fa640 1 -- 172.21.15.1:0/4112202605 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f393c010b90 con 0x55f4bd891f60 2024-09-21T00:56:46.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.301+0000 7f392d7fa640 1 -- 172.21.15.1:0/4112202605 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f393c02b830 con 0x55f4bd891f60 2024-09-21T00:56:46.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.301+0000 7f39562b3740 10 client.15366 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T00:56:46.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.301+0000 7f39562b3740 10 client.15366 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T00:56:46.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.301+0000 7f39562b3740 20 client.15366 populate_metadata read hostname 'smithi001' 2024-09-21T00:56:46.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.301+0000 7f39562b3740 1 --2- 172.21.15.1:0/4112202605 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x55f4bd825c90 0x55f4bdcc4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:46.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.301+0000 7f39562b3740 4 client.15366 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T00:56:46.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.301+0000 7f39562b3740 1 -- 172.21.15.1:0/4112202605 --> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] -- command(tid 0: {"prefix": "status"}) -- 0x55f4bdbad610 con 0x55f4bd825c90 2024-09-21T00:56:46.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.302+0000 7f394dadb640 1 --2- 172.21.15.1:0/4112202605 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x55f4bd825c90 0x55f4bdcc4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:46.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.302+0000 7f394dadb640 1 --2- 172.21.15.1:0/4112202605 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x55f4bd825c90 0x55f4bdcc4e80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=13c406f38638f2d0 server_cookie=52aaa76f3903d020 in_seq=0 out_seq=0 2024-09-21T00:56:46.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.302+0000 7f392d7fa640 10 client.15366 ms_handle_connect on v2:172.21.15.193:6838/1365361177 2024-09-21T00:56:46.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.302+0000 7f392d7fa640 1 -- 172.21.15.1:0/4112202605 <== mds.1 v2:172.21.15.193:6838/1365361177 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55f4bdbad610 con 0x55f4bd825c90 2024-09-21T00:56:46.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.302+0000 7f392d7fa640 10 client.15366 handle_command_reply: tid=0 2024-09-21T00:56:46.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.302+0000 7f39562b3740 1 client.15366 shutdown 2024-09-21T00:56:46.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.302+0000 7f39562b3740 1 -- 172.21.15.1:0/4112202605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4bd891f60 msgr2=0x55f4bdc58e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:46.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.302+0000 7f39562b3740 1 --2- 172.21.15.1:0/4112202605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4bd891f60 0x55f4bdc58e30 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f393c00be30 tx=0x7f393c00b450 comp rx=0 tx=0).stop 2024-09-21T00:56:46.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.303+0000 7f39562b3740 1 -- 172.21.15.1:0/4112202605 shutdown_connections 2024-09-21T00:56:46.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.303+0000 7f39562b3740 1 --2- 172.21.15.1:0/4112202605 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x55f4bd825c90 0x55f4bdcc4e80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:46.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.303+0000 7f39562b3740 1 --2- 172.21.15.1:0/4112202605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4bd891f60 0x55f4bdc58e30 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:46.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.303+0000 7f392d7fa640 0 client.15366 ms_handle_reset on v2:172.21.15.193:6838/1365361177 2024-09-21T00:56:46.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.303+0000 7f39562b3740 1 --2- 172.21.15.1:0/4112202605 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4bd871280 0x55f4bdc588f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:46.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.303+0000 7f39562b3740 1 --2- 172.21.15.1:0/4112202605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f4bd8690a0 0x55f4bdc583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:46.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.303+0000 7f39562b3740 1 -- 172.21.15.1:0/4112202605 >> 172.21.15.1:0/4112202605 conn(0x55f4bd886350 msgr2=0x55f4bdc35600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:46.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.303+0000 7f39562b3740 1 -- 172.21.15.1:0/4112202605 shutdown_connections 2024-09-21T00:56:46.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.303+0000 7f39562b3740 1 -- 172.21.15.1:0/4112202605 wait complete. 2024-09-21T00:56:46.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.303+0000 7f39562b3740 20 client.15366 trim_cache size 0 max 16384 2024-09-21T00:56:46.309 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T00:56:46.309 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "d3972c20-77b2-11ef-baf5-efdc52797490", 2024-09-21T00:56:46.309 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 1, 2024-09-21T00:56:46.309 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24637, 2024-09-21T00:56:46.309 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-21T00:56:46.310 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-21T00:56:46.310 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-21T00:56:46.310 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 100.140886811, 2024-09-21T00:56:46.310 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 26, 2024-09-21T00:56:46.310 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 75, 2024-09-21T00:56:46.310 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 73, 2024-09-21T00:56:46.310 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 126.919307807 2024-09-21T00:56:46.310 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T00:56:46.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.303+0000 7f394fd3f640 1 -- 172.21.15.1:0/1666050541 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f39300b6510 msgr2=0x7f39300b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:46.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.303+0000 7f394fd3f640 1 --2- 172.21.15.1:0/1666050541 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f39300b6510 0x7f39300b8a20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f394000d720 tx=0x7f39400dd910 comp rx=0 tx=0).stop 2024-09-21T00:56:46.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.303+0000 7f394fd3f640 1 -- 172.21.15.1:0/1666050541 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39481100e0 msgr2=0x7f39481a1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:46.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.303+0000 7f394fd3f640 1 --2- 172.21.15.1:0/1666050541 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39481100e0 0x7f39481a1e60 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f394000d750 tx=0x7f394000dc10 comp rx=0 tx=0).stop 2024-09-21T00:56:46.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.303+0000 7f394fd3f640 1 -- 172.21.15.1:0/1666050541 shutdown_connections 2024-09-21T00:56:46.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.303+0000 7f394fd3f640 1 --2- 172.21.15.1:0/1666050541 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f39300b6510 0x7f39300b8a20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:46.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.303+0000 7f394fd3f640 1 --2- 172.21.15.1:0/1666050541 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39481100e0 0x7f39481a1e60 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:46.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.303+0000 7f394fd3f640 1 --2- 172.21.15.1:0/1666050541 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3948076100 0x7f394819cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:46.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.303+0000 7f394fd3f640 1 --2- 172.21.15.1:0/1666050541 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f39480757b0 0x7f394819c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:46.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.303+0000 7f394fd3f640 1 -- 172.21.15.1:0/1666050541 >> 172.21.15.1:0/1666050541 conn(0x7f39480ff5b0 msgr2=0x7f3948109bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:46.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.304+0000 7f394fd3f640 1 -- 172.21.15.1:0/1666050541 shutdown_connections 2024-09-21T00:56:46.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:46.304+0000 7f394fd3f640 1 -- 172.21.15.1:0/1666050541 wait complete. 2024-09-21T00:56:47.110 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T00:56:47.369 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:47.902 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:47 smithi001 ceph-mon[31211]: pgmap v345: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:56:47.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.865+0000 7faad0756640 1 -- 172.21.15.1:0/452966273 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faac8102a80 msgr2=0x7faac8102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:47.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.865+0000 7faad0756640 1 --2- 172.21.15.1:0/452966273 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faac8102a80 0x7faac8102e90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7faac4009900 tx=0x7faac402a410 comp rx=0 tx=0).stop 2024-09-21T00:56:47.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.865+0000 7faad0756640 1 -- 172.21.15.1:0/452966273 shutdown_connections 2024-09-21T00:56:47.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.865+0000 7faad0756640 1 --2- 172.21.15.1:0/452966273 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faac8108d10 0x7faac810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.865+0000 7faad0756640 1 --2- 172.21.15.1:0/452966273 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faac81083c0 0x7faac81087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.865+0000 7faad0756640 1 --2- 172.21.15.1:0/452966273 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faac8102a80 0x7faac8102e90 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.865+0000 7faad0756640 1 -- 172.21.15.1:0/452966273 >> 172.21.15.1:0/452966273 conn(0x7faac8079740 msgr2=0x7faac8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:47.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.865+0000 7faad0756640 1 -- 172.21.15.1:0/452966273 shutdown_connections 2024-09-21T00:56:47.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.866+0000 7faad0756640 1 -- 172.21.15.1:0/452966273 wait complete. 2024-09-21T00:56:47.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.866+0000 7faad0756640 1 Processor -- start 2024-09-21T00:56:47.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.866+0000 7faad0756640 1 -- start start 2024-09-21T00:56:47.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.867+0000 7faad0756640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faac8102a80 0x7faac8104270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:47.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.867+0000 7faad0756640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faac81083c0 0x7faac81047b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:47.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.867+0000 7faad0756640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faac8108d10 0x7faac8104cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:47.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.867+0000 7faad0756640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faac8112980 con 0x7faac8108d10 2024-09-21T00:56:47.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.867+0000 7faad0756640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7faac8112800 con 0x7faac8102a80 2024-09-21T00:56:47.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.867+0000 7faad0756640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faac8112b00 con 0x7faac81083c0 2024-09-21T00:56:47.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.867+0000 7faacecf3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faac8108d10 0x7faac8104cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:47.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.867+0000 7faacecf3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faac8108d10 0x7faac8104cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34760/0 (socket says 172.21.15.1:34760) 2024-09-21T00:56:47.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.867+0000 7faacecf3640 1 -- 172.21.15.1:0/1880383440 learned_addr learned my addr 172.21.15.1:0/1880383440 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:47.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.867+0000 7faacdcf1640 1 --2- 172.21.15.1:0/1880383440 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faac81083c0 0x7faac81047b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:47.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.867+0000 7faace4f2640 1 --2- 172.21.15.1:0/1880383440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faac8102a80 0x7faac8104270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:47.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.867+0000 7faacecf3640 1 -- 172.21.15.1:0/1880383440 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faac81083c0 msgr2=0x7faac81047b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:47.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.867+0000 7faacecf3640 1 --2- 172.21.15.1:0/1880383440 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faac81083c0 0x7faac81047b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.867+0000 7faacecf3640 1 -- 172.21.15.1:0/1880383440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faac8102a80 msgr2=0x7faac8104270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:47.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.867+0000 7faacecf3640 1 --2- 172.21.15.1:0/1880383440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faac8102a80 0x7faac8104270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.867+0000 7faacecf3640 1 -- 172.21.15.1:0/1880383440 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac81a8690 con 0x7faac8108d10 2024-09-21T00:56:47.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.867+0000 7faace4f2640 1 --2- 172.21.15.1:0/1880383440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faac8102a80 0x7faac8104270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:56:47.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.867+0000 7faacecf3640 1 --2- 172.21.15.1:0/1880383440 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faac8108d10 0x7faac8104cf0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7faac000eb10 tx=0x7faac000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:47.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.868+0000 7faabf7fe640 1 -- 172.21.15.1:0/1880383440 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac000ce20 con 0x7faac8108d10 2024-09-21T00:56:47.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.868+0000 7faabf7fe640 1 -- 172.21.15.1:0/1880383440 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faac0005020 con 0x7faac8108d10 2024-09-21T00:56:47.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.868+0000 7faabf7fe640 1 -- 172.21.15.1:0/1880383440 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac0010690 con 0x7faac8108d10 2024-09-21T00:56:47.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.868+0000 7faad0756640 1 -- 172.21.15.1:0/1880383440 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faac81a8980 con 0x7faac8108d10 2024-09-21T00:56:47.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.868+0000 7faad0756640 1 -- 172.21.15.1:0/1880383440 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faac81a8e70 con 0x7faac8108d10 2024-09-21T00:56:47.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.870+0000 7faad6cca740 1 Processor -- start 2024-09-21T00:56:47.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.870+0000 7faabf7fe640 1 -- 172.21.15.1:0/1880383440 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 154511+0+0 (secure 0 0 0) 0x7faac0005510 con 0x7faac8108d10 2024-09-21T00:56:47.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.871+0000 7faad6cca740 1 -- start start 2024-09-21T00:56:47.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.871+0000 7faad6cca740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564243b32f60 0x564243ed8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:47.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.871+0000 7faad6cca740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564243b0a0a0 0x564243ed9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:47.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.871+0000 7faad6cca740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564243b12280 0x564243ed9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:47.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.871+0000 7faad6cca740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564243e50c10 con 0x564243b12280 2024-09-21T00:56:47.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.871+0000 7faad6cca740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564243e40040 con 0x564243b32f60 2024-09-21T00:56:47.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.871+0000 7faad6cca740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564243e43e50 con 0x564243b0a0a0 2024-09-21T00:56:47.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.871+0000 7faacdcf1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564243b12280 0x564243ed9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:47.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.871+0000 7faacdcf1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564243b12280 0x564243ed9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34774/0 (socket says 172.21.15.1:34774) 2024-09-21T00:56:47.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.871+0000 7faace4f2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564243b0a0a0 0x564243ed9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:47.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.871+0000 7faacdcf1640 1 -- 172.21.15.1:0/2069573427 learned_addr learned my addr 172.21.15.1:0/2069573427 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:47.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.871+0000 7faacdcf1640 1 --2- 172.21.15.1:0/2069573427 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564243b32f60 0x564243ed8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:47.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.871+0000 7faabf7fe640 1 --2- 172.21.15.1:0/1880383440 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7faab40b6510 0x7faab40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:47.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.871+0000 7faacdcf1640 1 -- 172.21.15.1:0/2069573427 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564243b0a0a0 msgr2=0x564243ed9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:47.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.872+0000 7faacdcf1640 1 --2- 172.21.15.1:0/2069573427 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564243b0a0a0 0x564243ed9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.872+0000 7faacdcf1640 1 -- 172.21.15.1:0/2069573427 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564243b32f60 msgr2=0x564243ed8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:47.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.872+0000 7faacdcf1640 1 --2- 172.21.15.1:0/2069573427 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564243b32f60 0x564243ed8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.872+0000 7faacdcf1640 1 -- 172.21.15.1:0/2069573427 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564243b9e540 con 0x564243b12280 2024-09-21T00:56:47.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.872+0000 7faace4f2640 1 --2- 172.21.15.1:0/2069573427 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564243b0a0a0 0x564243ed9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:56:47.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.872+0000 7faacecf3640 1 --2- 172.21.15.1:0/1880383440 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7faab40b6510 0x7faab40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:47.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.872+0000 7faacdcf1640 1 --2- 172.21.15.1:0/2069573427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564243b12280 0x564243ed9980 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7faab80117b0 tx=0x7faab800a720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc79228c17b502b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:47.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.872+0000 7faabf7fe640 1 -- 172.21.15.1:0/1880383440 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7faac00e7af0 con 0x7faac8108d10 2024-09-21T00:56:47.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.872+0000 7faabcff9640 1 -- 172.21.15.1:0/2069573427 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab8005020 con 0x564243b12280 2024-09-21T00:56:47.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.872+0000 7faabcff9640 1 -- 172.21.15.1:0/2069573427 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faab80047a0 con 0x564243b12280 2024-09-21T00:56:47.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.872+0000 7faabcff9640 1 -- 172.21.15.1:0/2069573427 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab800fa20 con 0x564243b12280 2024-09-21T00:56:47.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.873+0000 7faad6cca740 1 -- 172.21.15.1:0/2069573427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564243b12280 msgr2=0x564243ed9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:47.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.873+0000 7faad6cca740 1 --2- 172.21.15.1:0/2069573427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564243b12280 0x564243ed9980 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7faab80117b0 tx=0x7faab800a720 comp rx=0 tx=0).stop 2024-09-21T00:56:47.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.873+0000 7faacecf3640 1 --2- 172.21.15.1:0/1880383440 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7faab40b6510 0x7faab40b8a20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7faac00aa230 tx=0x7faac00d1040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:47.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.873+0000 7faad6cca740 1 -- 172.21.15.1:0/2069573427 shutdown_connections 2024-09-21T00:56:47.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.873+0000 7faad6cca740 1 --2- 172.21.15.1:0/2069573427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564243b12280 0x564243ed9980 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.873+0000 7faad6cca740 1 --2- 172.21.15.1:0/2069573427 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564243b0a0a0 0x564243ed9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.873+0000 7faad6cca740 1 --2- 172.21.15.1:0/2069573427 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564243b32f60 0x564243ed8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.873+0000 7faad6cca740 1 -- 172.21.15.1:0/2069573427 >> 172.21.15.1:0/2069573427 conn(0x564243b27350 msgr2=0x564243ed6df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:47.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.873+0000 7faad6cca740 1 -- 172.21.15.1:0/2069573427 shutdown_connections 2024-09-21T00:56:47.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.873+0000 7faad6cca740 1 -- 172.21.15.1:0/2069573427 wait complete. 2024-09-21T00:56:47.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.873+0000 7faad6cca740 1 -- start start 2024-09-21T00:56:47.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.874+0000 7faad6cca740 1 Processor -- start 2024-09-21T00:56:47.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.874+0000 7faad6cca740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564243b0a0a0 0x564243ee4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:47.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.874+0000 7faad6cca740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564243b12280 0x564243ee4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:47.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.874+0000 7faad6cca740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564243b32f60 0x564243ef09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:47.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.874+0000 7faad6cca740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564243ca15f0 con 0x564243b32f60 2024-09-21T00:56:47.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.874+0000 7faad6cca740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564243ddb010 con 0x564243b0a0a0 2024-09-21T00:56:47.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.874+0000 7faad6cca740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564243ee76e0 con 0x564243b12280 2024-09-21T00:56:47.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.874+0000 7faad6cca740 10 client.0 _ll_register_callbacks cb 0x564243e3a340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:56:47.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.874+0000 7faacdcf1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564243b32f60 0x564243ef09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:47.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.874+0000 7faacdcf1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564243b32f60 0x564243ef09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34784/0 (socket says 172.21.15.1:34784) 2024-09-21T00:56:47.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.874+0000 7faacdcf1640 1 -- 172.21.15.1:0/1295799017 learned_addr learned my addr 172.21.15.1:0/1295799017 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:47.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.874+0000 7faacdcf1640 1 --2- 172.21.15.1:0/1295799017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564243b0a0a0 0x564243ee4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:47.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.874+0000 7faace4f2640 1 --2- 172.21.15.1:0/1295799017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564243b12280 0x564243ee4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:47.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.875+0000 7faacdcf1640 1 -- 172.21.15.1:0/1295799017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564243b12280 msgr2=0x564243ee4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:47.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.875+0000 7faacdcf1640 1 --2- 172.21.15.1:0/1295799017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564243b12280 0x564243ee4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.875+0000 7faacdcf1640 1 -- 172.21.15.1:0/1295799017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564243b0a0a0 msgr2=0x564243ee4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:47.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.875+0000 7faacdcf1640 1 --2- 172.21.15.1:0/1295799017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564243b0a0a0 0x564243ee4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.875+0000 7faacdcf1640 1 -- 172.21.15.1:0/1295799017 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564243e08a00 con 0x564243b32f60 2024-09-21T00:56:47.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.875+0000 7faacdcf1640 1 --2- 172.21.15.1:0/1295799017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564243b32f60 0x564243ef09d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7faab8004e50 tx=0x7faab801a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc5315e1b43a6bd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:47.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.875+0000 7faab1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:56:47.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.875+0000 7faab1ffb640 1 -- 172.21.15.1:0/1295799017 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab8011260 con 0x564243b32f60 2024-09-21T00:56:47.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.875+0000 7faab1ffb640 1 -- 172.21.15.1:0/1295799017 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7faab8004f20 con 0x564243b32f60 2024-09-21T00:56:47.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.875+0000 7faad6cca740 1 -- 172.21.15.1:0/1295799017 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faab80047a0 con 0x564243b32f60 2024-09-21T00:56:47.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.875+0000 7faab1ffb640 1 -- 172.21.15.1:0/1295799017 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7faab8005120 con 0x564243b32f60 2024-09-21T00:56:47.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.875+0000 7faad6cca740 10 client.15378 fetch_fsmap learned FSMap version 26 2024-09-21T00:56:47.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.875+0000 7faad6cca740 1 -- 172.21.15.1:0/1295799017 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564243ef36e0 con 0x564243b32f60 2024-09-21T00:56:47.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.875+0000 7faab1ffb640 1 -- 172.21.15.1:0/1295799017 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faab80047a0 con 0x564243b32f60 2024-09-21T00:56:47.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.876+0000 7faab1ffb640 1 -- 172.21.15.1:0/1295799017 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7faab801e470 con 0x564243b32f60 2024-09-21T00:56:47.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.876+0000 7faad6cca740 10 client.15378 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T00:56:47.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.876+0000 7faad6cca740 10 client.15378 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T00:56:47.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.876+0000 7faad6cca740 20 client.15378 populate_metadata read hostname 'smithi001' 2024-09-21T00:56:47.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.876+0000 7faad6cca740 1 --2- 172.21.15.1:0/1295799017 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x564243af18e0 0x564243ef6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:47.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.876+0000 7faad6cca740 4 client.15378 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:56:47.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.876+0000 7faad6cca740 1 -- 172.21.15.1:0/1295799017 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564243e52b60 con 0x564243af18e0 2024-09-21T00:56:47.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.876+0000 7faace4f2640 1 --2- 172.21.15.1:0/1295799017 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x564243af18e0 0x564243ef6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:47.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.876+0000 7faab1ffb640 10 client.15378 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:56:47.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.876+0000 7faace4f2640 1 --2- 172.21.15.1:0/1295799017 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x564243af18e0 0x564243ef6ed0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8545c19b387df4 server_cookie=ffb714d99a9b6d74 in_seq=0 out_seq=0 2024-09-21T00:56:47.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.877+0000 7faab1ffb640 1 -- 172.21.15.1:0/1295799017 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564243e52b60 con 0x564243af18e0 2024-09-21T00:56:47.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.877+0000 7faab1ffb640 10 client.15378 handle_command_reply: tid=0 2024-09-21T00:56:47.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.877+0000 7faad6cca740 1 client.15378 shutdown 2024-09-21T00:56:47.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.877+0000 7faad6cca740 1 -- 172.21.15.1:0/1295799017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564243b32f60 msgr2=0x564243ef09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:47.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.877+0000 7faad6cca740 1 --2- 172.21.15.1:0/1295799017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564243b32f60 0x564243ef09d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7faab8004e50 tx=0x7faab801a040 comp rx=0 tx=0).stop 2024-09-21T00:56:47.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.877+0000 7faad6cca740 1 -- 172.21.15.1:0/1295799017 shutdown_connections 2024-09-21T00:56:47.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.877+0000 7faad6cca740 1 --2- 172.21.15.1:0/1295799017 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x564243af18e0 0x564243ef6ed0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.877+0000 7faad6cca740 1 --2- 172.21.15.1:0/1295799017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564243b32f60 0x564243ef09d0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.877+0000 7faad6cca740 1 --2- 172.21.15.1:0/1295799017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564243b12280 0x564243ee4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.877+0000 7faad6cca740 1 --2- 172.21.15.1:0/1295799017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564243b0a0a0 0x564243ee4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.877+0000 7faad6cca740 1 -- 172.21.15.1:0/1295799017 >> 172.21.15.1:0/1295799017 conn(0x564243b27350 msgr2=0x564243edc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:47.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.877+0000 7faab1ffb640 0 client.15378 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:56:47.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.877+0000 7faad6cca740 1 -- 172.21.15.1:0/1295799017 shutdown_connections 2024-09-21T00:56:47.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.877+0000 7faad6cca740 1 -- 172.21.15.1:0/1295799017 wait complete. 2024-09-21T00:56:47.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.878+0000 7faad6cca740 20 client.15378 trim_cache size 0 max 16384 2024-09-21T00:56:47.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.896+0000 7faad6cca740 1 Processor -- start 2024-09-21T00:56:47.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.896+0000 7faad6cca740 1 -- start start 2024-09-21T00:56:47.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.896+0000 7faad6cca740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564243b0a0a0 0x564243ef5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:47.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.896+0000 7faad6cca740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564243b12280 0x564243ef0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:47.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.896+0000 7faad6cca740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564243b32f60 0x564243ee4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:47.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.896+0000 7faad6cca740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564243ef5210 con 0x564243b32f60 2024-09-21T00:56:47.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.896+0000 7faad6cca740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564243ef58e0 con 0x564243b12280 2024-09-21T00:56:47.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.896+0000 7faad6cca740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564243ef5fb0 con 0x564243b0a0a0 2024-09-21T00:56:47.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.896+0000 7faacdcf1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564243b32f60 0x564243ee4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:47.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.896+0000 7faacdcf1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564243b32f60 0x564243ee4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34786/0 (socket says 172.21.15.1:34786) 2024-09-21T00:56:47.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.896+0000 7faacdcf1640 1 -- 172.21.15.1:0/395650491 learned_addr learned my addr 172.21.15.1:0/395650491 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:47.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.896+0000 7faacdcf1640 1 --2- 172.21.15.1:0/395650491 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564243b0a0a0 0x564243ef5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:47.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.896+0000 7faace4f2640 1 --2- 172.21.15.1:0/395650491 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564243b12280 0x564243ef0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:47.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.896+0000 7faacdcf1640 1 -- 172.21.15.1:0/395650491 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564243b0a0a0 msgr2=0x564243ef5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:47.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.896+0000 7faacdcf1640 1 --2- 172.21.15.1:0/395650491 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564243b0a0a0 0x564243ef5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.896+0000 7faacdcf1640 1 -- 172.21.15.1:0/395650491 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564243b12280 msgr2=0x564243ef0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:47.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.896+0000 7faacdcf1640 1 --2- 172.21.15.1:0/395650491 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564243b12280 0x564243ef0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.896+0000 7faacdcf1640 1 -- 172.21.15.1:0/395650491 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564243edb1f0 con 0x564243b32f60 2024-09-21T00:56:47.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.897+0000 7faace4f2640 1 --2- 172.21.15.1:0/395650491 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564243b12280 0x564243ef0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:56:47.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.897+0000 7faacdcf1640 1 --2- 172.21.15.1:0/395650491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564243b32f60 0x564243ee4a80 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7faab8011760 tx=0x7faab8013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64b38e3f7db34c65 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:47.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.897+0000 7faab3fff640 1 -- 172.21.15.1:0/395650491 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab803e070 con 0x564243b32f60 2024-09-21T00:56:47.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.897+0000 7faab3fff640 1 -- 172.21.15.1:0/395650491 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faab8004ef0 con 0x564243b32f60 2024-09-21T00:56:47.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.897+0000 7faab3fff640 1 -- 172.21.15.1:0/395650491 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab801e470 con 0x564243b32f60 2024-09-21T00:56:47.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.898+0000 7faad6cca740 1 -- 172.21.15.1:0/395650491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564243b32f60 msgr2=0x564243ee4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:47.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.898+0000 7faad6cca740 1 --2- 172.21.15.1:0/395650491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564243b32f60 0x564243ee4a80 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7faab8011760 tx=0x7faab8013040 comp rx=0 tx=0).stop 2024-09-21T00:56:47.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.898+0000 7faad6cca740 1 -- 172.21.15.1:0/395650491 shutdown_connections 2024-09-21T00:56:47.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.898+0000 7faad6cca740 1 --2- 172.21.15.1:0/395650491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564243b32f60 0x564243ee4a80 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.898+0000 7faad6cca740 1 --2- 172.21.15.1:0/395650491 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564243b12280 0x564243ef0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.898+0000 7faad6cca740 1 --2- 172.21.15.1:0/395650491 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564243b0a0a0 0x564243ef5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.898+0000 7faad6cca740 1 -- 172.21.15.1:0/395650491 >> 172.21.15.1:0/395650491 conn(0x564243b27350 msgr2=0x564243ef4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:47.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.898+0000 7faad6cca740 1 -- 172.21.15.1:0/395650491 shutdown_connections 2024-09-21T00:56:47.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.898+0000 7faad6cca740 1 -- 172.21.15.1:0/395650491 wait complete. 2024-09-21T00:56:47.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.898+0000 7faad6cca740 1 -- start start 2024-09-21T00:56:47.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.898+0000 7faad6cca740 1 Processor -- start 2024-09-21T00:56:47.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.898+0000 7faad6cca740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564243b0a0a0 0x564243ef80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:47.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.898+0000 7faad6cca740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564243b12280 0x564243ef8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:47.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.898+0000 7faad6cca740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564243b32f60 0x564243ef8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:47.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.898+0000 7faad6cca740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564243ef6d50 con 0x564243b12280 2024-09-21T00:56:47.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.898+0000 7faad6cca740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564243ef6680 con 0x564243b32f60 2024-09-21T00:56:47.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.898+0000 7faad6cca740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564243ef7420 con 0x564243b0a0a0 2024-09-21T00:56:47.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.898+0000 7faad6cca740 10 client.0 _ll_register_callbacks cb 0x7faab800ae30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:56:47.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.899+0000 7faace4f2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564243b12280 0x564243ef8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:47.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.899+0000 7faace4f2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564243b12280 0x564243ef8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34800/0 (socket says 172.21.15.1:34800) 2024-09-21T00:56:47.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.899+0000 7faace4f2640 1 -- 172.21.15.1:0/467007806 learned_addr learned my addr 172.21.15.1:0/467007806 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:47.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.899+0000 7faacdcf1640 1 --2- 172.21.15.1:0/467007806 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564243b0a0a0 0x564243ef80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:47.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.899+0000 7faacdcf1640 1 --2- 172.21.15.1:0/467007806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564243b32f60 0x564243ef8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:47.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.899+0000 7faace4f2640 1 -- 172.21.15.1:0/467007806 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564243b0a0a0 msgr2=0x564243ef80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:47.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.899+0000 7faace4f2640 1 --2- 172.21.15.1:0/467007806 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564243b0a0a0 0x564243ef80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.899+0000 7faace4f2640 1 -- 172.21.15.1:0/467007806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564243b32f60 msgr2=0x564243ef8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:56:47.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.899+0000 7faace4f2640 1 --2- 172.21.15.1:0/467007806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564243b32f60 0x564243ef8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.899+0000 7faace4f2640 1 -- 172.21.15.1:0/467007806 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564243f60390 con 0x564243b12280 2024-09-21T00:56:47.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.899+0000 7faacdcf1640 1 --2- 172.21.15.1:0/467007806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564243b32f60 0x564243ef8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:56:47.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.899+0000 7faace4f2640 1 --2- 172.21.15.1:0/467007806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564243b12280 0x564243ef8610 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7faac4000c00 tx=0x7faac40041f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b07942cd10449cc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:47.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.899+0000 7faab1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:56:47.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.899+0000 7faab1ffb640 1 -- 172.21.15.1:0/467007806 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac4035040 con 0x564243b12280 2024-09-21T00:56:47.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.899+0000 7faab1ffb640 1 -- 172.21.15.1:0/467007806 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7faac4005240 con 0x564243b12280 2024-09-21T00:56:47.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.899+0000 7faad6cca740 1 -- 172.21.15.1:0/467007806 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faab8004ef0 con 0x564243b12280 2024-09-21T00:56:47.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.899+0000 7faab1ffb640 1 -- 172.21.15.1:0/467007806 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7faac4054050 con 0x564243b12280 2024-09-21T00:56:47.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.899+0000 7faad6cca740 10 client.15384 fetch_fsmap learned FSMap version 26 2024-09-21T00:56:47.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.899+0000 7faad6cca740 1 -- 172.21.15.1:0/467007806 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564243f61610 con 0x564243b12280 2024-09-21T00:56:47.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.900+0000 7faab1ffb640 1 -- 172.21.15.1:0/467007806 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faab8004ef0 con 0x564243b12280 2024-09-21T00:56:47.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.900+0000 7faab1ffb640 1 -- 172.21.15.1:0/467007806 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7faac40035f0 con 0x564243b12280 2024-09-21T00:56:47.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.900+0000 7faad6cca740 10 client.15384 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T00:56:47.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.900+0000 7faad6cca740 10 client.15384 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T00:56:47.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.900+0000 7faad6cca740 20 client.15384 populate_metadata read hostname 'smithi001' 2024-09-21T00:56:47.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.900+0000 7faad6cca740 1 --2- 172.21.15.1:0/467007806 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x564243ac6c90 0x564243f64f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:47.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.900+0000 7faad6cca740 4 client.15384 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T00:56:47.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.900+0000 7faad6cca740 1 -- 172.21.15.1:0/467007806 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "status"}) -- 0x564243e4e610 con 0x564243ac6c90 2024-09-21T00:56:47.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.900+0000 7faacdcf1640 1 --2- 172.21.15.1:0/467007806 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x564243ac6c90 0x564243f64f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:47.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.901+0000 7faacdcf1640 1 --2- 172.21.15.1:0/467007806 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x564243ac6c90 0x564243f64f70 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d0d1951d9c01038 server_cookie=1339c2bc1d5a9f5 in_seq=0 out_seq=0 2024-09-21T00:56:47.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.901+0000 7faab1ffb640 10 client.15384 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:56:47.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.901+0000 7faab1ffb640 1 -- 172.21.15.1:0/467007806 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x564243e4e610 con 0x564243ac6c90 2024-09-21T00:56:47.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.901+0000 7faab1ffb640 10 client.15384 handle_command_reply: tid=0 2024-09-21T00:56:47.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.901+0000 7faad6cca740 1 client.15384 shutdown 2024-09-21T00:56:47.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.901+0000 7faad6cca740 1 -- 172.21.15.1:0/467007806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564243b12280 msgr2=0x564243ef8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:47.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.901+0000 7faad6cca740 1 --2- 172.21.15.1:0/467007806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564243b12280 0x564243ef8610 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7faac4000c00 tx=0x7faac40041f0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.901+0000 7faad6cca740 1 -- 172.21.15.1:0/467007806 shutdown_connections 2024-09-21T00:56:47.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.901+0000 7faad6cca740 1 --2- 172.21.15.1:0/467007806 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x564243ac6c90 0x564243f64f70 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.901+0000 7faad6cca740 1 --2- 172.21.15.1:0/467007806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564243b32f60 0x564243ef8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.901+0000 7faad6cca740 1 --2- 172.21.15.1:0/467007806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564243b12280 0x564243ef8610 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.901+0000 7faad6cca740 1 --2- 172.21.15.1:0/467007806 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564243b0a0a0 0x564243ef80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.901+0000 7faad6cca740 1 -- 172.21.15.1:0/467007806 >> 172.21.15.1:0/467007806 conn(0x564243b27350 msgr2=0x564243ef0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:47.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.901+0000 7faab1ffb640 0 client.15384 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:56:47.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.901+0000 7faad6cca740 1 -- 172.21.15.1:0/467007806 shutdown_connections 2024-09-21T00:56:47.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.901+0000 7faad6cca740 1 -- 172.21.15.1:0/467007806 wait complete. 2024-09-21T00:56:47.925 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T00:56:47.925 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "d3972c20-77b2-11ef-baf5-efdc52797490", 2024-09-21T00:56:47.925 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2024-09-21T00:56:47.925 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24653, 2024-09-21T00:56:47.925 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-21T00:56:47.925 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-21T00:56:47.925 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-21T00:56:47.925 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 109.044120433, 2024-09-21T00:56:47.925 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 26, 2024-09-21T00:56:47.925 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 75, 2024-09-21T00:56:47.925 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 73, 2024-09-21T00:56:47.925 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 119.78132966299999 2024-09-21T00:56:47.926 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T00:56:47.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.901+0000 7faad6cca740 20 client.15384 trim_cache size 0 max 16384 2024-09-21T00:56:47.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.902+0000 7faad0756640 1 -- 172.21.15.1:0/1880383440 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7faab40b6510 msgr2=0x7faab40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:47.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.902+0000 7faad0756640 1 --2- 172.21.15.1:0/1880383440 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7faab40b6510 0x7faab40b8a20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7faac00aa230 tx=0x7faac00d1040 comp rx=0 tx=0).stop 2024-09-21T00:56:47.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.902+0000 7faad0756640 1 -- 172.21.15.1:0/1880383440 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faac8108d10 msgr2=0x7faac8104cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:47.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.902+0000 7faad0756640 1 --2- 172.21.15.1:0/1880383440 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faac8108d10 0x7faac8104cf0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7faac000eb10 tx=0x7faac000ef10 comp rx=0 tx=0).stop 2024-09-21T00:56:47.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.902+0000 7faad0756640 1 -- 172.21.15.1:0/1880383440 shutdown_connections 2024-09-21T00:56:47.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.902+0000 7faad0756640 1 --2- 172.21.15.1:0/1880383440 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7faab40b6510 0x7faab40b8a20 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.902+0000 7faad0756640 1 --2- 172.21.15.1:0/1880383440 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faac8108d10 0x7faac8104cf0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.902+0000 7faad0756640 1 --2- 172.21.15.1:0/1880383440 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faac81083c0 0x7faac81047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.902+0000 7faad0756640 1 --2- 172.21.15.1:0/1880383440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faac8102a80 0x7faac8104270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.902+0000 7faad0756640 1 -- 172.21.15.1:0/1880383440 >> 172.21.15.1:0/1880383440 conn(0x7faac8079740 msgr2=0x7faac8101ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:47.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.902+0000 7faad0756640 1 -- 172.21.15.1:0/1880383440 shutdown_connections 2024-09-21T00:56:47.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:47.902+0000 7faad0756640 1 -- 172.21.15.1:0/1880383440 wait complete. 2024-09-21T00:56:48.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:47 smithi193 ceph-mon[34660]: pgmap v345: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:56:48.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:47 smithi042 ceph-mon[34481]: pgmap v345: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:56:48.713 INFO:teuthology.run_tasks:Running task kclient... 2024-09-21T00:56:48.736 INFO:tasks.kclient:Mounting kernel clients... 2024-09-21T00:56:48.736 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-21T00:56:48.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:56:48.736 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2024-09-21T00:56:48.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:56:48.754 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link delete ceph-brx 2024-09-21T00:56:48.823 INFO:teuthology.orchestra.run.smithi001.stderr:Cannot find device "ceph-brx" 2024-09-21T00:56:48.824 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:56:48.825 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-21T00:56:48.825 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T00:56:48.825 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T00:56:48.825 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T00:56:49.122 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:49.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.567+0000 7f27b3ca2640 1 -- 172.21.15.1:0/1676131241 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27ac102a60 msgr2=0x7f27ac102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:49.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.567+0000 7f27b3ca2640 1 --2- 172.21.15.1:0/1676131241 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27ac102a60 0x7f27ac102e70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f27a8009900 tx=0x7f27a802a410 comp rx=0 tx=0).stop 2024-09-21T00:56:49.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.567+0000 7f27b3ca2640 1 -- 172.21.15.1:0/1676131241 shutdown_connections 2024-09-21T00:56:49.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.567+0000 7f27b3ca2640 1 --2- 172.21.15.1:0/1676131241 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27ac108cf0 0x7f27ac10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:49.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.567+0000 7f27b3ca2640 1 --2- 172.21.15.1:0/1676131241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27ac1083a0 0x7f27ac1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:49.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.567+0000 7f27b3ca2640 1 --2- 172.21.15.1:0/1676131241 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27ac102a60 0x7f27ac102e70 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:49.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.567+0000 7f27b3ca2640 1 -- 172.21.15.1:0/1676131241 >> 172.21.15.1:0/1676131241 conn(0x7f27ac079730 msgr2=0x7f27ac079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:49.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.567+0000 7f27b3ca2640 1 -- 172.21.15.1:0/1676131241 shutdown_connections 2024-09-21T00:56:49.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.567+0000 7f27b3ca2640 1 -- 172.21.15.1:0/1676131241 wait complete. 2024-09-21T00:56:49.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.569+0000 7f27b3ca2640 1 Processor -- start 2024-09-21T00:56:49.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.569+0000 7f27b3ca2640 1 -- start start 2024-09-21T00:56:49.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.569+0000 7f27b3ca2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27ac102a60 0x7f27ac199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:49.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.569+0000 7f27b3ca2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27ac1083a0 0x7f27ac199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:49.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.569+0000 7f27b3ca2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27ac108cf0 0x7f27ac19ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:49.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.569+0000 7f27b3ca2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f27ac112960 con 0x7f27ac1083a0 2024-09-21T00:56:49.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.569+0000 7f27b3ca2640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f27ac1127e0 con 0x7f27ac108cf0 2024-09-21T00:56:49.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.569+0000 7f27b3ca2640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f27ac112ae0 con 0x7f27ac102a60 2024-09-21T00:56:49.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.569+0000 7f27b123d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27ac1083a0 0x7f27ac199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:49.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.569+0000 7f27b123d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27ac1083a0 0x7f27ac199910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39850/0 (socket says 172.21.15.1:39850) 2024-09-21T00:56:49.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.569+0000 7f27b123d640 1 -- 172.21.15.1:0/4049628550 learned_addr learned my addr 172.21.15.1:0/4049628550 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:49.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.569+0000 7f27b1a3e640 1 --2- 172.21.15.1:0/4049628550 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27ac102a60 0x7f27ac199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:49.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.569+0000 7f27b223f640 1 --2- 172.21.15.1:0/4049628550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27ac108cf0 0x7f27ac19ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:49.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.569+0000 7f27b123d640 1 -- 172.21.15.1:0/4049628550 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27ac102a60 msgr2=0x7f27ac199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:49.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.569+0000 7f27b123d640 1 --2- 172.21.15.1:0/4049628550 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27ac102a60 0x7f27ac199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:49.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.569+0000 7f27b123d640 1 -- 172.21.15.1:0/4049628550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27ac108cf0 msgr2=0x7f27ac19ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:49.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.569+0000 7f27b123d640 1 --2- 172.21.15.1:0/4049628550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27ac108cf0 0x7f27ac19ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:49.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.569+0000 7f27b123d640 1 -- 172.21.15.1:0/4049628550 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27ac19f220 con 0x7f27ac1083a0 2024-09-21T00:56:49.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.569+0000 7f27b223f640 1 --2- 172.21.15.1:0/4049628550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27ac108cf0 0x7f27ac19ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:56:49.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.569+0000 7f27b123d640 1 --2- 172.21.15.1:0/4049628550 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27ac1083a0 0x7f27ac199910 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f279c00d770 tx=0x7f279c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:49.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.569+0000 7f27a2ffd640 1 -- 172.21.15.1:0/4049628550 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279c017070 con 0x7f27ac1083a0 2024-09-21T00:56:49.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.569+0000 7f27b3ca2640 1 -- 172.21.15.1:0/4049628550 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27ac19f510 con 0x7f27ac1083a0 2024-09-21T00:56:49.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.569+0000 7f27a2ffd640 1 -- 172.21.15.1:0/4049628550 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f279c009c30 con 0x7f27ac1083a0 2024-09-21T00:56:49.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.569+0000 7f27a2ffd640 1 -- 172.21.15.1:0/4049628550 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279c00f620 con 0x7f27ac1083a0 2024-09-21T00:56:49.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.569+0000 7f27b3ca2640 1 -- 172.21.15.1:0/4049628550 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27ac1a5d30 con 0x7f27ac1083a0 2024-09-21T00:56:49.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.570+0000 7f27b3ca2640 1 -- 172.21.15.1:0/4049628550 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27ac102e70 con 0x7f27ac1083a0 2024-09-21T00:56:49.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.572+0000 7f27a2ffd640 1 -- 172.21.15.1:0/4049628550 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 154511+0+0 (secure 0 0 0) 0x7f279c01a070 con 0x7f27ac1083a0 2024-09-21T00:56:49.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.573+0000 7f27a2ffd640 1 --2- 172.21.15.1:0/4049628550 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f27980b6540 0x7f27980b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:49.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.573+0000 7f27b1a3e640 1 --2- 172.21.15.1:0/4049628550 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f27980b6540 0x7f27980b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:49.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.573+0000 7f27a2ffd640 1 -- 172.21.15.1:0/4049628550 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f279c0e6e00 con 0x7f27ac1083a0 2024-09-21T00:56:49.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.573+0000 7f27b1a3e640 1 --2- 172.21.15.1:0/4049628550 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f27980b6540 0x7f27980b8a50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f27a8031440 tx=0x7f27a8009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:49.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.577+0000 7f27a2ffd640 1 -- 172.21.15.1:0/4049628550 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f279c0ad670 con 0x7f27ac1083a0 2024-09-21T00:56:49.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.809+0000 7f27b3ca2640 1 -- 172.21.15.1:0/4049628550 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f27ac10aac0 con 0x7f27ac1083a0 2024-09-21T00:56:49.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.809+0000 7f27a2ffd640 1 -- 172.21.15.1:0/4049628550 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) ==== 53+0+73 (secure 0 0 0) 0x7f279c0b1a50 con 0x7f27ac1083a0 2024-09-21T00:56:49.810 INFO:teuthology.orchestra.run.smithi001.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T00:56:49.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.811+0000 7f27b3ca2640 1 -- 172.21.15.1:0/4049628550 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f27980b6540 msgr2=0x7f27980b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:49.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.811+0000 7f27b3ca2640 1 --2- 172.21.15.1:0/4049628550 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f27980b6540 0x7f27980b8a50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f27a8031440 tx=0x7f27a8009560 comp rx=0 tx=0).stop 2024-09-21T00:56:49.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.811+0000 7f27b3ca2640 1 -- 172.21.15.1:0/4049628550 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27ac1083a0 msgr2=0x7f27ac199910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:49.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.811+0000 7f27b3ca2640 1 --2- 172.21.15.1:0/4049628550 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27ac1083a0 0x7f27ac199910 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f279c00d770 tx=0x7f279c00dc30 comp rx=0 tx=0).stop 2024-09-21T00:56:49.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.812+0000 7f27b3ca2640 1 -- 172.21.15.1:0/4049628550 shutdown_connections 2024-09-21T00:56:49.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.812+0000 7f27b3ca2640 1 --2- 172.21.15.1:0/4049628550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27ac108cf0 0x7f27ac19ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:49.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.812+0000 7f27b3ca2640 1 --2- 172.21.15.1:0/4049628550 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f27980b6540 0x7f27980b8a50 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:49.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.812+0000 7f27b3ca2640 1 --2- 172.21.15.1:0/4049628550 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27ac1083a0 0x7f27ac199910 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:49.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.812+0000 7f27b3ca2640 1 --2- 172.21.15.1:0/4049628550 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27ac102a60 0x7f27ac199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:49.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.812+0000 7f27b3ca2640 1 -- 172.21.15.1:0/4049628550 >> 172.21.15.1:0/4049628550 conn(0x7f27ac079730 msgr2=0x7f27ac1014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:49.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.812+0000 7f27b3ca2640 1 -- 172.21.15.1:0/4049628550 shutdown_connections 2024-09-21T00:56:49.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:49.812+0000 7f27b3ca2640 1 -- 172.21.15.1:0/4049628550 wait complete. 2024-09-21T00:56:50.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:49 smithi001 ceph-mon[31211]: pgmap v346: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:56:50.239 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:49 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/4049628550' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T00:56:50.239 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:49 smithi193 ceph-mon[34660]: pgmap v346: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:56:50.239 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:49 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/4049628550' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T00:56:50.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:49 smithi042 ceph-mon[34481]: pgmap v346: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:56:50.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:49 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/4049628550' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T00:56:50.612 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T00:56:50.612 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T00:56:50.612 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi001.front.sepia.ceph.com 2024-09-21T00:56:50.612 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T00:56:50.612 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T00:56:50.612 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T00:56:50.612 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T00:56:50.613 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T00:56:50.613 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T00:56:50.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:56:50.613 DEBUG:teuthology.orchestra.run.smithi001:> ip addr 2024-09-21T00:56:50.630 INFO:teuthology.orchestra.run.smithi001.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T00:56:50.630 INFO:teuthology.orchestra.run.smithi001.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T00:56:50.630 INFO:teuthology.orchestra.run.smithi001.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T00:56:50.630 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:56:50.630 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 ::1/128 scope host 2024-09-21T00:56:50.630 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:56:50.630 INFO:teuthology.orchestra.run.smithi001.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T00:56:50.630 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7a brd ff:ff:ff:ff:ff:ff 2024-09-21T00:56:50.630 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f0 2024-09-21T00:56:50.630 INFO:teuthology.orchestra.run.smithi001.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T00:56:50.631 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7b brd ff:ff:ff:ff:ff:ff 2024-09-21T00:56:50.631 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f1 2024-09-21T00:56:50.631 INFO:teuthology.orchestra.run.smithi001.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T00:56:50.631 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e8 brd ff:ff:ff:ff:ff:ff 2024-09-21T00:56:50.631 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f0 2024-09-21T00:56:50.631 INFO:teuthology.orchestra.run.smithi001.stdout: inet 172.21.15.1/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-21T00:56:50.631 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft 42136sec preferred_lft 42136sec 2024-09-21T00:56:50.631 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::ec4:7aff:febd:15e8/64 scope link 2024-09-21T00:56:50.631 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:56:50.631 INFO:teuthology.orchestra.run.smithi001.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T00:56:50.631 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e9 brd ff:ff:ff:ff:ff:ff 2024-09-21T00:56:50.631 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f1 2024-09-21T00:56:50.632 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T00:56:50.632 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:56:50.632 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-21T00:56:50.632 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link add name ceph-brx type bridge 2024-09-21T00:56:50.632 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip addr flush dev ceph-brx 2024-09-21T00:56:50.632 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set ceph-brx up 2024-09-21T00:56:50.632 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T00:56:50.632 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-21T00:56:50.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:56:50.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:56:50.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:56:50.848 DEBUG:teuthology.orchestra.run.smithi001:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T00:56:50.874 INFO:teuthology.orchestra.run.smithi001.stdout:1 2024-09-21T00:56:50.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:56:50.875 DEBUG:teuthology.orchestra.run.smithi001:> route 2024-09-21T00:56:51.033 INFO:teuthology.orchestra.run.smithi001.stdout:Kernel IP routing table 2024-09-21T00:56:51.033 INFO:teuthology.orchestra.run.smithi001.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T00:56:51.033 INFO:teuthology.orchestra.run.smithi001.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-21T00:56:51.033 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-21T00:56:51.034 INFO:teuthology.orchestra.run.smithi001.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T00:56:51.034 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:56:51.034 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-21T00:56:51.034 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-21T00:56:51.034 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-21T00:56:51.034 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-21T00:56:51.034 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-21T00:56:51.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:56:51.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:56:51.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:56:51.306 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2024-09-21T00:56:51.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:56:51.322 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list-id 2024-09-21T00:56:51.379 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:56:51.379 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-21T00:56:51.379 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T00:56:51.379 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T00:56:51.379 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-21T00:56:51.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:56:51.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:56:51.499 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T00:56:51.500 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:56:51.500 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-21T00:56:51.500 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T00:56:51.500 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T00:56:51.500 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T00:56:51.500 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T00:56:51.500 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T00:56:51.500 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-21T00:56:51.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:56:51.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:56:51.658 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:56:51.658 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-21T00:56:51.659 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set brx.0 up 2024-09-21T00:56:51.659 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T00:56:51.659 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-21T00:56:51.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:56:51.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:56:51.739 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T00:56:51.739 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T00:56:51.755 INFO:teuthology.orchestra.run.smithi001.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T00:56:51.755 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T00:56:51.755 DEBUG:teuthology.orchestra.run.smithi001:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T00:56:51.811 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-21T00:56:51.811 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-21T00:56:51.811 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/8951b59d-e05c-4790-b838-6f047983b9c5 2024-09-21T00:56:51.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:56:51.811 DEBUG:teuthology.orchestra.run.smithi001:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/8951b59d-e05c-4790-b838-6f047983b9c5 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-21T00:56:51.927 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-21T00:56:51.927 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-09-21T00:56:51.953 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:51 smithi001 ceph-mon[31211]: pgmap v347: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T00:56:52.049 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-21T00:56:52.049 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-09-21T00:56:52.049 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: resolved to: "172.21.15.1:3300,172.21.15.42:3300,172.21.15.193:3300" 2024-09-21T00:56:52.049 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: trying mount with new device syntax: 0@d3972c20-77b2-11ef-baf5-efdc52797490.cephfs=/volumes/qa/sv_1/8951b59d-e05c-4790-b838-6f047983b9c5 2024-09-21T00:56:52.049 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync,name=0,key=0,mon_addr=172.21.15.1:3300/172.21.15.42:3300/172.21.15.193:3300" will pass to kernel 2024-09-21T00:56:52.050 INFO:teuthology.orchestra.run.smithi001.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T00:56:52.050 INFO:teuthology.orchestra.run.smithi001.stdout: You just mounted a file system that supports labels which does not 2024-09-21T00:56:52.050 INFO:teuthology.orchestra.run.smithi001.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T00:56:52.050 INFO:teuthology.orchestra.run.smithi001.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T00:56:52.050 INFO:teuthology.orchestra.run.smithi001.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T00:56:52.052 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T00:56:52.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:56:52.053 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T00:56:52.079 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T00:56:52.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T00:56:52.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:56:52.177 INFO:teuthology.orchestra.run.smithi001.stdout:client15393 2024-09-21T00:56:52.177 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-21T00:56:52.177 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T00:56:52.194 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T00:56:52.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:51 smithi193 ceph-mon[34660]: pgmap v347: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T00:56:52.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:51 smithi042 ceph-mon[34481]: pgmap v347: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T00:56:52.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T00:56:52.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:56:52.292 INFO:teuthology.orchestra.run.smithi001.stdout:client15393 2024-09-21T00:56:52.292 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T00:56:52.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T00:56:52.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:56:52.350 INFO:teuthology.orchestra.run.smithi001.stdout:client15393 2024-09-21T00:56:52.350 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/d3972c20-77b2-11ef-baf5-efdc52797490.client15393/status') 2024-09-21T00:56:52.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:56:52.410 INFO:teuthology.orchestra.run.smithi001.stdout:instance: client.15393 (3)192.168.0.1:0/3543014207 2024-09-21T00:56:52.410 INFO:teuthology.orchestra.run.smithi001.stdout:blocklisted: false 2024-09-21T00:56:52.410 INFO:teuthology.orchestra.run.smithi001.stderr:0+1 records in 2024-09-21T00:56:52.410 INFO:teuthology.orchestra.run.smithi001.stderr:0+1 records out 2024-09-21T00:56:52.410 INFO:teuthology.orchestra.run.smithi001.stderr:70 bytes copied, 3.2569e-05 s, 2.1 MB/s 2024-09-21T00:56:52.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:56:52.418 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T00:56:52.428 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T00:56:52.428 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi001.front.sepia.ceph.com 2024-09-21T00:56:52.428 DEBUG:teuthology.orchestra.run.smithi001:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-09-21T00:56:52.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.542+0000 7fdb5c827640 1 -- 172.21.15.1:0/579050194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb58101a90 msgr2=0x7fdb58101ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:52.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.542+0000 7fdb5c827640 1 --2- 172.21.15.1:0/579050194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb58101a90 0x7fdb58101ea0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fdb48009900 tx=0x7fdb4802a410 comp rx=0 tx=0).stop 2024-09-21T00:56:52.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.542+0000 7fdb5c827640 1 -- 172.21.15.1:0/579050194 shutdown_connections 2024-09-21T00:56:52.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.542+0000 7fdb5c827640 1 --2- 172.21.15.1:0/579050194 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb58109480 0x7fdb5810b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:52.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.542+0000 7fdb5c827640 1 --2- 172.21.15.1:0/579050194 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb58106b20 0x7fdb58108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:52.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.542+0000 7fdb5c827640 1 --2- 172.21.15.1:0/579050194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb58101a90 0x7fdb58101ea0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:52.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.542+0000 7fdb5c827640 1 -- 172.21.15.1:0/579050194 >> 172.21.15.1:0/579050194 conn(0x7fdb580fd690 msgr2=0x7fdb580ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:52.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.542+0000 7fdb5c827640 1 -- 172.21.15.1:0/579050194 shutdown_connections 2024-09-21T00:56:52.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.542+0000 7fdb5c827640 1 -- 172.21.15.1:0/579050194 wait complete. 2024-09-21T00:56:52.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.543+0000 7fdb5c827640 1 Processor -- start 2024-09-21T00:56:52.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.543+0000 7fdb5c827640 1 -- start start 2024-09-21T00:56:52.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.543+0000 7fdb5c827640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb58101a90 0x7fdb58199f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:52.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.543+0000 7fdb5c827640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb58106b20 0x7fdb5819a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:52.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.543+0000 7fdb5c827640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb58109480 0x7fdb5819b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:52.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.543+0000 7fdb5c827640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5810f340 con 0x7fdb58109480 2024-09-21T00:56:52.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.543+0000 7fdb5c827640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5810f1c0 con 0x7fdb58101a90 2024-09-21T00:56:52.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.543+0000 7fdb5c827640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5810f4c0 con 0x7fdb58106b20 2024-09-21T00:56:52.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.543+0000 7fdb56d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb58109480 0x7fdb5819b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:52.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.543+0000 7fdb56d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb58109480 0x7fdb5819b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39872/0 (socket says 172.21.15.1:39872) 2024-09-21T00:56:52.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.543+0000 7fdb56d9d640 1 -- 172.21.15.1:0/1773804287 learned_addr learned my addr 172.21.15.1:0/1773804287 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:52.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.543+0000 7fdb55d9b640 1 --2- 172.21.15.1:0/1773804287 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb58106b20 0x7fdb5819a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:52.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.543+0000 7fdb5659c640 1 --2- 172.21.15.1:0/1773804287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb58101a90 0x7fdb58199f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:52.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.543+0000 7fdb56d9d640 1 -- 172.21.15.1:0/1773804287 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb58106b20 msgr2=0x7fdb5819a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:52.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.543+0000 7fdb56d9d640 1 --2- 172.21.15.1:0/1773804287 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb58106b20 0x7fdb5819a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:52.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.543+0000 7fdb56d9d640 1 -- 172.21.15.1:0/1773804287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb58101a90 msgr2=0x7fdb58199f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:52.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.543+0000 7fdb56d9d640 1 --2- 172.21.15.1:0/1773804287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb58101a90 0x7fdb58199f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:52.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.543+0000 7fdb56d9d640 1 -- 172.21.15.1:0/1773804287 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb5819b950 con 0x7fdb58109480 2024-09-21T00:56:52.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.543+0000 7fdb5659c640 1 --2- 172.21.15.1:0/1773804287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb58101a90 0x7fdb58199f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:56:52.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.544+0000 7fdb56d9d640 1 --2- 172.21.15.1:0/1773804287 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb58109480 0x7fdb5819b130 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdb5000eaa0 tx=0x7fdb5000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:52.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.544+0000 7fdb477fe640 1 -- 172.21.15.1:0/1773804287 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5000cdb0 con 0x7fdb58109480 2024-09-21T00:56:52.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.544+0000 7fdb5c827640 1 -- 172.21.15.1:0/1773804287 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb5819bc40 con 0x7fdb58109480 2024-09-21T00:56:52.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.544+0000 7fdb477fe640 1 -- 172.21.15.1:0/1773804287 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb50005020 con 0x7fdb58109480 2024-09-21T00:56:52.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.544+0000 7fdb477fe640 1 -- 172.21.15.1:0/1773804287 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb500116d0 con 0x7fdb58109480 2024-09-21T00:56:52.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.544+0000 7fdb5c827640 1 -- 172.21.15.1:0/1773804287 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb581a2330 con 0x7fdb58109480 2024-09-21T00:56:52.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.545+0000 7fdb5c827640 1 -- 172.21.15.1:0/1773804287 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb580ff1b0 con 0x7fdb58109480 2024-09-21T00:56:52.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.546+0000 7fdb477fe640 1 -- 172.21.15.1:0/1773804287 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 154511+0+0 (secure 0 0 0) 0x7fdb500051d0 con 0x7fdb58109480 2024-09-21T00:56:52.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.547+0000 7fdb477fe640 1 --2- 172.21.15.1:0/1773804287 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fdb400b6510 0x7fdb400b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:52.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.547+0000 7fdb477fe640 1 -- 172.21.15.1:0/1773804287 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fdb500e74e0 con 0x7fdb58109480 2024-09-21T00:56:52.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.547+0000 7fdb5659c640 1 --2- 172.21.15.1:0/1773804287 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fdb400b6510 0x7fdb400b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:52.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.548+0000 7fdb5659c640 1 --2- 172.21.15.1:0/1773804287 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fdb400b6510 0x7fdb400b8a20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdb48000c00 tx=0x7fdb48031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:52.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.552+0000 7fdb477fe640 1 -- 172.21.15.1:0/1773804287 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdb50016030 con 0x7fdb58109480 2024-09-21T00:56:52.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.782+0000 7fdb5c827640 1 -- 172.21.15.1:0/1773804287 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7fdb5802e640 con 0x7fdb58109480 2024-09-21T00:56:52.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.860+0000 7fdb477fe640 1 -- 172.21.15.1:0/1773804287 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v27) ==== 118+0+0 (secure 0 0 0) 0x7fdb500add50 con 0x7fdb58109480 2024-09-21T00:56:52.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.863+0000 7fdb5c827640 1 -- 172.21.15.1:0/1773804287 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fdb400b6510 msgr2=0x7fdb400b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:52.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.863+0000 7fdb5c827640 1 --2- 172.21.15.1:0/1773804287 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fdb400b6510 0x7fdb400b8a20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdb48000c00 tx=0x7fdb48031400 comp rx=0 tx=0).stop 2024-09-21T00:56:52.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.863+0000 7fdb5c827640 1 -- 172.21.15.1:0/1773804287 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb58109480 msgr2=0x7fdb5819b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:52.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.863+0000 7fdb5c827640 1 --2- 172.21.15.1:0/1773804287 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb58109480 0x7fdb5819b130 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdb5000eaa0 tx=0x7fdb5000ef60 comp rx=0 tx=0).stop 2024-09-21T00:56:52.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.863+0000 7fdb5c827640 1 -- 172.21.15.1:0/1773804287 shutdown_connections 2024-09-21T00:56:52.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.863+0000 7fdb5c827640 1 --2- 172.21.15.1:0/1773804287 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fdb400b6510 0x7fdb400b8a20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:52.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.863+0000 7fdb5c827640 1 --2- 172.21.15.1:0/1773804287 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb58109480 0x7fdb5819b130 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:52.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.863+0000 7fdb5c827640 1 --2- 172.21.15.1:0/1773804287 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb58106b20 0x7fdb5819a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:52.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.863+0000 7fdb5c827640 1 --2- 172.21.15.1:0/1773804287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb58101a90 0x7fdb58199f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:52.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.863+0000 7fdb5c827640 1 -- 172.21.15.1:0/1773804287 >> 172.21.15.1:0/1773804287 conn(0x7fdb580fd690 msgr2=0x7fdb58107950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:52.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.863+0000 7fdb5c827640 1 -- 172.21.15.1:0/1773804287 shutdown_connections 2024-09-21T00:56:52.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.863+0000 7fdb5c827640 1 -- 172.21.15.1:0/1773804287 wait complete. 2024-09-21T00:56:52.875 DEBUG:teuthology.orchestra.run.smithi001:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-09-21T00:56:52.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.990+0000 7f6495c30640 1 -- 172.21.15.1:0/855822240 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6490106840 msgr2=0x7f6490108cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:52.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.990+0000 7f6495c30640 1 --2- 172.21.15.1:0/855822240 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6490106840 0x7f6490108cc0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6478009900 tx=0x7f647802a410 comp rx=0 tx=0).stop 2024-09-21T00:56:52.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.990+0000 7f6495c30640 1 -- 172.21.15.1:0/855822240 shutdown_connections 2024-09-21T00:56:52.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.990+0000 7f6495c30640 1 --2- 172.21.15.1:0/855822240 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6490109400 0x7f649010b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:52.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.990+0000 7f6495c30640 1 --2- 172.21.15.1:0/855822240 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6490106840 0x7f6490108cc0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:52.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.990+0000 7f6495c30640 1 --2- 172.21.15.1:0/855822240 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f649006b880 0x7f6490106300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:52.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.990+0000 7f6495c30640 1 -- 172.21.15.1:0/855822240 >> 172.21.15.1:0/855822240 conn(0x7f64900fdf00 msgr2=0x7f64901003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:52.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.990+0000 7f6495c30640 1 -- 172.21.15.1:0/855822240 shutdown_connections 2024-09-21T00:56:52.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.990+0000 7f6495c30640 1 -- 172.21.15.1:0/855822240 wait complete. 2024-09-21T00:56:52.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.991+0000 7f6495c30640 1 Processor -- start 2024-09-21T00:56:52.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.991+0000 7f6495c30640 1 -- start start 2024-09-21T00:56:52.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.991+0000 7f6495c30640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f649006b880 0x7f6490199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:52.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.991+0000 7f6495c30640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6490106840 0x7f649019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:52.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.991+0000 7f6495c30640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6490109400 0x7f649019b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:52.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.991+0000 7f6495c30640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f649010f2f0 con 0x7f6490106840 2024-09-21T00:56:52.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.991+0000 7f6495c30640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f649010f170 con 0x7f6490109400 2024-09-21T00:56:52.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.991+0000 7f6495c30640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f649010f470 con 0x7f649006b880 2024-09-21T00:56:52.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.991+0000 7f648effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6490106840 0x7f649019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:52.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.991+0000 7f648effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6490106840 0x7f649019a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39894/0 (socket says 172.21.15.1:39894) 2024-09-21T00:56:52.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.991+0000 7f648effd640 1 -- 172.21.15.1:0/3476450571 learned_addr learned my addr 172.21.15.1:0/3476450571 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:52.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.991+0000 7f648ffff640 1 --2- 172.21.15.1:0/3476450571 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6490109400 0x7f649019b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:52.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.992+0000 7f648f7fe640 1 --2- 172.21.15.1:0/3476450571 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f649006b880 0x7f6490199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:52.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.992+0000 7f648effd640 1 -- 172.21.15.1:0/3476450571 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f649006b880 msgr2=0x7f6490199f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:52.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.992+0000 7f648effd640 1 --2- 172.21.15.1:0/3476450571 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f649006b880 0x7f6490199f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:52.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.992+0000 7f648effd640 1 -- 172.21.15.1:0/3476450571 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6490109400 msgr2=0x7f649019b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:52.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.992+0000 7f648effd640 1 --2- 172.21.15.1:0/3476450571 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6490109400 0x7f649019b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:52.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.992+0000 7f648effd640 1 -- 172.21.15.1:0/3476450571 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f649019b930 con 0x7f6490106840 2024-09-21T00:56:52.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.992+0000 7f648effd640 1 --2- 172.21.15.1:0/3476450571 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6490106840 0x7f649019a5f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6478006010 tx=0x7f6478031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:52.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.992+0000 7f648cff9640 1 -- 172.21.15.1:0/3476450571 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647803f030 con 0x7f6490106840 2024-09-21T00:56:52.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.992+0000 7f6495c30640 1 -- 172.21.15.1:0/3476450571 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f649019bbc0 con 0x7f6490106840 2024-09-21T00:56:52.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.992+0000 7f648cff9640 1 -- 172.21.15.1:0/3476450571 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6478003aa0 con 0x7f6490106840 2024-09-21T00:56:52.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.992+0000 7f648cff9640 1 -- 172.21.15.1:0/3476450571 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6478035070 con 0x7f6490106840 2024-09-21T00:56:52.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.992+0000 7f6495c30640 1 -- 172.21.15.1:0/3476450571 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64901a21c0 con 0x7f6490106840 2024-09-21T00:56:52.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.993+0000 7f6495c30640 1 -- 172.21.15.1:0/3476450571 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64900ffa20 con 0x7f6490106840 2024-09-21T00:56:52.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.995+0000 7f648cff9640 1 -- 172.21.15.1:0/3476450571 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 154511+0+0 (secure 0 0 0) 0x7f6478042030 con 0x7f6490106840 2024-09-21T00:56:52.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.996+0000 7f648cff9640 1 --2- 172.21.15.1:0/3476450571 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f647c0b6510 0x7f647c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:52.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.996+0000 7f648f7fe640 1 --2- 172.21.15.1:0/3476450571 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f647c0b6510 0x7f647c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:52.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.996+0000 7f648cff9640 1 -- 172.21.15.1:0/3476450571 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f6478107dc0 con 0x7f6490106840 2024-09-21T00:56:52.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.996+0000 7f648f7fe640 1 --2- 172.21.15.1:0/3476450571 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f647c0b6510 0x7f647c0b8a20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6480007350 tx=0x7f64800072e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:52.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:52.999+0000 7f648cff9640 1 -- 172.21.15.1:0/3476450571 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f64780ce5d0 con 0x7f6490106840 2024-09-21T00:56:53.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:52 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1773804287' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-21T00:56:53.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.212+0000 7f6495c30640 1 -- 172.21.15.1:0/3476450571 --> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f64900638a0 con 0x7f647c0b6510 2024-09-21T00:56:53.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:52 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/1773804287' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-21T00:56:53.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.232+0000 7f648cff9640 1 -- 172.21.15.1:0/3476450571 <== mgr.14150 v2:172.21.15.1:6800/2032980330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f64900638a0 con 0x7f647c0b6510 2024-09-21T00:56:53.232 INFO:teuthology.orchestra.run.smithi001.stdout:{} 2024-09-21T00:56:53.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.234+0000 7f6495c30640 1 -- 172.21.15.1:0/3476450571 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f647c0b6510 msgr2=0x7f647c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:53.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.234+0000 7f6495c30640 1 --2- 172.21.15.1:0/3476450571 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f647c0b6510 0x7f647c0b8a20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6480007350 tx=0x7f64800072e0 comp rx=0 tx=0).stop 2024-09-21T00:56:53.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.234+0000 7f6495c30640 1 -- 172.21.15.1:0/3476450571 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6490106840 msgr2=0x7f649019a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:53.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.234+0000 7f6495c30640 1 --2- 172.21.15.1:0/3476450571 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6490106840 0x7f649019a5f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6478006010 tx=0x7f6478031a50 comp rx=0 tx=0).stop 2024-09-21T00:56:53.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.234+0000 7f6495c30640 1 -- 172.21.15.1:0/3476450571 shutdown_connections 2024-09-21T00:56:53.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.234+0000 7f6495c30640 1 --2- 172.21.15.1:0/3476450571 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6490109400 0x7f649019b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:53.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.234+0000 7f6495c30640 1 --2- 172.21.15.1:0/3476450571 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f647c0b6510 0x7f647c0b8a20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:53.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.234+0000 7f6495c30640 1 --2- 172.21.15.1:0/3476450571 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6490106840 0x7f649019a5f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:53.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.234+0000 7f6495c30640 1 --2- 172.21.15.1:0/3476450571 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f649006b880 0x7f6490199f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:53.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.234+0000 7f6495c30640 1 -- 172.21.15.1:0/3476450571 >> 172.21.15.1:0/3476450571 conn(0x7f64900fdf00 msgr2=0x7f6490104df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:53.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.234+0000 7f6495c30640 1 -- 172.21.15.1:0/3476450571 shutdown_connections 2024-09-21T00:56:53.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.234+0000 7f6495c30640 1 -- 172.21.15.1:0/3476450571 wait complete. 2024-09-21T00:56:53.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:52 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/1773804287' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-21T00:56:53.246 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-21T00:56:53.257 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-21T00:56:53.319 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T00:56:53.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.433+0000 7f1c938c5640 1 -- 172.21.15.1:0/515211843 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c8c103640 msgr2=0x7f1c8c103a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:53.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.433+0000 7f1c938c5640 1 --2- 172.21.15.1:0/515211843 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c8c103640 0x7f1c8c103a50 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c009900 tx=0x7f1c7c02a410 comp rx=0 tx=0).stop 2024-09-21T00:56:53.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.433+0000 7f1c938c5640 1 -- 172.21.15.1:0/515211843 shutdown_connections 2024-09-21T00:56:53.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.433+0000 7f1c938c5640 1 --2- 172.21.15.1:0/515211843 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c8c103fe0 0x7f1c8c10a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:53.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.433+0000 7f1c938c5640 1 --2- 172.21.15.1:0/515211843 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c8c103640 0x7f1c8c103a50 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:53.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.433+0000 7f1c938c5640 1 --2- 172.21.15.1:0/515211843 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1c8c1025c0 0x7f1c8c102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:53.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.433+0000 7f1c938c5640 1 -- 172.21.15.1:0/515211843 >> 172.21.15.1:0/515211843 conn(0x7f1c8c0fdf00 msgr2=0x7f1c8c1003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:53.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.433+0000 7f1c938c5640 1 -- 172.21.15.1:0/515211843 shutdown_connections 2024-09-21T00:56:53.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.433+0000 7f1c938c5640 1 -- 172.21.15.1:0/515211843 wait complete. 2024-09-21T00:56:53.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.433+0000 7f1c938c5640 1 Processor -- start 2024-09-21T00:56:53.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.433+0000 7f1c938c5640 1 -- start start 2024-09-21T00:56:53.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.434+0000 7f1c938c5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c8c1025c0 0x7f1c8c06c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:53.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.434+0000 7f1c938c5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1c8c103640 0x7f1c8c1a10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:53.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.434+0000 7f1c938c5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c8c103fe0 0x7f1c8c1a3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:53.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.434+0000 7f1c938c5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1c8c10e210 con 0x7f1c8c103fe0 2024-09-21T00:56:53.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.434+0000 7f1c938c5640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1c8c10e090 con 0x7f1c8c1025c0 2024-09-21T00:56:53.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.434+0000 7f1c938c5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1c8c10e390 con 0x7f1c8c103640 2024-09-21T00:56:53.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.434+0000 7f1c91e62640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c8c103fe0 0x7f1c8c1a3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:53.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.434+0000 7f1c91e62640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c8c103fe0 0x7f1c8c1a3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39918/0 (socket says 172.21.15.1:39918) 2024-09-21T00:56:53.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.434+0000 7f1c91e62640 1 -- 172.21.15.1:0/1874982049 learned_addr learned my addr 172.21.15.1:0/1874982049 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:53.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.434+0000 7f1c91661640 1 --2- 172.21.15.1:0/1874982049 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c8c1025c0 0x7f1c8c06c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:53.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.434+0000 7f1c90e60640 1 --2- 172.21.15.1:0/1874982049 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1c8c103640 0x7f1c8c1a10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:53.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.434+0000 7f1c91e62640 1 -- 172.21.15.1:0/1874982049 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1c8c103640 msgr2=0x7f1c8c1a10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:53.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.434+0000 7f1c91e62640 1 --2- 172.21.15.1:0/1874982049 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1c8c103640 0x7f1c8c1a10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:53.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.434+0000 7f1c91e62640 1 -- 172.21.15.1:0/1874982049 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c8c1025c0 msgr2=0x7f1c8c06c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:53.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.434+0000 7f1c91e62640 1 --2- 172.21.15.1:0/1874982049 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c8c1025c0 0x7f1c8c06c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:53.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.434+0000 7f1c91e62640 1 -- 172.21.15.1:0/1874982049 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c8c1a3c30 con 0x7f1c8c103fe0 2024-09-21T00:56:53.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.434+0000 7f1c91e62640 1 --2- 172.21.15.1:0/1874982049 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c8c103fe0 0x7f1c8c1a3620 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1c8400eaa0 tx=0x7f1c8400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:53.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.434+0000 7f1c827fc640 1 -- 172.21.15.1:0/1874982049 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c8400cdb0 con 0x7f1c8c103fe0 2024-09-21T00:56:53.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.434+0000 7f1c827fc640 1 -- 172.21.15.1:0/1874982049 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c84005020 con 0x7f1c8c103fe0 2024-09-21T00:56:53.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.434+0000 7f1c938c5640 1 -- 172.21.15.1:0/1874982049 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c8c1a3f20 con 0x7f1c8c103fe0 2024-09-21T00:56:53.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.434+0000 7f1c827fc640 1 -- 172.21.15.1:0/1874982049 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c840116d0 con 0x7f1c8c103fe0 2024-09-21T00:56:53.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.434+0000 7f1c938c5640 1 -- 172.21.15.1:0/1874982049 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c8c1a4390 con 0x7f1c8c103fe0 2024-09-21T00:56:53.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.435+0000 7f1c938c5640 1 -- 172.21.15.1:0/1874982049 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c8c109790 con 0x7f1c8c103fe0 2024-09-21T00:56:53.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.437+0000 7f1c827fc640 1 -- 172.21.15.1:0/1874982049 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 154511+0+0 (secure 0 0 0) 0x7f1c840051d0 con 0x7f1c8c103fe0 2024-09-21T00:56:53.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.438+0000 7f1c827fc640 1 --2- 172.21.15.1:0/1874982049 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f1c780b6510 0x7f1c780b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:53.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.438+0000 7f1c91661640 1 --2- 172.21.15.1:0/1874982049 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f1c780b6510 0x7f1c780b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:53.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.438+0000 7f1c827fc640 1 -- 172.21.15.1:0/1874982049 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f1c840e7990 con 0x7f1c8c103fe0 2024-09-21T00:56:53.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.438+0000 7f1c91661640 1 --2- 172.21.15.1:0/1874982049 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f1c780b6510 0x7f1c780b8a20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1c88005fd0 tx=0x7f1c8800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:53.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.441+0000 7f1c827fc640 1 -- 172.21.15.1:0/1874982049 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1c84016030 con 0x7f1c8c103fe0 2024-09-21T00:56:53.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.630+0000 7f1c938c5640 1 -- 172.21.15.1:0/1874982049 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1c8c063fc0 con 0x7f1c8c103fe0 2024-09-21T00:56:53.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.631+0000 7f1c827fc640 1 -- 172.21.15.1:0/1874982049 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22720 (secure 0 0 0) 0x7f1c840ae1a0 con 0x7f1c8c103fe0 2024-09-21T00:56:53.632 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:56:53.632 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":75,"fsid":"d3972c20-77b2-11ef-baf5-efdc52797490","created":"2024-09-21T00:46:29.745963+0000","modified":"2024-09-21T00:55:27.629379+0000","last_up_change":"2024-09-21T00:54:07.552837+0000","last_in_change":"2024-09-21T00:53:44.164415+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:50:16.456462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:54:54.305306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:54:56.506872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5bf09a34-4d6e-401c-8cef-29bbe72de68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6803","nonce":4067586847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6805","nonce":4067586847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6809","nonce":4067586847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6807","nonce":4067586847}]},"public_addr":"172.21.15.1:6803/4067586847","cluster_addr":"172.21.15.1:6805/4067586847","heartbeat_back_addr":"172.21.15.1:6809/4067586847","heartbeat_front_addr":"172.21.15.1:6807/4067586847","state":["exists","up"]},{"osd":1,"uuid":"195f9109-ef61-46be-a59a-d72e3a1b5b45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6801","nonce":436964633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6803","nonce":436964633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6807","nonce":436964633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6805","nonce":436964633}]},"public_addr":"172.21.15.42:6801/436964633","cluster_addr":"172.21.15.42:6803/436964633","heartbeat_back_addr":"172.21.15.42:6807/436964633","heartbeat_front_addr":"172.21.15.42:6805/436964633","state":["exists","up"]},{"osd":2,"uuid":"47cf90a7-6db6-464a-84ef-9f509f89a46b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6801","nonce":3495400570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6803","nonce":3495400570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6807","nonce":3495400570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6805","nonce":3495400570}]},"public_addr":"172.21.15.193:6801/3495400570","cluster_addr":"172.21.15.193:6803/3495400570","heartbeat_back_addr":"172.21.15.193:6807/3495400570","heartbeat_front_addr":"172.21.15.193:6805/3495400570","state":["exists","up"]},{"osd":3,"uuid":"a5230a66-3c74-41a7-9353-5650780ed25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6811","nonce":3221661671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6813","nonce":3221661671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6817","nonce":3221661671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6815","nonce":3221661671}]},"public_addr":"172.21.15.1:6811/3221661671","cluster_addr":"172.21.15.1:6813/3221661671","heartbeat_back_addr":"172.21.15.1:6817/3221661671","heartbeat_front_addr":"172.21.15.1:6815/3221661671","state":["exists","up"]},{"osd":4,"uuid":"b0476b9b-3257-46d4-aff7-1f038286ed43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6809","nonce":2066388104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6811","nonce":2066388104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6815","nonce":2066388104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6813","nonce":2066388104}]},"public_addr":"172.21.15.42:6809/2066388104","cluster_addr":"172.21.15.42:6811/2066388104","heartbeat_back_addr":"172.21.15.42:6815/2066388104","heartbeat_front_addr":"172.21.15.42:6813/2066388104","state":["exists","up"]},{"osd":5,"uuid":"96701ced-a55a-4ad9-be62-7f102c00697d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6809","nonce":732336675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6811","nonce":732336675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6815","nonce":732336675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6813","nonce":732336675}]},"public_addr":"172.21.15.193:6809/732336675","cluster_addr":"172.21.15.193:6811/732336675","heartbeat_back_addr":"172.21.15.193:6815/732336675","heartbeat_front_addr":"172.21.15.193:6813/732336675","state":["exists","up"]},{"osd":6,"uuid":"72d76017-e2e3-4118-8316-2c5da01c87b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6819","nonce":3201517067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6821","nonce":3201517067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6825","nonce":3201517067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6823","nonce":3201517067}]},"public_addr":"172.21.15.1:6819/3201517067","cluster_addr":"172.21.15.1:6821/3201517067","heartbeat_back_addr":"172.21.15.1:6825/3201517067","heartbeat_front_addr":"172.21.15.1:6823/3201517067","state":["exists","up"]},{"osd":7,"uuid":"8b239f96-2455-41b6-a905-9ed92078b890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6817","nonce":2124927218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6819","nonce":2124927218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6823","nonce":2124927218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6821","nonce":2124927218}]},"public_addr":"172.21.15.42:6817/2124927218","cluster_addr":"172.21.15.42:6819/2124927218","heartbeat_back_addr":"172.21.15.42:6823/2124927218","heartbeat_front_addr":"172.21.15.42:6821/2124927218","state":["exists","up"]},{"osd":8,"uuid":"8cd93aeb-fe00-4291-9f72-171d01893819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6817","nonce":2277449259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6819","nonce":2277449259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6823","nonce":2277449259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6821","nonce":2277449259}]},"public_addr":"172.21.15.193:6817/2277449259","cluster_addr":"172.21.15.193:6819/2277449259","heartbeat_back_addr":"172.21.15.193:6823/2277449259","heartbeat_front_addr":"172.21.15.193:6821/2277449259","state":["exists","up"]},{"osd":9,"uuid":"9e03e00b-0015-4aa8-adce-0d3352d2ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6827","nonce":1369323215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6829","nonce":1369323215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6833","nonce":1369323215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6831","nonce":1369323215}]},"public_addr":"172.21.15.1:6827/1369323215","cluster_addr":"172.21.15.1:6829/1369323215","heartbeat_back_addr":"172.21.15.1:6833/1369323215","heartbeat_front_addr":"172.21.15.1:6831/1369323215","state":["exists","up"]},{"osd":10,"uuid":"de55a908-b049-4f40-865f-cfa2ae6e461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6825","nonce":3182218295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6827","nonce":3182218295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6831","nonce":3182218295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6829","nonce":3182218295}]},"public_addr":"172.21.15.42:6825/3182218295","cluster_addr":"172.21.15.42:6827/3182218295","heartbeat_back_addr":"172.21.15.42:6831/3182218295","heartbeat_front_addr":"172.21.15.42:6829/3182218295","state":["exists","up"]},{"osd":11,"uuid":"1cac0c39-77aa-460b-92a0-39ed89cd6ce4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6825","nonce":2368815522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6827","nonce":2368815522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6831","nonce":2368815522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6829","nonce":2368815522}]},"public_addr":"172.21.15.193:6825/2368815522","cluster_addr":"172.21.15.193:6827/2368815522","heartbeat_back_addr":"172.21.15.193:6831/2368815522","heartbeat_front_addr":"172.21.15.193:6829/2368815522","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:49:21.491443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:49:47.486846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:50:12.757383+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:50:39.127690+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:05.545277+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:30.617491+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:57.612088+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:24.001953+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:48.447388+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:14.620538+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:40.503576+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:54:05.668236+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6801/59685083":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/309615464":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/1722941514":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/1199175740":"2024-09-22T00:47:25.985486+0000","172.21.15.1:6800/59685083":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/2811453932":"2024-09-22T00:46:58.953779+0000","172.21.15.1:0/3748689057":"2024-09-22T00:46:58.953779+0000","172.21.15.1:0/265697975":"2024-09-22T00:46:58.953779+0000","172.21.15.1:6801/1968786311":"2024-09-22T00:46:58.953779+0000","172.21.15.1:6800/1968786311":"2024-09-22T00:46:58.953779+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:56:53.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.633+0000 7f1c938c5640 1 -- 172.21.15.1:0/1874982049 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f1c780b6510 msgr2=0x7f1c780b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:53.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.633+0000 7f1c938c5640 1 --2- 172.21.15.1:0/1874982049 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f1c780b6510 0x7f1c780b8a20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1c88005fd0 tx=0x7f1c8800b390 comp rx=0 tx=0).stop 2024-09-21T00:56:53.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.634+0000 7f1c938c5640 1 -- 172.21.15.1:0/1874982049 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c8c103fe0 msgr2=0x7f1c8c1a3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:53.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.634+0000 7f1c938c5640 1 --2- 172.21.15.1:0/1874982049 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c8c103fe0 0x7f1c8c1a3620 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1c8400eaa0 tx=0x7f1c8400ef60 comp rx=0 tx=0).stop 2024-09-21T00:56:53.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.634+0000 7f1c938c5640 1 -- 172.21.15.1:0/1874982049 shutdown_connections 2024-09-21T00:56:53.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.634+0000 7f1c938c5640 1 --2- 172.21.15.1:0/1874982049 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f1c780b6510 0x7f1c780b8a20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:53.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.634+0000 7f1c938c5640 1 --2- 172.21.15.1:0/1874982049 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c8c103fe0 0x7f1c8c1a3620 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:53.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.634+0000 7f1c938c5640 1 --2- 172.21.15.1:0/1874982049 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1c8c103640 0x7f1c8c1a10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:53.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.634+0000 7f1c938c5640 1 --2- 172.21.15.1:0/1874982049 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c8c1025c0 0x7f1c8c06c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:53.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.634+0000 7f1c938c5640 1 -- 172.21.15.1:0/1874982049 >> 172.21.15.1:0/1874982049 conn(0x7f1c8c0fdf00 msgr2=0x7f1c8c106960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:53.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.634+0000 7f1c938c5640 1 -- 172.21.15.1:0/1874982049 shutdown_connections 2024-09-21T00:56:53.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.634+0000 7f1c938c5640 1 -- 172.21.15.1:0/1874982049 wait complete. 2024-09-21T00:56:53.645 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:56:53 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: 2024-09-21T00:56:53.217+0000 7fdd85ceb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T00:56:53.645 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:56:53 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: 2024-09-21T00:56:53.217+0000 7fdd85ceb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T00:56:53.645 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:56:53 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: 2024-09-21T00:56:53.217+0000 7fdd85ceb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T00:56:53.645 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:56:53 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: 2024-09-21T00:56:53.217+0000 7fdd85ceb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T00:56:53.645 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 00:56:53 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: 2024-09-21T00:56:53.217+0000 7fdd85ceb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T00:56:53.647 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T00:50:16.456462+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T00:54:54.305306+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T00:54:56.506872+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T00:56:53.647 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T00:56:53.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.763+0000 7f9315e1d640 1 -- 172.21.15.1:0/1074316743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9310103fc0 msgr2=0x7f931010a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:53.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.763+0000 7f9315e1d640 1 --2- 172.21.15.1:0/1074316743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9310103fc0 0x7f931010a960 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9308009ca0 tx=0x7f930802a8c0 comp rx=0 tx=0).stop 2024-09-21T00:56:53.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.763+0000 7f9315e1d640 1 -- 172.21.15.1:0/1074316743 shutdown_connections 2024-09-21T00:56:53.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.763+0000 7f9315e1d640 1 --2- 172.21.15.1:0/1074316743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9310103fc0 0x7f931010a960 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:53.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.763+0000 7f9315e1d640 1 --2- 172.21.15.1:0/1074316743 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9310103620 0x7f9310103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:53.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.763+0000 7f9315e1d640 1 --2- 172.21.15.1:0/1074316743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93101025a0 0x7f9310102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:53.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.763+0000 7f9315e1d640 1 -- 172.21.15.1:0/1074316743 >> 172.21.15.1:0/1074316743 conn(0x7f93100fdf00 msgr2=0x7f9310100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:53.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.763+0000 7f9315e1d640 1 -- 172.21.15.1:0/1074316743 shutdown_connections 2024-09-21T00:56:53.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.763+0000 7f9315e1d640 1 -- 172.21.15.1:0/1074316743 wait complete. 2024-09-21T00:56:53.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.764+0000 7f9315e1d640 1 Processor -- start 2024-09-21T00:56:53.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.764+0000 7f9315e1d640 1 -- start start 2024-09-21T00:56:53.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.764+0000 7f9315e1d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93101025a0 0x7f9310198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:53.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.764+0000 7f9315e1d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9310103620 0x7f9310199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:53.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.764+0000 7f9315e1d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9310103fc0 0x7f9310199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:53.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.764+0000 7f9315e1d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f931010e200 con 0x7f93101025a0 2024-09-21T00:56:53.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.764+0000 7f9315e1d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f931010e080 con 0x7f9310103620 2024-09-21T00:56:53.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.764+0000 7f9315e1d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f931010e380 con 0x7f9310103fc0 2024-09-21T00:56:53.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.764+0000 7f930f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93101025a0 0x7f9310198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:53.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.764+0000 7f930f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93101025a0 0x7f9310198dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39938/0 (socket says 172.21.15.1:39938) 2024-09-21T00:56:53.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.764+0000 7f930f7fe640 1 -- 172.21.15.1:0/3035059635 learned_addr learned my addr 172.21.15.1:0/3035059635 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:53.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.765+0000 7f9306ffd640 1 --2- 172.21.15.1:0/3035059635 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9310103620 0x7f9310199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:53.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.765+0000 7f930ffff640 1 --2- 172.21.15.1:0/3035059635 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9310103fc0 0x7f9310199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:53.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.765+0000 7f930f7fe640 1 -- 172.21.15.1:0/3035059635 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9310103fc0 msgr2=0x7f9310199fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:53.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.765+0000 7f930f7fe640 1 --2- 172.21.15.1:0/3035059635 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9310103fc0 0x7f9310199fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:53.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.765+0000 7f930f7fe640 1 -- 172.21.15.1:0/3035059635 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9310103620 msgr2=0x7f9310199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:53.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.765+0000 7f930f7fe640 1 --2- 172.21.15.1:0/3035059635 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9310103620 0x7f9310199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:53.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.765+0000 7f930f7fe640 1 -- 172.21.15.1:0/3035059635 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f931019a800 con 0x7f93101025a0 2024-09-21T00:56:53.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.765+0000 7f930ffff640 1 --2- 172.21.15.1:0/3035059635 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9310103fc0 0x7f9310199fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:56:53.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.765+0000 7f930f7fe640 1 --2- 172.21.15.1:0/3035059635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93101025a0 0x7f9310198dc0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f930000d950 tx=0x7f930000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:53.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.765+0000 7f930d7fa640 1 -- 172.21.15.1:0/3035059635 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9300017070 con 0x7f93101025a0 2024-09-21T00:56:53.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.765+0000 7f930d7fa640 1 -- 172.21.15.1:0/3035059635 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9300009c30 con 0x7f93101025a0 2024-09-21T00:56:53.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.765+0000 7f9315e1d640 1 -- 172.21.15.1:0/3035059635 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f931019aaf0 con 0x7f93101025a0 2024-09-21T00:56:53.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.765+0000 7f930d7fa640 1 -- 172.21.15.1:0/3035059635 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930000f620 con 0x7f93101025a0 2024-09-21T00:56:53.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.765+0000 7f9315e1d640 1 -- 172.21.15.1:0/3035059635 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93101a11e0 con 0x7f93101025a0 2024-09-21T00:56:53.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.766+0000 7f9315e1d640 1 -- 172.21.15.1:0/3035059635 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9310109750 con 0x7f93101025a0 2024-09-21T00:56:53.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.768+0000 7f930d7fa640 1 -- 172.21.15.1:0/3035059635 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 154511+0+0 (secure 0 0 0) 0x7f9300010460 con 0x7f93101025a0 2024-09-21T00:56:53.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.769+0000 7f930d7fa640 1 --2- 172.21.15.1:0/3035059635 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f92fc0b6590 0x7f92fc0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:53.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.769+0000 7f9306ffd640 1 --2- 172.21.15.1:0/3035059635 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f92fc0b6590 0x7f92fc0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:53.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.769+0000 7f930d7fa640 1 -- 172.21.15.1:0/3035059635 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f93000e6fb0 con 0x7f93101025a0 2024-09-21T00:56:53.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.770+0000 7f9306ffd640 1 --2- 172.21.15.1:0/3035059635 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f92fc0b6590 0x7f92fc0b8aa0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f92f8005fd0 tx=0x7f92f8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:53.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.773+0000 7f930d7fa640 1 -- 172.21.15.1:0/3035059635 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f93000ad8a0 con 0x7f93101025a0 2024-09-21T00:56:53.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:53 smithi001 ceph-mon[31211]: pgmap v348: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T00:56:53.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:53 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1773804287' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-21T00:56:53.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:53 smithi001 ceph-mon[31211]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T00:56:53.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:53 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1874982049' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:56:53.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.963+0000 7f9315e1d640 1 -- 172.21.15.1:0/3035059635 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f931002e7d0 con 0x7f93101025a0 2024-09-21T00:56:53.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.963+0000 7f930d7fa640 1 -- 172.21.15.1:0/3035059635 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7f9300009de0 con 0x7f93101025a0 2024-09-21T00:56:53.963 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2024-09-21T00:56:53.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.965+0000 7f9315e1d640 1 -- 172.21.15.1:0/3035059635 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f92fc0b6590 msgr2=0x7f92fc0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:53.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.965+0000 7f9315e1d640 1 --2- 172.21.15.1:0/3035059635 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f92fc0b6590 0x7f92fc0b8aa0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f92f8005fd0 tx=0x7f92f8005850 comp rx=0 tx=0).stop 2024-09-21T00:56:53.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.965+0000 7f9315e1d640 1 -- 172.21.15.1:0/3035059635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93101025a0 msgr2=0x7f9310198dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:53.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.965+0000 7f9315e1d640 1 --2- 172.21.15.1:0/3035059635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93101025a0 0x7f9310198dc0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f930000d950 tx=0x7f930000de10 comp rx=0 tx=0).stop 2024-09-21T00:56:53.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.966+0000 7f9315e1d640 1 -- 172.21.15.1:0/3035059635 shutdown_connections 2024-09-21T00:56:53.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.966+0000 7f9315e1d640 1 --2- 172.21.15.1:0/3035059635 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9310103fc0 0x7f9310199fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:53.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.966+0000 7f9315e1d640 1 --2- 172.21.15.1:0/3035059635 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9310103620 0x7f9310199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:53.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.966+0000 7f9315e1d640 1 --2- 172.21.15.1:0/3035059635 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f92fc0b6590 0x7f92fc0b8aa0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:53.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.966+0000 7f9315e1d640 1 --2- 172.21.15.1:0/3035059635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93101025a0 0x7f9310198dc0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:53.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.966+0000 7f9315e1d640 1 -- 172.21.15.1:0/3035059635 >> 172.21.15.1:0/3035059635 conn(0x7f93100fdf00 msgr2=0x7f9310106920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:53.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.966+0000 7f9315e1d640 1 -- 172.21.15.1:0/3035059635 shutdown_connections 2024-09-21T00:56:53.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:53.966+0000 7f9315e1d640 1 -- 172.21.15.1:0/3035059635 wait complete. 2024-09-21T00:56:53.978 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T00:56:54.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.093+0000 7f4a21c20640 1 -- 172.21.15.1:0/3739201841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a1c102c80 msgr2=0x7f4a1c1050a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:54.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.093+0000 7f4a21c20640 1 --2- 172.21.15.1:0/3739201841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a1c102c80 0x7f4a1c1050a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c009900 tx=0x7f4a0c02a410 comp rx=0 tx=0).stop 2024-09-21T00:56:54.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.093+0000 7f4a21c20640 1 -- 172.21.15.1:0/3739201841 shutdown_connections 2024-09-21T00:56:54.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.093+0000 7f4a21c20640 1 --2- 172.21.15.1:0/3739201841 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4a1c108300 0x7f4a1c10a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:54.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.093+0000 7f4a21c20640 1 --2- 172.21.15.1:0/3739201841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a1c1056e0 0x7f4a1c107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:54.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.093+0000 7f4a21c20640 1 --2- 172.21.15.1:0/3739201841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a1c102c80 0x7f4a1c1050a0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:54.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.093+0000 7f4a21c20640 1 -- 172.21.15.1:0/3739201841 >> 172.21.15.1:0/3739201841 conn(0x7f4a1c0fd690 msgr2=0x7f4a1c0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:54.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.093+0000 7f4a21c20640 1 -- 172.21.15.1:0/3739201841 shutdown_connections 2024-09-21T00:56:54.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.093+0000 7f4a21c20640 1 -- 172.21.15.1:0/3739201841 wait complete. 2024-09-21T00:56:54.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.094+0000 7f4a21c20640 1 Processor -- start 2024-09-21T00:56:54.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.094+0000 7f4a21c20640 1 -- start start 2024-09-21T00:56:54.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.094+0000 7f4a21c20640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a1c102c80 0x7f4a1c102140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:54.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.094+0000 7f4a21c20640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a1c1056e0 0x7f4a1c19ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:54.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.094+0000 7f4a21c20640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4a1c108300 0x7f4a1c1a11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:54.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.094+0000 7f4a21c20640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1c10e1f0 con 0x7f4a1c102c80 2024-09-21T00:56:54.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.094+0000 7f4a21c20640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1c10e070 con 0x7f4a1c1056e0 2024-09-21T00:56:54.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.094+0000 7f4a21c20640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1c10e370 con 0x7f4a1c108300 2024-09-21T00:56:54.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.095+0000 7f4a1b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a1c102c80 0x7f4a1c102140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:54.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.095+0000 7f4a1b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a1c102c80 0x7f4a1c102140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39948/0 (socket says 172.21.15.1:39948) 2024-09-21T00:56:54.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.095+0000 7f4a1b7fe640 1 -- 172.21.15.1:0/3289578058 learned_addr learned my addr 172.21.15.1:0/3289578058 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:54.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.095+0000 7f4a1bfff640 1 --2- 172.21.15.1:0/3289578058 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4a1c108300 0x7f4a1c1a11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:54.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.095+0000 7f4a1affd640 1 --2- 172.21.15.1:0/3289578058 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a1c1056e0 0x7f4a1c19ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:54.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.095+0000 7f4a1b7fe640 1 -- 172.21.15.1:0/3289578058 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4a1c108300 msgr2=0x7f4a1c1a11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:54.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.095+0000 7f4a1b7fe640 1 --2- 172.21.15.1:0/3289578058 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4a1c108300 0x7f4a1c1a11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:54.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.095+0000 7f4a1b7fe640 1 -- 172.21.15.1:0/3289578058 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a1c1056e0 msgr2=0x7f4a1c19ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:54.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.095+0000 7f4a1b7fe640 1 --2- 172.21.15.1:0/3289578058 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a1c1056e0 0x7f4a1c19ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:54.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.095+0000 7f4a1b7fe640 1 -- 172.21.15.1:0/3289578058 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a1c1a19d0 con 0x7f4a1c102c80 2024-09-21T00:56:54.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.095+0000 7f4a1b7fe640 1 --2- 172.21.15.1:0/3289578058 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a1c102c80 0x7f4a1c102140 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c006010 tx=0x7f4a0c004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:54.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.095+0000 7f4a18ff9640 1 -- 172.21.15.1:0/3289578058 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c03f030 con 0x7f4a1c102c80 2024-09-21T00:56:54.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.095+0000 7f4a21c20640 1 -- 172.21.15.1:0/3289578058 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a1c1a1c60 con 0x7f4a1c102c80 2024-09-21T00:56:54.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.095+0000 7f4a21c20640 1 -- 172.21.15.1:0/3289578058 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a1c1a21a0 con 0x7f4a1c102c80 2024-09-21T00:56:54.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.095+0000 7f4a18ff9640 1 -- 172.21.15.1:0/3289578058 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a0c003cb0 con 0x7f4a1c102c80 2024-09-21T00:56:54.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.095+0000 7f4a18ff9640 1 -- 172.21.15.1:0/3289578058 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c049060 con 0x7f4a1c102c80 2024-09-21T00:56:54.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.096+0000 7f4a21c20640 1 -- 172.21.15.1:0/3289578058 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a080052c0 con 0x7f4a1c102c80 2024-09-21T00:56:54.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.098+0000 7f4a18ff9640 1 -- 172.21.15.1:0/3289578058 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 154511+0+0 (secure 0 0 0) 0x7f4a0c042030 con 0x7f4a1c102c80 2024-09-21T00:56:54.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.099+0000 7f4a18ff9640 1 --2- 172.21.15.1:0/3289578058 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4a040b6510 0x7f4a040b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:54.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.099+0000 7f4a1affd640 1 --2- 172.21.15.1:0/3289578058 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4a040b6510 0x7f4a040b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:54.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.099+0000 7f4a18ff9640 1 -- 172.21.15.1:0/3289578058 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f4a0c107c50 con 0x7f4a1c102c80 2024-09-21T00:56:54.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.100+0000 7f4a1affd640 1 --2- 172.21.15.1:0/3289578058 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4a040b6510 0x7f4a040b8a20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4a10005fd0 tx=0x7f4a10005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:54.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.102+0000 7f4a18ff9640 1 -- 172.21.15.1:0/3289578058 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4a0c0ce4c0 con 0x7f4a1c102c80 2024-09-21T00:56:54.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:53 smithi193 ceph-mon[34660]: pgmap v348: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T00:56:54.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:53 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/1773804287' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-21T00:56:54.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:53 smithi193 ceph-mon[34660]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T00:56:54.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:53 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/1874982049' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:56:54.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:53 smithi042 ceph-mon[34481]: pgmap v348: 97 pgs: 97 active+clean; 646 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T00:56:54.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:53 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/1773804287' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-21T00:56:54.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:53 smithi042 ceph-mon[34481]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T00:56:54.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:53 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/1874982049' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:56:54.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.290+0000 7f4a21c20640 1 -- 172.21.15.1:0/3289578058 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4a08005880 con 0x7f4a1c102c80 2024-09-21T00:56:54.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.290+0000 7f4a18ff9640 1 -- 172.21.15.1:0/3289578058 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) ==== 104+0+11 (secure 0 0 0) 0x7f4a0c003e60 con 0x7f4a1c102c80 2024-09-21T00:56:54.291 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 32 2024-09-21T00:56:54.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.292+0000 7f4a21c20640 1 -- 172.21.15.1:0/3289578058 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4a040b6510 msgr2=0x7f4a040b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:54.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.292+0000 7f4a21c20640 1 --2- 172.21.15.1:0/3289578058 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4a040b6510 0x7f4a040b8a20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4a10005fd0 tx=0x7f4a10005850 comp rx=0 tx=0).stop 2024-09-21T00:56:54.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.292+0000 7f4a21c20640 1 -- 172.21.15.1:0/3289578058 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a1c102c80 msgr2=0x7f4a1c102140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:54.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.292+0000 7f4a21c20640 1 --2- 172.21.15.1:0/3289578058 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a1c102c80 0x7f4a1c102140 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c006010 tx=0x7f4a0c004340 comp rx=0 tx=0).stop 2024-09-21T00:56:54.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.292+0000 7f4a21c20640 1 -- 172.21.15.1:0/3289578058 shutdown_connections 2024-09-21T00:56:54.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.292+0000 7f4a21c20640 1 --2- 172.21.15.1:0/3289578058 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4a1c108300 0x7f4a1c1a11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:54.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.292+0000 7f4a21c20640 1 --2- 172.21.15.1:0/3289578058 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a1c1056e0 0x7f4a1c19ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:54.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.292+0000 7f4a21c20640 1 --2- 172.21.15.1:0/3289578058 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4a040b6510 0x7f4a040b8a20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:54.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.292+0000 7f4a21c20640 1 --2- 172.21.15.1:0/3289578058 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a1c102c80 0x7f4a1c102140 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:54.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.292+0000 7f4a21c20640 1 -- 172.21.15.1:0/3289578058 >> 172.21.15.1:0/3289578058 conn(0x7f4a1c0fd690 msgr2=0x7f4a1c103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:54.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.293+0000 7f4a21c20640 1 -- 172.21.15.1:0/3289578058 shutdown_connections 2024-09-21T00:56:54.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.293+0000 7f4a21c20640 1 -- 172.21.15.1:0/3289578058 wait complete. 2024-09-21T00:56:54.305 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T00:56:54.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.421+0000 7f7a3abc6640 1 -- 172.21.15.1:0/2386453039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7a34108300 msgr2=0x7f7a3410a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:54.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.421+0000 7f7a3abc6640 1 --2- 172.21.15.1:0/2386453039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7a34108300 0x7f7a3410a810 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c009ca0 tx=0x7f7a2c02a8c0 comp rx=0 tx=0).stop 2024-09-21T00:56:54.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.421+0000 7f7a3abc6640 1 -- 172.21.15.1:0/2386453039 shutdown_connections 2024-09-21T00:56:54.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.421+0000 7f7a3abc6640 1 --2- 172.21.15.1:0/2386453039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7a34108300 0x7f7a3410a810 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:54.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.421+0000 7f7a3abc6640 1 --2- 172.21.15.1:0/2386453039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a34105700 0x7f7a34107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:54.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.421+0000 7f7a3abc6640 1 --2- 172.21.15.1:0/2386453039 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a34102cc0 0x7f7a341050e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:54.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.421+0000 7f7a3abc6640 1 -- 172.21.15.1:0/2386453039 >> 172.21.15.1:0/2386453039 conn(0x7f7a340fd690 msgr2=0x7f7a340ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:54.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.421+0000 7f7a3abc6640 1 -- 172.21.15.1:0/2386453039 shutdown_connections 2024-09-21T00:56:54.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.421+0000 7f7a3abc6640 1 -- 172.21.15.1:0/2386453039 wait complete. 2024-09-21T00:56:54.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.421+0000 7f7a3abc6640 1 Processor -- start 2024-09-21T00:56:54.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.421+0000 7f7a3abc6640 1 -- start start 2024-09-21T00:56:54.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.422+0000 7f7a3abc6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a34102cc0 0x7f7a34198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:54.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.422+0000 7f7a3abc6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a34105700 0x7f7a34199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:54.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.422+0000 7f7a3abc6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7a34108300 0x7f7a34199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:54.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.422+0000 7f7a3abc6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3410e220 con 0x7f7a34108300 2024-09-21T00:56:54.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.422+0000 7f7a3abc6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3410e0a0 con 0x7f7a34105700 2024-09-21T00:56:54.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.422+0000 7f7a3abc6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3410e3a0 con 0x7f7a34102cc0 2024-09-21T00:56:54.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.422+0000 7f7a39163640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7a34108300 0x7f7a34199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:54.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.422+0000 7f7a39163640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7a34108300 0x7f7a34199fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39960/0 (socket says 172.21.15.1:39960) 2024-09-21T00:56:54.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.422+0000 7f7a39163640 1 -- 172.21.15.1:0/2416461682 learned_addr learned my addr 172.21.15.1:0/2416461682 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:54.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.422+0000 7f7a33fff640 1 --2- 172.21.15.1:0/2416461682 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a34105700 0x7f7a34199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:54.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.422+0000 7f7a38962640 1 --2- 172.21.15.1:0/2416461682 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a34102cc0 0x7f7a34198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:54.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.422+0000 7f7a39163640 1 -- 172.21.15.1:0/2416461682 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a34102cc0 msgr2=0x7f7a34198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:54.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.422+0000 7f7a39163640 1 --2- 172.21.15.1:0/2416461682 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a34102cc0 0x7f7a34198db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:54.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.422+0000 7f7a39163640 1 -- 172.21.15.1:0/2416461682 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a34105700 msgr2=0x7f7a34199420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:54.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.422+0000 7f7a39163640 1 --2- 172.21.15.1:0/2416461682 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a34105700 0x7f7a34199420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:54.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.422+0000 7f7a39163640 1 -- 172.21.15.1:0/2416461682 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a3419a760 con 0x7f7a34108300 2024-09-21T00:56:54.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.422+0000 7f7a38962640 1 --2- 172.21.15.1:0/2416461682 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a34102cc0 0x7f7a34198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:56:54.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.422+0000 7f7a39163640 1 --2- 172.21.15.1:0/2416461682 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7a34108300 0x7f7a34199fd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c0097b0 tx=0x7f7a2c031840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:54.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.422+0000 7f7a31ffb640 1 -- 172.21.15.1:0/2416461682 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c003bf0 con 0x7f7a34108300 2024-09-21T00:56:54.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.422+0000 7f7a31ffb640 1 -- 172.21.15.1:0/2416461682 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a2c003d90 con 0x7f7a34108300 2024-09-21T00:56:54.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.423+0000 7f7a3abc6640 1 -- 172.21.15.1:0/2416461682 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a3419a9f0 con 0x7f7a34108300 2024-09-21T00:56:54.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.423+0000 7f7a31ffb640 1 -- 172.21.15.1:0/2416461682 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c02fb70 con 0x7f7a34108300 2024-09-21T00:56:54.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.423+0000 7f7a3abc6640 1 -- 172.21.15.1:0/2416461682 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a341a0ff0 con 0x7f7a34108300 2024-09-21T00:56:54.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.424+0000 7f7a3abc6640 1 -- 172.21.15.1:0/2416461682 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a340ff1b0 con 0x7f7a34108300 2024-09-21T00:56:54.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.425+0000 7f7a31ffb640 1 -- 172.21.15.1:0/2416461682 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 154511+0+0 (secure 0 0 0) 0x7f7a2c02fd30 con 0x7f7a34108300 2024-09-21T00:56:54.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.426+0000 7f7a31ffb640 1 --2- 172.21.15.1:0/2416461682 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f7a1c0b6510 0x7f7a1c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:54.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.427+0000 7f7a38962640 1 --2- 172.21.15.1:0/2416461682 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f7a1c0b6510 0x7f7a1c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:54.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.427+0000 7f7a31ffb640 1 -- 172.21.15.1:0/2416461682 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f7a2c108970 con 0x7f7a34108300 2024-09-21T00:56:54.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.427+0000 7f7a38962640 1 --2- 172.21.15.1:0/2416461682 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f7a1c0b6510 0x7f7a1c0b8a20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7a24009b50 tx=0x7f7a24005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:54.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.430+0000 7f7a31ffb640 1 -- 172.21.15.1:0/2416461682 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7a2c0cf180 con 0x7f7a34108300 2024-09-21T00:56:54.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.618+0000 7f7a3abc6640 1 -- 172.21.15.1:0/2416461682 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7a3402e7d0 con 0x7f7a34108300 2024-09-21T00:56:54.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.619+0000 7f7a31ffb640 1 -- 172.21.15.1:0/2416461682 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) ==== 100+0+11 (secure 0 0 0) 0x7f7a2c0d3560 con 0x7f7a34108300 2024-09-21T00:56:54.620 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2024-09-21T00:56:54.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.622+0000 7f7a3abc6640 1 -- 172.21.15.1:0/2416461682 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f7a1c0b6510 msgr2=0x7f7a1c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:54.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.622+0000 7f7a3abc6640 1 --2- 172.21.15.1:0/2416461682 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f7a1c0b6510 0x7f7a1c0b8a20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7a24009b50 tx=0x7f7a24005f90 comp rx=0 tx=0).stop 2024-09-21T00:56:54.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.622+0000 7f7a3abc6640 1 -- 172.21.15.1:0/2416461682 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7a34108300 msgr2=0x7f7a34199fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:54.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.622+0000 7f7a3abc6640 1 --2- 172.21.15.1:0/2416461682 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7a34108300 0x7f7a34199fd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c0097b0 tx=0x7f7a2c031840 comp rx=0 tx=0).stop 2024-09-21T00:56:54.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.622+0000 7f7a3abc6640 1 -- 172.21.15.1:0/2416461682 shutdown_connections 2024-09-21T00:56:54.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.622+0000 7f7a3abc6640 1 --2- 172.21.15.1:0/2416461682 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f7a1c0b6510 0x7f7a1c0b8a20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:54.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.622+0000 7f7a3abc6640 1 --2- 172.21.15.1:0/2416461682 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7a34108300 0x7f7a34199fd0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:54.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.622+0000 7f7a3abc6640 1 --2- 172.21.15.1:0/2416461682 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a34105700 0x7f7a34199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:54.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.622+0000 7f7a3abc6640 1 --2- 172.21.15.1:0/2416461682 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a34102cc0 0x7f7a34198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:54.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.622+0000 7f7a3abc6640 1 -- 172.21.15.1:0/2416461682 >> 172.21.15.1:0/2416461682 conn(0x7f7a340fd690 msgr2=0x7f7a34103ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:54.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.622+0000 7f7a3abc6640 1 -- 172.21.15.1:0/2416461682 shutdown_connections 2024-09-21T00:56:54.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:54.622+0000 7f7a3abc6640 1 -- 172.21.15.1:0/2416461682 wait complete. 2024-09-21T00:56:54.634 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-21T00:56:54.634 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:56:54.899 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:54.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:54 smithi001 ceph-mon[31211]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:54.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:54 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/3035059635' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T00:56:54.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:54 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/3289578058' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T00:56:54.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:54 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/2416461682' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T00:56:55.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:54 smithi193 ceph-mon[34660]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:55.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:54 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/3035059635' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T00:56:55.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:54 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/3289578058' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T00:56:55.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:54 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/2416461682' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T00:56:55.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:54 smithi042 ceph-mon[34481]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:55.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:54 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/3035059635' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T00:56:55.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:54 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/3289578058' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T00:56:55.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:54 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/2416461682' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T00:56:55.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.391+0000 7f7e44420640 1 -- 172.21.15.1:0/712811937 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7e3c1052b0 msgr2=0x7f7e3c10d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:55.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.391+0000 7f7e44420640 1 --2- 172.21.15.1:0/712811937 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7e3c1052b0 0x7f7e3c10d8f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c009900 tx=0x7f7e2c02a3f0 comp rx=0 tx=0).stop 2024-09-21T00:56:55.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.391+0000 7f7e44420640 1 -- 172.21.15.1:0/712811937 shutdown_connections 2024-09-21T00:56:55.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.391+0000 7f7e44420640 1 --2- 172.21.15.1:0/712811937 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e3c10de30 0x7f7e3c110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:55.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.391+0000 7f7e44420640 1 --2- 172.21.15.1:0/712811937 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7e3c1052b0 0x7f7e3c10d8f0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:55.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.391+0000 7f7e44420640 1 --2- 172.21.15.1:0/712811937 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e3c104880 0x7f7e3c104c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:55.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.391+0000 7f7e44420640 1 -- 172.21.15.1:0/712811937 >> 172.21.15.1:0/712811937 conn(0x7f7e3c079730 msgr2=0x7f7e3c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:55.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.391+0000 7f7e44420640 1 -- 172.21.15.1:0/712811937 shutdown_connections 2024-09-21T00:56:55.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.391+0000 7f7e44420640 1 -- 172.21.15.1:0/712811937 wait complete. 2024-09-21T00:56:55.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.392+0000 7f7e44420640 1 Processor -- start 2024-09-21T00:56:55.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.392+0000 7f7e44420640 1 -- start start 2024-09-21T00:56:55.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.392+0000 7f7e44420640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7e3c104880 0x7f7e3c19a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:55.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.393+0000 7f7e44420640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e3c1052b0 0x7f7e3c19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:55.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.393+0000 7f7e44420640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e3c10de30 0x7f7e3c19fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:55.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.393+0000 7f7e44420640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7e3c113ad0 con 0x7f7e3c104880 2024-09-21T00:56:55.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.393+0000 7f7e44420640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7e3c113950 con 0x7f7e3c1052b0 2024-09-21T00:56:55.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.393+0000 7f7e44420640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7e3c113c50 con 0x7f7e3c10de30 2024-09-21T00:56:55.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.393+0000 7f7e421bc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7e3c104880 0x7f7e3c19a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:55.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.393+0000 7f7e421bc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7e3c104880 0x7f7e3c19a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39968/0 (socket says 172.21.15.1:39968) 2024-09-21T00:56:55.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.393+0000 7f7e421bc640 1 -- 172.21.15.1:0/3742798179 learned_addr learned my addr 172.21.15.1:0/3742798179 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:55.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.393+0000 7f7e419bb640 1 --2- 172.21.15.1:0/3742798179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e3c1052b0 0x7f7e3c19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:55.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.393+0000 7f7e429bd640 1 --2- 172.21.15.1:0/3742798179 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e3c10de30 0x7f7e3c19fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:55.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.393+0000 7f7e421bc640 1 -- 172.21.15.1:0/3742798179 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e3c10de30 msgr2=0x7f7e3c19fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:55.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.393+0000 7f7e421bc640 1 --2- 172.21.15.1:0/3742798179 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e3c10de30 0x7f7e3c19fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:55.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.393+0000 7f7e421bc640 1 -- 172.21.15.1:0/3742798179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e3c1052b0 msgr2=0x7f7e3c19ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:55.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.393+0000 7f7e421bc640 1 --2- 172.21.15.1:0/3742798179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e3c1052b0 0x7f7e3c19ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:55.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.393+0000 7f7e421bc640 1 -- 172.21.15.1:0/3742798179 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e3c1a0450 con 0x7f7e3c104880 2024-09-21T00:56:55.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.393+0000 7f7e419bb640 1 --2- 172.21.15.1:0/3742798179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e3c1052b0 0x7f7e3c19ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:56:55.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.393+0000 7f7e421bc640 1 --2- 172.21.15.1:0/3742798179 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7e3c104880 0x7f7e3c19a5a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7e3800b450 tx=0x7f7e3800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:55.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.393+0000 7f7e337fe640 1 -- 172.21.15.1:0/3742798179 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e38015020 con 0x7f7e3c104880 2024-09-21T00:56:55.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.393+0000 7f7e337fe640 1 -- 172.21.15.1:0/3742798179 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e38011d40 con 0x7f7e3c104880 2024-09-21T00:56:55.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.393+0000 7f7e337fe640 1 -- 172.21.15.1:0/3742798179 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3800f340 con 0x7f7e3c104880 2024-09-21T00:56:55.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.393+0000 7f7e44420640 1 -- 172.21.15.1:0/3742798179 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e3c1a0740 con 0x7f7e3c104880 2024-09-21T00:56:55.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.394+0000 7f7e44420640 1 -- 172.21.15.1:0/3742798179 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e3c1a6f60 con 0x7f7e3c104880 2024-09-21T00:56:55.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.395+0000 7f7e44420640 1 -- 172.21.15.1:0/3742798179 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e3c104c90 con 0x7f7e3c104880 2024-09-21T00:56:55.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.397+0000 7f7e337fe640 1 -- 172.21.15.1:0/3742798179 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 154562+0+0 (secure 0 0 0) 0x7f7e38018020 con 0x7f7e3c104880 2024-09-21T00:56:55.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.398+0000 7f7e337fe640 1 --2- 172.21.15.1:0/3742798179 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f7e280b6650 0x7f7e280b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:55.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.398+0000 7f7e419bb640 1 --2- 172.21.15.1:0/3742798179 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f7e280b6650 0x7f7e280b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:55.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.398+0000 7f7e337fe640 1 -- 172.21.15.1:0/3742798179 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f7e380e7440 con 0x7f7e3c104880 2024-09-21T00:56:55.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.399+0000 7f7e419bb640 1 --2- 172.21.15.1:0/3742798179 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f7e280b6650 0x7f7e280b8b60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c000c00 tx=0x7f7e2c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:55.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.401+0000 7f7e337fe640 1 -- 172.21.15.1:0/3742798179 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7e3801f020 con 0x7f7e3c104880 2024-09-21T00:56:55.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.631+0000 7f7e44420640 1 -- 172.21.15.1:0/3742798179 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e3c108fc0 con 0x7f7e3c104880 2024-09-21T00:56:55.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.632+0000 7f7e337fe640 1 -- 172.21.15.1:0/3742798179 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11955 (secure 0 0 0) 0x7f7e3800d040 con 0x7f7e3c104880 2024-09-21T00:56:55.633 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:56:55.633 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":27,"btime":"2024-09-21T00:56:52:855037+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2810186677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2810186677},{"type":"v1","addr":"172.21.15.1:6835","nonce":2810186677}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14736,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3935320478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3935320478},{"type":"v1","addr":"172.21.15.1:6837","nonce":3935320478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:54:58.592853+0000","modified":"2024-09-21T00:56:52.784125+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24653,"mds_1":24637,"mds_2":24626,"mds_3":24622,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/2125703572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2125703572},{"type":"v1","addr":"172.21.15.1:6839","nonce":2125703572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/3860445313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860445313},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860445313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6833/712170939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":712170939},{"type":"v1","addr":"172.21.15.193:6833","nonce":712170939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6833/1653911656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1653911656},{"type":"v1","addr":"172.21.15.42:6833","nonce":1653911656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6835/793085918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":793085918},{"type":"v1","addr":"172.21.15.42:6835","nonce":793085918}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6835/3631682268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":3631682268},{"type":"v1","addr":"172.21.15.193:6835","nonce":3631682268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.193:6837/909252228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":909252228},{"type":"v1","addr":"172.21.15.193:6837","nonce":909252228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.42:6837/2395608508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2395608508},{"type":"v1","addr":"172.21.15.42:6837","nonce":2395608508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.193:6839/1365361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1365361177},{"type":"v1","addr":"172.21.15.193:6839","nonce":1365361177}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6839/2526476666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2526476666},{"type":"v1","addr":"172.21.15.42:6839","nonce":2526476666}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24610,24622,24626,24637,24653]},"id":1}]} 2024-09-21T00:56:55.633 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 27 2024-09-21T00:56:55.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.634+0000 7f7e44420640 1 -- 172.21.15.1:0/3742798179 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f7e280b6650 msgr2=0x7f7e280b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:55.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.634+0000 7f7e44420640 1 --2- 172.21.15.1:0/3742798179 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f7e280b6650 0x7f7e280b8b60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c000c00 tx=0x7f7e2c031400 comp rx=0 tx=0).stop 2024-09-21T00:56:55.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.634+0000 7f7e44420640 1 -- 172.21.15.1:0/3742798179 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7e3c104880 msgr2=0x7f7e3c19a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:55.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.634+0000 7f7e44420640 1 --2- 172.21.15.1:0/3742798179 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7e3c104880 0x7f7e3c19a5a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7e3800b450 tx=0x7f7e3800b910 comp rx=0 tx=0).stop 2024-09-21T00:56:55.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.634+0000 7f7e44420640 1 -- 172.21.15.1:0/3742798179 shutdown_connections 2024-09-21T00:56:55.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.634+0000 7f7e44420640 1 --2- 172.21.15.1:0/3742798179 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e3c10de30 0x7f7e3c19fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:55.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.634+0000 7f7e44420640 1 --2- 172.21.15.1:0/3742798179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e3c1052b0 0x7f7e3c19ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:55.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.634+0000 7f7e44420640 1 --2- 172.21.15.1:0/3742798179 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f7e280b6650 0x7f7e280b8b60 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:55.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.634+0000 7f7e44420640 1 --2- 172.21.15.1:0/3742798179 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7e3c104880 0x7f7e3c19a5a0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:55.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.634+0000 7f7e44420640 1 -- 172.21.15.1:0/3742798179 >> 172.21.15.1:0/3742798179 conn(0x7f7e3c079730 msgr2=0x7f7e3c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:55.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.634+0000 7f7e44420640 1 -- 172.21.15.1:0/3742798179 shutdown_connections 2024-09-21T00:56:55.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:55.635+0000 7f7e44420640 1 -- 172.21.15.1:0/3742798179 wait complete. 2024-09-21T00:56:55.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:55 smithi001 ceph-mon[31211]: pgmap v349: 97 pgs: 97 active+clean; 652 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-21T00:56:55.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:55 smithi001 ceph-mon[31211]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-21T00:56:55.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:55 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/3742798179' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:56.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:55 smithi193 ceph-mon[34660]: pgmap v349: 97 pgs: 97 active+clean; 652 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-21T00:56:56.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:55 smithi193 ceph-mon[34660]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-21T00:56:56.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:55 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/3742798179' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:56.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:55 smithi042 ceph-mon[34481]: pgmap v349: 97 pgs: 97 active+clean; 652 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-21T00:56:56.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:55 smithi042 ceph-mon[34481]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-21T00:56:56.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:55 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/3742798179' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:56.379 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-21T00:56:56.379 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-21T00:56:56.380 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T00:56:56.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.502+0000 7fc1f3f4a640 1 -- 172.21.15.1:0/4074912996 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1ec103640 msgr2=0x7fc1ec103a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:56.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.502+0000 7fc1f3f4a640 1 --2- 172.21.15.1:0/4074912996 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1ec103640 0x7fc1ec103a50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc009900 tx=0x7fc1dc02a410 comp rx=0 tx=0).stop 2024-09-21T00:56:56.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.503+0000 7fc1f3f4a640 1 -- 172.21.15.1:0/4074912996 shutdown_connections 2024-09-21T00:56:56.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.503+0000 7fc1f3f4a640 1 --2- 172.21.15.1:0/4074912996 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1ec103fe0 0x7fc1ec10a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:56.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.503+0000 7fc1f3f4a640 1 --2- 172.21.15.1:0/4074912996 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1ec103640 0x7fc1ec103a50 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:56.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.503+0000 7fc1f3f4a640 1 --2- 172.21.15.1:0/4074912996 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1ec1025c0 0x7fc1ec102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:56.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.503+0000 7fc1f3f4a640 1 -- 172.21.15.1:0/4074912996 >> 172.21.15.1:0/4074912996 conn(0x7fc1ec0fdf00 msgr2=0x7fc1ec1003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:56.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.503+0000 7fc1f3f4a640 1 -- 172.21.15.1:0/4074912996 shutdown_connections 2024-09-21T00:56:56.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.503+0000 7fc1f3f4a640 1 -- 172.21.15.1:0/4074912996 wait complete. 2024-09-21T00:56:56.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.503+0000 7fc1f3f4a640 1 Processor -- start 2024-09-21T00:56:56.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.504+0000 7fc1f3f4a640 1 -- start start 2024-09-21T00:56:56.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.504+0000 7fc1f3f4a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1ec1025c0 0x7fc1ec198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:56.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.504+0000 7fc1f3f4a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1ec103640 0x7fc1ec199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:56.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.504+0000 7fc1f3f4a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1ec103fe0 0x7fc1ec19a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:56.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.504+0000 7fc1f3f4a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ec10e1f0 con 0x7fc1ec103640 2024-09-21T00:56:56.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.504+0000 7fc1f3f4a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ec10e070 con 0x7fc1ec103fe0 2024-09-21T00:56:56.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.504+0000 7fc1f3f4a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ec10e370 con 0x7fc1ec1025c0 2024-09-21T00:56:56.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.504+0000 7fc1f14e5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1ec103640 0x7fc1ec199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:56.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.504+0000 7fc1f14e5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1ec103640 0x7fc1ec199480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39978/0 (socket says 172.21.15.1:39978) 2024-09-21T00:56:56.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.504+0000 7fc1f14e5640 1 -- 172.21.15.1:0/508710661 learned_addr learned my addr 172.21.15.1:0/508710661 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:56.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.504+0000 7fc1f1ce6640 1 --2- 172.21.15.1:0/508710661 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1ec1025c0 0x7fc1ec198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:56.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.504+0000 7fc1f24e7640 1 --2- 172.21.15.1:0/508710661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1ec103fe0 0x7fc1ec19a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:56.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.504+0000 7fc1f14e5640 1 -- 172.21.15.1:0/508710661 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1ec1025c0 msgr2=0x7fc1ec198e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:56.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.504+0000 7fc1f14e5640 1 --2- 172.21.15.1:0/508710661 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1ec1025c0 0x7fc1ec198e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:56.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.504+0000 7fc1f14e5640 1 -- 172.21.15.1:0/508710661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1ec103fe0 msgr2=0x7fc1ec19a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:56.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.504+0000 7fc1f14e5640 1 --2- 172.21.15.1:0/508710661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1ec103fe0 0x7fc1ec19a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:56.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.504+0000 7fc1f14e5640 1 -- 172.21.15.1:0/508710661 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1ec19a850 con 0x7fc1ec103640 2024-09-21T00:56:56.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.505+0000 7fc1f14e5640 1 --2- 172.21.15.1:0/508710661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1ec103640 0x7fc1ec199480 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc006010 tx=0x7fc1dc004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:56.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.505+0000 7fc1e2ffd640 1 -- 172.21.15.1:0/508710661 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc046070 con 0x7fc1ec103640 2024-09-21T00:56:56.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.505+0000 7fc1e2ffd640 1 -- 172.21.15.1:0/508710661 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1dc0044b0 con 0x7fc1ec103640 2024-09-21T00:56:56.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.505+0000 7fc1e2ffd640 1 -- 172.21.15.1:0/508710661 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc035050 con 0x7fc1ec103640 2024-09-21T00:56:56.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.505+0000 7fc1f3f4a640 1 -- 172.21.15.1:0/508710661 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1ec19aae0 con 0x7fc1ec103640 2024-09-21T00:56:56.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.505+0000 7fc1f3f4a640 1 -- 172.21.15.1:0/508710661 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1ec19adf0 con 0x7fc1ec103640 2024-09-21T00:56:56.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.506+0000 7fc1f3f4a640 1 -- 172.21.15.1:0/508710661 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1ec06b2c0 con 0x7fc1ec103640 2024-09-21T00:56:56.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.507+0000 7fc1e2ffd640 1 -- 172.21.15.1:0/508710661 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 154562+0+0 (secure 0 0 0) 0x7fc1dc049070 con 0x7fc1ec103640 2024-09-21T00:56:56.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.508+0000 7fc1e2ffd640 1 --2- 172.21.15.1:0/508710661 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc1d80b65a0 0x7fc1d80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:56.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.508+0000 7fc1e2ffd640 1 -- 172.21.15.1:0/508710661 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fc1dc109560 con 0x7fc1ec103640 2024-09-21T00:56:56.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.508+0000 7fc1f1ce6640 1 --2- 172.21.15.1:0/508710661 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc1d80b65a0 0x7fc1d80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:56.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.509+0000 7fc1f1ce6640 1 --2- 172.21.15.1:0/508710661 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc1d80b65a0 0x7fc1d80b8ab0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc1e80058c0 tx=0x7fc1e800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:56.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.511+0000 7fc1e2ffd640 1 -- 172.21.15.1:0/508710661 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc1dc050080 con 0x7fc1ec103640 2024-09-21T00:56:56.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.700+0000 7fc1f3f4a640 1 -- 172.21.15.1:0/508710661 --> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc1ec109250 con 0x7fc1d80b65a0 2024-09-21T00:56:56.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.704+0000 7fc1e2ffd640 1 -- 172.21.15.1:0/508710661 <== mgr.14150 v2:172.21.15.1:6800/2032980330 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259179 (secure 0 0 0) 0x7fc1ec109250 con 0x7fc1d80b65a0 2024-09-21T00:56:56.708 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:56:56.709 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-21T00:56:56.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.708+0000 7fc1f3f4a640 1 -- 172.21.15.1:0/508710661 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc1d80b65a0 msgr2=0x7fc1d80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:56.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.708+0000 7fc1f3f4a640 1 --2- 172.21.15.1:0/508710661 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc1d80b65a0 0x7fc1d80b8ab0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc1e80058c0 tx=0x7fc1e800a2d0 comp rx=0 tx=0).stop 2024-09-21T00:56:56.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.708+0000 7fc1f3f4a640 1 -- 172.21.15.1:0/508710661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1ec103640 msgr2=0x7fc1ec199480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:56.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.708+0000 7fc1f3f4a640 1 --2- 172.21.15.1:0/508710661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1ec103640 0x7fc1ec199480 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc006010 tx=0x7fc1dc004340 comp rx=0 tx=0).stop 2024-09-21T00:56:56.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.708+0000 7fc1f3f4a640 1 -- 172.21.15.1:0/508710661 shutdown_connections 2024-09-21T00:56:56.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.708+0000 7fc1f3f4a640 1 --2- 172.21.15.1:0/508710661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1ec103fe0 0x7fc1ec19a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:56.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.708+0000 7fc1f3f4a640 1 --2- 172.21.15.1:0/508710661 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc1d80b65a0 0x7fc1d80b8ab0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:56.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.708+0000 7fc1f3f4a640 1 --2- 172.21.15.1:0/508710661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1ec103640 0x7fc1ec199480 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:56.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.708+0000 7fc1f3f4a640 1 --2- 172.21.15.1:0/508710661 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1ec1025c0 0x7fc1ec198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:56.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.708+0000 7fc1f3f4a640 1 -- 172.21.15.1:0/508710661 >> 172.21.15.1:0/508710661 conn(0x7fc1ec0fdf00 msgr2=0x7fc1ec106940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:56.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.708+0000 7fc1f3f4a640 1 -- 172.21.15.1:0/508710661 shutdown_connections 2024-09-21T00:56:56.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.708+0000 7fc1f3f4a640 1 -- 172.21.15.1:0/508710661 wait complete. 2024-09-21T00:56:56.720 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":350,"stamp":"2024-09-21T00:56:56.113518+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":668219,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1152,"num_read_kb":670,"num_write":383,"num_write_kb":2309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":3011044,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":816,"ondisk_log_size":816,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":380192,"kb_used_data":10144,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124561632,"statfs":{"total":1151940427776,"available":1151551111168,"internally_reserved":0,"allocated":10387456,"data_stored":6729979,"data_compressed":190923,"data_compressed_allocated":253952,"data_compressed_original":2039808,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6533,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":57,"num_write":8,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002999"},"pg_stats":[{"pgid":"3.3f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.471768+0000","last_change":"2024-09-21T00:54:57.879464+0000","last_active":"2024-09-21T00:56:26.471768+0000","last_peered":"2024-09-21T00:56:26.471768+0000","last_clean":"2024-09-21T00:56:26.471768+0000","last_became_active":"2024-09-21T00:54:57.878480+0000","last_became_peered":"2024-09-21T00:54:57.878480+0000","last_unstale":"2024-09-21T00:56:26.471768+0000","last_undegraded":"2024-09-21T00:56:26.471768+0000","last_fullsized":"2024-09-21T00:56:26.471768+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:28.056410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.471466+0000","last_change":"2024-09-21T00:54:57.866876+0000","last_active":"2024-09-21T00:56:26.471466+0000","last_peered":"2024-09-21T00:56:26.471466+0000","last_clean":"2024-09-21T00:56:26.471466+0000","last_became_active":"2024-09-21T00:54:57.866532+0000","last_became_peered":"2024-09-21T00:54:57.866532+0000","last_unstale":"2024-09-21T00:56:26.471466+0000","last_undegraded":"2024-09-21T00:56:26.471466+0000","last_fullsized":"2024-09-21T00:56:26.471466+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:15:58.881955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.491312+0000","last_change":"2024-09-21T00:54:57.874814+0000","last_active":"2024-09-21T00:56:26.491312+0000","last_peered":"2024-09-21T00:56:26.491312+0000","last_clean":"2024-09-21T00:56:26.491312+0000","last_became_active":"2024-09-21T00:54:57.873918+0000","last_became_peered":"2024-09-21T00:54:57.873918+0000","last_unstale":"2024-09-21T00:56:26.491312+0000","last_undegraded":"2024-09-21T00:56:26.491312+0000","last_fullsized":"2024-09-21T00:56:26.491312+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:14.677826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.475142+0000","last_change":"2024-09-21T00:54:57.877268+0000","last_active":"2024-09-21T00:56:26.475142+0000","last_peered":"2024-09-21T00:56:26.475142+0000","last_clean":"2024-09-21T00:56:26.475142+0000","last_became_active":"2024-09-21T00:54:57.876769+0000","last_became_peered":"2024-09-21T00:54:57.876769+0000","last_unstale":"2024-09-21T00:56:26.475142+0000","last_undegraded":"2024-09-21T00:56:26.475142+0000","last_fullsized":"2024-09-21T00:56:26.475142+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:27:02.534562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.470265+0000","last_change":"2024-09-21T00:54:57.872956+0000","last_active":"2024-09-21T00:56:26.470265+0000","last_peered":"2024-09-21T00:56:26.470265+0000","last_clean":"2024-09-21T00:56:26.470265+0000","last_became_active":"2024-09-21T00:54:57.872563+0000","last_became_peered":"2024-09-21T00:54:57.872563+0000","last_unstale":"2024-09-21T00:56:26.470265+0000","last_undegraded":"2024-09-21T00:56:26.470265+0000","last_fullsized":"2024-09-21T00:56:26.470265+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:47.776888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.492213+0000","last_change":"2024-09-21T00:54:57.870285+0000","last_active":"2024-09-21T00:56:26.492213+0000","last_peered":"2024-09-21T00:56:26.492213+0000","last_clean":"2024-09-21T00:56:26.492213+0000","last_became_active":"2024-09-21T00:54:57.869689+0000","last_became_peered":"2024-09-21T00:54:57.869689+0000","last_unstale":"2024-09-21T00:56:26.492213+0000","last_undegraded":"2024-09-21T00:56:26.492213+0000","last_fullsized":"2024-09-21T00:56:26.492213+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:54.304589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.485352+0000","last_change":"2024-09-21T00:54:57.868515+0000","last_active":"2024-09-21T00:56:26.485352+0000","last_peered":"2024-09-21T00:56:26.485352+0000","last_clean":"2024-09-21T00:56:26.485352+0000","last_became_active":"2024-09-21T00:54:57.868130+0000","last_became_peered":"2024-09-21T00:54:57.868130+0000","last_unstale":"2024-09-21T00:56:26.485352+0000","last_undegraded":"2024-09-21T00:56:26.485352+0000","last_fullsized":"2024-09-21T00:56:26.485352+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:45.482119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.465611+0000","last_change":"2024-09-21T00:54:57.869386+0000","last_active":"2024-09-21T00:56:26.465611+0000","last_peered":"2024-09-21T00:56:26.465611+0000","last_clean":"2024-09-21T00:56:26.465611+0000","last_became_active":"2024-09-21T00:54:57.869033+0000","last_became_peered":"2024-09-21T00:54:57.869033+0000","last_unstale":"2024-09-21T00:56:26.465611+0000","last_undegraded":"2024-09-21T00:56:26.465611+0000","last_fullsized":"2024-09-21T00:56:26.465611+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:39:01.305815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.478706+0000","last_change":"2024-09-21T00:54:57.870703+0000","last_active":"2024-09-21T00:56:26.478706+0000","last_peered":"2024-09-21T00:56:26.478706+0000","last_clean":"2024-09-21T00:56:26.478706+0000","last_became_active":"2024-09-21T00:54:57.870324+0000","last_became_peered":"2024-09-21T00:54:57.870324+0000","last_unstale":"2024-09-21T00:56:26.478706+0000","last_undegraded":"2024-09-21T00:56:26.478706+0000","last_fullsized":"2024-09-21T00:56:26.478706+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:50.548296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"75'16","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.492991+0000","last_change":"2024-09-21T00:54:57.869803+0000","last_active":"2024-09-21T00:56:26.492991+0000","last_peered":"2024-09-21T00:56:26.492991+0000","last_clean":"2024-09-21T00:56:26.492991+0000","last_became_active":"2024-09-21T00:54:57.869092+0000","last_became_peered":"2024-09-21T00:54:57.869092+0000","last_unstale":"2024-09-21T00:56:26.492991+0000","last_undegraded":"2024-09-21T00:56:26.492991+0000","last_fullsized":"2024-09-21T00:56:26.492991+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:05:27.727914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.490169+0000","last_change":"2024-09-21T00:54:57.873700+0000","last_active":"2024-09-21T00:56:26.490169+0000","last_peered":"2024-09-21T00:56:26.490169+0000","last_clean":"2024-09-21T00:56:26.490169+0000","last_became_active":"2024-09-21T00:54:57.873336+0000","last_became_peered":"2024-09-21T00:54:57.873336+0000","last_unstale":"2024-09-21T00:56:26.490169+0000","last_undegraded":"2024-09-21T00:56:26.490169+0000","last_fullsized":"2024-09-21T00:56:26.490169+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:28:17.520669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.477610+0000","last_change":"2024-09-21T00:54:57.877686+0000","last_active":"2024-09-21T00:56:26.477610+0000","last_peered":"2024-09-21T00:56:26.477610+0000","last_clean":"2024-09-21T00:56:26.477610+0000","last_became_active":"2024-09-21T00:54:57.876711+0000","last_became_peered":"2024-09-21T00:54:57.876711+0000","last_unstale":"2024-09-21T00:56:26.477610+0000","last_undegraded":"2024-09-21T00:56:26.477610+0000","last_fullsized":"2024-09-21T00:56:26.477610+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:20:11.254680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.478190+0000","last_change":"2024-09-21T00:54:57.880660+0000","last_active":"2024-09-21T00:56:26.478190+0000","last_peered":"2024-09-21T00:56:26.478190+0000","last_clean":"2024-09-21T00:56:26.478190+0000","last_became_active":"2024-09-21T00:54:57.880270+0000","last_became_peered":"2024-09-21T00:54:57.880270+0000","last_unstale":"2024-09-21T00:56:26.478190+0000","last_undegraded":"2024-09-21T00:56:26.478190+0000","last_fullsized":"2024-09-21T00:56:26.478190+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:50:16.260484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.480243+0000","last_change":"2024-09-21T00:54:57.869626+0000","last_active":"2024-09-21T00:56:26.480243+0000","last_peered":"2024-09-21T00:56:26.480243+0000","last_clean":"2024-09-21T00:56:26.480243+0000","last_became_active":"2024-09-21T00:54:57.869230+0000","last_became_peered":"2024-09-21T00:54:57.869230+0000","last_unstale":"2024-09-21T00:56:26.480243+0000","last_undegraded":"2024-09-21T00:56:26.480243+0000","last_fullsized":"2024-09-21T00:56:26.480243+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:49.131237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.480008+0000","last_change":"2024-09-21T00:54:57.874917+0000","last_active":"2024-09-21T00:56:26.480008+0000","last_peered":"2024-09-21T00:56:26.480008+0000","last_clean":"2024-09-21T00:56:26.480008+0000","last_became_active":"2024-09-21T00:54:57.873787+0000","last_became_peered":"2024-09-21T00:54:57.873787+0000","last_unstale":"2024-09-21T00:56:26.480008+0000","last_undegraded":"2024-09-21T00:56:26.480008+0000","last_fullsized":"2024-09-21T00:56:26.480008+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:44.226734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.488049+0000","last_change":"2024-09-21T00:54:57.877479+0000","last_active":"2024-09-21T00:56:26.488049+0000","last_peered":"2024-09-21T00:56:26.488049+0000","last_clean":"2024-09-21T00:56:26.488049+0000","last_became_active":"2024-09-21T00:54:57.877110+0000","last_became_peered":"2024-09-21T00:54:57.877110+0000","last_unstale":"2024-09-21T00:56:26.488049+0000","last_undegraded":"2024-09-21T00:56:26.488049+0000","last_fullsized":"2024-09-21T00:56:26.488049+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:18.547970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.472045+0000","last_change":"2024-09-21T00:54:57.878701+0000","last_active":"2024-09-21T00:56:26.472045+0000","last_peered":"2024-09-21T00:56:26.472045+0000","last_clean":"2024-09-21T00:56:26.472045+0000","last_became_active":"2024-09-21T00:54:57.878254+0000","last_became_peered":"2024-09-21T00:54:57.878254+0000","last_unstale":"2024-09-21T00:56:26.472045+0000","last_undegraded":"2024-09-21T00:56:26.472045+0000","last_fullsized":"2024-09-21T00:56:26.472045+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:51.309956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.488891+0000","last_change":"2024-09-21T00:54:57.869571+0000","last_active":"2024-09-21T00:56:26.488891+0000","last_peered":"2024-09-21T00:56:26.488891+0000","last_clean":"2024-09-21T00:56:26.488891+0000","last_became_active":"2024-09-21T00:54:57.868907+0000","last_became_peered":"2024-09-21T00:54:57.868907+0000","last_unstale":"2024-09-21T00:56:26.488891+0000","last_undegraded":"2024-09-21T00:56:26.488891+0000","last_fullsized":"2024-09-21T00:56:26.488891+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:14.951885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.478711+0000","last_change":"2024-09-21T00:54:57.869277+0000","last_active":"2024-09-21T00:56:26.478711+0000","last_peered":"2024-09-21T00:56:26.478711+0000","last_clean":"2024-09-21T00:56:26.478711+0000","last_became_active":"2024-09-21T00:54:57.868777+0000","last_became_peered":"2024-09-21T00:54:57.868777+0000","last_unstale":"2024-09-21T00:56:26.478711+0000","last_undegraded":"2024-09-21T00:56:26.478711+0000","last_fullsized":"2024-09-21T00:56:26.478711+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:09:04.766266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"75'8","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.466568+0000","last_change":"2024-09-21T00:55:27.641451+0000","last_active":"2024-09-21T00:56:26.466568+0000","last_peered":"2024-09-21T00:56:26.466568+0000","last_clean":"2024-09-21T00:56:26.466568+0000","last_became_active":"2024-09-21T00:55:27.640253+0000","last_became_peered":"2024-09-21T00:55:27.640253+0000","last_unstale":"2024-09-21T00:56:26.466568+0000","last_undegraded":"2024-09-21T00:56:26.466568+0000","last_fullsized":"2024-09-21T00:56:26.466568+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:34.064803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.488328+0000","last_change":"2024-09-21T00:54:57.871236+0000","last_active":"2024-09-21T00:56:26.488328+0000","last_peered":"2024-09-21T00:56:26.488328+0000","last_clean":"2024-09-21T00:56:26.488328+0000","last_became_active":"2024-09-21T00:54:57.870131+0000","last_became_peered":"2024-09-21T00:54:57.870131+0000","last_unstale":"2024-09-21T00:56:26.488328+0000","last_undegraded":"2024-09-21T00:56:26.488328+0000","last_fullsized":"2024-09-21T00:56:26.488328+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:45.067436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.487776+0000","last_change":"2024-09-21T00:54:57.878710+0000","last_active":"2024-09-21T00:56:26.487776+0000","last_peered":"2024-09-21T00:56:26.487776+0000","last_clean":"2024-09-21T00:56:26.487776+0000","last_became_active":"2024-09-21T00:54:57.878352+0000","last_became_peered":"2024-09-21T00:54:57.878352+0000","last_unstale":"2024-09-21T00:56:26.487776+0000","last_undegraded":"2024-09-21T00:56:26.487776+0000","last_fullsized":"2024-09-21T00:56:26.487776+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:32:40.561028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.477959+0000","last_change":"2024-09-21T00:54:57.873226+0000","last_active":"2024-09-21T00:56:26.477959+0000","last_peered":"2024-09-21T00:56:26.477959+0000","last_clean":"2024-09-21T00:56:26.477959+0000","last_became_active":"2024-09-21T00:54:57.872840+0000","last_became_peered":"2024-09-21T00:54:57.872840+0000","last_unstale":"2024-09-21T00:56:26.477959+0000","last_undegraded":"2024-09-21T00:56:26.477959+0000","last_fullsized":"2024-09-21T00:56:26.477959+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:41.259070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"75'6","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.475280+0000","last_change":"2024-09-21T00:55:28.430095+0000","last_active":"2024-09-21T00:56:26.475280+0000","last_peered":"2024-09-21T00:56:26.475280+0000","last_clean":"2024-09-21T00:56:26.475280+0000","last_became_active":"2024-09-21T00:55:28.429650+0000","last_became_peered":"2024-09-21T00:55:28.429650+0000","last_unstale":"2024-09-21T00:56:26.475280+0000","last_undegraded":"2024-09-21T00:56:26.475280+0000","last_fullsized":"2024-09-21T00:56:26.475280+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:18:14.994333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,3],"acting":[6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"75'2","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.468932+0000","last_change":"2024-09-21T00:55:27.961107+0000","last_active":"2024-09-21T00:56:26.468932+0000","last_peered":"2024-09-21T00:56:26.468932+0000","last_clean":"2024-09-21T00:56:26.468932+0000","last_became_active":"2024-09-21T00:55:27.960673+0000","last_became_peered":"2024-09-21T00:55:27.960673+0000","last_unstale":"2024-09-21T00:56:26.468932+0000","last_undegraded":"2024-09-21T00:56:26.468932+0000","last_fullsized":"2024-09-21T00:56:26.468932+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:30.418190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.26","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.477365+0000","last_change":"2024-09-21T00:54:57.870994+0000","last_active":"2024-09-21T00:56:26.477365+0000","last_peered":"2024-09-21T00:56:26.477365+0000","last_clean":"2024-09-21T00:56:26.477365+0000","last_became_active":"2024-09-21T00:54:57.867939+0000","last_became_peered":"2024-09-21T00:54:57.867939+0000","last_unstale":"2024-09-21T00:56:26.477365+0000","last_undegraded":"2024-09-21T00:56:26.477365+0000","last_fullsized":"2024-09-21T00:56:26.477365+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:44.858289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.466876+0000","last_change":"2024-09-21T00:54:57.870568+0000","last_active":"2024-09-21T00:56:26.466876+0000","last_peered":"2024-09-21T00:56:26.466876+0000","last_clean":"2024-09-21T00:56:26.466876+0000","last_became_active":"2024-09-21T00:54:57.870208+0000","last_became_peered":"2024-09-21T00:54:57.870208+0000","last_unstale":"2024-09-21T00:56:26.466876+0000","last_undegraded":"2024-09-21T00:56:26.466876+0000","last_fullsized":"2024-09-21T00:56:26.466876+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:28:09.824385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.481877+0000","last_change":"2024-09-21T00:54:57.870228+0000","last_active":"2024-09-21T00:56:26.481877+0000","last_peered":"2024-09-21T00:56:26.481877+0000","last_clean":"2024-09-21T00:56:26.481877+0000","last_became_active":"2024-09-21T00:54:57.869866+0000","last_became_peered":"2024-09-21T00:54:57.869866+0000","last_unstale":"2024-09-21T00:56:26.481877+0000","last_undegraded":"2024-09-21T00:56:26.481877+0000","last_fullsized":"2024-09-21T00:56:26.481877+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:20.073393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.480806+0000","last_change":"2024-09-21T00:54:57.867602+0000","last_active":"2024-09-21T00:56:26.480806+0000","last_peered":"2024-09-21T00:56:26.480806+0000","last_clean":"2024-09-21T00:56:26.480806+0000","last_became_active":"2024-09-21T00:54:57.867104+0000","last_became_peered":"2024-09-21T00:54:57.867104+0000","last_unstale":"2024-09-21T00:56:26.480806+0000","last_undegraded":"2024-09-21T00:56:26.480806+0000","last_fullsized":"2024-09-21T00:56:26.480806+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:29:37.403384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.480052+0000","last_change":"2024-09-21T00:54:57.869400+0000","last_active":"2024-09-21T00:56:26.480052+0000","last_peered":"2024-09-21T00:56:26.480052+0000","last_clean":"2024-09-21T00:56:26.480052+0000","last_became_active":"2024-09-21T00:54:57.868997+0000","last_became_peered":"2024-09-21T00:54:57.868997+0000","last_unstale":"2024-09-21T00:56:26.480052+0000","last_undegraded":"2024-09-21T00:56:26.480052+0000","last_fullsized":"2024-09-21T00:56:26.480052+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:00.117559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"75'12","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.481462+0000","last_change":"2024-09-21T00:54:57.867392+0000","last_active":"2024-09-21T00:56:26.481462+0000","last_peered":"2024-09-21T00:56:26.481462+0000","last_clean":"2024-09-21T00:56:26.481462+0000","last_became_active":"2024-09-21T00:54:57.867001+0000","last_became_peered":"2024-09-21T00:54:57.867001+0000","last_unstale":"2024-09-21T00:56:26.481462+0000","last_undegraded":"2024-09-21T00:56:26.481462+0000","last_fullsized":"2024-09-21T00:56:26.481462+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:05.090149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.473865+0000","last_change":"2024-09-21T00:54:57.867620+0000","last_active":"2024-09-21T00:56:26.473865+0000","last_peered":"2024-09-21T00:56:26.473865+0000","last_clean":"2024-09-21T00:56:26.473865+0000","last_became_active":"2024-09-21T00:54:57.867190+0000","last_became_peered":"2024-09-21T00:54:57.867190+0000","last_unstale":"2024-09-21T00:56:26.473865+0000","last_undegraded":"2024-09-21T00:56:26.473865+0000","last_fullsized":"2024-09-21T00:56:26.473865+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:36.432368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.476445+0000","last_change":"2024-09-21T00:54:57.880526+0000","last_active":"2024-09-21T00:56:26.476445+0000","last_peered":"2024-09-21T00:56:26.476445+0000","last_clean":"2024-09-21T00:56:26.476445+0000","last_became_active":"2024-09-21T00:54:57.880154+0000","last_became_peered":"2024-09-21T00:54:57.880154+0000","last_unstale":"2024-09-21T00:56:26.476445+0000","last_undegraded":"2024-09-21T00:56:26.476445+0000","last_fullsized":"2024-09-21T00:56:26.476445+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:56.179127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'5","reported_seq":133,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:50.739529+0000","last_change":"2024-09-21T00:54:55.867717+0000","last_active":"2024-09-21T00:56:50.739529+0000","last_peered":"2024-09-21T00:56:50.739529+0000","last_clean":"2024-09-21T00:56:50.739529+0000","last_became_active":"2024-09-21T00:54:55.867306+0000","last_became_peered":"2024-09-21T00:54:55.867306+0000","last_unstale":"2024-09-21T00:56:50.739529+0000","last_undegraded":"2024-09-21T00:56:50.739529+0000","last_fullsized":"2024-09-21T00:56:50.739529+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:25.192109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.476378+0000","last_change":"2024-09-21T00:54:57.879034+0000","last_active":"2024-09-21T00:56:26.476378+0000","last_peered":"2024-09-21T00:56:26.476378+0000","last_clean":"2024-09-21T00:56:26.476378+0000","last_became_active":"2024-09-21T00:54:57.878673+0000","last_became_peered":"2024-09-21T00:54:57.878673+0000","last_unstale":"2024-09-21T00:56:26.476378+0000","last_undegraded":"2024-09-21T00:56:26.476378+0000","last_fullsized":"2024-09-21T00:56:26.476378+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:39:12.467465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'7","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.633751+0000","last_change":"2024-09-21T00:54:55.867451+0000","last_active":"2024-09-21T00:55:27.633751+0000","last_peered":"2024-09-21T00:55:27.633751+0000","last_clean":"2024-09-21T00:55:27.633751+0000","last_became_active":"2024-09-21T00:54:55.866998+0000","last_became_peered":"2024-09-21T00:54:55.866998+0000","last_unstale":"2024-09-21T00:55:27.633751+0000","last_undegraded":"2024-09-21T00:55:27.633751+0000","last_fullsized":"2024-09-21T00:55:27.633751+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:40.878647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.634072+0000","last_change":"2024-09-21T00:54:55.853055+0000","last_active":"2024-09-21T00:55:27.634072+0000","last_peered":"2024-09-21T00:55:27.634072+0000","last_clean":"2024-09-21T00:55:27.634072+0000","last_became_active":"2024-09-21T00:54:55.852672+0000","last_became_peered":"2024-09-21T00:54:55.852672+0000","last_unstale":"2024-09-21T00:55:27.634072+0000","last_undegraded":"2024-09-21T00:55:27.634072+0000","last_fullsized":"2024-09-21T00:55:27.634072+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:17.082588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.469740+0000","last_change":"2024-09-21T00:54:57.875024+0000","last_active":"2024-09-21T00:56:26.469740+0000","last_peered":"2024-09-21T00:56:26.469740+0000","last_clean":"2024-09-21T00:56:26.469740+0000","last_became_active":"2024-09-21T00:54:57.870027+0000","last_became_peered":"2024-09-21T00:54:57.870027+0000","last_unstale":"2024-09-21T00:56:26.469740+0000","last_undegraded":"2024-09-21T00:56:26.469740+0000","last_fullsized":"2024-09-21T00:56:26.469740+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:37:48.880686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.650846+0000","last_change":"2024-09-21T00:54:55.864527+0000","last_active":"2024-09-21T00:55:27.650846+0000","last_peered":"2024-09-21T00:55:27.650846+0000","last_clean":"2024-09-21T00:55:27.650846+0000","last_became_active":"2024-09-21T00:54:55.864191+0000","last_became_peered":"2024-09-21T00:54:55.864191+0000","last_unstale":"2024-09-21T00:55:27.650846+0000","last_undegraded":"2024-09-21T00:55:27.650846+0000","last_fullsized":"2024-09-21T00:55:27.650846+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:43.781116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.470933+0000","last_change":"2024-09-21T00:54:57.865671+0000","last_active":"2024-09-21T00:56:26.470933+0000","last_peered":"2024-09-21T00:56:26.470933+0000","last_clean":"2024-09-21T00:56:26.470933+0000","last_became_active":"2024-09-21T00:54:57.865196+0000","last_became_peered":"2024-09-21T00:54:57.865196+0000","last_unstale":"2024-09-21T00:56:26.470933+0000","last_undegraded":"2024-09-21T00:56:26.470933+0000","last_fullsized":"2024-09-21T00:56:26.470933+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:16.524866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'6","reported_seq":237,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:52.741999+0000","last_change":"2024-09-21T00:54:55.862504+0000","last_active":"2024-09-21T00:56:52.741999+0000","last_peered":"2024-09-21T00:56:52.741999+0000","last_clean":"2024-09-21T00:56:52.741999+0000","last_became_active":"2024-09-21T00:54:55.862065+0000","last_became_peered":"2024-09-21T00:54:55.862065+0000","last_unstale":"2024-09-21T00:56:52.741999+0000","last_undegraded":"2024-09-21T00:56:52.741999+0000","last_fullsized":"2024-09-21T00:56:52.741999+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:16.497313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":208,"num_read_kb":208,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.491483+0000","last_change":"2024-09-21T00:54:57.873444+0000","last_active":"2024-09-21T00:56:26.491483+0000","last_peered":"2024-09-21T00:56:26.491483+0000","last_clean":"2024-09-21T00:56:26.491483+0000","last_became_active":"2024-09-21T00:54:57.873058+0000","last_became_peered":"2024-09-21T00:54:57.873058+0000","last_unstale":"2024-09-21T00:56:26.491483+0000","last_undegraded":"2024-09-21T00:56:26.491483+0000","last_fullsized":"2024-09-21T00:56:26.491483+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:36:40.603285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'4","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.967374+0000","last_change":"2024-09-21T00:55:27.967238+0000","last_active":"2024-09-21T00:55:27.967374+0000","last_peered":"2024-09-21T00:55:27.967374+0000","last_clean":"2024-09-21T00:55:27.967374+0000","last_became_active":"2024-09-21T00:55:27.962082+0000","last_became_peered":"2024-09-21T00:55:27.962082+0000","last_unstale":"2024-09-21T00:55:27.967374+0000","last_undegraded":"2024-09-21T00:55:27.967374+0000","last_fullsized":"2024-09-21T00:55:27.967374+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:02.943108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"75'9","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.480891+0000","last_change":"2024-09-21T00:55:27.652838+0000","last_active":"2024-09-21T00:56:26.480891+0000","last_peered":"2024-09-21T00:56:26.480891+0000","last_clean":"2024-09-21T00:56:26.480891+0000","last_became_active":"2024-09-21T00:55:27.652401+0000","last_became_peered":"2024-09-21T00:55:27.652401+0000","last_unstale":"2024-09-21T00:56:26.480891+0000","last_undegraded":"2024-09-21T00:56:26.480891+0000","last_fullsized":"2024-09-21T00:56:26.480891+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:53:33.968079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.651540+0000","last_change":"2024-09-21T00:54:55.968782+0000","last_active":"2024-09-21T00:55:27.651540+0000","last_peered":"2024-09-21T00:55:27.651540+0000","last_clean":"2024-09-21T00:55:27.651540+0000","last_became_active":"2024-09-21T00:54:55.968421+0000","last_became_peered":"2024-09-21T00:54:55.968421+0000","last_unstale":"2024-09-21T00:55:27.651540+0000","last_undegraded":"2024-09-21T00:55:27.651540+0000","last_fullsized":"2024-09-21T00:55:27.651540+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:28.680764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.490303+0000","last_change":"2024-09-21T00:54:57.877610+0000","last_active":"2024-09-21T00:56:26.490303+0000","last_peered":"2024-09-21T00:56:26.490303+0000","last_clean":"2024-09-21T00:56:26.490303+0000","last_became_active":"2024-09-21T00:54:57.877225+0000","last_became_peered":"2024-09-21T00:54:57.877225+0000","last_unstale":"2024-09-21T00:56:26.490303+0000","last_undegraded":"2024-09-21T00:56:26.490303+0000","last_fullsized":"2024-09-21T00:56:26.490303+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:08.294366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'35","reported_seq":296,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:53.128142+0000","last_change":"2024-09-21T00:55:27.975731+0000","last_active":"2024-09-21T00:56:53.128142+0000","last_peered":"2024-09-21T00:56:53.128142+0000","last_clean":"2024-09-21T00:56:53.128142+0000","last_became_active":"2024-09-21T00:55:27.961766+0000","last_became_peered":"2024-09-21T00:55:27.961766+0000","last_unstale":"2024-09-21T00:56:53.128142+0000","last_undegraded":"2024-09-21T00:56:53.128142+0000","last_fullsized":"2024-09-21T00:56:53.128142+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:42:32.442882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69740,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":208,"num_read_kb":158,"num_write":37,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":59092,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.471618+0000","last_change":"2024-09-21T00:54:57.875575+0000","last_active":"2024-09-21T00:56:26.471618+0000","last_peered":"2024-09-21T00:56:26.471618+0000","last_clean":"2024-09-21T00:56:26.471618+0000","last_became_active":"2024-09-21T00:54:57.874975+0000","last_became_peered":"2024-09-21T00:54:57.874975+0000","last_unstale":"2024-09-21T00:56:26.471618+0000","last_undegraded":"2024-09-21T00:56:26.471618+0000","last_fullsized":"2024-09-21T00:56:26.471618+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:34:36.089068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'9","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637272+0000","last_change":"2024-09-21T00:54:55.863532+0000","last_active":"2024-09-21T00:55:27.637272+0000","last_peered":"2024-09-21T00:55:27.637272+0000","last_clean":"2024-09-21T00:55:27.637272+0000","last_became_active":"2024-09-21T00:54:55.863124+0000","last_became_peered":"2024-09-21T00:54:55.863124+0000","last_unstale":"2024-09-21T00:55:27.637272+0000","last_undegraded":"2024-09-21T00:55:27.637272+0000","last_fullsized":"2024-09-21T00:55:27.637272+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:41:07.996906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.485241+0000","last_change":"2024-09-21T00:54:57.866126+0000","last_active":"2024-09-21T00:56:26.485241+0000","last_peered":"2024-09-21T00:56:26.485241+0000","last_clean":"2024-09-21T00:56:26.485241+0000","last_became_active":"2024-09-21T00:54:57.865775+0000","last_became_peered":"2024-09-21T00:54:57.865775+0000","last_unstale":"2024-09-21T00:56:26.485241+0000","last_undegraded":"2024-09-21T00:56:26.485241+0000","last_fullsized":"2024-09-21T00:56:26.485241+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:28.261632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.651370+0000","last_change":"2024-09-21T00:54:55.864593+0000","last_active":"2024-09-21T00:55:27.651370+0000","last_peered":"2024-09-21T00:55:27.651370+0000","last_clean":"2024-09-21T00:55:27.651370+0000","last_became_active":"2024-09-21T00:54:55.864202+0000","last_became_peered":"2024-09-21T00:54:55.864202+0000","last_unstale":"2024-09-21T00:55:27.651370+0000","last_undegraded":"2024-09-21T00:55:27.651370+0000","last_fullsized":"2024-09-21T00:55:27.651370+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:06.976588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.486026+0000","last_change":"2024-09-21T00:54:57.877892+0000","last_active":"2024-09-21T00:56:26.486026+0000","last_peered":"2024-09-21T00:56:26.486026+0000","last_clean":"2024-09-21T00:56:26.486026+0000","last_became_active":"2024-09-21T00:54:57.877510+0000","last_became_peered":"2024-09-21T00:54:57.877510+0000","last_unstale":"2024-09-21T00:56:26.486026+0000","last_undegraded":"2024-09-21T00:56:26.486026+0000","last_fullsized":"2024-09-21T00:56:26.486026+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:05.238100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'7","reported_seq":138,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:51.741113+0000","last_change":"2024-09-21T00:54:55.856707+0000","last_active":"2024-09-21T00:56:51.741113+0000","last_peered":"2024-09-21T00:56:51.741113+0000","last_clean":"2024-09-21T00:56:51.741113+0000","last_became_active":"2024-09-21T00:54:55.856095+0000","last_became_peered":"2024-09-21T00:54:55.856095+0000","last_unstale":"2024-09-21T00:56:51.741113+0000","last_undegraded":"2024-09-21T00:56:51.741113+0000","last_fullsized":"2024-09-21T00:56:51.741113+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:48.332764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.492677+0000","last_change":"2024-09-21T00:54:57.868398+0000","last_active":"2024-09-21T00:56:26.492677+0000","last_peered":"2024-09-21T00:56:26.492677+0000","last_clean":"2024-09-21T00:56:26.492677+0000","last_became_active":"2024-09-21T00:54:57.867963+0000","last_became_peered":"2024-09-21T00:54:57.867963+0000","last_unstale":"2024-09-21T00:56:26.492677+0000","last_undegraded":"2024-09-21T00:56:26.492677+0000","last_fullsized":"2024-09-21T00:56:26.492677+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:59:31.527713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'17","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.659007+0000","last_change":"2024-09-21T00:55:27.658543+0000","last_active":"2024-09-21T00:55:27.659007+0000","last_peered":"2024-09-21T00:55:27.659007+0000","last_clean":"2024-09-21T00:55:27.659007+0000","last_became_active":"2024-09-21T00:55:27.639915+0000","last_became_peered":"2024-09-21T00:55:27.639915+0000","last_unstale":"2024-09-21T00:55:27.659007+0000","last_undegraded":"2024-09-21T00:55:27.659007+0000","last_fullsized":"2024-09-21T00:55:27.659007+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:51.736732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.469871+0000","last_change":"2024-09-21T00:54:57.872256+0000","last_active":"2024-09-21T00:56:26.469871+0000","last_peered":"2024-09-21T00:56:26.469871+0000","last_clean":"2024-09-21T00:56:26.469871+0000","last_became_active":"2024-09-21T00:54:57.871848+0000","last_became_peered":"2024-09-21T00:54:57.871848+0000","last_unstale":"2024-09-21T00:56:26.469871+0000","last_undegraded":"2024-09-21T00:56:26.469871+0000","last_fullsized":"2024-09-21T00:56:26.469871+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:24:11.314693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636721+0000","last_change":"2024-09-21T00:54:55.870096+0000","last_active":"2024-09-21T00:55:27.636721+0000","last_peered":"2024-09-21T00:55:27.636721+0000","last_clean":"2024-09-21T00:55:27.636721+0000","last_became_active":"2024-09-21T00:54:55.869616+0000","last_became_peered":"2024-09-21T00:54:55.869616+0000","last_unstale":"2024-09-21T00:55:27.636721+0000","last_undegraded":"2024-09-21T00:55:27.636721+0000","last_fullsized":"2024-09-21T00:55:27.636721+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:53:48.036499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"75'5","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.465530+0000","last_change":"2024-09-21T00:55:27.652960+0000","last_active":"2024-09-21T00:56:26.465530+0000","last_peered":"2024-09-21T00:56:26.465530+0000","last_clean":"2024-09-21T00:56:26.465530+0000","last_became_active":"2024-09-21T00:55:27.652420+0000","last_became_peered":"2024-09-21T00:55:27.652420+0000","last_unstale":"2024-09-21T00:56:26.465530+0000","last_undegraded":"2024-09-21T00:56:26.465530+0000","last_fullsized":"2024-09-21T00:56:26.465530+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:24.436368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'5","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.634222+0000","last_change":"2024-09-21T00:54:55.866393+0000","last_active":"2024-09-21T00:55:27.634222+0000","last_peered":"2024-09-21T00:55:27.634222+0000","last_clean":"2024-09-21T00:55:27.634222+0000","last_became_active":"2024-09-21T00:54:55.865980+0000","last_became_peered":"2024-09-21T00:54:55.865980+0000","last_unstale":"2024-09-21T00:55:27.634222+0000","last_undegraded":"2024-09-21T00:55:27.634222+0000","last_fullsized":"2024-09-21T00:55:27.634222+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:56.471011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.480433+0000","last_change":"2024-09-21T00:54:57.875177+0000","last_active":"2024-09-21T00:56:26.480433+0000","last_peered":"2024-09-21T00:56:26.480433+0000","last_clean":"2024-09-21T00:56:26.480433+0000","last_became_active":"2024-09-21T00:54:57.874819+0000","last_became_peered":"2024-09-21T00:54:57.874819+0000","last_unstale":"2024-09-21T00:56:26.480433+0000","last_undegraded":"2024-09-21T00:56:26.480433+0000","last_fullsized":"2024-09-21T00:56:26.480433+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:43.942703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.651656+0000","last_change":"2024-09-21T00:54:55.864668+0000","last_active":"2024-09-21T00:55:27.651656+0000","last_peered":"2024-09-21T00:55:27.651656+0000","last_clean":"2024-09-21T00:55:27.651656+0000","last_became_active":"2024-09-21T00:54:55.864330+0000","last_became_peered":"2024-09-21T00:54:55.864330+0000","last_unstale":"2024-09-21T00:55:27.651656+0000","last_undegraded":"2024-09-21T00:55:27.651656+0000","last_fullsized":"2024-09-21T00:55:27.651656+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:45:50.751390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.485352+0000","last_change":"2024-09-21T00:54:57.871093+0000","last_active":"2024-09-21T00:56:26.485352+0000","last_peered":"2024-09-21T00:56:26.485352+0000","last_clean":"2024-09-21T00:56:26.485352+0000","last_became_active":"2024-09-21T00:54:57.870457+0000","last_became_peered":"2024-09-21T00:54:57.870457+0000","last_unstale":"2024-09-21T00:56:26.485352+0000","last_undegraded":"2024-09-21T00:56:26.485352+0000","last_fullsized":"2024-09-21T00:56:26.485352+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:19.810575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'8","reported_seq":142,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:53.744561+0000","last_change":"2024-09-21T00:54:55.968156+0000","last_active":"2024-09-21T00:56:53.744561+0000","last_peered":"2024-09-21T00:56:53.744561+0000","last_clean":"2024-09-21T00:56:53.744561+0000","last_became_active":"2024-09-21T00:54:55.967668+0000","last_became_peered":"2024-09-21T00:54:55.967668+0000","last_unstale":"2024-09-21T00:56:53.744561+0000","last_undegraded":"2024-09-21T00:56:53.744561+0000","last_fullsized":"2024-09-21T00:56:53.744561+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:28.854249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2093,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.491789+0000","last_change":"2024-09-21T00:54:57.868187+0000","last_active":"2024-09-21T00:56:26.491789+0000","last_peered":"2024-09-21T00:56:26.491789+0000","last_clean":"2024-09-21T00:56:26.491789+0000","last_became_active":"2024-09-21T00:54:57.867709+0000","last_became_peered":"2024-09-21T00:54:57.867709+0000","last_unstale":"2024-09-21T00:56:26.491789+0000","last_undegraded":"2024-09-21T00:56:26.491789+0000","last_fullsized":"2024-09-21T00:56:26.491789+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:40.123030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":97,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636523+0000","last_change":"2024-09-21T00:53:44.515787+0000","last_active":"2024-09-21T00:55:27.636523+0000","last_peered":"2024-09-21T00:55:27.636523+0000","last_clean":"2024-09-21T00:55:27.636523+0000","last_became_active":"2024-09-21T00:53:44.510106+0000","last_became_peered":"2024-09-21T00:53:44.510106+0000","last_unstale":"2024-09-21T00:55:27.636523+0000","last_undegraded":"2024-09-21T00:55:27.636523+0000","last_fullsized":"2024-09-21T00:55:27.636523+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:50:16.598790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:50:16.598790+0000","last_clean_scrub_stamp":"2024-09-21T00:50:16.598790+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:04:14.481212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'6","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.958651+0000","last_change":"2024-09-21T00:54:55.854929+0000","last_active":"2024-09-21T00:55:27.958651+0000","last_peered":"2024-09-21T00:55:27.958651+0000","last_clean":"2024-09-21T00:55:27.958651+0000","last_became_active":"2024-09-21T00:54:55.854489+0000","last_became_peered":"2024-09-21T00:54:55.854489+0000","last_unstale":"2024-09-21T00:55:27.958651+0000","last_undegraded":"2024-09-21T00:55:27.958651+0000","last_fullsized":"2024-09-21T00:55:27.958651+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:03.067142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"75'8","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.488103+0000","last_change":"2024-09-21T00:55:27.652679+0000","last_active":"2024-09-21T00:56:26.488103+0000","last_peered":"2024-09-21T00:56:26.488103+0000","last_clean":"2024-09-21T00:56:26.488103+0000","last_became_active":"2024-09-21T00:55:27.652348+0000","last_became_peered":"2024-09-21T00:55:27.652348+0000","last_unstale":"2024-09-21T00:56:26.488103+0000","last_undegraded":"2024-09-21T00:56:26.488103+0000","last_fullsized":"2024-09-21T00:56:26.488103+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:11.974613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636440+0000","last_change":"2024-09-21T00:54:55.863265+0000","last_active":"2024-09-21T00:55:27.636440+0000","last_peered":"2024-09-21T00:55:27.636440+0000","last_clean":"2024-09-21T00:55:27.636440+0000","last_became_active":"2024-09-21T00:54:55.862613+0000","last_became_peered":"2024-09-21T00:54:55.862613+0000","last_unstale":"2024-09-21T00:55:27.636440+0000","last_undegraded":"2024-09-21T00:55:27.636440+0000","last_fullsized":"2024-09-21T00:55:27.636440+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:56.707143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.481311+0000","last_change":"2024-09-21T00:54:57.855249+0000","last_active":"2024-09-21T00:56:26.481311+0000","last_peered":"2024-09-21T00:56:26.481311+0000","last_clean":"2024-09-21T00:56:26.481311+0000","last_became_active":"2024-09-21T00:54:57.854879+0000","last_became_peered":"2024-09-21T00:54:57.854879+0000","last_unstale":"2024-09-21T00:56:26.481311+0000","last_undegraded":"2024-09-21T00:56:26.481311+0000","last_fullsized":"2024-09-21T00:56:26.481311+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:15.733514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'6","reported_seq":136,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:53.743453+0000","last_change":"2024-09-21T00:54:55.968078+0000","last_active":"2024-09-21T00:56:53.743453+0000","last_peered":"2024-09-21T00:56:53.743453+0000","last_clean":"2024-09-21T00:56:53.743453+0000","last_became_active":"2024-09-21T00:54:55.967700+0000","last_became_peered":"2024-09-21T00:54:55.967700+0000","last_unstale":"2024-09-21T00:56:53.743453+0000","last_undegraded":"2024-09-21T00:56:53.743453+0000","last_fullsized":"2024-09-21T00:56:53.743453+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:35.121889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":107,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.472754+0000","last_change":"2024-09-21T00:54:57.873224+0000","last_active":"2024-09-21T00:56:26.472754+0000","last_peered":"2024-09-21T00:56:26.472754+0000","last_clean":"2024-09-21T00:56:26.472754+0000","last_became_active":"2024-09-21T00:54:57.872828+0000","last_became_peered":"2024-09-21T00:54:57.872828+0000","last_unstale":"2024-09-21T00:56:26.472754+0000","last_undegraded":"2024-09-21T00:56:26.472754+0000","last_fullsized":"2024-09-21T00:56:26.472754+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:58:55.758620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'5","reported_seq":136,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:54.744660+0000","last_change":"2024-09-21T00:54:55.859887+0000","last_active":"2024-09-21T00:56:54.744660+0000","last_peered":"2024-09-21T00:56:54.744660+0000","last_clean":"2024-09-21T00:56:54.744660+0000","last_became_active":"2024-09-21T00:54:55.859351+0000","last_became_peered":"2024-09-21T00:54:55.859351+0000","last_unstale":"2024-09-21T00:56:54.744660+0000","last_undegraded":"2024-09-21T00:56:54.744660+0000","last_fullsized":"2024-09-21T00:56:54.744660+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:31.407409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.491962+0000","last_change":"2024-09-21T00:54:57.882568+0000","last_active":"2024-09-21T00:56:26.491962+0000","last_peered":"2024-09-21T00:56:26.491962+0000","last_clean":"2024-09-21T00:56:26.491962+0000","last_became_active":"2024-09-21T00:54:57.882190+0000","last_became_peered":"2024-09-21T00:54:57.882190+0000","last_unstale":"2024-09-21T00:56:26.491962+0000","last_undegraded":"2024-09-21T00:56:26.491962+0000","last_fullsized":"2024-09-21T00:56:26.491962+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:19.339490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.632817+0000","last_change":"2024-09-21T00:54:55.970154+0000","last_active":"2024-09-21T00:55:27.632817+0000","last_peered":"2024-09-21T00:55:27.632817+0000","last_clean":"2024-09-21T00:55:27.632817+0000","last_became_active":"2024-09-21T00:54:55.969774+0000","last_became_peered":"2024-09-21T00:54:55.969774+0000","last_unstale":"2024-09-21T00:55:27.632817+0000","last_undegraded":"2024-09-21T00:55:27.632817+0000","last_fullsized":"2024-09-21T00:55:27.632817+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:05.241455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.491963+0000","last_change":"2024-09-21T00:54:57.873452+0000","last_active":"2024-09-21T00:56:26.491963+0000","last_peered":"2024-09-21T00:56:26.491963+0000","last_clean":"2024-09-21T00:56:26.491963+0000","last_became_active":"2024-09-21T00:54:57.872592+0000","last_became_peered":"2024-09-21T00:54:57.872592+0000","last_unstale":"2024-09-21T00:56:26.491963+0000","last_undegraded":"2024-09-21T00:56:26.491963+0000","last_fullsized":"2024-09-21T00:56:26.491963+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:25.196491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637464+0000","last_change":"2024-09-21T00:54:55.968563+0000","last_active":"2024-09-21T00:55:27.637464+0000","last_peered":"2024-09-21T00:55:27.637464+0000","last_clean":"2024-09-21T00:55:27.637464+0000","last_became_active":"2024-09-21T00:54:55.968176+0000","last_became_peered":"2024-09-21T00:54:55.968176+0000","last_unstale":"2024-09-21T00:55:27.637464+0000","last_undegraded":"2024-09-21T00:55:27.637464+0000","last_fullsized":"2024-09-21T00:55:27.637464+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:35.120595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.482137+0000","last_change":"2024-09-21T00:54:57.862128+0000","last_active":"2024-09-21T00:56:26.482137+0000","last_peered":"2024-09-21T00:56:26.482137+0000","last_clean":"2024-09-21T00:56:26.482137+0000","last_became_active":"2024-09-21T00:54:57.861692+0000","last_became_peered":"2024-09-21T00:54:57.861692+0000","last_unstale":"2024-09-21T00:56:26.482137+0000","last_undegraded":"2024-09-21T00:56:26.482137+0000","last_fullsized":"2024-09-21T00:56:26.482137+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:58:29.364344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'16","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.632906+0000","last_change":"2024-09-21T00:54:55.866240+0000","last_active":"2024-09-21T00:55:27.632906+0000","last_peered":"2024-09-21T00:55:27.632906+0000","last_clean":"2024-09-21T00:55:27.632906+0000","last_became_active":"2024-09-21T00:54:55.865192+0000","last_became_peered":"2024-09-21T00:54:55.865192+0000","last_unstale":"2024-09-21T00:55:27.632906+0000","last_undegraded":"2024-09-21T00:55:27.632906+0000","last_fullsized":"2024-09-21T00:55:27.632906+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:53:17.599528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.487825+0000","last_change":"2024-09-21T00:54:57.878847+0000","last_active":"2024-09-21T00:56:26.487825+0000","last_peered":"2024-09-21T00:56:26.487825+0000","last_clean":"2024-09-21T00:56:26.487825+0000","last_became_active":"2024-09-21T00:54:57.878117+0000","last_became_peered":"2024-09-21T00:54:57.878117+0000","last_unstale":"2024-09-21T00:56:26.487825+0000","last_undegraded":"2024-09-21T00:56:26.487825+0000","last_fullsized":"2024-09-21T00:56:26.487825+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:46.090963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'7","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.958730+0000","last_change":"2024-09-21T00:54:55.854035+0000","last_active":"2024-09-21T00:55:27.958730+0000","last_peered":"2024-09-21T00:55:27.958730+0000","last_clean":"2024-09-21T00:55:27.958730+0000","last_became_active":"2024-09-21T00:54:55.853301+0000","last_became_peered":"2024-09-21T00:54:55.853301+0000","last_unstale":"2024-09-21T00:55:27.958730+0000","last_undegraded":"2024-09-21T00:55:27.958730+0000","last_fullsized":"2024-09-21T00:55:27.958730+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:11.498865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.480267+0000","last_change":"2024-09-21T00:54:57.875093+0000","last_active":"2024-09-21T00:56:26.480267+0000","last_peered":"2024-09-21T00:56:26.480267+0000","last_clean":"2024-09-21T00:56:26.480267+0000","last_became_active":"2024-09-21T00:54:57.873996+0000","last_became_peered":"2024-09-21T00:54:57.873996+0000","last_unstale":"2024-09-21T00:56:26.480267+0000","last_undegraded":"2024-09-21T00:56:26.480267+0000","last_fullsized":"2024-09-21T00:56:26.480267+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:17:55.990167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637124+0000","last_change":"2024-09-21T00:54:55.968507+0000","last_active":"2024-09-21T00:55:27.637124+0000","last_peered":"2024-09-21T00:55:27.637124+0000","last_clean":"2024-09-21T00:55:27.637124+0000","last_became_active":"2024-09-21T00:54:55.968084+0000","last_became_peered":"2024-09-21T00:54:55.968084+0000","last_unstale":"2024-09-21T00:55:27.637124+0000","last_undegraded":"2024-09-21T00:55:27.637124+0000","last_fullsized":"2024-09-21T00:55:27.637124+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:34:06.325264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.433503+0000","last_change":"2024-09-21T00:54:57.870500+0000","last_active":"2024-09-21T00:56:26.433503+0000","last_peered":"2024-09-21T00:56:26.433503+0000","last_clean":"2024-09-21T00:56:26.433503+0000","last_became_active":"2024-09-21T00:54:57.870103+0000","last_became_peered":"2024-09-21T00:54:57.870103+0000","last_unstale":"2024-09-21T00:56:26.433503+0000","last_undegraded":"2024-09-21T00:56:26.433503+0000","last_fullsized":"2024-09-21T00:56:26.433503+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:31:03.469863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'7","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:28.428026+0000","last_change":"2024-09-21T00:54:55.856185+0000","last_active":"2024-09-21T00:55:28.428026+0000","last_peered":"2024-09-21T00:55:28.428026+0000","last_clean":"2024-09-21T00:55:28.428026+0000","last_became_active":"2024-09-21T00:54:55.855738+0000","last_became_peered":"2024-09-21T00:54:55.855738+0000","last_unstale":"2024-09-21T00:55:28.428026+0000","last_undegraded":"2024-09-21T00:55:28.428026+0000","last_fullsized":"2024-09-21T00:55:28.428026+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:02.870874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.472850+0000","last_change":"2024-09-21T00:54:57.877828+0000","last_active":"2024-09-21T00:56:26.472850+0000","last_peered":"2024-09-21T00:56:26.472850+0000","last_clean":"2024-09-21T00:56:26.472850+0000","last_became_active":"2024-09-21T00:54:57.877414+0000","last_became_peered":"2024-09-21T00:54:57.877414+0000","last_unstale":"2024-09-21T00:56:26.472850+0000","last_undegraded":"2024-09-21T00:56:26.472850+0000","last_fullsized":"2024-09-21T00:56:26.472850+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:27.485830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636953+0000","last_change":"2024-09-21T00:54:55.868014+0000","last_active":"2024-09-21T00:55:27.636953+0000","last_peered":"2024-09-21T00:55:27.636953+0000","last_clean":"2024-09-21T00:55:27.636953+0000","last_became_active":"2024-09-21T00:54:55.867640+0000","last_became_peered":"2024-09-21T00:54:55.867640+0000","last_unstale":"2024-09-21T00:55:27.636953+0000","last_undegraded":"2024-09-21T00:55:27.636953+0000","last_fullsized":"2024-09-21T00:55:27.636953+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:24:57.118238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.470306+0000","last_change":"2024-09-21T00:54:57.881935+0000","last_active":"2024-09-21T00:56:26.470306+0000","last_peered":"2024-09-21T00:56:26.470306+0000","last_clean":"2024-09-21T00:56:26.470306+0000","last_became_active":"2024-09-21T00:54:57.881598+0000","last_became_peered":"2024-09-21T00:54:57.881598+0000","last_unstale":"2024-09-21T00:56:26.470306+0000","last_undegraded":"2024-09-21T00:56:26.470306+0000","last_fullsized":"2024-09-21T00:56:26.470306+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:44:19.893961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.645759+0000","last_change":"2024-09-21T00:55:27.645172+0000","last_active":"2024-09-21T00:55:27.645759+0000","last_peered":"2024-09-21T00:55:27.645759+0000","last_clean":"2024-09-21T00:55:27.645759+0000","last_became_active":"2024-09-21T00:55:27.639795+0000","last_became_peered":"2024-09-21T00:55:27.639795+0000","last_unstale":"2024-09-21T00:55:27.645759+0000","last_undegraded":"2024-09-21T00:55:27.645759+0000","last_fullsized":"2024-09-21T00:55:27.645759+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:20:50.639608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.491583+0000","last_change":"2024-09-21T00:54:57.867972+0000","last_active":"2024-09-21T00:56:26.491583+0000","last_peered":"2024-09-21T00:56:26.491583+0000","last_clean":"2024-09-21T00:56:26.491583+0000","last_became_active":"2024-09-21T00:54:57.867586+0000","last_became_peered":"2024-09-21T00:54:57.867586+0000","last_unstale":"2024-09-21T00:56:26.491583+0000","last_undegraded":"2024-09-21T00:56:26.491583+0000","last_fullsized":"2024-09-21T00:56:26.491583+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:27.066795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.484037+0000","last_change":"2024-09-21T00:54:57.881014+0000","last_active":"2024-09-21T00:56:26.484037+0000","last_peered":"2024-09-21T00:56:26.484037+0000","last_clean":"2024-09-21T00:56:26.484037+0000","last_became_active":"2024-09-21T00:54:57.880608+0000","last_became_peered":"2024-09-21T00:54:57.880608+0000","last_unstale":"2024-09-21T00:56:26.484037+0000","last_undegraded":"2024-09-21T00:56:26.484037+0000","last_fullsized":"2024-09-21T00:56:26.484037+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:48:31.848315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.638999+0000","last_change":"2024-09-21T00:54:55.865031+0000","last_active":"2024-09-21T00:55:27.638999+0000","last_peered":"2024-09-21T00:55:27.638999+0000","last_clean":"2024-09-21T00:55:27.638999+0000","last_became_active":"2024-09-21T00:54:55.864576+0000","last_became_peered":"2024-09-21T00:54:55.864576+0000","last_unstale":"2024-09-21T00:55:27.638999+0000","last_undegraded":"2024-09-21T00:55:27.638999+0000","last_fullsized":"2024-09-21T00:55:27.638999+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:13.125491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.492158+0000","last_change":"2024-09-21T00:54:57.875878+0000","last_active":"2024-09-21T00:56:26.492158+0000","last_peered":"2024-09-21T00:56:26.492158+0000","last_clean":"2024-09-21T00:56:26.492158+0000","last_became_active":"2024-09-21T00:54:57.874177+0000","last_became_peered":"2024-09-21T00:54:57.874177+0000","last_unstale":"2024-09-21T00:56:26.492158+0000","last_undegraded":"2024-09-21T00:56:26.492158+0000","last_fullsized":"2024-09-21T00:56:26.492158+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:25.333036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'12","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637565+0000","last_change":"2024-09-21T00:54:55.868698+0000","last_active":"2024-09-21T00:55:27.637565+0000","last_peered":"2024-09-21T00:55:27.637565+0000","last_clean":"2024-09-21T00:55:27.637565+0000","last_became_active":"2024-09-21T00:54:55.868282+0000","last_became_peered":"2024-09-21T00:54:55.868282+0000","last_unstale":"2024-09-21T00:55:27.637565+0000","last_undegraded":"2024-09-21T00:55:27.637565+0000","last_fullsized":"2024-09-21T00:55:27.637565+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:50.253638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.491449+0000","last_change":"2024-09-21T00:54:57.867726+0000","last_active":"2024-09-21T00:56:26.491449+0000","last_peered":"2024-09-21T00:56:26.491449+0000","last_clean":"2024-09-21T00:56:26.491449+0000","last_became_active":"2024-09-21T00:54:57.866090+0000","last_became_peered":"2024-09-21T00:54:57.866090+0000","last_unstale":"2024-09-21T00:56:26.491449+0000","last_undegraded":"2024-09-21T00:56:26.491449+0000","last_fullsized":"2024-09-21T00:56:26.491449+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:57.938078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:28.428068+0000","last_change":"2024-09-21T00:54:55.968155+0000","last_active":"2024-09-21T00:55:28.428068+0000","last_peered":"2024-09-21T00:55:28.428068+0000","last_clean":"2024-09-21T00:55:28.428068+0000","last_became_active":"2024-09-21T00:54:55.967718+0000","last_became_peered":"2024-09-21T00:54:55.967718+0000","last_unstale":"2024-09-21T00:55:28.428068+0000","last_undegraded":"2024-09-21T00:55:28.428068+0000","last_fullsized":"2024-09-21T00:55:28.428068+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:18.160380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.461696+0000","last_change":"2024-09-21T00:54:57.873102+0000","last_active":"2024-09-21T00:56:26.461696+0000","last_peered":"2024-09-21T00:56:26.461696+0000","last_clean":"2024-09-21T00:56:26.461696+0000","last_became_active":"2024-09-21T00:54:57.872323+0000","last_became_peered":"2024-09-21T00:54:57.872323+0000","last_unstale":"2024-09-21T00:56:26.461696+0000","last_undegraded":"2024-09-21T00:56:26.461696+0000","last_fullsized":"2024-09-21T00:56:26.461696+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:18.087601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'13","reported_seq":139,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.736712+0000","last_change":"2024-09-21T00:54:55.865559+0000","last_active":"2024-09-21T00:56:49.736712+0000","last_peered":"2024-09-21T00:56:49.736712+0000","last_clean":"2024-09-21T00:56:49.736712+0000","last_became_active":"2024-09-21T00:54:55.865157+0000","last_became_peered":"2024-09-21T00:54:55.865157+0000","last_unstale":"2024-09-21T00:56:49.736712+0000","last_undegraded":"2024-09-21T00:56:49.736712+0000","last_fullsized":"2024-09-21T00:56:49.736712+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:53.113970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":77617,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1076,"num_read_kb":606,"num_write":258,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":59204,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":536576,"data_stored":232851,"data_compressed":13542,"data_compressed_allocated":20480,"data_compressed_original":73728,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":283734,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808868,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717320,"statfs":{"total":95995035648,"available":95966535680,"internally_reserved":0,"allocated":827392,"data_stored":396490,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972394,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":1050922,"data_compressed":43733,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135918,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":843776,"data_stored":395385,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332148,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31996,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713156,"statfs":{"total":95995035648,"available":95962271744,"internally_reserved":0,"allocated":831488,"data_stored":395651,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528377,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":988422,"data_compressed":41838,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691902,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36152,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709000,"statfs":{"total":95995035648,"available":95958016000,"internally_reserved":0,"allocated":827392,"data_stored":395102,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888131,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":987568,"data_compressed":41838,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018953,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36184,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708968,"statfs":{"total":95995035648,"available":95957983232,"internally_reserved":0,"allocated":860160,"data_stored":465235,"data_compressed":15515,"data_compressed_allocated":20480,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215182,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":843776,"data_stored":394927,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411412,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36164,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708988,"statfs":{"total":95995035648,"available":95958003712,"internally_reserved":0,"allocated":839680,"data_stored":397158,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36216,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708936,"statfs":{"total":95995035648,"available":95957950464,"internally_reserved":0,"allocated":892928,"data_stored":465755,"data_compressed":7658,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36172,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708980,"statfs":{"total":95995035648,"available":95957995520,"internally_reserved":0,"allocated":847872,"data_stored":397364,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":71492,"data_compressed":1895,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":70972,"data_compressed":9752,"data_compressed_allocated":12288,"data_compressed_original":57344,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":72008,"data_compressed":1895,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:56:56.724 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T00:56:56.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.874+0000 7fb60d5ba640 1 -- 172.21.15.1:0/232513227 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6081050d0 msgr2=0x7fb60810ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:56.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.874+0000 7fb60d5ba640 1 --2- 172.21.15.1:0/232513227 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6081050d0 0x7fb60810ba70 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb600009ca0 tx=0x7fb60002a8c0 comp rx=0 tx=0).stop 2024-09-21T00:56:56.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.874+0000 7fb60d5ba640 1 -- 172.21.15.1:0/232513227 shutdown_connections 2024-09-21T00:56:56.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.874+0000 7fb60d5ba640 1 --2- 172.21.15.1:0/232513227 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6081050d0 0x7fb60810ba70 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:56.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.874+0000 7fb60d5ba640 1 --2- 172.21.15.1:0/232513227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb608104730 0x7fb608104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:56.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.874+0000 7fb60d5ba640 1 --2- 172.21.15.1:0/232513227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6081036b0 0x7fb608103b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:56.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.874+0000 7fb60d5ba640 1 -- 172.21.15.1:0/232513227 >> 172.21.15.1:0/232513227 conn(0x7fb6080feff0 msgr2=0x7fb6081014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:56.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.874+0000 7fb60d5ba640 1 -- 172.21.15.1:0/232513227 shutdown_connections 2024-09-21T00:56:56.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.874+0000 7fb60d5ba640 1 -- 172.21.15.1:0/232513227 wait complete. 2024-09-21T00:56:56.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.875+0000 7fb60d5ba640 1 Processor -- start 2024-09-21T00:56:56.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.875+0000 7fb60d5ba640 1 -- start start 2024-09-21T00:56:56.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.875+0000 7fb60d5ba640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6081036b0 0x7fb608076e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:56.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.875+0000 7fb60d5ba640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb608104730 0x7fb608075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:56.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.875+0000 7fb60d5ba640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6081050d0 0x7fb608075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:56.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.875+0000 7fb60d5ba640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb60810f350 con 0x7fb608104730 2024-09-21T00:56:56.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.875+0000 7fb60d5ba640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb60810f1d0 con 0x7fb6081036b0 2024-09-21T00:56:56.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.875+0000 7fb60d5ba640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb60810f4d0 con 0x7fb6081050d0 2024-09-21T00:56:56.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.875+0000 7fb6067fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb608104730 0x7fb608075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:56.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.875+0000 7fb6067fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb608104730 0x7fb608075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39994/0 (socket says 172.21.15.1:39994) 2024-09-21T00:56:56.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.875+0000 7fb6067fc640 1 -- 172.21.15.1:0/2246990691 learned_addr learned my addr 172.21.15.1:0/2246990691 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:56.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.875+0000 7fb606ffd640 1 --2- 172.21.15.1:0/2246990691 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6081036b0 0x7fb608076e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:56.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.875+0000 7fb6077fe640 1 --2- 172.21.15.1:0/2246990691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6081050d0 0x7fb608075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:56.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.876+0000 7fb6067fc640 1 -- 172.21.15.1:0/2246990691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6081050d0 msgr2=0x7fb608075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:56.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.876+0000 7fb6067fc640 1 --2- 172.21.15.1:0/2246990691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6081050d0 0x7fb608075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:56.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.876+0000 7fb6067fc640 1 -- 172.21.15.1:0/2246990691 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6081036b0 msgr2=0x7fb608076e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:56.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.876+0000 7fb6067fc640 1 --2- 172.21.15.1:0/2246990691 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6081036b0 0x7fb608076e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:56.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.876+0000 7fb6067fc640 1 -- 172.21.15.1:0/2246990691 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb608076380 con 0x7fb608104730 2024-09-21T00:56:56.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.876+0000 7fb6067fc640 1 --2- 172.21.15.1:0/2246990691 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb608104730 0x7fb608075710 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00e9f0 tx=0x7fb5fc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:56.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.876+0000 7fb5effff640 1 -- 172.21.15.1:0/2246990691 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc00cd80 con 0x7fb608104730 2024-09-21T00:56:56.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.876+0000 7fb5effff640 1 -- 172.21.15.1:0/2246990691 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5fc0108e0 con 0x7fb608104730 2024-09-21T00:56:56.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.876+0000 7fb60d5ba640 1 -- 172.21.15.1:0/2246990691 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6081a3f40 con 0x7fb608104730 2024-09-21T00:56:56.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.876+0000 7fb5effff640 1 -- 172.21.15.1:0/2246990691 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc018980 con 0x7fb608104730 2024-09-21T00:56:56.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.876+0000 7fb60d5ba640 1 -- 172.21.15.1:0/2246990691 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6081a4350 con 0x7fb608104730 2024-09-21T00:56:56.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.877+0000 7fb60d5ba640 1 -- 172.21.15.1:0/2246990691 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb60810a880 con 0x7fb608104730 2024-09-21T00:56:56.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.879+0000 7fb5effff640 1 -- 172.21.15.1:0/2246990691 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 154562+0+0 (secure 0 0 0) 0x7fb5fc010430 con 0x7fb608104730 2024-09-21T00:56:56.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.880+0000 7fb5effff640 1 --2- 172.21.15.1:0/2246990691 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb5f00b6620 0x7fb5f00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:56.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.880+0000 7fb606ffd640 1 --2- 172.21.15.1:0/2246990691 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb5f00b6620 0x7fb5f00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:56.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.880+0000 7fb5effff640 1 -- 172.21.15.1:0/2246990691 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fb5fc0e7c10 con 0x7fb608104730 2024-09-21T00:56:56.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.880+0000 7fb606ffd640 1 --2- 172.21.15.1:0/2246990691 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb5f00b6620 0x7fb5f00b8b30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8009bd0 tx=0x7fb5f8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:56.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:56.883+0000 7fb5effff640 1 -- 172.21.15.1:0/2246990691 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb5fc0b2700 con 0x7fb608104730 2024-09-21T00:56:57.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.070+0000 7fb60d5ba640 1 -- 172.21.15.1:0/2246990691 --> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb608063800 con 0x7fb5f00b6620 2024-09-21T00:56:57.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.075+0000 7fb5effff640 1 -- 172.21.15.1:0/2246990691 <== mgr.14150 v2:172.21.15.1:6800/2032980330 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259179 (secure 0 0 0) 0x7fb608063800 con 0x7fb5f00b6620 2024-09-21T00:56:57.078 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:56:57.079 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-21T00:56:57.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.078+0000 7fb60d5ba640 1 -- 172.21.15.1:0/2246990691 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb5f00b6620 msgr2=0x7fb5f00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:57.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.078+0000 7fb60d5ba640 1 --2- 172.21.15.1:0/2246990691 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb5f00b6620 0x7fb5f00b8b30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8009bd0 tx=0x7fb5f8005f90 comp rx=0 tx=0).stop 2024-09-21T00:56:57.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.078+0000 7fb60d5ba640 1 -- 172.21.15.1:0/2246990691 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb608104730 msgr2=0x7fb608075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:57.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.078+0000 7fb60d5ba640 1 --2- 172.21.15.1:0/2246990691 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb608104730 0x7fb608075710 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00e9f0 tx=0x7fb5fc00eeb0 comp rx=0 tx=0).stop 2024-09-21T00:56:57.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.078+0000 7fb60d5ba640 1 -- 172.21.15.1:0/2246990691 shutdown_connections 2024-09-21T00:56:57.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.078+0000 7fb60d5ba640 1 --2- 172.21.15.1:0/2246990691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6081050d0 0x7fb608075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:57.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.078+0000 7fb60d5ba640 1 --2- 172.21.15.1:0/2246990691 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb5f00b6620 0x7fb5f00b8b30 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:57.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.078+0000 7fb60d5ba640 1 --2- 172.21.15.1:0/2246990691 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb608104730 0x7fb608075710 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:57.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.078+0000 7fb60d5ba640 1 --2- 172.21.15.1:0/2246990691 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6081036b0 0x7fb608076e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:57.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.078+0000 7fb60d5ba640 1 -- 172.21.15.1:0/2246990691 >> 172.21.15.1:0/2246990691 conn(0x7fb6080feff0 msgr2=0x7fb608107a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:57.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.078+0000 7fb60d5ba640 1 -- 172.21.15.1:0/2246990691 shutdown_connections 2024-09-21T00:56:57.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.078+0000 7fb60d5ba640 1 -- 172.21.15.1:0/2246990691 wait complete. 2024-09-21T00:56:57.090 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":350,"stamp":"2024-09-21T00:56:56.113518+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":668219,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1152,"num_read_kb":670,"num_write":383,"num_write_kb":2309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":3011044,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":816,"ondisk_log_size":816,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":380192,"kb_used_data":10144,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124561632,"statfs":{"total":1151940427776,"available":1151551111168,"internally_reserved":0,"allocated":10387456,"data_stored":6729979,"data_compressed":190923,"data_compressed_allocated":253952,"data_compressed_original":2039808,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6533,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":57,"num_write":8,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002999"},"pg_stats":[{"pgid":"3.3f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.471768+0000","last_change":"2024-09-21T00:54:57.879464+0000","last_active":"2024-09-21T00:56:26.471768+0000","last_peered":"2024-09-21T00:56:26.471768+0000","last_clean":"2024-09-21T00:56:26.471768+0000","last_became_active":"2024-09-21T00:54:57.878480+0000","last_became_peered":"2024-09-21T00:54:57.878480+0000","last_unstale":"2024-09-21T00:56:26.471768+0000","last_undegraded":"2024-09-21T00:56:26.471768+0000","last_fullsized":"2024-09-21T00:56:26.471768+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:28.056410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.471466+0000","last_change":"2024-09-21T00:54:57.866876+0000","last_active":"2024-09-21T00:56:26.471466+0000","last_peered":"2024-09-21T00:56:26.471466+0000","last_clean":"2024-09-21T00:56:26.471466+0000","last_became_active":"2024-09-21T00:54:57.866532+0000","last_became_peered":"2024-09-21T00:54:57.866532+0000","last_unstale":"2024-09-21T00:56:26.471466+0000","last_undegraded":"2024-09-21T00:56:26.471466+0000","last_fullsized":"2024-09-21T00:56:26.471466+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:15:58.881955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.491312+0000","last_change":"2024-09-21T00:54:57.874814+0000","last_active":"2024-09-21T00:56:26.491312+0000","last_peered":"2024-09-21T00:56:26.491312+0000","last_clean":"2024-09-21T00:56:26.491312+0000","last_became_active":"2024-09-21T00:54:57.873918+0000","last_became_peered":"2024-09-21T00:54:57.873918+0000","last_unstale":"2024-09-21T00:56:26.491312+0000","last_undegraded":"2024-09-21T00:56:26.491312+0000","last_fullsized":"2024-09-21T00:56:26.491312+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:14.677826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.475142+0000","last_change":"2024-09-21T00:54:57.877268+0000","last_active":"2024-09-21T00:56:26.475142+0000","last_peered":"2024-09-21T00:56:26.475142+0000","last_clean":"2024-09-21T00:56:26.475142+0000","last_became_active":"2024-09-21T00:54:57.876769+0000","last_became_peered":"2024-09-21T00:54:57.876769+0000","last_unstale":"2024-09-21T00:56:26.475142+0000","last_undegraded":"2024-09-21T00:56:26.475142+0000","last_fullsized":"2024-09-21T00:56:26.475142+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:27:02.534562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.470265+0000","last_change":"2024-09-21T00:54:57.872956+0000","last_active":"2024-09-21T00:56:26.470265+0000","last_peered":"2024-09-21T00:56:26.470265+0000","last_clean":"2024-09-21T00:56:26.470265+0000","last_became_active":"2024-09-21T00:54:57.872563+0000","last_became_peered":"2024-09-21T00:54:57.872563+0000","last_unstale":"2024-09-21T00:56:26.470265+0000","last_undegraded":"2024-09-21T00:56:26.470265+0000","last_fullsized":"2024-09-21T00:56:26.470265+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:47.776888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.492213+0000","last_change":"2024-09-21T00:54:57.870285+0000","last_active":"2024-09-21T00:56:26.492213+0000","last_peered":"2024-09-21T00:56:26.492213+0000","last_clean":"2024-09-21T00:56:26.492213+0000","last_became_active":"2024-09-21T00:54:57.869689+0000","last_became_peered":"2024-09-21T00:54:57.869689+0000","last_unstale":"2024-09-21T00:56:26.492213+0000","last_undegraded":"2024-09-21T00:56:26.492213+0000","last_fullsized":"2024-09-21T00:56:26.492213+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:54.304589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.485352+0000","last_change":"2024-09-21T00:54:57.868515+0000","last_active":"2024-09-21T00:56:26.485352+0000","last_peered":"2024-09-21T00:56:26.485352+0000","last_clean":"2024-09-21T00:56:26.485352+0000","last_became_active":"2024-09-21T00:54:57.868130+0000","last_became_peered":"2024-09-21T00:54:57.868130+0000","last_unstale":"2024-09-21T00:56:26.485352+0000","last_undegraded":"2024-09-21T00:56:26.485352+0000","last_fullsized":"2024-09-21T00:56:26.485352+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:45.482119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.465611+0000","last_change":"2024-09-21T00:54:57.869386+0000","last_active":"2024-09-21T00:56:26.465611+0000","last_peered":"2024-09-21T00:56:26.465611+0000","last_clean":"2024-09-21T00:56:26.465611+0000","last_became_active":"2024-09-21T00:54:57.869033+0000","last_became_peered":"2024-09-21T00:54:57.869033+0000","last_unstale":"2024-09-21T00:56:26.465611+0000","last_undegraded":"2024-09-21T00:56:26.465611+0000","last_fullsized":"2024-09-21T00:56:26.465611+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:39:01.305815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.478706+0000","last_change":"2024-09-21T00:54:57.870703+0000","last_active":"2024-09-21T00:56:26.478706+0000","last_peered":"2024-09-21T00:56:26.478706+0000","last_clean":"2024-09-21T00:56:26.478706+0000","last_became_active":"2024-09-21T00:54:57.870324+0000","last_became_peered":"2024-09-21T00:54:57.870324+0000","last_unstale":"2024-09-21T00:56:26.478706+0000","last_undegraded":"2024-09-21T00:56:26.478706+0000","last_fullsized":"2024-09-21T00:56:26.478706+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:50.548296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"75'16","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.492991+0000","last_change":"2024-09-21T00:54:57.869803+0000","last_active":"2024-09-21T00:56:26.492991+0000","last_peered":"2024-09-21T00:56:26.492991+0000","last_clean":"2024-09-21T00:56:26.492991+0000","last_became_active":"2024-09-21T00:54:57.869092+0000","last_became_peered":"2024-09-21T00:54:57.869092+0000","last_unstale":"2024-09-21T00:56:26.492991+0000","last_undegraded":"2024-09-21T00:56:26.492991+0000","last_fullsized":"2024-09-21T00:56:26.492991+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:05:27.727914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.490169+0000","last_change":"2024-09-21T00:54:57.873700+0000","last_active":"2024-09-21T00:56:26.490169+0000","last_peered":"2024-09-21T00:56:26.490169+0000","last_clean":"2024-09-21T00:56:26.490169+0000","last_became_active":"2024-09-21T00:54:57.873336+0000","last_became_peered":"2024-09-21T00:54:57.873336+0000","last_unstale":"2024-09-21T00:56:26.490169+0000","last_undegraded":"2024-09-21T00:56:26.490169+0000","last_fullsized":"2024-09-21T00:56:26.490169+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:28:17.520669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.477610+0000","last_change":"2024-09-21T00:54:57.877686+0000","last_active":"2024-09-21T00:56:26.477610+0000","last_peered":"2024-09-21T00:56:26.477610+0000","last_clean":"2024-09-21T00:56:26.477610+0000","last_became_active":"2024-09-21T00:54:57.876711+0000","last_became_peered":"2024-09-21T00:54:57.876711+0000","last_unstale":"2024-09-21T00:56:26.477610+0000","last_undegraded":"2024-09-21T00:56:26.477610+0000","last_fullsized":"2024-09-21T00:56:26.477610+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:20:11.254680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.478190+0000","last_change":"2024-09-21T00:54:57.880660+0000","last_active":"2024-09-21T00:56:26.478190+0000","last_peered":"2024-09-21T00:56:26.478190+0000","last_clean":"2024-09-21T00:56:26.478190+0000","last_became_active":"2024-09-21T00:54:57.880270+0000","last_became_peered":"2024-09-21T00:54:57.880270+0000","last_unstale":"2024-09-21T00:56:26.478190+0000","last_undegraded":"2024-09-21T00:56:26.478190+0000","last_fullsized":"2024-09-21T00:56:26.478190+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:50:16.260484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.480243+0000","last_change":"2024-09-21T00:54:57.869626+0000","last_active":"2024-09-21T00:56:26.480243+0000","last_peered":"2024-09-21T00:56:26.480243+0000","last_clean":"2024-09-21T00:56:26.480243+0000","last_became_active":"2024-09-21T00:54:57.869230+0000","last_became_peered":"2024-09-21T00:54:57.869230+0000","last_unstale":"2024-09-21T00:56:26.480243+0000","last_undegraded":"2024-09-21T00:56:26.480243+0000","last_fullsized":"2024-09-21T00:56:26.480243+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:49.131237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.480008+0000","last_change":"2024-09-21T00:54:57.874917+0000","last_active":"2024-09-21T00:56:26.480008+0000","last_peered":"2024-09-21T00:56:26.480008+0000","last_clean":"2024-09-21T00:56:26.480008+0000","last_became_active":"2024-09-21T00:54:57.873787+0000","last_became_peered":"2024-09-21T00:54:57.873787+0000","last_unstale":"2024-09-21T00:56:26.480008+0000","last_undegraded":"2024-09-21T00:56:26.480008+0000","last_fullsized":"2024-09-21T00:56:26.480008+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:44.226734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.488049+0000","last_change":"2024-09-21T00:54:57.877479+0000","last_active":"2024-09-21T00:56:26.488049+0000","last_peered":"2024-09-21T00:56:26.488049+0000","last_clean":"2024-09-21T00:56:26.488049+0000","last_became_active":"2024-09-21T00:54:57.877110+0000","last_became_peered":"2024-09-21T00:54:57.877110+0000","last_unstale":"2024-09-21T00:56:26.488049+0000","last_undegraded":"2024-09-21T00:56:26.488049+0000","last_fullsized":"2024-09-21T00:56:26.488049+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:18.547970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.472045+0000","last_change":"2024-09-21T00:54:57.878701+0000","last_active":"2024-09-21T00:56:26.472045+0000","last_peered":"2024-09-21T00:56:26.472045+0000","last_clean":"2024-09-21T00:56:26.472045+0000","last_became_active":"2024-09-21T00:54:57.878254+0000","last_became_peered":"2024-09-21T00:54:57.878254+0000","last_unstale":"2024-09-21T00:56:26.472045+0000","last_undegraded":"2024-09-21T00:56:26.472045+0000","last_fullsized":"2024-09-21T00:56:26.472045+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:51.309956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.488891+0000","last_change":"2024-09-21T00:54:57.869571+0000","last_active":"2024-09-21T00:56:26.488891+0000","last_peered":"2024-09-21T00:56:26.488891+0000","last_clean":"2024-09-21T00:56:26.488891+0000","last_became_active":"2024-09-21T00:54:57.868907+0000","last_became_peered":"2024-09-21T00:54:57.868907+0000","last_unstale":"2024-09-21T00:56:26.488891+0000","last_undegraded":"2024-09-21T00:56:26.488891+0000","last_fullsized":"2024-09-21T00:56:26.488891+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:14.951885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.478711+0000","last_change":"2024-09-21T00:54:57.869277+0000","last_active":"2024-09-21T00:56:26.478711+0000","last_peered":"2024-09-21T00:56:26.478711+0000","last_clean":"2024-09-21T00:56:26.478711+0000","last_became_active":"2024-09-21T00:54:57.868777+0000","last_became_peered":"2024-09-21T00:54:57.868777+0000","last_unstale":"2024-09-21T00:56:26.478711+0000","last_undegraded":"2024-09-21T00:56:26.478711+0000","last_fullsized":"2024-09-21T00:56:26.478711+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:09:04.766266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"75'8","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.466568+0000","last_change":"2024-09-21T00:55:27.641451+0000","last_active":"2024-09-21T00:56:26.466568+0000","last_peered":"2024-09-21T00:56:26.466568+0000","last_clean":"2024-09-21T00:56:26.466568+0000","last_became_active":"2024-09-21T00:55:27.640253+0000","last_became_peered":"2024-09-21T00:55:27.640253+0000","last_unstale":"2024-09-21T00:56:26.466568+0000","last_undegraded":"2024-09-21T00:56:26.466568+0000","last_fullsized":"2024-09-21T00:56:26.466568+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:34.064803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.488328+0000","last_change":"2024-09-21T00:54:57.871236+0000","last_active":"2024-09-21T00:56:26.488328+0000","last_peered":"2024-09-21T00:56:26.488328+0000","last_clean":"2024-09-21T00:56:26.488328+0000","last_became_active":"2024-09-21T00:54:57.870131+0000","last_became_peered":"2024-09-21T00:54:57.870131+0000","last_unstale":"2024-09-21T00:56:26.488328+0000","last_undegraded":"2024-09-21T00:56:26.488328+0000","last_fullsized":"2024-09-21T00:56:26.488328+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:45.067436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.487776+0000","last_change":"2024-09-21T00:54:57.878710+0000","last_active":"2024-09-21T00:56:26.487776+0000","last_peered":"2024-09-21T00:56:26.487776+0000","last_clean":"2024-09-21T00:56:26.487776+0000","last_became_active":"2024-09-21T00:54:57.878352+0000","last_became_peered":"2024-09-21T00:54:57.878352+0000","last_unstale":"2024-09-21T00:56:26.487776+0000","last_undegraded":"2024-09-21T00:56:26.487776+0000","last_fullsized":"2024-09-21T00:56:26.487776+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:32:40.561028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.477959+0000","last_change":"2024-09-21T00:54:57.873226+0000","last_active":"2024-09-21T00:56:26.477959+0000","last_peered":"2024-09-21T00:56:26.477959+0000","last_clean":"2024-09-21T00:56:26.477959+0000","last_became_active":"2024-09-21T00:54:57.872840+0000","last_became_peered":"2024-09-21T00:54:57.872840+0000","last_unstale":"2024-09-21T00:56:26.477959+0000","last_undegraded":"2024-09-21T00:56:26.477959+0000","last_fullsized":"2024-09-21T00:56:26.477959+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:41.259070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"75'6","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.475280+0000","last_change":"2024-09-21T00:55:28.430095+0000","last_active":"2024-09-21T00:56:26.475280+0000","last_peered":"2024-09-21T00:56:26.475280+0000","last_clean":"2024-09-21T00:56:26.475280+0000","last_became_active":"2024-09-21T00:55:28.429650+0000","last_became_peered":"2024-09-21T00:55:28.429650+0000","last_unstale":"2024-09-21T00:56:26.475280+0000","last_undegraded":"2024-09-21T00:56:26.475280+0000","last_fullsized":"2024-09-21T00:56:26.475280+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:18:14.994333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,3],"acting":[6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"75'2","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.468932+0000","last_change":"2024-09-21T00:55:27.961107+0000","last_active":"2024-09-21T00:56:26.468932+0000","last_peered":"2024-09-21T00:56:26.468932+0000","last_clean":"2024-09-21T00:56:26.468932+0000","last_became_active":"2024-09-21T00:55:27.960673+0000","last_became_peered":"2024-09-21T00:55:27.960673+0000","last_unstale":"2024-09-21T00:56:26.468932+0000","last_undegraded":"2024-09-21T00:56:26.468932+0000","last_fullsized":"2024-09-21T00:56:26.468932+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:30.418190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.26","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.477365+0000","last_change":"2024-09-21T00:54:57.870994+0000","last_active":"2024-09-21T00:56:26.477365+0000","last_peered":"2024-09-21T00:56:26.477365+0000","last_clean":"2024-09-21T00:56:26.477365+0000","last_became_active":"2024-09-21T00:54:57.867939+0000","last_became_peered":"2024-09-21T00:54:57.867939+0000","last_unstale":"2024-09-21T00:56:26.477365+0000","last_undegraded":"2024-09-21T00:56:26.477365+0000","last_fullsized":"2024-09-21T00:56:26.477365+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:44.858289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.466876+0000","last_change":"2024-09-21T00:54:57.870568+0000","last_active":"2024-09-21T00:56:26.466876+0000","last_peered":"2024-09-21T00:56:26.466876+0000","last_clean":"2024-09-21T00:56:26.466876+0000","last_became_active":"2024-09-21T00:54:57.870208+0000","last_became_peered":"2024-09-21T00:54:57.870208+0000","last_unstale":"2024-09-21T00:56:26.466876+0000","last_undegraded":"2024-09-21T00:56:26.466876+0000","last_fullsized":"2024-09-21T00:56:26.466876+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:28:09.824385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.481877+0000","last_change":"2024-09-21T00:54:57.870228+0000","last_active":"2024-09-21T00:56:26.481877+0000","last_peered":"2024-09-21T00:56:26.481877+0000","last_clean":"2024-09-21T00:56:26.481877+0000","last_became_active":"2024-09-21T00:54:57.869866+0000","last_became_peered":"2024-09-21T00:54:57.869866+0000","last_unstale":"2024-09-21T00:56:26.481877+0000","last_undegraded":"2024-09-21T00:56:26.481877+0000","last_fullsized":"2024-09-21T00:56:26.481877+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:20.073393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.480806+0000","last_change":"2024-09-21T00:54:57.867602+0000","last_active":"2024-09-21T00:56:26.480806+0000","last_peered":"2024-09-21T00:56:26.480806+0000","last_clean":"2024-09-21T00:56:26.480806+0000","last_became_active":"2024-09-21T00:54:57.867104+0000","last_became_peered":"2024-09-21T00:54:57.867104+0000","last_unstale":"2024-09-21T00:56:26.480806+0000","last_undegraded":"2024-09-21T00:56:26.480806+0000","last_fullsized":"2024-09-21T00:56:26.480806+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:29:37.403384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.480052+0000","last_change":"2024-09-21T00:54:57.869400+0000","last_active":"2024-09-21T00:56:26.480052+0000","last_peered":"2024-09-21T00:56:26.480052+0000","last_clean":"2024-09-21T00:56:26.480052+0000","last_became_active":"2024-09-21T00:54:57.868997+0000","last_became_peered":"2024-09-21T00:54:57.868997+0000","last_unstale":"2024-09-21T00:56:26.480052+0000","last_undegraded":"2024-09-21T00:56:26.480052+0000","last_fullsized":"2024-09-21T00:56:26.480052+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:00.117559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"75'12","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.481462+0000","last_change":"2024-09-21T00:54:57.867392+0000","last_active":"2024-09-21T00:56:26.481462+0000","last_peered":"2024-09-21T00:56:26.481462+0000","last_clean":"2024-09-21T00:56:26.481462+0000","last_became_active":"2024-09-21T00:54:57.867001+0000","last_became_peered":"2024-09-21T00:54:57.867001+0000","last_unstale":"2024-09-21T00:56:26.481462+0000","last_undegraded":"2024-09-21T00:56:26.481462+0000","last_fullsized":"2024-09-21T00:56:26.481462+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:05.090149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.473865+0000","last_change":"2024-09-21T00:54:57.867620+0000","last_active":"2024-09-21T00:56:26.473865+0000","last_peered":"2024-09-21T00:56:26.473865+0000","last_clean":"2024-09-21T00:56:26.473865+0000","last_became_active":"2024-09-21T00:54:57.867190+0000","last_became_peered":"2024-09-21T00:54:57.867190+0000","last_unstale":"2024-09-21T00:56:26.473865+0000","last_undegraded":"2024-09-21T00:56:26.473865+0000","last_fullsized":"2024-09-21T00:56:26.473865+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:36.432368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.476445+0000","last_change":"2024-09-21T00:54:57.880526+0000","last_active":"2024-09-21T00:56:26.476445+0000","last_peered":"2024-09-21T00:56:26.476445+0000","last_clean":"2024-09-21T00:56:26.476445+0000","last_became_active":"2024-09-21T00:54:57.880154+0000","last_became_peered":"2024-09-21T00:54:57.880154+0000","last_unstale":"2024-09-21T00:56:26.476445+0000","last_undegraded":"2024-09-21T00:56:26.476445+0000","last_fullsized":"2024-09-21T00:56:26.476445+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:56.179127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'5","reported_seq":133,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:50.739529+0000","last_change":"2024-09-21T00:54:55.867717+0000","last_active":"2024-09-21T00:56:50.739529+0000","last_peered":"2024-09-21T00:56:50.739529+0000","last_clean":"2024-09-21T00:56:50.739529+0000","last_became_active":"2024-09-21T00:54:55.867306+0000","last_became_peered":"2024-09-21T00:54:55.867306+0000","last_unstale":"2024-09-21T00:56:50.739529+0000","last_undegraded":"2024-09-21T00:56:50.739529+0000","last_fullsized":"2024-09-21T00:56:50.739529+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:25.192109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.476378+0000","last_change":"2024-09-21T00:54:57.879034+0000","last_active":"2024-09-21T00:56:26.476378+0000","last_peered":"2024-09-21T00:56:26.476378+0000","last_clean":"2024-09-21T00:56:26.476378+0000","last_became_active":"2024-09-21T00:54:57.878673+0000","last_became_peered":"2024-09-21T00:54:57.878673+0000","last_unstale":"2024-09-21T00:56:26.476378+0000","last_undegraded":"2024-09-21T00:56:26.476378+0000","last_fullsized":"2024-09-21T00:56:26.476378+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:39:12.467465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'7","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.633751+0000","last_change":"2024-09-21T00:54:55.867451+0000","last_active":"2024-09-21T00:55:27.633751+0000","last_peered":"2024-09-21T00:55:27.633751+0000","last_clean":"2024-09-21T00:55:27.633751+0000","last_became_active":"2024-09-21T00:54:55.866998+0000","last_became_peered":"2024-09-21T00:54:55.866998+0000","last_unstale":"2024-09-21T00:55:27.633751+0000","last_undegraded":"2024-09-21T00:55:27.633751+0000","last_fullsized":"2024-09-21T00:55:27.633751+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:40.878647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.634072+0000","last_change":"2024-09-21T00:54:55.853055+0000","last_active":"2024-09-21T00:55:27.634072+0000","last_peered":"2024-09-21T00:55:27.634072+0000","last_clean":"2024-09-21T00:55:27.634072+0000","last_became_active":"2024-09-21T00:54:55.852672+0000","last_became_peered":"2024-09-21T00:54:55.852672+0000","last_unstale":"2024-09-21T00:55:27.634072+0000","last_undegraded":"2024-09-21T00:55:27.634072+0000","last_fullsized":"2024-09-21T00:55:27.634072+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:17.082588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.469740+0000","last_change":"2024-09-21T00:54:57.875024+0000","last_active":"2024-09-21T00:56:26.469740+0000","last_peered":"2024-09-21T00:56:26.469740+0000","last_clean":"2024-09-21T00:56:26.469740+0000","last_became_active":"2024-09-21T00:54:57.870027+0000","last_became_peered":"2024-09-21T00:54:57.870027+0000","last_unstale":"2024-09-21T00:56:26.469740+0000","last_undegraded":"2024-09-21T00:56:26.469740+0000","last_fullsized":"2024-09-21T00:56:26.469740+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:37:48.880686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.650846+0000","last_change":"2024-09-21T00:54:55.864527+0000","last_active":"2024-09-21T00:55:27.650846+0000","last_peered":"2024-09-21T00:55:27.650846+0000","last_clean":"2024-09-21T00:55:27.650846+0000","last_became_active":"2024-09-21T00:54:55.864191+0000","last_became_peered":"2024-09-21T00:54:55.864191+0000","last_unstale":"2024-09-21T00:55:27.650846+0000","last_undegraded":"2024-09-21T00:55:27.650846+0000","last_fullsized":"2024-09-21T00:55:27.650846+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:43.781116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.470933+0000","last_change":"2024-09-21T00:54:57.865671+0000","last_active":"2024-09-21T00:56:26.470933+0000","last_peered":"2024-09-21T00:56:26.470933+0000","last_clean":"2024-09-21T00:56:26.470933+0000","last_became_active":"2024-09-21T00:54:57.865196+0000","last_became_peered":"2024-09-21T00:54:57.865196+0000","last_unstale":"2024-09-21T00:56:26.470933+0000","last_undegraded":"2024-09-21T00:56:26.470933+0000","last_fullsized":"2024-09-21T00:56:26.470933+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:16.524866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'6","reported_seq":237,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:52.741999+0000","last_change":"2024-09-21T00:54:55.862504+0000","last_active":"2024-09-21T00:56:52.741999+0000","last_peered":"2024-09-21T00:56:52.741999+0000","last_clean":"2024-09-21T00:56:52.741999+0000","last_became_active":"2024-09-21T00:54:55.862065+0000","last_became_peered":"2024-09-21T00:54:55.862065+0000","last_unstale":"2024-09-21T00:56:52.741999+0000","last_undegraded":"2024-09-21T00:56:52.741999+0000","last_fullsized":"2024-09-21T00:56:52.741999+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:16.497313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":208,"num_read_kb":208,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.491483+0000","last_change":"2024-09-21T00:54:57.873444+0000","last_active":"2024-09-21T00:56:26.491483+0000","last_peered":"2024-09-21T00:56:26.491483+0000","last_clean":"2024-09-21T00:56:26.491483+0000","last_became_active":"2024-09-21T00:54:57.873058+0000","last_became_peered":"2024-09-21T00:54:57.873058+0000","last_unstale":"2024-09-21T00:56:26.491483+0000","last_undegraded":"2024-09-21T00:56:26.491483+0000","last_fullsized":"2024-09-21T00:56:26.491483+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:36:40.603285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'4","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.967374+0000","last_change":"2024-09-21T00:55:27.967238+0000","last_active":"2024-09-21T00:55:27.967374+0000","last_peered":"2024-09-21T00:55:27.967374+0000","last_clean":"2024-09-21T00:55:27.967374+0000","last_became_active":"2024-09-21T00:55:27.962082+0000","last_became_peered":"2024-09-21T00:55:27.962082+0000","last_unstale":"2024-09-21T00:55:27.967374+0000","last_undegraded":"2024-09-21T00:55:27.967374+0000","last_fullsized":"2024-09-21T00:55:27.967374+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:02.943108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"75'9","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.480891+0000","last_change":"2024-09-21T00:55:27.652838+0000","last_active":"2024-09-21T00:56:26.480891+0000","last_peered":"2024-09-21T00:56:26.480891+0000","last_clean":"2024-09-21T00:56:26.480891+0000","last_became_active":"2024-09-21T00:55:27.652401+0000","last_became_peered":"2024-09-21T00:55:27.652401+0000","last_unstale":"2024-09-21T00:56:26.480891+0000","last_undegraded":"2024-09-21T00:56:26.480891+0000","last_fullsized":"2024-09-21T00:56:26.480891+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:53:33.968079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.651540+0000","last_change":"2024-09-21T00:54:55.968782+0000","last_active":"2024-09-21T00:55:27.651540+0000","last_peered":"2024-09-21T00:55:27.651540+0000","last_clean":"2024-09-21T00:55:27.651540+0000","last_became_active":"2024-09-21T00:54:55.968421+0000","last_became_peered":"2024-09-21T00:54:55.968421+0000","last_unstale":"2024-09-21T00:55:27.651540+0000","last_undegraded":"2024-09-21T00:55:27.651540+0000","last_fullsized":"2024-09-21T00:55:27.651540+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:28.680764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.490303+0000","last_change":"2024-09-21T00:54:57.877610+0000","last_active":"2024-09-21T00:56:26.490303+0000","last_peered":"2024-09-21T00:56:26.490303+0000","last_clean":"2024-09-21T00:56:26.490303+0000","last_became_active":"2024-09-21T00:54:57.877225+0000","last_became_peered":"2024-09-21T00:54:57.877225+0000","last_unstale":"2024-09-21T00:56:26.490303+0000","last_undegraded":"2024-09-21T00:56:26.490303+0000","last_fullsized":"2024-09-21T00:56:26.490303+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:08.294366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'35","reported_seq":296,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:53.128142+0000","last_change":"2024-09-21T00:55:27.975731+0000","last_active":"2024-09-21T00:56:53.128142+0000","last_peered":"2024-09-21T00:56:53.128142+0000","last_clean":"2024-09-21T00:56:53.128142+0000","last_became_active":"2024-09-21T00:55:27.961766+0000","last_became_peered":"2024-09-21T00:55:27.961766+0000","last_unstale":"2024-09-21T00:56:53.128142+0000","last_undegraded":"2024-09-21T00:56:53.128142+0000","last_fullsized":"2024-09-21T00:56:53.128142+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:42:32.442882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69740,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":208,"num_read_kb":158,"num_write":37,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":59092,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.471618+0000","last_change":"2024-09-21T00:54:57.875575+0000","last_active":"2024-09-21T00:56:26.471618+0000","last_peered":"2024-09-21T00:56:26.471618+0000","last_clean":"2024-09-21T00:56:26.471618+0000","last_became_active":"2024-09-21T00:54:57.874975+0000","last_became_peered":"2024-09-21T00:54:57.874975+0000","last_unstale":"2024-09-21T00:56:26.471618+0000","last_undegraded":"2024-09-21T00:56:26.471618+0000","last_fullsized":"2024-09-21T00:56:26.471618+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:34:36.089068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'9","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637272+0000","last_change":"2024-09-21T00:54:55.863532+0000","last_active":"2024-09-21T00:55:27.637272+0000","last_peered":"2024-09-21T00:55:27.637272+0000","last_clean":"2024-09-21T00:55:27.637272+0000","last_became_active":"2024-09-21T00:54:55.863124+0000","last_became_peered":"2024-09-21T00:54:55.863124+0000","last_unstale":"2024-09-21T00:55:27.637272+0000","last_undegraded":"2024-09-21T00:55:27.637272+0000","last_fullsized":"2024-09-21T00:55:27.637272+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:41:07.996906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.485241+0000","last_change":"2024-09-21T00:54:57.866126+0000","last_active":"2024-09-21T00:56:26.485241+0000","last_peered":"2024-09-21T00:56:26.485241+0000","last_clean":"2024-09-21T00:56:26.485241+0000","last_became_active":"2024-09-21T00:54:57.865775+0000","last_became_peered":"2024-09-21T00:54:57.865775+0000","last_unstale":"2024-09-21T00:56:26.485241+0000","last_undegraded":"2024-09-21T00:56:26.485241+0000","last_fullsized":"2024-09-21T00:56:26.485241+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:28.261632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.651370+0000","last_change":"2024-09-21T00:54:55.864593+0000","last_active":"2024-09-21T00:55:27.651370+0000","last_peered":"2024-09-21T00:55:27.651370+0000","last_clean":"2024-09-21T00:55:27.651370+0000","last_became_active":"2024-09-21T00:54:55.864202+0000","last_became_peered":"2024-09-21T00:54:55.864202+0000","last_unstale":"2024-09-21T00:55:27.651370+0000","last_undegraded":"2024-09-21T00:55:27.651370+0000","last_fullsized":"2024-09-21T00:55:27.651370+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:06.976588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.486026+0000","last_change":"2024-09-21T00:54:57.877892+0000","last_active":"2024-09-21T00:56:26.486026+0000","last_peered":"2024-09-21T00:56:26.486026+0000","last_clean":"2024-09-21T00:56:26.486026+0000","last_became_active":"2024-09-21T00:54:57.877510+0000","last_became_peered":"2024-09-21T00:54:57.877510+0000","last_unstale":"2024-09-21T00:56:26.486026+0000","last_undegraded":"2024-09-21T00:56:26.486026+0000","last_fullsized":"2024-09-21T00:56:26.486026+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:05.238100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'7","reported_seq":138,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:51.741113+0000","last_change":"2024-09-21T00:54:55.856707+0000","last_active":"2024-09-21T00:56:51.741113+0000","last_peered":"2024-09-21T00:56:51.741113+0000","last_clean":"2024-09-21T00:56:51.741113+0000","last_became_active":"2024-09-21T00:54:55.856095+0000","last_became_peered":"2024-09-21T00:54:55.856095+0000","last_unstale":"2024-09-21T00:56:51.741113+0000","last_undegraded":"2024-09-21T00:56:51.741113+0000","last_fullsized":"2024-09-21T00:56:51.741113+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:48.332764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.492677+0000","last_change":"2024-09-21T00:54:57.868398+0000","last_active":"2024-09-21T00:56:26.492677+0000","last_peered":"2024-09-21T00:56:26.492677+0000","last_clean":"2024-09-21T00:56:26.492677+0000","last_became_active":"2024-09-21T00:54:57.867963+0000","last_became_peered":"2024-09-21T00:54:57.867963+0000","last_unstale":"2024-09-21T00:56:26.492677+0000","last_undegraded":"2024-09-21T00:56:26.492677+0000","last_fullsized":"2024-09-21T00:56:26.492677+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:59:31.527713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'17","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.659007+0000","last_change":"2024-09-21T00:55:27.658543+0000","last_active":"2024-09-21T00:55:27.659007+0000","last_peered":"2024-09-21T00:55:27.659007+0000","last_clean":"2024-09-21T00:55:27.659007+0000","last_became_active":"2024-09-21T00:55:27.639915+0000","last_became_peered":"2024-09-21T00:55:27.639915+0000","last_unstale":"2024-09-21T00:55:27.659007+0000","last_undegraded":"2024-09-21T00:55:27.659007+0000","last_fullsized":"2024-09-21T00:55:27.659007+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:51.736732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.469871+0000","last_change":"2024-09-21T00:54:57.872256+0000","last_active":"2024-09-21T00:56:26.469871+0000","last_peered":"2024-09-21T00:56:26.469871+0000","last_clean":"2024-09-21T00:56:26.469871+0000","last_became_active":"2024-09-21T00:54:57.871848+0000","last_became_peered":"2024-09-21T00:54:57.871848+0000","last_unstale":"2024-09-21T00:56:26.469871+0000","last_undegraded":"2024-09-21T00:56:26.469871+0000","last_fullsized":"2024-09-21T00:56:26.469871+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:24:11.314693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636721+0000","last_change":"2024-09-21T00:54:55.870096+0000","last_active":"2024-09-21T00:55:27.636721+0000","last_peered":"2024-09-21T00:55:27.636721+0000","last_clean":"2024-09-21T00:55:27.636721+0000","last_became_active":"2024-09-21T00:54:55.869616+0000","last_became_peered":"2024-09-21T00:54:55.869616+0000","last_unstale":"2024-09-21T00:55:27.636721+0000","last_undegraded":"2024-09-21T00:55:27.636721+0000","last_fullsized":"2024-09-21T00:55:27.636721+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:53:48.036499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"75'5","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.465530+0000","last_change":"2024-09-21T00:55:27.652960+0000","last_active":"2024-09-21T00:56:26.465530+0000","last_peered":"2024-09-21T00:56:26.465530+0000","last_clean":"2024-09-21T00:56:26.465530+0000","last_became_active":"2024-09-21T00:55:27.652420+0000","last_became_peered":"2024-09-21T00:55:27.652420+0000","last_unstale":"2024-09-21T00:56:26.465530+0000","last_undegraded":"2024-09-21T00:56:26.465530+0000","last_fullsized":"2024-09-21T00:56:26.465530+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:24.436368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'5","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.634222+0000","last_change":"2024-09-21T00:54:55.866393+0000","last_active":"2024-09-21T00:55:27.634222+0000","last_peered":"2024-09-21T00:55:27.634222+0000","last_clean":"2024-09-21T00:55:27.634222+0000","last_became_active":"2024-09-21T00:54:55.865980+0000","last_became_peered":"2024-09-21T00:54:55.865980+0000","last_unstale":"2024-09-21T00:55:27.634222+0000","last_undegraded":"2024-09-21T00:55:27.634222+0000","last_fullsized":"2024-09-21T00:55:27.634222+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:56.471011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.480433+0000","last_change":"2024-09-21T00:54:57.875177+0000","last_active":"2024-09-21T00:56:26.480433+0000","last_peered":"2024-09-21T00:56:26.480433+0000","last_clean":"2024-09-21T00:56:26.480433+0000","last_became_active":"2024-09-21T00:54:57.874819+0000","last_became_peered":"2024-09-21T00:54:57.874819+0000","last_unstale":"2024-09-21T00:56:26.480433+0000","last_undegraded":"2024-09-21T00:56:26.480433+0000","last_fullsized":"2024-09-21T00:56:26.480433+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:43.942703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.651656+0000","last_change":"2024-09-21T00:54:55.864668+0000","last_active":"2024-09-21T00:55:27.651656+0000","last_peered":"2024-09-21T00:55:27.651656+0000","last_clean":"2024-09-21T00:55:27.651656+0000","last_became_active":"2024-09-21T00:54:55.864330+0000","last_became_peered":"2024-09-21T00:54:55.864330+0000","last_unstale":"2024-09-21T00:55:27.651656+0000","last_undegraded":"2024-09-21T00:55:27.651656+0000","last_fullsized":"2024-09-21T00:55:27.651656+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:45:50.751390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.485352+0000","last_change":"2024-09-21T00:54:57.871093+0000","last_active":"2024-09-21T00:56:26.485352+0000","last_peered":"2024-09-21T00:56:26.485352+0000","last_clean":"2024-09-21T00:56:26.485352+0000","last_became_active":"2024-09-21T00:54:57.870457+0000","last_became_peered":"2024-09-21T00:54:57.870457+0000","last_unstale":"2024-09-21T00:56:26.485352+0000","last_undegraded":"2024-09-21T00:56:26.485352+0000","last_fullsized":"2024-09-21T00:56:26.485352+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:19.810575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'8","reported_seq":142,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:53.744561+0000","last_change":"2024-09-21T00:54:55.968156+0000","last_active":"2024-09-21T00:56:53.744561+0000","last_peered":"2024-09-21T00:56:53.744561+0000","last_clean":"2024-09-21T00:56:53.744561+0000","last_became_active":"2024-09-21T00:54:55.967668+0000","last_became_peered":"2024-09-21T00:54:55.967668+0000","last_unstale":"2024-09-21T00:56:53.744561+0000","last_undegraded":"2024-09-21T00:56:53.744561+0000","last_fullsized":"2024-09-21T00:56:53.744561+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:28.854249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2093,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.491789+0000","last_change":"2024-09-21T00:54:57.868187+0000","last_active":"2024-09-21T00:56:26.491789+0000","last_peered":"2024-09-21T00:56:26.491789+0000","last_clean":"2024-09-21T00:56:26.491789+0000","last_became_active":"2024-09-21T00:54:57.867709+0000","last_became_peered":"2024-09-21T00:54:57.867709+0000","last_unstale":"2024-09-21T00:56:26.491789+0000","last_undegraded":"2024-09-21T00:56:26.491789+0000","last_fullsized":"2024-09-21T00:56:26.491789+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:40.123030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":97,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636523+0000","last_change":"2024-09-21T00:53:44.515787+0000","last_active":"2024-09-21T00:55:27.636523+0000","last_peered":"2024-09-21T00:55:27.636523+0000","last_clean":"2024-09-21T00:55:27.636523+0000","last_became_active":"2024-09-21T00:53:44.510106+0000","last_became_peered":"2024-09-21T00:53:44.510106+0000","last_unstale":"2024-09-21T00:55:27.636523+0000","last_undegraded":"2024-09-21T00:55:27.636523+0000","last_fullsized":"2024-09-21T00:55:27.636523+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:50:16.598790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:50:16.598790+0000","last_clean_scrub_stamp":"2024-09-21T00:50:16.598790+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:04:14.481212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'6","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.958651+0000","last_change":"2024-09-21T00:54:55.854929+0000","last_active":"2024-09-21T00:55:27.958651+0000","last_peered":"2024-09-21T00:55:27.958651+0000","last_clean":"2024-09-21T00:55:27.958651+0000","last_became_active":"2024-09-21T00:54:55.854489+0000","last_became_peered":"2024-09-21T00:54:55.854489+0000","last_unstale":"2024-09-21T00:55:27.958651+0000","last_undegraded":"2024-09-21T00:55:27.958651+0000","last_fullsized":"2024-09-21T00:55:27.958651+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:03.067142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"75'8","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.488103+0000","last_change":"2024-09-21T00:55:27.652679+0000","last_active":"2024-09-21T00:56:26.488103+0000","last_peered":"2024-09-21T00:56:26.488103+0000","last_clean":"2024-09-21T00:56:26.488103+0000","last_became_active":"2024-09-21T00:55:27.652348+0000","last_became_peered":"2024-09-21T00:55:27.652348+0000","last_unstale":"2024-09-21T00:56:26.488103+0000","last_undegraded":"2024-09-21T00:56:26.488103+0000","last_fullsized":"2024-09-21T00:56:26.488103+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:11.974613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636440+0000","last_change":"2024-09-21T00:54:55.863265+0000","last_active":"2024-09-21T00:55:27.636440+0000","last_peered":"2024-09-21T00:55:27.636440+0000","last_clean":"2024-09-21T00:55:27.636440+0000","last_became_active":"2024-09-21T00:54:55.862613+0000","last_became_peered":"2024-09-21T00:54:55.862613+0000","last_unstale":"2024-09-21T00:55:27.636440+0000","last_undegraded":"2024-09-21T00:55:27.636440+0000","last_fullsized":"2024-09-21T00:55:27.636440+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:56.707143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.481311+0000","last_change":"2024-09-21T00:54:57.855249+0000","last_active":"2024-09-21T00:56:26.481311+0000","last_peered":"2024-09-21T00:56:26.481311+0000","last_clean":"2024-09-21T00:56:26.481311+0000","last_became_active":"2024-09-21T00:54:57.854879+0000","last_became_peered":"2024-09-21T00:54:57.854879+0000","last_unstale":"2024-09-21T00:56:26.481311+0000","last_undegraded":"2024-09-21T00:56:26.481311+0000","last_fullsized":"2024-09-21T00:56:26.481311+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:15.733514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'6","reported_seq":136,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:53.743453+0000","last_change":"2024-09-21T00:54:55.968078+0000","last_active":"2024-09-21T00:56:53.743453+0000","last_peered":"2024-09-21T00:56:53.743453+0000","last_clean":"2024-09-21T00:56:53.743453+0000","last_became_active":"2024-09-21T00:54:55.967700+0000","last_became_peered":"2024-09-21T00:54:55.967700+0000","last_unstale":"2024-09-21T00:56:53.743453+0000","last_undegraded":"2024-09-21T00:56:53.743453+0000","last_fullsized":"2024-09-21T00:56:53.743453+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:35.121889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":107,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.472754+0000","last_change":"2024-09-21T00:54:57.873224+0000","last_active":"2024-09-21T00:56:26.472754+0000","last_peered":"2024-09-21T00:56:26.472754+0000","last_clean":"2024-09-21T00:56:26.472754+0000","last_became_active":"2024-09-21T00:54:57.872828+0000","last_became_peered":"2024-09-21T00:54:57.872828+0000","last_unstale":"2024-09-21T00:56:26.472754+0000","last_undegraded":"2024-09-21T00:56:26.472754+0000","last_fullsized":"2024-09-21T00:56:26.472754+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:58:55.758620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'5","reported_seq":136,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:54.744660+0000","last_change":"2024-09-21T00:54:55.859887+0000","last_active":"2024-09-21T00:56:54.744660+0000","last_peered":"2024-09-21T00:56:54.744660+0000","last_clean":"2024-09-21T00:56:54.744660+0000","last_became_active":"2024-09-21T00:54:55.859351+0000","last_became_peered":"2024-09-21T00:54:55.859351+0000","last_unstale":"2024-09-21T00:56:54.744660+0000","last_undegraded":"2024-09-21T00:56:54.744660+0000","last_fullsized":"2024-09-21T00:56:54.744660+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:31.407409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.491962+0000","last_change":"2024-09-21T00:54:57.882568+0000","last_active":"2024-09-21T00:56:26.491962+0000","last_peered":"2024-09-21T00:56:26.491962+0000","last_clean":"2024-09-21T00:56:26.491962+0000","last_became_active":"2024-09-21T00:54:57.882190+0000","last_became_peered":"2024-09-21T00:54:57.882190+0000","last_unstale":"2024-09-21T00:56:26.491962+0000","last_undegraded":"2024-09-21T00:56:26.491962+0000","last_fullsized":"2024-09-21T00:56:26.491962+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:19.339490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.632817+0000","last_change":"2024-09-21T00:54:55.970154+0000","last_active":"2024-09-21T00:55:27.632817+0000","last_peered":"2024-09-21T00:55:27.632817+0000","last_clean":"2024-09-21T00:55:27.632817+0000","last_became_active":"2024-09-21T00:54:55.969774+0000","last_became_peered":"2024-09-21T00:54:55.969774+0000","last_unstale":"2024-09-21T00:55:27.632817+0000","last_undegraded":"2024-09-21T00:55:27.632817+0000","last_fullsized":"2024-09-21T00:55:27.632817+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:05.241455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.491963+0000","last_change":"2024-09-21T00:54:57.873452+0000","last_active":"2024-09-21T00:56:26.491963+0000","last_peered":"2024-09-21T00:56:26.491963+0000","last_clean":"2024-09-21T00:56:26.491963+0000","last_became_active":"2024-09-21T00:54:57.872592+0000","last_became_peered":"2024-09-21T00:54:57.872592+0000","last_unstale":"2024-09-21T00:56:26.491963+0000","last_undegraded":"2024-09-21T00:56:26.491963+0000","last_fullsized":"2024-09-21T00:56:26.491963+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:25.196491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637464+0000","last_change":"2024-09-21T00:54:55.968563+0000","last_active":"2024-09-21T00:55:27.637464+0000","last_peered":"2024-09-21T00:55:27.637464+0000","last_clean":"2024-09-21T00:55:27.637464+0000","last_became_active":"2024-09-21T00:54:55.968176+0000","last_became_peered":"2024-09-21T00:54:55.968176+0000","last_unstale":"2024-09-21T00:55:27.637464+0000","last_undegraded":"2024-09-21T00:55:27.637464+0000","last_fullsized":"2024-09-21T00:55:27.637464+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:35.120595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.482137+0000","last_change":"2024-09-21T00:54:57.862128+0000","last_active":"2024-09-21T00:56:26.482137+0000","last_peered":"2024-09-21T00:56:26.482137+0000","last_clean":"2024-09-21T00:56:26.482137+0000","last_became_active":"2024-09-21T00:54:57.861692+0000","last_became_peered":"2024-09-21T00:54:57.861692+0000","last_unstale":"2024-09-21T00:56:26.482137+0000","last_undegraded":"2024-09-21T00:56:26.482137+0000","last_fullsized":"2024-09-21T00:56:26.482137+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:58:29.364344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'16","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.632906+0000","last_change":"2024-09-21T00:54:55.866240+0000","last_active":"2024-09-21T00:55:27.632906+0000","last_peered":"2024-09-21T00:55:27.632906+0000","last_clean":"2024-09-21T00:55:27.632906+0000","last_became_active":"2024-09-21T00:54:55.865192+0000","last_became_peered":"2024-09-21T00:54:55.865192+0000","last_unstale":"2024-09-21T00:55:27.632906+0000","last_undegraded":"2024-09-21T00:55:27.632906+0000","last_fullsized":"2024-09-21T00:55:27.632906+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:53:17.599528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.487825+0000","last_change":"2024-09-21T00:54:57.878847+0000","last_active":"2024-09-21T00:56:26.487825+0000","last_peered":"2024-09-21T00:56:26.487825+0000","last_clean":"2024-09-21T00:56:26.487825+0000","last_became_active":"2024-09-21T00:54:57.878117+0000","last_became_peered":"2024-09-21T00:54:57.878117+0000","last_unstale":"2024-09-21T00:56:26.487825+0000","last_undegraded":"2024-09-21T00:56:26.487825+0000","last_fullsized":"2024-09-21T00:56:26.487825+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:46.090963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'7","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.958730+0000","last_change":"2024-09-21T00:54:55.854035+0000","last_active":"2024-09-21T00:55:27.958730+0000","last_peered":"2024-09-21T00:55:27.958730+0000","last_clean":"2024-09-21T00:55:27.958730+0000","last_became_active":"2024-09-21T00:54:55.853301+0000","last_became_peered":"2024-09-21T00:54:55.853301+0000","last_unstale":"2024-09-21T00:55:27.958730+0000","last_undegraded":"2024-09-21T00:55:27.958730+0000","last_fullsized":"2024-09-21T00:55:27.958730+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:11.498865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.480267+0000","last_change":"2024-09-21T00:54:57.875093+0000","last_active":"2024-09-21T00:56:26.480267+0000","last_peered":"2024-09-21T00:56:26.480267+0000","last_clean":"2024-09-21T00:56:26.480267+0000","last_became_active":"2024-09-21T00:54:57.873996+0000","last_became_peered":"2024-09-21T00:54:57.873996+0000","last_unstale":"2024-09-21T00:56:26.480267+0000","last_undegraded":"2024-09-21T00:56:26.480267+0000","last_fullsized":"2024-09-21T00:56:26.480267+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:17:55.990167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637124+0000","last_change":"2024-09-21T00:54:55.968507+0000","last_active":"2024-09-21T00:55:27.637124+0000","last_peered":"2024-09-21T00:55:27.637124+0000","last_clean":"2024-09-21T00:55:27.637124+0000","last_became_active":"2024-09-21T00:54:55.968084+0000","last_became_peered":"2024-09-21T00:54:55.968084+0000","last_unstale":"2024-09-21T00:55:27.637124+0000","last_undegraded":"2024-09-21T00:55:27.637124+0000","last_fullsized":"2024-09-21T00:55:27.637124+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:34:06.325264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.433503+0000","last_change":"2024-09-21T00:54:57.870500+0000","last_active":"2024-09-21T00:56:26.433503+0000","last_peered":"2024-09-21T00:56:26.433503+0000","last_clean":"2024-09-21T00:56:26.433503+0000","last_became_active":"2024-09-21T00:54:57.870103+0000","last_became_peered":"2024-09-21T00:54:57.870103+0000","last_unstale":"2024-09-21T00:56:26.433503+0000","last_undegraded":"2024-09-21T00:56:26.433503+0000","last_fullsized":"2024-09-21T00:56:26.433503+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:31:03.469863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'7","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:28.428026+0000","last_change":"2024-09-21T00:54:55.856185+0000","last_active":"2024-09-21T00:55:28.428026+0000","last_peered":"2024-09-21T00:55:28.428026+0000","last_clean":"2024-09-21T00:55:28.428026+0000","last_became_active":"2024-09-21T00:54:55.855738+0000","last_became_peered":"2024-09-21T00:54:55.855738+0000","last_unstale":"2024-09-21T00:55:28.428026+0000","last_undegraded":"2024-09-21T00:55:28.428026+0000","last_fullsized":"2024-09-21T00:55:28.428026+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:02.870874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.472850+0000","last_change":"2024-09-21T00:54:57.877828+0000","last_active":"2024-09-21T00:56:26.472850+0000","last_peered":"2024-09-21T00:56:26.472850+0000","last_clean":"2024-09-21T00:56:26.472850+0000","last_became_active":"2024-09-21T00:54:57.877414+0000","last_became_peered":"2024-09-21T00:54:57.877414+0000","last_unstale":"2024-09-21T00:56:26.472850+0000","last_undegraded":"2024-09-21T00:56:26.472850+0000","last_fullsized":"2024-09-21T00:56:26.472850+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:27.485830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636953+0000","last_change":"2024-09-21T00:54:55.868014+0000","last_active":"2024-09-21T00:55:27.636953+0000","last_peered":"2024-09-21T00:55:27.636953+0000","last_clean":"2024-09-21T00:55:27.636953+0000","last_became_active":"2024-09-21T00:54:55.867640+0000","last_became_peered":"2024-09-21T00:54:55.867640+0000","last_unstale":"2024-09-21T00:55:27.636953+0000","last_undegraded":"2024-09-21T00:55:27.636953+0000","last_fullsized":"2024-09-21T00:55:27.636953+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:24:57.118238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.470306+0000","last_change":"2024-09-21T00:54:57.881935+0000","last_active":"2024-09-21T00:56:26.470306+0000","last_peered":"2024-09-21T00:56:26.470306+0000","last_clean":"2024-09-21T00:56:26.470306+0000","last_became_active":"2024-09-21T00:54:57.881598+0000","last_became_peered":"2024-09-21T00:54:57.881598+0000","last_unstale":"2024-09-21T00:56:26.470306+0000","last_undegraded":"2024-09-21T00:56:26.470306+0000","last_fullsized":"2024-09-21T00:56:26.470306+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:44:19.893961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.645759+0000","last_change":"2024-09-21T00:55:27.645172+0000","last_active":"2024-09-21T00:55:27.645759+0000","last_peered":"2024-09-21T00:55:27.645759+0000","last_clean":"2024-09-21T00:55:27.645759+0000","last_became_active":"2024-09-21T00:55:27.639795+0000","last_became_peered":"2024-09-21T00:55:27.639795+0000","last_unstale":"2024-09-21T00:55:27.645759+0000","last_undegraded":"2024-09-21T00:55:27.645759+0000","last_fullsized":"2024-09-21T00:55:27.645759+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:20:50.639608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.491583+0000","last_change":"2024-09-21T00:54:57.867972+0000","last_active":"2024-09-21T00:56:26.491583+0000","last_peered":"2024-09-21T00:56:26.491583+0000","last_clean":"2024-09-21T00:56:26.491583+0000","last_became_active":"2024-09-21T00:54:57.867586+0000","last_became_peered":"2024-09-21T00:54:57.867586+0000","last_unstale":"2024-09-21T00:56:26.491583+0000","last_undegraded":"2024-09-21T00:56:26.491583+0000","last_fullsized":"2024-09-21T00:56:26.491583+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:27.066795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.484037+0000","last_change":"2024-09-21T00:54:57.881014+0000","last_active":"2024-09-21T00:56:26.484037+0000","last_peered":"2024-09-21T00:56:26.484037+0000","last_clean":"2024-09-21T00:56:26.484037+0000","last_became_active":"2024-09-21T00:54:57.880608+0000","last_became_peered":"2024-09-21T00:54:57.880608+0000","last_unstale":"2024-09-21T00:56:26.484037+0000","last_undegraded":"2024-09-21T00:56:26.484037+0000","last_fullsized":"2024-09-21T00:56:26.484037+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:48:31.848315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.638999+0000","last_change":"2024-09-21T00:54:55.865031+0000","last_active":"2024-09-21T00:55:27.638999+0000","last_peered":"2024-09-21T00:55:27.638999+0000","last_clean":"2024-09-21T00:55:27.638999+0000","last_became_active":"2024-09-21T00:54:55.864576+0000","last_became_peered":"2024-09-21T00:54:55.864576+0000","last_unstale":"2024-09-21T00:55:27.638999+0000","last_undegraded":"2024-09-21T00:55:27.638999+0000","last_fullsized":"2024-09-21T00:55:27.638999+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:13.125491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.492158+0000","last_change":"2024-09-21T00:54:57.875878+0000","last_active":"2024-09-21T00:56:26.492158+0000","last_peered":"2024-09-21T00:56:26.492158+0000","last_clean":"2024-09-21T00:56:26.492158+0000","last_became_active":"2024-09-21T00:54:57.874177+0000","last_became_peered":"2024-09-21T00:54:57.874177+0000","last_unstale":"2024-09-21T00:56:26.492158+0000","last_undegraded":"2024-09-21T00:56:26.492158+0000","last_fullsized":"2024-09-21T00:56:26.492158+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:25.333036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'12","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637565+0000","last_change":"2024-09-21T00:54:55.868698+0000","last_active":"2024-09-21T00:55:27.637565+0000","last_peered":"2024-09-21T00:55:27.637565+0000","last_clean":"2024-09-21T00:55:27.637565+0000","last_became_active":"2024-09-21T00:54:55.868282+0000","last_became_peered":"2024-09-21T00:54:55.868282+0000","last_unstale":"2024-09-21T00:55:27.637565+0000","last_undegraded":"2024-09-21T00:55:27.637565+0000","last_fullsized":"2024-09-21T00:55:27.637565+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:50.253638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.491449+0000","last_change":"2024-09-21T00:54:57.867726+0000","last_active":"2024-09-21T00:56:26.491449+0000","last_peered":"2024-09-21T00:56:26.491449+0000","last_clean":"2024-09-21T00:56:26.491449+0000","last_became_active":"2024-09-21T00:54:57.866090+0000","last_became_peered":"2024-09-21T00:54:57.866090+0000","last_unstale":"2024-09-21T00:56:26.491449+0000","last_undegraded":"2024-09-21T00:56:26.491449+0000","last_fullsized":"2024-09-21T00:56:26.491449+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:57.938078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:28.428068+0000","last_change":"2024-09-21T00:54:55.968155+0000","last_active":"2024-09-21T00:55:28.428068+0000","last_peered":"2024-09-21T00:55:28.428068+0000","last_clean":"2024-09-21T00:55:28.428068+0000","last_became_active":"2024-09-21T00:54:55.967718+0000","last_became_peered":"2024-09-21T00:54:55.967718+0000","last_unstale":"2024-09-21T00:55:28.428068+0000","last_undegraded":"2024-09-21T00:55:28.428068+0000","last_fullsized":"2024-09-21T00:55:28.428068+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:18.160380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.461696+0000","last_change":"2024-09-21T00:54:57.873102+0000","last_active":"2024-09-21T00:56:26.461696+0000","last_peered":"2024-09-21T00:56:26.461696+0000","last_clean":"2024-09-21T00:56:26.461696+0000","last_became_active":"2024-09-21T00:54:57.872323+0000","last_became_peered":"2024-09-21T00:54:57.872323+0000","last_unstale":"2024-09-21T00:56:26.461696+0000","last_undegraded":"2024-09-21T00:56:26.461696+0000","last_fullsized":"2024-09-21T00:56:26.461696+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:18.087601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'13","reported_seq":139,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.736712+0000","last_change":"2024-09-21T00:54:55.865559+0000","last_active":"2024-09-21T00:56:49.736712+0000","last_peered":"2024-09-21T00:56:49.736712+0000","last_clean":"2024-09-21T00:56:49.736712+0000","last_became_active":"2024-09-21T00:54:55.865157+0000","last_became_peered":"2024-09-21T00:54:55.865157+0000","last_unstale":"2024-09-21T00:56:49.736712+0000","last_undegraded":"2024-09-21T00:56:49.736712+0000","last_fullsized":"2024-09-21T00:56:49.736712+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:53.113970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":77617,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1076,"num_read_kb":606,"num_write":258,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":59204,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":536576,"data_stored":232851,"data_compressed":13542,"data_compressed_allocated":20480,"data_compressed_original":73728,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":283734,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808868,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717320,"statfs":{"total":95995035648,"available":95966535680,"internally_reserved":0,"allocated":827392,"data_stored":396490,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972394,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":1050922,"data_compressed":43733,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135918,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":843776,"data_stored":395385,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332148,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31996,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713156,"statfs":{"total":95995035648,"available":95962271744,"internally_reserved":0,"allocated":831488,"data_stored":395651,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528377,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":988422,"data_compressed":41838,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691902,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36152,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709000,"statfs":{"total":95995035648,"available":95958016000,"internally_reserved":0,"allocated":827392,"data_stored":395102,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888131,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":987568,"data_compressed":41838,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018953,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36184,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708968,"statfs":{"total":95995035648,"available":95957983232,"internally_reserved":0,"allocated":860160,"data_stored":465235,"data_compressed":15515,"data_compressed_allocated":20480,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215182,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":843776,"data_stored":394927,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411412,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36164,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708988,"statfs":{"total":95995035648,"available":95958003712,"internally_reserved":0,"allocated":839680,"data_stored":397158,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36216,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708936,"statfs":{"total":95995035648,"available":95957950464,"internally_reserved":0,"allocated":892928,"data_stored":465755,"data_compressed":7658,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36172,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708980,"statfs":{"total":95995035648,"available":95957995520,"internally_reserved":0,"allocated":847872,"data_stored":397364,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":71492,"data_compressed":1895,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":70972,"data_compressed":9752,"data_compressed_allocated":12288,"data_compressed_original":57344,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":72008,"data_compressed":1895,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:56:57.093 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-21T00:56:57.094 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T00:56:57.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.242+0000 7f29e6e9b640 1 -- 172.21.15.1:0/1672810393 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29e0103fe0 msgr2=0x7f29e010a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:57.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.242+0000 7f29e6e9b640 1 --2- 172.21.15.1:0/1672810393 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29e0103fe0 0x7f29e010a980 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f29d8009ca0 tx=0x7f29d802a8c0 comp rx=0 tx=0).stop 2024-09-21T00:56:57.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.242+0000 7f29e6e9b640 1 -- 172.21.15.1:0/1672810393 shutdown_connections 2024-09-21T00:56:57.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.242+0000 7f29e6e9b640 1 --2- 172.21.15.1:0/1672810393 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29e0103fe0 0x7f29e010a980 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:57.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.242+0000 7f29e6e9b640 1 --2- 172.21.15.1:0/1672810393 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f29e0103640 0x7f29e0103a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:57.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.242+0000 7f29e6e9b640 1 --2- 172.21.15.1:0/1672810393 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29e01025c0 0x7f29e0102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:57.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.242+0000 7f29e6e9b640 1 -- 172.21.15.1:0/1672810393 >> 172.21.15.1:0/1672810393 conn(0x7f29e00fdf00 msgr2=0x7f29e01003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:57.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.242+0000 7f29e6e9b640 1 -- 172.21.15.1:0/1672810393 shutdown_connections 2024-09-21T00:56:57.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.242+0000 7f29e6e9b640 1 -- 172.21.15.1:0/1672810393 wait complete. 2024-09-21T00:56:57.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.243+0000 7f29e6e9b640 1 Processor -- start 2024-09-21T00:56:57.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.243+0000 7f29e6e9b640 1 -- start start 2024-09-21T00:56:57.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.243+0000 7f29e6e9b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f29e01025c0 0x7f29e0198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:57.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.243+0000 7f29e6e9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29e0103640 0x7f29e0199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:57.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.243+0000 7f29e6e9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29e0103fe0 0x7f29e0199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:57.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.243+0000 7f29e6e9b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f29e010e210 con 0x7f29e0103fe0 2024-09-21T00:56:57.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.243+0000 7f29e6e9b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f29e010e090 con 0x7f29e0103640 2024-09-21T00:56:57.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.243+0000 7f29e6e9b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f29e010e390 con 0x7f29e01025c0 2024-09-21T00:56:57.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.243+0000 7f29e5438640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29e0103fe0 0x7f29e0199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:57.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.244+0000 7f29e5438640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29e0103fe0 0x7f29e0199ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40010/0 (socket says 172.21.15.1:40010) 2024-09-21T00:56:57.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.244+0000 7f29e5438640 1 -- 172.21.15.1:0/3666074970 learned_addr learned my addr 172.21.15.1:0/3666074970 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:57.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.244+0000 7f29dffff640 1 --2- 172.21.15.1:0/3666074970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29e0103640 0x7f29e0199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:57.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.244+0000 7f29e4c37640 1 --2- 172.21.15.1:0/3666074970 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f29e01025c0 0x7f29e0198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:57.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.244+0000 7f29e5438640 1 -- 172.21.15.1:0/3666074970 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f29e01025c0 msgr2=0x7f29e0198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:57.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.244+0000 7f29e5438640 1 --2- 172.21.15.1:0/3666074970 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f29e01025c0 0x7f29e0198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:57.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.244+0000 7f29e5438640 1 -- 172.21.15.1:0/3666074970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29e0103640 msgr2=0x7f29e0199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:57.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.244+0000 7f29e5438640 1 --2- 172.21.15.1:0/3666074970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29e0103640 0x7f29e0199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:57.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.244+0000 7f29e5438640 1 -- 172.21.15.1:0/3666074970 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e019a810 con 0x7f29e0103fe0 2024-09-21T00:56:57.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.244+0000 7f29e5438640 1 --2- 172.21.15.1:0/3666074970 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29e0103fe0 0x7f29e0199ff0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f29d80097b0 tx=0x7f29d8003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:57.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.244+0000 7f29ddffb640 1 -- 172.21.15.1:0/3666074970 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d8004240 con 0x7f29e0103fe0 2024-09-21T00:56:57.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.244+0000 7f29e6e9b640 1 -- 172.21.15.1:0/3666074970 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29e019aaa0 con 0x7f29e0103fe0 2024-09-21T00:56:57.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.244+0000 7f29ddffb640 1 -- 172.21.15.1:0/3666074970 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29d802f310 con 0x7f29e0103fe0 2024-09-21T00:56:57.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.244+0000 7f29ddffb640 1 -- 172.21.15.1:0/3666074970 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d802fb50 con 0x7f29e0103fe0 2024-09-21T00:56:57.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.245+0000 7f29e6e9b640 1 -- 172.21.15.1:0/3666074970 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29e01a11f0 con 0x7f29e0103fe0 2024-09-21T00:56:57.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.245+0000 7f29e6e9b640 1 -- 172.21.15.1:0/3666074970 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29e0109770 con 0x7f29e0103fe0 2024-09-21T00:56:57.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.247+0000 7f29ddffb640 1 -- 172.21.15.1:0/3666074970 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 154562+0+0 (secure 0 0 0) 0x7f29d802fd50 con 0x7f29e0103fe0 2024-09-21T00:56:57.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.248+0000 7f29ddffb640 1 --2- 172.21.15.1:0/3666074970 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f29cc0b65a0 0x7f29cc0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:57.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.248+0000 7f29ddffb640 1 -- 172.21.15.1:0/3666074970 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f29d8108ac0 con 0x7f29e0103fe0 2024-09-21T00:56:57.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.248+0000 7f29e4c37640 1 --2- 172.21.15.1:0/3666074970 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f29cc0b65a0 0x7f29cc0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:57.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.249+0000 7f29e4c37640 1 --2- 172.21.15.1:0/3666074970 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f29cc0b65a0 0x7f29cc0b8ab0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f29d0005d00 tx=0x7f29d0005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:57.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.251+0000 7f29ddffb640 1 -- 172.21.15.1:0/3666074970 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f29d80cf1d0 con 0x7f29e0103fe0 2024-09-21T00:56:57.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.434+0000 7f29e6e9b640 1 -- 172.21.15.1:0/3666074970 --> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f29e0063800 con 0x7f29cc0b65a0 2024-09-21T00:56:57.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.438+0000 7f29ddffb640 1 -- 172.21.15.1:0/3666074970 <== mgr.14150 v2:172.21.15.1:6800/2032980330 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259179 (secure 0 0 0) 0x7f29e0063800 con 0x7f29cc0b65a0 2024-09-21T00:56:57.441 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:56:57.443 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-21T00:56:57.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.441+0000 7f29e6e9b640 1 -- 172.21.15.1:0/3666074970 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f29cc0b65a0 msgr2=0x7f29cc0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:57.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.441+0000 7f29e6e9b640 1 --2- 172.21.15.1:0/3666074970 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f29cc0b65a0 0x7f29cc0b8ab0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f29d0005d00 tx=0x7f29d0005c50 comp rx=0 tx=0).stop 2024-09-21T00:56:57.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.441+0000 7f29e6e9b640 1 -- 172.21.15.1:0/3666074970 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29e0103fe0 msgr2=0x7f29e0199ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:57.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.441+0000 7f29e6e9b640 1 --2- 172.21.15.1:0/3666074970 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29e0103fe0 0x7f29e0199ff0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f29d80097b0 tx=0x7f29d8003c20 comp rx=0 tx=0).stop 2024-09-21T00:56:57.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.441+0000 7f29e6e9b640 1 -- 172.21.15.1:0/3666074970 shutdown_connections 2024-09-21T00:56:57.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.441+0000 7f29e6e9b640 1 --2- 172.21.15.1:0/3666074970 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f29cc0b65a0 0x7f29cc0b8ab0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:57.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.441+0000 7f29e6e9b640 1 --2- 172.21.15.1:0/3666074970 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29e0103fe0 0x7f29e0199ff0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:57.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.441+0000 7f29e6e9b640 1 --2- 172.21.15.1:0/3666074970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29e0103640 0x7f29e0199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:57.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.441+0000 7f29e6e9b640 1 --2- 172.21.15.1:0/3666074970 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f29e01025c0 0x7f29e0198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:57.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.441+0000 7f29e6e9b640 1 -- 172.21.15.1:0/3666074970 >> 172.21.15.1:0/3666074970 conn(0x7f29e00fdf00 msgr2=0x7f29e0106940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:57.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.441+0000 7f29e6e9b640 1 -- 172.21.15.1:0/3666074970 shutdown_connections 2024-09-21T00:56:57.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:57.441+0000 7f29e6e9b640 1 -- 172.21.15.1:0/3666074970 wait complete. 2024-09-21T00:56:57.453 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":350,"stamp":"2024-09-21T00:56:56.113518+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":668219,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1152,"num_read_kb":670,"num_write":383,"num_write_kb":2309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":3011044,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":816,"ondisk_log_size":816,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":380192,"kb_used_data":10144,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124561632,"statfs":{"total":1151940427776,"available":1151551111168,"internally_reserved":0,"allocated":10387456,"data_stored":6729979,"data_compressed":190923,"data_compressed_allocated":253952,"data_compressed_original":2039808,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6533,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":57,"num_write":8,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002999"},"pg_stats":[{"pgid":"3.3f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.471768+0000","last_change":"2024-09-21T00:54:57.879464+0000","last_active":"2024-09-21T00:56:26.471768+0000","last_peered":"2024-09-21T00:56:26.471768+0000","last_clean":"2024-09-21T00:56:26.471768+0000","last_became_active":"2024-09-21T00:54:57.878480+0000","last_became_peered":"2024-09-21T00:54:57.878480+0000","last_unstale":"2024-09-21T00:56:26.471768+0000","last_undegraded":"2024-09-21T00:56:26.471768+0000","last_fullsized":"2024-09-21T00:56:26.471768+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:28.056410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.471466+0000","last_change":"2024-09-21T00:54:57.866876+0000","last_active":"2024-09-21T00:56:26.471466+0000","last_peered":"2024-09-21T00:56:26.471466+0000","last_clean":"2024-09-21T00:56:26.471466+0000","last_became_active":"2024-09-21T00:54:57.866532+0000","last_became_peered":"2024-09-21T00:54:57.866532+0000","last_unstale":"2024-09-21T00:56:26.471466+0000","last_undegraded":"2024-09-21T00:56:26.471466+0000","last_fullsized":"2024-09-21T00:56:26.471466+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:15:58.881955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.491312+0000","last_change":"2024-09-21T00:54:57.874814+0000","last_active":"2024-09-21T00:56:26.491312+0000","last_peered":"2024-09-21T00:56:26.491312+0000","last_clean":"2024-09-21T00:56:26.491312+0000","last_became_active":"2024-09-21T00:54:57.873918+0000","last_became_peered":"2024-09-21T00:54:57.873918+0000","last_unstale":"2024-09-21T00:56:26.491312+0000","last_undegraded":"2024-09-21T00:56:26.491312+0000","last_fullsized":"2024-09-21T00:56:26.491312+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:14.677826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.475142+0000","last_change":"2024-09-21T00:54:57.877268+0000","last_active":"2024-09-21T00:56:26.475142+0000","last_peered":"2024-09-21T00:56:26.475142+0000","last_clean":"2024-09-21T00:56:26.475142+0000","last_became_active":"2024-09-21T00:54:57.876769+0000","last_became_peered":"2024-09-21T00:54:57.876769+0000","last_unstale":"2024-09-21T00:56:26.475142+0000","last_undegraded":"2024-09-21T00:56:26.475142+0000","last_fullsized":"2024-09-21T00:56:26.475142+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:27:02.534562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.470265+0000","last_change":"2024-09-21T00:54:57.872956+0000","last_active":"2024-09-21T00:56:26.470265+0000","last_peered":"2024-09-21T00:56:26.470265+0000","last_clean":"2024-09-21T00:56:26.470265+0000","last_became_active":"2024-09-21T00:54:57.872563+0000","last_became_peered":"2024-09-21T00:54:57.872563+0000","last_unstale":"2024-09-21T00:56:26.470265+0000","last_undegraded":"2024-09-21T00:56:26.470265+0000","last_fullsized":"2024-09-21T00:56:26.470265+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:47.776888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.492213+0000","last_change":"2024-09-21T00:54:57.870285+0000","last_active":"2024-09-21T00:56:26.492213+0000","last_peered":"2024-09-21T00:56:26.492213+0000","last_clean":"2024-09-21T00:56:26.492213+0000","last_became_active":"2024-09-21T00:54:57.869689+0000","last_became_peered":"2024-09-21T00:54:57.869689+0000","last_unstale":"2024-09-21T00:56:26.492213+0000","last_undegraded":"2024-09-21T00:56:26.492213+0000","last_fullsized":"2024-09-21T00:56:26.492213+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:54.304589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.485352+0000","last_change":"2024-09-21T00:54:57.868515+0000","last_active":"2024-09-21T00:56:26.485352+0000","last_peered":"2024-09-21T00:56:26.485352+0000","last_clean":"2024-09-21T00:56:26.485352+0000","last_became_active":"2024-09-21T00:54:57.868130+0000","last_became_peered":"2024-09-21T00:54:57.868130+0000","last_unstale":"2024-09-21T00:56:26.485352+0000","last_undegraded":"2024-09-21T00:56:26.485352+0000","last_fullsized":"2024-09-21T00:56:26.485352+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:45.482119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.465611+0000","last_change":"2024-09-21T00:54:57.869386+0000","last_active":"2024-09-21T00:56:26.465611+0000","last_peered":"2024-09-21T00:56:26.465611+0000","last_clean":"2024-09-21T00:56:26.465611+0000","last_became_active":"2024-09-21T00:54:57.869033+0000","last_became_peered":"2024-09-21T00:54:57.869033+0000","last_unstale":"2024-09-21T00:56:26.465611+0000","last_undegraded":"2024-09-21T00:56:26.465611+0000","last_fullsized":"2024-09-21T00:56:26.465611+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:39:01.305815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.478706+0000","last_change":"2024-09-21T00:54:57.870703+0000","last_active":"2024-09-21T00:56:26.478706+0000","last_peered":"2024-09-21T00:56:26.478706+0000","last_clean":"2024-09-21T00:56:26.478706+0000","last_became_active":"2024-09-21T00:54:57.870324+0000","last_became_peered":"2024-09-21T00:54:57.870324+0000","last_unstale":"2024-09-21T00:56:26.478706+0000","last_undegraded":"2024-09-21T00:56:26.478706+0000","last_fullsized":"2024-09-21T00:56:26.478706+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:50.548296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"75'16","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.492991+0000","last_change":"2024-09-21T00:54:57.869803+0000","last_active":"2024-09-21T00:56:26.492991+0000","last_peered":"2024-09-21T00:56:26.492991+0000","last_clean":"2024-09-21T00:56:26.492991+0000","last_became_active":"2024-09-21T00:54:57.869092+0000","last_became_peered":"2024-09-21T00:54:57.869092+0000","last_unstale":"2024-09-21T00:56:26.492991+0000","last_undegraded":"2024-09-21T00:56:26.492991+0000","last_fullsized":"2024-09-21T00:56:26.492991+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:05:27.727914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.490169+0000","last_change":"2024-09-21T00:54:57.873700+0000","last_active":"2024-09-21T00:56:26.490169+0000","last_peered":"2024-09-21T00:56:26.490169+0000","last_clean":"2024-09-21T00:56:26.490169+0000","last_became_active":"2024-09-21T00:54:57.873336+0000","last_became_peered":"2024-09-21T00:54:57.873336+0000","last_unstale":"2024-09-21T00:56:26.490169+0000","last_undegraded":"2024-09-21T00:56:26.490169+0000","last_fullsized":"2024-09-21T00:56:26.490169+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:28:17.520669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.477610+0000","last_change":"2024-09-21T00:54:57.877686+0000","last_active":"2024-09-21T00:56:26.477610+0000","last_peered":"2024-09-21T00:56:26.477610+0000","last_clean":"2024-09-21T00:56:26.477610+0000","last_became_active":"2024-09-21T00:54:57.876711+0000","last_became_peered":"2024-09-21T00:54:57.876711+0000","last_unstale":"2024-09-21T00:56:26.477610+0000","last_undegraded":"2024-09-21T00:56:26.477610+0000","last_fullsized":"2024-09-21T00:56:26.477610+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:20:11.254680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.478190+0000","last_change":"2024-09-21T00:54:57.880660+0000","last_active":"2024-09-21T00:56:26.478190+0000","last_peered":"2024-09-21T00:56:26.478190+0000","last_clean":"2024-09-21T00:56:26.478190+0000","last_became_active":"2024-09-21T00:54:57.880270+0000","last_became_peered":"2024-09-21T00:54:57.880270+0000","last_unstale":"2024-09-21T00:56:26.478190+0000","last_undegraded":"2024-09-21T00:56:26.478190+0000","last_fullsized":"2024-09-21T00:56:26.478190+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:50:16.260484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.480243+0000","last_change":"2024-09-21T00:54:57.869626+0000","last_active":"2024-09-21T00:56:26.480243+0000","last_peered":"2024-09-21T00:56:26.480243+0000","last_clean":"2024-09-21T00:56:26.480243+0000","last_became_active":"2024-09-21T00:54:57.869230+0000","last_became_peered":"2024-09-21T00:54:57.869230+0000","last_unstale":"2024-09-21T00:56:26.480243+0000","last_undegraded":"2024-09-21T00:56:26.480243+0000","last_fullsized":"2024-09-21T00:56:26.480243+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:49.131237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.480008+0000","last_change":"2024-09-21T00:54:57.874917+0000","last_active":"2024-09-21T00:56:26.480008+0000","last_peered":"2024-09-21T00:56:26.480008+0000","last_clean":"2024-09-21T00:56:26.480008+0000","last_became_active":"2024-09-21T00:54:57.873787+0000","last_became_peered":"2024-09-21T00:54:57.873787+0000","last_unstale":"2024-09-21T00:56:26.480008+0000","last_undegraded":"2024-09-21T00:56:26.480008+0000","last_fullsized":"2024-09-21T00:56:26.480008+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:44.226734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.488049+0000","last_change":"2024-09-21T00:54:57.877479+0000","last_active":"2024-09-21T00:56:26.488049+0000","last_peered":"2024-09-21T00:56:26.488049+0000","last_clean":"2024-09-21T00:56:26.488049+0000","last_became_active":"2024-09-21T00:54:57.877110+0000","last_became_peered":"2024-09-21T00:54:57.877110+0000","last_unstale":"2024-09-21T00:56:26.488049+0000","last_undegraded":"2024-09-21T00:56:26.488049+0000","last_fullsized":"2024-09-21T00:56:26.488049+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:18.547970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.472045+0000","last_change":"2024-09-21T00:54:57.878701+0000","last_active":"2024-09-21T00:56:26.472045+0000","last_peered":"2024-09-21T00:56:26.472045+0000","last_clean":"2024-09-21T00:56:26.472045+0000","last_became_active":"2024-09-21T00:54:57.878254+0000","last_became_peered":"2024-09-21T00:54:57.878254+0000","last_unstale":"2024-09-21T00:56:26.472045+0000","last_undegraded":"2024-09-21T00:56:26.472045+0000","last_fullsized":"2024-09-21T00:56:26.472045+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:51.309956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.488891+0000","last_change":"2024-09-21T00:54:57.869571+0000","last_active":"2024-09-21T00:56:26.488891+0000","last_peered":"2024-09-21T00:56:26.488891+0000","last_clean":"2024-09-21T00:56:26.488891+0000","last_became_active":"2024-09-21T00:54:57.868907+0000","last_became_peered":"2024-09-21T00:54:57.868907+0000","last_unstale":"2024-09-21T00:56:26.488891+0000","last_undegraded":"2024-09-21T00:56:26.488891+0000","last_fullsized":"2024-09-21T00:56:26.488891+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:14.951885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.478711+0000","last_change":"2024-09-21T00:54:57.869277+0000","last_active":"2024-09-21T00:56:26.478711+0000","last_peered":"2024-09-21T00:56:26.478711+0000","last_clean":"2024-09-21T00:56:26.478711+0000","last_became_active":"2024-09-21T00:54:57.868777+0000","last_became_peered":"2024-09-21T00:54:57.868777+0000","last_unstale":"2024-09-21T00:56:26.478711+0000","last_undegraded":"2024-09-21T00:56:26.478711+0000","last_fullsized":"2024-09-21T00:56:26.478711+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:09:04.766266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"75'8","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.466568+0000","last_change":"2024-09-21T00:55:27.641451+0000","last_active":"2024-09-21T00:56:26.466568+0000","last_peered":"2024-09-21T00:56:26.466568+0000","last_clean":"2024-09-21T00:56:26.466568+0000","last_became_active":"2024-09-21T00:55:27.640253+0000","last_became_peered":"2024-09-21T00:55:27.640253+0000","last_unstale":"2024-09-21T00:56:26.466568+0000","last_undegraded":"2024-09-21T00:56:26.466568+0000","last_fullsized":"2024-09-21T00:56:26.466568+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:34.064803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.488328+0000","last_change":"2024-09-21T00:54:57.871236+0000","last_active":"2024-09-21T00:56:26.488328+0000","last_peered":"2024-09-21T00:56:26.488328+0000","last_clean":"2024-09-21T00:56:26.488328+0000","last_became_active":"2024-09-21T00:54:57.870131+0000","last_became_peered":"2024-09-21T00:54:57.870131+0000","last_unstale":"2024-09-21T00:56:26.488328+0000","last_undegraded":"2024-09-21T00:56:26.488328+0000","last_fullsized":"2024-09-21T00:56:26.488328+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:45.067436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.487776+0000","last_change":"2024-09-21T00:54:57.878710+0000","last_active":"2024-09-21T00:56:26.487776+0000","last_peered":"2024-09-21T00:56:26.487776+0000","last_clean":"2024-09-21T00:56:26.487776+0000","last_became_active":"2024-09-21T00:54:57.878352+0000","last_became_peered":"2024-09-21T00:54:57.878352+0000","last_unstale":"2024-09-21T00:56:26.487776+0000","last_undegraded":"2024-09-21T00:56:26.487776+0000","last_fullsized":"2024-09-21T00:56:26.487776+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:32:40.561028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.477959+0000","last_change":"2024-09-21T00:54:57.873226+0000","last_active":"2024-09-21T00:56:26.477959+0000","last_peered":"2024-09-21T00:56:26.477959+0000","last_clean":"2024-09-21T00:56:26.477959+0000","last_became_active":"2024-09-21T00:54:57.872840+0000","last_became_peered":"2024-09-21T00:54:57.872840+0000","last_unstale":"2024-09-21T00:56:26.477959+0000","last_undegraded":"2024-09-21T00:56:26.477959+0000","last_fullsized":"2024-09-21T00:56:26.477959+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:41.259070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"75'6","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.475280+0000","last_change":"2024-09-21T00:55:28.430095+0000","last_active":"2024-09-21T00:56:26.475280+0000","last_peered":"2024-09-21T00:56:26.475280+0000","last_clean":"2024-09-21T00:56:26.475280+0000","last_became_active":"2024-09-21T00:55:28.429650+0000","last_became_peered":"2024-09-21T00:55:28.429650+0000","last_unstale":"2024-09-21T00:56:26.475280+0000","last_undegraded":"2024-09-21T00:56:26.475280+0000","last_fullsized":"2024-09-21T00:56:26.475280+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:18:14.994333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,3],"acting":[6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"75'2","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.468932+0000","last_change":"2024-09-21T00:55:27.961107+0000","last_active":"2024-09-21T00:56:26.468932+0000","last_peered":"2024-09-21T00:56:26.468932+0000","last_clean":"2024-09-21T00:56:26.468932+0000","last_became_active":"2024-09-21T00:55:27.960673+0000","last_became_peered":"2024-09-21T00:55:27.960673+0000","last_unstale":"2024-09-21T00:56:26.468932+0000","last_undegraded":"2024-09-21T00:56:26.468932+0000","last_fullsized":"2024-09-21T00:56:26.468932+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:30.418190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.26","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.477365+0000","last_change":"2024-09-21T00:54:57.870994+0000","last_active":"2024-09-21T00:56:26.477365+0000","last_peered":"2024-09-21T00:56:26.477365+0000","last_clean":"2024-09-21T00:56:26.477365+0000","last_became_active":"2024-09-21T00:54:57.867939+0000","last_became_peered":"2024-09-21T00:54:57.867939+0000","last_unstale":"2024-09-21T00:56:26.477365+0000","last_undegraded":"2024-09-21T00:56:26.477365+0000","last_fullsized":"2024-09-21T00:56:26.477365+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:44.858289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.466876+0000","last_change":"2024-09-21T00:54:57.870568+0000","last_active":"2024-09-21T00:56:26.466876+0000","last_peered":"2024-09-21T00:56:26.466876+0000","last_clean":"2024-09-21T00:56:26.466876+0000","last_became_active":"2024-09-21T00:54:57.870208+0000","last_became_peered":"2024-09-21T00:54:57.870208+0000","last_unstale":"2024-09-21T00:56:26.466876+0000","last_undegraded":"2024-09-21T00:56:26.466876+0000","last_fullsized":"2024-09-21T00:56:26.466876+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:28:09.824385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.481877+0000","last_change":"2024-09-21T00:54:57.870228+0000","last_active":"2024-09-21T00:56:26.481877+0000","last_peered":"2024-09-21T00:56:26.481877+0000","last_clean":"2024-09-21T00:56:26.481877+0000","last_became_active":"2024-09-21T00:54:57.869866+0000","last_became_peered":"2024-09-21T00:54:57.869866+0000","last_unstale":"2024-09-21T00:56:26.481877+0000","last_undegraded":"2024-09-21T00:56:26.481877+0000","last_fullsized":"2024-09-21T00:56:26.481877+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:20.073393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.480806+0000","last_change":"2024-09-21T00:54:57.867602+0000","last_active":"2024-09-21T00:56:26.480806+0000","last_peered":"2024-09-21T00:56:26.480806+0000","last_clean":"2024-09-21T00:56:26.480806+0000","last_became_active":"2024-09-21T00:54:57.867104+0000","last_became_peered":"2024-09-21T00:54:57.867104+0000","last_unstale":"2024-09-21T00:56:26.480806+0000","last_undegraded":"2024-09-21T00:56:26.480806+0000","last_fullsized":"2024-09-21T00:56:26.480806+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:29:37.403384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.480052+0000","last_change":"2024-09-21T00:54:57.869400+0000","last_active":"2024-09-21T00:56:26.480052+0000","last_peered":"2024-09-21T00:56:26.480052+0000","last_clean":"2024-09-21T00:56:26.480052+0000","last_became_active":"2024-09-21T00:54:57.868997+0000","last_became_peered":"2024-09-21T00:54:57.868997+0000","last_unstale":"2024-09-21T00:56:26.480052+0000","last_undegraded":"2024-09-21T00:56:26.480052+0000","last_fullsized":"2024-09-21T00:56:26.480052+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:00.117559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"75'12","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.481462+0000","last_change":"2024-09-21T00:54:57.867392+0000","last_active":"2024-09-21T00:56:26.481462+0000","last_peered":"2024-09-21T00:56:26.481462+0000","last_clean":"2024-09-21T00:56:26.481462+0000","last_became_active":"2024-09-21T00:54:57.867001+0000","last_became_peered":"2024-09-21T00:54:57.867001+0000","last_unstale":"2024-09-21T00:56:26.481462+0000","last_undegraded":"2024-09-21T00:56:26.481462+0000","last_fullsized":"2024-09-21T00:56:26.481462+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:05.090149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.473865+0000","last_change":"2024-09-21T00:54:57.867620+0000","last_active":"2024-09-21T00:56:26.473865+0000","last_peered":"2024-09-21T00:56:26.473865+0000","last_clean":"2024-09-21T00:56:26.473865+0000","last_became_active":"2024-09-21T00:54:57.867190+0000","last_became_peered":"2024-09-21T00:54:57.867190+0000","last_unstale":"2024-09-21T00:56:26.473865+0000","last_undegraded":"2024-09-21T00:56:26.473865+0000","last_fullsized":"2024-09-21T00:56:26.473865+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:36.432368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.476445+0000","last_change":"2024-09-21T00:54:57.880526+0000","last_active":"2024-09-21T00:56:26.476445+0000","last_peered":"2024-09-21T00:56:26.476445+0000","last_clean":"2024-09-21T00:56:26.476445+0000","last_became_active":"2024-09-21T00:54:57.880154+0000","last_became_peered":"2024-09-21T00:54:57.880154+0000","last_unstale":"2024-09-21T00:56:26.476445+0000","last_undegraded":"2024-09-21T00:56:26.476445+0000","last_fullsized":"2024-09-21T00:56:26.476445+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:56.179127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'5","reported_seq":133,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:50.739529+0000","last_change":"2024-09-21T00:54:55.867717+0000","last_active":"2024-09-21T00:56:50.739529+0000","last_peered":"2024-09-21T00:56:50.739529+0000","last_clean":"2024-09-21T00:56:50.739529+0000","last_became_active":"2024-09-21T00:54:55.867306+0000","last_became_peered":"2024-09-21T00:54:55.867306+0000","last_unstale":"2024-09-21T00:56:50.739529+0000","last_undegraded":"2024-09-21T00:56:50.739529+0000","last_fullsized":"2024-09-21T00:56:50.739529+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:25.192109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.476378+0000","last_change":"2024-09-21T00:54:57.879034+0000","last_active":"2024-09-21T00:56:26.476378+0000","last_peered":"2024-09-21T00:56:26.476378+0000","last_clean":"2024-09-21T00:56:26.476378+0000","last_became_active":"2024-09-21T00:54:57.878673+0000","last_became_peered":"2024-09-21T00:54:57.878673+0000","last_unstale":"2024-09-21T00:56:26.476378+0000","last_undegraded":"2024-09-21T00:56:26.476378+0000","last_fullsized":"2024-09-21T00:56:26.476378+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:39:12.467465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'7","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.633751+0000","last_change":"2024-09-21T00:54:55.867451+0000","last_active":"2024-09-21T00:55:27.633751+0000","last_peered":"2024-09-21T00:55:27.633751+0000","last_clean":"2024-09-21T00:55:27.633751+0000","last_became_active":"2024-09-21T00:54:55.866998+0000","last_became_peered":"2024-09-21T00:54:55.866998+0000","last_unstale":"2024-09-21T00:55:27.633751+0000","last_undegraded":"2024-09-21T00:55:27.633751+0000","last_fullsized":"2024-09-21T00:55:27.633751+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:40.878647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.634072+0000","last_change":"2024-09-21T00:54:55.853055+0000","last_active":"2024-09-21T00:55:27.634072+0000","last_peered":"2024-09-21T00:55:27.634072+0000","last_clean":"2024-09-21T00:55:27.634072+0000","last_became_active":"2024-09-21T00:54:55.852672+0000","last_became_peered":"2024-09-21T00:54:55.852672+0000","last_unstale":"2024-09-21T00:55:27.634072+0000","last_undegraded":"2024-09-21T00:55:27.634072+0000","last_fullsized":"2024-09-21T00:55:27.634072+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:17.082588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.469740+0000","last_change":"2024-09-21T00:54:57.875024+0000","last_active":"2024-09-21T00:56:26.469740+0000","last_peered":"2024-09-21T00:56:26.469740+0000","last_clean":"2024-09-21T00:56:26.469740+0000","last_became_active":"2024-09-21T00:54:57.870027+0000","last_became_peered":"2024-09-21T00:54:57.870027+0000","last_unstale":"2024-09-21T00:56:26.469740+0000","last_undegraded":"2024-09-21T00:56:26.469740+0000","last_fullsized":"2024-09-21T00:56:26.469740+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:37:48.880686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.650846+0000","last_change":"2024-09-21T00:54:55.864527+0000","last_active":"2024-09-21T00:55:27.650846+0000","last_peered":"2024-09-21T00:55:27.650846+0000","last_clean":"2024-09-21T00:55:27.650846+0000","last_became_active":"2024-09-21T00:54:55.864191+0000","last_became_peered":"2024-09-21T00:54:55.864191+0000","last_unstale":"2024-09-21T00:55:27.650846+0000","last_undegraded":"2024-09-21T00:55:27.650846+0000","last_fullsized":"2024-09-21T00:55:27.650846+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:43.781116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.470933+0000","last_change":"2024-09-21T00:54:57.865671+0000","last_active":"2024-09-21T00:56:26.470933+0000","last_peered":"2024-09-21T00:56:26.470933+0000","last_clean":"2024-09-21T00:56:26.470933+0000","last_became_active":"2024-09-21T00:54:57.865196+0000","last_became_peered":"2024-09-21T00:54:57.865196+0000","last_unstale":"2024-09-21T00:56:26.470933+0000","last_undegraded":"2024-09-21T00:56:26.470933+0000","last_fullsized":"2024-09-21T00:56:26.470933+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:16.524866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'6","reported_seq":237,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:52.741999+0000","last_change":"2024-09-21T00:54:55.862504+0000","last_active":"2024-09-21T00:56:52.741999+0000","last_peered":"2024-09-21T00:56:52.741999+0000","last_clean":"2024-09-21T00:56:52.741999+0000","last_became_active":"2024-09-21T00:54:55.862065+0000","last_became_peered":"2024-09-21T00:54:55.862065+0000","last_unstale":"2024-09-21T00:56:52.741999+0000","last_undegraded":"2024-09-21T00:56:52.741999+0000","last_fullsized":"2024-09-21T00:56:52.741999+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:16.497313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":208,"num_read_kb":208,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.491483+0000","last_change":"2024-09-21T00:54:57.873444+0000","last_active":"2024-09-21T00:56:26.491483+0000","last_peered":"2024-09-21T00:56:26.491483+0000","last_clean":"2024-09-21T00:56:26.491483+0000","last_became_active":"2024-09-21T00:54:57.873058+0000","last_became_peered":"2024-09-21T00:54:57.873058+0000","last_unstale":"2024-09-21T00:56:26.491483+0000","last_undegraded":"2024-09-21T00:56:26.491483+0000","last_fullsized":"2024-09-21T00:56:26.491483+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:36:40.603285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'4","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.967374+0000","last_change":"2024-09-21T00:55:27.967238+0000","last_active":"2024-09-21T00:55:27.967374+0000","last_peered":"2024-09-21T00:55:27.967374+0000","last_clean":"2024-09-21T00:55:27.967374+0000","last_became_active":"2024-09-21T00:55:27.962082+0000","last_became_peered":"2024-09-21T00:55:27.962082+0000","last_unstale":"2024-09-21T00:55:27.967374+0000","last_undegraded":"2024-09-21T00:55:27.967374+0000","last_fullsized":"2024-09-21T00:55:27.967374+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:02.943108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"75'9","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.480891+0000","last_change":"2024-09-21T00:55:27.652838+0000","last_active":"2024-09-21T00:56:26.480891+0000","last_peered":"2024-09-21T00:56:26.480891+0000","last_clean":"2024-09-21T00:56:26.480891+0000","last_became_active":"2024-09-21T00:55:27.652401+0000","last_became_peered":"2024-09-21T00:55:27.652401+0000","last_unstale":"2024-09-21T00:56:26.480891+0000","last_undegraded":"2024-09-21T00:56:26.480891+0000","last_fullsized":"2024-09-21T00:56:26.480891+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:53:33.968079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.651540+0000","last_change":"2024-09-21T00:54:55.968782+0000","last_active":"2024-09-21T00:55:27.651540+0000","last_peered":"2024-09-21T00:55:27.651540+0000","last_clean":"2024-09-21T00:55:27.651540+0000","last_became_active":"2024-09-21T00:54:55.968421+0000","last_became_peered":"2024-09-21T00:54:55.968421+0000","last_unstale":"2024-09-21T00:55:27.651540+0000","last_undegraded":"2024-09-21T00:55:27.651540+0000","last_fullsized":"2024-09-21T00:55:27.651540+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:28.680764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.490303+0000","last_change":"2024-09-21T00:54:57.877610+0000","last_active":"2024-09-21T00:56:26.490303+0000","last_peered":"2024-09-21T00:56:26.490303+0000","last_clean":"2024-09-21T00:56:26.490303+0000","last_became_active":"2024-09-21T00:54:57.877225+0000","last_became_peered":"2024-09-21T00:54:57.877225+0000","last_unstale":"2024-09-21T00:56:26.490303+0000","last_undegraded":"2024-09-21T00:56:26.490303+0000","last_fullsized":"2024-09-21T00:56:26.490303+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:08.294366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'35","reported_seq":296,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:53.128142+0000","last_change":"2024-09-21T00:55:27.975731+0000","last_active":"2024-09-21T00:56:53.128142+0000","last_peered":"2024-09-21T00:56:53.128142+0000","last_clean":"2024-09-21T00:56:53.128142+0000","last_became_active":"2024-09-21T00:55:27.961766+0000","last_became_peered":"2024-09-21T00:55:27.961766+0000","last_unstale":"2024-09-21T00:56:53.128142+0000","last_undegraded":"2024-09-21T00:56:53.128142+0000","last_fullsized":"2024-09-21T00:56:53.128142+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:42:32.442882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69740,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":208,"num_read_kb":158,"num_write":37,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":59092,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.471618+0000","last_change":"2024-09-21T00:54:57.875575+0000","last_active":"2024-09-21T00:56:26.471618+0000","last_peered":"2024-09-21T00:56:26.471618+0000","last_clean":"2024-09-21T00:56:26.471618+0000","last_became_active":"2024-09-21T00:54:57.874975+0000","last_became_peered":"2024-09-21T00:54:57.874975+0000","last_unstale":"2024-09-21T00:56:26.471618+0000","last_undegraded":"2024-09-21T00:56:26.471618+0000","last_fullsized":"2024-09-21T00:56:26.471618+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:34:36.089068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'9","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637272+0000","last_change":"2024-09-21T00:54:55.863532+0000","last_active":"2024-09-21T00:55:27.637272+0000","last_peered":"2024-09-21T00:55:27.637272+0000","last_clean":"2024-09-21T00:55:27.637272+0000","last_became_active":"2024-09-21T00:54:55.863124+0000","last_became_peered":"2024-09-21T00:54:55.863124+0000","last_unstale":"2024-09-21T00:55:27.637272+0000","last_undegraded":"2024-09-21T00:55:27.637272+0000","last_fullsized":"2024-09-21T00:55:27.637272+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:41:07.996906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.485241+0000","last_change":"2024-09-21T00:54:57.866126+0000","last_active":"2024-09-21T00:56:26.485241+0000","last_peered":"2024-09-21T00:56:26.485241+0000","last_clean":"2024-09-21T00:56:26.485241+0000","last_became_active":"2024-09-21T00:54:57.865775+0000","last_became_peered":"2024-09-21T00:54:57.865775+0000","last_unstale":"2024-09-21T00:56:26.485241+0000","last_undegraded":"2024-09-21T00:56:26.485241+0000","last_fullsized":"2024-09-21T00:56:26.485241+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:28.261632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.651370+0000","last_change":"2024-09-21T00:54:55.864593+0000","last_active":"2024-09-21T00:55:27.651370+0000","last_peered":"2024-09-21T00:55:27.651370+0000","last_clean":"2024-09-21T00:55:27.651370+0000","last_became_active":"2024-09-21T00:54:55.864202+0000","last_became_peered":"2024-09-21T00:54:55.864202+0000","last_unstale":"2024-09-21T00:55:27.651370+0000","last_undegraded":"2024-09-21T00:55:27.651370+0000","last_fullsized":"2024-09-21T00:55:27.651370+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:06.976588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.486026+0000","last_change":"2024-09-21T00:54:57.877892+0000","last_active":"2024-09-21T00:56:26.486026+0000","last_peered":"2024-09-21T00:56:26.486026+0000","last_clean":"2024-09-21T00:56:26.486026+0000","last_became_active":"2024-09-21T00:54:57.877510+0000","last_became_peered":"2024-09-21T00:54:57.877510+0000","last_unstale":"2024-09-21T00:56:26.486026+0000","last_undegraded":"2024-09-21T00:56:26.486026+0000","last_fullsized":"2024-09-21T00:56:26.486026+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:05.238100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'7","reported_seq":138,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:51.741113+0000","last_change":"2024-09-21T00:54:55.856707+0000","last_active":"2024-09-21T00:56:51.741113+0000","last_peered":"2024-09-21T00:56:51.741113+0000","last_clean":"2024-09-21T00:56:51.741113+0000","last_became_active":"2024-09-21T00:54:55.856095+0000","last_became_peered":"2024-09-21T00:54:55.856095+0000","last_unstale":"2024-09-21T00:56:51.741113+0000","last_undegraded":"2024-09-21T00:56:51.741113+0000","last_fullsized":"2024-09-21T00:56:51.741113+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:48.332764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.492677+0000","last_change":"2024-09-21T00:54:57.868398+0000","last_active":"2024-09-21T00:56:26.492677+0000","last_peered":"2024-09-21T00:56:26.492677+0000","last_clean":"2024-09-21T00:56:26.492677+0000","last_became_active":"2024-09-21T00:54:57.867963+0000","last_became_peered":"2024-09-21T00:54:57.867963+0000","last_unstale":"2024-09-21T00:56:26.492677+0000","last_undegraded":"2024-09-21T00:56:26.492677+0000","last_fullsized":"2024-09-21T00:56:26.492677+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:59:31.527713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'17","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.659007+0000","last_change":"2024-09-21T00:55:27.658543+0000","last_active":"2024-09-21T00:55:27.659007+0000","last_peered":"2024-09-21T00:55:27.659007+0000","last_clean":"2024-09-21T00:55:27.659007+0000","last_became_active":"2024-09-21T00:55:27.639915+0000","last_became_peered":"2024-09-21T00:55:27.639915+0000","last_unstale":"2024-09-21T00:55:27.659007+0000","last_undegraded":"2024-09-21T00:55:27.659007+0000","last_fullsized":"2024-09-21T00:55:27.659007+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:51.736732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.469871+0000","last_change":"2024-09-21T00:54:57.872256+0000","last_active":"2024-09-21T00:56:26.469871+0000","last_peered":"2024-09-21T00:56:26.469871+0000","last_clean":"2024-09-21T00:56:26.469871+0000","last_became_active":"2024-09-21T00:54:57.871848+0000","last_became_peered":"2024-09-21T00:54:57.871848+0000","last_unstale":"2024-09-21T00:56:26.469871+0000","last_undegraded":"2024-09-21T00:56:26.469871+0000","last_fullsized":"2024-09-21T00:56:26.469871+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:24:11.314693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636721+0000","last_change":"2024-09-21T00:54:55.870096+0000","last_active":"2024-09-21T00:55:27.636721+0000","last_peered":"2024-09-21T00:55:27.636721+0000","last_clean":"2024-09-21T00:55:27.636721+0000","last_became_active":"2024-09-21T00:54:55.869616+0000","last_became_peered":"2024-09-21T00:54:55.869616+0000","last_unstale":"2024-09-21T00:55:27.636721+0000","last_undegraded":"2024-09-21T00:55:27.636721+0000","last_fullsized":"2024-09-21T00:55:27.636721+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:53:48.036499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"75'5","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.465530+0000","last_change":"2024-09-21T00:55:27.652960+0000","last_active":"2024-09-21T00:56:26.465530+0000","last_peered":"2024-09-21T00:56:26.465530+0000","last_clean":"2024-09-21T00:56:26.465530+0000","last_became_active":"2024-09-21T00:55:27.652420+0000","last_became_peered":"2024-09-21T00:55:27.652420+0000","last_unstale":"2024-09-21T00:56:26.465530+0000","last_undegraded":"2024-09-21T00:56:26.465530+0000","last_fullsized":"2024-09-21T00:56:26.465530+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:24.436368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'5","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.634222+0000","last_change":"2024-09-21T00:54:55.866393+0000","last_active":"2024-09-21T00:55:27.634222+0000","last_peered":"2024-09-21T00:55:27.634222+0000","last_clean":"2024-09-21T00:55:27.634222+0000","last_became_active":"2024-09-21T00:54:55.865980+0000","last_became_peered":"2024-09-21T00:54:55.865980+0000","last_unstale":"2024-09-21T00:55:27.634222+0000","last_undegraded":"2024-09-21T00:55:27.634222+0000","last_fullsized":"2024-09-21T00:55:27.634222+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:56.471011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.480433+0000","last_change":"2024-09-21T00:54:57.875177+0000","last_active":"2024-09-21T00:56:26.480433+0000","last_peered":"2024-09-21T00:56:26.480433+0000","last_clean":"2024-09-21T00:56:26.480433+0000","last_became_active":"2024-09-21T00:54:57.874819+0000","last_became_peered":"2024-09-21T00:54:57.874819+0000","last_unstale":"2024-09-21T00:56:26.480433+0000","last_undegraded":"2024-09-21T00:56:26.480433+0000","last_fullsized":"2024-09-21T00:56:26.480433+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:43.942703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.651656+0000","last_change":"2024-09-21T00:54:55.864668+0000","last_active":"2024-09-21T00:55:27.651656+0000","last_peered":"2024-09-21T00:55:27.651656+0000","last_clean":"2024-09-21T00:55:27.651656+0000","last_became_active":"2024-09-21T00:54:55.864330+0000","last_became_peered":"2024-09-21T00:54:55.864330+0000","last_unstale":"2024-09-21T00:55:27.651656+0000","last_undegraded":"2024-09-21T00:55:27.651656+0000","last_fullsized":"2024-09-21T00:55:27.651656+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:45:50.751390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.485352+0000","last_change":"2024-09-21T00:54:57.871093+0000","last_active":"2024-09-21T00:56:26.485352+0000","last_peered":"2024-09-21T00:56:26.485352+0000","last_clean":"2024-09-21T00:56:26.485352+0000","last_became_active":"2024-09-21T00:54:57.870457+0000","last_became_peered":"2024-09-21T00:54:57.870457+0000","last_unstale":"2024-09-21T00:56:26.485352+0000","last_undegraded":"2024-09-21T00:56:26.485352+0000","last_fullsized":"2024-09-21T00:56:26.485352+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:19.810575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'8","reported_seq":142,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:53.744561+0000","last_change":"2024-09-21T00:54:55.968156+0000","last_active":"2024-09-21T00:56:53.744561+0000","last_peered":"2024-09-21T00:56:53.744561+0000","last_clean":"2024-09-21T00:56:53.744561+0000","last_became_active":"2024-09-21T00:54:55.967668+0000","last_became_peered":"2024-09-21T00:54:55.967668+0000","last_unstale":"2024-09-21T00:56:53.744561+0000","last_undegraded":"2024-09-21T00:56:53.744561+0000","last_fullsized":"2024-09-21T00:56:53.744561+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:28.854249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2093,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.491789+0000","last_change":"2024-09-21T00:54:57.868187+0000","last_active":"2024-09-21T00:56:26.491789+0000","last_peered":"2024-09-21T00:56:26.491789+0000","last_clean":"2024-09-21T00:56:26.491789+0000","last_became_active":"2024-09-21T00:54:57.867709+0000","last_became_peered":"2024-09-21T00:54:57.867709+0000","last_unstale":"2024-09-21T00:56:26.491789+0000","last_undegraded":"2024-09-21T00:56:26.491789+0000","last_fullsized":"2024-09-21T00:56:26.491789+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:40.123030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":97,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636523+0000","last_change":"2024-09-21T00:53:44.515787+0000","last_active":"2024-09-21T00:55:27.636523+0000","last_peered":"2024-09-21T00:55:27.636523+0000","last_clean":"2024-09-21T00:55:27.636523+0000","last_became_active":"2024-09-21T00:53:44.510106+0000","last_became_peered":"2024-09-21T00:53:44.510106+0000","last_unstale":"2024-09-21T00:55:27.636523+0000","last_undegraded":"2024-09-21T00:55:27.636523+0000","last_fullsized":"2024-09-21T00:55:27.636523+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:50:16.598790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:50:16.598790+0000","last_clean_scrub_stamp":"2024-09-21T00:50:16.598790+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:04:14.481212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'6","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.958651+0000","last_change":"2024-09-21T00:54:55.854929+0000","last_active":"2024-09-21T00:55:27.958651+0000","last_peered":"2024-09-21T00:55:27.958651+0000","last_clean":"2024-09-21T00:55:27.958651+0000","last_became_active":"2024-09-21T00:54:55.854489+0000","last_became_peered":"2024-09-21T00:54:55.854489+0000","last_unstale":"2024-09-21T00:55:27.958651+0000","last_undegraded":"2024-09-21T00:55:27.958651+0000","last_fullsized":"2024-09-21T00:55:27.958651+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:03.067142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"75'8","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.488103+0000","last_change":"2024-09-21T00:55:27.652679+0000","last_active":"2024-09-21T00:56:26.488103+0000","last_peered":"2024-09-21T00:56:26.488103+0000","last_clean":"2024-09-21T00:56:26.488103+0000","last_became_active":"2024-09-21T00:55:27.652348+0000","last_became_peered":"2024-09-21T00:55:27.652348+0000","last_unstale":"2024-09-21T00:56:26.488103+0000","last_undegraded":"2024-09-21T00:56:26.488103+0000","last_fullsized":"2024-09-21T00:56:26.488103+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:11.974613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636440+0000","last_change":"2024-09-21T00:54:55.863265+0000","last_active":"2024-09-21T00:55:27.636440+0000","last_peered":"2024-09-21T00:55:27.636440+0000","last_clean":"2024-09-21T00:55:27.636440+0000","last_became_active":"2024-09-21T00:54:55.862613+0000","last_became_peered":"2024-09-21T00:54:55.862613+0000","last_unstale":"2024-09-21T00:55:27.636440+0000","last_undegraded":"2024-09-21T00:55:27.636440+0000","last_fullsized":"2024-09-21T00:55:27.636440+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:56.707143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.481311+0000","last_change":"2024-09-21T00:54:57.855249+0000","last_active":"2024-09-21T00:56:26.481311+0000","last_peered":"2024-09-21T00:56:26.481311+0000","last_clean":"2024-09-21T00:56:26.481311+0000","last_became_active":"2024-09-21T00:54:57.854879+0000","last_became_peered":"2024-09-21T00:54:57.854879+0000","last_unstale":"2024-09-21T00:56:26.481311+0000","last_undegraded":"2024-09-21T00:56:26.481311+0000","last_fullsized":"2024-09-21T00:56:26.481311+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:15.733514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'6","reported_seq":136,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:53.743453+0000","last_change":"2024-09-21T00:54:55.968078+0000","last_active":"2024-09-21T00:56:53.743453+0000","last_peered":"2024-09-21T00:56:53.743453+0000","last_clean":"2024-09-21T00:56:53.743453+0000","last_became_active":"2024-09-21T00:54:55.967700+0000","last_became_peered":"2024-09-21T00:54:55.967700+0000","last_unstale":"2024-09-21T00:56:53.743453+0000","last_undegraded":"2024-09-21T00:56:53.743453+0000","last_fullsized":"2024-09-21T00:56:53.743453+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:35.121889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":107,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.472754+0000","last_change":"2024-09-21T00:54:57.873224+0000","last_active":"2024-09-21T00:56:26.472754+0000","last_peered":"2024-09-21T00:56:26.472754+0000","last_clean":"2024-09-21T00:56:26.472754+0000","last_became_active":"2024-09-21T00:54:57.872828+0000","last_became_peered":"2024-09-21T00:54:57.872828+0000","last_unstale":"2024-09-21T00:56:26.472754+0000","last_undegraded":"2024-09-21T00:56:26.472754+0000","last_fullsized":"2024-09-21T00:56:26.472754+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:58:55.758620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'5","reported_seq":136,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:54.744660+0000","last_change":"2024-09-21T00:54:55.859887+0000","last_active":"2024-09-21T00:56:54.744660+0000","last_peered":"2024-09-21T00:56:54.744660+0000","last_clean":"2024-09-21T00:56:54.744660+0000","last_became_active":"2024-09-21T00:54:55.859351+0000","last_became_peered":"2024-09-21T00:54:55.859351+0000","last_unstale":"2024-09-21T00:56:54.744660+0000","last_undegraded":"2024-09-21T00:56:54.744660+0000","last_fullsized":"2024-09-21T00:56:54.744660+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:31.407409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.491962+0000","last_change":"2024-09-21T00:54:57.882568+0000","last_active":"2024-09-21T00:56:26.491962+0000","last_peered":"2024-09-21T00:56:26.491962+0000","last_clean":"2024-09-21T00:56:26.491962+0000","last_became_active":"2024-09-21T00:54:57.882190+0000","last_became_peered":"2024-09-21T00:54:57.882190+0000","last_unstale":"2024-09-21T00:56:26.491962+0000","last_undegraded":"2024-09-21T00:56:26.491962+0000","last_fullsized":"2024-09-21T00:56:26.491962+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:19.339490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.632817+0000","last_change":"2024-09-21T00:54:55.970154+0000","last_active":"2024-09-21T00:55:27.632817+0000","last_peered":"2024-09-21T00:55:27.632817+0000","last_clean":"2024-09-21T00:55:27.632817+0000","last_became_active":"2024-09-21T00:54:55.969774+0000","last_became_peered":"2024-09-21T00:54:55.969774+0000","last_unstale":"2024-09-21T00:55:27.632817+0000","last_undegraded":"2024-09-21T00:55:27.632817+0000","last_fullsized":"2024-09-21T00:55:27.632817+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:05.241455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.491963+0000","last_change":"2024-09-21T00:54:57.873452+0000","last_active":"2024-09-21T00:56:26.491963+0000","last_peered":"2024-09-21T00:56:26.491963+0000","last_clean":"2024-09-21T00:56:26.491963+0000","last_became_active":"2024-09-21T00:54:57.872592+0000","last_became_peered":"2024-09-21T00:54:57.872592+0000","last_unstale":"2024-09-21T00:56:26.491963+0000","last_undegraded":"2024-09-21T00:56:26.491963+0000","last_fullsized":"2024-09-21T00:56:26.491963+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:25.196491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637464+0000","last_change":"2024-09-21T00:54:55.968563+0000","last_active":"2024-09-21T00:55:27.637464+0000","last_peered":"2024-09-21T00:55:27.637464+0000","last_clean":"2024-09-21T00:55:27.637464+0000","last_became_active":"2024-09-21T00:54:55.968176+0000","last_became_peered":"2024-09-21T00:54:55.968176+0000","last_unstale":"2024-09-21T00:55:27.637464+0000","last_undegraded":"2024-09-21T00:55:27.637464+0000","last_fullsized":"2024-09-21T00:55:27.637464+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:35.120595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.482137+0000","last_change":"2024-09-21T00:54:57.862128+0000","last_active":"2024-09-21T00:56:26.482137+0000","last_peered":"2024-09-21T00:56:26.482137+0000","last_clean":"2024-09-21T00:56:26.482137+0000","last_became_active":"2024-09-21T00:54:57.861692+0000","last_became_peered":"2024-09-21T00:54:57.861692+0000","last_unstale":"2024-09-21T00:56:26.482137+0000","last_undegraded":"2024-09-21T00:56:26.482137+0000","last_fullsized":"2024-09-21T00:56:26.482137+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:58:29.364344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'16","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.632906+0000","last_change":"2024-09-21T00:54:55.866240+0000","last_active":"2024-09-21T00:55:27.632906+0000","last_peered":"2024-09-21T00:55:27.632906+0000","last_clean":"2024-09-21T00:55:27.632906+0000","last_became_active":"2024-09-21T00:54:55.865192+0000","last_became_peered":"2024-09-21T00:54:55.865192+0000","last_unstale":"2024-09-21T00:55:27.632906+0000","last_undegraded":"2024-09-21T00:55:27.632906+0000","last_fullsized":"2024-09-21T00:55:27.632906+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:53:17.599528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.487825+0000","last_change":"2024-09-21T00:54:57.878847+0000","last_active":"2024-09-21T00:56:26.487825+0000","last_peered":"2024-09-21T00:56:26.487825+0000","last_clean":"2024-09-21T00:56:26.487825+0000","last_became_active":"2024-09-21T00:54:57.878117+0000","last_became_peered":"2024-09-21T00:54:57.878117+0000","last_unstale":"2024-09-21T00:56:26.487825+0000","last_undegraded":"2024-09-21T00:56:26.487825+0000","last_fullsized":"2024-09-21T00:56:26.487825+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:46.090963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'7","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.958730+0000","last_change":"2024-09-21T00:54:55.854035+0000","last_active":"2024-09-21T00:55:27.958730+0000","last_peered":"2024-09-21T00:55:27.958730+0000","last_clean":"2024-09-21T00:55:27.958730+0000","last_became_active":"2024-09-21T00:54:55.853301+0000","last_became_peered":"2024-09-21T00:54:55.853301+0000","last_unstale":"2024-09-21T00:55:27.958730+0000","last_undegraded":"2024-09-21T00:55:27.958730+0000","last_fullsized":"2024-09-21T00:55:27.958730+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:11.498865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.480267+0000","last_change":"2024-09-21T00:54:57.875093+0000","last_active":"2024-09-21T00:56:26.480267+0000","last_peered":"2024-09-21T00:56:26.480267+0000","last_clean":"2024-09-21T00:56:26.480267+0000","last_became_active":"2024-09-21T00:54:57.873996+0000","last_became_peered":"2024-09-21T00:54:57.873996+0000","last_unstale":"2024-09-21T00:56:26.480267+0000","last_undegraded":"2024-09-21T00:56:26.480267+0000","last_fullsized":"2024-09-21T00:56:26.480267+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:17:55.990167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637124+0000","last_change":"2024-09-21T00:54:55.968507+0000","last_active":"2024-09-21T00:55:27.637124+0000","last_peered":"2024-09-21T00:55:27.637124+0000","last_clean":"2024-09-21T00:55:27.637124+0000","last_became_active":"2024-09-21T00:54:55.968084+0000","last_became_peered":"2024-09-21T00:54:55.968084+0000","last_unstale":"2024-09-21T00:55:27.637124+0000","last_undegraded":"2024-09-21T00:55:27.637124+0000","last_fullsized":"2024-09-21T00:55:27.637124+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:34:06.325264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.433503+0000","last_change":"2024-09-21T00:54:57.870500+0000","last_active":"2024-09-21T00:56:26.433503+0000","last_peered":"2024-09-21T00:56:26.433503+0000","last_clean":"2024-09-21T00:56:26.433503+0000","last_became_active":"2024-09-21T00:54:57.870103+0000","last_became_peered":"2024-09-21T00:54:57.870103+0000","last_unstale":"2024-09-21T00:56:26.433503+0000","last_undegraded":"2024-09-21T00:56:26.433503+0000","last_fullsized":"2024-09-21T00:56:26.433503+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:31:03.469863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'7","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:28.428026+0000","last_change":"2024-09-21T00:54:55.856185+0000","last_active":"2024-09-21T00:55:28.428026+0000","last_peered":"2024-09-21T00:55:28.428026+0000","last_clean":"2024-09-21T00:55:28.428026+0000","last_became_active":"2024-09-21T00:54:55.855738+0000","last_became_peered":"2024-09-21T00:54:55.855738+0000","last_unstale":"2024-09-21T00:55:28.428026+0000","last_undegraded":"2024-09-21T00:55:28.428026+0000","last_fullsized":"2024-09-21T00:55:28.428026+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:02.870874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.472850+0000","last_change":"2024-09-21T00:54:57.877828+0000","last_active":"2024-09-21T00:56:26.472850+0000","last_peered":"2024-09-21T00:56:26.472850+0000","last_clean":"2024-09-21T00:56:26.472850+0000","last_became_active":"2024-09-21T00:54:57.877414+0000","last_became_peered":"2024-09-21T00:54:57.877414+0000","last_unstale":"2024-09-21T00:56:26.472850+0000","last_undegraded":"2024-09-21T00:56:26.472850+0000","last_fullsized":"2024-09-21T00:56:26.472850+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:27.485830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.636953+0000","last_change":"2024-09-21T00:54:55.868014+0000","last_active":"2024-09-21T00:55:27.636953+0000","last_peered":"2024-09-21T00:55:27.636953+0000","last_clean":"2024-09-21T00:55:27.636953+0000","last_became_active":"2024-09-21T00:54:55.867640+0000","last_became_peered":"2024-09-21T00:54:55.867640+0000","last_unstale":"2024-09-21T00:55:27.636953+0000","last_undegraded":"2024-09-21T00:55:27.636953+0000","last_fullsized":"2024-09-21T00:55:27.636953+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:24:57.118238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.470306+0000","last_change":"2024-09-21T00:54:57.881935+0000","last_active":"2024-09-21T00:56:26.470306+0000","last_peered":"2024-09-21T00:56:26.470306+0000","last_clean":"2024-09-21T00:56:26.470306+0000","last_became_active":"2024-09-21T00:54:57.881598+0000","last_became_peered":"2024-09-21T00:54:57.881598+0000","last_unstale":"2024-09-21T00:56:26.470306+0000","last_undegraded":"2024-09-21T00:56:26.470306+0000","last_fullsized":"2024-09-21T00:56:26.470306+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:44:19.893961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.645759+0000","last_change":"2024-09-21T00:55:27.645172+0000","last_active":"2024-09-21T00:55:27.645759+0000","last_peered":"2024-09-21T00:55:27.645759+0000","last_clean":"2024-09-21T00:55:27.645759+0000","last_became_active":"2024-09-21T00:55:27.639795+0000","last_became_peered":"2024-09-21T00:55:27.639795+0000","last_unstale":"2024-09-21T00:55:27.645759+0000","last_undegraded":"2024-09-21T00:55:27.645759+0000","last_fullsized":"2024-09-21T00:55:27.645759+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:20:50.639608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.491583+0000","last_change":"2024-09-21T00:54:57.867972+0000","last_active":"2024-09-21T00:56:26.491583+0000","last_peered":"2024-09-21T00:56:26.491583+0000","last_clean":"2024-09-21T00:56:26.491583+0000","last_became_active":"2024-09-21T00:54:57.867586+0000","last_became_peered":"2024-09-21T00:54:57.867586+0000","last_unstale":"2024-09-21T00:56:26.491583+0000","last_undegraded":"2024-09-21T00:56:26.491583+0000","last_fullsized":"2024-09-21T00:56:26.491583+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:27.066795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.484037+0000","last_change":"2024-09-21T00:54:57.881014+0000","last_active":"2024-09-21T00:56:26.484037+0000","last_peered":"2024-09-21T00:56:26.484037+0000","last_clean":"2024-09-21T00:56:26.484037+0000","last_became_active":"2024-09-21T00:54:57.880608+0000","last_became_peered":"2024-09-21T00:54:57.880608+0000","last_unstale":"2024-09-21T00:56:26.484037+0000","last_undegraded":"2024-09-21T00:56:26.484037+0000","last_fullsized":"2024-09-21T00:56:26.484037+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:48:31.848315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.638999+0000","last_change":"2024-09-21T00:54:55.865031+0000","last_active":"2024-09-21T00:55:27.638999+0000","last_peered":"2024-09-21T00:55:27.638999+0000","last_clean":"2024-09-21T00:55:27.638999+0000","last_became_active":"2024-09-21T00:54:55.864576+0000","last_became_peered":"2024-09-21T00:54:55.864576+0000","last_unstale":"2024-09-21T00:55:27.638999+0000","last_undegraded":"2024-09-21T00:55:27.638999+0000","last_fullsized":"2024-09-21T00:55:27.638999+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:13.125491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.492158+0000","last_change":"2024-09-21T00:54:57.875878+0000","last_active":"2024-09-21T00:56:26.492158+0000","last_peered":"2024-09-21T00:56:26.492158+0000","last_clean":"2024-09-21T00:56:26.492158+0000","last_became_active":"2024-09-21T00:54:57.874177+0000","last_became_peered":"2024-09-21T00:54:57.874177+0000","last_unstale":"2024-09-21T00:56:26.492158+0000","last_undegraded":"2024-09-21T00:56:26.492158+0000","last_fullsized":"2024-09-21T00:56:26.492158+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:25.333036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'12","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:27.637565+0000","last_change":"2024-09-21T00:54:55.868698+0000","last_active":"2024-09-21T00:55:27.637565+0000","last_peered":"2024-09-21T00:55:27.637565+0000","last_clean":"2024-09-21T00:55:27.637565+0000","last_became_active":"2024-09-21T00:54:55.868282+0000","last_became_peered":"2024-09-21T00:54:55.868282+0000","last_unstale":"2024-09-21T00:55:27.637565+0000","last_undegraded":"2024-09-21T00:55:27.637565+0000","last_fullsized":"2024-09-21T00:55:27.637565+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:50.253638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.491449+0000","last_change":"2024-09-21T00:54:57.867726+0000","last_active":"2024-09-21T00:56:26.491449+0000","last_peered":"2024-09-21T00:56:26.491449+0000","last_clean":"2024-09-21T00:56:26.491449+0000","last_became_active":"2024-09-21T00:54:57.866090+0000","last_became_peered":"2024-09-21T00:54:57.866090+0000","last_unstale":"2024-09-21T00:56:26.491449+0000","last_undegraded":"2024-09-21T00:56:26.491449+0000","last_fullsized":"2024-09-21T00:56:26.491449+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:57.938078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:55:28.428068+0000","last_change":"2024-09-21T00:54:55.968155+0000","last_active":"2024-09-21T00:55:28.428068+0000","last_peered":"2024-09-21T00:55:28.428068+0000","last_clean":"2024-09-21T00:55:28.428068+0000","last_became_active":"2024-09-21T00:54:55.967718+0000","last_became_peered":"2024-09-21T00:54:55.967718+0000","last_unstale":"2024-09-21T00:55:28.428068+0000","last_undegraded":"2024-09-21T00:55:28.428068+0000","last_fullsized":"2024-09-21T00:55:28.428068+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:18.160380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:26.461696+0000","last_change":"2024-09-21T00:54:57.873102+0000","last_active":"2024-09-21T00:56:26.461696+0000","last_peered":"2024-09-21T00:56:26.461696+0000","last_clean":"2024-09-21T00:56:26.461696+0000","last_became_active":"2024-09-21T00:54:57.872323+0000","last_became_peered":"2024-09-21T00:54:57.872323+0000","last_unstale":"2024-09-21T00:56:26.461696+0000","last_undegraded":"2024-09-21T00:56:26.461696+0000","last_fullsized":"2024-09-21T00:56:26.461696+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:56.845234+0000","last_clean_scrub_stamp":"2024-09-21T00:54:56.845234+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:18.087601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'13","reported_seq":139,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.736712+0000","last_change":"2024-09-21T00:54:55.865559+0000","last_active":"2024-09-21T00:56:49.736712+0000","last_peered":"2024-09-21T00:56:49.736712+0000","last_clean":"2024-09-21T00:56:49.736712+0000","last_became_active":"2024-09-21T00:54:55.865157+0000","last_became_peered":"2024-09-21T00:54:55.865157+0000","last_unstale":"2024-09-21T00:56:49.736712+0000","last_undegraded":"2024-09-21T00:56:49.736712+0000","last_fullsized":"2024-09-21T00:56:49.736712+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:54:54.837132+0000","last_clean_scrub_stamp":"2024-09-21T00:54:54.837132+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:53.113970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":77617,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1076,"num_read_kb":606,"num_write":258,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":59204,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":536576,"data_stored":232851,"data_compressed":13542,"data_compressed_allocated":20480,"data_compressed_original":73728,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":283734,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808868,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717320,"statfs":{"total":95995035648,"available":95966535680,"internally_reserved":0,"allocated":827392,"data_stored":396490,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972394,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":1050922,"data_compressed":43733,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135918,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":843776,"data_stored":395385,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332148,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31996,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713156,"statfs":{"total":95995035648,"available":95962271744,"internally_reserved":0,"allocated":831488,"data_stored":395651,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528377,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":988422,"data_compressed":41838,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691902,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36152,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709000,"statfs":{"total":95995035648,"available":95958016000,"internally_reserved":0,"allocated":827392,"data_stored":395102,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888131,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":987568,"data_compressed":41838,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018953,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36184,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708968,"statfs":{"total":95995035648,"available":95957983232,"internally_reserved":0,"allocated":860160,"data_stored":465235,"data_compressed":15515,"data_compressed_allocated":20480,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215182,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":843776,"data_stored":394927,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411412,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36164,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708988,"statfs":{"total":95995035648,"available":95958003712,"internally_reserved":0,"allocated":839680,"data_stored":397158,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36216,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708936,"statfs":{"total":95995035648,"available":95957950464,"internally_reserved":0,"allocated":892928,"data_stored":465755,"data_compressed":7658,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36172,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708980,"statfs":{"total":95995035648,"available":95957995520,"internally_reserved":0,"allocated":847872,"data_stored":397364,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36075,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":71492,"data_compressed":1895,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":70972,"data_compressed":9752,"data_compressed_allocated":12288,"data_compressed_original":57344,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":72008,"data_compressed":1895,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:56:57.457 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:56:57.749 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:58.152 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:57 smithi001 ceph-mon[31211]: pgmap v350: 97 pgs: 97 active+clean; 653 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1023 B/s wr, 10 op/s 2024-09-21T00:56:58.152 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:57 smithi001 ceph-mon[31211]: from='client.15447 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:56:58.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:57 smithi193 ceph-mon[34660]: pgmap v350: 97 pgs: 97 active+clean; 653 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1023 B/s wr, 10 op/s 2024-09-21T00:56:58.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:57 smithi193 ceph-mon[34660]: from='client.15447 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:56:58.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:57 smithi042 ceph-mon[34481]: pgmap v350: 97 pgs: 97 active+clean; 653 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1023 B/s wr, 10 op/s 2024-09-21T00:56:58.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:57 smithi042 ceph-mon[34481]: from='client.15447 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:56:58.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.244+0000 7fc1fca80640 1 -- 172.21.15.1:0/4219781242 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1f8102a80 msgr2=0x7fc1f8102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:58.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.244+0000 7fc1fca80640 1 --2- 172.21.15.1:0/4219781242 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1f8102a80 0x7fc1f8102e90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8009900 tx=0x7fc1e802a410 comp rx=0 tx=0).stop 2024-09-21T00:56:58.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.244+0000 7fc1fca80640 1 -- 172.21.15.1:0/4219781242 shutdown_connections 2024-09-21T00:56:58.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.244+0000 7fc1fca80640 1 --2- 172.21.15.1:0/4219781242 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1f8108d10 0x7fc1f810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:58.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.244+0000 7fc1fca80640 1 --2- 172.21.15.1:0/4219781242 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1f81083c0 0x7fc1f81087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:58.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.244+0000 7fc1fca80640 1 --2- 172.21.15.1:0/4219781242 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1f8102a80 0x7fc1f8102e90 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:58.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.244+0000 7fc1fca80640 1 -- 172.21.15.1:0/4219781242 >> 172.21.15.1:0/4219781242 conn(0x7fc1f8079740 msgr2=0x7fc1f8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:58.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.245+0000 7fc1fca80640 1 -- 172.21.15.1:0/4219781242 shutdown_connections 2024-09-21T00:56:58.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.245+0000 7fc1fca80640 1 -- 172.21.15.1:0/4219781242 wait complete. 2024-09-21T00:56:58.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.245+0000 7fc1fca80640 1 Processor -- start 2024-09-21T00:56:58.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.245+0000 7fc1fca80640 1 -- start start 2024-09-21T00:56:58.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.246+0000 7fc1fca80640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1f8102a80 0x7fc1f819a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:58.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.246+0000 7fc1fca80640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1f81083c0 0x7fc1f819aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:58.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.246+0000 7fc1fca80640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1f8108d10 0x7fc1f819fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:58.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.246+0000 7fc1fca80640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f8112980 con 0x7fc1f81083c0 2024-09-21T00:56:58.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.246+0000 7fc1fca80640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f8112800 con 0x7fc1f8102a80 2024-09-21T00:56:58.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.246+0000 7fc1fca80640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f8112b00 con 0x7fc1f8108d10 2024-09-21T00:56:58.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.246+0000 7fc1f5d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1f81083c0 0x7fc1f819aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:58.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.246+0000 7fc1f5d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1f81083c0 0x7fc1f819aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40024/0 (socket says 172.21.15.1:40024) 2024-09-21T00:56:58.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.246+0000 7fc1f5d9b640 1 -- 172.21.15.1:0/1379347936 learned_addr learned my addr 172.21.15.1:0/1379347936 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:56:58.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.246+0000 7fc1f659c640 1 --2- 172.21.15.1:0/1379347936 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1f8102a80 0x7fc1f819a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:58.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.246+0000 7fc1f6d9d640 1 --2- 172.21.15.1:0/1379347936 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1f8108d10 0x7fc1f819fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:58.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.246+0000 7fc1f5d9b640 1 -- 172.21.15.1:0/1379347936 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1f8108d10 msgr2=0x7fc1f819fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:58.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.246+0000 7fc1f5d9b640 1 --2- 172.21.15.1:0/1379347936 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1f8108d10 0x7fc1f819fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:58.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.246+0000 7fc1f5d9b640 1 -- 172.21.15.1:0/1379347936 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1f8102a80 msgr2=0x7fc1f819a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:58.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.246+0000 7fc1f5d9b640 1 --2- 172.21.15.1:0/1379347936 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1f8102a80 0x7fc1f819a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:58.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.246+0000 7fc1f5d9b640 1 -- 172.21.15.1:0/1379347936 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1f81a0450 con 0x7fc1f81083c0 2024-09-21T00:56:58.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.246+0000 7fc1f6d9d640 1 --2- 172.21.15.1:0/1379347936 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1f8108d10 0x7fc1f819fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:56:58.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.246+0000 7fc1f5d9b640 1 --2- 172.21.15.1:0/1379347936 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1f81083c0 0x7fc1f819aa80 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc1e000d770 tx=0x7fc1e000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:58.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.247+0000 7fc1ef7fe640 1 -- 172.21.15.1:0/1379347936 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e0017070 con 0x7fc1f81083c0 2024-09-21T00:56:58.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.247+0000 7fc1ef7fe640 1 -- 172.21.15.1:0/1379347936 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1e0009c30 con 0x7fc1f81083c0 2024-09-21T00:56:58.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.247+0000 7fc1fca80640 1 -- 172.21.15.1:0/1379347936 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1f81a0740 con 0x7fc1f81083c0 2024-09-21T00:56:58.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.247+0000 7fc1ef7fe640 1 -- 172.21.15.1:0/1379347936 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e000f620 con 0x7fc1f81083c0 2024-09-21T00:56:58.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.247+0000 7fc1fca80640 1 -- 172.21.15.1:0/1379347936 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1f81a6ea0 con 0x7fc1f81083c0 2024-09-21T00:56:58.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.248+0000 7fc1fca80640 1 -- 172.21.15.1:0/1379347936 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1f8103d00 con 0x7fc1f81083c0 2024-09-21T00:56:58.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.250+0000 7fc1ef7fe640 1 -- 172.21.15.1:0/1379347936 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 154562+0+0 (secure 0 0 0) 0x7fc1e001a070 con 0x7fc1f81083c0 2024-09-21T00:56:58.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.251+0000 7fc1ef7fe640 1 --2- 172.21.15.1:0/1379347936 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc1e40b6620 0x7fc1e40b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:58.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.251+0000 7fc1f659c640 1 --2- 172.21.15.1:0/1379347936 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc1e40b6620 0x7fc1e40b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:58.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.251+0000 7fc1ef7fe640 1 -- 172.21.15.1:0/1379347936 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fc1e00e6f20 con 0x7fc1f81083c0 2024-09-21T00:56:58.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.252+0000 7fc1f659c640 1 --2- 172.21.15.1:0/1379347936 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc1e40b6620 0x7fc1e40b8b30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8031440 tx=0x7fc1e8009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:58.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.254+0000 7fc1ef7fe640 1 -- 172.21.15.1:0/1379347936 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc1e0009de0 con 0x7fc1f81083c0 2024-09-21T00:56:58.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.485+0000 7fc1fca80640 1 -- 172.21.15.1:0/1379347936 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1f819b610 con 0x7fc1f81083c0 2024-09-21T00:56:58.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.485+0000 7fc1ef7fe640 1 -- 172.21.15.1:0/1379347936 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11955 (secure 0 0 0) 0x7fc1e00ad6b0 con 0x7fc1f81083c0 2024-09-21T00:56:58.486 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:56:58.486 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":27,"btime":"2024-09-21T00:56:52:855037+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2810186677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2810186677},{"type":"v1","addr":"172.21.15.1:6835","nonce":2810186677}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14736,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3935320478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3935320478},{"type":"v1","addr":"172.21.15.1:6837","nonce":3935320478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:54:58.592853+0000","modified":"2024-09-21T00:56:52.784125+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24653,"mds_1":24637,"mds_2":24626,"mds_3":24622,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/2125703572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2125703572},{"type":"v1","addr":"172.21.15.1:6839","nonce":2125703572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/3860445313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860445313},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860445313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6833/712170939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":712170939},{"type":"v1","addr":"172.21.15.193:6833","nonce":712170939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6833/1653911656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1653911656},{"type":"v1","addr":"172.21.15.42:6833","nonce":1653911656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6835/793085918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":793085918},{"type":"v1","addr":"172.21.15.42:6835","nonce":793085918}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6835/3631682268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":3631682268},{"type":"v1","addr":"172.21.15.193:6835","nonce":3631682268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.193:6837/909252228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":909252228},{"type":"v1","addr":"172.21.15.193:6837","nonce":909252228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.42:6837/2395608508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2395608508},{"type":"v1","addr":"172.21.15.42:6837","nonce":2395608508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.193:6839/1365361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1365361177},{"type":"v1","addr":"172.21.15.193:6839","nonce":1365361177}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6839/2526476666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2526476666},{"type":"v1","addr":"172.21.15.42:6839","nonce":2526476666}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24610,24622,24626,24637,24653]},"id":1}]} 2024-09-21T00:56:58.487 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 27 2024-09-21T00:56:58.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.488+0000 7fc1fca80640 1 -- 172.21.15.1:0/1379347936 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc1e40b6620 msgr2=0x7fc1e40b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:58.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.488+0000 7fc1fca80640 1 --2- 172.21.15.1:0/1379347936 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc1e40b6620 0x7fc1e40b8b30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8031440 tx=0x7fc1e8009560 comp rx=0 tx=0).stop 2024-09-21T00:56:58.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.488+0000 7fc1fca80640 1 -- 172.21.15.1:0/1379347936 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1f81083c0 msgr2=0x7fc1f819aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:58.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.488+0000 7fc1fca80640 1 --2- 172.21.15.1:0/1379347936 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1f81083c0 0x7fc1f819aa80 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc1e000d770 tx=0x7fc1e000dc30 comp rx=0 tx=0).stop 2024-09-21T00:56:58.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.488+0000 7fc1fca80640 1 -- 172.21.15.1:0/1379347936 shutdown_connections 2024-09-21T00:56:58.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.488+0000 7fc1fca80640 1 --2- 172.21.15.1:0/1379347936 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1f8108d10 0x7fc1f819fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:58.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.488+0000 7fc1fca80640 1 --2- 172.21.15.1:0/1379347936 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc1e40b6620 0x7fc1e40b8b30 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:58.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.488+0000 7fc1fca80640 1 --2- 172.21.15.1:0/1379347936 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1f81083c0 0x7fc1f819aa80 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:58.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.488+0000 7fc1fca80640 1 --2- 172.21.15.1:0/1379347936 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1f8102a80 0x7fc1f819a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:58.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.488+0000 7fc1fca80640 1 -- 172.21.15.1:0/1379347936 >> 172.21.15.1:0/1379347936 conn(0x7fc1f8079740 msgr2=0x7fc1f8101b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:58.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.488+0000 7fc1fca80640 1 -- 172.21.15.1:0/1379347936 shutdown_connections 2024-09-21T00:56:58.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:58.488+0000 7fc1fca80640 1 -- 172.21.15.1:0/1379347936 wait complete. 2024-09-21T00:56:59.208 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:58 smithi001 ceph-mon[31211]: from='client.15453 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:56:59.209 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:58 smithi001 ceph-mon[31211]: from='client.15459 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:56:59.209 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:58 smithi001 ceph-mon[31211]: pgmap v351: 97 pgs: 97 active+clean; 653 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-21T00:56:59.209 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:56:58 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1379347936' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:59.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:58 smithi193 ceph-mon[34660]: from='client.15453 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:56:59.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:58 smithi193 ceph-mon[34660]: from='client.15459 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:56:59.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:58 smithi193 ceph-mon[34660]: pgmap v351: 97 pgs: 97 active+clean; 653 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-21T00:56:59.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:56:58 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/1379347936' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:59.240 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T00:56:59.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:58 smithi042 ceph-mon[34481]: from='client.15453 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:56:59.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:58 smithi042 ceph-mon[34481]: from='client.15459 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:56:59.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:58 smithi042 ceph-mon[34481]: pgmap v351: 97 pgs: 97 active+clean; 653 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-21T00:56:59.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:56:58 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/1379347936' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:59.501 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:59.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:59.996+0000 7f3d7fcda640 1 -- 172.21.15.1:0/2119493245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d78103b60 msgr2=0x7f3d78103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:59.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:59.996+0000 7f3d7fcda640 1 --2- 172.21.15.1:0/2119493245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d78103b60 0x7f3d78103f70 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3d74009900 tx=0x7f3d7402a410 comp rx=0 tx=0).stop 2024-09-21T00:56:59.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:59.996+0000 7f3d7fcda640 1 -- 172.21.15.1:0/2119493245 shutdown_connections 2024-09-21T00:56:59.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:59.996+0000 7f3d7fcda640 1 --2- 172.21.15.1:0/2119493245 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d78109df0 0x7f3d78110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:59.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:59.996+0000 7f3d7fcda640 1 --2- 172.21.15.1:0/2119493245 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d781094a0 0x7f3d781098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:59.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:59.996+0000 7f3d7fcda640 1 --2- 172.21.15.1:0/2119493245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d78103b60 0x7f3d78103f70 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:59.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:59.996+0000 7f3d7fcda640 1 -- 172.21.15.1:0/2119493245 >> 172.21.15.1:0/2119493245 conn(0x7f3d7807b850 msgr2=0x7f3d7807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:59.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:59.996+0000 7f3d7fcda640 1 -- 172.21.15.1:0/2119493245 shutdown_connections 2024-09-21T00:56:59.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:59.996+0000 7f3d7fcda640 1 -- 172.21.15.1:0/2119493245 wait complete. 2024-09-21T00:56:59.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:59.996+0000 7f3d7fcda640 1 Processor -- start 2024-09-21T00:56:59.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:59.997+0000 7f3d7fcda640 1 -- start start 2024-09-21T00:56:59.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:59.997+0000 7f3d7fcda640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d78103b60 0x7f3d7819a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:59.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:59.997+0000 7f3d7fcda640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d781094a0 0x7f3d7819ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:59.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:59.997+0000 7f3d7fcda640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d78109df0 0x7f3d7819fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:59.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:59.997+0000 7f3d7fcda640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3d78113b10 con 0x7f3d78109df0 2024-09-21T00:56:59.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:59.997+0000 7f3d7fcda640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3d78113990 con 0x7f3d78103b60 2024-09-21T00:56:59.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:59.997+0000 7f3d7fcda640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3d78113c90 con 0x7f3d781094a0 2024-09-21T00:57:00.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:59.997+0000 7f3d7e277640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d78109df0 0x7f3d7819fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:00.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:59.997+0000 7f3d7d275640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d781094a0 0x7f3d7819ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:00.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:59.997+0000 7f3d7d275640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d781094a0 0x7f3d7819ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:32898/0 (socket says 172.21.15.1:32898) 2024-09-21T00:57:00.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:59.997+0000 7f3d7e277640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d78109df0 0x7f3d7819fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50948/0 (socket says 172.21.15.1:50948) 2024-09-21T00:57:00.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:59.997+0000 7f3d7d275640 1 -- 172.21.15.1:0/3996242415 learned_addr learned my addr 172.21.15.1:0/3996242415 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:00.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:59.997+0000 7f3d7da76640 1 --2- 172.21.15.1:0/3996242415 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d78103b60 0x7f3d7819a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:00.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:59.998+0000 7f3d7e277640 1 -- 172.21.15.1:0/3996242415 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d781094a0 msgr2=0x7f3d7819ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:00.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:59.998+0000 7f3d7e277640 1 --2- 172.21.15.1:0/3996242415 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d781094a0 0x7f3d7819ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:00.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:59.998+0000 7f3d7e277640 1 -- 172.21.15.1:0/3996242415 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d78103b60 msgr2=0x7f3d7819a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:00.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:59.998+0000 7f3d7e277640 1 --2- 172.21.15.1:0/3996242415 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d78103b60 0x7f3d7819a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:00.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:59.998+0000 7f3d7e277640 1 -- 172.21.15.1:0/3996242415 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d781a0550 con 0x7f3d78109df0 2024-09-21T00:57:00.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:59.998+0000 7f3d7d275640 1 --2- 172.21.15.1:0/3996242415 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d781094a0 0x7f3d7819ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:00.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:59.998+0000 7f3d7e277640 1 --2- 172.21.15.1:0/3996242415 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d78109df0 0x7f3d7819fe20 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3d7000e940 tx=0x7f3d7000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:00.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:59.998+0000 7f3d6effd640 1 -- 172.21.15.1:0/3996242415 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d70004d20 con 0x7f3d78109df0 2024-09-21T00:57:00.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:59.998+0000 7f3d7fcda640 1 -- 172.21.15.1:0/3996242415 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d781a0840 con 0x7f3d78109df0 2024-09-21T00:57:00.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:59.998+0000 7f3d6effd640 1 -- 172.21.15.1:0/3996242415 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d70005020 con 0x7f3d78109df0 2024-09-21T00:57:00.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:59.998+0000 7f3d6effd640 1 -- 172.21.15.1:0/3996242415 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d700116d0 con 0x7f3d78109df0 2024-09-21T00:57:00.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:59.998+0000 7f3d7fcda640 1 -- 172.21.15.1:0/3996242415 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d781a6fa0 con 0x7f3d78109df0 2024-09-21T00:57:00.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:56:59.999+0000 7f3d7fcda640 1 -- 172.21.15.1:0/3996242415 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d78103f70 con 0x7f3d78109df0 2024-09-21T00:57:00.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:00.001+0000 7f3d6effd640 1 -- 172.21.15.1:0/3996242415 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 154562+0+0 (secure 0 0 0) 0x7f3d70005460 con 0x7f3d78109df0 2024-09-21T00:57:00.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:00.001+0000 7f3d6effd640 1 --2- 172.21.15.1:0/3996242415 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f3d640b65a0 0x7f3d640b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:00.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:00.002+0000 7f3d7da76640 1 --2- 172.21.15.1:0/3996242415 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f3d640b65a0 0x7f3d640b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:00.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:00.002+0000 7f3d6effd640 1 -- 172.21.15.1:0/3996242415 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f3d700e7870 con 0x7f3d78109df0 2024-09-21T00:57:00.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:00.002+0000 7f3d7da76640 1 --2- 172.21.15.1:0/3996242415 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f3d640b65a0 0x7f3d640b8ab0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3d74031440 tx=0x7f3d74009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:00.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:00.005+0000 7f3d6effd640 1 -- 172.21.15.1:0/3996242415 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3d70016030 con 0x7f3d78109df0 2024-09-21T00:57:00.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:00.195+0000 7f3d7fcda640 1 -- 172.21.15.1:0/3996242415 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3d7819b710 con 0x7f3d78109df0 2024-09-21T00:57:00.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:00.197+0000 7f3d6effd640 1 -- 172.21.15.1:0/3996242415 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22720 (secure 0 0 0) 0x7f3d7819b710 con 0x7f3d78109df0 2024-09-21T00:57:00.198 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:57:00.198 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":75,"fsid":"d3972c20-77b2-11ef-baf5-efdc52797490","created":"2024-09-21T00:46:29.745963+0000","modified":"2024-09-21T00:55:27.629379+0000","last_up_change":"2024-09-21T00:54:07.552837+0000","last_in_change":"2024-09-21T00:53:44.164415+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:50:16.456462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:54:54.305306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:54:56.506872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5bf09a34-4d6e-401c-8cef-29bbe72de68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6803","nonce":4067586847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6805","nonce":4067586847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6809","nonce":4067586847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6807","nonce":4067586847}]},"public_addr":"172.21.15.1:6803/4067586847","cluster_addr":"172.21.15.1:6805/4067586847","heartbeat_back_addr":"172.21.15.1:6809/4067586847","heartbeat_front_addr":"172.21.15.1:6807/4067586847","state":["exists","up"]},{"osd":1,"uuid":"195f9109-ef61-46be-a59a-d72e3a1b5b45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6801","nonce":436964633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6803","nonce":436964633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6807","nonce":436964633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6805","nonce":436964633}]},"public_addr":"172.21.15.42:6801/436964633","cluster_addr":"172.21.15.42:6803/436964633","heartbeat_back_addr":"172.21.15.42:6807/436964633","heartbeat_front_addr":"172.21.15.42:6805/436964633","state":["exists","up"]},{"osd":2,"uuid":"47cf90a7-6db6-464a-84ef-9f509f89a46b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6801","nonce":3495400570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6803","nonce":3495400570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6807","nonce":3495400570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6805","nonce":3495400570}]},"public_addr":"172.21.15.193:6801/3495400570","cluster_addr":"172.21.15.193:6803/3495400570","heartbeat_back_addr":"172.21.15.193:6807/3495400570","heartbeat_front_addr":"172.21.15.193:6805/3495400570","state":["exists","up"]},{"osd":3,"uuid":"a5230a66-3c74-41a7-9353-5650780ed25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6811","nonce":3221661671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6813","nonce":3221661671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6817","nonce":3221661671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6815","nonce":3221661671}]},"public_addr":"172.21.15.1:6811/3221661671","cluster_addr":"172.21.15.1:6813/3221661671","heartbeat_back_addr":"172.21.15.1:6817/3221661671","heartbeat_front_addr":"172.21.15.1:6815/3221661671","state":["exists","up"]},{"osd":4,"uuid":"b0476b9b-3257-46d4-aff7-1f038286ed43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6809","nonce":2066388104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6811","nonce":2066388104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6815","nonce":2066388104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6813","nonce":2066388104}]},"public_addr":"172.21.15.42:6809/2066388104","cluster_addr":"172.21.15.42:6811/2066388104","heartbeat_back_addr":"172.21.15.42:6815/2066388104","heartbeat_front_addr":"172.21.15.42:6813/2066388104","state":["exists","up"]},{"osd":5,"uuid":"96701ced-a55a-4ad9-be62-7f102c00697d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6809","nonce":732336675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6811","nonce":732336675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6815","nonce":732336675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6813","nonce":732336675}]},"public_addr":"172.21.15.193:6809/732336675","cluster_addr":"172.21.15.193:6811/732336675","heartbeat_back_addr":"172.21.15.193:6815/732336675","heartbeat_front_addr":"172.21.15.193:6813/732336675","state":["exists","up"]},{"osd":6,"uuid":"72d76017-e2e3-4118-8316-2c5da01c87b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6819","nonce":3201517067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6821","nonce":3201517067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6825","nonce":3201517067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6823","nonce":3201517067}]},"public_addr":"172.21.15.1:6819/3201517067","cluster_addr":"172.21.15.1:6821/3201517067","heartbeat_back_addr":"172.21.15.1:6825/3201517067","heartbeat_front_addr":"172.21.15.1:6823/3201517067","state":["exists","up"]},{"osd":7,"uuid":"8b239f96-2455-41b6-a905-9ed92078b890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6817","nonce":2124927218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6819","nonce":2124927218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6823","nonce":2124927218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6821","nonce":2124927218}]},"public_addr":"172.21.15.42:6817/2124927218","cluster_addr":"172.21.15.42:6819/2124927218","heartbeat_back_addr":"172.21.15.42:6823/2124927218","heartbeat_front_addr":"172.21.15.42:6821/2124927218","state":["exists","up"]},{"osd":8,"uuid":"8cd93aeb-fe00-4291-9f72-171d01893819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6817","nonce":2277449259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6819","nonce":2277449259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6823","nonce":2277449259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6821","nonce":2277449259}]},"public_addr":"172.21.15.193:6817/2277449259","cluster_addr":"172.21.15.193:6819/2277449259","heartbeat_back_addr":"172.21.15.193:6823/2277449259","heartbeat_front_addr":"172.21.15.193:6821/2277449259","state":["exists","up"]},{"osd":9,"uuid":"9e03e00b-0015-4aa8-adce-0d3352d2ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6827","nonce":1369323215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6829","nonce":1369323215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6833","nonce":1369323215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6831","nonce":1369323215}]},"public_addr":"172.21.15.1:6827/1369323215","cluster_addr":"172.21.15.1:6829/1369323215","heartbeat_back_addr":"172.21.15.1:6833/1369323215","heartbeat_front_addr":"172.21.15.1:6831/1369323215","state":["exists","up"]},{"osd":10,"uuid":"de55a908-b049-4f40-865f-cfa2ae6e461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6825","nonce":3182218295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6827","nonce":3182218295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6831","nonce":3182218295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6829","nonce":3182218295}]},"public_addr":"172.21.15.42:6825/3182218295","cluster_addr":"172.21.15.42:6827/3182218295","heartbeat_back_addr":"172.21.15.42:6831/3182218295","heartbeat_front_addr":"172.21.15.42:6829/3182218295","state":["exists","up"]},{"osd":11,"uuid":"1cac0c39-77aa-460b-92a0-39ed89cd6ce4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6825","nonce":2368815522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6827","nonce":2368815522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6831","nonce":2368815522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6829","nonce":2368815522}]},"public_addr":"172.21.15.193:6825/2368815522","cluster_addr":"172.21.15.193:6827/2368815522","heartbeat_back_addr":"172.21.15.193:6831/2368815522","heartbeat_front_addr":"172.21.15.193:6829/2368815522","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:49:21.491443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:49:47.486846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:50:12.757383+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:50:39.127690+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:05.545277+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:30.617491+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:57.612088+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:24.001953+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:48.447388+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:14.620538+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:40.503576+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:54:05.668236+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6801/59685083":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/309615464":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/1722941514":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/1199175740":"2024-09-22T00:47:25.985486+0000","172.21.15.1:6800/59685083":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/2811453932":"2024-09-22T00:46:58.953779+0000","172.21.15.1:0/3748689057":"2024-09-22T00:46:58.953779+0000","172.21.15.1:0/265697975":"2024-09-22T00:46:58.953779+0000","172.21.15.1:6801/1968786311":"2024-09-22T00:46:58.953779+0000","172.21.15.1:6800/1968786311":"2024-09-22T00:46:58.953779+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:57:00.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:00.199+0000 7f3d7fcda640 1 -- 172.21.15.1:0/3996242415 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f3d640b65a0 msgr2=0x7f3d640b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:00.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:00.199+0000 7f3d7fcda640 1 --2- 172.21.15.1:0/3996242415 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f3d640b65a0 0x7f3d640b8ab0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3d74031440 tx=0x7f3d74009560 comp rx=0 tx=0).stop 2024-09-21T00:57:00.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:00.199+0000 7f3d7fcda640 1 -- 172.21.15.1:0/3996242415 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d78109df0 msgr2=0x7f3d7819fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:00.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:00.199+0000 7f3d7fcda640 1 --2- 172.21.15.1:0/3996242415 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d78109df0 0x7f3d7819fe20 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3d7000e940 tx=0x7f3d7000ee00 comp rx=0 tx=0).stop 2024-09-21T00:57:00.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:00.199+0000 7f3d7fcda640 1 -- 172.21.15.1:0/3996242415 shutdown_connections 2024-09-21T00:57:00.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:00.199+0000 7f3d7fcda640 1 --2- 172.21.15.1:0/3996242415 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f3d640b65a0 0x7f3d640b8ab0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:00.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:00.199+0000 7f3d7fcda640 1 --2- 172.21.15.1:0/3996242415 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d78109df0 0x7f3d7819fe20 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:00.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:00.199+0000 7f3d7fcda640 1 --2- 172.21.15.1:0/3996242415 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d781094a0 0x7f3d7819ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:00.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:00.199+0000 7f3d7fcda640 1 --2- 172.21.15.1:0/3996242415 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d78103b60 0x7f3d7819a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:00.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:00.199+0000 7f3d7fcda640 1 -- 172.21.15.1:0/3996242415 >> 172.21.15.1:0/3996242415 conn(0x7f3d7807b850 msgr2=0x7f3d78107640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:00.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:00.199+0000 7f3d7fcda640 1 -- 172.21.15.1:0/3996242415 shutdown_connections 2024-09-21T00:57:00.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:00.199+0000 7f3d7fcda640 1 -- 172.21.15.1:0/3996242415 wait complete. 2024-09-21T00:57:00.870 DEBUG:tasks.fwd_scrub:Yielding 2024-09-21T00:57:00.870 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-21T00:57:00.879 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi001.front.sepia.ceph.com 2024-09-21T00:57:00.880 DEBUG:teuthology.orchestra.run.smithi001:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-21T00:57:00.880 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-21T00:57:00.880 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T00:57:00.880 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T00:57:00.882 INFO:teuthology.run_tasks:Running task workunit... 2024-09-21T00:57:00.929 INFO:tasks.workunit:Pulling workunits from ref 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:57:00.929 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T00:57:00.929 INFO:tasks.workunit:timeout=3h 2024-09-21T00:57:00.929 INFO:tasks.workunit:cleanup=True 2024-09-21T00:57:00.930 DEBUG:teuthology.orchestra.run.smithi001:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-21T00:57:00.948 INFO:teuthology.orchestra.run.smithi001.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-21T00:57:00.948 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-21T00:57:00.948 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-21T00:57:00.948 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:57:00.948 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-21T00:57:00.948 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-09-21 00:55:17.812023670 +0000 2024-09-21T00:57:00.948 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-09-21 00:55:17.812023670 +0000 2024-09-21T00:57:00.948 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-09-21 00:56:52.076731360 +0000 2024-09-21T00:57:00.948 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-09-21 00:55:17.812023670 +0000 2024-09-21T00:57:00.949 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-21T00:57:00.949 DEBUG:teuthology.orchestra.run.smithi001:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-21T00:57:01.026 DEBUG:teuthology.orchestra.run.smithi001:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:57:01.083 INFO:tasks.workunit.client.0.smithi001.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-21T00:57:01.157 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:01.420 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:01 smithi001 ceph-mon[31211]: pgmap v352: 97 pgs: 97 active+clean; 655 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-21T00:57:01.421 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:01 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/3996242415' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:57:01.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:01 smithi193 ceph-mon[34660]: pgmap v352: 97 pgs: 97 active+clean; 655 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-21T00:57:01.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:01 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/3996242415' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:57:01.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:01 smithi042 ceph-mon[34481]: pgmap v352: 97 pgs: 97 active+clean; 655 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-21T00:57:01.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:01 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/3996242415' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:57:01.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.694+0000 7f4c018af640 1 -- 172.21.15.1:0/4049997484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bfc105380 msgr2=0x7f4bfc10d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:01.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.694+0000 7f4c018af640 1 --2- 172.21.15.1:0/4049997484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bfc105380 0x7f4bfc10d8d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0009900 tx=0x7f4bf002a410 comp rx=0 tx=0).stop 2024-09-21T00:57:01.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.694+0000 7f4c018af640 1 -- 172.21.15.1:0/4049997484 shutdown_connections 2024-09-21T00:57:01.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.694+0000 7f4c018af640 1 --2- 172.21.15.1:0/4049997484 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bfc10de60 0x7f4bfc110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.694+0000 7f4c018af640 1 --2- 172.21.15.1:0/4049997484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bfc105380 0x7f4bfc10d8d0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.694+0000 7f4c018af640 1 --2- 172.21.15.1:0/4049997484 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bfc104a30 0x7f4bfc104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.694+0000 7f4c018af640 1 -- 172.21.15.1:0/4049997484 >> 172.21.15.1:0/4049997484 conn(0x7f4bfc0797b0 msgr2=0x7f4bfc079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:01.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.694+0000 7f4c018af640 1 -- 172.21.15.1:0/4049997484 shutdown_connections 2024-09-21T00:57:01.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.694+0000 7f4c018af640 1 -- 172.21.15.1:0/4049997484 wait complete. 2024-09-21T00:57:01.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.695+0000 7f4c018af640 1 Processor -- start 2024-09-21T00:57:01.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.695+0000 7f4c018af640 1 -- start start 2024-09-21T00:57:01.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.695+0000 7f4c018af640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bfc104a30 0x7f4bfc19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:01.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.695+0000 7f4c018af640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bfc105380 0x7f4bfc19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:01.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.695+0000 7f4c018af640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bfc10de60 0x7f4bfc19fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:01.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.695+0000 7f4c018af640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4bfc113ae0 con 0x7f4bfc105380 2024-09-21T00:57:01.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.695+0000 7f4c018af640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4bfc113960 con 0x7f4bfc10de60 2024-09-21T00:57:01.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.695+0000 7f4c018af640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4bfc113c60 con 0x7f4bfc104a30 2024-09-21T00:57:01.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.695+0000 7f4bfa7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bfc105380 0x7f4bfc19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:01.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.695+0000 7f4bfa7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bfc105380 0x7f4bfc19ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50970/0 (socket says 172.21.15.1:50970) 2024-09-21T00:57:01.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.695+0000 7f4bfa7fc640 1 -- 172.21.15.1:0/1416866198 learned_addr learned my addr 172.21.15.1:0/1416866198 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:01.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.696+0000 7f4bfaffd640 1 --2- 172.21.15.1:0/1416866198 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bfc104a30 0x7f4bfc19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:01.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.696+0000 7f4bfb7fe640 1 --2- 172.21.15.1:0/1416866198 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bfc10de60 0x7f4bfc19fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:01.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.696+0000 7f4bfa7fc640 1 -- 172.21.15.1:0/1416866198 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bfc104a30 msgr2=0x7f4bfc19a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:01.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.696+0000 7f4bfa7fc640 1 --2- 172.21.15.1:0/1416866198 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bfc104a30 0x7f4bfc19a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.696+0000 7f4bfa7fc640 1 -- 172.21.15.1:0/1416866198 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bfc10de60 msgr2=0x7f4bfc19fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:01.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.696+0000 7f4bfa7fc640 1 --2- 172.21.15.1:0/1416866198 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bfc10de60 0x7f4bfc19fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.696+0000 7f4bfa7fc640 1 -- 172.21.15.1:0/1416866198 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bfc1a0500 con 0x7f4bfc105380 2024-09-21T00:57:01.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.696+0000 7f4bfa7fc640 1 --2- 172.21.15.1:0/1416866198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bfc105380 0x7f4bfc19ab30 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4bf002a930 tx=0x7f4bf0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:01.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.696+0000 7f4c008ad640 1 -- 172.21.15.1:0/1416866198 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf003f030 con 0x7f4bfc105380 2024-09-21T00:57:01.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.696+0000 7f4c018af640 1 -- 172.21.15.1:0/1416866198 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bfc1a0790 con 0x7f4bfc105380 2024-09-21T00:57:01.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.696+0000 7f4c008ad640 1 -- 172.21.15.1:0/1416866198 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bf0003aa0 con 0x7f4bfc105380 2024-09-21T00:57:01.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.696+0000 7f4c008ad640 1 -- 172.21.15.1:0/1416866198 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0035070 con 0x7f4bfc105380 2024-09-21T00:57:01.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.696+0000 7f4c018af640 1 -- 172.21.15.1:0/1416866198 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bfc1a6f50 con 0x7f4bfc105380 2024-09-21T00:57:01.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.699+0000 7f4c07e23740 1 Processor -- start 2024-09-21T00:57:01.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.699+0000 7f4c07e23740 1 -- start start 2024-09-21T00:57:01.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.699+0000 7f4c008ad640 1 -- 172.21.15.1:0/1416866198 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 154562+0+0 (secure 0 0 0) 0x7f4bf0042030 con 0x7f4bfc105380 2024-09-21T00:57:01.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.699+0000 7f4c07e23740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557976ae350 0x555797a55430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:01.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.699+0000 7f4c07e23740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555797685490 0x555797a55970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:01.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.699+0000 7f4c07e23740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55579768d670 0x555797a55eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:01.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.699+0000 7f4c07e23740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5557979cbe60 con 0x555797685490 2024-09-21T00:57:01.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.699+0000 7f4c07e23740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5557979bb290 con 0x5557976ae350 2024-09-21T00:57:01.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.699+0000 7f4c07e23740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5557979bf0a0 con 0x55579768d670 2024-09-21T00:57:01.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.700+0000 7f4bfaffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555797685490 0x555797a55970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:01.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.700+0000 7f4bfaffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555797685490 0x555797a55970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50986/0 (socket says 172.21.15.1:50986) 2024-09-21T00:57:01.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.700+0000 7f4bfaffd640 1 -- 172.21.15.1:0/1820348165 learned_addr learned my addr 172.21.15.1:0/1820348165 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:01.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.700+0000 7f4bfb7fe640 1 --2- 172.21.15.1:0/1820348165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557976ae350 0x555797a55430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:01.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.700+0000 7f4bfa7fc640 1 --2- 172.21.15.1:0/1820348165 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55579768d670 0x555797a55eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:01.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.700+0000 7f4bfaffd640 1 -- 172.21.15.1:0/1820348165 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55579768d670 msgr2=0x555797a55eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:01.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.700+0000 7f4bfaffd640 1 --2- 172.21.15.1:0/1820348165 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55579768d670 0x555797a55eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.700+0000 7f4bfaffd640 1 -- 172.21.15.1:0/1820348165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557976ae350 msgr2=0x555797a55430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:01.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.700+0000 7f4bfaffd640 1 --2- 172.21.15.1:0/1820348165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557976ae350 0x555797a55430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.700+0000 7f4bfaffd640 1 -- 172.21.15.1:0/1820348165 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555797719930 con 0x555797685490 2024-09-21T00:57:01.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.700+0000 7f4bfaffd640 1 --2- 172.21.15.1:0/1820348165 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555797685490 0x555797a55970 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009a70 tx=0x7f4bec009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ba7d4b4a094819 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:01.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.700+0000 7f4c008ad640 1 --2- 172.21.15.1:0/1416866198 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4be40b6620 0x7f4be40b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:01.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.700+0000 7f4be1ffb640 1 -- 172.21.15.1:0/1820348165 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bec017070 con 0x555797685490 2024-09-21T00:57:01.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.700+0000 7f4bfb7fe640 1 --2- 172.21.15.1:0/1416866198 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4be40b6620 0x7f4be40b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:01.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.700+0000 7f4c008ad640 1 -- 172.21.15.1:0/1416866198 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f4bf0107a80 con 0x7f4bfc105380 2024-09-21T00:57:01.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.700+0000 7f4be1ffb640 1 -- 172.21.15.1:0/1820348165 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bec013470 con 0x555797685490 2024-09-21T00:57:01.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.700+0000 7f4be1ffb640 1 -- 172.21.15.1:0/1820348165 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bec012610 con 0x555797685490 2024-09-21T00:57:01.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.701+0000 7f4c07e23740 1 -- 172.21.15.1:0/1820348165 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555797685490 msgr2=0x555797a55970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:01.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.701+0000 7f4bfb7fe640 1 --2- 172.21.15.1:0/1416866198 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4be40b6620 0x7f4be40b8b30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4005fd0 tx=0x7f4bf40096a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:01.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.701+0000 7f4c07e23740 1 --2- 172.21.15.1:0/1820348165 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555797685490 0x555797a55970 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009a70 tx=0x7f4bec009f30 comp rx=0 tx=0).stop 2024-09-21T00:57:01.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.701+0000 7f4c07e23740 1 -- 172.21.15.1:0/1820348165 shutdown_connections 2024-09-21T00:57:01.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.701+0000 7f4c07e23740 1 --2- 172.21.15.1:0/1820348165 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55579768d670 0x555797a55eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.701+0000 7f4c07e23740 1 --2- 172.21.15.1:0/1820348165 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555797685490 0x555797a55970 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.701+0000 7f4c07e23740 1 --2- 172.21.15.1:0/1820348165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557976ae350 0x555797a55430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.701+0000 7f4c07e23740 1 -- 172.21.15.1:0/1820348165 >> 172.21.15.1:0/1820348165 conn(0x5557976a2740 msgr2=0x555797a53320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:01.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.701+0000 7f4c07e23740 1 -- 172.21.15.1:0/1820348165 shutdown_connections 2024-09-21T00:57:01.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.702+0000 7f4c07e23740 1 -- 172.21.15.1:0/1820348165 wait complete. 2024-09-21T00:57:01.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.702+0000 7f4c07e23740 1 -- start start 2024-09-21T00:57:01.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.702+0000 7f4c07e23740 1 Processor -- start 2024-09-21T00:57:01.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.702+0000 7f4c07e23740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555797685490 0x555797a60fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:01.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.702+0000 7f4c07e23740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55579768d670 0x555797a61510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:01.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.702+0000 7f4c07e23740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5557976ae350 0x555797a6cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:01.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.702+0000 7f4c07e23740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55579781c890 con 0x555797685490 2024-09-21T00:57:01.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.703+0000 7f4c07e23740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555797955d40 con 0x55579768d670 2024-09-21T00:57:01.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.703+0000 7f4c07e23740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x555797a63c10 con 0x5557976ae350 2024-09-21T00:57:01.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.703+0000 7f4c07e23740 10 client.0 _ll_register_callbacks cb 0x5557979b9c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:01.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.703+0000 7f4bfaffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555797685490 0x555797a60fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:01.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.703+0000 7f4bfaffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555797685490 0x555797a60fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50998/0 (socket says 172.21.15.1:50998) 2024-09-21T00:57:01.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.703+0000 7f4bfaffd640 1 -- 172.21.15.1:0/2027086916 learned_addr learned my addr 172.21.15.1:0/2027086916 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:01.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.703+0000 7f4bfa7fc640 1 --2- 172.21.15.1:0/2027086916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55579768d670 0x555797a61510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:01.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.703+0000 7f4bfaffd640 1 -- 172.21.15.1:0/2027086916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5557976ae350 msgr2=0x555797a6cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:01.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.703+0000 7f4bfb7fe640 1 --2- 172.21.15.1:0/2027086916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5557976ae350 0x555797a6cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:01.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.703+0000 7f4bfaffd640 1 --2- 172.21.15.1:0/2027086916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5557976ae350 0x555797a6cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.703+0000 7f4bfaffd640 1 -- 172.21.15.1:0/2027086916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55579768d670 msgr2=0x555797a61510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:01.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.703+0000 7f4bfaffd640 1 --2- 172.21.15.1:0/2027086916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55579768d670 0x555797a61510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.703+0000 7f4bfaffd640 1 -- 172.21.15.1:0/2027086916 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555797a6d470 con 0x555797685490 2024-09-21T00:57:01.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.703+0000 7f4bfaffd640 1 --2- 172.21.15.1:0/2027086916 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555797685490 0x555797a60fd0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4bec006cd0 tx=0x7f4bec00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fe5fb0ac7f28abc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:01.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.703+0000 7f4bdaffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:57:01.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.703+0000 7f4bdaffd640 1 -- 172.21.15.1:0/2027086916 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bec017050 con 0x555797685490 2024-09-21T00:57:01.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.704+0000 7f4bdaffd640 1 -- 172.21.15.1:0/2027086916 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f4bec01c450 con 0x555797685490 2024-09-21T00:57:01.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.704+0000 7f4c07e23740 1 -- 172.21.15.1:0/2027086916 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4bec013470 con 0x555797685490 2024-09-21T00:57:01.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.704+0000 7f4bdaffd640 1 -- 172.21.15.1:0/2027086916 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4bec01c650 con 0x555797685490 2024-09-21T00:57:01.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.704+0000 7f4c07e23740 10 client.15483 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:01.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.704+0000 7f4c07e23740 1 -- 172.21.15.1:0/2027086916 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555797a6fda0 con 0x555797685490 2024-09-21T00:57:01.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.704+0000 7f4bdaffd640 1 -- 172.21.15.1:0/2027086916 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bec013470 con 0x555797685490 2024-09-21T00:57:01.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.704+0000 7f4bdaffd640 1 -- 172.21.15.1:0/2027086916 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f4bec031860 con 0x555797685490 2024-09-21T00:57:01.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.704+0000 7f4c07e23740 10 client.15483 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:01.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.704+0000 7f4c07e23740 10 client.15483 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:57:01.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.704+0000 7f4c07e23740 20 client.15483 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:01.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.704+0000 7f4c07e23740 1 --2- 172.21.15.1:0/2027086916 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55579766ccd0 0x555797a731b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:01.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.704+0000 7f4c07e23740 4 client.15483 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:57:01.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.704+0000 7f4c07e23740 1 -- 172.21.15.1:0/2027086916 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5557979cddb0 con 0x55579766ccd0 2024-09-21T00:57:01.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.705+0000 7f4bfa7fc640 1 --2- 172.21.15.1:0/2027086916 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55579766ccd0 0x555797a731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:01.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.705+0000 7f4bfa7fc640 1 --2- 172.21.15.1:0/2027086916 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55579766ccd0 0x555797a731b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1de185488a654268 server_cookie=5c9ad4ffffc1f796 in_seq=0 out_seq=0 2024-09-21T00:57:01.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.705+0000 7f4bdaffd640 10 client.15483 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:01.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.706+0000 7f4bdaffd640 1 -- 172.21.15.1:0/2027086916 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5557979cddb0 con 0x55579766ccd0 2024-09-21T00:57:01.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.706+0000 7f4bdaffd640 10 client.15483 handle_command_reply: tid=0 2024-09-21T00:57:01.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.706+0000 7f4c07e23740 1 client.15483 shutdown 2024-09-21T00:57:01.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.706+0000 7f4c07e23740 1 -- 172.21.15.1:0/2027086916 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555797685490 msgr2=0x555797a60fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:01.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.706+0000 7f4c07e23740 1 --2- 172.21.15.1:0/2027086916 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555797685490 0x555797a60fd0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4bec006cd0 tx=0x7f4bec00edf0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.706+0000 7f4c07e23740 1 -- 172.21.15.1:0/2027086916 shutdown_connections 2024-09-21T00:57:01.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.706+0000 7f4c07e23740 1 --2- 172.21.15.1:0/2027086916 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55579766ccd0 0x555797a731b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.706+0000 7f4c07e23740 1 --2- 172.21.15.1:0/2027086916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5557976ae350 0x555797a6cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.706+0000 7f4c07e23740 1 --2- 172.21.15.1:0/2027086916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55579768d670 0x555797a61510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.706+0000 7f4c07e23740 1 --2- 172.21.15.1:0/2027086916 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555797685490 0x555797a60fd0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.706+0000 7f4c07e23740 1 -- 172.21.15.1:0/2027086916 >> 172.21.15.1:0/2027086916 conn(0x5557976a2740 msgr2=0x555797a585c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:01.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.706+0000 7f4bdaffd640 0 client.15483 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:01.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.706+0000 7f4c07e23740 1 -- 172.21.15.1:0/2027086916 shutdown_connections 2024-09-21T00:57:01.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.706+0000 7f4c07e23740 1 -- 172.21.15.1:0/2027086916 wait complete. 2024-09-21T00:57:01.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.707+0000 7f4c07e23740 20 client.15483 trim_cache size 0 max 16384 2024-09-21T00:57:01.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.724+0000 7f4c07e23740 1 Processor -- start 2024-09-21T00:57:01.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.724+0000 7f4c07e23740 1 -- start start 2024-09-21T00:57:01.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.724+0000 7f4c07e23740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555797685490 0x555797a5ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:01.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.724+0000 7f4c07e23740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55579768d670 0x555797a52860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:01.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.724+0000 7f4c07e23740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557976ae350 0x555797a52da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:01.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.724+0000 7f4c07e23740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4bfc1af4e0 con 0x5557976ae350 2024-09-21T00:57:01.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.724+0000 7f4c07e23740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4bfc1b1020 con 0x55579768d670 2024-09-21T00:57:01.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.724+0000 7f4c07e23740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4bfc1afbb0 con 0x555797685490 2024-09-21T00:57:01.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.725+0000 7f4bfb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557976ae350 0x555797a52da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:01.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.725+0000 7f4bfb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557976ae350 0x555797a52da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51000/0 (socket says 172.21.15.1:51000) 2024-09-21T00:57:01.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.725+0000 7f4bfb7fe640 1 -- 172.21.15.1:0/4182087878 learned_addr learned my addr 172.21.15.1:0/4182087878 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:01.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.725+0000 7f4bfaffd640 1 --2- 172.21.15.1:0/4182087878 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555797685490 0x555797a5ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:01.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.725+0000 7f4bfa7fc640 1 --2- 172.21.15.1:0/4182087878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55579768d670 0x555797a52860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:01.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.725+0000 7f4bfb7fe640 1 -- 172.21.15.1:0/4182087878 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555797685490 msgr2=0x555797a5ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:01.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.725+0000 7f4bfb7fe640 1 --2- 172.21.15.1:0/4182087878 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555797685490 0x555797a5ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.725+0000 7f4bfb7fe640 1 -- 172.21.15.1:0/4182087878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55579768d670 msgr2=0x555797a52860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:01.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.725+0000 7f4bfb7fe640 1 --2- 172.21.15.1:0/4182087878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55579768d670 0x555797a52860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.725+0000 7f4bfb7fe640 1 -- 172.21.15.1:0/4182087878 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555797a5c660 con 0x5557976ae350 2024-09-21T00:57:01.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.725+0000 7f4bfa7fc640 1 --2- 172.21.15.1:0/4182087878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55579768d670 0x555797a52860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:57:01.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.725+0000 7f4bfb7fe640 1 --2- 172.21.15.1:0/4182087878 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557976ae350 0x555797a52da0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4bf40049d0 tx=0x7f4bf4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51b5ba4b9d06199 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:01.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.725+0000 7f4be17fa640 1 -- 172.21.15.1:0/4182087878 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf401e0d0 con 0x5557976ae350 2024-09-21T00:57:01.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.725+0000 7f4be17fa640 1 -- 172.21.15.1:0/4182087878 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bf401e270 con 0x5557976ae350 2024-09-21T00:57:01.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.725+0000 7f4be17fa640 1 -- 172.21.15.1:0/4182087878 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf4011740 con 0x5557976ae350 2024-09-21T00:57:01.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.726+0000 7f4c07e23740 1 -- 172.21.15.1:0/4182087878 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557976ae350 msgr2=0x555797a52da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:01.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.726+0000 7f4c07e23740 1 --2- 172.21.15.1:0/4182087878 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557976ae350 0x555797a52da0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4bf40049d0 tx=0x7f4bf4016000 comp rx=0 tx=0).stop 2024-09-21T00:57:01.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.726+0000 7f4c07e23740 1 -- 172.21.15.1:0/4182087878 shutdown_connections 2024-09-21T00:57:01.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.726+0000 7f4c07e23740 1 --2- 172.21.15.1:0/4182087878 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557976ae350 0x555797a52da0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.726+0000 7f4c07e23740 1 --2- 172.21.15.1:0/4182087878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55579768d670 0x555797a52860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.726+0000 7f4c07e23740 1 --2- 172.21.15.1:0/4182087878 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555797685490 0x555797a5ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.726+0000 7f4c07e23740 1 -- 172.21.15.1:0/4182087878 >> 172.21.15.1:0/4182087878 conn(0x5557976a2740 msgr2=0x555797a5a540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:01.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.726+0000 7f4c07e23740 1 -- 172.21.15.1:0/4182087878 shutdown_connections 2024-09-21T00:57:01.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.726+0000 7f4c07e23740 1 -- 172.21.15.1:0/4182087878 wait complete. 2024-09-21T00:57:01.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.726+0000 7f4c07e23740 1 -- start start 2024-09-21T00:57:01.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.727+0000 7f4c07e23740 1 Processor -- start 2024-09-21T00:57:01.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.727+0000 7f4c07e23740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555797685490 0x555797a74c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:01.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.727+0000 7f4c07e23740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55579768d670 0x555797a75210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:01.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.727+0000 7f4c07e23740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557976ae350 0x555797ad6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:01.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.727+0000 7f4c07e23740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4bfc1b0950 con 0x5557976ae350 2024-09-21T00:57:01.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.727+0000 7f4c07e23740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4bfc1b0280 con 0x555797685490 2024-09-21T00:57:01.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.727+0000 7f4c07e23740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4bfc1ad4c0 con 0x55579768d670 2024-09-21T00:57:01.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.727+0000 7f4c07e23740 10 client.0 _ll_register_callbacks cb 0x7f4bf4009ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:01.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.727+0000 7f4bfb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557976ae350 0x555797ad6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:01.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.727+0000 7f4bfb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557976ae350 0x555797ad6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51002/0 (socket says 172.21.15.1:51002) 2024-09-21T00:57:01.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.727+0000 7f4bfb7fe640 1 -- 172.21.15.1:0/986318268 learned_addr learned my addr 172.21.15.1:0/986318268 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:01.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.727+0000 7f4bfa7fc640 1 --2- 172.21.15.1:0/986318268 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55579768d670 0x555797a75210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:01.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.727+0000 7f4bfaffd640 1 --2- 172.21.15.1:0/986318268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555797685490 0x555797a74c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:01.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.728+0000 7f4bfb7fe640 1 -- 172.21.15.1:0/986318268 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55579768d670 msgr2=0x555797a75210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:01.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.728+0000 7f4bfb7fe640 1 --2- 172.21.15.1:0/986318268 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55579768d670 0x555797a75210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.728+0000 7f4bfb7fe640 1 -- 172.21.15.1:0/986318268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555797685490 msgr2=0x555797a74c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:01.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.728+0000 7f4bfb7fe640 1 --2- 172.21.15.1:0/986318268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555797685490 0x555797a74c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.728+0000 7f4bfb7fe640 1 -- 172.21.15.1:0/986318268 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555797ad6fe0 con 0x5557976ae350 2024-09-21T00:57:01.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.728+0000 7f4bfaffd640 1 --2- 172.21.15.1:0/986318268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555797685490 0x555797a74c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:57:01.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.728+0000 7f4bfb7fe640 1 --2- 172.21.15.1:0/986318268 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557976ae350 0x555797ad6970 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4009370 tx=0x7f4bf4004870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=186ec2d7bdbd0df server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:01.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.728+0000 7f4bdaffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:57:01.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.728+0000 7f4bdaffd640 1 -- 172.21.15.1:0/986318268 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf4004d50 con 0x5557976ae350 2024-09-21T00:57:01.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.728+0000 7f4bdaffd640 1 -- 172.21.15.1:0/986318268 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f4bf402d070 con 0x5557976ae350 2024-09-21T00:57:01.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.728+0000 7f4c07e23740 1 -- 172.21.15.1:0/986318268 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4bf401e270 con 0x5557976ae350 2024-09-21T00:57:01.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.728+0000 7f4bdaffd640 1 -- 172.21.15.1:0/986318268 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4bf401c400 con 0x5557976ae350 2024-09-21T00:57:01.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.728+0000 7f4c07e23740 10 client.15489 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:01.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.728+0000 7f4c07e23740 1 -- 172.21.15.1:0/986318268 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555797ade360 con 0x5557976ae350 2024-09-21T00:57:01.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.729+0000 7f4bdaffd640 1 -- 172.21.15.1:0/986318268 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bf401e270 con 0x5557976ae350 2024-09-21T00:57:01.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.729+0000 7f4bdaffd640 1 -- 172.21.15.1:0/986318268 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f4bf4011a40 con 0x5557976ae350 2024-09-21T00:57:01.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.729+0000 7f4c07e23740 10 client.15489 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:01.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.729+0000 7f4c07e23740 10 client.15489 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:57:01.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.729+0000 7f4c07e23740 20 client.15489 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:01.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.729+0000 7f4c07e23740 1 --2- 172.21.15.1:0/986318268 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x555797642080 0x555797ae0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:01.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.729+0000 7f4c07e23740 4 client.15489 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T00:57:01.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.729+0000 7f4c07e23740 1 -- 172.21.15.1:0/986318268 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5557979c9860 con 0x555797642080 2024-09-21T00:57:01.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.729+0000 7f4bfaffd640 1 --2- 172.21.15.1:0/986318268 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x555797642080 0x555797ae0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:01.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.729+0000 7f4bfaffd640 1 --2- 172.21.15.1:0/986318268 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x555797642080 0x555797ae0af0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1148ad002f895561 server_cookie=f39cd22f2ae69a9b in_seq=0 out_seq=0 2024-09-21T00:57:01.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.729+0000 7f4bdaffd640 10 client.15489 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:01.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.731+0000 7f4bdaffd640 1 -- 172.21.15.1:0/986318268 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5557979c9860 con 0x555797642080 2024-09-21T00:57:01.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.731+0000 7f4bdaffd640 10 client.15489 handle_command_reply: tid=0 2024-09-21T00:57:01.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.731+0000 7f4c07e23740 1 client.15489 shutdown 2024-09-21T00:57:01.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.731+0000 7f4c07e23740 1 -- 172.21.15.1:0/986318268 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557976ae350 msgr2=0x555797ad6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:01.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.731+0000 7f4c07e23740 1 --2- 172.21.15.1:0/986318268 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557976ae350 0x555797ad6970 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4009370 tx=0x7f4bf4004870 comp rx=0 tx=0).stop 2024-09-21T00:57:01.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.732+0000 7f4c07e23740 1 -- 172.21.15.1:0/986318268 shutdown_connections 2024-09-21T00:57:01.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.732+0000 7f4c07e23740 1 --2- 172.21.15.1:0/986318268 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x555797642080 0x555797ae0af0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.732+0000 7f4c07e23740 1 --2- 172.21.15.1:0/986318268 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557976ae350 0x555797ad6970 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.732+0000 7f4c07e23740 1 --2- 172.21.15.1:0/986318268 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55579768d670 0x555797a75210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.732+0000 7f4c07e23740 1 --2- 172.21.15.1:0/986318268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555797685490 0x555797a74c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.732+0000 7f4c07e23740 1 -- 172.21.15.1:0/986318268 >> 172.21.15.1:0/986318268 conn(0x5557976a2740 msgr2=0x555797a56460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:01.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.732+0000 7f4bdaffd640 0 client.15489 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:01.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.732+0000 7f4c07e23740 1 -- 172.21.15.1:0/986318268 shutdown_connections 2024-09-21T00:57:01.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.732+0000 7f4c07e23740 1 -- 172.21.15.1:0/986318268 wait complete. 2024-09-21T00:57:01.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.732+0000 7f4c07e23740 20 client.15489 trim_cache size 0 max 16384 2024-09-21T00:57:01.736 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T00:57:01.736 INFO:teuthology.orchestra.run.smithi001.stdout: "return_code": 0, 2024-09-21T00:57:01.736 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_tag": "53fa74e4-5aa8-408b-9724-7c93618f7636", 2024-09-21T00:57:01.736 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": "asynchronous" 2024-09-21T00:57:01.736 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T00:57:01.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.732+0000 7f4c018af640 1 -- 172.21.15.1:0/1416866198 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4be40b6620 msgr2=0x7f4be40b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:01.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.732+0000 7f4c018af640 1 --2- 172.21.15.1:0/1416866198 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4be40b6620 0x7f4be40b8b30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4005fd0 tx=0x7f4bf40096a0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.732+0000 7f4c018af640 1 -- 172.21.15.1:0/1416866198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bfc105380 msgr2=0x7f4bfc19ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:01.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.732+0000 7f4c018af640 1 --2- 172.21.15.1:0/1416866198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bfc105380 0x7f4bfc19ab30 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4bf002a930 tx=0x7f4bf0004270 comp rx=0 tx=0).stop 2024-09-21T00:57:01.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.733+0000 7f4c018af640 1 -- 172.21.15.1:0/1416866198 shutdown_connections 2024-09-21T00:57:01.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.733+0000 7f4c018af640 1 --2- 172.21.15.1:0/1416866198 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bfc10de60 0x7f4bfc19fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.733+0000 7f4c018af640 1 --2- 172.21.15.1:0/1416866198 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4be40b6620 0x7f4be40b8b30 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.733+0000 7f4c018af640 1 --2- 172.21.15.1:0/1416866198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bfc105380 0x7f4bfc19ab30 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.733+0000 7f4c018af640 1 --2- 172.21.15.1:0/1416866198 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bfc104a30 0x7f4bfc19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.733+0000 7f4c018af640 1 -- 172.21.15.1:0/1416866198 >> 172.21.15.1:0/1416866198 conn(0x7f4bfc0797b0 msgr2=0x7f4bfc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:01.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.733+0000 7f4c018af640 1 -- 172.21.15.1:0/1416866198 shutdown_connections 2024-09-21T00:57:01.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:01.733+0000 7f4c018af640 1 -- 172.21.15.1:0/1416866198 wait complete. 2024-09-21T00:57:02.437 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:02 smithi001 ceph-mon[31211]: scrub queued for path: / 2024-09-21T00:57:02.437 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:02 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T00:57:02.437 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:02 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T00:57:02.438 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:02 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T00:57:02.472 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T00:57:02.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:02 smithi193 ceph-mon[34660]: scrub queued for path: / 2024-09-21T00:57:02.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:02 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T00:57:02.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:02 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T00:57:02.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:02 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T00:57:02.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:02 smithi042 ceph-mon[34481]: scrub queued for path: / 2024-09-21T00:57:02.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:02 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T00:57:02.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:02 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T00:57:02.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:02 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T00:57:02.769 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:03.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.247+0000 7f6cfd760640 1 -- 172.21.15.1:0/969713264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6cf8108cf0 msgr2=0x7f6cf810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:03.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.247+0000 7f6cfd760640 1 --2- 172.21.15.1:0/969713264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6cf8108cf0 0x7f6cf810f520 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0009ca0 tx=0x7f6cf002a8c0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.247+0000 7f6cfd760640 1 -- 172.21.15.1:0/969713264 shutdown_connections 2024-09-21T00:57:03.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.247+0000 7f6cfd760640 1 --2- 172.21.15.1:0/969713264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6cf8108cf0 0x7f6cf810f520 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.247+0000 7f6cfd760640 1 --2- 172.21.15.1:0/969713264 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cf81083a0 0x7f6cf81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.248+0000 7f6cfd760640 1 --2- 172.21.15.1:0/969713264 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6cf8102a60 0x7f6cf8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.248+0000 7f6cfd760640 1 -- 172.21.15.1:0/969713264 >> 172.21.15.1:0/969713264 conn(0x7f6cf8079730 msgr2=0x7f6cf8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:03.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.248+0000 7f6cfd760640 1 -- 172.21.15.1:0/969713264 shutdown_connections 2024-09-21T00:57:03.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.248+0000 7f6cfd760640 1 -- 172.21.15.1:0/969713264 wait complete. 2024-09-21T00:57:03.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.248+0000 7f6cfd760640 1 Processor -- start 2024-09-21T00:57:03.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.249+0000 7f6cfd760640 1 -- start start 2024-09-21T00:57:03.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.249+0000 7f6cfd760640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cf8102a60 0x7f6cf819a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:03.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.249+0000 7f6cfd760640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6cf81083a0 0x7f6cf819aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:03.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.249+0000 7f6cfd760640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6cf8108cf0 0x7f6cf819fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:03.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.249+0000 7f6cfd760640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf8113a80 con 0x7f6cf81083a0 2024-09-21T00:57:03.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.249+0000 7f6cfd760640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf8113900 con 0x7f6cf8102a60 2024-09-21T00:57:03.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.249+0000 7f6cfd760640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf8113c00 con 0x7f6cf8108cf0 2024-09-21T00:57:03.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.249+0000 7f6cf67fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6cf81083a0 0x7f6cf819aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:03.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.249+0000 7f6cf67fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6cf81083a0 0x7f6cf819aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51014/0 (socket says 172.21.15.1:51014) 2024-09-21T00:57:03.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.249+0000 7f6cf67fc640 1 -- 172.21.15.1:0/892376433 learned_addr learned my addr 172.21.15.1:0/892376433 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:03.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.249+0000 7f6cf6ffd640 1 --2- 172.21.15.1:0/892376433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cf8102a60 0x7f6cf819a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:03.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.249+0000 7f6cf77fe640 1 --2- 172.21.15.1:0/892376433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6cf8108cf0 0x7f6cf819fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:03.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.249+0000 7f6cf6ffd640 1 -- 172.21.15.1:0/892376433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6cf8108cf0 msgr2=0x7f6cf819fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:03.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.249+0000 7f6cf6ffd640 1 --2- 172.21.15.1:0/892376433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6cf8108cf0 0x7f6cf819fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.249+0000 7f6cf6ffd640 1 -- 172.21.15.1:0/892376433 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6cf81083a0 msgr2=0x7f6cf819aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:03.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.249+0000 7f6cf6ffd640 1 --2- 172.21.15.1:0/892376433 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6cf81083a0 0x7f6cf819aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.249+0000 7f6cf6ffd640 1 -- 172.21.15.1:0/892376433 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf81a0400 con 0x7f6cf8102a60 2024-09-21T00:57:03.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.250+0000 7f6cf67fc640 1 --2- 172.21.15.1:0/892376433 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6cf81083a0 0x7f6cf819aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:57:03.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.250+0000 7f6cf6ffd640 1 --2- 172.21.15.1:0/892376433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cf8102a60 0x7f6cf819a490 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8009b50 tx=0x7f6ce800b690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:03.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.250+0000 7f6cdffff640 1 -- 172.21.15.1:0/892376433 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce8009e50 con 0x7f6cf8102a60 2024-09-21T00:57:03.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.250+0000 7f6cfd760640 1 -- 172.21.15.1:0/892376433 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cf81a06f0 con 0x7f6cf8102a60 2024-09-21T00:57:03.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.250+0000 7f6cdffff640 1 -- 172.21.15.1:0/892376433 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ce80054d0 con 0x7f6cf8102a60 2024-09-21T00:57:03.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.250+0000 7f6cdffff640 1 -- 172.21.15.1:0/892376433 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce8019670 con 0x7f6cf8102a60 2024-09-21T00:57:03.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.250+0000 7f6cfd760640 1 -- 172.21.15.1:0/892376433 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cf810fe90 con 0x7f6cf8102a60 2024-09-21T00:57:03.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.253+0000 7f6d03cd4740 1 Processor -- start 2024-09-21T00:57:03.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.253+0000 7f6d03cd4740 1 -- start start 2024-09-21T00:57:03.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.253+0000 7f6cdffff640 1 -- 172.21.15.1:0/892376433 <== mon.2 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 154562+0+0 (secure 0 0 0) 0x7f6ce8020020 con 0x7f6cf8102a60 2024-09-21T00:57:03.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.253+0000 7f6d03cd4740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56413dc90070 0x56413e037270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:03.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.253+0000 7f6d03cd4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56413dc671b0 0x56413e0377b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:03.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.253+0000 7f6d03cd4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56413dc6f390 0x56413e037cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:03.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.253+0000 7f6d03cd4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56413dfade50 con 0x56413dc671b0 2024-09-21T00:57:03.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.253+0000 7f6d03cd4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56413df9d280 con 0x56413dc6f390 2024-09-21T00:57:03.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.253+0000 7f6d03cd4740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56413dfa1090 con 0x56413dc90070 2024-09-21T00:57:03.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.253+0000 7f6cf6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56413dc671b0 0x56413e0377b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:03.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.253+0000 7f6cf6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56413dc671b0 0x56413e0377b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51018/0 (socket says 172.21.15.1:51018) 2024-09-21T00:57:03.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.253+0000 7f6cf6ffd640 1 -- 172.21.15.1:0/1632960782 learned_addr learned my addr 172.21.15.1:0/1632960782 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:03.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.253+0000 7f6cf77fe640 1 --2- 172.21.15.1:0/1632960782 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56413dc90070 0x56413e037270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:03.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.253+0000 7f6cf67fc640 1 --2- 172.21.15.1:0/1632960782 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56413dc6f390 0x56413e037cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:03.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.254+0000 7f6cf6ffd640 1 -- 172.21.15.1:0/1632960782 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56413dc90070 msgr2=0x56413e037270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:03.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.254+0000 7f6cf6ffd640 1 --2- 172.21.15.1:0/1632960782 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56413dc90070 0x56413e037270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.254+0000 7f6cf6ffd640 1 -- 172.21.15.1:0/1632960782 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56413dc6f390 msgr2=0x56413e037cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:03.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.254+0000 7f6cf6ffd640 1 --2- 172.21.15.1:0/1632960782 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56413dc6f390 0x56413e037cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.254+0000 7f6cf6ffd640 1 -- 172.21.15.1:0/1632960782 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56413dcfb650 con 0x56413dc671b0 2024-09-21T00:57:03.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.254+0000 7f6cf67fc640 1 --2- 172.21.15.1:0/1632960782 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56413dc6f390 0x56413e037cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:57:03.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.254+0000 7f6cf6ffd640 1 --2- 172.21.15.1:0/1632960782 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56413dc671b0 0x56413e0377b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f6ce80eef20 tx=0x7f6ce80f31a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc2be46e1aa07c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:03.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.254+0000 7f6cdffff640 1 --2- 172.21.15.1:0/892376433 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6ce00b6740 0x7f6ce00b8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:03.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.254+0000 7f6cf77fe640 1 --2- 172.21.15.1:0/892376433 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6ce00b6740 0x7f6ce00b8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:03.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.254+0000 7f6cdd7fa640 1 -- 172.21.15.1:0/1632960782 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce80fe070 con 0x56413dc671b0 2024-09-21T00:57:03.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.254+0000 7f6cdd7fa640 1 -- 172.21.15.1:0/1632960782 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ce80b0900 con 0x56413dc671b0 2024-09-21T00:57:03.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.254+0000 7f6cdd7fa640 1 -- 172.21.15.1:0/1632960782 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce8016270 con 0x56413dc671b0 2024-09-21T00:57:03.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.255+0000 7f6cdffff640 1 -- 172.21.15.1:0/892376433 <== mon.2 v2:172.21.15.42:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f6ce80eae40 con 0x7f6cf8102a60 2024-09-21T00:57:03.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.255+0000 7f6d03cd4740 1 -- 172.21.15.1:0/1632960782 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56413dc671b0 msgr2=0x56413e0377b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:03.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.255+0000 7f6cf77fe640 1 --2- 172.21.15.1:0/892376433 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6ce00b6740 0x7f6ce00b8c50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0006010 tx=0x7f6cf0009440 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:03.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.255+0000 7f6d03cd4740 1 --2- 172.21.15.1:0/1632960782 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56413dc671b0 0x56413e0377b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f6ce80eef20 tx=0x7f6ce80f31a0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.256+0000 7f6d03cd4740 1 -- 172.21.15.1:0/1632960782 shutdown_connections 2024-09-21T00:57:03.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.256+0000 7f6d03cd4740 1 --2- 172.21.15.1:0/1632960782 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56413dc6f390 0x56413e037cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.256+0000 7f6d03cd4740 1 --2- 172.21.15.1:0/1632960782 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56413dc671b0 0x56413e0377b0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.256+0000 7f6d03cd4740 1 --2- 172.21.15.1:0/1632960782 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56413dc90070 0x56413e037270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.256+0000 7f6d03cd4740 1 -- 172.21.15.1:0/1632960782 >> 172.21.15.1:0/1632960782 conn(0x56413dc84460 msgr2=0x56413e035160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:03.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.256+0000 7f6d03cd4740 1 -- 172.21.15.1:0/1632960782 shutdown_connections 2024-09-21T00:57:03.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.256+0000 7f6d03cd4740 1 -- 172.21.15.1:0/1632960782 wait complete. 2024-09-21T00:57:03.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.256+0000 7f6d03cd4740 1 -- start start 2024-09-21T00:57:03.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.256+0000 7f6d03cd4740 1 Processor -- start 2024-09-21T00:57:03.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.256+0000 7f6d03cd4740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56413dc671b0 0x56413e042970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:03.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.256+0000 7f6d03cd4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56413dc6f390 0x56413e042eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:03.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.256+0000 7f6d03cd4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56413dc90070 0x56413e04ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:03.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.257+0000 7f6d03cd4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56413ddfe700 con 0x56413dc90070 2024-09-21T00:57:03.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.257+0000 7f6d03cd4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56413df38110 con 0x56413dc6f390 2024-09-21T00:57:03.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.257+0000 7f6d03cd4740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56413e045a50 con 0x56413dc671b0 2024-09-21T00:57:03.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.257+0000 7f6cf77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56413dc90070 0x56413e04ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:03.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.257+0000 7f6d03cd4740 10 client.0 _ll_register_callbacks cb 0x56413df51990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:03.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.257+0000 7f6cf77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56413dc90070 0x56413e04ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51032/0 (socket says 172.21.15.1:51032) 2024-09-21T00:57:03.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.257+0000 7f6cf77fe640 1 -- 172.21.15.1:0/2512156831 learned_addr learned my addr 172.21.15.1:0/2512156831 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:03.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.257+0000 7f6cf6ffd640 1 --2- 172.21.15.1:0/2512156831 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56413dc671b0 0x56413e042970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:03.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.257+0000 7f6cf67fc640 1 --2- 172.21.15.1:0/2512156831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56413dc6f390 0x56413e042eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:03.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.257+0000 7f6cf77fe640 1 -- 172.21.15.1:0/2512156831 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56413dc671b0 msgr2=0x56413e042970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:03.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.257+0000 7f6cf77fe640 1 --2- 172.21.15.1:0/2512156831 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56413dc671b0 0x56413e042970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.257+0000 7f6cf77fe640 1 -- 172.21.15.1:0/2512156831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56413dc6f390 msgr2=0x56413e042eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:03.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.257+0000 7f6cf77fe640 1 --2- 172.21.15.1:0/2512156831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56413dc6f390 0x56413e042eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.257+0000 7f6cf77fe640 1 -- 172.21.15.1:0/2512156831 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56413df65c40 con 0x56413dc90070 2024-09-21T00:57:03.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.257+0000 7f6cf77fe640 1 --2- 172.21.15.1:0/2512156831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56413dc90070 0x56413e04ed40 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0032000 tx=0x7f6cf002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2ce6082ab458a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:03.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.257+0000 7f6cdaff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:57:03.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.258+0000 7f6cdaff5640 1 -- 172.21.15.1:0/2512156831 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf0003b80 con 0x56413dc90070 2024-09-21T00:57:03.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.258+0000 7f6cdaff5640 1 -- 172.21.15.1:0/2512156831 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f6cf0003d20 con 0x56413dc90070 2024-09-21T00:57:03.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.258+0000 7f6d03cd4740 1 -- 172.21.15.1:0/2512156831 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ce80b0900 con 0x56413dc90070 2024-09-21T00:57:03.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.258+0000 7f6cdaff5640 1 -- 172.21.15.1:0/2512156831 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6cf0004040 con 0x56413dc90070 2024-09-21T00:57:03.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.258+0000 7f6d03cd4740 10 client.15501 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:03.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.258+0000 7f6d03cd4740 1 -- 172.21.15.1:0/2512156831 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56413e0517c0 con 0x56413dc90070 2024-09-21T00:57:03.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.258+0000 7f6cdaff5640 1 -- 172.21.15.1:0/2512156831 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ce80b0900 con 0x56413dc90070 2024-09-21T00:57:03.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.258+0000 7f6cdaff5640 1 -- 172.21.15.1:0/2512156831 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f6cf0051070 con 0x56413dc90070 2024-09-21T00:57:03.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.258+0000 7f6d03cd4740 10 client.15501 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:03.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.258+0000 7f6d03cd4740 10 client.15501 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:57:03.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.258+0000 7f6d03cd4740 20 client.15501 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:03.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.258+0000 7f6d03cd4740 1 --2- 172.21.15.1:0/2512156831 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x56413dc4e9f0 0x56413e054cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:03.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.258+0000 7f6d03cd4740 4 client.15501 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:57:03.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.258+0000 7f6d03cd4740 1 -- 172.21.15.1:0/2512156831 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56413dfafda0 con 0x56413dc4e9f0 2024-09-21T00:57:03.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.259+0000 7f6cf6ffd640 1 --2- 172.21.15.1:0/2512156831 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x56413dc4e9f0 0x56413e054cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:03.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.259+0000 7f6cf6ffd640 1 --2- 172.21.15.1:0/2512156831 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x56413dc4e9f0 0x56413e054cb0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75e305343f4b1fd8 server_cookie=3fbcb51e7d3bbafe in_seq=0 out_seq=0 2024-09-21T00:57:03.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.259+0000 7f6cdaff5640 10 client.15501 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:03.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.260+0000 7f6cdaff5640 1 -- 172.21.15.1:0/2512156831 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56413dfafda0 con 0x56413dc4e9f0 2024-09-21T00:57:03.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.260+0000 7f6cdaff5640 10 client.15501 handle_command_reply: tid=0 2024-09-21T00:57:03.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.260+0000 7f6d03cd4740 1 client.15501 shutdown 2024-09-21T00:57:03.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.260+0000 7f6d03cd4740 1 -- 172.21.15.1:0/2512156831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56413dc90070 msgr2=0x56413e04ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:03.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.260+0000 7f6d03cd4740 1 --2- 172.21.15.1:0/2512156831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56413dc90070 0x56413e04ed40 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0032000 tx=0x7f6cf002a8c0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.260+0000 7f6d03cd4740 1 -- 172.21.15.1:0/2512156831 shutdown_connections 2024-09-21T00:57:03.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.260+0000 7f6d03cd4740 1 --2- 172.21.15.1:0/2512156831 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x56413dc4e9f0 0x56413e054cb0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.260+0000 7f6cdaff5640 0 client.15501 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:03.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.260+0000 7f6d03cd4740 1 --2- 172.21.15.1:0/2512156831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56413dc90070 0x56413e04ed40 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.260+0000 7f6d03cd4740 1 --2- 172.21.15.1:0/2512156831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56413dc6f390 0x56413e042eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.260+0000 7f6d03cd4740 1 --2- 172.21.15.1:0/2512156831 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56413dc671b0 0x56413e042970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.260+0000 7f6d03cd4740 1 -- 172.21.15.1:0/2512156831 >> 172.21.15.1:0/2512156831 conn(0x56413dc84460 msgr2=0x56413e03a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:03.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.260+0000 7f6d03cd4740 1 -- 172.21.15.1:0/2512156831 shutdown_connections 2024-09-21T00:57:03.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.260+0000 7f6d03cd4740 1 -- 172.21.15.1:0/2512156831 wait complete. 2024-09-21T00:57:03.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.260+0000 7f6d03cd4740 20 client.15501 trim_cache size 0 max 16384 2024-09-21T00:57:03.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.278+0000 7f6d03cd4740 1 Processor -- start 2024-09-21T00:57:03.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.278+0000 7f6d03cd4740 1 -- start start 2024-09-21T00:57:03.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.278+0000 7f6d03cd4740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56413dc4e9f0 0x56413e042e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:03.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.278+0000 7f6d03cd4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56413dc671b0 0x56413e04ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:03.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.278+0000 7f6d03cd4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56413dc6f390 0x56413e03fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:03.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.278+0000 7f6d03cd4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf81ad320 con 0x56413dc671b0 2024-09-21T00:57:03.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.278+0000 7f6d03cd4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf81aee60 con 0x56413dc6f390 2024-09-21T00:57:03.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.278+0000 7f6d03cd4740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf81ad9f0 con 0x56413dc4e9f0 2024-09-21T00:57:03.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.279+0000 7f6cf67fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56413dc671b0 0x56413e04ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:03.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.279+0000 7f6cf67fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56413dc671b0 0x56413e04ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51044/0 (socket says 172.21.15.1:51044) 2024-09-21T00:57:03.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.279+0000 7f6cf67fc640 1 -- 172.21.15.1:0/428805154 learned_addr learned my addr 172.21.15.1:0/428805154 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:03.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.279+0000 7f6cf6ffd640 1 --2- 172.21.15.1:0/428805154 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56413dc4e9f0 0x56413e042e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:03.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.279+0000 7f6cf77fe640 1 --2- 172.21.15.1:0/428805154 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56413dc6f390 0x56413e03fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:03.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.279+0000 7f6cf67fc640 1 -- 172.21.15.1:0/428805154 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56413dc4e9f0 msgr2=0x56413e042e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:03.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.279+0000 7f6cf67fc640 1 --2- 172.21.15.1:0/428805154 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56413dc4e9f0 0x56413e042e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.279+0000 7f6cf67fc640 1 -- 172.21.15.1:0/428805154 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56413dc6f390 msgr2=0x56413e03fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:03.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.279+0000 7f6cf67fc640 1 --2- 172.21.15.1:0/428805154 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56413dc6f390 0x56413e03fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.279+0000 7f6cf67fc640 1 -- 172.21.15.1:0/428805154 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56413e0418d0 con 0x56413dc671b0 2024-09-21T00:57:03.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.279+0000 7f6cf77fe640 1 --2- 172.21.15.1:0/428805154 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56413dc6f390 0x56413e03fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:57:03.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.279+0000 7f6cf67fc640 1 --2- 172.21.15.1:0/428805154 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56413dc671b0 0x56413e04ec40 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6cec009e00 tx=0x7f6cec013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f84b90d6710bea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:03.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.279+0000 7f6cdcff9640 1 -- 172.21.15.1:0/428805154 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec004050 con 0x56413dc671b0 2024-09-21T00:57:03.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.279+0000 7f6cdcff9640 1 -- 172.21.15.1:0/428805154 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cec0054d0 con 0x56413dc671b0 2024-09-21T00:57:03.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.279+0000 7f6cdcff9640 1 -- 172.21.15.1:0/428805154 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec004c60 con 0x56413dc671b0 2024-09-21T00:57:03.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.280+0000 7f6d03cd4740 1 -- 172.21.15.1:0/428805154 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56413dc671b0 msgr2=0x56413e04ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:03.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.280+0000 7f6d03cd4740 1 --2- 172.21.15.1:0/428805154 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56413dc671b0 0x56413e04ec40 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6cec009e00 tx=0x7f6cec013830 comp rx=0 tx=0).stop 2024-09-21T00:57:03.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.280+0000 7f6d03cd4740 1 -- 172.21.15.1:0/428805154 shutdown_connections 2024-09-21T00:57:03.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.280+0000 7f6d03cd4740 1 --2- 172.21.15.1:0/428805154 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56413dc6f390 0x56413e03fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.280+0000 7f6d03cd4740 1 --2- 172.21.15.1:0/428805154 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56413dc671b0 0x56413e04ec40 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.280+0000 7f6d03cd4740 1 --2- 172.21.15.1:0/428805154 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56413dc4e9f0 0x56413e042e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.280+0000 7f6d03cd4740 1 -- 172.21.15.1:0/428805154 >> 172.21.15.1:0/428805154 conn(0x56413dc84460 msgr2=0x56413e042720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:03.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.280+0000 7f6d03cd4740 1 -- 172.21.15.1:0/428805154 shutdown_connections 2024-09-21T00:57:03.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.280+0000 7f6d03cd4740 1 -- 172.21.15.1:0/428805154 wait complete. 2024-09-21T00:57:03.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.281+0000 7f6d03cd4740 1 -- start start 2024-09-21T00:57:03.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.281+0000 7f6d03cd4740 1 Processor -- start 2024-09-21T00:57:03.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.281+0000 7f6d03cd4740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56413dc4e9f0 0x56413e047470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:03.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.281+0000 7f6d03cd4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56413dc671b0 0x56413e0479b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:03.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.281+0000 7f6d03cd4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56413dc6f390 0x56413e0be690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:03.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.281+0000 7f6d03cd4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf81ae790 con 0x56413dc6f390 2024-09-21T00:57:03.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.281+0000 7f6d03cd4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf81ae0c0 con 0x56413dc671b0 2024-09-21T00:57:03.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.281+0000 7f6d03cd4740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf81ab300 con 0x56413dc4e9f0 2024-09-21T00:57:03.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.281+0000 7f6d03cd4740 10 client.0 _ll_register_callbacks cb 0x7f6ce8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:03.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.281+0000 7f6cf77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56413dc6f390 0x56413e0be690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:03.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.281+0000 7f6cf77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56413dc6f390 0x56413e0be690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51048/0 (socket says 172.21.15.1:51048) 2024-09-21T00:57:03.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.281+0000 7f6cf77fe640 1 -- 172.21.15.1:0/3798972095 learned_addr learned my addr 172.21.15.1:0/3798972095 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:03.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.281+0000 7f6cf6ffd640 1 --2- 172.21.15.1:0/3798972095 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56413dc4e9f0 0x56413e047470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:03.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.282+0000 7f6cf67fc640 1 --2- 172.21.15.1:0/3798972095 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56413dc671b0 0x56413e0479b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:03.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.282+0000 7f6cf77fe640 1 -- 172.21.15.1:0/3798972095 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56413dc4e9f0 msgr2=0x56413e047470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:03.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.282+0000 7f6cf77fe640 1 --2- 172.21.15.1:0/3798972095 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56413dc4e9f0 0x56413e047470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.282+0000 7f6cf77fe640 1 -- 172.21.15.1:0/3798972095 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56413dc671b0 msgr2=0x56413e0479b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:03.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.282+0000 7f6cf77fe640 1 --2- 172.21.15.1:0/3798972095 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56413dc671b0 0x56413e0479b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.282+0000 7f6cf77fe640 1 -- 172.21.15.1:0/3798972095 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56413e039b00 con 0x56413dc6f390 2024-09-21T00:57:03.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.282+0000 7f6cf67fc640 1 --2- 172.21.15.1:0/3798972095 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56413dc671b0 0x56413e0479b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:57:03.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.282+0000 7f6cf77fe640 1 --2- 172.21.15.1:0/3798972095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56413dc6f390 0x56413e0be690 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0031fd0 tx=0x7f6cf002f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=809296382d40639d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:03.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.282+0000 7f6cdaff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:57:03.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.282+0000 7f6cdaff5640 1 -- 172.21.15.1:0/3798972095 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf0031820 con 0x56413dc6f390 2024-09-21T00:57:03.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.282+0000 7f6cdaff5640 1 -- 172.21.15.1:0/3798972095 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f6cf0004b40 con 0x56413dc6f390 2024-09-21T00:57:03.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.282+0000 7f6d03cd4740 1 -- 172.21.15.1:0/3798972095 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cec0054d0 con 0x56413dc6f390 2024-09-21T00:57:03.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.282+0000 7f6cdaff5640 1 -- 172.21.15.1:0/3798972095 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6cf0004d40 con 0x56413dc6f390 2024-09-21T00:57:03.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.282+0000 7f6d03cd4740 10 client.15507 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:03.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.282+0000 7f6d03cd4740 1 -- 172.21.15.1:0/3798972095 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56413e0bfd10 con 0x56413dc6f390 2024-09-21T00:57:03.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.283+0000 7f6cdaff5640 1 -- 172.21.15.1:0/3798972095 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cec0054d0 con 0x56413dc6f390 2024-09-21T00:57:03.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.283+0000 7f6cdaff5640 1 -- 172.21.15.1:0/3798972095 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f6cf0065030 con 0x56413dc6f390 2024-09-21T00:57:03.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.283+0000 7f6d03cd4740 10 client.15507 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:03.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.283+0000 7f6d03cd4740 10 client.15507 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:57:03.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.283+0000 7f6d03cd4740 20 client.15507 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:03.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.283+0000 7f6d03cd4740 1 --2- 172.21.15.1:0/3798972095 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x56413dc90070 0x56413e0c2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:03.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.283+0000 7f6d03cd4740 4 client.15507 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T00:57:03.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.283+0000 7f6d03cd4740 1 -- 172.21.15.1:0/3798972095 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56413dfab850 con 0x56413dc90070 2024-09-21T00:57:03.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.283+0000 7f6cf6ffd640 1 --2- 172.21.15.1:0/3798972095 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x56413dc90070 0x56413e0c2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:03.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.284+0000 7f6cf6ffd640 1 --2- 172.21.15.1:0/3798972095 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x56413dc90070 0x56413e0c2460 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5a8f66318ef3cdb server_cookie=ca542f619097f6b6 in_seq=0 out_seq=0 2024-09-21T00:57:03.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.284+0000 7f6cdaff5640 10 client.15507 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:03.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.284+0000 7f6cdaff5640 1 -- 172.21.15.1:0/3798972095 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+570 (crc 0 0 0) 0x56413dfab850 con 0x56413dc90070 2024-09-21T00:57:03.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.284+0000 7f6cdaff5640 10 client.15507 handle_command_reply: tid=0 2024-09-21T00:57:03.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.284+0000 7f6d03cd4740 1 client.15507 shutdown 2024-09-21T00:57:03.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.284+0000 7f6d03cd4740 1 -- 172.21.15.1:0/3798972095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56413dc6f390 msgr2=0x56413e0be690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:03.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.284+0000 7f6d03cd4740 1 --2- 172.21.15.1:0/3798972095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56413dc6f390 0x56413e0be690 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0031fd0 tx=0x7f6cf002f890 comp rx=0 tx=0).stop 2024-09-21T00:57:03.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.284+0000 7f6d03cd4740 1 -- 172.21.15.1:0/3798972095 shutdown_connections 2024-09-21T00:57:03.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.284+0000 7f6d03cd4740 1 --2- 172.21.15.1:0/3798972095 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x56413dc90070 0x56413e0c2460 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.284+0000 7f6d03cd4740 1 --2- 172.21.15.1:0/3798972095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56413dc6f390 0x56413e0be690 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.284+0000 7f6d03cd4740 1 --2- 172.21.15.1:0/3798972095 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56413dc671b0 0x56413e0479b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.284+0000 7f6d03cd4740 1 --2- 172.21.15.1:0/3798972095 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56413dc4e9f0 0x56413e047470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.284+0000 7f6cdaff5640 0 client.15507 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:03.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.284+0000 7f6d03cd4740 1 -- 172.21.15.1:0/3798972095 >> 172.21.15.1:0/3798972095 conn(0x56413dc84460 msgr2=0x56413e043e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:03.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.284+0000 7f6d03cd4740 1 -- 172.21.15.1:0/3798972095 shutdown_connections 2024-09-21T00:57:03.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.284+0000 7f6d03cd4740 1 -- 172.21.15.1:0/3798972095 wait complete. 2024-09-21T00:57:03.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.284+0000 7f6d03cd4740 20 client.15507 trim_cache size 0 max 16384 2024-09-21T00:57:03.290 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T00:57:03.290 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T00:57:03.290 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": { 2024-09-21T00:57:03.290 INFO:teuthology.orchestra.run.smithi001.stdout: "53fa74e4-5aa8-408b-9724-7c93618f7636": { 2024-09-21T00:57:03.290 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T00:57:03.290 INFO:teuthology.orchestra.run.smithi001.stdout: "tag": "53fa74e4-5aa8-408b-9724-7c93618f7636", 2024-09-21T00:57:03.290 INFO:teuthology.orchestra.run.smithi001.stdout: "options": "recursive,force" 2024-09-21T00:57:03.290 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T00:57:03.290 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T00:57:03.290 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_stats": { 2024-09-21T00:57:03.290 INFO:teuthology.orchestra.run.smithi001.stdout: "53fa74e4-5aa8-408b-9724-7c93618f7636": { 2024-09-21T00:57:03.290 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:01.730608+0000", 2024-09-21T00:57:03.291 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T00:57:03.291 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T00:57:03.291 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T00:57:03.291 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T00:57:03.291 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T00:57:03.291 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T00:57:03.291 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T00:57:03.291 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T00:57:03.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.285+0000 7f6cfd760640 1 -- 172.21.15.1:0/892376433 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6ce00b6740 msgr2=0x7f6ce00b8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:03.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.285+0000 7f6cfd760640 1 --2- 172.21.15.1:0/892376433 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6ce00b6740 0x7f6ce00b8c50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0006010 tx=0x7f6cf0009440 comp rx=0 tx=0).stop 2024-09-21T00:57:03.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.285+0000 7f6cfd760640 1 -- 172.21.15.1:0/892376433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cf8102a60 msgr2=0x7f6cf819a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:03.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.285+0000 7f6cfd760640 1 --2- 172.21.15.1:0/892376433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cf8102a60 0x7f6cf819a490 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8009b50 tx=0x7f6ce800b690 comp rx=0 tx=0).stop 2024-09-21T00:57:03.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.285+0000 7f6cfd760640 1 -- 172.21.15.1:0/892376433 shutdown_connections 2024-09-21T00:57:03.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.285+0000 7f6cfd760640 1 --2- 172.21.15.1:0/892376433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6cf8108cf0 0x7f6cf819fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.285+0000 7f6cfd760640 1 --2- 172.21.15.1:0/892376433 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6ce00b6740 0x7f6ce00b8c50 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.285+0000 7f6cfd760640 1 --2- 172.21.15.1:0/892376433 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6cf81083a0 0x7f6cf819aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.285+0000 7f6cfd760640 1 --2- 172.21.15.1:0/892376433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cf8102a60 0x7f6cf819a490 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.285+0000 7f6cfd760640 1 -- 172.21.15.1:0/892376433 >> 172.21.15.1:0/892376433 conn(0x7f6cf8079730 msgr2=0x7f6cf8104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:03.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.285+0000 7f6cfd760640 1 -- 172.21.15.1:0/892376433 shutdown_connections 2024-09-21T00:57:03.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:03.285+0000 7f6cfd760640 1 -- 172.21.15.1:0/892376433 wait complete. 2024-09-21T00:57:03.434 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:03 smithi001 ceph-mon[31211]: pgmap v353: 97 pgs: 97 active+clean; 655 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-21T00:57:03.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:03 smithi193 ceph-mon[34660]: pgmap v353: 97 pgs: 97 active+clean; 655 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-21T00:57:03.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:03 smithi042 ceph-mon[34481]: pgmap v353: 97 pgs: 97 active+clean; 655 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-21T00:57:04.010 INFO:tasks.cephfs.filesystem:scrub status for tag:53fa74e4-5aa8-408b-9724-7c93618f7636 - {'path': '/', 'tag': '53fa74e4-5aa8-408b-9724-7c93618f7636', 'options': 'recursive,force'} 2024-09-21T00:57:05.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:05 smithi001 ceph-mon[31211]: pgmap v354: 97 pgs: 97 active+clean; 662 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.3 KiB/s wr, 13 op/s 2024-09-21T00:57:05.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:05 smithi193 ceph-mon[34660]: pgmap v354: 97 pgs: 97 active+clean; 662 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.3 KiB/s wr, 13 op/s 2024-09-21T00:57:05.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:05 smithi042 ceph-mon[34481]: pgmap v354: 97 pgs: 97 active+clean; 662 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.3 KiB/s wr, 13 op/s 2024-09-21T00:57:06.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:06 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:57:06.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:06 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:57:06.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:06 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:57:07.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:07 smithi001 ceph-mon[31211]: pgmap v355: 97 pgs: 97 active+clean; 662 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-21T00:57:07.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:07 smithi193 ceph-mon[34660]: pgmap v355: 97 pgs: 97 active+clean; 662 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-21T00:57:07.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:07 smithi042 ceph-mon[34481]: pgmap v355: 97 pgs: 97 active+clean; 662 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-21T00:57:08.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:08 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:57:08.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:08 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:57:08.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:08 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:57:08.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:08 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:57:08.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:08 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:57:08.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:08 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:57:08.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:08 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:57:08.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:08 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:57:08.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:08 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:57:08.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:08 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:57:08.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:08 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:57:08.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:08 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:57:08.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:08 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:57:08.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:08 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:57:08.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:08 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:57:08.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:08 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:57:08.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:08 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:57:08.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:08 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:57:08.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:08 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:57:08.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:08 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:57:08.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:08 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:57:08.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:08 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:57:08.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:08 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:57:08.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:08 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:57:08.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:08 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:57:08.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:08 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:57:08.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:08 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:57:09.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:09 smithi001 ceph-mon[31211]: pgmap v356: 97 pgs: 97 active+clean; 662 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-21T00:57:09.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:09 smithi193 ceph-mon[34660]: pgmap v356: 97 pgs: 97 active+clean; 662 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-21T00:57:09.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:09 smithi042 ceph-mon[34481]: pgmap v356: 97 pgs: 97 active+clean; 662 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-21T00:57:11.782 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:11 smithi193 ceph-mon[34660]: pgmap v357: 97 pgs: 97 active+clean; 662 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-21T00:57:11.793 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:11 smithi042 ceph-mon[34481]: pgmap v357: 97 pgs: 97 active+clean; 662 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-21T00:57:11.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:11 smithi001 ceph-mon[31211]: pgmap v357: 97 pgs: 97 active+clean; 662 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-21T00:57:13.944 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:13 smithi001 ceph-mon[31211]: pgmap v358: 97 pgs: 97 active+clean; 662 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T00:57:13.944 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:13 smithi001 ceph-mon[31211]: scrub summary: idle 2024-09-21T00:57:13.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:13 smithi193 ceph-mon[34660]: pgmap v358: 97 pgs: 97 active+clean; 662 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T00:57:13.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:13 smithi193 ceph-mon[34660]: scrub summary: idle 2024-09-21T00:57:13.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:13 smithi042 ceph-mon[34481]: pgmap v358: 97 pgs: 97 active+clean; 662 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T00:57:13.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:13 smithi042 ceph-mon[34481]: scrub summary: idle 2024-09-21T00:57:14.039 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.039+0000 7f7fe74f2640 1 -- 172.21.15.1:0/44912173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fe0103650 msgr2=0x7f7fe0103a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:14.040 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.039+0000 7f7fe74f2640 1 --2- 172.21.15.1:0/44912173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fe0103650 0x7f7fe0103a60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4009900 tx=0x7f7fd402a410 comp rx=0 tx=0).stop 2024-09-21T00:57:14.040 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.039+0000 7f7fe74f2640 1 -- 172.21.15.1:0/44912173 shutdown_connections 2024-09-21T00:57:14.040 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.039+0000 7f7fe74f2640 1 --2- 172.21.15.1:0/44912173 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fe0103ff0 0x7f7fe010a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.040 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.039+0000 7f7fe74f2640 1 --2- 172.21.15.1:0/44912173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fe0103650 0x7f7fe0103a60 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.040 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.039+0000 7f7fe74f2640 1 --2- 172.21.15.1:0/44912173 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7fe01025d0 0x7f7fe0102a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.040 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.039+0000 7f7fe74f2640 1 -- 172.21.15.1:0/44912173 >> 172.21.15.1:0/44912173 conn(0x7f7fe00fdf30 msgr2=0x7f7fe01003c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:14.040 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.039+0000 7f7fe74f2640 1 -- 172.21.15.1:0/44912173 shutdown_connections 2024-09-21T00:57:14.040 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.039+0000 7f7fe74f2640 1 -- 172.21.15.1:0/44912173 wait complete. 2024-09-21T00:57:14.042 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.039+0000 7f7fe74f2640 1 Processor -- start 2024-09-21T00:57:14.042 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.039+0000 7f7fe74f2640 1 -- start start 2024-09-21T00:57:14.042 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.040+0000 7f7fe74f2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fe01025d0 0x7f7fe0199f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:14.042 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.040+0000 7f7fe74f2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7fe0103650 0x7f7fe019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:14.042 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.040+0000 7f7fe74f2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fe0103ff0 0x7f7fe019b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:14.042 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.040+0000 7f7fe74f2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe010e200 con 0x7f7fe0103ff0 2024-09-21T00:57:14.043 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.040+0000 7f7fe74f2640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe010e080 con 0x7f7fe01025d0 2024-09-21T00:57:14.043 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.040+0000 7f7fe74f2640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe010e380 con 0x7f7fe0103650 2024-09-21T00:57:14.043 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.040+0000 7f7fe5a8f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fe0103ff0 0x7f7fe019b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:14.043 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.040+0000 7f7fe5a8f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fe0103ff0 0x7f7fe019b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32960/0 (socket says 172.21.15.1:32960) 2024-09-21T00:57:14.043 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.040+0000 7f7fe5a8f640 1 -- 172.21.15.1:0/846303669 learned_addr learned my addr 172.21.15.1:0/846303669 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:14.043 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.040+0000 7f7fe528e640 1 --2- 172.21.15.1:0/846303669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fe01025d0 0x7f7fe0199f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:14.043 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.040+0000 7f7fe4a8d640 1 --2- 172.21.15.1:0/846303669 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7fe0103650 0x7f7fe019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:14.043 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.040+0000 7f7fe5a8f640 1 -- 172.21.15.1:0/846303669 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7fe0103650 msgr2=0x7f7fe019a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:14.043 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.040+0000 7f7fe5a8f640 1 --2- 172.21.15.1:0/846303669 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7fe0103650 0x7f7fe019a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.043 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.040+0000 7f7fe5a8f640 1 -- 172.21.15.1:0/846303669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fe01025d0 msgr2=0x7f7fe0199f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:14.043 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.040+0000 7f7fe5a8f640 1 --2- 172.21.15.1:0/846303669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fe01025d0 0x7f7fe0199f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.043 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.040+0000 7f7fe5a8f640 1 -- 172.21.15.1:0/846303669 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe019b9a0 con 0x7f7fe0103ff0 2024-09-21T00:57:14.043 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.040+0000 7f7fe4a8d640 1 --2- 172.21.15.1:0/846303669 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7fe0103650 0x7f7fe019a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:57:14.043 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.040+0000 7f7fe5a8f640 1 --2- 172.21.15.1:0/846303669 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fe0103ff0 0x7f7fe019b180 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7fd800eb10 tx=0x7f7fd800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:14.044 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.041+0000 7f7fd27fc640 1 -- 172.21.15.1:0/846303669 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8004b20 con 0x7f7fe0103ff0 2024-09-21T00:57:14.044 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.041+0000 7f7fd27fc640 1 -- 172.21.15.1:0/846303669 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fd8004cc0 con 0x7f7fe0103ff0 2024-09-21T00:57:14.044 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.041+0000 7f7fe74f2640 1 -- 172.21.15.1:0/846303669 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fe019bc90 con 0x7f7fe0103ff0 2024-09-21T00:57:14.044 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.041+0000 7f7fd27fc640 1 -- 172.21.15.1:0/846303669 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8010670 con 0x7f7fe0103ff0 2024-09-21T00:57:14.044 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.041+0000 7f7fe74f2640 1 -- 172.21.15.1:0/846303669 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fe01a2380 con 0x7f7fe0103ff0 2024-09-21T00:57:14.046 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.043+0000 7f7fee45f740 1 Processor -- start 2024-09-21T00:57:14.046 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.043+0000 7f7fd27fc640 1 -- 172.21.15.1:0/846303669 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 154562+0+0 (secure 0 0 0) 0x7f7fd8005020 con 0x7f7fe0103ff0 2024-09-21T00:57:14.046 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.044+0000 7f7fee45f740 1 -- start start 2024-09-21T00:57:14.046 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.044+0000 7f7fee45f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcef8551b0 0x55bcefc01260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:14.046 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.044+0000 7f7fee45f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcef82c2f0 0x55bcefc018d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:14.046 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.044+0000 7f7fee45f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcef8344d0 0x55bcefc02420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:14.046 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.044+0000 7f7fee45f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55bcefb6f6f0 con 0x55bcef82c2f0 2024-09-21T00:57:14.046 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.044+0000 7f7fee45f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55bcefb5eb20 con 0x55bcef8551b0 2024-09-21T00:57:14.046 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.044+0000 7f7fee45f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55bcefb62930 con 0x55bcef8344d0 2024-09-21T00:57:14.046 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.044+0000 7f7fe528e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcef82c2f0 0x55bcefc018d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:14.046 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.044+0000 7f7fe528e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcef82c2f0 0x55bcefc018d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32964/0 (socket says 172.21.15.1:32964) 2024-09-21T00:57:14.046 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.044+0000 7f7fe528e640 1 -- 172.21.15.1:0/242414527 learned_addr learned my addr 172.21.15.1:0/242414527 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:14.047 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.044+0000 7f7fe4a8d640 1 --2- 172.21.15.1:0/242414527 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcef8344d0 0x55bcefc02420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:14.047 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.044+0000 7f7fe4a8d640 1 --2- 172.21.15.1:0/242414527 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcef8551b0 0x55bcefc01260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:14.047 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.044+0000 7f7fd27fc640 1 --2- 172.21.15.1:0/846303669 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f7fcc0b6620 0x7f7fcc0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:14.047 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.044+0000 7f7fe528e640 1 -- 172.21.15.1:0/242414527 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcef8344d0 msgr2=0x55bcefc02420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:14.047 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.044+0000 7f7fe528e640 1 --2- 172.21.15.1:0/242414527 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcef8344d0 0x55bcefc02420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.047 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.044+0000 7f7fe528e640 1 -- 172.21.15.1:0/242414527 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcef8551b0 msgr2=0x55bcefc01260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:14.047 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.044+0000 7f7fe528e640 1 --2- 172.21.15.1:0/242414527 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcef8551b0 0x55bcefc01260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.047 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.044+0000 7f7fe528e640 1 -- 172.21.15.1:0/242414527 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcefb24530 con 0x55bcef82c2f0 2024-09-21T00:57:14.047 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.044+0000 7f7fe5a8f640 1 --2- 172.21.15.1:0/846303669 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f7fcc0b6620 0x7f7fcc0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:14.047 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.045+0000 7f7fd27fc640 1 -- 172.21.15.1:0/846303669 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f7fd80e7b80 con 0x7f7fe0103ff0 2024-09-21T00:57:14.047 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.045+0000 7f7fe528e640 1 --2- 172.21.15.1:0/242414527 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcef82c2f0 0x55bcefc018d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc00bcb0 tx=0x7f7fdc00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b82dc782aa624ad server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:14.047 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.045+0000 7f7fcb7fe640 1 -- 172.21.15.1:0/242414527 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc015070 con 0x55bcef82c2f0 2024-09-21T00:57:14.047 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.045+0000 7f7fcb7fe640 1 -- 172.21.15.1:0/242414527 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fdc01a910 con 0x55bcef82c2f0 2024-09-21T00:57:14.047 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.045+0000 7f7fcb7fe640 1 -- 172.21.15.1:0/242414527 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc011860 con 0x55bcef82c2f0 2024-09-21T00:57:14.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.046+0000 7f7fee45f740 1 -- 172.21.15.1:0/242414527 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcef82c2f0 msgr2=0x55bcefc018d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:14.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.046+0000 7f7fe5a8f640 1 --2- 172.21.15.1:0/846303669 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f7fcc0b6620 0x7f7fcc0b8b30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7fd80ad890 tx=0x7f7fd807a890 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:14.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.046+0000 7f7fee45f740 1 --2- 172.21.15.1:0/242414527 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcef82c2f0 0x55bcefc018d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc00bcb0 tx=0x7f7fdc00f730 comp rx=0 tx=0).stop 2024-09-21T00:57:14.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.046+0000 7f7fee45f740 1 -- 172.21.15.1:0/242414527 shutdown_connections 2024-09-21T00:57:14.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.046+0000 7f7fee45f740 1 --2- 172.21.15.1:0/242414527 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcef8344d0 0x55bcefc02420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.046+0000 7f7fee45f740 1 --2- 172.21.15.1:0/242414527 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcef82c2f0 0x55bcefc018d0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.046+0000 7f7fee45f740 1 --2- 172.21.15.1:0/242414527 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcef8551b0 0x55bcefc01260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.046+0000 7f7fee45f740 1 -- 172.21.15.1:0/242414527 >> 172.21.15.1:0/242414527 conn(0x55bcef849300 msgr2=0x55bcefbf88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:14.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.046+0000 7f7fee45f740 1 -- 172.21.15.1:0/242414527 shutdown_connections 2024-09-21T00:57:14.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.046+0000 7f7fee45f740 1 -- 172.21.15.1:0/242414527 wait complete. 2024-09-21T00:57:14.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.046+0000 7f7fee45f740 1 -- start start 2024-09-21T00:57:14.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.046+0000 7f7fee45f740 1 Processor -- start 2024-09-21T00:57:14.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.047+0000 7f7fee45f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcef82c2f0 0x55bcefc0a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:14.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.047+0000 7f7fee45f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcef8344d0 0x55bcefc0b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:14.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.047+0000 7f7fee45f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcef8551b0 0x55bcefc0bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:14.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.047+0000 7f7fee45f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55bcefa96ab0 con 0x55bcef8551b0 2024-09-21T00:57:14.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.047+0000 7f7fee45f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55bcefb04730 con 0x55bcef82c2f0 2024-09-21T00:57:14.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.047+0000 7f7fee45f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55bcefc02f40 con 0x55bcef8344d0 2024-09-21T00:57:14.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.047+0000 7f7fee45f740 10 client.0 _ll_register_callbacks cb 0x55bcefb586b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.047+0000 7f7fe4a8d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcef8551b0 0x55bcefc0bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.047+0000 7f7fe4a8d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcef8551b0 0x55bcefc0bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32978/0 (socket says 172.21.15.1:32978) 2024-09-21T00:57:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.047+0000 7f7fe4a8d640 1 -- 172.21.15.1:0/2070452639 learned_addr learned my addr 172.21.15.1:0/2070452639 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.047+0000 7f7fe4a8d640 1 --2- 172.21.15.1:0/2070452639 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcef82c2f0 0x55bcefc0a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.047+0000 7f7fe528e640 1 --2- 172.21.15.1:0/2070452639 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcef8344d0 0x55bcefc0b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.047+0000 7f7fe4a8d640 1 -- 172.21.15.1:0/2070452639 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcef8344d0 msgr2=0x55bcefc0b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.047+0000 7f7fe4a8d640 1 --2- 172.21.15.1:0/2070452639 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcef8344d0 0x55bcefc0b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.047+0000 7f7fe4a8d640 1 -- 172.21.15.1:0/2070452639 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcef82c2f0 msgr2=0x55bcefc0a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.047+0000 7f7fe4a8d640 1 --2- 172.21.15.1:0/2070452639 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcef82c2f0 0x55bcefc0a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.047+0000 7f7fe4a8d640 1 -- 172.21.15.1:0/2070452639 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcef8c0790 con 0x55bcef8551b0 2024-09-21T00:57:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.048+0000 7f7fe4a8d640 1 --2- 172.21.15.1:0/2070452639 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcef8551b0 0x55bcefc0bc20 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4033000 tx=0x7f7fd402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdcf3ccc8a06d75 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.048+0000 7f7fc8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:57:14.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.048+0000 7f7fc8ff9640 1 -- 172.21.15.1:0/2070452639 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd4035040 con 0x55bcef8551b0 2024-09-21T00:57:14.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.048+0000 7f7fc8ff9640 1 -- 172.21.15.1:0/2070452639 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f7fd4004460 con 0x55bcef8551b0 2024-09-21T00:57:14.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.048+0000 7f7fee45f740 1 -- 172.21.15.1:0/2070452639 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fdc01a910 con 0x55bcef8551b0 2024-09-21T00:57:14.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.048+0000 7f7fc8ff9640 1 -- 172.21.15.1:0/2070452639 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7fd4051070 con 0x55bcef8551b0 2024-09-21T00:57:14.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.048+0000 7f7fee45f740 10 client.15519 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:14.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.048+0000 7f7fee45f740 1 -- 172.21.15.1:0/2070452639 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bcef939620 con 0x55bcef8551b0 2024-09-21T00:57:14.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.048+0000 7f7fc8ff9640 1 -- 172.21.15.1:0/2070452639 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fdc01a910 con 0x55bcef8551b0 2024-09-21T00:57:14.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.048+0000 7f7fc8ff9640 1 -- 172.21.15.1:0/2070452639 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f7fd403a070 con 0x55bcef8551b0 2024-09-21T00:57:14.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.048+0000 7f7fee45f740 10 client.15519 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:14.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.048+0000 7f7fee45f740 10 client.15519 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:57:14.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.048+0000 7f7fee45f740 20 client.15519 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:14.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.048+0000 7f7fee45f740 1 --2- 172.21.15.1:0/2070452639 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55bcef813d80 0x55bcefc181a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:14.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.048+0000 7f7fee45f740 4 client.15519 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:57:14.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.048+0000 7f7fee45f740 1 -- 172.21.15.1:0/2070452639 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bcefb71640 con 0x55bcef813d80 2024-09-21T00:57:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.049+0000 7f7fe528e640 1 --2- 172.21.15.1:0/2070452639 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55bcef813d80 0x55bcefc181a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.049+0000 7f7fe528e640 1 --2- 172.21.15.1:0/2070452639 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55bcef813d80 0x55bcefc181a0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afdc85fbae512ec7 server_cookie=fc5c04fd092abd20 in_seq=0 out_seq=0 2024-09-21T00:57:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.049+0000 7f7fc8ff9640 10 client.15519 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.050+0000 7f7fc8ff9640 1 -- 172.21.15.1:0/2070452639 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bcefb71640 con 0x55bcef813d80 2024-09-21T00:57:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.050+0000 7f7fc8ff9640 10 client.15519 handle_command_reply: tid=0 2024-09-21T00:57:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.050+0000 7f7fee45f740 1 client.15519 shutdown 2024-09-21T00:57:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.050+0000 7f7fee45f740 1 -- 172.21.15.1:0/2070452639 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcef8551b0 msgr2=0x55bcefc0bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.050+0000 7f7fee45f740 1 --2- 172.21.15.1:0/2070452639 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcef8551b0 0x55bcefc0bc20 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4033000 tx=0x7f7fd402a410 comp rx=0 tx=0).stop 2024-09-21T00:57:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.050+0000 7f7fee45f740 1 -- 172.21.15.1:0/2070452639 shutdown_connections 2024-09-21T00:57:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.050+0000 7f7fee45f740 1 --2- 172.21.15.1:0/2070452639 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55bcef813d80 0x55bcefc181a0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.050+0000 7f7fee45f740 1 --2- 172.21.15.1:0/2070452639 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcef8551b0 0x55bcefc0bc20 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.050+0000 7f7fee45f740 1 --2- 172.21.15.1:0/2070452639 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcef8344d0 0x55bcefc0b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.050+0000 7f7fc8ff9640 0 client.15519 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:14.057 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.050+0000 7f7fee45f740 1 --2- 172.21.15.1:0/2070452639 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcef82c2f0 0x55bcefc0a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.057 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.050+0000 7f7fee45f740 1 -- 172.21.15.1:0/2070452639 >> 172.21.15.1:0/2070452639 conn(0x55bcef849300 msgr2=0x55bcefbf6ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:14.057 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.050+0000 7f7fee45f740 1 -- 172.21.15.1:0/2070452639 shutdown_connections 2024-09-21T00:57:14.057 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.050+0000 7f7fee45f740 1 -- 172.21.15.1:0/2070452639 wait complete. 2024-09-21T00:57:14.057 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.051+0000 7f7fee45f740 20 client.15519 trim_cache size 0 max 16384 2024-09-21T00:57:14.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.065+0000 7f7fee45f740 1 Processor -- start 2024-09-21T00:57:14.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.065+0000 7f7fee45f740 1 -- start start 2024-09-21T00:57:14.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.065+0000 7f7fee45f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcef82c2f0 0x55bcefbf8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:14.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.065+0000 7f7fee45f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcef8344d0 0x55bcefbf35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:14.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.066+0000 7f7fee45f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcef8551b0 0x55bcefbf8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:14.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.066+0000 7f7fee45f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe01a8e30 con 0x55bcef8344d0 2024-09-21T00:57:14.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.066+0000 7f7fee45f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe01aa970 con 0x55bcef8551b0 2024-09-21T00:57:14.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.066+0000 7f7fee45f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe01a9500 con 0x55bcef82c2f0 2024-09-21T00:57:14.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.066+0000 7f7fe528e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcef8344d0 0x55bcefbf35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:14.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.066+0000 7f7fe528e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcef8344d0 0x55bcefbf35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32992/0 (socket says 172.21.15.1:32992) 2024-09-21T00:57:14.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.066+0000 7f7fe528e640 1 -- 172.21.15.1:0/1820035104 learned_addr learned my addr 172.21.15.1:0/1820035104 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:14.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.066+0000 7f7fe528e640 1 -- 172.21.15.1:0/1820035104 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcef82c2f0 msgr2=0x55bcefbf8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:14.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.066+0000 7f7fe4a8d640 1 --2- 172.21.15.1:0/1820035104 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcef82c2f0 0x55bcefbf8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:14.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.066+0000 7f7fe528e640 1 --2- 172.21.15.1:0/1820035104 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcef82c2f0 0x55bcefbf8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.066+0000 7f7fe528e640 1 -- 172.21.15.1:0/1820035104 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcef8551b0 msgr2=0x55bcefbf8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:14.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.066+0000 7f7fe528e640 1 --2- 172.21.15.1:0/1820035104 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcef8551b0 0x55bcefbf8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.066+0000 7f7fe528e640 1 -- 172.21.15.1:0/1820035104 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcefc02800 con 0x55bcef8344d0 2024-09-21T00:57:14.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.066+0000 7f7fe4a8d640 1 --2- 172.21.15.1:0/1820035104 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcef82c2f0 0x55bcefbf8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:57:14.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.066+0000 7f7fe528e640 1 --2- 172.21.15.1:0/1820035104 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcef8344d0 0x55bcefbf35c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc00bbd0 tx=0x7f7fdc00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ae2ead583c4d819 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:14.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.066+0000 7f7fcaffd640 1 -- 172.21.15.1:0/1820035104 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc015050 con 0x55bcef8344d0 2024-09-21T00:57:14.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.066+0000 7f7fcaffd640 1 -- 172.21.15.1:0/1820035104 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fdc0054d0 con 0x55bcef8344d0 2024-09-21T00:57:14.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.066+0000 7f7fcaffd640 1 -- 172.21.15.1:0/1820035104 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc011840 con 0x55bcef8344d0 2024-09-21T00:57:14.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.067+0000 7f7fee45f740 1 -- 172.21.15.1:0/1820035104 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcef8344d0 msgr2=0x55bcefbf35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:14.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.067+0000 7f7fee45f740 1 --2- 172.21.15.1:0/1820035104 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcef8344d0 0x55bcefbf35c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc00bbd0 tx=0x7f7fdc00bda0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.067+0000 7f7fee45f740 1 -- 172.21.15.1:0/1820035104 shutdown_connections 2024-09-21T00:57:14.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.067+0000 7f7fee45f740 1 --2- 172.21.15.1:0/1820035104 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcef8551b0 0x55bcefbf8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.067+0000 7f7fee45f740 1 --2- 172.21.15.1:0/1820035104 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcef8344d0 0x55bcefbf35c0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.067+0000 7f7fee45f740 1 --2- 172.21.15.1:0/1820035104 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcef82c2f0 0x55bcefbf8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.067+0000 7f7fee45f740 1 -- 172.21.15.1:0/1820035104 >> 172.21.15.1:0/1820035104 conn(0x55bcef849300 msgr2=0x55bcefc020f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:14.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.067+0000 7f7fee45f740 1 -- 172.21.15.1:0/1820035104 shutdown_connections 2024-09-21T00:57:14.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.067+0000 7f7fee45f740 1 -- 172.21.15.1:0/1820035104 wait complete. 2024-09-21T00:57:14.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.067+0000 7f7fee45f740 1 -- start start 2024-09-21T00:57:14.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.067+0000 7f7fee45f740 1 Processor -- start 2024-09-21T00:57:14.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.068+0000 7f7fee45f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcef82c2f0 0x55bcefc12a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:14.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.068+0000 7f7fee45f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcef8344d0 0x55bcefc11800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:14.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.068+0000 7f7fee45f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcef8551b0 0x55bcefc11f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:14.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.068+0000 7f7fee45f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe01aa2a0 con 0x55bcef8344d0 2024-09-21T00:57:14.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.068+0000 7f7fee45f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe01a9bd0 con 0x55bcef82c2f0 2024-09-21T00:57:14.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.068+0000 7f7fee45f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe01a6e10 con 0x55bcef8551b0 2024-09-21T00:57:14.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.068+0000 7f7fee45f740 10 client.0 _ll_register_callbacks cb 0x7f7fd403f410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:14.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.068+0000 7f7fe528e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcef8344d0 0x55bcefc11800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:14.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.068+0000 7f7fe528e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcef8344d0 0x55bcefc11800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32994/0 (socket says 172.21.15.1:32994) 2024-09-21T00:57:14.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.068+0000 7f7fe528e640 1 -- 172.21.15.1:0/1054007504 learned_addr learned my addr 172.21.15.1:0/1054007504 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:14.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.068+0000 7f7fe4a8d640 1 --2- 172.21.15.1:0/1054007504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcef82c2f0 0x55bcefc12a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:14.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.068+0000 7f7fe4a8d640 1 --2- 172.21.15.1:0/1054007504 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcef8551b0 0x55bcefc11f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:14.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.068+0000 7f7fe528e640 1 -- 172.21.15.1:0/1054007504 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcef8551b0 msgr2=0x55bcefc11f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:14.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.068+0000 7f7fe528e640 1 --2- 172.21.15.1:0/1054007504 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcef8551b0 0x55bcefc11f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.068+0000 7f7fe528e640 1 -- 172.21.15.1:0/1054007504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcef82c2f0 msgr2=0x55bcefc12a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:14.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.068+0000 7f7fe528e640 1 --2- 172.21.15.1:0/1054007504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcef82c2f0 0x55bcefc12a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.068+0000 7f7fe528e640 1 -- 172.21.15.1:0/1054007504 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcefc10300 con 0x55bcef8344d0 2024-09-21T00:57:14.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.068+0000 7f7fe4a8d640 1 --2- 172.21.15.1:0/1054007504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcef82c2f0 0x55bcefc12a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:57:14.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.069+0000 7f7fe528e640 1 --2- 172.21.15.1:0/1054007504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcef8344d0 0x55bcefc11800 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc0058c0 tx=0x7f7fdc005430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35bac5729b076502 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:14.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.069+0000 7f7fc8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:57:14.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.069+0000 7f7fc8ff9640 1 -- 172.21.15.1:0/1054007504 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc035020 con 0x55bcef8344d0 2024-09-21T00:57:14.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.069+0000 7f7fc8ff9640 1 -- 172.21.15.1:0/1054007504 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f7fdc004680 con 0x55bcef8344d0 2024-09-21T00:57:14.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.069+0000 7f7fee45f740 1 -- 172.21.15.1:0/1054007504 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fdc0054d0 con 0x55bcef8344d0 2024-09-21T00:57:14.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.069+0000 7f7fc8ff9640 1 -- 172.21.15.1:0/1054007504 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7fdc015020 con 0x55bcef8344d0 2024-09-21T00:57:14.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.069+0000 7f7fee45f740 10 client.15525 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:14.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.069+0000 7f7fee45f740 1 -- 172.21.15.1:0/1054007504 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bcefc82ce0 con 0x55bcef8344d0 2024-09-21T00:57:14.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.069+0000 7f7fc8ff9640 1 -- 172.21.15.1:0/1054007504 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fdc0054d0 con 0x55bcef8344d0 2024-09-21T00:57:14.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.069+0000 7f7fc8ff9640 1 -- 172.21.15.1:0/1054007504 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f7fdc011cc0 con 0x55bcef8344d0 2024-09-21T00:57:14.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.069+0000 7f7fee45f740 10 client.15525 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:14.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.069+0000 7f7fee45f740 10 client.15525 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:57:14.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.069+0000 7f7fee45f740 20 client.15525 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:14.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.069+0000 7f7fee45f740 1 --2- 172.21.15.1:0/1054007504 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55bcef7e91c0 0x55bcefc855b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:14.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.069+0000 7f7fee45f740 4 client.15525 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T00:57:14.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.069+0000 7f7fee45f740 1 -- 172.21.15.1:0/1054007504 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bcefb6d0f0 con 0x55bcef7e91c0 2024-09-21T00:57:14.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.070+0000 7f7fe4a8d640 1 --2- 172.21.15.1:0/1054007504 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55bcef7e91c0 0x55bcefc855b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:14.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.070+0000 7f7fc8ff9640 10 client.15525 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:14.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.070+0000 7f7fe4a8d640 1 --2- 172.21.15.1:0/1054007504 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55bcef7e91c0 0x55bcefc855b0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5b90e16d9b9403 server_cookie=80d691340a55e4bb in_seq=0 out_seq=0 2024-09-21T00:57:14.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.083+0000 7f7fc8ff9640 1 -- 172.21.15.1:0/1054007504 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bcefb6d0f0 con 0x55bcef7e91c0 2024-09-21T00:57:14.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.083+0000 7f7fc8ff9640 10 client.15525 handle_command_reply: tid=0 2024-09-21T00:57:14.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.083+0000 7f7fee45f740 1 client.15525 shutdown 2024-09-21T00:57:14.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.083+0000 7f7fee45f740 1 -- 172.21.15.1:0/1054007504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcef8344d0 msgr2=0x55bcefc11800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:14.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.083+0000 7f7fee45f740 1 --2- 172.21.15.1:0/1054007504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcef8344d0 0x55bcefc11800 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc0058c0 tx=0x7f7fdc005430 comp rx=0 tx=0).stop 2024-09-21T00:57:14.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.083+0000 7f7fee45f740 1 -- 172.21.15.1:0/1054007504 shutdown_connections 2024-09-21T00:57:14.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.083+0000 7f7fee45f740 1 --2- 172.21.15.1:0/1054007504 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55bcef7e91c0 0x55bcefc855b0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.083+0000 7f7fee45f740 1 --2- 172.21.15.1:0/1054007504 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcef8551b0 0x55bcefc11f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.083+0000 7f7fee45f740 1 --2- 172.21.15.1:0/1054007504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcef8344d0 0x55bcefc11800 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.083+0000 7f7fc8ff9640 0 client.15525 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.083+0000 7f7fee45f740 1 --2- 172.21.15.1:0/1054007504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcef82c2f0 0x55bcefc12a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.083+0000 7f7fee45f740 1 -- 172.21.15.1:0/1054007504 >> 172.21.15.1:0/1054007504 conn(0x55bcef849300 msgr2=0x55bcefc020f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.083+0000 7f7fee45f740 1 -- 172.21.15.1:0/1054007504 shutdown_connections 2024-09-21T00:57:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.083+0000 7f7fee45f740 1 -- 172.21.15.1:0/1054007504 wait complete. 2024-09-21T00:57:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.083+0000 7f7fee45f740 20 client.15525 trim_cache size 0 max 16384 2024-09-21T00:57:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T00:57:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T00:57:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T00:57:14.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T00:57:14.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.084+0000 7f7fe74f2640 1 -- 172.21.15.1:0/846303669 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f7fcc0b6620 msgr2=0x7f7fcc0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:14.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.084+0000 7f7fe74f2640 1 --2- 172.21.15.1:0/846303669 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f7fcc0b6620 0x7f7fcc0b8b30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7fd80ad890 tx=0x7f7fd807a890 comp rx=0 tx=0).stop 2024-09-21T00:57:14.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.084+0000 7f7fe74f2640 1 -- 172.21.15.1:0/846303669 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fe0103ff0 msgr2=0x7f7fe019b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:14.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.084+0000 7f7fe74f2640 1 --2- 172.21.15.1:0/846303669 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fe0103ff0 0x7f7fe019b180 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7fd800eb10 tx=0x7f7fd800c2d0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.084+0000 7f7fe74f2640 1 -- 172.21.15.1:0/846303669 shutdown_connections 2024-09-21T00:57:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.084+0000 7f7fe74f2640 1 --2- 172.21.15.1:0/846303669 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f7fcc0b6620 0x7f7fcc0b8b30 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.084+0000 7f7fe74f2640 1 --2- 172.21.15.1:0/846303669 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fe0103ff0 0x7f7fe019b180 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.084+0000 7f7fe74f2640 1 --2- 172.21.15.1:0/846303669 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7fe0103650 0x7f7fe019a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.084+0000 7f7fe74f2640 1 --2- 172.21.15.1:0/846303669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fe01025d0 0x7f7fe0199f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.084+0000 7f7fe74f2640 1 -- 172.21.15.1:0/846303669 >> 172.21.15.1:0/846303669 conn(0x7f7fe00fdf30 msgr2=0x7f7fe00ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.084+0000 7f7fe74f2640 1 -- 172.21.15.1:0/846303669 shutdown_connections 2024-09-21T00:57:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:14.084+0000 7f7fe74f2640 1 -- 172.21.15.1:0/846303669 wait complete. 2024-09-21T00:57:15.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:15 smithi001 ceph-mon[31211]: pgmap v359: 97 pgs: 97 active+clean; 662 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-21T00:57:15.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:15 smithi193 ceph-mon[34660]: pgmap v359: 97 pgs: 97 active+clean; 662 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-21T00:57:15.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:15 smithi042 ceph-mon[34481]: pgmap v359: 97 pgs: 97 active+clean; 662 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-21T00:57:17.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:17 smithi001 ceph-mon[31211]: pgmap v360: 97 pgs: 97 active+clean; 662 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-21T00:57:17.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:17 smithi193 ceph-mon[34660]: pgmap v360: 97 pgs: 97 active+clean; 662 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-21T00:57:17.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:17 smithi042 ceph-mon[34481]: pgmap v360: 97 pgs: 97 active+clean; 662 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-21T00:57:19.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:19 smithi001 ceph-mon[31211]: pgmap v361: 97 pgs: 97 active+clean; 662 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-21T00:57:19.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:19 smithi193 ceph-mon[34660]: pgmap v361: 97 pgs: 97 active+clean; 662 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-21T00:57:19.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:19 smithi042 ceph-mon[34481]: pgmap v361: 97 pgs: 97 active+clean; 662 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-21T00:57:21.779 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:21 smithi001 ceph-mon[31211]: pgmap v362: 97 pgs: 97 active+clean; 665 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2024-09-21T00:57:21.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:21 smithi193 ceph-mon[34660]: pgmap v362: 97 pgs: 97 active+clean; 665 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2024-09-21T00:57:21.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:21 smithi042 ceph-mon[34481]: pgmap v362: 97 pgs: 97 active+clean; 665 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2024-09-21T00:57:23.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:23 smithi001 ceph-mon[31211]: pgmap v363: 97 pgs: 97 active+clean; 665 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2024-09-21T00:57:23.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:23 smithi193 ceph-mon[34660]: pgmap v363: 97 pgs: 97 active+clean; 665 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2024-09-21T00:57:23.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:23 smithi042 ceph-mon[34481]: pgmap v363: 97 pgs: 97 active+clean; 665 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2024-09-21T00:57:25.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:25 smithi001 ceph-mon[31211]: pgmap v364: 97 pgs: 97 active+clean; 665 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.6 KiB/s wr, 15 op/s 2024-09-21T00:57:25.982 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:25 smithi193 ceph-mon[34660]: pgmap v364: 97 pgs: 97 active+clean; 665 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.6 KiB/s wr, 15 op/s 2024-09-21T00:57:25.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:25 smithi042 ceph-mon[34481]: pgmap v364: 97 pgs: 97 active+clean; 665 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.6 KiB/s wr, 15 op/s 2024-09-21T00:57:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.186+0000 7fab0cca4640 1 -- 172.21.15.1:0/3138449554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fab08109400 msgr2=0x7fab0810b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.186+0000 7fab0cca4640 1 --2- 172.21.15.1:0/3138449554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fab08109400 0x7fab0810b910 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fab00009ca0 tx=0x7fab0002a8c0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.186+0000 7fab0cca4640 1 -- 172.21.15.1:0/3138449554 shutdown_connections 2024-09-21T00:57:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.186+0000 7fab0cca4640 1 --2- 172.21.15.1:0/3138449554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fab08109400 0x7fab0810b910 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.186+0000 7fab0cca4640 1 --2- 172.21.15.1:0/3138449554 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab081068a0 0x7fab08108cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.186+0000 7fab0cca4640 1 --2- 172.21.15.1:0/3138449554 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab0806b820 0x7fab08106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.186+0000 7fab0cca4640 1 -- 172.21.15.1:0/3138449554 >> 172.21.15.1:0/3138449554 conn(0x7fab080fdf00 msgr2=0x7fab081003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.186+0000 7fab0cca4640 1 -- 172.21.15.1:0/3138449554 shutdown_connections 2024-09-21T00:57:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.187+0000 7fab0cca4640 1 -- 172.21.15.1:0/3138449554 wait complete. 2024-09-21T00:57:27.190 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.187+0000 7fab0cca4640 1 Processor -- start 2024-09-21T00:57:27.190 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.187+0000 7fab0cca4640 1 -- start start 2024-09-21T00:57:27.190 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.188+0000 7fab0cca4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab0806b820 0x7fab081039a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:27.190 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.188+0000 7fab0cca4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab081068a0 0x7fab08102260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:27.190 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.188+0000 7fab0cca4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fab08109400 0x7fab081027a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:27.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.188+0000 7fab0cca4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fab0810f370 con 0x7fab08109400 2024-09-21T00:57:27.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.188+0000 7fab0cca4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fab0810f1f0 con 0x7fab081068a0 2024-09-21T00:57:27.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.188+0000 7fab0cca4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fab0810f4f0 con 0x7fab0806b820 2024-09-21T00:57:27.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.188+0000 7fab06d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fab08109400 0x7fab081027a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:27.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.188+0000 7fab06d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fab08109400 0x7fab081027a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56678/0 (socket says 172.21.15.1:56678) 2024-09-21T00:57:27.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.188+0000 7fab06d9d640 1 -- 172.21.15.1:0/282114483 learned_addr learned my addr 172.21.15.1:0/282114483 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:27.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.188+0000 7faafffff640 1 --2- 172.21.15.1:0/282114483 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab081068a0 0x7fab08102260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:27.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.188+0000 7fab0659c640 1 --2- 172.21.15.1:0/282114483 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab0806b820 0x7fab081039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:27.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.188+0000 7fab06d9d640 1 -- 172.21.15.1:0/282114483 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab0806b820 msgr2=0x7fab081039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:27.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.188+0000 7fab06d9d640 1 --2- 172.21.15.1:0/282114483 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab0806b820 0x7fab081039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.188+0000 7fab06d9d640 1 -- 172.21.15.1:0/282114483 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab081068a0 msgr2=0x7fab08102260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:27.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.188+0000 7fab06d9d640 1 --2- 172.21.15.1:0/282114483 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab081068a0 0x7fab08102260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.188+0000 7fab06d9d640 1 -- 172.21.15.1:0/282114483 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab08102e40 con 0x7fab08109400 2024-09-21T00:57:27.192 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.188+0000 7faafffff640 1 --2- 172.21.15.1:0/282114483 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab081068a0 0x7fab08102260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:27.192 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.188+0000 7fab06d9d640 1 --2- 172.21.15.1:0/282114483 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fab08109400 0x7fab081027a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fab00009430 tx=0x7fab000317c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:27.192 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.189+0000 7faaff7fe640 1 -- 172.21.15.1:0/282114483 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab00003bf0 con 0x7fab08109400 2024-09-21T00:57:27.192 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.189+0000 7faaff7fe640 1 -- 172.21.15.1:0/282114483 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab00003d90 con 0x7fab08109400 2024-09-21T00:57:27.192 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.189+0000 7fab0cca4640 1 -- 172.21.15.1:0/282114483 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab081a3fc0 con 0x7fab08109400 2024-09-21T00:57:27.192 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.189+0000 7faaff7fe640 1 -- 172.21.15.1:0/282114483 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab0002fc10 con 0x7fab08109400 2024-09-21T00:57:27.192 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.189+0000 7fab0cca4640 1 -- 172.21.15.1:0/282114483 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab081a4370 con 0x7fab08109400 2024-09-21T00:57:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.192+0000 7fab13c0e740 1 Processor -- start 2024-09-21T00:57:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.192+0000 7faaff7fe640 1 -- 172.21.15.1:0/282114483 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 154562+0+0 (secure 0 0 0) 0x7fab000046a0 con 0x7fab08109400 2024-09-21T00:57:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.192+0000 7fab13c0e740 1 -- start start 2024-09-21T00:57:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.192+0000 7fab13c0e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3cd69a1b0 0x55b3cda41e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.193+0000 7fab13c0e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b3cd6712f0 0x55b3cda424c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.193+0000 7fab13c0e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b3cd6794d0 0x55b3cda43010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.193+0000 7fab13c0e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b3cd9b46f0 con 0x55b3cd69a1b0 2024-09-21T00:57:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.193+0000 7fab13c0e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b3cd9a3b20 con 0x55b3cd6794d0 2024-09-21T00:57:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.193+0000 7fab13c0e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b3cd9a7930 con 0x55b3cd6712f0 2024-09-21T00:57:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.193+0000 7faafffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3cd69a1b0 0x55b3cda41e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.193+0000 7faafffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3cd69a1b0 0x55b3cda41e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56694/0 (socket says 172.21.15.1:56694) 2024-09-21T00:57:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.193+0000 7faafffff640 1 -- 172.21.15.1:0/3885180072 learned_addr learned my addr 172.21.15.1:0/3885180072 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.193+0000 7faafffff640 1 --2- 172.21.15.1:0/3885180072 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b3cd6794d0 0x55b3cda43010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.193+0000 7fab0659c640 1 --2- 172.21.15.1:0/3885180072 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b3cd6712f0 0x55b3cda424c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.193+0000 7faafffff640 1 -- 172.21.15.1:0/3885180072 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b3cd6712f0 msgr2=0x55b3cda424c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.193+0000 7faafffff640 1 --2- 172.21.15.1:0/3885180072 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b3cd6712f0 0x55b3cda424c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.193+0000 7faafffff640 1 -- 172.21.15.1:0/3885180072 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b3cd6794d0 msgr2=0x55b3cda43010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:27.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.193+0000 7faafffff640 1 --2- 172.21.15.1:0/3885180072 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b3cd6794d0 0x55b3cda43010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.193+0000 7faafffff640 1 -- 172.21.15.1:0/3885180072 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3cd969530 con 0x55b3cd69a1b0 2024-09-21T00:57:27.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.193+0000 7fab0659c640 1 --2- 172.21.15.1:0/3885180072 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b3cd6712f0 0x55b3cda424c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:57:27.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.193+0000 7faaff7fe640 1 --2- 172.21.15.1:0/282114483 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7faaf40b6620 0x7faaf40b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:27.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.193+0000 7faafffff640 1 --2- 172.21.15.1:0/3885180072 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3cd69a1b0 0x55b3cda41e50 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7faaf0013a20 tx=0x7faaf0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9cc42641b081edc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:27.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.193+0000 7fab0659c640 1 --2- 172.21.15.1:0/282114483 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7faaf40b6620 0x7faaf40b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:27.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.194+0000 7faafcff9640 1 -- 172.21.15.1:0/3885180072 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf0004030 con 0x55b3cd69a1b0 2024-09-21T00:57:27.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.194+0000 7faaff7fe640 1 -- 172.21.15.1:0/282114483 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fab00108860 con 0x7fab08109400 2024-09-21T00:57:27.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.194+0000 7faafcff9640 1 -- 172.21.15.1:0/3885180072 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faaf000f980 con 0x55b3cd69a1b0 2024-09-21T00:57:27.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.194+0000 7faafcff9640 1 -- 172.21.15.1:0/3885180072 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf0003a10 con 0x55b3cd69a1b0 2024-09-21T00:57:27.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.195+0000 7fab13c0e740 1 -- 172.21.15.1:0/3885180072 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3cd69a1b0 msgr2=0x55b3cda41e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:27.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.195+0000 7fab0659c640 1 --2- 172.21.15.1:0/282114483 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7faaf40b6620 0x7faaf40b8b30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faaf800ac70 tx=0x7faaf800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:27.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.195+0000 7fab13c0e740 1 --2- 172.21.15.1:0/3885180072 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3cd69a1b0 0x55b3cda41e50 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7faaf0013a20 tx=0x7faaf0009c00 comp rx=0 tx=0).stop 2024-09-21T00:57:27.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.195+0000 7fab13c0e740 1 -- 172.21.15.1:0/3885180072 shutdown_connections 2024-09-21T00:57:27.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.195+0000 7fab13c0e740 1 --2- 172.21.15.1:0/3885180072 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b3cd6794d0 0x55b3cda43010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.195+0000 7fab13c0e740 1 --2- 172.21.15.1:0/3885180072 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b3cd6712f0 0x55b3cda424c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.195+0000 7fab13c0e740 1 --2- 172.21.15.1:0/3885180072 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3cd69a1b0 0x55b3cda41e50 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.195+0000 7fab13c0e740 1 -- 172.21.15.1:0/3885180072 >> 172.21.15.1:0/3885180072 conn(0x55b3cd68e300 msgr2=0x55b3cda3d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:27.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.195+0000 7fab13c0e740 1 -- 172.21.15.1:0/3885180072 shutdown_connections 2024-09-21T00:57:27.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.195+0000 7fab13c0e740 1 -- 172.21.15.1:0/3885180072 wait complete. 2024-09-21T00:57:27.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.195+0000 7fab13c0e740 1 -- start start 2024-09-21T00:57:27.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.195+0000 7fab13c0e740 1 Processor -- start 2024-09-21T00:57:27.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.195+0000 7fab13c0e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b3cd6712f0 0x55b3cda4b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:27.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.196+0000 7fab13c0e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b3cd6794d0 0x55b3cda4bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:27.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.196+0000 7fab13c0e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3cd69a1b0 0x55b3cda4c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:27.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.196+0000 7fab13c0e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b3cd8dbab0 con 0x55b3cd69a1b0 2024-09-21T00:57:27.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.196+0000 7fab13c0e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b3cd949730 con 0x55b3cd6712f0 2024-09-21T00:57:27.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.196+0000 7fab13c0e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b3cda43ad0 con 0x55b3cd6794d0 2024-09-21T00:57:27.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.196+0000 7fab13c0e740 10 client.0 _ll_register_callbacks cb 0x55b3cd99d6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:27.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.196+0000 7fab06d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3cd69a1b0 0x55b3cda4c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:27.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.196+0000 7fab06d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3cd69a1b0 0x55b3cda4c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56702/0 (socket says 172.21.15.1:56702) 2024-09-21T00:57:27.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.196+0000 7fab06d9d640 1 -- 172.21.15.1:0/2242917436 learned_addr learned my addr 172.21.15.1:0/2242917436 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:27.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.196+0000 7fab0659c640 1 --2- 172.21.15.1:0/2242917436 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b3cd6712f0 0x55b3cda4b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:27.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.196+0000 7faafffff640 1 --2- 172.21.15.1:0/2242917436 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b3cd6794d0 0x55b3cda4bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:27.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.196+0000 7fab06d9d640 1 -- 172.21.15.1:0/2242917436 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b3cd6794d0 msgr2=0x55b3cda4bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:27.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.196+0000 7fab06d9d640 1 --2- 172.21.15.1:0/2242917436 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b3cd6794d0 0x55b3cda4bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.196+0000 7fab06d9d640 1 -- 172.21.15.1:0/2242917436 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b3cd6712f0 msgr2=0x55b3cda4b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:27.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.196+0000 7fab06d9d640 1 --2- 172.21.15.1:0/2242917436 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b3cd6712f0 0x55b3cda4b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.196+0000 7fab06d9d640 1 -- 172.21.15.1:0/2242917436 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3cd705790 con 0x55b3cd69a1b0 2024-09-21T00:57:27.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.196+0000 7fab06d9d640 1 --2- 172.21.15.1:0/2242917436 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3cd69a1b0 0x55b3cda4c800 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fab000cae40 tx=0x7fab0002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=300c06640ac1437 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:27.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.196+0000 7faaedffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:57:27.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.196+0000 7faaedffb640 1 -- 172.21.15.1:0/2242917436 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab000cfda0 con 0x55b3cd69a1b0 2024-09-21T00:57:27.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.196+0000 7faaedffb640 1 -- 172.21.15.1:0/2242917436 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fab000cdad0 con 0x55b3cd69a1b0 2024-09-21T00:57:27.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.196+0000 7fab13c0e740 1 -- 172.21.15.1:0/2242917436 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faaf000f980 con 0x55b3cd69a1b0 2024-09-21T00:57:27.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.197+0000 7faaedffb640 1 -- 172.21.15.1:0/2242917436 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fab000ce380 con 0x55b3cd69a1b0 2024-09-21T00:57:27.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.197+0000 7fab13c0e740 10 client.15537 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:27.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.197+0000 7fab13c0e740 1 -- 172.21.15.1:0/2242917436 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b3cd77e620 con 0x55b3cd69a1b0 2024-09-21T00:57:27.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.197+0000 7faaedffb640 1 -- 172.21.15.1:0/2242917436 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faaf000f980 con 0x55b3cd69a1b0 2024-09-21T00:57:27.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.197+0000 7faaedffb640 1 -- 172.21.15.1:0/2242917436 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fab000cd540 con 0x55b3cd69a1b0 2024-09-21T00:57:27.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.197+0000 7fab13c0e740 10 client.15537 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:27.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.197+0000 7fab13c0e740 10 client.15537 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:57:27.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.197+0000 7fab13c0e740 20 client.15537 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.197+0000 7fab13c0e740 1 --2- 172.21.15.1:0/2242917436 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55b3cd658d80 0x55b3cda58d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.197+0000 7fab13c0e740 4 client.15537 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:57:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.197+0000 7fab13c0e740 1 -- 172.21.15.1:0/2242917436 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b3cd9b6640 con 0x55b3cd658d80 2024-09-21T00:57:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.197+0000 7fab0659c640 1 --2- 172.21.15.1:0/2242917436 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55b3cd658d80 0x55b3cda58d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.198+0000 7fab0659c640 1 --2- 172.21.15.1:0/2242917436 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55b3cd658d80 0x55b3cda58d70 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7512048c0f8ab4cc server_cookie=5f78afb15acc0656 in_seq=0 out_seq=0 2024-09-21T00:57:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.198+0000 7faaedffb640 10 client.15537 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.199+0000 7faaedffb640 1 -- 172.21.15.1:0/2242917436 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b3cd9b6640 con 0x55b3cd658d80 2024-09-21T00:57:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.199+0000 7faaedffb640 10 client.15537 handle_command_reply: tid=0 2024-09-21T00:57:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.199+0000 7fab13c0e740 1 client.15537 shutdown 2024-09-21T00:57:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.199+0000 7fab13c0e740 1 -- 172.21.15.1:0/2242917436 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3cd69a1b0 msgr2=0x55b3cda4c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.199+0000 7fab13c0e740 1 --2- 172.21.15.1:0/2242917436 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3cd69a1b0 0x55b3cda4c800 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fab000cae40 tx=0x7fab0002a8c0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.199+0000 7fab13c0e740 1 -- 172.21.15.1:0/2242917436 shutdown_connections 2024-09-21T00:57:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.199+0000 7fab13c0e740 1 --2- 172.21.15.1:0/2242917436 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55b3cd658d80 0x55b3cda58d70 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.199+0000 7fab13c0e740 1 --2- 172.21.15.1:0/2242917436 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3cd69a1b0 0x55b3cda4c800 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.205 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.199+0000 7faaedffb640 0 client.15537 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:27.205 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.199+0000 7fab13c0e740 1 --2- 172.21.15.1:0/2242917436 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b3cd6794d0 0x55b3cda4bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.205 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.199+0000 7fab13c0e740 1 --2- 172.21.15.1:0/2242917436 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b3cd6712f0 0x55b3cda4b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.205 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.199+0000 7fab13c0e740 1 -- 172.21.15.1:0/2242917436 >> 172.21.15.1:0/2242917436 conn(0x55b3cd68e300 msgr2=0x55b3cda3bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:27.205 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.199+0000 7fab13c0e740 1 -- 172.21.15.1:0/2242917436 shutdown_connections 2024-09-21T00:57:27.205 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.199+0000 7fab13c0e740 1 -- 172.21.15.1:0/2242917436 wait complete. 2024-09-21T00:57:27.205 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.199+0000 7fab13c0e740 20 client.15537 trim_cache size 0 max 16384 2024-09-21T00:57:27.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.216+0000 7fab13c0e740 1 Processor -- start 2024-09-21T00:57:27.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.216+0000 7fab13c0e740 1 -- start start 2024-09-21T00:57:27.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.216+0000 7fab13c0e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3cd658d80 0x55b3cda3d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:27.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.216+0000 7fab13c0e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b3cd6712f0 0x55b3cda42d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.216+0000 7fab13c0e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b3cd6794d0 0x55b3cda4a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.216+0000 7fab13c0e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fab081ad100 con 0x55b3cd658d80 2024-09-21T00:57:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.216+0000 7fab13c0e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fab081aec40 con 0x55b3cd6712f0 2024-09-21T00:57:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.216+0000 7fab13c0e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fab081ad7d0 con 0x55b3cd6794d0 2024-09-21T00:57:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.216+0000 7fab0659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3cd658d80 0x55b3cda3d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.216+0000 7fab0659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3cd658d80 0x55b3cda3d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56706/0 (socket says 172.21.15.1:56706) 2024-09-21T00:57:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.216+0000 7fab0659c640 1 -- 172.21.15.1:0/2426221238 learned_addr learned my addr 172.21.15.1:0/2426221238 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.216+0000 7faafffff640 1 --2- 172.21.15.1:0/2426221238 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b3cd6712f0 0x55b3cda42d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.216+0000 7fab06d9d640 1 --2- 172.21.15.1:0/2426221238 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b3cd6794d0 0x55b3cda4a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.216+0000 7fab0659c640 1 -- 172.21.15.1:0/2426221238 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b3cd6794d0 msgr2=0x55b3cda4a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.216+0000 7fab0659c640 1 --2- 172.21.15.1:0/2426221238 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b3cd6794d0 0x55b3cda4a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.216+0000 7fab0659c640 1 -- 172.21.15.1:0/2426221238 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b3cd6712f0 msgr2=0x55b3cda42d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.216+0000 7fab0659c640 1 --2- 172.21.15.1:0/2426221238 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b3cd6712f0 0x55b3cda42d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.216+0000 7fab0659c640 1 -- 172.21.15.1:0/2426221238 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3cda3cfd0 con 0x55b3cd658d80 2024-09-21T00:57:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.216+0000 7fab06d9d640 1 --2- 172.21.15.1:0/2426221238 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b3cd6794d0 0x55b3cda4a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:57:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.216+0000 7fab0659c640 1 --2- 172.21.15.1:0/2426221238 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3cd658d80 0x55b3cda3d290 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7faaf80126f0 tx=0x7faaf8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ee1e448e522886 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.217+0000 7faaeffff640 1 -- 172.21.15.1:0/2426221238 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf802e070 con 0x55b3cd658d80 2024-09-21T00:57:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.217+0000 7faaeffff640 1 -- 172.21.15.1:0/2426221238 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faaf80211d0 con 0x55b3cd658d80 2024-09-21T00:57:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.217+0000 7faaeffff640 1 -- 172.21.15.1:0/2426221238 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf801f8e0 con 0x55b3cd658d80 2024-09-21T00:57:27.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.217+0000 7fab13c0e740 1 -- 172.21.15.1:0/2426221238 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3cd658d80 msgr2=0x55b3cda3d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:27.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.217+0000 7fab13c0e740 1 --2- 172.21.15.1:0/2426221238 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3cd658d80 0x55b3cda3d290 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7faaf80126f0 tx=0x7faaf8014000 comp rx=0 tx=0).stop 2024-09-21T00:57:27.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.217+0000 7fab13c0e740 1 -- 172.21.15.1:0/2426221238 shutdown_connections 2024-09-21T00:57:27.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.217+0000 7fab13c0e740 1 --2- 172.21.15.1:0/2426221238 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b3cd6794d0 0x55b3cda4a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.217+0000 7fab13c0e740 1 --2- 172.21.15.1:0/2426221238 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b3cd6712f0 0x55b3cda42d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.217+0000 7fab13c0e740 1 --2- 172.21.15.1:0/2426221238 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3cd658d80 0x55b3cda3d290 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.217+0000 7fab13c0e740 1 -- 172.21.15.1:0/2426221238 >> 172.21.15.1:0/2426221238 conn(0x55b3cd68e300 msgr2=0x55b3cda58ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.218+0000 7fab13c0e740 1 -- 172.21.15.1:0/2426221238 shutdown_connections 2024-09-21T00:57:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.218+0000 7fab13c0e740 1 -- 172.21.15.1:0/2426221238 wait complete. 2024-09-21T00:57:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.218+0000 7fab13c0e740 1 -- start start 2024-09-21T00:57:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.218+0000 7fab13c0e740 1 Processor -- start 2024-09-21T00:57:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.218+0000 7fab13c0e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3cd658d80 0x55b3cda4ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.218+0000 7fab13c0e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b3cd6712f0 0x55b3cda4f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.218+0000 7fab13c0e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b3cd6794d0 0x55b3cda52df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.218+0000 7fab13c0e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fab081ae570 con 0x55b3cd658d80 2024-09-21T00:57:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.218+0000 7fab13c0e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fab081adea0 con 0x55b3cd6712f0 2024-09-21T00:57:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.218+0000 7fab13c0e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fab081ab0e0 con 0x55b3cd6794d0 2024-09-21T00:57:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.218+0000 7fab13c0e740 10 client.0 _ll_register_callbacks cb 0x7fab00009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.218+0000 7fab0659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3cd658d80 0x55b3cda4ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.218+0000 7fab0659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3cd658d80 0x55b3cda4ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56722/0 (socket says 172.21.15.1:56722) 2024-09-21T00:57:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.218+0000 7fab0659c640 1 -- 172.21.15.1:0/4222350448 learned_addr learned my addr 172.21.15.1:0/4222350448 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.219+0000 7faafffff640 1 --2- 172.21.15.1:0/4222350448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b3cd6712f0 0x55b3cda4f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.219+0000 7fab06d9d640 1 --2- 172.21.15.1:0/4222350448 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b3cd6794d0 0x55b3cda52df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.219+0000 7fab0659c640 1 -- 172.21.15.1:0/4222350448 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b3cd6794d0 msgr2=0x55b3cda52df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.219+0000 7fab0659c640 1 --2- 172.21.15.1:0/4222350448 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b3cd6794d0 0x55b3cda52df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.219+0000 7fab0659c640 1 -- 172.21.15.1:0/4222350448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b3cd6712f0 msgr2=0x55b3cda4f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.219+0000 7fab0659c640 1 --2- 172.21.15.1:0/4222350448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b3cd6712f0 0x55b3cda4f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.219+0000 7fab0659c640 1 -- 172.21.15.1:0/4222350448 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3cda53550 con 0x55b3cd658d80 2024-09-21T00:57:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.219+0000 7fab0659c640 1 --2- 172.21.15.1:0/4222350448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3cd658d80 0x55b3cda4ebb0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7faaf8012fd0 tx=0x7faaf800af30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e1d44a8ceacc57 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.219+0000 7faaedffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:57:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.219+0000 7faaedffb640 1 -- 172.21.15.1:0/4222350448 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf802e040 con 0x55b3cd658d80 2024-09-21T00:57:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.219+0000 7faaedffb640 1 -- 172.21.15.1:0/4222350448 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7faaf80053f0 con 0x55b3cd658d80 2024-09-21T00:57:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.219+0000 7fab13c0e740 1 -- 172.21.15.1:0/4222350448 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faaf80211d0 con 0x55b3cd658d80 2024-09-21T00:57:27.225 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.219+0000 7faaedffb640 1 -- 172.21.15.1:0/4222350448 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7faaf80055f0 con 0x55b3cd658d80 2024-09-21T00:57:27.225 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.219+0000 7fab13c0e740 10 client.15543 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:27.225 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.219+0000 7fab13c0e740 1 -- 172.21.15.1:0/4222350448 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b3cda507a0 con 0x55b3cd658d80 2024-09-21T00:57:27.225 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.220+0000 7faaedffb640 1 -- 172.21.15.1:0/4222350448 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faaf80211d0 con 0x55b3cd658d80 2024-09-21T00:57:27.225 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.220+0000 7faaedffb640 1 -- 172.21.15.1:0/4222350448 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7faaf803a030 con 0x55b3cd658d80 2024-09-21T00:57:27.225 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.220+0000 7fab13c0e740 10 client.15543 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:27.225 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.220+0000 7fab13c0e740 10 client.15543 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:57:27.225 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.220+0000 7fab13c0e740 20 client.15543 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:27.225 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.220+0000 7fab13c0e740 1 --2- 172.21.15.1:0/4222350448 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55b3cd69a1b0 0x55b3cdac5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:27.225 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.220+0000 7fab13c0e740 4 client.15543 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T00:57:27.225 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.220+0000 7fab13c0e740 1 -- 172.21.15.1:0/4222350448 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b3cd9b20f0 con 0x55b3cd69a1b0 2024-09-21T00:57:27.225 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.220+0000 7faafffff640 1 --2- 172.21.15.1:0/4222350448 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55b3cd69a1b0 0x55b3cdac5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:27.225 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.221+0000 7faaedffb640 10 client.15543 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:27.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.221+0000 7faafffff640 1 --2- 172.21.15.1:0/4222350448 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55b3cd69a1b0 0x55b3cdac5c00 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49fa63f9038aa375 server_cookie=b4cd8c607242bc0b in_seq=0 out_seq=0 2024-09-21T00:57:27.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.227+0000 7faaedffb640 1 -- 172.21.15.1:0/4222350448 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b3cd9b20f0 con 0x55b3cd69a1b0 2024-09-21T00:57:27.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.227+0000 7faaedffb640 10 client.15543 handle_command_reply: tid=0 2024-09-21T00:57:27.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.227+0000 7fab13c0e740 1 client.15543 shutdown 2024-09-21T00:57:27.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.227+0000 7fab13c0e740 1 -- 172.21.15.1:0/4222350448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3cd658d80 msgr2=0x55b3cda4ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:27.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.227+0000 7fab13c0e740 1 --2- 172.21.15.1:0/4222350448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3cd658d80 0x55b3cda4ebb0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7faaf8012fd0 tx=0x7faaf800af30 comp rx=0 tx=0).stop 2024-09-21T00:57:27.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.227+0000 7fab13c0e740 1 -- 172.21.15.1:0/4222350448 shutdown_connections 2024-09-21T00:57:27.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.227+0000 7fab13c0e740 1 --2- 172.21.15.1:0/4222350448 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55b3cd69a1b0 0x55b3cdac5c00 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.227+0000 7fab13c0e740 1 --2- 172.21.15.1:0/4222350448 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b3cd6794d0 0x55b3cda52df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.227+0000 7fab13c0e740 1 --2- 172.21.15.1:0/4222350448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b3cd6712f0 0x55b3cda4f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.227+0000 7fab13c0e740 1 --2- 172.21.15.1:0/4222350448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3cd658d80 0x55b3cda4ebb0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.227+0000 7faaedffb640 0 client.15543 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.227+0000 7fab13c0e740 1 -- 172.21.15.1:0/4222350448 >> 172.21.15.1:0/4222350448 conn(0x55b3cd68e300 msgr2=0x55b3cda42d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.227+0000 7fab13c0e740 1 -- 172.21.15.1:0/4222350448 shutdown_connections 2024-09-21T00:57:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.227+0000 7fab13c0e740 1 -- 172.21.15.1:0/4222350448 wait complete. 2024-09-21T00:57:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.227+0000 7fab13c0e740 20 client.15543 trim_cache size 0 max 16384 2024-09-21T00:57:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T00:57:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T00:57:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T00:57:27.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T00:57:27.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.228+0000 7fab0cca4640 1 -- 172.21.15.1:0/282114483 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7faaf40b6620 msgr2=0x7faaf40b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:27.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.228+0000 7fab0cca4640 1 --2- 172.21.15.1:0/282114483 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7faaf40b6620 0x7faaf40b8b30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faaf800ac70 tx=0x7faaf800a2d0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.228+0000 7fab0cca4640 1 -- 172.21.15.1:0/282114483 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fab08109400 msgr2=0x7fab081027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.228+0000 7fab0cca4640 1 --2- 172.21.15.1:0/282114483 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fab08109400 0x7fab081027a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fab00009430 tx=0x7fab000317c0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.228+0000 7fab0cca4640 1 -- 172.21.15.1:0/282114483 shutdown_connections 2024-09-21T00:57:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.228+0000 7fab0cca4640 1 --2- 172.21.15.1:0/282114483 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7faaf40b6620 0x7faaf40b8b30 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.228+0000 7fab0cca4640 1 --2- 172.21.15.1:0/282114483 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fab08109400 0x7fab081027a0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.228+0000 7fab0cca4640 1 --2- 172.21.15.1:0/282114483 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab081068a0 0x7fab08102260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.228+0000 7fab0cca4640 1 --2- 172.21.15.1:0/282114483 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab0806b820 0x7fab081039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.228+0000 7fab0cca4640 1 -- 172.21.15.1:0/282114483 >> 172.21.15.1:0/282114483 conn(0x7fab080fdf00 msgr2=0x7fab08104d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.228+0000 7fab0cca4640 1 -- 172.21.15.1:0/282114483 shutdown_connections 2024-09-21T00:57:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:27.228+0000 7fab0cca4640 1 -- 172.21.15.1:0/282114483 wait complete. 2024-09-21T00:57:27.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:27 smithi001 ceph-mon[31211]: pgmap v365: 97 pgs: 97 active+clean; 665 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-09-21T00:57:27.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:27 smithi193 ceph-mon[34660]: pgmap v365: 97 pgs: 97 active+clean; 665 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-09-21T00:57:27.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:27 smithi042 ceph-mon[34481]: pgmap v365: 97 pgs: 97 active+clean; 665 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-09-21T00:57:29.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:29 smithi001 ceph-mon[31211]: pgmap v366: 97 pgs: 97 active+clean; 665 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-21T00:57:29.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:29 smithi193 ceph-mon[34660]: pgmap v366: 97 pgs: 97 active+clean; 665 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-21T00:57:29.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:29 smithi042 ceph-mon[34481]: pgmap v366: 97 pgs: 97 active+clean; 665 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-21T00:57:31.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:31 smithi001 ceph-mon[31211]: pgmap v367: 97 pgs: 97 active+clean; 666 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-21T00:57:31.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:31 smithi193 ceph-mon[34660]: pgmap v367: 97 pgs: 97 active+clean; 666 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-21T00:57:31.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:31 smithi042 ceph-mon[34481]: pgmap v367: 97 pgs: 97 active+clean; 666 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-21T00:57:33.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:33 smithi001 ceph-mon[31211]: pgmap v368: 97 pgs: 97 active+clean; 666 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-21T00:57:33.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:33 smithi193 ceph-mon[34660]: pgmap v368: 97 pgs: 97 active+clean; 666 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-21T00:57:33.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:33 smithi042 ceph-mon[34481]: pgmap v368: 97 pgs: 97 active+clean; 666 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-21T00:57:34.011 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T00:57:34.291 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:34.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.825+0000 7ff5e880c640 1 -- 172.21.15.1:0/705370614 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5e4102a60 msgr2=0x7ff5e4102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:34.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.825+0000 7ff5e880c640 1 --2- 172.21.15.1:0/705370614 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5e4102a60 0x7ff5e4102e70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4009900 tx=0x7ff5d402a410 comp rx=0 tx=0).stop 2024-09-21T00:57:34.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.825+0000 7ff5e880c640 1 -- 172.21.15.1:0/705370614 shutdown_connections 2024-09-21T00:57:34.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.825+0000 7ff5e880c640 1 --2- 172.21.15.1:0/705370614 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff5e4108cf0 0x7ff5e410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:34.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.825+0000 7ff5e880c640 1 --2- 172.21.15.1:0/705370614 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5e41083a0 0x7ff5e41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:34.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.825+0000 7ff5e880c640 1 --2- 172.21.15.1:0/705370614 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5e4102a60 0x7ff5e4102e70 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:34.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.825+0000 7ff5e880c640 1 -- 172.21.15.1:0/705370614 >> 172.21.15.1:0/705370614 conn(0x7ff5e4079730 msgr2=0x7ff5e4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:34.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.825+0000 7ff5e880c640 1 -- 172.21.15.1:0/705370614 shutdown_connections 2024-09-21T00:57:34.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.825+0000 7ff5e880c640 1 -- 172.21.15.1:0/705370614 wait complete. 2024-09-21T00:57:34.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.826+0000 7ff5e880c640 1 Processor -- start 2024-09-21T00:57:34.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.826+0000 7ff5e880c640 1 -- start start 2024-09-21T00:57:34.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.827+0000 7ff5e880c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5e4102a60 0x7ff5e4104250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:34.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.827+0000 7ff5e880c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5e41083a0 0x7ff5e4104790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:34.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.827+0000 7ff5e880c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff5e4108cf0 0x7ff5e4104cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:34.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.827+0000 7ff5e259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5e4102a60 0x7ff5e4104250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:34.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.827+0000 7ff5e259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5e4102a60 0x7ff5e4104250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59430/0 (socket says 172.21.15.1:59430) 2024-09-21T00:57:34.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.827+0000 7ff5e259c640 1 -- 172.21.15.1:0/1078735152 learned_addr learned my addr 172.21.15.1:0/1078735152 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:34.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.827+0000 7ff5e1d9b640 1 --2- 172.21.15.1:0/1078735152 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5e41083a0 0x7ff5e4104790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:34.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.827+0000 7ff5e880c640 1 -- 172.21.15.1:0/1078735152 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e4112960 con 0x7ff5e4102a60 2024-09-21T00:57:34.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.827+0000 7ff5e880c640 1 -- 172.21.15.1:0/1078735152 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e41127e0 con 0x7ff5e41083a0 2024-09-21T00:57:34.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.827+0000 7ff5e880c640 1 -- 172.21.15.1:0/1078735152 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e4112ae0 con 0x7ff5e4108cf0 2024-09-21T00:57:34.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.827+0000 7ff5e2d9d640 1 --2- 172.21.15.1:0/1078735152 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff5e4108cf0 0x7ff5e4104cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:34.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.828+0000 7ff5e259c640 1 -- 172.21.15.1:0/1078735152 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff5e4108cf0 msgr2=0x7ff5e4104cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:34.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.828+0000 7ff5e259c640 1 --2- 172.21.15.1:0/1078735152 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff5e4108cf0 0x7ff5e4104cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:34.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.828+0000 7ff5e259c640 1 -- 172.21.15.1:0/1078735152 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5e41083a0 msgr2=0x7ff5e4104790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:34.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.828+0000 7ff5e259c640 1 --2- 172.21.15.1:0/1078735152 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5e41083a0 0x7ff5e4104790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:34.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.828+0000 7ff5e259c640 1 -- 172.21.15.1:0/1078735152 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5e41a86c0 con 0x7ff5e4102a60 2024-09-21T00:57:34.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.828+0000 7ff5e1d9b640 1 --2- 172.21.15.1:0/1078735152 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5e41083a0 0x7ff5e4104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:34.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.828+0000 7ff5e259c640 1 --2- 172.21.15.1:0/1078735152 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5e4102a60 0x7ff5e4104250 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4005940 tx=0x7ff5d40316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:34.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.828+0000 7ff5d37fe640 1 -- 172.21.15.1:0/1078735152 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d404c070 con 0x7ff5e4102a60 2024-09-21T00:57:34.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.828+0000 7ff5d37fe640 1 -- 172.21.15.1:0/1078735152 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5d40318c0 con 0x7ff5e4102a60 2024-09-21T00:57:34.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.828+0000 7ff5d37fe640 1 -- 172.21.15.1:0/1078735152 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d4035050 con 0x7ff5e4102a60 2024-09-21T00:57:34.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.828+0000 7ff5e880c640 1 -- 172.21.15.1:0/1078735152 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5e419a110 con 0x7ff5e4102a60 2024-09-21T00:57:34.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.829+0000 7ff5e880c640 1 -- 172.21.15.1:0/1078735152 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5e419a5a0 con 0x7ff5e4102a60 2024-09-21T00:57:34.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.831+0000 7ff5eed80740 1 Processor -- start 2024-09-21T00:57:34.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.832+0000 7ff5eed80740 1 -- start start 2024-09-21T00:57:34.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.832+0000 7ff5eed80740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be8096d070 0x55be80d14650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:34.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.832+0000 7ff5eed80740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be809441b0 0x55be80d14b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:34.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.832+0000 7ff5eed80740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be8094c390 0x55be80d150d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:34.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.832+0000 7ff5eed80740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55be80c8ae50 con 0x55be8096d070 2024-09-21T00:57:34.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.832+0000 7ff5eed80740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55be80c7a280 con 0x55be809441b0 2024-09-21T00:57:34.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.832+0000 7ff5eed80740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55be80c7e090 con 0x55be8094c390 2024-09-21T00:57:34.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.832+0000 7ff5e2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be8096d070 0x55be80d14650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:34.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.832+0000 7ff5e2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be8096d070 0x55be80d14650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59444/0 (socket says 172.21.15.1:59444) 2024-09-21T00:57:34.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.832+0000 7ff5e2d9d640 1 -- 172.21.15.1:0/4035453224 learned_addr learned my addr 172.21.15.1:0/4035453224 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:34.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.833+0000 7ff5e1d9b640 1 --2- 172.21.15.1:0/4035453224 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be8094c390 0x55be80d150d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:34.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.833+0000 7ff5e2d9d640 1 -- 172.21.15.1:0/4035453224 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be8094c390 msgr2=0x55be80d150d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:34.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.833+0000 7ff5e2d9d640 1 --2- 172.21.15.1:0/4035453224 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be8094c390 0x55be80d150d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:34.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.833+0000 7ff5e2d9d640 1 -- 172.21.15.1:0/4035453224 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be809441b0 msgr2=0x55be80d14b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T00:57:34.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.833+0000 7ff5e2d9d640 1 --2- 172.21.15.1:0/4035453224 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be809441b0 0x55be80d14b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:34.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.833+0000 7ff5e2d9d640 1 -- 172.21.15.1:0/4035453224 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be809d8650 con 0x55be8096d070 2024-09-21T00:57:34.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.833+0000 7ff5e2d9d640 1 --2- 172.21.15.1:0/4035453224 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be8096d070 0x55be80d14650 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc009f70 tx=0x7ff5dc010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b76962c772056d7e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:34.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.833+0000 7ff5d37fe640 1 -- 172.21.15.1:0/1078735152 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 154562+0+0 (secure 0 0 0) 0x7ff5d404f070 con 0x7ff5e4102a60 2024-09-21T00:57:34.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.834+0000 7ff5d0ff9640 1 -- 172.21.15.1:0/4035453224 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc016070 con 0x55be8096d070 2024-09-21T00:57:34.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.834+0000 7ff5d0ff9640 1 -- 172.21.15.1:0/4035453224 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5dc004d20 con 0x55be8096d070 2024-09-21T00:57:34.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.834+0000 7ff5d0ff9640 1 -- 172.21.15.1:0/4035453224 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc012890 con 0x55be8096d070 2024-09-21T00:57:34.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.835+0000 7ff5d37fe640 1 --2- 172.21.15.1:0/1078735152 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff5cc0b6620 0x7ff5cc0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:34.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.835+0000 7ff5eed80740 1 -- 172.21.15.1:0/4035453224 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be8096d070 msgr2=0x55be80d14650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:34.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.835+0000 7ff5eed80740 1 --2- 172.21.15.1:0/4035453224 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be8096d070 0x55be80d14650 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc009f70 tx=0x7ff5dc010800 comp rx=0 tx=0).stop 2024-09-21T00:57:34.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.835+0000 7ff5e259c640 1 --2- 172.21.15.1:0/1078735152 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff5cc0b6620 0x7ff5cc0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:34.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.835+0000 7ff5d37fe640 1 -- 172.21.15.1:0/1078735152 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7ff5d410f560 con 0x7ff5e4102a60 2024-09-21T00:57:34.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.835+0000 7ff5eed80740 1 -- 172.21.15.1:0/4035453224 shutdown_connections 2024-09-21T00:57:34.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.835+0000 7ff5eed80740 1 --2- 172.21.15.1:0/4035453224 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be8094c390 0x55be80d150d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:34.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.835+0000 7ff5eed80740 1 --2- 172.21.15.1:0/4035453224 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be809441b0 0x55be80d14b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:34.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.835+0000 7ff5eed80740 1 --2- 172.21.15.1:0/4035453224 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be8096d070 0x55be80d14650 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:34.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.835+0000 7ff5eed80740 1 -- 172.21.15.1:0/4035453224 >> 172.21.15.1:0/4035453224 conn(0x55be80961460 msgr2=0x55be80d12540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:34.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.836+0000 7ff5eed80740 1 -- 172.21.15.1:0/4035453224 shutdown_connections 2024-09-21T00:57:34.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.836+0000 7ff5eed80740 1 -- 172.21.15.1:0/4035453224 wait complete. 2024-09-21T00:57:34.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.836+0000 7ff5e259c640 1 --2- 172.21.15.1:0/1078735152 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff5cc0b6620 0x7ff5cc0b8b30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55be80d132d0 tx=0x7ff5d4035f70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:34.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.836+0000 7ff5eed80740 1 -- start start 2024-09-21T00:57:34.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.836+0000 7ff5eed80740 1 Processor -- start 2024-09-21T00:57:34.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.837+0000 7ff5eed80740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be809441b0 0x55be80d1fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:34.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.837+0000 7ff5eed80740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be8094c390 0x55be80d201e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:34.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.837+0000 7ff5eed80740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be8096d070 0x55be80d20720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:34.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.837+0000 7ff5eed80740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55be80adb700 con 0x55be8096d070 2024-09-21T00:57:34.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.837+0000 7ff5eed80740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55be80c15110 con 0x55be8094c390 2024-09-21T00:57:34.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.837+0000 7ff5eed80740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55be80d22ed0 con 0x55be809441b0 2024-09-21T00:57:34.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.837+0000 7ff5e2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be8096d070 0x55be80d20720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:34.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.837+0000 7ff5e2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be8096d070 0x55be80d20720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59446/0 (socket says 172.21.15.1:59446) 2024-09-21T00:57:34.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.837+0000 7ff5e2d9d640 1 -- 172.21.15.1:0/3142423249 learned_addr learned my addr 172.21.15.1:0/3142423249 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:34.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.837+0000 7ff5eed80740 10 client.0 _ll_register_callbacks cb 0x55be80c2e990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:34.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.837+0000 7ff5e1d9b640 1 --2- 172.21.15.1:0/3142423249 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be8094c390 0x55be80d201e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:34.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.837+0000 7ff5e2d9d640 1 --2- 172.21.15.1:0/3142423249 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be809441b0 0x55be80d1fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:34.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.837+0000 7ff5e2d9d640 1 -- 172.21.15.1:0/3142423249 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be809441b0 msgr2=0x55be80d1fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:34.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.837+0000 7ff5e2d9d640 1 --2- 172.21.15.1:0/3142423249 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be809441b0 0x55be80d1fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:34.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.837+0000 7ff5e2d9d640 1 -- 172.21.15.1:0/3142423249 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be8094c390 msgr2=0x55be80d201e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:34.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.837+0000 7ff5e2d9d640 1 --2- 172.21.15.1:0/3142423249 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be8094c390 0x55be80d201e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:34.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.837+0000 7ff5e2d9d640 1 -- 172.21.15.1:0/3142423249 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be80c42c40 con 0x55be8096d070 2024-09-21T00:57:34.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.838+0000 7ff5e2d9d640 1 --2- 172.21.15.1:0/3142423249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be8096d070 0x55be80d20720 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc009d30 tx=0x7ff5dc0124f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43645a055513e02b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:34.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.838+0000 7ff5c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:57:34.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.838+0000 7ff5c9ffb640 1 -- 172.21.15.1:0/3142423249 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc016030 con 0x55be8096d070 2024-09-21T00:57:34.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.838+0000 7ff5c9ffb640 1 -- 172.21.15.1:0/3142423249 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7ff5dc012cc0 con 0x55be8096d070 2024-09-21T00:57:34.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.838+0000 7ff5eed80740 1 -- 172.21.15.1:0/3142423249 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5dc004d20 con 0x55be8096d070 2024-09-21T00:57:34.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.838+0000 7ff5c9ffb640 1 -- 172.21.15.1:0/3142423249 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff5dc003970 con 0x55be8096d070 2024-09-21T00:57:34.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.838+0000 7ff5eed80740 10 client.15555 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:34.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.838+0000 7ff5eed80740 1 -- 172.21.15.1:0/3142423249 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55be80d2eb20 con 0x55be8096d070 2024-09-21T00:57:34.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.838+0000 7ff5c9ffb640 1 -- 172.21.15.1:0/3142423249 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5dc004d20 con 0x55be8096d070 2024-09-21T00:57:34.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.839+0000 7ff5c9ffb640 1 -- 172.21.15.1:0/3142423249 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7ff5dc00f040 con 0x55be8096d070 2024-09-21T00:57:34.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.839+0000 7ff5eed80740 10 client.15555 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:34.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.839+0000 7ff5eed80740 10 client.15555 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:57:34.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.839+0000 7ff5eed80740 20 client.15555 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:34.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.839+0000 7ff5eed80740 1 --2- 172.21.15.1:0/3142423249 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55be8092b9f0 0x55be80d31ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:34.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.839+0000 7ff5eed80740 4 client.15555 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:57:34.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.839+0000 7ff5eed80740 1 -- 172.21.15.1:0/3142423249 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be80c8cda0 con 0x55be8092b9f0 2024-09-21T00:57:34.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.839+0000 7ff5e1d9b640 1 --2- 172.21.15.1:0/3142423249 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55be8092b9f0 0x55be80d31ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:34.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.841+0000 7ff5c9ffb640 10 client.15555 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:34.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.841+0000 7ff5e1d9b640 1 --2- 172.21.15.1:0/3142423249 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55be8092b9f0 0x55be80d31ee0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f330dff74ec02fa2 server_cookie=3104a2810a7fb1de in_seq=0 out_seq=0 2024-09-21T00:57:34.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.841+0000 7ff5c9ffb640 1 -- 172.21.15.1:0/3142423249 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55be80c8cda0 con 0x55be8092b9f0 2024-09-21T00:57:34.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.841+0000 7ff5c9ffb640 10 client.15555 handle_command_reply: tid=0 2024-09-21T00:57:34.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.841+0000 7ff5eed80740 1 client.15555 shutdown 2024-09-21T00:57:34.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.842+0000 7ff5eed80740 1 -- 172.21.15.1:0/3142423249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be8096d070 msgr2=0x55be80d20720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:34.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.842+0000 7ff5eed80740 1 --2- 172.21.15.1:0/3142423249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be8096d070 0x55be80d20720 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc009d30 tx=0x7ff5dc0124f0 comp rx=0 tx=0).stop 2024-09-21T00:57:34.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.842+0000 7ff5eed80740 1 -- 172.21.15.1:0/3142423249 shutdown_connections 2024-09-21T00:57:34.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.842+0000 7ff5eed80740 1 --2- 172.21.15.1:0/3142423249 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55be8092b9f0 0x55be80d31ee0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:34.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.842+0000 7ff5eed80740 1 --2- 172.21.15.1:0/3142423249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be8096d070 0x55be80d20720 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:34.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.842+0000 7ff5eed80740 1 --2- 172.21.15.1:0/3142423249 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be8094c390 0x55be80d201e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:34.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.842+0000 7ff5eed80740 1 --2- 172.21.15.1:0/3142423249 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be809441b0 0x55be80d1fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:34.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.842+0000 7ff5eed80740 1 -- 172.21.15.1:0/3142423249 >> 172.21.15.1:0/3142423249 conn(0x55be80961460 msgr2=0x55be80d15680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:34.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.842+0000 7ff5c9ffb640 0 client.15555 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:34.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.842+0000 7ff5eed80740 1 -- 172.21.15.1:0/3142423249 shutdown_connections 2024-09-21T00:57:34.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.842+0000 7ff5eed80740 1 -- 172.21.15.1:0/3142423249 wait complete. 2024-09-21T00:57:34.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.843+0000 7ff5eed80740 20 client.15555 trim_cache size 0 max 16384 2024-09-21T00:57:34.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.860+0000 7ff5eed80740 1 Processor -- start 2024-09-21T00:57:34.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.860+0000 7ff5eed80740 1 -- start start 2024-09-21T00:57:34.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.860+0000 7ff5eed80740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be809441b0 0x55be80d15d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:34.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.861+0000 7ff5eed80740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be8094c390 0x55be80d1ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:34.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.861+0000 7ff5eed80740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be8096d070 0x55be80d1d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:34.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.861+0000 7ff5eed80740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e41ad230 con 0x55be8094c390 2024-09-21T00:57:34.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.861+0000 7ff5eed80740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e41aed70 con 0x55be8096d070 2024-09-21T00:57:34.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.861+0000 7ff5eed80740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e41ad900 con 0x55be809441b0 2024-09-21T00:57:34.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.861+0000 7ff5e1d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be8094c390 0x55be80d1ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:34.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.861+0000 7ff5e1d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be8094c390 0x55be80d1ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59448/0 (socket says 172.21.15.1:59448) 2024-09-21T00:57:34.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.861+0000 7ff5e1d9b640 1 -- 172.21.15.1:0/2205496493 learned_addr learned my addr 172.21.15.1:0/2205496493 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:34.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.861+0000 7ff5e1d9b640 1 -- 172.21.15.1:0/2205496493 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be809441b0 msgr2=0x55be80d15d90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T00:57:34.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.861+0000 7ff5e1d9b640 1 --2- 172.21.15.1:0/2205496493 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be809441b0 0x55be80d15d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:34.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.861+0000 7ff5e1d9b640 1 -- 172.21.15.1:0/2205496493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be8096d070 msgr2=0x55be80d1d3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T00:57:34.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.861+0000 7ff5e1d9b640 1 --2- 172.21.15.1:0/2205496493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be8096d070 0x55be80d1d3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:34.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.861+0000 7ff5e1d9b640 1 -- 172.21.15.1:0/2205496493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be80d15470 con 0x55be8094c390 2024-09-21T00:57:34.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.861+0000 7ff5e1d9b640 1 --2- 172.21.15.1:0/2205496493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be8094c390 0x55be80d1ce90 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8005d00 tx=0x7ff5d8014b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e1a269bd551c018 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:34.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.862+0000 7ff5cbfff640 1 -- 172.21.15.1:0/2205496493 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8014390 con 0x55be8094c390 2024-09-21T00:57:34.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.862+0000 7ff5cbfff640 1 -- 172.21.15.1:0/2205496493 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5d8014530 con 0x55be8094c390 2024-09-21T00:57:34.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.862+0000 7ff5cbfff640 1 -- 172.21.15.1:0/2205496493 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d80126b0 con 0x55be8094c390 2024-09-21T00:57:34.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.863+0000 7ff5eed80740 1 -- 172.21.15.1:0/2205496493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be8094c390 msgr2=0x55be80d1ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:34.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.863+0000 7ff5eed80740 1 --2- 172.21.15.1:0/2205496493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be8094c390 0x55be80d1ce90 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8005d00 tx=0x7ff5d8014b00 comp rx=0 tx=0).stop 2024-09-21T00:57:34.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.863+0000 7ff5eed80740 1 -- 172.21.15.1:0/2205496493 shutdown_connections 2024-09-21T00:57:34.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.863+0000 7ff5eed80740 1 --2- 172.21.15.1:0/2205496493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be8096d070 0x55be80d1d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:34.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.863+0000 7ff5eed80740 1 --2- 172.21.15.1:0/2205496493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be8094c390 0x55be80d1ce90 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:34.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.863+0000 7ff5eed80740 1 --2- 172.21.15.1:0/2205496493 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be809441b0 0x55be80d15d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:34.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.863+0000 7ff5eed80740 1 -- 172.21.15.1:0/2205496493 >> 172.21.15.1:0/2205496493 conn(0x55be80961460 msgr2=0x55be80d15680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:34.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.863+0000 7ff5eed80740 1 -- 172.21.15.1:0/2205496493 shutdown_connections 2024-09-21T00:57:34.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.863+0000 7ff5eed80740 1 -- 172.21.15.1:0/2205496493 wait complete. 2024-09-21T00:57:34.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.864+0000 7ff5eed80740 1 -- start start 2024-09-21T00:57:34.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.864+0000 7ff5eed80740 1 Processor -- start 2024-09-21T00:57:34.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.864+0000 7ff5eed80740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be809441b0 0x55be80d24330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:34.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.864+0000 7ff5eed80740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be8094c390 0x55be80d24870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:34.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.864+0000 7ff5eed80740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be8096d070 0x55be80d24df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:34.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.864+0000 7ff5e1d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be8094c390 0x55be80d24870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:34.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.864+0000 7ff5eed80740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e41ae6a0 con 0x55be8094c390 2024-09-21T00:57:34.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.864+0000 7ff5eed80740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e41adfd0 con 0x55be809441b0 2024-09-21T00:57:34.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.864+0000 7ff5eed80740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e41ab230 con 0x55be8096d070 2024-09-21T00:57:34.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.864+0000 7ff5e1d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be8094c390 0x55be80d24870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59452/0 (socket says 172.21.15.1:59452) 2024-09-21T00:57:34.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.864+0000 7ff5e1d9b640 1 -- 172.21.15.1:0/1845120137 learned_addr learned my addr 172.21.15.1:0/1845120137 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:34.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.865+0000 7ff5e2d9d640 1 --2- 172.21.15.1:0/1845120137 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be809441b0 0x55be80d24330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:34.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.865+0000 7ff5eed80740 10 client.0 _ll_register_callbacks cb 0x7ff5dc009df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:34.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.865+0000 7ff5e2d9d640 1 --2- 172.21.15.1:0/1845120137 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be8096d070 0x55be80d24df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:34.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.865+0000 7ff5e1d9b640 1 -- 172.21.15.1:0/1845120137 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be8096d070 msgr2=0x55be80d24df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:34.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.865+0000 7ff5e1d9b640 1 --2- 172.21.15.1:0/1845120137 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be8096d070 0x55be80d24df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:34.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.865+0000 7ff5e1d9b640 1 -- 172.21.15.1:0/1845120137 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be809441b0 msgr2=0x55be80d24330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:34.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.865+0000 7ff5e1d9b640 1 --2- 172.21.15.1:0/1845120137 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be809441b0 0x55be80d24330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:34.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.865+0000 7ff5e1d9b640 1 -- 172.21.15.1:0/1845120137 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be80d9ba10 con 0x55be8094c390 2024-09-21T00:57:34.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.865+0000 7ff5e1d9b640 1 --2- 172.21.15.1:0/1845120137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be8094c390 0x55be80d24870 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8004930 tx=0x7ff5d8004960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7be786564aacdfd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:34.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.865+0000 7ff5c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:57:34.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.865+0000 7ff5c9ffb640 1 -- 172.21.15.1:0/1845120137 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8004220 con 0x55be8094c390 2024-09-21T00:57:34.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.866+0000 7ff5c9ffb640 1 -- 172.21.15.1:0/1845120137 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7ff5d80043c0 con 0x55be8094c390 2024-09-21T00:57:34.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.866+0000 7ff5eed80740 1 -- 172.21.15.1:0/1845120137 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5d8014530 con 0x55be8094c390 2024-09-21T00:57:34.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.866+0000 7ff5c9ffb640 1 -- 172.21.15.1:0/1845120137 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff5d8005230 con 0x55be8094c390 2024-09-21T00:57:34.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.866+0000 7ff5eed80740 10 client.15561 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:34.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.866+0000 7ff5eed80740 1 -- 172.21.15.1:0/1845120137 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55be80d9cc80 con 0x55be8094c390 2024-09-21T00:57:34.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.866+0000 7ff5c9ffb640 1 -- 172.21.15.1:0/1845120137 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5d8014530 con 0x55be8094c390 2024-09-21T00:57:34.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.867+0000 7ff5c9ffb640 1 -- 172.21.15.1:0/1845120137 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7ff5d80035f0 con 0x55be8094c390 2024-09-21T00:57:34.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.867+0000 7ff5eed80740 10 client.15561 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:34.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.867+0000 7ff5eed80740 10 client.15561 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:57:34.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.867+0000 7ff5eed80740 20 client.15561 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:34.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.867+0000 7ff5eed80740 1 --2- 172.21.15.1:0/1845120137 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55be80900da0 0x55be80d9f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:34.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.867+0000 7ff5eed80740 4 client.15561 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T00:57:34.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.867+0000 7ff5eed80740 1 -- 172.21.15.1:0/1845120137 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55be80d0d990 con 0x55be80900da0 2024-09-21T00:57:34.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.867+0000 7ff5e2d9d640 1 --2- 172.21.15.1:0/1845120137 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55be80900da0 0x55be80d9f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:34.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.868+0000 7ff5c9ffb640 10 client.15561 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:34.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.868+0000 7ff5e2d9d640 1 --2- 172.21.15.1:0/1845120137 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55be80900da0 0x55be80d9f3f0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa79fbe6d32dd8d6 server_cookie=fa14e8ddfd38bcd4 in_seq=0 out_seq=0 2024-09-21T00:57:34.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.868+0000 7ff5c9ffb640 1 -- 172.21.15.1:0/1845120137 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x55be80d0d990 con 0x55be80900da0 2024-09-21T00:57:34.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.868+0000 7ff5c9ffb640 10 client.15561 handle_command_reply: tid=0 2024-09-21T00:57:34.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.868+0000 7ff5eed80740 1 client.15561 shutdown 2024-09-21T00:57:34.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.868+0000 7ff5eed80740 1 -- 172.21.15.1:0/1845120137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be8094c390 msgr2=0x55be80d24870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:34.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.868+0000 7ff5eed80740 1 --2- 172.21.15.1:0/1845120137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be8094c390 0x55be80d24870 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8004930 tx=0x7ff5d8004960 comp rx=0 tx=0).stop 2024-09-21T00:57:34.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.868+0000 7ff5eed80740 1 -- 172.21.15.1:0/1845120137 shutdown_connections 2024-09-21T00:57:34.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.868+0000 7ff5eed80740 1 --2- 172.21.15.1:0/1845120137 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55be80900da0 0x55be80d9f3f0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:34.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.868+0000 7ff5eed80740 1 --2- 172.21.15.1:0/1845120137 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be8096d070 0x55be80d24df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:34.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.868+0000 7ff5eed80740 1 --2- 172.21.15.1:0/1845120137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be8094c390 0x55be80d24870 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:34.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.868+0000 7ff5c9ffb640 0 client.15561 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:34.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.868+0000 7ff5eed80740 1 --2- 172.21.15.1:0/1845120137 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be809441b0 0x55be80d24330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:34.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.868+0000 7ff5eed80740 1 -- 172.21.15.1:0/1845120137 >> 172.21.15.1:0/1845120137 conn(0x55be80961460 msgr2=0x55be80d15680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:34.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.868+0000 7ff5eed80740 1 -- 172.21.15.1:0/1845120137 shutdown_connections 2024-09-21T00:57:34.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.869+0000 7ff5eed80740 1 -- 172.21.15.1:0/1845120137 wait complete. 2024-09-21T00:57:34.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.869+0000 7ff5eed80740 20 client.15561 trim_cache size 0 max 16384 2024-09-21T00:57:34.871 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T00:57:34.871 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "no active scrubs running", 2024-09-21T00:57:34.871 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": {}, 2024-09-21T00:57:34.872 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_stats": { 2024-09-21T00:57:34.872 INFO:teuthology.orchestra.run.smithi001.stdout: "53fa74e4-5aa8-408b-9724-7c93618f7636": { 2024-09-21T00:57:34.872 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:01.730608+0000", 2024-09-21T00:57:34.872 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T00:57:34.872 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T00:57:34.872 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T00:57:34.872 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T00:57:34.872 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T00:57:34.872 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T00:57:34.872 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T00:57:34.872 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T00:57:34.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.869+0000 7ff5e880c640 1 -- 172.21.15.1:0/1078735152 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff5cc0b6620 msgr2=0x7ff5cc0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:34.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.869+0000 7ff5e880c640 1 --2- 172.21.15.1:0/1078735152 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff5cc0b6620 0x7ff5cc0b8b30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55be80d132d0 tx=0x7ff5d4035f70 comp rx=0 tx=0).stop 2024-09-21T00:57:34.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.869+0000 7ff5e880c640 1 -- 172.21.15.1:0/1078735152 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5e4102a60 msgr2=0x7ff5e4104250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:34.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.869+0000 7ff5e880c640 1 --2- 172.21.15.1:0/1078735152 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5e4102a60 0x7ff5e4104250 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4005940 tx=0x7ff5d40316d0 comp rx=0 tx=0).stop 2024-09-21T00:57:34.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.870+0000 7ff5e880c640 1 -- 172.21.15.1:0/1078735152 shutdown_connections 2024-09-21T00:57:34.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.870+0000 7ff5e880c640 1 --2- 172.21.15.1:0/1078735152 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff5e4108cf0 0x7ff5e4104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:34.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.870+0000 7ff5e880c640 1 --2- 172.21.15.1:0/1078735152 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5e41083a0 0x7ff5e4104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:34.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.870+0000 7ff5e880c640 1 --2- 172.21.15.1:0/1078735152 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff5cc0b6620 0x7ff5cc0b8b30 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:34.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.870+0000 7ff5e880c640 1 --2- 172.21.15.1:0/1078735152 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5e4102a60 0x7ff5e4104250 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:34.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.870+0000 7ff5e880c640 1 -- 172.21.15.1:0/1078735152 >> 172.21.15.1:0/1078735152 conn(0x7ff5e4079730 msgr2=0x7ff5e4101a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:34.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.870+0000 7ff5e880c640 1 -- 172.21.15.1:0/1078735152 shutdown_connections 2024-09-21T00:57:34.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:34.870+0000 7ff5e880c640 1 -- 172.21.15.1:0/1078735152 wait complete. 2024-09-21T00:57:35.645 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T00:57:35.645 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:57:35.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:35 smithi001 ceph-mon[31211]: pgmap v369: 97 pgs: 97 active+clean; 666 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-21T00:57:35.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:35 smithi193 ceph-mon[34660]: pgmap v369: 97 pgs: 97 active+clean; 666 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-21T00:57:35.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:35 smithi042 ceph-mon[34481]: pgmap v369: 97 pgs: 97 active+clean; 666 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-21T00:57:36.021 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:36.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.577+0000 7f74d6ed4640 1 -- 172.21.15.1:0/1824798119 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74d0102a60 msgr2=0x7f74d0102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:36.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.577+0000 7f74d6ed4640 1 --2- 172.21.15.1:0/1824798119 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74d0102a60 0x7f74d0102e70 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f74c4009900 tx=0x7f74c402a3f0 comp rx=0 tx=0).stop 2024-09-21T00:57:36.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.577+0000 7f74d6ed4640 1 -- 172.21.15.1:0/1824798119 shutdown_connections 2024-09-21T00:57:36.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.577+0000 7f74d6ed4640 1 --2- 172.21.15.1:0/1824798119 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74d0108cf0 0x7f74d010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:36.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.577+0000 7f74d6ed4640 1 --2- 172.21.15.1:0/1824798119 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74d01083a0 0x7f74d01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:36.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.577+0000 7f74d6ed4640 1 --2- 172.21.15.1:0/1824798119 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74d0102a60 0x7f74d0102e70 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:36.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.577+0000 7f74d6ed4640 1 -- 172.21.15.1:0/1824798119 >> 172.21.15.1:0/1824798119 conn(0x7f74d0079730 msgr2=0x7f74d0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:36.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.578+0000 7f74d6ed4640 1 -- 172.21.15.1:0/1824798119 shutdown_connections 2024-09-21T00:57:36.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.578+0000 7f74d6ed4640 1 -- 172.21.15.1:0/1824798119 wait complete. 2024-09-21T00:57:36.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.578+0000 7f74d6ed4640 1 Processor -- start 2024-09-21T00:57:36.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.578+0000 7f74d6ed4640 1 -- start start 2024-09-21T00:57:36.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.579+0000 7f74d6ed4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74d0102a60 0x7f74d019a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:36.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.579+0000 7f74d6ed4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74d01083a0 0x7f74d019aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:36.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.579+0000 7f74d6ed4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74d0108cf0 0x7f74d019fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:36.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.579+0000 7f74cffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74d01083a0 0x7f74d019aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:36.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.579+0000 7f74d6ed4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f74d0112960 con 0x7f74d01083a0 2024-09-21T00:57:36.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.579+0000 7f74cffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74d01083a0 0x7f74d019aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59470/0 (socket says 172.21.15.1:59470) 2024-09-21T00:57:36.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.579+0000 7f74cffff640 1 -- 172.21.15.1:0/197208502 learned_addr learned my addr 172.21.15.1:0/197208502 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:36.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.579+0000 7f74d6ed4640 1 -- 172.21.15.1:0/197208502 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f74d01127e0 con 0x7f74d0108cf0 2024-09-21T00:57:36.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.579+0000 7f74d6ed4640 1 -- 172.21.15.1:0/197208502 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f74d0112ae0 con 0x7f74d0102a60 2024-09-21T00:57:36.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.579+0000 7f74d4c70640 1 --2- 172.21.15.1:0/197208502 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74d0102a60 0x7f74d019a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:36.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.579+0000 7f74d5471640 1 --2- 172.21.15.1:0/197208502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74d0108cf0 0x7f74d019fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:36.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.579+0000 7f74cffff640 1 -- 172.21.15.1:0/197208502 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74d0102a60 msgr2=0x7f74d019a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:36.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.579+0000 7f74cffff640 1 --2- 172.21.15.1:0/197208502 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74d0102a60 0x7f74d019a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:36.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.579+0000 7f74cffff640 1 -- 172.21.15.1:0/197208502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74d0108cf0 msgr2=0x7f74d019fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:36.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.579+0000 7f74cffff640 1 --2- 172.21.15.1:0/197208502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74d0108cf0 0x7f74d019fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:36.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.580+0000 7f74cffff640 1 -- 172.21.15.1:0/197208502 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74d01a0330 con 0x7f74d01083a0 2024-09-21T00:57:36.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.580+0000 7f74d5471640 1 --2- 172.21.15.1:0/197208502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74d0108cf0 0x7f74d019fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:57:36.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.580+0000 7f74cffff640 1 --2- 172.21.15.1:0/197208502 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74d01083a0 0x7f74d019aa20 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f74bc009ab0 tx=0x7f74bc00ff80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:36.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.580+0000 7f74cdffb640 1 -- 172.21.15.1:0/197208502 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74bc007920 con 0x7f74d01083a0 2024-09-21T00:57:36.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.580+0000 7f74cdffb640 1 -- 172.21.15.1:0/197208502 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74bc005020 con 0x7f74d01083a0 2024-09-21T00:57:36.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.581+0000 7f74cdffb640 1 -- 172.21.15.1:0/197208502 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74bc004d00 con 0x7f74d01083a0 2024-09-21T00:57:36.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.581+0000 7f74d6ed4640 1 -- 172.21.15.1:0/197208502 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74d01a0620 con 0x7f74d01083a0 2024-09-21T00:57:36.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.581+0000 7f74d6ed4640 1 -- 172.21.15.1:0/197208502 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74d01a0ae0 con 0x7f74d01083a0 2024-09-21T00:57:36.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.582+0000 7f74d6ed4640 1 -- 172.21.15.1:0/197208502 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74d0103ce0 con 0x7f74d01083a0 2024-09-21T00:57:36.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.585+0000 7f74cdffb640 1 -- 172.21.15.1:0/197208502 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 154562+0+0 (secure 0 0 0) 0x7f74bc007ac0 con 0x7f74d01083a0 2024-09-21T00:57:36.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.586+0000 7f74cdffb640 1 --2- 172.21.15.1:0/197208502 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f74c00b6470 0x7f74c00b8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:36.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.586+0000 7f74cdffb640 1 -- 172.21.15.1:0/197208502 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f74bc0eb320 con 0x7f74d01083a0 2024-09-21T00:57:36.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.586+0000 7f74d4c70640 1 --2- 172.21.15.1:0/197208502 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f74c00b6470 0x7f74c00b8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:36.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.587+0000 7f74d4c70640 1 --2- 172.21.15.1:0/197208502 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f74c00b6470 0x7f74c00b8980 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f74c4031440 tx=0x7f74c4009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:36.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.590+0000 7f74cdffb640 1 -- 172.21.15.1:0/197208502 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f74bc0b19d0 con 0x7f74d01083a0 2024-09-21T00:57:36.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.863+0000 7f74d6ed4640 1 -- 172.21.15.1:0/197208502 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f74d01041c0 con 0x7f74d01083a0 2024-09-21T00:57:36.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.863+0000 7f74cdffb640 1 -- 172.21.15.1:0/197208502 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11955 (secure 0 0 0) 0x7f74bc0b5db0 con 0x7f74d01083a0 2024-09-21T00:57:36.864 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:57:36.864 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":27,"btime":"2024-09-21T00:56:52:855037+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2810186677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2810186677},{"type":"v1","addr":"172.21.15.1:6835","nonce":2810186677}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14736,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3935320478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3935320478},{"type":"v1","addr":"172.21.15.1:6837","nonce":3935320478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:54:58.592853+0000","modified":"2024-09-21T00:56:52.784125+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24653,"mds_1":24637,"mds_2":24626,"mds_3":24622,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/2125703572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2125703572},{"type":"v1","addr":"172.21.15.1:6839","nonce":2125703572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/3860445313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860445313},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860445313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6833/712170939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":712170939},{"type":"v1","addr":"172.21.15.193:6833","nonce":712170939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6833/1653911656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1653911656},{"type":"v1","addr":"172.21.15.42:6833","nonce":1653911656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6835/793085918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":793085918},{"type":"v1","addr":"172.21.15.42:6835","nonce":793085918}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6835/3631682268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":3631682268},{"type":"v1","addr":"172.21.15.193:6835","nonce":3631682268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.193:6837/909252228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":909252228},{"type":"v1","addr":"172.21.15.193:6837","nonce":909252228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.42:6837/2395608508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2395608508},{"type":"v1","addr":"172.21.15.42:6837","nonce":2395608508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.193:6839/1365361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1365361177},{"type":"v1","addr":"172.21.15.193:6839","nonce":1365361177}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6839/2526476666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2526476666},{"type":"v1","addr":"172.21.15.42:6839","nonce":2526476666}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24610,24622,24626,24637,24653]},"id":1}]} 2024-09-21T00:57:36.864 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 27 2024-09-21T00:57:36.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.867+0000 7f74d6ed4640 1 -- 172.21.15.1:0/197208502 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f74c00b6470 msgr2=0x7f74c00b8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:36.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.867+0000 7f74d6ed4640 1 --2- 172.21.15.1:0/197208502 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f74c00b6470 0x7f74c00b8980 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f74c4031440 tx=0x7f74c4009560 comp rx=0 tx=0).stop 2024-09-21T00:57:36.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.867+0000 7f74d6ed4640 1 -- 172.21.15.1:0/197208502 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74d01083a0 msgr2=0x7f74d019aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:36.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.867+0000 7f74d6ed4640 1 --2- 172.21.15.1:0/197208502 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74d01083a0 0x7f74d019aa20 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f74bc009ab0 tx=0x7f74bc00ff80 comp rx=0 tx=0).stop 2024-09-21T00:57:36.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.867+0000 7f74d6ed4640 1 -- 172.21.15.1:0/197208502 shutdown_connections 2024-09-21T00:57:36.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.867+0000 7f74d6ed4640 1 --2- 172.21.15.1:0/197208502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74d0108cf0 0x7f74d019fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:36.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.867+0000 7f74d6ed4640 1 --2- 172.21.15.1:0/197208502 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f74c00b6470 0x7f74c00b8980 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:36.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.867+0000 7f74d6ed4640 1 --2- 172.21.15.1:0/197208502 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74d01083a0 0x7f74d019aa20 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:36.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.867+0000 7f74d6ed4640 1 --2- 172.21.15.1:0/197208502 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74d0102a60 0x7f74d019a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:36.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.867+0000 7f74d6ed4640 1 -- 172.21.15.1:0/197208502 >> 172.21.15.1:0/197208502 conn(0x7f74d0079730 msgr2=0x7f74d0101ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:36.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.867+0000 7f74d6ed4640 1 -- 172.21.15.1:0/197208502 shutdown_connections 2024-09-21T00:57:36.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:36.867+0000 7f74d6ed4640 1 -- 172.21.15.1:0/197208502 wait complete. 2024-09-21T00:57:37.579 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T00:57:37.885 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:37.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:37 smithi001 ceph-mon[31211]: pgmap v370: 97 pgs: 97 active+clean; 666 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-21T00:57:37.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:37 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/197208502' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:57:37.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:37 smithi193 ceph-mon[34660]: pgmap v370: 97 pgs: 97 active+clean; 666 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-21T00:57:37.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:37 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/197208502' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:57:37.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:37 smithi042 ceph-mon[34481]: pgmap v370: 97 pgs: 97 active+clean; 666 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-21T00:57:37.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:37 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/197208502' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:57:38.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.436+0000 7f26d26b9640 1 -- 172.21.15.1:0/936457839 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26cc109e20 msgr2=0x7f26cc110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:38.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.436+0000 7f26d26b9640 1 --2- 172.21.15.1:0/936457839 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26cc109e20 0x7f26cc110650 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f26c4009ca0 tx=0x7f26c402a8c0 comp rx=0 tx=0).stop 2024-09-21T00:57:38.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.437+0000 7f26d26b9640 1 -- 172.21.15.1:0/936457839 shutdown_connections 2024-09-21T00:57:38.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.437+0000 7f26d26b9640 1 --2- 172.21.15.1:0/936457839 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26cc109e20 0x7f26cc110650 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:38.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.437+0000 7f26d26b9640 1 --2- 172.21.15.1:0/936457839 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26cc1094d0 0x7f26cc1098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:38.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.437+0000 7f26d26b9640 1 --2- 172.21.15.1:0/936457839 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26cc103b90 0x7f26cc103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:38.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.437+0000 7f26d26b9640 1 -- 172.21.15.1:0/936457839 >> 172.21.15.1:0/936457839 conn(0x7f26cc0ff5e0 msgr2=0x7f26cc101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:38.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.437+0000 7f26d26b9640 1 -- 172.21.15.1:0/936457839 shutdown_connections 2024-09-21T00:57:38.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.437+0000 7f26d26b9640 1 -- 172.21.15.1:0/936457839 wait complete. 2024-09-21T00:57:38.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.438+0000 7f26d26b9640 1 Processor -- start 2024-09-21T00:57:38.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.438+0000 7f26d26b9640 1 -- start start 2024-09-21T00:57:38.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.439+0000 7f26d26b9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26cc103b90 0x7f26cc19a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:38.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.439+0000 7f26d26b9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26cc1094d0 0x7f26cc19a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:38.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.439+0000 7f26d26b9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26cc109e20 0x7f26cc19fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:38.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.439+0000 7f26d26b9640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc113b30 con 0x7f26cc1094d0 2024-09-21T00:57:38.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.439+0000 7f26d26b9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc1139b0 con 0x7f26cc109e20 2024-09-21T00:57:38.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.439+0000 7f26d26b9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc113cb0 con 0x7f26cc103b90 2024-09-21T00:57:38.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.439+0000 7f26cbfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26cc103b90 0x7f26cc19a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:38.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.439+0000 7f26cbfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26cc103b90 0x7f26cc19a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:52954/0 (socket says 172.21.15.1:52954) 2024-09-21T00:57:38.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.439+0000 7f26cbfff640 1 -- 172.21.15.1:0/1821068308 learned_addr learned my addr 172.21.15.1:0/1821068308 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:38.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.439+0000 7f26cb7fe640 1 --2- 172.21.15.1:0/1821068308 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26cc1094d0 0x7f26cc19a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:38.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.439+0000 7f26cbfff640 1 -- 172.21.15.1:0/1821068308 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26cc109e20 msgr2=0x7f26cc19fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:38.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.439+0000 7f26cbfff640 1 --2- 172.21.15.1:0/1821068308 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26cc109e20 0x7f26cc19fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:38.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.439+0000 7f26cbfff640 1 -- 172.21.15.1:0/1821068308 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26cc1094d0 msgr2=0x7f26cc19a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:38.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.439+0000 7f26cbfff640 1 --2- 172.21.15.1:0/1821068308 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26cc1094d0 0x7f26cc19a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:38.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.439+0000 7f26cbfff640 1 -- 172.21.15.1:0/1821068308 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26cc1a01e0 con 0x7f26cc103b90 2024-09-21T00:57:38.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.440+0000 7f26cb7fe640 1 --2- 172.21.15.1:0/1821068308 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26cc1094d0 0x7f26cc19a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:57:38.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.440+0000 7f26cbfff640 1 --2- 172.21.15.1:0/1821068308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26cc103b90 0x7f26cc19a270 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f26bc00e9f0 tx=0x7f26bc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:38.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.440+0000 7f26c97fa640 1 -- 172.21.15.1:0/1821068308 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26bc00cd80 con 0x7f26cc103b90 2024-09-21T00:57:38.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.440+0000 7f26d26b9640 1 -- 172.21.15.1:0/1821068308 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26cc1a04d0 con 0x7f26cc103b90 2024-09-21T00:57:38.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.440+0000 7f26c97fa640 1 -- 172.21.15.1:0/1821068308 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26bc0108e0 con 0x7f26cc103b90 2024-09-21T00:57:38.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.440+0000 7f26c97fa640 1 -- 172.21.15.1:0/1821068308 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26bc018860 con 0x7f26cc103b90 2024-09-21T00:57:38.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.440+0000 7f26d26b9640 1 -- 172.21.15.1:0/1821068308 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26cc1a6c30 con 0x7f26cc103b90 2024-09-21T00:57:38.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.444+0000 7f26d8c2d740 1 Processor -- start 2024-09-21T00:57:38.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.444+0000 7f26d8c2d740 1 -- start start 2024-09-21T00:57:38.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.444+0000 7f26d8c2d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d503528070 0x55d5038cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:38.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.444+0000 7f26d8c2d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5034ff1b0 0x55d5038cfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:38.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.444+0000 7f26d8c2d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d503507390 0x55d5038d0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:38.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.444+0000 7f26d8c2d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d503845ea0 con 0x55d503528070 2024-09-21T00:57:38.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.444+0000 7f26d8c2d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d5038352d0 con 0x55d5034ff1b0 2024-09-21T00:57:38.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.444+0000 7f26d8c2d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d5038390e0 con 0x55d503507390 2024-09-21T00:57:38.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.445+0000 7f26d0c56640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d503528070 0x55d5038cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:38.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.445+0000 7f26cb7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d503507390 0x55d5038d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:38.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.445+0000 7f26cb7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d503507390 0x55d5038d0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:52964/0 (socket says 172.21.15.1:52964) 2024-09-21T00:57:38.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.445+0000 7f26cb7fe640 1 -- 172.21.15.1:0/4084515111 learned_addr learned my addr 172.21.15.1:0/4084515111 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:38.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.445+0000 7f26c97fa640 1 -- 172.21.15.1:0/1821068308 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 19) ==== 154562+0+0 (secure 0 0 0) 0x7f26bc018a00 con 0x7f26cc103b90 2024-09-21T00:57:38.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.445+0000 7f26cb7fe640 1 -- 172.21.15.1:0/4084515111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5034ff1b0 msgr2=0x55d5038cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:38.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.445+0000 7f26cb7fe640 1 --2- 172.21.15.1:0/4084515111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5034ff1b0 0x55d5038cfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:38.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.445+0000 7f26cb7fe640 1 -- 172.21.15.1:0/4084515111 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d503528070 msgr2=0x55d5038cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:38.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.445+0000 7f26cb7fe640 1 --2- 172.21.15.1:0/4084515111 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d503528070 0x55d5038cf6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:38.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.445+0000 7f26cb7fe640 1 -- 172.21.15.1:0/4084515111 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d503593650 con 0x55d503507390 2024-09-21T00:57:38.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.446+0000 7f26cb7fe640 1 --2- 172.21.15.1:0/4084515111 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d503507390 0x55d5038d0120 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f26c000bc30 tx=0x7f26c000f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e54a7e7d6660ae4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:38.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.446+0000 7f26b27fc640 1 -- 172.21.15.1:0/4084515111 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c0004030 con 0x55d503507390 2024-09-21T00:57:38.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.446+0000 7f26b27fc640 1 -- 172.21.15.1:0/4084515111 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26c00054d0 con 0x55d503507390 2024-09-21T00:57:38.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.446+0000 7f26b27fc640 1 -- 172.21.15.1:0/4084515111 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c0004ba0 con 0x55d503507390 2024-09-21T00:57:38.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.446+0000 7f26c97fa640 1 --2- 172.21.15.1:0/1821068308 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f26b40b6620 0x7f26b40b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:38.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.447+0000 7f26c97fa640 1 -- 172.21.15.1:0/1821068308 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f26bc0e7940 con 0x7f26cc103b90 2024-09-21T00:57:38.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.447+0000 7f26d0c56640 1 --2- 172.21.15.1:0/1821068308 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f26b40b6620 0x7f26b40b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:38.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.447+0000 7f26d8c2d740 1 -- 172.21.15.1:0/4084515111 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d503507390 msgr2=0x55d5038d0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:38.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.447+0000 7f26d8c2d740 1 --2- 172.21.15.1:0/4084515111 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d503507390 0x55d5038d0120 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f26c000bc30 tx=0x7f26c000f730 comp rx=0 tx=0).stop 2024-09-21T00:57:38.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.447+0000 7f26d0c56640 1 --2- 172.21.15.1:0/1821068308 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f26b40b6620 0x7f26b40b8b30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f26c4009620 tx=0x7f26c4004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:38.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.448+0000 7f26d8c2d740 1 -- 172.21.15.1:0/4084515111 shutdown_connections 2024-09-21T00:57:38.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.448+0000 7f26d8c2d740 1 --2- 172.21.15.1:0/4084515111 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d503507390 0x55d5038d0120 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:38.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.448+0000 7f26d8c2d740 1 --2- 172.21.15.1:0/4084515111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5034ff1b0 0x55d5038cfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:38.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.448+0000 7f26d8c2d740 1 --2- 172.21.15.1:0/4084515111 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d503528070 0x55d5038cf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:38.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.448+0000 7f26d8c2d740 1 -- 172.21.15.1:0/4084515111 >> 172.21.15.1:0/4084515111 conn(0x55d50351c460 msgr2=0x55d5038cd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:38.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.448+0000 7f26d8c2d740 1 -- 172.21.15.1:0/4084515111 shutdown_connections 2024-09-21T00:57:38.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.448+0000 7f26d8c2d740 1 -- 172.21.15.1:0/4084515111 wait complete. 2024-09-21T00:57:38.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.448+0000 7f26d8c2d740 1 -- start start 2024-09-21T00:57:38.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.449+0000 7f26d8c2d740 1 Processor -- start 2024-09-21T00:57:38.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.449+0000 7f26d8c2d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5034ff1b0 0x55d5038df1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:38.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.449+0000 7f26d8c2d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d503507390 0x55d5038df720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:38.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.449+0000 7f26d8c2d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d503528070 0x55d5038eb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:38.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.449+0000 7f26d8c2d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d503696700 con 0x55d503528070 2024-09-21T00:57:38.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.449+0000 7f26d8c2d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d5037d0160 con 0x55d503507390 2024-09-21T00:57:38.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.449+0000 7f26d8c2d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d5038e21e0 con 0x55d5034ff1b0 2024-09-21T00:57:38.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.449+0000 7f26cbfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5034ff1b0 0x55d5038df1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:38.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.449+0000 7f26cbfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5034ff1b0 0x55d5038df1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:52980/0 (socket says 172.21.15.1:52980) 2024-09-21T00:57:38.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.449+0000 7f26cbfff640 1 -- 172.21.15.1:0/790170373 learned_addr learned my addr 172.21.15.1:0/790170373 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:38.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.450+0000 7f26d0c56640 1 --2- 172.21.15.1:0/790170373 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d503528070 0x55d5038eb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:38.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.450+0000 7f26cbfff640 1 -- 172.21.15.1:0/790170373 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d503507390 msgr2=0x55d5038df720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:38.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.450+0000 7f26cbfff640 1 --2- 172.21.15.1:0/790170373 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d503507390 0x55d5038df720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:38.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.450+0000 7f26cbfff640 1 -- 172.21.15.1:0/790170373 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d503528070 msgr2=0x55d5038eb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:38.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.450+0000 7f26cbfff640 1 --2- 172.21.15.1:0/790170373 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d503528070 0x55d5038eb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:38.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.450+0000 7f26cbfff640 1 -- 172.21.15.1:0/790170373 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5037fdc90 con 0x55d5034ff1b0 2024-09-21T00:57:38.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.450+0000 7f26d0c56640 1 --2- 172.21.15.1:0/790170373 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d503528070 0x55d5038eb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:38.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.450+0000 7f26d8c2d740 10 client.0 _ll_register_callbacks cb 0x55d5037e99e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:38.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.450+0000 7f26cbfff640 1 --2- 172.21.15.1:0/790170373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5034ff1b0 0x55d5038df1e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f26bc00e9c0 tx=0x7f26bc0ad240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ccacf0f5a958aa3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:38.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.450+0000 7f26ab7fe640 10 client.25219 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T00:57:38.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.450+0000 7f26d8c2d740 1 -- 172.21.15.1:0/790170373 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26c00054d0 con 0x55d5034ff1b0 2024-09-21T00:57:38.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.451+0000 7f26ab7fe640 1 -- 172.21.15.1:0/790170373 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26bc0adff0 con 0x55d5034ff1b0 2024-09-21T00:57:38.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.451+0000 7f26ab7fe640 1 -- 172.21.15.1:0/790170373 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f26bc0a9240 con 0x55d5034ff1b0 2024-09-21T00:57:38.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.451+0000 7f26ab7fe640 1 -- 172.21.15.1:0/790170373 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f26bc0a94c0 con 0x55d5034ff1b0 2024-09-21T00:57:38.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.451+0000 7f26d8c2d740 10 client.25219 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:38.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.451+0000 7f26d8c2d740 1 -- 172.21.15.1:0/790170373 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55d5038d72b0 con 0x55d5034ff1b0 2024-09-21T00:57:38.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.451+0000 7f26ab7fe640 1 -- 172.21.15.1:0/790170373 <== mon.1 v2:172.21.15.193:3300/0 4 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f26bc0ac5c0 con 0x55d5034ff1b0 2024-09-21T00:57:38.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.451+0000 7f26d8c2d740 10 client.25219 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:38.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.451+0000 7f26d8c2d740 10 client.25219 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T00:57:38.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.451+0000 7f26d8c2d740 20 client.25219 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:38.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.451+0000 7f26d8c2d740 1 --2- 172.21.15.1:0/790170373 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x55d5034e69f0 0x55d5038d8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:38.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.451+0000 7f26d8c2d740 4 client.25219 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:57:38.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.451+0000 7f26d8c2d740 1 -- 172.21.15.1:0/790170373 --> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f26c00054d0 con 0x55d5034e69f0 2024-09-21T00:57:38.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.452+0000 7f26cb7fe640 1 --2- 172.21.15.1:0/790170373 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x55d5034e69f0 0x55d5038d8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:38.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.452+0000 7f26ab7fe640 10 client.25219 ms_handle_connect on v2:172.21.15.193:6834/3631682268 2024-09-21T00:57:38.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.452+0000 7f26cb7fe640 1 --2- 172.21.15.1:0/790170373 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x55d5034e69f0 0x55d5038d8710 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ceaa29505057873f server_cookie=24fdc2a60bf5df3a in_seq=0 out_seq=0 2024-09-21T00:57:38.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.453+0000 7f26ab7fe640 1 -- 172.21.15.1:0/790170373 <== mds.4 v2:172.21.15.193:6834/3631682268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f26c00054d0 con 0x55d5034e69f0 2024-09-21T00:57:38.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.453+0000 7f26ab7fe640 10 client.25219 handle_command_reply: tid=0 2024-09-21T00:57:38.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.453+0000 7f26d8c2d740 1 client.25219 shutdown 2024-09-21T00:57:38.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.454+0000 7f26d8c2d740 1 -- 172.21.15.1:0/790170373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5034ff1b0 msgr2=0x55d5038df1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:38.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.454+0000 7f26d8c2d740 1 --2- 172.21.15.1:0/790170373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5034ff1b0 0x55d5038df1e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f26bc00e9c0 tx=0x7f26bc0ad240 comp rx=0 tx=0).stop 2024-09-21T00:57:38.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.454+0000 7f26d8c2d740 1 -- 172.21.15.1:0/790170373 shutdown_connections 2024-09-21T00:57:38.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.454+0000 7f26d8c2d740 1 --2- 172.21.15.1:0/790170373 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x55d5034e69f0 0x55d5038d8710 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:38.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.454+0000 7f26ab7fe640 0 client.25219 ms_handle_reset on v2:172.21.15.193:6834/3631682268 2024-09-21T00:57:38.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.454+0000 7f26d8c2d740 1 --2- 172.21.15.1:0/790170373 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d503528070 0x55d5038eb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:38.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.454+0000 7f26d8c2d740 1 --2- 172.21.15.1:0/790170373 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d503507390 0x55d5038df720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:38.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.454+0000 7f26d8c2d740 1 --2- 172.21.15.1:0/790170373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5034ff1b0 0x55d5038df1e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:38.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.454+0000 7f26d8c2d740 1 -- 172.21.15.1:0/790170373 >> 172.21.15.1:0/790170373 conn(0x55d50351c460 msgr2=0x55d5038d1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:38.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.454+0000 7f26d8c2d740 1 -- 172.21.15.1:0/790170373 shutdown_connections 2024-09-21T00:57:38.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.454+0000 7f26d8c2d740 1 -- 172.21.15.1:0/790170373 wait complete. 2024-09-21T00:57:38.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.454+0000 7f26d8c2d740 20 client.25219 trim_cache size 0 max 16384 2024-09-21T00:57:38.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.481+0000 7f26d8c2d740 1 Processor -- start 2024-09-21T00:57:38.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.481+0000 7f26d8c2d740 1 -- start start 2024-09-21T00:57:38.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.481+0000 7f26d8c2d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d5034e69f0 0x55d5038e10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:38.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.481+0000 7f26d8c2d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5034ff1b0 0x55d5038d0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:38.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.481+0000 7f26cbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d5034e69f0 0x55d5038e10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:38.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.481+0000 7f26cbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d5034e69f0 0x55d5038e10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59522/0 (socket says 172.21.15.1:59522) 2024-09-21T00:57:38.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.481+0000 7f26d8c2d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d503507390 0x55d5038dc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:38.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.481+0000 7f26d8c2d740 1 -- 172.21.15.1:0/1602028496 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc1ad2e0 con 0x55d5034e69f0 2024-09-21T00:57:38.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.481+0000 7f26cbfff640 1 -- 172.21.15.1:0/1602028496 learned_addr learned my addr 172.21.15.1:0/1602028496 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:38.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.481+0000 7f26d8c2d740 1 -- 172.21.15.1:0/1602028496 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc1aee20 con 0x55d5034ff1b0 2024-09-21T00:57:38.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.481+0000 7f26d8c2d740 1 -- 172.21.15.1:0/1602028496 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc1ad9b0 con 0x55d503507390 2024-09-21T00:57:38.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.481+0000 7f26cb7fe640 1 --2- 172.21.15.1:0/1602028496 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5034ff1b0 0x55d5038d0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:38.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.482+0000 7f26d0c56640 1 --2- 172.21.15.1:0/1602028496 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d503507390 0x55d5038dc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:38.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.482+0000 7f26cbfff640 1 -- 172.21.15.1:0/1602028496 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d503507390 msgr2=0x55d5038dc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:38.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.482+0000 7f26cbfff640 1 --2- 172.21.15.1:0/1602028496 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d503507390 0x55d5038dc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:38.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.482+0000 7f26cbfff640 1 -- 172.21.15.1:0/1602028496 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5034ff1b0 msgr2=0x55d5038d0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:38.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.482+0000 7f26cbfff640 1 --2- 172.21.15.1:0/1602028496 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5034ff1b0 0x55d5038d0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:38.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.482+0000 7f26cbfff640 1 -- 172.21.15.1:0/1602028496 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5038e04a0 con 0x55d5034e69f0 2024-09-21T00:57:38.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.482+0000 7f26d0c56640 1 --2- 172.21.15.1:0/1602028496 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d503507390 0x55d5038dc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:57:38.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.482+0000 7f26cbfff640 1 --2- 172.21.15.1:0/1602028496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d5034e69f0 0x55d5038e10c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f26bc0ad5f0 tx=0x7f26bc0d1000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf20fc56a0ac4764 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:38.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.483+0000 7f26b1ffb640 1 -- 172.21.15.1:0/1602028496 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26bc0b21d0 con 0x55d5034e69f0 2024-09-21T00:57:38.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.483+0000 7f26b1ffb640 1 -- 172.21.15.1:0/1602028496 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26bc0b2020 con 0x55d5034e69f0 2024-09-21T00:57:38.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.483+0000 7f26b1ffb640 1 -- 172.21.15.1:0/1602028496 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26bc0b23d0 con 0x55d5034e69f0 2024-09-21T00:57:38.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.484+0000 7f26d8c2d740 1 -- 172.21.15.1:0/1602028496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d5034e69f0 msgr2=0x55d5038e10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:38.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.484+0000 7f26d8c2d740 1 --2- 172.21.15.1:0/1602028496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d5034e69f0 0x55d5038e10c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f26bc0ad5f0 tx=0x7f26bc0d1000 comp rx=0 tx=0).stop 2024-09-21T00:57:38.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.484+0000 7f26d8c2d740 1 -- 172.21.15.1:0/1602028496 shutdown_connections 2024-09-21T00:57:38.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.484+0000 7f26d8c2d740 1 --2- 172.21.15.1:0/1602028496 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d503507390 0x55d5038dc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:38.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.484+0000 7f26d8c2d740 1 --2- 172.21.15.1:0/1602028496 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5034ff1b0 0x55d5038d0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:38.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.484+0000 7f26d8c2d740 1 --2- 172.21.15.1:0/1602028496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d5034e69f0 0x55d5038e10c0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:38.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.484+0000 7f26d8c2d740 1 -- 172.21.15.1:0/1602028496 >> 172.21.15.1:0/1602028496 conn(0x55d50351c460 msgr2=0x55d5038d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:38.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.484+0000 7f26d8c2d740 1 -- 172.21.15.1:0/1602028496 shutdown_connections 2024-09-21T00:57:38.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.485+0000 7f26d8c2d740 1 -- 172.21.15.1:0/1602028496 wait complete. 2024-09-21T00:57:38.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.485+0000 7f26d8c2d740 1 -- start start 2024-09-21T00:57:38.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.486+0000 7f26d8c2d740 1 Processor -- start 2024-09-21T00:57:38.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.486+0000 7f26d8c2d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d5034e69f0 0x55d5038f0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:38.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.487+0000 7f26cbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d5034e69f0 0x55d5038f0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:38.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.487+0000 7f26cbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d5034e69f0 0x55d5038f0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59536/0 (socket says 172.21.15.1:59536) 2024-09-21T00:57:38.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.487+0000 7f26cbfff640 1 -- 172.21.15.1:0/1329053007 learned_addr learned my addr 172.21.15.1:0/1329053007 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:38.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.487+0000 7f26d8c2d740 1 --2- 172.21.15.1:0/1329053007 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5034ff1b0 0x55d5038f1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:38.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.487+0000 7f26d8c2d740 1 --2- 172.21.15.1:0/1329053007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d503507390 0x55d5039567a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:38.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.487+0000 7f26d8c2d740 1 -- 172.21.15.1:0/1329053007 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc1ae750 con 0x55d5034e69f0 2024-09-21T00:57:38.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.487+0000 7f26d8c2d740 1 -- 172.21.15.1:0/1329053007 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc1ae080 con 0x55d503507390 2024-09-21T00:57:38.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.487+0000 7f26d8c2d740 1 -- 172.21.15.1:0/1329053007 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc1ab2e0 con 0x55d5034ff1b0 2024-09-21T00:57:38.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.487+0000 7f26cb7fe640 1 --2- 172.21.15.1:0/1329053007 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5034ff1b0 0x55d5038f1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:38.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.487+0000 7f26d0c56640 1 --2- 172.21.15.1:0/1329053007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d503507390 0x55d5039567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:38.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.487+0000 7f26cb7fe640 1 -- 172.21.15.1:0/1329053007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d503507390 msgr2=0x55d5039567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:38.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.487+0000 7f26cb7fe640 1 --2- 172.21.15.1:0/1329053007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d503507390 0x55d5039567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:38.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.487+0000 7f26cb7fe640 1 -- 172.21.15.1:0/1329053007 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d5034e69f0 msgr2=0x55d5038f0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:38.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.487+0000 7f26cb7fe640 1 --2- 172.21.15.1:0/1329053007 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d5034e69f0 0x55d5038f0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:38.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.487+0000 7f26cb7fe640 1 -- 172.21.15.1:0/1329053007 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d503956ce0 con 0x55d5034ff1b0 2024-09-21T00:57:38.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.488+0000 7f26d8c2d740 10 client.0 _ll_register_callbacks cb 0x7f26bc00cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:38.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.488+0000 7f26cb7fe640 1 --2- 172.21.15.1:0/1329053007 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5034ff1b0 0x55d5038f1140 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f26c0004800 tx=0x7f26c0004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b646408ca37f08a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:38.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.488+0000 7f26ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T00:57:38.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.488+0000 7f26d8c2d740 1 -- 172.21.15.1:0/1329053007 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26bc0b2020 con 0x55d5034ff1b0 2024-09-21T00:57:38.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.488+0000 7f26ab7fe640 1 -- 172.21.15.1:0/1329053007 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c000b4c0 con 0x55d5034ff1b0 2024-09-21T00:57:38.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.488+0000 7f26ab7fe640 1 -- 172.21.15.1:0/1329053007 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f26c00293f0 con 0x55d5034ff1b0 2024-09-21T00:57:38.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.489+0000 7f26ab7fe640 1 -- 172.21.15.1:0/1329053007 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f26c00295f0 con 0x55d5034ff1b0 2024-09-21T00:57:38.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.489+0000 7f26d8c2d740 10 client.25225 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:38.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.489+0000 7f26d8c2d740 1 -- 172.21.15.1:0/1329053007 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55d503957d60 con 0x55d5034ff1b0 2024-09-21T00:57:38.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.489+0000 7f26ab7fe640 1 -- 172.21.15.1:0/1329053007 <== mon.1 v2:172.21.15.193:3300/0 4 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f26c0036030 con 0x55d5034ff1b0 2024-09-21T00:57:38.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.489+0000 7f26d8c2d740 10 client.25225 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:38.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.489+0000 7f26d8c2d740 10 client.25225 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T00:57:38.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.489+0000 7f26d8c2d740 20 client.25225 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:38.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.489+0000 7f26d8c2d740 1 --2- 172.21.15.1:0/1329053007 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x55d503528070 0x55d50395a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:38.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.489+0000 7f26d8c2d740 4 client.25225 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:57:38.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.489+0000 7f26d8c2d740 1 -- 172.21.15.1:0/1329053007 --> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f26bc0b2020 con 0x55d503528070 2024-09-21T00:57:38.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.490+0000 7f26cbfff640 1 --2- 172.21.15.1:0/1329053007 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x55d503528070 0x55d50395a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:38.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.490+0000 7f26ab7fe640 10 client.25225 ms_handle_connect on v2:172.21.15.193:6834/3631682268 2024-09-21T00:57:38.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.490+0000 7f26cbfff640 1 --2- 172.21.15.1:0/1329053007 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x55d503528070 0x55d50395a2c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=30a618858e901c4a server_cookie=b1155f341fe7e3dd in_seq=0 out_seq=0 2024-09-21T00:57:38.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.490+0000 7f26ab7fe640 1 -- 172.21.15.1:0/1329053007 <== mds.4 v2:172.21.15.193:6834/3631682268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f26bc0b2020 con 0x55d503528070 2024-09-21T00:57:38.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.490+0000 7f26ab7fe640 10 client.25225 handle_command_reply: tid=0 2024-09-21T00:57:38.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.490+0000 7f26d8c2d740 1 client.25225 shutdown 2024-09-21T00:57:38.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.491+0000 7f26d8c2d740 1 -- 172.21.15.1:0/1329053007 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5034ff1b0 msgr2=0x55d5038f1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:38.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.491+0000 7f26d8c2d740 1 --2- 172.21.15.1:0/1329053007 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5034ff1b0 0x55d5038f1140 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f26c0004800 tx=0x7f26c0004600 comp rx=0 tx=0).stop 2024-09-21T00:57:38.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.491+0000 7f26d8c2d740 1 -- 172.21.15.1:0/1329053007 shutdown_connections 2024-09-21T00:57:38.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.491+0000 7f26d8c2d740 1 --2- 172.21.15.1:0/1329053007 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x55d503528070 0x55d50395a2c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:38.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.491+0000 7f26d8c2d740 1 --2- 172.21.15.1:0/1329053007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d503507390 0x55d5039567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:38.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.491+0000 7f26ab7fe640 0 client.25225 ms_handle_reset on v2:172.21.15.193:6834/3631682268 2024-09-21T00:57:38.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.491+0000 7f26d8c2d740 1 --2- 172.21.15.1:0/1329053007 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5034ff1b0 0x55d5038f1140 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:38.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.491+0000 7f26d8c2d740 1 --2- 172.21.15.1:0/1329053007 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d5034e69f0 0x55d5038f0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:38.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.491+0000 7f26d8c2d740 1 -- 172.21.15.1:0/1329053007 >> 172.21.15.1:0/1329053007 conn(0x55d50351c460 msgr2=0x55d5038e0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:38.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.491+0000 7f26d8c2d740 1 -- 172.21.15.1:0/1329053007 shutdown_connections 2024-09-21T00:57:38.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.491+0000 7f26d8c2d740 1 -- 172.21.15.1:0/1329053007 wait complete. 2024-09-21T00:57:38.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.492+0000 7f26d8c2d740 20 client.25225 trim_cache size 0 max 16384 2024-09-21T00:57:38.494 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T00:57:38.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.492+0000 7f26d26b9640 1 -- 172.21.15.1:0/1821068308 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f26b40b6620 msgr2=0x7f26b40b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:38.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.492+0000 7f26d26b9640 1 --2- 172.21.15.1:0/1821068308 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f26b40b6620 0x7f26b40b8b30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f26c4009620 tx=0x7f26c4004a40 comp rx=0 tx=0).stop 2024-09-21T00:57:38.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.492+0000 7f26d26b9640 1 -- 172.21.15.1:0/1821068308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26cc103b90 msgr2=0x7f26cc19a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:38.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.493+0000 7f26d26b9640 1 --2- 172.21.15.1:0/1821068308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26cc103b90 0x7f26cc19a270 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f26bc00e9f0 tx=0x7f26bc00eeb0 comp rx=0 tx=0).stop 2024-09-21T00:57:38.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.493+0000 7f26d26b9640 1 -- 172.21.15.1:0/1821068308 shutdown_connections 2024-09-21T00:57:38.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.493+0000 7f26d26b9640 1 --2- 172.21.15.1:0/1821068308 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26cc109e20 0x7f26cc19fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:38.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.493+0000 7f26d26b9640 1 --2- 172.21.15.1:0/1821068308 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f26b40b6620 0x7f26b40b8b30 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:38.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.493+0000 7f26d26b9640 1 --2- 172.21.15.1:0/1821068308 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26cc1094d0 0x7f26cc19a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:38.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.493+0000 7f26d26b9640 1 --2- 172.21.15.1:0/1821068308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26cc103b90 0x7f26cc19a270 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:38.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.493+0000 7f26d26b9640 1 -- 172.21.15.1:0/1821068308 >> 172.21.15.1:0/1821068308 conn(0x7f26cc0ff5e0 msgr2=0x7f26cc105260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:38.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.493+0000 7f26d26b9640 1 -- 172.21.15.1:0/1821068308 shutdown_connections 2024-09-21T00:57:38.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:38.493+0000 7f26d26b9640 1 -- 172.21.15.1:0/1821068308 wait complete. 2024-09-21T00:57:39.178 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T00:57:39.455 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:39.862 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:39 smithi001 ceph-mon[31211]: pgmap v371: 97 pgs: 97 active+clean; 666 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-21T00:57:39.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:39 smithi193 ceph-mon[34660]: pgmap v371: 97 pgs: 97 active+clean; 666 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-21T00:57:39.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:39 smithi042 ceph-mon[34481]: pgmap v371: 97 pgs: 97 active+clean; 666 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-21T00:57:40.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.007+0000 7fb0ae2e9640 1 -- 172.21.15.1:0/3331370447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0a8109e00 msgr2=0x7fb0a8110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:40.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.007+0000 7fb0ae2e9640 1 --2- 172.21.15.1:0/3331370447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0a8109e00 0x7fb0a8110630 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0009ca0 tx=0x7fb0a002a8c0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.007+0000 7fb0ae2e9640 1 -- 172.21.15.1:0/3331370447 shutdown_connections 2024-09-21T00:57:40.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.007+0000 7fb0ae2e9640 1 --2- 172.21.15.1:0/3331370447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0a8109e00 0x7fb0a8110630 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.007+0000 7fb0ae2e9640 1 --2- 172.21.15.1:0/3331370447 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb0a81094b0 0x7fb0a81098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.007+0000 7fb0ae2e9640 1 --2- 172.21.15.1:0/3331370447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0a8101f70 0x7fb0a8102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.007+0000 7fb0ae2e9640 1 -- 172.21.15.1:0/3331370447 >> 172.21.15.1:0/3331370447 conn(0x7fb0a8077c60 msgr2=0x7fb0a80780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:40.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.007+0000 7fb0ae2e9640 1 -- 172.21.15.1:0/3331370447 shutdown_connections 2024-09-21T00:57:40.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.007+0000 7fb0ae2e9640 1 -- 172.21.15.1:0/3331370447 wait complete. 2024-09-21T00:57:40.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.008+0000 7fb0ae2e9640 1 Processor -- start 2024-09-21T00:57:40.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.008+0000 7fb0ae2e9640 1 -- start start 2024-09-21T00:57:40.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.009+0000 7fb0ae2e9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0a8101f70 0x7fb0a819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.009+0000 7fb0ae2e9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb0a81094b0 0x7fb0a819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.009+0000 7fb0ae2e9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0a8109e00 0x7fb0a819fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.009+0000 7fb0ae2e9640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a8113b10 con 0x7fb0a8109e00 2024-09-21T00:57:40.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.009+0000 7fb0ae2e9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a8113990 con 0x7fb0a8101f70 2024-09-21T00:57:40.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.009+0000 7fb0ae2e9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a8113c90 con 0x7fb0a81094b0 2024-09-21T00:57:40.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.009+0000 7fb0a77fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb0a81094b0 0x7fb0a819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.009+0000 7fb0a77fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb0a81094b0 0x7fb0a819aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:37708/0 (socket says 172.21.15.1:37708) 2024-09-21T00:57:40.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.009+0000 7fb0a77fe640 1 -- 172.21.15.1:0/4056989604 learned_addr learned my addr 172.21.15.1:0/4056989604 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:40.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.009+0000 7fb0ac886640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0a8109e00 0x7fb0a819fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.009+0000 7fb0a7fff640 1 --2- 172.21.15.1:0/4056989604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0a8101f70 0x7fb0a819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.009+0000 7fb0a77fe640 1 -- 172.21.15.1:0/4056989604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0a8101f70 msgr2=0x7fb0a819a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:40.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.009+0000 7fb0a77fe640 1 --2- 172.21.15.1:0/4056989604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0a8101f70 0x7fb0a819a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.009+0000 7fb0a77fe640 1 -- 172.21.15.1:0/4056989604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0a8109e00 msgr2=0x7fb0a819fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:40.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.010+0000 7fb0a77fe640 1 --2- 172.21.15.1:0/4056989604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0a8109e00 0x7fb0a819fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.010+0000 7fb0a77fe640 1 -- 172.21.15.1:0/4056989604 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a81a03f0 con 0x7fb0a81094b0 2024-09-21T00:57:40.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.010+0000 7fb0ac886640 1 --2- 172.21.15.1:0/4056989604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0a8109e00 0x7fb0a819fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:57:40.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.010+0000 7fb0a77fe640 1 --2- 172.21.15.1:0/4056989604 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb0a81094b0 0x7fb0a819aa20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb09c00e9c0 tx=0x7fb09c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:40.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.010+0000 7fb0a57fa640 1 -- 172.21.15.1:0/4056989604 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09c00ccc0 con 0x7fb0a81094b0 2024-09-21T00:57:40.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.010+0000 7fb0a57fa640 1 -- 172.21.15.1:0/4056989604 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb09c0054d0 con 0x7fb0a81094b0 2024-09-21T00:57:40.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.010+0000 7fb0a57fa640 1 -- 172.21.15.1:0/4056989604 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09c010430 con 0x7fb0a81094b0 2024-09-21T00:57:40.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.010+0000 7fb0ae2e9640 1 -- 172.21.15.1:0/4056989604 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0a81a06e0 con 0x7fb0a81094b0 2024-09-21T00:57:40.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.011+0000 7fb0ae2e9640 1 -- 172.21.15.1:0/4056989604 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0a81a6e40 con 0x7fb0a81094b0 2024-09-21T00:57:40.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.014+0000 7fb0b485d740 1 Processor -- start 2024-09-21T00:57:40.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.015+0000 7fb0b485d740 1 -- start start 2024-09-21T00:57:40.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.015+0000 7fb0a57fa640 1 -- 172.21.15.1:0/4056989604 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 19) ==== 154562+0+0 (secure 0 0 0) 0x7fb09c0046c0 con 0x7fb0a81094b0 2024-09-21T00:57:40.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.015+0000 7fb0b485d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645a5e2e070 0x5645a61d52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.015+0000 7fb0b485d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645a5e051b0 0x5645a61d5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.015+0000 7fb0b485d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645a5e0d390 0x5645a61d5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.015+0000 7fb0b485d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5645a614bea0 con 0x5645a5e0d390 2024-09-21T00:57:40.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.015+0000 7fb0b485d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5645a613b2d0 con 0x5645a5e051b0 2024-09-21T00:57:40.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.015+0000 7fb0b485d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5645a613f0e0 con 0x5645a5e2e070 2024-09-21T00:57:40.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.015+0000 7fb0a77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645a5e0d390 0x5645a61d5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.015+0000 7fb0a77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645a5e0d390 0x5645a61d5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32778/0 (socket says 172.21.15.1:32778) 2024-09-21T00:57:40.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.015+0000 7fb0a77fe640 1 -- 172.21.15.1:0/3179187979 learned_addr learned my addr 172.21.15.1:0/3179187979 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:40.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.015+0000 7fb0ac886640 1 --2- 172.21.15.1:0/3179187979 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645a5e2e070 0x5645a61d52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.016+0000 7fb0a7fff640 1 --2- 172.21.15.1:0/3179187979 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645a5e051b0 0x5645a61d5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.016+0000 7fb0a77fe640 1 -- 172.21.15.1:0/3179187979 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645a5e2e070 msgr2=0x5645a61d52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:40.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.016+0000 7fb0a77fe640 1 --2- 172.21.15.1:0/3179187979 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645a5e2e070 0x5645a61d52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.016+0000 7fb0a77fe640 1 -- 172.21.15.1:0/3179187979 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645a5e051b0 msgr2=0x5645a61d5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:40.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.016+0000 7fb0a77fe640 1 --2- 172.21.15.1:0/3179187979 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645a5e051b0 0x5645a61d5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.016+0000 7fb0a77fe640 1 -- 172.21.15.1:0/3179187979 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645a5e99650 con 0x5645a5e0d390 2024-09-21T00:57:40.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.016+0000 7fb0a77fe640 1 --2- 172.21.15.1:0/3179187979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645a5e0d390 0x5645a61d5d40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0eda60 tx=0x7fb09c0edb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40886cb377104d88 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:40.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.017+0000 7fb0a57fa640 1 --2- 172.21.15.1:0/4056989604 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb0900b66a0 0x7fb0900b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.017+0000 7fb0a57fa640 1 -- 172.21.15.1:0/4056989604 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fb09c0e7970 con 0x7fb0a81094b0 2024-09-21T00:57:40.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.017+0000 7fb0ac886640 1 --2- 172.21.15.1:0/4056989604 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb0900b66a0 0x7fb0900b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.017+0000 7fb08e7fc640 1 -- 172.21.15.1:0/3179187979 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09c0f6070 con 0x5645a5e0d390 2024-09-21T00:57:40.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.018+0000 7fb08e7fc640 1 -- 172.21.15.1:0/3179187979 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb09c005680 con 0x5645a5e0d390 2024-09-21T00:57:40.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.018+0000 7fb08e7fc640 1 -- 172.21.15.1:0/3179187979 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09c0ad270 con 0x5645a5e0d390 2024-09-21T00:57:40.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.019+0000 7fb0b485d740 1 -- 172.21.15.1:0/3179187979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645a5e0d390 msgr2=0x5645a61d5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:40.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.019+0000 7fb0ac886640 1 --2- 172.21.15.1:0/4056989604 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb0900b66a0 0x7fb0900b8bb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0006010 tx=0x7fb0a002f3f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:40.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.019+0000 7fb0b485d740 1 --2- 172.21.15.1:0/3179187979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645a5e0d390 0x5645a61d5d40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0eda60 tx=0x7fb09c0edb50 comp rx=0 tx=0).stop 2024-09-21T00:57:40.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.019+0000 7fb0b485d740 1 -- 172.21.15.1:0/3179187979 shutdown_connections 2024-09-21T00:57:40.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.019+0000 7fb0b485d740 1 --2- 172.21.15.1:0/3179187979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645a5e0d390 0x5645a61d5d40 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.019+0000 7fb0b485d740 1 --2- 172.21.15.1:0/3179187979 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645a5e051b0 0x5645a61d5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.019+0000 7fb0b485d740 1 --2- 172.21.15.1:0/3179187979 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645a5e2e070 0x5645a61d52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.019+0000 7fb0b485d740 1 -- 172.21.15.1:0/3179187979 >> 172.21.15.1:0/3179187979 conn(0x5645a5e22460 msgr2=0x5645a61d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:40.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.019+0000 7fb0b485d740 1 -- 172.21.15.1:0/3179187979 shutdown_connections 2024-09-21T00:57:40.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.019+0000 7fb0b485d740 1 -- 172.21.15.1:0/3179187979 wait complete. 2024-09-21T00:57:40.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.020+0000 7fb0b485d740 1 -- start start 2024-09-21T00:57:40.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.020+0000 7fb0b485d740 1 Processor -- start 2024-09-21T00:57:40.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.020+0000 7fb0b485d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645a5e051b0 0x5645a61e09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.021+0000 7fb0b485d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645a5e0d390 0x5645a61e0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.021+0000 7fb0b485d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645a5e2e070 0x5645a61f11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.021+0000 7fb0b485d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5645a5f9c700 con 0x5645a5e2e070 2024-09-21T00:57:40.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.021+0000 7fb0b485d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5645a60d6160 con 0x5645a5e051b0 2024-09-21T00:57:40.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.021+0000 7fb0a7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645a5e051b0 0x5645a61e09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.021+0000 7fb0a7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645a5e051b0 0x5645a61e09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:42134/0 (socket says 172.21.15.1:42134) 2024-09-21T00:57:40.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.021+0000 7fb0a7fff640 1 -- 172.21.15.1:0/1888095518 learned_addr learned my addr 172.21.15.1:0/1888095518 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:40.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.021+0000 7fb0b485d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5645a61e7eb0 con 0x5645a5e0d390 2024-09-21T00:57:40.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.021+0000 7fb0a77fe640 1 --2- 172.21.15.1:0/1888095518 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645a5e0d390 0x5645a61e0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.021+0000 7fb0b485d740 10 client.0 _ll_register_callbacks cb 0x5645a60ef9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:40.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.021+0000 7fb0ac886640 1 --2- 172.21.15.1:0/1888095518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645a5e2e070 0x5645a61f11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.021+0000 7fb0a7fff640 1 -- 172.21.15.1:0/1888095518 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645a5e0d390 msgr2=0x5645a61e0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:40.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.021+0000 7fb0a7fff640 1 --2- 172.21.15.1:0/1888095518 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645a5e0d390 0x5645a61e0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.021+0000 7fb0a7fff640 1 -- 172.21.15.1:0/1888095518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645a5e2e070 msgr2=0x5645a61f11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:40.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.021+0000 7fb0a7fff640 1 --2- 172.21.15.1:0/1888095518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645a5e2e070 0x5645a61f11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.021+0000 7fb0a7fff640 1 -- 172.21.15.1:0/1888095518 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645a6103c90 con 0x5645a5e051b0 2024-09-21T00:57:40.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.021+0000 7fb0ac886640 1 --2- 172.21.15.1:0/1888095518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645a5e2e070 0x5645a61f11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:57:40.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.022+0000 7fb0a7fff640 1 --2- 172.21.15.1:0/1888095518 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645a5e051b0 0x5645a61e09d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb098012440 tx=0x7fb098012900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=580de81211c7ac1f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:40.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.022+0000 7fb0877fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T00:57:40.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.022+0000 7fb0877fe640 1 -- 172.21.15.1:0/1888095518 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb098010900 con 0x5645a5e051b0 2024-09-21T00:57:40.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.022+0000 7fb0877fe640 1 -- 172.21.15.1:0/1888095518 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fb098010aa0 con 0x5645a5e051b0 2024-09-21T00:57:40.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.022+0000 7fb0b485d740 1 -- 172.21.15.1:0/1888095518 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb09c005680 con 0x5645a5e051b0 2024-09-21T00:57:40.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.022+0000 7fb0877fe640 1 -- 172.21.15.1:0/1888095518 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb098010ca0 con 0x5645a5e051b0 2024-09-21T00:57:40.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.022+0000 7fb0b485d740 10 client.25280 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:40.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.022+0000 7fb0b485d740 1 -- 172.21.15.1:0/1888095518 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5645a61e5340 con 0x5645a5e051b0 2024-09-21T00:57:40.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.023+0000 7fb0877fe640 1 -- 172.21.15.1:0/1888095518 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb098010e40 con 0x5645a5e051b0 2024-09-21T00:57:40.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.023+0000 7fb0877fe640 1 -- 172.21.15.1:0/1888095518 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fb09800f040 con 0x5645a5e051b0 2024-09-21T00:57:40.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.024+0000 7fb0b485d740 10 client.25280 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:40.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.024+0000 7fb0b485d740 10 client.25280 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-21T00:57:40.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.024+0000 7fb0b485d740 20 client.25280 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:40.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.024+0000 7fb0b485d740 1 --2- 172.21.15.1:0/1888095518 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x5645a5dec9f0 0x5645a61e67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.024+0000 7fb0b485d740 4 client.25280 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:57:40.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.024+0000 7fb0b485d740 1 -- 172.21.15.1:0/1888095518 --> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb09c005680 con 0x5645a5dec9f0 2024-09-21T00:57:40.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.025+0000 7fb0a77fe640 1 --2- 172.21.15.1:0/1888095518 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x5645a5dec9f0 0x5645a61e67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.025+0000 7fb0877fe640 10 client.25280 ms_handle_connect on v2:172.21.15.193:6836/909252228 2024-09-21T00:57:40.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.025+0000 7fb0a77fe640 1 --2- 172.21.15.1:0/1888095518 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x5645a5dec9f0 0x5645a61e67b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7d865bde89db32d1 server_cookie=d8a0b7bedc7f48e8 in_seq=0 out_seq=0 2024-09-21T00:57:40.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.026+0000 7fb0877fe640 1 -- 172.21.15.1:0/1888095518 <== mds.3 v2:172.21.15.193:6836/909252228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fb09c005680 con 0x5645a5dec9f0 2024-09-21T00:57:40.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.026+0000 7fb0877fe640 10 client.25280 handle_command_reply: tid=0 2024-09-21T00:57:40.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.026+0000 7fb0b485d740 1 client.25280 shutdown 2024-09-21T00:57:40.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.026+0000 7fb0b485d740 1 -- 172.21.15.1:0/1888095518 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645a5e051b0 msgr2=0x5645a61e09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:40.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.026+0000 7fb0b485d740 1 --2- 172.21.15.1:0/1888095518 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645a5e051b0 0x5645a61e09d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb098012440 tx=0x7fb098012900 comp rx=0 tx=0).stop 2024-09-21T00:57:40.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.027+0000 7fb0b485d740 1 -- 172.21.15.1:0/1888095518 shutdown_connections 2024-09-21T00:57:40.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.027+0000 7fb0b485d740 1 --2- 172.21.15.1:0/1888095518 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x5645a5dec9f0 0x5645a61e67b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.027+0000 7fb0b485d740 1 --2- 172.21.15.1:0/1888095518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645a5e2e070 0x5645a61f11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.027+0000 7fb0b485d740 1 --2- 172.21.15.1:0/1888095518 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645a5e0d390 0x5645a61e0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.027+0000 7fb0877fe640 0 client.25280 ms_handle_reset on v2:172.21.15.193:6836/909252228 2024-09-21T00:57:40.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.027+0000 7fb0b485d740 1 --2- 172.21.15.1:0/1888095518 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645a5e051b0 0x5645a61e09d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.027+0000 7fb0b485d740 1 -- 172.21.15.1:0/1888095518 >> 172.21.15.1:0/1888095518 conn(0x5645a5e22460 msgr2=0x5645a61d62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:40.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.027+0000 7fb0b485d740 1 -- 172.21.15.1:0/1888095518 shutdown_connections 2024-09-21T00:57:40.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.027+0000 7fb0b485d740 1 -- 172.21.15.1:0/1888095518 wait complete. 2024-09-21T00:57:40.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.027+0000 7fb0b485d740 20 client.25280 trim_cache size 0 max 16384 2024-09-21T00:57:40.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.054+0000 7fb0b485d740 1 Processor -- start 2024-09-21T00:57:40.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.054+0000 7fb0b485d740 1 -- start start 2024-09-21T00:57:40.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.054+0000 7fb0b485d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645a5e051b0 0x5645a61d6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.054+0000 7fb0b485d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645a5e0d390 0x5645a61e0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.054+0000 7fb0b485d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645a5e2e070 0x5645a61e0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.054+0000 7fb0b485d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a81ad300 con 0x5645a5e051b0 2024-09-21T00:57:40.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.054+0000 7fb0b485d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a81aee40 con 0x5645a5e2e070 2024-09-21T00:57:40.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.054+0000 7fb0b485d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a81ad9d0 con 0x5645a5e0d390 2024-09-21T00:57:40.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.054+0000 7fb0a7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645a5e051b0 0x5645a61d6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.054+0000 7fb0a7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645a5e051b0 0x5645a61d6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32794/0 (socket says 172.21.15.1:32794) 2024-09-21T00:57:40.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.055+0000 7fb0a7fff640 1 -- 172.21.15.1:0/3795647820 learned_addr learned my addr 172.21.15.1:0/3795647820 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:40.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.055+0000 7fb0a77fe640 1 --2- 172.21.15.1:0/3795647820 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645a5e0d390 0x5645a61e0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.055+0000 7fb0a77fe640 1 -- 172.21.15.1:0/3795647820 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645a5e2e070 msgr2=0x5645a61e0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:40.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.055+0000 7fb0a77fe640 1 --2- 172.21.15.1:0/3795647820 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645a5e2e070 0x5645a61e0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.055+0000 7fb0a77fe640 1 -- 172.21.15.1:0/3795647820 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645a5e051b0 msgr2=0x5645a61d6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:40.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.055+0000 7fb0a77fe640 1 --2- 172.21.15.1:0/3795647820 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645a5e051b0 0x5645a61d6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.055+0000 7fb0a77fe640 1 -- 172.21.15.1:0/3795647820 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645a61ce5d0 con 0x5645a5e0d390 2024-09-21T00:57:40.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.055+0000 7fb0a77fe640 1 --2- 172.21.15.1:0/3795647820 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645a5e0d390 0x5645a61e0780 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0eda60 tx=0x7fb09c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9f77eb3a7642c1a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:40.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.056+0000 7fb08dffb640 1 -- 172.21.15.1:0/3795647820 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09c0f6070 con 0x5645a5e0d390 2024-09-21T00:57:40.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.056+0000 7fb08dffb640 1 -- 172.21.15.1:0/3795647820 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb09c0ad430 con 0x5645a5e0d390 2024-09-21T00:57:40.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.056+0000 7fb08dffb640 1 -- 172.21.15.1:0/3795647820 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09c00ce60 con 0x5645a5e0d390 2024-09-21T00:57:40.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.057+0000 7fb0b485d740 1 -- 172.21.15.1:0/3795647820 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645a5e0d390 msgr2=0x5645a61e0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:40.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.057+0000 7fb0b485d740 1 --2- 172.21.15.1:0/3795647820 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645a5e0d390 0x5645a61e0780 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0eda60 tx=0x7fb09c009780 comp rx=0 tx=0).stop 2024-09-21T00:57:40.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.057+0000 7fb0b485d740 1 -- 172.21.15.1:0/3795647820 shutdown_connections 2024-09-21T00:57:40.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.057+0000 7fb0b485d740 1 --2- 172.21.15.1:0/3795647820 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645a5e2e070 0x5645a61e0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.057+0000 7fb0b485d740 1 --2- 172.21.15.1:0/3795647820 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645a5e0d390 0x5645a61e0780 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.057+0000 7fb0b485d740 1 --2- 172.21.15.1:0/3795647820 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645a5e051b0 0x5645a61d6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.057+0000 7fb0b485d740 1 -- 172.21.15.1:0/3795647820 >> 172.21.15.1:0/3795647820 conn(0x5645a5e22460 msgr2=0x5645a61d62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:40.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.057+0000 7fb0b485d740 1 -- 172.21.15.1:0/3795647820 shutdown_connections 2024-09-21T00:57:40.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.057+0000 7fb0b485d740 1 -- 172.21.15.1:0/3795647820 wait complete. 2024-09-21T00:57:40.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.058+0000 7fb0b485d740 1 -- start start 2024-09-21T00:57:40.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.058+0000 7fb0b485d740 1 Processor -- start 2024-09-21T00:57:40.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.058+0000 7fb0b485d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645a5e051b0 0x5645a6201d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.059+0000 7fb0b485d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645a5e0d390 0x5645a61ff210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.059+0000 7fb0b485d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645a5e2e070 0x5645a61ff750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.059+0000 7fb0b485d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a81ae770 con 0x5645a5e0d390 2024-09-21T00:57:40.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.059+0000 7fb0b485d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a81ae0a0 con 0x5645a5e2e070 2024-09-21T00:57:40.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.059+0000 7fb0b485d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a81ab2e0 con 0x5645a5e051b0 2024-09-21T00:57:40.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.059+0000 7fb0a77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645a5e0d390 0x5645a61ff210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.059+0000 7fb0b485d740 10 client.0 _ll_register_callbacks cb 0x7fb098009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:40.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.059+0000 7fb0a77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645a5e0d390 0x5645a61ff210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32808/0 (socket says 172.21.15.1:32808) 2024-09-21T00:57:40.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.059+0000 7fb0a77fe640 1 -- 172.21.15.1:0/398117852 learned_addr learned my addr 172.21.15.1:0/398117852 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:40.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.059+0000 7fb0ac886640 1 --2- 172.21.15.1:0/398117852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645a5e2e070 0x5645a61ff750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.059+0000 7fb0a7fff640 1 --2- 172.21.15.1:0/398117852 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645a5e051b0 0x5645a6201d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.059+0000 7fb0a77fe640 1 -- 172.21.15.1:0/398117852 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645a5e051b0 msgr2=0x5645a6201d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:40.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.059+0000 7fb0a77fe640 1 --2- 172.21.15.1:0/398117852 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645a5e051b0 0x5645a6201d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.059+0000 7fb0a77fe640 1 -- 172.21.15.1:0/398117852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645a5e2e070 msgr2=0x5645a61ff750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:40.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.059+0000 7fb0a77fe640 1 --2- 172.21.15.1:0/398117852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645a5e2e070 0x5645a61ff750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.059+0000 7fb0a77fe640 1 -- 172.21.15.1:0/398117852 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645a61ffc90 con 0x5645a5e0d390 2024-09-21T00:57:40.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.059+0000 7fb0ac886640 1 --2- 172.21.15.1:0/398117852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645a5e2e070 0x5645a61ff750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:40.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.060+0000 7fb0a77fe640 1 --2- 172.21.15.1:0/398117852 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645a5e0d390 0x5645a61ff210 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0ef670 tx=0x7fb09c0ef720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c798b7fcd84dfcd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:40.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.060+0000 7fb0877fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:57:40.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.060+0000 7fb0877fe640 1 -- 172.21.15.1:0/398117852 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09c0f6070 con 0x5645a5e0d390 2024-09-21T00:57:40.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.060+0000 7fb0877fe640 1 -- 172.21.15.1:0/398117852 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fb09c0a9b90 con 0x5645a5e0d390 2024-09-21T00:57:40.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.060+0000 7fb0b485d740 1 -- 172.21.15.1:0/398117852 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb09c0ad430 con 0x5645a5e0d390 2024-09-21T00:57:40.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.060+0000 7fb0877fe640 1 -- 172.21.15.1:0/398117852 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb09c0ad090 con 0x5645a5e0d390 2024-09-21T00:57:40.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.060+0000 7fb0b485d740 10 client.15600 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:40.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.060+0000 7fb0b485d740 1 -- 172.21.15.1:0/398117852 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5645a62666c0 con 0x5645a5e0d390 2024-09-21T00:57:40.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.061+0000 7fb0877fe640 1 -- 172.21.15.1:0/398117852 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb09c005680 con 0x5645a5e0d390 2024-09-21T00:57:40.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.062+0000 7fb0877fe640 1 -- 172.21.15.1:0/398117852 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fb09c016330 con 0x5645a5e0d390 2024-09-21T00:57:40.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.062+0000 7fb0b485d740 10 client.15600 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:40.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.062+0000 7fb0b485d740 10 client.15600 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-21T00:57:40.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.062+0000 7fb0b485d740 20 client.15600 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:40.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.062+0000 7fb0b485d740 1 --2- 172.21.15.1:0/398117852 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x5645a5dc1da0 0x5645a6268900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.062+0000 7fb0b485d740 4 client.15600 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:57:40.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.062+0000 7fb0b485d740 1 -- 172.21.15.1:0/398117852 --> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fb09c0ad430 con 0x5645a5dc1da0 2024-09-21T00:57:40.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.063+0000 7fb0a7fff640 1 --2- 172.21.15.1:0/398117852 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x5645a5dc1da0 0x5645a6268900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.063+0000 7fb0a7fff640 1 --2- 172.21.15.1:0/398117852 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x5645a5dc1da0 0x5645a6268900 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d80c0c0d1da990db server_cookie=5c7ed94325d9bd7d in_seq=0 out_seq=0 2024-09-21T00:57:40.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.063+0000 7fb0877fe640 10 client.15600 ms_handle_connect on v2:172.21.15.193:6836/909252228 2024-09-21T00:57:40.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.063+0000 7fb0877fe640 1 -- 172.21.15.1:0/398117852 <== mds.3 v2:172.21.15.193:6836/909252228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fb09c0ad430 con 0x5645a5dc1da0 2024-09-21T00:57:40.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.063+0000 7fb0877fe640 10 client.15600 handle_command_reply: tid=0 2024-09-21T00:57:40.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.063+0000 7fb0b485d740 1 client.15600 shutdown 2024-09-21T00:57:40.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.064+0000 7fb0b485d740 1 -- 172.21.15.1:0/398117852 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645a5e0d390 msgr2=0x5645a61ff210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:40.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.064+0000 7fb0b485d740 1 --2- 172.21.15.1:0/398117852 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645a5e0d390 0x5645a61ff210 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0ef670 tx=0x7fb09c0ef720 comp rx=0 tx=0).stop 2024-09-21T00:57:40.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.064+0000 7fb0b485d740 1 -- 172.21.15.1:0/398117852 shutdown_connections 2024-09-21T00:57:40.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.064+0000 7fb0b485d740 1 --2- 172.21.15.1:0/398117852 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x5645a5dc1da0 0x5645a6268900 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.064+0000 7fb0b485d740 1 --2- 172.21.15.1:0/398117852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645a5e2e070 0x5645a61ff750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.064+0000 7fb0b485d740 1 --2- 172.21.15.1:0/398117852 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645a5e0d390 0x5645a61ff210 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.064+0000 7fb0b485d740 1 --2- 172.21.15.1:0/398117852 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645a5e051b0 0x5645a6201d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.064+0000 7fb0b485d740 1 -- 172.21.15.1:0/398117852 >> 172.21.15.1:0/398117852 conn(0x5645a5e22460 msgr2=0x5645a61e0780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:40.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.064+0000 7fb0877fe640 0 client.15600 ms_handle_reset on v2:172.21.15.193:6836/909252228 2024-09-21T00:57:40.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.064+0000 7fb0b485d740 1 -- 172.21.15.1:0/398117852 shutdown_connections 2024-09-21T00:57:40.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.065+0000 7fb0b485d740 1 -- 172.21.15.1:0/398117852 wait complete. 2024-09-21T00:57:40.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.065+0000 7fb0b485d740 20 client.15600 trim_cache size 0 max 16384 2024-09-21T00:57:40.066 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T00:57:40.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.065+0000 7fb0ae2e9640 1 -- 172.21.15.1:0/4056989604 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb0900b66a0 msgr2=0x7fb0900b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:40.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.065+0000 7fb0ae2e9640 1 --2- 172.21.15.1:0/4056989604 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb0900b66a0 0x7fb0900b8bb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0006010 tx=0x7fb0a002f3f0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.065+0000 7fb0ae2e9640 1 -- 172.21.15.1:0/4056989604 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb0a81094b0 msgr2=0x7fb0a819aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:40.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.065+0000 7fb0ae2e9640 1 --2- 172.21.15.1:0/4056989604 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb0a81094b0 0x7fb0a819aa20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb09c00e9c0 tx=0x7fb09c00ee80 comp rx=0 tx=0).stop 2024-09-21T00:57:40.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.066+0000 7fb0ae2e9640 1 -- 172.21.15.1:0/4056989604 shutdown_connections 2024-09-21T00:57:40.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.066+0000 7fb0ae2e9640 1 --2- 172.21.15.1:0/4056989604 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb0900b66a0 0x7fb0900b8bb0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.066+0000 7fb0ae2e9640 1 --2- 172.21.15.1:0/4056989604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0a8109e00 0x7fb0a819fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.066+0000 7fb0ae2e9640 1 --2- 172.21.15.1:0/4056989604 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb0a81094b0 0x7fb0a819aa20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.066+0000 7fb0ae2e9640 1 --2- 172.21.15.1:0/4056989604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0a8101f70 0x7fb0a819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.066+0000 7fb0ae2e9640 1 -- 172.21.15.1:0/4056989604 >> 172.21.15.1:0/4056989604 conn(0x7fb0a8077c60 msgr2=0x7fb0a81074a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:40.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.066+0000 7fb0ae2e9640 1 -- 172.21.15.1:0/4056989604 shutdown_connections 2024-09-21T00:57:40.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:40.066+0000 7fb0ae2e9640 1 -- 172.21.15.1:0/4056989604 wait complete. 2024-09-21T00:57:40.337 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.336+0000 7f234bea2640 1 -- 172.21.15.1:0/3627395148 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2344103640 msgr2=0x7f2344103a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:40.337 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.336+0000 7f234bea2640 1 --2- 172.21.15.1:0/3627395148 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2344103640 0x7f2344103a50 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2334009900 tx=0x7f233402a3f0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.337 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.336+0000 7f234bea2640 1 -- 172.21.15.1:0/3627395148 shutdown_connections 2024-09-21T00:57:40.337 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.336+0000 7f234bea2640 1 --2- 172.21.15.1:0/3627395148 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2344103fe0 0x7f234410a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.337 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.336+0000 7f234bea2640 1 --2- 172.21.15.1:0/3627395148 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2344103640 0x7f2344103a50 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.337 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.336+0000 7f234bea2640 1 --2- 172.21.15.1:0/3627395148 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f23441025c0 0x7f2344102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.337 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.336+0000 7f234bea2640 1 -- 172.21.15.1:0/3627395148 >> 172.21.15.1:0/3627395148 conn(0x7f23440fdf00 msgr2=0x7f23441003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:40.338 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.336+0000 7f234bea2640 1 -- 172.21.15.1:0/3627395148 shutdown_connections 2024-09-21T00:57:40.338 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.336+0000 7f234bea2640 1 -- 172.21.15.1:0/3627395148 wait complete. 2024-09-21T00:57:40.339 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.337+0000 7f234bea2640 1 Processor -- start 2024-09-21T00:57:40.339 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.337+0000 7f234bea2640 1 -- start start 2024-09-21T00:57:40.339 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.337+0000 7f234bea2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23441025c0 0x7f234406b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.337+0000 7f234bea2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2344103640 0x7f234419ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.337+0000 7f234bea2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2344103fe0 0x7f23441a11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.337+0000 7f234943d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2344103640 0x7f234419ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.337+0000 7f234943d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2344103640 0x7f234419ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32830/0 (socket says 172.21.15.1:32830) 2024-09-21T00:57:40.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.338+0000 7f234943d640 1 -- 172.21.15.1:0/304571370 learned_addr learned my addr 172.21.15.1:0/304571370 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:40.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.338+0000 7f234bea2640 1 -- 172.21.15.1:0/304571370 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f234410e1f0 con 0x7f2344103640 2024-09-21T00:57:40.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.338+0000 7f234bea2640 1 -- 172.21.15.1:0/304571370 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f234410e070 con 0x7f23441025c0 2024-09-21T00:57:40.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.338+0000 7f234bea2640 1 -- 172.21.15.1:0/304571370 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f234410e370 con 0x7f2344103fe0 2024-09-21T00:57:40.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.338+0000 7f2349c3e640 1 --2- 172.21.15.1:0/304571370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23441025c0 0x7f234406b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.338+0000 7f234a43f640 1 --2- 172.21.15.1:0/304571370 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2344103fe0 0x7f23441a11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.338+0000 7f234943d640 1 -- 172.21.15.1:0/304571370 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2344103fe0 msgr2=0x7f23441a11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:40.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.338+0000 7f234943d640 1 --2- 172.21.15.1:0/304571370 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2344103fe0 0x7f23441a11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.338+0000 7f234943d640 1 -- 172.21.15.1:0/304571370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23441025c0 msgr2=0x7f234406b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:40.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.338+0000 7f234943d640 1 --2- 172.21.15.1:0/304571370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23441025c0 0x7f234406b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.338+0000 7f234943d640 1 -- 172.21.15.1:0/304571370 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2344198a60 con 0x7f2344103640 2024-09-21T00:57:40.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.338+0000 7f234943d640 1 --2- 172.21.15.1:0/304571370 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2344103640 0x7f234419ec90 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2334006010 tx=0x7f2334004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:40.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.339+0000 7f233affd640 1 -- 172.21.15.1:0/304571370 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233403f030 con 0x7f2344103640 2024-09-21T00:57:40.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.339+0000 7f234bea2640 1 -- 172.21.15.1:0/304571370 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2344198cf0 con 0x7f2344103640 2024-09-21T00:57:40.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.339+0000 7f234bea2640 1 -- 172.21.15.1:0/304571370 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2344199230 con 0x7f2344103640 2024-09-21T00:57:40.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.339+0000 7f233affd640 1 -- 172.21.15.1:0/304571370 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2334003cb0 con 0x7f2344103640 2024-09-21T00:57:40.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.339+0000 7f233affd640 1 -- 172.21.15.1:0/304571370 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2334035070 con 0x7f2344103640 2024-09-21T00:57:40.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.342+0000 7f2352e15740 1 Processor -- start 2024-09-21T00:57:40.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.343+0000 7f2352e15740 1 -- start start 2024-09-21T00:57:40.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.343+0000 7f2352e15740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b046f51b0 0x560b04a9ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.343+0000 7f2352e15740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560b046cc2f0 0x560b04a9d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.343+0000 7f2352e15740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560b046d44d0 0x560b04a9e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.343+0000 7f2352e15740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560b04a0f6f0 con 0x560b046d44d0 2024-09-21T00:57:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.343+0000 7f2352e15740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560b049feb20 con 0x560b046cc2f0 2024-09-21T00:57:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.343+0000 7f2352e15740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560b04a02930 con 0x560b046f51b0 2024-09-21T00:57:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.344+0000 7f234a43f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b046f51b0 0x560b04a9ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.344+0000 7f234a43f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b046f51b0 0x560b04a9ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:37762/0 (socket says 172.21.15.1:37762) 2024-09-21T00:57:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.344+0000 7f234a43f640 1 -- 172.21.15.1:0/2026667355 learned_addr learned my addr 172.21.15.1:0/2026667355 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.344+0000 7f2349c3e640 1 --2- 172.21.15.1:0/2026667355 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560b046cc2f0 0x560b04a9d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.344+0000 7f233affd640 1 -- 172.21.15.1:0/304571370 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 154562+0+0 (secure 0 0 0) 0x7f2334042030 con 0x7f2344103640 2024-09-21T00:57:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.344+0000 7f234a43f640 1 -- 172.21.15.1:0/2026667355 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560b046cc2f0 msgr2=0x560b04a9d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.344+0000 7f234a43f640 1 --2- 172.21.15.1:0/2026667355 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560b046cc2f0 0x560b04a9d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.344+0000 7f234a43f640 1 -- 172.21.15.1:0/2026667355 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560b046d44d0 msgr2=0x560b04a9e010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T00:57:40.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.344+0000 7f234943d640 1 --2- 172.21.15.1:0/2026667355 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560b046d44d0 0x560b04a9e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.344+0000 7f234a43f640 1 --2- 172.21.15.1:0/2026667355 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560b046d44d0 0x560b04a9e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.344+0000 7f234a43f640 1 -- 172.21.15.1:0/2026667355 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b049c4530 con 0x560b046f51b0 2024-09-21T00:57:40.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.345+0000 7f233affd640 1 --2- 172.21.15.1:0/304571370 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f23300b6620 0x7f23300b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.345+0000 7f234a43f640 1 --2- 172.21.15.1:0/2026667355 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b046f51b0 0x560b04a9ce50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f233c009b30 tx=0x7f233c003970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d2de4846b343b62 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:40.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.346+0000 7f233affd640 1 -- 172.21.15.1:0/304571370 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f2334107b90 con 0x7f2344103640 2024-09-21T00:57:40.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.346+0000 7f2349c3e640 1 --2- 172.21.15.1:0/304571370 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f23300b6620 0x7f23300b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.346+0000 7f232ffff640 1 -- 172.21.15.1:0/2026667355 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233c0041e0 con 0x560b046f51b0 2024-09-21T00:57:40.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.346+0000 7f232ffff640 1 -- 172.21.15.1:0/2026667355 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f233c004830 con 0x560b046f51b0 2024-09-21T00:57:40.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.346+0000 7f232ffff640 1 -- 172.21.15.1:0/2026667355 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233c01e370 con 0x560b046f51b0 2024-09-21T00:57:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.347+0000 7f2352e15740 1 -- 172.21.15.1:0/2026667355 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b046f51b0 msgr2=0x560b04a9ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.347+0000 7f2352e15740 1 --2- 172.21.15.1:0/2026667355 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b046f51b0 0x560b04a9ce50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f233c009b30 tx=0x7f233c003970 comp rx=0 tx=0).stop 2024-09-21T00:57:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.347+0000 7f2349c3e640 1 --2- 172.21.15.1:0/304571370 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f23300b6620 0x7f23300b8b30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2340004610 tx=0x7f234000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.348+0000 7f2352e15740 1 -- 172.21.15.1:0/2026667355 shutdown_connections 2024-09-21T00:57:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.348+0000 7f2352e15740 1 --2- 172.21.15.1:0/2026667355 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560b046d44d0 0x560b04a9e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.348+0000 7f2352e15740 1 --2- 172.21.15.1:0/2026667355 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560b046cc2f0 0x560b04a9d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.348+0000 7f2352e15740 1 --2- 172.21.15.1:0/2026667355 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b046f51b0 0x560b04a9ce50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.348+0000 7f2352e15740 1 -- 172.21.15.1:0/2026667355 >> 172.21.15.1:0/2026667355 conn(0x560b046e9300 msgr2=0x560b04a988e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.348+0000 7f2352e15740 1 -- 172.21.15.1:0/2026667355 shutdown_connections 2024-09-21T00:57:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.348+0000 7f2352e15740 1 -- 172.21.15.1:0/2026667355 wait complete. 2024-09-21T00:57:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.348+0000 7f2352e15740 1 -- start start 2024-09-21T00:57:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.349+0000 7f2352e15740 1 Processor -- start 2024-09-21T00:57:40.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.350+0000 7f2352e15740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560b046cc2f0 0x560b04aa65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.350+0000 7f2352e15740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560b046d44d0 0x560b04aa6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.350+0000 7f2352e15740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b046f51b0 0x560b04aa7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.350+0000 7f2352e15740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560b04936ab0 con 0x560b046cc2f0 2024-09-21T00:57:40.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.350+0000 7f2349c3e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560b046cc2f0 0x560b04aa65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.350+0000 7f234943d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560b046d44d0 0x560b04aa6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.350+0000 7f2349c3e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560b046cc2f0 0x560b04aa65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32844/0 (socket says 172.21.15.1:32844) 2024-09-21T00:57:40.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.350+0000 7f234943d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560b046d44d0 0x560b04aa6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:42214/0 (socket says 172.21.15.1:42214) 2024-09-21T00:57:40.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.350+0000 7f2352e15740 1 -- 172.21.15.1:0/3103698514 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560b049a4730 con 0x560b046d44d0 2024-09-21T00:57:40.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.350+0000 7f2349c3e640 1 -- 172.21.15.1:0/3103698514 learned_addr learned my addr 172.21.15.1:0/3103698514 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:40.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.350+0000 7f2352e15740 1 -- 172.21.15.1:0/3103698514 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560b04a9eb80 con 0x560b046f51b0 2024-09-21T00:57:40.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.350+0000 7f2352e15740 10 client.0 _ll_register_callbacks cb 0x560b049f86b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:40.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.350+0000 7f234a43f640 1 --2- 172.21.15.1:0/3103698514 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b046f51b0 0x560b04aa7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.350+0000 7f2349c3e640 1 -- 172.21.15.1:0/3103698514 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b046f51b0 msgr2=0x560b04aa7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:40.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.350+0000 7f2349c3e640 1 --2- 172.21.15.1:0/3103698514 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b046f51b0 0x560b04aa7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.350+0000 7f2349c3e640 1 -- 172.21.15.1:0/3103698514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560b046d44d0 msgr2=0x560b04aa6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:40.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.350+0000 7f2349c3e640 1 --2- 172.21.15.1:0/3103698514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560b046d44d0 0x560b04aa6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.350+0000 7f2349c3e640 1 -- 172.21.15.1:0/3103698514 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b04760790 con 0x560b046cc2f0 2024-09-21T00:57:40.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.351+0000 7f2349c3e640 1 --2- 172.21.15.1:0/3103698514 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560b046cc2f0 0x560b04aa65f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f23400058a0 tx=0x7f2340004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69af3ee839da9bb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:40.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.351+0000 7f232d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:57:40.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.351+0000 7f232d7fa640 1 -- 172.21.15.1:0/3103698514 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f234002c060 con 0x560b046cc2f0 2024-09-21T00:57:40.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.351+0000 7f232d7fa640 1 -- 172.21.15.1:0/3103698514 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f2340017030 con 0x560b046cc2f0 2024-09-21T00:57:40.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.351+0000 7f2352e15740 1 -- 172.21.15.1:0/3103698514 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f233c004830 con 0x560b046cc2f0 2024-09-21T00:57:40.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.351+0000 7f232d7fa640 1 -- 172.21.15.1:0/3103698514 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2340027410 con 0x560b046cc2f0 2024-09-21T00:57:40.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.351+0000 7f2352e15740 10 client.15609 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:40.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.351+0000 7f2352e15740 1 -- 172.21.15.1:0/3103698514 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560b047d9620 con 0x560b046cc2f0 2024-09-21T00:57:40.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.352+0000 7f232d7fa640 1 -- 172.21.15.1:0/3103698514 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2340027a60 con 0x560b046cc2f0 2024-09-21T00:57:40.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.352+0000 7f232d7fa640 1 -- 172.21.15.1:0/3103698514 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f2340032750 con 0x560b046cc2f0 2024-09-21T00:57:40.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.352+0000 7f2352e15740 10 client.15609 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:40.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.352+0000 7f2352e15740 10 client.15609 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:57:40.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.352+0000 7f2352e15740 20 client.15609 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:40.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.352+0000 7f2352e15740 1 --2- 172.21.15.1:0/3103698514 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560b046b3d80 0x560b04ab4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.352+0000 7f2352e15740 4 client.15609 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:57:40.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.352+0000 7f2352e15740 1 -- 172.21.15.1:0/3103698514 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f233c004830 con 0x560b046b3d80 2024-09-21T00:57:40.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.352+0000 7f234943d640 1 --2- 172.21.15.1:0/3103698514 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560b046b3d80 0x560b04ab4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.353+0000 7f232d7fa640 10 client.15609 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.353+0000 7f234943d640 1 --2- 172.21.15.1:0/3103698514 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560b046b3d80 0x560b04ab4200 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27a8226c0037e332 server_cookie=cfc94d1612a5effc in_seq=0 out_seq=0 2024-09-21T00:57:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.353+0000 7f232d7fa640 1 -- 172.21.15.1:0/3103698514 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f233c004830 con 0x560b046b3d80 2024-09-21T00:57:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.353+0000 7f232d7fa640 10 client.15609 handle_command_reply: tid=0 2024-09-21T00:57:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.354+0000 7f2352e15740 1 client.15609 shutdown 2024-09-21T00:57:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.354+0000 7f2352e15740 1 -- 172.21.15.1:0/3103698514 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560b046cc2f0 msgr2=0x560b04aa65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.354+0000 7f2352e15740 1 --2- 172.21.15.1:0/3103698514 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560b046cc2f0 0x560b04aa65f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f23400058a0 tx=0x7f2340004730 comp rx=0 tx=0).stop 2024-09-21T00:57:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.354+0000 7f2352e15740 1 -- 172.21.15.1:0/3103698514 shutdown_connections 2024-09-21T00:57:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.354+0000 7f2352e15740 1 --2- 172.21.15.1:0/3103698514 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560b046b3d80 0x560b04ab4200 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.354+0000 7f2352e15740 1 --2- 172.21.15.1:0/3103698514 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b046f51b0 0x560b04aa7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.354+0000 7f2352e15740 1 --2- 172.21.15.1:0/3103698514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560b046d44d0 0x560b04aa6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.354+0000 7f2352e15740 1 --2- 172.21.15.1:0/3103698514 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560b046cc2f0 0x560b04aa65f0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.354+0000 7f2352e15740 1 -- 172.21.15.1:0/3103698514 >> 172.21.15.1:0/3103698514 conn(0x560b046e9300 msgr2=0x560b04a96ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:40.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.354+0000 7f232d7fa640 0 client.15609 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:40.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.354+0000 7f2352e15740 1 -- 172.21.15.1:0/3103698514 shutdown_connections 2024-09-21T00:57:40.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.354+0000 7f2352e15740 1 -- 172.21.15.1:0/3103698514 wait complete. 2024-09-21T00:57:40.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.354+0000 7f2352e15740 20 client.15609 trim_cache size 0 max 16384 2024-09-21T00:57:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.369+0000 7f2352e15740 1 Processor -- start 2024-09-21T00:57:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.369+0000 7f2352e15740 1 -- start start 2024-09-21T00:57:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.369+0000 7f2352e15740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560b046cc2f0 0x560b04a9cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.369+0000 7f2352e15740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560b046d44d0 0x560b04a9d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.369+0000 7f234943d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560b046d44d0 0x560b04a9d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.369+0000 7f234943d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560b046d44d0 0x560b04a9d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32846/0 (socket says 172.21.15.1:32846) 2024-09-21T00:57:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.369+0000 7f234943d640 1 -- 172.21.15.1:0/3435870726 learned_addr learned my addr 172.21.15.1:0/3435870726 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.369+0000 7f2349c3e640 1 --2- 172.21.15.1:0/3435870726 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560b046cc2f0 0x560b04a9cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.369+0000 7f2352e15740 1 --2- 172.21.15.1:0/3435870726 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b046f51b0 0x560b04a99480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.369+0000 7f2352e15740 1 -- 172.21.15.1:0/3435870726 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f23441a8e50 con 0x560b046d44d0 2024-09-21T00:57:40.371 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.370+0000 7f2352e15740 1 -- 172.21.15.1:0/3435870726 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f23441aa990 con 0x560b046cc2f0 2024-09-21T00:57:40.371 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.370+0000 7f2352e15740 1 -- 172.21.15.1:0/3435870726 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f23441a9520 con 0x560b046f51b0 2024-09-21T00:57:40.371 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.370+0000 7f234a43f640 1 --2- 172.21.15.1:0/3435870726 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b046f51b0 0x560b04a99480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.370+0000 7f2349c3e640 1 -- 172.21.15.1:0/3435870726 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b046f51b0 msgr2=0x560b04a99480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:40.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.370+0000 7f2349c3e640 1 --2- 172.21.15.1:0/3435870726 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b046f51b0 0x560b04a99480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.370+0000 7f2349c3e640 1 -- 172.21.15.1:0/3435870726 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560b046d44d0 msgr2=0x560b04a9d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:40.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.370+0000 7f2349c3e640 1 --2- 172.21.15.1:0/3435870726 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560b046d44d0 0x560b04a9d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.370+0000 7f2349c3e640 1 -- 172.21.15.1:0/3435870726 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b04aae7c0 con 0x560b046cc2f0 2024-09-21T00:57:40.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.370+0000 7f2349c3e640 1 --2- 172.21.15.1:0/3435870726 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560b046cc2f0 0x560b04a9cdf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f234000bfd0 tx=0x7f2340003d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b9a0532cb3104e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:40.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.371+0000 7f232f7fe640 1 -- 172.21.15.1:0/3435870726 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2340032600 con 0x560b046cc2f0 2024-09-21T00:57:40.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.371+0000 7f232f7fe640 1 -- 172.21.15.1:0/3435870726 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23400327a0 con 0x560b046cc2f0 2024-09-21T00:57:40.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.371+0000 7f232f7fe640 1 -- 172.21.15.1:0/3435870726 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2340027830 con 0x560b046cc2f0 2024-09-21T00:57:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.371+0000 7f2352e15740 1 -- 172.21.15.1:0/3435870726 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560b046cc2f0 msgr2=0x560b04a9cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.371+0000 7f2352e15740 1 --2- 172.21.15.1:0/3435870726 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560b046cc2f0 0x560b04a9cdf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f234000bfd0 tx=0x7f2340003d80 comp rx=0 tx=0).stop 2024-09-21T00:57:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.372+0000 7f2352e15740 1 -- 172.21.15.1:0/3435870726 shutdown_connections 2024-09-21T00:57:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.372+0000 7f2352e15740 1 --2- 172.21.15.1:0/3435870726 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b046f51b0 0x560b04a99480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.372+0000 7f2352e15740 1 --2- 172.21.15.1:0/3435870726 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560b046d44d0 0x560b04a9d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.372+0000 7f2352e15740 1 --2- 172.21.15.1:0/3435870726 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560b046cc2f0 0x560b04a9cdf0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.372+0000 7f2352e15740 1 -- 172.21.15.1:0/3435870726 >> 172.21.15.1:0/3435870726 conn(0x560b046e9300 msgr2=0x560b04a98220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.372+0000 7f2352e15740 1 -- 172.21.15.1:0/3435870726 shutdown_connections 2024-09-21T00:57:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.372+0000 7f2352e15740 1 -- 172.21.15.1:0/3435870726 wait complete. 2024-09-21T00:57:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.372+0000 7f2352e15740 1 -- start start 2024-09-21T00:57:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.372+0000 7f2352e15740 1 Processor -- start 2024-09-21T00:57:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.373+0000 7f2352e15740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b046cc2f0 0x560b04aab280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.373+0000 7f2352e15740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560b046d44d0 0x560b04aab940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.373+0000 7f2352e15740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560b046f51b0 0x560b04aac4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.373+0000 7f2352e15740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f23441aa2c0 con 0x560b046f51b0 2024-09-21T00:57:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.373+0000 7f2352e15740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f23441a9bf0 con 0x560b046d44d0 2024-09-21T00:57:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.373+0000 7f2352e15740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f23441a6e30 con 0x560b046cc2f0 2024-09-21T00:57:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.373+0000 7f234943d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560b046d44d0 0x560b04aab940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.373+0000 7f234943d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560b046d44d0 0x560b04aab940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:42224/0 (socket says 172.21.15.1:42224) 2024-09-21T00:57:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.373+0000 7f234943d640 1 -- 172.21.15.1:0/3448070392 learned_addr learned my addr 172.21.15.1:0/3448070392 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.373+0000 7f2349c3e640 1 --2- 172.21.15.1:0/3448070392 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b046cc2f0 0x560b04aab280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.373+0000 7f234a43f640 1 --2- 172.21.15.1:0/3448070392 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560b046f51b0 0x560b04aac4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.373+0000 7f2352e15740 10 client.0 _ll_register_callbacks cb 0x7f2340004300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.373+0000 7f234943d640 1 -- 172.21.15.1:0/3448070392 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b046cc2f0 msgr2=0x560b04aab280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.373+0000 7f234943d640 1 --2- 172.21.15.1:0/3448070392 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b046cc2f0 0x560b04aab280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.373+0000 7f234943d640 1 -- 172.21.15.1:0/3448070392 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560b046f51b0 msgr2=0x560b04aac4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.373+0000 7f234943d640 1 --2- 172.21.15.1:0/3448070392 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560b046f51b0 0x560b04aac4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.373+0000 7f234943d640 1 -- 172.21.15.1:0/3448070392 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b04aacc10 con 0x560b046d44d0 2024-09-21T00:57:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.374+0000 7f234a43f640 1 --2- 172.21.15.1:0/3448070392 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560b046f51b0 0x560b04aac4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:57:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.374+0000 7f234943d640 1 --2- 172.21.15.1:0/3448070392 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560b046d44d0 0x560b04aab940 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2334005e00 tx=0x7f2334005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6eb90000acafc88 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.374+0000 7f232d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T00:57:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.374+0000 7f232d7fa640 1 -- 172.21.15.1:0/3448070392 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23340d2070 con 0x560b046d44d0 2024-09-21T00:57:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.374+0000 7f2352e15740 1 -- 172.21.15.1:0/3448070392 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23400327a0 con 0x560b046d44d0 2024-09-21T00:57:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.374+0000 7f232d7fa640 1 -- 172.21.15.1:0/3448070392 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f23340c9e60 con 0x560b046d44d0 2024-09-21T00:57:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.374+0000 7f232d7fa640 1 -- 172.21.15.1:0/3448070392 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2334049040 con 0x560b046d44d0 2024-09-21T00:57:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.374+0000 7f2352e15740 10 client.25301 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.374+0000 7f2352e15740 1 -- 172.21.15.1:0/3448070392 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560b04aae000 con 0x560b046d44d0 2024-09-21T00:57:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.375+0000 7f232d7fa640 1 -- 172.21.15.1:0/3448070392 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23400327a0 con 0x560b046d44d0 2024-09-21T00:57:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.375+0000 7f232d7fa640 1 -- 172.21.15.1:0/3448070392 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f23340c9040 con 0x560b046d44d0 2024-09-21T00:57:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.375+0000 7f2352e15740 10 client.25301 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.375+0000 7f2352e15740 10 client.25301 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:57:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.375+0000 7f2352e15740 20 client.25301 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.375+0000 7f2352e15740 1 --2- 172.21.15.1:0/3448070392 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560b046891c0 0x560b04b20e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.375+0000 7f2352e15740 4 client.25301 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T00:57:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.375+0000 7f2352e15740 1 -- 172.21.15.1:0/3448070392 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560b04a11640 con 0x560b046891c0 2024-09-21T00:57:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.375+0000 7f2349c3e640 1 --2- 172.21.15.1:0/3448070392 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560b046891c0 0x560b04b20e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.376+0000 7f232d7fa640 10 client.25301 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.376+0000 7f2349c3e640 1 --2- 172.21.15.1:0/3448070392 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560b046891c0 0x560b04b20e70 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af627fc219dbf52b server_cookie=7361aa145445e96 in_seq=0 out_seq=0 2024-09-21T00:57:40.384 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.383+0000 7f232d7fa640 1 -- 172.21.15.1:0/3448070392 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560b04a11640 con 0x560b046891c0 2024-09-21T00:57:40.384 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.383+0000 7f232d7fa640 10 client.25301 handle_command_reply: tid=0 2024-09-21T00:57:40.384 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.383+0000 7f2352e15740 1 client.25301 shutdown 2024-09-21T00:57:40.384 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.383+0000 7f2352e15740 1 -- 172.21.15.1:0/3448070392 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560b046d44d0 msgr2=0x560b04aab940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:40.384 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.383+0000 7f2352e15740 1 --2- 172.21.15.1:0/3448070392 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560b046d44d0 0x560b04aab940 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2334005e00 tx=0x7f2334005d50 comp rx=0 tx=0).stop 2024-09-21T00:57:40.384 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.383+0000 7f2352e15740 1 -- 172.21.15.1:0/3448070392 shutdown_connections 2024-09-21T00:57:40.384 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.383+0000 7f2352e15740 1 --2- 172.21.15.1:0/3448070392 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560b046891c0 0x560b04b20e70 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.384 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.383+0000 7f2352e15740 1 --2- 172.21.15.1:0/3448070392 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560b046f51b0 0x560b04aac4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.383+0000 7f2352e15740 1 --2- 172.21.15.1:0/3448070392 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560b046d44d0 0x560b04aab940 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.383+0000 7f232d7fa640 0 client.25301 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.383+0000 7f2352e15740 1 --2- 172.21.15.1:0/3448070392 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b046cc2f0 0x560b04aab280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.383+0000 7f2352e15740 1 -- 172.21.15.1:0/3448070392 >> 172.21.15.1:0/3448070392 conn(0x560b046e9300 msgr2=0x560b04a98220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.383+0000 7f2352e15740 1 -- 172.21.15.1:0/3448070392 shutdown_connections 2024-09-21T00:57:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.383+0000 7f2352e15740 1 -- 172.21.15.1:0/3448070392 wait complete. 2024-09-21T00:57:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.383+0000 7f2352e15740 20 client.25301 trim_cache size 0 max 16384 2024-09-21T00:57:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T00:57:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T00:57:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T00:57:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T00:57:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.384+0000 7f234bea2640 1 -- 172.21.15.1:0/304571370 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f23300b6620 msgr2=0x7f23300b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.384+0000 7f234bea2640 1 --2- 172.21.15.1:0/304571370 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f23300b6620 0x7f23300b8b30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2340004610 tx=0x7f234000b390 comp rx=0 tx=0).stop 2024-09-21T00:57:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.384+0000 7f234bea2640 1 -- 172.21.15.1:0/304571370 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2344103640 msgr2=0x7f234419ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.384+0000 7f234bea2640 1 --2- 172.21.15.1:0/304571370 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2344103640 0x7f234419ec90 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2334006010 tx=0x7f2334004340 comp rx=0 tx=0).stop 2024-09-21T00:57:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.384+0000 7f234bea2640 1 -- 172.21.15.1:0/304571370 shutdown_connections 2024-09-21T00:57:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.384+0000 7f234bea2640 1 --2- 172.21.15.1:0/304571370 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2344103fe0 0x7f23441a11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.384+0000 7f234bea2640 1 --2- 172.21.15.1:0/304571370 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f23300b6620 0x7f23300b8b30 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.384+0000 7f234bea2640 1 --2- 172.21.15.1:0/304571370 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2344103640 0x7f234419ec90 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.384+0000 7f234bea2640 1 --2- 172.21.15.1:0/304571370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23441025c0 0x7f234406b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.385+0000 7f234bea2640 1 -- 172.21.15.1:0/304571370 >> 172.21.15.1:0/304571370 conn(0x7f23440fdf00 msgr2=0x7f2344106960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.385+0000 7f234bea2640 1 -- 172.21.15.1:0/304571370 shutdown_connections 2024-09-21T00:57:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:40.385+0000 7f234bea2640 1 -- 172.21.15.1:0/304571370 wait complete. 2024-09-21T00:57:40.765 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T00:57:41.050 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:41.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.568+0000 7fadecdcf640 1 -- 172.21.15.1:0/2389563321 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fade8101f70 msgr2=0x7fade8102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:41.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.568+0000 7fadecdcf640 1 --2- 172.21.15.1:0/2389563321 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fade8101f70 0x7fade8102380 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fadd8009900 tx=0x7fadd802a410 comp rx=0 tx=0).stop 2024-09-21T00:57:41.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.568+0000 7fadecdcf640 1 -- 172.21.15.1:0/2389563321 shutdown_connections 2024-09-21T00:57:41.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.568+0000 7fadecdcf640 1 --2- 172.21.15.1:0/2389563321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fade8109e00 0x7fade8110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.568+0000 7fadecdcf640 1 --2- 172.21.15.1:0/2389563321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fade81094b0 0x7fade81098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.569+0000 7fadecdcf640 1 --2- 172.21.15.1:0/2389563321 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fade8101f70 0x7fade8102380 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.569+0000 7fadecdcf640 1 -- 172.21.15.1:0/2389563321 >> 172.21.15.1:0/2389563321 conn(0x7fade8077c60 msgr2=0x7fade80780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:41.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.569+0000 7fadecdcf640 1 -- 172.21.15.1:0/2389563321 shutdown_connections 2024-09-21T00:57:41.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.569+0000 7fadecdcf640 1 -- 172.21.15.1:0/2389563321 wait complete. 2024-09-21T00:57:41.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.571+0000 7fadecdcf640 1 Processor -- start 2024-09-21T00:57:41.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.571+0000 7fadecdcf640 1 -- start start 2024-09-21T00:57:41.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.571+0000 7fadecdcf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fade8101f70 0x7fade819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:41.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.572+0000 7fadecdcf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fade81094b0 0x7fade819aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:41.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.572+0000 7fade659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fade8101f70 0x7fade819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:41.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.572+0000 7fade5d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fade81094b0 0x7fade819aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:41.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.572+0000 7fade659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fade8101f70 0x7fade819a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:42248/0 (socket says 172.21.15.1:42248) 2024-09-21T00:57:41.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.572+0000 7fade5d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fade81094b0 0x7fade819aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32876/0 (socket says 172.21.15.1:32876) 2024-09-21T00:57:41.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.572+0000 7fade659c640 1 -- 172.21.15.1:0/623154489 learned_addr learned my addr 172.21.15.1:0/623154489 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:41.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.572+0000 7fadecdcf640 1 --2- 172.21.15.1:0/623154489 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fade8109e00 0x7fade819fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:41.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.572+0000 7fadecdcf640 1 -- 172.21.15.1:0/623154489 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fade8113b10 con 0x7fade81094b0 2024-09-21T00:57:41.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.572+0000 7fadecdcf640 1 -- 172.21.15.1:0/623154489 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fade8113990 con 0x7fade8101f70 2024-09-21T00:57:41.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.572+0000 7fadecdcf640 1 -- 172.21.15.1:0/623154489 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fade8113c90 con 0x7fade8109e00 2024-09-21T00:57:41.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.573+0000 7fade6d9d640 1 --2- 172.21.15.1:0/623154489 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fade8109e00 0x7fade819fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:41.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.573+0000 7fade5d9b640 1 -- 172.21.15.1:0/623154489 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fade8109e00 msgr2=0x7fade819fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:41.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.573+0000 7fade5d9b640 1 --2- 172.21.15.1:0/623154489 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fade8109e00 0x7fade819fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.573+0000 7fade5d9b640 1 -- 172.21.15.1:0/623154489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fade8101f70 msgr2=0x7fade819a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:41.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.573+0000 7fade5d9b640 1 --2- 172.21.15.1:0/623154489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fade8101f70 0x7fade819a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.573+0000 7fade5d9b640 1 -- 172.21.15.1:0/623154489 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade81a0370 con 0x7fade81094b0 2024-09-21T00:57:41.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.574+0000 7fade5d9b640 1 --2- 172.21.15.1:0/623154489 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fade81094b0 0x7fade819aa60 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fade8075ab0 tx=0x7faddc00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:41.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.574+0000 7fadd77fe640 1 -- 172.21.15.1:0/623154489 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc00cc10 con 0x7fade81094b0 2024-09-21T00:57:41.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.574+0000 7fadd77fe640 1 -- 172.21.15.1:0/623154489 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faddc00cdb0 con 0x7fade81094b0 2024-09-21T00:57:41.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.574+0000 7fadecdcf640 1 -- 172.21.15.1:0/623154489 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade81a0660 con 0x7fade81094b0 2024-09-21T00:57:41.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.574+0000 7fadd77fe640 1 -- 172.21.15.1:0/623154489 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc018840 con 0x7fade81094b0 2024-09-21T00:57:41.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.574+0000 7fadecdcf640 1 -- 172.21.15.1:0/623154489 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade8102df0 con 0x7fade81094b0 2024-09-21T00:57:41.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.578+0000 7fadf3343740 1 Processor -- start 2024-09-21T00:57:41.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.579+0000 7fadf3343740 1 -- start start 2024-09-21T00:57:41.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.579+0000 7fadf3343740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619b6459070 0x5619b68002c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:41.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.579+0000 7fade6d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619b6459070 0x5619b68002c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:41.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.579+0000 7fade6d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619b6459070 0x5619b68002c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32892/0 (socket says 172.21.15.1:32892) 2024-09-21T00:57:41.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.580+0000 7fade6d9d640 1 -- 172.21.15.1:0/4285397741 learned_addr learned my addr 172.21.15.1:0/4285397741 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:41.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.580+0000 7fadf3343740 1 --2- 172.21.15.1:0/4285397741 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619b64301b0 0x5619b6800800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:41.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.580+0000 7fadf3343740 1 --2- 172.21.15.1:0/4285397741 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619b6438390 0x5619b6800d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:41.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.580+0000 7fadf3343740 1 -- 172.21.15.1:0/4285397741 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5619b6776ea0 con 0x5619b6459070 2024-09-21T00:57:41.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.580+0000 7fadf3343740 1 -- 172.21.15.1:0/4285397741 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5619b67662d0 con 0x5619b6438390 2024-09-21T00:57:41.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.580+0000 7fadf3343740 1 -- 172.21.15.1:0/4285397741 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5619b676a0e0 con 0x5619b64301b0 2024-09-21T00:57:41.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.580+0000 7fade5d9b640 1 --2- 172.21.15.1:0/4285397741 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619b6438390 0x5619b6800d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:41.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.580+0000 7fade6d9d640 1 -- 172.21.15.1:0/4285397741 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619b64301b0 msgr2=0x5619b6800800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:41.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.580+0000 7fade659c640 1 --2- 172.21.15.1:0/4285397741 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619b64301b0 0x5619b6800800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:41.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.580+0000 7fade6d9d640 1 --2- 172.21.15.1:0/4285397741 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619b64301b0 0x5619b6800800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.580+0000 7fade6d9d640 1 -- 172.21.15.1:0/4285397741 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619b6438390 msgr2=0x5619b6800d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:41.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.580+0000 7fade6d9d640 1 --2- 172.21.15.1:0/4285397741 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619b6438390 0x5619b6800d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.580+0000 7fade6d9d640 1 -- 172.21.15.1:0/4285397741 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619b64c4650 con 0x5619b6459070 2024-09-21T00:57:41.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.581+0000 7fadd77fe640 1 -- 172.21.15.1:0/623154489 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 154562+0+0 (secure 0 0 0) 0x7faddc0189e0 con 0x7fade81094b0 2024-09-21T00:57:41.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.581+0000 7fade6d9d640 1 --2- 172.21.15.1:0/4285397741 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619b6459070 0x5619b68002c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fade0007f40 tx=0x7fade0007520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=789a4fdf537c390f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:41.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.582+0000 7fadd4ff9640 1 -- 172.21.15.1:0/4285397741 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade000a900 con 0x5619b6459070 2024-09-21T00:57:41.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.582+0000 7fadd4ff9640 1 -- 172.21.15.1:0/4285397741 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fade001e070 con 0x5619b6459070 2024-09-21T00:57:41.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.582+0000 7fadd4ff9640 1 -- 172.21.15.1:0/4285397741 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade0018380 con 0x5619b6459070 2024-09-21T00:57:41.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.582+0000 7fadd77fe640 1 --2- 172.21.15.1:0/623154489 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fadd00b66d0 0x7fadd00b8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:41.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.583+0000 7fade659c640 1 --2- 172.21.15.1:0/623154489 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fadd00b66d0 0x7fadd00b8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:41.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.583+0000 7fadd77fe640 1 -- 172.21.15.1:0/623154489 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7faddc0e76d0 con 0x7fade81094b0 2024-09-21T00:57:41.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.583+0000 7fadf3343740 1 -- 172.21.15.1:0/4285397741 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619b6459070 msgr2=0x5619b68002c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:41.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.583+0000 7fade659c640 1 --2- 172.21.15.1:0/623154489 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fadd00b66d0 0x7fadd00b8be0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x5619b67fef40 tx=0x7fadd8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:41.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.583+0000 7fadf3343740 1 --2- 172.21.15.1:0/4285397741 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619b6459070 0x5619b68002c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fade0007f40 tx=0x7fade0007520 comp rx=0 tx=0).stop 2024-09-21T00:57:41.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.584+0000 7fadf3343740 1 -- 172.21.15.1:0/4285397741 shutdown_connections 2024-09-21T00:57:41.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.584+0000 7fadf3343740 1 --2- 172.21.15.1:0/4285397741 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619b6438390 0x5619b6800d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.584+0000 7fadf3343740 1 --2- 172.21.15.1:0/4285397741 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619b64301b0 0x5619b6800800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.584+0000 7fadf3343740 1 --2- 172.21.15.1:0/4285397741 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619b6459070 0x5619b68002c0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.584+0000 7fadf3343740 1 -- 172.21.15.1:0/4285397741 >> 172.21.15.1:0/4285397741 conn(0x5619b644d460 msgr2=0x5619b67fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:41.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.584+0000 7fadf3343740 1 -- 172.21.15.1:0/4285397741 shutdown_connections 2024-09-21T00:57:41.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.584+0000 7fadf3343740 1 -- 172.21.15.1:0/4285397741 wait complete. 2024-09-21T00:57:41.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.584+0000 7fadf3343740 1 -- start start 2024-09-21T00:57:41.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.585+0000 7fadf3343740 1 Processor -- start 2024-09-21T00:57:41.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.585+0000 7fadf3343740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619b64301b0 0x5619b680ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:41.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.585+0000 7fadf3343740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619b6438390 0x5619b680bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:41.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.585+0000 7fadf3343740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619b6459070 0x5619b6817d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:41.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.585+0000 7fadf3343740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5619b65c7700 con 0x5619b6438390 2024-09-21T00:57:41.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.585+0000 7fadf3343740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5619b6701160 con 0x5619b6459070 2024-09-21T00:57:41.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.585+0000 7fadf3343740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5619b680eaa0 con 0x5619b64301b0 2024-09-21T00:57:41.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.585+0000 7fade5d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619b6438390 0x5619b680bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:41.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.585+0000 7fade5d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619b6438390 0x5619b680bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32906/0 (socket says 172.21.15.1:32906) 2024-09-21T00:57:41.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.585+0000 7fade5d9b640 1 -- 172.21.15.1:0/1144469847 learned_addr learned my addr 172.21.15.1:0/1144469847 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:41.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.585+0000 7fadf3343740 10 client.0 _ll_register_callbacks cb 0x5619b671a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:41.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.585+0000 7fade659c640 1 --2- 172.21.15.1:0/1144469847 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619b64301b0 0x5619b680ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:41.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.586+0000 7fade6d9d640 1 --2- 172.21.15.1:0/1144469847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619b6459070 0x5619b6817d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:41.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.586+0000 7fade5d9b640 1 -- 172.21.15.1:0/1144469847 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619b64301b0 msgr2=0x5619b680ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:41.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.586+0000 7fade5d9b640 1 --2- 172.21.15.1:0/1144469847 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619b64301b0 0x5619b680ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.586+0000 7fade5d9b640 1 -- 172.21.15.1:0/1144469847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619b6459070 msgr2=0x5619b6817d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:41.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.586+0000 7fade5d9b640 1 --2- 172.21.15.1:0/1144469847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619b6459070 0x5619b6817d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.586+0000 7fade5d9b640 1 -- 172.21.15.1:0/1144469847 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619b672ec90 con 0x5619b6438390 2024-09-21T00:57:41.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.586+0000 7fade5d9b640 1 --2- 172.21.15.1:0/1144469847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619b6438390 0x5619b680bf70 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7faddc0ad430 tx=0x7faddc0eb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60415f93470d51c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:41.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.586+0000 7fadcdffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:57:41.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.586+0000 7fadcdffb640 1 -- 172.21.15.1:0/1144469847 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc0a95d0 con 0x5619b6438390 2024-09-21T00:57:41.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.587+0000 7fadcdffb640 1 -- 172.21.15.1:0/1144469847 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7faddc0a9080 con 0x5619b6438390 2024-09-21T00:57:41.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.587+0000 7fadf3343740 1 -- 172.21.15.1:0/1144469847 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fade001e070 con 0x5619b6438390 2024-09-21T00:57:41.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.587+0000 7fadcdffb640 1 -- 172.21.15.1:0/1144469847 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7faddc0acea0 con 0x5619b6438390 2024-09-21T00:57:41.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.587+0000 7fadf3343740 10 client.15627 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:41.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.587+0000 7fadf3343740 1 -- 172.21.15.1:0/1144469847 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5619b681a8b0 con 0x5619b6438390 2024-09-21T00:57:41.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.587+0000 7fadcdffb640 1 -- 172.21.15.1:0/1144469847 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fade001e070 con 0x5619b6438390 2024-09-21T00:57:41.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.588+0000 7fadcdffb640 1 -- 172.21.15.1:0/1144469847 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7faddc0a9280 con 0x5619b6438390 2024-09-21T00:57:41.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.588+0000 7fadf3343740 10 client.15627 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:41.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.588+0000 7fadf3343740 10 client.15627 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T00:57:41.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.588+0000 7fadf3343740 20 client.15627 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:41.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.588+0000 7fadf3343740 1 --2- 172.21.15.1:0/1144469847 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x5619b64179f0 0x5619b681ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:41.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.588+0000 7fadf3343740 4 client.15627 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:57:41.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.588+0000 7fadf3343740 1 -- 172.21.15.1:0/1144469847 --> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5619b6778df0 con 0x5619b64179f0 2024-09-21T00:57:41.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.588+0000 7fade659c640 1 --2- 172.21.15.1:0/1144469847 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x5619b64179f0 0x5619b681ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:41.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.589+0000 7fadcdffb640 10 client.15627 ms_handle_connect on v2:172.21.15.42:6836/2395608508 2024-09-21T00:57:41.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.589+0000 7fade659c640 1 --2- 172.21.15.1:0/1144469847 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x5619b64179f0 0x5619b681ddb0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d91f2f44b8376826 server_cookie=6afe6cc49f35b44b in_seq=0 out_seq=0 2024-09-21T00:57:41.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.589+0000 7fadcdffb640 1 -- 172.21.15.1:0/1144469847 <== mds.2 v2:172.21.15.42:6836/2395608508 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5619b6778df0 con 0x5619b64179f0 2024-09-21T00:57:41.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.589+0000 7fadcdffb640 10 client.15627 handle_command_reply: tid=0 2024-09-21T00:57:41.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.589+0000 7fadf3343740 1 client.15627 shutdown 2024-09-21T00:57:41.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.590+0000 7fadf3343740 1 -- 172.21.15.1:0/1144469847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619b6438390 msgr2=0x5619b680bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:41.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.590+0000 7fadf3343740 1 --2- 172.21.15.1:0/1144469847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619b6438390 0x5619b680bf70 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7faddc0ad430 tx=0x7faddc0eb040 comp rx=0 tx=0).stop 2024-09-21T00:57:41.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.590+0000 7fadf3343740 1 -- 172.21.15.1:0/1144469847 shutdown_connections 2024-09-21T00:57:41.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.590+0000 7fadf3343740 1 --2- 172.21.15.1:0/1144469847 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x5619b64179f0 0x5619b681ddb0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.590+0000 7fadcdffb640 0 client.15627 ms_handle_reset on v2:172.21.15.42:6836/2395608508 2024-09-21T00:57:41.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.590+0000 7fadf3343740 1 --2- 172.21.15.1:0/1144469847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619b6459070 0x5619b6817d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.590+0000 7fadf3343740 1 --2- 172.21.15.1:0/1144469847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619b6438390 0x5619b680bf70 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.590+0000 7fadf3343740 1 --2- 172.21.15.1:0/1144469847 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619b64301b0 0x5619b680ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.590+0000 7fadf3343740 1 -- 172.21.15.1:0/1144469847 >> 172.21.15.1:0/1144469847 conn(0x5619b644d460 msgr2=0x5619b68034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:41.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.590+0000 7fadf3343740 1 -- 172.21.15.1:0/1144469847 shutdown_connections 2024-09-21T00:57:41.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.590+0000 7fadf3343740 1 -- 172.21.15.1:0/1144469847 wait complete. 2024-09-21T00:57:41.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.590+0000 7fadf3343740 20 client.15627 trim_cache size 0 max 16384 2024-09-21T00:57:41.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.617+0000 7fadf3343740 1 Processor -- start 2024-09-21T00:57:41.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.617+0000 7fadf3343740 1 -- start start 2024-09-21T00:57:41.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.617+0000 7fadf3343740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619b64179f0 0x5619b67fe200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:41.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.617+0000 7fadf3343740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619b64301b0 0x5619b6817c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:41.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.618+0000 7fade5d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619b64301b0 0x5619b6817c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:41.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.618+0000 7fade659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619b64179f0 0x5619b67fe200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:41.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.618+0000 7fade5d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619b64301b0 0x5619b6817c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32918/0 (socket says 172.21.15.1:32918) 2024-09-21T00:57:41.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.618+0000 7fade5d9b640 1 -- 172.21.15.1:0/1994759254 learned_addr learned my addr 172.21.15.1:0/1994759254 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:41.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.618+0000 7fadf3343740 1 --2- 172.21.15.1:0/1994759254 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619b6438390 0x5619b68181d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:41.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.618+0000 7fadf3343740 1 -- 172.21.15.1:0/1994759254 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fade81ad290 con 0x5619b64301b0 2024-09-21T00:57:41.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.618+0000 7fadf3343740 1 -- 172.21.15.1:0/1994759254 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fade81aedd0 con 0x5619b64179f0 2024-09-21T00:57:41.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.618+0000 7fadf3343740 1 -- 172.21.15.1:0/1994759254 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fade81ad960 con 0x5619b6438390 2024-09-21T00:57:41.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.618+0000 7fade6d9d640 1 --2- 172.21.15.1:0/1994759254 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619b6438390 0x5619b68181d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:41.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.618+0000 7fade659c640 1 -- 172.21.15.1:0/1994759254 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619b6438390 msgr2=0x5619b68181d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:41.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.618+0000 7fade659c640 1 --2- 172.21.15.1:0/1994759254 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619b6438390 0x5619b68181d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.618+0000 7fade659c640 1 -- 172.21.15.1:0/1994759254 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619b64301b0 msgr2=0x5619b6817c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:41.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.618+0000 7fade659c640 1 --2- 172.21.15.1:0/1994759254 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619b64301b0 0x5619b6817c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.618+0000 7fade659c640 1 -- 172.21.15.1:0/1994759254 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619b6803120 con 0x5619b64179f0 2024-09-21T00:57:41.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.619+0000 7fade659c640 1 --2- 172.21.15.1:0/1994759254 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619b64179f0 0x5619b67fe200 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fadd8000c00 tx=0x7fadd803e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c231fbea365ee753 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:41.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.619+0000 7fadcffff640 1 -- 172.21.15.1:0/1994759254 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd8056070 con 0x5619b64179f0 2024-09-21T00:57:41.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.619+0000 7fadcffff640 1 -- 172.21.15.1:0/1994759254 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadd80314a0 con 0x5619b64179f0 2024-09-21T00:57:41.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.619+0000 7fadcffff640 1 -- 172.21.15.1:0/1994759254 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd8035050 con 0x5619b64179f0 2024-09-21T00:57:41.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.620+0000 7fadf3343740 1 -- 172.21.15.1:0/1994759254 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619b64179f0 msgr2=0x5619b67fe200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:41.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.620+0000 7fadf3343740 1 --2- 172.21.15.1:0/1994759254 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619b64179f0 0x5619b67fe200 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fadd8000c00 tx=0x7fadd803e000 comp rx=0 tx=0).stop 2024-09-21T00:57:41.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.620+0000 7fadf3343740 1 -- 172.21.15.1:0/1994759254 shutdown_connections 2024-09-21T00:57:41.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.620+0000 7fadf3343740 1 --2- 172.21.15.1:0/1994759254 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619b6438390 0x5619b68181d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.620+0000 7fadf3343740 1 --2- 172.21.15.1:0/1994759254 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619b64301b0 0x5619b6817c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.620+0000 7fadf3343740 1 --2- 172.21.15.1:0/1994759254 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619b64179f0 0x5619b67fe200 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.620+0000 7fadf3343740 1 -- 172.21.15.1:0/1994759254 >> 172.21.15.1:0/1994759254 conn(0x5619b644d460 msgr2=0x5619b67fdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:41.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.620+0000 7fadf3343740 1 -- 172.21.15.1:0/1994759254 shutdown_connections 2024-09-21T00:57:41.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.620+0000 7fadf3343740 1 -- 172.21.15.1:0/1994759254 wait complete. 2024-09-21T00:57:41.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.621+0000 7fadf3343740 1 -- start start 2024-09-21T00:57:41.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.621+0000 7fadf3343740 1 Processor -- start 2024-09-21T00:57:41.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.621+0000 7fadf3343740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619b64179f0 0x5619b6810460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:41.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.621+0000 7fadf3343740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619b64301b0 0x5619b68109a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:41.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.621+0000 7fadf3343740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619b6438390 0x5619b6887750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:41.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.622+0000 7fadf3343740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fade81ae700 con 0x5619b64301b0 2024-09-21T00:57:41.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.622+0000 7fadf3343740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fade81ae030 con 0x5619b6438390 2024-09-21T00:57:41.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.622+0000 7fadf3343740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fade81ab270 con 0x5619b64179f0 2024-09-21T00:57:41.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.622+0000 7fadf3343740 10 client.0 _ll_register_callbacks cb 0x7faddc0a9bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:41.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.622+0000 7fade5d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619b64301b0 0x5619b68109a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:41.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.622+0000 7fade659c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619b64179f0 0x5619b6810460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:41.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.622+0000 7fade659c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619b64179f0 0x5619b6810460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:37848/0 (socket says 172.21.15.1:37848) 2024-09-21T00:57:41.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.622+0000 7fade659c640 1 -- 172.21.15.1:0/615387623 learned_addr learned my addr 172.21.15.1:0/615387623 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:41.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.622+0000 7fade6d9d640 1 --2- 172.21.15.1:0/615387623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619b6438390 0x5619b6887750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:41.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.622+0000 7fade659c640 1 -- 172.21.15.1:0/615387623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619b6438390 msgr2=0x5619b6887750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:41.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.622+0000 7fade659c640 1 --2- 172.21.15.1:0/615387623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619b6438390 0x5619b6887750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.622+0000 7fade659c640 1 -- 172.21.15.1:0/615387623 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619b64301b0 msgr2=0x5619b68109a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:41.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.622+0000 7fade659c640 1 --2- 172.21.15.1:0/615387623 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619b64301b0 0x5619b68109a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.622+0000 7fade659c640 1 -- 172.21.15.1:0/615387623 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619b6887ce0 con 0x5619b64179f0 2024-09-21T00:57:41.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.622+0000 7fade659c640 1 --2- 172.21.15.1:0/615387623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619b64179f0 0x5619b6810460 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fadd8031440 tx=0x7fadd8004500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a136ff87becf0eb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:41.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.622+0000 7fadcdffb640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T00:57:41.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.623+0000 7fadcdffb640 1 -- 172.21.15.1:0/615387623 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd8056070 con 0x5619b64179f0 2024-09-21T00:57:41.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.623+0000 7fadf3343740 1 -- 172.21.15.1:0/615387623 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadd80314a0 con 0x5619b64179f0 2024-09-21T00:57:41.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.623+0000 7fadcdffb640 1 -- 172.21.15.1:0/615387623 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fadd8003c30 con 0x5619b64179f0 2024-09-21T00:57:41.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.623+0000 7fadcdffb640 1 -- 172.21.15.1:0/615387623 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fadd8035030 con 0x5619b64179f0 2024-09-21T00:57:41.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.623+0000 7fadf3343740 10 client.25270 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:41.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.623+0000 7fadf3343740 1 -- 172.21.15.1:0/615387623 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5619b6888f60 con 0x5619b64179f0 2024-09-21T00:57:41.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.623+0000 7fadcdffb640 1 -- 172.21.15.1:0/615387623 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadd80314a0 con 0x5619b64179f0 2024-09-21T00:57:41.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.624+0000 7fadcdffb640 1 -- 172.21.15.1:0/615387623 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fadd8065910 con 0x5619b64179f0 2024-09-21T00:57:41.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.624+0000 7fadf3343740 10 client.25270 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:41.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.624+0000 7fadf3343740 10 client.25270 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T00:57:41.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.624+0000 7fadf3343740 20 client.25270 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:41.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.624+0000 7fadf3343740 1 --2- 172.21.15.1:0/615387623 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x5619b6459070 0x5619b688b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:41.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.624+0000 7fadf3343740 4 client.25270 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:57:41.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.624+0000 7fadf3343740 1 -- 172.21.15.1:0/615387623 --> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5619b67748a0 con 0x5619b6459070 2024-09-21T00:57:41.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.624+0000 7fade5d9b640 1 --2- 172.21.15.1:0/615387623 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x5619b6459070 0x5619b688b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:41.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.625+0000 7fadcdffb640 10 client.25270 ms_handle_connect on v2:172.21.15.42:6836/2395608508 2024-09-21T00:57:41.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.625+0000 7fade5d9b640 1 --2- 172.21.15.1:0/615387623 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x5619b6459070 0x5619b688b6e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3af1bf4cbec67305 server_cookie=15d9427efdd48dc6 in_seq=0 out_seq=0 2024-09-21T00:57:41.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.625+0000 7fadcdffb640 1 -- 172.21.15.1:0/615387623 <== mds.2 v2:172.21.15.42:6836/2395608508 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5619b67748a0 con 0x5619b6459070 2024-09-21T00:57:41.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.625+0000 7fadcdffb640 10 client.25270 handle_command_reply: tid=0 2024-09-21T00:57:41.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.625+0000 7fadf3343740 1 client.25270 shutdown 2024-09-21T00:57:41.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.625+0000 7fadf3343740 1 -- 172.21.15.1:0/615387623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619b64179f0 msgr2=0x5619b6810460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:41.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.625+0000 7fadf3343740 1 --2- 172.21.15.1:0/615387623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619b64179f0 0x5619b6810460 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fadd8031440 tx=0x7fadd8004500 comp rx=0 tx=0).stop 2024-09-21T00:57:41.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.625+0000 7fadf3343740 1 -- 172.21.15.1:0/615387623 shutdown_connections 2024-09-21T00:57:41.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.625+0000 7fadf3343740 1 --2- 172.21.15.1:0/615387623 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x5619b6459070 0x5619b688b6e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.625+0000 7fadf3343740 1 --2- 172.21.15.1:0/615387623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619b6438390 0x5619b6887750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.625+0000 7fadf3343740 1 --2- 172.21.15.1:0/615387623 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619b64301b0 0x5619b68109a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.625+0000 7fadcdffb640 0 client.25270 ms_handle_reset on v2:172.21.15.42:6836/2395608508 2024-09-21T00:57:41.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.625+0000 7fadf3343740 1 --2- 172.21.15.1:0/615387623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619b64179f0 0x5619b6810460 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.625+0000 7fadf3343740 1 -- 172.21.15.1:0/615387623 >> 172.21.15.1:0/615387623 conn(0x5619b644d460 msgr2=0x5619b68033c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:41.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.625+0000 7fadf3343740 1 -- 172.21.15.1:0/615387623 shutdown_connections 2024-09-21T00:57:41.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.625+0000 7fadf3343740 1 -- 172.21.15.1:0/615387623 wait complete. 2024-09-21T00:57:41.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.625+0000 7fadf3343740 20 client.25270 trim_cache size 0 max 16384 2024-09-21T00:57:41.628 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T00:57:41.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.627+0000 7fadecdcf640 1 -- 172.21.15.1:0/623154489 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fadd00b66d0 msgr2=0x7fadd00b8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:41.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.627+0000 7fadecdcf640 1 --2- 172.21.15.1:0/623154489 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fadd00b66d0 0x7fadd00b8be0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x5619b67fef40 tx=0x7fadd8005a20 comp rx=0 tx=0).stop 2024-09-21T00:57:41.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.627+0000 7fadecdcf640 1 -- 172.21.15.1:0/623154489 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fade81094b0 msgr2=0x7fade819aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:41.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.627+0000 7fadecdcf640 1 --2- 172.21.15.1:0/623154489 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fade81094b0 0x7fade819aa60 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fade8075ab0 tx=0x7faddc00ef10 comp rx=0 tx=0).stop 2024-09-21T00:57:41.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.627+0000 7fadecdcf640 1 -- 172.21.15.1:0/623154489 shutdown_connections 2024-09-21T00:57:41.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.627+0000 7fadecdcf640 1 --2- 172.21.15.1:0/623154489 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fade8109e00 0x7fade819fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.627+0000 7fadecdcf640 1 --2- 172.21.15.1:0/623154489 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fadd00b66d0 0x7fadd00b8be0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.627+0000 7fadecdcf640 1 --2- 172.21.15.1:0/623154489 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fade81094b0 0x7fade819aa60 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.627+0000 7fadecdcf640 1 --2- 172.21.15.1:0/623154489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fade8101f70 0x7fade819a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.627+0000 7fadecdcf640 1 -- 172.21.15.1:0/623154489 >> 172.21.15.1:0/623154489 conn(0x7fade8077c60 msgr2=0x7fade81075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:41.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.629+0000 7fadecdcf640 1 -- 172.21.15.1:0/623154489 shutdown_connections 2024-09-21T00:57:41.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:41.629+0000 7fadecdcf640 1 -- 172.21.15.1:0/623154489 wait complete. 2024-09-21T00:57:41.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:41 smithi001 ceph-mon[31211]: pgmap v372: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T00:57:41.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:41 smithi193 ceph-mon[34660]: pgmap v372: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T00:57:41.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:41 smithi042 ceph-mon[34481]: pgmap v372: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T00:57:42.311 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T00:57:42.607 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:43.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.194+0000 7f79091f0640 1 -- 172.21.15.1:0/284197269 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7904108cf0 msgr2=0x7f790410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:43.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.194+0000 7f79091f0640 1 --2- 172.21.15.1:0/284197269 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7904108cf0 0x7f790410f520 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f78fc009ca0 tx=0x7f78fc02a8c0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.194+0000 7f79091f0640 1 -- 172.21.15.1:0/284197269 shutdown_connections 2024-09-21T00:57:43.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.194+0000 7f79091f0640 1 --2- 172.21.15.1:0/284197269 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7904108cf0 0x7f790410f520 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.194+0000 7f79091f0640 1 --2- 172.21.15.1:0/284197269 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79041083a0 0x7f79041087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.194+0000 7f79091f0640 1 --2- 172.21.15.1:0/284197269 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7904102a60 0x7f7904102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.194+0000 7f79091f0640 1 -- 172.21.15.1:0/284197269 >> 172.21.15.1:0/284197269 conn(0x7f7904079730 msgr2=0x7f7904079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:43.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.195+0000 7f79091f0640 1 -- 172.21.15.1:0/284197269 shutdown_connections 2024-09-21T00:57:43.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.195+0000 7f79091f0640 1 -- 172.21.15.1:0/284197269 wait complete. 2024-09-21T00:57:43.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.196+0000 7f79091f0640 1 Processor -- start 2024-09-21T00:57:43.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.196+0000 7f79091f0640 1 -- start start 2024-09-21T00:57:43.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.196+0000 7f79091f0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7904102a60 0x7f790419a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:43.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.197+0000 7f79091f0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79041083a0 0x7f790419a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:43.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.197+0000 7f79091f0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7904108cf0 0x7f790419fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:43.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.197+0000 7f79091f0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7904113a80 con 0x7f7904108cf0 2024-09-21T00:57:43.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.197+0000 7f79091f0640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7904113900 con 0x7f79041083a0 2024-09-21T00:57:43.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.197+0000 7f79091f0640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7904113c00 con 0x7f7904102a60 2024-09-21T00:57:43.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.197+0000 7f78fbfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79041083a0 0x7f790419a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:43.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.197+0000 7f78fbfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79041083a0 0x7f790419a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:42308/0 (socket says 172.21.15.1:42308) 2024-09-21T00:57:43.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.197+0000 7f78fbfff640 1 -- 172.21.15.1:0/401202221 learned_addr learned my addr 172.21.15.1:0/401202221 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.197+0000 7f790359e640 1 --2- 172.21.15.1:0/401202221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7904108cf0 0x7f790419fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.197+0000 7f7902d9d640 1 --2- 172.21.15.1:0/401202221 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7904102a60 0x7f790419a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.197+0000 7f78fbfff640 1 -- 172.21.15.1:0/401202221 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7904102a60 msgr2=0x7f790419a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.198+0000 7f78fbfff640 1 --2- 172.21.15.1:0/401202221 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7904102a60 0x7f790419a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.198+0000 7f78fbfff640 1 -- 172.21.15.1:0/401202221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7904108cf0 msgr2=0x7f790419fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.198+0000 7f78fbfff640 1 --2- 172.21.15.1:0/401202221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7904108cf0 0x7f790419fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.198+0000 7f78fbfff640 1 -- 172.21.15.1:0/401202221 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79041a0380 con 0x7f79041083a0 2024-09-21T00:57:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.198+0000 7f7902d9d640 1 --2- 172.21.15.1:0/401202221 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7904102a60 0x7f790419a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:57:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.198+0000 7f78fbfff640 1 --2- 172.21.15.1:0/401202221 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79041083a0 0x7f790419a9b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f78ec00afa0 tx=0x7f78ec00cd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.198+0000 7f7900d99640 1 -- 172.21.15.1:0/401202221 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ec007b80 con 0x7f79041083a0 2024-09-21T00:57:43.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.198+0000 7f7900d99640 1 -- 172.21.15.1:0/401202221 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78ec007d20 con 0x7f79041083a0 2024-09-21T00:57:43.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.198+0000 7f7900d99640 1 -- 172.21.15.1:0/401202221 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ec011750 con 0x7f79041083a0 2024-09-21T00:57:43.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.198+0000 7f79091f0640 1 -- 172.21.15.1:0/401202221 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79041a0670 con 0x7f79041083a0 2024-09-21T00:57:43.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.198+0000 7f79091f0640 1 -- 172.21.15.1:0/401202221 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f790410fe90 con 0x7f79041083a0 2024-09-21T00:57:43.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.202+0000 7f790f764740 1 Processor -- start 2024-09-21T00:57:43.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.202+0000 7f790f764740 1 -- start start 2024-09-21T00:57:43.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.202+0000 7f790f764740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5596ab25f070 0x5596ab6066a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:43.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.203+0000 7f790f764740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596ab2361b0 0x5596ab606be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:43.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.203+0000 7f790f764740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596ab23e390 0x5596ab607120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:43.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.203+0000 7f790f764740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5596ab57cea0 con 0x5596ab23e390 2024-09-21T00:57:43.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.203+0000 7f790f764740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5596ab56c2d0 con 0x5596ab2361b0 2024-09-21T00:57:43.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.203+0000 7f790f764740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5596ab5700e0 con 0x5596ab25f070 2024-09-21T00:57:43.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.203+0000 7f790359e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5596ab25f070 0x5596ab6066a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:43.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.203+0000 7f7902d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596ab2361b0 0x5596ab606be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:43.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.203+0000 7f790359e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5596ab25f070 0x5596ab6066a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:37882/0 (socket says 172.21.15.1:37882) 2024-09-21T00:57:43.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.203+0000 7f7902d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596ab2361b0 0x5596ab606be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:42318/0 (socket says 172.21.15.1:42318) 2024-09-21T00:57:43.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.203+0000 7f790359e640 1 -- 172.21.15.1:0/2713438080 learned_addr learned my addr 172.21.15.1:0/2713438080 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:43.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.203+0000 7f790359e640 1 -- 172.21.15.1:0/2713438080 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596ab2361b0 msgr2=0x5596ab606be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:43.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.203+0000 7f790359e640 1 --2- 172.21.15.1:0/2713438080 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596ab2361b0 0x5596ab606be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.203+0000 7f790359e640 1 -- 172.21.15.1:0/2713438080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596ab23e390 msgr2=0x5596ab607120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T00:57:43.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.203+0000 7f790359e640 1 --2- 172.21.15.1:0/2713438080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596ab23e390 0x5596ab607120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.203+0000 7f790359e640 1 -- 172.21.15.1:0/2713438080 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596ab2ca650 con 0x5596ab25f070 2024-09-21T00:57:43.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.203+0000 7f7900d99640 1 -- 172.21.15.1:0/401202221 <== mon.2 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 154562+0+0 (secure 0 0 0) 0x7f78ec0118f0 con 0x7f79041083a0 2024-09-21T00:57:43.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.204+0000 7f790359e640 1 --2- 172.21.15.1:0/2713438080 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5596ab25f070 0x5596ab6066a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f78fc0098b0 tx=0x7f78fc0098e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c3718f2d9b1edd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:43.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.204+0000 7f78f97fa640 1 -- 172.21.15.1:0/2713438080 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc031e30 con 0x5596ab25f070 2024-09-21T00:57:43.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.204+0000 7f78f97fa640 1 -- 172.21.15.1:0/2713438080 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78fc036030 con 0x5596ab25f070 2024-09-21T00:57:43.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.204+0000 7f78f97fa640 1 -- 172.21.15.1:0/2713438080 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc0043b0 con 0x5596ab25f070 2024-09-21T00:57:43.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.205+0000 7f790f764740 1 -- 172.21.15.1:0/2713438080 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5596ab25f070 msgr2=0x5596ab6066a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:43.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.205+0000 7f790f764740 1 --2- 172.21.15.1:0/2713438080 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5596ab25f070 0x5596ab6066a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f78fc0098b0 tx=0x7f78fc0098e0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.205+0000 7f7900d99640 1 --2- 172.21.15.1:0/401202221 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f78f00b6620 0x7f78f00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:43.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.205+0000 7f790359e640 1 --2- 172.21.15.1:0/401202221 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f78f00b6620 0x7f78f00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:43.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.206+0000 7f790f764740 1 -- 172.21.15.1:0/2713438080 shutdown_connections 2024-09-21T00:57:43.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.206+0000 7f790f764740 1 --2- 172.21.15.1:0/2713438080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596ab23e390 0x5596ab607120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.206+0000 7f790f764740 1 --2- 172.21.15.1:0/2713438080 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596ab2361b0 0x5596ab606be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.206+0000 7f790f764740 1 --2- 172.21.15.1:0/2713438080 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5596ab25f070 0x5596ab6066a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.206+0000 7f790f764740 1 -- 172.21.15.1:0/2713438080 >> 172.21.15.1:0/2713438080 conn(0x5596ab253460 msgr2=0x5596ab604590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:43.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.206+0000 7f7900d99640 1 -- 172.21.15.1:0/401202221 <== mon.2 v2:172.21.15.42:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f78ec0eb0e0 con 0x7f79041083a0 2024-09-21T00:57:43.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.206+0000 7f790f764740 1 -- 172.21.15.1:0/2713438080 shutdown_connections 2024-09-21T00:57:43.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.206+0000 7f790f764740 1 -- 172.21.15.1:0/2713438080 wait complete. 2024-09-21T00:57:43.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.207+0000 7f790359e640 1 --2- 172.21.15.1:0/401202221 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f78f00b6620 0x7f78f00b8b30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f78fc02f470 tx=0x7f78fc0095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:43.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.207+0000 7f790f764740 1 -- start start 2024-09-21T00:57:43.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.207+0000 7f790f764740 1 Processor -- start 2024-09-21T00:57:43.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.208+0000 7f790f764740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596ab2361b0 0x5596ab611db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:43.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.208+0000 7f790f764740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5596ab25f070 0x5596ab6122f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:43.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.208+0000 7f790f764740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596ab21d9f0 0x5596ab61dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:43.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.208+0000 7f790f764740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5596ab3cd700 con 0x5596ab21d9f0 2024-09-21T00:57:43.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.208+0000 7f790f764740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5596ab507160 con 0x5596ab2361b0 2024-09-21T00:57:43.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.208+0000 7f790f764740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5596ab614ca0 con 0x5596ab25f070 2024-09-21T00:57:43.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.208+0000 7f790f764740 10 client.0 _ll_register_callbacks cb 0x5596ab5209e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:43.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.208+0000 7f790359e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596ab21d9f0 0x5596ab61dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:43.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.208+0000 7f790359e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596ab21d9f0 0x5596ab61dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32942/0 (socket says 172.21.15.1:32942) 2024-09-21T00:57:43.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.208+0000 7f790359e640 1 -- 172.21.15.1:0/822515889 learned_addr learned my addr 172.21.15.1:0/822515889 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:43.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.208+0000 7f78fbfff640 1 --2- 172.21.15.1:0/822515889 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5596ab25f070 0x5596ab6122f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:43.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.208+0000 7f7902d9d640 1 --2- 172.21.15.1:0/822515889 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596ab2361b0 0x5596ab611db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:43.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.208+0000 7f78fbfff640 1 -- 172.21.15.1:0/822515889 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596ab2361b0 msgr2=0x5596ab611db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:43.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.208+0000 7f78fbfff640 1 --2- 172.21.15.1:0/822515889 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596ab2361b0 0x5596ab611db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.208+0000 7f78fbfff640 1 -- 172.21.15.1:0/822515889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596ab21d9f0 msgr2=0x5596ab61dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:43.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.208+0000 7f78fbfff640 1 --2- 172.21.15.1:0/822515889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596ab21d9f0 0x5596ab61dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.208+0000 7f78fbfff640 1 -- 172.21.15.1:0/822515889 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596ab534c90 con 0x5596ab25f070 2024-09-21T00:57:43.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.208+0000 7f790359e640 1 --2- 172.21.15.1:0/822515889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596ab21d9f0 0x5596ab61dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:43.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.209+0000 7f78fbfff640 1 --2- 172.21.15.1:0/822515889 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5596ab25f070 0x5596ab6122f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f78ec0e8a70 tx=0x7f78ec0e8ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60a6f96ce1e84a3f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:43.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.209+0000 7f78ea7fc640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T00:57:43.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.209+0000 7f78ea7fc640 1 -- 172.21.15.1:0/822515889 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ec0b5bd0 con 0x5596ab25f070 2024-09-21T00:57:43.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.209+0000 7f78ea7fc640 1 -- 172.21.15.1:0/822515889 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f78ec0b0350 con 0x5596ab25f070 2024-09-21T00:57:43.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.209+0000 7f790f764740 1 -- 172.21.15.1:0/822515889 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78fc036030 con 0x5596ab25f070 2024-09-21T00:57:43.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.209+0000 7f78ea7fc640 1 -- 172.21.15.1:0/822515889 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f78ec0bab10 con 0x5596ab25f070 2024-09-21T00:57:43.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.209+0000 7f790f764740 10 client.25279 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:43.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.209+0000 7f790f764740 1 -- 172.21.15.1:0/822515889 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5596ab6292e0 con 0x5596ab25f070 2024-09-21T00:57:43.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.209+0000 7f78ea7fc640 1 -- 172.21.15.1:0/822515889 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78fc036030 con 0x5596ab25f070 2024-09-21T00:57:43.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.211+0000 7f78ea7fc640 1 -- 172.21.15.1:0/822515889 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f78ec0aca40 con 0x5596ab25f070 2024-09-21T00:57:43.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.211+0000 7f790f764740 10 client.25279 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:43.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.211+0000 7f790f764740 10 client.25279 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T00:57:43.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.211+0000 7f790f764740 20 client.25279 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:43.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.211+0000 7f790f764740 1 --2- 172.21.15.1:0/822515889 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5596ab1f2da0 0x5596ab62c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:43.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.211+0000 7f790f764740 4 client.25279 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:57:43.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.211+0000 7f790f764740 1 -- 172.21.15.1:0/822515889 --> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596ab57edf0 con 0x5596ab1f2da0 2024-09-21T00:57:43.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.211+0000 7f7902d9d640 1 --2- 172.21.15.1:0/822515889 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5596ab1f2da0 0x5596ab62c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:43.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.212+0000 7f78ea7fc640 10 client.25279 ms_handle_connect on v2:172.21.15.193:6838/1365361177 2024-09-21T00:57:43.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.212+0000 7f7902d9d640 1 --2- 172.21.15.1:0/822515889 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5596ab1f2da0 0x5596ab62c720 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=69ce7c20bf3637ab server_cookie=4fd7535b43e74372 in_seq=0 out_seq=0 2024-09-21T00:57:43.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.212+0000 7f78ea7fc640 1 -- 172.21.15.1:0/822515889 <== mds.1 v2:172.21.15.193:6838/1365361177 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5596ab57edf0 con 0x5596ab1f2da0 2024-09-21T00:57:43.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.212+0000 7f78ea7fc640 10 client.25279 handle_command_reply: tid=0 2024-09-21T00:57:43.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.213+0000 7f790f764740 1 client.25279 shutdown 2024-09-21T00:57:43.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.213+0000 7f790f764740 1 -- 172.21.15.1:0/822515889 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5596ab25f070 msgr2=0x5596ab6122f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:43.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.213+0000 7f790f764740 1 --2- 172.21.15.1:0/822515889 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5596ab25f070 0x5596ab6122f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f78ec0e8a70 tx=0x7f78ec0e8ef0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.213+0000 7f790f764740 1 -- 172.21.15.1:0/822515889 shutdown_connections 2024-09-21T00:57:43.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.213+0000 7f790f764740 1 --2- 172.21.15.1:0/822515889 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5596ab1f2da0 0x5596ab62c720 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.213+0000 7f790f764740 1 --2- 172.21.15.1:0/822515889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596ab21d9f0 0x5596ab61dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.213+0000 7f790f764740 1 --2- 172.21.15.1:0/822515889 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5596ab25f070 0x5596ab6122f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.213+0000 7f78ea7fc640 0 client.25279 ms_handle_reset on v2:172.21.15.193:6838/1365361177 2024-09-21T00:57:43.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.213+0000 7f790f764740 1 --2- 172.21.15.1:0/822515889 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596ab2361b0 0x5596ab611db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.213+0000 7f790f764740 1 -- 172.21.15.1:0/822515889 >> 172.21.15.1:0/822515889 conn(0x5596ab253460 msgr2=0x5596ab609830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:43.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.213+0000 7f790f764740 1 -- 172.21.15.1:0/822515889 shutdown_connections 2024-09-21T00:57:43.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.213+0000 7f790f764740 1 -- 172.21.15.1:0/822515889 wait complete. 2024-09-21T00:57:43.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.213+0000 7f790f764740 20 client.25279 trim_cache size 0 max 16384 2024-09-21T00:57:43.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.240+0000 7f790f764740 1 Processor -- start 2024-09-21T00:57:43.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.240+0000 7f790f764740 1 -- start start 2024-09-21T00:57:43.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.240+0000 7f790f764740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5596ab1f2da0 0x5596ab6139e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:43.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.240+0000 7f790f764740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596ab21d9f0 0x5596ab61def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:43.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.240+0000 7f790f764740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596ab2361b0 0x5596ab60efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:43.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.240+0000 7f790f764740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7904073180 con 0x5596ab21d9f0 2024-09-21T00:57:43.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.240+0000 7f790f764740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7904074cc0 con 0x5596ab2361b0 2024-09-21T00:57:43.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.240+0000 7f790f764740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7904073850 con 0x5596ab1f2da0 2024-09-21T00:57:43.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.241+0000 7f78fbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596ab21d9f0 0x5596ab61def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:43.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.241+0000 7f78fbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596ab21d9f0 0x5596ab61def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32954/0 (socket says 172.21.15.1:32954) 2024-09-21T00:57:43.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.241+0000 7f7902d9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5596ab1f2da0 0x5596ab6139e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:43.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.241+0000 7f78fbfff640 1 -- 172.21.15.1:0/3736416846 learned_addr learned my addr 172.21.15.1:0/3736416846 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:43.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.241+0000 7f790359e640 1 --2- 172.21.15.1:0/3736416846 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596ab2361b0 0x5596ab60efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:43.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.241+0000 7f7902d9d640 1 -- 172.21.15.1:0/3736416846 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596ab2361b0 msgr2=0x5596ab60efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:43.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.241+0000 7f7902d9d640 1 --2- 172.21.15.1:0/3736416846 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596ab2361b0 0x5596ab60efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.241+0000 7f7902d9d640 1 -- 172.21.15.1:0/3736416846 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596ab21d9f0 msgr2=0x5596ab61def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:43.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.241+0000 7f7902d9d640 1 --2- 172.21.15.1:0/3736416846 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596ab21d9f0 0x5596ab61def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.241+0000 7f7902d9d640 1 -- 172.21.15.1:0/3736416846 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596ab614be0 con 0x5596ab1f2da0 2024-09-21T00:57:43.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.241+0000 7f78fbfff640 1 --2- 172.21.15.1:0/3736416846 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596ab21d9f0 0x5596ab61def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:43.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.241+0000 7f7902d9d640 1 --2- 172.21.15.1:0/3736416846 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5596ab1f2da0 0x5596ab6139e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x5596ab62cdd0 tx=0x7f78f4009f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93039f01d96c5eec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:43.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.242+0000 7f78f8ff9640 1 -- 172.21.15.1:0/3736416846 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f4003e80 con 0x5596ab1f2da0 2024-09-21T00:57:43.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.242+0000 7f78f8ff9640 1 -- 172.21.15.1:0/3736416846 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78f401e8d0 con 0x5596ab1f2da0 2024-09-21T00:57:43.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.242+0000 7f78f8ff9640 1 -- 172.21.15.1:0/3736416846 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f4012af0 con 0x5596ab1f2da0 2024-09-21T00:57:43.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.243+0000 7f790f764740 1 -- 172.21.15.1:0/3736416846 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5596ab1f2da0 msgr2=0x5596ab6139e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:43.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.243+0000 7f790f764740 1 --2- 172.21.15.1:0/3736416846 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5596ab1f2da0 0x5596ab6139e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x5596ab62cdd0 tx=0x7f78f4009f10 comp rx=0 tx=0).stop 2024-09-21T00:57:43.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.243+0000 7f790f764740 1 -- 172.21.15.1:0/3736416846 shutdown_connections 2024-09-21T00:57:43.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.243+0000 7f790f764740 1 --2- 172.21.15.1:0/3736416846 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596ab2361b0 0x5596ab60efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.243+0000 7f790f764740 1 --2- 172.21.15.1:0/3736416846 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596ab21d9f0 0x5596ab61def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.243+0000 7f790f764740 1 --2- 172.21.15.1:0/3736416846 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5596ab1f2da0 0x5596ab6139e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.243+0000 7f790f764740 1 -- 172.21.15.1:0/3736416846 >> 172.21.15.1:0/3736416846 conn(0x5596ab253460 msgr2=0x5596ab6132d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:43.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.243+0000 7f790f764740 1 -- 172.21.15.1:0/3736416846 shutdown_connections 2024-09-21T00:57:43.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.243+0000 7f790f764740 1 -- 172.21.15.1:0/3736416846 wait complete. 2024-09-21T00:57:43.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.244+0000 7f790f764740 1 -- start start 2024-09-21T00:57:43.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.244+0000 7f790f764740 1 Processor -- start 2024-09-21T00:57:43.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.244+0000 7f790f764740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596ab1f2da0 0x5596ab616840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:43.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.245+0000 7f790f764740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596ab21d9f0 0x5596ab616e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:43.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.245+0000 7f790f764740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5596ab2361b0 0x5596ab690060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:43.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.245+0000 7f7902d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596ab1f2da0 0x5596ab616840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:43.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.245+0000 7f78fbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596ab21d9f0 0x5596ab616e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:43.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.245+0000 7f7902d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596ab1f2da0 0x5596ab616840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:42350/0 (socket says 172.21.15.1:42350) 2024-09-21T00:57:43.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.245+0000 7f7902d9d640 1 -- 172.21.15.1:0/1571823333 learned_addr learned my addr 172.21.15.1:0/1571823333 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:43.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.245+0000 7f790f764740 1 -- 172.21.15.1:0/1571823333 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f79040745f0 con 0x5596ab21d9f0 2024-09-21T00:57:43.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.245+0000 7f790359e640 1 --2- 172.21.15.1:0/1571823333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5596ab2361b0 0x5596ab690060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:43.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.245+0000 7f790f764740 1 -- 172.21.15.1:0/1571823333 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7904073f20 con 0x5596ab1f2da0 2024-09-21T00:57:43.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.245+0000 7f790f764740 1 -- 172.21.15.1:0/1571823333 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7904071160 con 0x5596ab2361b0 2024-09-21T00:57:43.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.245+0000 7f790359e640 1 -- 172.21.15.1:0/1571823333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596ab1f2da0 msgr2=0x5596ab616840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:43.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.245+0000 7f790359e640 1 --2- 172.21.15.1:0/1571823333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596ab1f2da0 0x5596ab616840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.245+0000 7f790359e640 1 -- 172.21.15.1:0/1571823333 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596ab21d9f0 msgr2=0x5596ab616e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:43.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.245+0000 7f790359e640 1 --2- 172.21.15.1:0/1571823333 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596ab21d9f0 0x5596ab616e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.245+0000 7f790359e640 1 -- 172.21.15.1:0/1571823333 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596ab6906d0 con 0x5596ab2361b0 2024-09-21T00:57:43.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.245+0000 7f78fbfff640 1 --2- 172.21.15.1:0/1571823333 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596ab21d9f0 0x5596ab616e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:43.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.246+0000 7f790f764740 10 client.0 _ll_register_callbacks cb 0x7f78ec00a4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:43.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.246+0000 7f790f764740 1 -- 172.21.15.1:0/1571823333 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78f401e8d0 con 0x5596ab2361b0 2024-09-21T00:57:43.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.246+0000 7f790359e640 1 --2- 172.21.15.1:0/1571823333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5596ab2361b0 0x5596ab690060 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f78fc0098b0 tx=0x7f78fc0098e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20b00d3289a54ced server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:43.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.246+0000 7f78ea7fc640 10 client.25285 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T00:57:43.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.246+0000 7f78ea7fc640 1 -- 172.21.15.1:0/1571823333 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc060070 con 0x5596ab2361b0 2024-09-21T00:57:43.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.246+0000 7f78ea7fc640 1 -- 172.21.15.1:0/1571823333 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f78fc031860 con 0x5596ab2361b0 2024-09-21T00:57:43.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.246+0000 7f78ea7fc640 1 -- 172.21.15.1:0/1571823333 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f78fc02f660 con 0x5596ab2361b0 2024-09-21T00:57:43.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.246+0000 7f790f764740 10 client.25285 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:43.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.246+0000 7f790f764740 1 -- 172.21.15.1:0/1571823333 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({fsmap=27}) -- 0x5596ab6978d0 con 0x5596ab2361b0 2024-09-21T00:57:43.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.247+0000 7f78ea7fc640 1 -- 172.21.15.1:0/1571823333 <== mon.1 v2:172.21.15.193:3300/0 4 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f78fc043070 con 0x5596ab2361b0 2024-09-21T00:57:43.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.247+0000 7f790f764740 10 client.25285 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:43.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.247+0000 7f790f764740 10 client.25285 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T00:57:43.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.247+0000 7f790f764740 20 client.25285 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:43.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.247+0000 7f790f764740 1 --2- 172.21.15.1:0/1571823333 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5596ab25f070 0x5596ab699d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:43.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.247+0000 7f790f764740 4 client.25285 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:57:43.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.247+0000 7f790f764740 1 -- 172.21.15.1:0/1571823333 --> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5596ab57a8a0 con 0x5596ab25f070 2024-09-21T00:57:43.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.248+0000 7f7902d9d640 1 --2- 172.21.15.1:0/1571823333 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5596ab25f070 0x5596ab699d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:43.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.248+0000 7f78ea7fc640 10 client.25285 ms_handle_connect on v2:172.21.15.193:6838/1365361177 2024-09-21T00:57:43.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.248+0000 7f7902d9d640 1 --2- 172.21.15.1:0/1571823333 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5596ab25f070 0x5596ab699d40 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e49095818e503885 server_cookie=3db30c70751fec9b in_seq=0 out_seq=0 2024-09-21T00:57:43.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.248+0000 7f78ea7fc640 1 -- 172.21.15.1:0/1571823333 <== mds.1 v2:172.21.15.193:6838/1365361177 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5596ab57a8a0 con 0x5596ab25f070 2024-09-21T00:57:43.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.248+0000 7f78ea7fc640 10 client.25285 handle_command_reply: tid=0 2024-09-21T00:57:43.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.248+0000 7f790f764740 1 client.25285 shutdown 2024-09-21T00:57:43.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.249+0000 7f790f764740 1 -- 172.21.15.1:0/1571823333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5596ab2361b0 msgr2=0x5596ab690060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:43.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.249+0000 7f790f764740 1 --2- 172.21.15.1:0/1571823333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5596ab2361b0 0x5596ab690060 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f78fc0098b0 tx=0x7f78fc0098e0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.249+0000 7f790f764740 1 -- 172.21.15.1:0/1571823333 shutdown_connections 2024-09-21T00:57:43.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.249+0000 7f790f764740 1 --2- 172.21.15.1:0/1571823333 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5596ab25f070 0x5596ab699d40 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.249+0000 7f790f764740 1 --2- 172.21.15.1:0/1571823333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5596ab2361b0 0x5596ab690060 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.249+0000 7f78ea7fc640 0 client.25285 ms_handle_reset on v2:172.21.15.193:6838/1365361177 2024-09-21T00:57:43.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.249+0000 7f790f764740 1 --2- 172.21.15.1:0/1571823333 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596ab21d9f0 0x5596ab616e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.249+0000 7f790f764740 1 --2- 172.21.15.1:0/1571823333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596ab1f2da0 0x5596ab616840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.249+0000 7f790f764740 1 -- 172.21.15.1:0/1571823333 >> 172.21.15.1:0/1571823333 conn(0x5596ab253460 msgr2=0x5596ab6131f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:43.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.249+0000 7f790f764740 1 -- 172.21.15.1:0/1571823333 shutdown_connections 2024-09-21T00:57:43.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.249+0000 7f790f764740 1 -- 172.21.15.1:0/1571823333 wait complete. 2024-09-21T00:57:43.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.249+0000 7f790f764740 20 client.25285 trim_cache size 0 max 16384 2024-09-21T00:57:43.252 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T00:57:43.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.250+0000 7f79091f0640 1 -- 172.21.15.1:0/401202221 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f78f00b6620 msgr2=0x7f78f00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:43.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.250+0000 7f79091f0640 1 --2- 172.21.15.1:0/401202221 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f78f00b6620 0x7f78f00b8b30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f78fc02f470 tx=0x7f78fc0095c0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.250+0000 7f79091f0640 1 -- 172.21.15.1:0/401202221 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79041083a0 msgr2=0x7f790419a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:43.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.250+0000 7f79091f0640 1 --2- 172.21.15.1:0/401202221 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79041083a0 0x7f790419a9b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f78ec00afa0 tx=0x7f78ec00cd50 comp rx=0 tx=0).stop 2024-09-21T00:57:43.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.250+0000 7f79091f0640 1 -- 172.21.15.1:0/401202221 shutdown_connections 2024-09-21T00:57:43.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.250+0000 7f79091f0640 1 --2- 172.21.15.1:0/401202221 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f78f00b6620 0x7f78f00b8b30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.251+0000 7f79091f0640 1 --2- 172.21.15.1:0/401202221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7904108cf0 0x7f790419fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.251+0000 7f79091f0640 1 --2- 172.21.15.1:0/401202221 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79041083a0 0x7f790419a9b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.251+0000 7f79091f0640 1 --2- 172.21.15.1:0/401202221 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7904102a60 0x7f790419a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.251+0000 7f79091f0640 1 -- 172.21.15.1:0/401202221 >> 172.21.15.1:0/401202221 conn(0x7f7904079730 msgr2=0x7f7904104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:43.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.251+0000 7f79091f0640 1 -- 172.21.15.1:0/401202221 shutdown_connections 2024-09-21T00:57:43.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:43.251+0000 7f79091f0640 1 -- 172.21.15.1:0/401202221 wait complete. 2024-09-21T00:57:43.912 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:43 smithi001 ceph-mon[31211]: pgmap v373: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T00:57:43.952 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T00:57:43.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:43 smithi193 ceph-mon[34660]: pgmap v373: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T00:57:43.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:43 smithi042 ceph-mon[34481]: pgmap v373: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T00:57:44.344 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:44.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.928+0000 7fd7c77c3640 1 -- 172.21.15.1:0/4201749746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7c0102a60 msgr2=0x7fd7c0102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:44.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.928+0000 7fd7c77c3640 1 --2- 172.21.15.1:0/4201749746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7c0102a60 0x7fd7c0102e70 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc009900 tx=0x7fd7bc02a400 comp rx=0 tx=0).stop 2024-09-21T00:57:44.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.928+0000 7fd7c77c3640 1 -- 172.21.15.1:0/4201749746 shutdown_connections 2024-09-21T00:57:44.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.928+0000 7fd7c77c3640 1 --2- 172.21.15.1:0/4201749746 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7c0108cf0 0x7fd7c010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.928+0000 7fd7c77c3640 1 --2- 172.21.15.1:0/4201749746 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd7c01083a0 0x7fd7c01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.928+0000 7fd7c77c3640 1 --2- 172.21.15.1:0/4201749746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7c0102a60 0x7fd7c0102e70 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.928+0000 7fd7c77c3640 1 -- 172.21.15.1:0/4201749746 >> 172.21.15.1:0/4201749746 conn(0x7fd7c0079730 msgr2=0x7fd7c0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:44.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.928+0000 7fd7c77c3640 1 -- 172.21.15.1:0/4201749746 shutdown_connections 2024-09-21T00:57:44.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.928+0000 7fd7c77c3640 1 -- 172.21.15.1:0/4201749746 wait complete. 2024-09-21T00:57:44.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.929+0000 7fd7c77c3640 1 Processor -- start 2024-09-21T00:57:44.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.929+0000 7fd7c77c3640 1 -- start start 2024-09-21T00:57:44.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.930+0000 7fd7c77c3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd7c0102a60 0x7fd7c019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:44.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.930+0000 7fd7c77c3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7c01083a0 0x7fd7c019aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:44.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.930+0000 7fd7c77c3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7c0108cf0 0x7fd7c019fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:44.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.930+0000 7fd7c77c3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c01129c0 con 0x7fd7c01083a0 2024-09-21T00:57:44.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.930+0000 7fd7c77c3640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c0112840 con 0x7fd7c0108cf0 2024-09-21T00:57:44.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.930+0000 7fd7c77c3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c0112b40 con 0x7fd7c0102a60 2024-09-21T00:57:44.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.930+0000 7fd7c4d5e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7c01083a0 0x7fd7c019aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:44.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.930+0000 7fd7c555f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd7c0102a60 0x7fd7c019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:44.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.930+0000 7fd7c555f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd7c0102a60 0x7fd7c019a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:37922/0 (socket says 172.21.15.1:37922) 2024-09-21T00:57:44.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.930+0000 7fd7c555f640 1 -- 172.21.15.1:0/3263195623 learned_addr learned my addr 172.21.15.1:0/3263195623 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:44.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.930+0000 7fd7c5d60640 1 --2- 172.21.15.1:0/3263195623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7c0108cf0 0x7fd7c019fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:44.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.931+0000 7fd7c555f640 1 -- 172.21.15.1:0/3263195623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7c0108cf0 msgr2=0x7fd7c019fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:44.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.931+0000 7fd7c555f640 1 --2- 172.21.15.1:0/3263195623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7c0108cf0 0x7fd7c019fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.931+0000 7fd7c555f640 1 -- 172.21.15.1:0/3263195623 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7c01083a0 msgr2=0x7fd7c019aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:44.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.931+0000 7fd7c555f640 1 --2- 172.21.15.1:0/3263195623 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7c01083a0 0x7fd7c019aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.931+0000 7fd7c555f640 1 -- 172.21.15.1:0/3263195623 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c01a0480 con 0x7fd7c0102a60 2024-09-21T00:57:44.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.931+0000 7fd7c4d5e640 1 --2- 172.21.15.1:0/3263195623 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7c01083a0 0x7fd7c019aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:44.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.931+0000 7fd7c555f640 1 --2- 172.21.15.1:0/3263195623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd7c0102a60 0x7fd7c019a510 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc005940 tx=0x7fd7bc0042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:44.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.931+0000 7fd7b67fc640 1 -- 172.21.15.1:0/3263195623 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc03f030 con 0x7fd7c0102a60 2024-09-21T00:57:44.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.931+0000 7fd7b67fc640 1 -- 172.21.15.1:0/3263195623 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7bc003cb0 con 0x7fd7c0102a60 2024-09-21T00:57:44.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.931+0000 7fd7b67fc640 1 -- 172.21.15.1:0/3263195623 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc035070 con 0x7fd7c0102a60 2024-09-21T00:57:44.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.931+0000 7fd7c77c3640 1 -- 172.21.15.1:0/3263195623 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7c01a0710 con 0x7fd7c0102a60 2024-09-21T00:57:44.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.932+0000 7fd7c77c3640 1 -- 172.21.15.1:0/3263195623 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7c01a0ab0 con 0x7fd7c0102a60 2024-09-21T00:57:44.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.935+0000 7fd7cdd37740 1 Processor -- start 2024-09-21T00:57:44.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.935+0000 7fd7cdd37740 1 -- start start 2024-09-21T00:57:44.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.936+0000 7fd7cdd37740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e6896b4070 0x55e689a5b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:44.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.936+0000 7fd7cdd37740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e68968b1b0 0x55e689a5bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:44.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.936+0000 7fd7cdd37740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e689693390 0x55e689a5c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:44.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.936+0000 7fd7cdd37740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e6899d1ea0 con 0x55e68968b1b0 2024-09-21T00:57:44.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.936+0000 7fd7cdd37740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e6899c12d0 con 0x55e6896b4070 2024-09-21T00:57:44.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.936+0000 7fd7cdd37740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55e6899c50e0 con 0x55e689693390 2024-09-21T00:57:44.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.936+0000 7fd7c4d5e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e689693390 0x55e689a5c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:44.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.936+0000 7fd7c5d60640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e6896b4070 0x55e689a5b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:44.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.936+0000 7fd7c4d5e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e689693390 0x55e689a5c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:37930/0 (socket says 172.21.15.1:37930) 2024-09-21T00:57:44.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.936+0000 7fd7c4d5e640 1 -- 172.21.15.1:0/1681730443 learned_addr learned my addr 172.21.15.1:0/1681730443 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:44.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.936+0000 7fd7b67fc640 1 -- 172.21.15.1:0/3263195623 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 19) ==== 154562+0+0 (secure 0 0 0) 0x7fd7bc042030 con 0x7fd7c0102a60 2024-09-21T00:57:44.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.936+0000 7fd7c4d5e640 1 -- 172.21.15.1:0/1681730443 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e6896b4070 msgr2=0x55e689a5b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:44.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.936+0000 7fd7c4d5e640 1 --2- 172.21.15.1:0/1681730443 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e6896b4070 0x55e689a5b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.936+0000 7fd7c4d5e640 1 -- 172.21.15.1:0/1681730443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e68968b1b0 msgr2=0x55e689a5bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:44.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.936+0000 7fd7c555f640 1 --2- 172.21.15.1:0/1681730443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e68968b1b0 0x55e689a5bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:44.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.937+0000 7fd7c4d5e640 1 --2- 172.21.15.1:0/1681730443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e68968b1b0 0x55e689a5bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.937+0000 7fd7c4d5e640 1 -- 172.21.15.1:0/1681730443 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e68971f650 con 0x55e689693390 2024-09-21T00:57:44.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.937+0000 7fd7c5d60640 1 --2- 172.21.15.1:0/1681730443 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e6896b4070 0x55e689a5b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:44.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.937+0000 7fd7c555f640 1 --2- 172.21.15.1:0/1681730443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e68968b1b0 0x55e689a5bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:57:44.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.938+0000 7fd7b67fc640 1 --2- 172.21.15.1:0/3263195623 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd7ac0b65a0 0x7fd7ac0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:44.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.938+0000 7fd7c5d60640 1 --2- 172.21.15.1:0/3263195623 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd7ac0b65a0 0x7fd7ac0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:44.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.938+0000 7fd7b67fc640 1 -- 172.21.15.1:0/3263195623 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fd7bc107dc0 con 0x7fd7c0102a60 2024-09-21T00:57:44.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.938+0000 7fd7c4d5e640 1 --2- 172.21.15.1:0/1681730443 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e689693390 0x55e689a5c120 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0009de0 tx=0x7fd7b000e5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75574d6217d744ef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:44.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.938+0000 7fd7c5d60640 1 --2- 172.21.15.1:0/3263195623 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd7ac0b65a0 0x7fd7ac0b8ab0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8005fd0 tx=0x7fd7b8009860 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:44.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.939+0000 7fd7ab7fe640 1 -- 172.21.15.1:0/1681730443 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b0017070 con 0x55e689693390 2024-09-21T00:57:44.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.939+0000 7fd7ab7fe640 1 -- 172.21.15.1:0/1681730443 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7b0013920 con 0x55e689693390 2024-09-21T00:57:44.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.939+0000 7fd7ab7fe640 1 -- 172.21.15.1:0/1681730443 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b0012930 con 0x55e689693390 2024-09-21T00:57:44.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.940+0000 7fd7cdd37740 1 -- 172.21.15.1:0/1681730443 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e689693390 msgr2=0x55e689a5c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:44.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.940+0000 7fd7cdd37740 1 --2- 172.21.15.1:0/1681730443 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e689693390 0x55e689a5c120 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0009de0 tx=0x7fd7b000e5a0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.940+0000 7fd7cdd37740 1 -- 172.21.15.1:0/1681730443 shutdown_connections 2024-09-21T00:57:44.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.940+0000 7fd7cdd37740 1 --2- 172.21.15.1:0/1681730443 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e689693390 0x55e689a5c120 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.940+0000 7fd7cdd37740 1 --2- 172.21.15.1:0/1681730443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e68968b1b0 0x55e689a5bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.940+0000 7fd7cdd37740 1 --2- 172.21.15.1:0/1681730443 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e6896b4070 0x55e689a5b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.940+0000 7fd7cdd37740 1 -- 172.21.15.1:0/1681730443 >> 172.21.15.1:0/1681730443 conn(0x55e6896a8460 msgr2=0x55e689a59590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:44.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.940+0000 7fd7cdd37740 1 -- 172.21.15.1:0/1681730443 shutdown_connections 2024-09-21T00:57:44.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.940+0000 7fd7cdd37740 1 -- 172.21.15.1:0/1681730443 wait complete. 2024-09-21T00:57:44.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.941+0000 7fd7cdd37740 1 -- start start 2024-09-21T00:57:44.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.941+0000 7fd7cdd37740 1 Processor -- start 2024-09-21T00:57:44.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.941+0000 7fd7cdd37740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e68968b1b0 0x55e689a6fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:44.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.941+0000 7fd7cdd37740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e689693390 0x55e689a70420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:44.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.942+0000 7fd7cdd37740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e6896b4070 0x55e689a75440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:44.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.942+0000 7fd7cdd37740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e689822700 con 0x55e6896b4070 2024-09-21T00:57:44.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.942+0000 7fd7cdd37740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e68995c160 con 0x55e689693390 2024-09-21T00:57:44.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.942+0000 7fd7cdd37740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55e689a69e80 con 0x55e68968b1b0 2024-09-21T00:57:44.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.942+0000 7fd7c555f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e68968b1b0 0x55e689a6fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:44.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.942+0000 7fd7cdd37740 10 client.0 _ll_register_callbacks cb 0x55e6899759e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:44.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.942+0000 7fd7c555f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e68968b1b0 0x55e689a6fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:37938/0 (socket says 172.21.15.1:37938) 2024-09-21T00:57:44.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.942+0000 7fd7c555f640 1 -- 172.21.15.1:0/1920131991 learned_addr learned my addr 172.21.15.1:0/1920131991 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:44.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.942+0000 7fd7c4d5e640 1 --2- 172.21.15.1:0/1920131991 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e689693390 0x55e689a70420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:44.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.942+0000 7fd7c5d60640 1 --2- 172.21.15.1:0/1920131991 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e6896b4070 0x55e689a75440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:44.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.942+0000 7fd7c555f640 1 -- 172.21.15.1:0/1920131991 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e689693390 msgr2=0x55e689a70420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:44.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.942+0000 7fd7c555f640 1 --2- 172.21.15.1:0/1920131991 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e689693390 0x55e689a70420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.942+0000 7fd7c555f640 1 -- 172.21.15.1:0/1920131991 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e6896b4070 msgr2=0x55e689a75440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:44.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.942+0000 7fd7c555f640 1 --2- 172.21.15.1:0/1920131991 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e6896b4070 0x55e689a75440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.942+0000 7fd7c555f640 1 -- 172.21.15.1:0/1920131991 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e689989c90 con 0x55e68968b1b0 2024-09-21T00:57:44.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.942+0000 7fd7c5d60640 1 --2- 172.21.15.1:0/1920131991 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e6896b4070 0x55e689a75440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:57:44.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.943+0000 7fd7c555f640 1 --2- 172.21.15.1:0/1920131991 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e68968b1b0 0x55e689a6fe40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc006010 tx=0x7fd7bc105bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f17e87760de853f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:44.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.943+0000 7fd7a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T00:57:44.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.943+0000 7fd7a8ff9640 1 -- 172.21.15.1:0/1920131991 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc049030 con 0x55e68968b1b0 2024-09-21T00:57:44.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.943+0000 7fd7a8ff9640 1 -- 172.21.15.1:0/1920131991 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fd7bc0d7560 con 0x55e68968b1b0 2024-09-21T00:57:44.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.943+0000 7fd7cdd37740 1 -- 172.21.15.1:0/1920131991 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7b0013920 con 0x55e68968b1b0 2024-09-21T00:57:44.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.943+0000 7fd7a8ff9640 1 -- 172.21.15.1:0/1920131991 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd7bc0c9c70 con 0x55e68968b1b0 2024-09-21T00:57:44.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.943+0000 7fd7cdd37740 10 client.25294 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:44.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.943+0000 7fd7cdd37740 1 -- 172.21.15.1:0/1920131991 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e689a7e300 con 0x55e68968b1b0 2024-09-21T00:57:44.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.943+0000 7fd7a8ff9640 1 -- 172.21.15.1:0/1920131991 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7b0013920 con 0x55e68968b1b0 2024-09-21T00:57:44.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.944+0000 7fd7a8ff9640 1 -- 172.21.15.1:0/1920131991 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fd7bc0cd030 con 0x55e68968b1b0 2024-09-21T00:57:44.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.944+0000 7fd7cdd37740 10 client.25294 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:44.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.944+0000 7fd7cdd37740 10 client.25294 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:57:44.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.944+0000 7fd7cdd37740 20 client.25294 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:44.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.944+0000 7fd7cdd37740 1 --2- 172.21.15.1:0/1920131991 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55e6896729f0 0x55e689a81980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:44.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.944+0000 7fd7cdd37740 4 client.25294 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:57:44.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.944+0000 7fd7cdd37740 1 -- 172.21.15.1:0/1920131991 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6899d3df0 con 0x55e6896729f0 2024-09-21T00:57:44.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.944+0000 7fd7c4d5e640 1 --2- 172.21.15.1:0/1920131991 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55e6896729f0 0x55e689a81980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:44.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.945+0000 7fd7a8ff9640 10 client.25294 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:44.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.945+0000 7fd7c4d5e640 1 --2- 172.21.15.1:0/1920131991 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55e6896729f0 0x55e689a81980 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4be6718ddcb9d180 server_cookie=d5a681eef6a247ba in_seq=0 out_seq=0 2024-09-21T00:57:44.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.946+0000 7fd7a8ff9640 1 -- 172.21.15.1:0/1920131991 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e6899d3df0 con 0x55e6896729f0 2024-09-21T00:57:44.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.946+0000 7fd7a8ff9640 10 client.25294 handle_command_reply: tid=0 2024-09-21T00:57:44.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.946+0000 7fd7cdd37740 1 client.25294 shutdown 2024-09-21T00:57:44.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.946+0000 7fd7cdd37740 1 -- 172.21.15.1:0/1920131991 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e68968b1b0 msgr2=0x55e689a6fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:44.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.946+0000 7fd7cdd37740 1 --2- 172.21.15.1:0/1920131991 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e68968b1b0 0x55e689a6fe40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc006010 tx=0x7fd7bc105bd0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.946+0000 7fd7cdd37740 1 -- 172.21.15.1:0/1920131991 shutdown_connections 2024-09-21T00:57:44.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.946+0000 7fd7cdd37740 1 --2- 172.21.15.1:0/1920131991 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55e6896729f0 0x55e689a81980 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.946+0000 7fd7cdd37740 1 --2- 172.21.15.1:0/1920131991 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e6896b4070 0x55e689a75440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.946+0000 7fd7cdd37740 1 --2- 172.21.15.1:0/1920131991 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e689693390 0x55e689a70420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.946+0000 7fd7cdd37740 1 --2- 172.21.15.1:0/1920131991 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e68968b1b0 0x55e689a6fe40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.946+0000 7fd7cdd37740 1 -- 172.21.15.1:0/1920131991 >> 172.21.15.1:0/1920131991 conn(0x55e6896a8460 msgr2=0x55e689a5e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:44.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.946+0000 7fd7a8ff9640 0 client.25294 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:44.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.946+0000 7fd7cdd37740 1 -- 172.21.15.1:0/1920131991 shutdown_connections 2024-09-21T00:57:44.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.947+0000 7fd7cdd37740 1 -- 172.21.15.1:0/1920131991 wait complete. 2024-09-21T00:57:44.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.947+0000 7fd7cdd37740 20 client.25294 trim_cache size 0 max 16384 2024-09-21T00:57:44.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.973+0000 7fd7cdd37740 1 Processor -- start 2024-09-21T00:57:44.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.973+0000 7fd7cdd37740 1 -- start start 2024-09-21T00:57:44.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.973+0000 7fd7cdd37740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e68968b1b0 0x55e689a6a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:44.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.973+0000 7fd7cdd37740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e689693390 0x55e689a691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:44.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.973+0000 7fd7cdd37740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e6896b4070 0x55e689a6ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:44.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.973+0000 7fd7cdd37740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c01ad1c0 con 0x55e68968b1b0 2024-09-21T00:57:44.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.973+0000 7fd7cdd37740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c01aed00 con 0x55e689693390 2024-09-21T00:57:44.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.973+0000 7fd7cdd37740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c01ad890 con 0x55e6896b4070 2024-09-21T00:57:44.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.973+0000 7fd7c555f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e68968b1b0 0x55e689a6a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:44.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.974+0000 7fd7c555f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e68968b1b0 0x55e689a6a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33026/0 (socket says 172.21.15.1:33026) 2024-09-21T00:57:44.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.974+0000 7fd7c555f640 1 -- 172.21.15.1:0/2443989156 learned_addr learned my addr 172.21.15.1:0/2443989156 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:44.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.974+0000 7fd7c4d5e640 1 --2- 172.21.15.1:0/2443989156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e689693390 0x55e689a691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:44.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.974+0000 7fd7c5d60640 1 --2- 172.21.15.1:0/2443989156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e6896b4070 0x55e689a6ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:44.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.974+0000 7fd7c555f640 1 -- 172.21.15.1:0/2443989156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e6896b4070 msgr2=0x55e689a6ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:44.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.974+0000 7fd7c555f640 1 --2- 172.21.15.1:0/2443989156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e6896b4070 0x55e689a6ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.974+0000 7fd7c555f640 1 -- 172.21.15.1:0/2443989156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e689693390 msgr2=0x55e689a691a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:44.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.974+0000 7fd7c555f640 1 --2- 172.21.15.1:0/2443989156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e689693390 0x55e689a691a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.974+0000 7fd7c555f640 1 -- 172.21.15.1:0/2443989156 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e689a5f7b0 con 0x55e68968b1b0 2024-09-21T00:57:44.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.974+0000 7fd7c4d5e640 1 --2- 172.21.15.1:0/2443989156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e689693390 0x55e689a691a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:57:44.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.974+0000 7fd7c555f640 1 --2- 172.21.15.1:0/2443989156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e68968b1b0 0x55e689a6a4f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc0cdad0 tx=0x7fd7bc0c9720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dfe9fcfd762f8ba server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:44.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.975+0000 7fd7aaffd640 1 -- 172.21.15.1:0/2443989156 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc0f5020 con 0x55e68968b1b0 2024-09-21T00:57:44.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.975+0000 7fd7aaffd640 1 -- 172.21.15.1:0/2443989156 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7bc0cd8e0 con 0x55e68968b1b0 2024-09-21T00:57:44.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.975+0000 7fd7aaffd640 1 -- 172.21.15.1:0/2443989156 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc049070 con 0x55e68968b1b0 2024-09-21T00:57:44.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.976+0000 7fd7cdd37740 1 -- 172.21.15.1:0/2443989156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e68968b1b0 msgr2=0x55e689a6a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:44.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.976+0000 7fd7cdd37740 1 --2- 172.21.15.1:0/2443989156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e68968b1b0 0x55e689a6a4f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc0cdad0 tx=0x7fd7bc0c9720 comp rx=0 tx=0).stop 2024-09-21T00:57:44.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.976+0000 7fd7cdd37740 1 -- 172.21.15.1:0/2443989156 shutdown_connections 2024-09-21T00:57:44.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.976+0000 7fd7cdd37740 1 --2- 172.21.15.1:0/2443989156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e6896b4070 0x55e689a6ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.976+0000 7fd7cdd37740 1 --2- 172.21.15.1:0/2443989156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e689693390 0x55e689a691a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.976+0000 7fd7cdd37740 1 --2- 172.21.15.1:0/2443989156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e68968b1b0 0x55e689a6a4f0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.976+0000 7fd7cdd37740 1 -- 172.21.15.1:0/2443989156 >> 172.21.15.1:0/2443989156 conn(0x55e6896a8460 msgr2=0x55e689a6e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:44.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.976+0000 7fd7cdd37740 1 -- 172.21.15.1:0/2443989156 shutdown_connections 2024-09-21T00:57:44.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.976+0000 7fd7cdd37740 1 -- 172.21.15.1:0/2443989156 wait complete. 2024-09-21T00:57:44.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.977+0000 7fd7cdd37740 1 -- start start 2024-09-21T00:57:44.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.977+0000 7fd7cdd37740 1 Processor -- start 2024-09-21T00:57:44.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.977+0000 7fd7cdd37740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e68968b1b0 0x55e689a7c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:44.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.977+0000 7fd7cdd37740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e689693390 0x55e689a77550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:44.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.978+0000 7fd7cdd37740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e6896b4070 0x55e689a77a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:44.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.978+0000 7fd7cdd37740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c01ae630 con 0x55e68968b1b0 2024-09-21T00:57:44.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.978+0000 7fd7cdd37740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c01adf60 con 0x55e689693390 2024-09-21T00:57:44.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.978+0000 7fd7cdd37740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c01ab1a0 con 0x55e6896b4070 2024-09-21T00:57:44.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.978+0000 7fd7cdd37740 10 client.0 _ll_register_callbacks cb 0x7fd7bc004570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:44.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.978+0000 7fd7c4d5e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e689693390 0x55e689a77550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:44.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.978+0000 7fd7c555f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e68968b1b0 0x55e689a7c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:44.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.978+0000 7fd7c5d60640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e6896b4070 0x55e689a77a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:44.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.978+0000 7fd7c555f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e68968b1b0 0x55e689a7c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33034/0 (socket says 172.21.15.1:33034) 2024-09-21T00:57:44.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.978+0000 7fd7c555f640 1 -- 172.21.15.1:0/701083600 learned_addr learned my addr 172.21.15.1:0/701083600 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:44.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.978+0000 7fd7c5d60640 1 -- 172.21.15.1:0/701083600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e689693390 msgr2=0x55e689a77550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:44.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.978+0000 7fd7c5d60640 1 --2- 172.21.15.1:0/701083600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e689693390 0x55e689a77550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.978+0000 7fd7c5d60640 1 -- 172.21.15.1:0/701083600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e68968b1b0 msgr2=0x55e689a7c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:44.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.978+0000 7fd7c5d60640 1 --2- 172.21.15.1:0/701083600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e68968b1b0 0x55e689a7c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.978+0000 7fd7c5d60640 1 -- 172.21.15.1:0/701083600 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e689a78220 con 0x55e6896b4070 2024-09-21T00:57:44.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.978+0000 7fd7c555f640 1 --2- 172.21.15.1:0/701083600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e68968b1b0 0x55e689a7c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:44.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.979+0000 7fd7c5d60640 1 --2- 172.21.15.1:0/701083600 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e6896b4070 0x55e689a77a90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8013fd0 tx=0x7fd7b8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2f71c8f2f0f39b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:44.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.979+0000 7fd7a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T00:57:44.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.979+0000 7fd7a8ff9640 1 -- 172.21.15.1:0/701083600 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b8004b20 con 0x55e6896b4070 2024-09-21T00:57:44.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.979+0000 7fd7cdd37740 1 -- 172.21.15.1:0/701083600 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7bc0cd8e0 con 0x55e6896b4070 2024-09-21T00:57:44.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.979+0000 7fd7a8ff9640 1 -- 172.21.15.1:0/701083600 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fd7b8004cc0 con 0x55e6896b4070 2024-09-21T00:57:44.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.979+0000 7fd7a8ff9640 1 -- 172.21.15.1:0/701083600 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd7b8003970 con 0x55e6896b4070 2024-09-21T00:57:44.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.980+0000 7fd7cdd37740 10 client.25300 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:44.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.980+0000 7fd7cdd37740 1 -- 172.21.15.1:0/701083600 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e689aec1a0 con 0x55e6896b4070 2024-09-21T00:57:44.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.980+0000 7fd7a8ff9640 1 -- 172.21.15.1:0/701083600 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7b801f970 con 0x55e6896b4070 2024-09-21T00:57:44.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.980+0000 7fd7a8ff9640 1 -- 172.21.15.1:0/701083600 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fd7b8027070 con 0x55e6896b4070 2024-09-21T00:57:44.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.981+0000 7fd7cdd37740 10 client.25300 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:44.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.981+0000 7fd7cdd37740 10 client.25300 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:57:44.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.981+0000 7fd7cdd37740 20 client.25300 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:44.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.981+0000 7fd7cdd37740 1 --2- 172.21.15.1:0/701083600 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55e689647da0 0x55e689aee990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:44.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.981+0000 7fd7cdd37740 4 client.25300 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:57:44.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.981+0000 7fd7cdd37740 1 -- 172.21.15.1:0/701083600 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fd7bc0cd8e0 con 0x55e689647da0 2024-09-21T00:57:44.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.981+0000 7fd7c555f640 1 --2- 172.21.15.1:0/701083600 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55e689647da0 0x55e689aee990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:44.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.982+0000 7fd7c555f640 1 --2- 172.21.15.1:0/701083600 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55e689647da0 0x55e689aee990 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb05903e886f0e4e server_cookie=404f8dd9cc9695ef in_seq=0 out_seq=0 2024-09-21T00:57:44.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.982+0000 7fd7a8ff9640 10 client.25300 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:44.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.982+0000 7fd7a8ff9640 1 -- 172.21.15.1:0/701083600 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fd7bc0cd8e0 con 0x55e689647da0 2024-09-21T00:57:44.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.982+0000 7fd7a8ff9640 10 client.25300 handle_command_reply: tid=0 2024-09-21T00:57:44.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.982+0000 7fd7cdd37740 1 client.25300 shutdown 2024-09-21T00:57:44.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.982+0000 7fd7cdd37740 1 -- 172.21.15.1:0/701083600 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e6896b4070 msgr2=0x55e689a77a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:44.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.982+0000 7fd7cdd37740 1 --2- 172.21.15.1:0/701083600 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e6896b4070 0x55e689a77a90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8013fd0 tx=0x7fd7b8004a40 comp rx=0 tx=0).stop 2024-09-21T00:57:44.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.982+0000 7fd7cdd37740 1 -- 172.21.15.1:0/701083600 shutdown_connections 2024-09-21T00:57:44.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.982+0000 7fd7cdd37740 1 --2- 172.21.15.1:0/701083600 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55e689647da0 0x55e689aee990 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.982+0000 7fd7cdd37740 1 --2- 172.21.15.1:0/701083600 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e6896b4070 0x55e689a77a90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.982+0000 7fd7a8ff9640 0 client.25300 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:44.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.982+0000 7fd7cdd37740 1 --2- 172.21.15.1:0/701083600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e689693390 0x55e689a77550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.982+0000 7fd7cdd37740 1 --2- 172.21.15.1:0/701083600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e68968b1b0 0x55e689a7c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.982+0000 7fd7cdd37740 1 -- 172.21.15.1:0/701083600 >> 172.21.15.1:0/701083600 conn(0x55e6896a8460 msgr2=0x55e689a5c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:44.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.983+0000 7fd7cdd37740 1 -- 172.21.15.1:0/701083600 shutdown_connections 2024-09-21T00:57:44.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.983+0000 7fd7cdd37740 1 -- 172.21.15.1:0/701083600 wait complete. 2024-09-21T00:57:44.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.983+0000 7fd7cdd37740 20 client.25300 trim_cache size 0 max 16384 2024-09-21T00:57:44.985 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T00:57:44.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.983+0000 7fd7c77c3640 1 -- 172.21.15.1:0/3263195623 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd7ac0b65a0 msgr2=0x7fd7ac0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:44.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.983+0000 7fd7c77c3640 1 --2- 172.21.15.1:0/3263195623 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd7ac0b65a0 0x7fd7ac0b8ab0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8005fd0 tx=0x7fd7b8009860 comp rx=0 tx=0).stop 2024-09-21T00:57:44.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.983+0000 7fd7c77c3640 1 -- 172.21.15.1:0/3263195623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd7c0102a60 msgr2=0x7fd7c019a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:44.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.983+0000 7fd7c77c3640 1 --2- 172.21.15.1:0/3263195623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd7c0102a60 0x7fd7c019a510 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc005940 tx=0x7fd7bc0042f0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.984+0000 7fd7c77c3640 1 -- 172.21.15.1:0/3263195623 shutdown_connections 2024-09-21T00:57:44.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.984+0000 7fd7c77c3640 1 --2- 172.21.15.1:0/3263195623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7c0108cf0 0x7fd7c019fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.984+0000 7fd7c77c3640 1 --2- 172.21.15.1:0/3263195623 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd7ac0b65a0 0x7fd7ac0b8ab0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.984+0000 7fd7c77c3640 1 --2- 172.21.15.1:0/3263195623 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7c01083a0 0x7fd7c019aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.984+0000 7fd7c77c3640 1 --2- 172.21.15.1:0/3263195623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd7c0102a60 0x7fd7c019a510 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.984+0000 7fd7c77c3640 1 -- 172.21.15.1:0/3263195623 >> 172.21.15.1:0/3263195623 conn(0x7fd7c0079730 msgr2=0x7fd7c01005c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:44.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.984+0000 7fd7c77c3640 1 -- 172.21.15.1:0/3263195623 shutdown_connections 2024-09-21T00:57:44.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:44.984+0000 7fd7c77c3640 1 -- 172.21.15.1:0/3263195623 wait complete. 2024-09-21T00:57:45.888 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:45 smithi001 ceph-mon[31211]: pgmap v374: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-09-21T00:57:45.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:45 smithi193 ceph-mon[34660]: pgmap v374: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-09-21T00:57:45.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:45 smithi042 ceph-mon[34481]: pgmap v374: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-09-21T00:57:46.723 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T00:57:46.724 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T00:57:47.006 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:47.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.559+0000 7f9573912640 1 -- 172.21.15.1:0/3111192895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f956c106280 msgr2=0x7f956c106690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:47.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.559+0000 7f9573912640 1 --2- 172.21.15.1:0/3111192895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f956c106280 0x7f956c106690 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f955c009900 tx=0x7f955c02a410 comp rx=0 tx=0).stop 2024-09-21T00:57:47.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.560+0000 7f9573912640 1 -- 172.21.15.1:0/3111192895 shutdown_connections 2024-09-21T00:57:47.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.560+0000 7f9573912640 1 --2- 172.21.15.1:0/3111192895 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f956c106bd0 0x7f956c110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:47.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.560+0000 7f9573912640 1 --2- 172.21.15.1:0/3111192895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f956c106280 0x7f956c106690 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:47.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.560+0000 7f9573912640 1 --2- 172.21.15.1:0/3111192895 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f956c101fa0 0x7f956c1023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:47.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.560+0000 7f9573912640 1 -- 172.21.15.1:0/3111192895 >> 172.21.15.1:0/3111192895 conn(0x7f956c077ca0 msgr2=0x7f956c0780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:47.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.560+0000 7f9573912640 1 -- 172.21.15.1:0/3111192895 shutdown_connections 2024-09-21T00:57:47.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.561+0000 7f9573912640 1 -- 172.21.15.1:0/3111192895 wait complete. 2024-09-21T00:57:47.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.562+0000 7f9573912640 1 Processor -- start 2024-09-21T00:57:47.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.562+0000 7f9573912640 1 -- start start 2024-09-21T00:57:47.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.562+0000 7f9573912640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f956c101fa0 0x7f956c1150d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:47.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.562+0000 7f9573912640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f956c106280 0x7f956c1113b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:47.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.562+0000 7f9573912640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f956c106bd0 0x7f956c111ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:47.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.562+0000 7f9573912640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f956c115c90 con 0x7f956c106280 2024-09-21T00:57:47.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.562+0000 7f9573912640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f956c115b10 con 0x7f956c106bd0 2024-09-21T00:57:47.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.562+0000 7f9573912640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f956c115e10 con 0x7f956c101fa0 2024-09-21T00:57:47.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.562+0000 7f9570ead640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f956c106280 0x7f956c1113b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:47.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.562+0000 7f95716ae640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f956c101fa0 0x7f956c1150d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:47.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.562+0000 7f9570ead640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f956c106280 0x7f956c1113b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33054/0 (socket says 172.21.15.1:33054) 2024-09-21T00:57:47.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.562+0000 7f9570ead640 1 -- 172.21.15.1:0/1128963590 learned_addr learned my addr 172.21.15.1:0/1128963590 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:47.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.563+0000 7f9570ead640 1 -- 172.21.15.1:0/1128963590 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f956c101fa0 msgr2=0x7f956c1150d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:47.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.563+0000 7f9570ead640 1 --2- 172.21.15.1:0/1128963590 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f956c101fa0 0x7f956c1150d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:47.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.563+0000 7f9571eaf640 1 --2- 172.21.15.1:0/1128963590 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f956c106bd0 0x7f956c111ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:47.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.563+0000 7f9570ead640 1 -- 172.21.15.1:0/1128963590 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f956c106bd0 msgr2=0x7f956c111ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:47.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.563+0000 7f9570ead640 1 --2- 172.21.15.1:0/1128963590 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f956c106bd0 0x7f956c111ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:47.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.563+0000 7f9570ead640 1 -- 172.21.15.1:0/1128963590 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f956c1acbf0 con 0x7f956c106280 2024-09-21T00:57:47.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.563+0000 7f9571eaf640 1 --2- 172.21.15.1:0/1128963590 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f956c106bd0 0x7f956c111ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:57:47.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.564+0000 7f9570ead640 1 --2- 172.21.15.1:0/1128963590 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f956c106280 0x7f956c1113b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f955c02a930 tx=0x7f955c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:47.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.565+0000 7f95627fc640 1 -- 172.21.15.1:0/1128963590 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955c03f030 con 0x7f956c106280 2024-09-21T00:57:47.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.565+0000 7f95627fc640 1 -- 172.21.15.1:0/1128963590 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f955c003aa0 con 0x7f956c106280 2024-09-21T00:57:47.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.565+0000 7f9573912640 1 -- 172.21.15.1:0/1128963590 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f956c1acdc0 con 0x7f956c106280 2024-09-21T00:57:47.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.565+0000 7f9573912640 1 -- 172.21.15.1:0/1128963590 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f956c1ad1c0 con 0x7f956c106280 2024-09-21T00:57:47.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.566+0000 7f95627fc640 1 -- 172.21.15.1:0/1128963590 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955c049060 con 0x7f956c106280 2024-09-21T00:57:47.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.569+0000 7f95627fc640 1 -- 172.21.15.1:0/1128963590 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 154562+0+0 (secure 0 0 0) 0x7f955c042030 con 0x7f956c106280 2024-09-21T00:57:47.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.570+0000 7f95627fc640 1 --2- 172.21.15.1:0/1128963590 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f95580b65a0 0x7f95580b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:47.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.570+0000 7f95627fc640 1 -- 172.21.15.1:0/1128963590 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f955c107bb0 con 0x7f956c106280 2024-09-21T00:57:47.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.570+0000 7f9579e86740 1 Processor -- start 2024-09-21T00:57:47.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.571+0000 7f95716ae640 1 --2- 172.21.15.1:0/1128963590 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f95580b65a0 0x7f95580b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:47.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.571+0000 7f9579e86740 1 -- start start 2024-09-21T00:57:47.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.571+0000 7f95716ae640 1 --2- 172.21.15.1:0/1128963590 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f95580b65a0 0x7f95580b8ab0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f956c114e20 tx=0x7f956800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:47.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.571+0000 7f9579e86740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e767266350 0x55e76760d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:47.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.572+0000 7f95716ae640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e767266350 0x55e76760d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:47.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.572+0000 7f95716ae640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e767266350 0x55e76760d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33064/0 (socket says 172.21.15.1:33064) 2024-09-21T00:57:47.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.572+0000 7f9579e86740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e76723d490 0x55e76760d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:47.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.572+0000 7f95716ae640 1 -- 172.21.15.1:0/367927917 learned_addr learned my addr 172.21.15.1:0/367927917 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:47.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.572+0000 7f9579e86740 1 --2- 172.21.15.1:0/367927917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e767245670 0x55e76760deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:47.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.572+0000 7f9579e86740 1 -- 172.21.15.1:0/367927917 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e767583e60 con 0x55e767266350 2024-09-21T00:57:47.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.572+0000 7f9570ead640 1 --2- 172.21.15.1:0/367927917 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e76723d490 0x55e76760d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:47.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.572+0000 7f9571eaf640 1 --2- 172.21.15.1:0/367927917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e767245670 0x55e76760deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:47.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.572+0000 7f9579e86740 1 -- 172.21.15.1:0/367927917 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e767573290 con 0x55e767245670 2024-09-21T00:57:47.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.573+0000 7f9579e86740 1 -- 172.21.15.1:0/367927917 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55e7675770a0 con 0x55e76723d490 2024-09-21T00:57:47.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.573+0000 7f95716ae640 1 -- 172.21.15.1:0/367927917 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e76723d490 msgr2=0x55e76760d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:47.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.573+0000 7f95716ae640 1 --2- 172.21.15.1:0/367927917 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e76723d490 0x55e76760d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:47.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.573+0000 7f95716ae640 1 -- 172.21.15.1:0/367927917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e767245670 msgr2=0x55e76760deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:47.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.573+0000 7f95716ae640 1 --2- 172.21.15.1:0/367927917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e767245670 0x55e76760deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:47.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.573+0000 7f95716ae640 1 -- 172.21.15.1:0/367927917 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7672d1930 con 0x55e767266350 2024-09-21T00:57:47.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.573+0000 7f95716ae640 1 --2- 172.21.15.1:0/367927917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e767266350 0x55e76760d430 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f956800b620 tx=0x7f9568013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef72c732f34c4f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:47.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.573+0000 7f95577fe640 1 -- 172.21.15.1:0/367927917 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9568003eb0 con 0x55e767266350 2024-09-21T00:57:47.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.574+0000 7f95577fe640 1 -- 172.21.15.1:0/367927917 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f956801e8d0 con 0x55e767266350 2024-09-21T00:57:47.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.574+0000 7f95577fe640 1 -- 172.21.15.1:0/367927917 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9568026930 con 0x55e767266350 2024-09-21T00:57:47.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.574+0000 7f9579e86740 1 -- 172.21.15.1:0/367927917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e767266350 msgr2=0x55e76760d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:47.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.574+0000 7f9579e86740 1 --2- 172.21.15.1:0/367927917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e767266350 0x55e76760d430 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f956800b620 tx=0x7f9568013000 comp rx=0 tx=0).stop 2024-09-21T00:57:47.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.575+0000 7f9579e86740 1 -- 172.21.15.1:0/367927917 shutdown_connections 2024-09-21T00:57:47.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.575+0000 7f9579e86740 1 --2- 172.21.15.1:0/367927917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e767245670 0x55e76760deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:47.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.575+0000 7f9579e86740 1 --2- 172.21.15.1:0/367927917 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e76723d490 0x55e76760d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:47.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.575+0000 7f9579e86740 1 --2- 172.21.15.1:0/367927917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e767266350 0x55e76760d430 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:47.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.575+0000 7f9579e86740 1 -- 172.21.15.1:0/367927917 >> 172.21.15.1:0/367927917 conn(0x55e76725a740 msgr2=0x55e76760b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:47.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.575+0000 7f9579e86740 1 -- 172.21.15.1:0/367927917 shutdown_connections 2024-09-21T00:57:47.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.575+0000 7f9579e86740 1 -- 172.21.15.1:0/367927917 wait complete. 2024-09-21T00:57:47.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.575+0000 7f9579e86740 1 -- start start 2024-09-21T00:57:47.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.575+0000 7f9579e86740 1 Processor -- start 2024-09-21T00:57:47.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.576+0000 7f9579e86740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e76723d490 0x55e767619080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:47.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.576+0000 7f9579e86740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e767245670 0x55e767619600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:47.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.576+0000 7f9579e86740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e767266350 0x55e767624f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:47.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.576+0000 7f9579e86740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e7673d4890 con 0x55e767245670 2024-09-21T00:57:47.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.576+0000 7f9579e86740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e76750dd40 con 0x55e767266350 2024-09-21T00:57:47.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.576+0000 7f95716ae640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e76723d490 0x55e767619080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:47.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.576+0000 7f95716ae640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e76723d490 0x55e767619080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:37962/0 (socket says 172.21.15.1:37962) 2024-09-21T00:57:47.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.576+0000 7f95716ae640 1 -- 172.21.15.1:0/1103220593 learned_addr learned my addr 172.21.15.1:0/1103220593 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:47.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.577+0000 7f9579e86740 1 -- 172.21.15.1:0/1103220593 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55e76761bc10 con 0x55e76723d490 2024-09-21T00:57:47.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.577+0000 7f9570ead640 1 --2- 172.21.15.1:0/1103220593 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e767245670 0x55e767619600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:47.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.577+0000 7f9579e86740 10 client.0 _ll_register_callbacks cb 0x55e767571c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:47.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.577+0000 7f9571eaf640 1 --2- 172.21.15.1:0/1103220593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e767266350 0x55e767624f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:47.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.577+0000 7f9570ead640 1 -- 172.21.15.1:0/1103220593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e76723d490 msgr2=0x55e767619080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:47.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.577+0000 7f9570ead640 1 --2- 172.21.15.1:0/1103220593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e76723d490 0x55e767619080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:47.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.577+0000 7f9570ead640 1 -- 172.21.15.1:0/1103220593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e767266350 msgr2=0x55e767624f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:47.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.577+0000 7f9570ead640 1 --2- 172.21.15.1:0/1103220593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e767266350 0x55e767624f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:47.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.577+0000 7f9570ead640 1 -- 172.21.15.1:0/1103220593 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e767625540 con 0x55e767245670 2024-09-21T00:57:47.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.577+0000 7f9570ead640 1 --2- 172.21.15.1:0/1103220593 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e767245670 0x55e767619600 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f955c105540 tx=0x7f955c0cda50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0cd6ad1790d7bba server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:47.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.578+0000 7f9554ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:57:47.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.578+0000 7f9554ff9640 1 -- 172.21.15.1:0/1103220593 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955c035040 con 0x55e767245670 2024-09-21T00:57:47.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.578+0000 7f9554ff9640 1 -- 172.21.15.1:0/1103220593 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f955c0f1110 con 0x55e767245670 2024-09-21T00:57:47.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.578+0000 7f9579e86740 1 -- 172.21.15.1:0/1103220593 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f956801e8d0 con 0x55e767245670 2024-09-21T00:57:47.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.578+0000 7f9554ff9640 1 -- 172.21.15.1:0/1103220593 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f955c0f5170 con 0x55e767245670 2024-09-21T00:57:47.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.578+0000 7f9579e86740 10 client.15672 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:47.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.578+0000 7f9579e86740 1 -- 172.21.15.1:0/1103220593 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e767627e70 con 0x55e767245670 2024-09-21T00:57:47.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.579+0000 7f9554ff9640 1 -- 172.21.15.1:0/1103220593 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f956801e8d0 con 0x55e767245670 2024-09-21T00:57:47.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.579+0000 7f9554ff9640 1 -- 172.21.15.1:0/1103220593 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f955c0c9e30 con 0x55e767245670 2024-09-21T00:57:47.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.579+0000 7f9579e86740 10 client.15672 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:47.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.579+0000 7f9579e86740 10 client.15672 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:57:47.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.579+0000 7f9579e86740 20 client.15672 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:47.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.579+0000 7f9579e86740 1 --2- 172.21.15.1:0/1103220593 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55e767224cd0 0x55e76762b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:47.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.579+0000 7f9579e86740 4 client.15672 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:57:47.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.579+0000 7f9579e86740 1 -- 172.21.15.1:0/1103220593 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e767585db0 con 0x55e767224cd0 2024-09-21T00:57:47.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.579+0000 7f95716ae640 1 --2- 172.21.15.1:0/1103220593 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55e767224cd0 0x55e76762b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:47.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.580+0000 7f9554ff9640 10 client.15672 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:47.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.580+0000 7f95716ae640 1 --2- 172.21.15.1:0/1103220593 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55e767224cd0 0x55e76762b400 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7395cc1090bb2d13 server_cookie=df3f2c025bcb75b5 in_seq=0 out_seq=0 2024-09-21T00:57:47.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.581+0000 7f9554ff9640 1 -- 172.21.15.1:0/1103220593 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e767585db0 con 0x55e767224cd0 2024-09-21T00:57:47.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.581+0000 7f9554ff9640 10 client.15672 handle_command_reply: tid=0 2024-09-21T00:57:47.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.581+0000 7f9579e86740 1 client.15672 shutdown 2024-09-21T00:57:47.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.581+0000 7f9579e86740 1 -- 172.21.15.1:0/1103220593 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e767245670 msgr2=0x55e767619600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:47.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.581+0000 7f9579e86740 1 --2- 172.21.15.1:0/1103220593 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e767245670 0x55e767619600 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f955c105540 tx=0x7f955c0cda50 comp rx=0 tx=0).stop 2024-09-21T00:57:47.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.581+0000 7f9579e86740 1 -- 172.21.15.1:0/1103220593 shutdown_connections 2024-09-21T00:57:47.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.581+0000 7f9579e86740 1 --2- 172.21.15.1:0/1103220593 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55e767224cd0 0x55e76762b400 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:47.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.581+0000 7f9579e86740 1 --2- 172.21.15.1:0/1103220593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e767266350 0x55e767624f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:47.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.582+0000 7f9579e86740 1 --2- 172.21.15.1:0/1103220593 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e767245670 0x55e767619600 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:47.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.582+0000 7f9579e86740 1 --2- 172.21.15.1:0/1103220593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e76723d490 0x55e767619080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:47.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.582+0000 7f9579e86740 1 -- 172.21.15.1:0/1103220593 >> 172.21.15.1:0/1103220593 conn(0x55e76725a740 msgr2=0x55e767610610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:47.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.581+0000 7f9554ff9640 0 client.15672 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:47.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.582+0000 7f9579e86740 1 -- 172.21.15.1:0/1103220593 shutdown_connections 2024-09-21T00:57:47.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.582+0000 7f9579e86740 1 -- 172.21.15.1:0/1103220593 wait complete. 2024-09-21T00:57:47.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.582+0000 7f9579e86740 20 client.15672 trim_cache size 0 max 16384 2024-09-21T00:57:47.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.601+0000 7f9579e86740 1 Processor -- start 2024-09-21T00:57:47.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.601+0000 7f9579e86740 1 -- start start 2024-09-21T00:57:47.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.601+0000 7f9579e86740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e76723d490 0x55e767624e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:47.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.601+0000 7f9579e86740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e767245670 0x55e767612510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:47.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.601+0000 7f9579e86740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e767266350 0x55e767612a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:47.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.601+0000 7f9579e86740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f956c1b5a40 con 0x55e767266350 2024-09-21T00:57:47.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.601+0000 7f9579e86740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f956c1b7580 con 0x55e76723d490 2024-09-21T00:57:47.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.601+0000 7f9579e86740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f956c1b6110 con 0x55e767245670 2024-09-21T00:57:47.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.602+0000 7f9571eaf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e767266350 0x55e767612a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:47.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.602+0000 7f9571eaf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e767266350 0x55e767612a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33086/0 (socket says 172.21.15.1:33086) 2024-09-21T00:57:47.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.602+0000 7f9571eaf640 1 -- 172.21.15.1:0/2393907350 learned_addr learned my addr 172.21.15.1:0/2393907350 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:47.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.602+0000 7f9570ead640 1 --2- 172.21.15.1:0/2393907350 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e767245670 0x55e767612510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:47.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.602+0000 7f95716ae640 1 --2- 172.21.15.1:0/2393907350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e76723d490 0x55e767624e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:47.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.602+0000 7f9571eaf640 1 -- 172.21.15.1:0/2393907350 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e767245670 msgr2=0x55e767612510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:47.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.602+0000 7f9571eaf640 1 --2- 172.21.15.1:0/2393907350 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e767245670 0x55e767612510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:47.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.602+0000 7f9571eaf640 1 -- 172.21.15.1:0/2393907350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e76723d490 msgr2=0x55e767624e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:47.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.602+0000 7f9571eaf640 1 --2- 172.21.15.1:0/2393907350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e76723d490 0x55e767624e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:47.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.602+0000 7f9571eaf640 1 -- 172.21.15.1:0/2393907350 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e767614710 con 0x55e767266350 2024-09-21T00:57:47.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.603+0000 7f9571eaf640 1 --2- 172.21.15.1:0/2393907350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e767266350 0x55e767612a50 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f9564012610 tx=0x7f9564012ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda94d70d594fb95 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:47.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.603+0000 7f9556ffd640 1 -- 172.21.15.1:0/2393907350 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9564020070 con 0x55e767266350 2024-09-21T00:57:47.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.603+0000 7f9556ffd640 1 -- 172.21.15.1:0/2393907350 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9564010a80 con 0x55e767266350 2024-09-21T00:57:47.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.603+0000 7f9556ffd640 1 -- 172.21.15.1:0/2393907350 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f956401bc30 con 0x55e767266350 2024-09-21T00:57:47.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.604+0000 7f9579e86740 1 -- 172.21.15.1:0/2393907350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e767266350 msgr2=0x55e767612a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:47.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.604+0000 7f9579e86740 1 --2- 172.21.15.1:0/2393907350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e767266350 0x55e767612a50 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f9564012610 tx=0x7f9564012ad0 comp rx=0 tx=0).stop 2024-09-21T00:57:47.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.604+0000 7f9579e86740 1 -- 172.21.15.1:0/2393907350 shutdown_connections 2024-09-21T00:57:47.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.604+0000 7f9579e86740 1 --2- 172.21.15.1:0/2393907350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e767266350 0x55e767612a50 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:47.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.604+0000 7f9579e86740 1 --2- 172.21.15.1:0/2393907350 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e767245670 0x55e767612510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:47.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.604+0000 7f9579e86740 1 --2- 172.21.15.1:0/2393907350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e76723d490 0x55e767624e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:47.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.604+0000 7f9579e86740 1 -- 172.21.15.1:0/2393907350 >> 172.21.15.1:0/2393907350 conn(0x55e76725a740 msgr2=0x55e767617700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:47.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.604+0000 7f9579e86740 1 -- 172.21.15.1:0/2393907350 shutdown_connections 2024-09-21T00:57:47.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.605+0000 7f9579e86740 1 -- 172.21.15.1:0/2393907350 wait complete. 2024-09-21T00:57:47.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.605+0000 7f9579e86740 1 -- start start 2024-09-21T00:57:47.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.605+0000 7f9579e86740 1 Processor -- start 2024-09-21T00:57:47.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.606+0000 7f9579e86740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e76723d490 0x55e767620ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:47.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.606+0000 7f9579e86740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e767245670 0x55e7676213e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:47.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.606+0000 7f9579e86740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e767266350 0x55e76761be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:47.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.606+0000 7f9579e86740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f956c1b6eb0 con 0x55e76723d490 2024-09-21T00:57:47.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.606+0000 7f9579e86740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f956c1b67e0 con 0x55e767266350 2024-09-21T00:57:47.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.606+0000 7f9579e86740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f956c1b3a20 con 0x55e767245670 2024-09-21T00:57:47.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.606+0000 7f95716ae640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e76723d490 0x55e767620ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:47.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.606+0000 7f9579e86740 10 client.0 _ll_register_callbacks cb 0x7f955c0b50b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:47.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.606+0000 7f95716ae640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e76723d490 0x55e767620ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33098/0 (socket says 172.21.15.1:33098) 2024-09-21T00:57:47.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.606+0000 7f95716ae640 1 -- 172.21.15.1:0/4178476959 learned_addr learned my addr 172.21.15.1:0/4178476959 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:47.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.606+0000 7f9570ead640 1 --2- 172.21.15.1:0/4178476959 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e767245670 0x55e7676213e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:47.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.606+0000 7f9571eaf640 1 --2- 172.21.15.1:0/4178476959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e767266350 0x55e76761be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:47.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.607+0000 7f9570ead640 1 -- 172.21.15.1:0/4178476959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e767266350 msgr2=0x55e76761be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:47.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.607+0000 7f9570ead640 1 --2- 172.21.15.1:0/4178476959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e767266350 0x55e76761be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:47.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.607+0000 7f9570ead640 1 -- 172.21.15.1:0/4178476959 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e76723d490 msgr2=0x55e767620ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:47.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.607+0000 7f9570ead640 1 --2- 172.21.15.1:0/4178476959 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e76723d490 0x55e767620ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:47.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.607+0000 7f9570ead640 1 -- 172.21.15.1:0/4178476959 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e767621a20 con 0x55e767245670 2024-09-21T00:57:47.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.607+0000 7f9570ead640 1 --2- 172.21.15.1:0/4178476959 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e767245670 0x55e7676213e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f955c0ca190 tx=0x7f955c031a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1331aee978de6156 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:47.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.607+0000 7f9554ff9640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T00:57:47.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.607+0000 7f9554ff9640 1 -- 172.21.15.1:0/4178476959 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955c035070 con 0x55e767245670 2024-09-21T00:57:47.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.607+0000 7f9554ff9640 1 -- 172.21.15.1:0/4178476959 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f955c0d7350 con 0x55e767245670 2024-09-21T00:57:47.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.607+0000 7f9579e86740 1 -- 172.21.15.1:0/4178476959 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9564010a80 con 0x55e767245670 2024-09-21T00:57:47.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.607+0000 7f9554ff9640 1 -- 172.21.15.1:0/4178476959 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f955c0c9a60 con 0x55e767245670 2024-09-21T00:57:47.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.607+0000 7f9579e86740 10 client.25318 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:47.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.607+0000 7f9579e86740 1 -- 172.21.15.1:0/4178476959 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e7676961a0 con 0x55e767245670 2024-09-21T00:57:47.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.608+0000 7f9554ff9640 1 -- 172.21.15.1:0/4178476959 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f955c0cd6d0 con 0x55e767245670 2024-09-21T00:57:47.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.608+0000 7f9554ff9640 1 -- 172.21.15.1:0/4178476959 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f955c003680 con 0x55e767245670 2024-09-21T00:57:47.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.608+0000 7f9579e86740 10 client.25318 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:47.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.608+0000 7f9579e86740 10 client.25318 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:57:47.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.608+0000 7f9579e86740 20 client.25318 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:47.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.608+0000 7f9579e86740 1 --2- 172.21.15.1:0/4178476959 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55e7671fa080 0x55e7676987d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:47.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.608+0000 7f9579e86740 4 client.25318 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T00:57:47.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.608+0000 7f9579e86740 1 -- 172.21.15.1:0/4178476959 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f9564010a80 con 0x55e7671fa080 2024-09-21T00:57:47.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.608+0000 7f95716ae640 1 --2- 172.21.15.1:0/4178476959 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55e7671fa080 0x55e7676987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:47.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.609+0000 7f9554ff9640 10 client.25318 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:47.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.609+0000 7f95716ae640 1 --2- 172.21.15.1:0/4178476959 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55e7671fa080 0x55e7676987d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e739241e140389fc server_cookie=a02d9725a18892d5 in_seq=0 out_seq=0 2024-09-21T00:57:47.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.611+0000 7f9554ff9640 1 -- 172.21.15.1:0/4178476959 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f9564010a80 con 0x55e7671fa080 2024-09-21T00:57:47.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.611+0000 7f9554ff9640 10 client.25318 handle_command_reply: tid=0 2024-09-21T00:57:47.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.611+0000 7f9579e86740 1 client.25318 shutdown 2024-09-21T00:57:47.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.611+0000 7f9579e86740 1 -- 172.21.15.1:0/4178476959 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e767245670 msgr2=0x55e7676213e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:47.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.611+0000 7f9579e86740 1 --2- 172.21.15.1:0/4178476959 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e767245670 0x55e7676213e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f955c0ca190 tx=0x7f955c031a10 comp rx=0 tx=0).stop 2024-09-21T00:57:47.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.611+0000 7f9579e86740 1 -- 172.21.15.1:0/4178476959 shutdown_connections 2024-09-21T00:57:47.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.611+0000 7f9579e86740 1 --2- 172.21.15.1:0/4178476959 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55e7671fa080 0x55e7676987d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:47.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.611+0000 7f9579e86740 1 --2- 172.21.15.1:0/4178476959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e767266350 0x55e76761be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:47.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.611+0000 7f9579e86740 1 --2- 172.21.15.1:0/4178476959 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e767245670 0x55e7676213e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:47.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.611+0000 7f9579e86740 1 --2- 172.21.15.1:0/4178476959 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e76723d490 0x55e767620ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:47.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.611+0000 7f9554ff9640 0 client.25318 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:47.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.611+0000 7f9579e86740 1 -- 172.21.15.1:0/4178476959 >> 172.21.15.1:0/4178476959 conn(0x55e76725a740 msgr2=0x55e76760abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:47.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.612+0000 7f9579e86740 1 -- 172.21.15.1:0/4178476959 shutdown_connections 2024-09-21T00:57:47.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.612+0000 7f9579e86740 1 -- 172.21.15.1:0/4178476959 wait complete. 2024-09-21T00:57:47.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.612+0000 7f9579e86740 20 client.25318 trim_cache size 0 max 16384 2024-09-21T00:57:47.614 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T00:57:47.614 INFO:teuthology.orchestra.run.smithi001.stdout: "return_code": 0, 2024-09-21T00:57:47.614 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_tag": "2383a19c-993d-4440-99f7-93b43dcf33b4", 2024-09-21T00:57:47.615 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": "asynchronous" 2024-09-21T00:57:47.615 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T00:57:47.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.613+0000 7f9573912640 1 -- 172.21.15.1:0/1128963590 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f95580b65a0 msgr2=0x7f95580b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:47.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.613+0000 7f9573912640 1 --2- 172.21.15.1:0/1128963590 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f95580b65a0 0x7f95580b8ab0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f956c114e20 tx=0x7f956800b390 comp rx=0 tx=0).stop 2024-09-21T00:57:47.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.613+0000 7f9573912640 1 -- 172.21.15.1:0/1128963590 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f956c106280 msgr2=0x7f956c1113b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:47.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.613+0000 7f9573912640 1 --2- 172.21.15.1:0/1128963590 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f956c106280 0x7f956c1113b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f955c02a930 tx=0x7f955c004270 comp rx=0 tx=0).stop 2024-09-21T00:57:47.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.614+0000 7f9573912640 1 -- 172.21.15.1:0/1128963590 shutdown_connections 2024-09-21T00:57:47.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.614+0000 7f9573912640 1 --2- 172.21.15.1:0/1128963590 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f956c106bd0 0x7f956c111ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:47.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.614+0000 7f9573912640 1 --2- 172.21.15.1:0/1128963590 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f95580b65a0 0x7f95580b8ab0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:47.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.614+0000 7f9573912640 1 --2- 172.21.15.1:0/1128963590 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f956c106280 0x7f956c1113b0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:47.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.614+0000 7f9573912640 1 --2- 172.21.15.1:0/1128963590 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f956c101fa0 0x7f956c1150d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:47.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.614+0000 7f9573912640 1 -- 172.21.15.1:0/1128963590 >> 172.21.15.1:0/1128963590 conn(0x7f956c077ca0 msgr2=0x7f956c107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:47.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.614+0000 7f9573912640 1 -- 172.21.15.1:0/1128963590 shutdown_connections 2024-09-21T00:57:47.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:47.614+0000 7f9573912640 1 -- 172.21.15.1:0/1128963590 wait complete. 2024-09-21T00:57:47.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:47 smithi001 ceph-mon[31211]: pgmap v375: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-21T00:57:47.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:47 smithi193 ceph-mon[34660]: pgmap v375: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-21T00:57:47.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:47 smithi042 ceph-mon[34481]: pgmap v375: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-21T00:57:48.458 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T00:57:48.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:48 smithi001 ceph-mon[31211]: scrub queued for path: / 2024-09-21T00:57:48.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:48 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T00:57:48.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:48 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T00:57:48.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:48 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T00:57:48.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:48 smithi001 ceph-mon[31211]: scrub summary: idle 2024-09-21T00:57:48.850 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:48.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:48 smithi193 ceph-mon[34660]: scrub queued for path: / 2024-09-21T00:57:48.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:48 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T00:57:48.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:48 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T00:57:48.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:48 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T00:57:48.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:48 smithi193 ceph-mon[34660]: scrub summary: idle 2024-09-21T00:57:48.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:48 smithi042 ceph-mon[34481]: scrub queued for path: / 2024-09-21T00:57:48.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:48 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T00:57:48.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:48 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T00:57:48.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:48 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T00:57:48.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:48 smithi042 ceph-mon[34481]: scrub summary: idle 2024-09-21T00:57:49.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.341+0000 7f5eaaf9d640 1 -- 172.21.15.1:0/3380157899 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ea4102a60 msgr2=0x7f5ea4102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:49.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.341+0000 7f5eaaf9d640 1 --2- 172.21.15.1:0/3380157899 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ea4102a60 0x7f5ea4102e70 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f5e98009900 tx=0x7f5e9802a410 comp rx=0 tx=0).stop 2024-09-21T00:57:49.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.341+0000 7f5eaaf9d640 1 -- 172.21.15.1:0/3380157899 shutdown_connections 2024-09-21T00:57:49.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.341+0000 7f5eaaf9d640 1 --2- 172.21.15.1:0/3380157899 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ea4108cf0 0x7f5ea410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.341+0000 7f5eaaf9d640 1 --2- 172.21.15.1:0/3380157899 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ea41083a0 0x7f5ea41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.341+0000 7f5eaaf9d640 1 --2- 172.21.15.1:0/3380157899 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ea4102a60 0x7f5ea4102e70 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.341+0000 7f5eaaf9d640 1 -- 172.21.15.1:0/3380157899 >> 172.21.15.1:0/3380157899 conn(0x7f5ea4079730 msgr2=0x7f5ea4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:49.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.341+0000 7f5eaaf9d640 1 -- 172.21.15.1:0/3380157899 shutdown_connections 2024-09-21T00:57:49.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.341+0000 7f5eaaf9d640 1 -- 172.21.15.1:0/3380157899 wait complete. 2024-09-21T00:57:49.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.342+0000 7f5eaaf9d640 1 Processor -- start 2024-09-21T00:57:49.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.342+0000 7f5eaaf9d640 1 -- start start 2024-09-21T00:57:49.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.342+0000 7f5eaaf9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ea4102a60 0x7f5ea419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:49.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.342+0000 7f5eaaf9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ea41083a0 0x7f5ea419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:49.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.342+0000 7f5eaaf9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ea4108cf0 0x7f5ea419fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:49.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.342+0000 7f5eaaf9d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea4112960 con 0x7f5ea4108cf0 2024-09-21T00:57:49.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.342+0000 7f5eaaf9d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea41127e0 con 0x7f5ea4102a60 2024-09-21T00:57:49.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.342+0000 7f5eaaf9d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea4112ae0 con 0x7f5ea41083a0 2024-09-21T00:57:49.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.343+0000 7f5ea953a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ea4108cf0 0x7f5ea419fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:49.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.343+0000 7f5ea953a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ea4108cf0 0x7f5ea419fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47446/0 (socket says 172.21.15.1:47446) 2024-09-21T00:57:49.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.343+0000 7f5ea953a640 1 -- 172.21.15.1:0/594246769 learned_addr learned my addr 172.21.15.1:0/594246769 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:49.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.343+0000 7f5ea3fff640 1 --2- 172.21.15.1:0/594246769 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ea41083a0 0x7f5ea419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:49.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.343+0000 7f5ea8d39640 1 --2- 172.21.15.1:0/594246769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ea4102a60 0x7f5ea419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:49.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.343+0000 7f5ea953a640 1 -- 172.21.15.1:0/594246769 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ea41083a0 msgr2=0x7f5ea419aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:49.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.343+0000 7f5ea953a640 1 --2- 172.21.15.1:0/594246769 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ea41083a0 0x7f5ea419aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.343+0000 7f5ea953a640 1 -- 172.21.15.1:0/594246769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ea4102a60 msgr2=0x7f5ea419a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:49.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.343+0000 7f5ea953a640 1 --2- 172.21.15.1:0/594246769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ea4102a60 0x7f5ea419a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.343+0000 7f5ea953a640 1 -- 172.21.15.1:0/594246769 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea41a03d0 con 0x7f5ea4108cf0 2024-09-21T00:57:49.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.343+0000 7f5ea953a640 1 --2- 172.21.15.1:0/594246769 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ea4108cf0 0x7f5ea419fca0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c00eb10 tx=0x7f5e9c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:49.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.343+0000 7f5ea1ffb640 1 -- 172.21.15.1:0/594246769 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c004b20 con 0x7f5ea4108cf0 2024-09-21T00:57:49.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.344+0000 7f5ea1ffb640 1 -- 172.21.15.1:0/594246769 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e9c004cc0 con 0x7f5ea4108cf0 2024-09-21T00:57:49.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.344+0000 7f5ea1ffb640 1 -- 172.21.15.1:0/594246769 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c010670 con 0x7f5ea4108cf0 2024-09-21T00:57:49.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.344+0000 7f5eaaf9d640 1 -- 172.21.15.1:0/594246769 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ea41a06c0 con 0x7f5ea4108cf0 2024-09-21T00:57:49.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.344+0000 7f5eaaf9d640 1 -- 172.21.15.1:0/594246769 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ea4104130 con 0x7f5ea4108cf0 2024-09-21T00:57:49.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.347+0000 7f5ea1ffb640 1 -- 172.21.15.1:0/594246769 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 154562+0+0 (secure 0 0 0) 0x7f5e9c005020 con 0x7f5ea4108cf0 2024-09-21T00:57:49.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.347+0000 7f5eb1511740 1 Processor -- start 2024-09-21T00:57:49.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.348+0000 7f5eb1511740 1 -- start start 2024-09-21T00:57:49.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.348+0000 7f5eb1511740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcd2d36070 0x55bcd30e5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:49.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.348+0000 7f5eb1511740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcd2d0d1b0 0x55bcd30e63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:49.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.348+0000 7f5eb1511740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcd2d15390 0x55bcd30e68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:49.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.348+0000 7f5eb1511740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55bcd3053e50 con 0x55bcd2d36070 2024-09-21T00:57:49.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.348+0000 7f5eb1511740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55bcd3043280 con 0x55bcd2d15390 2024-09-21T00:57:49.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.348+0000 7f5eb1511740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55bcd3047090 con 0x55bcd2d0d1b0 2024-09-21T00:57:49.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.348+0000 7f5ea3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcd2d36070 0x55bcd30e5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:49.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.348+0000 7f5ea3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcd2d36070 0x55bcd30e5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47456/0 (socket says 172.21.15.1:47456) 2024-09-21T00:57:49.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.348+0000 7f5ea3fff640 1 -- 172.21.15.1:0/845443139 learned_addr learned my addr 172.21.15.1:0/845443139 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:49.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.348+0000 7f5ea3fff640 1 -- 172.21.15.1:0/845443139 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcd2d0d1b0 msgr2=0x55bcd30e63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:49.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.348+0000 7f5ea3fff640 1 --2- 172.21.15.1:0/845443139 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcd2d0d1b0 0x55bcd30e63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.348+0000 7f5ea3fff640 1 -- 172.21.15.1:0/845443139 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcd2d15390 msgr2=0x55bcd30e68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:49.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.348+0000 7f5ea3fff640 1 --2- 172.21.15.1:0/845443139 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcd2d15390 0x55bcd30e68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.348+0000 7f5ea3fff640 1 -- 172.21.15.1:0/845443139 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcd2da1650 con 0x55bcd2d36070 2024-09-21T00:57:49.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.349+0000 7f5ea3fff640 1 --2- 172.21.15.1:0/845443139 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcd2d36070 0x55bcd30e5e60 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5e90004650 tx=0x7f5e9000bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac7c755d8c4015a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:49.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.349+0000 7f5e8effd640 1 -- 172.21.15.1:0/845443139 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e90003dd0 con 0x55bcd2d36070 2024-09-21T00:57:49.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.349+0000 7f5e8effd640 1 -- 172.21.15.1:0/845443139 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e90016030 con 0x55bcd2d36070 2024-09-21T00:57:49.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.349+0000 7f5e8effd640 1 -- 172.21.15.1:0/845443139 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e90004d60 con 0x55bcd2d36070 2024-09-21T00:57:49.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.349+0000 7f5ea1ffb640 1 --2- 172.21.15.1:0/594246769 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5e940b6620 0x7f5e940b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:49.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.349+0000 7f5ea1ffb640 1 -- 172.21.15.1:0/594246769 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f5e9c0e7b20 con 0x7f5ea4108cf0 2024-09-21T00:57:49.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.350+0000 7f5ea8d39640 1 --2- 172.21.15.1:0/594246769 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5e940b6620 0x7f5e940b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:49.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.350+0000 7f5eb1511740 1 -- 172.21.15.1:0/845443139 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcd2d36070 msgr2=0x55bcd30e5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:49.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.350+0000 7f5eb1511740 1 --2- 172.21.15.1:0/845443139 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcd2d36070 0x55bcd30e5e60 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5e90004650 tx=0x7f5e9000bc20 comp rx=0 tx=0).stop 2024-09-21T00:57:49.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.350+0000 7f5ea8d39640 1 --2- 172.21.15.1:0/594246769 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5e940b6620 0x7f5e940b8b30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5e98031440 tx=0x7f5e98005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:49.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.350+0000 7f5eb1511740 1 -- 172.21.15.1:0/845443139 shutdown_connections 2024-09-21T00:57:49.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.350+0000 7f5eb1511740 1 --2- 172.21.15.1:0/845443139 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcd2d15390 0x55bcd30e68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.350+0000 7f5eb1511740 1 --2- 172.21.15.1:0/845443139 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcd2d0d1b0 0x55bcd30e63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.350+0000 7f5eb1511740 1 --2- 172.21.15.1:0/845443139 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcd2d36070 0x55bcd30e5e60 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.350+0000 7f5eb1511740 1 -- 172.21.15.1:0/845443139 >> 172.21.15.1:0/845443139 conn(0x55bcd2d2a460 msgr2=0x55bcd30e3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:49.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.351+0000 7f5eb1511740 1 -- 172.21.15.1:0/845443139 shutdown_connections 2024-09-21T00:57:49.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.351+0000 7f5eb1511740 1 -- 172.21.15.1:0/845443139 wait complete. 2024-09-21T00:57:49.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.351+0000 7f5eb1511740 1 -- start start 2024-09-21T00:57:49.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.351+0000 7f5eb1511740 1 Processor -- start 2024-09-21T00:57:49.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.351+0000 7f5eb1511740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcd2d0d1b0 0x55bcd30f15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:49.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.351+0000 7f5eb1511740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcd2d15390 0x55bcd30f1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:49.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.352+0000 7f5eb1511740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcd2d36070 0x55bcd30fd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:49.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.352+0000 7f5eb1511740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55bcd2ea4700 con 0x55bcd2d0d1b0 2024-09-21T00:57:49.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.352+0000 7f5eb1511740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55bcd2fde110 con 0x55bcd2d15390 2024-09-21T00:57:49.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.352+0000 7f5eb1511740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55bcd30f45e0 con 0x55bcd2d36070 2024-09-21T00:57:49.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.352+0000 7f5eb1511740 10 client.0 _ll_register_callbacks cb 0x55bcd2ff7990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:49.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.352+0000 7f5ea8d39640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcd2d0d1b0 0x55bcd30f15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:49.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.352+0000 7f5ea8d39640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcd2d0d1b0 0x55bcd30f15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47458/0 (socket says 172.21.15.1:47458) 2024-09-21T00:57:49.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.352+0000 7f5ea8d39640 1 -- 172.21.15.1:0/3195315373 learned_addr learned my addr 172.21.15.1:0/3195315373 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:49.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.352+0000 7f5ea3fff640 1 --2- 172.21.15.1:0/3195315373 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcd2d15390 0x55bcd30f1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:49.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.352+0000 7f5ea953a640 1 --2- 172.21.15.1:0/3195315373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcd2d36070 0x55bcd30fd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:49.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.352+0000 7f5ea8d39640 1 -- 172.21.15.1:0/3195315373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcd2d36070 msgr2=0x55bcd30fd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:49.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.352+0000 7f5ea8d39640 1 --2- 172.21.15.1:0/3195315373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcd2d36070 0x55bcd30fd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.352+0000 7f5ea8d39640 1 -- 172.21.15.1:0/3195315373 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcd2d15390 msgr2=0x55bcd30f1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:49.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.352+0000 7f5ea8d39640 1 --2- 172.21.15.1:0/3195315373 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcd2d15390 0x55bcd30f1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.352+0000 7f5ea8d39640 1 -- 172.21.15.1:0/3195315373 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcd300bc40 con 0x55bcd2d0d1b0 2024-09-21T00:57:49.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.353+0000 7f5ea8d39640 1 --2- 172.21.15.1:0/3195315373 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcd2d0d1b0 0x55bcd30f15c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5e98009900 tx=0x7f5e98031910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fadd7404d665ebe8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:49.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.353+0000 7f5e83fff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:57:49.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.353+0000 7f5e83fff640 1 -- 172.21.15.1:0/3195315373 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9804c020 con 0x55bcd2d0d1b0 2024-09-21T00:57:49.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.353+0000 7f5e83fff640 1 -- 172.21.15.1:0/3195315373 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f5e98004240 con 0x55bcd2d0d1b0 2024-09-21T00:57:49.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.353+0000 7f5eb1511740 1 -- 172.21.15.1:0/3195315373 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e90016030 con 0x55bcd2d0d1b0 2024-09-21T00:57:49.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.353+0000 7f5e83fff640 1 -- 172.21.15.1:0/3195315373 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5e98057050 con 0x55bcd2d0d1b0 2024-09-21T00:57:49.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.353+0000 7f5eb1511740 10 client.15690 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:49.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.353+0000 7f5eb1511740 1 -- 172.21.15.1:0/3195315373 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bcd3100380 con 0x55bcd2d0d1b0 2024-09-21T00:57:49.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.353+0000 7f5e83fff640 1 -- 172.21.15.1:0/3195315373 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e90016030 con 0x55bcd2d0d1b0 2024-09-21T00:57:49.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.354+0000 7f5e83fff640 1 -- 172.21.15.1:0/3195315373 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f5e98004a20 con 0x55bcd2d0d1b0 2024-09-21T00:57:49.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.354+0000 7f5eb1511740 10 client.15690 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:49.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.354+0000 7f5eb1511740 10 client.15690 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:57:49.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.354+0000 7f5eb1511740 20 client.15690 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:49.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.354+0000 7f5eb1511740 1 --2- 172.21.15.1:0/3195315373 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55bcd2cf49f0 0x55bcd3103920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:49.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.354+0000 7f5eb1511740 4 client.15690 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:57:49.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.354+0000 7f5eb1511740 1 -- 172.21.15.1:0/3195315373 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bcd3055da0 con 0x55bcd2cf49f0 2024-09-21T00:57:49.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.355+0000 7f5ea3fff640 1 --2- 172.21.15.1:0/3195315373 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55bcd2cf49f0 0x55bcd3103920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:49.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.355+0000 7f5e83fff640 10 client.15690 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:49.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.355+0000 7f5ea3fff640 1 --2- 172.21.15.1:0/3195315373 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55bcd2cf49f0 0x55bcd3103920 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=185fccaa116c81cb server_cookie=ffe78f00f720b1eb in_seq=0 out_seq=0 2024-09-21T00:57:49.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.356+0000 7f5e83fff640 1 -- 172.21.15.1:0/3195315373 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bcd3055da0 con 0x55bcd2cf49f0 2024-09-21T00:57:49.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.356+0000 7f5e83fff640 10 client.15690 handle_command_reply: tid=0 2024-09-21T00:57:49.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.356+0000 7f5eb1511740 1 client.15690 shutdown 2024-09-21T00:57:49.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.356+0000 7f5eb1511740 1 -- 172.21.15.1:0/3195315373 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcd2d0d1b0 msgr2=0x55bcd30f15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:49.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.356+0000 7f5eb1511740 1 --2- 172.21.15.1:0/3195315373 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcd2d0d1b0 0x55bcd30f15c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5e98009900 tx=0x7f5e98031910 comp rx=0 tx=0).stop 2024-09-21T00:57:49.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.356+0000 7f5eb1511740 1 -- 172.21.15.1:0/3195315373 shutdown_connections 2024-09-21T00:57:49.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.356+0000 7f5eb1511740 1 --2- 172.21.15.1:0/3195315373 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55bcd2cf49f0 0x55bcd3103920 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.356+0000 7f5eb1511740 1 --2- 172.21.15.1:0/3195315373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcd2d36070 0x55bcd30fd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.356+0000 7f5eb1511740 1 --2- 172.21.15.1:0/3195315373 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcd2d15390 0x55bcd30f1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.356+0000 7f5eb1511740 1 --2- 172.21.15.1:0/3195315373 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcd2d0d1b0 0x55bcd30f15c0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.356+0000 7f5eb1511740 1 -- 172.21.15.1:0/3195315373 >> 172.21.15.1:0/3195315373 conn(0x55bcd2d2a460 msgr2=0x55bcd30e9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:49.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.356+0000 7f5e83fff640 0 client.15690 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:49.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.357+0000 7f5eb1511740 1 -- 172.21.15.1:0/3195315373 shutdown_connections 2024-09-21T00:57:49.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.357+0000 7f5eb1511740 1 -- 172.21.15.1:0/3195315373 wait complete. 2024-09-21T00:57:49.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.357+0000 7f5eb1511740 20 client.15690 trim_cache size 0 max 16384 2024-09-21T00:57:49.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.375+0000 7f5eb1511740 1 Processor -- start 2024-09-21T00:57:49.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.375+0000 7f5eb1511740 1 -- start start 2024-09-21T00:57:49.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.375+0000 7f5eb1511740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcd2d0d1b0 0x55bcd30f34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:49.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.375+0000 7f5eb1511740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcd2d15390 0x55bcd30e75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:49.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.375+0000 7f5eb1511740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcd2d36070 0x55bcd30fd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:49.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.375+0000 7f5eb1511740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea41ad260 con 0x55bcd2d0d1b0 2024-09-21T00:57:49.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.375+0000 7f5eb1511740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea41aeda0 con 0x55bcd2d36070 2024-09-21T00:57:49.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.375+0000 7f5eb1511740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea41ad930 con 0x55bcd2d15390 2024-09-21T00:57:49.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.376+0000 7f5ea8d39640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcd2d0d1b0 0x55bcd30f34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:49.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.376+0000 7f5ea8d39640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcd2d0d1b0 0x55bcd30f34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47462/0 (socket says 172.21.15.1:47462) 2024-09-21T00:57:49.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.376+0000 7f5ea8d39640 1 -- 172.21.15.1:0/3572536212 learned_addr learned my addr 172.21.15.1:0/3572536212 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:49.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.376+0000 7f5ea953a640 1 --2- 172.21.15.1:0/3572536212 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcd2d36070 0x55bcd30fd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:49.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.376+0000 7f5ea3fff640 1 --2- 172.21.15.1:0/3572536212 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcd2d15390 0x55bcd30e75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:49.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.376+0000 7f5ea953a640 1 -- 172.21.15.1:0/3572536212 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcd2d15390 msgr2=0x55bcd30e75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:49.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.376+0000 7f5ea953a640 1 --2- 172.21.15.1:0/3572536212 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcd2d15390 0x55bcd30e75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.376+0000 7f5ea953a640 1 -- 172.21.15.1:0/3572536212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcd2d0d1b0 msgr2=0x55bcd30f34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:49.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.376+0000 7f5ea953a640 1 --2- 172.21.15.1:0/3572536212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcd2d0d1b0 0x55bcd30f34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.376+0000 7f5ea953a640 1 -- 172.21.15.1:0/3572536212 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcd30e8150 con 0x55bcd2d36070 2024-09-21T00:57:49.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.376+0000 7f5ea8d39640 1 --2- 172.21.15.1:0/3572536212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcd2d0d1b0 0x55bcd30f34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:49.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.377+0000 7f5ea953a640 1 --2- 172.21.15.1:0/3572536212 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcd2d36070 0x55bcd30fd800 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c0e5450 tx=0x7f5e9c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e1936fb7a6ef480 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:49.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.377+0000 7f5ea3fff640 1 --2- 172.21.15.1:0/3572536212 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcd2d15390 0x55bcd30e75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:49.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.377+0000 7f5e8e7fc640 1 -- 172.21.15.1:0/3572536212 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c0b2070 con 0x55bcd2d36070 2024-09-21T00:57:49.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.377+0000 7f5e8e7fc640 1 -- 172.21.15.1:0/3572536212 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e9c0ad5e0 con 0x55bcd2d36070 2024-09-21T00:57:49.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.377+0000 7f5e8e7fc640 1 -- 172.21.15.1:0/3572536212 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c0e56a0 con 0x55bcd2d36070 2024-09-21T00:57:49.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.378+0000 7f5eb1511740 1 -- 172.21.15.1:0/3572536212 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcd2d36070 msgr2=0x55bcd30fd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:49.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.378+0000 7f5eb1511740 1 --2- 172.21.15.1:0/3572536212 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcd2d36070 0x55bcd30fd800 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c0e5450 tx=0x7f5e9c004a40 comp rx=0 tx=0).stop 2024-09-21T00:57:49.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.378+0000 7f5eb1511740 1 -- 172.21.15.1:0/3572536212 shutdown_connections 2024-09-21T00:57:49.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.378+0000 7f5eb1511740 1 --2- 172.21.15.1:0/3572536212 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcd2d36070 0x55bcd30fd800 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.378+0000 7f5eb1511740 1 --2- 172.21.15.1:0/3572536212 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcd2d15390 0x55bcd30e75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.378+0000 7f5eb1511740 1 --2- 172.21.15.1:0/3572536212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcd2d0d1b0 0x55bcd30f34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.378+0000 7f5eb1511740 1 -- 172.21.15.1:0/3572536212 >> 172.21.15.1:0/3572536212 conn(0x55bcd2d2a460 msgr2=0x55bcd30e6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:49.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.378+0000 7f5eb1511740 1 -- 172.21.15.1:0/3572536212 shutdown_connections 2024-09-21T00:57:49.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.378+0000 7f5eb1511740 1 -- 172.21.15.1:0/3572536212 wait complete. 2024-09-21T00:57:49.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.379+0000 7f5eb1511740 1 -- start start 2024-09-21T00:57:49.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.379+0000 7f5eb1511740 1 Processor -- start 2024-09-21T00:57:49.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.379+0000 7f5eb1511740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcd2d0d1b0 0x55bcd30f5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:49.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.379+0000 7f5eb1511740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcd2d15390 0x55bcd30f6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:49.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.380+0000 7f5eb1511740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcd2d36070 0x55bcd316d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:49.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.380+0000 7f5eb1511740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea41ae6d0 con 0x55bcd2d36070 2024-09-21T00:57:49.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.380+0000 7f5eb1511740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea41ae000 con 0x55bcd2d0d1b0 2024-09-21T00:57:49.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.380+0000 7f5eb1511740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea41ab240 con 0x55bcd2d15390 2024-09-21T00:57:49.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.380+0000 7f5eb1511740 10 client.0 _ll_register_callbacks cb 0x7f5e9803f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:49.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.380+0000 7f5ea953a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcd2d36070 0x55bcd316d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:49.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.380+0000 7f5ea8d39640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcd2d0d1b0 0x55bcd30f5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:49.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.380+0000 7f5ea953a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcd2d36070 0x55bcd316d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47466/0 (socket says 172.21.15.1:47466) 2024-09-21T00:57:49.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.380+0000 7f5ea953a640 1 -- 172.21.15.1:0/4209149162 learned_addr learned my addr 172.21.15.1:0/4209149162 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:49.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.380+0000 7f5ea3fff640 1 --2- 172.21.15.1:0/4209149162 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcd2d15390 0x55bcd30f6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:49.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.380+0000 7f5ea8d39640 1 -- 172.21.15.1:0/4209149162 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcd2d15390 msgr2=0x55bcd30f6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:49.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.380+0000 7f5ea8d39640 1 --2- 172.21.15.1:0/4209149162 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcd2d15390 0x55bcd30f6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.380+0000 7f5ea8d39640 1 -- 172.21.15.1:0/4209149162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcd2d36070 msgr2=0x55bcd316d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:49.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.380+0000 7f5ea8d39640 1 --2- 172.21.15.1:0/4209149162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcd2d36070 0x55bcd316d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.380+0000 7f5ea8d39640 1 -- 172.21.15.1:0/4209149162 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcd316d820 con 0x55bcd2d0d1b0 2024-09-21T00:57:49.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.381+0000 7f5ea8d39640 1 --2- 172.21.15.1:0/4209149162 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcd2d0d1b0 0x55bcd30f5c80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5e98033000 tx=0x7f5e98032c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bff31c70e3e8d13 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:49.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.381+0000 7f5e83fff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T00:57:49.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.381+0000 7f5e83fff640 1 -- 172.21.15.1:0/4209149162 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9804c070 con 0x55bcd2d0d1b0 2024-09-21T00:57:49.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.381+0000 7f5e83fff640 1 -- 172.21.15.1:0/4209149162 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f5e98004040 con 0x55bcd2d0d1b0 2024-09-21T00:57:49.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.381+0000 7f5eb1511740 1 -- 172.21.15.1:0/4209149162 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e9c0ad5e0 con 0x55bcd2d0d1b0 2024-09-21T00:57:49.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.381+0000 7f5e83fff640 1 -- 172.21.15.1:0/4209149162 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5e9806b050 con 0x55bcd2d0d1b0 2024-09-21T00:57:49.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.381+0000 7f5eb1511740 10 client.25385 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:49.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.381+0000 7f5eb1511740 1 -- 172.21.15.1:0/4209149162 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bcd316e980 con 0x55bcd2d0d1b0 2024-09-21T00:57:49.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.382+0000 7f5e83fff640 1 -- 172.21.15.1:0/4209149162 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e9c0ad5e0 con 0x55bcd2d0d1b0 2024-09-21T00:57:49.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.382+0000 7f5e83fff640 1 -- 172.21.15.1:0/4209149162 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f5e98004fe0 con 0x55bcd2d0d1b0 2024-09-21T00:57:49.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.382+0000 7f5eb1511740 10 client.25385 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:49.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.382+0000 7f5eb1511740 10 client.25385 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:57:49.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.382+0000 7f5eb1511740 20 client.25385 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:49.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.382+0000 7f5eb1511740 1 --2- 172.21.15.1:0/4209149162 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55bcd2cc9da0 0x55bcd3171140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:49.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.382+0000 7f5eb1511740 4 client.25385 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T00:57:49.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.382+0000 7f5eb1511740 1 -- 172.21.15.1:0/4209149162 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55bcd3051850 con 0x55bcd2cc9da0 2024-09-21T00:57:49.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.382+0000 7f5ea3fff640 1 --2- 172.21.15.1:0/4209149162 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55bcd2cc9da0 0x55bcd3171140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:49.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.383+0000 7f5e83fff640 10 client.25385 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:49.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.383+0000 7f5ea3fff640 1 --2- 172.21.15.1:0/4209149162 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55bcd2cc9da0 0x55bcd3171140 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ce6bb1a6c710475 server_cookie=9d69304a5420820b in_seq=0 out_seq=0 2024-09-21T00:57:49.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.383+0000 7f5e83fff640 1 -- 172.21.15.1:0/4209149162 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x55bcd3051850 con 0x55bcd2cc9da0 2024-09-21T00:57:49.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.383+0000 7f5e83fff640 10 client.25385 handle_command_reply: tid=0 2024-09-21T00:57:49.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.383+0000 7f5eb1511740 1 client.25385 shutdown 2024-09-21T00:57:49.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.383+0000 7f5eb1511740 1 -- 172.21.15.1:0/4209149162 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcd2d0d1b0 msgr2=0x55bcd30f5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:49.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.384+0000 7f5eb1511740 1 --2- 172.21.15.1:0/4209149162 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcd2d0d1b0 0x55bcd30f5c80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5e98033000 tx=0x7f5e98032c70 comp rx=0 tx=0).stop 2024-09-21T00:57:49.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.384+0000 7f5eb1511740 1 -- 172.21.15.1:0/4209149162 shutdown_connections 2024-09-21T00:57:49.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.384+0000 7f5eb1511740 1 --2- 172.21.15.1:0/4209149162 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55bcd2cc9da0 0x55bcd3171140 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.384+0000 7f5e83fff640 0 client.25385 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:49.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.384+0000 7f5eb1511740 1 --2- 172.21.15.1:0/4209149162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcd2d36070 0x55bcd316d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.384+0000 7f5eb1511740 1 --2- 172.21.15.1:0/4209149162 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bcd2d15390 0x55bcd30f6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.384+0000 7f5eb1511740 1 --2- 172.21.15.1:0/4209149162 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bcd2d0d1b0 0x55bcd30f5c80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.384+0000 7f5eb1511740 1 -- 172.21.15.1:0/4209149162 >> 172.21.15.1:0/4209149162 conn(0x55bcd2d2a460 msgr2=0x55bcd30f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:49.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.384+0000 7f5eb1511740 1 -- 172.21.15.1:0/4209149162 shutdown_connections 2024-09-21T00:57:49.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.384+0000 7f5eb1511740 1 -- 172.21.15.1:0/4209149162 wait complete. 2024-09-21T00:57:49.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.384+0000 7f5eb1511740 20 client.25385 trim_cache size 0 max 16384 2024-09-21T00:57:49.389 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T00:57:49.389 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "no active scrubs running", 2024-09-21T00:57:49.389 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": {}, 2024-09-21T00:57:49.389 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_stats": { 2024-09-21T00:57:49.389 INFO:teuthology.orchestra.run.smithi001.stdout: "2383a19c-993d-4440-99f7-93b43dcf33b4": { 2024-09-21T00:57:49.389 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:47.609257+0000", 2024-09-21T00:57:49.390 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T00:57:49.390 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T00:57:49.390 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T00:57:49.390 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T00:57:49.390 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T00:57:49.390 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T00:57:49.390 INFO:teuthology.orchestra.run.smithi001.stdout: "53fa74e4-5aa8-408b-9724-7c93618f7636": { 2024-09-21T00:57:49.390 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:01.730608+0000", 2024-09-21T00:57:49.390 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T00:57:49.390 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T00:57:49.390 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T00:57:49.391 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T00:57:49.391 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T00:57:49.391 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T00:57:49.391 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T00:57:49.391 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T00:57:49.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.385+0000 7f5eaaf9d640 1 -- 172.21.15.1:0/594246769 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5e940b6620 msgr2=0x7f5e940b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:49.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.385+0000 7f5eaaf9d640 1 --2- 172.21.15.1:0/594246769 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5e940b6620 0x7f5e940b8b30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5e98031440 tx=0x7f5e98005a20 comp rx=0 tx=0).stop 2024-09-21T00:57:49.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.385+0000 7f5eaaf9d640 1 -- 172.21.15.1:0/594246769 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ea4108cf0 msgr2=0x7f5ea419fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:49.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.385+0000 7f5eaaf9d640 1 --2- 172.21.15.1:0/594246769 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ea4108cf0 0x7f5ea419fca0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c00eb10 tx=0x7f5e9c00c2d0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.385+0000 7f5eaaf9d640 1 -- 172.21.15.1:0/594246769 shutdown_connections 2024-09-21T00:57:49.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.385+0000 7f5eaaf9d640 1 --2- 172.21.15.1:0/594246769 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5e940b6620 0x7f5e940b8b30 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.385+0000 7f5eaaf9d640 1 --2- 172.21.15.1:0/594246769 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ea4108cf0 0x7f5ea419fca0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.385+0000 7f5eaaf9d640 1 --2- 172.21.15.1:0/594246769 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ea41083a0 0x7f5ea419aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.385+0000 7f5eaaf9d640 1 --2- 172.21.15.1:0/594246769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ea4102a60 0x7f5ea419a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.385+0000 7f5eaaf9d640 1 -- 172.21.15.1:0/594246769 >> 172.21.15.1:0/594246769 conn(0x7f5ea4079730 msgr2=0x7f5ea4101aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:49.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.385+0000 7f5eaaf9d640 1 -- 172.21.15.1:0/594246769 shutdown_connections 2024-09-21T00:57:49.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:49.386+0000 7f5eaaf9d640 1 -- 172.21.15.1:0/594246769 wait complete. 2024-09-21T00:57:49.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:49 smithi001 ceph-mon[31211]: pgmap v376: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-21T00:57:49.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:49 smithi193 ceph-mon[34660]: pgmap v376: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-21T00:57:49.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:49 smithi042 ceph-mon[34481]: pgmap v376: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-21T00:57:50.072 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T00:57:50.073 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:57:50.370 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:50.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.930+0000 7fd482875640 1 -- 172.21.15.1:0/932445745 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd47c108cf0 msgr2=0x7fd47c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:50.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.930+0000 7fd482875640 1 --2- 172.21.15.1:0/932445745 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd47c108cf0 0x7fd47c10f520 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd474009ca0 tx=0x7fd47402a8c0 comp rx=0 tx=0).stop 2024-09-21T00:57:50.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.931+0000 7fd482875640 1 -- 172.21.15.1:0/932445745 shutdown_connections 2024-09-21T00:57:50.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.931+0000 7fd482875640 1 --2- 172.21.15.1:0/932445745 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd47c108cf0 0x7fd47c10f520 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:50.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.931+0000 7fd482875640 1 --2- 172.21.15.1:0/932445745 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd47c1083a0 0x7fd47c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:50.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.931+0000 7fd482875640 1 --2- 172.21.15.1:0/932445745 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd47c102a60 0x7fd47c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:50.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.931+0000 7fd482875640 1 -- 172.21.15.1:0/932445745 >> 172.21.15.1:0/932445745 conn(0x7fd47c079730 msgr2=0x7fd47c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:50.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.931+0000 7fd482875640 1 -- 172.21.15.1:0/932445745 shutdown_connections 2024-09-21T00:57:50.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.931+0000 7fd482875640 1 -- 172.21.15.1:0/932445745 wait complete. 2024-09-21T00:57:50.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.932+0000 7fd482875640 1 Processor -- start 2024-09-21T00:57:50.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.932+0000 7fd482875640 1 -- start start 2024-09-21T00:57:50.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.933+0000 7fd482875640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd47c102a60 0x7fd47c199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:50.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.933+0000 7fd482875640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd47c1083a0 0x7fd47c1997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:50.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.933+0000 7fd482875640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd47c108cf0 0x7fd47c19ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:50.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.933+0000 7fd482875640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd47c1129b0 con 0x7fd47c108cf0 2024-09-21T00:57:50.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.933+0000 7fd480e12640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd47c108cf0 0x7fd47c19ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:50.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.933+0000 7fd480e12640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd47c108cf0 0x7fd47c19ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47472/0 (socket says 172.21.15.1:47472) 2024-09-21T00:57:50.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.933+0000 7fd480e12640 1 -- 172.21.15.1:0/4017966258 learned_addr learned my addr 172.21.15.1:0/4017966258 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:50.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.933+0000 7fd47b7fe640 1 --2- 172.21.15.1:0/4017966258 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd47c1083a0 0x7fd47c1997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:50.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.934+0000 7fd482875640 1 -- 172.21.15.1:0/4017966258 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd47c112830 con 0x7fd47c102a60 2024-09-21T00:57:50.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.934+0000 7fd47bfff640 1 --2- 172.21.15.1:0/4017966258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd47c102a60 0x7fd47c199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:50.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.934+0000 7fd482875640 1 -- 172.21.15.1:0/4017966258 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd47c112b30 con 0x7fd47c1083a0 2024-09-21T00:57:50.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.934+0000 7fd47b7fe640 1 -- 172.21.15.1:0/4017966258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd47c102a60 msgr2=0x7fd47c199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:50.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.934+0000 7fd47b7fe640 1 --2- 172.21.15.1:0/4017966258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd47c102a60 0x7fd47c199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:50.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.934+0000 7fd47b7fe640 1 -- 172.21.15.1:0/4017966258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd47c108cf0 msgr2=0x7fd47c19ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:50.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.934+0000 7fd47b7fe640 1 --2- 172.21.15.1:0/4017966258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd47c108cf0 0x7fd47c19ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:50.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.934+0000 7fd47b7fe640 1 -- 172.21.15.1:0/4017966258 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd47c19f170 con 0x7fd47c1083a0 2024-09-21T00:57:50.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.934+0000 7fd480e12640 1 --2- 172.21.15.1:0/4017966258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd47c108cf0 0x7fd47c19ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:50.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.935+0000 7fd47b7fe640 1 --2- 172.21.15.1:0/4017966258 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd47c1083a0 0x7fd47c1997a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd47000e9c0 tx=0x7fd47000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:50.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.935+0000 7fd4797fa640 1 -- 172.21.15.1:0/4017966258 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47000ccc0 con 0x7fd47c1083a0 2024-09-21T00:57:50.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.935+0000 7fd482875640 1 -- 172.21.15.1:0/4017966258 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd47c19f460 con 0x7fd47c1083a0 2024-09-21T00:57:50.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.935+0000 7fd4797fa640 1 -- 172.21.15.1:0/4017966258 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd470005020 con 0x7fd47c1083a0 2024-09-21T00:57:50.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.935+0000 7fd4797fa640 1 -- 172.21.15.1:0/4017966258 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd470004a00 con 0x7fd47c1083a0 2024-09-21T00:57:50.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.935+0000 7fd482875640 1 -- 172.21.15.1:0/4017966258 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd47c06ae40 con 0x7fd47c1083a0 2024-09-21T00:57:50.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.936+0000 7fd482875640 1 -- 172.21.15.1:0/4017966258 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd47c19a330 con 0x7fd47c1083a0 2024-09-21T00:57:50.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.938+0000 7fd4797fa640 1 -- 172.21.15.1:0/4017966258 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 19) ==== 154562+0+0 (secure 0 0 0) 0x7fd4700051d0 con 0x7fd47c1083a0 2024-09-21T00:57:50.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.939+0000 7fd4797fa640 1 --2- 172.21.15.1:0/4017966258 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd4640bedb0 0x7fd4640c12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:50.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.939+0000 7fd4797fa640 1 -- 172.21.15.1:0/4017966258 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fd4700e7860 con 0x7fd47c1083a0 2024-09-21T00:57:50.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.939+0000 7fd47bfff640 1 --2- 172.21.15.1:0/4017966258 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd4640bedb0 0x7fd4640c12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:50.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.940+0000 7fd47bfff640 1 --2- 172.21.15.1:0/4017966258 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd4640bedb0 0x7fd4640c12c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009b60 tx=0x7fd46c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:50.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:50.942+0000 7fd4797fa640 1 -- 172.21.15.1:0/4017966258 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd4700adf70 con 0x7fd47c1083a0 2024-09-21T00:57:51.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:51.170+0000 7fd482875640 1 -- 172.21.15.1:0/4017966258 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd47c06b4f0 con 0x7fd47c1083a0 2024-09-21T00:57:51.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:51.171+0000 7fd4797fa640 1 -- 172.21.15.1:0/4017966258 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11955 (secure 0 0 0) 0x7fd4700b2350 con 0x7fd47c1083a0 2024-09-21T00:57:51.172 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:57:51.172 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":27,"btime":"2024-09-21T00:56:52:855037+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2810186677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2810186677},{"type":"v1","addr":"172.21.15.1:6835","nonce":2810186677}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14736,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3935320478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3935320478},{"type":"v1","addr":"172.21.15.1:6837","nonce":3935320478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:54:58.592853+0000","modified":"2024-09-21T00:56:52.784125+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24653,"mds_1":24637,"mds_2":24626,"mds_3":24622,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/2125703572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2125703572},{"type":"v1","addr":"172.21.15.1:6839","nonce":2125703572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/3860445313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860445313},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860445313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6833/712170939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":712170939},{"type":"v1","addr":"172.21.15.193:6833","nonce":712170939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6833/1653911656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1653911656},{"type":"v1","addr":"172.21.15.42:6833","nonce":1653911656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6835/793085918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":793085918},{"type":"v1","addr":"172.21.15.42:6835","nonce":793085918}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6835/3631682268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":3631682268},{"type":"v1","addr":"172.21.15.193:6835","nonce":3631682268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.193:6837/909252228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":909252228},{"type":"v1","addr":"172.21.15.193:6837","nonce":909252228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.42:6837/2395608508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2395608508},{"type":"v1","addr":"172.21.15.42:6837","nonce":2395608508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.193:6839/1365361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1365361177},{"type":"v1","addr":"172.21.15.193:6839","nonce":1365361177}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6839/2526476666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2526476666},{"type":"v1","addr":"172.21.15.42:6839","nonce":2526476666}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24610,24622,24626,24637,24653]},"id":1}]} 2024-09-21T00:57:51.173 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 27 2024-09-21T00:57:51.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:51.174+0000 7fd482875640 1 -- 172.21.15.1:0/4017966258 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd4640bedb0 msgr2=0x7fd4640c12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:51.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:51.174+0000 7fd482875640 1 --2- 172.21.15.1:0/4017966258 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd4640bedb0 0x7fd4640c12c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009b60 tx=0x7fd46c005f90 comp rx=0 tx=0).stop 2024-09-21T00:57:51.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:51.174+0000 7fd482875640 1 -- 172.21.15.1:0/4017966258 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd47c1083a0 msgr2=0x7fd47c1997a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:51.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:51.174+0000 7fd482875640 1 --2- 172.21.15.1:0/4017966258 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd47c1083a0 0x7fd47c1997a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd47000e9c0 tx=0x7fd47000ee80 comp rx=0 tx=0).stop 2024-09-21T00:57:51.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:51.178+0000 7fd482875640 1 -- 172.21.15.1:0/4017966258 shutdown_connections 2024-09-21T00:57:51.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:51.178+0000 7fd482875640 1 --2- 172.21.15.1:0/4017966258 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd4640bedb0 0x7fd4640c12c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:51.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:51.178+0000 7fd482875640 1 --2- 172.21.15.1:0/4017966258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd47c108cf0 0x7fd47c19ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:51.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:51.178+0000 7fd482875640 1 --2- 172.21.15.1:0/4017966258 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd47c1083a0 0x7fd47c1997a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:51.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:51.178+0000 7fd482875640 1 --2- 172.21.15.1:0/4017966258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd47c102a60 0x7fd47c199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:51.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:51.178+0000 7fd482875640 1 -- 172.21.15.1:0/4017966258 >> 172.21.15.1:0/4017966258 conn(0x7fd47c079730 msgr2=0x7fd47c101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:51.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:51.178+0000 7fd482875640 1 -- 172.21.15.1:0/4017966258 shutdown_connections 2024-09-21T00:57:51.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:51.179+0000 7fd482875640 1 -- 172.21.15.1:0/4017966258 wait complete. 2024-09-21T00:57:51.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:51 smithi001 ceph-mon[31211]: pgmap v377: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-09-21T00:57:51.757 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:51 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/4017966258' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:57:51.967 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T00:57:51.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:51 smithi193 ceph-mon[34660]: pgmap v377: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-09-21T00:57:51.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:51 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/4017966258' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:57:51.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:51 smithi042 ceph-mon[34481]: pgmap v377: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-09-21T00:57:51.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:51 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/4017966258' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:57:52.374 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:52.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.924+0000 7fa74844a640 1 -- 172.21.15.1:0/3018450740 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7401083a0 msgr2=0x7fa7401087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:52.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.924+0000 7fa74844a640 1 --2- 172.21.15.1:0/3018450740 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7401083a0 0x7fa7401087b0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa730009900 tx=0x7fa73002a410 comp rx=0 tx=0).stop 2024-09-21T00:57:52.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.924+0000 7fa74844a640 1 -- 172.21.15.1:0/3018450740 shutdown_connections 2024-09-21T00:57:52.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.924+0000 7fa74844a640 1 --2- 172.21.15.1:0/3018450740 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa740108cf0 0x7fa74010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.924+0000 7fa74844a640 1 --2- 172.21.15.1:0/3018450740 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7401083a0 0x7fa7401087b0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.924+0000 7fa74844a640 1 --2- 172.21.15.1:0/3018450740 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa740102a60 0x7fa740102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.924+0000 7fa74844a640 1 -- 172.21.15.1:0/3018450740 >> 172.21.15.1:0/3018450740 conn(0x7fa740079730 msgr2=0x7fa740079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:52.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.925+0000 7fa74844a640 1 -- 172.21.15.1:0/3018450740 shutdown_connections 2024-09-21T00:57:52.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.925+0000 7fa74844a640 1 -- 172.21.15.1:0/3018450740 wait complete. 2024-09-21T00:57:52.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.925+0000 7fa74844a640 1 Processor -- start 2024-09-21T00:57:52.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.925+0000 7fa74844a640 1 -- start start 2024-09-21T00:57:52.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.926+0000 7fa74844a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa740102a60 0x7fa74010c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:52.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.926+0000 7fa74844a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7401083a0 0x7fa74010cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:52.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.926+0000 7fa74844a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa740108cf0 0x7fa74010d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:52.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.926+0000 7fa74844a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa7401116e0 con 0x7fa7401083a0 2024-09-21T00:57:52.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.926+0000 7fa74844a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa740111560 con 0x7fa740102a60 2024-09-21T00:57:52.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.926+0000 7fa74844a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa740111860 con 0x7fa740108cf0 2024-09-21T00:57:52.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.926+0000 7fa7461e6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa740102a60 0x7fa74010c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:52.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.926+0000 7fa7459e5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7401083a0 0x7fa74010cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:52.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.926+0000 7fa7461e6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa740102a60 0x7fa74010c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:45550/0 (socket says 172.21.15.1:45550) 2024-09-21T00:57:52.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.926+0000 7fa7461e6640 1 -- 172.21.15.1:0/2759832618 learned_addr learned my addr 172.21.15.1:0/2759832618 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:52.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.926+0000 7fa7459e5640 1 -- 172.21.15.1:0/2759832618 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa740108cf0 msgr2=0x7fa74010d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:52.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.926+0000 7fa7459e5640 1 --2- 172.21.15.1:0/2759832618 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa740108cf0 0x7fa74010d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.926+0000 7fa7459e5640 1 -- 172.21.15.1:0/2759832618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa740102a60 msgr2=0x7fa74010c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:52.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.926+0000 7fa7459e5640 1 --2- 172.21.15.1:0/2759832618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa740102a60 0x7fa74010c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.926+0000 7fa7459e5640 1 -- 172.21.15.1:0/2759832618 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7401acb10 con 0x7fa7401083a0 2024-09-21T00:57:52.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.926+0000 7fa7461e6640 1 --2- 172.21.15.1:0/2759832618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa740102a60 0x7fa74010c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:52.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.927+0000 7fa7459e5640 1 --2- 172.21.15.1:0/2759832618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7401083a0 0x7fa74010cec0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa73002a930 tx=0x7fa730003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:52.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.927+0000 7fa7377fe640 1 -- 172.21.15.1:0/2759832618 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73003f070 con 0x7fa7401083a0 2024-09-21T00:57:52.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.927+0000 7fa7377fe640 1 -- 172.21.15.1:0/2759832618 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa730031b60 con 0x7fa7401083a0 2024-09-21T00:57:52.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.927+0000 7fa7377fe640 1 -- 172.21.15.1:0/2759832618 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa730035030 con 0x7fa7401083a0 2024-09-21T00:57:52.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.927+0000 7fa74844a640 1 -- 172.21.15.1:0/2759832618 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7401acda0 con 0x7fa7401083a0 2024-09-21T00:57:52.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.927+0000 7fa74844a640 1 -- 172.21.15.1:0/2759832618 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7401ad1a0 con 0x7fa7401083a0 2024-09-21T00:57:52.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.930+0000 7fa74e9be740 1 Processor -- start 2024-09-21T00:57:52.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.931+0000 7fa74e9be740 1 -- start start 2024-09-21T00:57:52.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.931+0000 7fa74e9be740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56163e417070 0x56163e7be2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:52.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.931+0000 7fa74e9be740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56163e3ee1b0 0x56163e7be800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:52.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.931+0000 7fa74e9be740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56163e3f6390 0x56163e7bed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:52.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.931+0000 7fa74e9be740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56163e734ea0 con 0x56163e417070 2024-09-21T00:57:52.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.931+0000 7fa74e9be740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56163e7242d0 con 0x56163e3ee1b0 2024-09-21T00:57:52.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.931+0000 7fa74e9be740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56163e7280e0 con 0x56163e3f6390 2024-09-21T00:57:52.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.932+0000 7fa7461e6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56163e3ee1b0 0x56163e7be800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:52.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.932+0000 7fa7461e6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56163e3ee1b0 0x56163e7be800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:45560/0 (socket says 172.21.15.1:45560) 2024-09-21T00:57:52.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.932+0000 7fa7461e6640 1 -- 172.21.15.1:0/1148009975 learned_addr learned my addr 172.21.15.1:0/1148009975 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:52.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.932+0000 7fa7469e7640 1 --2- 172.21.15.1:0/1148009975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56163e417070 0x56163e7be2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:52.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.932+0000 7fa7461e6640 1 -- 172.21.15.1:0/1148009975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56163e3f6390 msgr2=0x56163e7bed40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T00:57:52.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.932+0000 7fa7461e6640 1 --2- 172.21.15.1:0/1148009975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56163e3f6390 0x56163e7bed40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.932+0000 7fa7461e6640 1 -- 172.21.15.1:0/1148009975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56163e417070 msgr2=0x56163e7be2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:52.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.932+0000 7fa7461e6640 1 --2- 172.21.15.1:0/1148009975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56163e417070 0x56163e7be2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.932+0000 7fa7461e6640 1 -- 172.21.15.1:0/1148009975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56163e482650 con 0x56163e3ee1b0 2024-09-21T00:57:52.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.932+0000 7fa7461e6640 1 --2- 172.21.15.1:0/1148009975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56163e3ee1b0 0x56163e7be800 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa73c010580 tx=0x7fa73c010a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dafb139cc7a0737e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:52.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.933+0000 7fa734d9a640 1 -- 172.21.15.1:0/1148009975 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73c00e830 con 0x56163e3ee1b0 2024-09-21T00:57:52.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.933+0000 7fa734d9a640 1 -- 172.21.15.1:0/1148009975 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa73c00ee80 con 0x56163e3ee1b0 2024-09-21T00:57:52.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.933+0000 7fa734d9a640 1 -- 172.21.15.1:0/1148009975 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73c01b430 con 0x56163e3ee1b0 2024-09-21T00:57:52.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.933+0000 7fa7377fe640 1 -- 172.21.15.1:0/2759832618 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 154562+0+0 (secure 0 0 0) 0x7fa730042070 con 0x7fa7401083a0 2024-09-21T00:57:52.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.933+0000 7fa7377fe640 1 --2- 172.21.15.1:0/2759832618 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa72c0b66a0 0x7fa72c0b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:52.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.934+0000 7fa74e9be740 1 -- 172.21.15.1:0/1148009975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56163e3ee1b0 msgr2=0x56163e7be800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:52.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.934+0000 7fa74e9be740 1 --2- 172.21.15.1:0/1148009975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56163e3ee1b0 0x56163e7be800 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa73c010580 tx=0x7fa73c010a40 comp rx=0 tx=0).stop 2024-09-21T00:57:52.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.934+0000 7fa7377fe640 1 -- 172.21.15.1:0/2759832618 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fa730107b20 con 0x7fa7401083a0 2024-09-21T00:57:52.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.934+0000 7fa7469e7640 1 --2- 172.21.15.1:0/2759832618 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa72c0b66a0 0x7fa72c0b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:52.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.934+0000 7fa74e9be740 1 -- 172.21.15.1:0/1148009975 shutdown_connections 2024-09-21T00:57:52.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.934+0000 7fa74e9be740 1 --2- 172.21.15.1:0/1148009975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56163e3f6390 0x56163e7bed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.934+0000 7fa74e9be740 1 --2- 172.21.15.1:0/1148009975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56163e3ee1b0 0x56163e7be800 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.934+0000 7fa74e9be740 1 --2- 172.21.15.1:0/1148009975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56163e417070 0x56163e7be2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.934+0000 7fa74e9be740 1 -- 172.21.15.1:0/1148009975 >> 172.21.15.1:0/1148009975 conn(0x56163e40b460 msgr2=0x56163e7bc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:52.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.935+0000 7fa7469e7640 1 --2- 172.21.15.1:0/2759832618 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa72c0b66a0 0x7fa72c0b8bb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa738005fd0 tx=0x7fa738009b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:52.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.935+0000 7fa74e9be740 1 -- 172.21.15.1:0/1148009975 shutdown_connections 2024-09-21T00:57:52.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.935+0000 7fa74e9be740 1 -- 172.21.15.1:0/1148009975 wait complete. 2024-09-21T00:57:52.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.935+0000 7fa74e9be740 1 -- start start 2024-09-21T00:57:52.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.935+0000 7fa74e9be740 1 Processor -- start 2024-09-21T00:57:52.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.936+0000 7fa74e9be740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56163e3ee1b0 0x56163e7c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:52.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.936+0000 7fa74e9be740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56163e3f6390 0x56163e7c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:52.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.936+0000 7fa74e9be740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56163e417070 0x56163e7d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:52.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.936+0000 7fa74e9be740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56163e585700 con 0x56163e3ee1b0 2024-09-21T00:57:52.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.936+0000 7fa7461e6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56163e3ee1b0 0x56163e7c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:52.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.936+0000 7fa7461e6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56163e3ee1b0 0x56163e7c99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47510/0 (socket says 172.21.15.1:47510) 2024-09-21T00:57:52.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.936+0000 7fa7461e6640 1 -- 172.21.15.1:0/2668332501 learned_addr learned my addr 172.21.15.1:0/2668332501 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:52.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.936+0000 7fa74e9be740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56163e6bf160 con 0x56163e417070 2024-09-21T00:57:52.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.936+0000 7fa7459e5640 1 --2- 172.21.15.1:0/2668332501 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56163e3f6390 0x56163e7c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:52.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.936+0000 7fa74e9be740 1 -- 172.21.15.1:0/2668332501 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56163e7ccaa0 con 0x56163e3f6390 2024-09-21T00:57:52.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.936+0000 7fa7469e7640 1 --2- 172.21.15.1:0/2668332501 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56163e417070 0x56163e7d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:52.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.936+0000 7fa7459e5640 1 -- 172.21.15.1:0/2668332501 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56163e417070 msgr2=0x56163e7d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:52.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.937+0000 7fa7459e5640 1 --2- 172.21.15.1:0/2668332501 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56163e417070 0x56163e7d5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.937+0000 7fa7459e5640 1 -- 172.21.15.1:0/2668332501 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56163e3ee1b0 msgr2=0x56163e7c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:52.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.937+0000 7fa7459e5640 1 --2- 172.21.15.1:0/2668332501 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56163e3ee1b0 0x56163e7c99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.937+0000 7fa74e9be740 10 client.0 _ll_register_callbacks cb 0x56163e6d89e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:52.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.937+0000 7fa7459e5640 1 -- 172.21.15.1:0/2668332501 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56163e6ecc90 con 0x56163e3f6390 2024-09-21T00:57:52.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.937+0000 7fa74e9be740 1 -- 172.21.15.1:0/2668332501 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56163e736df0 con 0x56163e3f6390 2024-09-21T00:57:52.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.937+0000 7fa7461e6640 1 --2- 172.21.15.1:0/2668332501 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56163e3ee1b0 0x56163e7c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:52.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.937+0000 7fa7459e5640 1 --2- 172.21.15.1:0/2668332501 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56163e3f6390 0x56163e7c9f10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa730105450 tx=0x7fa7300c9aa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2a64a6d1c2b0521 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:52.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.937+0000 7fa729ffb640 10 client.25345 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T00:57:52.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.937+0000 7fa729ffb640 1 -- 172.21.15.1:0/2668332501 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa730049030 con 0x56163e3f6390 2024-09-21T00:57:52.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.937+0000 7fa729ffb640 1 -- 172.21.15.1:0/2668332501 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fa7300c9070 con 0x56163e3f6390 2024-09-21T00:57:52.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.937+0000 7fa729ffb640 1 -- 172.21.15.1:0/2668332501 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa7300cd5e0 con 0x56163e3f6390 2024-09-21T00:57:52.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.938+0000 7fa74e9be740 10 client.25345 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:52.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.938+0000 7fa74e9be740 1 -- 172.21.15.1:0/2668332501 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({fsmap=27}) -- 0x56163e7d8590 con 0x56163e3f6390 2024-09-21T00:57:52.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.938+0000 7fa729ffb640 1 -- 172.21.15.1:0/2668332501 <== mon.1 v2:172.21.15.193:3300/0 4 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fa7301056a0 con 0x56163e3f6390 2024-09-21T00:57:52.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.938+0000 7fa74e9be740 10 client.25345 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:52.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.938+0000 7fa74e9be740 10 client.25345 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T00:57:52.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.938+0000 7fa74e9be740 20 client.25345 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:52.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.938+0000 7fa74e9be740 1 --2- 172.21.15.1:0/2668332501 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x56163e3d59f0 0x56163e7dbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:52.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.938+0000 7fa74e9be740 4 client.25345 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:57:52.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.938+0000 7fa74e9be740 1 -- 172.21.15.1:0/2668332501 --> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56163e7328a0 con 0x56163e3d59f0 2024-09-21T00:57:52.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.939+0000 7fa7461e6640 1 --2- 172.21.15.1:0/2668332501 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x56163e3d59f0 0x56163e7dbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:52.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.939+0000 7fa7461e6640 1 --2- 172.21.15.1:0/2668332501 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x56163e3d59f0 0x56163e7dbaf0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c09df0e3ffefa3f9 server_cookie=abfb850febce643a in_seq=0 out_seq=0 2024-09-21T00:57:52.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.939+0000 7fa729ffb640 10 client.25345 ms_handle_connect on v2:172.21.15.193:6834/3631682268 2024-09-21T00:57:52.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.940+0000 7fa729ffb640 1 -- 172.21.15.1:0/2668332501 <== mds.4 v2:172.21.15.193:6834/3631682268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56163e7328a0 con 0x56163e3d59f0 2024-09-21T00:57:52.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.940+0000 7fa729ffb640 10 client.25345 handle_command_reply: tid=0 2024-09-21T00:57:52.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.940+0000 7fa74e9be740 1 client.25345 shutdown 2024-09-21T00:57:52.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.940+0000 7fa74e9be740 1 -- 172.21.15.1:0/2668332501 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56163e3f6390 msgr2=0x56163e7c9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:52.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.940+0000 7fa74e9be740 1 --2- 172.21.15.1:0/2668332501 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56163e3f6390 0x56163e7c9f10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa730105450 tx=0x7fa7300c9aa0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.940+0000 7fa74e9be740 1 -- 172.21.15.1:0/2668332501 shutdown_connections 2024-09-21T00:57:52.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.940+0000 7fa74e9be740 1 --2- 172.21.15.1:0/2668332501 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x56163e3d59f0 0x56163e7dbaf0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.940+0000 7fa729ffb640 0 client.25345 ms_handle_reset on v2:172.21.15.193:6834/3631682268 2024-09-21T00:57:52.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.940+0000 7fa74e9be740 1 --2- 172.21.15.1:0/2668332501 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56163e417070 0x56163e7d5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.940+0000 7fa74e9be740 1 --2- 172.21.15.1:0/2668332501 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56163e3f6390 0x56163e7c9f10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.940+0000 7fa74e9be740 1 --2- 172.21.15.1:0/2668332501 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56163e3ee1b0 0x56163e7c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.940+0000 7fa74e9be740 1 -- 172.21.15.1:0/2668332501 >> 172.21.15.1:0/2668332501 conn(0x56163e40b460 msgr2=0x56163e7c14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:52.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.941+0000 7fa74e9be740 1 -- 172.21.15.1:0/2668332501 shutdown_connections 2024-09-21T00:57:52.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.941+0000 7fa74e9be740 1 -- 172.21.15.1:0/2668332501 wait complete. 2024-09-21T00:57:52.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.941+0000 7fa74e9be740 20 client.25345 trim_cache size 0 max 16384 2024-09-21T00:57:52.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.954+0000 7fa74e9be740 1 Processor -- start 2024-09-21T00:57:52.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.954+0000 7fa74e9be740 1 -- start start 2024-09-21T00:57:52.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.954+0000 7fa74e9be740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56163e3ee1b0 0x56163e7cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:52.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.954+0000 7fa74e9be740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56163e3f6390 0x56163e7c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:52.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.954+0000 7fa74e9be740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56163e417070 0x56163e7bb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:52.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.954+0000 7fa74e9be740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa7401b5a10 con 0x56163e3f6390 2024-09-21T00:57:52.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.954+0000 7fa74e9be740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa7401b7550 con 0x56163e417070 2024-09-21T00:57:52.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.954+0000 7fa74e9be740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa7401b60e0 con 0x56163e3ee1b0 2024-09-21T00:57:52.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.955+0000 7fa7461e6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56163e3ee1b0 0x56163e7cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:52.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.955+0000 7fa7459e5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56163e3f6390 0x56163e7c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:52.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.955+0000 7fa7461e6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56163e3ee1b0 0x56163e7cb9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:39002/0 (socket says 172.21.15.1:39002) 2024-09-21T00:57:52.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.955+0000 7fa7461e6640 1 -- 172.21.15.1:0/111451549 learned_addr learned my addr 172.21.15.1:0/111451549 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:52.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.955+0000 7fa7469e7640 1 --2- 172.21.15.1:0/111451549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56163e417070 0x56163e7bb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:52.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.955+0000 7fa7459e5640 1 -- 172.21.15.1:0/111451549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56163e3ee1b0 msgr2=0x56163e7cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:52.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.955+0000 7fa7459e5640 1 --2- 172.21.15.1:0/111451549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56163e3ee1b0 0x56163e7cb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.955+0000 7fa7459e5640 1 -- 172.21.15.1:0/111451549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56163e417070 msgr2=0x56163e7bb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:52.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.955+0000 7fa7459e5640 1 --2- 172.21.15.1:0/111451549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56163e417070 0x56163e7bb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.955+0000 7fa7459e5640 1 -- 172.21.15.1:0/111451549 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56163e7c1120 con 0x56163e3f6390 2024-09-21T00:57:52.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.956+0000 7fa7459e5640 1 --2- 172.21.15.1:0/111451549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56163e3f6390 0x56163e7c8ee0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa7300cda60 tx=0x7fa7300b4000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a39f2de940843560 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:52.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.956+0000 7fa72bfff640 1 -- 172.21.15.1:0/111451549 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa730049070 con 0x56163e3f6390 2024-09-21T00:57:52.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.956+0000 7fa72bfff640 1 -- 172.21.15.1:0/111451549 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56163e736df0 con 0x56163e3f6390 2024-09-21T00:57:52.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.956+0000 7fa72bfff640 1 -- 172.21.15.1:0/111451549 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73003b4f0 con 0x56163e3f6390 2024-09-21T00:57:52.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.957+0000 7fa74e9be740 1 -- 172.21.15.1:0/111451549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56163e3f6390 msgr2=0x56163e7c8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:52.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.957+0000 7fa74e9be740 1 --2- 172.21.15.1:0/111451549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56163e3f6390 0x56163e7c8ee0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa7300cda60 tx=0x7fa7300b4000 comp rx=0 tx=0).stop 2024-09-21T00:57:52.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.957+0000 7fa74e9be740 1 -- 172.21.15.1:0/111451549 shutdown_connections 2024-09-21T00:57:52.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.957+0000 7fa74e9be740 1 --2- 172.21.15.1:0/111451549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56163e417070 0x56163e7bb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.957+0000 7fa74e9be740 1 --2- 172.21.15.1:0/111451549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56163e3f6390 0x56163e7c8ee0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.957+0000 7fa74e9be740 1 --2- 172.21.15.1:0/111451549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56163e3ee1b0 0x56163e7cb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.957+0000 7fa74e9be740 1 -- 172.21.15.1:0/111451549 >> 172.21.15.1:0/111451549 conn(0x56163e40b460 msgr2=0x56163e7bfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:52.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.957+0000 7fa74e9be740 1 -- 172.21.15.1:0/111451549 shutdown_connections 2024-09-21T00:57:52.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.957+0000 7fa74e9be740 1 -- 172.21.15.1:0/111451549 wait complete. 2024-09-21T00:57:52.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.958+0000 7fa74e9be740 1 -- start start 2024-09-21T00:57:52.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.958+0000 7fa74e9be740 1 Processor -- start 2024-09-21T00:57:52.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.959+0000 7fa74e9be740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56163e3ee1b0 0x56163e7cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:52.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.959+0000 7fa74e9be740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56163e417070 0x56163e7ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:52.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.959+0000 7fa74e9be740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56163e3aada0 0x56163e8454b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:52.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.959+0000 7fa74e9be740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa7401b6e80 con 0x56163e3aada0 2024-09-21T00:57:52.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.959+0000 7fa74e9be740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa7401b67b0 con 0x56163e3ee1b0 2024-09-21T00:57:52.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.959+0000 7fa74e9be740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa7401b39f0 con 0x56163e417070 2024-09-21T00:57:52.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.959+0000 7fa7461e6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56163e3ee1b0 0x56163e7cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:52.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.959+0000 7fa7461e6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56163e3ee1b0 0x56163e7cdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:45592/0 (socket says 172.21.15.1:45592) 2024-09-21T00:57:52.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.959+0000 7fa7461e6640 1 -- 172.21.15.1:0/1650150808 learned_addr learned my addr 172.21.15.1:0/1650150808 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:52.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.959+0000 7fa7459e5640 1 --2- 172.21.15.1:0/1650150808 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56163e417070 0x56163e7ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:52.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.959+0000 7fa74e9be740 10 client.0 _ll_register_callbacks cb 0x7fa730005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:52.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.959+0000 7fa7469e7640 1 --2- 172.21.15.1:0/1650150808 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56163e3aada0 0x56163e8454b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:52.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.960+0000 7fa7461e6640 1 -- 172.21.15.1:0/1650150808 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56163e417070 msgr2=0x56163e7ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:52.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.960+0000 7fa7461e6640 1 --2- 172.21.15.1:0/1650150808 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56163e417070 0x56163e7ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.960+0000 7fa7461e6640 1 -- 172.21.15.1:0/1650150808 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56163e3aada0 msgr2=0x56163e8454b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:52.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.960+0000 7fa7461e6640 1 --2- 172.21.15.1:0/1650150808 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56163e3aada0 0x56163e8454b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.960+0000 7fa7461e6640 1 -- 172.21.15.1:0/1650150808 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56163e7cedb0 con 0x56163e3ee1b0 2024-09-21T00:57:52.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.960+0000 7fa7469e7640 1 --2- 172.21.15.1:0/1650150808 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56163e3aada0 0x56163e8454b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:57:52.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.960+0000 7fa7459e5640 1 --2- 172.21.15.1:0/1650150808 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56163e417070 0x56163e7ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:57:52.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.960+0000 7fa7461e6640 1 --2- 172.21.15.1:0/1650150808 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56163e3ee1b0 0x56163e7cdfd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa73c011c80 tx=0x7fa73c00be80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9003fb93aae59267 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:52.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.960+0000 7fa729ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T00:57:52.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.960+0000 7fa729ffb640 1 -- 172.21.15.1:0/1650150808 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73c032060 con 0x56163e3ee1b0 2024-09-21T00:57:52.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.960+0000 7fa729ffb640 1 -- 172.21.15.1:0/1650150808 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fa73c005310 con 0x56163e3ee1b0 2024-09-21T00:57:52.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.960+0000 7fa74e9be740 1 -- 172.21.15.1:0/1650150808 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56163e736df0 con 0x56163e3ee1b0 2024-09-21T00:57:52.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.960+0000 7fa729ffb640 1 -- 172.21.15.1:0/1650150808 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa73c005510 con 0x56163e3ee1b0 2024-09-21T00:57:52.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.961+0000 7fa74e9be740 10 client.25409 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:52.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.961+0000 7fa74e9be740 1 -- 172.21.15.1:0/1650150808 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56163e846a50 con 0x56163e3ee1b0 2024-09-21T00:57:52.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.961+0000 7fa729ffb640 1 -- 172.21.15.1:0/1650150808 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56163e736df0 con 0x56163e3ee1b0 2024-09-21T00:57:52.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.961+0000 7fa729ffb640 1 -- 172.21.15.1:0/1650150808 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fa73c003830 con 0x56163e3ee1b0 2024-09-21T00:57:52.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.961+0000 7fa74e9be740 10 client.25409 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:52.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.961+0000 7fa74e9be740 10 client.25409 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T00:57:52.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.961+0000 7fa74e9be740 20 client.25409 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:52.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.961+0000 7fa74e9be740 1 --2- 172.21.15.1:0/1650150808 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x56163e846f00 0x56163e849320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:52.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.961+0000 7fa74e9be740 4 client.25409 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:57:52.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.961+0000 7fa74e9be740 1 -- 172.21.15.1:0/1650150808 --> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56163e72fcd0 con 0x56163e846f00 2024-09-21T00:57:52.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.961+0000 7fa7459e5640 1 --2- 172.21.15.1:0/1650150808 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x56163e846f00 0x56163e849320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:52.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.962+0000 7fa729ffb640 10 client.25409 ms_handle_connect on v2:172.21.15.193:6834/3631682268 2024-09-21T00:57:52.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.962+0000 7fa7459e5640 1 --2- 172.21.15.1:0/1650150808 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x56163e846f00 0x56163e849320 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=94d656d9b4690d3b server_cookie=c64f4bae66a94633 in_seq=0 out_seq=0 2024-09-21T00:57:52.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.962+0000 7fa729ffb640 1 -- 172.21.15.1:0/1650150808 <== mds.4 v2:172.21.15.193:6834/3631682268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56163e72fcd0 con 0x56163e846f00 2024-09-21T00:57:52.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.962+0000 7fa729ffb640 10 client.25409 handle_command_reply: tid=0 2024-09-21T00:57:52.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.962+0000 7fa74e9be740 1 client.25409 shutdown 2024-09-21T00:57:52.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.962+0000 7fa74e9be740 1 -- 172.21.15.1:0/1650150808 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56163e3ee1b0 msgr2=0x56163e7cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:52.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.962+0000 7fa74e9be740 1 --2- 172.21.15.1:0/1650150808 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56163e3ee1b0 0x56163e7cdfd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa73c011c80 tx=0x7fa73c00be80 comp rx=0 tx=0).stop 2024-09-21T00:57:52.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.962+0000 7fa74e9be740 1 -- 172.21.15.1:0/1650150808 shutdown_connections 2024-09-21T00:57:52.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.962+0000 7fa74e9be740 1 --2- 172.21.15.1:0/1650150808 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x56163e846f00 0x56163e849320 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.962+0000 7fa74e9be740 1 --2- 172.21.15.1:0/1650150808 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56163e3aada0 0x56163e8454b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.962+0000 7fa74e9be740 1 --2- 172.21.15.1:0/1650150808 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56163e417070 0x56163e7ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.962+0000 7fa74e9be740 1 --2- 172.21.15.1:0/1650150808 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56163e3ee1b0 0x56163e7cdfd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.963+0000 7fa74e9be740 1 -- 172.21.15.1:0/1650150808 >> 172.21.15.1:0/1650150808 conn(0x56163e40b460 msgr2=0x56163e7c7ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:52.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.963+0000 7fa729ffb640 0 client.25409 ms_handle_reset on v2:172.21.15.193:6834/3631682268 2024-09-21T00:57:52.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.963+0000 7fa74e9be740 1 -- 172.21.15.1:0/1650150808 shutdown_connections 2024-09-21T00:57:52.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.963+0000 7fa74e9be740 1 -- 172.21.15.1:0/1650150808 wait complete. 2024-09-21T00:57:52.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.963+0000 7fa74e9be740 20 client.25409 trim_cache size 0 max 16384 2024-09-21T00:57:52.967 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T00:57:52.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.963+0000 7fa74844a640 1 -- 172.21.15.1:0/2759832618 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa72c0b66a0 msgr2=0x7fa72c0b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:52.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.963+0000 7fa74844a640 1 --2- 172.21.15.1:0/2759832618 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa72c0b66a0 0x7fa72c0b8bb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa738005fd0 tx=0x7fa738009b40 comp rx=0 tx=0).stop 2024-09-21T00:57:52.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.963+0000 7fa74844a640 1 -- 172.21.15.1:0/2759832618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7401083a0 msgr2=0x7fa74010cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:52.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.963+0000 7fa74844a640 1 --2- 172.21.15.1:0/2759832618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7401083a0 0x7fa74010cec0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa73002a930 tx=0x7fa730003c10 comp rx=0 tx=0).stop 2024-09-21T00:57:52.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.964+0000 7fa74844a640 1 -- 172.21.15.1:0/2759832618 shutdown_connections 2024-09-21T00:57:52.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.964+0000 7fa74844a640 1 --2- 172.21.15.1:0/2759832618 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa740108cf0 0x7fa74010d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.964+0000 7fa74844a640 1 --2- 172.21.15.1:0/2759832618 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa72c0b66a0 0x7fa72c0b8bb0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.964+0000 7fa74844a640 1 --2- 172.21.15.1:0/2759832618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7401083a0 0x7fa74010cec0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.964+0000 7fa74844a640 1 --2- 172.21.15.1:0/2759832618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa740102a60 0x7fa74010c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.964+0000 7fa74844a640 1 -- 172.21.15.1:0/2759832618 >> 172.21.15.1:0/2759832618 conn(0x7fa740079730 msgr2=0x7fa740105260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:52.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.964+0000 7fa74844a640 1 -- 172.21.15.1:0/2759832618 shutdown_connections 2024-09-21T00:57:52.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:52.964+0000 7fa74844a640 1 -- 172.21.15.1:0/2759832618 wait complete. 2024-09-21T00:57:53.491 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.489+0000 7faeeaa5c640 1 -- 172.21.15.1:0/2356390739 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faee41050d0 msgr2=0x7faee410ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:53.492 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.489+0000 7faeeaa5c640 1 --2- 172.21.15.1:0/2356390739 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faee41050d0 0x7faee410ba70 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7faedc009ca0 tx=0x7faedc02a8c0 comp rx=0 tx=0).stop 2024-09-21T00:57:53.492 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.490+0000 7faeeaa5c640 1 -- 172.21.15.1:0/2356390739 shutdown_connections 2024-09-21T00:57:53.492 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.490+0000 7faeeaa5c640 1 --2- 172.21.15.1:0/2356390739 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faee41050d0 0x7faee410ba70 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:53.492 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.490+0000 7faeeaa5c640 1 --2- 172.21.15.1:0/2356390739 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faee4104730 0x7faee4104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:53.492 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.490+0000 7faeeaa5c640 1 --2- 172.21.15.1:0/2356390739 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faee41036b0 0x7faee4103b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:53.492 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.490+0000 7faeeaa5c640 1 -- 172.21.15.1:0/2356390739 >> 172.21.15.1:0/2356390739 conn(0x7faee40feff0 msgr2=0x7faee41014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:53.492 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.490+0000 7faeeaa5c640 1 -- 172.21.15.1:0/2356390739 shutdown_connections 2024-09-21T00:57:53.492 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.490+0000 7faeeaa5c640 1 -- 172.21.15.1:0/2356390739 wait complete. 2024-09-21T00:57:53.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.490+0000 7faeeaa5c640 1 Processor -- start 2024-09-21T00:57:53.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.491+0000 7faeeaa5c640 1 -- start start 2024-09-21T00:57:53.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.491+0000 7faeeaa5c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faee41036b0 0x7faee4076de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:53.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.491+0000 7faeeaa5c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faee4104730 0x7faee4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:53.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.491+0000 7faeeaa5c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faee41050d0 0x7faee4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:53.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.491+0000 7faeeaa5c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faee410f2e0 con 0x7faee4104730 2024-09-21T00:57:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.491+0000 7faeeaa5c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7faee410f160 con 0x7faee41036b0 2024-09-21T00:57:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.491+0000 7faeeaa5c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faee410f460 con 0x7faee41050d0 2024-09-21T00:57:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.491+0000 7faee37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faee4104730 0x7faee4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.491+0000 7faee37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faee4104730 0x7faee4075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47544/0 (socket says 172.21.15.1:47544) 2024-09-21T00:57:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.491+0000 7faee37fe640 1 -- 172.21.15.1:0/55524305 learned_addr learned my addr 172.21.15.1:0/55524305 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.491+0000 7faee8ff9640 1 --2- 172.21.15.1:0/55524305 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faee41050d0 0x7faee4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.491+0000 7faee3fff640 1 --2- 172.21.15.1:0/55524305 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faee41036b0 0x7faee4076de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.492+0000 7faee37fe640 1 -- 172.21.15.1:0/55524305 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faee41050d0 msgr2=0x7faee4075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.492+0000 7faee37fe640 1 --2- 172.21.15.1:0/55524305 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faee41050d0 0x7faee4075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.492+0000 7faee37fe640 1 -- 172.21.15.1:0/55524305 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faee41036b0 msgr2=0x7faee4076de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.492+0000 7faee37fe640 1 --2- 172.21.15.1:0/55524305 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faee41036b0 0x7faee4076de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.492+0000 7faee37fe640 1 -- 172.21.15.1:0/55524305 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee40762f0 con 0x7faee4104730 2024-09-21T00:57:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.492+0000 7faee37fe640 1 --2- 172.21.15.1:0/55524305 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faee4104730 0x7faee4075710 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7faed800e9f0 tx=0x7faed800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.492+0000 7faee17fa640 1 -- 172.21.15.1:0/55524305 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed800cd80 con 0x7faee4104730 2024-09-21T00:57:53.496 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.492+0000 7faeeaa5c640 1 -- 172.21.15.1:0/55524305 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faee41a3f90 con 0x7faee4104730 2024-09-21T00:57:53.496 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.492+0000 7faee17fa640 1 -- 172.21.15.1:0/55524305 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faed80108e0 con 0x7faee4104730 2024-09-21T00:57:53.496 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.492+0000 7faee17fa640 1 -- 172.21.15.1:0/55524305 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed8018980 con 0x7faee4104730 2024-09-21T00:57:53.496 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.492+0000 7faeeaa5c640 1 -- 172.21.15.1:0/55524305 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faee41a4340 con 0x7faee4104730 2024-09-21T00:57:53.497 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.496+0000 7faef19cd740 1 Processor -- start 2024-09-21T00:57:53.497 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.496+0000 7faef19cd740 1 -- start start 2024-09-21T00:57:53.498 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.496+0000 7faef19cd740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff588451b0 0x55ff58bece50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:53.498 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.496+0000 7faef19cd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff5881c2f0 0x55ff58bed4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:53.498 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.496+0000 7faef19cd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ff588244d0 0x55ff58bee010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:53.498 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.496+0000 7faef19cd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ff58b5f6f0 con 0x55ff588244d0 2024-09-21T00:57:53.498 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.496+0000 7faef19cd740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ff58b4eb20 con 0x55ff588451b0 2024-09-21T00:57:53.498 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.496+0000 7faef19cd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ff58b52930 con 0x55ff5881c2f0 2024-09-21T00:57:53.498 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.496+0000 7faee17fa640 1 -- 172.21.15.1:0/55524305 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 154562+0+0 (secure 0 0 0) 0x7faed8018b20 con 0x7faee4104730 2024-09-21T00:57:53.498 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.496+0000 7faee8ff9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff588451b0 0x55ff58bece50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:53.498 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.496+0000 7faee8ff9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff588451b0 0x55ff58bece50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:45616/0 (socket says 172.21.15.1:45616) 2024-09-21T00:57:53.499 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.496+0000 7faee8ff9640 1 -- 172.21.15.1:0/1111192015 learned_addr learned my addr 172.21.15.1:0/1111192015 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:53.499 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.496+0000 7faee3fff640 1 --2- 172.21.15.1:0/1111192015 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff5881c2f0 0x55ff58bed4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:53.499 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.496+0000 7faee37fe640 1 --2- 172.21.15.1:0/1111192015 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ff588244d0 0x55ff58bee010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:53.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.497+0000 7faee8ff9640 1 -- 172.21.15.1:0/1111192015 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff5881c2f0 msgr2=0x55ff58bed4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:53.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.497+0000 7faee8ff9640 1 --2- 172.21.15.1:0/1111192015 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff5881c2f0 0x55ff58bed4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:53.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.497+0000 7faee8ff9640 1 -- 172.21.15.1:0/1111192015 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ff588244d0 msgr2=0x55ff58bee010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:53.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.497+0000 7faee8ff9640 1 --2- 172.21.15.1:0/1111192015 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ff588244d0 0x55ff58bee010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:53.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.497+0000 7faee8ff9640 1 -- 172.21.15.1:0/1111192015 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff58b14530 con 0x55ff588451b0 2024-09-21T00:57:53.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.497+0000 7faee3fff640 1 --2- 172.21.15.1:0/1111192015 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff5881c2f0 0x55ff58bed4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:57:53.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.497+0000 7faee37fe640 1 --2- 172.21.15.1:0/1111192015 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ff588244d0 0x55ff58bee010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:57:53.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.497+0000 7faee8ff9640 1 --2- 172.21.15.1:0/1111192015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff588451b0 0x55ff58bece50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7faedc035000 tx=0x7faedc02f410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d637a746e6b31bbf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:53.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.497+0000 7faeca7fc640 1 -- 172.21.15.1:0/1111192015 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faedc031650 con 0x55ff588451b0 2024-09-21T00:57:53.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.498+0000 7faee17fa640 1 --2- 172.21.15.1:0/55524305 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7faecc0b6620 0x7faecc0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:53.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.498+0000 7faeca7fc640 1 -- 172.21.15.1:0/1111192015 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faedc036030 con 0x55ff588451b0 2024-09-21T00:57:53.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.498+0000 7faeca7fc640 1 -- 172.21.15.1:0/1111192015 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faedc0047f0 con 0x55ff588451b0 2024-09-21T00:57:53.501 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.498+0000 7faee17fa640 1 -- 172.21.15.1:0/55524305 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7faed80e7810 con 0x7faee4104730 2024-09-21T00:57:53.501 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.498+0000 7faee3fff640 1 --2- 172.21.15.1:0/55524305 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7faecc0b6620 0x7faecc0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:53.502 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.499+0000 7faee3fff640 1 --2- 172.21.15.1:0/55524305 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7faecc0b6620 0x7faecc0b8b30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7faed4009d00 tx=0x7faed4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:53.502 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.499+0000 7faef19cd740 1 -- 172.21.15.1:0/1111192015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff588451b0 msgr2=0x55ff58bece50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.499+0000 7faef19cd740 1 --2- 172.21.15.1:0/1111192015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff588451b0 0x55ff58bece50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7faedc035000 tx=0x7faedc02f410 comp rx=0 tx=0).stop 2024-09-21T00:57:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.499+0000 7faef19cd740 1 -- 172.21.15.1:0/1111192015 shutdown_connections 2024-09-21T00:57:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.499+0000 7faef19cd740 1 --2- 172.21.15.1:0/1111192015 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ff588244d0 0x55ff58bee010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.499+0000 7faef19cd740 1 --2- 172.21.15.1:0/1111192015 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff5881c2f0 0x55ff58bed4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.499+0000 7faef19cd740 1 --2- 172.21.15.1:0/1111192015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff588451b0 0x55ff58bece50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.499+0000 7faef19cd740 1 -- 172.21.15.1:0/1111192015 >> 172.21.15.1:0/1111192015 conn(0x55ff58839300 msgr2=0x55ff58be88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.499+0000 7faef19cd740 1 -- 172.21.15.1:0/1111192015 shutdown_connections 2024-09-21T00:57:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.499+0000 7faef19cd740 1 -- 172.21.15.1:0/1111192015 wait complete. 2024-09-21T00:57:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.499+0000 7faef19cd740 1 -- start start 2024-09-21T00:57:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.500+0000 7faef19cd740 1 Processor -- start 2024-09-21T00:57:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.500+0000 7faef19cd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff5881c2f0 0x55ff58bf6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.500+0000 7faef19cd740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff588244d0 0x55ff58bf6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.500+0000 7faef19cd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ff588451b0 0x55ff58bf7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.500+0000 7faef19cd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ff58a86ab0 con 0x55ff588451b0 2024-09-21T00:57:53.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.500+0000 7faef19cd740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ff58af4730 con 0x55ff588244d0 2024-09-21T00:57:53.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.500+0000 7faef19cd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ff58bee950 con 0x55ff5881c2f0 2024-09-21T00:57:53.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.500+0000 7faef19cd740 10 client.0 _ll_register_callbacks cb 0x55ff58b486b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:53.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.500+0000 7faee8ff9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ff588451b0 0x55ff58bf7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:53.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.500+0000 7faee8ff9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ff588451b0 0x55ff58bf7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47562/0 (socket says 172.21.15.1:47562) 2024-09-21T00:57:53.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.500+0000 7faee8ff9640 1 -- 172.21.15.1:0/3681163418 learned_addr learned my addr 172.21.15.1:0/3681163418 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:53.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.500+0000 7faee37fe640 1 --2- 172.21.15.1:0/3681163418 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff588244d0 0x55ff58bf6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:53.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.500+0000 7faee3fff640 1 --2- 172.21.15.1:0/3681163418 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff5881c2f0 0x55ff58bf6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:53.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.501+0000 7faee8ff9640 1 -- 172.21.15.1:0/3681163418 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff5881c2f0 msgr2=0x55ff58bf6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:53.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.501+0000 7faee8ff9640 1 --2- 172.21.15.1:0/3681163418 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff5881c2f0 0x55ff58bf6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:53.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.501+0000 7faee8ff9640 1 -- 172.21.15.1:0/3681163418 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff588244d0 msgr2=0x55ff58bf6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:53.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.501+0000 7faee8ff9640 1 --2- 172.21.15.1:0/3681163418 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff588244d0 0x55ff58bf6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:53.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.501+0000 7faee8ff9640 1 -- 172.21.15.1:0/3681163418 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff588b0790 con 0x55ff588451b0 2024-09-21T00:57:53.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.501+0000 7faee37fe640 1 --2- 172.21.15.1:0/3681163418 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff588244d0 0x55ff58bf6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:53.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.501+0000 7faee8ff9640 1 --2- 172.21.15.1:0/3681163418 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ff588451b0 0x55ff58bf7650 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7faedc0316e0 tx=0x7faedc031710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d644bde09d0c30ab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:53.505 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.501+0000 7faec37fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:57:53.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.501+0000 7faec37fe640 1 -- 172.21.15.1:0/3681163418 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faedc04a040 con 0x55ff588451b0 2024-09-21T00:57:53.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.502+0000 7faec37fe640 1 -- 172.21.15.1:0/3681163418 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7faedc003b70 con 0x55ff588451b0 2024-09-21T00:57:53.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.502+0000 7faef19cd740 1 -- 172.21.15.1:0/3681163418 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faedc036030 con 0x55ff588451b0 2024-09-21T00:57:53.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.502+0000 7faec37fe640 1 -- 172.21.15.1:0/3681163418 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7faedc009360 con 0x55ff588451b0 2024-09-21T00:57:53.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.502+0000 7faef19cd740 10 client.15726 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:53.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.502+0000 7faef19cd740 1 -- 172.21.15.1:0/3681163418 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ff58929620 con 0x55ff588451b0 2024-09-21T00:57:53.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.502+0000 7faec37fe640 1 -- 172.21.15.1:0/3681163418 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faedc036030 con 0x55ff588451b0 2024-09-21T00:57:53.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.503+0000 7faec37fe640 1 -- 172.21.15.1:0/3681163418 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7faedc04d030 con 0x55ff588451b0 2024-09-21T00:57:53.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.504+0000 7faef19cd740 10 client.15726 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:53.507 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.504+0000 7faef19cd740 10 client.15726 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:57:53.507 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.504+0000 7faef19cd740 20 client.15726 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:53.507 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.504+0000 7faef19cd740 1 --2- 172.21.15.1:0/3681163418 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55ff58803d80 0x55ff58c03ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:53.507 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.504+0000 7faef19cd740 4 client.15726 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:57:53.507 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.504+0000 7faef19cd740 1 -- 172.21.15.1:0/3681163418 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff58b61640 con 0x55ff58803d80 2024-09-21T00:57:53.507 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.504+0000 7faee3fff640 1 --2- 172.21.15.1:0/3681163418 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55ff58803d80 0x55ff58c03ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:53.507 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.504+0000 7faee3fff640 1 --2- 172.21.15.1:0/3681163418 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55ff58803d80 0x55ff58c03ad0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c04efc1381d62de3 server_cookie=99511f47d4774b9f in_seq=0 out_seq=0 2024-09-21T00:57:53.507 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.504+0000 7faec37fe640 10 client.15726 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:53.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.505+0000 7faec37fe640 1 -- 172.21.15.1:0/3681163418 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ff58b61640 con 0x55ff58803d80 2024-09-21T00:57:53.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.505+0000 7faec37fe640 10 client.15726 handle_command_reply: tid=0 2024-09-21T00:57:53.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.505+0000 7faef19cd740 1 client.15726 shutdown 2024-09-21T00:57:53.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.506+0000 7faef19cd740 1 -- 172.21.15.1:0/3681163418 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ff588451b0 msgr2=0x55ff58bf7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:53.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.506+0000 7faef19cd740 1 --2- 172.21.15.1:0/3681163418 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ff588451b0 0x55ff58bf7650 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7faedc0316e0 tx=0x7faedc031710 comp rx=0 tx=0).stop 2024-09-21T00:57:53.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.506+0000 7faef19cd740 1 -- 172.21.15.1:0/3681163418 shutdown_connections 2024-09-21T00:57:53.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.506+0000 7faef19cd740 1 --2- 172.21.15.1:0/3681163418 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55ff58803d80 0x55ff58c03ad0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:53.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.506+0000 7faef19cd740 1 --2- 172.21.15.1:0/3681163418 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ff588451b0 0x55ff58bf7650 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:53.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.506+0000 7faef19cd740 1 --2- 172.21.15.1:0/3681163418 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff588244d0 0x55ff58bf6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:53.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.506+0000 7faef19cd740 1 --2- 172.21.15.1:0/3681163418 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff5881c2f0 0x55ff58bf6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:53.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.506+0000 7faef19cd740 1 -- 172.21.15.1:0/3681163418 >> 172.21.15.1:0/3681163418 conn(0x55ff58839300 msgr2=0x55ff58be6ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:53.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.506+0000 7faec37fe640 0 client.15726 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:53.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.506+0000 7faef19cd740 1 -- 172.21.15.1:0/3681163418 shutdown_connections 2024-09-21T00:57:53.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.506+0000 7faef19cd740 1 -- 172.21.15.1:0/3681163418 wait complete. 2024-09-21T00:57:53.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.506+0000 7faef19cd740 20 client.15726 trim_cache size 0 max 16384 2024-09-21T00:57:53.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.521+0000 7faef19cd740 1 Processor -- start 2024-09-21T00:57:53.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.521+0000 7faef19cd740 1 -- start start 2024-09-21T00:57:53.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.521+0000 7faef19cd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ff5881c2f0 0x55ff58bed500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:53.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.521+0000 7faef19cd740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff588244d0 0x55ff58be7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:53.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.521+0000 7faef19cd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff588451b0 0x55ff58be83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:53.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.521+0000 7faef19cd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faee41acf30 con 0x55ff5881c2f0 2024-09-21T00:57:53.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.521+0000 7faef19cd740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7faee41aea70 con 0x55ff588244d0 2024-09-21T00:57:53.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.521+0000 7faef19cd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faee41ad600 con 0x55ff588451b0 2024-09-21T00:57:53.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.521+0000 7faee3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ff5881c2f0 0x55ff58bed500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:53.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.521+0000 7faee3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ff5881c2f0 0x55ff58bed500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47576/0 (socket says 172.21.15.1:47576) 2024-09-21T00:57:53.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.521+0000 7faee3fff640 1 -- 172.21.15.1:0/1048054683 learned_addr learned my addr 172.21.15.1:0/1048054683 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:53.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.521+0000 7faee37fe640 1 --2- 172.21.15.1:0/1048054683 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff588244d0 0x55ff58be7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:53.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.521+0000 7faee8ff9640 1 --2- 172.21.15.1:0/1048054683 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff588451b0 0x55ff58be83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:53.525 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.522+0000 7faee3fff640 1 -- 172.21.15.1:0/1048054683 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff588451b0 msgr2=0x55ff58be83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:53.525 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.522+0000 7faee3fff640 1 --2- 172.21.15.1:0/1048054683 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff588451b0 0x55ff58be83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:53.525 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.522+0000 7faee3fff640 1 -- 172.21.15.1:0/1048054683 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff588244d0 msgr2=0x55ff58be7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:53.525 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.522+0000 7faee3fff640 1 --2- 172.21.15.1:0/1048054683 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff588244d0 0x55ff58be7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:53.525 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.522+0000 7faee3fff640 1 -- 172.21.15.1:0/1048054683 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff58bee780 con 0x55ff5881c2f0 2024-09-21T00:57:53.525 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.522+0000 7faee37fe640 1 --2- 172.21.15.1:0/1048054683 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff588244d0 0x55ff58be7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:57:53.525 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.522+0000 7faee3fff640 1 --2- 172.21.15.1:0/1048054683 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ff5881c2f0 0x55ff58bed500 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7faed4009600 tx=0x7faed4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11063b031c0239e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:53.525 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.522+0000 7faec9ffb640 1 -- 172.21.15.1:0/1048054683 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed402f070 con 0x55ff5881c2f0 2024-09-21T00:57:53.525 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.522+0000 7faec9ffb640 1 -- 172.21.15.1:0/1048054683 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faed4020420 con 0x55ff5881c2f0 2024-09-21T00:57:53.525 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.522+0000 7faec9ffb640 1 -- 172.21.15.1:0/1048054683 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed40116b0 con 0x55ff5881c2f0 2024-09-21T00:57:53.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.523+0000 7faef19cd740 1 -- 172.21.15.1:0/1048054683 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ff5881c2f0 msgr2=0x55ff58bed500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:53.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.523+0000 7faef19cd740 1 --2- 172.21.15.1:0/1048054683 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ff5881c2f0 0x55ff58bed500 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7faed4009600 tx=0x7faed4016000 comp rx=0 tx=0).stop 2024-09-21T00:57:53.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.523+0000 7faef19cd740 1 -- 172.21.15.1:0/1048054683 shutdown_connections 2024-09-21T00:57:53.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.523+0000 7faef19cd740 1 --2- 172.21.15.1:0/1048054683 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff588451b0 0x55ff58be83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:53.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.523+0000 7faef19cd740 1 --2- 172.21.15.1:0/1048054683 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff588244d0 0x55ff58be7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:53.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.523+0000 7faef19cd740 1 --2- 172.21.15.1:0/1048054683 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ff5881c2f0 0x55ff58bed500 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:53.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.523+0000 7faef19cd740 1 -- 172.21.15.1:0/1048054683 >> 172.21.15.1:0/1048054683 conn(0x55ff58839300 msgr2=0x55ff58becdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:53.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.523+0000 7faef19cd740 1 -- 172.21.15.1:0/1048054683 shutdown_connections 2024-09-21T00:57:53.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.523+0000 7faef19cd740 1 -- 172.21.15.1:0/1048054683 wait complete. 2024-09-21T00:57:53.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.524+0000 7faef19cd740 1 -- start start 2024-09-21T00:57:53.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.524+0000 7faef19cd740 1 Processor -- start 2024-09-21T00:57:53.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.524+0000 7faef19cd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ff5881c2f0 0x55ff58bfb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:53.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.524+0000 7faef19cd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff588244d0 0x55ff58bfba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:53.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.524+0000 7faef19cd740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff588451b0 0x55ff58bfc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:53.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.524+0000 7faef19cd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faee41ae3a0 con 0x55ff5881c2f0 2024-09-21T00:57:53.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.524+0000 7faef19cd740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7faee41adcd0 con 0x55ff588451b0 2024-09-21T00:57:53.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.524+0000 7faef19cd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faee41aafc0 con 0x55ff588244d0 2024-09-21T00:57:53.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.524+0000 7faee3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ff5881c2f0 0x55ff58bfb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:53.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.524+0000 7faef19cd740 10 client.0 _ll_register_callbacks cb 0x7faedc009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:53.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.524+0000 7faee3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ff5881c2f0 0x55ff58bfb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47590/0 (socket says 172.21.15.1:47590) 2024-09-21T00:57:53.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.524+0000 7faee3fff640 1 -- 172.21.15.1:0/1868687007 learned_addr learned my addr 172.21.15.1:0/1868687007 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:53.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.525+0000 7faee8ff9640 1 --2- 172.21.15.1:0/1868687007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff588451b0 0x55ff58bfc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:53.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.525+0000 7faee37fe640 1 --2- 172.21.15.1:0/1868687007 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff588244d0 0x55ff58bfba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:53.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.525+0000 7faee3fff640 1 -- 172.21.15.1:0/1868687007 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff588244d0 msgr2=0x55ff58bfba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:53.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.525+0000 7faee3fff640 1 --2- 172.21.15.1:0/1868687007 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff588244d0 0x55ff58bfba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:53.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.525+0000 7faee3fff640 1 -- 172.21.15.1:0/1868687007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff588451b0 msgr2=0x55ff58bfc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:53.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.525+0000 7faee3fff640 1 --2- 172.21.15.1:0/1868687007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff588451b0 0x55ff58bfc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:53.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.525+0000 7faee3fff640 1 -- 172.21.15.1:0/1868687007 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff58bfcc90 con 0x55ff5881c2f0 2024-09-21T00:57:53.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.525+0000 7faee37fe640 1 --2- 172.21.15.1:0/1868687007 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff588244d0 0x55ff58bfba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:57:53.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.525+0000 7faee3fff640 1 --2- 172.21.15.1:0/1868687007 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ff5881c2f0 0x55ff58bfb350 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7faed4004630 tx=0x7faed4003e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a5f87fe8235ee5d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:53.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.525+0000 7faec37fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:57:53.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.525+0000 7faec37fe640 1 -- 172.21.15.1:0/1868687007 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed402f040 con 0x55ff5881c2f0 2024-09-21T00:57:53.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.525+0000 7faec37fe640 1 -- 172.21.15.1:0/1868687007 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7faed40205d0 con 0x55ff5881c2f0 2024-09-21T00:57:53.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.525+0000 7faef19cd740 1 -- 172.21.15.1:0/1868687007 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faed4020420 con 0x55ff5881c2f0 2024-09-21T00:57:53.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.526+0000 7faec37fe640 1 -- 172.21.15.1:0/1868687007 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7faed4020810 con 0x55ff5881c2f0 2024-09-21T00:57:53.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.526+0000 7faef19cd740 10 client.15732 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:53.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.526+0000 7faef19cd740 1 -- 172.21.15.1:0/1868687007 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ff58bfdfb0 con 0x55ff5881c2f0 2024-09-21T00:57:53.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.526+0000 7faec37fe640 1 -- 172.21.15.1:0/1868687007 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faed4038070 con 0x55ff5881c2f0 2024-09-21T00:57:53.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.526+0000 7faec37fe640 1 -- 172.21.15.1:0/1868687007 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7faed40047c0 con 0x55ff5881c2f0 2024-09-21T00:57:53.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.526+0000 7faef19cd740 10 client.15732 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:53.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.526+0000 7faef19cd740 10 client.15732 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:57:53.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.526+0000 7faef19cd740 20 client.15732 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:53.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.526+0000 7faef19cd740 1 --2- 172.21.15.1:0/1868687007 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55ff587d91c0 0x55ff58c704e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:53.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.526+0000 7faef19cd740 4 client.15732 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T00:57:53.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.526+0000 7faef19cd740 1 -- 172.21.15.1:0/1868687007 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7faed4020420 con 0x55ff587d91c0 2024-09-21T00:57:53.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.526+0000 7faee37fe640 1 --2- 172.21.15.1:0/1868687007 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55ff587d91c0 0x55ff58c704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:53.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.527+0000 7faec37fe640 10 client.15732 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:53.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.527+0000 7faee37fe640 1 --2- 172.21.15.1:0/1868687007 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55ff587d91c0 0x55ff58c704e0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52b7d199f965bff6 server_cookie=d99b997606852dcf in_seq=0 out_seq=0 2024-09-21T00:57:53.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.533+0000 7faec37fe640 1 -- 172.21.15.1:0/1868687007 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7faed4020420 con 0x55ff587d91c0 2024-09-21T00:57:53.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.533+0000 7faec37fe640 10 client.15732 handle_command_reply: tid=0 2024-09-21T00:57:53.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.533+0000 7faef19cd740 1 client.15732 shutdown 2024-09-21T00:57:53.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.533+0000 7faef19cd740 1 -- 172.21.15.1:0/1868687007 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ff5881c2f0 msgr2=0x55ff58bfb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:53.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.533+0000 7faef19cd740 1 --2- 172.21.15.1:0/1868687007 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ff5881c2f0 0x55ff58bfb350 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7faed4004630 tx=0x7faed4003e10 comp rx=0 tx=0).stop 2024-09-21T00:57:53.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.533+0000 7faef19cd740 1 -- 172.21.15.1:0/1868687007 shutdown_connections 2024-09-21T00:57:53.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.533+0000 7faef19cd740 1 --2- 172.21.15.1:0/1868687007 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55ff587d91c0 0x55ff58c704e0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:53.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.533+0000 7faef19cd740 1 --2- 172.21.15.1:0/1868687007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff588451b0 0x55ff58bfc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:53.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.533+0000 7faef19cd740 1 --2- 172.21.15.1:0/1868687007 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff588244d0 0x55ff58bfba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:53.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.533+0000 7faef19cd740 1 --2- 172.21.15.1:0/1868687007 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ff5881c2f0 0x55ff58bfb350 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:53.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.533+0000 7faef19cd740 1 -- 172.21.15.1:0/1868687007 >> 172.21.15.1:0/1868687007 conn(0x55ff58839300 msgr2=0x55ff58bf4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:53.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.533+0000 7faec37fe640 0 client.15732 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:53.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.533+0000 7faef19cd740 1 -- 172.21.15.1:0/1868687007 shutdown_connections 2024-09-21T00:57:53.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.533+0000 7faef19cd740 1 -- 172.21.15.1:0/1868687007 wait complete. 2024-09-21T00:57:53.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.534+0000 7faef19cd740 20 client.15732 trim_cache size 0 max 16384 2024-09-21T00:57:53.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T00:57:53.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T00:57:53.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T00:57:53.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T00:57:53.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.534+0000 7faeeaa5c640 1 -- 172.21.15.1:0/55524305 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7faecc0b6620 msgr2=0x7faecc0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:53.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.534+0000 7faeeaa5c640 1 --2- 172.21.15.1:0/55524305 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7faecc0b6620 0x7faecc0b8b30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7faed4009d00 tx=0x7faed4005f90 comp rx=0 tx=0).stop 2024-09-21T00:57:53.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.534+0000 7faeeaa5c640 1 -- 172.21.15.1:0/55524305 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faee4104730 msgr2=0x7faee4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:53.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.534+0000 7faeeaa5c640 1 --2- 172.21.15.1:0/55524305 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faee4104730 0x7faee4075710 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7faed800e9f0 tx=0x7faed800eeb0 comp rx=0 tx=0).stop 2024-09-21T00:57:53.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.534+0000 7faeeaa5c640 1 -- 172.21.15.1:0/55524305 shutdown_connections 2024-09-21T00:57:53.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.534+0000 7faeeaa5c640 1 --2- 172.21.15.1:0/55524305 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faee41050d0 0x7faee4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:53.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.534+0000 7faeeaa5c640 1 --2- 172.21.15.1:0/55524305 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7faecc0b6620 0x7faecc0b8b30 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:53.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.534+0000 7faeeaa5c640 1 --2- 172.21.15.1:0/55524305 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faee4104730 0x7faee4075710 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:53.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.534+0000 7faeeaa5c640 1 --2- 172.21.15.1:0/55524305 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faee41036b0 0x7faee4076de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:53.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.534+0000 7faeeaa5c640 1 -- 172.21.15.1:0/55524305 >> 172.21.15.1:0/55524305 conn(0x7faee40feff0 msgr2=0x7faee4107a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:53.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.535+0000 7faeeaa5c640 1 -- 172.21.15.1:0/55524305 shutdown_connections 2024-09-21T00:57:53.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:57:53.535+0000 7faeeaa5c640 1 -- 172.21.15.1:0/55524305 wait complete. 2024-09-21T00:57:53.691 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T00:57:53.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:53 smithi001 ceph-mon[31211]: pgmap v378: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-21T00:57:53.962 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:53.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:53 smithi193 ceph-mon[34660]: pgmap v378: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-21T00:57:53.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:53 smithi042 ceph-mon[34481]: pgmap v378: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-21T00:57:54.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.457+0000 7fce54e1e640 1 -- 172.21.15.1:0/817745910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce50104690 msgr2=0x7fce50104aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:54.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.457+0000 7fce54e1e640 1 --2- 172.21.15.1:0/817745910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce50104690 0x7fce50104aa0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fce40009900 tx=0x7fce4002a410 comp rx=0 tx=0).stop 2024-09-21T00:57:54.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.457+0000 7fce54e1e640 1 -- 172.21.15.1:0/817745910 shutdown_connections 2024-09-21T00:57:54.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.457+0000 7fce54e1e640 1 --2- 172.21.15.1:0/817745910 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce50102890 0x7fce50112530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.457+0000 7fce54e1e640 1 --2- 172.21.15.1:0/817745910 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce50101da0 0x7fce501021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.457+0000 7fce54e1e640 1 --2- 172.21.15.1:0/817745910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce50104690 0x7fce50104aa0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.457+0000 7fce54e1e640 1 -- 172.21.15.1:0/817745910 >> 172.21.15.1:0/817745910 conn(0x7fce50077c90 msgr2=0x7fce500780d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:54.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.457+0000 7fce54e1e640 1 -- 172.21.15.1:0/817745910 shutdown_connections 2024-09-21T00:57:54.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.457+0000 7fce54e1e640 1 -- 172.21.15.1:0/817745910 wait complete. 2024-09-21T00:57:54.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.459+0000 7fce54e1e640 1 Processor -- start 2024-09-21T00:57:54.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.459+0000 7fce54e1e640 1 -- start start 2024-09-21T00:57:54.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.460+0000 7fce54e1e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce50101da0 0x7fce5019c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:54.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.460+0000 7fce54e1e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce50102890 0x7fce5019cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:54.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.460+0000 7fce54e1e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce50104690 0x7fce501a1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:54.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.460+0000 7fce4e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce50101da0 0x7fce5019c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:54.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.460+0000 7fce4e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce50101da0 0x7fce5019c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47604/0 (socket says 172.21.15.1:47604) 2024-09-21T00:57:54.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.460+0000 7fce4dd9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce50102890 0x7fce5019cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:54.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.460+0000 7fce4e59c640 1 -- 172.21.15.1:0/2241146844 learned_addr learned my addr 172.21.15.1:0/2241146844 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:54.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.460+0000 7fce4ed9d640 1 --2- 172.21.15.1:0/2241146844 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce50104690 0x7fce501a1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:54.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.460+0000 7fce54e1e640 1 -- 172.21.15.1:0/2241146844 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fce50115ca0 con 0x7fce50101da0 2024-09-21T00:57:54.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.460+0000 7fce54e1e640 1 -- 172.21.15.1:0/2241146844 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fce50115b20 con 0x7fce50102890 2024-09-21T00:57:54.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.460+0000 7fce54e1e640 1 -- 172.21.15.1:0/2241146844 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fce50115e20 con 0x7fce50104690 2024-09-21T00:57:54.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.461+0000 7fce4e59c640 1 -- 172.21.15.1:0/2241146844 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce50104690 msgr2=0x7fce501a1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:54.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.461+0000 7fce4e59c640 1 --2- 172.21.15.1:0/2241146844 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce50104690 0x7fce501a1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.461+0000 7fce4e59c640 1 -- 172.21.15.1:0/2241146844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce50102890 msgr2=0x7fce5019cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:54.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.461+0000 7fce4e59c640 1 --2- 172.21.15.1:0/2241146844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce50102890 0x7fce5019cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.461+0000 7fce4e59c640 1 -- 172.21.15.1:0/2241146844 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce501a2620 con 0x7fce50101da0 2024-09-21T00:57:54.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.461+0000 7fce4ed9d640 1 --2- 172.21.15.1:0/2241146844 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce50104690 0x7fce501a1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:57:54.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.461+0000 7fce4e59c640 1 --2- 172.21.15.1:0/2241146844 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce50101da0 0x7fce5019c6b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fce40005940 tx=0x7fce40004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:54.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.461+0000 7fce3f7fe640 1 -- 172.21.15.1:0/2241146844 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4003f030 con 0x7fce50101da0 2024-09-21T00:57:54.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.461+0000 7fce3f7fe640 1 -- 172.21.15.1:0/2241146844 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce40003aa0 con 0x7fce50101da0 2024-09-21T00:57:54.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.461+0000 7fce54e1e640 1 -- 172.21.15.1:0/2241146844 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce501a28b0 con 0x7fce50101da0 2024-09-21T00:57:54.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.461+0000 7fce3f7fe640 1 -- 172.21.15.1:0/2241146844 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce40035070 con 0x7fce50101da0 2024-09-21T00:57:54.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.462+0000 7fce54e1e640 1 -- 172.21.15.1:0/2241146844 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce501a9070 con 0x7fce50101da0 2024-09-21T00:57:54.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.466+0000 7fce3f7fe640 1 -- 172.21.15.1:0/2241146844 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 154562+0+0 (secure 0 0 0) 0x7fce40042030 con 0x7fce50101da0 2024-09-21T00:57:54.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.466+0000 7fce3f7fe640 1 --2- 172.21.15.1:0/2241146844 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fce380b65a0 0x7fce380b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:54.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.467+0000 7fce5b392740 1 Processor -- start 2024-09-21T00:57:54.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.467+0000 7fce3f7fe640 1 -- 172.21.15.1:0/2241146844 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fce40107c20 con 0x7fce50101da0 2024-09-21T00:57:54.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.467+0000 7fce4dd9b640 1 --2- 172.21.15.1:0/2241146844 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fce380b65a0 0x7fce380b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:54.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.467+0000 7fce5b392740 1 -- start start 2024-09-21T00:57:54.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.467+0000 7fce5b392740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dbc7665070 0x55dbc7a0c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:54.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.467+0000 7fce5b392740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbc763c1b0 0x55dbc7a0c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:54.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.467+0000 7fce5b392740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbc7644390 0x55dbc7a0cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:54.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.468+0000 7fce5b392740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55dbc7982ea0 con 0x55dbc7644390 2024-09-21T00:57:54.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.468+0000 7fce5b392740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55dbc79722d0 con 0x55dbc7665070 2024-09-21T00:57:54.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.468+0000 7fce5b392740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55dbc79760e0 con 0x55dbc763c1b0 2024-09-21T00:57:54.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.468+0000 7fce4ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbc7644390 0x55dbc7a0cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:54.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.468+0000 7fce4ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbc7644390 0x55dbc7a0cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47612/0 (socket says 172.21.15.1:47612) 2024-09-21T00:57:54.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.468+0000 7fce4ed9d640 1 -- 172.21.15.1:0/1174891118 learned_addr learned my addr 172.21.15.1:0/1174891118 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:54.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.468+0000 7fce4dd9b640 1 --2- 172.21.15.1:0/2241146844 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fce380b65a0 0x7fce380b8ab0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fce5006b110 tx=0x7fce44005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:54.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.468+0000 7fce4ed9d640 1 -- 172.21.15.1:0/1174891118 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbc763c1b0 msgr2=0x55dbc7a0c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:54.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.468+0000 7fce4ed9d640 1 --2- 172.21.15.1:0/1174891118 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbc763c1b0 0x55dbc7a0c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.468+0000 7fce4ed9d640 1 -- 172.21.15.1:0/1174891118 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dbc7665070 msgr2=0x55dbc7a0c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:54.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.468+0000 7fce4ed9d640 1 --2- 172.21.15.1:0/1174891118 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dbc7665070 0x55dbc7a0c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.468+0000 7fce4ed9d640 1 -- 172.21.15.1:0/1174891118 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbc76d0650 con 0x55dbc7644390 2024-09-21T00:57:54.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.468+0000 7fce4ed9d640 1 --2- 172.21.15.1:0/1174891118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbc7644390 0x55dbc7a0cd40 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fce48009ea0 tx=0x7fce48009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=791d4b4d80023161 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:54.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.469+0000 7fce3cff9640 1 -- 172.21.15.1:0/1174891118 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce48018de0 con 0x55dbc7644390 2024-09-21T00:57:54.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.469+0000 7fce3cff9640 1 -- 172.21.15.1:0/1174891118 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce48005020 con 0x55dbc7644390 2024-09-21T00:57:54.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.469+0000 7fce3cff9640 1 -- 172.21.15.1:0/1174891118 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4800d600 con 0x55dbc7644390 2024-09-21T00:57:54.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.469+0000 7fce5b392740 1 -- 172.21.15.1:0/1174891118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbc7644390 msgr2=0x55dbc7a0cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:54.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.469+0000 7fce5b392740 1 --2- 172.21.15.1:0/1174891118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbc7644390 0x55dbc7a0cd40 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fce48009ea0 tx=0x7fce48009f90 comp rx=0 tx=0).stop 2024-09-21T00:57:54.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.470+0000 7fce5b392740 1 -- 172.21.15.1:0/1174891118 shutdown_connections 2024-09-21T00:57:54.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.470+0000 7fce5b392740 1 --2- 172.21.15.1:0/1174891118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbc7644390 0x55dbc7a0cd40 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.470+0000 7fce5b392740 1 --2- 172.21.15.1:0/1174891118 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbc763c1b0 0x55dbc7a0c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.470+0000 7fce5b392740 1 --2- 172.21.15.1:0/1174891118 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dbc7665070 0x55dbc7a0c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.470+0000 7fce5b392740 1 -- 172.21.15.1:0/1174891118 >> 172.21.15.1:0/1174891118 conn(0x55dbc7659460 msgr2=0x55dbc7a0a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:54.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.470+0000 7fce5b392740 1 -- 172.21.15.1:0/1174891118 shutdown_connections 2024-09-21T00:57:54.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.470+0000 7fce5b392740 1 -- 172.21.15.1:0/1174891118 wait complete. 2024-09-21T00:57:54.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.470+0000 7fce5b392740 1 -- start start 2024-09-21T00:57:54.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.470+0000 7fce5b392740 1 Processor -- start 2024-09-21T00:57:54.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.471+0000 7fce5b392740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dbc763c1b0 0x55dbc7a17aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:54.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.471+0000 7fce5b392740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbc7644390 0x55dbc7a17fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:54.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.471+0000 7fce4dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbc7644390 0x55dbc7a17fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:54.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.471+0000 7fce4dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbc7644390 0x55dbc7a17fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47626/0 (socket says 172.21.15.1:47626) 2024-09-21T00:57:54.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.471+0000 7fce4dd9b640 1 -- 172.21.15.1:0/1011970638 learned_addr learned my addr 172.21.15.1:0/1011970638 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:54.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.471+0000 7fce5b392740 1 --2- 172.21.15.1:0/1011970638 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbc7665070 0x55dbc7a1cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:54.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.471+0000 7fce5b392740 1 -- 172.21.15.1:0/1011970638 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55dbc77d3700 con 0x55dbc7644390 2024-09-21T00:57:54.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.471+0000 7fce4e59c640 1 --2- 172.21.15.1:0/1011970638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dbc763c1b0 0x55dbc7a17aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:54.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.471+0000 7fce5b392740 1 -- 172.21.15.1:0/1011970638 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55dbc790d160 con 0x55dbc763c1b0 2024-09-21T00:57:54.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.471+0000 7fce5b392740 1 -- 172.21.15.1:0/1011970638 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55dbc7a1aaa0 con 0x55dbc7665070 2024-09-21T00:57:54.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.471+0000 7fce5b392740 10 client.0 _ll_register_callbacks cb 0x55dbc79269e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:54.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.472+0000 7fce4e59c640 1 -- 172.21.15.1:0/1011970638 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbc7665070 msgr2=0x55dbc7a1cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:54.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.472+0000 7fce4e59c640 1 --2- 172.21.15.1:0/1011970638 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbc7665070 0x55dbc7a1cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.472+0000 7fce4e59c640 1 -- 172.21.15.1:0/1011970638 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbc7644390 msgr2=0x55dbc7a17fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:54.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.472+0000 7fce4e59c640 1 --2- 172.21.15.1:0/1011970638 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbc7644390 0x55dbc7a17fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.472+0000 7fce4e59c640 1 -- 172.21.15.1:0/1011970638 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbc793ac90 con 0x55dbc763c1b0 2024-09-21T00:57:54.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.472+0000 7fce4dd9b640 1 --2- 172.21.15.1:0/1011970638 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbc7644390 0x55dbc7a17fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:54.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.472+0000 7fce4e59c640 1 --2- 172.21.15.1:0/1011970638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dbc763c1b0 0x55dbc7a17aa0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fce401055b0 tx=0x7fce40009650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b598c419aaa69ea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:54.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.472+0000 7fce35ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T00:57:54.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.472+0000 7fce35ffb640 1 -- 172.21.15.1:0/1011970638 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce40049070 con 0x55dbc763c1b0 2024-09-21T00:57:54.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.472+0000 7fce5b392740 1 -- 172.21.15.1:0/1011970638 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce48005020 con 0x55dbc763c1b0 2024-09-21T00:57:54.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.472+0000 7fce35ffb640 1 -- 172.21.15.1:0/1011970638 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fce400f1110 con 0x55dbc763c1b0 2024-09-21T00:57:54.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.472+0000 7fce35ffb640 1 -- 172.21.15.1:0/1011970638 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fce400c93a0 con 0x55dbc763c1b0 2024-09-21T00:57:54.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.472+0000 7fce5b392740 10 client.25436 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:54.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.472+0000 7fce5b392740 1 -- 172.21.15.1:0/1011970638 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55dbc7a1f860 con 0x55dbc763c1b0 2024-09-21T00:57:54.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.473+0000 7fce35ffb640 1 -- 172.21.15.1:0/1011970638 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce400cd740 con 0x55dbc763c1b0 2024-09-21T00:57:54.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.473+0000 7fce35ffb640 1 -- 172.21.15.1:0/1011970638 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fce400d71c0 con 0x55dbc763c1b0 2024-09-21T00:57:54.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.473+0000 7fce5b392740 10 client.25436 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:54.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.473+0000 7fce5b392740 10 client.25436 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-21T00:57:54.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.473+0000 7fce5b392740 20 client.25436 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:54.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.473+0000 7fce5b392740 1 --2- 172.21.15.1:0/1011970638 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x55dbc76239f0 0x55dbc7a22d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:54.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.473+0000 7fce5b392740 4 client.25436 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:57:54.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.473+0000 7fce5b392740 1 -- 172.21.15.1:0/1011970638 --> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fce48005020 con 0x55dbc76239f0 2024-09-21T00:57:54.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.473+0000 7fce4dd9b640 1 --2- 172.21.15.1:0/1011970638 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x55dbc76239f0 0x55dbc7a22d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:54.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.474+0000 7fce4dd9b640 1 --2- 172.21.15.1:0/1011970638 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x55dbc76239f0 0x55dbc7a22d20 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=af4c96c8dd4f321b server_cookie=48133b1dacd07f8e in_seq=0 out_seq=0 2024-09-21T00:57:54.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.474+0000 7fce35ffb640 10 client.25436 ms_handle_connect on v2:172.21.15.193:6836/909252228 2024-09-21T00:57:54.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.475+0000 7fce35ffb640 1 -- 172.21.15.1:0/1011970638 <== mds.3 v2:172.21.15.193:6836/909252228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fce48005020 con 0x55dbc76239f0 2024-09-21T00:57:54.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.475+0000 7fce35ffb640 10 client.25436 handle_command_reply: tid=0 2024-09-21T00:57:54.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.475+0000 7fce5b392740 1 client.25436 shutdown 2024-09-21T00:57:54.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.475+0000 7fce5b392740 1 -- 172.21.15.1:0/1011970638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dbc763c1b0 msgr2=0x55dbc7a17aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:54.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.475+0000 7fce5b392740 1 --2- 172.21.15.1:0/1011970638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dbc763c1b0 0x55dbc7a17aa0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fce401055b0 tx=0x7fce40009650 comp rx=0 tx=0).stop 2024-09-21T00:57:54.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.475+0000 7fce5b392740 1 -- 172.21.15.1:0/1011970638 shutdown_connections 2024-09-21T00:57:54.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.475+0000 7fce5b392740 1 --2- 172.21.15.1:0/1011970638 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x55dbc76239f0 0x55dbc7a22d20 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.475+0000 7fce5b392740 1 --2- 172.21.15.1:0/1011970638 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbc7665070 0x55dbc7a1cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.475+0000 7fce35ffb640 0 client.25436 ms_handle_reset on v2:172.21.15.193:6836/909252228 2024-09-21T00:57:54.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.475+0000 7fce5b392740 1 --2- 172.21.15.1:0/1011970638 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbc7644390 0x55dbc7a17fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.475+0000 7fce5b392740 1 --2- 172.21.15.1:0/1011970638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dbc763c1b0 0x55dbc7a17aa0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.475+0000 7fce5b392740 1 -- 172.21.15.1:0/1011970638 >> 172.21.15.1:0/1011970638 conn(0x55dbc7659460 msgr2=0x55dbc7a0f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:54.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.475+0000 7fce5b392740 1 -- 172.21.15.1:0/1011970638 shutdown_connections 2024-09-21T00:57:54.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.475+0000 7fce5b392740 1 -- 172.21.15.1:0/1011970638 wait complete. 2024-09-21T00:57:54.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.475+0000 7fce5b392740 20 client.25436 trim_cache size 0 max 16384 2024-09-21T00:57:54.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.502+0000 7fce5b392740 1 Processor -- start 2024-09-21T00:57:54.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.502+0000 7fce5b392740 1 -- start start 2024-09-21T00:57:54.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.502+0000 7fce5b392740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbc7659460 0x55dbc7a17f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:54.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.502+0000 7fce5b392740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dbc76239f0 0x55dbc7a0f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:54.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.503+0000 7fce5b392740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbc763c1b0 0x55dbc7a0f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:54.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.503+0000 7fce5b392740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fce50070ca0 con 0x55dbc7659460 2024-09-21T00:57:54.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.503+0000 7fce4e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbc7659460 0x55dbc7a17f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:54.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.503+0000 7fce4dd9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dbc76239f0 0x55dbc7a0f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:54.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.503+0000 7fce4e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbc7659460 0x55dbc7a17f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47634/0 (socket says 172.21.15.1:47634) 2024-09-21T00:57:54.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.503+0000 7fce4e59c640 1 -- 172.21.15.1:0/1478899151 learned_addr learned my addr 172.21.15.1:0/1478899151 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:54.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.503+0000 7fce4dd9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dbc76239f0 0x55dbc7a0f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:45680/0 (socket says 172.21.15.1:45680) 2024-09-21T00:57:54.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.503+0000 7fce5b392740 1 -- 172.21.15.1:0/1478899151 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fce500727e0 con 0x55dbc76239f0 2024-09-21T00:57:54.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.503+0000 7fce5b392740 1 -- 172.21.15.1:0/1478899151 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fce50071370 con 0x55dbc763c1b0 2024-09-21T00:57:54.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.503+0000 7fce4ed9d640 1 --2- 172.21.15.1:0/1478899151 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbc763c1b0 0x55dbc7a0f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:54.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.503+0000 7fce4dd9b640 1 -- 172.21.15.1:0/1478899151 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbc763c1b0 msgr2=0x55dbc7a0f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:54.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.503+0000 7fce4dd9b640 1 --2- 172.21.15.1:0/1478899151 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbc763c1b0 0x55dbc7a0f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.503+0000 7fce4dd9b640 1 -- 172.21.15.1:0/1478899151 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbc7659460 msgr2=0x55dbc7a17f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:54.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.503+0000 7fce4dd9b640 1 --2- 172.21.15.1:0/1478899151 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbc7659460 0x55dbc7a17f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.503+0000 7fce4dd9b640 1 -- 172.21.15.1:0/1478899151 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbc7a043b0 con 0x55dbc76239f0 2024-09-21T00:57:54.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.504+0000 7fce4dd9b640 1 --2- 172.21.15.1:0/1478899151 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dbc76239f0 0x55dbc7a0f3c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fce44009600 tx=0x7fce44014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9acf666ee195e8b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:54.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.504+0000 7fce37fff640 1 -- 172.21.15.1:0/1478899151 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce44012e60 con 0x55dbc76239f0 2024-09-21T00:57:54.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.504+0000 7fce37fff640 1 -- 172.21.15.1:0/1478899151 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce4401fe20 con 0x55dbc76239f0 2024-09-21T00:57:54.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.504+0000 7fce37fff640 1 -- 172.21.15.1:0/1478899151 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce44003d10 con 0x55dbc76239f0 2024-09-21T00:57:54.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.505+0000 7fce5b392740 1 -- 172.21.15.1:0/1478899151 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dbc76239f0 msgr2=0x55dbc7a0f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:54.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.505+0000 7fce5b392740 1 --2- 172.21.15.1:0/1478899151 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dbc76239f0 0x55dbc7a0f3c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fce44009600 tx=0x7fce44014000 comp rx=0 tx=0).stop 2024-09-21T00:57:54.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.505+0000 7fce5b392740 1 -- 172.21.15.1:0/1478899151 shutdown_connections 2024-09-21T00:57:54.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.505+0000 7fce5b392740 1 --2- 172.21.15.1:0/1478899151 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbc763c1b0 0x55dbc7a0f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.505+0000 7fce5b392740 1 --2- 172.21.15.1:0/1478899151 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dbc76239f0 0x55dbc7a0f3c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.505+0000 7fce5b392740 1 --2- 172.21.15.1:0/1478899151 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbc7659460 0x55dbc7a17f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.505+0000 7fce5b392740 1 -- 172.21.15.1:0/1478899151 >> 172.21.15.1:0/1478899151 conn(0x55dbc7a22fe0 msgr2=0x55dbc7a17850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:54.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.505+0000 7fce5b392740 1 -- 172.21.15.1:0/1478899151 shutdown_connections 2024-09-21T00:57:54.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.505+0000 7fce5b392740 1 -- 172.21.15.1:0/1478899151 wait complete. 2024-09-21T00:57:54.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.506+0000 7fce5b392740 1 -- start start 2024-09-21T00:57:54.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.506+0000 7fce5b392740 1 Processor -- start 2024-09-21T00:57:54.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.506+0000 7fce5b392740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbc76239f0 0x55dbc7a255e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:54.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.506+0000 7fce5b392740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbc763c1b0 0x55dbc7a25b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:54.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.507+0000 7fce4dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbc763c1b0 0x55dbc7a25b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:54.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.507+0000 7fce4dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbc763c1b0 0x55dbc7a25b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47636/0 (socket says 172.21.15.1:47636) 2024-09-21T00:57:54.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.507+0000 7fce4e59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbc76239f0 0x55dbc7a255e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:54.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.507+0000 7fce4e59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbc76239f0 0x55dbc7a255e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:39110/0 (socket says 172.21.15.1:39110) 2024-09-21T00:57:54.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.507+0000 7fce4dd9b640 1 -- 172.21.15.1:0/4191209840 learned_addr learned my addr 172.21.15.1:0/4191209840 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:54.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.507+0000 7fce5b392740 1 --2- 172.21.15.1:0/4191209840 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dbc7659460 0x55dbc7a26060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:54.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.507+0000 7fce5b392740 1 -- 172.21.15.1:0/4191209840 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fce50072110 con 0x55dbc763c1b0 2024-09-21T00:57:54.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.507+0000 7fce5b392740 1 -- 172.21.15.1:0/4191209840 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fce50071a40 con 0x55dbc7659460 2024-09-21T00:57:54.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.507+0000 7fce5b392740 1 -- 172.21.15.1:0/4191209840 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fce5006eca0 con 0x55dbc76239f0 2024-09-21T00:57:54.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.507+0000 7fce4ed9d640 1 --2- 172.21.15.1:0/4191209840 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dbc7659460 0x55dbc7a26060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:54.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.507+0000 7fce5b392740 10 client.0 _ll_register_callbacks cb 0x7fce40005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:54.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.507+0000 7fce4dd9b640 1 -- 172.21.15.1:0/4191209840 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbc76239f0 msgr2=0x55dbc7a255e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:54.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.507+0000 7fce4dd9b640 1 --2- 172.21.15.1:0/4191209840 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbc76239f0 0x55dbc7a255e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.507+0000 7fce4dd9b640 1 -- 172.21.15.1:0/4191209840 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dbc7659460 msgr2=0x55dbc7a26060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:54.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.507+0000 7fce4dd9b640 1 --2- 172.21.15.1:0/4191209840 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dbc7659460 0x55dbc7a26060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.508+0000 7fce4dd9b640 1 -- 172.21.15.1:0/4191209840 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbc7a0af40 con 0x55dbc763c1b0 2024-09-21T00:57:54.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.508+0000 7fce5b392740 1 -- 172.21.15.1:0/4191209840 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce4401fe20 con 0x55dbc763c1b0 2024-09-21T00:57:54.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.508+0000 7fce4dd9b640 1 --2- 172.21.15.1:0/4191209840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbc763c1b0 0x55dbc7a25b20 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fce44000c00 tx=0x7fce44003870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b58f970f75d16068 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:54.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.508+0000 7fce35ffb640 10 client.15750 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:57:54.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.508+0000 7fce35ffb640 1 -- 172.21.15.1:0/4191209840 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4401fa30 con 0x55dbc763c1b0 2024-09-21T00:57:54.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.509+0000 7fce35ffb640 1 -- 172.21.15.1:0/4191209840 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fce4401fbd0 con 0x55dbc763c1b0 2024-09-21T00:57:54.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.509+0000 7fce35ffb640 1 -- 172.21.15.1:0/4191209840 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fce44005050 con 0x55dbc763c1b0 2024-09-21T00:57:54.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.509+0000 7fce5b392740 10 client.15750 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:54.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.509+0000 7fce5b392740 1 -- 172.21.15.1:0/4191209840 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55dbc7a0ab20 con 0x55dbc763c1b0 2024-09-21T00:57:54.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.509+0000 7fce35ffb640 1 -- 172.21.15.1:0/4191209840 <== mon.0 v2:172.21.15.1:3300/0 4 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fce440051f0 con 0x55dbc763c1b0 2024-09-21T00:57:54.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.510+0000 7fce5b392740 10 client.15750 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:54.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.510+0000 7fce5b392740 10 client.15750 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-21T00:57:54.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.510+0000 7fce5b392740 20 client.15750 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:54.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.510+0000 7fce5b392740 1 --2- 172.21.15.1:0/4191209840 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x55dbc7644390 0x55dbc7adb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:54.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.510+0000 7fce5b392740 4 client.15750 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:57:54.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.510+0000 7fce5b392740 1 -- 172.21.15.1:0/4191209840 --> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dbc7984df0 con 0x55dbc7644390 2024-09-21T00:57:54.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.510+0000 7fce4e59c640 1 --2- 172.21.15.1:0/4191209840 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x55dbc7644390 0x55dbc7adb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:54.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.511+0000 7fce35ffb640 10 client.15750 ms_handle_connect on v2:172.21.15.193:6836/909252228 2024-09-21T00:57:54.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.511+0000 7fce4e59c640 1 --2- 172.21.15.1:0/4191209840 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x55dbc7644390 0x55dbc7adb450 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=20d3222d8785ce9f server_cookie=8e00a0d95e802893 in_seq=0 out_seq=0 2024-09-21T00:57:54.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.511+0000 7fce35ffb640 1 -- 172.21.15.1:0/4191209840 <== mds.3 v2:172.21.15.193:6836/909252228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dbc7984df0 con 0x55dbc7644390 2024-09-21T00:57:54.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.511+0000 7fce35ffb640 10 client.15750 handle_command_reply: tid=0 2024-09-21T00:57:54.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.511+0000 7fce5b392740 1 client.15750 shutdown 2024-09-21T00:57:54.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.511+0000 7fce5b392740 1 -- 172.21.15.1:0/4191209840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbc763c1b0 msgr2=0x55dbc7a25b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:54.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.511+0000 7fce5b392740 1 --2- 172.21.15.1:0/4191209840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbc763c1b0 0x55dbc7a25b20 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fce44000c00 tx=0x7fce44003870 comp rx=0 tx=0).stop 2024-09-21T00:57:54.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.511+0000 7fce5b392740 1 -- 172.21.15.1:0/4191209840 shutdown_connections 2024-09-21T00:57:54.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.511+0000 7fce5b392740 1 --2- 172.21.15.1:0/4191209840 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x55dbc7644390 0x55dbc7adb450 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.511+0000 7fce5b392740 1 --2- 172.21.15.1:0/4191209840 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dbc7659460 0x55dbc7a26060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.511+0000 7fce5b392740 1 --2- 172.21.15.1:0/4191209840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbc763c1b0 0x55dbc7a25b20 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.512+0000 7fce35ffb640 0 client.15750 ms_handle_reset on v2:172.21.15.193:6836/909252228 2024-09-21T00:57:54.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.512+0000 7fce5b392740 1 --2- 172.21.15.1:0/4191209840 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbc76239f0 0x55dbc7a255e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.512+0000 7fce5b392740 1 -- 172.21.15.1:0/4191209840 >> 172.21.15.1:0/4191209840 conn(0x55dbc7a22fe0 msgr2=0x55dbc7a0f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:54.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.512+0000 7fce5b392740 1 -- 172.21.15.1:0/4191209840 shutdown_connections 2024-09-21T00:57:54.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.512+0000 7fce5b392740 1 -- 172.21.15.1:0/4191209840 wait complete. 2024-09-21T00:57:54.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.512+0000 7fce5b392740 20 client.15750 trim_cache size 0 max 16384 2024-09-21T00:57:54.515 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T00:57:54.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.513+0000 7fce54e1e640 1 -- 172.21.15.1:0/2241146844 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fce380b65a0 msgr2=0x7fce380b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:54.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.513+0000 7fce54e1e640 1 --2- 172.21.15.1:0/2241146844 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fce380b65a0 0x7fce380b8ab0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fce5006b110 tx=0x7fce44005f90 comp rx=0 tx=0).stop 2024-09-21T00:57:54.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.513+0000 7fce54e1e640 1 -- 172.21.15.1:0/2241146844 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce50101da0 msgr2=0x7fce5019c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:54.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.513+0000 7fce54e1e640 1 --2- 172.21.15.1:0/2241146844 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce50101da0 0x7fce5019c6b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fce40005940 tx=0x7fce40004270 comp rx=0 tx=0).stop 2024-09-21T00:57:54.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.513+0000 7fce54e1e640 1 -- 172.21.15.1:0/2241146844 shutdown_connections 2024-09-21T00:57:54.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.513+0000 7fce54e1e640 1 --2- 172.21.15.1:0/2241146844 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce50104690 0x7fce501a1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.513+0000 7fce54e1e640 1 --2- 172.21.15.1:0/2241146844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce50102890 0x7fce5019cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.513+0000 7fce54e1e640 1 --2- 172.21.15.1:0/2241146844 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fce380b65a0 0x7fce380b8ab0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.513+0000 7fce54e1e640 1 --2- 172.21.15.1:0/2241146844 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce50101da0 0x7fce5019c6b0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.513+0000 7fce54e1e640 1 -- 172.21.15.1:0/2241146844 >> 172.21.15.1:0/2241146844 conn(0x7fce50077c90 msgr2=0x7fce500ff8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:54.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.513+0000 7fce54e1e640 1 -- 172.21.15.1:0/2241146844 shutdown_connections 2024-09-21T00:57:54.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:54.513+0000 7fce54e1e640 1 -- 172.21.15.1:0/2241146844 wait complete. 2024-09-21T00:57:55.239 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T00:57:55.643 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:55.910 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:55 smithi001 ceph-mon[31211]: pgmap v379: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-21T00:57:55.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:55 smithi193 ceph-mon[34660]: pgmap v379: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-21T00:57:55.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:55 smithi042 ceph-mon[34481]: pgmap v379: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-21T00:57:56.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.188+0000 7fb68896e640 1 -- 172.21.15.1:0/772632777 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb684102090 msgr2=0x7fb6841024a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:56.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.188+0000 7fb68896e640 1 --2- 172.21.15.1:0/772632777 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb684102090 0x7fb6841024a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb674009900 tx=0x7fb67402a410 comp rx=0 tx=0).stop 2024-09-21T00:57:56.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.188+0000 7fb68896e640 1 -- 172.21.15.1:0/772632777 shutdown_connections 2024-09-21T00:57:56.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.188+0000 7fb68896e640 1 --2- 172.21.15.1:0/772632777 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb684106bd0 0x7fb684110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:56.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.188+0000 7fb68896e640 1 --2- 172.21.15.1:0/772632777 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb684106280 0x7fb684106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:56.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.188+0000 7fb68896e640 1 --2- 172.21.15.1:0/772632777 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb684102090 0x7fb6841024a0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:56.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.188+0000 7fb68896e640 1 -- 172.21.15.1:0/772632777 >> 172.21.15.1:0/772632777 conn(0x7fb684077c60 msgr2=0x7fb6840780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:56.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.189+0000 7fb68896e640 1 -- 172.21.15.1:0/772632777 shutdown_connections 2024-09-21T00:57:56.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.190+0000 7fb68896e640 1 -- 172.21.15.1:0/772632777 wait complete. 2024-09-21T00:57:56.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.191+0000 7fb68896e640 1 Processor -- start 2024-09-21T00:57:56.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.191+0000 7fb68896e640 1 -- start start 2024-09-21T00:57:56.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.191+0000 7fb68896e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb684102090 0x7fb68419a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:56.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.191+0000 7fb68896e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb684106280 0x7fb68419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:56.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.191+0000 7fb68896e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb684106bd0 0x7fb68419fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:56.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.191+0000 7fb68896e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb684113af0 con 0x7fb684102090 2024-09-21T00:57:56.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.191+0000 7fb68896e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb684113970 con 0x7fb684106280 2024-09-21T00:57:56.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.191+0000 7fb68896e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb684113c70 con 0x7fb684106bd0 2024-09-21T00:57:56.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.191+0000 7fb68259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb684102090 0x7fb68419a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:56.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.191+0000 7fb68259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb684102090 0x7fb68419a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47660/0 (socket says 172.21.15.1:47660) 2024-09-21T00:57:56.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.192+0000 7fb68259c640 1 -- 172.21.15.1:0/1771789433 learned_addr learned my addr 172.21.15.1:0/1771789433 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:56.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.192+0000 7fb682d9d640 1 --2- 172.21.15.1:0/1771789433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb684106bd0 0x7fb68419fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:56.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.192+0000 7fb681d9b640 1 --2- 172.21.15.1:0/1771789433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb684106280 0x7fb68419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:56.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.192+0000 7fb68259c640 1 -- 172.21.15.1:0/1771789433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb684106bd0 msgr2=0x7fb68419fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:56.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.192+0000 7fb68259c640 1 --2- 172.21.15.1:0/1771789433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb684106bd0 0x7fb68419fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:56.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.192+0000 7fb68259c640 1 -- 172.21.15.1:0/1771789433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb684106280 msgr2=0x7fb68419ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:56.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.192+0000 7fb68259c640 1 --2- 172.21.15.1:0/1771789433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb684106280 0x7fb68419ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:56.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.192+0000 7fb68259c640 1 -- 172.21.15.1:0/1771789433 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6841a04f0 con 0x7fb684102090 2024-09-21T00:57:56.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.192+0000 7fb681d9b640 1 --2- 172.21.15.1:0/1771789433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb684106280 0x7fb68419ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:57:56.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.192+0000 7fb68259c640 1 --2- 172.21.15.1:0/1771789433 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb684102090 0x7fb68419a580 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb67402a930 tx=0x7fb674003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:56.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.193+0000 7fb6737fe640 1 -- 172.21.15.1:0/1771789433 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67403f070 con 0x7fb684102090 2024-09-21T00:57:56.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.193+0000 7fb68896e640 1 -- 172.21.15.1:0/1771789433 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6841a0780 con 0x7fb684102090 2024-09-21T00:57:56.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.193+0000 7fb68896e640 1 -- 172.21.15.1:0/1771789433 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6841a6f40 con 0x7fb684102090 2024-09-21T00:57:56.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.193+0000 7fb6737fe640 1 -- 172.21.15.1:0/1771789433 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb67403bb10 con 0x7fb684102090 2024-09-21T00:57:56.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.193+0000 7fb6737fe640 1 -- 172.21.15.1:0/1771789433 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb674035030 con 0x7fb684102090 2024-09-21T00:57:56.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.196+0000 7fb6737fe640 1 -- 172.21.15.1:0/1771789433 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 154562+0+0 (secure 0 0 0) 0x7fb674042070 con 0x7fb684102090 2024-09-21T00:57:56.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.197+0000 7fb68eee2740 1 Processor -- start 2024-09-21T00:57:56.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.197+0000 7fb68eee2740 1 -- start start 2024-09-21T00:57:56.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.197+0000 7fb68eee2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c38495070 0x559c3883c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:56.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.197+0000 7fb68eee2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c3846c1b0 0x559c3883c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:56.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.197+0000 7fb68eee2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c38474390 0x559c3883cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:56.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.198+0000 7fb68eee2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559c387b2ea0 con 0x559c38474390 2024-09-21T00:57:56.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.198+0000 7fb68eee2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559c387a22d0 con 0x559c3846c1b0 2024-09-21T00:57:56.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.198+0000 7fb68eee2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559c387a60e0 con 0x559c38495070 2024-09-21T00:57:56.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.198+0000 7fb681d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c38474390 0x559c3883cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:56.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.198+0000 7fb681d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c38474390 0x559c3883cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47670/0 (socket says 172.21.15.1:47670) 2024-09-21T00:57:56.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.198+0000 7fb681d9b640 1 -- 172.21.15.1:0/286715192 learned_addr learned my addr 172.21.15.1:0/286715192 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:56.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.198+0000 7fb68259c640 1 --2- 172.21.15.1:0/286715192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c3846c1b0 0x559c3883c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:56.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.198+0000 7fb682d9d640 1 --2- 172.21.15.1:0/286715192 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c38495070 0x559c3883c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:56.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.198+0000 7fb68259c640 1 -- 172.21.15.1:0/286715192 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c38495070 msgr2=0x559c3883c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:56.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.198+0000 7fb68259c640 1 --2- 172.21.15.1:0/286715192 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c38495070 0x559c3883c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:56.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.198+0000 7fb68259c640 1 -- 172.21.15.1:0/286715192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c38474390 msgr2=0x559c3883cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:56.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.199+0000 7fb68259c640 1 --2- 172.21.15.1:0/286715192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c38474390 0x559c3883cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:56.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.199+0000 7fb68259c640 1 -- 172.21.15.1:0/286715192 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c38500650 con 0x559c3846c1b0 2024-09-21T00:57:56.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.199+0000 7fb682d9d640 1 --2- 172.21.15.1:0/286715192 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c38495070 0x559c3883c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:57:56.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.199+0000 7fb681d9b640 1 --2- 172.21.15.1:0/286715192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c38474390 0x559c3883cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:56.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.199+0000 7fb68259c640 1 --2- 172.21.15.1:0/286715192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c3846c1b0 0x559c3883c800 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb674106540 tx=0x7fb67402a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7967a15d1f89424e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:56.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.200+0000 7fb670ff9640 1 -- 172.21.15.1:0/286715192 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb674110890 con 0x559c3846c1b0 2024-09-21T00:57:56.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.200+0000 7fb670ff9640 1 -- 172.21.15.1:0/286715192 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb674115020 con 0x559c3846c1b0 2024-09-21T00:57:56.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.200+0000 7fb670ff9640 1 -- 172.21.15.1:0/286715192 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67410ba00 con 0x559c3846c1b0 2024-09-21T00:57:56.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.200+0000 7fb6737fe640 1 --2- 172.21.15.1:0/1771789433 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb66c0b6620 0x7fb66c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:56.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.200+0000 7fb682d9d640 1 --2- 172.21.15.1:0/1771789433 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb66c0b6620 0x7fb66c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:56.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.200+0000 7fb6737fe640 1 -- 172.21.15.1:0/1771789433 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fb674108bb0 con 0x7fb684102090 2024-09-21T00:57:56.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.201+0000 7fb68eee2740 1 -- 172.21.15.1:0/286715192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c3846c1b0 msgr2=0x559c3883c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:56.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.201+0000 7fb682d9d640 1 --2- 172.21.15.1:0/1771789433 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb66c0b6620 0x7fb66c0b8b30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb67c009370 tx=0x7fb67c009440 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:56.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.201+0000 7fb68eee2740 1 --2- 172.21.15.1:0/286715192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c3846c1b0 0x559c3883c800 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb674106540 tx=0x7fb67402a410 comp rx=0 tx=0).stop 2024-09-21T00:57:56.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.201+0000 7fb68eee2740 1 -- 172.21.15.1:0/286715192 shutdown_connections 2024-09-21T00:57:56.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.201+0000 7fb68eee2740 1 --2- 172.21.15.1:0/286715192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c38474390 0x559c3883cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:56.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.201+0000 7fb68eee2740 1 --2- 172.21.15.1:0/286715192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c3846c1b0 0x559c3883c800 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:56.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.201+0000 7fb68eee2740 1 --2- 172.21.15.1:0/286715192 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c38495070 0x559c3883c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:56.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.201+0000 7fb68eee2740 1 -- 172.21.15.1:0/286715192 >> 172.21.15.1:0/286715192 conn(0x559c38489460 msgr2=0x559c3883a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:56.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.201+0000 7fb68eee2740 1 -- 172.21.15.1:0/286715192 shutdown_connections 2024-09-21T00:57:56.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.201+0000 7fb68eee2740 1 -- 172.21.15.1:0/286715192 wait complete. 2024-09-21T00:57:56.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.201+0000 7fb68eee2740 1 -- start start 2024-09-21T00:57:56.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.202+0000 7fb68eee2740 1 Processor -- start 2024-09-21T00:57:56.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.202+0000 7fb68eee2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c3846c1b0 0x559c38847930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:56.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.202+0000 7fb68eee2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c38474390 0x559c38847e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:56.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.202+0000 7fb68eee2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c38495070 0x559c38857ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:56.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.202+0000 7fb68eee2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559c38603700 con 0x559c38474390 2024-09-21T00:57:56.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.202+0000 7fb68eee2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559c3873d160 con 0x559c38495070 2024-09-21T00:57:56.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.202+0000 7fb68eee2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559c3884ec70 con 0x559c3846c1b0 2024-09-21T00:57:56.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.202+0000 7fb681d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c38474390 0x559c38847e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:56.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.202+0000 7fb68eee2740 10 client.0 _ll_register_callbacks cb 0x559c387569e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:56.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.202+0000 7fb681d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c38474390 0x559c38847e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47676/0 (socket says 172.21.15.1:47676) 2024-09-21T00:57:56.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.202+0000 7fb681d9b640 1 -- 172.21.15.1:0/3115776091 learned_addr learned my addr 172.21.15.1:0/3115776091 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:56.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.202+0000 7fb68259c640 1 --2- 172.21.15.1:0/3115776091 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c3846c1b0 0x559c38847930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:56.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.203+0000 7fb682d9d640 1 --2- 172.21.15.1:0/3115776091 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c38495070 0x559c38857ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:56.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.203+0000 7fb68259c640 1 -- 172.21.15.1:0/3115776091 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c38495070 msgr2=0x559c38857ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:56.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.203+0000 7fb68259c640 1 --2- 172.21.15.1:0/3115776091 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c38495070 0x559c38857ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:56.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.203+0000 7fb68259c640 1 -- 172.21.15.1:0/3115776091 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c38474390 msgr2=0x559c38847e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:56.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.203+0000 7fb68259c640 1 --2- 172.21.15.1:0/3115776091 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c38474390 0x559c38847e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:56.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.203+0000 7fb68259c640 1 -- 172.21.15.1:0/3115776091 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c3876ac90 con 0x559c3846c1b0 2024-09-21T00:57:56.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.203+0000 7fb681d9b640 1 --2- 172.21.15.1:0/3115776091 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c38474390 0x559c38847e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:56.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.203+0000 7fb68259c640 1 --2- 172.21.15.1:0/3115776091 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c3846c1b0 0x559c38847930 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x559c3883af40 tx=0x7fb67403baa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46c95a8b7f8ade08 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:56.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.203+0000 7fb669ffb640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T00:57:56.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.203+0000 7fb669ffb640 1 -- 172.21.15.1:0/3115776091 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb674049070 con 0x559c3846c1b0 2024-09-21T00:57:56.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.203+0000 7fb669ffb640 1 -- 172.21.15.1:0/3115776091 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fb6740cae30 con 0x559c3846c1b0 2024-09-21T00:57:56.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.203+0000 7fb68eee2740 1 -- 172.21.15.1:0/3115776091 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb674115020 con 0x559c3846c1b0 2024-09-21T00:57:56.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.204+0000 7fb669ffb640 1 -- 172.21.15.1:0/3115776091 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb6740cb210 con 0x559c3846c1b0 2024-09-21T00:57:56.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.204+0000 7fb68eee2740 10 client.25384 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:56.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.204+0000 7fb68eee2740 1 -- 172.21.15.1:0/3115776091 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559c3885a820 con 0x559c3846c1b0 2024-09-21T00:57:56.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.204+0000 7fb669ffb640 1 -- 172.21.15.1:0/3115776091 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6740ce6d0 con 0x559c3846c1b0 2024-09-21T00:57:56.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.204+0000 7fb669ffb640 1 -- 172.21.15.1:0/3115776091 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fb6740f20e0 con 0x559c3846c1b0 2024-09-21T00:57:56.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.204+0000 7fb68eee2740 10 client.25384 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:56.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.204+0000 7fb68eee2740 10 client.25384 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T00:57:56.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.204+0000 7fb68eee2740 20 client.25384 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:56.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.204+0000 7fb68eee2740 1 --2- 172.21.15.1:0/3115776091 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x559c384539f0 0x559c3885db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:56.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.204+0000 7fb68eee2740 4 client.25384 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:57:56.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.204+0000 7fb68eee2740 1 -- 172.21.15.1:0/3115776091 --> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb674115020 con 0x559c384539f0 2024-09-21T00:57:56.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.205+0000 7fb681d9b640 1 --2- 172.21.15.1:0/3115776091 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x559c384539f0 0x559c3885db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:56.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.205+0000 7fb669ffb640 10 client.25384 ms_handle_connect on v2:172.21.15.42:6836/2395608508 2024-09-21T00:57:56.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.205+0000 7fb681d9b640 1 --2- 172.21.15.1:0/3115776091 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x559c384539f0 0x559c3885db80 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6c14a4b94e43ff95 server_cookie=a77dd40c4de42876 in_seq=0 out_seq=0 2024-09-21T00:57:56.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.206+0000 7fb669ffb640 1 -- 172.21.15.1:0/3115776091 <== mds.2 v2:172.21.15.42:6836/2395608508 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fb674115020 con 0x559c384539f0 2024-09-21T00:57:56.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.206+0000 7fb669ffb640 10 client.25384 handle_command_reply: tid=0 2024-09-21T00:57:56.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.206+0000 7fb68eee2740 1 client.25384 shutdown 2024-09-21T00:57:56.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.207+0000 7fb68eee2740 1 -- 172.21.15.1:0/3115776091 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c3846c1b0 msgr2=0x559c38847930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:56.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.207+0000 7fb68eee2740 1 --2- 172.21.15.1:0/3115776091 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c3846c1b0 0x559c38847930 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x559c3883af40 tx=0x7fb67403baa0 comp rx=0 tx=0).stop 2024-09-21T00:57:56.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.207+0000 7fb68eee2740 1 -- 172.21.15.1:0/3115776091 shutdown_connections 2024-09-21T00:57:56.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.207+0000 7fb68eee2740 1 --2- 172.21.15.1:0/3115776091 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x559c384539f0 0x559c3885db80 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:56.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.207+0000 7fb68eee2740 1 --2- 172.21.15.1:0/3115776091 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c38495070 0x559c38857ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:56.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.207+0000 7fb669ffb640 0 client.25384 ms_handle_reset on v2:172.21.15.42:6836/2395608508 2024-09-21T00:57:56.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.207+0000 7fb68eee2740 1 --2- 172.21.15.1:0/3115776091 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c38474390 0x559c38847e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:56.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.207+0000 7fb68eee2740 1 --2- 172.21.15.1:0/3115776091 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c3846c1b0 0x559c38847930 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:56.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.207+0000 7fb68eee2740 1 -- 172.21.15.1:0/3115776091 >> 172.21.15.1:0/3115776091 conn(0x559c38489460 msgr2=0x559c3883f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:56.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.207+0000 7fb68eee2740 1 -- 172.21.15.1:0/3115776091 shutdown_connections 2024-09-21T00:57:56.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.207+0000 7fb68eee2740 1 -- 172.21.15.1:0/3115776091 wait complete. 2024-09-21T00:57:56.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.207+0000 7fb68eee2740 20 client.25384 trim_cache size 0 max 16384 2024-09-21T00:57:56.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.233+0000 7fb68eee2740 1 Processor -- start 2024-09-21T00:57:56.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.233+0000 7fb68eee2740 1 -- start start 2024-09-21T00:57:56.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.234+0000 7fb68eee2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c384539f0 0x559c38847df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:56.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.234+0000 7fb68eee2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c3846c1b0 0x559c38839760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:56.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.234+0000 7fb68eee2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c38474390 0x559c38839ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:56.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.234+0000 7fb68eee2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb6841ad320 con 0x559c384539f0 2024-09-21T00:57:56.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.234+0000 7fb68eee2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb6841aee60 con 0x559c3846c1b0 2024-09-21T00:57:56.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.234+0000 7fb68eee2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb6841ad9f0 con 0x559c38474390 2024-09-21T00:57:56.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.234+0000 7fb682d9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c38474390 0x559c38839ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:56.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.234+0000 7fb682d9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c38474390 0x559c38839ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:39160/0 (socket says 172.21.15.1:39160) 2024-09-21T00:57:56.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.234+0000 7fb682d9d640 1 -- 172.21.15.1:0/177797896 learned_addr learned my addr 172.21.15.1:0/177797896 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:56.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.234+0000 7fb681d9b640 1 --2- 172.21.15.1:0/177797896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c3846c1b0 0x559c38839760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:56.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.234+0000 7fb682d9d640 1 -- 172.21.15.1:0/177797896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c3846c1b0 msgr2=0x559c38839760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:56.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.234+0000 7fb682d9d640 1 --2- 172.21.15.1:0/177797896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c3846c1b0 0x559c38839760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:56.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.234+0000 7fb682d9d640 1 -- 172.21.15.1:0/177797896 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c384539f0 msgr2=0x559c38847df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:56.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.234+0000 7fb682d9d640 1 --2- 172.21.15.1:0/177797896 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c384539f0 0x559c38847df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:56.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.234+0000 7fb682d9d640 1 -- 172.21.15.1:0/177797896 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c3883e5e0 con 0x559c38474390 2024-09-21T00:57:56.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.235+0000 7fb682d9d640 1 --2- 172.21.15.1:0/177797896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c38474390 0x559c38839ca0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb67c011490 tx=0x7fb67c012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96e173d27b7298a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:56.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.235+0000 7fb66bfff640 1 -- 172.21.15.1:0/177797896 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67c01e620 con 0x559c38474390 2024-09-21T00:57:56.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.235+0000 7fb66bfff640 1 -- 172.21.15.1:0/177797896 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb67c01ec70 con 0x559c38474390 2024-09-21T00:57:56.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.235+0000 7fb66bfff640 1 -- 172.21.15.1:0/177797896 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67c026ce0 con 0x559c38474390 2024-09-21T00:57:56.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.236+0000 7fb68eee2740 1 -- 172.21.15.1:0/177797896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c38474390 msgr2=0x559c38839ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:56.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.236+0000 7fb68eee2740 1 --2- 172.21.15.1:0/177797896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c38474390 0x559c38839ca0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb67c011490 tx=0x7fb67c012000 comp rx=0 tx=0).stop 2024-09-21T00:57:56.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.236+0000 7fb68eee2740 1 -- 172.21.15.1:0/177797896 shutdown_connections 2024-09-21T00:57:56.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.236+0000 7fb68eee2740 1 --2- 172.21.15.1:0/177797896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c38474390 0x559c38839ca0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:56.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.236+0000 7fb68eee2740 1 --2- 172.21.15.1:0/177797896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c3846c1b0 0x559c38839760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:56.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.236+0000 7fb68eee2740 1 --2- 172.21.15.1:0/177797896 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c384539f0 0x559c38847df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:56.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.236+0000 7fb68eee2740 1 -- 172.21.15.1:0/177797896 >> 172.21.15.1:0/177797896 conn(0x559c38489460 msgr2=0x559c388476e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:56.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.236+0000 7fb68eee2740 1 -- 172.21.15.1:0/177797896 shutdown_connections 2024-09-21T00:57:56.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.236+0000 7fb68eee2740 1 -- 172.21.15.1:0/177797896 wait complete. 2024-09-21T00:57:56.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.237+0000 7fb68eee2740 1 -- start start 2024-09-21T00:57:56.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.237+0000 7fb68eee2740 1 Processor -- start 2024-09-21T00:57:56.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.237+0000 7fb68eee2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c384539f0 0x559c3884dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:56.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.238+0000 7fb68eee2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c3846c1b0 0x559c3884e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:56.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.238+0000 7fb68eee2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c38474390 0x559c3884e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:56.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.238+0000 7fb68eee2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb6841ae790 con 0x559c3846c1b0 2024-09-21T00:57:56.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.238+0000 7fb68eee2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb6841ae0c0 con 0x559c38474390 2024-09-21T00:57:56.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.238+0000 7fb68eee2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb6841ab300 con 0x559c384539f0 2024-09-21T00:57:56.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.238+0000 7fb681d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c3846c1b0 0x559c3884e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:56.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.238+0000 7fb681d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c3846c1b0 0x559c3884e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47684/0 (socket says 172.21.15.1:47684) 2024-09-21T00:57:56.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.238+0000 7fb681d9b640 1 -- 172.21.15.1:0/1963239213 learned_addr learned my addr 172.21.15.1:0/1963239213 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:56.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.238+0000 7fb68259c640 1 --2- 172.21.15.1:0/1963239213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c384539f0 0x559c3884dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:56.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.238+0000 7fb682d9d640 1 --2- 172.21.15.1:0/1963239213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c38474390 0x559c3884e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:56.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.238+0000 7fb68eee2740 10 client.0 _ll_register_callbacks cb 0x7fb678009630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:56.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.238+0000 7fb68259c640 1 -- 172.21.15.1:0/1963239213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c38474390 msgr2=0x559c3884e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:56.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.238+0000 7fb68259c640 1 --2- 172.21.15.1:0/1963239213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c38474390 0x559c3884e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:56.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.238+0000 7fb68259c640 1 -- 172.21.15.1:0/1963239213 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c3846c1b0 msgr2=0x559c3884e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:56.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.238+0000 7fb68259c640 1 --2- 172.21.15.1:0/1963239213 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c3846c1b0 0x559c3884e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:56.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.238+0000 7fb68259c640 1 -- 172.21.15.1:0/1963239213 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c38860290 con 0x559c384539f0 2024-09-21T00:57:56.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.238+0000 7fb681d9b640 1 --2- 172.21.15.1:0/1963239213 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c3846c1b0 0x559c3884e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:56.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.238+0000 7fb68eee2740 1 -- 172.21.15.1:0/1963239213 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb67c01ec70 con 0x559c384539f0 2024-09-21T00:57:56.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.239+0000 7fb68259c640 1 --2- 172.21.15.1:0/1963239213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c384539f0 0x559c3884dac0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb6740cbe30 tx=0x7fb674003f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed3c13c1517d7fea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:56.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.239+0000 7fb669ffb640 10 client.25390 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T00:57:56.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.239+0000 7fb669ffb640 1 -- 172.21.15.1:0/1963239213 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb674049070 con 0x559c384539f0 2024-09-21T00:57:56.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.239+0000 7fb669ffb640 1 -- 172.21.15.1:0/1963239213 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fb6740f20e0 con 0x559c384539f0 2024-09-21T00:57:56.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.239+0000 7fb669ffb640 1 -- 172.21.15.1:0/1963239213 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb6740ca330 con 0x559c384539f0 2024-09-21T00:57:56.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.239+0000 7fb68eee2740 10 client.25390 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:56.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.239+0000 7fb68eee2740 1 -- 172.21.15.1:0/1963239213 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({fsmap=27}) -- 0x559c38860290 con 0x559c384539f0 2024-09-21T00:57:56.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.239+0000 7fb669ffb640 1 -- 172.21.15.1:0/1963239213 <== mon.1 v2:172.21.15.193:3300/0 4 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fb6740f0bd0 con 0x559c384539f0 2024-09-21T00:57:56.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.239+0000 7fb68eee2740 10 client.25390 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:56.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.239+0000 7fb68eee2740 10 client.25390 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T00:57:56.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.239+0000 7fb68eee2740 20 client.25390 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:56.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.239+0000 7fb68eee2740 1 --2- 172.21.15.1:0/1963239213 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x559c38495070 0x559c388d75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:56.245 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T00:57:56.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.239+0000 7fb68eee2740 4 client.25390 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:57:56.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.239+0000 7fb68eee2740 1 -- 172.21.15.1:0/1963239213 --> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559c387b4df0 con 0x559c38495070 2024-09-21T00:57:56.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.240+0000 7fb681d9b640 1 --2- 172.21.15.1:0/1963239213 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x559c38495070 0x559c388d75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:56.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.240+0000 7fb669ffb640 10 client.25390 ms_handle_connect on v2:172.21.15.42:6836/2395608508 2024-09-21T00:57:56.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.240+0000 7fb681d9b640 1 --2- 172.21.15.1:0/1963239213 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x559c38495070 0x559c388d75a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e3211ec21a53e531 server_cookie=1a2238ae90e60a66 in_seq=0 out_seq=0 2024-09-21T00:57:56.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.241+0000 7fb669ffb640 1 -- 172.21.15.1:0/1963239213 <== mds.2 v2:172.21.15.42:6836/2395608508 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559c387b4df0 con 0x559c38495070 2024-09-21T00:57:56.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.241+0000 7fb669ffb640 10 client.25390 handle_command_reply: tid=0 2024-09-21T00:57:56.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.241+0000 7fb68eee2740 1 client.25390 shutdown 2024-09-21T00:57:56.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.241+0000 7fb68eee2740 1 -- 172.21.15.1:0/1963239213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c384539f0 msgr2=0x559c3884dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:56.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.241+0000 7fb68eee2740 1 --2- 172.21.15.1:0/1963239213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c384539f0 0x559c3884dac0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb6740cbe30 tx=0x7fb674003f90 comp rx=0 tx=0).stop 2024-09-21T00:57:56.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.241+0000 7fb68eee2740 1 -- 172.21.15.1:0/1963239213 shutdown_connections 2024-09-21T00:57:56.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.241+0000 7fb68eee2740 1 --2- 172.21.15.1:0/1963239213 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x559c38495070 0x559c388d75a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:56.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.241+0000 7fb669ffb640 0 client.25390 ms_handle_reset on v2:172.21.15.42:6836/2395608508 2024-09-21T00:57:56.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.241+0000 7fb68eee2740 1 --2- 172.21.15.1:0/1963239213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c38474390 0x559c3884e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:56.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.241+0000 7fb68eee2740 1 --2- 172.21.15.1:0/1963239213 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c3846c1b0 0x559c3884e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:56.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.241+0000 7fb68eee2740 1 --2- 172.21.15.1:0/1963239213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c384539f0 0x559c3884dac0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:56.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.241+0000 7fb68eee2740 1 -- 172.21.15.1:0/1963239213 >> 172.21.15.1:0/1963239213 conn(0x559c38489460 msgr2=0x559c38848d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:56.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.241+0000 7fb68eee2740 1 -- 172.21.15.1:0/1963239213 shutdown_connections 2024-09-21T00:57:56.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.241+0000 7fb68eee2740 1 -- 172.21.15.1:0/1963239213 wait complete. 2024-09-21T00:57:56.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.241+0000 7fb68eee2740 20 client.25390 trim_cache size 0 max 16384 2024-09-21T00:57:56.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.242+0000 7fb68896e640 1 -- 172.21.15.1:0/1771789433 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb66c0b6620 msgr2=0x7fb66c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:56.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.242+0000 7fb68896e640 1 --2- 172.21.15.1:0/1771789433 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb66c0b6620 0x7fb66c0b8b30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb67c009370 tx=0x7fb67c009440 comp rx=0 tx=0).stop 2024-09-21T00:57:56.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.242+0000 7fb68896e640 1 -- 172.21.15.1:0/1771789433 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb684102090 msgr2=0x7fb68419a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:56.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.242+0000 7fb68896e640 1 --2- 172.21.15.1:0/1771789433 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb684102090 0x7fb68419a580 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb67402a930 tx=0x7fb674003b90 comp rx=0 tx=0).stop 2024-09-21T00:57:56.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.242+0000 7fb68896e640 1 -- 172.21.15.1:0/1771789433 shutdown_connections 2024-09-21T00:57:56.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.242+0000 7fb68896e640 1 --2- 172.21.15.1:0/1771789433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb684106bd0 0x7fb68419fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:56.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.242+0000 7fb68896e640 1 --2- 172.21.15.1:0/1771789433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb684106280 0x7fb68419ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:56.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.242+0000 7fb68896e640 1 --2- 172.21.15.1:0/1771789433 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb66c0b6620 0x7fb66c0b8b30 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:56.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.242+0000 7fb68896e640 1 --2- 172.21.15.1:0/1771789433 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb684102090 0x7fb68419a580 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:56.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.242+0000 7fb68896e640 1 -- 172.21.15.1:0/1771789433 >> 172.21.15.1:0/1771789433 conn(0x7fb684077c60 msgr2=0x7fb684107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:56.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.242+0000 7fb68896e640 1 -- 172.21.15.1:0/1771789433 shutdown_connections 2024-09-21T00:57:56.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:56.242+0000 7fb68896e640 1 -- 172.21.15.1:0/1771789433 wait complete. 2024-09-21T00:57:56.956 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T00:57:57.248 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:57.667 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:57 smithi001 ceph-mon[31211]: pgmap v380: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-21T00:57:57.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.809+0000 7f05c6747640 1 -- 172.21.15.1:0/1491187164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05c01084b0 msgr2=0x7f05c010ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:57.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.809+0000 7f05c6747640 1 --2- 172.21.15.1:0/1491187164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05c01084b0 0x7f05c010ece0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f05b8009ca0 tx=0x7f05b802a8c0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.809+0000 7f05c6747640 1 -- 172.21.15.1:0/1491187164 shutdown_connections 2024-09-21T00:57:57.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.809+0000 7f05c6747640 1 --2- 172.21.15.1:0/1491187164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05c01084b0 0x7f05c010ece0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.809+0000 7f05c6747640 1 --2- 172.21.15.1:0/1491187164 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05c0107b60 0x7f05c0107f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.809+0000 7f05c6747640 1 --2- 172.21.15.1:0/1491187164 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05c0102220 0x7f05c0102630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.809+0000 7f05c6747640 1 -- 172.21.15.1:0/1491187164 >> 172.21.15.1:0/1491187164 conn(0x7f05c0077cc0 msgr2=0x7f05c0078100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:57.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.810+0000 7f05c6747640 1 -- 172.21.15.1:0/1491187164 shutdown_connections 2024-09-21T00:57:57.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.810+0000 7f05c6747640 1 -- 172.21.15.1:0/1491187164 wait complete. 2024-09-21T00:57:57.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.811+0000 7f05c6747640 1 Processor -- start 2024-09-21T00:57:57.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.811+0000 7f05c6747640 1 -- start start 2024-09-21T00:57:57.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.811+0000 7f05c6747640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05c0102220 0x7f05c0110450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:57.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.811+0000 7f05c6747640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05c0107b60 0x7f05c0110990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:57.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.811+0000 7f05c6747640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05c01084b0 0x7f05c0110ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:57.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.811+0000 7f05bffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05c0102220 0x7f05c0110450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:57.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.811+0000 7f05bffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05c0102220 0x7f05c0110450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47702/0 (socket says 172.21.15.1:47702) 2024-09-21T00:57:57.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.811+0000 7f05c6747640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f05c0113ad0 con 0x7f05c0102220 2024-09-21T00:57:57.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.811+0000 7f05bffff640 1 -- 172.21.15.1:0/1994675898 learned_addr learned my addr 172.21.15.1:0/1994675898 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:57.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.811+0000 7f05c6747640 1 -- 172.21.15.1:0/1994675898 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f05c0113950 con 0x7f05c0107b60 2024-09-21T00:57:57.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.811+0000 7f05c6747640 1 -- 172.21.15.1:0/1994675898 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f05c0113c50 con 0x7f05c01084b0 2024-09-21T00:57:57.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.812+0000 7f05bf7fe640 1 --2- 172.21.15.1:0/1994675898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05c0107b60 0x7f05c0110990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:57.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.812+0000 7f05c4ce4640 1 --2- 172.21.15.1:0/1994675898 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05c01084b0 0x7f05c0110ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:57.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.812+0000 7f05bf7fe640 1 -- 172.21.15.1:0/1994675898 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05c01084b0 msgr2=0x7f05c0110ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:57.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.812+0000 7f05bf7fe640 1 --2- 172.21.15.1:0/1994675898 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05c01084b0 0x7f05c0110ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.812+0000 7f05bf7fe640 1 -- 172.21.15.1:0/1994675898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05c0102220 msgr2=0x7f05c0110450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:57.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.812+0000 7f05bf7fe640 1 --2- 172.21.15.1:0/1994675898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05c0102220 0x7f05c0110450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.812+0000 7f05bf7fe640 1 -- 172.21.15.1:0/1994675898 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c01a8740 con 0x7f05c0107b60 2024-09-21T00:57:57.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.812+0000 7f05bf7fe640 1 --2- 172.21.15.1:0/1994675898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05c0107b60 0x7f05c0110990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f05c0075b40 tx=0x7f05b400db30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:57.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.813+0000 7f05bd7fa640 1 -- 172.21.15.1:0/1994675898 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b4017070 con 0x7f05c0107b60 2024-09-21T00:57:57.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.813+0000 7f05bd7fa640 1 -- 172.21.15.1:0/1994675898 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05b4009820 con 0x7f05c0107b60 2024-09-21T00:57:57.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.813+0000 7f05c6747640 1 -- 172.21.15.1:0/1994675898 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05c01a8a30 con 0x7f05c0107b60 2024-09-21T00:57:57.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.813+0000 7f05c6747640 1 -- 172.21.15.1:0/1994675898 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05c01a8f00 con 0x7f05c0107b60 2024-09-21T00:57:57.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.813+0000 7f05bd7fa640 1 -- 172.21.15.1:0/1994675898 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b4004b90 con 0x7f05c0107b60 2024-09-21T00:57:57.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.817+0000 7f05cccbb740 1 Processor -- start 2024-09-21T00:57:57.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.817+0000 7f05bd7fa640 1 -- 172.21.15.1:0/1994675898 <== mon.2 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 154562+0+0 (secure 0 0 0) 0x7f05b4010460 con 0x7f05c0107b60 2024-09-21T00:57:57.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.817+0000 7f05cccbb740 1 -- start start 2024-09-21T00:57:57.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.817+0000 7f05cccbb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561e8fa6a070 0x561e8fe116a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:57.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.817+0000 7f05cccbb740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561e8fa411b0 0x561e8fe11be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:57.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.817+0000 7f05cccbb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e8fa49390 0x561e8fe12120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:57.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.817+0000 7f05cccbb740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561e8fd87ea0 con 0x561e8fa411b0 2024-09-21T00:57:57.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.817+0000 7f05cccbb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561e8fd772d0 con 0x561e8fa49390 2024-09-21T00:57:57.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.817+0000 7f05cccbb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x561e8fd7b0e0 con 0x561e8fa6a070 2024-09-21T00:57:57.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.818+0000 7f05bffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561e8fa411b0 0x561e8fe11be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:57.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.818+0000 7f05bffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561e8fa411b0 0x561e8fe11be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47716/0 (socket says 172.21.15.1:47716) 2024-09-21T00:57:57.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.818+0000 7f05bffff640 1 -- 172.21.15.1:0/2732773302 learned_addr learned my addr 172.21.15.1:0/2732773302 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:57.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.818+0000 7f05bf7fe640 1 --2- 172.21.15.1:0/2732773302 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e8fa49390 0x561e8fe12120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:57.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.818+0000 7f05c4ce4640 1 --2- 172.21.15.1:0/2732773302 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561e8fa6a070 0x561e8fe116a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:57.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.818+0000 7f05bf7fe640 1 -- 172.21.15.1:0/2732773302 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561e8fa6a070 msgr2=0x561e8fe116a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:57.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.818+0000 7f05bf7fe640 1 --2- 172.21.15.1:0/2732773302 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561e8fa6a070 0x561e8fe116a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.818+0000 7f05bf7fe640 1 -- 172.21.15.1:0/2732773302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561e8fa411b0 msgr2=0x561e8fe11be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:57.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.818+0000 7f05bf7fe640 1 --2- 172.21.15.1:0/2732773302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561e8fa411b0 0x561e8fe11be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.818+0000 7f05bf7fe640 1 -- 172.21.15.1:0/2732773302 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e8fad5650 con 0x561e8fa49390 2024-09-21T00:57:57.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.818+0000 7f05bffff640 1 --2- 172.21.15.1:0/2732773302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561e8fa411b0 0x561e8fe11be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:57.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.818+0000 7f05bf7fe640 1 --2- 172.21.15.1:0/2732773302 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e8fa49390 0x561e8fe12120 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f05b40e45c0 tx=0x7f05b40ef790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcda7823a2a49970 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:57.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.819+0000 7f05a67fc640 1 -- 172.21.15.1:0/2732773302 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b40ed850 con 0x561e8fa49390 2024-09-21T00:57:57.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.819+0000 7f05a67fc640 1 -- 172.21.15.1:0/2732773302 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05b40f4070 con 0x561e8fa49390 2024-09-21T00:57:57.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.819+0000 7f05a67fc640 1 -- 172.21.15.1:0/2732773302 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b40f9da0 con 0x561e8fa49390 2024-09-21T00:57:57.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.820+0000 7f05bd7fa640 1 --2- 172.21.15.1:0/1994675898 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f05a80b6620 0x7f05a80b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:57.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.820+0000 7f05c4ce4640 1 --2- 172.21.15.1:0/1994675898 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f05a80b6620 0x7f05a80b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:57.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.820+0000 7f05bd7fa640 1 -- 172.21.15.1:0/1994675898 <== mon.2 v2:172.21.15.42:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f05b40e6c30 con 0x7f05c0107b60 2024-09-21T00:57:57.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.820+0000 7f05cccbb740 1 -- 172.21.15.1:0/2732773302 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e8fa49390 msgr2=0x561e8fe12120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:57.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.820+0000 7f05cccbb740 1 --2- 172.21.15.1:0/2732773302 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e8fa49390 0x561e8fe12120 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f05b40e45c0 tx=0x7f05b40ef790 comp rx=0 tx=0).stop 2024-09-21T00:57:57.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.821+0000 7f05c4ce4640 1 --2- 172.21.15.1:0/1994675898 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f05a80b6620 0x7f05a80b8b30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f05b8006010 tx=0x7f05b80093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:57.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.821+0000 7f05cccbb740 1 -- 172.21.15.1:0/2732773302 shutdown_connections 2024-09-21T00:57:57.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.821+0000 7f05cccbb740 1 --2- 172.21.15.1:0/2732773302 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e8fa49390 0x561e8fe12120 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.821+0000 7f05cccbb740 1 --2- 172.21.15.1:0/2732773302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561e8fa411b0 0x561e8fe11be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.821+0000 7f05cccbb740 1 --2- 172.21.15.1:0/2732773302 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561e8fa6a070 0x561e8fe116a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.821+0000 7f05cccbb740 1 -- 172.21.15.1:0/2732773302 >> 172.21.15.1:0/2732773302 conn(0x561e8fa5e460 msgr2=0x561e8fe0f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:57.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.821+0000 7f05cccbb740 1 -- 172.21.15.1:0/2732773302 shutdown_connections 2024-09-21T00:57:57.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.821+0000 7f05cccbb740 1 -- 172.21.15.1:0/2732773302 wait complete. 2024-09-21T00:57:57.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.821+0000 7f05cccbb740 1 -- start start 2024-09-21T00:57:57.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.822+0000 7f05cccbb740 1 Processor -- start 2024-09-21T00:57:57.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.822+0000 7f05cccbb740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561e8fa411b0 0x561e8fe1cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:57.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.822+0000 7f05cccbb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561e8fa49390 0x561e8fe1d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:57.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.822+0000 7f05cccbb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e8fa6a070 0x561e8fe31a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:57.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.822+0000 7f05cccbb740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561e8fbd8700 con 0x561e8fa411b0 2024-09-21T00:57:57.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.822+0000 7f05cccbb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561e8fd12160 con 0x561e8fa6a070 2024-09-21T00:57:57.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.822+0000 7f05cccbb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x561e8fe1fe80 con 0x561e8fa49390 2024-09-21T00:57:57.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.822+0000 7f05cccbb740 10 client.0 _ll_register_callbacks cb 0x561e8fd2b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:57.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.822+0000 7f05bffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561e8fa411b0 0x561e8fe1cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:57.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.823+0000 7f05bffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561e8fa411b0 0x561e8fe1cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47728/0 (socket says 172.21.15.1:47728) 2024-09-21T00:57:57.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.823+0000 7f05bffff640 1 -- 172.21.15.1:0/3935229847 learned_addr learned my addr 172.21.15.1:0/3935229847 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:57.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.823+0000 7f05bf7fe640 1 --2- 172.21.15.1:0/3935229847 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561e8fa49390 0x561e8fe1d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:57.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.823+0000 7f05c4ce4640 1 --2- 172.21.15.1:0/3935229847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e8fa6a070 0x561e8fe31a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:57.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.823+0000 7f05bf7fe640 1 -- 172.21.15.1:0/3935229847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e8fa6a070 msgr2=0x561e8fe31a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:57.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.823+0000 7f05bf7fe640 1 --2- 172.21.15.1:0/3935229847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e8fa6a070 0x561e8fe31a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.823+0000 7f05bf7fe640 1 -- 172.21.15.1:0/3935229847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561e8fa411b0 msgr2=0x561e8fe1cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:57.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.823+0000 7f05bf7fe640 1 --2- 172.21.15.1:0/3935229847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561e8fa411b0 0x561e8fe1cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.823+0000 7f05bf7fe640 1 -- 172.21.15.1:0/3935229847 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e8fd3fc90 con 0x561e8fa49390 2024-09-21T00:57:57.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.823+0000 7f05bffff640 1 --2- 172.21.15.1:0/3935229847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561e8fa411b0 0x561e8fe1cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:57.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.823+0000 7f05bf7fe640 1 --2- 172.21.15.1:0/3935229847 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561e8fa49390 0x561e8fe1d300 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f05b40acbd0 tx=0x7f05b4000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d252680577104a51 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:57.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.823+0000 7f059f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T00:57:57.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.823+0000 7f059f7fe640 1 -- 172.21.15.1:0/3935229847 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b4020070 con 0x561e8fa49390 2024-09-21T00:57:57.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.824+0000 7f059f7fe640 1 -- 172.21.15.1:0/3935229847 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f05b4004d30 con 0x561e8fa49390 2024-09-21T00:57:57.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.824+0000 7f05cccbb740 1 -- 172.21.15.1:0/3935229847 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05b40f4070 con 0x561e8fa49390 2024-09-21T00:57:57.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.824+0000 7f059f7fe640 1 -- 172.21.15.1:0/3935229847 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f05b40a9290 con 0x561e8fa49390 2024-09-21T00:57:57.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.824+0000 7f05cccbb740 10 client.25399 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:57.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.824+0000 7f05cccbb740 1 -- 172.21.15.1:0/3935229847 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561e8fe34430 con 0x561e8fa49390 2024-09-21T00:57:57.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.824+0000 7f059f7fe640 1 -- 172.21.15.1:0/3935229847 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05b40f4070 con 0x561e8fa49390 2024-09-21T00:57:57.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.824+0000 7f059f7fe640 1 -- 172.21.15.1:0/3935229847 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f05b40a8eb0 con 0x561e8fa49390 2024-09-21T00:57:57.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.824+0000 7f05cccbb740 10 client.25399 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:57.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.824+0000 7f05cccbb740 10 client.25399 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T00:57:57.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.824+0000 7f05cccbb740 20 client.25399 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:57.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.825+0000 7f05cccbb740 1 --2- 172.21.15.1:0/3935229847 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x561e8fa289f0 0x561e8fe37790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:57.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.825+0000 7f05cccbb740 4 client.25399 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:57:57.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.825+0000 7f05cccbb740 1 -- 172.21.15.1:0/3935229847 --> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e8fd89df0 con 0x561e8fa289f0 2024-09-21T00:57:57.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.825+0000 7f05bffff640 1 --2- 172.21.15.1:0/3935229847 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x561e8fa289f0 0x561e8fe37790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:57.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.825+0000 7f059f7fe640 10 client.25399 ms_handle_connect on v2:172.21.15.193:6838/1365361177 2024-09-21T00:57:57.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.825+0000 7f05bffff640 1 --2- 172.21.15.1:0/3935229847 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x561e8fa289f0 0x561e8fe37790 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d82bf347fa35990a server_cookie=fce320d05376034e in_seq=0 out_seq=0 2024-09-21T00:57:57.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.827+0000 7f059f7fe640 1 -- 172.21.15.1:0/3935229847 <== mds.1 v2:172.21.15.193:6838/1365361177 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561e8fd89df0 con 0x561e8fa289f0 2024-09-21T00:57:57.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.827+0000 7f059f7fe640 10 client.25399 handle_command_reply: tid=0 2024-09-21T00:57:57.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.827+0000 7f05cccbb740 1 client.25399 shutdown 2024-09-21T00:57:57.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.827+0000 7f05cccbb740 1 -- 172.21.15.1:0/3935229847 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561e8fa49390 msgr2=0x561e8fe1d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:57.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.827+0000 7f05cccbb740 1 --2- 172.21.15.1:0/3935229847 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561e8fa49390 0x561e8fe1d300 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f05b40acbd0 tx=0x7f05b4000bc0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.827+0000 7f05cccbb740 1 -- 172.21.15.1:0/3935229847 shutdown_connections 2024-09-21T00:57:57.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.827+0000 7f05cccbb740 1 --2- 172.21.15.1:0/3935229847 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x561e8fa289f0 0x561e8fe37790 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.827+0000 7f059f7fe640 0 client.25399 ms_handle_reset on v2:172.21.15.193:6838/1365361177 2024-09-21T00:57:57.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.827+0000 7f05cccbb740 1 --2- 172.21.15.1:0/3935229847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e8fa6a070 0x561e8fe31a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.827+0000 7f05cccbb740 1 --2- 172.21.15.1:0/3935229847 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561e8fa49390 0x561e8fe1d300 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.827+0000 7f05cccbb740 1 --2- 172.21.15.1:0/3935229847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561e8fa411b0 0x561e8fe1cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.827+0000 7f05cccbb740 1 -- 172.21.15.1:0/3935229847 >> 172.21.15.1:0/3935229847 conn(0x561e8fa5e460 msgr2=0x561e8fe14830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:57.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.827+0000 7f05cccbb740 1 -- 172.21.15.1:0/3935229847 shutdown_connections 2024-09-21T00:57:57.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.827+0000 7f05cccbb740 1 -- 172.21.15.1:0/3935229847 wait complete. 2024-09-21T00:57:57.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.827+0000 7f05cccbb740 20 client.25399 trim_cache size 0 max 16384 2024-09-21T00:57:57.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.853+0000 7f05cccbb740 1 Processor -- start 2024-09-21T00:57:57.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.853+0000 7f05cccbb740 1 -- start start 2024-09-21T00:57:57.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.854+0000 7f05cccbb740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561e8fa289f0 0x561e8fe1d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:57.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.854+0000 7f05bffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561e8fa289f0 0x561e8fe1d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:57.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.854+0000 7f05bffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561e8fa289f0 0x561e8fe1d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47742/0 (socket says 172.21.15.1:47742) 2024-09-21T00:57:57.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.854+0000 7f05bffff640 1 -- 172.21.15.1:0/2549343007 learned_addr learned my addr 172.21.15.1:0/2549343007 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:57.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.854+0000 7f05cccbb740 1 --2- 172.21.15.1:0/2549343007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e8fa411b0 0x561e8fe31a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:57.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.854+0000 7f05cccbb740 1 --2- 172.21.15.1:0/2549343007 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561e8fa49390 0x561e8fe19fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:57.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.854+0000 7f05cccbb740 1 -- 172.21.15.1:0/2549343007 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f05ac00e4a0 con 0x561e8fa289f0 2024-09-21T00:57:57.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.854+0000 7f05cccbb740 1 -- 172.21.15.1:0/2549343007 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f05ac00ffe0 con 0x561e8fa411b0 2024-09-21T00:57:57.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.854+0000 7f05cccbb740 1 -- 172.21.15.1:0/2549343007 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f05ac00eb70 con 0x561e8fa49390 2024-09-21T00:57:57.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.855+0000 7f05bf7fe640 1 --2- 172.21.15.1:0/2549343007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e8fa411b0 0x561e8fe31a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:57.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.855+0000 7f05c4ce4640 1 --2- 172.21.15.1:0/2549343007 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561e8fa49390 0x561e8fe19fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:57.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.855+0000 7f05bffff640 1 -- 172.21.15.1:0/2549343007 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561e8fa49390 msgr2=0x561e8fe19fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:57.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.855+0000 7f05bffff640 1 --2- 172.21.15.1:0/2549343007 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561e8fa49390 0x561e8fe19fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.855+0000 7f05bffff640 1 -- 172.21.15.1:0/2549343007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e8fa411b0 msgr2=0x561e8fe31a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:57.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.855+0000 7f05bffff640 1 --2- 172.21.15.1:0/2549343007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e8fa411b0 0x561e8fe31a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.855+0000 7f05bffff640 1 -- 172.21.15.1:0/2549343007 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e8fe1de60 con 0x561e8fa289f0 2024-09-21T00:57:57.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.855+0000 7f05bffff640 1 --2- 172.21.15.1:0/2549343007 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561e8fa289f0 0x561e8fe1d280 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f05b0004040 tx=0x7f05b0004500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea8d6e642c98703 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:57.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.856+0000 7f05a5ffb640 1 -- 172.21.15.1:0/2549343007 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b0021040 con 0x561e8fa289f0 2024-09-21T00:57:57.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.856+0000 7f05a5ffb640 1 -- 172.21.15.1:0/2549343007 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05b0012a00 con 0x561e8fa289f0 2024-09-21T00:57:57.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.856+0000 7f05a5ffb640 1 -- 172.21.15.1:0/2549343007 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b001fae0 con 0x561e8fa289f0 2024-09-21T00:57:57.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.857+0000 7f05cccbb740 1 -- 172.21.15.1:0/2549343007 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561e8fa289f0 msgr2=0x561e8fe1d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:57.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.857+0000 7f05cccbb740 1 --2- 172.21.15.1:0/2549343007 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561e8fa289f0 0x561e8fe1d280 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f05b0004040 tx=0x7f05b0004500 comp rx=0 tx=0).stop 2024-09-21T00:57:57.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.857+0000 7f05cccbb740 1 -- 172.21.15.1:0/2549343007 shutdown_connections 2024-09-21T00:57:57.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.857+0000 7f05cccbb740 1 --2- 172.21.15.1:0/2549343007 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561e8fa49390 0x561e8fe19fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.857+0000 7f05cccbb740 1 --2- 172.21.15.1:0/2549343007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e8fa411b0 0x561e8fe31a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.857+0000 7f05cccbb740 1 --2- 172.21.15.1:0/2549343007 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561e8fa289f0 0x561e8fe1d280 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.858+0000 7f05cccbb740 1 -- 172.21.15.1:0/2549343007 >> 172.21.15.1:0/2549343007 conn(0x561e8fa5e460 msgr2=0x561e8fe1cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:57.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.858+0000 7f05cccbb740 1 -- 172.21.15.1:0/2549343007 shutdown_connections 2024-09-21T00:57:57.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.858+0000 7f05cccbb740 1 -- 172.21.15.1:0/2549343007 wait complete. 2024-09-21T00:57:57.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.858+0000 7f05cccbb740 1 -- start start 2024-09-21T00:57:57.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.859+0000 7f05cccbb740 1 Processor -- start 2024-09-21T00:57:57.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.859+0000 7f05cccbb740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561e8fa289f0 0x561e8fe3aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:57.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.860+0000 7f05bffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561e8fa289f0 0x561e8fe3aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:57.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.860+0000 7f05bffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561e8fa289f0 0x561e8fe3aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47750/0 (socket says 172.21.15.1:47750) 2024-09-21T00:57:57.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.860+0000 7f05bffff640 1 -- 172.21.15.1:0/3556786791 learned_addr learned my addr 172.21.15.1:0/3556786791 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:57.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.860+0000 7f05cccbb740 1 --2- 172.21.15.1:0/3556786791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e8fa411b0 0x561e8fe384c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:57.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.860+0000 7f05cccbb740 1 --2- 172.21.15.1:0/3556786791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561e8fa49390 0x561e8fe38a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:57.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.860+0000 7f05cccbb740 1 -- 172.21.15.1:0/3556786791 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f05ac00f910 con 0x561e8fa289f0 2024-09-21T00:57:57.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.860+0000 7f05cccbb740 1 -- 172.21.15.1:0/3556786791 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f05ac00f240 con 0x561e8fa411b0 2024-09-21T00:57:57.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.860+0000 7f05bf7fe640 1 --2- 172.21.15.1:0/3556786791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e8fa411b0 0x561e8fe384c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:57.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.860+0000 7f05cccbb740 1 -- 172.21.15.1:0/3556786791 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f05ac00c480 con 0x561e8fa49390 2024-09-21T00:57:57.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.860+0000 7f05c4ce4640 1 --2- 172.21.15.1:0/3556786791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561e8fa49390 0x561e8fe38a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:57.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.860+0000 7f05cccbb740 10 client.0 _ll_register_callbacks cb 0x7f05b000b500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:57.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.861+0000 7f05bf7fe640 1 -- 172.21.15.1:0/3556786791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561e8fa49390 msgr2=0x561e8fe38a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:57.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.861+0000 7f05bf7fe640 1 --2- 172.21.15.1:0/3556786791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561e8fa49390 0x561e8fe38a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.861+0000 7f05bf7fe640 1 -- 172.21.15.1:0/3556786791 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561e8fa289f0 msgr2=0x561e8fe3aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:57.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.861+0000 7f05bf7fe640 1 --2- 172.21.15.1:0/3556786791 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561e8fa289f0 0x561e8fe3aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.861+0000 7f05bf7fe640 1 -- 172.21.15.1:0/3556786791 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e8fe391d0 con 0x561e8fa411b0 2024-09-21T00:57:57.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.861+0000 7f05bf7fe640 1 --2- 172.21.15.1:0/3556786791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e8fa411b0 0x561e8fe384c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f05b40e4b40 tx=0x7f05b40b6660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52c3aef38f188861 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:57.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.861+0000 7f059f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T00:57:57.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.861+0000 7f059f7fe640 1 -- 172.21.15.1:0/3556786791 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b4020070 con 0x561e8fa411b0 2024-09-21T00:57:57.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.861+0000 7f059f7fe640 1 -- 172.21.15.1:0/3556786791 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f05b40d00b0 con 0x561e8fa411b0 2024-09-21T00:57:57.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.861+0000 7f05cccbb740 1 -- 172.21.15.1:0/3556786791 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05b0012a00 con 0x561e8fa411b0 2024-09-21T00:57:57.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.862+0000 7f059f7fe640 1 -- 172.21.15.1:0/3556786791 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f05b40a83b0 con 0x561e8fa411b0 2024-09-21T00:57:57.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.862+0000 7f05cccbb740 10 client.25472 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:57.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.862+0000 7f05cccbb740 1 -- 172.21.15.1:0/3556786791 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561e8fe391d0 con 0x561e8fa411b0 2024-09-21T00:57:57.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.862+0000 7f059f7fe640 1 -- 172.21.15.1:0/3556786791 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05b0012a00 con 0x561e8fa411b0 2024-09-21T00:57:57.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.862+0000 7f059f7fe640 1 -- 172.21.15.1:0/3556786791 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f05b40e4bd0 con 0x561e8fa411b0 2024-09-21T00:57:57.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.862+0000 7f05cccbb740 10 client.25472 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:57.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.862+0000 7f05cccbb740 10 client.25472 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T00:57:57.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.863+0000 7f05cccbb740 20 client.25472 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:57.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.863+0000 7f05cccbb740 1 --2- 172.21.15.1:0/3556786791 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x561e8fa6a070 0x561e8fea4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:57.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.863+0000 7f05cccbb740 4 client.25472 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:57:57.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.863+0000 7f05cccbb740 1 -- 172.21.15.1:0/3556786791 --> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561e8fd858a0 con 0x561e8fa6a070 2024-09-21T00:57:57.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.863+0000 7f05bffff640 1 --2- 172.21.15.1:0/3556786791 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x561e8fa6a070 0x561e8fea4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:57.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.864+0000 7f05bffff640 1 --2- 172.21.15.1:0/3556786791 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x561e8fa6a070 0x561e8fea4200 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f7324e75b2b4dfcf server_cookie=2f80899d8194140d in_seq=0 out_seq=0 2024-09-21T00:57:57.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.864+0000 7f059f7fe640 10 client.25472 ms_handle_connect on v2:172.21.15.193:6838/1365361177 2024-09-21T00:57:57.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.864+0000 7f059f7fe640 1 -- 172.21.15.1:0/3556786791 <== mds.1 v2:172.21.15.193:6838/1365361177 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561e8fd858a0 con 0x561e8fa6a070 2024-09-21T00:57:57.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.864+0000 7f059f7fe640 10 client.25472 handle_command_reply: tid=0 2024-09-21T00:57:57.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.864+0000 7f05cccbb740 1 client.25472 shutdown 2024-09-21T00:57:57.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.864+0000 7f05cccbb740 1 -- 172.21.15.1:0/3556786791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e8fa411b0 msgr2=0x561e8fe384c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:57.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.864+0000 7f05cccbb740 1 --2- 172.21.15.1:0/3556786791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e8fa411b0 0x561e8fe384c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f05b40e4b40 tx=0x7f05b40b6660 comp rx=0 tx=0).stop 2024-09-21T00:57:57.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.864+0000 7f05cccbb740 1 -- 172.21.15.1:0/3556786791 shutdown_connections 2024-09-21T00:57:57.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.865+0000 7f05cccbb740 1 --2- 172.21.15.1:0/3556786791 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x561e8fa6a070 0x561e8fea4200 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.865+0000 7f05cccbb740 1 --2- 172.21.15.1:0/3556786791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561e8fa49390 0x561e8fe38a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.865+0000 7f059f7fe640 0 client.25472 ms_handle_reset on v2:172.21.15.193:6838/1365361177 2024-09-21T00:57:57.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.865+0000 7f05cccbb740 1 --2- 172.21.15.1:0/3556786791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e8fa411b0 0x561e8fe384c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.865+0000 7f05cccbb740 1 --2- 172.21.15.1:0/3556786791 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561e8fa289f0 0x561e8fe3aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.865+0000 7f05cccbb740 1 -- 172.21.15.1:0/3556786791 >> 172.21.15.1:0/3556786791 conn(0x561e8fa5e460 msgr2=0x561e8fe1b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:57.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.865+0000 7f05cccbb740 1 -- 172.21.15.1:0/3556786791 shutdown_connections 2024-09-21T00:57:57.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.865+0000 7f05cccbb740 1 -- 172.21.15.1:0/3556786791 wait complete. 2024-09-21T00:57:57.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.865+0000 7f05cccbb740 20 client.25472 trim_cache size 0 max 16384 2024-09-21T00:57:57.869 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T00:57:57.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.866+0000 7f05c6747640 1 -- 172.21.15.1:0/1994675898 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f05a80b6620 msgr2=0x7f05a80b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:57.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.866+0000 7f05c6747640 1 --2- 172.21.15.1:0/1994675898 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f05a80b6620 0x7f05a80b8b30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f05b8006010 tx=0x7f05b80093f0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.866+0000 7f05c6747640 1 -- 172.21.15.1:0/1994675898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05c0107b60 msgr2=0x7f05c0110990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:57.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.866+0000 7f05c6747640 1 --2- 172.21.15.1:0/1994675898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05c0107b60 0x7f05c0110990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f05c0075b40 tx=0x7f05b400db30 comp rx=0 tx=0).stop 2024-09-21T00:57:57.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.866+0000 7f05c6747640 1 -- 172.21.15.1:0/1994675898 shutdown_connections 2024-09-21T00:57:57.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.866+0000 7f05c6747640 1 --2- 172.21.15.1:0/1994675898 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05c01084b0 0x7f05c0110ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.866+0000 7f05c6747640 1 --2- 172.21.15.1:0/1994675898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05c0107b60 0x7f05c0110990 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.866+0000 7f05c6747640 1 --2- 172.21.15.1:0/1994675898 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f05a80b6620 0x7f05a80b8b30 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.866+0000 7f05c6747640 1 --2- 172.21.15.1:0/1994675898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05c0102220 0x7f05c0110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.867+0000 7f05c6747640 1 -- 172.21.15.1:0/1994675898 >> 172.21.15.1:0/1994675898 conn(0x7f05c0077cc0 msgr2=0x7f05c0103b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:57.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.867+0000 7f05c6747640 1 -- 172.21.15.1:0/1994675898 shutdown_connections 2024-09-21T00:57:57.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:57.867+0000 7f05c6747640 1 -- 172.21.15.1:0/1994675898 wait complete. 2024-09-21T00:57:57.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:57 smithi193 ceph-mon[34660]: pgmap v380: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-21T00:57:57.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:57 smithi042 ceph-mon[34481]: pgmap v380: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-21T00:57:58.926 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T00:57:59.306 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:59.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:59 smithi001 ceph-mon[31211]: pgmap v381: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-21T00:57:59.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:57:59 smithi001 ceph-mon[31211]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-21T00:57:59.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.885+0000 7f4ab7a4c640 1 -- 172.21.15.1:0/2471433615 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ab0103b80 msgr2=0x7f4ab0103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:59.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.885+0000 7f4ab7a4c640 1 --2- 172.21.15.1:0/2471433615 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ab0103b80 0x7f4ab0103f90 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4aac009900 tx=0x7f4aac02a410 comp rx=0 tx=0).stop 2024-09-21T00:57:59.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.885+0000 7f4ab7a4c640 1 -- 172.21.15.1:0/2471433615 shutdown_connections 2024-09-21T00:57:59.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.885+0000 7f4ab7a4c640 1 --2- 172.21.15.1:0/2471433615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ab0109e10 0x7f4ab0110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.885+0000 7f4ab7a4c640 1 --2- 172.21.15.1:0/2471433615 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4ab01094c0 0x7f4ab01098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.885+0000 7f4ab7a4c640 1 --2- 172.21.15.1:0/2471433615 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ab0103b80 0x7f4ab0103f90 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.885+0000 7f4ab7a4c640 1 -- 172.21.15.1:0/2471433615 >> 172.21.15.1:0/2471433615 conn(0x7f4ab00ff5b0 msgr2=0x7f4ab0101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:59.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.885+0000 7f4ab7a4c640 1 -- 172.21.15.1:0/2471433615 shutdown_connections 2024-09-21T00:57:59.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.885+0000 7f4ab7a4c640 1 -- 172.21.15.1:0/2471433615 wait complete. 2024-09-21T00:57:59.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.886+0000 7f4ab7a4c640 1 Processor -- start 2024-09-21T00:57:59.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.886+0000 7f4ab7a4c640 1 -- start start 2024-09-21T00:57:59.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.887+0000 7f4ab7a4c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ab0103b80 0x7f4ab0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:59.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.887+0000 7f4ab7a4c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4ab01094c0 0x7f4ab0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:59.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.887+0000 7f4ab7a4c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ab0109e10 0x7f4ab0076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:59.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.887+0000 7f4ab57e8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ab0103b80 0x7f4ab0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:59.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.887+0000 7f4ab4fe7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4ab01094c0 0x7f4ab0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:59.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.887+0000 7f4ab7a4c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab0113b20 con 0x7f4ab0103b80 2024-09-21T00:57:59.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.887+0000 7f4ab7a4c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab01139a0 con 0x7f4ab0109e10 2024-09-21T00:57:59.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.887+0000 7f4ab7a4c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab0113ca0 con 0x7f4ab01094c0 2024-09-21T00:57:59.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.887+0000 7f4ab57e8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ab0103b80 0x7f4ab0075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58964/0 (socket says 172.21.15.1:58964) 2024-09-21T00:57:59.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.887+0000 7f4ab4fe7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4ab01094c0 0x7f4ab0075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:54012/0 (socket says 172.21.15.1:54012) 2024-09-21T00:57:59.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.887+0000 7f4ab57e8640 1 -- 172.21.15.1:0/1457915360 learned_addr learned my addr 172.21.15.1:0/1457915360 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:59.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.887+0000 7f4ab5fe9640 1 --2- 172.21.15.1:0/1457915360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ab0109e10 0x7f4ab0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:59.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.887+0000 7f4ab57e8640 1 -- 172.21.15.1:0/1457915360 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4ab01094c0 msgr2=0x7f4ab0075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:59.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.887+0000 7f4ab57e8640 1 --2- 172.21.15.1:0/1457915360 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4ab01094c0 0x7f4ab0075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.887+0000 7f4ab57e8640 1 -- 172.21.15.1:0/1457915360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ab0109e10 msgr2=0x7f4ab0076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:59.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.887+0000 7f4ab57e8640 1 --2- 172.21.15.1:0/1457915360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ab0109e10 0x7f4ab0076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.888+0000 7f4ab57e8640 1 -- 172.21.15.1:0/1457915360 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ab01a8700 con 0x7f4ab0103b80 2024-09-21T00:57:59.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.888+0000 7f4ab5fe9640 1 --2- 172.21.15.1:0/1457915360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ab0109e10 0x7f4ab0076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:57:59.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.888+0000 7f4ab57e8640 1 --2- 172.21.15.1:0/1457915360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ab0103b80 0x7f4ab0075710 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4aac005ab0 tx=0x7f4aac003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:59.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.888+0000 7f4aa67fc640 1 -- 172.21.15.1:0/1457915360 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aac03f070 con 0x7f4ab0103b80 2024-09-21T00:57:59.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.888+0000 7f4ab7a4c640 1 -- 172.21.15.1:0/1457915360 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ab01a8990 con 0x7f4ab0103b80 2024-09-21T00:57:59.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.888+0000 7f4aa67fc640 1 -- 172.21.15.1:0/1457915360 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4aac031d60 con 0x7f4ab0103b80 2024-09-21T00:57:59.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.888+0000 7f4aa67fc640 1 -- 172.21.15.1:0/1457915360 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aac035030 con 0x7f4ab0103b80 2024-09-21T00:57:59.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.888+0000 7f4ab7a4c640 1 -- 172.21.15.1:0/1457915360 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ab01a8ec0 con 0x7f4ab0103b80 2024-09-21T00:57:59.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.892+0000 7f4abdfc0740 1 Processor -- start 2024-09-21T00:57:59.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.892+0000 7f4aa67fc640 1 -- 172.21.15.1:0/1457915360 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f4aac042070 con 0x7f4ab0103b80 2024-09-21T00:57:59.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.893+0000 7f4abdfc0740 1 -- start start 2024-09-21T00:57:59.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.893+0000 7f4abdfc0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e50e2c070 0x558e511d36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:59.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.894+0000 7f4abdfc0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e50e031b0 0x558e511d3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:59.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.894+0000 7f4aa67fc640 1 --2- 172.21.15.1:0/1457915360 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4a9c0b6590 0x7f4a9c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:59.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.894+0000 7f4ab5fe9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e50e2c070 0x558e511d36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:59.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.894+0000 7f4ab5fe9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e50e2c070 0x558e511d36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58974/0 (socket says 172.21.15.1:58974) 2024-09-21T00:57:59.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.894+0000 7f4ab5fe9640 1 -- 172.21.15.1:0/2708921459 learned_addr learned my addr 172.21.15.1:0/2708921459 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:59.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.894+0000 7f4abdfc0740 1 --2- 172.21.15.1:0/2708921459 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e50e0b390 0x558e511d4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:59.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.894+0000 7f4abdfc0740 1 -- 172.21.15.1:0/2708921459 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558e51149ea0 con 0x558e50e2c070 2024-09-21T00:57:59.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.894+0000 7f4abdfc0740 1 -- 172.21.15.1:0/2708921459 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558e511392d0 con 0x558e50e0b390 2024-09-21T00:57:59.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.894+0000 7f4ab4fe7640 1 --2- 172.21.15.1:0/1457915360 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4a9c0b6590 0x7f4a9c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:59.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.894+0000 7f4abdfc0740 1 -- 172.21.15.1:0/2708921459 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558e5113d0e0 con 0x558e50e031b0 2024-09-21T00:57:59.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.894+0000 7f4aa67fc640 1 -- 172.21.15.1:0/1457915360 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f4aac1057f0 con 0x7f4ab0103b80 2024-09-21T00:57:59.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.895+0000 7f4ab5fe9640 1 --2- 172.21.15.1:0/2708921459 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e50e0b390 0x558e511d4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:59.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.895+0000 7f4ab5fe9640 1 -- 172.21.15.1:0/2708921459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e50e031b0 msgr2=0x558e511d3be0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T00:57:59.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.895+0000 7f4ab5fe9640 1 --2- 172.21.15.1:0/2708921459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e50e031b0 0x558e511d3be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.895+0000 7f4ab5fe9640 1 -- 172.21.15.1:0/2708921459 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e50e0b390 msgr2=0x558e511d4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:59.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.895+0000 7f4ab5fe9640 1 --2- 172.21.15.1:0/2708921459 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e50e0b390 0x558e511d4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.895+0000 7f4ab5fe9640 1 -- 172.21.15.1:0/2708921459 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e50e97650 con 0x558e50e2c070 2024-09-21T00:57:59.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.895+0000 7f4ab5fe9640 1 --2- 172.21.15.1:0/2708921459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e50e2c070 0x558e511d36a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8012840 tx=0x7f4aa8007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=733e8f2353564938 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:59.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.895+0000 7f4ab4fe7640 1 --2- 172.21.15.1:0/1457915360 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4a9c0b6590 0x7f4a9c0b8aa0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0102d90 tx=0x7f4aa000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:59.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.895+0000 7f4a9b7fe640 1 -- 172.21.15.1:0/2708921459 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa80120d0 con 0x558e50e2c070 2024-09-21T00:57:59.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.896+0000 7f4a9b7fe640 1 -- 172.21.15.1:0/2708921459 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4aa800ea60 con 0x558e50e2c070 2024-09-21T00:57:59.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.896+0000 7f4a9b7fe640 1 -- 172.21.15.1:0/2708921459 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8003cf0 con 0x558e50e2c070 2024-09-21T00:57:59.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.897+0000 7f4abdfc0740 1 -- 172.21.15.1:0/2708921459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e50e2c070 msgr2=0x558e511d36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:59.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.897+0000 7f4abdfc0740 1 --2- 172.21.15.1:0/2708921459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e50e2c070 0x558e511d36a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8012840 tx=0x7f4aa8007bc0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.897+0000 7f4abdfc0740 1 -- 172.21.15.1:0/2708921459 shutdown_connections 2024-09-21T00:57:59.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.897+0000 7f4abdfc0740 1 --2- 172.21.15.1:0/2708921459 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e50e0b390 0x558e511d4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.897+0000 7f4abdfc0740 1 --2- 172.21.15.1:0/2708921459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e50e031b0 0x558e511d3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.897+0000 7f4abdfc0740 1 --2- 172.21.15.1:0/2708921459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e50e2c070 0x558e511d36a0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.897+0000 7f4abdfc0740 1 -- 172.21.15.1:0/2708921459 >> 172.21.15.1:0/2708921459 conn(0x558e50e20460 msgr2=0x558e511d1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:59.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.897+0000 7f4abdfc0740 1 -- 172.21.15.1:0/2708921459 shutdown_connections 2024-09-21T00:57:59.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.897+0000 7f4abdfc0740 1 -- 172.21.15.1:0/2708921459 wait complete. 2024-09-21T00:57:59.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.898+0000 7f4abdfc0740 1 -- start start 2024-09-21T00:57:59.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.898+0000 7f4abdfc0740 1 Processor -- start 2024-09-21T00:57:59.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.899+0000 7f4abdfc0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e50e031b0 0x558e511dee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:59.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.899+0000 7f4abdfc0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e50e0b390 0x558e511df3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:59.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.899+0000 7f4abdfc0740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e50e2c070 0x558e511eb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:59.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.899+0000 7f4abdfc0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558e50f9a700 con 0x558e50e0b390 2024-09-21T00:57:59.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.899+0000 7f4abdfc0740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558e510d4160 con 0x558e50e2c070 2024-09-21T00:57:59.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.899+0000 7f4abdfc0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558e511e1e80 con 0x558e50e031b0 2024-09-21T00:57:59.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.899+0000 7f4ab4fe7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e50e0b390 0x558e511df3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:59.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.899+0000 7f4ab57e8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e50e031b0 0x558e511dee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:59.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.899+0000 7f4ab57e8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e50e031b0 0x558e511dee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:54028/0 (socket says 172.21.15.1:54028) 2024-09-21T00:57:59.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.899+0000 7f4ab57e8640 1 -- 172.21.15.1:0/537429227 learned_addr learned my addr 172.21.15.1:0/537429227 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:59.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.899+0000 7f4ab5fe9640 1 --2- 172.21.15.1:0/537429227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e50e2c070 0x558e511eb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:59.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.899+0000 7f4abdfc0740 10 client.0 _ll_register_callbacks cb 0x558e510ed9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:59.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.899+0000 7f4ab57e8640 1 -- 172.21.15.1:0/537429227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e50e2c070 msgr2=0x558e511eb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:59.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.899+0000 7f4ab57e8640 1 --2- 172.21.15.1:0/537429227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e50e2c070 0x558e511eb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.900+0000 7f4ab57e8640 1 -- 172.21.15.1:0/537429227 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e50e0b390 msgr2=0x558e511df3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:59.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.900+0000 7f4ab57e8640 1 --2- 172.21.15.1:0/537429227 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e50e0b390 0x558e511df3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.900+0000 7f4ab57e8640 1 -- 172.21.15.1:0/537429227 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e51101c90 con 0x558e50e031b0 2024-09-21T00:57:59.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.900+0000 7f4ab5fe9640 1 --2- 172.21.15.1:0/537429227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e50e2c070 0x558e511eb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:59.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.900+0000 7f4ab4fe7640 1 --2- 172.21.15.1:0/537429227 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e50e0b390 0x558e511df3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:59.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.900+0000 7f4ab57e8640 1 --2- 172.21.15.1:0/537429227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e50e031b0 0x558e511dee90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0cda70 tx=0x7f4aac009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfcbdf6d44467014 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:59.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.900+0000 7f4a98ff9640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T00:57:59.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.900+0000 7f4a98ff9640 1 -- 172.21.15.1:0/537429227 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aac049070 con 0x558e50e031b0 2024-09-21T00:57:59.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.900+0000 7f4a98ff9640 1 -- 172.21.15.1:0/537429227 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f4aac0d5bd0 con 0x558e50e031b0 2024-09-21T00:57:59.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.900+0000 7f4abdfc0740 1 -- 172.21.15.1:0/537429227 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4aa800ea60 con 0x558e50e031b0 2024-09-21T00:57:59.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.901+0000 7f4a98ff9640 1 -- 172.21.15.1:0/537429227 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4aac0cd4e0 con 0x558e50e031b0 2024-09-21T00:57:59.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.901+0000 7f4abdfc0740 10 client.25414 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:59.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.901+0000 7f4abdfc0740 1 -- 172.21.15.1:0/537429227 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558e511edc30 con 0x558e50e031b0 2024-09-21T00:57:59.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.901+0000 7f4a98ff9640 1 -- 172.21.15.1:0/537429227 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4aa800ea60 con 0x558e50e031b0 2024-09-21T00:57:59.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.901+0000 7f4a98ff9640 1 -- 172.21.15.1:0/537429227 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f4aac0f5190 con 0x558e50e031b0 2024-09-21T00:57:59.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.901+0000 7f4abdfc0740 10 client.25414 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:59.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.901+0000 7f4abdfc0740 10 client.25414 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:57:59.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.902+0000 7f4abdfc0740 20 client.25414 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:59.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.902+0000 7f4abdfc0740 1 --2- 172.21.15.1:0/537429227 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558e50dea9f0 0x558e511f11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:59.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.902+0000 7f4abdfc0740 4 client.25414 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:57:59.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.902+0000 7f4abdfc0740 1 -- 172.21.15.1:0/537429227 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e5114bdf0 con 0x558e50dea9f0 2024-09-21T00:57:59.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.902+0000 7f4ab4fe7640 1 --2- 172.21.15.1:0/537429227 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558e50dea9f0 0x558e511f11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:59.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.903+0000 7f4ab4fe7640 1 --2- 172.21.15.1:0/537429227 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558e50dea9f0 0x558e511f11a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c663407422af5984 server_cookie=c3d73bc7bfd1b78a in_seq=0 out_seq=0 2024-09-21T00:57:59.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.903+0000 7f4a98ff9640 10 client.25414 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:59.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.903+0000 7f4a98ff9640 1 -- 172.21.15.1:0/537429227 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558e5114bdf0 con 0x558e50dea9f0 2024-09-21T00:57:59.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.903+0000 7f4a98ff9640 10 client.25414 handle_command_reply: tid=0 2024-09-21T00:57:59.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.903+0000 7f4abdfc0740 1 client.25414 shutdown 2024-09-21T00:57:59.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.904+0000 7f4abdfc0740 1 -- 172.21.15.1:0/537429227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e50e031b0 msgr2=0x558e511dee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:59.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.904+0000 7f4abdfc0740 1 --2- 172.21.15.1:0/537429227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e50e031b0 0x558e511dee90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0cda70 tx=0x7f4aac009260 comp rx=0 tx=0).stop 2024-09-21T00:57:59.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.904+0000 7f4abdfc0740 1 -- 172.21.15.1:0/537429227 shutdown_connections 2024-09-21T00:57:59.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.904+0000 7f4abdfc0740 1 --2- 172.21.15.1:0/537429227 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558e50dea9f0 0x558e511f11a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.904+0000 7f4abdfc0740 1 --2- 172.21.15.1:0/537429227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e50e2c070 0x558e511eb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.904+0000 7f4a98ff9640 0 client.25414 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:59.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.904+0000 7f4abdfc0740 1 --2- 172.21.15.1:0/537429227 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e50e0b390 0x558e511df3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.904+0000 7f4abdfc0740 1 --2- 172.21.15.1:0/537429227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e50e031b0 0x558e511dee90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.904+0000 7f4abdfc0740 1 -- 172.21.15.1:0/537429227 >> 172.21.15.1:0/537429227 conn(0x558e50e20460 msgr2=0x558e511d6880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:59.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.904+0000 7f4abdfc0740 1 -- 172.21.15.1:0/537429227 shutdown_connections 2024-09-21T00:57:59.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.904+0000 7f4abdfc0740 1 -- 172.21.15.1:0/537429227 wait complete. 2024-09-21T00:57:59.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.904+0000 7f4abdfc0740 20 client.25414 trim_cache size 0 max 16384 2024-09-21T00:57:59.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.931+0000 7f4abdfc0740 1 Processor -- start 2024-09-21T00:57:59.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.931+0000 7f4abdfc0740 1 -- start start 2024-09-21T00:57:59.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.932+0000 7f4abdfc0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e50e0b390 0x558e511df350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:59.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.932+0000 7f4abdfc0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e50e2c070 0x558e511eb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:59.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.932+0000 7f4abdfc0740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e50dbfda0 0x558e511d67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:59.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.932+0000 7f4abdfc0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab01b1690 con 0x558e50e2c070 2024-09-21T00:57:59.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.932+0000 7f4abdfc0740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab01b31d0 con 0x558e50dbfda0 2024-09-21T00:57:59.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.932+0000 7f4abdfc0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab01b1d60 con 0x558e50e0b390 2024-09-21T00:57:59.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.932+0000 7f4ab57e8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e50e0b390 0x558e511df350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:59.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.932+0000 7f4ab4fe7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e50e2c070 0x558e511eb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:59.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.932+0000 7f4ab4fe7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e50e2c070 0x558e511eb0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59000/0 (socket says 172.21.15.1:59000) 2024-09-21T00:57:59.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.932+0000 7f4ab4fe7640 1 -- 172.21.15.1:0/3057833653 learned_addr learned my addr 172.21.15.1:0/3057833653 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:59.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.933+0000 7f4ab5fe9640 1 --2- 172.21.15.1:0/3057833653 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e50dbfda0 0x558e511d67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:59.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.933+0000 7f4ab4fe7640 1 -- 172.21.15.1:0/3057833653 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e50e0b390 msgr2=0x558e511df350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:59.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.933+0000 7f4ab4fe7640 1 --2- 172.21.15.1:0/3057833653 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e50e0b390 0x558e511df350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.933+0000 7f4ab4fe7640 1 -- 172.21.15.1:0/3057833653 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e50dbfda0 msgr2=0x558e511d67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:59.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.933+0000 7f4ab4fe7640 1 --2- 172.21.15.1:0/3057833653 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e50dbfda0 0x558e511d67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.933+0000 7f4ab4fe7640 1 -- 172.21.15.1:0/3057833653 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e511d6500 con 0x558e50e2c070 2024-09-21T00:57:59.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.933+0000 7f4ab4fe7640 1 --2- 172.21.15.1:0/3057833653 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e50e2c070 0x558e511eb0a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4ab006c730 tx=0x7f4aa0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb7be5d7388974a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:59.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.933+0000 7f4a9affd640 1 -- 172.21.15.1:0/3057833653 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa0005020 con 0x558e50e2c070 2024-09-21T00:57:59.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.933+0000 7f4a9affd640 1 -- 172.21.15.1:0/3057833653 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4aa00047a0 con 0x558e50e2c070 2024-09-21T00:57:59.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.933+0000 7f4a9affd640 1 -- 172.21.15.1:0/3057833653 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa001e740 con 0x558e50e2c070 2024-09-21T00:57:59.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.936+0000 7f4abdfc0740 1 -- 172.21.15.1:0/3057833653 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e50e2c070 msgr2=0x558e511eb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:59.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.936+0000 7f4abdfc0740 1 --2- 172.21.15.1:0/3057833653 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e50e2c070 0x558e511eb0a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4ab006c730 tx=0x7f4aa0013000 comp rx=0 tx=0).stop 2024-09-21T00:57:59.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.936+0000 7f4abdfc0740 1 -- 172.21.15.1:0/3057833653 shutdown_connections 2024-09-21T00:57:59.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.936+0000 7f4abdfc0740 1 --2- 172.21.15.1:0/3057833653 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e50dbfda0 0x558e511d67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.936+0000 7f4abdfc0740 1 --2- 172.21.15.1:0/3057833653 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e50e2c070 0x558e511eb0a0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.936+0000 7f4abdfc0740 1 --2- 172.21.15.1:0/3057833653 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e50e0b390 0x558e511df350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.936+0000 7f4abdfc0740 1 -- 172.21.15.1:0/3057833653 >> 172.21.15.1:0/3057833653 conn(0x558e50e20460 msgr2=0x558e511dec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:59.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.936+0000 7f4abdfc0740 1 -- 172.21.15.1:0/3057833653 shutdown_connections 2024-09-21T00:57:59.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.936+0000 7f4abdfc0740 1 -- 172.21.15.1:0/3057833653 wait complete. 2024-09-21T00:57:59.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.937+0000 7f4abdfc0740 1 -- start start 2024-09-21T00:57:59.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.937+0000 7f4abdfc0740 1 Processor -- start 2024-09-21T00:57:59.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.938+0000 7f4abdfc0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e50dbfda0 0x558e511e3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:59.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.938+0000 7f4ab57e8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e50dbfda0 0x558e511e3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:59.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.938+0000 7f4ab57e8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e50dbfda0 0x558e511e3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59008/0 (socket says 172.21.15.1:59008) 2024-09-21T00:57:59.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.938+0000 7f4ab57e8640 1 -- 172.21.15.1:0/606066901 learned_addr learned my addr 172.21.15.1:0/606066901 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:57:59.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.938+0000 7f4abdfc0740 1 --2- 172.21.15.1:0/606066901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e50e0b390 0x558e511e3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:59.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.938+0000 7f4abdfc0740 1 --2- 172.21.15.1:0/606066901 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e50e2c070 0x558e511e3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:59.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.938+0000 7f4abdfc0740 1 -- 172.21.15.1:0/606066901 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab01b2b00 con 0x558e50dbfda0 2024-09-21T00:57:59.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.938+0000 7f4abdfc0740 1 -- 172.21.15.1:0/606066901 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab01b2430 con 0x558e50e0b390 2024-09-21T00:57:59.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.938+0000 7f4abdfc0740 1 -- 172.21.15.1:0/606066901 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab01af670 con 0x558e50e2c070 2024-09-21T00:57:59.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.939+0000 7f4ab5fe9640 1 --2- 172.21.15.1:0/606066901 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e50e2c070 0x558e511e3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:59.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.939+0000 7f4ab4fe7640 1 --2- 172.21.15.1:0/606066901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e50e0b390 0x558e511e3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:59.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.939+0000 7f4ab5fe9640 1 -- 172.21.15.1:0/606066901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e50e0b390 msgr2=0x558e511e3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:59.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.939+0000 7f4ab5fe9640 1 --2- 172.21.15.1:0/606066901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e50e0b390 0x558e511e3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.939+0000 7f4ab5fe9640 1 -- 172.21.15.1:0/606066901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e50dbfda0 msgr2=0x558e511e3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:57:59.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.939+0000 7f4ab5fe9640 1 --2- 172.21.15.1:0/606066901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e50dbfda0 0x558e511e3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.939+0000 7f4ab5fe9640 1 -- 172.21.15.1:0/606066901 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e5125acc0 con 0x558e50e2c070 2024-09-21T00:57:59.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.939+0000 7f4ab4fe7640 1 --2- 172.21.15.1:0/606066901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e50e0b390 0x558e511e3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:57:59.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.939+0000 7f4ab57e8640 1 --2- 172.21.15.1:0/606066901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e50dbfda0 0x558e511e3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:59.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.939+0000 7f4abdfc0740 10 client.0 _ll_register_callbacks cb 0x7f4aac03b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:57:59.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.939+0000 7f4abdfc0740 1 -- 172.21.15.1:0/606066901 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4aa00047a0 con 0x558e50e2c070 2024-09-21T00:57:59.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.940+0000 7f4ab5fe9640 1 --2- 172.21.15.1:0/606066901 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e50e2c070 0x558e511e3ca0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8007310 tx=0x7f4aa8003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d199d979d0c5b2c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:59.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.940+0000 7f4a98ff9640 10 client.25420 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T00:57:59.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.940+0000 7f4a98ff9640 1 -- 172.21.15.1:0/606066901 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa800ea60 con 0x558e50e2c070 2024-09-21T00:57:59.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.940+0000 7f4a98ff9640 1 -- 172.21.15.1:0/606066901 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f4aa80052c0 con 0x558e50e2c070 2024-09-21T00:57:59.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.940+0000 7f4a98ff9640 1 -- 172.21.15.1:0/606066901 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4aa8005520 con 0x558e50e2c070 2024-09-21T00:57:59.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.940+0000 7f4abdfc0740 10 client.25420 fetch_fsmap learned FSMap version 27 2024-09-21T00:57:59.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.940+0000 7f4abdfc0740 1 -- 172.21.15.1:0/606066901 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({fsmap=27}) -- 0x558e5125bbd0 con 0x558e50e2c070 2024-09-21T00:57:59.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.941+0000 7f4a98ff9640 1 -- 172.21.15.1:0/606066901 <== mon.1 v2:172.21.15.193:3300/0 4 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f4aa80056c0 con 0x558e50e2c070 2024-09-21T00:57:59.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.941+0000 7f4abdfc0740 10 client.25420 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:57:59.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.941+0000 7f4abdfc0740 10 client.25420 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:57:59.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.941+0000 7f4abdfc0740 20 client.25420 populate_metadata read hostname 'smithi001' 2024-09-21T00:57:59.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.941+0000 7f4abdfc0740 1 --2- 172.21.15.1:0/606066901 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558e5125bee0 0x558e5125e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:59.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.941+0000 7f4abdfc0740 4 client.25420 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:57:59.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.941+0000 7f4abdfc0740 1 -- 172.21.15.1:0/606066901 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558e511478a0 con 0x558e5125bee0 2024-09-21T00:57:59.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.942+0000 7f4ab57e8640 1 --2- 172.21.15.1:0/606066901 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558e5125bee0 0x558e5125e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:59.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.942+0000 7f4a98ff9640 10 client.25420 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:59.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.942+0000 7f4ab57e8640 1 --2- 172.21.15.1:0/606066901 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558e5125bee0 0x558e5125e3f0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43cff8058609ce3f server_cookie=fb86764083650448 in_seq=0 out_seq=0 2024-09-21T00:57:59.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.942+0000 7f4a98ff9640 1 -- 172.21.15.1:0/606066901 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558e511478a0 con 0x558e5125bee0 2024-09-21T00:57:59.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.942+0000 7f4a98ff9640 10 client.25420 handle_command_reply: tid=0 2024-09-21T00:57:59.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.942+0000 7f4abdfc0740 1 client.25420 shutdown 2024-09-21T00:57:59.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.943+0000 7f4abdfc0740 1 -- 172.21.15.1:0/606066901 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e50e2c070 msgr2=0x558e511e3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:59.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.943+0000 7f4abdfc0740 1 --2- 172.21.15.1:0/606066901 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e50e2c070 0x558e511e3ca0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8007310 tx=0x7f4aa8003f10 comp rx=0 tx=0).stop 2024-09-21T00:57:59.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.944+0000 7f4abdfc0740 1 -- 172.21.15.1:0/606066901 shutdown_connections 2024-09-21T00:57:59.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.944+0000 7f4abdfc0740 1 --2- 172.21.15.1:0/606066901 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558e5125bee0 0x558e5125e3f0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.944+0000 7f4abdfc0740 1 --2- 172.21.15.1:0/606066901 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e50e2c070 0x558e511e3ca0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.944+0000 7f4abdfc0740 1 --2- 172.21.15.1:0/606066901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e50e0b390 0x558e511e3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.944+0000 7f4abdfc0740 1 --2- 172.21.15.1:0/606066901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e50dbfda0 0x558e511e3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.944+0000 7f4abdfc0740 1 -- 172.21.15.1:0/606066901 >> 172.21.15.1:0/606066901 conn(0x558e50e20460 msgr2=0x558e511d67a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:59.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.944+0000 7f4a98ff9640 0 client.25420 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:57:59.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.944+0000 7f4abdfc0740 1 -- 172.21.15.1:0/606066901 shutdown_connections 2024-09-21T00:57:59.947 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T00:57:59.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.944+0000 7f4abdfc0740 1 -- 172.21.15.1:0/606066901 wait complete. 2024-09-21T00:57:59.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.944+0000 7f4abdfc0740 20 client.25420 trim_cache size 0 max 16384 2024-09-21T00:57:59.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.945+0000 7f4ab7a4c640 1 -- 172.21.15.1:0/1457915360 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4a9c0b6590 msgr2=0x7f4a9c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:59.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.945+0000 7f4ab7a4c640 1 --2- 172.21.15.1:0/1457915360 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4a9c0b6590 0x7f4a9c0b8aa0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0102d90 tx=0x7f4aa000b390 comp rx=0 tx=0).stop 2024-09-21T00:57:59.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.945+0000 7f4ab7a4c640 1 -- 172.21.15.1:0/1457915360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ab0103b80 msgr2=0x7f4ab0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:59.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.945+0000 7f4ab7a4c640 1 --2- 172.21.15.1:0/1457915360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ab0103b80 0x7f4ab0075710 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4aac005ab0 tx=0x7f4aac003cd0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.945+0000 7f4ab7a4c640 1 -- 172.21.15.1:0/1457915360 shutdown_connections 2024-09-21T00:57:59.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.945+0000 7f4ab7a4c640 1 --2- 172.21.15.1:0/1457915360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ab0109e10 0x7f4ab0076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.945+0000 7f4ab7a4c640 1 --2- 172.21.15.1:0/1457915360 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4ab01094c0 0x7f4ab0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.945+0000 7f4ab7a4c640 1 --2- 172.21.15.1:0/1457915360 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4a9c0b6590 0x7f4a9c0b8aa0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.945+0000 7f4ab7a4c640 1 --2- 172.21.15.1:0/1457915360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ab0103b80 0x7f4ab0075710 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.945+0000 7f4ab7a4c640 1 -- 172.21.15.1:0/1457915360 >> 172.21.15.1:0/1457915360 conn(0x7f4ab00ff5b0 msgr2=0x7f4ab0108af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:59.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.945+0000 7f4ab7a4c640 1 -- 172.21.15.1:0/1457915360 shutdown_connections 2024-09-21T00:57:59.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:57:59.945+0000 7f4ab7a4c640 1 -- 172.21.15.1:0/1457915360 wait complete. 2024-09-21T00:57:59.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:59 smithi193 ceph-mon[34660]: pgmap v381: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-21T00:57:59.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:57:59 smithi193 ceph-mon[34660]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-21T00:57:59.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:59 smithi042 ceph-mon[34481]: pgmap v381: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-21T00:57:59.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:57:59 smithi042 ceph-mon[34481]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-21T00:58:01.786 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T00:58:01.786 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T00:58:01.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:01 smithi001 ceph-mon[31211]: pgmap v382: 97 pgs: 97 active+clean; 677 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 341 B/s wr, 12 op/s 2024-09-21T00:58:01.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:01 smithi193 ceph-mon[34660]: pgmap v382: 97 pgs: 97 active+clean; 677 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 341 B/s wr, 12 op/s 2024-09-21T00:58:01.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:01 smithi042 ceph-mon[34481]: pgmap v382: 97 pgs: 97 active+clean; 677 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 341 B/s wr, 12 op/s 2024-09-21T00:58:02.084 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:58:02.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.686+0000 7efef10dd640 1 -- 172.21.15.1:0/159173170 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efeec105ae0 msgr2=0x7efeec10f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:02.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.686+0000 7efef10dd640 1 --2- 172.21.15.1:0/159173170 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efeec105ae0 0x7efeec10f530 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7efee4009ca0 tx=0x7efee402a8c0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.686+0000 7efef10dd640 1 -- 172.21.15.1:0/159173170 shutdown_connections 2024-09-21T00:58:02.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.686+0000 7efef10dd640 1 --2- 172.21.15.1:0/159173170 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efeec105ae0 0x7efeec10f530 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.686+0000 7efef10dd640 1 --2- 172.21.15.1:0/159173170 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efeec105190 0x7efeec1055a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.686+0000 7efef10dd640 1 --2- 172.21.15.1:0/159173170 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efeec1031c0 0x7efeec1035d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.686+0000 7efef10dd640 1 -- 172.21.15.1:0/159173170 >> 172.21.15.1:0/159173170 conn(0x7efeec077c60 msgr2=0x7efeec0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:02.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.687+0000 7efef10dd640 1 -- 172.21.15.1:0/159173170 shutdown_connections 2024-09-21T00:58:02.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.687+0000 7efef10dd640 1 -- 172.21.15.1:0/159173170 wait complete. 2024-09-21T00:58:02.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.688+0000 7efef10dd640 1 Processor -- start 2024-09-21T00:58:02.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.688+0000 7efef10dd640 1 -- start start 2024-09-21T00:58:02.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.689+0000 7efef10dd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efeec1031c0 0x7efeec10bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:02.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.689+0000 7efef10dd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efeec105190 0x7efeec10c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:02.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.689+0000 7efef10dd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efeec105ae0 0x7efeec1ac640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:02.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.689+0000 7efef10dd640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efeec111870 con 0x7efeec105190 2024-09-21T00:58:02.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.689+0000 7efef10dd640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efeec1116f0 con 0x7efeec1031c0 2024-09-21T00:58:02.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.689+0000 7efef10dd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efeec1119f0 con 0x7efeec105ae0 2024-09-21T00:58:02.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.689+0000 7efeeb59e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efeec105ae0 0x7efeec1ac640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:02.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.689+0000 7efeeb59e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efeec105ae0 0x7efeec1ac640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:54070/0 (socket says 172.21.15.1:54070) 2024-09-21T00:58:02.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.689+0000 7efeeb59e640 1 -- 172.21.15.1:0/1389528176 learned_addr learned my addr 172.21.15.1:0/1389528176 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:02.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.689+0000 7efeea59c640 1 --2- 172.21.15.1:0/1389528176 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efeec105190 0x7efeec10c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:02.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.689+0000 7efeead9d640 1 --2- 172.21.15.1:0/1389528176 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efeec1031c0 0x7efeec10bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:02.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.690+0000 7efeeb59e640 1 -- 172.21.15.1:0/1389528176 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efeec1031c0 msgr2=0x7efeec10bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:02.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.690+0000 7efeeb59e640 1 --2- 172.21.15.1:0/1389528176 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efeec1031c0 0x7efeec10bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.690+0000 7efeeb59e640 1 -- 172.21.15.1:0/1389528176 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efeec105190 msgr2=0x7efeec10c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:02.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.690+0000 7efeeb59e640 1 --2- 172.21.15.1:0/1389528176 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efeec105190 0x7efeec10c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.690+0000 7efeeb59e640 1 -- 172.21.15.1:0/1389528176 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeec1acb80 con 0x7efeec105ae0 2024-09-21T00:58:02.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.690+0000 7efeeb59e640 1 --2- 172.21.15.1:0/1389528176 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efeec105ae0 0x7efeec1ac640 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efee40098d0 tx=0x7efee40319f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:02.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.690+0000 7efed3fff640 1 -- 172.21.15.1:0/1389528176 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee4003b70 con 0x7efeec105ae0 2024-09-21T00:58:02.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.691+0000 7efef10dd640 1 -- 172.21.15.1:0/1389528176 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeec1acdb0 con 0x7efeec105ae0 2024-09-21T00:58:02.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.691+0000 7efed3fff640 1 -- 172.21.15.1:0/1389528176 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efee4003d10 con 0x7efeec105ae0 2024-09-21T00:58:02.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.691+0000 7efed3fff640 1 -- 172.21.15.1:0/1389528176 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee402f990 con 0x7efeec105ae0 2024-09-21T00:58:02.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.691+0000 7efef10dd640 1 -- 172.21.15.1:0/1389528176 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeec1ad260 con 0x7efeec105ae0 2024-09-21T00:58:02.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.696+0000 7efed3fff640 1 -- 172.21.15.1:0/1389528176 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7efee402fc30 con 0x7efeec105ae0 2024-09-21T00:58:02.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.696+0000 7efef7651740 1 Processor -- start 2024-09-21T00:58:02.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.697+0000 7efef7651740 1 -- start start 2024-09-21T00:58:02.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.697+0000 7efef7651740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c6ca269350 0x55c6ca610430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:02.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.697+0000 7efef7651740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c6ca240490 0x55c6ca610970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:02.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.697+0000 7efef7651740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6ca248670 0x55c6ca610eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:02.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.697+0000 7efef7651740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c6ca586e60 con 0x55c6ca248670 2024-09-21T00:58:02.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.697+0000 7efef7651740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c6ca576290 con 0x55c6ca240490 2024-09-21T00:58:02.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.697+0000 7efef7651740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55c6ca57a0a0 con 0x55c6ca269350 2024-09-21T00:58:02.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.697+0000 7efed3fff640 1 --2- 172.21.15.1:0/1389528176 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7efed40b65d0 0x7efed40b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:02.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.698+0000 7efeea59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6ca248670 0x55c6ca610eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:02.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.698+0000 7efeea59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6ca248670 0x55c6ca610eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59042/0 (socket says 172.21.15.1:59042) 2024-09-21T00:58:02.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.698+0000 7efeea59c640 1 -- 172.21.15.1:0/2156607363 learned_addr learned my addr 172.21.15.1:0/2156607363 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:02.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.698+0000 7efeea59c640 1 --2- 172.21.15.1:0/2156607363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c6ca269350 0x55c6ca610430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:02.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.698+0000 7efed3fff640 1 -- 172.21.15.1:0/1389528176 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7efee41087c0 con 0x7efeec105ae0 2024-09-21T00:58:02.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.698+0000 7efeeb59e640 1 --2- 172.21.15.1:0/1389528176 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7efed40b65d0 0x7efed40b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:02.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.698+0000 7efeea59c640 1 -- 172.21.15.1:0/2156607363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c6ca269350 msgr2=0x55c6ca610430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:02.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.698+0000 7efeea59c640 1 --2- 172.21.15.1:0/2156607363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c6ca269350 0x55c6ca610430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.698+0000 7efeea59c640 1 -- 172.21.15.1:0/2156607363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c6ca240490 msgr2=0x55c6ca610970 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T00:58:02.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.698+0000 7efeea59c640 1 --2- 172.21.15.1:0/2156607363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c6ca240490 0x55c6ca610970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.698+0000 7efeea59c640 1 -- 172.21.15.1:0/2156607363 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6ca2d4930 con 0x55c6ca248670 2024-09-21T00:58:02.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.699+0000 7efeeb59e640 1 --2- 172.21.15.1:0/1389528176 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7efed40b65d0 0x7efed40b8ae0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7efee40ce8a0 tx=0x7efee40095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:02.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.699+0000 7efeea59c640 1 --2- 172.21.15.1:0/2156607363 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6ca248670 0x55c6ca610eb0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7efee0012770 tx=0x7efee0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c181bf75d47dcf71 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:02.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.699+0000 7efed17fa640 1 -- 172.21.15.1:0/2156607363 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee0012cf0 con 0x55c6ca248670 2024-09-21T00:58:02.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.699+0000 7efed17fa640 1 -- 172.21.15.1:0/2156607363 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efee0010c20 con 0x55c6ca248670 2024-09-21T00:58:02.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.699+0000 7efed17fa640 1 -- 172.21.15.1:0/2156607363 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee001ea70 con 0x55c6ca248670 2024-09-21T00:58:02.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.700+0000 7efef7651740 1 -- 172.21.15.1:0/2156607363 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6ca248670 msgr2=0x55c6ca610eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:02.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.700+0000 7efef7651740 1 --2- 172.21.15.1:0/2156607363 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6ca248670 0x55c6ca610eb0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7efee0012770 tx=0x7efee0004730 comp rx=0 tx=0).stop 2024-09-21T00:58:02.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.700+0000 7efef7651740 1 -- 172.21.15.1:0/2156607363 shutdown_connections 2024-09-21T00:58:02.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.700+0000 7efef7651740 1 --2- 172.21.15.1:0/2156607363 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6ca248670 0x55c6ca610eb0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.700+0000 7efef7651740 1 --2- 172.21.15.1:0/2156607363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c6ca240490 0x55c6ca610970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.700+0000 7efef7651740 1 --2- 172.21.15.1:0/2156607363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c6ca269350 0x55c6ca610430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.700+0000 7efef7651740 1 -- 172.21.15.1:0/2156607363 >> 172.21.15.1:0/2156607363 conn(0x55c6ca25d740 msgr2=0x55c6ca60e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:02.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.701+0000 7efef7651740 1 -- 172.21.15.1:0/2156607363 shutdown_connections 2024-09-21T00:58:02.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.701+0000 7efef7651740 1 -- 172.21.15.1:0/2156607363 wait complete. 2024-09-21T00:58:02.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.701+0000 7efef7651740 1 -- start start 2024-09-21T00:58:02.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.701+0000 7efef7651740 1 Processor -- start 2024-09-21T00:58:02.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.702+0000 7efef7651740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c6ca240490 0x55c6ca61bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:02.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.702+0000 7efef7651740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6ca248670 0x55c6ca61c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:02.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.702+0000 7efeead9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6ca248670 0x55c6ca61c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:02.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.702+0000 7efeead9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6ca248670 0x55c6ca61c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59052/0 (socket says 172.21.15.1:59052) 2024-09-21T00:58:02.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.702+0000 7efeea59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c6ca240490 0x55c6ca61bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:02.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.702+0000 7efeead9d640 1 -- 172.21.15.1:0/1094168444 learned_addr learned my addr 172.21.15.1:0/1094168444 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:02.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.702+0000 7efef7651740 1 --2- 172.21.15.1:0/1094168444 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c6ca269350 0x55c6ca627fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:02.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.702+0000 7efef7651740 1 -- 172.21.15.1:0/1094168444 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c6ca3d7890 con 0x55c6ca248670 2024-09-21T00:58:02.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.702+0000 7efef7651740 1 -- 172.21.15.1:0/1094168444 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c6ca510d40 con 0x55c6ca240490 2024-09-21T00:58:02.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.702+0000 7efef7651740 1 -- 172.21.15.1:0/1094168444 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55c6ca61ec10 con 0x55c6ca269350 2024-09-21T00:58:02.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.703+0000 7efeead9d640 1 -- 172.21.15.1:0/1094168444 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c6ca269350 msgr2=0x55c6ca627fe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T00:58:02.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.703+0000 7efeead9d640 1 --2- 172.21.15.1:0/1094168444 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c6ca269350 0x55c6ca627fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.703+0000 7efeead9d640 1 -- 172.21.15.1:0/1094168444 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c6ca240490 msgr2=0x55c6ca61bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:02.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.703+0000 7efeead9d640 1 --2- 172.21.15.1:0/1094168444 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c6ca240490 0x55c6ca61bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.703+0000 7efeead9d640 1 -- 172.21.15.1:0/1094168444 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6ca628520 con 0x55c6ca248670 2024-09-21T00:58:02.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.703+0000 7efeead9d640 1 --2- 172.21.15.1:0/1094168444 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6ca248670 0x55c6ca61c4e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7efedc0116f0 tx=0x7efedc011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5218fd4304d3d92d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:02.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.703+0000 7efeceff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:58:02.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.703+0000 7efeea59c640 1 --2- 172.21.15.1:0/1094168444 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c6ca240490 0x55c6ca61bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:58:02.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.703+0000 7efef7651740 10 client.0 _ll_register_callbacks cb 0x55c6ca574c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:02.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.704+0000 7efef7651740 1 -- 172.21.15.1:0/1094168444 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efee0010c20 con 0x55c6ca248670 2024-09-21T00:58:02.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.704+0000 7efeceff5640 1 -- 172.21.15.1:0/1094168444 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efedc00f920 con 0x55c6ca248670 2024-09-21T00:58:02.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.704+0000 7efeceff5640 1 -- 172.21.15.1:0/1094168444 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7efedc00fac0 con 0x55c6ca248670 2024-09-21T00:58:02.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.704+0000 7efeceff5640 1 -- 172.21.15.1:0/1094168444 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efedc00fcc0 con 0x55c6ca248670 2024-09-21T00:58:02.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.704+0000 7efef7651740 10 client.15813 fetch_fsmap learned FSMap version 27 2024-09-21T00:58:02.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.704+0000 7efef7651740 1 -- 172.21.15.1:0/1094168444 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55c6ca62adc0 con 0x55c6ca248670 2024-09-21T00:58:02.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.705+0000 7efeceff5640 1 -- 172.21.15.1:0/1094168444 <== mon.0 v2:172.21.15.1:3300/0 4 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7efedc018070 con 0x55c6ca248670 2024-09-21T00:58:02.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.705+0000 7efef7651740 10 client.15813 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:58:02.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.705+0000 7efef7651740 10 client.15813 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:58:02.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.705+0000 7efef7651740 20 client.15813 populate_metadata read hostname 'smithi001' 2024-09-21T00:58:02.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.705+0000 7efef7651740 1 --2- 172.21.15.1:0/1094168444 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55c6ca227cd0 0x55c6ca62e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:02.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.705+0000 7efef7651740 4 client.15813 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:58:02.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.705+0000 7efef7651740 1 -- 172.21.15.1:0/1094168444 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c6ca588db0 con 0x55c6ca227cd0 2024-09-21T00:58:02.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.705+0000 7efeea59c640 1 --2- 172.21.15.1:0/1094168444 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55c6ca227cd0 0x55c6ca62e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:02.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.706+0000 7efeceff5640 10 client.15813 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:02.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.706+0000 7efeea59c640 1 --2- 172.21.15.1:0/1094168444 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55c6ca227cd0 0x55c6ca62e250 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=966a193cc597e877 server_cookie=96890feb26c68288 in_seq=0 out_seq=0 2024-09-21T00:58:02.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.706+0000 7efeceff5640 1 -- 172.21.15.1:0/1094168444 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c6ca588db0 con 0x55c6ca227cd0 2024-09-21T00:58:02.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.706+0000 7efeceff5640 10 client.15813 handle_command_reply: tid=0 2024-09-21T00:58:02.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.706+0000 7efef7651740 1 client.15813 shutdown 2024-09-21T00:58:02.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.707+0000 7efef7651740 1 -- 172.21.15.1:0/1094168444 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6ca248670 msgr2=0x55c6ca61c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:02.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.707+0000 7efef7651740 1 --2- 172.21.15.1:0/1094168444 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6ca248670 0x55c6ca61c4e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7efedc0116f0 tx=0x7efedc011bb0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.707+0000 7efef7651740 1 -- 172.21.15.1:0/1094168444 shutdown_connections 2024-09-21T00:58:02.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.707+0000 7efef7651740 1 --2- 172.21.15.1:0/1094168444 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55c6ca227cd0 0x55c6ca62e250 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.707+0000 7efef7651740 1 --2- 172.21.15.1:0/1094168444 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c6ca269350 0x55c6ca627fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.707+0000 7efeceff5640 0 client.15813 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:02.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.707+0000 7efef7651740 1 --2- 172.21.15.1:0/1094168444 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6ca248670 0x55c6ca61c4e0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.707+0000 7efef7651740 1 --2- 172.21.15.1:0/1094168444 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c6ca240490 0x55c6ca61bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.707+0000 7efef7651740 1 -- 172.21.15.1:0/1094168444 >> 172.21.15.1:0/1094168444 conn(0x55c6ca25d740 msgr2=0x55c6ca6135c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:02.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.707+0000 7efef7651740 1 -- 172.21.15.1:0/1094168444 shutdown_connections 2024-09-21T00:58:02.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.707+0000 7efef7651740 1 -- 172.21.15.1:0/1094168444 wait complete. 2024-09-21T00:58:02.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.707+0000 7efef7651740 20 client.15813 trim_cache size 0 max 16384 2024-09-21T00:58:02.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.743+0000 7efef7651740 1 Processor -- start 2024-09-21T00:58:02.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.743+0000 7efef7651740 1 -- start start 2024-09-21T00:58:02.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.743+0000 7efef7651740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c6ca227cd0 0x55c6ca61c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:02.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.743+0000 7efef7651740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6ca240490 0x55c6ca627ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:02.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.743+0000 7efef7651740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c6ca248670 0x55c6ca616550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:02.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.743+0000 7efef7651740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efed800e530 con 0x55c6ca240490 2024-09-21T00:58:02.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.744+0000 7efef7651740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efed8010070 con 0x55c6ca248670 2024-09-21T00:58:02.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.744+0000 7efef7651740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efed800ec00 con 0x55c6ca227cd0 2024-09-21T00:58:02.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.744+0000 7efeead9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6ca240490 0x55c6ca627ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:02.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.744+0000 7efeead9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6ca240490 0x55c6ca627ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59068/0 (socket says 172.21.15.1:59068) 2024-09-21T00:58:02.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.744+0000 7efeead9d640 1 -- 172.21.15.1:0/2952834940 learned_addr learned my addr 172.21.15.1:0/2952834940 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:02.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.744+0000 7efeea59c640 1 --2- 172.21.15.1:0/2952834940 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c6ca227cd0 0x55c6ca61c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:02.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.744+0000 7efeea59c640 1 --2- 172.21.15.1:0/2952834940 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c6ca248670 0x55c6ca616550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:02.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.744+0000 7efeead9d640 1 -- 172.21.15.1:0/2952834940 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c6ca227cd0 msgr2=0x55c6ca61c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:02.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.744+0000 7efeead9d640 1 --2- 172.21.15.1:0/2952834940 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c6ca227cd0 0x55c6ca61c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.744+0000 7efeead9d640 1 -- 172.21.15.1:0/2952834940 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c6ca248670 msgr2=0x55c6ca616550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:02.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.744+0000 7efeead9d640 1 --2- 172.21.15.1:0/2952834940 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c6ca248670 0x55c6ca616550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.744+0000 7efeead9d640 1 -- 172.21.15.1:0/2952834940 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6ca60ec90 con 0x55c6ca240490 2024-09-21T00:58:02.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.745+0000 7efeead9d640 1 --2- 172.21.15.1:0/2952834940 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6ca240490 0x55c6ca627ee0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7efedc003610 tx=0x7efedc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ca7ccc8865762a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:02.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.745+0000 7efed0ff9640 1 -- 172.21.15.1:0/2952834940 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efedc00f920 con 0x55c6ca240490 2024-09-21T00:58:02.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.745+0000 7efed0ff9640 1 -- 172.21.15.1:0/2952834940 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efee0010c20 con 0x55c6ca240490 2024-09-21T00:58:02.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.745+0000 7efed0ff9640 1 -- 172.21.15.1:0/2952834940 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efedc01a7c0 con 0x55c6ca240490 2024-09-21T00:58:02.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.746+0000 7efef7651740 1 -- 172.21.15.1:0/2952834940 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6ca240490 msgr2=0x55c6ca627ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:02.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.746+0000 7efef7651740 1 --2- 172.21.15.1:0/2952834940 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6ca240490 0x55c6ca627ee0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7efedc003610 tx=0x7efedc014000 comp rx=0 tx=0).stop 2024-09-21T00:58:02.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.746+0000 7efef7651740 1 -- 172.21.15.1:0/2952834940 shutdown_connections 2024-09-21T00:58:02.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.746+0000 7efef7651740 1 --2- 172.21.15.1:0/2952834940 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c6ca248670 0x55c6ca616550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.746+0000 7efef7651740 1 --2- 172.21.15.1:0/2952834940 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6ca240490 0x55c6ca627ee0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.746+0000 7efef7651740 1 --2- 172.21.15.1:0/2952834940 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c6ca227cd0 0x55c6ca61c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.746+0000 7efef7651740 1 -- 172.21.15.1:0/2952834940 >> 172.21.15.1:0/2952834940 conn(0x55c6ca25d740 msgr2=0x55c6ca61bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:02.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.746+0000 7efef7651740 1 -- 172.21.15.1:0/2952834940 shutdown_connections 2024-09-21T00:58:02.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.747+0000 7efef7651740 1 -- 172.21.15.1:0/2952834940 wait complete. 2024-09-21T00:58:02.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.747+0000 7efef7651740 1 -- start start 2024-09-21T00:58:02.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.747+0000 7efef7651740 1 Processor -- start 2024-09-21T00:58:02.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.747+0000 7efef7651740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c6ca227cd0 0x55c6ca6208a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:02.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.748+0000 7efef7651740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c6ca240490 0x55c6ca620e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:02.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.748+0000 7efef7651740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6ca248670 0x55c6ca691ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:02.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.748+0000 7efef7651740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efed800f9a0 con 0x55c6ca248670 2024-09-21T00:58:02.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.748+0000 7efef7651740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efed800f2d0 con 0x55c6ca227cd0 2024-09-21T00:58:02.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.748+0000 7efef7651740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efed800c510 con 0x55c6ca240490 2024-09-21T00:58:02.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.748+0000 7efef7651740 10 client.0 _ll_register_callbacks cb 0x7efedc0097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:02.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.748+0000 7efeea59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c6ca227cd0 0x55c6ca6208a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:02.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.748+0000 7efeea59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c6ca227cd0 0x55c6ca6208a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:47938/0 (socket says 172.21.15.1:47938) 2024-09-21T00:58:02.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.748+0000 7efeea59c640 1 -- 172.21.15.1:0/3589300707 learned_addr learned my addr 172.21.15.1:0/3589300707 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:02.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.748+0000 7efeea59c640 1 --2- 172.21.15.1:0/3589300707 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6ca248670 0x55c6ca691ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:02.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.748+0000 7efeead9d640 1 --2- 172.21.15.1:0/3589300707 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c6ca240490 0x55c6ca620e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:02.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.748+0000 7efeea59c640 1 -- 172.21.15.1:0/3589300707 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c6ca240490 msgr2=0x55c6ca620e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:02.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.748+0000 7efeea59c640 1 --2- 172.21.15.1:0/3589300707 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c6ca240490 0x55c6ca620e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.748+0000 7efeea59c640 1 -- 172.21.15.1:0/3589300707 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6ca248670 msgr2=0x55c6ca691ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:02.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.748+0000 7efeea59c640 1 --2- 172.21.15.1:0/3589300707 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6ca248670 0x55c6ca691ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.748+0000 7efeea59c640 1 -- 172.21.15.1:0/3589300707 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6ca692350 con 0x55c6ca227cd0 2024-09-21T00:58:02.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.748+0000 7efeea59c640 1 --2- 172.21.15.1:0/3589300707 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c6ca227cd0 0x55c6ca6208a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efee001e620 tx=0x7efee0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1ce014a3037f08d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:02.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.748+0000 7efeceff5640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T00:58:02.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.749+0000 7efeceff5640 1 -- 172.21.15.1:0/3589300707 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee00109a0 con 0x55c6ca227cd0 2024-09-21T00:58:02.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.749+0000 7efef7651740 1 -- 172.21.15.1:0/3589300707 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efee0010c20 con 0x55c6ca227cd0 2024-09-21T00:58:02.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.749+0000 7efeceff5640 1 -- 172.21.15.1:0/3589300707 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7efee0029f90 con 0x55c6ca227cd0 2024-09-21T00:58:02.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.749+0000 7efeceff5640 1 -- 172.21.15.1:0/3589300707 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efee0004020 con 0x55c6ca227cd0 2024-09-21T00:58:02.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.749+0000 7efef7651740 10 client.25499 fetch_fsmap learned FSMap version 27 2024-09-21T00:58:02.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.749+0000 7efef7651740 1 -- 172.21.15.1:0/3589300707 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c6ca699780 con 0x55c6ca227cd0 2024-09-21T00:58:02.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.749+0000 7efeceff5640 1 -- 172.21.15.1:0/3589300707 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efee0010c20 con 0x55c6ca227cd0 2024-09-21T00:58:02.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.749+0000 7efeceff5640 1 -- 172.21.15.1:0/3589300707 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7efee001ec30 con 0x55c6ca227cd0 2024-09-21T00:58:02.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.749+0000 7efef7651740 10 client.25499 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:58:02.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.749+0000 7efef7651740 10 client.25499 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:58:02.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.749+0000 7efef7651740 20 client.25499 populate_metadata read hostname 'smithi001' 2024-09-21T00:58:02.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.749+0000 7efef7651740 1 --2- 172.21.15.1:0/3589300707 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55c6ca269350 0x55c6ca69bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:02.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.749+0000 7efef7651740 4 client.25499 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T00:58:02.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.749+0000 7efef7651740 1 -- 172.21.15.1:0/3589300707 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c6ca584860 con 0x55c6ca269350 2024-09-21T00:58:02.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.750+0000 7efeead9d640 1 --2- 172.21.15.1:0/3589300707 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55c6ca269350 0x55c6ca69bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:02.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.750+0000 7efeead9d640 1 --2- 172.21.15.1:0/3589300707 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55c6ca269350 0x55c6ca69bd80 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffb8d56100a2297b server_cookie=a67ae4c202981e09 in_seq=0 out_seq=0 2024-09-21T00:58:02.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.750+0000 7efeceff5640 10 client.25499 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:02.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.752+0000 7efeceff5640 1 -- 172.21.15.1:0/3589300707 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c6ca584860 con 0x55c6ca269350 2024-09-21T00:58:02.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.752+0000 7efeceff5640 10 client.25499 handle_command_reply: tid=0 2024-09-21T00:58:02.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.752+0000 7efef7651740 1 client.25499 shutdown 2024-09-21T00:58:02.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.753+0000 7efef7651740 1 -- 172.21.15.1:0/3589300707 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c6ca227cd0 msgr2=0x55c6ca6208a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:02.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.753+0000 7efef7651740 1 --2- 172.21.15.1:0/3589300707 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c6ca227cd0 0x55c6ca6208a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efee001e620 tx=0x7efee0004730 comp rx=0 tx=0).stop 2024-09-21T00:58:02.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.753+0000 7efef7651740 1 -- 172.21.15.1:0/3589300707 shutdown_connections 2024-09-21T00:58:02.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.753+0000 7efef7651740 1 --2- 172.21.15.1:0/3589300707 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55c6ca269350 0x55c6ca69bd80 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.753+0000 7efeceff5640 0 client.25499 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:02.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.753+0000 7efef7651740 1 --2- 172.21.15.1:0/3589300707 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6ca248670 0x55c6ca691ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.753+0000 7efef7651740 1 --2- 172.21.15.1:0/3589300707 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c6ca240490 0x55c6ca620e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.753+0000 7efef7651740 1 --2- 172.21.15.1:0/3589300707 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c6ca227cd0 0x55c6ca6208a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.753+0000 7efef7651740 1 -- 172.21.15.1:0/3589300707 >> 172.21.15.1:0/3589300707 conn(0x55c6ca25d740 msgr2=0x55c6ca611280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:02.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.753+0000 7efef7651740 1 -- 172.21.15.1:0/3589300707 shutdown_connections 2024-09-21T00:58:02.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.753+0000 7efef7651740 1 -- 172.21.15.1:0/3589300707 wait complete. 2024-09-21T00:58:02.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.753+0000 7efef7651740 20 client.25499 trim_cache size 0 max 16384 2024-09-21T00:58:02.756 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T00:58:02.756 INFO:teuthology.orchestra.run.smithi001.stdout: "return_code": 0, 2024-09-21T00:58:02.756 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_tag": "7cb1bc3f-e2d2-4bf7-b13e-8f3371d7aac1", 2024-09-21T00:58:02.756 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": "asynchronous" 2024-09-21T00:58:02.756 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T00:58:02.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.754+0000 7efef10dd640 1 -- 172.21.15.1:0/1389528176 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7efed40b65d0 msgr2=0x7efed40b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:02.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.754+0000 7efef10dd640 1 --2- 172.21.15.1:0/1389528176 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7efed40b65d0 0x7efed40b8ae0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7efee40ce8a0 tx=0x7efee40095c0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.754+0000 7efef10dd640 1 -- 172.21.15.1:0/1389528176 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efeec105ae0 msgr2=0x7efeec1ac640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:02.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.754+0000 7efef10dd640 1 --2- 172.21.15.1:0/1389528176 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efeec105ae0 0x7efeec1ac640 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efee40098d0 tx=0x7efee40319f0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.754+0000 7efef10dd640 1 -- 172.21.15.1:0/1389528176 shutdown_connections 2024-09-21T00:58:02.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.754+0000 7efef10dd640 1 --2- 172.21.15.1:0/1389528176 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efeec105ae0 0x7efeec1ac640 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.754+0000 7efef10dd640 1 --2- 172.21.15.1:0/1389528176 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7efed40b65d0 0x7efed40b8ae0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.754+0000 7efef10dd640 1 --2- 172.21.15.1:0/1389528176 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efeec105190 0x7efeec10c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.754+0000 7efef10dd640 1 --2- 172.21.15.1:0/1389528176 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efeec1031c0 0x7efeec10bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.754+0000 7efef10dd640 1 -- 172.21.15.1:0/1389528176 >> 172.21.15.1:0/1389528176 conn(0x7efeec077c60 msgr2=0x7efeec106440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:02.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.755+0000 7efef10dd640 1 -- 172.21.15.1:0/1389528176 shutdown_connections 2024-09-21T00:58:02.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:02.755+0000 7efef10dd640 1 -- 172.21.15.1:0/1389528176 wait complete. 2024-09-21T00:58:03.536 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T00:58:03.819 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:58:03.947 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:03 smithi001 ceph-mon[31211]: pgmap v383: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-21T00:58:03.947 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:03 smithi001 ceph-mon[31211]: scrub queued for path: / 2024-09-21T00:58:03.948 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:03 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T00:58:03.948 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:03 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T00:58:03.948 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:03 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T00:58:03.948 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:03 smithi001 ceph-mon[31211]: scrub summary: idle 2024-09-21T00:58:03.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:03 smithi193 ceph-mon[34660]: pgmap v383: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-21T00:58:03.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:03 smithi193 ceph-mon[34660]: scrub queued for path: / 2024-09-21T00:58:03.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:03 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T00:58:03.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:03 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T00:58:03.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:03 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T00:58:03.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:03 smithi193 ceph-mon[34660]: scrub summary: idle 2024-09-21T00:58:03.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:03 smithi042 ceph-mon[34481]: pgmap v383: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-21T00:58:03.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:03 smithi042 ceph-mon[34481]: scrub queued for path: / 2024-09-21T00:58:03.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:03 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T00:58:03.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:03 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T00:58:03.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:03 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T00:58:03.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:03 smithi042 ceph-mon[34481]: scrub summary: idle 2024-09-21T00:58:04.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.351+0000 7fc814ad6640 1 -- 172.21.15.1:0/770481210 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc810108cf0 msgr2=0x7fc81010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:04.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.351+0000 7fc814ad6640 1 --2- 172.21.15.1:0/770481210 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc810108cf0 0x7fc81010f520 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc808009ca0 tx=0x7fc80802a8c0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.351+0000 7fc814ad6640 1 -- 172.21.15.1:0/770481210 shutdown_connections 2024-09-21T00:58:04.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.351+0000 7fc814ad6640 1 --2- 172.21.15.1:0/770481210 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc810108cf0 0x7fc81010f520 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.351+0000 7fc814ad6640 1 --2- 172.21.15.1:0/770481210 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8101083a0 0x7fc8101087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.351+0000 7fc814ad6640 1 --2- 172.21.15.1:0/770481210 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc810102a60 0x7fc810102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.351+0000 7fc814ad6640 1 -- 172.21.15.1:0/770481210 >> 172.21.15.1:0/770481210 conn(0x7fc810079730 msgr2=0x7fc810079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:04.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.351+0000 7fc814ad6640 1 -- 172.21.15.1:0/770481210 shutdown_connections 2024-09-21T00:58:04.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.351+0000 7fc814ad6640 1 -- 172.21.15.1:0/770481210 wait complete. 2024-09-21T00:58:04.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.352+0000 7fc814ad6640 1 Processor -- start 2024-09-21T00:58:04.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.352+0000 7fc814ad6640 1 -- start start 2024-09-21T00:58:04.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.352+0000 7fc814ad6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc810102a60 0x7fc81019a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:04.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.352+0000 7fc814ad6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8101083a0 0x7fc81019a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:04.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.352+0000 7fc814ad6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc810108cf0 0x7fc81019fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:04.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.352+0000 7fc814ad6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc810112960 con 0x7fc810108cf0 2024-09-21T00:58:04.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.352+0000 7fc814ad6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc8101127e0 con 0x7fc810102a60 2024-09-21T00:58:04.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.352+0000 7fc814ad6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc810112ae0 con 0x7fc8101083a0 2024-09-21T00:58:04.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.352+0000 7fc80ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc810108cf0 0x7fc81019fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:04.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.352+0000 7fc80ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc810108cf0 0x7fc81019fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59114/0 (socket says 172.21.15.1:59114) 2024-09-21T00:58:04.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.353+0000 7fc80ed9d640 1 -- 172.21.15.1:0/1725956939 learned_addr learned my addr 172.21.15.1:0/1725956939 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:04.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.353+0000 7fc80dd9b640 1 --2- 172.21.15.1:0/1725956939 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8101083a0 0x7fc81019a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:04.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.353+0000 7fc80e59c640 1 --2- 172.21.15.1:0/1725956939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc810102a60 0x7fc81019a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:04.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.353+0000 7fc80ed9d640 1 -- 172.21.15.1:0/1725956939 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8101083a0 msgr2=0x7fc81019a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:04.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.353+0000 7fc80ed9d640 1 --2- 172.21.15.1:0/1725956939 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8101083a0 0x7fc81019a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.353+0000 7fc80ed9d640 1 -- 172.21.15.1:0/1725956939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc810102a60 msgr2=0x7fc81019a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:04.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.353+0000 7fc80ed9d640 1 --2- 172.21.15.1:0/1725956939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc810102a60 0x7fc81019a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.353+0000 7fc80ed9d640 1 -- 172.21.15.1:0/1725956939 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8101a0350 con 0x7fc810108cf0 2024-09-21T00:58:04.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.353+0000 7fc80dd9b640 1 --2- 172.21.15.1:0/1725956939 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8101083a0 0x7fc81019a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:04.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.353+0000 7fc80ed9d640 1 --2- 172.21.15.1:0/1725956939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc810108cf0 0x7fc81019fc20 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc808005cc0 tx=0x7fc80802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:04.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.354+0000 7fc7ff7fe640 1 -- 172.21.15.1:0/1725956939 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc808003bf0 con 0x7fc810108cf0 2024-09-21T00:58:04.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.354+0000 7fc7ff7fe640 1 -- 172.21.15.1:0/1725956939 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc808003d90 con 0x7fc810108cf0 2024-09-21T00:58:04.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.354+0000 7fc814ad6640 1 -- 172.21.15.1:0/1725956939 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8101a05e0 con 0x7fc810108cf0 2024-09-21T00:58:04.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.354+0000 7fc7ff7fe640 1 -- 172.21.15.1:0/1725956939 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80802fbc0 con 0x7fc810108cf0 2024-09-21T00:58:04.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.355+0000 7fc814ad6640 1 -- 172.21.15.1:0/1725956939 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8100ff550 con 0x7fc810108cf0 2024-09-21T00:58:04.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.357+0000 7fc7ff7fe640 1 -- 172.21.15.1:0/1725956939 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7fc80802fd60 con 0x7fc810108cf0 2024-09-21T00:58:04.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.358+0000 7fc81b04a740 1 Processor -- start 2024-09-21T00:58:04.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.358+0000 7fc81b04a740 1 -- start start 2024-09-21T00:58:04.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.358+0000 7fc7ff7fe640 1 --2- 172.21.15.1:0/1725956939 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc7f80b6510 0x7fc7f80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:04.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.358+0000 7fc81b04a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946a9aa070 0x55946ad51650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:04.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.358+0000 7fc81b04a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55946a9811b0 0x55946ad51b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:04.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.358+0000 7fc81b04a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55946a989390 0x55946ad520d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:04.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.358+0000 7fc81b04a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55946acc7e50 con 0x55946a989390 2024-09-21T00:58:04.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.358+0000 7fc81b04a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55946acb7280 con 0x55946a9811b0 2024-09-21T00:58:04.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.358+0000 7fc81b04a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55946acbb090 con 0x55946a9aa070 2024-09-21T00:58:04.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.359+0000 7fc80ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55946a989390 0x55946ad520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:04.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.359+0000 7fc80ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55946a989390 0x55946ad520d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59120/0 (socket says 172.21.15.1:59120) 2024-09-21T00:58:04.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.359+0000 7fc80ed9d640 1 -- 172.21.15.1:0/4170147180 learned_addr learned my addr 172.21.15.1:0/4170147180 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:04.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.359+0000 7fc7ff7fe640 1 -- 172.21.15.1:0/1725956939 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fc8081087b0 con 0x7fc810108cf0 2024-09-21T00:58:04.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.359+0000 7fc80dd9b640 1 --2- 172.21.15.1:0/1725956939 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc7f80b6510 0x7fc7f80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:04.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.359+0000 7fc80e59c640 1 --2- 172.21.15.1:0/4170147180 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946a9aa070 0x55946ad51650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:04.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.359+0000 7fc80ed9d640 1 -- 172.21.15.1:0/4170147180 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946a9aa070 msgr2=0x55946ad51650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:04.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.359+0000 7fc80ed9d640 1 --2- 172.21.15.1:0/4170147180 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946a9aa070 0x55946ad51650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.359+0000 7fc80dd9b640 1 --2- 172.21.15.1:0/4170147180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55946a9811b0 0x55946ad51b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:04.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.359+0000 7fc80ed9d640 1 -- 172.21.15.1:0/4170147180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55946a9811b0 msgr2=0x55946ad51b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:04.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.359+0000 7fc80ed9d640 1 --2- 172.21.15.1:0/4170147180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55946a9811b0 0x55946ad51b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.359+0000 7fc80ed9d640 1 -- 172.21.15.1:0/4170147180 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55946aa15650 con 0x55946a989390 2024-09-21T00:58:04.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.359+0000 7fc80e59c640 1 --2- 172.21.15.1:0/4170147180 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946a9aa070 0x55946ad51650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:58:04.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.359+0000 7fc80dd9b640 1 --2- 172.21.15.1:0/4170147180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55946a9811b0 0x55946ad51b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:58:04.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.360+0000 7fc80ed9d640 1 --2- 172.21.15.1:0/4170147180 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55946a989390 0x55946ad520d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc8080ce620 tx=0x7fc808037e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d1962fa46fee68a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:04.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.360+0000 7fc80dd9b640 1 --2- 172.21.15.1:0/1725956939 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc7f80b6510 0x7fc7f80b8a20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x55946ad502d0 tx=0x7fc80400bd70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:04.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.360+0000 7fc7fcff9640 1 -- 172.21.15.1:0/4170147180 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8080ce090 con 0x55946a989390 2024-09-21T00:58:04.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.360+0000 7fc7fcff9640 1 -- 172.21.15.1:0/4170147180 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc808036070 con 0x55946a989390 2024-09-21T00:58:04.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.360+0000 7fc7fcff9640 1 -- 172.21.15.1:0/4170147180 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc808037ed0 con 0x55946a989390 2024-09-21T00:58:04.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.361+0000 7fc81b04a740 1 -- 172.21.15.1:0/4170147180 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55946a989390 msgr2=0x55946ad520d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:04.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.361+0000 7fc81b04a740 1 --2- 172.21.15.1:0/4170147180 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55946a989390 0x55946ad520d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc8080ce620 tx=0x7fc808037e60 comp rx=0 tx=0).stop 2024-09-21T00:58:04.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.361+0000 7fc81b04a740 1 -- 172.21.15.1:0/4170147180 shutdown_connections 2024-09-21T00:58:04.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.361+0000 7fc81b04a740 1 --2- 172.21.15.1:0/4170147180 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55946a989390 0x55946ad520d0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.361+0000 7fc81b04a740 1 --2- 172.21.15.1:0/4170147180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55946a9811b0 0x55946ad51b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.361+0000 7fc81b04a740 1 --2- 172.21.15.1:0/4170147180 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946a9aa070 0x55946ad51650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.361+0000 7fc81b04a740 1 -- 172.21.15.1:0/4170147180 >> 172.21.15.1:0/4170147180 conn(0x55946a99e460 msgr2=0x55946ad4f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:04.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.361+0000 7fc81b04a740 1 -- 172.21.15.1:0/4170147180 shutdown_connections 2024-09-21T00:58:04.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.361+0000 7fc81b04a740 1 -- 172.21.15.1:0/4170147180 wait complete. 2024-09-21T00:58:04.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.362+0000 7fc81b04a740 1 -- start start 2024-09-21T00:58:04.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.362+0000 7fc81b04a740 1 Processor -- start 2024-09-21T00:58:04.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.363+0000 7fc81b04a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55946a9811b0 0x55946ad5cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:04.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.363+0000 7fc81b04a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946a989390 0x55946ad5d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:04.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.363+0000 7fc81b04a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55946a9aa070 0x55946ad68cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:04.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.363+0000 7fc81b04a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55946ab18700 con 0x55946a9811b0 2024-09-21T00:58:04.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.363+0000 7fc81b04a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55946ac52110 con 0x55946a9aa070 2024-09-21T00:58:04.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.363+0000 7fc81b04a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55946acc7e50 con 0x55946a989390 2024-09-21T00:58:04.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.363+0000 7fc81b04a740 10 client.0 _ll_register_callbacks cb 0x55946ac6b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:04.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.363+0000 7fc80e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55946a9811b0 0x55946ad5cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:04.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.363+0000 7fc80e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55946a9811b0 0x55946ad5cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59134/0 (socket says 172.21.15.1:59134) 2024-09-21T00:58:04.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.363+0000 7fc80e59c640 1 -- 172.21.15.1:0/2599592075 learned_addr learned my addr 172.21.15.1:0/2599592075 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:04.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.363+0000 7fc80dd9b640 1 --2- 172.21.15.1:0/2599592075 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946a989390 0x55946ad5d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:04.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.363+0000 7fc80ed9d640 1 --2- 172.21.15.1:0/2599592075 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55946a9aa070 0x55946ad68cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:04.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.363+0000 7fc80e59c640 1 -- 172.21.15.1:0/2599592075 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946a989390 msgr2=0x55946ad5d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:04.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.363+0000 7fc80e59c640 1 --2- 172.21.15.1:0/2599592075 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946a989390 0x55946ad5d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.363+0000 7fc80e59c640 1 -- 172.21.15.1:0/2599592075 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55946a9aa070 msgr2=0x55946ad68cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:04.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.363+0000 7fc80e59c640 1 --2- 172.21.15.1:0/2599592075 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55946a9aa070 0x55946ad68cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.363+0000 7fc80e59c640 1 -- 172.21.15.1:0/2599592075 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55946ac7fc40 con 0x55946a9811b0 2024-09-21T00:58:04.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.363+0000 7fc80ed9d640 1 --2- 172.21.15.1:0/2599592075 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55946a9aa070 0x55946ad68cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:58:04.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.363+0000 7fc80e59c640 1 --2- 172.21.15.1:0/2599592075 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55946a9811b0 0x55946ad5cd10 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc80000bfb0 tx=0x7fc8000128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7269b155a84dc0d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:04.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.363+0000 7fc7f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:58:04.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.364+0000 7fc7f5ffb640 1 -- 172.21.15.1:0/2599592075 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc800004220 con 0x55946a9811b0 2024-09-21T00:58:04.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.364+0000 7fc7f5ffb640 1 -- 172.21.15.1:0/2599592075 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fc8000043c0 con 0x55946a9811b0 2024-09-21T00:58:04.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.364+0000 7fc81b04a740 1 -- 172.21.15.1:0/2599592075 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc808036070 con 0x55946a9811b0 2024-09-21T00:58:04.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.364+0000 7fc7f5ffb640 1 -- 172.21.15.1:0/2599592075 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc800010700 con 0x55946a9811b0 2024-09-21T00:58:04.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.364+0000 7fc81b04a740 10 client.15831 fetch_fsmap learned FSMap version 27 2024-09-21T00:58:04.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.364+0000 7fc81b04a740 1 -- 172.21.15.1:0/2599592075 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55946ad6b6c0 con 0x55946a9811b0 2024-09-21T00:58:04.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.364+0000 7fc7f5ffb640 1 -- 172.21.15.1:0/2599592075 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc800010d50 con 0x55946a9811b0 2024-09-21T00:58:04.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.364+0000 7fc7f5ffb640 1 -- 172.21.15.1:0/2599592075 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fc800026420 con 0x55946a9811b0 2024-09-21T00:58:04.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.364+0000 7fc81b04a740 10 client.15831 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:58:04.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.364+0000 7fc81b04a740 10 client.15831 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:58:04.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.364+0000 7fc81b04a740 20 client.15831 populate_metadata read hostname 'smithi001' 2024-09-21T00:58:04.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.364+0000 7fc81b04a740 1 --2- 172.21.15.1:0/2599592075 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55946a9689f0 0x55946ad6eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:04.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.365+0000 7fc81b04a740 4 client.15831 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:58:04.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.365+0000 7fc81b04a740 1 -- 172.21.15.1:0/2599592075 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc808036070 con 0x55946a9689f0 2024-09-21T00:58:04.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.365+0000 7fc80dd9b640 1 --2- 172.21.15.1:0/2599592075 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55946a9689f0 0x55946ad6eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:04.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.365+0000 7fc80dd9b640 1 --2- 172.21.15.1:0/2599592075 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55946a9689f0 0x55946ad6eb50 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1e6af9f5890dad0 server_cookie=373603ec999fe3cb in_seq=0 out_seq=0 2024-09-21T00:58:04.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.365+0000 7fc7f5ffb640 10 client.15831 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:04.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.366+0000 7fc7f5ffb640 1 -- 172.21.15.1:0/2599592075 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fc808036070 con 0x55946a9689f0 2024-09-21T00:58:04.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.366+0000 7fc7f5ffb640 10 client.15831 handle_command_reply: tid=0 2024-09-21T00:58:04.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.366+0000 7fc81b04a740 1 client.15831 shutdown 2024-09-21T00:58:04.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.366+0000 7fc81b04a740 1 -- 172.21.15.1:0/2599592075 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55946a9811b0 msgr2=0x55946ad5cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:04.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.366+0000 7fc81b04a740 1 --2- 172.21.15.1:0/2599592075 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55946a9811b0 0x55946ad5cd10 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc80000bfb0 tx=0x7fc8000128e0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.367+0000 7fc81b04a740 1 -- 172.21.15.1:0/2599592075 shutdown_connections 2024-09-21T00:58:04.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.367+0000 7fc81b04a740 1 --2- 172.21.15.1:0/2599592075 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55946a9689f0 0x55946ad6eb50 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.367+0000 7fc81b04a740 1 --2- 172.21.15.1:0/2599592075 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55946a9aa070 0x55946ad68cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.367+0000 7fc81b04a740 1 --2- 172.21.15.1:0/2599592075 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946a989390 0x55946ad5d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.367+0000 7fc7f5ffb640 0 client.15831 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:04.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.367+0000 7fc81b04a740 1 --2- 172.21.15.1:0/2599592075 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55946a9811b0 0x55946ad5cd10 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.367+0000 7fc81b04a740 1 -- 172.21.15.1:0/2599592075 >> 172.21.15.1:0/2599592075 conn(0x55946a99e460 msgr2=0x55946ad53040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:04.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.367+0000 7fc81b04a740 1 -- 172.21.15.1:0/2599592075 shutdown_connections 2024-09-21T00:58:04.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.367+0000 7fc81b04a740 1 -- 172.21.15.1:0/2599592075 wait complete. 2024-09-21T00:58:04.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.367+0000 7fc81b04a740 20 client.15831 trim_cache size 0 max 16384 2024-09-21T00:58:04.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.385+0000 7fc81b04a740 1 Processor -- start 2024-09-21T00:58:04.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.385+0000 7fc81b04a740 1 -- start start 2024-09-21T00:58:04.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.385+0000 7fc81b04a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55946a9811b0 0x55946ad57ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:04.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.385+0000 7fc81b04a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946a989390 0x55946ad59f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:04.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.385+0000 7fc81b04a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55946a9aa070 0x55946ad5a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:04.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.385+0000 7fc81b04a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc8101b1670 con 0x55946a9811b0 2024-09-21T00:58:04.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.385+0000 7fc81b04a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc8101b31b0 con 0x55946a9aa070 2024-09-21T00:58:04.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.385+0000 7fc81b04a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc8101b1d40 con 0x55946a989390 2024-09-21T00:58:04.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.385+0000 7fc80e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55946a9811b0 0x55946ad57ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:04.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.385+0000 7fc80e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55946a9811b0 0x55946ad57ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59140/0 (socket says 172.21.15.1:59140) 2024-09-21T00:58:04.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.385+0000 7fc80e59c640 1 -- 172.21.15.1:0/2398294131 learned_addr learned my addr 172.21.15.1:0/2398294131 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:04.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.385+0000 7fc80ed9d640 1 --2- 172.21.15.1:0/2398294131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55946a9aa070 0x55946ad5a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:04.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.386+0000 7fc80dd9b640 1 --2- 172.21.15.1:0/2398294131 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946a989390 0x55946ad59f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:04.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.386+0000 7fc80e59c640 1 -- 172.21.15.1:0/2398294131 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946a989390 msgr2=0x55946ad59f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:04.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.386+0000 7fc80e59c640 1 --2- 172.21.15.1:0/2398294131 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946a989390 0x55946ad59f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.386+0000 7fc80e59c640 1 -- 172.21.15.1:0/2398294131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55946a9aa070 msgr2=0x55946ad5a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:04.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.386+0000 7fc80e59c640 1 --2- 172.21.15.1:0/2398294131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55946a9aa070 0x55946ad5a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.386+0000 7fc80e59c640 1 -- 172.21.15.1:0/2398294131 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55946ad5b210 con 0x55946a9811b0 2024-09-21T00:58:04.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.386+0000 7fc80ed9d640 1 --2- 172.21.15.1:0/2398294131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55946a9aa070 0x55946ad5a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:04.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.386+0000 7fc80dd9b640 1 --2- 172.21.15.1:0/2398294131 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946a989390 0x55946ad59f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:58:04.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.386+0000 7fc80e59c640 1 --2- 172.21.15.1:0/2398294131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55946a9811b0 0x55946ad57ec0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc80000b510 tx=0x7fc80000baa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe09598637a12ff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:04.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.386+0000 7fc7f7fff640 1 -- 172.21.15.1:0/2398294131 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc800034070 con 0x55946a9811b0 2024-09-21T00:58:04.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.386+0000 7fc7f7fff640 1 -- 172.21.15.1:0/2398294131 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc800026a80 con 0x55946a9811b0 2024-09-21T00:58:04.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.386+0000 7fc7f7fff640 1 -- 172.21.15.1:0/2398294131 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8000035f0 con 0x55946a9811b0 2024-09-21T00:58:04.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.387+0000 7fc81b04a740 1 -- 172.21.15.1:0/2398294131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55946a9811b0 msgr2=0x55946ad57ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:04.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.387+0000 7fc81b04a740 1 --2- 172.21.15.1:0/2398294131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55946a9811b0 0x55946ad57ec0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc80000b510 tx=0x7fc80000baa0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.387+0000 7fc81b04a740 1 -- 172.21.15.1:0/2398294131 shutdown_connections 2024-09-21T00:58:04.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.387+0000 7fc81b04a740 1 --2- 172.21.15.1:0/2398294131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55946a9aa070 0x55946ad5a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.387+0000 7fc81b04a740 1 --2- 172.21.15.1:0/2398294131 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946a989390 0x55946ad59f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.387+0000 7fc81b04a740 1 --2- 172.21.15.1:0/2398294131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55946a9811b0 0x55946ad57ec0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.387+0000 7fc81b04a740 1 -- 172.21.15.1:0/2398294131 >> 172.21.15.1:0/2398294131 conn(0x55946a99e460 msgr2=0x55946ad5b590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:04.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.387+0000 7fc81b04a740 1 -- 172.21.15.1:0/2398294131 shutdown_connections 2024-09-21T00:58:04.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.388+0000 7fc81b04a740 1 -- 172.21.15.1:0/2398294131 wait complete. 2024-09-21T00:58:04.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.388+0000 7fc81b04a740 1 -- start start 2024-09-21T00:58:04.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.388+0000 7fc81b04a740 1 Processor -- start 2024-09-21T00:58:04.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.388+0000 7fc81b04a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946a989390 0x55946ad61710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:04.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.388+0000 7fc81b04a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55946a9aa070 0x55946ad61cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:04.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.388+0000 7fc81b04a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55946a93dda0 0x55946add2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:04.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.388+0000 7fc81b04a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc8101b2ae0 con 0x55946a9aa070 2024-09-21T00:58:04.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.388+0000 7fc81b04a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc8101b2410 con 0x55946a93dda0 2024-09-21T00:58:04.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.388+0000 7fc81b04a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc8101af650 con 0x55946a989390 2024-09-21T00:58:04.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.389+0000 7fc81b04a740 10 client.0 _ll_register_callbacks cb 0x7fc80000bb40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:04.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.389+0000 7fc80dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55946a9aa070 0x55946ad61cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:04.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.389+0000 7fc80dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55946a9aa070 0x55946ad61cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59142/0 (socket says 172.21.15.1:59142) 2024-09-21T00:58:04.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.389+0000 7fc80dd9b640 1 -- 172.21.15.1:0/463744267 learned_addr learned my addr 172.21.15.1:0/463744267 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:04.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.389+0000 7fc80e59c640 1 --2- 172.21.15.1:0/463744267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946a989390 0x55946ad61710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:04.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.389+0000 7fc80ed9d640 1 --2- 172.21.15.1:0/463744267 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55946a93dda0 0x55946add2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:04.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.389+0000 7fc80dd9b640 1 -- 172.21.15.1:0/463744267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946a989390 msgr2=0x55946ad61710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:04.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.389+0000 7fc80dd9b640 1 --2- 172.21.15.1:0/463744267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946a989390 0x55946ad61710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.389+0000 7fc80dd9b640 1 -- 172.21.15.1:0/463744267 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55946a93dda0 msgr2=0x55946add2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:04.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.389+0000 7fc80dd9b640 1 --2- 172.21.15.1:0/463744267 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55946a93dda0 0x55946add2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.389+0000 7fc80dd9b640 1 -- 172.21.15.1:0/463744267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55946add2ce0 con 0x55946a9aa070 2024-09-21T00:58:04.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.389+0000 7fc80dd9b640 1 --2- 172.21.15.1:0/463744267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55946a9aa070 0x55946ad61cf0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc810079cd0 tx=0x7fc8040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb1cdcd6db5daedd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:04.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.389+0000 7fc7f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:58:04.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.390+0000 7fc7f5ffb640 1 -- 172.21.15.1:0/463744267 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80402c020 con 0x55946a9aa070 2024-09-21T00:58:04.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.390+0000 7fc7f5ffb640 1 -- 172.21.15.1:0/463744267 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fc8040238c0 con 0x55946a9aa070 2024-09-21T00:58:04.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.390+0000 7fc81b04a740 1 -- 172.21.15.1:0/463744267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc800026a80 con 0x55946a9aa070 2024-09-21T00:58:04.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.390+0000 7fc7f5ffb640 1 -- 172.21.15.1:0/463744267 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc804023ac0 con 0x55946a9aa070 2024-09-21T00:58:04.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.390+0000 7fc81b04a740 10 client.15837 fetch_fsmap learned FSMap version 27 2024-09-21T00:58:04.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.390+0000 7fc81b04a740 1 -- 172.21.15.1:0/463744267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55946adda0e0 con 0x55946a9aa070 2024-09-21T00:58:04.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.390+0000 7fc7f5ffb640 1 -- 172.21.15.1:0/463744267 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc800026a80 con 0x55946a9aa070 2024-09-21T00:58:04.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.390+0000 7fc7f5ffb640 1 -- 172.21.15.1:0/463744267 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fc80401e040 con 0x55946a9aa070 2024-09-21T00:58:04.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.390+0000 7fc81b04a740 10 client.15837 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:58:04.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.390+0000 7fc81b04a740 10 client.15837 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:58:04.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.390+0000 7fc81b04a740 20 client.15837 populate_metadata read hostname 'smithi001' 2024-09-21T00:58:04.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.390+0000 7fc81b04a740 1 --2- 172.21.15.1:0/463744267 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55946adda7f0 0x55946addcc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:04.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.390+0000 7fc81b04a740 4 client.15837 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T00:58:04.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.390+0000 7fc81b04a740 1 -- 172.21.15.1:0/463744267 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55946acc9da0 con 0x55946adda7f0 2024-09-21T00:58:04.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.391+0000 7fc80e59c640 1 --2- 172.21.15.1:0/463744267 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55946adda7f0 0x55946addcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:04.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.391+0000 7fc7f5ffb640 10 client.15837 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:04.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.391+0000 7fc80e59c640 1 --2- 172.21.15.1:0/463744267 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55946adda7f0 0x55946addcc10 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=787cd8e7b7172ee6 server_cookie=9feb23068ce7249b in_seq=0 out_seq=0 2024-09-21T00:58:04.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.392+0000 7fc7f5ffb640 1 -- 172.21.15.1:0/463744267 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+942 (crc 0 0 0) 0x55946acc9da0 con 0x55946adda7f0 2024-09-21T00:58:04.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.392+0000 7fc7f5ffb640 10 client.15837 handle_command_reply: tid=0 2024-09-21T00:58:04.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.392+0000 7fc81b04a740 1 client.15837 shutdown 2024-09-21T00:58:04.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.392+0000 7fc81b04a740 1 -- 172.21.15.1:0/463744267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55946a9aa070 msgr2=0x55946ad61cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:04.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.392+0000 7fc81b04a740 1 --2- 172.21.15.1:0/463744267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55946a9aa070 0x55946ad61cf0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc810079cd0 tx=0x7fc8040046c0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.392+0000 7fc81b04a740 1 -- 172.21.15.1:0/463744267 shutdown_connections 2024-09-21T00:58:04.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.392+0000 7fc81b04a740 1 --2- 172.21.15.1:0/463744267 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55946adda7f0 0x55946addcc10 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.392+0000 7fc81b04a740 1 --2- 172.21.15.1:0/463744267 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55946a93dda0 0x55946add2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.392+0000 7fc81b04a740 1 --2- 172.21.15.1:0/463744267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55946a9aa070 0x55946ad61cf0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.392+0000 7fc81b04a740 1 --2- 172.21.15.1:0/463744267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946a989390 0x55946ad61710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.392+0000 7fc81b04a740 1 -- 172.21.15.1:0/463744267 >> 172.21.15.1:0/463744267 conn(0x55946a99e460 msgr2=0x55946ad5b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:04.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.392+0000 7fc7f5ffb640 0 client.15837 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:04.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.392+0000 7fc81b04a740 1 -- 172.21.15.1:0/463744267 shutdown_connections 2024-09-21T00:58:04.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.393+0000 7fc81b04a740 1 -- 172.21.15.1:0/463744267 wait complete. 2024-09-21T00:58:04.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.393+0000 7fc81b04a740 20 client.15837 trim_cache size 0 max 16384 2024-09-21T00:58:04.398 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T00:58:04.398 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "no active scrubs running", 2024-09-21T00:58:04.398 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": {}, 2024-09-21T00:58:04.398 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_stats": { 2024-09-21T00:58:04.398 INFO:teuthology.orchestra.run.smithi001.stdout: "7cb1bc3f-e2d2-4bf7-b13e-8f3371d7aac1": { 2024-09-21T00:58:04.398 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:58:02.751142+0000", 2024-09-21T00:58:04.398 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T00:58:04.399 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T00:58:04.399 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T00:58:04.399 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T00:58:04.399 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T00:58:04.399 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T00:58:04.399 INFO:teuthology.orchestra.run.smithi001.stdout: "2383a19c-993d-4440-99f7-93b43dcf33b4": { 2024-09-21T00:58:04.399 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:47.609257+0000", 2024-09-21T00:58:04.399 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T00:58:04.399 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T00:58:04.399 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T00:58:04.399 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T00:58:04.399 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T00:58:04.399 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T00:58:04.399 INFO:teuthology.orchestra.run.smithi001.stdout: "53fa74e4-5aa8-408b-9724-7c93618f7636": { 2024-09-21T00:58:04.399 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:01.730608+0000", 2024-09-21T00:58:04.400 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T00:58:04.400 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T00:58:04.400 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T00:58:04.400 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T00:58:04.400 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T00:58:04.400 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T00:58:04.400 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T00:58:04.400 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T00:58:04.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.393+0000 7fc814ad6640 1 -- 172.21.15.1:0/1725956939 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc7f80b6510 msgr2=0x7fc7f80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:04.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.393+0000 7fc814ad6640 1 --2- 172.21.15.1:0/1725956939 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc7f80b6510 0x7fc7f80b8a20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x55946ad502d0 tx=0x7fc80400bd70 comp rx=0 tx=0).stop 2024-09-21T00:58:04.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.393+0000 7fc814ad6640 1 -- 172.21.15.1:0/1725956939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc810108cf0 msgr2=0x7fc81019fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:04.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.393+0000 7fc814ad6640 1 --2- 172.21.15.1:0/1725956939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc810108cf0 0x7fc81019fc20 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc808005cc0 tx=0x7fc80802f380 comp rx=0 tx=0).stop 2024-09-21T00:58:04.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.394+0000 7fc814ad6640 1 -- 172.21.15.1:0/1725956939 shutdown_connections 2024-09-21T00:58:04.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.394+0000 7fc814ad6640 1 --2- 172.21.15.1:0/1725956939 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc7f80b6510 0x7fc7f80b8a20 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.394+0000 7fc814ad6640 1 --2- 172.21.15.1:0/1725956939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc810108cf0 0x7fc81019fc20 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.394+0000 7fc814ad6640 1 --2- 172.21.15.1:0/1725956939 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8101083a0 0x7fc81019a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.394+0000 7fc814ad6640 1 --2- 172.21.15.1:0/1725956939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc810102a60 0x7fc81019a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.394+0000 7fc814ad6640 1 -- 172.21.15.1:0/1725956939 >> 172.21.15.1:0/1725956939 conn(0x7fc810079730 msgr2=0x7fc81006b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:04.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.394+0000 7fc814ad6640 1 -- 172.21.15.1:0/1725956939 shutdown_connections 2024-09-21T00:58:04.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:04.394+0000 7fc814ad6640 1 -- 172.21.15.1:0/1725956939 wait complete. 2024-09-21T00:58:05.474 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T00:58:05.475 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:58:05.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:05 smithi001 ceph-mon[31211]: pgmap v384: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 511 B/s wr, 12 op/s 2024-09-21T00:58:05.746 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:58:05.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:05 smithi193 ceph-mon[34660]: pgmap v384: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 511 B/s wr, 12 op/s 2024-09-21T00:58:05.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:05 smithi042 ceph-mon[34481]: pgmap v384: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 511 B/s wr, 12 op/s 2024-09-21T00:58:06.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.359+0000 7f2271404640 1 -- 172.21.15.1:0/1079919266 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f226c108b30 msgr2=0x7f226c10f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:06.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.359+0000 7f2271404640 1 --2- 172.21.15.1:0/1079919266 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f226c108b30 0x7f226c10f360 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f2264009ca0 tx=0x7f226402a8c0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.359+0000 7f2271404640 1 -- 172.21.15.1:0/1079919266 shutdown_connections 2024-09-21T00:58:06.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.359+0000 7f2271404640 1 --2- 172.21.15.1:0/1079919266 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f226c108b30 0x7f226c10f360 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.359+0000 7f2271404640 1 --2- 172.21.15.1:0/1079919266 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f226c1081e0 0x7f226c1085f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.359+0000 7f2271404640 1 --2- 172.21.15.1:0/1079919266 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f226c1028a0 0x7f226c102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.359+0000 7f2271404640 1 -- 172.21.15.1:0/1079919266 >> 172.21.15.1:0/1079919266 conn(0x7f226c0fe2f0 msgr2=0x7f226c100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:06.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.359+0000 7f2271404640 1 -- 172.21.15.1:0/1079919266 shutdown_connections 2024-09-21T00:58:06.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.359+0000 7f2271404640 1 -- 172.21.15.1:0/1079919266 wait complete. 2024-09-21T00:58:06.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.360+0000 7f2271404640 1 Processor -- start 2024-09-21T00:58:06.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.360+0000 7f2271404640 1 -- start start 2024-09-21T00:58:06.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.360+0000 7f2271404640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f226c1028a0 0x7f226c19c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:06.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.360+0000 7f2271404640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f226c1081e0 0x7f226c19cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:06.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.360+0000 7f2271404640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f226c108b30 0x7f226c1a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:06.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.360+0000 7f2271404640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f226c1127e0 con 0x7f226c1028a0 2024-09-21T00:58:06.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.360+0000 7f2271404640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f226c112660 con 0x7f226c1081e0 2024-09-21T00:58:06.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.360+0000 7f2271404640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f226c112960 con 0x7f226c108b30 2024-09-21T00:58:06.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.360+0000 7f226affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f226c1028a0 0x7f226c19c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:06.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.360+0000 7f226affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f226c1028a0 0x7f226c19c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59160/0 (socket says 172.21.15.1:59160) 2024-09-21T00:58:06.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.360+0000 7f226affd640 1 -- 172.21.15.1:0/3048016214 learned_addr learned my addr 172.21.15.1:0/3048016214 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:06.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.360+0000 7f226a7fc640 1 --2- 172.21.15.1:0/3048016214 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f226c1081e0 0x7f226c19cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:06.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.360+0000 7f226b7fe640 1 --2- 172.21.15.1:0/3048016214 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f226c108b30 0x7f226c1a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:06.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.361+0000 7f226affd640 1 -- 172.21.15.1:0/3048016214 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f226c108b30 msgr2=0x7f226c1a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:06.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.361+0000 7f226affd640 1 --2- 172.21.15.1:0/3048016214 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f226c108b30 0x7f226c1a1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.361+0000 7f226affd640 1 -- 172.21.15.1:0/3048016214 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f226c1081e0 msgr2=0x7f226c19cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:06.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.361+0000 7f226affd640 1 --2- 172.21.15.1:0/3048016214 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f226c1081e0 0x7f226c19cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.361+0000 7f226affd640 1 -- 172.21.15.1:0/3048016214 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f226c1a2540 con 0x7f226c1028a0 2024-09-21T00:58:06.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.361+0000 7f226affd640 1 --2- 172.21.15.1:0/3048016214 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f226c1028a0 0x7f226c19c5d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f225c00d950 tx=0x7f225c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:06.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.361+0000 7f2253fff640 1 -- 172.21.15.1:0/3048016214 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225c017070 con 0x7f226c1028a0 2024-09-21T00:58:06.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.361+0000 7f2271404640 1 -- 172.21.15.1:0/3048016214 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f226c1a2830 con 0x7f226c1028a0 2024-09-21T00:58:06.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.361+0000 7f2253fff640 1 -- 172.21.15.1:0/3048016214 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f225c009c30 con 0x7f226c1028a0 2024-09-21T00:58:06.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.361+0000 7f2253fff640 1 -- 172.21.15.1:0/3048016214 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225c00f620 con 0x7f226c1028a0 2024-09-21T00:58:06.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.361+0000 7f2271404640 1 -- 172.21.15.1:0/3048016214 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f226c1a8f90 con 0x7f226c1028a0 2024-09-21T00:58:06.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.362+0000 7f2271404640 1 -- 172.21.15.1:0/3048016214 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f226c102cb0 con 0x7f226c1028a0 2024-09-21T00:58:06.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.364+0000 7f2253fff640 1 -- 172.21.15.1:0/3048016214 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f225c010460 con 0x7f226c1028a0 2024-09-21T00:58:06.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.364+0000 7f2253fff640 1 --2- 172.21.15.1:0/3048016214 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f22540b6510 0x7f22540b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:06.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.365+0000 7f226a7fc640 1 --2- 172.21.15.1:0/3048016214 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f22540b6510 0x7f22540b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:06.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.365+0000 7f2253fff640 1 -- 172.21.15.1:0/3048016214 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f225c0e6ec0 con 0x7f226c1028a0 2024-09-21T00:58:06.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.365+0000 7f226a7fc640 1 --2- 172.21.15.1:0/3048016214 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f22540b6510 0x7f22540b8a20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f226c104a90 tx=0x7f226000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:06.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.369+0000 7f2253fff640 1 -- 172.21.15.1:0/3048016214 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f225c009de0 con 0x7f226c1028a0 2024-09-21T00:58:06.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.598+0000 7f2271404640 1 -- 172.21.15.1:0/3048016214 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f226c19d700 con 0x7f226c1028a0 2024-09-21T00:58:06.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.599+0000 7f2253fff640 1 -- 172.21.15.1:0/3048016214 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11955 (secure 0 0 0) 0x7f225c0b1b10 con 0x7f226c1028a0 2024-09-21T00:58:06.601 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:58:06.601 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":27,"btime":"2024-09-21T00:56:52:855037+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2810186677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2810186677},{"type":"v1","addr":"172.21.15.1:6835","nonce":2810186677}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14736,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3935320478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3935320478},{"type":"v1","addr":"172.21.15.1:6837","nonce":3935320478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:54:58.592853+0000","modified":"2024-09-21T00:56:52.784125+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24653,"mds_1":24637,"mds_2":24626,"mds_3":24622,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/2125703572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2125703572},{"type":"v1","addr":"172.21.15.1:6839","nonce":2125703572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/3860445313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860445313},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860445313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6833/712170939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":712170939},{"type":"v1","addr":"172.21.15.193:6833","nonce":712170939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6833/1653911656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1653911656},{"type":"v1","addr":"172.21.15.42:6833","nonce":1653911656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6835/793085918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":793085918},{"type":"v1","addr":"172.21.15.42:6835","nonce":793085918}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6835/3631682268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":3631682268},{"type":"v1","addr":"172.21.15.193:6835","nonce":3631682268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.193:6837/909252228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":909252228},{"type":"v1","addr":"172.21.15.193:6837","nonce":909252228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.42:6837/2395608508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2395608508},{"type":"v1","addr":"172.21.15.42:6837","nonce":2395608508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.193:6839/1365361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1365361177},{"type":"v1","addr":"172.21.15.193:6839","nonce":1365361177}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6839/2526476666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2526476666},{"type":"v1","addr":"172.21.15.42:6839","nonce":2526476666}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24610,24622,24626,24637,24653]},"id":1}]} 2024-09-21T00:58:06.602 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 27 2024-09-21T00:58:06.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.602+0000 7f2271404640 1 -- 172.21.15.1:0/3048016214 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f22540b6510 msgr2=0x7f22540b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:06.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.602+0000 7f2271404640 1 --2- 172.21.15.1:0/3048016214 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f22540b6510 0x7f22540b8a20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f226c104a90 tx=0x7f226000a2d0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.602+0000 7f2271404640 1 -- 172.21.15.1:0/3048016214 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f226c1028a0 msgr2=0x7f226c19c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:06.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.602+0000 7f2271404640 1 --2- 172.21.15.1:0/3048016214 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f226c1028a0 0x7f226c19c5d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f225c00d950 tx=0x7f225c00de10 comp rx=0 tx=0).stop 2024-09-21T00:58:06.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.603+0000 7f2271404640 1 -- 172.21.15.1:0/3048016214 shutdown_connections 2024-09-21T00:58:06.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.603+0000 7f2271404640 1 --2- 172.21.15.1:0/3048016214 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f226c108b30 0x7f226c1a1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.603+0000 7f2271404640 1 --2- 172.21.15.1:0/3048016214 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f226c1081e0 0x7f226c19cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.603+0000 7f2271404640 1 --2- 172.21.15.1:0/3048016214 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f22540b6510 0x7f22540b8a20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.603+0000 7f2271404640 1 --2- 172.21.15.1:0/3048016214 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f226c1028a0 0x7f226c19c5d0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.603+0000 7f2271404640 1 -- 172.21.15.1:0/3048016214 >> 172.21.15.1:0/3048016214 conn(0x7f226c0fe2f0 msgr2=0x7f226c106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:06.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.603+0000 7f2271404640 1 -- 172.21.15.1:0/3048016214 shutdown_connections 2024-09-21T00:58:06.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:06.603+0000 7f2271404640 1 -- 172.21.15.1:0/3048016214 wait complete. 2024-09-21T00:58:06.649 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.647+0000 7f0a57630640 1 -- 172.21.15.1:0/314972327 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a50103640 msgr2=0x7f0a50103a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:06.649 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.648+0000 7f0a57630640 1 --2- 172.21.15.1:0/314972327 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a50103640 0x7f0a50103a50 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0a40009900 tx=0x7f0a4002a410 comp rx=0 tx=0).stop 2024-09-21T00:58:06.649 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.648+0000 7f0a57630640 1 -- 172.21.15.1:0/314972327 shutdown_connections 2024-09-21T00:58:06.650 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.648+0000 7f0a57630640 1 --2- 172.21.15.1:0/314972327 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0a50103fe0 0x7f0a5010a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.650 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.648+0000 7f0a57630640 1 --2- 172.21.15.1:0/314972327 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a50103640 0x7f0a50103a50 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.650 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.648+0000 7f0a57630640 1 --2- 172.21.15.1:0/314972327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a501025c0 0x7f0a50102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.650 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.648+0000 7f0a57630640 1 -- 172.21.15.1:0/314972327 >> 172.21.15.1:0/314972327 conn(0x7f0a500fdf00 msgr2=0x7f0a501003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:06.650 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.648+0000 7f0a57630640 1 -- 172.21.15.1:0/314972327 shutdown_connections 2024-09-21T00:58:06.650 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.648+0000 7f0a57630640 1 -- 172.21.15.1:0/314972327 wait complete. 2024-09-21T00:58:06.652 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.648+0000 7f0a57630640 1 Processor -- start 2024-09-21T00:58:06.652 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.648+0000 7f0a57630640 1 -- start start 2024-09-21T00:58:06.652 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.649+0000 7f0a57630640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0a501025c0 0x7f0a50106190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:06.652 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.649+0000 7f0a57630640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a50103640 0x7f0a50104a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:06.652 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.649+0000 7f0a57630640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a50103fe0 0x7f0a50104f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:06.652 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.649+0000 7f0a57630640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5010e260 con 0x7f0a50103fe0 2024-09-21T00:58:06.652 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.649+0000 7f0a57630640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5010e0e0 con 0x7f0a50103640 2024-09-21T00:58:06.652 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.649+0000 7f0a57630640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5010e3e0 con 0x7f0a501025c0 2024-09-21T00:58:06.652 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.649+0000 7f0a55bcd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a50103fe0 0x7f0a50104f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:06.652 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.649+0000 7f0a55bcd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a50103fe0 0x7f0a50104f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59172/0 (socket says 172.21.15.1:59172) 2024-09-21T00:58:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.649+0000 7f0a55bcd640 1 -- 172.21.15.1:0/3967106150 learned_addr learned my addr 172.21.15.1:0/3967106150 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.649+0000 7f0a54bcb640 1 --2- 172.21.15.1:0/3967106150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a50103640 0x7f0a50104a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.649+0000 7f0a553cc640 1 --2- 172.21.15.1:0/3967106150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0a501025c0 0x7f0a50106190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.649+0000 7f0a55bcd640 1 -- 172.21.15.1:0/3967106150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0a501025c0 msgr2=0x7f0a50106190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.649+0000 7f0a55bcd640 1 --2- 172.21.15.1:0/3967106150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0a501025c0 0x7f0a50106190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.649+0000 7f0a55bcd640 1 -- 172.21.15.1:0/3967106150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a50103640 msgr2=0x7f0a50104a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.649+0000 7f0a55bcd640 1 --2- 172.21.15.1:0/3967106150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a50103640 0x7f0a50104a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.649+0000 7f0a55bcd640 1 -- 172.21.15.1:0/3967106150 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a501056c0 con 0x7f0a50103fe0 2024-09-21T00:58:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.649+0000 7f0a55bcd640 1 --2- 172.21.15.1:0/3967106150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a50103fe0 0x7f0a50104f90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f0a4800eb10 tx=0x7f0a4800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.649+0000 7f0a467fc640 1 -- 172.21.15.1:0/3967106150 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a48004b20 con 0x7f0a50103fe0 2024-09-21T00:58:06.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.650+0000 7f0a57630640 1 -- 172.21.15.1:0/3967106150 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a501a4000 con 0x7f0a50103fe0 2024-09-21T00:58:06.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.650+0000 7f0a467fc640 1 -- 172.21.15.1:0/3967106150 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a48004cc0 con 0x7f0a50103fe0 2024-09-21T00:58:06.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.650+0000 7f0a467fc640 1 -- 172.21.15.1:0/3967106150 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a48010690 con 0x7f0a50103fe0 2024-09-21T00:58:06.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.650+0000 7f0a57630640 1 -- 172.21.15.1:0/3967106150 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a501a44c0 con 0x7f0a50103fe0 2024-09-21T00:58:06.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.652+0000 7f0a467fc640 1 -- 172.21.15.1:0/3967106150 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f0a480108f0 con 0x7f0a50103fe0 2024-09-21T00:58:06.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.653+0000 7f0a5e67c740 1 Processor -- start 2024-09-21T00:58:06.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.653+0000 7f0a5e67c740 1 -- start start 2024-09-21T00:58:06.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.653+0000 7f0a5e67c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555f174241b0 0x555f177cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:06.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.653+0000 7f0a5e67c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555f173fb2f0 0x555f177cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:06.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.653+0000 7f0a5e67c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f174034d0 0x555f177cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:06.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.653+0000 7f0a5e67c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x555f1773e6f0 con 0x555f173fb2f0 2024-09-21T00:58:06.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.653+0000 7f0a5e67c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555f1772db20 con 0x555f174241b0 2024-09-21T00:58:06.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.653+0000 7f0a5e67c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x555f17731930 con 0x555f174034d0 2024-09-21T00:58:06.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.653+0000 7f0a553cc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555f173fb2f0 0x555f177cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:06.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.653+0000 7f0a553cc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555f173fb2f0 0x555f177cc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59178/0 (socket says 172.21.15.1:59178) 2024-09-21T00:58:06.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.653+0000 7f0a553cc640 1 -- 172.21.15.1:0/4034035934 learned_addr learned my addr 172.21.15.1:0/4034035934 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:06.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.653+0000 7f0a54bcb640 1 --2- 172.21.15.1:0/4034035934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555f174241b0 0x555f177cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:06.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.654+0000 7f0a54bcb640 1 --2- 172.21.15.1:0/4034035934 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f174034d0 0x555f177cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:06.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.654+0000 7f0a467fc640 1 --2- 172.21.15.1:0/3967106150 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f0a3c0b6510 0x7f0a3c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:06.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.654+0000 7f0a553cc640 1 -- 172.21.15.1:0/4034035934 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f174034d0 msgr2=0x555f177cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:06.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.654+0000 7f0a553cc640 1 --2- 172.21.15.1:0/4034035934 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f174034d0 0x555f177cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.654+0000 7f0a553cc640 1 -- 172.21.15.1:0/4034035934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555f174241b0 msgr2=0x555f177cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:06.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.654+0000 7f0a553cc640 1 --2- 172.21.15.1:0/4034035934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555f174241b0 0x555f177cbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.654+0000 7f0a553cc640 1 -- 172.21.15.1:0/4034035934 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f176f3530 con 0x555f173fb2f0 2024-09-21T00:58:06.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.654+0000 7f0a54bcb640 1 --2- 172.21.15.1:0/4034035934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555f174241b0 0x555f177cbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:58:06.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.654+0000 7f0a55bcd640 1 --2- 172.21.15.1:0/3967106150 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f0a3c0b6510 0x7f0a3c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:06.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.654+0000 7f0a553cc640 1 --2- 172.21.15.1:0/4034035934 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555f173fb2f0 0x555f177cc4c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c00bcb0 tx=0x7f0a4c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef72d5c37a989cc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:06.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.654+0000 7f0a467fc640 1 -- 172.21.15.1:0/3967106150 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f0a480e79b0 con 0x7f0a50103fe0 2024-09-21T00:58:06.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.654+0000 7f0a3b7fe640 1 -- 172.21.15.1:0/4034035934 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c015070 con 0x555f173fb2f0 2024-09-21T00:58:06.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.654+0000 7f0a3b7fe640 1 -- 172.21.15.1:0/4034035934 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a4c01a910 con 0x555f173fb2f0 2024-09-21T00:58:06.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.654+0000 7f0a3b7fe640 1 -- 172.21.15.1:0/4034035934 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c011980 con 0x555f173fb2f0 2024-09-21T00:58:06.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.655+0000 7f0a5e67c740 1 -- 172.21.15.1:0/4034035934 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555f173fb2f0 msgr2=0x555f177cc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:06.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.655+0000 7f0a5e67c740 1 --2- 172.21.15.1:0/4034035934 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555f173fb2f0 0x555f177cc4c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c00bcb0 tx=0x7f0a4c00f730 comp rx=0 tx=0).stop 2024-09-21T00:58:06.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.655+0000 7f0a55bcd640 1 --2- 172.21.15.1:0/3967106150 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f0a3c0b6510 0x7f0a3c0b8a20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0a480049d0 tx=0x7f0a480de560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:06.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.655+0000 7f0a5e67c740 1 -- 172.21.15.1:0/4034035934 shutdown_connections 2024-09-21T00:58:06.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.655+0000 7f0a5e67c740 1 --2- 172.21.15.1:0/4034035934 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f174034d0 0x555f177cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.655+0000 7f0a5e67c740 1 --2- 172.21.15.1:0/4034035934 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555f173fb2f0 0x555f177cc4c0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.655+0000 7f0a5e67c740 1 --2- 172.21.15.1:0/4034035934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555f174241b0 0x555f177cbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.655+0000 7f0a5e67c740 1 -- 172.21.15.1:0/4034035934 >> 172.21.15.1:0/4034035934 conn(0x555f17418300 msgr2=0x555f177c78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:06.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.655+0000 7f0a5e67c740 1 -- 172.21.15.1:0/4034035934 shutdown_connections 2024-09-21T00:58:06.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.655+0000 7f0a5e67c740 1 -- 172.21.15.1:0/4034035934 wait complete. 2024-09-21T00:58:06.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.656+0000 7f0a5e67c740 1 -- start start 2024-09-21T00:58:06.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.656+0000 7f0a5e67c740 1 Processor -- start 2024-09-21T00:58:06.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.656+0000 7f0a5e67c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555f173fb2f0 0x555f177d55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.656+0000 7f0a5e67c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f174034d0 0x555f177d5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.656+0000 7f0a5e67c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555f174241b0 0x555f177d6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.656+0000 7f0a5e67c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x555f17665ab0 con 0x555f174241b0 2024-09-21T00:58:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.656+0000 7f0a5e67c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555f176d3730 con 0x555f173fb2f0 2024-09-21T00:58:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.656+0000 7f0a5e67c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x555f177cdb30 con 0x555f174034d0 2024-09-21T00:58:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.656+0000 7f0a5e67c740 10 client.0 _ll_register_callbacks cb 0x555f177276b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.656+0000 7f0a54bcb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555f174241b0 0x555f177d6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.656+0000 7f0a54bcb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555f174241b0 0x555f177d6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59192/0 (socket says 172.21.15.1:59192) 2024-09-21T00:58:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.656+0000 7f0a54bcb640 1 -- 172.21.15.1:0/1361484247 learned_addr learned my addr 172.21.15.1:0/1361484247 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.656+0000 7f0a54bcb640 1 --2- 172.21.15.1:0/1361484247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555f173fb2f0 0x555f177d55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.657+0000 7f0a553cc640 1 --2- 172.21.15.1:0/1361484247 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f174034d0 0x555f177d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.657+0000 7f0a54bcb640 1 -- 172.21.15.1:0/1361484247 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f174034d0 msgr2=0x555f177d5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.657+0000 7f0a54bcb640 1 --2- 172.21.15.1:0/1361484247 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f174034d0 0x555f177d5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.657+0000 7f0a54bcb640 1 -- 172.21.15.1:0/1361484247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555f173fb2f0 msgr2=0x555f177d55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.657+0000 7f0a54bcb640 1 --2- 172.21.15.1:0/1361484247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555f173fb2f0 0x555f177d55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.657+0000 7f0a54bcb640 1 -- 172.21.15.1:0/1361484247 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f1748f790 con 0x555f174241b0 2024-09-21T00:58:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.657+0000 7f0a54bcb640 1 --2- 172.21.15.1:0/1361484247 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555f174241b0 0x555f177d6810 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0a40000c00 tx=0x7f0a4002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5b8e9d3673ecec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.657+0000 7f0a38ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:58:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.657+0000 7f0a38ff9640 1 -- 172.21.15.1:0/1361484247 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a40046040 con 0x555f174241b0 2024-09-21T00:58:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.657+0000 7f0a38ff9640 1 -- 172.21.15.1:0/1361484247 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f0a4004c650 con 0x555f174241b0 2024-09-21T00:58:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.657+0000 7f0a5e67c740 1 -- 172.21.15.1:0/1361484247 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a4c01a910 con 0x555f174241b0 2024-09-21T00:58:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.657+0000 7f0a38ff9640 1 -- 172.21.15.1:0/1361484247 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0a40035040 con 0x555f174241b0 2024-09-21T00:58:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.657+0000 7f0a5e67c740 10 client.15855 fetch_fsmap learned FSMap version 27 2024-09-21T00:58:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.657+0000 7f0a5e67c740 1 -- 172.21.15.1:0/1361484247 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555f17508620 con 0x555f174241b0 2024-09-21T00:58:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.658+0000 7f0a38ff9640 1 -- 172.21.15.1:0/1361484247 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a4c01a910 con 0x555f174241b0 2024-09-21T00:58:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.658+0000 7f0a38ff9640 1 -- 172.21.15.1:0/1361484247 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f0a4003d860 con 0x555f174241b0 2024-09-21T00:58:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.658+0000 7f0a5e67c740 10 client.15855 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:58:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.658+0000 7f0a5e67c740 10 client.15855 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:58:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.658+0000 7f0a5e67c740 20 client.15855 populate_metadata read hostname 'smithi001' 2024-09-21T00:58:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.658+0000 7f0a5e67c740 1 --2- 172.21.15.1:0/1361484247 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x555f173e2d80 0x555f177e2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.658+0000 7f0a5e67c740 4 client.15855 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:58:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.658+0000 7f0a5e67c740 1 -- 172.21.15.1:0/1361484247 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f17740640 con 0x555f173e2d80 2024-09-21T00:58:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.658+0000 7f0a553cc640 1 --2- 172.21.15.1:0/1361484247 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x555f173e2d80 0x555f177e2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.659+0000 7f0a553cc640 1 --2- 172.21.15.1:0/1361484247 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x555f173e2d80 0x555f177e2d20 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4796fd3c753c7905 server_cookie=bf331648e92e9d6a in_seq=0 out_seq=0 2024-09-21T00:58:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.659+0000 7f0a38ff9640 10 client.15855 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.659+0000 7f0a38ff9640 1 -- 172.21.15.1:0/1361484247 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555f17740640 con 0x555f173e2d80 2024-09-21T00:58:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.659+0000 7f0a38ff9640 10 client.15855 handle_command_reply: tid=0 2024-09-21T00:58:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.659+0000 7f0a5e67c740 1 client.15855 shutdown 2024-09-21T00:58:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.660+0000 7f0a5e67c740 1 -- 172.21.15.1:0/1361484247 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555f174241b0 msgr2=0x555f177d6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.660+0000 7f0a5e67c740 1 --2- 172.21.15.1:0/1361484247 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555f174241b0 0x555f177d6810 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0a40000c00 tx=0x7f0a4002a410 comp rx=0 tx=0).stop 2024-09-21T00:58:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.660+0000 7f0a5e67c740 1 -- 172.21.15.1:0/1361484247 shutdown_connections 2024-09-21T00:58:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.660+0000 7f0a5e67c740 1 --2- 172.21.15.1:0/1361484247 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x555f173e2d80 0x555f177e2d20 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.660+0000 7f0a5e67c740 1 --2- 172.21.15.1:0/1361484247 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555f174241b0 0x555f177d6810 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.660+0000 7f0a5e67c740 1 --2- 172.21.15.1:0/1361484247 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f174034d0 0x555f177d5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.660+0000 7f0a38ff9640 0 client.15855 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.660+0000 7f0a5e67c740 1 --2- 172.21.15.1:0/1361484247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555f173fb2f0 0x555f177d55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.660+0000 7f0a5e67c740 1 -- 172.21.15.1:0/1361484247 >> 172.21.15.1:0/1361484247 conn(0x555f17418300 msgr2=0x555f177c5ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.660+0000 7f0a5e67c740 1 -- 172.21.15.1:0/1361484247 shutdown_connections 2024-09-21T00:58:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.660+0000 7f0a5e67c740 1 -- 172.21.15.1:0/1361484247 wait complete. 2024-09-21T00:58:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.660+0000 7f0a5e67c740 20 client.15855 trim_cache size 0 max 16384 2024-09-21T00:58:06.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.675+0000 7f0a5e67c740 1 Processor -- start 2024-09-21T00:58:06.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.675+0000 7f0a5e67c740 1 -- start start 2024-09-21T00:58:06.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.675+0000 7f0a5e67c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555f173fb2f0 0x555f177c7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:06.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.675+0000 7f0a5e67c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555f174034d0 0x555f177c25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:06.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.675+0000 7f0a5e67c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f174241b0 0x555f177c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:06.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.675+0000 7f0a5e67c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0a501ad1f0 con 0x555f174034d0 2024-09-21T00:58:06.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.675+0000 7f0a5e67c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0a501aed30 con 0x555f173fb2f0 2024-09-21T00:58:06.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.675+0000 7f0a5e67c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0a501ad8c0 con 0x555f174241b0 2024-09-21T00:58:06.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.675+0000 7f0a553cc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555f174034d0 0x555f177c25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:06.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.675+0000 7f0a553cc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555f174034d0 0x555f177c25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59198/0 (socket says 172.21.15.1:59198) 2024-09-21T00:58:06.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.675+0000 7f0a553cc640 1 -- 172.21.15.1:0/1827683034 learned_addr learned my addr 172.21.15.1:0/1827683034 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:06.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.675+0000 7f0a54bcb640 1 --2- 172.21.15.1:0/1827683034 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f174241b0 0x555f177c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:06.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.675+0000 7f0a54bcb640 1 --2- 172.21.15.1:0/1827683034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555f173fb2f0 0x555f177c7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:06.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.676+0000 7f0a553cc640 1 -- 172.21.15.1:0/1827683034 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f174241b0 msgr2=0x555f177c7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:06.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.676+0000 7f0a553cc640 1 --2- 172.21.15.1:0/1827683034 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f174241b0 0x555f177c7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.676+0000 7f0a553cc640 1 -- 172.21.15.1:0/1827683034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555f173fb2f0 msgr2=0x555f177c7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:06.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.676+0000 7f0a553cc640 1 --2- 172.21.15.1:0/1827683034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555f173fb2f0 0x555f177c7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.676+0000 7f0a553cc640 1 -- 172.21.15.1:0/1827683034 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f177d3770 con 0x555f174034d0 2024-09-21T00:58:06.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.676+0000 7f0a553cc640 1 --2- 172.21.15.1:0/1827683034 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555f174034d0 0x555f177c25c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c00bcb0 tx=0x7f0a4c011510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f38825e510d62ad server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:06.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.676+0000 7f0a3affd640 1 -- 172.21.15.1:0/1827683034 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c030070 con 0x555f174034d0 2024-09-21T00:58:06.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.676+0000 7f0a3affd640 1 -- 172.21.15.1:0/1827683034 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a4c0054e0 con 0x555f174034d0 2024-09-21T00:58:06.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.676+0000 7f0a3affd640 1 -- 172.21.15.1:0/1827683034 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c015040 con 0x555f174034d0 2024-09-21T00:58:06.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.677+0000 7f0a5e67c740 1 -- 172.21.15.1:0/1827683034 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555f174034d0 msgr2=0x555f177c25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:06.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.677+0000 7f0a5e67c740 1 --2- 172.21.15.1:0/1827683034 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555f174034d0 0x555f177c25c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c00bcb0 tx=0x7f0a4c011510 comp rx=0 tx=0).stop 2024-09-21T00:58:06.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.677+0000 7f0a5e67c740 1 -- 172.21.15.1:0/1827683034 shutdown_connections 2024-09-21T00:58:06.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.677+0000 7f0a5e67c740 1 --2- 172.21.15.1:0/1827683034 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f174241b0 0x555f177c7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.677+0000 7f0a5e67c740 1 --2- 172.21.15.1:0/1827683034 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555f174034d0 0x555f177c25c0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.677+0000 7f0a5e67c740 1 --2- 172.21.15.1:0/1827683034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555f173fb2f0 0x555f177c7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.677+0000 7f0a5e67c740 1 -- 172.21.15.1:0/1827683034 >> 172.21.15.1:0/1827683034 conn(0x555f17418300 msgr2=0x555f177ccc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:06.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.677+0000 7f0a5e67c740 1 -- 172.21.15.1:0/1827683034 shutdown_connections 2024-09-21T00:58:06.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.677+0000 7f0a5e67c740 1 -- 172.21.15.1:0/1827683034 wait complete. 2024-09-21T00:58:06.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.677+0000 7f0a5e67c740 1 -- start start 2024-09-21T00:58:06.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.677+0000 7f0a5e67c740 1 Processor -- start 2024-09-21T00:58:06.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.678+0000 7f0a5e67c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f173fb2f0 0x555f177dd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:06.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.678+0000 7f0a5e67c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555f174034d0 0x555f177dc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:06.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.678+0000 7f0a5e67c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555f174241b0 0x555f177dc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:06.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.678+0000 7f0a5e67c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0a501ae660 con 0x555f174034d0 2024-09-21T00:58:06.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.678+0000 7f0a5e67c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0a501adf90 con 0x555f174241b0 2024-09-21T00:58:06.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.678+0000 7f0a5e67c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0a501ab1d0 con 0x555f173fb2f0 2024-09-21T00:58:06.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.678+0000 7f0a5e67c740 10 client.0 _ll_register_callbacks cb 0x7f0a40009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:06.689 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.678+0000 7f0a553cc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555f174034d0 0x555f177dc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:06.689 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.678+0000 7f0a553cc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555f174034d0 0x555f177dc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59214/0 (socket says 172.21.15.1:59214) 2024-09-21T00:58:06.689 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.678+0000 7f0a553cc640 1 -- 172.21.15.1:0/568557524 learned_addr learned my addr 172.21.15.1:0/568557524 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:06.689 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.678+0000 7f0a54bcb640 1 --2- 172.21.15.1:0/568557524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555f174241b0 0x555f177dc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:06.689 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.678+0000 7f0a54bcb640 1 --2- 172.21.15.1:0/568557524 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f173fb2f0 0x555f177dd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:06.689 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.678+0000 7f0a553cc640 1 -- 172.21.15.1:0/568557524 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f173fb2f0 msgr2=0x555f177dd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:06.689 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.678+0000 7f0a553cc640 1 --2- 172.21.15.1:0/568557524 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f173fb2f0 0x555f177dd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.689 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.678+0000 7f0a553cc640 1 -- 172.21.15.1:0/568557524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555f174241b0 msgr2=0x555f177dc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:06.689 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.678+0000 7f0a553cc640 1 --2- 172.21.15.1:0/568557524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555f174241b0 0x555f177dc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.689 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.678+0000 7f0a553cc640 1 -- 172.21.15.1:0/568557524 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f177dcdf0 con 0x555f174034d0 2024-09-21T00:58:06.689 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.678+0000 7f0a54bcb640 1 --2- 172.21.15.1:0/568557524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555f174241b0 0x555f177dc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:58:06.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.678+0000 7f0a553cc640 1 --2- 172.21.15.1:0/568557524 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555f174034d0 0x555f177dc0e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c005780 tx=0x7f0a4c00fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c7a2f1c219b27a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:06.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.678+0000 7f0a38ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:58:06.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.679+0000 7f0a38ff9640 1 -- 172.21.15.1:0/568557524 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c030040 con 0x555f174034d0 2024-09-21T00:58:06.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.679+0000 7f0a38ff9640 1 -- 172.21.15.1:0/568557524 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f0a4c004240 con 0x555f174034d0 2024-09-21T00:58:06.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.679+0000 7f0a5e67c740 1 -- 172.21.15.1:0/568557524 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a4c0054e0 con 0x555f174034d0 2024-09-21T00:58:06.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.679+0000 7f0a38ff9640 1 -- 172.21.15.1:0/568557524 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0a4c015040 con 0x555f174034d0 2024-09-21T00:58:06.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.679+0000 7f0a5e67c740 10 client.15861 fetch_fsmap learned FSMap version 27 2024-09-21T00:58:06.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.679+0000 7f0a5e67c740 1 -- 172.21.15.1:0/568557524 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555f1784d720 con 0x555f174034d0 2024-09-21T00:58:06.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.679+0000 7f0a38ff9640 1 -- 172.21.15.1:0/568557524 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a4c0054e0 con 0x555f174034d0 2024-09-21T00:58:06.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.679+0000 7f0a38ff9640 1 -- 172.21.15.1:0/568557524 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f0a4c011580 con 0x555f174034d0 2024-09-21T00:58:06.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.679+0000 7f0a5e67c740 10 client.15861 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:58:06.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.679+0000 7f0a5e67c740 10 client.15861 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:58:06.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.679+0000 7f0a5e67c740 20 client.15861 populate_metadata read hostname 'smithi001' 2024-09-21T00:58:06.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.679+0000 7f0a5e67c740 1 --2- 172.21.15.1:0/568557524 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x555f173b81c0 0x555f1784fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.679+0000 7f0a5e67c740 4 client.15861 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T00:58:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.679+0000 7f0a5e67c740 1 -- 172.21.15.1:0/568557524 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555f1773c0f0 con 0x555f173b81c0 2024-09-21T00:58:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.680+0000 7f0a54bcb640 1 --2- 172.21.15.1:0/568557524 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x555f173b81c0 0x555f1784fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.680+0000 7f0a38ff9640 10 client.15861 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.680+0000 7f0a54bcb640 1 --2- 172.21.15.1:0/568557524 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x555f173b81c0 0x555f1784fe60 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5fabec94a1eb88b server_cookie=86cd513607ea716d in_seq=0 out_seq=0 2024-09-21T00:58:06.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.686+0000 7f0a38ff9640 1 -- 172.21.15.1:0/568557524 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555f1773c0f0 con 0x555f173b81c0 2024-09-21T00:58:06.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.686+0000 7f0a38ff9640 10 client.15861 handle_command_reply: tid=0 2024-09-21T00:58:06.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.686+0000 7f0a5e67c740 1 client.15861 shutdown 2024-09-21T00:58:06.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.686+0000 7f0a5e67c740 1 -- 172.21.15.1:0/568557524 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555f174034d0 msgr2=0x555f177dc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.686+0000 7f0a5e67c740 1 --2- 172.21.15.1:0/568557524 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555f174034d0 0x555f177dc0e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c005780 tx=0x7f0a4c00fce0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.686+0000 7f0a5e67c740 1 -- 172.21.15.1:0/568557524 shutdown_connections 2024-09-21T00:58:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.686+0000 7f0a5e67c740 1 --2- 172.21.15.1:0/568557524 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x555f173b81c0 0x555f1784fe60 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.686+0000 7f0a5e67c740 1 --2- 172.21.15.1:0/568557524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555f174241b0 0x555f177dc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.686+0000 7f0a5e67c740 1 --2- 172.21.15.1:0/568557524 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555f174034d0 0x555f177dc0e0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.686+0000 7f0a5e67c740 1 --2- 172.21.15.1:0/568557524 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f173fb2f0 0x555f177dd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.686+0000 7f0a38ff9640 0 client.15861 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.686+0000 7f0a5e67c740 1 -- 172.21.15.1:0/568557524 >> 172.21.15.1:0/568557524 conn(0x555f17418300 msgr2=0x555f177ccc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.687+0000 7f0a5e67c740 1 -- 172.21.15.1:0/568557524 shutdown_connections 2024-09-21T00:58:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.687+0000 7f0a5e67c740 1 -- 172.21.15.1:0/568557524 wait complete. 2024-09-21T00:58:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.687+0000 7f0a5e67c740 20 client.15861 trim_cache size 0 max 16384 2024-09-21T00:58:06.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T00:58:06.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T00:58:06.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T00:58:06.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T00:58:06.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.687+0000 7f0a57630640 1 -- 172.21.15.1:0/3967106150 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f0a3c0b6510 msgr2=0x7f0a3c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:06.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.687+0000 7f0a57630640 1 --2- 172.21.15.1:0/3967106150 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f0a3c0b6510 0x7f0a3c0b8a20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0a480049d0 tx=0x7f0a480de560 comp rx=0 tx=0).stop 2024-09-21T00:58:06.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.687+0000 7f0a57630640 1 -- 172.21.15.1:0/3967106150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a50103fe0 msgr2=0x7f0a50104f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:06.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.687+0000 7f0a57630640 1 --2- 172.21.15.1:0/3967106150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a50103fe0 0x7f0a50104f90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f0a4800eb10 tx=0x7f0a4800c2d0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.687+0000 7f0a57630640 1 -- 172.21.15.1:0/3967106150 shutdown_connections 2024-09-21T00:58:06.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.687+0000 7f0a57630640 1 --2- 172.21.15.1:0/3967106150 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f0a3c0b6510 0x7f0a3c0b8a20 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.687+0000 7f0a57630640 1 --2- 172.21.15.1:0/3967106150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a50103fe0 0x7f0a50104f90 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.687+0000 7f0a57630640 1 --2- 172.21.15.1:0/3967106150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a50103640 0x7f0a50104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.687+0000 7f0a57630640 1 --2- 172.21.15.1:0/3967106150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0a501025c0 0x7f0a50106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:06.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.687+0000 7f0a57630640 1 -- 172.21.15.1:0/3967106150 >> 172.21.15.1:0/3967106150 conn(0x7f0a500fdf00 msgr2=0x7f0a500ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:06.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.687+0000 7f0a57630640 1 -- 172.21.15.1:0/3967106150 shutdown_connections 2024-09-21T00:58:06.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:06.687+0000 7f0a57630640 1 -- 172.21.15.1:0/3967106150 wait complete. 2024-09-21T00:58:07.088 INFO:tasks.workunit.client.0.smithi001.stderr:Updating files: 87% (11149/12697) Updating files: 88% (11174/12697) Updating files: 89% (11301/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-21T00:58:07.462 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T00:58:07.494 INFO:tasks.workunit.client.0.smithi001.stderr:Note: switching to '1843221895adccfb3b692060251dd6a0183bc410'. 2024-09-21T00:58:07.494 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-21T00:58:07.494 INFO:tasks.workunit.client.0.smithi001.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T00:58:07.495 INFO:tasks.workunit.client.0.smithi001.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T00:58:07.495 INFO:tasks.workunit.client.0.smithi001.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T00:58:07.495 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-21T00:58:07.495 INFO:tasks.workunit.client.0.smithi001.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T00:58:07.495 INFO:tasks.workunit.client.0.smithi001.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T00:58:07.495 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-21T00:58:07.495 INFO:tasks.workunit.client.0.smithi001.stderr: git switch -c 2024-09-21T00:58:07.495 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-21T00:58:07.495 INFO:tasks.workunit.client.0.smithi001.stderr:Or undo this operation with: 2024-09-21T00:58:07.495 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-21T00:58:07.495 INFO:tasks.workunit.client.0.smithi001.stderr: git switch - 2024-09-21T00:58:07.495 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-21T00:58:07.495 INFO:tasks.workunit.client.0.smithi001.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T00:58:07.495 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-21T00:58:07.496 INFO:tasks.workunit.client.0.smithi001.stderr:HEAD is now at 1843221895a Merge PR #56776 into wip-pdonnell-testing-20240920.212106-debug 2024-09-21T00:58:07.499 DEBUG:teuthology.orchestra.run.smithi001:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-21T00:58:07.561 INFO:tasks.workunit.client.0.smithi001.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T00:58:07.564 INFO:tasks.workunit.client.0.smithi001.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T00:58:07.564 INFO:tasks.workunit.client.0.smithi001.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T00:58:07.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:07 smithi001 ceph-mon[31211]: pgmap v385: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-21T00:58:07.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:07 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/3048016214' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:58:07.754 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:58:07.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:07 smithi193 ceph-mon[34660]: pgmap v385: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-21T00:58:07.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:07 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/3048016214' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:58:07.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:07 smithi042 ceph-mon[34481]: pgmap v385: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-21T00:58:07.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:07 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/3048016214' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:58:08.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.341+0000 7f1988dd6640 1 -- 172.21.15.1:0/967533309 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19841083d0 msgr2=0x7f19841087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:08.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.341+0000 7f1988dd6640 1 --2- 172.21.15.1:0/967533309 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19841083d0 0x7f19841087e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f1978009900 tx=0x7f197802a410 comp rx=0 tx=0).stop 2024-09-21T00:58:08.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.341+0000 7f1988dd6640 1 -- 172.21.15.1:0/967533309 shutdown_connections 2024-09-21T00:58:08.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.341+0000 7f1988dd6640 1 --2- 172.21.15.1:0/967533309 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1984108d20 0x7f198410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:08.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.341+0000 7f1988dd6640 1 --2- 172.21.15.1:0/967533309 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19841083d0 0x7f19841087e0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:08.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.341+0000 7f1988dd6640 1 --2- 172.21.15.1:0/967533309 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1984102ae0 0x7f1984102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:08.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.341+0000 7f1988dd6640 1 -- 172.21.15.1:0/967533309 >> 172.21.15.1:0/967533309 conn(0x7f1984079760 msgr2=0x7f1984079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:08.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.341+0000 7f1988dd6640 1 -- 172.21.15.1:0/967533309 shutdown_connections 2024-09-21T00:58:08.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.341+0000 7f1988dd6640 1 -- 172.21.15.1:0/967533309 wait complete. 2024-09-21T00:58:08.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.342+0000 7f1988dd6640 1 Processor -- start 2024-09-21T00:58:08.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.342+0000 7f1988dd6640 1 -- start start 2024-09-21T00:58:08.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.342+0000 7f1988dd6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1984102ae0 0x7f19840ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:08.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.342+0000 7f1988dd6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19841083d0 0x7f19840ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:08.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.342+0000 7f1988dd6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1984108d20 0x7f19841000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:08.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.342+0000 7f1988dd6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1984112990 con 0x7f1984102ae0 2024-09-21T00:58:08.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.342+0000 7f1988dd6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1984112810 con 0x7f1984108d20 2024-09-21T00:58:08.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.342+0000 7f1988dd6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1984112b10 con 0x7f19841083d0 2024-09-21T00:58:08.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.342+0000 7f198259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1984102ae0 0x7f19840ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:08.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.342+0000 7f198259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1984102ae0 0x7f19840ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59236/0 (socket says 172.21.15.1:59236) 2024-09-21T00:58:08.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.342+0000 7f198259c640 1 -- 172.21.15.1:0/269119271 learned_addr learned my addr 172.21.15.1:0/269119271 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:08.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.342+0000 7f1981d9b640 1 --2- 172.21.15.1:0/269119271 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19841083d0 0x7f19840ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:08.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.342+0000 7f1982d9d640 1 --2- 172.21.15.1:0/269119271 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1984108d20 0x7f19841000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:08.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.343+0000 7f198259c640 1 -- 172.21.15.1:0/269119271 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19841083d0 msgr2=0x7f19840ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:08.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.343+0000 7f198259c640 1 --2- 172.21.15.1:0/269119271 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19841083d0 0x7f19840ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:08.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.343+0000 7f198259c640 1 -- 172.21.15.1:0/269119271 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1984108d20 msgr2=0x7f19841000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:08.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.343+0000 7f198259c640 1 --2- 172.21.15.1:0/269119271 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1984108d20 0x7f19841000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:08.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.343+0000 7f198259c640 1 -- 172.21.15.1:0/269119271 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19841a8750 con 0x7f1984102ae0 2024-09-21T00:58:08.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.343+0000 7f198259c640 1 --2- 172.21.15.1:0/269119271 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1984102ae0 0x7f19840ff670 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f197400e9f0 tx=0x7f197400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:08.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.343+0000 7f19737fe640 1 -- 172.21.15.1:0/269119271 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f197400cd80 con 0x7f1984102ae0 2024-09-21T00:58:08.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.343+0000 7f1988dd6640 1 -- 172.21.15.1:0/269119271 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19841a8a40 con 0x7f1984102ae0 2024-09-21T00:58:08.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.343+0000 7f19737fe640 1 -- 172.21.15.1:0/269119271 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19740054d0 con 0x7f1984102ae0 2024-09-21T00:58:08.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.343+0000 7f19737fe640 1 -- 172.21.15.1:0/269119271 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1974010690 con 0x7f1984102ae0 2024-09-21T00:58:08.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.343+0000 7f1988dd6640 1 -- 172.21.15.1:0/269119271 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19841a8f50 con 0x7f1984102ae0 2024-09-21T00:58:08.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.346+0000 7f19737fe640 1 -- 172.21.15.1:0/269119271 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f1974004e90 con 0x7f1984102ae0 2024-09-21T00:58:08.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.346+0000 7f198f34a740 1 Processor -- start 2024-09-21T00:58:08.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.346+0000 7f198f34a740 1 -- start start 2024-09-21T00:58:08.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.346+0000 7f198f34a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bed1be7070 0x55bed1f8e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:08.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.346+0000 7f198f34a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bed1bbe1b0 0x55bed1f8e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:08.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.346+0000 7f198f34a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bed1bc6390 0x55bed1f8ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:08.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.346+0000 7f198f34a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55bed1f04ea0 con 0x55bed1bc6390 2024-09-21T00:58:08.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.346+0000 7f198f34a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55bed1ef42d0 con 0x55bed1be7070 2024-09-21T00:58:08.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.346+0000 7f198f34a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55bed1ef80e0 con 0x55bed1bbe1b0 2024-09-21T00:58:08.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.346+0000 7f1982d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bed1be7070 0x55bed1f8e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:08.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.346+0000 7f1981d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bed1bc6390 0x55bed1f8ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:08.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.347+0000 7f198259c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bed1bbe1b0 0x55bed1f8e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:08.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.347+0000 7f1982d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bed1be7070 0x55bed1f8e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:48082/0 (socket says 172.21.15.1:48082) 2024-09-21T00:58:08.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.347+0000 7f1982d9d640 1 -- 172.21.15.1:0/3286936205 learned_addr learned my addr 172.21.15.1:0/3286936205 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:08.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.347+0000 7f19737fe640 1 --2- 172.21.15.1:0/269119271 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f196c0b6510 0x7f196c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:08.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.347+0000 7f1981d9b640 1 -- 172.21.15.1:0/3286936205 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bed1bbe1b0 msgr2=0x55bed1f8e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:08.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.347+0000 7f1981d9b640 1 --2- 172.21.15.1:0/3286936205 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bed1bbe1b0 0x55bed1f8e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:08.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.347+0000 7f1981d9b640 1 -- 172.21.15.1:0/3286936205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bed1be7070 msgr2=0x55bed1f8e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:08.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.347+0000 7f1981d9b640 1 --2- 172.21.15.1:0/3286936205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bed1be7070 0x55bed1f8e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:08.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.347+0000 7f1981d9b640 1 -- 172.21.15.1:0/3286936205 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bed1c52650 con 0x55bed1bc6390 2024-09-21T00:58:08.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.347+0000 7f198259c640 1 --2- 172.21.15.1:0/3286936205 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bed1bbe1b0 0x55bed1f8e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:08.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.347+0000 7f1982d9d640 1 --2- 172.21.15.1:0/3286936205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bed1be7070 0x55bed1f8e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:08.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.347+0000 7f1982d9d640 1 --2- 172.21.15.1:0/269119271 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f196c0b6510 0x7f196c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:08.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.347+0000 7f19737fe640 1 -- 172.21.15.1:0/269119271 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f19740e7750 con 0x7f1984102ae0 2024-09-21T00:58:08.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.347+0000 7f1981d9b640 1 --2- 172.21.15.1:0/3286936205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bed1bc6390 0x55bed1f8ed40 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1978006010 tx=0x7f1978032b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b06a3f00dcf67b70 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:08.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.347+0000 7f1970ff9640 1 -- 172.21.15.1:0/3286936205 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1978040070 con 0x55bed1bc6390 2024-09-21T00:58:08.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.348+0000 7f1970ff9640 1 -- 172.21.15.1:0/3286936205 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1978004030 con 0x55bed1bc6390 2024-09-21T00:58:08.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.348+0000 7f1970ff9640 1 -- 172.21.15.1:0/3286936205 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1978035040 con 0x55bed1bc6390 2024-09-21T00:58:08.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.348+0000 7f198f34a740 1 -- 172.21.15.1:0/3286936205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bed1bc6390 msgr2=0x55bed1f8ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:08.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.348+0000 7f198f34a740 1 --2- 172.21.15.1:0/3286936205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bed1bc6390 0x55bed1f8ed40 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1978006010 tx=0x7f1978032b20 comp rx=0 tx=0).stop 2024-09-21T00:58:08.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.348+0000 7f1982d9d640 1 --2- 172.21.15.1:0/269119271 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f196c0b6510 0x7f196c0b8a20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f197c003df0 tx=0x7f197c004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:08.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.348+0000 7f198f34a740 1 -- 172.21.15.1:0/3286936205 shutdown_connections 2024-09-21T00:58:08.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.348+0000 7f198f34a740 1 --2- 172.21.15.1:0/3286936205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bed1bc6390 0x55bed1f8ed40 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:08.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.348+0000 7f198f34a740 1 --2- 172.21.15.1:0/3286936205 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bed1bbe1b0 0x55bed1f8e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:08.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.348+0000 7f198f34a740 1 --2- 172.21.15.1:0/3286936205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bed1be7070 0x55bed1f8e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:08.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.348+0000 7f198f34a740 1 -- 172.21.15.1:0/3286936205 >> 172.21.15.1:0/3286936205 conn(0x55bed1bdb460 msgr2=0x55bed1f8c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:08.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.349+0000 7f198f34a740 1 -- 172.21.15.1:0/3286936205 shutdown_connections 2024-09-21T00:58:08.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.349+0000 7f198f34a740 1 -- 172.21.15.1:0/3286936205 wait complete. 2024-09-21T00:58:08.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.349+0000 7f198f34a740 1 -- start start 2024-09-21T00:58:08.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.349+0000 7f198f34a740 1 Processor -- start 2024-09-21T00:58:08.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.349+0000 7f198f34a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bed1bbe1b0 0x55bed1f99960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:08.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.349+0000 7f198f34a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bed1bc6390 0x55bed1f99ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:08.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.349+0000 7f198f34a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bed1be7070 0x55bed1fa5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:08.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.349+0000 7f198f34a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55bed1d55700 con 0x55bed1bbe1b0 2024-09-21T00:58:08.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.349+0000 7f198f34a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55bed1e8f160 con 0x55bed1bc6390 2024-09-21T00:58:08.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.349+0000 7f198f34a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55bed1f9ca40 con 0x55bed1be7070 2024-09-21T00:58:08.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.349+0000 7f198f34a740 10 client.0 _ll_register_callbacks cb 0x55bed1ea89e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:08.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.350+0000 7f198259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bed1bbe1b0 0x55bed1f99960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:08.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.350+0000 7f198259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bed1bbe1b0 0x55bed1f99960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59256/0 (socket says 172.21.15.1:59256) 2024-09-21T00:58:08.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.350+0000 7f198259c640 1 -- 172.21.15.1:0/4180568319 learned_addr learned my addr 172.21.15.1:0/4180568319 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:08.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.350+0000 7f1981d9b640 1 --2- 172.21.15.1:0/4180568319 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bed1bc6390 0x55bed1f99ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:08.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.350+0000 7f1982d9d640 1 --2- 172.21.15.1:0/4180568319 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bed1be7070 0x55bed1fa5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:08.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.350+0000 7f198259c640 1 -- 172.21.15.1:0/4180568319 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bed1be7070 msgr2=0x55bed1fa5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:08.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.350+0000 7f198259c640 1 --2- 172.21.15.1:0/4180568319 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bed1be7070 0x55bed1fa5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:08.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.350+0000 7f198259c640 1 -- 172.21.15.1:0/4180568319 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bed1bc6390 msgr2=0x55bed1f99ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:08.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.350+0000 7f198259c640 1 --2- 172.21.15.1:0/4180568319 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bed1bc6390 0x55bed1f99ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:08.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.350+0000 7f198259c640 1 -- 172.21.15.1:0/4180568319 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bed1ebcc90 con 0x55bed1bbe1b0 2024-09-21T00:58:08.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.350+0000 7f198259c640 1 --2- 172.21.15.1:0/4180568319 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bed1bbe1b0 0x55bed1f99960 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f19740e79f0 tx=0x7f19740048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5609b75557a11e11 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:08.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.350+0000 7f1969ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:58:08.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.350+0000 7f1969ffb640 1 -- 172.21.15.1:0/4180568319 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19740ad1b0 con 0x55bed1bbe1b0 2024-09-21T00:58:08.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.350+0000 7f1969ffb640 1 -- 172.21.15.1:0/4180568319 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f19740e7b40 con 0x55bed1bbe1b0 2024-09-21T00:58:08.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.350+0000 7f198f34a740 1 -- 172.21.15.1:0/4180568319 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1978004030 con 0x55bed1bbe1b0 2024-09-21T00:58:08.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.350+0000 7f1969ffb640 1 -- 172.21.15.1:0/4180568319 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1974005180 con 0x55bed1bbe1b0 2024-09-21T00:58:08.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.350+0000 7f198f34a740 10 client.15873 fetch_fsmap learned FSMap version 27 2024-09-21T00:58:08.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.350+0000 7f198f34a740 1 -- 172.21.15.1:0/4180568319 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bed1fa8730 con 0x55bed1bbe1b0 2024-09-21T00:58:08.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.351+0000 7f1969ffb640 1 -- 172.21.15.1:0/4180568319 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1978004030 con 0x55bed1bbe1b0 2024-09-21T00:58:08.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.351+0000 7f1969ffb640 1 -- 172.21.15.1:0/4180568319 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f19740ac530 con 0x55bed1bbe1b0 2024-09-21T00:58:08.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.351+0000 7f198f34a740 10 client.15873 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:58:08.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.351+0000 7f198f34a740 10 client.15873 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T00:58:08.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.351+0000 7f198f34a740 20 client.15873 populate_metadata read hostname 'smithi001' 2024-09-21T00:58:08.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.351+0000 7f198f34a740 1 --2- 172.21.15.1:0/4180568319 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x55bed1ba59f0 0x55bed1fabaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:08.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.351+0000 7f198f34a740 4 client.15873 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:58:08.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.351+0000 7f198f34a740 1 -- 172.21.15.1:0/4180568319 --> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bed1f06df0 con 0x55bed1ba59f0 2024-09-21T00:58:08.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.351+0000 7f1981d9b640 1 --2- 172.21.15.1:0/4180568319 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x55bed1ba59f0 0x55bed1fabaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:08.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.351+0000 7f1969ffb640 10 client.15873 ms_handle_connect on v2:172.21.15.193:6834/3631682268 2024-09-21T00:58:08.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.351+0000 7f1981d9b640 1 --2- 172.21.15.1:0/4180568319 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x55bed1ba59f0 0x55bed1fabaf0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=caddc2221e74e468 server_cookie=d64b8cc11ae0df17 in_seq=0 out_seq=0 2024-09-21T00:58:08.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.352+0000 7f1969ffb640 1 -- 172.21.15.1:0/4180568319 <== mds.4 v2:172.21.15.193:6834/3631682268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bed1f06df0 con 0x55bed1ba59f0 2024-09-21T00:58:08.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.352+0000 7f1969ffb640 10 client.15873 handle_command_reply: tid=0 2024-09-21T00:58:08.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.352+0000 7f198f34a740 1 client.15873 shutdown 2024-09-21T00:58:08.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.352+0000 7f198f34a740 1 -- 172.21.15.1:0/4180568319 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bed1bbe1b0 msgr2=0x55bed1f99960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:08.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.352+0000 7f198f34a740 1 --2- 172.21.15.1:0/4180568319 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bed1bbe1b0 0x55bed1f99960 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f19740e79f0 tx=0x7f19740048f0 comp rx=0 tx=0).stop 2024-09-21T00:58:08.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.352+0000 7f198f34a740 1 -- 172.21.15.1:0/4180568319 shutdown_connections 2024-09-21T00:58:08.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.352+0000 7f198f34a740 1 --2- 172.21.15.1:0/4180568319 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x55bed1ba59f0 0x55bed1fabaf0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:08.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.352+0000 7f1969ffb640 0 client.15873 ms_handle_reset on v2:172.21.15.193:6834/3631682268 2024-09-21T00:58:08.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.352+0000 7f198f34a740 1 --2- 172.21.15.1:0/4180568319 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bed1be7070 0x55bed1fa5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:08.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.352+0000 7f198f34a740 1 --2- 172.21.15.1:0/4180568319 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bed1bc6390 0x55bed1f99ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:08.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.352+0000 7f198f34a740 1 --2- 172.21.15.1:0/4180568319 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bed1bbe1b0 0x55bed1f99960 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:08.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.352+0000 7f198f34a740 1 -- 172.21.15.1:0/4180568319 >> 172.21.15.1:0/4180568319 conn(0x55bed1bdb460 msgr2=0x55bed1f914a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:08.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.352+0000 7f198f34a740 1 -- 172.21.15.1:0/4180568319 shutdown_connections 2024-09-21T00:58:08.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.353+0000 7f198f34a740 1 -- 172.21.15.1:0/4180568319 wait complete. 2024-09-21T00:58:08.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.353+0000 7f198f34a740 20 client.15873 trim_cache size 0 max 16384 2024-09-21T00:58:08.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.367+0000 7f198f34a740 1 Processor -- start 2024-09-21T00:58:08.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.367+0000 7f198f34a740 1 -- start start 2024-09-21T00:58:08.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.367+0000 7f198f34a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bed1bbe1b0 0x55bed1f8fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:08.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.367+0000 7f198f34a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bed1bc6390 0x55bed1fa5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:08.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.367+0000 7f198f34a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bed1be7070 0x55bed1f9b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:08.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.367+0000 7f198f34a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f19841b1600 con 0x55bed1be7070 2024-09-21T00:58:08.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.367+0000 7f198f34a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f19841b3140 con 0x55bed1bc6390 2024-09-21T00:58:08.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.367+0000 7f198f34a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f19841b1cd0 con 0x55bed1bbe1b0 2024-09-21T00:58:08.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.367+0000 7f1982d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bed1be7070 0x55bed1f9b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:08.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.367+0000 7f1982d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bed1be7070 0x55bed1f9b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59270/0 (socket says 172.21.15.1:59270) 2024-09-21T00:58:08.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.367+0000 7f1982d9d640 1 -- 172.21.15.1:0/649106175 learned_addr learned my addr 172.21.15.1:0/649106175 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:08.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.367+0000 7f1981d9b640 1 --2- 172.21.15.1:0/649106175 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bed1bc6390 0x55bed1fa5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:08.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.367+0000 7f198259c640 1 --2- 172.21.15.1:0/649106175 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bed1bbe1b0 0x55bed1f8fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:08.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.367+0000 7f1982d9d640 1 -- 172.21.15.1:0/649106175 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bed1bbe1b0 msgr2=0x55bed1f8fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:08.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.367+0000 7f1982d9d640 1 --2- 172.21.15.1:0/649106175 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bed1bbe1b0 0x55bed1f8fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:08.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.367+0000 7f1982d9d640 1 -- 172.21.15.1:0/649106175 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bed1bc6390 msgr2=0x55bed1fa5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:08.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.367+0000 7f1982d9d640 1 --2- 172.21.15.1:0/649106175 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bed1bc6390 0x55bed1fa5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:08.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.368+0000 7f1982d9d640 1 -- 172.21.15.1:0/649106175 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bed1f875d0 con 0x55bed1be7070 2024-09-21T00:58:08.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.368+0000 7f1982d9d640 1 --2- 172.21.15.1:0/649106175 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bed1be7070 0x55bed1f9b330 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f197c0117c0 tx=0x7f197c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a78c3744aed2c05a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:08.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.368+0000 7f196bfff640 1 -- 172.21.15.1:0/649106175 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f197c004b20 con 0x55bed1be7070 2024-09-21T00:58:08.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.368+0000 7f196bfff640 1 -- 172.21.15.1:0/649106175 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f197c004cc0 con 0x55bed1be7070 2024-09-21T00:58:08.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.368+0000 7f196bfff640 1 -- 172.21.15.1:0/649106175 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f197c0054e0 con 0x55bed1be7070 2024-09-21T00:58:08.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.369+0000 7f198f34a740 1 -- 172.21.15.1:0/649106175 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bed1be7070 msgr2=0x55bed1f9b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:08.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.369+0000 7f198f34a740 1 --2- 172.21.15.1:0/649106175 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bed1be7070 0x55bed1f9b330 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f197c0117c0 tx=0x7f197c019000 comp rx=0 tx=0).stop 2024-09-21T00:58:08.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.369+0000 7f198f34a740 1 -- 172.21.15.1:0/649106175 shutdown_connections 2024-09-21T00:58:08.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.369+0000 7f198f34a740 1 --2- 172.21.15.1:0/649106175 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bed1be7070 0x55bed1f9b330 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:08.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.369+0000 7f198f34a740 1 --2- 172.21.15.1:0/649106175 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bed1bc6390 0x55bed1fa5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:08.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.369+0000 7f198f34a740 1 --2- 172.21.15.1:0/649106175 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bed1bbe1b0 0x55bed1f8fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:08.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.369+0000 7f198f34a740 1 -- 172.21.15.1:0/649106175 >> 172.21.15.1:0/649106175 conn(0x55bed1bdb460 msgr2=0x55bed1f9ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:08.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.369+0000 7f198f34a740 1 -- 172.21.15.1:0/649106175 shutdown_connections 2024-09-21T00:58:08.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.369+0000 7f198f34a740 1 -- 172.21.15.1:0/649106175 wait complete. 2024-09-21T00:58:08.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.369+0000 7f198f34a740 1 -- start start 2024-09-21T00:58:08.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.369+0000 7f198f34a740 1 Processor -- start 2024-09-21T00:58:08.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.370+0000 7f198f34a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bed1bbe1b0 0x55bed1f9dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:08.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.370+0000 7f198f34a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bed1bc6390 0x55bed1f9e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:08.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.370+0000 7f198f34a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bed1be7070 0x55bed1f9e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:08.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.370+0000 7f198f34a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f19841b2a70 con 0x55bed1bc6390 2024-09-21T00:58:08.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.370+0000 7f198f34a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f19841b23a0 con 0x55bed1bbe1b0 2024-09-21T00:58:08.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.370+0000 7f198f34a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f19841af5e0 con 0x55bed1be7070 2024-09-21T00:58:08.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.370+0000 7f198f34a740 10 client.0 _ll_register_callbacks cb 0x7f19740ed220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:08.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.370+0000 7f1981d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bed1bc6390 0x55bed1f9e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:08.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.370+0000 7f198259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bed1bbe1b0 0x55bed1f9dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:08.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.370+0000 7f1981d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bed1bc6390 0x55bed1f9e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59280/0 (socket says 172.21.15.1:59280) 2024-09-21T00:58:08.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.370+0000 7f1981d9b640 1 -- 172.21.15.1:0/500030096 learned_addr learned my addr 172.21.15.1:0/500030096 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:08.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.370+0000 7f1982d9d640 1 --2- 172.21.15.1:0/500030096 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bed1be7070 0x55bed1f9e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:08.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.370+0000 7f198259c640 1 -- 172.21.15.1:0/500030096 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bed1be7070 msgr2=0x55bed1f9e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:08.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.370+0000 7f198259c640 1 --2- 172.21.15.1:0/500030096 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bed1be7070 0x55bed1f9e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:08.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.370+0000 7f198259c640 1 -- 172.21.15.1:0/500030096 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bed1bc6390 msgr2=0x55bed1f9e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:08.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.370+0000 7f198259c640 1 --2- 172.21.15.1:0/500030096 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bed1bc6390 0x55bed1f9e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:08.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.370+0000 7f198259c640 1 -- 172.21.15.1:0/500030096 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bed20155b0 con 0x55bed1bbe1b0 2024-09-21T00:58:08.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.370+0000 7f1982d9d640 1 --2- 172.21.15.1:0/500030096 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bed1be7070 0x55bed1f9e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:58:08.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.370+0000 7f1981d9b640 1 --2- 172.21.15.1:0/500030096 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bed1bc6390 0x55bed1f9e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:08.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.370+0000 7f198259c640 1 --2- 172.21.15.1:0/500030096 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bed1bbe1b0 0x55bed1f9dd90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f19740aaad0 tx=0x7f19740ad6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=997c863116ac4625 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:08.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.370+0000 7f1969ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T00:58:08.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.371+0000 7f1969ffb640 1 -- 172.21.15.1:0/500030096 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19740acfd0 con 0x55bed1bbe1b0 2024-09-21T00:58:08.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.371+0000 7f1969ffb640 1 -- 172.21.15.1:0/500030096 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f19740aeb90 con 0x55bed1bbe1b0 2024-09-21T00:58:08.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.371+0000 7f198f34a740 1 -- 172.21.15.1:0/500030096 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f197c004cc0 con 0x55bed1bbe1b0 2024-09-21T00:58:08.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.371+0000 7f1969ffb640 1 -- 172.21.15.1:0/500030096 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f19740ad1b0 con 0x55bed1bbe1b0 2024-09-21T00:58:08.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.371+0000 7f198f34a740 10 client.25556 fetch_fsmap learned FSMap version 27 2024-09-21T00:58:08.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.371+0000 7f198f34a740 1 -- 172.21.15.1:0/500030096 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bed2016830 con 0x55bed1bbe1b0 2024-09-21T00:58:08.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.371+0000 7f1969ffb640 1 -- 172.21.15.1:0/500030096 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f197c004cc0 con 0x55bed1bbe1b0 2024-09-21T00:58:08.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.371+0000 7f1969ffb640 1 -- 172.21.15.1:0/500030096 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f19740cf300 con 0x55bed1bbe1b0 2024-09-21T00:58:08.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.371+0000 7f198f34a740 10 client.25556 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:58:08.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.371+0000 7f198f34a740 10 client.25556 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T00:58:08.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.371+0000 7f198f34a740 20 client.25556 populate_metadata read hostname 'smithi001' 2024-09-21T00:58:08.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.371+0000 7f198f34a740 1 --2- 172.21.15.1:0/500030096 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x55bed1b7ada0 0x55bed2018ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:08.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.371+0000 7f198f34a740 4 client.25556 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:58:08.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.371+0000 7f198f34a740 1 -- 172.21.15.1:0/500030096 --> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bed1f9a250 con 0x55bed1b7ada0 2024-09-21T00:58:08.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.372+0000 7f1981d9b640 1 --2- 172.21.15.1:0/500030096 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x55bed1b7ada0 0x55bed2018ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:08.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.372+0000 7f1981d9b640 1 --2- 172.21.15.1:0/500030096 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x55bed1b7ada0 0x55bed2018ff0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5fab129eb1fc27b1 server_cookie=2c1586cec23553b5 in_seq=0 out_seq=0 2024-09-21T00:58:08.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.372+0000 7f1969ffb640 10 client.25556 ms_handle_connect on v2:172.21.15.193:6834/3631682268 2024-09-21T00:58:08.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.372+0000 7f1969ffb640 1 -- 172.21.15.1:0/500030096 <== mds.4 v2:172.21.15.193:6834/3631682268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bed1f9a250 con 0x55bed1b7ada0 2024-09-21T00:58:08.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.372+0000 7f1969ffb640 10 client.25556 handle_command_reply: tid=0 2024-09-21T00:58:08.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.372+0000 7f198f34a740 1 client.25556 shutdown 2024-09-21T00:58:08.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.372+0000 7f198f34a740 1 -- 172.21.15.1:0/500030096 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bed1bbe1b0 msgr2=0x55bed1f9dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:08.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.372+0000 7f198f34a740 1 --2- 172.21.15.1:0/500030096 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bed1bbe1b0 0x55bed1f9dd90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f19740aaad0 tx=0x7f19740ad6f0 comp rx=0 tx=0).stop 2024-09-21T00:58:08.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.372+0000 7f198f34a740 1 -- 172.21.15.1:0/500030096 shutdown_connections 2024-09-21T00:58:08.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.372+0000 7f198f34a740 1 --2- 172.21.15.1:0/500030096 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x55bed1b7ada0 0x55bed2018ff0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:08.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.372+0000 7f198f34a740 1 --2- 172.21.15.1:0/500030096 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bed1be7070 0x55bed1f9e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:08.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.372+0000 7f198f34a740 1 --2- 172.21.15.1:0/500030096 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bed1bc6390 0x55bed1f9e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:08.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.372+0000 7f1969ffb640 0 client.25556 ms_handle_reset on v2:172.21.15.193:6834/3631682268 2024-09-21T00:58:08.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.372+0000 7f198f34a740 1 --2- 172.21.15.1:0/500030096 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bed1bbe1b0 0x55bed1f9dd90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:08.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.372+0000 7f198f34a740 1 -- 172.21.15.1:0/500030096 >> 172.21.15.1:0/500030096 conn(0x55bed1bdb460 msgr2=0x55bed1f9b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:08.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.373+0000 7f198f34a740 1 -- 172.21.15.1:0/500030096 shutdown_connections 2024-09-21T00:58:08.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.373+0000 7f198f34a740 1 -- 172.21.15.1:0/500030096 wait complete. 2024-09-21T00:58:08.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.373+0000 7f198f34a740 20 client.25556 trim_cache size 0 max 16384 2024-09-21T00:58:08.384 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T00:58:08.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.373+0000 7f1988dd6640 1 -- 172.21.15.1:0/269119271 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f196c0b6510 msgr2=0x7f196c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:08.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.373+0000 7f1988dd6640 1 --2- 172.21.15.1:0/269119271 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f196c0b6510 0x7f196c0b8a20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f197c003df0 tx=0x7f197c004a40 comp rx=0 tx=0).stop 2024-09-21T00:58:08.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.373+0000 7f1988dd6640 1 -- 172.21.15.1:0/269119271 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1984102ae0 msgr2=0x7f19840ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:08.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.373+0000 7f1988dd6640 1 --2- 172.21.15.1:0/269119271 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1984102ae0 0x7f19840ff670 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f197400e9f0 tx=0x7f197400edf0 comp rx=0 tx=0).stop 2024-09-21T00:58:08.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.373+0000 7f1988dd6640 1 -- 172.21.15.1:0/269119271 shutdown_connections 2024-09-21T00:58:08.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.373+0000 7f1988dd6640 1 --2- 172.21.15.1:0/269119271 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1984108d20 0x7f19841000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:08.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.373+0000 7f1988dd6640 1 --2- 172.21.15.1:0/269119271 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19841083d0 0x7f19840ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:08.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.373+0000 7f1988dd6640 1 --2- 172.21.15.1:0/269119271 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f196c0b6510 0x7f196c0b8a20 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:08.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.373+0000 7f1988dd6640 1 --2- 172.21.15.1:0/269119271 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1984102ae0 0x7f19840ff670 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:08.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.373+0000 7f1988dd6640 1 -- 172.21.15.1:0/269119271 >> 172.21.15.1:0/269119271 conn(0x7f1984079760 msgr2=0x7f1984101b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:08.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.373+0000 7f1988dd6640 1 -- 172.21.15.1:0/269119271 shutdown_connections 2024-09-21T00:58:08.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:08.373+0000 7f1988dd6640 1 -- 172.21.15.1:0/269119271 wait complete. 2024-09-21T00:58:08.949 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:08 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:58:08.949 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:08 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:58:08.949 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:08 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:58:08.949 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:08 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:58:08.949 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:08 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:58:08.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:08 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:58:08.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:08 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:58:08.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:08 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:58:08.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:08 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:58:08.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:08 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:58:08.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:08 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:58:08.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:08 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:58:08.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:08 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:58:08.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:08 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:58:08.994 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:08 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:58:09.062 INFO:tasks.workunit.client.0.smithi001.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T00:58:09.162 INFO:tasks.workunit.client.0.smithi001.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T00:58:09.203 INFO:tasks.workunit.client.0.smithi001.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T00:58:09.204 INFO:tasks.workunit.client.0.smithi001.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T00:58:09.205 INFO:tasks.workunit.client.0.smithi001.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T00:58:09.245 INFO:tasks.workunit.client.0.smithi001.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T00:58:09.248 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-21T00:58:09.248 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-21T00:58:09.305 INFO:tasks.workunit:Running workunits matching suites/blogbench.sh on client.0... 2024-09-21T00:58:09.307 INFO:tasks.workunit:Running workunit suites/blogbench.sh... 2024-09-21T00:58:09.307 DEBUG:teuthology.orchestra.run.smithi001:workunit test suites/blogbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/blogbench.sh 2024-09-21T00:58:09.368 INFO:tasks.workunit.client.0.smithi001.stdout:getting blogbench 2024-09-21T00:58:09.368 INFO:tasks.workunit.client.0.smithi001.stderr:+ echo 'getting blogbench' 2024-09-21T00:58:09.368 INFO:tasks.workunit.client.0.smithi001.stderr:+ wget http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-09-21T00:58:09.432 INFO:tasks.workunit.client.0.smithi001.stderr:--2024-09-21 00:58:09-- http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-09-21T00:58:09.433 INFO:tasks.workunit.client.0.smithi001.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-09-21T00:58:09.447 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T00:58:09.454 INFO:tasks.workunit.client.0.smithi001.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-09-21T00:58:09.475 INFO:tasks.workunit.client.0.smithi001.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-21T00:58:09.475 INFO:tasks.workunit.client.0.smithi001.stderr:Length: 103355 (101K) [application/octet-stream] 2024-09-21T00:58:09.476 INFO:tasks.workunit.client.0.smithi001.stderr:Saving to: ‘blogbench-1.0.tar.bz2’ 2024-09-21T00:58:09.479 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-21T00:58:09.516 INFO:tasks.workunit.client.0.smithi001.stderr: 0K .......... .......... .......... .......... .......... 49% 1.23M 0s 2024-09-21T00:58:09.556 INFO:tasks.workunit.client.0.smithi001.stderr: 50K .......... .......... .......... .......... .......... 99% 2.38M 0s 2024-09-21T00:58:09.557 INFO:tasks.workunit.client.0.smithi001.stderr: 100K 100% 46.0K=0.08s 2024-09-21T00:58:09.557 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-21T00:58:09.557 INFO:tasks.workunit.client.0.smithi001.stderr:2024-09-21 00:58:09 (1.22 MB/s) - ‘blogbench-1.0.tar.bz2’ saved [103355/103355] 2024-09-21T00:58:09.557 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-21T00:58:09.557 INFO:tasks.workunit.client.0.smithi001.stderr:+ tar -xvf blogbench-1.0.tar.bz2 2024-09-21T00:58:09.580 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/ 2024-09-21T00:58:09.581 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/m4/ 2024-09-21T00:58:09.582 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/m4/acx_pthread.m4 2024-09-21T00:58:09.583 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/man/ 2024-09-21T00:58:09.584 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/man/blogbench.8 2024-09-21T00:58:09.584 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/man/Makefile.am 2024-09-21T00:58:09.585 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/man/Makefile.in 2024-09-21T00:58:09.586 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/src/ 2024-09-21T00:58:09.587 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/src/mysnprintf.c 2024-09-21T00:58:09.588 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/src/mysnprintf.h 2024-09-21T00:58:09.589 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/src/blogbench.c 2024-09-21T00:58:09.590 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/src/blogbench.h 2024-09-21T00:58:09.591 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/src/fakesnprintf.c 2024-09-21T00:58:09.592 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/src/fakesnprintf.h 2024-09-21T00:58:09.593 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/src/blogbench_p.h 2024-09-21T00:58:09.594 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/src/bsd-getopt_long.c 2024-09-21T00:58:09.595 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/src/bsd-getopt_long.h 2024-09-21T00:58:09.596 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/src/Makefile.am 2024-09-21T00:58:09.596 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/src/Makefile.in 2024-09-21T00:58:09.597 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/src/process.c 2024-09-21T00:58:09.598 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/src/globals.h 2024-09-21T00:58:09.599 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/src/commenter.c 2024-09-21T00:58:09.600 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/src/rewriter.c 2024-09-21T00:58:09.601 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/src/reader.c 2024-09-21T00:58:09.602 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/src/writer.c 2024-09-21T00:58:09.603 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/src/helpers.c 2024-09-21T00:58:09.604 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/NEWS 2024-09-21T00:58:09.606 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/compile 2024-09-21T00:58:09.606 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/depcomp 2024-09-21T00:58:09.606 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/aclocal.m4 2024-09-21T00:58:09.607 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/README 2024-09-21T00:58:09.608 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/configure 2024-09-21T00:58:09.613 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/configure.ac 2024-09-21T00:58:09.614 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/config.guess 2024-09-21T00:58:09.615 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/install-sh 2024-09-21T00:58:09.615 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/config.sub 2024-09-21T00:58:09.616 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/missing 2024-09-21T00:58:09.617 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/mkinstalldirs 2024-09-21T00:58:09.618 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/Makefile.am 2024-09-21T00:58:09.619 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/Makefile.in 2024-09-21T00:58:09.620 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/config.h.in 2024-09-21T00:58:09.621 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/AUTHORS 2024-09-21T00:58:09.621 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/INSTALL 2024-09-21T00:58:09.622 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/ChangeLog 2024-09-21T00:58:09.623 INFO:tasks.workunit.client.0.smithi001.stdout:blogbench-1.0/COPYING 2024-09-21T00:58:09.624 INFO:tasks.workunit.client.0.smithi001.stderr:+ cd blogbench-1.0/ 2024-09-21T00:58:09.625 INFO:tasks.workunit.client.0.smithi001.stdout:making blogbench 2024-09-21T00:58:09.625 INFO:tasks.workunit.client.0.smithi001.stderr:+ echo 'making blogbench' 2024-09-21T00:58:09.625 INFO:tasks.workunit.client.0.smithi001.stderr:+ ./configure 2024-09-21T00:58:09.724 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:58:09.729 INFO:tasks.workunit.client.0.smithi001.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-21T00:58:09.976 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:09 smithi001 ceph-mon[31211]: pgmap v386: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-21T00:58:09.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:09 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:58:09.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:09 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:58:09.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:09 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:58:09.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:09 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:58:09.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:09 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:58:09.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:09 smithi193 ceph-mon[34660]: pgmap v386: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-21T00:58:09.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:09 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:58:09.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:09 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:58:09.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:09 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:58:09.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:09 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:58:09.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:09 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:58:09.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:09 smithi042 ceph-mon[34481]: pgmap v386: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-21T00:58:09.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:09 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:58:09.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:09 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:58:09.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:09 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:58:09.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:09 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:58:09.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:09 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:58:10.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.178+0000 7f04e46af640 1 -- 172.21.15.1:0/531044090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04dc1049e0 msgr2=0x7f04dc104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:10.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.178+0000 7f04e46af640 1 --2- 172.21.15.1:0/531044090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04dc1049e0 0x7f04dc104df0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f04d8009900 tx=0x7f04d802a410 comp rx=0 tx=0).stop 2024-09-21T00:58:10.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.178+0000 7f04e46af640 1 -- 172.21.15.1:0/531044090 shutdown_connections 2024-09-21T00:58:10.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.178+0000 7f04e46af640 1 --2- 172.21.15.1:0/531044090 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04dc10de40 0x7f04dc110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.178+0000 7f04e46af640 1 --2- 172.21.15.1:0/531044090 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04dc105330 0x7f04dc10d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.178+0000 7f04e46af640 1 --2- 172.21.15.1:0/531044090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04dc1049e0 0x7f04dc104df0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.178+0000 7f04e46af640 1 -- 172.21.15.1:0/531044090 >> 172.21.15.1:0/531044090 conn(0x7f04dc079750 msgr2=0x7f04dc079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:10.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.178+0000 7f04e46af640 1 -- 172.21.15.1:0/531044090 shutdown_connections 2024-09-21T00:58:10.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.178+0000 7f04e46af640 1 -- 172.21.15.1:0/531044090 wait complete. 2024-09-21T00:58:10.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.179+0000 7f04e46af640 1 Processor -- start 2024-09-21T00:58:10.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.179+0000 7f04e46af640 1 -- start start 2024-09-21T00:58:10.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.179+0000 7f04e46af640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04dc1049e0 0x7f04dc19a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:10.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.179+0000 7f04e46af640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04dc105330 0x7f04dc19aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:10.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.179+0000 7f04e46af640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04dc10de40 0x7f04dc19fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:10.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.179+0000 7f04e46af640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f04dc113ac0 con 0x7f04dc1049e0 2024-09-21T00:58:10.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.179+0000 7f04e46af640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f04dc113940 con 0x7f04dc105330 2024-09-21T00:58:10.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.179+0000 7f04e46af640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f04dc113c40 con 0x7f04dc10de40 2024-09-21T00:58:10.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.179+0000 7f04e244b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04dc1049e0 0x7f04dc19a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:10.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.179+0000 7f04e244b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04dc1049e0 0x7f04dc19a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50290/0 (socket says 172.21.15.1:50290) 2024-09-21T00:58:10.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.179+0000 7f04e244b640 1 -- 172.21.15.1:0/2460465892 learned_addr learned my addr 172.21.15.1:0/2460465892 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:10.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.180+0000 7f04e2c4c640 1 --2- 172.21.15.1:0/2460465892 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04dc10de40 0x7f04dc19fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:10.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.180+0000 7f04e1c4a640 1 --2- 172.21.15.1:0/2460465892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04dc105330 0x7f04dc19aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:10.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.180+0000 7f04e244b640 1 -- 172.21.15.1:0/2460465892 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04dc10de40 msgr2=0x7f04dc19fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:10.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.180+0000 7f04e244b640 1 --2- 172.21.15.1:0/2460465892 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04dc10de40 0x7f04dc19fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.180+0000 7f04e244b640 1 -- 172.21.15.1:0/2460465892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04dc105330 msgr2=0x7f04dc19aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:10.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.180+0000 7f04e244b640 1 --2- 172.21.15.1:0/2460465892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04dc105330 0x7f04dc19aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.180+0000 7f04e244b640 1 -- 172.21.15.1:0/2460465892 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04dc1a0480 con 0x7f04dc1049e0 2024-09-21T00:58:10.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.180+0000 7f04e2c4c640 1 --2- 172.21.15.1:0/2460465892 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04dc10de40 0x7f04dc19fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:58:10.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.180+0000 7f04e244b640 1 --2- 172.21.15.1:0/2460465892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04dc1049e0 0x7f04dc19a510 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f04d8032fd0 tx=0x7f04d8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:10.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.180+0000 7f04d37fe640 1 -- 172.21.15.1:0/2460465892 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d803f030 con 0x7f04dc1049e0 2024-09-21T00:58:10.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.180+0000 7f04d37fe640 1 -- 172.21.15.1:0/2460465892 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04d8004490 con 0x7f04dc1049e0 2024-09-21T00:58:10.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.180+0000 7f04d37fe640 1 -- 172.21.15.1:0/2460465892 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d8035070 con 0x7f04dc1049e0 2024-09-21T00:58:10.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.180+0000 7f04e46af640 1 -- 172.21.15.1:0/2460465892 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04dc1a0710 con 0x7f04dc1049e0 2024-09-21T00:58:10.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.180+0000 7f04e46af640 1 -- 172.21.15.1:0/2460465892 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04dc1a6ed0 con 0x7f04dc1049e0 2024-09-21T00:58:10.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.183+0000 7f04eac23740 1 Processor -- start 2024-09-21T00:58:10.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.184+0000 7f04eac23740 1 -- start start 2024-09-21T00:58:10.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.184+0000 7f04eac23740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d37eb5070 0x560d3825c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:10.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.184+0000 7f04eac23740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d37e8c1b0 0x560d3825cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:10.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.184+0000 7f04eac23740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d37e94390 0x560d3825d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:10.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.184+0000 7f04eac23740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560d381d2ea0 con 0x560d37e94390 2024-09-21T00:58:10.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.184+0000 7f04d37fe640 1 -- 172.21.15.1:0/2460465892 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f04d8042030 con 0x7f04dc1049e0 2024-09-21T00:58:10.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.184+0000 7f04eac23740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560d381c22d0 con 0x560d37eb5070 2024-09-21T00:58:10.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.184+0000 7f04eac23740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560d381c60e0 con 0x560d37e8c1b0 2024-09-21T00:58:10.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.184+0000 7f04e1c4a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d37e94390 0x560d3825d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:10.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.184+0000 7f04e1c4a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d37e94390 0x560d3825d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50296/0 (socket says 172.21.15.1:50296) 2024-09-21T00:58:10.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.184+0000 7f04e1c4a640 1 -- 172.21.15.1:0/499389837 learned_addr learned my addr 172.21.15.1:0/499389837 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:10.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.184+0000 7f04e244b640 1 --2- 172.21.15.1:0/499389837 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d37e8c1b0 0x560d3825cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:10.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.184+0000 7f04e2c4c640 1 --2- 172.21.15.1:0/499389837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d37eb5070 0x560d3825c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:10.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.185+0000 7f04e1c4a640 1 -- 172.21.15.1:0/499389837 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d37e8c1b0 msgr2=0x560d3825cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:10.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.185+0000 7f04e1c4a640 1 --2- 172.21.15.1:0/499389837 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d37e8c1b0 0x560d3825cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.185+0000 7f04e1c4a640 1 -- 172.21.15.1:0/499389837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d37eb5070 msgr2=0x560d3825c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:10.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.185+0000 7f04e1c4a640 1 --2- 172.21.15.1:0/499389837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d37eb5070 0x560d3825c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.185+0000 7f04e1c4a640 1 -- 172.21.15.1:0/499389837 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d37f20650 con 0x560d37e94390 2024-09-21T00:58:10.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.185+0000 7f04e244b640 1 --2- 172.21.15.1:0/499389837 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d37e8c1b0 0x560d3825cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:58:10.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.185+0000 7f04e1c4a640 1 --2- 172.21.15.1:0/499389837 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d37e94390 0x560d3825d120 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f04cc00bc20 tx=0x7f04cc00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f48394ed83426219 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:10.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.185+0000 7f04d37fe640 1 --2- 172.21.15.1:0/2460465892 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f04c80b6510 0x7f04c80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:10.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.185+0000 7f04d0ff9640 1 -- 172.21.15.1:0/499389837 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04cc015070 con 0x560d37e94390 2024-09-21T00:58:10.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.185+0000 7f04d0ff9640 1 -- 172.21.15.1:0/499389837 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04cc01a910 con 0x560d37e94390 2024-09-21T00:58:10.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.185+0000 7f04e2c4c640 1 --2- 172.21.15.1:0/2460465892 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f04c80b6510 0x7f04c80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:10.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.185+0000 7f04d0ff9640 1 -- 172.21.15.1:0/499389837 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04cc0119a0 con 0x560d37e94390 2024-09-21T00:58:10.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.185+0000 7f04d37fe640 1 -- 172.21.15.1:0/2460465892 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f04d81078d0 con 0x7f04dc1049e0 2024-09-21T00:58:10.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.186+0000 7f04eac23740 1 -- 172.21.15.1:0/499389837 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d37e94390 msgr2=0x560d3825d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:10.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.186+0000 7f04e2c4c640 1 --2- 172.21.15.1:0/2460465892 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f04c80b6510 0x7f04c80b8a20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f04d400af80 tx=0x7f04d400a730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:10.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.186+0000 7f04eac23740 1 --2- 172.21.15.1:0/499389837 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d37e94390 0x560d3825d120 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f04cc00bc20 tx=0x7f04cc00f730 comp rx=0 tx=0).stop 2024-09-21T00:58:10.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.186+0000 7f04eac23740 1 -- 172.21.15.1:0/499389837 shutdown_connections 2024-09-21T00:58:10.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.186+0000 7f04eac23740 1 --2- 172.21.15.1:0/499389837 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d37e94390 0x560d3825d120 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.186+0000 7f04eac23740 1 --2- 172.21.15.1:0/499389837 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d37e8c1b0 0x560d3825cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.186+0000 7f04eac23740 1 --2- 172.21.15.1:0/499389837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d37eb5070 0x560d3825c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.186+0000 7f04eac23740 1 -- 172.21.15.1:0/499389837 >> 172.21.15.1:0/499389837 conn(0x560d37ea9460 msgr2=0x560d3825a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:10.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.186+0000 7f04eac23740 1 -- 172.21.15.1:0/499389837 shutdown_connections 2024-09-21T00:58:10.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.187+0000 7f04eac23740 1 -- 172.21.15.1:0/499389837 wait complete. 2024-09-21T00:58:10.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.187+0000 7f04eac23740 1 -- start start 2024-09-21T00:58:10.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.187+0000 7f04eac23740 1 Processor -- start 2024-09-21T00:58:10.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.187+0000 7f04eac23740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d37e8c1b0 0x560d38267d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:10.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.187+0000 7f04eac23740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d37e94390 0x560d382682b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:10.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.187+0000 7f04eac23740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d37eb5070 0x560d382785b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:10.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.187+0000 7f04eac23740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560d38023700 con 0x560d37e94390 2024-09-21T00:58:10.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.187+0000 7f04eac23740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560d3815d160 con 0x560d37e8c1b0 2024-09-21T00:58:10.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.187+0000 7f04eac23740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560d3826f290 con 0x560d37eb5070 2024-09-21T00:58:10.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.188+0000 7f04eac23740 10 client.0 _ll_register_callbacks cb 0x560d381769e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:10.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.188+0000 7f04e1c4a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d37e94390 0x560d382682b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:10.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.188+0000 7f04e1c4a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d37e94390 0x560d382682b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50310/0 (socket says 172.21.15.1:50310) 2024-09-21T00:58:10.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.188+0000 7f04e1c4a640 1 -- 172.21.15.1:0/4148304483 learned_addr learned my addr 172.21.15.1:0/4148304483 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:10.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.188+0000 7f04e244b640 1 --2- 172.21.15.1:0/4148304483 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d37e8c1b0 0x560d38267d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:10.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.188+0000 7f04e2c4c640 1 --2- 172.21.15.1:0/4148304483 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d37eb5070 0x560d382785b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:10.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.188+0000 7f04e1c4a640 1 -- 172.21.15.1:0/4148304483 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d37eb5070 msgr2=0x560d382785b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:10.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.188+0000 7f04e1c4a640 1 --2- 172.21.15.1:0/4148304483 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d37eb5070 0x560d382785b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.188+0000 7f04e1c4a640 1 -- 172.21.15.1:0/4148304483 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d37e8c1b0 msgr2=0x560d38267d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:10.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.188+0000 7f04e1c4a640 1 --2- 172.21.15.1:0/4148304483 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d37e8c1b0 0x560d38267d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.188+0000 7f04e1c4a640 1 -- 172.21.15.1:0/4148304483 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d3818ac90 con 0x560d37e94390 2024-09-21T00:58:10.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.188+0000 7f04e2c4c640 1 --2- 172.21.15.1:0/4148304483 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d37eb5070 0x560d382785b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:58:10.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.188+0000 7f04e1c4a640 1 --2- 172.21.15.1:0/4148304483 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d37e94390 0x560d382682b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f04cc0115c0 tx=0x7f04cc00bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1adf2c85f84bcdf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:10.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.188+0000 7f04c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:58:10.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.188+0000 7f04c5ffb640 1 -- 172.21.15.1:0/4148304483 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04cc028060 con 0x560d37e94390 2024-09-21T00:58:10.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.188+0000 7f04c5ffb640 1 -- 172.21.15.1:0/4148304483 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f04cc01acc0 con 0x560d37e94390 2024-09-21T00:58:10.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.188+0000 7f04eac23740 1 -- 172.21.15.1:0/4148304483 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04cc01a910 con 0x560d37e94390 2024-09-21T00:58:10.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.189+0000 7f04c5ffb640 1 -- 172.21.15.1:0/4148304483 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f04cc015040 con 0x560d37e94390 2024-09-21T00:58:10.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.189+0000 7f04eac23740 10 client.15891 fetch_fsmap learned FSMap version 27 2024-09-21T00:58:10.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.189+0000 7f04eac23740 1 -- 172.21.15.1:0/4148304483 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560d3827afe0 con 0x560d37e94390 2024-09-21T00:58:10.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.189+0000 7f04c5ffb640 1 -- 172.21.15.1:0/4148304483 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04cc01a910 con 0x560d37e94390 2024-09-21T00:58:10.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.189+0000 7f04c5ffb640 1 -- 172.21.15.1:0/4148304483 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f04cc022030 con 0x560d37e94390 2024-09-21T00:58:10.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.189+0000 7f04eac23740 10 client.15891 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:58:10.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.189+0000 7f04eac23740 10 client.15891 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-21T00:58:10.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.189+0000 7f04eac23740 20 client.15891 populate_metadata read hostname 'smithi001' 2024-09-21T00:58:10.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.189+0000 7f04eac23740 1 --2- 172.21.15.1:0/4148304483 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x560d37e739f0 0x560d3827e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:10.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.189+0000 7f04eac23740 4 client.15891 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:58:10.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.189+0000 7f04eac23740 1 -- 172.21.15.1:0/4148304483 --> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d381d4df0 con 0x560d37e739f0 2024-09-21T00:58:10.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.189+0000 7f04e244b640 1 --2- 172.21.15.1:0/4148304483 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x560d37e739f0 0x560d3827e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:10.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.190+0000 7f04c5ffb640 10 client.15891 ms_handle_connect on v2:172.21.15.193:6836/909252228 2024-09-21T00:58:10.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.190+0000 7f04e244b640 1 --2- 172.21.15.1:0/4148304483 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x560d37e739f0 0x560d3827e340 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e67acb0af56910bb server_cookie=71dbda3c6a3bc806 in_seq=0 out_seq=0 2024-09-21T00:58:10.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.191+0000 7f04c5ffb640 1 -- 172.21.15.1:0/4148304483 <== mds.3 v2:172.21.15.193:6836/909252228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560d381d4df0 con 0x560d37e739f0 2024-09-21T00:58:10.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.191+0000 7f04c5ffb640 10 client.15891 handle_command_reply: tid=0 2024-09-21T00:58:10.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.191+0000 7f04eac23740 1 client.15891 shutdown 2024-09-21T00:58:10.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.191+0000 7f04eac23740 1 -- 172.21.15.1:0/4148304483 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d37e94390 msgr2=0x560d382682b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:10.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.191+0000 7f04eac23740 1 --2- 172.21.15.1:0/4148304483 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d37e94390 0x560d382682b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f04cc0115c0 tx=0x7f04cc00bfb0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.191+0000 7f04eac23740 1 -- 172.21.15.1:0/4148304483 shutdown_connections 2024-09-21T00:58:10.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.191+0000 7f04eac23740 1 --2- 172.21.15.1:0/4148304483 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x560d37e739f0 0x560d3827e340 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.191+0000 7f04eac23740 1 --2- 172.21.15.1:0/4148304483 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d37eb5070 0x560d382785b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.191+0000 7f04eac23740 1 --2- 172.21.15.1:0/4148304483 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d37e94390 0x560d382682b0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.191+0000 7f04c5ffb640 0 client.15891 ms_handle_reset on v2:172.21.15.193:6836/909252228 2024-09-21T00:58:10.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.191+0000 7f04eac23740 1 --2- 172.21.15.1:0/4148304483 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d37e8c1b0 0x560d38267d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.191+0000 7f04eac23740 1 -- 172.21.15.1:0/4148304483 >> 172.21.15.1:0/4148304483 conn(0x560d37ea9460 msgr2=0x560d3825f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:10.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.191+0000 7f04eac23740 1 -- 172.21.15.1:0/4148304483 shutdown_connections 2024-09-21T00:58:10.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.191+0000 7f04eac23740 1 -- 172.21.15.1:0/4148304483 wait complete. 2024-09-21T00:58:10.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.191+0000 7f04eac23740 20 client.15891 trim_cache size 0 max 16384 2024-09-21T00:58:10.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.204+0000 7f04eac23740 1 Processor -- start 2024-09-21T00:58:10.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.204+0000 7f04eac23740 1 -- start start 2024-09-21T00:58:10.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.205+0000 7f04eac23740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d37e739f0 0x560d382682f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:10.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.205+0000 7f04eac23740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d37e8c1b0 0x560d38269c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:10.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.205+0000 7f04eac23740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d37e94390 0x560d3825dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:10.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.205+0000 7f04eac23740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f04dc1ad250 con 0x560d37e739f0 2024-09-21T00:58:10.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.205+0000 7f04eac23740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f04dc1aed90 con 0x560d37e94390 2024-09-21T00:58:10.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.205+0000 7f04eac23740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f04dc1ad920 con 0x560d37e8c1b0 2024-09-21T00:58:10.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.205+0000 7f04e244b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d37e739f0 0x560d382682f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:10.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.205+0000 7f04e244b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d37e739f0 0x560d382682f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50312/0 (socket says 172.21.15.1:50312) 2024-09-21T00:58:10.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.205+0000 7f04e244b640 1 -- 172.21.15.1:0/324438578 learned_addr learned my addr 172.21.15.1:0/324438578 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:10.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.205+0000 7f04e2c4c640 1 --2- 172.21.15.1:0/324438578 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d37e94390 0x560d3825dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:10.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.205+0000 7f04e244b640 1 -- 172.21.15.1:0/324438578 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d37e8c1b0 msgr2=0x560d38269c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:10.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.205+0000 7f04e1c4a640 1 --2- 172.21.15.1:0/324438578 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d37e8c1b0 0x560d38269c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:10.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.205+0000 7f04e244b640 1 --2- 172.21.15.1:0/324438578 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d37e8c1b0 0x560d38269c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.205+0000 7f04e244b640 1 -- 172.21.15.1:0/324438578 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d37e94390 msgr2=0x560d3825dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:10.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.205+0000 7f04e244b640 1 --2- 172.21.15.1:0/324438578 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d37e94390 0x560d3825dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.205+0000 7f04e244b640 1 -- 172.21.15.1:0/324438578 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d38284630 con 0x560d37e739f0 2024-09-21T00:58:10.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.205+0000 7f04e2c4c640 1 --2- 172.21.15.1:0/324438578 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d37e94390 0x560d3825dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:58:10.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.205+0000 7f04e244b640 1 --2- 172.21.15.1:0/324438578 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d37e739f0 0x560d382682f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f04d80cacb0 tx=0x7f04d8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b4e601e3fde8db server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:10.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.205+0000 7f04c7fff640 1 -- 172.21.15.1:0/324438578 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d8049040 con 0x560d37e739f0 2024-09-21T00:58:10.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.205+0000 7f04c7fff640 1 -- 172.21.15.1:0/324438578 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04d80cd550 con 0x560d37e739f0 2024-09-21T00:58:10.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.205+0000 7f04c7fff640 1 -- 172.21.15.1:0/324438578 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d80c9cb0 con 0x560d37e739f0 2024-09-21T00:58:10.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.206+0000 7f04eac23740 1 -- 172.21.15.1:0/324438578 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d37e739f0 msgr2=0x560d382682f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:10.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.206+0000 7f04eac23740 1 --2- 172.21.15.1:0/324438578 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d37e739f0 0x560d382682f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f04d80cacb0 tx=0x7f04d8000bc0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.206+0000 7f04eac23740 1 -- 172.21.15.1:0/324438578 shutdown_connections 2024-09-21T00:58:10.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.206+0000 7f04eac23740 1 --2- 172.21.15.1:0/324438578 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d37e94390 0x560d3825dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.206+0000 7f04eac23740 1 --2- 172.21.15.1:0/324438578 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d37e8c1b0 0x560d38269c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.206+0000 7f04eac23740 1 --2- 172.21.15.1:0/324438578 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d37e739f0 0x560d382682f0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.206+0000 7f04eac23740 1 -- 172.21.15.1:0/324438578 >> 172.21.15.1:0/324438578 conn(0x560d37ea9460 msgr2=0x560d3825d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:10.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.206+0000 7f04eac23740 1 -- 172.21.15.1:0/324438578 shutdown_connections 2024-09-21T00:58:10.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.206+0000 7f04eac23740 1 -- 172.21.15.1:0/324438578 wait complete. 2024-09-21T00:58:10.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.207+0000 7f04eac23740 1 -- start start 2024-09-21T00:58:10.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.207+0000 7f04eac23740 1 Processor -- start 2024-09-21T00:58:10.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.207+0000 7f04eac23740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d37e739f0 0x560d3827f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:10.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.207+0000 7f04eac23740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d37e8c1b0 0x560d3827fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:10.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.207+0000 7f04eac23740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d37e94390 0x560d382e7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:10.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.207+0000 7f04eac23740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f04dc1ae6c0 con 0x560d37e8c1b0 2024-09-21T00:58:10.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.207+0000 7f04eac23740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f04dc1adff0 con 0x560d37e94390 2024-09-21T00:58:10.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.207+0000 7f04eac23740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f04dc1ab230 con 0x560d37e739f0 2024-09-21T00:58:10.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.207+0000 7f04eac23740 10 client.0 _ll_register_callbacks cb 0x7f04d400a5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:10.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.207+0000 7f04e1c4a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d37e8c1b0 0x560d3827fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:10.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.207+0000 7f04e1c4a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d37e8c1b0 0x560d3827fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50322/0 (socket says 172.21.15.1:50322) 2024-09-21T00:58:10.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.207+0000 7f04e1c4a640 1 -- 172.21.15.1:0/1516413794 learned_addr learned my addr 172.21.15.1:0/1516413794 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:10.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.207+0000 7f04e244b640 1 --2- 172.21.15.1:0/1516413794 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d37e739f0 0x560d3827f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:10.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.208+0000 7f04e2c4c640 1 --2- 172.21.15.1:0/1516413794 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d37e94390 0x560d382e7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:10.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.208+0000 7f04e1c4a640 1 -- 172.21.15.1:0/1516413794 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d37e739f0 msgr2=0x560d3827f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:10.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.208+0000 7f04e1c4a640 1 --2- 172.21.15.1:0/1516413794 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d37e739f0 0x560d3827f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.208+0000 7f04e1c4a640 1 -- 172.21.15.1:0/1516413794 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d37e94390 msgr2=0x560d382e7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:10.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.208+0000 7f04e1c4a640 1 --2- 172.21.15.1:0/1516413794 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d37e94390 0x560d382e7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.208+0000 7f04e1c4a640 1 -- 172.21.15.1:0/1516413794 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d382e8000 con 0x560d37e8c1b0 2024-09-21T00:58:10.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.208+0000 7f04e1c4a640 1 --2- 172.21.15.1:0/1516413794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d37e8c1b0 0x560d3827fc20 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f04cc00f770 tx=0x7f04cc005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=369a68b04c354fd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:10.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.208+0000 7f04c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:58:10.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.208+0000 7f04c5ffb640 1 -- 172.21.15.1:0/1516413794 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04cc028040 con 0x560d37e8c1b0 2024-09-21T00:58:10.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.208+0000 7f04c5ffb640 1 -- 172.21.15.1:0/1516413794 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f04cc01aa30 con 0x560d37e8c1b0 2024-09-21T00:58:10.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.208+0000 7f04eac23740 1 -- 172.21.15.1:0/1516413794 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04d80cd550 con 0x560d37e8c1b0 2024-09-21T00:58:10.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.208+0000 7f04c5ffb640 1 -- 172.21.15.1:0/1516413794 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f04cc00b830 con 0x560d37e8c1b0 2024-09-21T00:58:10.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.208+0000 7f04eac23740 10 client.15897 fetch_fsmap learned FSMap version 27 2024-09-21T00:58:10.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.208+0000 7f04eac23740 1 -- 172.21.15.1:0/1516413794 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560d382e9030 con 0x560d37e8c1b0 2024-09-21T00:58:10.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.208+0000 7f04c5ffb640 1 -- 172.21.15.1:0/1516413794 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04d80cd550 con 0x560d37e8c1b0 2024-09-21T00:58:10.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.209+0000 7f04c5ffb640 1 -- 172.21.15.1:0/1516413794 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f04cc035070 con 0x560d37e8c1b0 2024-09-21T00:58:10.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.209+0000 7f04eac23740 10 client.15897 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:58:10.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.209+0000 7f04eac23740 10 client.15897 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-21T00:58:10.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.209+0000 7f04eac23740 20 client.15897 populate_metadata read hostname 'smithi001' 2024-09-21T00:58:10.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.209+0000 7f04eac23740 1 --2- 172.21.15.1:0/1516413794 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x560d37eb5070 0x560d382eb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:10.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.209+0000 7f04eac23740 4 client.15897 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:58:10.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.209+0000 7f04eac23740 1 -- 172.21.15.1:0/1516413794 --> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560d381d08a0 con 0x560d37eb5070 2024-09-21T00:58:10.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.209+0000 7f04e244b640 1 --2- 172.21.15.1:0/1516413794 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x560d37eb5070 0x560d382eb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:10.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.209+0000 7f04e244b640 1 --2- 172.21.15.1:0/1516413794 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x560d37eb5070 0x560d382eb730 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=390c3bf0403622d6 server_cookie=f30f9921bde27549 in_seq=0 out_seq=0 2024-09-21T00:58:10.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.209+0000 7f04c5ffb640 10 client.15897 ms_handle_connect on v2:172.21.15.193:6836/909252228 2024-09-21T00:58:10.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.210+0000 7f04c5ffb640 1 -- 172.21.15.1:0/1516413794 <== mds.3 v2:172.21.15.193:6836/909252228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560d381d08a0 con 0x560d37eb5070 2024-09-21T00:58:10.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.210+0000 7f04c5ffb640 10 client.15897 handle_command_reply: tid=0 2024-09-21T00:58:10.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.210+0000 7f04eac23740 1 client.15897 shutdown 2024-09-21T00:58:10.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.210+0000 7f04eac23740 1 -- 172.21.15.1:0/1516413794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d37e8c1b0 msgr2=0x560d3827fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:10.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.210+0000 7f04eac23740 1 --2- 172.21.15.1:0/1516413794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d37e8c1b0 0x560d3827fc20 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f04cc00f770 tx=0x7f04cc005c50 comp rx=0 tx=0).stop 2024-09-21T00:58:10.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.210+0000 7f04eac23740 1 -- 172.21.15.1:0/1516413794 shutdown_connections 2024-09-21T00:58:10.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.210+0000 7f04eac23740 1 --2- 172.21.15.1:0/1516413794 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x560d37eb5070 0x560d382eb730 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.210+0000 7f04eac23740 1 --2- 172.21.15.1:0/1516413794 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d37e94390 0x560d382e7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.210+0000 7f04eac23740 1 --2- 172.21.15.1:0/1516413794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d37e8c1b0 0x560d3827fc20 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.210+0000 7f04eac23740 1 --2- 172.21.15.1:0/1516413794 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d37e739f0 0x560d3827f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.210+0000 7f04eac23740 1 -- 172.21.15.1:0/1516413794 >> 172.21.15.1:0/1516413794 conn(0x560d37ea9460 msgr2=0x560d382699f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:10.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.210+0000 7f04c5ffb640 0 client.15897 ms_handle_reset on v2:172.21.15.193:6836/909252228 2024-09-21T00:58:10.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.210+0000 7f04eac23740 1 -- 172.21.15.1:0/1516413794 shutdown_connections 2024-09-21T00:58:10.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.210+0000 7f04eac23740 1 -- 172.21.15.1:0/1516413794 wait complete. 2024-09-21T00:58:10.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.210+0000 7f04eac23740 20 client.15897 trim_cache size 0 max 16384 2024-09-21T00:58:10.231 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T00:58:10.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.210+0000 7f04e46af640 1 -- 172.21.15.1:0/2460465892 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f04c80b6510 msgr2=0x7f04c80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:10.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.210+0000 7f04e46af640 1 --2- 172.21.15.1:0/2460465892 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f04c80b6510 0x7f04c80b8a20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f04d400af80 tx=0x7f04d400a730 comp rx=0 tx=0).stop 2024-09-21T00:58:10.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.210+0000 7f04e46af640 1 -- 172.21.15.1:0/2460465892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04dc1049e0 msgr2=0x7f04dc19a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:10.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.210+0000 7f04e46af640 1 --2- 172.21.15.1:0/2460465892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04dc1049e0 0x7f04dc19a510 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f04d8032fd0 tx=0x7f04d8004270 comp rx=0 tx=0).stop 2024-09-21T00:58:10.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.211+0000 7f04e46af640 1 -- 172.21.15.1:0/2460465892 shutdown_connections 2024-09-21T00:58:10.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.211+0000 7f04e46af640 1 --2- 172.21.15.1:0/2460465892 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04dc10de40 0x7f04dc19fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.211+0000 7f04e46af640 1 --2- 172.21.15.1:0/2460465892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04dc105330 0x7f04dc19aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.211+0000 7f04e46af640 1 --2- 172.21.15.1:0/2460465892 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f04c80b6510 0x7f04c80b8a20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.211+0000 7f04e46af640 1 --2- 172.21.15.1:0/2460465892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04dc1049e0 0x7f04dc19a510 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.211+0000 7f04e46af640 1 -- 172.21.15.1:0/2460465892 >> 172.21.15.1:0/2460465892 conn(0x7f04dc079750 msgr2=0x7f04dc100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:10.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.211+0000 7f04e46af640 1 -- 172.21.15.1:0/2460465892 shutdown_connections 2024-09-21T00:58:10.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:10.211+0000 7f04e46af640 1 -- 172.21.15.1:0/2460465892 wait complete. 2024-09-21T00:58:10.736 INFO:tasks.workunit.client.0.smithi001.stdout:checking whether build environment is sane... yes 2024-09-21T00:58:10.745 INFO:tasks.workunit.client.0.smithi001.stdout:checking for gawk... gawk 2024-09-21T00:58:10.760 INFO:tasks.workunit.client.0.smithi001.stdout:checking whether make sets $(MAKE)... yes 2024-09-21T00:58:10.784 INFO:tasks.workunit.client.0.smithi001.stdout:checking for gcc... gcc 2024-09-21T00:58:10.832 INFO:tasks.workunit.client.0.smithi001.stdout:checking for C compiler default output file name... a.out 2024-09-21T00:58:10.834 INFO:tasks.workunit.client.0.smithi001.stdout:checking whether the C compiler works... yes 2024-09-21T00:58:10.837 INFO:tasks.workunit.client.0.smithi001.stdout:checking whether we are cross compiling... no 2024-09-21T00:58:10.873 INFO:tasks.workunit.client.0.smithi001.stdout:checking for suffix of executables... 2024-09-21T00:58:10.920 INFO:tasks.workunit.client.0.smithi001.stdout:checking for suffix of object files... o 2024-09-21T00:58:10.955 INFO:tasks.workunit.client.0.smithi001.stdout:checking whether we are using the GNU C compiler... yes 2024-09-21T00:58:10.993 INFO:tasks.workunit.client.0.smithi001.stdout:checking whether gcc accepts -g... yes 2024-09-21T00:58:11.103 INFO:tasks.workunit.client.0.smithi001.stdout:checking for gcc option to accept ANSI C... none needed 2024-09-21T00:58:11.105 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T00:58:11.155 INFO:tasks.workunit.client.0.smithi001.stdout:checking for style of include used by make... GNU 2024-09-21T00:58:11.257 INFO:tasks.workunit.client.0.smithi001.stdout:checking dependency style of gcc... gcc3 2024-09-21T00:58:11.257 INFO:tasks.workunit.client.0.smithi001.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-21T00:58:11.325 INFO:tasks.workunit.client.0.smithi001.stdout:checking how to run the C preprocessor... gcc -E 2024-09-21T00:58:11.366 INFO:tasks.workunit.client.0.smithi001.stdout:checking for egrep... grep -E 2024-09-21T00:58:11.375 INFO:tasks.workunit.client.0.smithi001.stdout:checking for AIX... no 2024-09-21T00:58:11.395 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:58:11.454 INFO:tasks.workunit.client.0.smithi001.stdout:checking for library containing strerror... none required 2024-09-21T00:58:11.660 INFO:tasks.workunit.client.0.smithi001.stdout:checking for ANSI C header files... yes 2024-09-21T00:58:11.725 INFO:tasks.workunit.client.0.smithi001.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-21T00:58:11.775 INFO:tasks.workunit.client.0.smithi001.stdout:checking for sys/types.h... yes 2024-09-21T00:58:11.825 INFO:tasks.workunit.client.0.smithi001.stdout:checking for sys/stat.h... yes 2024-09-21T00:58:11.829 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:11 smithi001 ceph-mon[31211]: pgmap v387: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 681 B/s wr, 12 op/s 2024-09-21T00:58:11.876 INFO:tasks.workunit.client.0.smithi001.stdout:checking for stdlib.h... yes 2024-09-21T00:58:11.935 INFO:tasks.workunit.client.0.smithi001.stdout:checking for string.h... yes 2024-09-21T00:58:11.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.928+0000 7f0bc2617640 1 -- 172.21.15.1:0/3525684432 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bbc1052d0 msgr2=0x7f0bbc10d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:11.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.928+0000 7f0bc2617640 1 --2- 172.21.15.1:0/3525684432 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bbc1052d0 0x7f0bbc10d910 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0009900 tx=0x7f0bb002a410 comp rx=0 tx=0).stop 2024-09-21T00:58:11.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.928+0000 7f0bc2617640 1 -- 172.21.15.1:0/3525684432 shutdown_connections 2024-09-21T00:58:11.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.928+0000 7f0bc2617640 1 --2- 172.21.15.1:0/3525684432 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bbc10de50 0x7f0bbc110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:11.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.928+0000 7f0bc2617640 1 --2- 172.21.15.1:0/3525684432 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bbc1052d0 0x7f0bbc10d910 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:11.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.928+0000 7f0bc2617640 1 --2- 172.21.15.1:0/3525684432 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0bbc1048a0 0x7f0bbc104cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:11.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.928+0000 7f0bc2617640 1 -- 172.21.15.1:0/3525684432 >> 172.21.15.1:0/3525684432 conn(0x7f0bbc079740 msgr2=0x7f0bbc079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:11.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.928+0000 7f0bc2617640 1 -- 172.21.15.1:0/3525684432 shutdown_connections 2024-09-21T00:58:11.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.928+0000 7f0bc2617640 1 -- 172.21.15.1:0/3525684432 wait complete. 2024-09-21T00:58:11.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.928+0000 7f0bc2617640 1 Processor -- start 2024-09-21T00:58:11.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.929+0000 7f0bc2617640 1 -- start start 2024-09-21T00:58:11.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.929+0000 7f0bc2617640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bbc1048a0 0x7f0bbc1027b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:11.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.929+0000 7f0bc2617640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bbc1052d0 0x7f0bbc102cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:11.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.929+0000 7f0bc2617640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0bbc10de50 0x7f0bbc103230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:11.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.929+0000 7f0bc2617640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0bbc113ae0 con 0x7f0bbc1048a0 2024-09-21T00:58:11.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.929+0000 7f0bc2617640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0bbc113960 con 0x7f0bbc1052d0 2024-09-21T00:58:11.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.929+0000 7f0bc2617640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0bbc113c60 con 0x7f0bbc10de50 2024-09-21T00:58:11.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.929+0000 7f0bbbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bbc1048a0 0x7f0bbc1027b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:11.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.929+0000 7f0bbbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bbc1048a0 0x7f0bbc1027b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50340/0 (socket says 172.21.15.1:50340) 2024-09-21T00:58:11.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.929+0000 7f0bbbfff640 1 -- 172.21.15.1:0/2068656788 learned_addr learned my addr 172.21.15.1:0/2068656788 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:11.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.929+0000 7f0bbb7fe640 1 --2- 172.21.15.1:0/2068656788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bbc1052d0 0x7f0bbc102cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:11.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.929+0000 7f0bc0bb4640 1 --2- 172.21.15.1:0/2068656788 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0bbc10de50 0x7f0bbc103230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:11.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.930+0000 7f0bbbfff640 1 -- 172.21.15.1:0/2068656788 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0bbc10de50 msgr2=0x7f0bbc103230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:11.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.930+0000 7f0bbbfff640 1 --2- 172.21.15.1:0/2068656788 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0bbc10de50 0x7f0bbc103230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:11.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.930+0000 7f0bbbfff640 1 -- 172.21.15.1:0/2068656788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bbc1052d0 msgr2=0x7f0bbc102cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:11.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.930+0000 7f0bbbfff640 1 --2- 172.21.15.1:0/2068656788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bbc1052d0 0x7f0bbc102cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:11.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.930+0000 7f0bbbfff640 1 -- 172.21.15.1:0/2068656788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bbc1a8810 con 0x7f0bbc1048a0 2024-09-21T00:58:11.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.930+0000 7f0bbb7fe640 1 --2- 172.21.15.1:0/2068656788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bbc1052d0 0x7f0bbc102cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:11.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.930+0000 7f0bbbfff640 1 --2- 172.21.15.1:0/2068656788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bbc1048a0 0x7f0bbc1027b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0bac00d770 tx=0x7f0bac00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:11.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.930+0000 7f0bb97fa640 1 -- 172.21.15.1:0/2068656788 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac017070 con 0x7f0bbc1048a0 2024-09-21T00:58:11.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.930+0000 7f0bc2617640 1 -- 172.21.15.1:0/2068656788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bbc1a8b00 con 0x7f0bbc1048a0 2024-09-21T00:58:11.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.930+0000 7f0bb97fa640 1 -- 172.21.15.1:0/2068656788 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bac009c30 con 0x7f0bbc1048a0 2024-09-21T00:58:11.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.930+0000 7f0bb97fa640 1 -- 172.21.15.1:0/2068656788 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac003cc0 con 0x7f0bbc1048a0 2024-09-21T00:58:11.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.930+0000 7f0bc2617640 1 -- 172.21.15.1:0/2068656788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bbc1a9060 con 0x7f0bbc1048a0 2024-09-21T00:58:11.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.933+0000 7f0bc8b8b740 1 Processor -- start 2024-09-21T00:58:11.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.934+0000 7f0bc8b8b740 1 -- start start 2024-09-21T00:58:11.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.934+0000 7f0bb97fa640 1 -- 172.21.15.1:0/2068656788 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f0bac010460 con 0x7f0bbc1048a0 2024-09-21T00:58:11.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.934+0000 7f0bc8b8b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b0f748070 0x564b0faef2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:11.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.934+0000 7f0bc8b8b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b0f71f1b0 0x564b0faef800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:11.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.934+0000 7f0bc8b8b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b0f727390 0x564b0faefd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:11.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.934+0000 7f0bc8b8b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564b0fa65ea0 con 0x564b0f71f1b0 2024-09-21T00:58:11.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.934+0000 7f0bc8b8b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564b0fa552d0 con 0x564b0f727390 2024-09-21T00:58:11.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.934+0000 7f0bc8b8b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564b0fa590e0 con 0x564b0f748070 2024-09-21T00:58:11.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.934+0000 7f0bbbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b0f71f1b0 0x564b0faef800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:11.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.934+0000 7f0bbbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b0f71f1b0 0x564b0faef800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50356/0 (socket says 172.21.15.1:50356) 2024-09-21T00:58:11.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.934+0000 7f0bbbfff640 1 -- 172.21.15.1:0/3247067405 learned_addr learned my addr 172.21.15.1:0/3247067405 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:11.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.934+0000 7f0bc0bb4640 1 --2- 172.21.15.1:0/3247067405 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b0f748070 0x564b0faef2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:11.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.934+0000 7f0bbb7fe640 1 --2- 172.21.15.1:0/3247067405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b0f727390 0x564b0faefd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:11.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.935+0000 7f0bbbfff640 1 -- 172.21.15.1:0/3247067405 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b0f748070 msgr2=0x564b0faef2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:11.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.935+0000 7f0bbbfff640 1 --2- 172.21.15.1:0/3247067405 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b0f748070 0x564b0faef2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:11.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.935+0000 7f0bbbfff640 1 -- 172.21.15.1:0/3247067405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b0f727390 msgr2=0x564b0faefd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:11.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.935+0000 7f0bbbfff640 1 --2- 172.21.15.1:0/3247067405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b0f727390 0x564b0faefd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:11.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.935+0000 7f0bbbfff640 1 -- 172.21.15.1:0/3247067405 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b0f7b3650 con 0x564b0f71f1b0 2024-09-21T00:58:11.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.935+0000 7f0bbb7fe640 1 --2- 172.21.15.1:0/3247067405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b0f727390 0x564b0faefd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:11.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.935+0000 7f0bc0bb4640 1 --2- 172.21.15.1:0/3247067405 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b0f748070 0x564b0faef2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:11.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.935+0000 7f0bb97fa640 1 --2- 172.21.15.1:0/2068656788 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f0ba40b6510 0x7f0ba40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:11.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.935+0000 7f0bbbfff640 1 --2- 172.21.15.1:0/3247067405 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b0f71f1b0 0x564b0faef800 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f0bac0eade0 tx=0x7f0bac0ef710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7218802f84d927e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:11.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.935+0000 7f0bc0bb4640 1 --2- 172.21.15.1:0/2068656788 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f0ba40b6510 0x7f0ba40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:11.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.935+0000 7f0ba27fc640 1 -- 172.21.15.1:0/3247067405 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac0a94b0 con 0x564b0f71f1b0 2024-09-21T00:58:11.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.935+0000 7f0bb97fa640 1 -- 172.21.15.1:0/2068656788 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f0bac0e6c40 con 0x7f0bbc1048a0 2024-09-21T00:58:11.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.935+0000 7f0ba27fc640 1 -- 172.21.15.1:0/3247067405 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bac0ac970 con 0x564b0f71f1b0 2024-09-21T00:58:11.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.936+0000 7f0ba27fc640 1 -- 172.21.15.1:0/3247067405 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac022300 con 0x564b0f71f1b0 2024-09-21T00:58:11.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.936+0000 7f0bc8b8b740 1 -- 172.21.15.1:0/3247067405 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b0f71f1b0 msgr2=0x564b0faef800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:11.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.936+0000 7f0bc8b8b740 1 --2- 172.21.15.1:0/3247067405 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b0f71f1b0 0x564b0faef800 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f0bac0eade0 tx=0x7f0bac0ef710 comp rx=0 tx=0).stop 2024-09-21T00:58:11.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.936+0000 7f0bc0bb4640 1 --2- 172.21.15.1:0/2068656788 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f0ba40b6510 0x7f0ba40b8a20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4009fd0 tx=0x7f0bb4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:11.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.937+0000 7f0bc8b8b740 1 -- 172.21.15.1:0/3247067405 shutdown_connections 2024-09-21T00:58:11.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.937+0000 7f0bc8b8b740 1 --2- 172.21.15.1:0/3247067405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b0f727390 0x564b0faefd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:11.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.937+0000 7f0bc8b8b740 1 --2- 172.21.15.1:0/3247067405 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b0f71f1b0 0x564b0faef800 secure :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f0bac0eade0 tx=0x7f0bac0ef710 comp rx=0 tx=0).stop 2024-09-21T00:58:11.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.937+0000 7f0bc8b8b740 1 --2- 172.21.15.1:0/3247067405 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b0f748070 0x564b0faef2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:11.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.937+0000 7f0bc8b8b740 1 -- 172.21.15.1:0/3247067405 >> 172.21.15.1:0/3247067405 conn(0x564b0f73c460 msgr2=0x564b0faed1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:11.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.937+0000 7f0bc8b8b740 1 -- 172.21.15.1:0/3247067405 shutdown_connections 2024-09-21T00:58:11.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.937+0000 7f0bc8b8b740 1 -- 172.21.15.1:0/3247067405 wait complete. 2024-09-21T00:58:11.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.938+0000 7f0bc8b8b740 1 -- start start 2024-09-21T00:58:11.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.938+0000 7f0bc8b8b740 1 Processor -- start 2024-09-21T00:58:11.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.938+0000 7f0bc8b8b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b0f727390 0x564b0fafaa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:11.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.938+0000 7f0bc8b8b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b0f748070 0x564b0fafaf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:11.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.938+0000 7f0bc8b8b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b0f7069f0 0x564b0fb06dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:11.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.938+0000 7f0bc8b8b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564b0f8b6700 con 0x564b0f7069f0 2024-09-21T00:58:11.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.938+0000 7f0bc8b8b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564b0f9f0160 con 0x564b0f748070 2024-09-21T00:58:11.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.938+0000 7f0bc8b8b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564b0fafdaa0 con 0x564b0f727390 2024-09-21T00:58:11.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.939+0000 7f0bc0bb4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b0f7069f0 0x564b0fb06dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:11.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.939+0000 7f0bbb7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b0f748070 0x564b0fafaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:11.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.939+0000 7f0bc0bb4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b0f7069f0 0x564b0fb06dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50370/0 (socket says 172.21.15.1:50370) 2024-09-21T00:58:11.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.939+0000 7f0bbb7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b0f748070 0x564b0fafaf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:44902/0 (socket says 172.21.15.1:44902) 2024-09-21T00:58:11.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.939+0000 7f0bc0bb4640 1 -- 172.21.15.1:0/2502980099 learned_addr learned my addr 172.21.15.1:0/2502980099 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:11.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.939+0000 7f0bc8b8b740 10 client.0 _ll_register_callbacks cb 0x564b0fa099e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:11.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.939+0000 7f0bbbfff640 1 --2- 172.21.15.1:0/2502980099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b0f727390 0x564b0fafaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:11.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.939+0000 7f0bc0bb4640 1 -- 172.21.15.1:0/2502980099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b0f727390 msgr2=0x564b0fafaa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:11.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.939+0000 7f0bc0bb4640 1 --2- 172.21.15.1:0/2502980099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b0f727390 0x564b0fafaa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:11.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.939+0000 7f0bc0bb4640 1 -- 172.21.15.1:0/2502980099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b0f748070 msgr2=0x564b0fafaf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:11.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.939+0000 7f0bc0bb4640 1 --2- 172.21.15.1:0/2502980099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b0f748070 0x564b0fafaf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:11.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.939+0000 7f0bc0bb4640 1 -- 172.21.15.1:0/2502980099 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b0fa1dc90 con 0x564b0f7069f0 2024-09-21T00:58:11.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.939+0000 7f0bbb7fe640 1 --2- 172.21.15.1:0/2502980099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b0f748070 0x564b0fafaf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:11.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.939+0000 7f0bc0bb4640 1 --2- 172.21.15.1:0/2502980099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b0f7069f0 0x564b0fb06dc0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0bb400f6a0 tx=0x7f0bb4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c8c53848f5a64d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:11.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.939+0000 7f0b9b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:58:11.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.939+0000 7f0b9b7fe640 1 -- 172.21.15.1:0/2502980099 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb402c060 con 0x564b0f7069f0 2024-09-21T00:58:11.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.939+0000 7f0b9b7fe640 1 -- 172.21.15.1:0/2502980099 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f0bb4017030 con 0x564b0f7069f0 2024-09-21T00:58:11.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.940+0000 7f0bc8b8b740 1 -- 172.21.15.1:0/2502980099 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bac0ac970 con 0x564b0f7069f0 2024-09-21T00:58:11.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.940+0000 7f0b9b7fe640 1 -- 172.21.15.1:0/2502980099 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0bb401f800 con 0x564b0f7069f0 2024-09-21T00:58:11.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.940+0000 7f0bc8b8b740 10 client.15909 fetch_fsmap learned FSMap version 27 2024-09-21T00:58:11.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.940+0000 7f0bc8b8b740 1 -- 172.21.15.1:0/2502980099 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564b0fb09880 con 0x564b0f7069f0 2024-09-21T00:58:11.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.940+0000 7f0b9b7fe640 1 -- 172.21.15.1:0/2502980099 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bac0ac970 con 0x564b0f7069f0 2024-09-21T00:58:11.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.940+0000 7f0b9b7fe640 1 -- 172.21.15.1:0/2502980099 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f0bb4010c30 con 0x564b0f7069f0 2024-09-21T00:58:11.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.940+0000 7f0bc8b8b740 10 client.15909 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:58:11.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.940+0000 7f0bc8b8b740 10 client.15909 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T00:58:11.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.940+0000 7f0bc8b8b740 20 client.15909 populate_metadata read hostname 'smithi001' 2024-09-21T00:58:11.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.940+0000 7f0bc8b8b740 1 --2- 172.21.15.1:0/2502980099 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x564b0f6dbda0 0x564b0fb0d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:11.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.940+0000 7f0bc8b8b740 4 client.15909 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:58:11.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.940+0000 7f0bc8b8b740 1 -- 172.21.15.1:0/2502980099 --> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b0fa67df0 con 0x564b0f6dbda0 2024-09-21T00:58:11.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.941+0000 7f0bbbfff640 1 --2- 172.21.15.1:0/2502980099 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x564b0f6dbda0 0x564b0fb0d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:11.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.941+0000 7f0b9b7fe640 10 client.15909 ms_handle_connect on v2:172.21.15.42:6836/2395608508 2024-09-21T00:58:11.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.941+0000 7f0bbbfff640 1 --2- 172.21.15.1:0/2502980099 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x564b0f6dbda0 0x564b0fb0d1e0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=78ca84730c52e663 server_cookie=ddefcb0adc3ac652 in_seq=0 out_seq=0 2024-09-21T00:58:11.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.942+0000 7f0b9b7fe640 1 -- 172.21.15.1:0/2502980099 <== mds.2 v2:172.21.15.42:6836/2395608508 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564b0fa67df0 con 0x564b0f6dbda0 2024-09-21T00:58:11.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.942+0000 7f0b9b7fe640 10 client.15909 handle_command_reply: tid=0 2024-09-21T00:58:11.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.942+0000 7f0bc8b8b740 1 client.15909 shutdown 2024-09-21T00:58:11.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.942+0000 7f0bc8b8b740 1 -- 172.21.15.1:0/2502980099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b0f7069f0 msgr2=0x564b0fb06dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:11.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.942+0000 7f0bc8b8b740 1 --2- 172.21.15.1:0/2502980099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b0f7069f0 0x564b0fb06dc0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0bb400f6a0 tx=0x7f0bb4004ab0 comp rx=0 tx=0).stop 2024-09-21T00:58:11.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.942+0000 7f0bc8b8b740 1 -- 172.21.15.1:0/2502980099 shutdown_connections 2024-09-21T00:58:11.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.942+0000 7f0bc8b8b740 1 --2- 172.21.15.1:0/2502980099 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x564b0f6dbda0 0x564b0fb0d1e0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:11.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.942+0000 7f0bc8b8b740 1 --2- 172.21.15.1:0/2502980099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b0f7069f0 0x564b0fb06dc0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:11.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.942+0000 7f0bc8b8b740 1 --2- 172.21.15.1:0/2502980099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b0f748070 0x564b0fafaf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:11.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.942+0000 7f0bc8b8b740 1 --2- 172.21.15.1:0/2502980099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b0f727390 0x564b0fafaa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:11.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.942+0000 7f0bc8b8b740 1 -- 172.21.15.1:0/2502980099 >> 172.21.15.1:0/2502980099 conn(0x564b0f73c460 msgr2=0x564b0faf2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:11.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.942+0000 7f0b9b7fe640 0 client.15909 ms_handle_reset on v2:172.21.15.42:6836/2395608508 2024-09-21T00:58:11.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.943+0000 7f0bc8b8b740 1 -- 172.21.15.1:0/2502980099 shutdown_connections 2024-09-21T00:58:11.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.943+0000 7f0bc8b8b740 1 -- 172.21.15.1:0/2502980099 wait complete. 2024-09-21T00:58:11.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.943+0000 7f0bc8b8b740 20 client.15909 trim_cache size 0 max 16384 2024-09-21T00:58:11.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.956+0000 7f0bc8b8b740 1 Processor -- start 2024-09-21T00:58:11.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.956+0000 7f0bc8b8b740 1 -- start start 2024-09-21T00:58:11.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.956+0000 7f0bc8b8b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b0f7069f0 0x564b0faf23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:11.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.956+0000 7f0bc8b8b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b0f727390 0x564b0faf2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:11.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.956+0000 7f0bc8b8b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b0f748070 0x564b0faf7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:11.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.957+0000 7f0bc8b8b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0bbc1b1710 con 0x564b0f727390 2024-09-21T00:58:11.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.957+0000 7f0bc8b8b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0bbc1b3250 con 0x564b0f7069f0 2024-09-21T00:58:11.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.957+0000 7f0bc8b8b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0bbc1b1de0 con 0x564b0f748070 2024-09-21T00:58:11.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.957+0000 7f0bbb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b0f727390 0x564b0faf2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:11.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.957+0000 7f0bbbfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b0f7069f0 0x564b0faf23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:11.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.957+0000 7f0bbb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b0f727390 0x564b0faf2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50382/0 (socket says 172.21.15.1:50382) 2024-09-21T00:58:11.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.957+0000 7f0bbb7fe640 1 -- 172.21.15.1:0/18935739 learned_addr learned my addr 172.21.15.1:0/18935739 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:11.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.957+0000 7f0bc0bb4640 1 --2- 172.21.15.1:0/18935739 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b0f748070 0x564b0faf7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:11.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.957+0000 7f0bbbfff640 1 -- 172.21.15.1:0/18935739 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b0f748070 msgr2=0x564b0faf7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:11.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.957+0000 7f0bbbfff640 1 --2- 172.21.15.1:0/18935739 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b0f748070 0x564b0faf7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:11.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.957+0000 7f0bbbfff640 1 -- 172.21.15.1:0/18935739 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b0f727390 msgr2=0x564b0faf2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:11.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.957+0000 7f0bbbfff640 1 --2- 172.21.15.1:0/18935739 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b0f727390 0x564b0faf2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:11.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.957+0000 7f0bbbfff640 1 -- 172.21.15.1:0/18935739 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b0faf2120 con 0x564b0f7069f0 2024-09-21T00:58:11.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.957+0000 7f0bc0bb4640 1 --2- 172.21.15.1:0/18935739 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b0f748070 0x564b0faf7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:58:11.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.957+0000 7f0bbbfff640 1 --2- 172.21.15.1:0/18935739 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b0f7069f0 0x564b0faf23c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0bac005fa0 tx=0x7f0bac000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfb342cda5038b60 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:11.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.958+0000 7f0ba1ffb640 1 -- 172.21.15.1:0/18935739 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac020040 con 0x564b0f7069f0 2024-09-21T00:58:11.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.958+0000 7f0ba1ffb640 1 -- 172.21.15.1:0/18935739 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bac0eaa20 con 0x564b0f7069f0 2024-09-21T00:58:11.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.958+0000 7f0ba1ffb640 1 -- 172.21.15.1:0/18935739 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac00f730 con 0x564b0f7069f0 2024-09-21T00:58:11.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.959+0000 7f0bc8b8b740 1 -- 172.21.15.1:0/18935739 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b0f7069f0 msgr2=0x564b0faf23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:11.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.959+0000 7f0bc8b8b740 1 --2- 172.21.15.1:0/18935739 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b0f7069f0 0x564b0faf23c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0bac005fa0 tx=0x7f0bac000bc0 comp rx=0 tx=0).stop 2024-09-21T00:58:11.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.959+0000 7f0bc8b8b740 1 -- 172.21.15.1:0/18935739 shutdown_connections 2024-09-21T00:58:11.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.959+0000 7f0bc8b8b740 1 --2- 172.21.15.1:0/18935739 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b0f748070 0x564b0faf7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:11.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.959+0000 7f0bc8b8b740 1 --2- 172.21.15.1:0/18935739 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b0f727390 0x564b0faf2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:11.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.959+0000 7f0bc8b8b740 1 --2- 172.21.15.1:0/18935739 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b0f7069f0 0x564b0faf23c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:11.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.959+0000 7f0bc8b8b740 1 -- 172.21.15.1:0/18935739 >> 172.21.15.1:0/18935739 conn(0x564b0f73c460 msgr2=0x564b0faf92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:11.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.959+0000 7f0bc8b8b740 1 -- 172.21.15.1:0/18935739 shutdown_connections 2024-09-21T00:58:11.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.959+0000 7f0bc8b8b740 1 -- 172.21.15.1:0/18935739 wait complete. 2024-09-21T00:58:11.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.959+0000 7f0bc8b8b740 1 -- start start 2024-09-21T00:58:11.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.960+0000 7f0bc8b8b740 1 Processor -- start 2024-09-21T00:58:11.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.960+0000 7f0bc8b8b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b0f7069f0 0x564b0fb036c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:11.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.960+0000 7f0bc8b8b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b0f727390 0x564b0fafeb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:11.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.960+0000 7f0bc8b8b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b0f748070 0x564b0faff260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:11.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.960+0000 7f0bc8b8b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0bbc1b2b80 con 0x564b0f727390 2024-09-21T00:58:11.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.960+0000 7f0bc8b8b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0bbc1b24b0 con 0x564b0f748070 2024-09-21T00:58:11.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.960+0000 7f0bc8b8b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0bbc1af6f0 con 0x564b0f7069f0 2024-09-21T00:58:11.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.960+0000 7f0bbb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b0f727390 0x564b0fafeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:11.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.961+0000 7f0bbb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b0f727390 0x564b0fafeb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50398/0 (socket says 172.21.15.1:50398) 2024-09-21T00:58:11.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.961+0000 7f0bbb7fe640 1 -- 172.21.15.1:0/885817117 learned_addr learned my addr 172.21.15.1:0/885817117 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:11.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.961+0000 7f0bc8b8b740 10 client.0 _ll_register_callbacks cb 0x7f0bb4009be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:11.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.961+0000 7f0bc0bb4640 1 --2- 172.21.15.1:0/885817117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b0f748070 0x564b0faff260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:11.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.961+0000 7f0bbbfff640 1 --2- 172.21.15.1:0/885817117 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b0f7069f0 0x564b0fb036c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:11.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.961+0000 7f0bbb7fe640 1 -- 172.21.15.1:0/885817117 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b0f7069f0 msgr2=0x564b0fb036c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:11.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.961+0000 7f0bbb7fe640 1 --2- 172.21.15.1:0/885817117 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b0f7069f0 0x564b0fb036c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:11.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.961+0000 7f0bbb7fe640 1 -- 172.21.15.1:0/885817117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b0f748070 msgr2=0x564b0faff260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:11.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.961+0000 7f0bbb7fe640 1 --2- 172.21.15.1:0/885817117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b0f748070 0x564b0faff260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:11.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.961+0000 7f0bbb7fe640 1 -- 172.21.15.1:0/885817117 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b0fb76be0 con 0x564b0f727390 2024-09-21T00:58:11.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.961+0000 7f0bbbfff640 1 --2- 172.21.15.1:0/885817117 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b0f7069f0 0x564b0fb036c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:58:11.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.961+0000 7f0bc0bb4640 1 --2- 172.21.15.1:0/885817117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b0f748070 0x564b0faff260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:11.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.961+0000 7f0bbb7fe640 1 --2- 172.21.15.1:0/885817117 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b0f727390 0x564b0fafeb70 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0bb002aa00 tx=0x7f0bb00049a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2807ee1ba15cc27 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:11.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.961+0000 7f0b9b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:58:11.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.961+0000 7f0b9b7fe640 1 -- 172.21.15.1:0/885817117 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb004b060 con 0x564b0f727390 2024-09-21T00:58:11.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.961+0000 7f0b9b7fe640 1 -- 172.21.15.1:0/885817117 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f0bb00035f0 con 0x564b0f727390 2024-09-21T00:58:11.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.961+0000 7f0bc8b8b740 1 -- 172.21.15.1:0/885817117 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bac0eaa20 con 0x564b0f727390 2024-09-21T00:58:11.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.962+0000 7f0b9b7fe640 1 -- 172.21.15.1:0/885817117 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0bb0035040 con 0x564b0f727390 2024-09-21T00:58:11.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.962+0000 7f0bc8b8b740 10 client.15915 fetch_fsmap learned FSMap version 27 2024-09-21T00:58:11.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.962+0000 7f0bc8b8b740 1 -- 172.21.15.1:0/885817117 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564b0fb77cd0 con 0x564b0f727390 2024-09-21T00:58:11.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.962+0000 7f0b9b7fe640 1 -- 172.21.15.1:0/885817117 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bac0eaa20 con 0x564b0f727390 2024-09-21T00:58:11.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.962+0000 7f0b9b7fe640 1 -- 172.21.15.1:0/885817117 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f0bb0031740 con 0x564b0f727390 2024-09-21T00:58:11.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.962+0000 7f0bc8b8b740 10 client.15915 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:58:11.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.962+0000 7f0bc8b8b740 10 client.15915 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T00:58:11.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.962+0000 7f0bc8b8b740 20 client.15915 populate_metadata read hostname 'smithi001' 2024-09-21T00:58:11.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.962+0000 7f0bc8b8b740 1 --2- 172.21.15.1:0/885817117 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x564b0fb78450 0x564b0fb7a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:11.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.962+0000 7f0bc8b8b740 4 client.15915 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:58:11.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.962+0000 7f0bc8b8b740 1 -- 172.21.15.1:0/885817117 --> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564b0fa638a0 con 0x564b0fb78450 2024-09-21T00:58:11.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.962+0000 7f0bbbfff640 1 --2- 172.21.15.1:0/885817117 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x564b0fb78450 0x564b0fb7a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:11.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.963+0000 7f0b9b7fe640 10 client.15915 ms_handle_connect on v2:172.21.15.42:6836/2395608508 2024-09-21T00:58:11.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.963+0000 7f0bbbfff640 1 --2- 172.21.15.1:0/885817117 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x564b0fb78450 0x564b0fb7a870 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c4d0434176a14fce server_cookie=8cd4315fca9c801a in_seq=0 out_seq=0 2024-09-21T00:58:11.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.963+0000 7f0b9b7fe640 1 -- 172.21.15.1:0/885817117 <== mds.2 v2:172.21.15.42:6836/2395608508 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564b0fa638a0 con 0x564b0fb78450 2024-09-21T00:58:11.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.963+0000 7f0b9b7fe640 10 client.15915 handle_command_reply: tid=0 2024-09-21T00:58:11.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.963+0000 7f0bc8b8b740 1 client.15915 shutdown 2024-09-21T00:58:11.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.964+0000 7f0bc8b8b740 1 -- 172.21.15.1:0/885817117 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b0f727390 msgr2=0x564b0fafeb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:11.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.964+0000 7f0bc8b8b740 1 --2- 172.21.15.1:0/885817117 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b0f727390 0x564b0fafeb70 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0bb002aa00 tx=0x7f0bb00049a0 comp rx=0 tx=0).stop 2024-09-21T00:58:11.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.964+0000 7f0bc8b8b740 1 -- 172.21.15.1:0/885817117 shutdown_connections 2024-09-21T00:58:11.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.964+0000 7f0bc8b8b740 1 --2- 172.21.15.1:0/885817117 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x564b0fb78450 0x564b0fb7a870 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:11.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.964+0000 7f0bc8b8b740 1 --2- 172.21.15.1:0/885817117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b0f748070 0x564b0faff260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:11.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.964+0000 7f0bc8b8b740 1 --2- 172.21.15.1:0/885817117 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b0f727390 0x564b0fafeb70 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:11.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.964+0000 7f0bc8b8b740 1 --2- 172.21.15.1:0/885817117 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b0f7069f0 0x564b0fb036c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:11.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.964+0000 7f0bc8b8b740 1 -- 172.21.15.1:0/885817117 >> 172.21.15.1:0/885817117 conn(0x564b0f73c460 msgr2=0x564b0faf23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:11.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.964+0000 7f0b9b7fe640 0 client.15915 ms_handle_reset on v2:172.21.15.42:6836/2395608508 2024-09-21T00:58:11.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.964+0000 7f0bc8b8b740 1 -- 172.21.15.1:0/885817117 shutdown_connections 2024-09-21T00:58:11.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.964+0000 7f0bc8b8b740 1 -- 172.21.15.1:0/885817117 wait complete. 2024-09-21T00:58:11.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.964+0000 7f0bc8b8b740 20 client.15915 trim_cache size 0 max 16384 2024-09-21T00:58:11.971 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T00:58:11.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.964+0000 7f0bc2617640 1 -- 172.21.15.1:0/2068656788 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f0ba40b6510 msgr2=0x7f0ba40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:11.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.964+0000 7f0bc2617640 1 --2- 172.21.15.1:0/2068656788 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f0ba40b6510 0x7f0ba40b8a20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4009fd0 tx=0x7f0bb4009500 comp rx=0 tx=0).stop 2024-09-21T00:58:11.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.964+0000 7f0bc2617640 1 -- 172.21.15.1:0/2068656788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bbc1048a0 msgr2=0x7f0bbc1027b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:11.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.964+0000 7f0bc2617640 1 --2- 172.21.15.1:0/2068656788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bbc1048a0 0x7f0bbc1027b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0bac00d770 tx=0x7f0bac00dc30 comp rx=0 tx=0).stop 2024-09-21T00:58:11.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.965+0000 7f0bc2617640 1 -- 172.21.15.1:0/2068656788 shutdown_connections 2024-09-21T00:58:11.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.965+0000 7f0bc2617640 1 --2- 172.21.15.1:0/2068656788 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0bbc10de50 0x7f0bbc103230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:11.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.965+0000 7f0bc2617640 1 --2- 172.21.15.1:0/2068656788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bbc1052d0 0x7f0bbc102cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:11.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.965+0000 7f0bc2617640 1 --2- 172.21.15.1:0/2068656788 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f0ba40b6510 0x7f0ba40b8a20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:11.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.965+0000 7f0bc2617640 1 --2- 172.21.15.1:0/2068656788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bbc1048a0 0x7f0bbc1027b0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:11.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.965+0000 7f0bc2617640 1 -- 172.21.15.1:0/2068656788 >> 172.21.15.1:0/2068656788 conn(0x7f0bbc079740 msgr2=0x7f0bbc105900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:11.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.965+0000 7f0bc2617640 1 -- 172.21.15.1:0/2068656788 shutdown_connections 2024-09-21T00:58:11.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:11.965+0000 7f0bc2617640 1 -- 172.21.15.1:0/2068656788 wait complete. 2024-09-21T00:58:11.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:11 smithi193 ceph-mon[34660]: pgmap v387: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 681 B/s wr, 12 op/s 2024-09-21T00:58:11.988 INFO:tasks.workunit.client.0.smithi001.stdout:checking for memory.h... yes 2024-09-21T00:58:11.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:11 smithi042 ceph-mon[34481]: pgmap v387: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 681 B/s wr, 12 op/s 2024-09-21T00:58:12.039 INFO:tasks.workunit.client.0.smithi001.stdout:checking for strings.h... yes 2024-09-21T00:58:12.088 INFO:tasks.workunit.client.0.smithi001.stdout:checking for inttypes.h... yes 2024-09-21T00:58:12.157 INFO:tasks.workunit.client.0.smithi001.stdout:checking for stdint.h... yes 2024-09-21T00:58:12.189 INFO:tasks.workunit.client.0.smithi001.stdout:checking for unistd.h... yes 2024-09-21T00:58:12.200 INFO:tasks.workunit.client.0.smithi001.stdout:checking for memory.h... (cached) yes 2024-09-21T00:58:12.205 INFO:tasks.workunit.client.0.smithi001.stdout:checking for strings.h... (cached) yes 2024-09-21T00:58:12.210 INFO:tasks.workunit.client.0.smithi001.stdout:checking for unistd.h... (cached) yes 2024-09-21T00:58:12.296 INFO:tasks.workunit.client.0.smithi001.stdout:checking locale.h usability... yes 2024-09-21T00:58:12.315 INFO:tasks.workunit.client.0.smithi001.stdout:checking locale.h presence... yes 2024-09-21T00:58:12.316 INFO:tasks.workunit.client.0.smithi001.stdout:checking for locale.h... yes 2024-09-21T00:58:12.331 INFO:tasks.workunit.client.0.smithi001.stdout:checking for stdlib.h... (cached) yes 2024-09-21T00:58:12.336 INFO:tasks.workunit.client.0.smithi001.stdout:checking for string.h... (cached) yes 2024-09-21T00:58:12.549 INFO:tasks.workunit.client.0.smithi001.stdout:checking sys/socket.h usability... yes 2024-09-21T00:58:12.571 INFO:tasks.workunit.client.0.smithi001.stdout:checking sys/socket.h presence... yes 2024-09-21T00:58:12.572 INFO:tasks.workunit.client.0.smithi001.stdout:checking for sys/socket.h... yes 2024-09-21T00:58:12.632 INFO:tasks.workunit.client.0.smithi001.stdout:checking sys/time.h usability... yes 2024-09-21T00:58:12.652 INFO:tasks.workunit.client.0.smithi001.stdout:checking sys/time.h presence... yes 2024-09-21T00:58:12.653 INFO:tasks.workunit.client.0.smithi001.stdout:checking for sys/time.h... yes 2024-09-21T00:58:12.708 INFO:tasks.workunit.client.0.smithi001.stdout:checking fcntl.h usability... yes 2024-09-21T00:58:12.728 INFO:tasks.workunit.client.0.smithi001.stdout:checking fcntl.h presence... yes 2024-09-21T00:58:12.729 INFO:tasks.workunit.client.0.smithi001.stdout:checking for fcntl.h... yes 2024-09-21T00:58:12.797 INFO:tasks.workunit.client.0.smithi001.stdout:checking sys/fcntl.h usability... yes 2024-09-21T00:58:12.822 INFO:tasks.workunit.client.0.smithi001.stdout:checking sys/fcntl.h presence... yes 2024-09-21T00:58:12.823 INFO:tasks.workunit.client.0.smithi001.stdout:checking for sys/fcntl.h... yes 2024-09-21T00:58:12.885 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T00:58:12.910 INFO:tasks.workunit.client.0.smithi001.stdout:checking sys/param.h usability... yes 2024-09-21T00:58:12.932 INFO:tasks.workunit.client.0.smithi001.stdout:checking sys/param.h presence... yes 2024-09-21T00:58:12.933 INFO:tasks.workunit.client.0.smithi001.stdout:checking for sys/param.h... yes 2024-09-21T00:58:12.980 INFO:tasks.workunit.client.0.smithi001.stdout:checking ioctl.h usability... no 2024-09-21T00:58:13.001 INFO:tasks.workunit.client.0.smithi001.stdout:checking ioctl.h presence... no 2024-09-21T00:58:13.002 INFO:tasks.workunit.client.0.smithi001.stdout:checking for ioctl.h... no 2024-09-21T00:58:13.053 INFO:tasks.workunit.client.0.smithi001.stdout:checking sys/ioctl.h usability... yes 2024-09-21T00:58:13.072 INFO:tasks.workunit.client.0.smithi001.stdout:checking sys/ioctl.h presence... yes 2024-09-21T00:58:13.073 INFO:tasks.workunit.client.0.smithi001.stdout:checking for sys/ioctl.h... yes 2024-09-21T00:58:13.129 INFO:tasks.workunit.client.0.smithi001.stdout:checking return type of signal handlers... void 2024-09-21T00:58:13.176 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:58:13.176 INFO:tasks.workunit.client.0.smithi001.stdout:checking for size_t... yes 2024-09-21T00:58:13.222 INFO:tasks.workunit.client.0.smithi001.stdout:checking for dev_t... yes 2024-09-21T00:58:13.266 INFO:tasks.workunit.client.0.smithi001.stdout:checking for short... yes 2024-09-21T00:58:13.352 INFO:tasks.workunit.client.0.smithi001.stdout:checking size of short... 2 2024-09-21T00:58:13.404 INFO:tasks.workunit.client.0.smithi001.stdout:checking for int... yes 2024-09-21T00:58:13.481 INFO:tasks.workunit.client.0.smithi001.stdout:checking size of int... 4 2024-09-21T00:58:13.542 INFO:tasks.workunit.client.0.smithi001.stdout:checking for long... yes 2024-09-21T00:58:13.619 INFO:tasks.workunit.client.0.smithi001.stdout:checking size of long... 8 2024-09-21T00:58:13.666 INFO:tasks.workunit.client.0.smithi001.stdout:checking for long long... yes 2024-09-21T00:58:13.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.698+0000 7ffac7c36640 1 -- 172.21.15.1:0/271706881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffac0105290 msgr2=0x7ffac010d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:13.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.698+0000 7ffac7c36640 1 --2- 172.21.15.1:0/271706881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffac0105290 0x7ffac010d920 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ffab4009900 tx=0x7ffab402a410 comp rx=0 tx=0).stop 2024-09-21T00:58:13.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.698+0000 7ffac7c36640 1 -- 172.21.15.1:0/271706881 shutdown_connections 2024-09-21T00:58:13.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.698+0000 7ffac7c36640 1 --2- 172.21.15.1:0/271706881 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffac010de60 0x7ffac0110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.698+0000 7ffac7c36640 1 --2- 172.21.15.1:0/271706881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffac0105290 0x7ffac010d920 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.698+0000 7ffac7c36640 1 --2- 172.21.15.1:0/271706881 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffac01048b0 0x7ffac0104cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.698+0000 7ffac7c36640 1 -- 172.21.15.1:0/271706881 >> 172.21.15.1:0/271706881 conn(0x7ffac00796d0 msgr2=0x7ffac0079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:13.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.698+0000 7ffac7c36640 1 -- 172.21.15.1:0/271706881 shutdown_connections 2024-09-21T00:58:13.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.698+0000 7ffac7c36640 1 -- 172.21.15.1:0/271706881 wait complete. 2024-09-21T00:58:13.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.700+0000 7ffac7c36640 1 Processor -- start 2024-09-21T00:58:13.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.700+0000 7ffac7c36640 1 -- start start 2024-09-21T00:58:13.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.700+0000 7ffac7c36640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffac01048b0 0x7ffac019a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:13.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.700+0000 7ffac7c36640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffac0105290 0x7ffac019aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:13.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.700+0000 7ffac7c36640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffac010de60 0x7ffac019fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:13.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.700+0000 7ffac7c36640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffac0113ae0 con 0x7ffac0105290 2024-09-21T00:58:13.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.700+0000 7ffac7c36640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ffac0113960 con 0x7ffac010de60 2024-09-21T00:58:13.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.700+0000 7ffac7c36640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ffac0113c60 con 0x7ffac01048b0 2024-09-21T00:58:13.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.700+0000 7ffac51d1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffac0105290 0x7ffac019aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:13.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.700+0000 7ffac51d1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffac0105290 0x7ffac019aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50416/0 (socket says 172.21.15.1:50416) 2024-09-21T00:58:13.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.700+0000 7ffac51d1640 1 -- 172.21.15.1:0/1202944441 learned_addr learned my addr 172.21.15.1:0/1202944441 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:13.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.700+0000 7ffac61d3640 1 --2- 172.21.15.1:0/1202944441 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffac010de60 0x7ffac019fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:13.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.700+0000 7ffac59d2640 1 --2- 172.21.15.1:0/1202944441 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffac01048b0 0x7ffac019a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:13.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.701+0000 7ffac51d1640 1 -- 172.21.15.1:0/1202944441 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffac01048b0 msgr2=0x7ffac019a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:13.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.701+0000 7ffac51d1640 1 --2- 172.21.15.1:0/1202944441 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffac01048b0 0x7ffac019a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.701+0000 7ffac51d1640 1 -- 172.21.15.1:0/1202944441 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffac010de60 msgr2=0x7ffac019fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:13.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.701+0000 7ffac51d1640 1 --2- 172.21.15.1:0/1202944441 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffac010de60 0x7ffac019fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.701+0000 7ffac51d1640 1 -- 172.21.15.1:0/1202944441 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffac01a0440 con 0x7ffac0105290 2024-09-21T00:58:13.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.701+0000 7ffac61d3640 1 --2- 172.21.15.1:0/1202944441 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffac010de60 0x7ffac019fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:13.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.701+0000 7ffac51d1640 1 --2- 172.21.15.1:0/1202944441 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffac0105290 0x7ffac019aa70 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ffab402a930 tx=0x7ffab4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:13.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.701+0000 7ffab2ffd640 1 -- 172.21.15.1:0/1202944441 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab403f030 con 0x7ffac0105290 2024-09-21T00:58:13.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.701+0000 7ffac7c36640 1 -- 172.21.15.1:0/1202944441 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffac01a06d0 con 0x7ffac0105290 2024-09-21T00:58:13.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.701+0000 7ffab2ffd640 1 -- 172.21.15.1:0/1202944441 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffab4003aa0 con 0x7ffac0105290 2024-09-21T00:58:13.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.701+0000 7ffab2ffd640 1 -- 172.21.15.1:0/1202944441 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab4035070 con 0x7ffac0105290 2024-09-21T00:58:13.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.701+0000 7ffac7c36640 1 -- 172.21.15.1:0/1202944441 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffac01a6e90 con 0x7ffac0105290 2024-09-21T00:58:13.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.704+0000 7fface1aa740 1 Processor -- start 2024-09-21T00:58:13.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.704+0000 7fface1aa740 1 -- start start 2024-09-21T00:58:13.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.704+0000 7ffab2ffd640 1 -- 172.21.15.1:0/1202944441 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7ffab4042030 con 0x7ffac0105290 2024-09-21T00:58:13.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.705+0000 7fface1aa740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f99a020070 0x55f99a3c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:13.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.705+0000 7fface1aa740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f999ff71b0 0x55f99a3c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:13.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.705+0000 7fface1aa740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999fff390 0x55f99a3c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:13.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.705+0000 7fface1aa740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f99a33dea0 con 0x55f999ff71b0 2024-09-21T00:58:13.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.705+0000 7fface1aa740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f99a32d2d0 con 0x55f999fff390 2024-09-21T00:58:13.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.705+0000 7fface1aa740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f99a3310e0 con 0x55f99a020070 2024-09-21T00:58:13.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.705+0000 7ffac59d2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f999ff71b0 0x55f99a3c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:13.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.705+0000 7ffac59d2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f999ff71b0 0x55f99a3c7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50422/0 (socket says 172.21.15.1:50422) 2024-09-21T00:58:13.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.705+0000 7ffac59d2640 1 -- 172.21.15.1:0/1412439788 learned_addr learned my addr 172.21.15.1:0/1412439788 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:13.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.705+0000 7ffac51d1640 1 --2- 172.21.15.1:0/1412439788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999fff390 0x55f99a3c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:13.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.705+0000 7ffac61d3640 1 --2- 172.21.15.1:0/1412439788 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f99a020070 0x55f99a3c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:13.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.705+0000 7ffac59d2640 1 -- 172.21.15.1:0/1412439788 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f99a020070 msgr2=0x55f99a3c76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:13.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.705+0000 7ffac59d2640 1 --2- 172.21.15.1:0/1412439788 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f99a020070 0x55f99a3c76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.705+0000 7ffac59d2640 1 -- 172.21.15.1:0/1412439788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999fff390 msgr2=0x55f99a3c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:13.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.705+0000 7ffac59d2640 1 --2- 172.21.15.1:0/1412439788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999fff390 0x55f99a3c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.705+0000 7ffac59d2640 1 -- 172.21.15.1:0/1412439788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f99a08b650 con 0x55f999ff71b0 2024-09-21T00:58:13.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.705+0000 7ffac51d1640 1 --2- 172.21.15.1:0/1412439788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999fff390 0x55f99a3c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:13.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.705+0000 7ffac59d2640 1 --2- 172.21.15.1:0/1412439788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f999ff71b0 0x55f99a3c7be0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ffabc00bcb0 tx=0x7ffabc00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17cc23c5d751034c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:13.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.706+0000 7ffab2ffd640 1 --2- 172.21.15.1:0/1202944441 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ffaac0b6510 0x7ffaac0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:13.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.706+0000 7ffac61d3640 1 --2- 172.21.15.1:0/1202944441 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ffaac0b6510 0x7ffaac0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:13.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.706+0000 7ffab2ffd640 1 -- 172.21.15.1:0/1202944441 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7ffab41077f0 con 0x7ffac0105290 2024-09-21T00:58:13.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.706+0000 7ffaabfff640 1 -- 172.21.15.1:0/1412439788 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc015070 con 0x55f999ff71b0 2024-09-21T00:58:13.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.706+0000 7ffaabfff640 1 -- 172.21.15.1:0/1412439788 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffabc01a910 con 0x55f999ff71b0 2024-09-21T00:58:13.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.706+0000 7ffaabfff640 1 -- 172.21.15.1:0/1412439788 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc011940 con 0x55f999ff71b0 2024-09-21T00:58:13.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.707+0000 7fface1aa740 1 -- 172.21.15.1:0/1412439788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f999ff71b0 msgr2=0x55f99a3c7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:13.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.707+0000 7ffac61d3640 1 --2- 172.21.15.1:0/1202944441 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ffaac0b6510 0x7ffaac0b8a20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ffab8009fd0 tx=0x7ffab800d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:13.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.707+0000 7fface1aa740 1 --2- 172.21.15.1:0/1412439788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f999ff71b0 0x55f99a3c7be0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ffabc00bcb0 tx=0x7ffabc00f730 comp rx=0 tx=0).stop 2024-09-21T00:58:13.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.707+0000 7fface1aa740 1 -- 172.21.15.1:0/1412439788 shutdown_connections 2024-09-21T00:58:13.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.707+0000 7fface1aa740 1 --2- 172.21.15.1:0/1412439788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999fff390 0x55f99a3c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.707+0000 7fface1aa740 1 --2- 172.21.15.1:0/1412439788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f999ff71b0 0x55f99a3c7be0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.707+0000 7fface1aa740 1 --2- 172.21.15.1:0/1412439788 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f99a020070 0x55f99a3c76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.707+0000 7fface1aa740 1 -- 172.21.15.1:0/1412439788 >> 172.21.15.1:0/1412439788 conn(0x55f99a014460 msgr2=0x55f99a3c5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:13.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.707+0000 7fface1aa740 1 -- 172.21.15.1:0/1412439788 shutdown_connections 2024-09-21T00:58:13.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.707+0000 7fface1aa740 1 -- 172.21.15.1:0/1412439788 wait complete. 2024-09-21T00:58:13.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.708+0000 7fface1aa740 1 -- start start 2024-09-21T00:58:13.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.708+0000 7fface1aa740 1 Processor -- start 2024-09-21T00:58:13.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.708+0000 7fface1aa740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f999ff71b0 0x55f99a3d7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:13.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.708+0000 7fface1aa740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f999fff390 0x55f99a3d7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:13.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.708+0000 7fface1aa740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f99a020070 0x55f99a3d7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:13.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.708+0000 7fface1aa740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f99a18e700 con 0x55f999fff390 2024-09-21T00:58:13.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.708+0000 7fface1aa740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f99a2c8160 con 0x55f99a020070 2024-09-21T00:58:13.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.708+0000 7fface1aa740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f99a3da1e0 con 0x55f999ff71b0 2024-09-21T00:58:13.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.708+0000 7ffac51d1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f999fff390 0x55f99a3d7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:13.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.708+0000 7ffac51d1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f999fff390 0x55f99a3d7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50434/0 (socket says 172.21.15.1:50434) 2024-09-21T00:58:13.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.708+0000 7ffac51d1640 1 -- 172.21.15.1:0/1773839661 learned_addr learned my addr 172.21.15.1:0/1773839661 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:13.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.708+0000 7fface1aa740 10 client.0 _ll_register_callbacks cb 0x55f99a2e19e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:13.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.708+0000 7ffac59d2640 1 --2- 172.21.15.1:0/1773839661 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f999ff71b0 0x55f99a3d7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:13.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.709+0000 7ffac61d3640 1 --2- 172.21.15.1:0/1773839661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f99a020070 0x55f99a3d7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:13.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.709+0000 7ffac51d1640 1 -- 172.21.15.1:0/1773839661 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f999ff71b0 msgr2=0x55f99a3d7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:13.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.709+0000 7ffac51d1640 1 --2- 172.21.15.1:0/1773839661 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f999ff71b0 0x55f99a3d7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.709+0000 7ffac51d1640 1 -- 172.21.15.1:0/1773839661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f99a020070 msgr2=0x55f99a3d7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:13.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.709+0000 7ffac51d1640 1 --2- 172.21.15.1:0/1773839661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f99a020070 0x55f99a3d7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.709+0000 7ffac51d1640 1 -- 172.21.15.1:0/1773839661 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f99a2f5c90 con 0x55f999fff390 2024-09-21T00:58:13.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.709+0000 7ffac51d1640 1 --2- 172.21.15.1:0/1773839661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f999fff390 0x55f99a3d7650 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ffab40cabd0 tx=0x7ffab4031a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41672bedb34e84d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:13.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.709+0000 7ffaa97fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:58:13.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.709+0000 7ffaa97fa640 1 -- 172.21.15.1:0/1773839661 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab4049040 con 0x55f999fff390 2024-09-21T00:58:13.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.709+0000 7fface1aa740 1 -- 172.21.15.1:0/1773839661 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffabc01a910 con 0x55f999fff390 2024-09-21T00:58:13.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.709+0000 7ffaa97fa640 1 -- 172.21.15.1:0/1773839661 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7ffab40d6ef0 con 0x55f999fff390 2024-09-21T00:58:13.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.709+0000 7ffaa97fa640 1 -- 172.21.15.1:0/1773839661 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ffab40c9800 con 0x55f999fff390 2024-09-21T00:58:13.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.709+0000 7fface1aa740 10 client.15927 fetch_fsmap learned FSMap version 27 2024-09-21T00:58:13.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.709+0000 7fface1aa740 1 -- 172.21.15.1:0/1773839661 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f99a3e5ef0 con 0x55f999fff390 2024-09-21T00:58:13.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.710+0000 7ffaa97fa640 1 -- 172.21.15.1:0/1773839661 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffabc01a910 con 0x55f999fff390 2024-09-21T00:58:13.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.710+0000 7ffaa97fa640 1 -- 172.21.15.1:0/1773839661 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7ffab40d2080 con 0x55f999fff390 2024-09-21T00:58:13.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.710+0000 7fface1aa740 10 client.15927 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:58:13.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.710+0000 7fface1aa740 10 client.15927 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T00:58:13.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.710+0000 7fface1aa740 20 client.15927 populate_metadata read hostname 'smithi001' 2024-09-21T00:58:13.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.710+0000 7fface1aa740 1 --2- 172.21.15.1:0/1773839661 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x55f999fde9f0 0x55f99a3e9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:13.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.710+0000 7fface1aa740 4 client.15927 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:58:13.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.710+0000 7fface1aa740 1 -- 172.21.15.1:0/1773839661 --> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f99a33fdf0 con 0x55f999fde9f0 2024-09-21T00:58:13.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.710+0000 7ffac59d2640 1 --2- 172.21.15.1:0/1773839661 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x55f999fde9f0 0x55f99a3e9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:13.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.711+0000 7ffaa97fa640 10 client.15927 ms_handle_connect on v2:172.21.15.193:6838/1365361177 2024-09-21T00:58:13.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.711+0000 7ffac59d2640 1 --2- 172.21.15.1:0/1773839661 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x55f999fde9f0 0x55f99a3e9350 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c985b689ad127f72 server_cookie=549d3678e853075e in_seq=0 out_seq=0 2024-09-21T00:58:13.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.711+0000 7ffaa97fa640 1 -- 172.21.15.1:0/1773839661 <== mds.1 v2:172.21.15.193:6838/1365361177 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f99a33fdf0 con 0x55f999fde9f0 2024-09-21T00:58:13.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.711+0000 7ffaa97fa640 10 client.15927 handle_command_reply: tid=0 2024-09-21T00:58:13.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.712+0000 7fface1aa740 1 client.15927 shutdown 2024-09-21T00:58:13.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.712+0000 7fface1aa740 1 -- 172.21.15.1:0/1773839661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f999fff390 msgr2=0x55f99a3d7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:13.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.712+0000 7fface1aa740 1 --2- 172.21.15.1:0/1773839661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f999fff390 0x55f99a3d7650 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ffab40cabd0 tx=0x7ffab4031a10 comp rx=0 tx=0).stop 2024-09-21T00:58:13.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.712+0000 7fface1aa740 1 -- 172.21.15.1:0/1773839661 shutdown_connections 2024-09-21T00:58:13.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.712+0000 7fface1aa740 1 --2- 172.21.15.1:0/1773839661 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x55f999fde9f0 0x55f99a3e9350 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.712+0000 7fface1aa740 1 --2- 172.21.15.1:0/1773839661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f99a020070 0x55f99a3d7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.712+0000 7fface1aa740 1 --2- 172.21.15.1:0/1773839661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f999fff390 0x55f99a3d7650 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.712+0000 7fface1aa740 1 --2- 172.21.15.1:0/1773839661 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f999ff71b0 0x55f99a3d7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.712+0000 7ffaa97fa640 0 client.15927 ms_handle_reset on v2:172.21.15.193:6838/1365361177 2024-09-21T00:58:13.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.712+0000 7fface1aa740 1 -- 172.21.15.1:0/1773839661 >> 172.21.15.1:0/1773839661 conn(0x55f99a014460 msgr2=0x55f99a3c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:13.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.712+0000 7fface1aa740 1 -- 172.21.15.1:0/1773839661 shutdown_connections 2024-09-21T00:58:13.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.712+0000 7fface1aa740 1 -- 172.21.15.1:0/1773839661 wait complete. 2024-09-21T00:58:13.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.712+0000 7fface1aa740 20 client.15927 trim_cache size 0 max 16384 2024-09-21T00:58:13.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.726+0000 7fface1aa740 1 Processor -- start 2024-09-21T00:58:13.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.726+0000 7fface1aa740 1 -- start start 2024-09-21T00:58:13.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.726+0000 7fface1aa740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999ff71b0 0x55f99a3d8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:13.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.726+0000 7fface1aa740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f999fff390 0x55f99a3d4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:13.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.726+0000 7fface1aa740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f99a020070 0x55f99a3d4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:13.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.726+0000 7fface1aa740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffac01ad300 con 0x55f999fff390 2024-09-21T00:58:13.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.726+0000 7fface1aa740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ffac01aee40 con 0x55f999ff71b0 2024-09-21T00:58:13.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.726+0000 7fface1aa740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ffac01ad9d0 con 0x55f99a020070 2024-09-21T00:58:13.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.726+0000 7ffac51d1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f999fff390 0x55f99a3d4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:13.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.726+0000 7ffac59d2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999ff71b0 0x55f99a3d8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:13.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.726+0000 7ffac59d2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999ff71b0 0x55f99a3d8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:44962/0 (socket says 172.21.15.1:44962) 2024-09-21T00:58:13.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.726+0000 7ffac59d2640 1 -- 172.21.15.1:0/4259941719 learned_addr learned my addr 172.21.15.1:0/4259941719 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:13.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.726+0000 7ffac51d1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f999fff390 0x55f99a3d4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50446/0 (socket says 172.21.15.1:50446) 2024-09-21T00:58:13.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.726+0000 7ffac61d3640 1 --2- 172.21.15.1:0/4259941719 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f99a020070 0x55f99a3d4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:13.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.726+0000 7ffac59d2640 1 -- 172.21.15.1:0/4259941719 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f99a020070 msgr2=0x55f99a3d4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:13.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.726+0000 7ffac59d2640 1 --2- 172.21.15.1:0/4259941719 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f99a020070 0x55f99a3d4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.726+0000 7ffac59d2640 1 -- 172.21.15.1:0/4259941719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f999fff390 msgr2=0x55f99a3d4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:13.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.726+0000 7ffac59d2640 1 --2- 172.21.15.1:0/4259941719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f999fff390 0x55f99a3d4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.726+0000 7ffac59d2640 1 -- 172.21.15.1:0/4259941719 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f99a3c8490 con 0x55f999ff71b0 2024-09-21T00:58:13.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.726+0000 7ffac61d3640 1 --2- 172.21.15.1:0/4259941719 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f99a020070 0x55f99a3d4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:58:13.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.727+0000 7ffac59d2640 1 --2- 172.21.15.1:0/4259941719 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999ff71b0 0x55f99a3d8d40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffabc005fd0 tx=0x7ffabc00bbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=976302f5ed2523f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:13.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.727+0000 7ffaab7fe640 1 -- 172.21.15.1:0/4259941719 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc015040 con 0x55f999ff71b0 2024-09-21T00:58:13.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.727+0000 7ffaab7fe640 1 -- 172.21.15.1:0/4259941719 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffabc005500 con 0x55f999ff71b0 2024-09-21T00:58:13.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.727+0000 7ffaab7fe640 1 -- 172.21.15.1:0/4259941719 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc0048e0 con 0x55f999ff71b0 2024-09-21T00:58:13.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.728+0000 7fface1aa740 1 -- 172.21.15.1:0/4259941719 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999ff71b0 msgr2=0x55f99a3d8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:13.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.728+0000 7fface1aa740 1 --2- 172.21.15.1:0/4259941719 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999ff71b0 0x55f99a3d8d40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffabc005fd0 tx=0x7ffabc00bbf0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.728+0000 7fface1aa740 1 -- 172.21.15.1:0/4259941719 shutdown_connections 2024-09-21T00:58:13.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.728+0000 7fface1aa740 1 --2- 172.21.15.1:0/4259941719 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f99a020070 0x55f99a3d4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.728+0000 7fface1aa740 1 --2- 172.21.15.1:0/4259941719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f999fff390 0x55f99a3d4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.728+0000 7fface1aa740 1 --2- 172.21.15.1:0/4259941719 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999ff71b0 0x55f99a3d8d40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.728+0000 7fface1aa740 1 -- 172.21.15.1:0/4259941719 >> 172.21.15.1:0/4259941719 conn(0x55f99a014460 msgr2=0x55f99a3d8630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:13.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.728+0000 7fface1aa740 1 -- 172.21.15.1:0/4259941719 shutdown_connections 2024-09-21T00:58:13.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.728+0000 7fface1aa740 1 -- 172.21.15.1:0/4259941719 wait complete. 2024-09-21T00:58:13.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.729+0000 7fface1aa740 1 -- start start 2024-09-21T00:58:13.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.729+0000 7fface1aa740 1 Processor -- start 2024-09-21T00:58:13.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.729+0000 7fface1aa740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999ff71b0 0x55f99a3dd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:13.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.729+0000 7fface1aa740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f999fff390 0x55f99a3dd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:13.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.729+0000 7fface1aa740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f99a020070 0x55f99a3ddeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:13.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.729+0000 7fface1aa740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffac01ae770 con 0x55f99a020070 2024-09-21T00:58:13.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.729+0000 7fface1aa740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ffac01ae0a0 con 0x55f999ff71b0 2024-09-21T00:58:13.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.729+0000 7fface1aa740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ffac01ab2e0 con 0x55f999fff390 2024-09-21T00:58:13.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.729+0000 7fface1aa740 10 client.0 _ll_register_callbacks cb 0x7ffab4005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:13.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.729+0000 7ffac59d2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999ff71b0 0x55f99a3dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:13.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.729+0000 7ffac59d2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999ff71b0 0x55f99a3dd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:44966/0 (socket says 172.21.15.1:44966) 2024-09-21T00:58:13.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.729+0000 7ffac59d2640 1 -- 172.21.15.1:0/3877067324 learned_addr learned my addr 172.21.15.1:0/3877067324 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:13.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.729+0000 7ffac61d3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f99a020070 0x55f99a3ddeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:13.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.729+0000 7ffac51d1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f999fff390 0x55f99a3dd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:13.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.730+0000 7ffac59d2640 1 -- 172.21.15.1:0/3877067324 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f999fff390 msgr2=0x55f99a3dd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:13.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.730+0000 7ffac59d2640 1 --2- 172.21.15.1:0/3877067324 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f999fff390 0x55f99a3dd970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.730+0000 7ffac59d2640 1 -- 172.21.15.1:0/3877067324 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f99a020070 msgr2=0x55f99a3ddeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:13.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.730+0000 7ffac59d2640 1 --2- 172.21.15.1:0/3877067324 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f99a020070 0x55f99a3ddeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.730+0000 7ffac59d2640 1 -- 172.21.15.1:0/3877067324 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f99a452d20 con 0x55f999ff71b0 2024-09-21T00:58:13.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.730+0000 7ffac61d3640 1 --2- 172.21.15.1:0/3877067324 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f99a020070 0x55f99a3ddeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:13.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.731+0000 7ffac59d2640 1 --2- 172.21.15.1:0/3877067324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999ff71b0 0x55f99a3dd430 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffabc011480 tx=0x7ffabc00fd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52e18df560d90514 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:13.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.731+0000 7ffaa97fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T00:58:13.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.732+0000 7ffaa97fa640 1 -- 172.21.15.1:0/3877067324 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc015040 con 0x55f999ff71b0 2024-09-21T00:58:13.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.732+0000 7ffaa97fa640 1 -- 172.21.15.1:0/3877067324 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7ffabc004040 con 0x55f999ff71b0 2024-09-21T00:58:13.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.732+0000 7fface1aa740 1 -- 172.21.15.1:0/3877067324 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffabc005500 con 0x55f999ff71b0 2024-09-21T00:58:13.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.733+0000 7ffaa97fa640 1 -- 172.21.15.1:0/3877067324 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ffabc0035f0 con 0x55f999ff71b0 2024-09-21T00:58:13.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.733+0000 7fface1aa740 10 client.25601 fetch_fsmap learned FSMap version 27 2024-09-21T00:58:13.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.733+0000 7fface1aa740 1 -- 172.21.15.1:0/3877067324 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f99a453f30 con 0x55f999ff71b0 2024-09-21T00:58:13.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.733+0000 7ffaa97fa640 1 -- 172.21.15.1:0/3877067324 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffabc005500 con 0x55f999ff71b0 2024-09-21T00:58:13.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.733+0000 7ffaa97fa640 1 -- 172.21.15.1:0/3877067324 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7ffabc011760 con 0x55f999ff71b0 2024-09-21T00:58:13.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.733+0000 7fface1aa740 10 client.25601 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:58:13.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.733+0000 7fface1aa740 10 client.25601 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T00:58:13.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.733+0000 7fface1aa740 20 client.25601 populate_metadata read hostname 'smithi001' 2024-09-21T00:58:13.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.733+0000 7fface1aa740 1 --2- 172.21.15.1:0/3877067324 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x55f999fb3da0 0x55f99a456490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:13.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.733+0000 7fface1aa740 4 client.25601 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:58:13.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.733+0000 7fface1aa740 1 -- 172.21.15.1:0/3877067324 --> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f99a33b8a0 con 0x55f999fb3da0 2024-09-21T00:58:13.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.733+0000 7ffac51d1640 1 --2- 172.21.15.1:0/3877067324 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x55f999fb3da0 0x55f99a456490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:13.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.734+0000 7ffaa97fa640 10 client.25601 ms_handle_connect on v2:172.21.15.193:6838/1365361177 2024-09-21T00:58:13.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.734+0000 7ffac51d1640 1 --2- 172.21.15.1:0/3877067324 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x55f999fb3da0 0x55f99a456490 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5cdd5cc99e79963f server_cookie=2bba2624e554a5d9 in_seq=0 out_seq=0 2024-09-21T00:58:13.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.734+0000 7ffaa97fa640 1 -- 172.21.15.1:0/3877067324 <== mds.1 v2:172.21.15.193:6838/1365361177 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f99a33b8a0 con 0x55f999fb3da0 2024-09-21T00:58:13.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.734+0000 7ffaa97fa640 10 client.25601 handle_command_reply: tid=0 2024-09-21T00:58:13.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.734+0000 7fface1aa740 1 client.25601 shutdown 2024-09-21T00:58:13.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.734+0000 7fface1aa740 1 -- 172.21.15.1:0/3877067324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999ff71b0 msgr2=0x55f99a3dd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:13.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.734+0000 7fface1aa740 1 --2- 172.21.15.1:0/3877067324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999ff71b0 0x55f99a3dd430 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffabc011480 tx=0x7ffabc00fd70 comp rx=0 tx=0).stop 2024-09-21T00:58:13.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.735+0000 7fface1aa740 1 -- 172.21.15.1:0/3877067324 shutdown_connections 2024-09-21T00:58:13.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.735+0000 7fface1aa740 1 --2- 172.21.15.1:0/3877067324 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x55f999fb3da0 0x55f99a456490 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.735+0000 7fface1aa740 1 --2- 172.21.15.1:0/3877067324 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f99a020070 0x55f99a3ddeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.735+0000 7fface1aa740 1 --2- 172.21.15.1:0/3877067324 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f999fff390 0x55f99a3dd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.735+0000 7fface1aa740 1 --2- 172.21.15.1:0/3877067324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999ff71b0 0x55f99a3dd430 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.735+0000 7ffaa97fa640 0 client.25601 ms_handle_reset on v2:172.21.15.193:6838/1365361177 2024-09-21T00:58:13.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.735+0000 7fface1aa740 1 -- 172.21.15.1:0/3877067324 >> 172.21.15.1:0/3877067324 conn(0x55f99a014460 msgr2=0x55f99a3c8660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:13.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.735+0000 7fface1aa740 1 -- 172.21.15.1:0/3877067324 shutdown_connections 2024-09-21T00:58:13.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.735+0000 7fface1aa740 1 -- 172.21.15.1:0/3877067324 wait complete. 2024-09-21T00:58:13.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.735+0000 7fface1aa740 20 client.25601 trim_cache size 0 max 16384 2024-09-21T00:58:13.748 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T00:58:13.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.736+0000 7ffac7c36640 1 -- 172.21.15.1:0/1202944441 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ffaac0b6510 msgr2=0x7ffaac0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:13.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.736+0000 7ffac7c36640 1 --2- 172.21.15.1:0/1202944441 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ffaac0b6510 0x7ffaac0b8a20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ffab8009fd0 tx=0x7ffab800d040 comp rx=0 tx=0).stop 2024-09-21T00:58:13.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.736+0000 7ffac7c36640 1 -- 172.21.15.1:0/1202944441 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffac0105290 msgr2=0x7ffac019aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:13.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.736+0000 7ffac7c36640 1 --2- 172.21.15.1:0/1202944441 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffac0105290 0x7ffac019aa70 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ffab402a930 tx=0x7ffab4004270 comp rx=0 tx=0).stop 2024-09-21T00:58:13.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.736+0000 7ffac7c36640 1 -- 172.21.15.1:0/1202944441 shutdown_connections 2024-09-21T00:58:13.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.736+0000 7ffac7c36640 1 --2- 172.21.15.1:0/1202944441 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffac010de60 0x7ffac019fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.736+0000 7ffac7c36640 1 --2- 172.21.15.1:0/1202944441 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ffaac0b6510 0x7ffaac0b8a20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.736+0000 7ffac7c36640 1 --2- 172.21.15.1:0/1202944441 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffac0105290 0x7ffac019aa70 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.736+0000 7ffac7c36640 1 --2- 172.21.15.1:0/1202944441 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffac01048b0 0x7ffac019a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.736+0000 7ffac7c36640 1 -- 172.21.15.1:0/1202944441 >> 172.21.15.1:0/1202944441 conn(0x7ffac00796d0 msgr2=0x7ffac01079b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:13.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.736+0000 7ffac7c36640 1 -- 172.21.15.1:0/1202944441 shutdown_connections 2024-09-21T00:58:13.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:13.736+0000 7ffac7c36640 1 -- 172.21.15.1:0/1202944441 wait complete. 2024-09-21T00:58:13.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:13 smithi001 ceph-mon[31211]: pgmap v388: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 766 B/s wr, 12 op/s 2024-09-21T00:58:13.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:13 smithi042 ceph-mon[34481]: pgmap v388: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 766 B/s wr, 12 op/s 2024-09-21T00:58:14.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:13 smithi193 ceph-mon[34660]: pgmap v388: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 766 B/s wr, 12 op/s 2024-09-21T00:58:14.522 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T00:58:14.819 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:58:14.945 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:14 smithi001 ceph-mon[31211]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T00:58:14.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:14 smithi042 ceph-mon[34481]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T00:58:15.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:14 smithi193 ceph-mon[34660]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T00:58:15.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.316+0000 7f0abed60640 1 -- 172.21.15.1:0/555789424 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ab81083c0 msgr2=0x7f0ab81087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:15.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.316+0000 7f0abed60640 1 --2- 172.21.15.1:0/555789424 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ab81083c0 0x7f0ab81087d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4009900 tx=0x7f0aa402a410 comp rx=0 tx=0).stop 2024-09-21T00:58:15.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.316+0000 7f0abed60640 1 -- 172.21.15.1:0/555789424 shutdown_connections 2024-09-21T00:58:15.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.316+0000 7f0abed60640 1 --2- 172.21.15.1:0/555789424 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0ab8108d10 0x7f0ab810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.316+0000 7f0abed60640 1 --2- 172.21.15.1:0/555789424 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ab81083c0 0x7f0ab81087d0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.316+0000 7f0abed60640 1 --2- 172.21.15.1:0/555789424 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ab8102a80 0x7f0ab8102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.316+0000 7f0abed60640 1 -- 172.21.15.1:0/555789424 >> 172.21.15.1:0/555789424 conn(0x7f0ab8079740 msgr2=0x7f0ab8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:15.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.316+0000 7f0abed60640 1 -- 172.21.15.1:0/555789424 shutdown_connections 2024-09-21T00:58:15.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.316+0000 7f0abed60640 1 -- 172.21.15.1:0/555789424 wait complete. 2024-09-21T00:58:15.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.316+0000 7f0abed60640 1 Processor -- start 2024-09-21T00:58:15.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.316+0000 7f0abed60640 1 -- start start 2024-09-21T00:58:15.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.317+0000 7f0abed60640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0ab8102a80 0x7f0ab8105100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:15.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.317+0000 7f0abed60640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ab81083c0 0x7f0ab8105640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:15.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.317+0000 7f0abed60640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ab8108d10 0x7f0ab8105b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:15.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.317+0000 7f0abed60640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab81129c0 con 0x7f0ab81083c0 2024-09-21T00:58:15.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.317+0000 7f0abed60640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab8112840 con 0x7f0ab8108d10 2024-09-21T00:58:15.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.317+0000 7f0abed60640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab8112b40 con 0x7f0ab8102a80 2024-09-21T00:58:15.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.317+0000 7f0ab7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ab81083c0 0x7f0ab8105640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:15.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.317+0000 7f0ab7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ab81083c0 0x7f0ab8105640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50464/0 (socket says 172.21.15.1:50464) 2024-09-21T00:58:15.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.317+0000 7f0ab7fff640 1 -- 172.21.15.1:0/559376542 learned_addr learned my addr 172.21.15.1:0/559376542 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:15.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.317+0000 7f0abcafc640 1 --2- 172.21.15.1:0/559376542 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0ab8102a80 0x7f0ab8105100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:15.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.317+0000 7f0abd2fd640 1 --2- 172.21.15.1:0/559376542 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ab8108d10 0x7f0ab8105b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:15.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.317+0000 7f0ab7fff640 1 -- 172.21.15.1:0/559376542 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0ab8102a80 msgr2=0x7f0ab8105100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:15.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.317+0000 7f0ab7fff640 1 --2- 172.21.15.1:0/559376542 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0ab8102a80 0x7f0ab8105100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.317+0000 7f0ab7fff640 1 -- 172.21.15.1:0/559376542 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ab8108d10 msgr2=0x7f0ab8105b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:15.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.317+0000 7f0ab7fff640 1 --2- 172.21.15.1:0/559376542 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ab8108d10 0x7f0ab8105b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.317+0000 7f0ab7fff640 1 -- 172.21.15.1:0/559376542 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ab81a87b0 con 0x7f0ab81083c0 2024-09-21T00:58:15.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.318+0000 7f0ab7fff640 1 --2- 172.21.15.1:0/559376542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ab81083c0 0x7f0ab8105640 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4031a90 tx=0x7f0aa4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:15.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.318+0000 7f0ab5ffb640 1 -- 172.21.15.1:0/559376542 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa403f030 con 0x7f0ab81083c0 2024-09-21T00:58:15.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.318+0000 7f0ab5ffb640 1 -- 172.21.15.1:0/559376542 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0aa4003cb0 con 0x7f0ab81083c0 2024-09-21T00:58:15.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.318+0000 7f0ab5ffb640 1 -- 172.21.15.1:0/559376542 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4035070 con 0x7f0ab81083c0 2024-09-21T00:58:15.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.318+0000 7f0abed60640 1 -- 172.21.15.1:0/559376542 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ab81a8a40 con 0x7f0ab81083c0 2024-09-21T00:58:15.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.318+0000 7f0abed60640 1 -- 172.21.15.1:0/559376542 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ab81a8fa0 con 0x7f0ab81083c0 2024-09-21T00:58:15.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.321+0000 7f0ac52d4740 1 Processor -- start 2024-09-21T00:58:15.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.321+0000 7f0ab5ffb640 1 -- 172.21.15.1:0/559376542 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f0aa4042030 con 0x7f0ab81083c0 2024-09-21T00:58:15.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.321+0000 7f0ac52d4740 1 -- start start 2024-09-21T00:58:15.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.321+0000 7f0ac52d4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55572255d070 0x5557229042c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:15.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.321+0000 7f0ac52d4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557225341b0 0x555722904800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:15.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.321+0000 7f0ac52d4740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55572253c390 0x555722904d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:15.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.321+0000 7f0ac52d4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55572287aea0 con 0x5557225341b0 2024-09-21T00:58:15.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.321+0000 7f0ac52d4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55572286a2d0 con 0x55572255d070 2024-09-21T00:58:15.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.321+0000 7f0ac52d4740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55572286e0e0 con 0x55572253c390 2024-09-21T00:58:15.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.321+0000 7f0abcafc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557225341b0 0x555722904800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:15.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.321+0000 7f0abcafc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557225341b0 0x555722904800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50476/0 (socket says 172.21.15.1:50476) 2024-09-21T00:58:15.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.321+0000 7f0abcafc640 1 -- 172.21.15.1:0/3740403554 learned_addr learned my addr 172.21.15.1:0/3740403554 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:15.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.321+0000 7f0abd2fd640 1 --2- 172.21.15.1:0/3740403554 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55572255d070 0x5557229042c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:15.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.321+0000 7f0ab7fff640 1 --2- 172.21.15.1:0/3740403554 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55572253c390 0x555722904d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:15.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.322+0000 7f0abd2fd640 1 -- 172.21.15.1:0/3740403554 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55572253c390 msgr2=0x555722904d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:15.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.322+0000 7f0abd2fd640 1 --2- 172.21.15.1:0/3740403554 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55572253c390 0x555722904d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.322+0000 7f0abd2fd640 1 -- 172.21.15.1:0/3740403554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557225341b0 msgr2=0x555722904800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:15.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.322+0000 7f0abd2fd640 1 --2- 172.21.15.1:0/3740403554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557225341b0 0x555722904800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.322+0000 7f0abd2fd640 1 -- 172.21.15.1:0/3740403554 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557225c8650 con 0x55572255d070 2024-09-21T00:58:15.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.322+0000 7f0abcafc640 1 --2- 172.21.15.1:0/3740403554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557225341b0 0x555722904800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:15.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.322+0000 7f0ab5ffb640 1 --2- 172.21.15.1:0/559376542 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f0aa80b6510 0x7f0aa80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:15.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.322+0000 7f0abcafc640 1 --2- 172.21.15.1:0/559376542 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f0aa80b6510 0x7f0aa80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:15.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.322+0000 7f0abd2fd640 1 --2- 172.21.15.1:0/3740403554 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55572255d070 0x5557229042c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0009f70 tx=0x7f0ab0009650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9539e109c11d354 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:15.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.322+0000 7f0ab5ffb640 1 -- 172.21.15.1:0/559376542 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f0aa41078a0 con 0x7f0ab81083c0 2024-09-21T00:58:15.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.322+0000 7f0aa2ffd640 1 -- 172.21.15.1:0/3740403554 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab0013850 con 0x55572255d070 2024-09-21T00:58:15.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.322+0000 7f0aa2ffd640 1 -- 172.21.15.1:0/3740403554 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ab0019070 con 0x55572255d070 2024-09-21T00:58:15.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.322+0000 7f0aa2ffd640 1 -- 172.21.15.1:0/3740403554 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab0014e50 con 0x55572255d070 2024-09-21T00:58:15.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.323+0000 7f0ac52d4740 1 -- 172.21.15.1:0/3740403554 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55572255d070 msgr2=0x5557229042c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:15.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.323+0000 7f0abcafc640 1 --2- 172.21.15.1:0/559376542 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f0aa80b6510 0x7f0aa80b8a20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x555722902f40 tx=0x7f0aac00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:15.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.323+0000 7f0ac52d4740 1 --2- 172.21.15.1:0/3740403554 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55572255d070 0x5557229042c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0009f70 tx=0x7f0ab0009650 comp rx=0 tx=0).stop 2024-09-21T00:58:15.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.323+0000 7f0ac52d4740 1 -- 172.21.15.1:0/3740403554 shutdown_connections 2024-09-21T00:58:15.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.323+0000 7f0ac52d4740 1 --2- 172.21.15.1:0/3740403554 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55572253c390 0x555722904d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.323+0000 7f0ac52d4740 1 --2- 172.21.15.1:0/3740403554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557225341b0 0x555722904800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.323+0000 7f0ac52d4740 1 --2- 172.21.15.1:0/3740403554 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55572255d070 0x5557229042c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.323+0000 7f0ac52d4740 1 -- 172.21.15.1:0/3740403554 >> 172.21.15.1:0/3740403554 conn(0x555722551460 msgr2=0x5557229021b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:15.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.323+0000 7f0ac52d4740 1 -- 172.21.15.1:0/3740403554 shutdown_connections 2024-09-21T00:58:15.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.323+0000 7f0ac52d4740 1 -- 172.21.15.1:0/3740403554 wait complete. 2024-09-21T00:58:15.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.323+0000 7f0ac52d4740 1 -- start start 2024-09-21T00:58:15.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.324+0000 7f0ac52d4740 1 Processor -- start 2024-09-21T00:58:15.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.324+0000 7f0ac52d4740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5557225341b0 0x55572290f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:15.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.324+0000 7f0ac52d4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55572253c390 0x55572290ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:15.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.324+0000 7f0ac52d4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55572255d070 0x55572291bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:15.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.324+0000 7f0ac52d4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5557226cb700 con 0x55572253c390 2024-09-21T00:58:15.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.324+0000 7f0ac52d4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555722805160 con 0x55572255d070 2024-09-21T00:58:15.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.324+0000 7f0ac52d4740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x555722912aa0 con 0x5557225341b0 2024-09-21T00:58:15.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.324+0000 7f0ac52d4740 10 client.0 _ll_register_callbacks cb 0x55572281e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:15.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.324+0000 7f0ab7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55572253c390 0x55572290ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:15.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.324+0000 7f0ab7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55572253c390 0x55572290ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50488/0 (socket says 172.21.15.1:50488) 2024-09-21T00:58:15.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.324+0000 7f0ab7fff640 1 -- 172.21.15.1:0/628786227 learned_addr learned my addr 172.21.15.1:0/628786227 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:15.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.324+0000 7f0abd2fd640 1 --2- 172.21.15.1:0/628786227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55572255d070 0x55572291bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:15.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.324+0000 7f0abcafc640 1 --2- 172.21.15.1:0/628786227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5557225341b0 0x55572290f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:15.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.325+0000 7f0ab7fff640 1 -- 172.21.15.1:0/628786227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5557225341b0 msgr2=0x55572290f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:15.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.325+0000 7f0ab7fff640 1 --2- 172.21.15.1:0/628786227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5557225341b0 0x55572290f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.325+0000 7f0ab7fff640 1 -- 172.21.15.1:0/628786227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55572255d070 msgr2=0x55572291bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:15.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.325+0000 7f0ab7fff640 1 --2- 172.21.15.1:0/628786227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55572255d070 0x55572291bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.325+0000 7f0ab7fff640 1 -- 172.21.15.1:0/628786227 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555722832c90 con 0x55572253c390 2024-09-21T00:58:15.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.325+0000 7f0abd2fd640 1 --2- 172.21.15.1:0/628786227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55572255d070 0x55572291bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:15.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.325+0000 7f0ab7fff640 1 --2- 172.21.15.1:0/628786227 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55572253c390 0x55572290ff00 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4031440 tx=0x7f0aa403b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da92bfa246a532d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:15.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.325+0000 7f0a97fff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:58:15.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.325+0000 7f0a97fff640 1 -- 172.21.15.1:0/628786227 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4049070 con 0x55572253c390 2024-09-21T00:58:15.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.325+0000 7f0a97fff640 1 -- 172.21.15.1:0/628786227 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f0aa40d6fa0 con 0x55572253c390 2024-09-21T00:58:15.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.325+0000 7f0ac52d4740 1 -- 172.21.15.1:0/628786227 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ab0019070 con 0x55572253c390 2024-09-21T00:58:15.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.325+0000 7f0a97fff640 1 -- 172.21.15.1:0/628786227 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0aa40ca110 con 0x55572253c390 2024-09-21T00:58:15.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.325+0000 7f0ac52d4740 10 client.15945 fetch_fsmap learned FSMap version 28 2024-09-21T00:58:15.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.325+0000 7f0ac52d4740 1 -- 172.21.15.1:0/628786227 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55572291e790 con 0x55572253c390 2024-09-21T00:58:15.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.325+0000 7f0a97fff640 1 -- 172.21.15.1:0/628786227 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ab0019070 con 0x55572253c390 2024-09-21T00:58:15.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.326+0000 7f0a97fff640 1 -- 172.21.15.1:0/628786227 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7f0aa40ccd20 con 0x55572253c390 2024-09-21T00:58:15.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.326+0000 7f0ac52d4740 10 client.15945 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:58:15.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.326+0000 7f0ac52d4740 10 client.15945 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:58:15.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.326+0000 7f0ac52d4740 20 client.15945 populate_metadata read hostname 'smithi001' 2024-09-21T00:58:15.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.326+0000 7f0ac52d4740 1 --2- 172.21.15.1:0/628786227 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55572251b9f0 0x555722921b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:15.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.326+0000 7f0ac52d4740 4 client.15945 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:58:15.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.326+0000 7f0ac52d4740 1 -- 172.21.15.1:0/628786227 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55572287cdf0 con 0x55572251b9f0 2024-09-21T00:58:15.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.326+0000 7f0abcafc640 1 --2- 172.21.15.1:0/628786227 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55572251b9f0 0x555722921b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:15.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.327+0000 7f0abcafc640 1 --2- 172.21.15.1:0/628786227 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55572251b9f0 0x555722921b90 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f8d6958bbc9c337 server_cookie=d32648af2045f8a9 in_seq=0 out_seq=0 2024-09-21T00:58:15.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.327+0000 7f0a97fff640 10 client.15945 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:15.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.327+0000 7f0a97fff640 1 -- 172.21.15.1:0/628786227 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55572287cdf0 con 0x55572251b9f0 2024-09-21T00:58:15.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.327+0000 7f0a97fff640 10 client.15945 handle_command_reply: tid=0 2024-09-21T00:58:15.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.327+0000 7f0ac52d4740 1 client.15945 shutdown 2024-09-21T00:58:15.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.327+0000 7f0ac52d4740 1 -- 172.21.15.1:0/628786227 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55572253c390 msgr2=0x55572290ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:15.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.327+0000 7f0ac52d4740 1 --2- 172.21.15.1:0/628786227 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55572253c390 0x55572290ff00 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4031440 tx=0x7f0aa403b690 comp rx=0 tx=0).stop 2024-09-21T00:58:15.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.328+0000 7f0ac52d4740 1 -- 172.21.15.1:0/628786227 shutdown_connections 2024-09-21T00:58:15.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.328+0000 7f0ac52d4740 1 --2- 172.21.15.1:0/628786227 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55572251b9f0 0x555722921b90 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.328+0000 7f0ac52d4740 1 --2- 172.21.15.1:0/628786227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55572255d070 0x55572291bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.328+0000 7f0ac52d4740 1 --2- 172.21.15.1:0/628786227 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55572253c390 0x55572290ff00 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.328+0000 7f0a97fff640 0 client.15945 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:15.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.328+0000 7f0ac52d4740 1 --2- 172.21.15.1:0/628786227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5557225341b0 0x55572290f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.328+0000 7f0ac52d4740 1 -- 172.21.15.1:0/628786227 >> 172.21.15.1:0/628786227 conn(0x555722551460 msgr2=0x555722907470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:15.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.328+0000 7f0ac52d4740 1 -- 172.21.15.1:0/628786227 shutdown_connections 2024-09-21T00:58:15.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.328+0000 7f0ac52d4740 1 -- 172.21.15.1:0/628786227 wait complete. 2024-09-21T00:58:15.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.328+0000 7f0ac52d4740 20 client.15945 trim_cache size 0 max 16384 2024-09-21T00:58:15.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.341+0000 7f0ac52d4740 1 Processor -- start 2024-09-21T00:58:15.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.341+0000 7f0ac52d4740 1 -- start start 2024-09-21T00:58:15.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.341+0000 7f0ac52d4740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5557225341b0 0x555722905a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:15.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.341+0000 7f0ac52d4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55572253c390 0x55572291bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:15.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.341+0000 7f0ac52d4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55572255d070 0x55572290cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:15.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.341+0000 7f0ac52d4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab81b16f0 con 0x55572255d070 2024-09-21T00:58:15.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.341+0000 7f0ac52d4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab81b3260 con 0x55572253c390 2024-09-21T00:58:15.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.341+0000 7f0ac52d4740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab81b1dc0 con 0x5557225341b0 2024-09-21T00:58:15.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.341+0000 7f0abd2fd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55572255d070 0x55572290cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:15.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.342+0000 7f0abd2fd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55572255d070 0x55572290cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50504/0 (socket says 172.21.15.1:50504) 2024-09-21T00:58:15.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.342+0000 7f0abd2fd640 1 -- 172.21.15.1:0/2288486984 learned_addr learned my addr 172.21.15.1:0/2288486984 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:15.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.342+0000 7f0abcafc640 1 --2- 172.21.15.1:0/2288486984 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5557225341b0 0x555722905a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:15.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.342+0000 7f0ab7fff640 1 --2- 172.21.15.1:0/2288486984 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55572253c390 0x55572291bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:15.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.342+0000 7f0abd2fd640 1 -- 172.21.15.1:0/2288486984 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5557225341b0 msgr2=0x555722905a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:15.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.342+0000 7f0abd2fd640 1 --2- 172.21.15.1:0/2288486984 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5557225341b0 0x555722905a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.342+0000 7f0abd2fd640 1 -- 172.21.15.1:0/2288486984 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55572253c390 msgr2=0x55572291bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:15.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.342+0000 7f0abd2fd640 1 --2- 172.21.15.1:0/2288486984 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55572253c390 0x55572291bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.342+0000 7f0abd2fd640 1 -- 172.21.15.1:0/2288486984 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55572290a5f0 con 0x55572255d070 2024-09-21T00:58:15.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.342+0000 7f0ab7fff640 1 --2- 172.21.15.1:0/2288486984 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55572253c390 0x55572291bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:58:15.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.342+0000 7f0abd2fd640 1 --2- 172.21.15.1:0/2288486984 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55572255d070 0x55572290cbb0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0000f80 tx=0x7f0ab0009e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c16b7cf06a044443 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:15.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.342+0000 7f0aa27fc640 1 -- 172.21.15.1:0/2288486984 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab0014ce0 con 0x55572255d070 2024-09-21T00:58:15.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.342+0000 7f0aa27fc640 1 -- 172.21.15.1:0/2288486984 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ab0019040 con 0x55572255d070 2024-09-21T00:58:15.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.342+0000 7f0aa27fc640 1 -- 172.21.15.1:0/2288486984 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab0013ed0 con 0x55572255d070 2024-09-21T00:58:15.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.343+0000 7f0ac52d4740 1 -- 172.21.15.1:0/2288486984 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55572255d070 msgr2=0x55572290cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:15.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.343+0000 7f0ac52d4740 1 --2- 172.21.15.1:0/2288486984 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55572255d070 0x55572290cbb0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0000f80 tx=0x7f0ab0009e70 comp rx=0 tx=0).stop 2024-09-21T00:58:15.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.343+0000 7f0ac52d4740 1 -- 172.21.15.1:0/2288486984 shutdown_connections 2024-09-21T00:58:15.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.343+0000 7f0ac52d4740 1 --2- 172.21.15.1:0/2288486984 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55572255d070 0x55572290cbb0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.343+0000 7f0ac52d4740 1 --2- 172.21.15.1:0/2288486984 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55572253c390 0x55572291bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.343+0000 7f0ac52d4740 1 --2- 172.21.15.1:0/2288486984 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5557225341b0 0x555722905a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.343+0000 7f0ac52d4740 1 -- 172.21.15.1:0/2288486984 >> 172.21.15.1:0/2288486984 conn(0x555722551460 msgr2=0x5557229052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:15.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.343+0000 7f0ac52d4740 1 -- 172.21.15.1:0/2288486984 shutdown_connections 2024-09-21T00:58:15.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.343+0000 7f0ac52d4740 1 -- 172.21.15.1:0/2288486984 wait complete. 2024-09-21T00:58:15.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.343+0000 7f0ac52d4740 1 -- start start 2024-09-21T00:58:15.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.344+0000 7f0ac52d4740 1 Processor -- start 2024-09-21T00:58:15.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.344+0000 7f0ac52d4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557225341b0 0x5557229146d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:15.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.344+0000 7f0ac52d4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55572253c390 0x555722914cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:15.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.344+0000 7f0ac52d4740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55572255d070 0x5557229855c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:15.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.344+0000 7f0ac52d4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab81b2b60 con 0x5557225341b0 2024-09-21T00:58:15.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.344+0000 7f0ac52d4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab81b2490 con 0x55572253c390 2024-09-21T00:58:15.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.344+0000 7f0ac52d4740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab81af6d0 con 0x55572255d070 2024-09-21T00:58:15.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.344+0000 7f0ac52d4740 10 client.0 _ll_register_callbacks cb 0x7f0aa4005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:15.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.344+0000 7f0abcafc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557225341b0 0x5557229146d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:15.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.344+0000 7f0abcafc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557225341b0 0x5557229146d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50510/0 (socket says 172.21.15.1:50510) 2024-09-21T00:58:15.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.344+0000 7f0abcafc640 1 -- 172.21.15.1:0/1230081440 learned_addr learned my addr 172.21.15.1:0/1230081440 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:15.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.344+0000 7f0ab7fff640 1 --2- 172.21.15.1:0/1230081440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55572253c390 0x555722914cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:15.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.344+0000 7f0abd2fd640 1 --2- 172.21.15.1:0/1230081440 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55572255d070 0x5557229855c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:15.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.345+0000 7f0abcafc640 1 -- 172.21.15.1:0/1230081440 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55572255d070 msgr2=0x5557229855c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:15.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.345+0000 7f0abcafc640 1 --2- 172.21.15.1:0/1230081440 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55572255d070 0x5557229855c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.345+0000 7f0abcafc640 1 -- 172.21.15.1:0/1230081440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55572253c390 msgr2=0x555722914cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:15.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.345+0000 7f0abcafc640 1 --2- 172.21.15.1:0/1230081440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55572253c390 0x555722914cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.345+0000 7f0abcafc640 1 -- 172.21.15.1:0/1230081440 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555722985c30 con 0x5557225341b0 2024-09-21T00:58:15.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.345+0000 7f0abcafc640 1 --2- 172.21.15.1:0/1230081440 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557225341b0 0x5557229146d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x555722902cf0 tx=0x7f0aac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70374899ba234438 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:15.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.345+0000 7f0a97fff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:58:15.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.345+0000 7f0a97fff640 1 -- 172.21.15.1:0/1230081440 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aac034060 con 0x5557225341b0 2024-09-21T00:58:15.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.345+0000 7f0a97fff640 1 -- 172.21.15.1:0/1230081440 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f0aac01bd70 con 0x5557225341b0 2024-09-21T00:58:15.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.345+0000 7f0ac52d4740 1 -- 172.21.15.1:0/1230081440 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ab0019040 con 0x5557225341b0 2024-09-21T00:58:15.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.345+0000 7f0a97fff640 1 -- 172.21.15.1:0/1230081440 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0aac02f480 con 0x5557225341b0 2024-09-21T00:58:15.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.345+0000 7f0ac52d4740 10 client.15951 fetch_fsmap learned FSMap version 28 2024-09-21T00:58:15.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.345+0000 7f0ac52d4740 1 -- 172.21.15.1:0/1230081440 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55572298d000 con 0x5557225341b0 2024-09-21T00:58:15.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.345+0000 7f0a97fff640 1 -- 172.21.15.1:0/1230081440 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ab0019040 con 0x5557225341b0 2024-09-21T00:58:15.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.346+0000 7f0a97fff640 1 -- 172.21.15.1:0/1230081440 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7f0aac03a6a0 con 0x5557225341b0 2024-09-21T00:58:15.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.346+0000 7f0ac52d4740 10 client.15951 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:58:15.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.346+0000 7f0ac52d4740 10 client.15951 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:58:15.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.346+0000 7f0ac52d4740 20 client.15951 populate_metadata read hostname 'smithi001' 2024-09-21T00:58:15.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.346+0000 7f0ac52d4740 1 --2- 172.21.15.1:0/1230081440 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5557224f0da0 0x55572298f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:15.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.346+0000 7f0ac52d4740 4 client.15951 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:58:15.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.346+0000 7f0ac52d4740 1 -- 172.21.15.1:0/1230081440 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5557228788a0 con 0x5557224f0da0 2024-09-21T00:58:15.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.346+0000 7f0ab7fff640 1 --2- 172.21.15.1:0/1230081440 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5557224f0da0 0x55572298f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:15.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.346+0000 7f0ab7fff640 1 --2- 172.21.15.1:0/1230081440 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5557224f0da0 0x55572298f7d0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64a78056cf190bfe server_cookie=4c8444f74d87a97b in_seq=0 out_seq=0 2024-09-21T00:58:15.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.346+0000 7f0a97fff640 10 client.15951 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:15.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.346+0000 7f0a97fff640 1 -- 172.21.15.1:0/1230081440 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5557228788a0 con 0x5557224f0da0 2024-09-21T00:58:15.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.346+0000 7f0a97fff640 10 client.15951 handle_command_reply: tid=0 2024-09-21T00:58:15.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.346+0000 7f0ac52d4740 1 client.15951 shutdown 2024-09-21T00:58:15.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.347+0000 7f0ac52d4740 1 -- 172.21.15.1:0/1230081440 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557225341b0 msgr2=0x5557229146d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:15.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.347+0000 7f0ac52d4740 1 --2- 172.21.15.1:0/1230081440 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557225341b0 0x5557229146d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x555722902cf0 tx=0x7f0aac0046c0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.347+0000 7f0ac52d4740 1 -- 172.21.15.1:0/1230081440 shutdown_connections 2024-09-21T00:58:15.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.347+0000 7f0ac52d4740 1 --2- 172.21.15.1:0/1230081440 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5557224f0da0 0x55572298f7d0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.347+0000 7f0ac52d4740 1 --2- 172.21.15.1:0/1230081440 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55572255d070 0x5557229855c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.347+0000 7f0ac52d4740 1 --2- 172.21.15.1:0/1230081440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55572253c390 0x555722914cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.347+0000 7f0ac52d4740 1 --2- 172.21.15.1:0/1230081440 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557225341b0 0x5557229146d0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.347+0000 7f0ac52d4740 1 -- 172.21.15.1:0/1230081440 >> 172.21.15.1:0/1230081440 conn(0x555722551460 msgr2=0x555722911600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:15.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.347+0000 7f0a97fff640 0 client.15951 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:15.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.347+0000 7f0ac52d4740 1 -- 172.21.15.1:0/1230081440 shutdown_connections 2024-09-21T00:58:15.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.347+0000 7f0ac52d4740 1 -- 172.21.15.1:0/1230081440 wait complete. 2024-09-21T00:58:15.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.347+0000 7f0ac52d4740 20 client.15951 trim_cache size 0 max 16384 2024-09-21T00:58:15.352 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T00:58:15.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.348+0000 7f0abed60640 1 -- 172.21.15.1:0/559376542 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f0aa80b6510 msgr2=0x7f0aa80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:15.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.348+0000 7f0abed60640 1 --2- 172.21.15.1:0/559376542 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f0aa80b6510 0x7f0aa80b8a20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x555722902f40 tx=0x7f0aac00a2d0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.348+0000 7f0abed60640 1 -- 172.21.15.1:0/559376542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ab81083c0 msgr2=0x7f0ab8105640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:15.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.348+0000 7f0abed60640 1 --2- 172.21.15.1:0/559376542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ab81083c0 0x7f0ab8105640 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4031a90 tx=0x7f0aa4004270 comp rx=0 tx=0).stop 2024-09-21T00:58:15.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.348+0000 7f0abed60640 1 -- 172.21.15.1:0/559376542 shutdown_connections 2024-09-21T00:58:15.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.348+0000 7f0abed60640 1 --2- 172.21.15.1:0/559376542 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ab8108d10 0x7f0ab8105b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.348+0000 7f0abed60640 1 --2- 172.21.15.1:0/559376542 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f0aa80b6510 0x7f0aa80b8a20 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.348+0000 7f0abed60640 1 --2- 172.21.15.1:0/559376542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ab81083c0 0x7f0ab8105640 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.348+0000 7f0abed60640 1 --2- 172.21.15.1:0/559376542 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0ab8102a80 0x7f0ab8105100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.348+0000 7f0abed60640 1 -- 172.21.15.1:0/559376542 >> 172.21.15.1:0/559376542 conn(0x7f0ab8079740 msgr2=0x7f0ab806bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:15.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.348+0000 7f0abed60640 1 -- 172.21.15.1:0/559376542 shutdown_connections 2024-09-21T00:58:15.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:15.348+0000 7f0abed60640 1 -- 172.21.15.1:0/559376542 wait complete. 2024-09-21T00:58:15.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:15 smithi001 ceph-mon[31211]: pgmap v389: 97 pgs: 97 active+clean; 1.9 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 111 KiB/s wr, 16 op/s 2024-09-21T00:58:15.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:15 smithi042 ceph-mon[34481]: pgmap v389: 97 pgs: 97 active+clean; 1.9 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 111 KiB/s wr, 16 op/s 2024-09-21T00:58:16.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:15 smithi193 ceph-mon[34660]: pgmap v389: 97 pgs: 97 active+clean; 1.9 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 111 KiB/s wr, 16 op/s 2024-09-21T00:58:17.056 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T00:58:17.057 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T00:58:17.326 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:58:17.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.845+0000 7ff80f62a640 1 -- 172.21.15.1:0/810026623 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff808110200 msgr2=0x7ff808112620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:17.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.845+0000 7ff80f62a640 1 --2- 172.21.15.1:0/810026623 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff808110200 0x7ff808112620 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ff800009ca0 tx=0x7ff80002a950 comp rx=0 tx=0).stop 2024-09-21T00:58:17.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.845+0000 7ff80f62a640 1 -- 172.21.15.1:0/810026623 shutdown_connections 2024-09-21T00:58:17.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.845+0000 7ff80f62a640 1 --2- 172.21.15.1:0/810026623 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff808110200 0x7ff808112620 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.845+0000 7ff80f62a640 1 --2- 172.21.15.1:0/810026623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff808102fa0 0x7ff80810fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.845+0000 7ff80f62a640 1 --2- 172.21.15.1:0/810026623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff808102650 0x7ff808102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.845+0000 7ff80f62a640 1 -- 172.21.15.1:0/810026623 >> 172.21.15.1:0/810026623 conn(0x7ff808079760 msgr2=0x7ff808079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:17.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.845+0000 7ff80f62a640 1 -- 172.21.15.1:0/810026623 shutdown_connections 2024-09-21T00:58:17.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.845+0000 7ff80f62a640 1 -- 172.21.15.1:0/810026623 wait complete. 2024-09-21T00:58:17.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.846+0000 7ff80f62a640 1 Processor -- start 2024-09-21T00:58:17.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.846+0000 7ff80f62a640 1 -- start start 2024-09-21T00:58:17.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.846+0000 7ff80f62a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff808102650 0x7ff80819c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:17.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.846+0000 7ff80f62a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff808102fa0 0x7ff80819cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:17.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.846+0000 7ff80f62a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff808110200 0x7ff8081a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:17.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.846+0000 7ff80f62a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff808115ca0 con 0x7ff808102fa0 2024-09-21T00:58:17.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.846+0000 7ff80f62a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff808115b20 con 0x7ff808102650 2024-09-21T00:58:17.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.846+0000 7ff80f62a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff808115e20 con 0x7ff808110200 2024-09-21T00:58:17.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.846+0000 7ff80cbc5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff808102fa0 0x7ff80819cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:17.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.846+0000 7ff80cbc5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff808102fa0 0x7ff80819cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50530/0 (socket says 172.21.15.1:50530) 2024-09-21T00:58:17.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.846+0000 7ff80cbc5640 1 -- 172.21.15.1:0/3656873443 learned_addr learned my addr 172.21.15.1:0/3656873443 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:17.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.846+0000 7ff80d3c6640 1 --2- 172.21.15.1:0/3656873443 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff808102650 0x7ff80819c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:17.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.846+0000 7ff80cbc5640 1 -- 172.21.15.1:0/3656873443 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff808110200 msgr2=0x7ff8081a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:17.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.846+0000 7ff80dbc7640 1 --2- 172.21.15.1:0/3656873443 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff808110200 0x7ff8081a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:17.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.846+0000 7ff80cbc5640 1 --2- 172.21.15.1:0/3656873443 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff808110200 0x7ff8081a1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.846+0000 7ff80cbc5640 1 -- 172.21.15.1:0/3656873443 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff808102650 msgr2=0x7ff80819c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:17.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.846+0000 7ff80cbc5640 1 --2- 172.21.15.1:0/3656873443 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff808102650 0x7ff80819c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.846+0000 7ff80cbc5640 1 -- 172.21.15.1:0/3656873443 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8081a24c0 con 0x7ff808102fa0 2024-09-21T00:58:17.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.846+0000 7ff80d3c6640 1 --2- 172.21.15.1:0/3656873443 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff808102650 0x7ff80819c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:58:17.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.847+0000 7ff80cbc5640 1 --2- 172.21.15.1:0/3656873443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff808102fa0 0x7ff80819cbb0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7ff7f800c890 tx=0x7ff7f800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:17.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.847+0000 7ff7fe7fc640 1 -- 172.21.15.1:0/3656873443 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f8004220 con 0x7ff808102fa0 2024-09-21T00:58:17.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.847+0000 7ff7fe7fc640 1 -- 172.21.15.1:0/3656873443 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7f80043c0 con 0x7ff808102fa0 2024-09-21T00:58:17.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.847+0000 7ff80f62a640 1 -- 172.21.15.1:0/3656873443 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8081a27b0 con 0x7ff808102fa0 2024-09-21T00:58:17.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.847+0000 7ff7fe7fc640 1 -- 172.21.15.1:0/3656873443 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f8004a00 con 0x7ff808102fa0 2024-09-21T00:58:17.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.847+0000 7ff80f62a640 1 -- 172.21.15.1:0/3656873443 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8081a8fd0 con 0x7ff808102fa0 2024-09-21T00:58:17.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.850+0000 7ff815b9e740 1 Processor -- start 2024-09-21T00:58:17.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.850+0000 7ff815b9e740 1 -- start start 2024-09-21T00:58:17.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.850+0000 7ff815b9e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629b1d77350 0x5629b211e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:17.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.850+0000 7ff815b9e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629b1d4e490 0x5629b211e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:17.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.850+0000 7ff815b9e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b1d56670 0x5629b211eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:17.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.850+0000 7ff815b9e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5629b2094e60 con 0x5629b1d56670 2024-09-21T00:58:17.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.850+0000 7ff815b9e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5629b2084290 con 0x5629b1d4e490 2024-09-21T00:58:17.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.850+0000 7ff815b9e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5629b20880a0 con 0x5629b1d77350 2024-09-21T00:58:17.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.850+0000 7ff7fe7fc640 1 -- 172.21.15.1:0/3656873443 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7ff7f8004ba0 con 0x7ff808102fa0 2024-09-21T00:58:17.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.850+0000 7ff80cbc5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b1d56670 0x5629b211eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:17.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.851+0000 7ff80dbc7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629b1d77350 0x5629b211e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:17.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.851+0000 7ff80cbc5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b1d56670 0x5629b211eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50536/0 (socket says 172.21.15.1:50536) 2024-09-21T00:58:17.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.851+0000 7ff80cbc5640 1 -- 172.21.15.1:0/1630154825 learned_addr learned my addr 172.21.15.1:0/1630154825 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:17.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.851+0000 7ff80d3c6640 1 --2- 172.21.15.1:0/1630154825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629b1d4e490 0x5629b211e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:17.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.851+0000 7ff80cbc5640 1 -- 172.21.15.1:0/1630154825 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629b1d77350 msgr2=0x5629b211e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:17.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.851+0000 7ff80cbc5640 1 --2- 172.21.15.1:0/1630154825 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629b1d77350 0x5629b211e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.851+0000 7ff80cbc5640 1 -- 172.21.15.1:0/1630154825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629b1d4e490 msgr2=0x5629b211e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:17.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.851+0000 7ff80cbc5640 1 --2- 172.21.15.1:0/1630154825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629b1d4e490 0x5629b211e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.851+0000 7ff80cbc5640 1 -- 172.21.15.1:0/1630154825 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629b1de2930 con 0x5629b1d56670 2024-09-21T00:58:17.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.851+0000 7ff80cbc5640 1 --2- 172.21.15.1:0/1630154825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b1d56670 0x5629b211eeb0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff7f80ef480 tx=0x7ff7f80ef940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2a6b78d74224270 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:17.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.851+0000 7ff7f37fe640 1 -- 172.21.15.1:0/1630154825 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f80fa070 con 0x5629b1d56670 2024-09-21T00:58:17.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.851+0000 7ff7f37fe640 1 -- 172.21.15.1:0/1630154825 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7f80e79c0 con 0x5629b1d56670 2024-09-21T00:58:17.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.851+0000 7ff7f37fe640 1 -- 172.21.15.1:0/1630154825 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f80f5ab0 con 0x5629b1d56670 2024-09-21T00:58:17.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.852+0000 7ff7fe7fc640 1 --2- 172.21.15.1:0/3656873443 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff7f40b65c0 0x7ff7f40b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:17.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.852+0000 7ff80dbc7640 1 --2- 172.21.15.1:0/3656873443 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff7f40b65c0 0x7ff7f40b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:17.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.852+0000 7ff7fe7fc640 1 -- 172.21.15.1:0/3656873443 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7ff7f80e6ff0 con 0x7ff808102fa0 2024-09-21T00:58:17.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.852+0000 7ff815b9e740 1 -- 172.21.15.1:0/1630154825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b1d56670 msgr2=0x5629b211eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:17.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.852+0000 7ff80dbc7640 1 --2- 172.21.15.1:0/3656873443 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff7f40b65c0 0x7ff7f40b8ad0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff800009a60 tx=0x7ff80003c040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:17.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.852+0000 7ff815b9e740 1 --2- 172.21.15.1:0/1630154825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b1d56670 0x5629b211eeb0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff7f80ef480 tx=0x7ff7f80ef940 comp rx=0 tx=0).stop 2024-09-21T00:58:17.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.853+0000 7ff815b9e740 1 -- 172.21.15.1:0/1630154825 shutdown_connections 2024-09-21T00:58:17.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.853+0000 7ff815b9e740 1 --2- 172.21.15.1:0/1630154825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b1d56670 0x5629b211eeb0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.853+0000 7ff815b9e740 1 --2- 172.21.15.1:0/1630154825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629b1d4e490 0x5629b211e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.853+0000 7ff815b9e740 1 --2- 172.21.15.1:0/1630154825 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629b1d77350 0x5629b211e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.853+0000 7ff815b9e740 1 -- 172.21.15.1:0/1630154825 >> 172.21.15.1:0/1630154825 conn(0x5629b1d6b740 msgr2=0x5629b211c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:17.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.853+0000 7ff815b9e740 1 -- 172.21.15.1:0/1630154825 shutdown_connections 2024-09-21T00:58:17.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.853+0000 7ff815b9e740 1 -- 172.21.15.1:0/1630154825 wait complete. 2024-09-21T00:58:17.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.853+0000 7ff815b9e740 1 -- start start 2024-09-21T00:58:17.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.853+0000 7ff815b9e740 1 Processor -- start 2024-09-21T00:58:17.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.854+0000 7ff815b9e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629b1d4e490 0x5629b2129ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:17.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.854+0000 7ff815b9e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b1d56670 0x5629b212a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:17.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.854+0000 7ff815b9e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629b1d77350 0x5629b2135f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:17.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.854+0000 7ff815b9e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5629b1ee5890 con 0x5629b1d56670 2024-09-21T00:58:17.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.854+0000 7ff815b9e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5629b201ed40 con 0x5629b1d77350 2024-09-21T00:58:17.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.854+0000 7ff815b9e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5629b212cc10 con 0x5629b1d4e490 2024-09-21T00:58:17.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.854+0000 7ff815b9e740 10 client.0 _ll_register_callbacks cb 0x5629b2082c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:17.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.854+0000 7ff80cbc5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b1d56670 0x5629b212a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:17.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.854+0000 7ff80cbc5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b1d56670 0x5629b212a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50550/0 (socket says 172.21.15.1:50550) 2024-09-21T00:58:17.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.854+0000 7ff80cbc5640 1 -- 172.21.15.1:0/2707337717 learned_addr learned my addr 172.21.15.1:0/2707337717 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:17.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.854+0000 7ff80dbc7640 1 --2- 172.21.15.1:0/2707337717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629b1d77350 0x5629b2135f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:17.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.854+0000 7ff80d3c6640 1 --2- 172.21.15.1:0/2707337717 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629b1d4e490 0x5629b2129ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:17.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.854+0000 7ff80cbc5640 1 -- 172.21.15.1:0/2707337717 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629b1d4e490 msgr2=0x5629b2129ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:17.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.854+0000 7ff80cbc5640 1 --2- 172.21.15.1:0/2707337717 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629b1d4e490 0x5629b2129ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.854+0000 7ff80cbc5640 1 -- 172.21.15.1:0/2707337717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629b1d77350 msgr2=0x5629b2135f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:17.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.854+0000 7ff80cbc5640 1 --2- 172.21.15.1:0/2707337717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629b1d77350 0x5629b2135f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.854+0000 7ff80cbc5640 1 -- 172.21.15.1:0/2707337717 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629b2136520 con 0x5629b1d56670 2024-09-21T00:58:17.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.854+0000 7ff80cbc5640 1 --2- 172.21.15.1:0/2707337717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b1d56670 0x5629b212a530 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff7f80ad190 tx=0x7ff7f80ead50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b178366dd0a0e37 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:17.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.854+0000 7ff7f0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:58:17.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.854+0000 7ff7f0ff9640 1 -- 172.21.15.1:0/2707337717 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f801d070 con 0x5629b1d56670 2024-09-21T00:58:17.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.855+0000 7ff7f0ff9640 1 -- 172.21.15.1:0/2707337717 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7ff7f80b6790 con 0x5629b1d56670 2024-09-21T00:58:17.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.855+0000 7ff815b9e740 1 -- 172.21.15.1:0/2707337717 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7f80e79c0 con 0x5629b1d56670 2024-09-21T00:58:17.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.855+0000 7ff7f0ff9640 1 -- 172.21.15.1:0/2707337717 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff7f80a9850 con 0x5629b1d56670 2024-09-21T00:58:17.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.855+0000 7ff815b9e740 10 client.15963 fetch_fsmap learned FSMap version 28 2024-09-21T00:58:17.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.855+0000 7ff815b9e740 1 -- 172.21.15.1:0/2707337717 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5629b2138e30 con 0x5629b1d56670 2024-09-21T00:58:17.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.855+0000 7ff7f0ff9640 1 -- 172.21.15.1:0/2707337717 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7f80e79c0 con 0x5629b1d56670 2024-09-21T00:58:17.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.855+0000 7ff7f0ff9640 1 -- 172.21.15.1:0/2707337717 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7ff7f80e7b70 con 0x5629b1d56670 2024-09-21T00:58:17.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.855+0000 7ff815b9e740 10 client.15963 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:58:17.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.855+0000 7ff815b9e740 10 client.15963 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:58:17.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.855+0000 7ff815b9e740 20 client.15963 populate_metadata read hostname 'smithi001' 2024-09-21T00:58:17.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.855+0000 7ff815b9e740 1 --2- 172.21.15.1:0/2707337717 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5629b1d35cd0 0x5629b213c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:17.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.855+0000 7ff815b9e740 4 client.15963 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:58:17.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.855+0000 7ff815b9e740 1 -- 172.21.15.1:0/2707337717 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629b2096db0 con 0x5629b1d35cd0 2024-09-21T00:58:17.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.855+0000 7ff80d3c6640 1 --2- 172.21.15.1:0/2707337717 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5629b1d35cd0 0x5629b213c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:17.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.856+0000 7ff80d3c6640 1 --2- 172.21.15.1:0/2707337717 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5629b1d35cd0 0x5629b213c190 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=851e066ad7f8ae5f server_cookie=2245c3391b113fee in_seq=0 out_seq=0 2024-09-21T00:58:17.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.856+0000 7ff7f0ff9640 10 client.15963 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:17.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.857+0000 7ff7f0ff9640 1 -- 172.21.15.1:0/2707337717 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5629b2096db0 con 0x5629b1d35cd0 2024-09-21T00:58:17.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.857+0000 7ff7f0ff9640 10 client.15963 handle_command_reply: tid=0 2024-09-21T00:58:17.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.857+0000 7ff815b9e740 1 client.15963 shutdown 2024-09-21T00:58:17.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.857+0000 7ff815b9e740 1 -- 172.21.15.1:0/2707337717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b1d56670 msgr2=0x5629b212a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:17.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.857+0000 7ff815b9e740 1 --2- 172.21.15.1:0/2707337717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b1d56670 0x5629b212a530 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff7f80ad190 tx=0x7ff7f80ead50 comp rx=0 tx=0).stop 2024-09-21T00:58:17.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.857+0000 7ff815b9e740 1 -- 172.21.15.1:0/2707337717 shutdown_connections 2024-09-21T00:58:17.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.857+0000 7ff815b9e740 1 --2- 172.21.15.1:0/2707337717 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5629b1d35cd0 0x5629b213c190 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.857+0000 7ff815b9e740 1 --2- 172.21.15.1:0/2707337717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629b1d77350 0x5629b2135f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.857+0000 7ff815b9e740 1 --2- 172.21.15.1:0/2707337717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b1d56670 0x5629b212a530 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.857+0000 7ff815b9e740 1 --2- 172.21.15.1:0/2707337717 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629b1d4e490 0x5629b2129ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.857+0000 7ff815b9e740 1 -- 172.21.15.1:0/2707337717 >> 172.21.15.1:0/2707337717 conn(0x5629b1d6b740 msgr2=0x5629b21215c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:17.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.857+0000 7ff7f0ff9640 0 client.15963 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:17.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.857+0000 7ff815b9e740 1 -- 172.21.15.1:0/2707337717 shutdown_connections 2024-09-21T00:58:17.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.857+0000 7ff815b9e740 1 -- 172.21.15.1:0/2707337717 wait complete. 2024-09-21T00:58:17.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.857+0000 7ff815b9e740 20 client.15963 trim_cache size 0 max 16384 2024-09-21T00:58:17.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.877+0000 7ff815b9e740 1 Processor -- start 2024-09-21T00:58:17.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.877+0000 7ff815b9e740 1 -- start start 2024-09-21T00:58:17.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.878+0000 7ff815b9e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629b1d4e490 0x5629b2135ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:17.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.878+0000 7ff815b9e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b1d56670 0x5629b2126fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:17.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.878+0000 7ff815b9e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629b1d77350 0x5629b2127520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:17.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.878+0000 7ff815b9e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff8081b16d0 con 0x5629b1d56670 2024-09-21T00:58:17.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.878+0000 7ff815b9e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff8081b3240 con 0x5629b1d4e490 2024-09-21T00:58:17.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.878+0000 7ff815b9e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff8081b1da0 con 0x5629b1d77350 2024-09-21T00:58:17.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.878+0000 7ff80cbc5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b1d56670 0x5629b2126fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:17.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.878+0000 7ff80cbc5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b1d56670 0x5629b2126fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50558/0 (socket says 172.21.15.1:50558) 2024-09-21T00:58:17.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.878+0000 7ff80cbc5640 1 -- 172.21.15.1:0/2936511229 learned_addr learned my addr 172.21.15.1:0/2936511229 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:17.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.878+0000 7ff80dbc7640 1 --2- 172.21.15.1:0/2936511229 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629b1d77350 0x5629b2127520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:17.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.878+0000 7ff80d3c6640 1 --2- 172.21.15.1:0/2936511229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629b1d4e490 0x5629b2135ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:17.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.878+0000 7ff80cbc5640 1 -- 172.21.15.1:0/2936511229 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629b1d77350 msgr2=0x5629b2127520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:17.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.878+0000 7ff80cbc5640 1 --2- 172.21.15.1:0/2936511229 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629b1d77350 0x5629b2127520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.878+0000 7ff80cbc5640 1 -- 172.21.15.1:0/2936511229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629b1d4e490 msgr2=0x5629b2135ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:17.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.878+0000 7ff80cbc5640 1 --2- 172.21.15.1:0/2936511229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629b1d4e490 0x5629b2135ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.878+0000 7ff80cbc5640 1 -- 172.21.15.1:0/2936511229 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629b2120720 con 0x5629b1d56670 2024-09-21T00:58:17.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.878+0000 7ff80cbc5640 1 --2- 172.21.15.1:0/2936511229 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b1d56670 0x5629b2126fe0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8004610 tx=0x7ff7f80ef940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca06402598a8f3d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:17.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.879+0000 7ff7f2ffd640 1 -- 172.21.15.1:0/2936511229 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f801d070 con 0x5629b1d56670 2024-09-21T00:58:17.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.879+0000 7ff7f2ffd640 1 -- 172.21.15.1:0/2936511229 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7f80eaa10 con 0x5629b1d56670 2024-09-21T00:58:17.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.879+0000 7ff7f2ffd640 1 -- 172.21.15.1:0/2936511229 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f80ac970 con 0x5629b1d56670 2024-09-21T00:58:17.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.880+0000 7ff815b9e740 1 -- 172.21.15.1:0/2936511229 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b1d56670 msgr2=0x5629b2126fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:17.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.880+0000 7ff815b9e740 1 --2- 172.21.15.1:0/2936511229 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b1d56670 0x5629b2126fe0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8004610 tx=0x7ff7f80ef940 comp rx=0 tx=0).stop 2024-09-21T00:58:17.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.880+0000 7ff815b9e740 1 -- 172.21.15.1:0/2936511229 shutdown_connections 2024-09-21T00:58:17.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.880+0000 7ff815b9e740 1 --2- 172.21.15.1:0/2936511229 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629b1d77350 0x5629b2127520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.880+0000 7ff815b9e740 1 --2- 172.21.15.1:0/2936511229 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b1d56670 0x5629b2126fe0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.880+0000 7ff815b9e740 1 --2- 172.21.15.1:0/2936511229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629b1d4e490 0x5629b2135ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.880+0000 7ff815b9e740 1 -- 172.21.15.1:0/2936511229 >> 172.21.15.1:0/2936511229 conn(0x5629b1d6b740 msgr2=0x5629b2128670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:17.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.880+0000 7ff815b9e740 1 -- 172.21.15.1:0/2936511229 shutdown_connections 2024-09-21T00:58:17.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.880+0000 7ff815b9e740 1 -- 172.21.15.1:0/2936511229 wait complete. 2024-09-21T00:58:17.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.880+0000 7ff815b9e740 1 -- start start 2024-09-21T00:58:17.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.880+0000 7ff815b9e740 1 Processor -- start 2024-09-21T00:58:17.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.881+0000 7ff815b9e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629b1d4e490 0x5629b213d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:17.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.881+0000 7ff815b9e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b1d56670 0x5629b213d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:17.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.881+0000 7ff815b9e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629b1d77350 0x5629b213dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:17.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.881+0000 7ff815b9e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff8081b2b40 con 0x5629b1d56670 2024-09-21T00:58:17.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.881+0000 7ff815b9e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff8081b2470 con 0x5629b1d4e490 2024-09-21T00:58:17.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.881+0000 7ff815b9e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff8081af6b0 con 0x5629b1d77350 2024-09-21T00:58:17.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.881+0000 7ff815b9e740 10 client.0 _ll_register_callbacks cb 0x7ff7f80f8070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:17.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.881+0000 7ff80cbc5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b1d56670 0x5629b213d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:17.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.881+0000 7ff80cbc5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b1d56670 0x5629b213d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50570/0 (socket says 172.21.15.1:50570) 2024-09-21T00:58:17.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.881+0000 7ff80d3c6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629b1d4e490 0x5629b213d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:17.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.881+0000 7ff80cbc5640 1 -- 172.21.15.1:0/538189760 learned_addr learned my addr 172.21.15.1:0/538189760 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:17.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.881+0000 7ff80dbc7640 1 --2- 172.21.15.1:0/538189760 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629b1d77350 0x5629b213dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:17.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.881+0000 7ff80cbc5640 1 -- 172.21.15.1:0/538189760 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629b1d77350 msgr2=0x5629b213dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:17.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.881+0000 7ff80cbc5640 1 --2- 172.21.15.1:0/538189760 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629b1d77350 0x5629b213dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.881+0000 7ff80cbc5640 1 -- 172.21.15.1:0/538189760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629b1d4e490 msgr2=0x5629b213d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:17.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.881+0000 7ff80cbc5640 1 --2- 172.21.15.1:0/538189760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629b1d4e490 0x5629b213d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.881+0000 7ff80cbc5640 1 -- 172.21.15.1:0/538189760 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629b21a5a10 con 0x5629b1d56670 2024-09-21T00:58:17.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.882+0000 7ff80cbc5640 1 --2- 172.21.15.1:0/538189760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b1d56670 0x5629b213d800 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff7f80ef3d0 tx=0x7ff7f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4cf4ea4392e643e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:17.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.882+0000 7ff7f0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:58:17.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.882+0000 7ff7f0ff9640 1 -- 172.21.15.1:0/538189760 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f801d050 con 0x5629b1d56670 2024-09-21T00:58:17.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.882+0000 7ff7f0ff9640 1 -- 172.21.15.1:0/538189760 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7ff7f80b6990 con 0x5629b1d56670 2024-09-21T00:58:17.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.882+0000 7ff815b9e740 1 -- 172.21.15.1:0/538189760 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7f80eaa10 con 0x5629b1d56670 2024-09-21T00:58:17.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.882+0000 7ff7f0ff9640 1 -- 172.21.15.1:0/538189760 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff7f80acb50 con 0x5629b1d56670 2024-09-21T00:58:17.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.882+0000 7ff815b9e740 10 client.15969 fetch_fsmap learned FSMap version 28 2024-09-21T00:58:17.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.882+0000 7ff815b9e740 1 -- 172.21.15.1:0/538189760 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5629b21a5a10 con 0x5629b1d56670 2024-09-21T00:58:17.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.882+0000 7ff7f0ff9640 1 -- 172.21.15.1:0/538189760 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7f80eaa10 con 0x5629b1d56670 2024-09-21T00:58:17.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.883+0000 7ff7f0ff9640 1 -- 172.21.15.1:0/538189760 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7ff7f80d0b80 con 0x5629b1d56670 2024-09-21T00:58:17.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.883+0000 7ff815b9e740 10 client.15969 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:58:17.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.883+0000 7ff815b9e740 10 client.15969 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:58:17.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.883+0000 7ff815b9e740 20 client.15969 populate_metadata read hostname 'smithi001' 2024-09-21T00:58:17.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.883+0000 7ff815b9e740 1 --2- 172.21.15.1:0/538189760 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5629b1d0b080 0x5629b21a9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:17.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.883+0000 7ff815b9e740 4 client.15969 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T00:58:17.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.883+0000 7ff815b9e740 1 -- 172.21.15.1:0/538189760 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5629b2092860 con 0x5629b1d0b080 2024-09-21T00:58:17.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.883+0000 7ff80d3c6640 1 --2- 172.21.15.1:0/538189760 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5629b1d0b080 0x5629b21a9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:17.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.883+0000 7ff80d3c6640 1 --2- 172.21.15.1:0/538189760 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5629b1d0b080 0x5629b21a9050 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2e0f53d72887304 server_cookie=d4a8f493ee01d968 in_seq=0 out_seq=0 2024-09-21T00:58:17.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.883+0000 7ff7f0ff9640 10 client.15969 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:17.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.885+0000 7ff7f0ff9640 1 -- 172.21.15.1:0/538189760 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5629b2092860 con 0x5629b1d0b080 2024-09-21T00:58:17.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.885+0000 7ff7f0ff9640 10 client.15969 handle_command_reply: tid=0 2024-09-21T00:58:17.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.885+0000 7ff815b9e740 1 client.15969 shutdown 2024-09-21T00:58:17.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.885+0000 7ff815b9e740 1 -- 172.21.15.1:0/538189760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b1d56670 msgr2=0x5629b213d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:17.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.885+0000 7ff815b9e740 1 --2- 172.21.15.1:0/538189760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b1d56670 0x5629b213d800 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff7f80ef3d0 tx=0x7ff7f80046c0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.885+0000 7ff815b9e740 1 -- 172.21.15.1:0/538189760 shutdown_connections 2024-09-21T00:58:17.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.885+0000 7ff815b9e740 1 --2- 172.21.15.1:0/538189760 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5629b1d0b080 0x5629b21a9050 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.885+0000 7ff815b9e740 1 --2- 172.21.15.1:0/538189760 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629b1d77350 0x5629b213dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.885+0000 7ff815b9e740 1 --2- 172.21.15.1:0/538189760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b1d56670 0x5629b213d800 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.885+0000 7ff815b9e740 1 --2- 172.21.15.1:0/538189760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629b1d4e490 0x5629b213d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.885+0000 7ff815b9e740 1 -- 172.21.15.1:0/538189760 >> 172.21.15.1:0/538189760 conn(0x5629b1d6b740 msgr2=0x5629b2121530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:17.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.886+0000 7ff7f0ff9640 0 client.15969 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:17.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.886+0000 7ff815b9e740 1 -- 172.21.15.1:0/538189760 shutdown_connections 2024-09-21T00:58:17.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.886+0000 7ff815b9e740 1 -- 172.21.15.1:0/538189760 wait complete. 2024-09-21T00:58:17.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.886+0000 7ff815b9e740 20 client.15969 trim_cache size 0 max 16384 2024-09-21T00:58:17.889 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T00:58:17.889 INFO:teuthology.orchestra.run.smithi001.stdout: "return_code": 0, 2024-09-21T00:58:17.889 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_tag": "bee49cce-b407-4617-a959-331ffd8dc5b0", 2024-09-21T00:58:17.889 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": "asynchronous" 2024-09-21T00:58:17.889 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T00:58:17.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.886+0000 7ff80f62a640 1 -- 172.21.15.1:0/3656873443 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff7f40b65c0 msgr2=0x7ff7f40b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:17.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.886+0000 7ff80f62a640 1 --2- 172.21.15.1:0/3656873443 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff7f40b65c0 0x7ff7f40b8ad0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff800009a60 tx=0x7ff80003c040 comp rx=0 tx=0).stop 2024-09-21T00:58:17.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.886+0000 7ff80f62a640 1 -- 172.21.15.1:0/3656873443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff808102fa0 msgr2=0x7ff80819cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:17.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.886+0000 7ff80f62a640 1 --2- 172.21.15.1:0/3656873443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff808102fa0 0x7ff80819cbb0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7ff7f800c890 tx=0x7ff7f800cd50 comp rx=0 tx=0).stop 2024-09-21T00:58:17.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.886+0000 7ff80f62a640 1 -- 172.21.15.1:0/3656873443 shutdown_connections 2024-09-21T00:58:17.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.886+0000 7ff80f62a640 1 --2- 172.21.15.1:0/3656873443 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff808110200 0x7ff8081a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.886+0000 7ff80f62a640 1 --2- 172.21.15.1:0/3656873443 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff7f40b65c0 0x7ff7f40b8ad0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.886+0000 7ff80f62a640 1 --2- 172.21.15.1:0/3656873443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff808102fa0 0x7ff80819cbb0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.886+0000 7ff80f62a640 1 --2- 172.21.15.1:0/3656873443 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff808102650 0x7ff80819c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.886+0000 7ff80f62a640 1 -- 172.21.15.1:0/3656873443 >> 172.21.15.1:0/3656873443 conn(0x7ff808079760 msgr2=0x7ff808109d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:17.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.887+0000 7ff80f62a640 1 -- 172.21.15.1:0/3656873443 shutdown_connections 2024-09-21T00:58:17.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:17.887+0000 7ff80f62a640 1 -- 172.21.15.1:0/3656873443 wait complete. 2024-09-21T00:58:18.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:17 smithi001 ceph-mon[31211]: pgmap v390: 97 pgs: 97 active+clean; 2.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 160 KiB/s wr, 23 op/s 2024-09-21T00:58:18.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:17 smithi193 ceph-mon[34660]: pgmap v390: 97 pgs: 97 active+clean; 2.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 160 KiB/s wr, 23 op/s 2024-09-21T00:58:18.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:17 smithi042 ceph-mon[34481]: pgmap v390: 97 pgs: 97 active+clean; 2.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 160 KiB/s wr, 23 op/s 2024-09-21T00:58:18.316 INFO:tasks.workunit.client.0.smithi001.stdout:checking size of long long... 8 2024-09-21T00:58:18.376 INFO:tasks.workunit.client.0.smithi001.stdout:checking for ssize_t... yes 2024-09-21T00:58:18.420 INFO:tasks.workunit.client.0.smithi001.stdout:checking for sig_atomic_t... yes 2024-09-21T00:58:18.538 INFO:tasks.workunit.client.0.smithi001.stdout:checking whether gcc needs -traditional... no 2024-09-21T00:58:18.576 INFO:tasks.workunit.client.0.smithi001.stdout:checking for an ANSI C-conforming const... yes 2024-09-21T00:58:18.601 INFO:tasks.workunit.client.0.smithi001.stdout:checking for inline... inline 2024-09-21T00:58:18.662 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T00:58:18.663 INFO:tasks.workunit.client.0.smithi001.stdout:checking for working alloca.h... yes 2024-09-21T00:58:18.711 INFO:tasks.workunit.client.0.smithi001.stdout:checking for alloca... yes 2024-09-21T00:58:18.780 INFO:tasks.workunit.client.0.smithi001.stdout:checking for working memcmp... yes 2024-09-21T00:58:18.837 INFO:tasks.workunit.client.0.smithi001.stdout:checking for strftime... yes 2024-09-21T00:58:18.920 INFO:tasks.workunit.client.0.smithi001.stdout:checking whether lstat dereferences a symlink specified with a trailing slash... yes 2024-09-21T00:58:18.925 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:58:18.984 INFO:tasks.workunit.client.0.smithi001.stdout:checking whether stat accepts an empty string... no 2024-09-21T00:58:19.044 INFO:tasks.workunit.client.0.smithi001.stdout:checking for vprintf... yes 2024-09-21T00:58:19.047 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:18 smithi001 ceph-mon[31211]: scrub queued for path: / 2024-09-21T00:58:19.047 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:18 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T00:58:19.047 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:18 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T00:58:19.103 INFO:tasks.workunit.client.0.smithi001.stdout:checking for _doprnt... no 2024-09-21T00:58:19.126 INFO:tasks.workunit.client.0.smithi001.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-21T00:58:19.138 INFO:tasks.workunit.client.0.smithi001.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-21T00:58:19.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:18 smithi193 ceph-mon[34660]: scrub queued for path: / 2024-09-21T00:58:19.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:18 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T00:58:19.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:18 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T00:58:19.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:18 smithi042 ceph-mon[34481]: scrub queued for path: / 2024-09-21T00:58:19.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:18 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T00:58:19.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:18 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T00:58:19.306 INFO:tasks.workunit.client.0.smithi001.stdout:checking for the pthreads library -lpthreads... no 2024-09-21T00:58:19.360 INFO:tasks.workunit.client.0.smithi001.stdout:checking whether pthreads work without any flags... yes 2024-09-21T00:58:19.406 INFO:tasks.workunit.client.0.smithi001.stdout:checking for joinable pthread attribute... PTHREAD_CREATE_JOINABLE 2024-09-21T00:58:19.406 INFO:tasks.workunit.client.0.smithi001.stdout:checking if more special flags are required for pthreads... no 2024-09-21T00:58:19.406 INFO:tasks.workunit.client.0.smithi001.stdout:checking for cc_r... gcc 2024-09-21T00:58:19.492 INFO:tasks.workunit.client.0.smithi001.stdout:checking for setrlimit... yes 2024-09-21T00:58:19.556 INFO:tasks.workunit.client.0.smithi001.stdout:checking for setproctitle... no 2024-09-21T00:58:19.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.541+0000 7f46c7406640 1 -- 172.21.15.1:0/320064997 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46c010de20 msgr2=0x7f46c0110310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:19.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.541+0000 7f46c7406640 1 --2- 172.21.15.1:0/320064997 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46c010de20 0x7f46c0110310 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f46b0009ca0 tx=0x7f46b002a8c0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.541+0000 7f46c7406640 1 -- 172.21.15.1:0/320064997 shutdown_connections 2024-09-21T00:58:19.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.541+0000 7f46c7406640 1 --2- 172.21.15.1:0/320064997 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46c010de20 0x7f46c0110310 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.541+0000 7f46c7406640 1 --2- 172.21.15.1:0/320064997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46c0105310 0x7f46c010d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.541+0000 7f46c7406640 1 --2- 172.21.15.1:0/320064997 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46c01049c0 0x7f46c0104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.541+0000 7f46c7406640 1 -- 172.21.15.1:0/320064997 >> 172.21.15.1:0/320064997 conn(0x7f46c0079730 msgr2=0x7f46c0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:19.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.541+0000 7f46c7406640 1 -- 172.21.15.1:0/320064997 shutdown_connections 2024-09-21T00:58:19.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.541+0000 7f46c7406640 1 -- 172.21.15.1:0/320064997 wait complete. 2024-09-21T00:58:19.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.542+0000 7f46c7406640 1 Processor -- start 2024-09-21T00:58:19.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.542+0000 7f46c7406640 1 -- start start 2024-09-21T00:58:19.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.542+0000 7f46c7406640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46c01049c0 0x7f46c0102700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:19.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.542+0000 7f46c7406640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46c0105310 0x7f46c0102c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:19.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.542+0000 7f46c7406640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46c010de20 0x7f46c0103180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:19.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.542+0000 7f46c7406640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f46c0113a80 con 0x7f46c0105310 2024-09-21T00:58:19.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.542+0000 7f46c7406640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f46c0113900 con 0x7f46c01049c0 2024-09-21T00:58:19.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.542+0000 7f46c7406640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f46c0113c00 con 0x7f46c010de20 2024-09-21T00:58:19.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.542+0000 7f46c49a1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46c0105310 0x7f46c0102c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:19.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.542+0000 7f46c51a2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46c01049c0 0x7f46c0102700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:19.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.542+0000 7f46c49a1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46c0105310 0x7f46c0102c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57778/0 (socket says 172.21.15.1:57778) 2024-09-21T00:58:19.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.542+0000 7f46c51a2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46c01049c0 0x7f46c0102700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:36496/0 (socket says 172.21.15.1:36496) 2024-09-21T00:58:19.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.542+0000 7f46c49a1640 1 -- 172.21.15.1:0/2917717656 learned_addr learned my addr 172.21.15.1:0/2917717656 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:19.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.543+0000 7f46c59a3640 1 --2- 172.21.15.1:0/2917717656 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46c010de20 0x7f46c0103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:19.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.543+0000 7f46c51a2640 1 -- 172.21.15.1:0/2917717656 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46c010de20 msgr2=0x7f46c0103180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:19.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.543+0000 7f46c51a2640 1 --2- 172.21.15.1:0/2917717656 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46c010de20 0x7f46c0103180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.543+0000 7f46c51a2640 1 -- 172.21.15.1:0/2917717656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46c0105310 msgr2=0x7f46c0102c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:19.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.543+0000 7f46c51a2640 1 --2- 172.21.15.1:0/2917717656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46c0105310 0x7f46c0102c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.543+0000 7f46c51a2640 1 -- 172.21.15.1:0/2917717656 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46c01a87f0 con 0x7f46c01049c0 2024-09-21T00:58:19.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.543+0000 7f46c49a1640 1 --2- 172.21.15.1:0/2917717656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46c0105310 0x7f46c0102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:19.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.543+0000 7f46c51a2640 1 --2- 172.21.15.1:0/2917717656 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46c01049c0 0x7f46c0102700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f46b800d6a0 tx=0x7f46b800db60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:19.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.543+0000 7f46be7fc640 1 -- 172.21.15.1:0/2917717656 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b8017070 con 0x7f46c01049c0 2024-09-21T00:58:19.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.543+0000 7f46c7406640 1 -- 172.21.15.1:0/2917717656 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46c01a8ae0 con 0x7f46c01049c0 2024-09-21T00:58:19.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.543+0000 7f46be7fc640 1 -- 172.21.15.1:0/2917717656 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46b8009cd0 con 0x7f46c01049c0 2024-09-21T00:58:19.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.543+0000 7f46be7fc640 1 -- 172.21.15.1:0/2917717656 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b8003b50 con 0x7f46c01049c0 2024-09-21T00:58:19.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.543+0000 7f46c7406640 1 -- 172.21.15.1:0/2917717656 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46c01a9020 con 0x7f46c01049c0 2024-09-21T00:58:19.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.546+0000 7f46cd97a740 1 Processor -- start 2024-09-21T00:58:19.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.546+0000 7f46be7fc640 1 -- 172.21.15.1:0/2917717656 <== mon.2 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f46b80042b0 con 0x7f46c01049c0 2024-09-21T00:58:19.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.546+0000 7f46cd97a740 1 -- start start 2024-09-21T00:58:19.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.546+0000 7f46cd97a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f630f1070 0x556f63498650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:19.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.546+0000 7f46cd97a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556f630c81b0 0x556f63498b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:19.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.546+0000 7f46cd97a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f630d0390 0x556f634990d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:19.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.546+0000 7f46cd97a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556f6340ee50 con 0x556f630f1070 2024-09-21T00:58:19.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.546+0000 7f46cd97a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556f633fe280 con 0x556f630d0390 2024-09-21T00:58:19.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.546+0000 7f46cd97a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556f63402090 con 0x556f630c81b0 2024-09-21T00:58:19.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.547+0000 7f46c59a3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f630f1070 0x556f63498650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:19.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.547+0000 7f46c59a3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f630f1070 0x556f63498650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57790/0 (socket says 172.21.15.1:57790) 2024-09-21T00:58:19.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.547+0000 7f46c49a1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f630d0390 0x556f634990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:19.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.547+0000 7f46c59a3640 1 -- 172.21.15.1:0/1741912772 learned_addr learned my addr 172.21.15.1:0/1741912772 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:19.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.547+0000 7f46c51a2640 1 --2- 172.21.15.1:0/1741912772 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556f630c81b0 0x556f63498b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:19.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.547+0000 7f46c59a3640 1 -- 172.21.15.1:0/1741912772 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556f630c81b0 msgr2=0x556f63498b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:19.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.547+0000 7f46c59a3640 1 --2- 172.21.15.1:0/1741912772 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556f630c81b0 0x556f63498b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.547+0000 7f46c59a3640 1 -- 172.21.15.1:0/1741912772 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f630d0390 msgr2=0x556f634990d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:19.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.547+0000 7f46c59a3640 1 --2- 172.21.15.1:0/1741912772 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f630d0390 0x556f634990d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.547+0000 7f46c59a3640 1 -- 172.21.15.1:0/1741912772 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f6315c650 con 0x556f630f1070 2024-09-21T00:58:19.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.547+0000 7f46c51a2640 1 --2- 172.21.15.1:0/1741912772 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556f630c81b0 0x556f63498b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:58:19.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.547+0000 7f46c49a1640 1 --2- 172.21.15.1:0/1741912772 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f630d0390 0x556f634990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:19.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.547+0000 7f46be7fc640 1 --2- 172.21.15.1:0/2917717656 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f46a80b6510 0x7f46a80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:19.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.547+0000 7f46c59a3640 1 --2- 172.21.15.1:0/1741912772 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f630f1070 0x556f63498650 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f46b0005cc0 tx=0x7f46b0009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa63c65b6f5bfbec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:19.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.547+0000 7f46c51a2640 1 --2- 172.21.15.1:0/2917717656 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f46a80b6510 0x7f46a80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:19.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.548+0000 7f46be7fc640 1 -- 172.21.15.1:0/2917717656 <== mon.2 v2:172.21.15.42:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f46b80e6d30 con 0x7f46c01049c0 2024-09-21T00:58:19.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.548+0000 7f46a77fe640 1 -- 172.21.15.1:0/1741912772 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b0031cf0 con 0x556f630f1070 2024-09-21T00:58:19.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.548+0000 7f46a77fe640 1 -- 172.21.15.1:0/1741912772 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46b0036040 con 0x556f630f1070 2024-09-21T00:58:19.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.548+0000 7f46a77fe640 1 -- 172.21.15.1:0/1741912772 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b00042a0 con 0x556f630f1070 2024-09-21T00:58:19.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.549+0000 7f46cd97a740 1 -- 172.21.15.1:0/1741912772 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f630f1070 msgr2=0x556f63498650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:19.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.549+0000 7f46cd97a740 1 --2- 172.21.15.1:0/1741912772 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f630f1070 0x556f63498650 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f46b0005cc0 tx=0x7f46b0009800 comp rx=0 tx=0).stop 2024-09-21T00:58:19.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.549+0000 7f46c51a2640 1 --2- 172.21.15.1:0/2917717656 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f46a80b6510 0x7f46a80b8a20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x556f634972d0 tx=0x7f46b8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:19.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.549+0000 7f46cd97a740 1 -- 172.21.15.1:0/1741912772 shutdown_connections 2024-09-21T00:58:19.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.549+0000 7f46cd97a740 1 --2- 172.21.15.1:0/1741912772 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f630d0390 0x556f634990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.549+0000 7f46cd97a740 1 --2- 172.21.15.1:0/1741912772 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556f630c81b0 0x556f63498b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.549+0000 7f46cd97a740 1 --2- 172.21.15.1:0/1741912772 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f630f1070 0x556f63498650 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.549+0000 7f46cd97a740 1 -- 172.21.15.1:0/1741912772 >> 172.21.15.1:0/1741912772 conn(0x556f630e5460 msgr2=0x556f63496540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:19.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.549+0000 7f46cd97a740 1 -- 172.21.15.1:0/1741912772 shutdown_connections 2024-09-21T00:58:19.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.549+0000 7f46cd97a740 1 -- 172.21.15.1:0/1741912772 wait complete. 2024-09-21T00:58:19.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.549+0000 7f46cd97a740 1 -- start start 2024-09-21T00:58:19.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.549+0000 7f46cd97a740 1 Processor -- start 2024-09-21T00:58:19.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.550+0000 7f46cd97a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f630c81b0 0x556f634a3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:19.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.550+0000 7f46cd97a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f630d0390 0x556f634a42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:19.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.550+0000 7f46cd97a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556f630f1070 0x556f634b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:19.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.550+0000 7f46cd97a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556f6325f700 con 0x556f630c81b0 2024-09-21T00:58:19.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.550+0000 7f46cd97a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556f63399110 con 0x556f630d0390 2024-09-21T00:58:19.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.550+0000 7f46cd97a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556f634a6dd0 con 0x556f630f1070 2024-09-21T00:58:19.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.550+0000 7f46cd97a740 10 client.0 _ll_register_callbacks cb 0x556f633b2990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:19.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.550+0000 7f46c59a3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f630c81b0 0x556f634a3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:19.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.550+0000 7f46c59a3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f630c81b0 0x556f634a3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57802/0 (socket says 172.21.15.1:57802) 2024-09-21T00:58:19.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.550+0000 7f46c59a3640 1 -- 172.21.15.1:0/3745703147 learned_addr learned my addr 172.21.15.1:0/3745703147 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:19.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.550+0000 7f46c49a1640 1 --2- 172.21.15.1:0/3745703147 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f630d0390 0x556f634a42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:19.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.550+0000 7f46c59a3640 1 --2- 172.21.15.1:0/3745703147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556f630f1070 0x556f634b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:19.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.550+0000 7f46c59a3640 1 -- 172.21.15.1:0/3745703147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556f630f1070 msgr2=0x556f634b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:19.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.550+0000 7f46c59a3640 1 --2- 172.21.15.1:0/3745703147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556f630f1070 0x556f634b00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.550+0000 7f46c59a3640 1 -- 172.21.15.1:0/3745703147 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f630d0390 msgr2=0x556f634a42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:19.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.550+0000 7f46c59a3640 1 --2- 172.21.15.1:0/3745703147 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f630d0390 0x556f634a42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.550+0000 7f46c59a3640 1 -- 172.21.15.1:0/3745703147 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f633c6c40 con 0x556f630c81b0 2024-09-21T00:58:19.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.551+0000 7f46c49a1640 1 --2- 172.21.15.1:0/3745703147 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f630d0390 0x556f634a42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:19.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.551+0000 7f46c59a3640 1 --2- 172.21.15.1:0/3745703147 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f630c81b0 0x556f634a3d70 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f46b002a900 tx=0x7f46b0003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65b850923883b0c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:19.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.551+0000 7f46a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:58:19.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.551+0000 7f46a4ff9640 1 -- 172.21.15.1:0/3745703147 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b0058060 con 0x556f630c81b0 2024-09-21T00:58:19.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.551+0000 7f46a4ff9640 1 -- 172.21.15.1:0/3745703147 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f46b0031450 con 0x556f630c81b0 2024-09-21T00:58:19.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.551+0000 7f46cd97a740 1 -- 172.21.15.1:0/3745703147 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46b0036040 con 0x556f630c81b0 2024-09-21T00:58:19.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.551+0000 7f46a4ff9640 1 -- 172.21.15.1:0/3745703147 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f46b0031650 con 0x556f630c81b0 2024-09-21T00:58:19.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.551+0000 7f46cd97a740 10 client.15981 fetch_fsmap learned FSMap version 28 2024-09-21T00:58:19.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.551+0000 7f46cd97a740 1 -- 172.21.15.1:0/3745703147 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556f634b2b40 con 0x556f630c81b0 2024-09-21T00:58:19.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.551+0000 7f46a4ff9640 1 -- 172.21.15.1:0/3745703147 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46b0036040 con 0x556f630c81b0 2024-09-21T00:58:19.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.552+0000 7f46a4ff9640 1 -- 172.21.15.1:0/3745703147 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7f46b0030630 con 0x556f630c81b0 2024-09-21T00:58:19.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.552+0000 7f46cd97a740 10 client.15981 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:58:19.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.552+0000 7f46cd97a740 10 client.15981 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:58:19.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.552+0000 7f46cd97a740 20 client.15981 populate_metadata read hostname 'smithi001' 2024-09-21T00:58:19.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.552+0000 7f46cd97a740 1 --2- 172.21.15.1:0/3745703147 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x556f630af9f0 0x556f634b5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:19.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.552+0000 7f46cd97a740 4 client.15981 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:58:19.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.552+0000 7f46cd97a740 1 -- 172.21.15.1:0/3745703147 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f63410da0 con 0x556f630af9f0 2024-09-21T00:58:19.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.552+0000 7f46c49a1640 1 --2- 172.21.15.1:0/3745703147 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x556f630af9f0 0x556f634b5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:19.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.552+0000 7f46a4ff9640 10 client.15981 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:19.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.552+0000 7f46c49a1640 1 --2- 172.21.15.1:0/3745703147 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x556f630af9f0 0x556f634b5ea0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eeb658fc5042b57c server_cookie=a19d01d90f5746b1 in_seq=0 out_seq=0 2024-09-21T00:58:19.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.553+0000 7f46a4ff9640 1 -- 172.21.15.1:0/3745703147 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556f63410da0 con 0x556f630af9f0 2024-09-21T00:58:19.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.553+0000 7f46a4ff9640 10 client.15981 handle_command_reply: tid=0 2024-09-21T00:58:19.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.553+0000 7f46cd97a740 1 client.15981 shutdown 2024-09-21T00:58:19.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.553+0000 7f46cd97a740 1 -- 172.21.15.1:0/3745703147 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f630c81b0 msgr2=0x556f634a3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:19.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.553+0000 7f46cd97a740 1 --2- 172.21.15.1:0/3745703147 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f630c81b0 0x556f634a3d70 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f46b002a900 tx=0x7f46b0003c20 comp rx=0 tx=0).stop 2024-09-21T00:58:19.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.553+0000 7f46cd97a740 1 -- 172.21.15.1:0/3745703147 shutdown_connections 2024-09-21T00:58:19.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.553+0000 7f46cd97a740 1 --2- 172.21.15.1:0/3745703147 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x556f630af9f0 0x556f634b5ea0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.553+0000 7f46cd97a740 1 --2- 172.21.15.1:0/3745703147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556f630f1070 0x556f634b00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.553+0000 7f46cd97a740 1 --2- 172.21.15.1:0/3745703147 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f630d0390 0x556f634a42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.553+0000 7f46a4ff9640 0 client.15981 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:19.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.553+0000 7f46cd97a740 1 --2- 172.21.15.1:0/3745703147 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f630c81b0 0x556f634a3d70 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.553+0000 7f46cd97a740 1 -- 172.21.15.1:0/3745703147 >> 172.21.15.1:0/3745703147 conn(0x556f630e5460 msgr2=0x556f6349b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:19.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.553+0000 7f46cd97a740 1 -- 172.21.15.1:0/3745703147 shutdown_connections 2024-09-21T00:58:19.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.553+0000 7f46cd97a740 1 -- 172.21.15.1:0/3745703147 wait complete. 2024-09-21T00:58:19.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.553+0000 7f46cd97a740 20 client.15981 trim_cache size 0 max 16384 2024-09-21T00:58:19.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.571+0000 7f46cd97a740 1 Processor -- start 2024-09-21T00:58:19.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.571+0000 7f46cd97a740 1 -- start start 2024-09-21T00:58:19.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.571+0000 7f46cd97a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f630af9f0 0x556f634a42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:19.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.571+0000 7f46cd97a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f630c81b0 0x556f634a5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:19.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.571+0000 7f46cd97a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556f630d0390 0x556f63499d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:19.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.571+0000 7f46cd97a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f46c01b1760 con 0x556f630c81b0 2024-09-21T00:58:19.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.571+0000 7f46cd97a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f46c01b32d0 con 0x556f630af9f0 2024-09-21T00:58:19.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.571+0000 7f46cd97a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f46c01b1e30 con 0x556f630d0390 2024-09-21T00:58:19.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.572+0000 7f46c49a1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f630c81b0 0x556f634a5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:19.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.572+0000 7f46c49a1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f630c81b0 0x556f634a5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57808/0 (socket says 172.21.15.1:57808) 2024-09-21T00:58:19.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.572+0000 7f46c49a1640 1 -- 172.21.15.1:0/313961589 learned_addr learned my addr 172.21.15.1:0/313961589 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:19.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.572+0000 7f46c59a3640 1 --2- 172.21.15.1:0/313961589 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f630af9f0 0x556f634a42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:19.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.572+0000 7f46c49a1640 1 -- 172.21.15.1:0/313961589 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556f630d0390 msgr2=0x556f63499d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:19.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.572+0000 7f46c49a1640 1 --2- 172.21.15.1:0/313961589 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556f630d0390 0x556f63499d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.572+0000 7f46c49a1640 1 -- 172.21.15.1:0/313961589 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f630af9f0 msgr2=0x556f634a42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:19.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.572+0000 7f46c49a1640 1 --2- 172.21.15.1:0/313961589 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f630af9f0 0x556f634a42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.572+0000 7f46c49a1640 1 -- 172.21.15.1:0/313961589 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f634a2270 con 0x556f630c81b0 2024-09-21T00:58:19.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.572+0000 7f46c49a1640 1 --2- 172.21.15.1:0/313961589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f630c81b0 0x556f634a5c50 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f46b4005fd0 tx=0x7f46b400b440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8891e99424b69869 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:19.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.572+0000 7f46a6ffd640 1 -- 172.21.15.1:0/313961589 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b4029070 con 0x556f630c81b0 2024-09-21T00:58:19.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.572+0000 7f46a6ffd640 1 -- 172.21.15.1:0/313961589 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46b4011c70 con 0x556f630c81b0 2024-09-21T00:58:19.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.572+0000 7f46a6ffd640 1 -- 172.21.15.1:0/313961589 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b4024da0 con 0x556f630c81b0 2024-09-21T00:58:19.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.573+0000 7f46cd97a740 1 -- 172.21.15.1:0/313961589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f630c81b0 msgr2=0x556f634a5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:19.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.573+0000 7f46cd97a740 1 --2- 172.21.15.1:0/313961589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f630c81b0 0x556f634a5c50 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f46b4005fd0 tx=0x7f46b400b440 comp rx=0 tx=0).stop 2024-09-21T00:58:19.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.573+0000 7f46cd97a740 1 -- 172.21.15.1:0/313961589 shutdown_connections 2024-09-21T00:58:19.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.573+0000 7f46cd97a740 1 --2- 172.21.15.1:0/313961589 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556f630d0390 0x556f63499d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.573+0000 7f46cd97a740 1 --2- 172.21.15.1:0/313961589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f630c81b0 0x556f634a5c50 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.573+0000 7f46cd97a740 1 --2- 172.21.15.1:0/313961589 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f630af9f0 0x556f634a42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.573+0000 7f46cd97a740 1 -- 172.21.15.1:0/313961589 >> 172.21.15.1:0/313961589 conn(0x556f630e5460 msgr2=0x556f63499680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:19.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.573+0000 7f46cd97a740 1 -- 172.21.15.1:0/313961589 shutdown_connections 2024-09-21T00:58:19.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.573+0000 7f46cd97a740 1 -- 172.21.15.1:0/313961589 wait complete. 2024-09-21T00:58:19.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.574+0000 7f46cd97a740 1 -- start start 2024-09-21T00:58:19.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.574+0000 7f46cd97a740 1 Processor -- start 2024-09-21T00:58:19.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.574+0000 7f46cd97a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556f630af9f0 0x556f634b69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:19.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.574+0000 7f46cd97a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f630c81b0 0x556f634b6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:19.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.574+0000 7f46cd97a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f630d0390 0x556f63517640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:19.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.574+0000 7f46cd97a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f46c01b2bd0 con 0x556f630d0390 2024-09-21T00:58:19.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.574+0000 7f46cd97a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f46c01b2500 con 0x556f630c81b0 2024-09-21T00:58:19.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.574+0000 7f46cd97a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f46c01af740 con 0x556f630af9f0 2024-09-21T00:58:19.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.574+0000 7f46cd97a740 10 client.0 _ll_register_callbacks cb 0x7f46b4005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:19.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.575+0000 7f46c59a3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f630d0390 0x556f63517640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:19.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.575+0000 7f46c59a3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f630d0390 0x556f63517640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57810/0 (socket says 172.21.15.1:57810) 2024-09-21T00:58:19.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.575+0000 7f46c59a3640 1 -- 172.21.15.1:0/3844726759 learned_addr learned my addr 172.21.15.1:0/3844726759 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:19.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.575+0000 7f46c49a1640 1 --2- 172.21.15.1:0/3844726759 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f630c81b0 0x556f634b6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:19.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.575+0000 7f46c59a3640 1 --2- 172.21.15.1:0/3844726759 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556f630af9f0 0x556f634b69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:19.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.575+0000 7f46c59a3640 1 -- 172.21.15.1:0/3844726759 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556f630af9f0 msgr2=0x556f634b69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:19.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.575+0000 7f46c59a3640 1 --2- 172.21.15.1:0/3844726759 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556f630af9f0 0x556f634b69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.575+0000 7f46c59a3640 1 -- 172.21.15.1:0/3844726759 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f630c81b0 msgr2=0x556f634b6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:19.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.575+0000 7f46c59a3640 1 --2- 172.21.15.1:0/3844726759 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f630c81b0 0x556f634b6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.575+0000 7f46c59a3640 1 -- 172.21.15.1:0/3844726759 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f63517cb0 con 0x556f630d0390 2024-09-21T00:58:19.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.575+0000 7f46c49a1640 1 --2- 172.21.15.1:0/3844726759 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f630c81b0 0x556f634b6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:19.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.575+0000 7f46c59a3640 1 --2- 172.21.15.1:0/3844726759 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f630d0390 0x556f63517640 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f46b0002230 tx=0x7f46b0000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20a984ef30075ee3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:19.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.575+0000 7f46a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:58:19.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.575+0000 7f46a4ff9640 1 -- 172.21.15.1:0/3844726759 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b0058030 con 0x556f630d0390 2024-09-21T00:58:19.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.575+0000 7f46a4ff9640 1 -- 172.21.15.1:0/3844726759 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f46b0003a20 con 0x556f630d0390 2024-09-21T00:58:19.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.575+0000 7f46cd97a740 1 -- 172.21.15.1:0/3844726759 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46b4011c70 con 0x556f630d0390 2024-09-21T00:58:19.597 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T00:58:19.597 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T00:58:19.597 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": { 2024-09-21T00:58:19.597 INFO:teuthology.orchestra.run.smithi001.stdout: "bee49cce-b407-4617-a959-331ffd8dc5b0": { 2024-09-21T00:58:19.597 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T00:58:19.597 INFO:teuthology.orchestra.run.smithi001.stdout: "tag": "bee49cce-b407-4617-a959-331ffd8dc5b0", 2024-09-21T00:58:19.597 INFO:teuthology.orchestra.run.smithi001.stdout: "options": "recursive,force" 2024-09-21T00:58:19.597 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T00:58:19.597 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T00:58:19.598 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_stats": { 2024-09-21T00:58:19.598 INFO:teuthology.orchestra.run.smithi001.stdout: "bee49cce-b407-4617-a959-331ffd8dc5b0": { 2024-09-21T00:58:19.598 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:58:17.883027+0000", 2024-09-21T00:58:19.598 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T00:58:19.598 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T00:58:19.598 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T00:58:19.598 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T00:58:19.598 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T00:58:19.598 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T00:58:19.598 INFO:teuthology.orchestra.run.smithi001.stdout: "7cb1bc3f-e2d2-4bf7-b13e-8f3371d7aac1": { 2024-09-21T00:58:19.598 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:58:02.751142+0000", 2024-09-21T00:58:19.598 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T00:58:19.598 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T00:58:19.598 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T00:58:19.599 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T00:58:19.599 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T00:58:19.599 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T00:58:19.599 INFO:teuthology.orchestra.run.smithi001.stdout: "2383a19c-993d-4440-99f7-93b43dcf33b4": { 2024-09-21T00:58:19.599 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:47.609257+0000", 2024-09-21T00:58:19.599 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T00:58:19.599 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T00:58:19.599 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T00:58:19.599 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T00:58:19.599 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T00:58:19.599 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T00:58:19.599 INFO:teuthology.orchestra.run.smithi001.stdout: "53fa74e4-5aa8-408b-9724-7c93618f7636": { 2024-09-21T00:58:19.600 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:01.730608+0000", 2024-09-21T00:58:19.600 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T00:58:19.600 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T00:58:19.600 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T00:58:19.600 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T00:58:19.600 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T00:58:19.600 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T00:58:19.600 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T00:58:19.600 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T00:58:19.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.576+0000 7f46a4ff9640 1 -- 172.21.15.1:0/3844726759 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f46b00305c0 con 0x556f630d0390 2024-09-21T00:58:19.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.576+0000 7f46cd97a740 10 client.15987 fetch_fsmap learned FSMap version 28 2024-09-21T00:58:19.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.576+0000 7f46cd97a740 1 -- 172.21.15.1:0/3844726759 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556f63520130 con 0x556f630d0390 2024-09-21T00:58:19.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.576+0000 7f46a4ff9640 1 -- 172.21.15.1:0/3844726759 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46b4011c70 con 0x556f630d0390 2024-09-21T00:58:19.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.576+0000 7f46a4ff9640 1 -- 172.21.15.1:0/3844726759 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7f46b0067070 con 0x556f630d0390 2024-09-21T00:58:19.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.576+0000 7f46cd97a740 10 client.15987 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:58:19.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.576+0000 7f46cd97a740 10 client.15987 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:58:19.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.576+0000 7f46cd97a740 20 client.15987 populate_metadata read hostname 'smithi001' 2024-09-21T00:58:19.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.576+0000 7f46cd97a740 1 --2- 172.21.15.1:0/3844726759 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x556f630f1070 0x556f63522750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:19.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.576+0000 7f46cd97a740 4 client.15987 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T00:58:19.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.576+0000 7f46cd97a740 1 -- 172.21.15.1:0/3844726759 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556f6340c850 con 0x556f630f1070 2024-09-21T00:58:19.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.576+0000 7f46c49a1640 1 --2- 172.21.15.1:0/3844726759 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x556f630f1070 0x556f63522750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:19.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.577+0000 7f46a4ff9640 10 client.15987 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:19.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.577+0000 7f46c49a1640 1 --2- 172.21.15.1:0/3844726759 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x556f630f1070 0x556f63522750 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c5dbcb52aabd8e7 server_cookie=ea6fba69f0b3e340 in_seq=0 out_seq=0 2024-09-21T00:58:19.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.577+0000 7f46a4ff9640 1 -- 172.21.15.1:0/3844726759 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1422 (crc 0 0 0) 0x556f6340c850 con 0x556f630f1070 2024-09-21T00:58:19.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.577+0000 7f46a4ff9640 10 client.15987 handle_command_reply: tid=0 2024-09-21T00:58:19.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.577+0000 7f46cd97a740 1 client.15987 shutdown 2024-09-21T00:58:19.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.577+0000 7f46cd97a740 1 -- 172.21.15.1:0/3844726759 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f630d0390 msgr2=0x556f63517640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:19.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.577+0000 7f46cd97a740 1 --2- 172.21.15.1:0/3844726759 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f630d0390 0x556f63517640 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f46b0002230 tx=0x7f46b0000f40 comp rx=0 tx=0).stop 2024-09-21T00:58:19.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.577+0000 7f46cd97a740 1 -- 172.21.15.1:0/3844726759 shutdown_connections 2024-09-21T00:58:19.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.577+0000 7f46cd97a740 1 --2- 172.21.15.1:0/3844726759 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x556f630f1070 0x556f63522750 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.577+0000 7f46cd97a740 1 --2- 172.21.15.1:0/3844726759 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f630d0390 0x556f63517640 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.577+0000 7f46cd97a740 1 --2- 172.21.15.1:0/3844726759 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f630c81b0 0x556f634b6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.577+0000 7f46cd97a740 1 --2- 172.21.15.1:0/3844726759 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556f630af9f0 0x556f634b69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.577+0000 7f46a4ff9640 0 client.15987 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:19.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.577+0000 7f46cd97a740 1 -- 172.21.15.1:0/3844726759 >> 172.21.15.1:0/3844726759 conn(0x556f630e5460 msgr2=0x556f63499dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:19.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.577+0000 7f46cd97a740 1 -- 172.21.15.1:0/3844726759 shutdown_connections 2024-09-21T00:58:19.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.577+0000 7f46cd97a740 1 -- 172.21.15.1:0/3844726759 wait complete. 2024-09-21T00:58:19.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.578+0000 7f46cd97a740 20 client.15987 trim_cache size 0 max 16384 2024-09-21T00:58:19.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.578+0000 7f46c7406640 1 -- 172.21.15.1:0/2917717656 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f46a80b6510 msgr2=0x7f46a80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:19.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.578+0000 7f46c7406640 1 --2- 172.21.15.1:0/2917717656 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f46a80b6510 0x7f46a80b8a20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x556f634972d0 tx=0x7f46b8000bc0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.578+0000 7f46c7406640 1 -- 172.21.15.1:0/2917717656 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46c01049c0 msgr2=0x7f46c0102700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:19.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.578+0000 7f46c7406640 1 --2- 172.21.15.1:0/2917717656 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46c01049c0 0x7f46c0102700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f46b800d6a0 tx=0x7f46b800db60 comp rx=0 tx=0).stop 2024-09-21T00:58:19.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.578+0000 7f46c7406640 1 -- 172.21.15.1:0/2917717656 shutdown_connections 2024-09-21T00:58:19.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.578+0000 7f46c7406640 1 --2- 172.21.15.1:0/2917717656 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46c010de20 0x7f46c0103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.578+0000 7f46c7406640 1 --2- 172.21.15.1:0/2917717656 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f46a80b6510 0x7f46a80b8a20 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.578+0000 7f46c7406640 1 --2- 172.21.15.1:0/2917717656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46c0105310 0x7f46c0102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.578+0000 7f46c7406640 1 --2- 172.21.15.1:0/2917717656 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46c01049c0 0x7f46c0102700 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.578+0000 7f46c7406640 1 -- 172.21.15.1:0/2917717656 >> 172.21.15.1:0/2917717656 conn(0x7f46c0079730 msgr2=0x7f46c0107940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:19.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.578+0000 7f46c7406640 1 -- 172.21.15.1:0/2917717656 shutdown_connections 2024-09-21T00:58:19.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:19.578+0000 7f46c7406640 1 -- 172.21.15.1:0/2917717656 wait complete. 2024-09-21T00:58:19.619 INFO:tasks.workunit.client.0.smithi001.stdout:checking for getopt_long... yes 2024-09-21T00:58:19.679 INFO:tasks.workunit.client.0.smithi001.stdout:checking for strtoull... yes 2024-09-21T00:58:19.740 INFO:tasks.workunit.client.0.smithi001.stdout:checking for strtoq... yes 2024-09-21T00:58:19.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.795+0000 7f52744a9640 1 -- 172.21.15.1:0/605150749 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f526c104010 msgr2=0x7f526c10a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:19.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.795+0000 7f52744a9640 1 --2- 172.21.15.1:0/605150749 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f526c104010 0x7f526c10a9b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f5264009ca0 tx=0x7f526402a8c0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.795+0000 7f52744a9640 1 -- 172.21.15.1:0/605150749 shutdown_connections 2024-09-21T00:58:19.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.795+0000 7f52744a9640 1 --2- 172.21.15.1:0/605150749 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f526c104010 0x7f526c10a9b0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.795+0000 7f52744a9640 1 --2- 172.21.15.1:0/605150749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f526c103670 0x7f526c103a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.795+0000 7f52744a9640 1 --2- 172.21.15.1:0/605150749 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f526c1025f0 0x7f526c102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.795+0000 7f52744a9640 1 -- 172.21.15.1:0/605150749 >> 172.21.15.1:0/605150749 conn(0x7f526c0fdf30 msgr2=0x7f526c1003e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:19.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.795+0000 7f52744a9640 1 -- 172.21.15.1:0/605150749 shutdown_connections 2024-09-21T00:58:19.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.795+0000 7f52744a9640 1 -- 172.21.15.1:0/605150749 wait complete. 2024-09-21T00:58:19.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.796+0000 7f52744a9640 1 Processor -- start 2024-09-21T00:58:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.796+0000 7f52744a9640 1 -- start start 2024-09-21T00:58:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.796+0000 7f52744a9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f526c1025f0 0x7f526c19c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.796+0000 7f52744a9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f526c103670 0x7f526c19c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.796+0000 7f52744a9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f526c104010 0x7f526c19d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.796+0000 7f52744a9640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f526c10e240 con 0x7f526c104010 2024-09-21T00:58:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.796+0000 7f52744a9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f526c10e0c0 con 0x7f526c103670 2024-09-21T00:58:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.796+0000 7f52744a9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f526c10e3c0 con 0x7f526c1025f0 2024-09-21T00:58:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.796+0000 7f5272a46640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f526c104010 0x7f526c19d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.796+0000 7f5272a46640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f526c104010 0x7f526c19d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57834/0 (socket says 172.21.15.1:57834) 2024-09-21T00:58:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.796+0000 7f5272a46640 1 -- 172.21.15.1:0/2402298612 learned_addr learned my addr 172.21.15.1:0/2402298612 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.796+0000 7f5272245640 1 --2- 172.21.15.1:0/2402298612 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f526c1025f0 0x7f526c19c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.796+0000 7f5271a44640 1 --2- 172.21.15.1:0/2402298612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f526c103670 0x7f526c19c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.796+0000 7f5272a46640 1 -- 172.21.15.1:0/2402298612 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f526c1025f0 msgr2=0x7f526c19c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.796+0000 7f5272a46640 1 --2- 172.21.15.1:0/2402298612 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f526c1025f0 0x7f526c19c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.800 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.796+0000 7f5272a46640 1 -- 172.21.15.1:0/2402298612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f526c103670 msgr2=0x7f526c19c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:19.800 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.796+0000 7f5272a46640 1 --2- 172.21.15.1:0/2402298612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f526c103670 0x7f526c19c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.800 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.796+0000 7f5272a46640 1 -- 172.21.15.1:0/2402298612 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f526c19db60 con 0x7f526c104010 2024-09-21T00:58:19.800 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.797+0000 7f5271a44640 1 --2- 172.21.15.1:0/2402298612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f526c103670 0x7f526c19c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:58:19.800 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.797+0000 7f5272a46640 1 --2- 172.21.15.1:0/2402298612 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f526c104010 0x7f526c19d340 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f52640097b0 tx=0x7f5264003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:19.800 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.797+0000 7f52637fe640 1 -- 172.21.15.1:0/2402298612 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5264004240 con 0x7f526c104010 2024-09-21T00:58:19.800 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.797+0000 7f52744a9640 1 -- 172.21.15.1:0/2402298612 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f526c19ddf0 con 0x7f526c104010 2024-09-21T00:58:19.800 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.797+0000 7f52637fe640 1 -- 172.21.15.1:0/2402298612 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f526402f310 con 0x7f526c104010 2024-09-21T00:58:19.800 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.797+0000 7f52637fe640 1 -- 172.21.15.1:0/2402298612 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526402fb50 con 0x7f526c104010 2024-09-21T00:58:19.800 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.797+0000 7f52744a9640 1 -- 172.21.15.1:0/2402298612 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f526c1a4540 con 0x7f526c104010 2024-09-21T00:58:19.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.800+0000 7f527b418740 1 Processor -- start 2024-09-21T00:58:19.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.800+0000 7f52637fe640 1 -- 172.21.15.1:0/2402298612 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f526402fd70 con 0x7f526c104010 2024-09-21T00:58:19.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.800+0000 7f527b418740 1 -- start start 2024-09-21T00:58:19.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.801+0000 7f527b418740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a8138f1b0 0x557a81736e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:19.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.801+0000 7f527b418740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557a813662f0 0x557a817374c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:19.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.801+0000 7f527b418740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8136e4d0 0x557a81738010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:19.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.801+0000 7f527b418740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557a816a96f0 con 0x557a8136e4d0 2024-09-21T00:58:19.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.801+0000 7f527b418740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557a81698b20 con 0x557a8138f1b0 2024-09-21T00:58:19.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.801+0000 7f527b418740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x557a8169c930 con 0x557a813662f0 2024-09-21T00:58:19.810 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.801+0000 7f5271a44640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a8138f1b0 0x557a81736e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:19.810 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.801+0000 7f5271a44640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a8138f1b0 0x557a81736e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:36560/0 (socket says 172.21.15.1:36560) 2024-09-21T00:58:19.810 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.801+0000 7f5271a44640 1 -- 172.21.15.1:0/756210878 learned_addr learned my addr 172.21.15.1:0/756210878 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:19.810 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.801+0000 7f5271a44640 1 --2- 172.21.15.1:0/756210878 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8136e4d0 0x557a81738010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:19.810 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.801+0000 7f5272245640 1 --2- 172.21.15.1:0/756210878 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557a813662f0 0x557a817374c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:19.810 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.801+0000 7f5271a44640 1 -- 172.21.15.1:0/756210878 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557a813662f0 msgr2=0x557a817374c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:19.810 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.801+0000 7f5271a44640 1 --2- 172.21.15.1:0/756210878 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557a813662f0 0x557a817374c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.810 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.801+0000 7f5271a44640 1 -- 172.21.15.1:0/756210878 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8136e4d0 msgr2=0x557a81738010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:19.810 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.801+0000 7f5271a44640 1 --2- 172.21.15.1:0/756210878 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8136e4d0 0x557a81738010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.811 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.801+0000 7f5271a44640 1 -- 172.21.15.1:0/756210878 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a8165e530 con 0x557a8138f1b0 2024-09-21T00:58:19.811 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.801+0000 7f5272245640 1 --2- 172.21.15.1:0/756210878 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557a813662f0 0x557a817374c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:58:19.811 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.801+0000 7f52637fe640 1 --2- 172.21.15.1:0/2402298612 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f52580b6510 0x7f52580b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:19.811 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.801+0000 7f5272245640 1 --2- 172.21.15.1:0/2402298612 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f52580b6510 0x7f52580b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:19.811 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.802+0000 7f5271a44640 1 --2- 172.21.15.1:0/756210878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a8138f1b0 0x557a81736e50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f525c014a20 tx=0x7f525c00b540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb081acbd61183b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:19.811 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.802+0000 7f52637fe640 1 -- 172.21.15.1:0/2402298612 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f52641087c0 con 0x7f526c104010 2024-09-21T00:58:19.811 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.802+0000 7f5260bfe640 1 -- 172.21.15.1:0/756210878 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c0142d0 con 0x557a8138f1b0 2024-09-21T00:58:19.811 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.802+0000 7f5260bfe640 1 -- 172.21.15.1:0/756210878 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f525c005020 con 0x557a8138f1b0 2024-09-21T00:58:19.811 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.802+0000 7f5260bfe640 1 -- 172.21.15.1:0/756210878 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c004a90 con 0x557a8138f1b0 2024-09-21T00:58:19.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.803+0000 7f527b418740 1 -- 172.21.15.1:0/756210878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a8138f1b0 msgr2=0x557a81736e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:19.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.803+0000 7f527b418740 1 --2- 172.21.15.1:0/756210878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a8138f1b0 0x557a81736e50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f525c014a20 tx=0x7f525c00b540 comp rx=0 tx=0).stop 2024-09-21T00:58:19.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.803+0000 7f5272245640 1 --2- 172.21.15.1:0/2402298612 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f52580b6510 0x7f52580b8a20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5268009db0 tx=0x7f5268005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:19.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.803+0000 7f527b418740 1 -- 172.21.15.1:0/756210878 shutdown_connections 2024-09-21T00:58:19.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.803+0000 7f527b418740 1 --2- 172.21.15.1:0/756210878 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8136e4d0 0x557a81738010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.803+0000 7f527b418740 1 --2- 172.21.15.1:0/756210878 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557a813662f0 0x557a817374c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.803+0000 7f527b418740 1 --2- 172.21.15.1:0/756210878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a8138f1b0 0x557a81736e50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.803+0000 7f527b418740 1 -- 172.21.15.1:0/756210878 >> 172.21.15.1:0/756210878 conn(0x557a81383300 msgr2=0x557a817328e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:19.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.803+0000 7f527b418740 1 -- 172.21.15.1:0/756210878 shutdown_connections 2024-09-21T00:58:19.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.803+0000 7f527b418740 1 -- 172.21.15.1:0/756210878 wait complete. 2024-09-21T00:58:19.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.803+0000 7f527b418740 1 -- start start 2024-09-21T00:58:19.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.803+0000 7f527b418740 1 Processor -- start 2024-09-21T00:58:19.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.804+0000 7f527b418740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a813662f0 0x557a817405a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:19.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.804+0000 7f527b418740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557a8136e4d0 0x557a81740c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:19.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.804+0000 7f527b418740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8138f1b0 0x557a817417d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:19.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.804+0000 7f527b418740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557a815d0ab0 con 0x557a8138f1b0 2024-09-21T00:58:19.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.804+0000 7f527b418740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557a8163e730 con 0x557a813662f0 2024-09-21T00:58:19.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.804+0000 7f527b418740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x557a81738ad0 con 0x557a8136e4d0 2024-09-21T00:58:19.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.804+0000 7f527b418740 10 client.0 _ll_register_callbacks cb 0x557a816926b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:19.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.804+0000 7f5272245640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a813662f0 0x557a817405a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:19.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.804+0000 7f5272245640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a813662f0 0x557a817405a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:36576/0 (socket says 172.21.15.1:36576) 2024-09-21T00:58:19.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.804+0000 7f5272a46640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8138f1b0 0x557a817417d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:19.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.804+0000 7f5272245640 1 -- 172.21.15.1:0/3880332068 learned_addr learned my addr 172.21.15.1:0/3880332068 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:19.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.804+0000 7f5271a44640 1 --2- 172.21.15.1:0/3880332068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557a8136e4d0 0x557a81740c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:19.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.804+0000 7f5272245640 1 -- 172.21.15.1:0/3880332068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557a8136e4d0 msgr2=0x557a81740c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:19.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.804+0000 7f5272245640 1 --2- 172.21.15.1:0/3880332068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557a8136e4d0 0x557a81740c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.804+0000 7f5272245640 1 -- 172.21.15.1:0/3880332068 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8138f1b0 msgr2=0x557a817417d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:19.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.804+0000 7f5272245640 1 --2- 172.21.15.1:0/3880332068 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8138f1b0 0x557a817417d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.804+0000 7f5272245640 1 -- 172.21.15.1:0/3880332068 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a813fa790 con 0x557a813662f0 2024-09-21T00:58:19.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.804+0000 7f5272245640 1 --2- 172.21.15.1:0/3880332068 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a813662f0 0x557a817405a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f526801e9d0 tx=0x7f5268004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db2e4a500b6d666 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:19.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.804+0000 7f5255ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T00:58:19.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.805+0000 7f5255ffb640 1 -- 172.21.15.1:0/3880332068 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526802e060 con 0x557a813662f0 2024-09-21T00:58:19.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.805+0000 7f5255ffb640 1 -- 172.21.15.1:0/3880332068 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f5268018030 con 0x557a813662f0 2024-09-21T00:58:19.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.805+0000 7f527b418740 1 -- 172.21.15.1:0/3880332068 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f525c005020 con 0x557a813662f0 2024-09-21T00:58:19.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.805+0000 7f5255ffb640 1 -- 172.21.15.1:0/3880332068 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5268009de0 con 0x557a813662f0 2024-09-21T00:58:19.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.805+0000 7f527b418740 10 client.25655 fetch_fsmap learned FSMap version 28 2024-09-21T00:58:19.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.805+0000 7f527b418740 1 -- 172.21.15.1:0/3880332068 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557a81473620 con 0x557a813662f0 2024-09-21T00:58:19.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.805+0000 7f5255ffb640 1 -- 172.21.15.1:0/3880332068 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f525c005020 con 0x557a813662f0 2024-09-21T00:58:19.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.805+0000 7f5255ffb640 1 -- 172.21.15.1:0/3880332068 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7f526800f5f0 con 0x557a813662f0 2024-09-21T00:58:19.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.805+0000 7f527b418740 10 client.25655 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:58:19.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.805+0000 7f527b418740 10 client.25655 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:58:19.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.805+0000 7f527b418740 20 client.25655 populate_metadata read hostname 'smithi001' 2024-09-21T00:58:19.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.805+0000 7f527b418740 1 --2- 172.21.15.1:0/3880332068 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x557a8134dd80 0x557a8174de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:19.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.805+0000 7f527b418740 4 client.25655 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:58:19.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.805+0000 7f527b418740 1 -- 172.21.15.1:0/3880332068 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a816ab640 con 0x557a8134dd80 2024-09-21T00:58:19.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.805+0000 7f5271a44640 1 --2- 172.21.15.1:0/3880332068 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x557a8134dd80 0x557a8174de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:19.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.806+0000 7f5255ffb640 10 client.25655 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:19.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.806+0000 7f5271a44640 1 --2- 172.21.15.1:0/3880332068 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x557a8134dd80 0x557a8174de20 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37c5b2bb499c5935 server_cookie=f5404b02cafc0592 in_seq=0 out_seq=0 2024-09-21T00:58:19.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.806+0000 7f5255ffb640 1 -- 172.21.15.1:0/3880332068 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557a816ab640 con 0x557a8134dd80 2024-09-21T00:58:19.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.807+0000 7f5255ffb640 10 client.25655 handle_command_reply: tid=0 2024-09-21T00:58:19.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.807+0000 7f527b418740 1 client.25655 shutdown 2024-09-21T00:58:19.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.807+0000 7f527b418740 1 -- 172.21.15.1:0/3880332068 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a813662f0 msgr2=0x557a817405a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:19.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.807+0000 7f527b418740 1 --2- 172.21.15.1:0/3880332068 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a813662f0 0x557a817405a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f526801e9d0 tx=0x7f5268004730 comp rx=0 tx=0).stop 2024-09-21T00:58:19.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.807+0000 7f527b418740 1 -- 172.21.15.1:0/3880332068 shutdown_connections 2024-09-21T00:58:19.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.807+0000 7f527b418740 1 --2- 172.21.15.1:0/3880332068 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x557a8134dd80 0x557a8174de20 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.807+0000 7f527b418740 1 --2- 172.21.15.1:0/3880332068 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8138f1b0 0x557a817417d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.807+0000 7f5255ffb640 0 client.25655 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:19.817 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.807+0000 7f527b418740 1 --2- 172.21.15.1:0/3880332068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557a8136e4d0 0x557a81740c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.817 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.807+0000 7f527b418740 1 --2- 172.21.15.1:0/3880332068 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a813662f0 0x557a817405a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.817 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.807+0000 7f527b418740 1 -- 172.21.15.1:0/3880332068 >> 172.21.15.1:0/3880332068 conn(0x557a81383300 msgr2=0x557a81730ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:19.817 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.807+0000 7f527b418740 1 -- 172.21.15.1:0/3880332068 shutdown_connections 2024-09-21T00:58:19.817 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.807+0000 7f527b418740 1 -- 172.21.15.1:0/3880332068 wait complete. 2024-09-21T00:58:19.817 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.807+0000 7f527b418740 20 client.25655 trim_cache size 0 max 16384 2024-09-21T00:58:19.817 INFO:tasks.workunit.client.0.smithi001.stdout:checking for snprintf... yes 2024-09-21T00:58:19.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.823+0000 7f527b418740 1 Processor -- start 2024-09-21T00:58:19.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.823+0000 7f527b418740 1 -- start start 2024-09-21T00:58:19.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.823+0000 7f527b418740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a813662f0 0x557a81732220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:19.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.823+0000 7f527b418740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557a8136e4d0 0x557a8173f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:19.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.823+0000 7f527b418740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8138f1b0 0x557a8172d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:19.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.823+0000 7f527b418740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f526c1ad210 con 0x557a8138f1b0 2024-09-21T00:58:19.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.823+0000 7f527b418740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f526c1aed80 con 0x557a813662f0 2024-09-21T00:58:19.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.823+0000 7f527b418740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f526c1ad8e0 con 0x557a8136e4d0 2024-09-21T00:58:19.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.823+0000 7f5272a46640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8138f1b0 0x557a8172d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:19.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.823+0000 7f5272a46640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8138f1b0 0x557a8172d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57856/0 (socket says 172.21.15.1:57856) 2024-09-21T00:58:19.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.823+0000 7f5272245640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a813662f0 0x557a81732220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:19.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.823+0000 7f5272a46640 1 -- 172.21.15.1:0/280847374 learned_addr learned my addr 172.21.15.1:0/280847374 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:19.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.823+0000 7f5271a44640 1 --2- 172.21.15.1:0/280847374 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557a8136e4d0 0x557a8173f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:19.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.823+0000 7f5272245640 1 -- 172.21.15.1:0/280847374 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557a8136e4d0 msgr2=0x557a8173f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:19.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.823+0000 7f5272245640 1 --2- 172.21.15.1:0/280847374 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557a8136e4d0 0x557a8173f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.823+0000 7f5272245640 1 -- 172.21.15.1:0/280847374 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8138f1b0 msgr2=0x557a8172d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:19.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.823+0000 7f5272245640 1 --2- 172.21.15.1:0/280847374 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8138f1b0 0x557a8172d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.823+0000 7f5272245640 1 -- 172.21.15.1:0/280847374 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a81741b40 con 0x557a813662f0 2024-09-21T00:58:19.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.823+0000 7f5272a46640 1 --2- 172.21.15.1:0/280847374 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8138f1b0 0x557a8172d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:19.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.824+0000 7f5272245640 1 --2- 172.21.15.1:0/280847374 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a813662f0 0x557a81732220 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5268012d50 tx=0x7f5268005870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43586e1ab7e8aed6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:19.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.824+0000 7f5257fff640 1 -- 172.21.15.1:0/280847374 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5268041070 con 0x557a813662f0 2024-09-21T00:58:19.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.824+0000 7f5257fff640 1 -- 172.21.15.1:0/280847374 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5268034400 con 0x557a813662f0 2024-09-21T00:58:19.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.824+0000 7f5257fff640 1 -- 172.21.15.1:0/280847374 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5268029640 con 0x557a813662f0 2024-09-21T00:58:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.825+0000 7f527b418740 1 -- 172.21.15.1:0/280847374 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a813662f0 msgr2=0x557a81732220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.825+0000 7f527b418740 1 --2- 172.21.15.1:0/280847374 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a813662f0 0x557a81732220 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5268012d50 tx=0x7f5268005870 comp rx=0 tx=0).stop 2024-09-21T00:58:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.825+0000 7f527b418740 1 -- 172.21.15.1:0/280847374 shutdown_connections 2024-09-21T00:58:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.825+0000 7f527b418740 1 --2- 172.21.15.1:0/280847374 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8138f1b0 0x557a8172d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.825+0000 7f527b418740 1 --2- 172.21.15.1:0/280847374 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557a8136e4d0 0x557a8173f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.825+0000 7f527b418740 1 --2- 172.21.15.1:0/280847374 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a813662f0 0x557a81732220 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.825+0000 7f527b418740 1 -- 172.21.15.1:0/280847374 >> 172.21.15.1:0/280847374 conn(0x557a81383300 msgr2=0x557a81741d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.825+0000 7f527b418740 1 -- 172.21.15.1:0/280847374 shutdown_connections 2024-09-21T00:58:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.825+0000 7f527b418740 1 -- 172.21.15.1:0/280847374 wait complete. 2024-09-21T00:58:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.825+0000 7f527b418740 1 -- start start 2024-09-21T00:58:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.825+0000 7f527b418740 1 Processor -- start 2024-09-21T00:58:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.825+0000 7f527b418740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557a813662f0 0x557a81743cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.825+0000 7f527b418740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8136e4d0 0x557a817443b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.825+0000 7f527b418740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a8138f1b0 0x557a81747f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.825+0000 7f527b418740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f526c1ae680 con 0x557a8136e4d0 2024-09-21T00:58:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.825+0000 7f527b418740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f526c1adfb0 con 0x557a8138f1b0 2024-09-21T00:58:19.831 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.825+0000 7f527b418740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f526c1ab1f0 con 0x557a813662f0 2024-09-21T00:58:19.831 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.825+0000 7f527b418740 10 client.0 _ll_register_callbacks cb 0x7f5268005d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:19.831 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.826+0000 7f5271a44640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8136e4d0 0x557a817443b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:19.831 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.826+0000 7f5272a46640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a8138f1b0 0x557a81747f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:19.831 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.826+0000 7f5271a44640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8136e4d0 0x557a817443b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57858/0 (socket says 172.21.15.1:57858) 2024-09-21T00:58:19.831 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.826+0000 7f5271a44640 1 -- 172.21.15.1:0/16510626 learned_addr learned my addr 172.21.15.1:0/16510626 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:19.831 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.826+0000 7f5272245640 1 --2- 172.21.15.1:0/16510626 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557a813662f0 0x557a81743cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:19.831 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.826+0000 7f5271a44640 1 -- 172.21.15.1:0/16510626 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557a813662f0 msgr2=0x557a81743cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:19.831 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.826+0000 7f5271a44640 1 --2- 172.21.15.1:0/16510626 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557a813662f0 0x557a81743cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.831 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.826+0000 7f5271a44640 1 -- 172.21.15.1:0/16510626 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a8138f1b0 msgr2=0x557a81747f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:19.831 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.826+0000 7f5271a44640 1 --2- 172.21.15.1:0/16510626 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a8138f1b0 0x557a81747f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.831 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.826+0000 7f5271a44640 1 -- 172.21.15.1:0/16510626 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a817486b0 con 0x557a8136e4d0 2024-09-21T00:58:19.831 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.826+0000 7f5272a46640 1 --2- 172.21.15.1:0/16510626 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a8138f1b0 0x557a81747f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:19.831 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.826+0000 7f5271a44640 1 --2- 172.21.15.1:0/16510626 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8136e4d0 0x557a817443b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f525c00b510 tx=0x7f525c00b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=865eacd149cf3cc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:19.831 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.826+0000 7f5255ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:58:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.826+0000 7f5255ffb640 1 -- 172.21.15.1:0/16510626 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c005020 con 0x557a8136e4d0 2024-09-21T00:58:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.826+0000 7f5255ffb640 1 -- 172.21.15.1:0/16510626 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f525c0051c0 con 0x557a8136e4d0 2024-09-21T00:58:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.826+0000 7f527b418740 1 -- 172.21.15.1:0/16510626 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5268034400 con 0x557a8136e4d0 2024-09-21T00:58:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.827+0000 7f5255ffb640 1 -- 172.21.15.1:0/16510626 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f525c037070 con 0x557a8136e4d0 2024-09-21T00:58:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.827+0000 7f527b418740 10 client.16005 fetch_fsmap learned FSMap version 28 2024-09-21T00:58:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.827+0000 7f527b418740 1 -- 172.21.15.1:0/16510626 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557a81745b40 con 0x557a8136e4d0 2024-09-21T00:58:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.827+0000 7f5255ffb640 1 -- 172.21.15.1:0/16510626 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5268034400 con 0x557a8136e4d0 2024-09-21T00:58:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.827+0000 7f5255ffb640 1 -- 172.21.15.1:0/16510626 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7f525c00f830 con 0x557a8136e4d0 2024-09-21T00:58:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.827+0000 7f527b418740 10 client.16005 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:58:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.827+0000 7f527b418740 10 client.16005 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:58:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.827+0000 7f527b418740 20 client.16005 populate_metadata read hostname 'smithi001' 2024-09-21T00:58:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.827+0000 7f527b418740 1 --2- 172.21.15.1:0/16510626 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x557a813231c0 0x557a817bac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.827+0000 7f527b418740 4 client.16005 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T00:58:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.827+0000 7f527b418740 1 -- 172.21.15.1:0/16510626 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557a816a70f0 con 0x557a813231c0 2024-09-21T00:58:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.827+0000 7f5272245640 1 --2- 172.21.15.1:0/16510626 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x557a813231c0 0x557a817bac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.828+0000 7f5255ffb640 10 client.16005 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.828+0000 7f5272245640 1 --2- 172.21.15.1:0/16510626 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x557a813231c0 0x557a817bac50 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec443e9437c39744 server_cookie=624cf592cbeaa0ec in_seq=0 out_seq=0 2024-09-21T00:58:19.839 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.838+0000 7f5255ffb640 1 -- 172.21.15.1:0/16510626 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557a816a70f0 con 0x557a813231c0 2024-09-21T00:58:19.839 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.838+0000 7f5255ffb640 10 client.16005 handle_command_reply: tid=0 2024-09-21T00:58:19.839 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.838+0000 7f527b418740 1 client.16005 shutdown 2024-09-21T00:58:19.839 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.838+0000 7f527b418740 1 -- 172.21.15.1:0/16510626 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8136e4d0 msgr2=0x557a817443b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:19.839 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.838+0000 7f527b418740 1 --2- 172.21.15.1:0/16510626 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8136e4d0 0x557a817443b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f525c00b510 tx=0x7f525c00b610 comp rx=0 tx=0).stop 2024-09-21T00:58:19.839 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.838+0000 7f527b418740 1 -- 172.21.15.1:0/16510626 shutdown_connections 2024-09-21T00:58:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.838+0000 7f527b418740 1 --2- 172.21.15.1:0/16510626 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x557a813231c0 0x557a817bac50 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.838+0000 7f527b418740 1 --2- 172.21.15.1:0/16510626 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a8138f1b0 0x557a81747f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.838+0000 7f527b418740 1 --2- 172.21.15.1:0/16510626 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8136e4d0 0x557a817443b0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.838+0000 7f527b418740 1 --2- 172.21.15.1:0/16510626 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557a813662f0 0x557a81743cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.838+0000 7f5255ffb640 0 client.16005 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.838+0000 7f527b418740 1 -- 172.21.15.1:0/16510626 >> 172.21.15.1:0/16510626 conn(0x557a81383300 msgr2=0x557a8172d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.839+0000 7f527b418740 1 -- 172.21.15.1:0/16510626 shutdown_connections 2024-09-21T00:58:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.839+0000 7f527b418740 1 -- 172.21.15.1:0/16510626 wait complete. 2024-09-21T00:58:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.839+0000 7f527b418740 20 client.16005 trim_cache size 0 max 16384 2024-09-21T00:58:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T00:58:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T00:58:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T00:58:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T00:58:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.839+0000 7f52744a9640 1 -- 172.21.15.1:0/2402298612 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f52580b6510 msgr2=0x7f52580b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.839+0000 7f52744a9640 1 --2- 172.21.15.1:0/2402298612 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f52580b6510 0x7f52580b8a20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5268009db0 tx=0x7f5268005f90 comp rx=0 tx=0).stop 2024-09-21T00:58:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.839+0000 7f52744a9640 1 -- 172.21.15.1:0/2402298612 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f526c104010 msgr2=0x7f526c19d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.839+0000 7f52744a9640 1 --2- 172.21.15.1:0/2402298612 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f526c104010 0x7f526c19d340 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f52640097b0 tx=0x7f5264003c20 comp rx=0 tx=0).stop 2024-09-21T00:58:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.839+0000 7f52744a9640 1 -- 172.21.15.1:0/2402298612 shutdown_connections 2024-09-21T00:58:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.839+0000 7f52744a9640 1 --2- 172.21.15.1:0/2402298612 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f52580b6510 0x7f52580b8a20 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.839+0000 7f52744a9640 1 --2- 172.21.15.1:0/2402298612 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f526c104010 0x7f526c19d340 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.839+0000 7f52744a9640 1 --2- 172.21.15.1:0/2402298612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f526c103670 0x7f526c19c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.839+0000 7f52744a9640 1 --2- 172.21.15.1:0/2402298612 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f526c1025f0 0x7f526c19c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.839+0000 7f52744a9640 1 -- 172.21.15.1:0/2402298612 >> 172.21.15.1:0/2402298612 conn(0x7f526c0fdf30 msgr2=0x7f526c0ff760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.839+0000 7f52744a9640 1 -- 172.21.15.1:0/2402298612 shutdown_connections 2024-09-21T00:58:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:19.840+0000 7f52744a9640 1 -- 172.21.15.1:0/2402298612 wait complete. 2024-09-21T00:58:19.876 INFO:tasks.workunit.client.0.smithi001.stdout:checking for vsnprintf... yes 2024-09-21T00:58:19.939 INFO:tasks.workunit.client.0.smithi001.stdout:checking for vfprintf... yes 2024-09-21T00:58:20.029 INFO:tasks.workunit.client.0.smithi001.stdout:checking for gethostname... yes 2024-09-21T00:58:20.097 INFO:tasks.workunit.client.0.smithi001.stdout:checking for setlocale... yes 2024-09-21T00:58:20.105 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:19 smithi001 ceph-mon[31211]: pgmap v391: 97 pgs: 97 active+clean; 2.7 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 191 KiB/s wr, 30 op/s 2024-09-21T00:58:20.105 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:19 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T00:58:20.105 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:19 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T00:58:20.105 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:19 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T00:58:20.158 INFO:tasks.workunit.client.0.smithi001.stdout:checking for sync... yes 2024-09-21T00:58:20.223 INFO:tasks.workunit.client.0.smithi001.stdout:checking whether snprintf is C99 conformant... done 2024-09-21T00:58:20.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:19 smithi193 ceph-mon[34660]: pgmap v391: 97 pgs: 97 active+clean; 2.7 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 191 KiB/s wr, 30 op/s 2024-09-21T00:58:20.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:19 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T00:58:20.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:19 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T00:58:20.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:19 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T00:58:20.234 INFO:tasks.workunit.client.0.smithi001.stdout:configure: creating ./config.status 2024-09-21T00:58:20.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:19 smithi042 ceph-mon[34481]: pgmap v391: 97 pgs: 97 active+clean; 2.7 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 191 KiB/s wr, 30 op/s 2024-09-21T00:58:20.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:19 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T00:58:20.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:19 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T00:58:20.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:19 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T00:58:20.384 INFO:tasks.workunit.client.0.smithi001.stdout:config.status: creating Makefile 2024-09-21T00:58:20.401 INFO:tasks.workunit.client.0.smithi001.stdout:config.status: creating src/Makefile 2024-09-21T00:58:20.421 INFO:tasks.workunit.client.0.smithi001.stdout:config.status: creating man/Makefile 2024-09-21T00:58:20.432 INFO:tasks.workunit.client.0.smithi001.stdout:config.status: creating config.h 2024-09-21T00:58:20.467 INFO:tasks.cephfs.filesystem:scrub status for tag:bee49cce-b407-4617-a959-331ffd8dc5b0 - {'path': '/', 'tag': 'bee49cce-b407-4617-a959-331ffd8dc5b0', 'options': 'recursive,force'} 2024-09-21T00:58:20.489 INFO:tasks.workunit.client.0.smithi001.stdout:config.status: executing depfiles commands 2024-09-21T00:58:20.627 INFO:tasks.workunit.client.0.smithi001.stderr:+ make 2024-09-21T00:58:20.635 INFO:tasks.workunit.client.0.smithi001.stdout:make all-recursive 2024-09-21T00:58:20.637 INFO:tasks.workunit.client.0.smithi001.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-21T00:58:20.640 INFO:tasks.workunit.client.0.smithi001.stdout:Making all in src 2024-09-21T00:58:20.645 INFO:tasks.workunit.client.0.smithi001.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-09-21T00:58:20.645 INFO:tasks.workunit.client.0.smithi001.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT blogbench.o -MD -MP -MF ".deps/blogbench.Tpo" -c -o blogbench.o blogbench.c; \ 2024-09-21T00:58:20.645 INFO:tasks.workunit.client.0.smithi001.stdout:then mv -f ".deps/blogbench.Tpo" ".deps/blogbench.Po"; else rm -f ".deps/blogbench.Tpo"; exit 1; fi 2024-09-21T00:58:20.744 INFO:tasks.workunit.client.0.smithi001.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT process.o -MD -MP -MF ".deps/process.Tpo" -c -o process.o process.c; \ 2024-09-21T00:58:20.744 INFO:tasks.workunit.client.0.smithi001.stdout:then mv -f ".deps/process.Tpo" ".deps/process.Po"; else rm -f ".deps/process.Tpo"; exit 1; fi 2024-09-21T00:58:20.812 INFO:tasks.workunit.client.0.smithi001.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT writer.o -MD -MP -MF ".deps/writer.Tpo" -c -o writer.o writer.c; \ 2024-09-21T00:58:20.813 INFO:tasks.workunit.client.0.smithi001.stdout:then mv -f ".deps/writer.Tpo" ".deps/writer.Po"; else rm -f ".deps/writer.Tpo"; exit 1; fi 2024-09-21T00:58:20.866 INFO:tasks.workunit.client.0.smithi001.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT rewriter.o -MD -MP -MF ".deps/rewriter.Tpo" -c -o rewriter.o rewriter.c; \ 2024-09-21T00:58:20.866 INFO:tasks.workunit.client.0.smithi001.stdout:then mv -f ".deps/rewriter.Tpo" ".deps/rewriter.Po"; else rm -f ".deps/rewriter.Tpo"; exit 1; fi 2024-09-21T00:58:20.919 INFO:tasks.workunit.client.0.smithi001.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT reader.o -MD -MP -MF ".deps/reader.Tpo" -c -o reader.o reader.c; \ 2024-09-21T00:58:20.919 INFO:tasks.workunit.client.0.smithi001.stdout:then mv -f ".deps/reader.Tpo" ".deps/reader.Po"; else rm -f ".deps/reader.Tpo"; exit 1; fi 2024-09-21T00:58:20.969 INFO:tasks.workunit.client.0.smithi001.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT commenter.o -MD -MP -MF ".deps/commenter.Tpo" -c -o commenter.o commenter.c; \ 2024-09-21T00:58:20.969 INFO:tasks.workunit.client.0.smithi001.stdout:then mv -f ".deps/commenter.Tpo" ".deps/commenter.Po"; else rm -f ".deps/commenter.Tpo"; exit 1; fi 2024-09-21T00:58:21.017 INFO:tasks.workunit.client.0.smithi001.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT helpers.o -MD -MP -MF ".deps/helpers.Tpo" -c -o helpers.o helpers.c; \ 2024-09-21T00:58:21.017 INFO:tasks.workunit.client.0.smithi001.stdout:then mv -f ".deps/helpers.Tpo" ".deps/helpers.Po"; else rm -f ".deps/helpers.Tpo"; exit 1; fi 2024-09-21T00:58:21.093 INFO:tasks.workunit.client.0.smithi001.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT bsd-getopt_long.o -MD -MP -MF ".deps/bsd-getopt_long.Tpo" -c -o bsd-getopt_long.o bsd-getopt_long.c; \ 2024-09-21T00:58:21.093 INFO:tasks.workunit.client.0.smithi001.stdout:then mv -f ".deps/bsd-getopt_long.Tpo" ".deps/bsd-getopt_long.Po"; else rm -f ".deps/bsd-getopt_long.Tpo"; exit 1; fi 2024-09-21T00:58:21.129 INFO:tasks.workunit.client.0.smithi001.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT fakesnprintf.o -MD -MP -MF ".deps/fakesnprintf.Tpo" -c -o fakesnprintf.o fakesnprintf.c; \ 2024-09-21T00:58:21.129 INFO:tasks.workunit.client.0.smithi001.stdout:then mv -f ".deps/fakesnprintf.Tpo" ".deps/fakesnprintf.Po"; else rm -f ".deps/fakesnprintf.Tpo"; exit 1; fi 2024-09-21T00:58:21.163 INFO:tasks.workunit.client.0.smithi001.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT mysnprintf.o -MD -MP -MF ".deps/mysnprintf.Tpo" -c -o mysnprintf.o mysnprintf.c; \ 2024-09-21T00:58:21.163 INFO:tasks.workunit.client.0.smithi001.stdout:then mv -f ".deps/mysnprintf.Tpo" ".deps/mysnprintf.Po"; else rm -f ".deps/mysnprintf.Tpo"; exit 1; fi 2024-09-21T00:58:21.202 INFO:tasks.workunit.client.0.smithi001.stdout:gcc -g -O2 -o blogbench blogbench.o process.o writer.o rewriter.o reader.o commenter.o helpers.o bsd-getopt_long.o fakesnprintf.o mysnprintf.o 2024-09-21T00:58:21.221 INFO:tasks.workunit.client.0.smithi001.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-09-21T00:58:21.221 INFO:tasks.workunit.client.0.smithi001.stdout:Making all in man 2024-09-21T00:58:21.224 INFO:tasks.workunit.client.0.smithi001.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-09-21T00:58:21.224 INFO:tasks.workunit.client.0.smithi001.stdout:make[2]: Nothing to be done for 'all'. 2024-09-21T00:58:21.224 INFO:tasks.workunit.client.0.smithi001.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-09-21T00:58:21.226 INFO:tasks.workunit.client.0.smithi001.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-21T00:58:21.227 INFO:tasks.workunit.client.0.smithi001.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-21T00:58:21.227 INFO:tasks.workunit.client.0.smithi001.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-21T00:58:21.228 INFO:tasks.workunit.client.0.smithi001.stderr:+ cd src 2024-09-21T00:58:21.228 INFO:tasks.workunit.client.0.smithi001.stderr:+ mkdir blogtest_in 2024-09-21T00:58:21.229 INFO:tasks.workunit.client.0.smithi001.stdout:running blogbench 2024-09-21T00:58:21.229 INFO:tasks.workunit.client.0.smithi001.stderr:+ echo 'running blogbench' 2024-09-21T00:58:21.229 INFO:tasks.workunit.client.0.smithi001.stderr:+ ./blogbench -d blogtest_in 2024-09-21T00:58:21.230 INFO:tasks.workunit.client.0.smithi001.stdout: 2024-09-21T00:58:21.230 INFO:tasks.workunit.client.0.smithi001.stdout:Frequency = 10 secs 2024-09-21T00:58:21.230 INFO:tasks.workunit.client.0.smithi001.stdout:Scratch dir = [blogtest_in] 2024-09-21T00:58:22.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:21 smithi001 ceph-mon[31211]: pgmap v392: 97 pgs: 97 active+clean; 3.2 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 254 KiB/s wr, 44 op/s 2024-09-21T00:58:22.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:21 smithi193 ceph-mon[34660]: pgmap v392: 97 pgs: 97 active+clean; 3.2 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 254 KiB/s wr, 44 op/s 2024-09-21T00:58:22.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:21 smithi042 ceph-mon[34481]: pgmap v392: 97 pgs: 97 active+clean; 3.2 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 254 KiB/s wr, 44 op/s 2024-09-21T00:58:23.554 INFO:tasks.workunit.client.0.smithi001.stdout:Spawning 3 writers... 2024-09-21T00:58:23.554 INFO:tasks.workunit.client.0.smithi001.stdout:Spawning 1 rewriters... 2024-09-21T00:58:23.555 INFO:tasks.workunit.client.0.smithi001.stdout:Spawning 5 commenters... 2024-09-21T00:58:23.555 INFO:tasks.workunit.client.0.smithi001.stdout:Spawning 100 readers... 2024-09-21T00:58:23.556 INFO:tasks.workunit.client.0.smithi001.stdout:Benchmarking for 30 iterations. 2024-09-21T00:58:23.556 INFO:tasks.workunit.client.0.smithi001.stdout:The test will run during 5 minutes. 2024-09-21T00:58:23.556 INFO:tasks.workunit.client.0.smithi001.stdout: 2024-09-21T00:58:23.556 INFO:tasks.workunit.client.0.smithi001.stdout: Nb blogs R articles W articles R pictures W pictures R comments W comments 2024-09-21T00:58:24.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:23 smithi001 ceph-mon[31211]: pgmap v393: 97 pgs: 97 active+clean; 3.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 264 KiB/s wr, 50 op/s 2024-09-21T00:58:24.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:23 smithi193 ceph-mon[34660]: pgmap v393: 97 pgs: 97 active+clean; 3.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 264 KiB/s wr, 50 op/s 2024-09-21T00:58:24.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:23 smithi042 ceph-mon[34481]: pgmap v393: 97 pgs: 97 active+clean; 3.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 264 KiB/s wr, 50 op/s 2024-09-21T00:58:25.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:24 smithi001 ceph-mon[31211]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T00:58:25.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:24 smithi193 ceph-mon[34660]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T00:58:25.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:24 smithi042 ceph-mon[34481]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T00:58:26.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:25 smithi001 ceph-mon[31211]: pgmap v394: 97 pgs: 97 active+clean; 4.6 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 383 KiB/s wr, 61 op/s 2024-09-21T00:58:26.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:25 smithi193 ceph-mon[34660]: pgmap v394: 97 pgs: 97 active+clean; 4.6 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 383 KiB/s wr, 61 op/s 2024-09-21T00:58:26.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:25 smithi042 ceph-mon[34481]: pgmap v394: 97 pgs: 97 active+clean; 4.6 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 383 KiB/s wr, 61 op/s 2024-09-21T00:58:28.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:27 smithi001 ceph-mon[31211]: pgmap v395: 97 pgs: 97 active+clean; 5.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 319 KiB/s wr, 62 op/s 2024-09-21T00:58:28.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:27 smithi193 ceph-mon[34660]: pgmap v395: 97 pgs: 97 active+clean; 5.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 319 KiB/s wr, 62 op/s 2024-09-21T00:58:28.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:27 smithi042 ceph-mon[34481]: pgmap v395: 97 pgs: 97 active+clean; 5.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 319 KiB/s wr, 62 op/s 2024-09-21T00:58:29.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:28 smithi001 ceph-mon[31211]: scrub summary: idle 2024-09-21T00:58:29.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:28 smithi193 ceph-mon[34660]: scrub summary: idle 2024-09-21T00:58:29.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:28 smithi042 ceph-mon[34481]: scrub summary: idle 2024-09-21T00:58:30.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:29 smithi001 ceph-mon[31211]: scrub summary: idle 2024-09-21T00:58:30.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:29 smithi001 ceph-mon[31211]: pgmap v396: 97 pgs: 97 active+clean; 8.2 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 552 KiB/s wr, 56 op/s 2024-09-21T00:58:30.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:29 smithi193 ceph-mon[34660]: scrub summary: idle 2024-09-21T00:58:30.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:29 smithi193 ceph-mon[34660]: pgmap v396: 97 pgs: 97 active+clean; 8.2 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 552 KiB/s wr, 56 op/s 2024-09-21T00:58:30.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:29 smithi042 ceph-mon[34481]: scrub summary: idle 2024-09-21T00:58:30.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:29 smithi042 ceph-mon[34481]: pgmap v396: 97 pgs: 97 active+clean; 8.2 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 552 KiB/s wr, 56 op/s 2024-09-21T00:58:32.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:31 smithi001 ceph-mon[31211]: pgmap v397: 97 pgs: 97 active+clean; 15 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 1.1 MiB/s wr, 70 op/s 2024-09-21T00:58:32.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:31 smithi193 ceph-mon[34660]: pgmap v397: 97 pgs: 97 active+clean; 15 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 1.1 MiB/s wr, 70 op/s 2024-09-21T00:58:32.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:31 smithi042 ceph-mon[34481]: pgmap v397: 97 pgs: 97 active+clean; 15 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 1.1 MiB/s wr, 70 op/s 2024-09-21T00:58:32.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.942+0000 7f9261571640 1 -- 172.21.15.1:0/1401988416 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f925c103fe0 msgr2=0x7f925c10a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:32.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.942+0000 7f9261571640 1 --2- 172.21.15.1:0/1401988416 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f925c103fe0 0x7f925c10a980 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9254009860 tx=0x7f925402a340 comp rx=0 tx=0).stop 2024-09-21T00:58:32.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.942+0000 7f9261571640 1 -- 172.21.15.1:0/1401988416 shutdown_connections 2024-09-21T00:58:32.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.942+0000 7f9261571640 1 --2- 172.21.15.1:0/1401988416 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f925c103fe0 0x7f925c10a980 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:32.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.942+0000 7f9261571640 1 --2- 172.21.15.1:0/1401988416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f925c103640 0x7f925c103a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:32.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.942+0000 7f9261571640 1 --2- 172.21.15.1:0/1401988416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f925c1025c0 0x7f925c102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:32.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.942+0000 7f9261571640 1 -- 172.21.15.1:0/1401988416 >> 172.21.15.1:0/1401988416 conn(0x7f925c0fdf00 msgr2=0x7f925c1003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:32.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.942+0000 7f9261571640 1 -- 172.21.15.1:0/1401988416 shutdown_connections 2024-09-21T00:58:32.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.942+0000 7f9261571640 1 -- 172.21.15.1:0/1401988416 wait complete. 2024-09-21T00:58:32.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.943+0000 7f9261571640 1 Processor -- start 2024-09-21T00:58:32.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.943+0000 7f9261571640 1 -- start start 2024-09-21T00:58:32.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.943+0000 7f9261571640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f925c1025c0 0x7f925c199f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:32.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.943+0000 7f9261571640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f925c103640 0x7f925c19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:32.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.943+0000 7f9261571640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f925c103fe0 0x7f925c19b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:32.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.943+0000 7f9261571640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f925c10e260 con 0x7f925c1025c0 2024-09-21T00:58:32.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.943+0000 7f9261571640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f925c10e0e0 con 0x7f925c103fe0 2024-09-21T00:58:32.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.943+0000 7f9261571640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f925c10e3e0 con 0x7f925c103640 2024-09-21T00:58:32.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.943+0000 7f925affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f925c1025c0 0x7f925c199f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:32.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.943+0000 7f925affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f925c1025c0 0x7f925c199f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51468/0 (socket says 172.21.15.1:51468) 2024-09-21T00:58:32.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.943+0000 7f925affd640 1 -- 172.21.15.1:0/1755442781 learned_addr learned my addr 172.21.15.1:0/1755442781 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:32.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.943+0000 7f925b7fe640 1 --2- 172.21.15.1:0/1755442781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f925c103fe0 0x7f925c19b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:32.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.944+0000 7f925a7fc640 1 --2- 172.21.15.1:0/1755442781 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f925c103640 0x7f925c19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:32.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.944+0000 7f925affd640 1 -- 172.21.15.1:0/1755442781 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f925c103640 msgr2=0x7f925c19a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:32.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.944+0000 7f925affd640 1 --2- 172.21.15.1:0/1755442781 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f925c103640 0x7f925c19a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:32.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.944+0000 7f925affd640 1 -- 172.21.15.1:0/1755442781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f925c103fe0 msgr2=0x7f925c19b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:32.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.944+0000 7f925affd640 1 --2- 172.21.15.1:0/1755442781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f925c103fe0 0x7f925c19b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:32.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.944+0000 7f925affd640 1 -- 172.21.15.1:0/1755442781 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f925c19b990 con 0x7f925c1025c0 2024-09-21T00:58:32.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.944+0000 7f925b7fe640 1 --2- 172.21.15.1:0/1755442781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f925c103fe0 0x7f925c19b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:32.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.944+0000 7f925affd640 1 --2- 172.21.15.1:0/1755442781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f925c1025c0 0x7f925c199f50 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f924c00ba50 tx=0x7f924c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:32.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.944+0000 7f9253fff640 1 -- 172.21.15.1:0/1755442781 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f924c019070 con 0x7f925c1025c0 2024-09-21T00:58:32.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.944+0000 7f9253fff640 1 -- 172.21.15.1:0/1755442781 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f924c00cbe0 con 0x7f925c1025c0 2024-09-21T00:58:32.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.944+0000 7f9261571640 1 -- 172.21.15.1:0/1755442781 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f925c19bc80 con 0x7f925c1025c0 2024-09-21T00:58:32.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.944+0000 7f9253fff640 1 -- 172.21.15.1:0/1755442781 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f924c0075d0 con 0x7f925c1025c0 2024-09-21T00:58:32.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.944+0000 7f9261571640 1 -- 172.21.15.1:0/1755442781 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f925c1a2370 con 0x7f925c1025c0 2024-09-21T00:58:32.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.947+0000 7f9253fff640 1 -- 172.21.15.1:0/1755442781 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f924c01c070 con 0x7f925c1025c0 2024-09-21T00:58:32.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.948+0000 7f9253fff640 1 --2- 172.21.15.1:0/1755442781 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f92480b6510 0x7f92480b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:32.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.948+0000 7f9253fff640 1 -- 172.21.15.1:0/1755442781 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f924c0e6890 con 0x7f925c1025c0 2024-09-21T00:58:32.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.948+0000 7f925a7fc640 1 --2- 172.21.15.1:0/1755442781 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f92480b6510 0x7f92480b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:32.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.948+0000 7f9268122740 1 Processor -- start 2024-09-21T00:58:32.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.948+0000 7f9268122740 1 -- start start 2024-09-21T00:58:32.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.949+0000 7f925a7fc640 1 --2- 172.21.15.1:0/1755442781 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f92480b6510 0x7f92480b8a20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9244009530 tx=0x7f9244009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:32.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.949+0000 7f9268122740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6fd0fd1b0 0x55d6fd4a4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:32.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.949+0000 7f9268122740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6fd0d42f0 0x55d6fd4a54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:32.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.949+0000 7f9268122740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d6fd0dc4d0 0x55d6fd4a6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:32.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.949+0000 7f9268122740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d6fd4176f0 con 0x55d6fd0d42f0 2024-09-21T00:58:32.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.949+0000 7f9268122740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d6fd406b20 con 0x55d6fd0dc4d0 2024-09-21T00:58:32.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.949+0000 7f9268122740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d6fd40a930 con 0x55d6fd0fd1b0 2024-09-21T00:58:32.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.949+0000 7f925a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6fd0d42f0 0x55d6fd4a54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:32.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.949+0000 7f925a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6fd0d42f0 0x55d6fd4a54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51474/0 (socket says 172.21.15.1:51474) 2024-09-21T00:58:32.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.949+0000 7f925a7fc640 1 -- 172.21.15.1:0/1197170955 learned_addr learned my addr 172.21.15.1:0/1197170955 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:32.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.949+0000 7f925affd640 1 --2- 172.21.15.1:0/1197170955 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6fd0fd1b0 0x55d6fd4a4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:32.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.949+0000 7f925b7fe640 1 --2- 172.21.15.1:0/1197170955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d6fd0dc4d0 0x55d6fd4a6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:32.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.949+0000 7f925affd640 1 -- 172.21.15.1:0/1197170955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d6fd0dc4d0 msgr2=0x55d6fd4a6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:32.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.949+0000 7f925affd640 1 --2- 172.21.15.1:0/1197170955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d6fd0dc4d0 0x55d6fd4a6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:32.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.949+0000 7f925affd640 1 -- 172.21.15.1:0/1197170955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6fd0d42f0 msgr2=0x55d6fd4a54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:32.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.949+0000 7f925affd640 1 --2- 172.21.15.1:0/1197170955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6fd0d42f0 0x55d6fd4a54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:32.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.949+0000 7f925affd640 1 -- 172.21.15.1:0/1197170955 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6fd3cc530 con 0x55d6fd0fd1b0 2024-09-21T00:58:32.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.949+0000 7f925a7fc640 1 --2- 172.21.15.1:0/1197170955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6fd0d42f0 0x55d6fd4a54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:32.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.949+0000 7f925affd640 1 --2- 172.21.15.1:0/1197170955 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6fd0fd1b0 0x55d6fd4a4e50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f924c009fd0 tx=0x7f924c004b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e77e9d7db5347e5e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:32.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.950+0000 7f92517fa640 1 -- 172.21.15.1:0/1197170955 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f924c0b14e0 con 0x55d6fd0fd1b0 2024-09-21T00:58:32.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.950+0000 7f92517fa640 1 -- 172.21.15.1:0/1197170955 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f924c0b6420 con 0x55d6fd0fd1b0 2024-09-21T00:58:32.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.950+0000 7f92517fa640 1 -- 172.21.15.1:0/1197170955 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f924c0ab780 con 0x55d6fd0fd1b0 2024-09-21T00:58:32.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.951+0000 7f9268122740 1 -- 172.21.15.1:0/1197170955 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6fd0fd1b0 msgr2=0x55d6fd4a4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:32.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.951+0000 7f9268122740 1 --2- 172.21.15.1:0/1197170955 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6fd0fd1b0 0x55d6fd4a4e50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f924c009fd0 tx=0x7f924c004b50 comp rx=0 tx=0).stop 2024-09-21T00:58:32.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.951+0000 7f9268122740 1 -- 172.21.15.1:0/1197170955 shutdown_connections 2024-09-21T00:58:32.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.951+0000 7f9268122740 1 --2- 172.21.15.1:0/1197170955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d6fd0dc4d0 0x55d6fd4a6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:32.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.951+0000 7f9268122740 1 --2- 172.21.15.1:0/1197170955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6fd0d42f0 0x55d6fd4a54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:32.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.951+0000 7f9268122740 1 --2- 172.21.15.1:0/1197170955 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6fd0fd1b0 0x55d6fd4a4e50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:32.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.951+0000 7f9268122740 1 -- 172.21.15.1:0/1197170955 >> 172.21.15.1:0/1197170955 conn(0x55d6fd0f1300 msgr2=0x55d6fd4a08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:32.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.951+0000 7f9268122740 1 -- 172.21.15.1:0/1197170955 shutdown_connections 2024-09-21T00:58:32.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.951+0000 7f9268122740 1 -- 172.21.15.1:0/1197170955 wait complete. 2024-09-21T00:58:32.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.951+0000 7f9268122740 1 -- start start 2024-09-21T00:58:32.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.951+0000 7f9268122740 1 Processor -- start 2024-09-21T00:58:32.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.952+0000 7f9268122740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6fd0d42f0 0x55d6fd4ae540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:32.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.952+0000 7f9268122740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6fd0dc4d0 0x55d6fd4aec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:32.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.952+0000 7f9268122740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d6fd0fd1b0 0x55d6fd4af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:32.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.952+0000 7f9268122740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d6fd33eab0 con 0x55d6fd0d42f0 2024-09-21T00:58:32.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.952+0000 7f9268122740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d6fd3ac730 con 0x55d6fd0fd1b0 2024-09-21T00:58:32.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.952+0000 7f9268122740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d6fd4a6a70 con 0x55d6fd0dc4d0 2024-09-21T00:58:32.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.952+0000 7f9268122740 10 client.0 _ll_register_callbacks cb 0x55d6fd4006b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:32.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.952+0000 7f925affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6fd0d42f0 0x55d6fd4ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:32.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.952+0000 7f925affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6fd0d42f0 0x55d6fd4ae540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51490/0 (socket says 172.21.15.1:51490) 2024-09-21T00:58:32.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.952+0000 7f925affd640 1 -- 172.21.15.1:0/3954013032 learned_addr learned my addr 172.21.15.1:0/3954013032 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:32.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.952+0000 7f925b7fe640 1 --2- 172.21.15.1:0/3954013032 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d6fd0fd1b0 0x55d6fd4af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:32.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.952+0000 7f925a7fc640 1 --2- 172.21.15.1:0/3954013032 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6fd0dc4d0 0x55d6fd4aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:32.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.952+0000 7f925affd640 1 -- 172.21.15.1:0/3954013032 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6fd0dc4d0 msgr2=0x55d6fd4aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:32.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.952+0000 7f925affd640 1 --2- 172.21.15.1:0/3954013032 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6fd0dc4d0 0x55d6fd4aec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:32.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.952+0000 7f925affd640 1 -- 172.21.15.1:0/3954013032 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d6fd0fd1b0 msgr2=0x55d6fd4af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:32.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.952+0000 7f925affd640 1 --2- 172.21.15.1:0/3954013032 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d6fd0fd1b0 0x55d6fd4af770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:32.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.952+0000 7f925affd640 1 -- 172.21.15.1:0/3954013032 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6fd168790 con 0x55d6fd0d42f0 2024-09-21T00:58:32.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.952+0000 7f925a7fc640 1 --2- 172.21.15.1:0/3954013032 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6fd0dc4d0 0x55d6fd4aec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:58:32.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.952+0000 7f925affd640 1 --2- 172.21.15.1:0/3954013032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6fd0d42f0 0x55d6fd4ae540 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f924c0a9080 tx=0x7f924c009930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53a6f97a9fef2950 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:32.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.952+0000 7f92427fc640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:58:32.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.952+0000 7f92427fc640 1 -- 172.21.15.1:0/3954013032 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f924c0b1290 con 0x55d6fd0d42f0 2024-09-21T00:58:32.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.952+0000 7f92427fc640 1 -- 172.21.15.1:0/3954013032 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f924c0abd10 con 0x55d6fd0d42f0 2024-09-21T00:58:32.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.952+0000 7f9268122740 1 -- 172.21.15.1:0/3954013032 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f924c0b6420 con 0x55d6fd0d42f0 2024-09-21T00:58:32.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.953+0000 7f92427fc640 1 -- 172.21.15.1:0/3954013032 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f924c0abf10 con 0x55d6fd0d42f0 2024-09-21T00:58:32.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.953+0000 7f9268122740 10 client.16017 fetch_fsmap learned FSMap version 30 2024-09-21T00:58:32.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.953+0000 7f9268122740 1 -- 172.21.15.1:0/3954013032 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d6fd1e1620 con 0x55d6fd0d42f0 2024-09-21T00:58:32.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.953+0000 7f92427fc640 1 -- 172.21.15.1:0/3954013032 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f924c0b6420 con 0x55d6fd0d42f0 2024-09-21T00:58:32.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.953+0000 7f92427fc640 1 -- 172.21.15.1:0/3954013032 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 30) ==== 8382+0+0 (secure 0 0 0) 0x7f924c0b5960 con 0x55d6fd0d42f0 2024-09-21T00:58:32.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.953+0000 7f9268122740 10 client.16017 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T00:58:32.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.953+0000 7f9268122740 10 client.16017 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:58:32.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.953+0000 7f9268122740 20 client.16017 populate_metadata read hostname 'smithi001' 2024-09-21T00:58:32.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.953+0000 7f9268122740 1 --2- 172.21.15.1:0/3954013032 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d6fd0bbd80 0x55d6fd4bb850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:32.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.953+0000 7f9268122740 4 client.16017 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:58:32.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.953+0000 7f9268122740 1 -- 172.21.15.1:0/3954013032 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6fd419640 con 0x55d6fd0bbd80 2024-09-21T00:58:32.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.953+0000 7f925a7fc640 1 --2- 172.21.15.1:0/3954013032 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d6fd0bbd80 0x55d6fd4bb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:32.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.954+0000 7f92427fc640 10 client.16017 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:32.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.954+0000 7f925a7fc640 1 --2- 172.21.15.1:0/3954013032 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d6fd0bbd80 0x55d6fd4bb850 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eca3f66b4e820272 server_cookie=80060e3e1b0c26c9 in_seq=0 out_seq=0 2024-09-21T00:58:32.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.954+0000 7f92427fc640 1 -- 172.21.15.1:0/3954013032 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d6fd419640 con 0x55d6fd0bbd80 2024-09-21T00:58:32.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.954+0000 7f92427fc640 10 client.16017 handle_command_reply: tid=0 2024-09-21T00:58:32.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.955+0000 7f9268122740 1 client.16017 shutdown 2024-09-21T00:58:32.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.955+0000 7f9268122740 1 -- 172.21.15.1:0/3954013032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6fd0d42f0 msgr2=0x55d6fd4ae540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:32.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.955+0000 7f9268122740 1 --2- 172.21.15.1:0/3954013032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6fd0d42f0 0x55d6fd4ae540 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f924c0a9080 tx=0x7f924c009930 comp rx=0 tx=0).stop 2024-09-21T00:58:32.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.955+0000 7f9268122740 1 -- 172.21.15.1:0/3954013032 shutdown_connections 2024-09-21T00:58:32.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.955+0000 7f9268122740 1 --2- 172.21.15.1:0/3954013032 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d6fd0bbd80 0x55d6fd4bb850 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:32.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.955+0000 7f9268122740 1 --2- 172.21.15.1:0/3954013032 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d6fd0fd1b0 0x55d6fd4af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:32.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.955+0000 7f92427fc640 0 client.16017 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:32.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.955+0000 7f9268122740 1 --2- 172.21.15.1:0/3954013032 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6fd0dc4d0 0x55d6fd4aec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:32.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.955+0000 7f9268122740 1 --2- 172.21.15.1:0/3954013032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6fd0d42f0 0x55d6fd4ae540 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:32.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.955+0000 7f9268122740 1 -- 172.21.15.1:0/3954013032 >> 172.21.15.1:0/3954013032 conn(0x55d6fd0f1300 msgr2=0x55d6fd4a5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:32.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.955+0000 7f9268122740 1 -- 172.21.15.1:0/3954013032 shutdown_connections 2024-09-21T00:58:32.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.955+0000 7f9268122740 1 -- 172.21.15.1:0/3954013032 wait complete. 2024-09-21T00:58:32.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.955+0000 7f9268122740 20 client.16017 trim_cache size 0 max 16384 2024-09-21T00:58:32.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.970+0000 7f9268122740 1 Processor -- start 2024-09-21T00:58:32.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.970+0000 7f9268122740 1 -- start start 2024-09-21T00:58:32.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.971+0000 7f9268122740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d6fd0f1300 0x55d6fd4a6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:32.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.971+0000 7f9268122740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6fd0bbd80 0x55d6fd4a7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:32.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.971+0000 7f9268122740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6fd0d42f0 0x55d6fd4a79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:32.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.971+0000 7f9268122740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f925c1ab020 con 0x55d6fd0d42f0 2024-09-21T00:58:32.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.971+0000 7f9268122740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f925c1acc50 con 0x55d6fd0f1300 2024-09-21T00:58:32.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.971+0000 7f9268122740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f925c1ab6f0 con 0x55d6fd0bbd80 2024-09-21T00:58:32.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.971+0000 7f925b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6fd0d42f0 0x55d6fd4a79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:32.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.971+0000 7f925affd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d6fd0f1300 0x55d6fd4a6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:32.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.971+0000 7f925affd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d6fd0f1300 0x55d6fd4a6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:38910/0 (socket says 172.21.15.1:38910) 2024-09-21T00:58:32.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.971+0000 7f925affd640 1 -- 172.21.15.1:0/4118948960 learned_addr learned my addr 172.21.15.1:0/4118948960 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:32.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.971+0000 7f925a7fc640 1 --2- 172.21.15.1:0/4118948960 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6fd0bbd80 0x55d6fd4a7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:32.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.971+0000 7f925affd640 1 -- 172.21.15.1:0/4118948960 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6fd0bbd80 msgr2=0x55d6fd4a7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:32.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.971+0000 7f925affd640 1 --2- 172.21.15.1:0/4118948960 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6fd0bbd80 0x55d6fd4a7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:32.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.971+0000 7f925affd640 1 -- 172.21.15.1:0/4118948960 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6fd0d42f0 msgr2=0x55d6fd4a79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:32.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.971+0000 7f925affd640 1 --2- 172.21.15.1:0/4118948960 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6fd0d42f0 0x55d6fd4a79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:32.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.971+0000 7f925affd640 1 -- 172.21.15.1:0/4118948960 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6fd4b0370 con 0x55d6fd0f1300 2024-09-21T00:58:32.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.972+0000 7f925affd640 1 --2- 172.21.15.1:0/4118948960 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d6fd0f1300 0x55d6fd4a6f50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f924c0e46e0 tx=0x7f924c0a8880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=169948e8789e658a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:32.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.972+0000 7f9250ff9640 1 -- 172.21.15.1:0/4118948960 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f924c0b1040 con 0x55d6fd0f1300 2024-09-21T00:58:32.974 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.972+0000 7f9250ff9640 1 -- 172.21.15.1:0/4118948960 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f924c0cea10 con 0x55d6fd0f1300 2024-09-21T00:58:32.974 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.972+0000 7f9250ff9640 1 -- 172.21.15.1:0/4118948960 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f924c0090a0 con 0x55d6fd0f1300 2024-09-21T00:58:32.977 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.973+0000 7f9268122740 1 -- 172.21.15.1:0/4118948960 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d6fd0f1300 msgr2=0x55d6fd4a6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:32.977 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.973+0000 7f9268122740 1 --2- 172.21.15.1:0/4118948960 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d6fd0f1300 0x55d6fd4a6f50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f924c0e46e0 tx=0x7f924c0a8880 comp rx=0 tx=0).stop 2024-09-21T00:58:32.977 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.973+0000 7f9268122740 1 -- 172.21.15.1:0/4118948960 shutdown_connections 2024-09-21T00:58:32.977 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.973+0000 7f9268122740 1 --2- 172.21.15.1:0/4118948960 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6fd0d42f0 0x55d6fd4a79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:32.977 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.973+0000 7f9268122740 1 --2- 172.21.15.1:0/4118948960 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6fd0bbd80 0x55d6fd4a7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:32.977 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.973+0000 7f9268122740 1 --2- 172.21.15.1:0/4118948960 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d6fd0f1300 0x55d6fd4a6f50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:32.977 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.973+0000 7f9268122740 1 -- 172.21.15.1:0/4118948960 >> 172.21.15.1:0/4118948960 conn(0x55d6fd4a5720 msgr2=0x55d6fd4acad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:32.977 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.973+0000 7f9268122740 1 -- 172.21.15.1:0/4118948960 shutdown_connections 2024-09-21T00:58:32.977 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.973+0000 7f9268122740 1 -- 172.21.15.1:0/4118948960 wait complete. 2024-09-21T00:58:32.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.973+0000 7f9268122740 1 -- start start 2024-09-21T00:58:32.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.973+0000 7f9268122740 1 Processor -- start 2024-09-21T00:58:32.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.974+0000 7f9268122740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d6fd0bbd80 0x55d6fd4b5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:32.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.974+0000 7f9268122740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6fd0d42f0 0x55d6fd4b4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:32.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.974+0000 7f9268122740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6fd0f1300 0x55d6fd4b5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:32.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.974+0000 7f9268122740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f925c1ac4c0 con 0x55d6fd0f1300 2024-09-21T00:58:32.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.974+0000 7f9268122740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f925c1abdf0 con 0x55d6fd0bbd80 2024-09-21T00:58:32.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.974+0000 7f9268122740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f925c1a9000 con 0x55d6fd0d42f0 2024-09-21T00:58:32.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.974+0000 7f9268122740 10 client.0 _ll_register_callbacks cb 0x7f9244009c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:32.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.974+0000 7f925affd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d6fd0bbd80 0x55d6fd4b5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:32.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.974+0000 7f925a7fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6fd0d42f0 0x55d6fd4b4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:32.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.974+0000 7f925b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6fd0f1300 0x55d6fd4b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:32.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.974+0000 7f925affd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d6fd0bbd80 0x55d6fd4b5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:38926/0 (socket says 172.21.15.1:38926) 2024-09-21T00:58:32.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.974+0000 7f925affd640 1 -- 172.21.15.1:0/1533385978 learned_addr learned my addr 172.21.15.1:0/1533385978 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:32.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.974+0000 7f925affd640 1 -- 172.21.15.1:0/1533385978 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6fd0d42f0 msgr2=0x55d6fd4b4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:32.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.974+0000 7f925affd640 1 --2- 172.21.15.1:0/1533385978 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6fd0d42f0 0x55d6fd4b4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:32.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.974+0000 7f925affd640 1 -- 172.21.15.1:0/1533385978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6fd0f1300 msgr2=0x55d6fd4b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:32.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.974+0000 7f925affd640 1 --2- 172.21.15.1:0/1533385978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6fd0f1300 0x55d6fd4b5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:32.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.974+0000 7f925affd640 1 -- 172.21.15.1:0/1533385978 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6fd4b6a10 con 0x55d6fd0bbd80 2024-09-21T00:58:32.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.974+0000 7f925a7fc640 1 --2- 172.21.15.1:0/1533385978 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6fd0d42f0 0x55d6fd4b4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:32.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.975+0000 7f925affd640 1 --2- 172.21.15.1:0/1533385978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d6fd0bbd80 0x55d6fd4b5f50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f924c0a9080 tx=0x7f924c014c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6401dc3ddc76353 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:32.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.975+0000 7f92427fc640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T00:58:32.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.975+0000 7f92427fc640 1 -- 172.21.15.1:0/1533385978 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f924c0b1070 con 0x55d6fd0bbd80 2024-09-21T00:58:32.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.975+0000 7f92427fc640 1 -- 172.21.15.1:0/1533385978 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f924c0c2bb0 con 0x55d6fd0bbd80 2024-09-21T00:58:32.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.975+0000 7f9268122740 1 -- 172.21.15.1:0/1533385978 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f924c0cea10 con 0x55d6fd0bbd80 2024-09-21T00:58:32.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.975+0000 7f92427fc640 1 -- 172.21.15.1:0/1533385978 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f924c0c2e30 con 0x55d6fd0bbd80 2024-09-21T00:58:32.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.975+0000 7f9268122740 10 client.25679 fetch_fsmap learned FSMap version 30 2024-09-21T00:58:32.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.975+0000 7f9268122740 1 -- 172.21.15.1:0/1533385978 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d6fd4b6a10 con 0x55d6fd0bbd80 2024-09-21T00:58:32.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.975+0000 7f92427fc640 1 -- 172.21.15.1:0/1533385978 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f924c0cd070 con 0x55d6fd0bbd80 2024-09-21T00:58:32.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.975+0000 7f92427fc640 1 -- 172.21.15.1:0/1533385978 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 30) ==== 8382+0+0 (secure 0 0 0) 0x7f924c0acab0 con 0x55d6fd0bbd80 2024-09-21T00:58:32.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.975+0000 7f9268122740 10 client.25679 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T00:58:32.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.975+0000 7f9268122740 10 client.25679 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:58:32.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.975+0000 7f9268122740 20 client.25679 populate_metadata read hostname 'smithi001' 2024-09-21T00:58:32.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.975+0000 7f9268122740 1 --2- 172.21.15.1:0/1533385978 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d6fd0dc4d0 0x55d6fd528770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:32.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.976+0000 7f9268122740 4 client.25679 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T00:58:32.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.976+0000 7f9268122740 1 -- 172.21.15.1:0/1533385978 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d6fd4150f0 con 0x55d6fd0dc4d0 2024-09-21T00:58:32.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.976+0000 7f925a7fc640 1 --2- 172.21.15.1:0/1533385978 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d6fd0dc4d0 0x55d6fd528770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:32.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.976+0000 7f92427fc640 10 client.25679 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:32.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.976+0000 7f925a7fc640 1 --2- 172.21.15.1:0/1533385978 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d6fd0dc4d0 0x55d6fd528770 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d2afecb4ed11f14 server_cookie=fc02812aa0d62c11 in_seq=0 out_seq=0 2024-09-21T00:58:32.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.987+0000 7f92427fc640 1 -- 172.21.15.1:0/1533385978 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d6fd4150f0 con 0x55d6fd0dc4d0 2024-09-21T00:58:32.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.987+0000 7f92427fc640 10 client.25679 handle_command_reply: tid=0 2024-09-21T00:58:32.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.987+0000 7f9268122740 1 client.25679 shutdown 2024-09-21T00:58:32.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.987+0000 7f9268122740 1 -- 172.21.15.1:0/1533385978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d6fd0bbd80 msgr2=0x55d6fd4b5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:32.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.987+0000 7f9268122740 1 --2- 172.21.15.1:0/1533385978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d6fd0bbd80 0x55d6fd4b5f50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f924c0a9080 tx=0x7f924c014c90 comp rx=0 tx=0).stop 2024-09-21T00:58:32.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.987+0000 7f9268122740 1 -- 172.21.15.1:0/1533385978 shutdown_connections 2024-09-21T00:58:32.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.987+0000 7f9268122740 1 --2- 172.21.15.1:0/1533385978 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d6fd0dc4d0 0x55d6fd528770 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:32.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.987+0000 7f9268122740 1 --2- 172.21.15.1:0/1533385978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6fd0f1300 0x55d6fd4b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:32.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.987+0000 7f92427fc640 0 client.25679 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:32.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.987+0000 7f9268122740 1 --2- 172.21.15.1:0/1533385978 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6fd0d42f0 0x55d6fd4b4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:32.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.987+0000 7f9268122740 1 --2- 172.21.15.1:0/1533385978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d6fd0bbd80 0x55d6fd4b5f50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:32.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.987+0000 7f9268122740 1 -- 172.21.15.1:0/1533385978 >> 172.21.15.1:0/1533385978 conn(0x55d6fd4a5720 msgr2=0x55d6fd49eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:32.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.987+0000 7f9268122740 1 -- 172.21.15.1:0/1533385978 shutdown_connections 2024-09-21T00:58:32.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.987+0000 7f9268122740 1 -- 172.21.15.1:0/1533385978 wait complete. 2024-09-21T00:58:32.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.987+0000 7f9268122740 20 client.25679 trim_cache size 0 max 16384 2024-09-21T00:58:32.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T00:58:32.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T00:58:32.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T00:58:32.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T00:58:32.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.988+0000 7f9261571640 1 -- 172.21.15.1:0/1755442781 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f92480b6510 msgr2=0x7f92480b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:32.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.988+0000 7f9261571640 1 --2- 172.21.15.1:0/1755442781 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f92480b6510 0x7f92480b8a20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9244009530 tx=0x7f9244009260 comp rx=0 tx=0).stop 2024-09-21T00:58:32.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.988+0000 7f9261571640 1 -- 172.21.15.1:0/1755442781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f925c1025c0 msgr2=0x7f925c199f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:32.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.988+0000 7f9261571640 1 --2- 172.21.15.1:0/1755442781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f925c1025c0 0x7f925c199f50 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f924c00ba50 tx=0x7f924c00bf10 comp rx=0 tx=0).stop 2024-09-21T00:58:32.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.988+0000 7f9261571640 1 -- 172.21.15.1:0/1755442781 shutdown_connections 2024-09-21T00:58:32.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.988+0000 7f9261571640 1 --2- 172.21.15.1:0/1755442781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f925c103fe0 0x7f925c19b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:32.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.988+0000 7f9261571640 1 --2- 172.21.15.1:0/1755442781 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f925c103640 0x7f925c19a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:32.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.988+0000 7f9261571640 1 --2- 172.21.15.1:0/1755442781 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f92480b6510 0x7f92480b8a20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:32.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.988+0000 7f9261571640 1 --2- 172.21.15.1:0/1755442781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f925c1025c0 0x7f925c199f50 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:32.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.988+0000 7f9261571640 1 -- 172.21.15.1:0/1755442781 >> 172.21.15.1:0/1755442781 conn(0x7f925c0fdf00 msgr2=0x7f925c0ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:32.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.988+0000 7f9261571640 1 -- 172.21.15.1:0/1755442781 shutdown_connections 2024-09-21T00:58:32.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:32.988+0000 7f9261571640 1 -- 172.21.15.1:0/1755442781 wait complete. 2024-09-21T00:58:33.558 INFO:tasks.workunit.client.0.smithi001.stdout: 15 239668 1039 140741 785 44575 923 2024-09-21T00:58:33.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:33 smithi001 ceph-mon[31211]: pgmap v398: 97 pgs: 97 active+clean; 35 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 2.9 MiB/s wr, 151 op/s 2024-09-21T00:58:33.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:33 smithi001 ceph-mon[31211]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T00:58:34.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:33 smithi193 ceph-mon[34660]: pgmap v398: 97 pgs: 97 active+clean; 35 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 2.9 MiB/s wr, 151 op/s 2024-09-21T00:58:34.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:33 smithi193 ceph-mon[34660]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T00:58:34.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:33 smithi042 ceph-mon[34481]: pgmap v398: 97 pgs: 97 active+clean; 35 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 2.9 MiB/s wr, 151 op/s 2024-09-21T00:58:34.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:33 smithi042 ceph-mon[34481]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T00:58:36.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:35 smithi001 ceph-mon[31211]: pgmap v399: 97 pgs: 97 active+clean; 52 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.4 MiB/s wr, 215 op/s 2024-09-21T00:58:36.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:35 smithi193 ceph-mon[34660]: pgmap v399: 97 pgs: 97 active+clean; 52 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.4 MiB/s wr, 215 op/s 2024-09-21T00:58:36.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:35 smithi042 ceph-mon[34481]: pgmap v399: 97 pgs: 97 active+clean; 52 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.4 MiB/s wr, 215 op/s 2024-09-21T00:58:38.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:37 smithi001 ceph-mon[31211]: pgmap v400: 97 pgs: 97 active+clean; 51 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.3 MiB/s wr, 230 op/s 2024-09-21T00:58:38.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:37 smithi193 ceph-mon[34660]: pgmap v400: 97 pgs: 97 active+clean; 51 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.3 MiB/s wr, 230 op/s 2024-09-21T00:58:38.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:37 smithi042 ceph-mon[34481]: pgmap v400: 97 pgs: 97 active+clean; 51 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.3 MiB/s wr, 230 op/s 2024-09-21T00:58:39.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:38 smithi001 ceph-mon[31211]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T00:58:39.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:38 smithi193 ceph-mon[34660]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T00:58:39.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:38 smithi042 ceph-mon[34481]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T00:58:40.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:39 smithi001 ceph-mon[31211]: pgmap v401: 97 pgs: 97 active+clean; 57 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.9 MiB/s wr, 281 op/s 2024-09-21T00:58:40.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:39 smithi193 ceph-mon[34660]: pgmap v401: 97 pgs: 97 active+clean; 57 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.9 MiB/s wr, 281 op/s 2024-09-21T00:58:40.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:39 smithi042 ceph-mon[34481]: pgmap v401: 97 pgs: 97 active+clean; 57 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.9 MiB/s wr, 281 op/s 2024-09-21T00:58:42.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:41 smithi001 ceph-mon[31211]: pgmap v402: 97 pgs: 97 active+clean; 60 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.9 MiB/s wr, 318 op/s 2024-09-21T00:58:42.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:41 smithi193 ceph-mon[34660]: pgmap v402: 97 pgs: 97 active+clean; 60 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.9 MiB/s wr, 318 op/s 2024-09-21T00:58:42.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:41 smithi042 ceph-mon[34481]: pgmap v402: 97 pgs: 97 active+clean; 60 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.9 MiB/s wr, 318 op/s 2024-09-21T00:58:43.556 INFO:tasks.workunit.client.0.smithi001.stdout: 26 391513 550 221223 583 130564 1526 2024-09-21T00:58:44.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:43 smithi001 ceph-mon[31211]: pgmap v403: 97 pgs: 97 active+clean; 62 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 4.5 MiB/s wr, 407 op/s 2024-09-21T00:58:44.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:43 smithi193 ceph-mon[34660]: pgmap v403: 97 pgs: 97 active+clean; 62 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 4.5 MiB/s wr, 407 op/s 2024-09-21T00:58:44.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:43 smithi042 ceph-mon[34481]: pgmap v403: 97 pgs: 97 active+clean; 62 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 4.5 MiB/s wr, 407 op/s 2024-09-21T00:58:46.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.095+0000 7f62024b6640 1 -- 172.21.15.1:0/3971871960 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61fc103fe0 msgr2=0x7f61fc10a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:46.097 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.095+0000 7f62024b6640 1 --2- 172.21.15.1:0/3971871960 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61fc103fe0 0x7f61fc10a980 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f61f4009ca0 tx=0x7f61f402a8c0 comp rx=0 tx=0).stop 2024-09-21T00:58:46.097 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.095+0000 7f62024b6640 1 -- 172.21.15.1:0/3971871960 shutdown_connections 2024-09-21T00:58:46.097 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.095+0000 7f62024b6640 1 --2- 172.21.15.1:0/3971871960 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61fc103fe0 0x7f61fc10a980 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:46.097 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.095+0000 7f62024b6640 1 --2- 172.21.15.1:0/3971871960 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f61fc103640 0x7f61fc103a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:46.097 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.095+0000 7f62024b6640 1 --2- 172.21.15.1:0/3971871960 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f61fc1025c0 0x7f61fc102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:46.097 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.095+0000 7f62024b6640 1 -- 172.21.15.1:0/3971871960 >> 172.21.15.1:0/3971871960 conn(0x7f61fc0fdf00 msgr2=0x7f61fc1003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:46.097 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.095+0000 7f62024b6640 1 -- 172.21.15.1:0/3971871960 shutdown_connections 2024-09-21T00:58:46.097 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.095+0000 7f62024b6640 1 -- 172.21.15.1:0/3971871960 wait complete. 2024-09-21T00:58:46.097 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.096+0000 7f62024b6640 1 Processor -- start 2024-09-21T00:58:46.097 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.096+0000 7f62024b6640 1 -- start start 2024-09-21T00:58:46.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.096+0000 7f62024b6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f61fc1025c0 0x7f61fc06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:46.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.096+0000 7f62024b6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61fc103640 0x7f61fc19ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:46.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.096+0000 7f62024b6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f61fc103fe0 0x7f61fc1a1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:46.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.096+0000 7f62024b6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc10e210 con 0x7f61fc103640 2024-09-21T00:58:46.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.096+0000 7f62024b6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc10e090 con 0x7f61fc103fe0 2024-09-21T00:58:46.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.096+0000 7f62024b6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc10e390 con 0x7f61fc1025c0 2024-09-21T00:58:46.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.097+0000 7f61fb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61fc103640 0x7f61fc19ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:46.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.097+0000 7f61fb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61fc103640 0x7f61fc19ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49844/0 (socket says 172.21.15.1:49844) 2024-09-21T00:58:46.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.097+0000 7f61fb7fe640 1 -- 172.21.15.1:0/195101126 learned_addr learned my addr 172.21.15.1:0/195101126 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:46.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.097+0000 7f6200a53640 1 --2- 172.21.15.1:0/195101126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f61fc103fe0 0x7f61fc1a1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:46.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.097+0000 7f61fbfff640 1 --2- 172.21.15.1:0/195101126 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f61fc1025c0 0x7f61fc06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:46.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.097+0000 7f61fb7fe640 1 -- 172.21.15.1:0/195101126 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f61fc1025c0 msgr2=0x7f61fc06b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:46.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.097+0000 7f61fb7fe640 1 --2- 172.21.15.1:0/195101126 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f61fc1025c0 0x7f61fc06b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:46.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.097+0000 7f61fb7fe640 1 -- 172.21.15.1:0/195101126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f61fc103fe0 msgr2=0x7f61fc1a1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:46.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.097+0000 7f61fb7fe640 1 --2- 172.21.15.1:0/195101126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f61fc103fe0 0x7f61fc1a1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:46.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.097+0000 7f61fb7fe640 1 -- 172.21.15.1:0/195101126 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61fc1a1990 con 0x7f61fc103640 2024-09-21T00:58:46.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.097+0000 7f61fb7fe640 1 --2- 172.21.15.1:0/195101126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61fc103640 0x7f61fc19ec20 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f61f000e9f0 tx=0x7f61f000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:46.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.097+0000 7f61f97fa640 1 -- 172.21.15.1:0/195101126 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f000cd80 con 0x7f61fc103640 2024-09-21T00:58:46.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.097+0000 7f62024b6640 1 -- 172.21.15.1:0/195101126 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61fc1a1c80 con 0x7f61fc103640 2024-09-21T00:58:46.101 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.097+0000 7f61f97fa640 1 -- 172.21.15.1:0/195101126 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61f00054d0 con 0x7f61fc103640 2024-09-21T00:58:46.101 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.097+0000 7f62024b6640 1 -- 172.21.15.1:0/195101126 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61fc1a21d0 con 0x7f61fc103640 2024-09-21T00:58:46.101 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.097+0000 7f61f97fa640 1 -- 172.21.15.1:0/195101126 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f0010690 con 0x7f61fc103640 2024-09-21T00:58:46.103 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.100+0000 7f620941e740 1 Processor -- start 2024-09-21T00:58:46.103 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.100+0000 7f620941e740 1 -- start start 2024-09-21T00:58:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.100+0000 7f61f97fa640 1 -- 172.21.15.1:0/195101126 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f61f0004e90 con 0x7f61fc103640 2024-09-21T00:58:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.100+0000 7f620941e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e4c191b0 0x5625e4fc5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.100+0000 7f620941e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625e4bf02f0 0x5625e4fc58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.100+0000 7f620941e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5625e4bf84d0 0x5625e4fc6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.100+0000 7f620941e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5625e4f336f0 con 0x5625e4bf02f0 2024-09-21T00:58:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.100+0000 7f620941e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5625e4f22b20 con 0x5625e4bf84d0 2024-09-21T00:58:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.100+0000 7f620941e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5625e4f26930 con 0x5625e4c191b0 2024-09-21T00:58:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.101+0000 7f61fbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625e4bf02f0 0x5625e4fc58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.101+0000 7f61fb7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5625e4bf84d0 0x5625e4fc6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.101+0000 7f61fbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625e4bf02f0 0x5625e4fc58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49858/0 (socket says 172.21.15.1:49858) 2024-09-21T00:58:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.101+0000 7f61fb7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5625e4bf84d0 0x5625e4fc6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:46648/0 (socket says 172.21.15.1:46648) 2024-09-21T00:58:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.101+0000 7f61fbfff640 1 -- 172.21.15.1:0/2588967690 learned_addr learned my addr 172.21.15.1:0/2588967690 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.101+0000 7f6200a53640 1 --2- 172.21.15.1:0/2588967690 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e4c191b0 0x5625e4fc5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.101+0000 7f61fbfff640 1 -- 172.21.15.1:0/2588967690 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e4c191b0 msgr2=0x5625e4fc5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.101+0000 7f61fbfff640 1 --2- 172.21.15.1:0/2588967690 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e4c191b0 0x5625e4fc5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.101+0000 7f61fbfff640 1 -- 172.21.15.1:0/2588967690 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5625e4bf84d0 msgr2=0x5625e4fc6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.101+0000 7f61fbfff640 1 --2- 172.21.15.1:0/2588967690 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5625e4bf84d0 0x5625e4fc6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.101+0000 7f61fbfff640 1 -- 172.21.15.1:0/2588967690 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625e4ee8530 con 0x5625e4bf02f0 2024-09-21T00:58:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.101+0000 7f61fb7fe640 1 --2- 172.21.15.1:0/2588967690 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5625e4bf84d0 0x5625e4fc6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.101+0000 7f61fbfff640 1 --2- 172.21.15.1:0/2588967690 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625e4bf02f0 0x5625e4fc58d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f61ec009cf0 tx=0x7f61ec011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad343019c5f3800 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.101+0000 7f61e27fc640 1 -- 172.21.15.1:0/2588967690 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ec004230 con 0x5625e4bf02f0 2024-09-21T00:58:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.101+0000 7f61f97fa640 1 --2- 172.21.15.1:0/195101126 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f61e40b6510 0x7f61e40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.102+0000 7f61e27fc640 1 -- 172.21.15.1:0/2588967690 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61ec0043d0 con 0x5625e4bf02f0 2024-09-21T00:58:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.102+0000 7f61e27fc640 1 -- 172.21.15.1:0/2588967690 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ec019880 con 0x5625e4bf02f0 2024-09-21T00:58:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.102+0000 7f6200a53640 1 --2- 172.21.15.1:0/195101126 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f61e40b6510 0x7f61e40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.102+0000 7f61f97fa640 1 -- 172.21.15.1:0/195101126 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f61f00e76f0 con 0x7f61fc103640 2024-09-21T00:58:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.102+0000 7f620941e740 1 -- 172.21.15.1:0/2588967690 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625e4bf02f0 msgr2=0x5625e4fc58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.102+0000 7f6200a53640 1 --2- 172.21.15.1:0/195101126 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f61e40b6510 0x7f61e40b8a20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f61f4004af0 tx=0x7f61f4009380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:46.106 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.102+0000 7f620941e740 1 --2- 172.21.15.1:0/2588967690 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625e4bf02f0 0x5625e4fc58d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f61ec009cf0 tx=0x7f61ec011810 comp rx=0 tx=0).stop 2024-09-21T00:58:46.106 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.102+0000 7f620941e740 1 -- 172.21.15.1:0/2588967690 shutdown_connections 2024-09-21T00:58:46.106 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.102+0000 7f620941e740 1 --2- 172.21.15.1:0/2588967690 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5625e4bf84d0 0x5625e4fc6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:46.106 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.102+0000 7f620941e740 1 --2- 172.21.15.1:0/2588967690 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625e4bf02f0 0x5625e4fc58d0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:46.106 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.102+0000 7f620941e740 1 --2- 172.21.15.1:0/2588967690 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e4c191b0 0x5625e4fc5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:46.106 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.102+0000 7f620941e740 1 -- 172.21.15.1:0/2588967690 >> 172.21.15.1:0/2588967690 conn(0x5625e4c0d300 msgr2=0x5625e4fbc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:46.106 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.102+0000 7f620941e740 1 -- 172.21.15.1:0/2588967690 shutdown_connections 2024-09-21T00:58:46.106 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.103+0000 7f620941e740 1 -- 172.21.15.1:0/2588967690 wait complete. 2024-09-21T00:58:46.106 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.103+0000 7f620941e740 1 -- start start 2024-09-21T00:58:46.106 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.103+0000 7f620941e740 1 Processor -- start 2024-09-21T00:58:46.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.103+0000 7f620941e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5625e4bf02f0 0x5625e4fce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:46.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.103+0000 7f620941e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625e4bf84d0 0x5625e4fcf060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.103+0000 7f620941e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e4c191b0 0x5625e4fcfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.103+0000 7f620941e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5625e4e5aab0 con 0x5625e4bf84d0 2024-09-21T00:58:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.103+0000 7f620941e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5625e4ec8730 con 0x5625e4bf02f0 2024-09-21T00:58:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.103+0000 7f620941e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5625e4fc6f40 con 0x5625e4c191b0 2024-09-21T00:58:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.103+0000 7f620941e740 10 client.0 _ll_register_callbacks cb 0x5625e4f1c6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.104+0000 7f61fb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625e4bf84d0 0x5625e4fcf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.104+0000 7f61fbfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5625e4bf02f0 0x5625e4fce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.104+0000 7f61fb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625e4bf84d0 0x5625e4fcf060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49864/0 (socket says 172.21.15.1:49864) 2024-09-21T00:58:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.104+0000 7f61fb7fe640 1 -- 172.21.15.1:0/2621865099 learned_addr learned my addr 172.21.15.1:0/2621865099 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.104+0000 7f6200a53640 1 --2- 172.21.15.1:0/2621865099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e4c191b0 0x5625e4fcfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.104+0000 7f61fbfff640 1 -- 172.21.15.1:0/2621865099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e4c191b0 msgr2=0x5625e4fcfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.104+0000 7f61fbfff640 1 --2- 172.21.15.1:0/2621865099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e4c191b0 0x5625e4fcfbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.104+0000 7f61fbfff640 1 -- 172.21.15.1:0/2621865099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625e4bf84d0 msgr2=0x5625e4fcf060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:46.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.104+0000 7f61fbfff640 1 --2- 172.21.15.1:0/2621865099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625e4bf84d0 0x5625e4fcf060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:46.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.104+0000 7f61fbfff640 1 -- 172.21.15.1:0/2621865099 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625e4c84790 con 0x5625e4bf02f0 2024-09-21T00:58:46.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.104+0000 7f61fb7fe640 1 --2- 172.21.15.1:0/2621865099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625e4bf84d0 0x5625e4fcf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:46.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.104+0000 7f6200a53640 1 --2- 172.21.15.1:0/2621865099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e4c191b0 0x5625e4fcfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:58:46.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.104+0000 7f61fbfff640 1 --2- 172.21.15.1:0/2621865099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5625e4bf02f0 0x5625e4fce9a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f61ec01a000 tx=0x7f61ec003820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ff40782bc63ae4d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:46.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.104+0000 7f61db7fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T00:58:46.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.104+0000 7f61db7fe640 1 -- 172.21.15.1:0/2621865099 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ec027070 con 0x5625e4bf02f0 2024-09-21T00:58:46.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.104+0000 7f61db7fe640 1 -- 172.21.15.1:0/2621865099 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f61ec005240 con 0x5625e4bf02f0 2024-09-21T00:58:46.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.104+0000 7f620941e740 1 -- 172.21.15.1:0/2621865099 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61ec0043d0 con 0x5625e4bf02f0 2024-09-21T00:58:46.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.105+0000 7f61db7fe640 1 -- 172.21.15.1:0/2621865099 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f61ec033050 con 0x5625e4bf02f0 2024-09-21T00:58:46.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.105+0000 7f620941e740 10 client.25691 fetch_fsmap learned FSMap version 31 2024-09-21T00:58:46.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.105+0000 7f620941e740 1 -- 172.21.15.1:0/2621865099 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5625e4cfd620 con 0x5625e4bf02f0 2024-09-21T00:58:46.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.105+0000 7f61db7fe640 1 -- 172.21.15.1:0/2621865099 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61ec0043d0 con 0x5625e4bf02f0 2024-09-21T00:58:46.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.105+0000 7f61db7fe640 1 -- 172.21.15.1:0/2621865099 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7f61ec004b70 con 0x5625e4bf02f0 2024-09-21T00:58:46.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.105+0000 7f620941e740 10 client.25691 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:58:46.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.105+0000 7f620941e740 10 client.25691 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:58:46.112 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.105+0000 7f620941e740 20 client.25691 populate_metadata read hostname 'smithi001' 2024-09-21T00:58:46.112 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.105+0000 7f620941e740 1 --2- 172.21.15.1:0/2621865099 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5625e4bd7d80 0x5625e4fdc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:46.112 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.105+0000 7f620941e740 4 client.25691 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:58:46.112 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.105+0000 7f620941e740 1 -- 172.21.15.1:0/2621865099 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5625e4f35640 con 0x5625e4bd7d80 2024-09-21T00:58:46.112 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.105+0000 7f61fb7fe640 1 --2- 172.21.15.1:0/2621865099 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5625e4bd7d80 0x5625e4fdc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:46.112 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.106+0000 7f61fb7fe640 1 --2- 172.21.15.1:0/2621865099 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5625e4bd7d80 0x5625e4fdc110 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=845d3ac9f80bf80 server_cookie=7a93774be4ae25f2 in_seq=0 out_seq=0 2024-09-21T00:58:46.112 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.106+0000 7f61db7fe640 10 client.25691 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:46.112 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.106+0000 7f61db7fe640 1 -- 172.21.15.1:0/2621865099 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5625e4f35640 con 0x5625e4bd7d80 2024-09-21T00:58:46.112 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.106+0000 7f61db7fe640 10 client.25691 handle_command_reply: tid=0 2024-09-21T00:58:46.112 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.107+0000 7f620941e740 1 client.25691 shutdown 2024-09-21T00:58:46.112 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.107+0000 7f620941e740 1 -- 172.21.15.1:0/2621865099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5625e4bf02f0 msgr2=0x5625e4fce9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:46.112 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.107+0000 7f620941e740 1 --2- 172.21.15.1:0/2621865099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5625e4bf02f0 0x5625e4fce9a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f61ec01a000 tx=0x7f61ec003820 comp rx=0 tx=0).stop 2024-09-21T00:58:46.113 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.107+0000 7f620941e740 1 -- 172.21.15.1:0/2621865099 shutdown_connections 2024-09-21T00:58:46.113 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.107+0000 7f620941e740 1 --2- 172.21.15.1:0/2621865099 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5625e4bd7d80 0x5625e4fdc110 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:46.113 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.107+0000 7f620941e740 1 --2- 172.21.15.1:0/2621865099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e4c191b0 0x5625e4fcfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:46.113 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.107+0000 7f620941e740 1 --2- 172.21.15.1:0/2621865099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625e4bf84d0 0x5625e4fcf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:46.113 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.107+0000 7f61db7fe640 0 client.25691 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:46.113 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.107+0000 7f620941e740 1 --2- 172.21.15.1:0/2621865099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5625e4bf02f0 0x5625e4fce9a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:46.113 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.107+0000 7f620941e740 1 -- 172.21.15.1:0/2621865099 >> 172.21.15.1:0/2621865099 conn(0x5625e4c0d300 msgr2=0x5625e4fbaea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:46.113 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.107+0000 7f620941e740 1 -- 172.21.15.1:0/2621865099 shutdown_connections 2024-09-21T00:58:46.113 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.107+0000 7f620941e740 1 -- 172.21.15.1:0/2621865099 wait complete. 2024-09-21T00:58:46.113 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.107+0000 7f620941e740 20 client.25691 trim_cache size 0 max 16384 2024-09-21T00:58:46.124 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.123+0000 7f620941e740 1 Processor -- start 2024-09-21T00:58:46.124 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.123+0000 7f620941e740 1 -- start start 2024-09-21T00:58:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.123+0000 7f620941e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e4bf02f0 0x5625e4fd0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.123+0000 7f620941e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625e4bf84d0 0x5625e4fd6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.123+0000 7f620941e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5625e4c191b0 0x5625e4fc5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.123+0000 7f620941e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc1a8d00 con 0x5625e4bf84d0 2024-09-21T00:58:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.123+0000 7f620941e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc1aa9c0 con 0x5625e4c191b0 2024-09-21T00:58:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.123+0000 7f620941e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc1a93d0 con 0x5625e4bf02f0 2024-09-21T00:58:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.123+0000 7f61fb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625e4bf84d0 0x5625e4fd6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.123+0000 7f61fb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625e4bf84d0 0x5625e4fd6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49872/0 (socket says 172.21.15.1:49872) 2024-09-21T00:58:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.123+0000 7f61fb7fe640 1 -- 172.21.15.1:0/1176236624 learned_addr learned my addr 172.21.15.1:0/1176236624 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.123+0000 7f61fbfff640 1 --2- 172.21.15.1:0/1176236624 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e4bf02f0 0x5625e4fd0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.123+0000 7f6200a53640 1 --2- 172.21.15.1:0/1176236624 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5625e4c191b0 0x5625e4fc5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.124+0000 7f61fb7fe640 1 -- 172.21.15.1:0/1176236624 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e4bf02f0 msgr2=0x5625e4fd0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.124+0000 7f61fb7fe640 1 --2- 172.21.15.1:0/1176236624 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e4bf02f0 0x5625e4fd0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.124+0000 7f61fb7fe640 1 -- 172.21.15.1:0/1176236624 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5625e4c191b0 msgr2=0x5625e4fc5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.124+0000 7f61fb7fe640 1 --2- 172.21.15.1:0/1176236624 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5625e4c191b0 0x5625e4fc5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.124+0000 7f61fb7fe640 1 -- 172.21.15.1:0/1176236624 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625e4fd9e10 con 0x5625e4bf84d0 2024-09-21T00:58:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.124+0000 7f6200a53640 1 --2- 172.21.15.1:0/1176236624 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5625e4c191b0 0x5625e4fc5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:58:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.124+0000 7f61fb7fe640 1 --2- 172.21.15.1:0/1176236624 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625e4bf84d0 0x5625e4fd6ab0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f61f000c6a0 tx=0x7f61f00ed550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ac68db0b80c03f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.124+0000 7f61e1ffb640 1 -- 172.21.15.1:0/1176236624 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f00ad630 con 0x5625e4bf84d0 2024-09-21T00:58:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.124+0000 7f61e1ffb640 1 -- 172.21.15.1:0/1176236624 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61f00b2120 con 0x5625e4bf84d0 2024-09-21T00:58:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.124+0000 7f61e1ffb640 1 -- 172.21.15.1:0/1176236624 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f0005180 con 0x5625e4bf84d0 2024-09-21T00:58:46.129 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.125+0000 7f620941e740 1 -- 172.21.15.1:0/1176236624 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625e4bf84d0 msgr2=0x5625e4fd6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:46.129 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.125+0000 7f620941e740 1 --2- 172.21.15.1:0/1176236624 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625e4bf84d0 0x5625e4fd6ab0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f61f000c6a0 tx=0x7f61f00ed550 comp rx=0 tx=0).stop 2024-09-21T00:58:46.129 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.125+0000 7f620941e740 1 -- 172.21.15.1:0/1176236624 shutdown_connections 2024-09-21T00:58:46.129 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.125+0000 7f620941e740 1 --2- 172.21.15.1:0/1176236624 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5625e4c191b0 0x5625e4fc5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:46.129 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.125+0000 7f620941e740 1 --2- 172.21.15.1:0/1176236624 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625e4bf84d0 0x5625e4fd6ab0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.125+0000 7f620941e740 1 --2- 172.21.15.1:0/1176236624 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e4bf02f0 0x5625e4fd0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.125+0000 7f620941e740 1 -- 172.21.15.1:0/1176236624 >> 172.21.15.1:0/1176236624 conn(0x5625e4c0d300 msgr2=0x5625e4fcdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.125+0000 7f620941e740 1 -- 172.21.15.1:0/1176236624 shutdown_connections 2024-09-21T00:58:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.125+0000 7f620941e740 1 -- 172.21.15.1:0/1176236624 wait complete. 2024-09-21T00:58:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.125+0000 7f620941e740 1 -- start start 2024-09-21T00:58:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.125+0000 7f620941e740 1 Processor -- start 2024-09-21T00:58:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.126+0000 7f620941e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5625e4bf02f0 0x5625e4fd6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.126+0000 7f620941e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e4bf84d0 0x5625e4fd5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.126+0000 7f620941e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625e4c191b0 0x5625e4fd5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.126+0000 7f620941e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc1aa230 con 0x5625e4c191b0 2024-09-21T00:58:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.126+0000 7f620941e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc1a9b60 con 0x5625e4bf02f0 2024-09-21T00:58:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.126+0000 7f620941e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc1a6ce0 con 0x5625e4bf84d0 2024-09-21T00:58:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.126+0000 7f620941e740 10 client.0 _ll_register_callbacks cb 0x7f61f00ed420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.126+0000 7f61fbfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5625e4bf02f0 0x5625e4fd6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:46.131 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.126+0000 7f6200a53640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625e4c191b0 0x5625e4fd5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:46.131 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.126+0000 7f61fbfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5625e4bf02f0 0x5625e4fd6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:46680/0 (socket says 172.21.15.1:46680) 2024-09-21T00:58:46.131 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.126+0000 7f61fbfff640 1 -- 172.21.15.1:0/976396936 learned_addr learned my addr 172.21.15.1:0/976396936 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:46.131 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.126+0000 7f6200a53640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625e4c191b0 0x5625e4fd5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49886/0 (socket says 172.21.15.1:49886) 2024-09-21T00:58:46.131 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.126+0000 7f61fb7fe640 1 --2- 172.21.15.1:0/976396936 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e4bf84d0 0x5625e4fd5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:46.131 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.126+0000 7f61fb7fe640 1 -- 172.21.15.1:0/976396936 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5625e4bf02f0 msgr2=0x5625e4fd6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:46.131 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.126+0000 7f61fb7fe640 1 --2- 172.21.15.1:0/976396936 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5625e4bf02f0 0x5625e4fd6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:46.131 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.126+0000 7f61fb7fe640 1 -- 172.21.15.1:0/976396936 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625e4c191b0 msgr2=0x5625e4fd5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:46.131 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.126+0000 7f61fb7fe640 1 --2- 172.21.15.1:0/976396936 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625e4c191b0 0x5625e4fd5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:46.131 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.126+0000 7f61fb7fe640 1 -- 172.21.15.1:0/976396936 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625e4fd6120 con 0x5625e4bf84d0 2024-09-21T00:58:46.131 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.126+0000 7f61fb7fe640 1 --2- 172.21.15.1:0/976396936 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e4bf84d0 0x5625e4fd5430 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f61f00a9e30 tx=0x7f61f0005710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2e3dd1b70061333 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:46.131 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.126+0000 7f61db7fe640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T00:58:46.131 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.127+0000 7f61db7fe640 1 -- 172.21.15.1:0/976396936 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f00acfd0 con 0x5625e4bf84d0 2024-09-21T00:58:46.131 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.127+0000 7f61db7fe640 1 -- 172.21.15.1:0/976396936 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f61f00e7ba0 con 0x5625e4bf84d0 2024-09-21T00:58:46.132 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.127+0000 7f620941e740 1 -- 172.21.15.1:0/976396936 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5625e4f310f0 con 0x5625e4bf84d0 2024-09-21T00:58:46.132 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.127+0000 7f61db7fe640 1 -- 172.21.15.1:0/976396936 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f61f00ad1b0 con 0x5625e4bf84d0 2024-09-21T00:58:46.132 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.127+0000 7f620941e740 10 client.25624 fetch_fsmap learned FSMap version 31 2024-09-21T00:58:46.132 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.127+0000 7f620941e740 1 -- 172.21.15.1:0/976396936 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5625e5046ad0 con 0x5625e4bf84d0 2024-09-21T00:58:46.132 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.127+0000 7f61db7fe640 1 -- 172.21.15.1:0/976396936 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5625e4f310f0 con 0x5625e4bf84d0 2024-09-21T00:58:46.132 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.127+0000 7f61db7fe640 1 -- 172.21.15.1:0/976396936 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7f61f00eace0 con 0x5625e4bf84d0 2024-09-21T00:58:46.132 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.127+0000 7f620941e740 10 client.25624 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:58:46.132 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.127+0000 7f620941e740 10 client.25624 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:58:46.132 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.127+0000 7f620941e740 20 client.25624 populate_metadata read hostname 'smithi001' 2024-09-21T00:58:46.132 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.127+0000 7f620941e740 1 --2- 172.21.15.1:0/976396936 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5625e4bad1c0 0x5625e5049430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:46.132 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.127+0000 7f620941e740 4 client.25624 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T00:58:46.132 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.127+0000 7f620941e740 1 -- 172.21.15.1:0/976396936 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5625e4f2e520 con 0x5625e4bad1c0 2024-09-21T00:58:46.133 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.128+0000 7f61fbfff640 1 --2- 172.21.15.1:0/976396936 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5625e4bad1c0 0x5625e5049430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:46.133 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.128+0000 7f61db7fe640 10 client.25624 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:46.133 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.128+0000 7f61fbfff640 1 --2- 172.21.15.1:0/976396936 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5625e4bad1c0 0x5625e5049430 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b78b0a73b48d2afe server_cookie=10e4dd5fff7070bb in_seq=0 out_seq=0 2024-09-21T00:58:46.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:45 smithi001 ceph-mon[31211]: pgmap v404: 97 pgs: 97 active+clean; 65 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 2.9 MiB/s wr, 394 op/s 2024-09-21T00:58:46.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:45 smithi193 ceph-mon[34660]: pgmap v404: 97 pgs: 97 active+clean; 65 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 2.9 MiB/s wr, 394 op/s 2024-09-21T00:58:46.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:45 smithi042 ceph-mon[34481]: pgmap v404: 97 pgs: 97 active+clean; 65 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 2.9 MiB/s wr, 394 op/s 2024-09-21T00:58:46.903 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.901+0000 7f61db7fe640 1 -- 172.21.15.1:0/976396936 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5625e4f2e520 con 0x5625e4bad1c0 2024-09-21T00:58:46.903 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.901+0000 7f61db7fe640 10 client.25624 handle_command_reply: tid=0 2024-09-21T00:58:46.903 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.901+0000 7f620941e740 1 client.25624 shutdown 2024-09-21T00:58:46.903 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.901+0000 7f620941e740 1 -- 172.21.15.1:0/976396936 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e4bf84d0 msgr2=0x5625e4fd5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:46.903 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.901+0000 7f620941e740 1 --2- 172.21.15.1:0/976396936 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e4bf84d0 0x5625e4fd5430 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f61f00a9e30 tx=0x7f61f0005710 comp rx=0 tx=0).stop 2024-09-21T00:58:46.903 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.902+0000 7f620941e740 1 -- 172.21.15.1:0/976396936 shutdown_connections 2024-09-21T00:58:46.903 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.902+0000 7f620941e740 1 --2- 172.21.15.1:0/976396936 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5625e4bad1c0 0x5625e5049430 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:46.903 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.902+0000 7f620941e740 1 --2- 172.21.15.1:0/976396936 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625e4c191b0 0x5625e4fd5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:46.903 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.902+0000 7f620941e740 1 --2- 172.21.15.1:0/976396936 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e4bf84d0 0x5625e4fd5430 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:46.903 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.902+0000 7f61db7fe640 0 client.25624 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:46.904 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.902+0000 7f620941e740 1 --2- 172.21.15.1:0/976396936 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5625e4bf02f0 0x5625e4fd6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:46.904 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.902+0000 7f620941e740 1 -- 172.21.15.1:0/976396936 >> 172.21.15.1:0/976396936 conn(0x5625e4c0d300 msgr2=0x5625e4fbdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:46.904 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.902+0000 7f620941e740 1 -- 172.21.15.1:0/976396936 shutdown_connections 2024-09-21T00:58:46.904 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.902+0000 7f620941e740 1 -- 172.21.15.1:0/976396936 wait complete. 2024-09-21T00:58:46.904 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.902+0000 7f620941e740 20 client.25624 trim_cache size 0 max 16384 2024-09-21T00:58:46.904 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T00:58:46.904 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T00:58:46.904 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T00:58:46.904 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T00:58:46.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.903+0000 7f62024b6640 1 -- 172.21.15.1:0/195101126 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f61e40b6510 msgr2=0x7f61e40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:46.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.903+0000 7f62024b6640 1 --2- 172.21.15.1:0/195101126 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f61e40b6510 0x7f61e40b8a20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f61f4004af0 tx=0x7f61f4009380 comp rx=0 tx=0).stop 2024-09-21T00:58:46.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.903+0000 7f62024b6640 1 -- 172.21.15.1:0/195101126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61fc103640 msgr2=0x7f61fc19ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:46.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.903+0000 7f62024b6640 1 --2- 172.21.15.1:0/195101126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61fc103640 0x7f61fc19ec20 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f61f000e9f0 tx=0x7f61f000edf0 comp rx=0 tx=0).stop 2024-09-21T00:58:46.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.903+0000 7f62024b6640 1 -- 172.21.15.1:0/195101126 shutdown_connections 2024-09-21T00:58:46.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.903+0000 7f62024b6640 1 --2- 172.21.15.1:0/195101126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f61fc103fe0 0x7f61fc1a1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:46.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.903+0000 7f62024b6640 1 --2- 172.21.15.1:0/195101126 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f61e40b6510 0x7f61e40b8a20 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:46.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.903+0000 7f62024b6640 1 --2- 172.21.15.1:0/195101126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61fc103640 0x7f61fc19ec20 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:46.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.903+0000 7f62024b6640 1 --2- 172.21.15.1:0/195101126 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f61fc1025c0 0x7f61fc06b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:46.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.903+0000 7f62024b6640 1 -- 172.21.15.1:0/195101126 >> 172.21.15.1:0/195101126 conn(0x7f61fc0fdf00 msgr2=0x7f61fc106940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:46.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.903+0000 7f62024b6640 1 -- 172.21.15.1:0/195101126 shutdown_connections 2024-09-21T00:58:46.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:58:46.903+0000 7f62024b6640 1 -- 172.21.15.1:0/195101126 wait complete. 2024-09-21T00:58:48.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:47 smithi001 ceph-mon[31211]: pgmap v405: 97 pgs: 97 active+clean; 67 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 1.7 MiB/s wr, 408 op/s 2024-09-21T00:58:48.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:47 smithi193 ceph-mon[34660]: pgmap v405: 97 pgs: 97 active+clean; 67 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 1.7 MiB/s wr, 408 op/s 2024-09-21T00:58:48.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:47 smithi042 ceph-mon[34481]: pgmap v405: 97 pgs: 97 active+clean; 67 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 1.7 MiB/s wr, 408 op/s 2024-09-21T00:58:50.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:49 smithi001 ceph-mon[31211]: pgmap v406: 97 pgs: 97 active+clean; 75 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 2.4 MiB/s wr, 479 op/s 2024-09-21T00:58:50.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:49 smithi193 ceph-mon[34660]: pgmap v406: 97 pgs: 97 active+clean; 75 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 2.4 MiB/s wr, 479 op/s 2024-09-21T00:58:50.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:49 smithi042 ceph-mon[34481]: pgmap v406: 97 pgs: 97 active+clean; 75 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 2.4 MiB/s wr, 479 op/s 2024-09-21T00:58:50.468 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T00:58:50.856 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:58:51.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.420+0000 7fcaddfd3640 1 -- 172.21.15.1:0/1831762212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcad8106c10 msgr2=0x7fcad81106a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:51.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.420+0000 7fcaddfd3640 1 --2- 172.21.15.1:0/1831762212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcad8106c10 0x7fcad81106a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fcad0009ca0 tx=0x7fcad002a8c0 comp rx=0 tx=0).stop 2024-09-21T00:58:51.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.420+0000 7fcaddfd3640 1 -- 172.21.15.1:0/1831762212 shutdown_connections 2024-09-21T00:58:51.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.420+0000 7fcaddfd3640 1 --2- 172.21.15.1:0/1831762212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcad8106c10 0x7fcad81106a0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:51.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.420+0000 7fcaddfd3640 1 --2- 172.21.15.1:0/1831762212 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcad81062c0 0x7fcad81066d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:51.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.420+0000 7fcaddfd3640 1 --2- 172.21.15.1:0/1831762212 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcad8102070 0x7fcad8102480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:51.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.420+0000 7fcaddfd3640 1 -- 172.21.15.1:0/1831762212 >> 172.21.15.1:0/1831762212 conn(0x7fcad8079e10 msgr2=0x7fcad807a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:51.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.420+0000 7fcaddfd3640 1 -- 172.21.15.1:0/1831762212 shutdown_connections 2024-09-21T00:58:51.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.420+0000 7fcaddfd3640 1 -- 172.21.15.1:0/1831762212 wait complete. 2024-09-21T00:58:51.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.421+0000 7fcaddfd3640 1 Processor -- start 2024-09-21T00:58:51.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.421+0000 7fcaddfd3640 1 -- start start 2024-09-21T00:58:51.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.422+0000 7fcaddfd3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcad8102070 0x7fcad8103010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:51.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.422+0000 7fcaddfd3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcad81062c0 0x7fcad8103550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:51.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.422+0000 7fcad77fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcad8102070 0x7fcad8103010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:51.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.422+0000 7fcaddfd3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcad8106c10 0x7fcad8103a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:51.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.422+0000 7fcad77fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcad8102070 0x7fcad8103010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:52802/0 (socket says 172.21.15.1:52802) 2024-09-21T00:58:51.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.422+0000 7fcaddfd3640 1 -- 172.21.15.1:0/249388985 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcad8113b00 con 0x7fcad81062c0 2024-09-21T00:58:51.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.422+0000 7fcad77fe640 1 -- 172.21.15.1:0/249388985 learned_addr learned my addr 172.21.15.1:0/249388985 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:51.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.422+0000 7fcaddfd3640 1 -- 172.21.15.1:0/249388985 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcad8113980 con 0x7fcad8102070 2024-09-21T00:58:51.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.422+0000 7fcaddfd3640 1 -- 172.21.15.1:0/249388985 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcad8113c80 con 0x7fcad8106c10 2024-09-21T00:58:51.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.422+0000 7fcad6ffd640 1 --2- 172.21.15.1:0/249388985 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcad81062c0 0x7fcad8103550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:51.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.422+0000 7fcad7fff640 1 --2- 172.21.15.1:0/249388985 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcad8106c10 0x7fcad8103a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:51.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.422+0000 7fcad77fe640 1 -- 172.21.15.1:0/249388985 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcad8106c10 msgr2=0x7fcad8103a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:51.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.423+0000 7fcad77fe640 1 --2- 172.21.15.1:0/249388985 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcad8106c10 0x7fcad8103a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:51.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.423+0000 7fcad77fe640 1 -- 172.21.15.1:0/249388985 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcad81062c0 msgr2=0x7fcad8103550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:51.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.423+0000 7fcad77fe640 1 --2- 172.21.15.1:0/249388985 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcad81062c0 0x7fcad8103550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:51.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.423+0000 7fcad77fe640 1 -- 172.21.15.1:0/249388985 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcad81a8770 con 0x7fcad8102070 2024-09-21T00:58:51.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.423+0000 7fcad77fe640 1 --2- 172.21.15.1:0/249388985 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcad8102070 0x7fcad8103010 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcac800e9c0 tx=0x7fcac800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:51.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.423+0000 7fcad4ff9640 1 -- 172.21.15.1:0/249388985 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac800cd80 con 0x7fcad8102070 2024-09-21T00:58:51.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.423+0000 7fcad4ff9640 1 -- 172.21.15.1:0/249388985 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcac80035f0 con 0x7fcad8102070 2024-09-21T00:58:51.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.423+0000 7fcaddfd3640 1 -- 172.21.15.1:0/249388985 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcad81a8a60 con 0x7fcad8102070 2024-09-21T00:58:51.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.423+0000 7fcad4ff9640 1 -- 172.21.15.1:0/249388985 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac8010690 con 0x7fcad8102070 2024-09-21T00:58:51.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.423+0000 7fcaddfd3640 1 -- 172.21.15.1:0/249388985 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcad81a8f50 con 0x7fcad8102070 2024-09-21T00:58:51.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.426+0000 7fcae4547740 1 Processor -- start 2024-09-21T00:58:51.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.426+0000 7fcae4547740 1 -- start start 2024-09-21T00:58:51.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.427+0000 7fcae4547740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560282c85070 0x56028302c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:51.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.427+0000 7fcae4547740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560282c5c1b0 0x56028302cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:51.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.427+0000 7fcae4547740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560282c64390 0x56028302d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:51.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.427+0000 7fcae4547740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560282fa2e50 con 0x560282c5c1b0 2024-09-21T00:58:51.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.427+0000 7fcae4547740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560282f92280 con 0x560282c85070 2024-09-21T00:58:51.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.427+0000 7fcae4547740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560282f96090 con 0x560282c64390 2024-09-21T00:58:51.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.427+0000 7fcad7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560282c85070 0x56028302c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:51.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.427+0000 7fcad7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560282c85070 0x56028302c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:52818/0 (socket says 172.21.15.1:52818) 2024-09-21T00:58:51.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.427+0000 7fcad7fff640 1 -- 172.21.15.1:0/2497107605 learned_addr learned my addr 172.21.15.1:0/2497107605 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:51.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.427+0000 7fcad6ffd640 1 --2- 172.21.15.1:0/2497107605 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560282c64390 0x56028302d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:51.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.427+0000 7fcad4ff9640 1 -- 172.21.15.1:0/249388985 <== mon.2 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7fcac8010830 con 0x7fcad8102070 2024-09-21T00:58:51.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.427+0000 7fcad7fff640 1 -- 172.21.15.1:0/2497107605 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560282c64390 msgr2=0x56028302d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:51.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.427+0000 7fcad7fff640 1 --2- 172.21.15.1:0/2497107605 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560282c64390 0x56028302d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:51.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.427+0000 7fcad7fff640 1 -- 172.21.15.1:0/2497107605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560282c5c1b0 msgr2=0x56028302cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:51.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.427+0000 7fcad7fff640 1 --2- 172.21.15.1:0/2497107605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560282c5c1b0 0x56028302cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:51.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.427+0000 7fcad7fff640 1 -- 172.21.15.1:0/2497107605 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560282cf0650 con 0x560282c85070 2024-09-21T00:58:51.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.428+0000 7fcad7fff640 1 --2- 172.21.15.1:0/2497107605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560282c85070 0x56028302c650 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcad0005cc0 tx=0x7fcad002f420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7dc7295345b975e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:51.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.428+0000 7fcabdffb640 1 -- 172.21.15.1:0/2497107605 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad0031ce0 con 0x560282c85070 2024-09-21T00:58:51.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.428+0000 7fcabdffb640 1 -- 172.21.15.1:0/2497107605 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcad0036040 con 0x560282c85070 2024-09-21T00:58:51.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.428+0000 7fcabdffb640 1 -- 172.21.15.1:0/2497107605 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad0004040 con 0x560282c85070 2024-09-21T00:58:51.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.428+0000 7fcad4ff9640 1 --2- 172.21.15.1:0/249388985 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fcac00b6510 0x7fcac00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:51.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.428+0000 7fcad77fe640 1 --2- 172.21.15.1:0/249388985 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fcac00b6510 0x7fcac00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:51.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.428+0000 7fcad4ff9640 1 -- 172.21.15.1:0/249388985 <== mon.2 v2:172.21.15.42:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fcac80e7920 con 0x7fcad8102070 2024-09-21T00:58:51.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.429+0000 7fcae4547740 1 -- 172.21.15.1:0/2497107605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560282c85070 msgr2=0x56028302c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:51.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.429+0000 7fcad77fe640 1 --2- 172.21.15.1:0/249388985 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fcac00b6510 0x7fcac00b8a20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcac800cfd0 tx=0x7fcac8076600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:51.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.429+0000 7fcae4547740 1 --2- 172.21.15.1:0/2497107605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560282c85070 0x56028302c650 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcad0005cc0 tx=0x7fcad002f420 comp rx=0 tx=0).stop 2024-09-21T00:58:51.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.429+0000 7fcae4547740 1 -- 172.21.15.1:0/2497107605 shutdown_connections 2024-09-21T00:58:51.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.429+0000 7fcae4547740 1 --2- 172.21.15.1:0/2497107605 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560282c64390 0x56028302d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:51.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.429+0000 7fcae4547740 1 --2- 172.21.15.1:0/2497107605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560282c5c1b0 0x56028302cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:51.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.429+0000 7fcae4547740 1 --2- 172.21.15.1:0/2497107605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560282c85070 0x56028302c650 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:51.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.429+0000 7fcae4547740 1 -- 172.21.15.1:0/2497107605 >> 172.21.15.1:0/2497107605 conn(0x560282c79460 msgr2=0x56028302a540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:51.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.429+0000 7fcae4547740 1 -- 172.21.15.1:0/2497107605 shutdown_connections 2024-09-21T00:58:51.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.429+0000 7fcae4547740 1 -- 172.21.15.1:0/2497107605 wait complete. 2024-09-21T00:58:51.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.429+0000 7fcae4547740 1 -- start start 2024-09-21T00:58:51.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.430+0000 7fcae4547740 1 Processor -- start 2024-09-21T00:58:51.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.430+0000 7fcae4547740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560282c5c1b0 0x560283037cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:51.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.430+0000 7fcae4547740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560282c64390 0x560283038230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:51.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.430+0000 7fcae4547740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560282c85070 0x560283038770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:51.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.430+0000 7fcae4547740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560282df3700 con 0x560282c85070 2024-09-21T00:58:51.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.430+0000 7fcae4547740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560282f2d110 con 0x560282c5c1b0 2024-09-21T00:58:51.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.430+0000 7fcae4547740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56028303add0 con 0x560282c64390 2024-09-21T00:58:51.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.430+0000 7fcae4547740 10 client.0 _ll_register_callbacks cb 0x560282f46990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:51.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.430+0000 7fcad7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560282c5c1b0 0x560283037cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:51.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.430+0000 7fcad7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560282c85070 0x560283038770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:51.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.430+0000 7fcad7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560282c85070 0x560283038770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33756/0 (socket says 172.21.15.1:33756) 2024-09-21T00:58:51.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.430+0000 7fcad7fff640 1 -- 172.21.15.1:0/2501553879 learned_addr learned my addr 172.21.15.1:0/2501553879 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:51.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.430+0000 7fcad6ffd640 1 --2- 172.21.15.1:0/2501553879 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560282c64390 0x560283038230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:51.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.430+0000 7fcad7fff640 1 -- 172.21.15.1:0/2501553879 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560282c64390 msgr2=0x560283038230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:51.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.430+0000 7fcad7fff640 1 --2- 172.21.15.1:0/2501553879 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560282c64390 0x560283038230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:51.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.430+0000 7fcad7fff640 1 -- 172.21.15.1:0/2501553879 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560282c5c1b0 msgr2=0x560283037cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:51.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.430+0000 7fcad7fff640 1 --2- 172.21.15.1:0/2501553879 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560282c5c1b0 0x560283037cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:51.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.430+0000 7fcad7fff640 1 -- 172.21.15.1:0/2501553879 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560282f5ac40 con 0x560282c85070 2024-09-21T00:58:51.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.431+0000 7fcad7fff640 1 --2- 172.21.15.1:0/2501553879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560282c85070 0x560283038770 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fcad00094e0 tx=0x7fcad002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a26c0d0b3deb19f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:51.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.431+0000 7fcab6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:58:51.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.431+0000 7fcab6ffd640 1 -- 172.21.15.1:0/2501553879 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad004a040 con 0x560282c85070 2024-09-21T00:58:51.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.431+0000 7fcab6ffd640 1 -- 172.21.15.1:0/2501553879 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fcad0031450 con 0x560282c85070 2024-09-21T00:58:51.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.431+0000 7fcae4547740 1 -- 172.21.15.1:0/2501553879 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcad0036040 con 0x560282c85070 2024-09-21T00:58:51.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.431+0000 7fcab6ffd640 1 -- 172.21.15.1:0/2501553879 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fcad0031650 con 0x560282c85070 2024-09-21T00:58:51.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.431+0000 7fcae4547740 10 client.16050 fetch_fsmap learned FSMap version 31 2024-09-21T00:58:51.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.431+0000 7fcae4547740 1 -- 172.21.15.1:0/2501553879 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x560283046a10 con 0x560282c85070 2024-09-21T00:58:51.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.431+0000 7fcab6ffd640 1 -- 172.21.15.1:0/2501553879 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcad0036040 con 0x560282c85070 2024-09-21T00:58:51.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.431+0000 7fcab6ffd640 1 -- 172.21.15.1:0/2501553879 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7fcad0004640 con 0x560282c85070 2024-09-21T00:58:51.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.432+0000 7fcae4547740 10 client.16050 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:58:51.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.432+0000 7fcae4547740 10 client.16050 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:58:51.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.432+0000 7fcae4547740 20 client.16050 populate_metadata read hostname 'smithi001' 2024-09-21T00:58:51.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.432+0000 7fcae4547740 1 --2- 172.21.15.1:0/2501553879 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560282c439f0 0x560283049d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:51.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.432+0000 7fcae4547740 4 client.16050 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:58:51.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.432+0000 7fcae4547740 1 -- 172.21.15.1:0/2501553879 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560282fa4da0 con 0x560282c439f0 2024-09-21T00:58:51.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.432+0000 7fcad6ffd640 1 --2- 172.21.15.1:0/2501553879 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560282c439f0 0x560283049d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:51.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.432+0000 7fcad6ffd640 1 --2- 172.21.15.1:0/2501553879 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560282c439f0 0x560283049d70 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=902433eeb10c6dd6 server_cookie=937be0d505de5f65 in_seq=0 out_seq=0 2024-09-21T00:58:51.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.432+0000 7fcab6ffd640 10 client.16050 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:51.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.433+0000 7fcab6ffd640 1 -- 172.21.15.1:0/2501553879 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560282fa4da0 con 0x560282c439f0 2024-09-21T00:58:51.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.433+0000 7fcab6ffd640 10 client.16050 handle_command_reply: tid=0 2024-09-21T00:58:51.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.433+0000 7fcae4547740 1 client.16050 shutdown 2024-09-21T00:58:51.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.433+0000 7fcae4547740 1 -- 172.21.15.1:0/2501553879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560282c85070 msgr2=0x560283038770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:51.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.433+0000 7fcae4547740 1 --2- 172.21.15.1:0/2501553879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560282c85070 0x560283038770 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fcad00094e0 tx=0x7fcad002a8c0 comp rx=0 tx=0).stop 2024-09-21T00:58:51.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.433+0000 7fcae4547740 1 -- 172.21.15.1:0/2501553879 shutdown_connections 2024-09-21T00:58:51.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.433+0000 7fcae4547740 1 --2- 172.21.15.1:0/2501553879 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560282c439f0 0x560283049d70 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:51.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.433+0000 7fcab6ffd640 0 client.16050 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:51.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.433+0000 7fcae4547740 1 --2- 172.21.15.1:0/2501553879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560282c85070 0x560283038770 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:51.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.433+0000 7fcae4547740 1 --2- 172.21.15.1:0/2501553879 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560282c64390 0x560283038230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:51.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.433+0000 7fcae4547740 1 --2- 172.21.15.1:0/2501553879 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560282c5c1b0 0x560283037cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:51.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.433+0000 7fcae4547740 1 -- 172.21.15.1:0/2501553879 >> 172.21.15.1:0/2501553879 conn(0x560282c79460 msgr2=0x56028302f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:51.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.433+0000 7fcae4547740 1 -- 172.21.15.1:0/2501553879 shutdown_connections 2024-09-21T00:58:51.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.433+0000 7fcae4547740 1 -- 172.21.15.1:0/2501553879 wait complete. 2024-09-21T00:58:51.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.434+0000 7fcae4547740 20 client.16050 trim_cache size 0 max 16384 2024-09-21T00:58:51.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.452+0000 7fcae4547740 1 Processor -- start 2024-09-21T00:58:51.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.452+0000 7fcae4547740 1 -- start start 2024-09-21T00:58:51.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.453+0000 7fcae4547740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560282c439f0 0x56028302e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:51.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.453+0000 7fcae4547740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560282c5c1b0 0x560283039920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:51.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.453+0000 7fcae4547740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560282c64390 0x560283029b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:51.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.453+0000 7fcae4547740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcad81b1680 con 0x560282c439f0 2024-09-21T00:58:51.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.453+0000 7fcae4547740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcad81b3340 con 0x560282c64390 2024-09-21T00:58:51.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.453+0000 7fcae4547740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcad81b1d50 con 0x560282c5c1b0 2024-09-21T00:58:51.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.453+0000 7fcad7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560282c439f0 0x56028302e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:51.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.453+0000 7fcad7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560282c439f0 0x56028302e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33768/0 (socket says 172.21.15.1:33768) 2024-09-21T00:58:51.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.453+0000 7fcad7fff640 1 -- 172.21.15.1:0/1519578493 learned_addr learned my addr 172.21.15.1:0/1519578493 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:51.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.453+0000 7fcad6ffd640 1 --2- 172.21.15.1:0/1519578493 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560282c5c1b0 0x560283039920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:51.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.453+0000 7fcad7fff640 1 --2- 172.21.15.1:0/1519578493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560282c64390 0x560283029b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:51.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.453+0000 7fcad7fff640 1 -- 172.21.15.1:0/1519578493 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560282c5c1b0 msgr2=0x560283039920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:51.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.453+0000 7fcad7fff640 1 --2- 172.21.15.1:0/1519578493 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560282c5c1b0 0x560283039920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:51.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.453+0000 7fcad7fff640 1 -- 172.21.15.1:0/1519578493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560282c64390 msgr2=0x560283029b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:51.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.453+0000 7fcad7fff640 1 --2- 172.21.15.1:0/1519578493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560282c64390 0x560283029b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:51.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.453+0000 7fcad7fff640 1 -- 172.21.15.1:0/1519578493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56028302b100 con 0x560282c439f0 2024-09-21T00:58:51.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.453+0000 7fcad6ffd640 1 --2- 172.21.15.1:0/1519578493 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560282c5c1b0 0x560283039920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:58:51.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.453+0000 7fcad7fff640 1 --2- 172.21.15.1:0/1519578493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560282c439f0 0x56028302e040 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fcad0009bf0 tx=0x7fcad002bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d734f4044e3ac7a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:51.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.453+0000 7fcabd7fa640 1 -- 172.21.15.1:0/1519578493 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad0003db0 con 0x560282c439f0 2024-09-21T00:58:51.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.454+0000 7fcabd7fa640 1 -- 172.21.15.1:0/1519578493 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcad0036070 con 0x560282c439f0 2024-09-21T00:58:51.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.454+0000 7fcabd7fa640 1 -- 172.21.15.1:0/1519578493 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad002fc50 con 0x560282c439f0 2024-09-21T00:58:51.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.454+0000 7fcae4547740 1 -- 172.21.15.1:0/1519578493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560282c439f0 msgr2=0x56028302e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:51.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.454+0000 7fcae4547740 1 --2- 172.21.15.1:0/1519578493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560282c439f0 0x56028302e040 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fcad0009bf0 tx=0x7fcad002bfd0 comp rx=0 tx=0).stop 2024-09-21T00:58:51.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.454+0000 7fcae4547740 1 -- 172.21.15.1:0/1519578493 shutdown_connections 2024-09-21T00:58:51.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.454+0000 7fcae4547740 1 --2- 172.21.15.1:0/1519578493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560282c64390 0x560283029b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:51.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.454+0000 7fcae4547740 1 --2- 172.21.15.1:0/1519578493 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560282c5c1b0 0x560283039920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:51.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.454+0000 7fcae4547740 1 --2- 172.21.15.1:0/1519578493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560282c439f0 0x56028302e040 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:51.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.454+0000 7fcae4547740 1 -- 172.21.15.1:0/1519578493 >> 172.21.15.1:0/1519578493 conn(0x560282c79460 msgr2=0x560283039210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:51.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.454+0000 7fcae4547740 1 -- 172.21.15.1:0/1519578493 shutdown_connections 2024-09-21T00:58:51.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.455+0000 7fcae4547740 1 -- 172.21.15.1:0/1519578493 wait complete. 2024-09-21T00:58:51.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.455+0000 7fcae4547740 1 -- start start 2024-09-21T00:58:51.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.455+0000 7fcae4547740 1 Processor -- start 2024-09-21T00:58:51.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.455+0000 7fcae4547740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560282c439f0 0x56028304d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:51.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.455+0000 7fcae4547740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560282c5c1b0 0x56028304aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:51.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.455+0000 7fcae4547740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560282c64390 0x56028304afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:51.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.455+0000 7fcae4547740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcad81b2bb0 con 0x560282c5c1b0 2024-09-21T00:58:51.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.456+0000 7fcae4547740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcad81b24e0 con 0x560282c439f0 2024-09-21T00:58:51.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.456+0000 7fcae4547740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcad81af660 con 0x560282c64390 2024-09-21T00:58:51.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.456+0000 7fcae4547740 10 client.0 _ll_register_callbacks cb 0x7fcac8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:51.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.456+0000 7fcad7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560282c439f0 0x56028304d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:51.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.456+0000 7fcad6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560282c5c1b0 0x56028304aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:51.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.456+0000 7fcad7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560282c439f0 0x56028304d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:52846/0 (socket says 172.21.15.1:52846) 2024-09-21T00:58:51.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.456+0000 7fcad6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560282c5c1b0 0x56028304aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33774/0 (socket says 172.21.15.1:33774) 2024-09-21T00:58:51.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.456+0000 7fcad7fff640 1 -- 172.21.15.1:0/55579967 learned_addr learned my addr 172.21.15.1:0/55579967 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:51.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.456+0000 7fcad7fff640 1 --2- 172.21.15.1:0/55579967 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560282c64390 0x56028304afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:51.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.456+0000 7fcad6ffd640 1 -- 172.21.15.1:0/55579967 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560282c64390 msgr2=0x56028304afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:51.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.456+0000 7fcad6ffd640 1 --2- 172.21.15.1:0/55579967 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560282c64390 0x56028304afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:51.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.456+0000 7fcad6ffd640 1 -- 172.21.15.1:0/55579967 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560282c439f0 msgr2=0x56028304d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:51.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.456+0000 7fcad6ffd640 1 --2- 172.21.15.1:0/55579967 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560282c439f0 0x56028304d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:51.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.456+0000 7fcad6ffd640 1 -- 172.21.15.1:0/55579967 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56028302d470 con 0x560282c5c1b0 2024-09-21T00:58:51.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.456+0000 7fcad6ffd640 1 --2- 172.21.15.1:0/55579967 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560282c5c1b0 0x56028304aaa0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x560282f92280 tx=0x7fcacc010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfc04c78d4bad7db server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:51.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.456+0000 7fcab6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:58:51.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.456+0000 7fcab6ffd640 1 -- 172.21.15.1:0/55579967 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcacc005220 con 0x560282c5c1b0 2024-09-21T00:58:51.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.456+0000 7fcab6ffd640 1 -- 172.21.15.1:0/55579967 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fcacc0053c0 con 0x560282c5c1b0 2024-09-21T00:58:51.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.457+0000 7fcae4547740 1 -- 172.21.15.1:0/55579967 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcad0036070 con 0x560282c5c1b0 2024-09-21T00:58:51.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.457+0000 7fcab6ffd640 1 -- 172.21.15.1:0/55579967 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fcacc0055c0 con 0x560282c5c1b0 2024-09-21T00:58:51.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.457+0000 7fcae4547740 10 client.16056 fetch_fsmap learned FSMap version 31 2024-09-21T00:58:51.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.457+0000 7fcae4547740 1 -- 172.21.15.1:0/55579967 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5602830b42d0 con 0x560282c5c1b0 2024-09-21T00:58:51.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.457+0000 7fcab6ffd640 1 -- 172.21.15.1:0/55579967 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcad0036070 con 0x560282c5c1b0 2024-09-21T00:58:51.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.457+0000 7fcab6ffd640 1 -- 172.21.15.1:0/55579967 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7fcacc01f940 con 0x560282c5c1b0 2024-09-21T00:58:51.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.457+0000 7fcae4547740 10 client.16056 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:58:51.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.457+0000 7fcae4547740 10 client.16056 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:58:51.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.457+0000 7fcae4547740 20 client.16056 populate_metadata read hostname 'smithi001' 2024-09-21T00:58:51.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.457+0000 7fcae4547740 1 --2- 172.21.15.1:0/55579967 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560282c85070 0x5602830b6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:51.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.457+0000 7fcae4547740 4 client.16056 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T00:58:51.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.457+0000 7fcae4547740 1 -- 172.21.15.1:0/55579967 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560282fa0850 con 0x560282c85070 2024-09-21T00:58:51.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.457+0000 7fcad7fff640 1 --2- 172.21.15.1:0/55579967 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560282c85070 0x5602830b6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:51.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.458+0000 7fcab6ffd640 10 client.16056 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:51.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.458+0000 7fcad7fff640 1 --2- 172.21.15.1:0/55579967 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560282c85070 0x5602830b6b50 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=469135f03494b65b server_cookie=ca689c0e0a1e36b in_seq=0 out_seq=0 2024-09-21T00:58:51.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.458+0000 7fcab6ffd640 1 -- 172.21.15.1:0/55579967 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1226 (crc 0 0 0) 0x560282fa0850 con 0x560282c85070 2024-09-21T00:58:51.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.458+0000 7fcab6ffd640 10 client.16056 handle_command_reply: tid=0 2024-09-21T00:58:51.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.458+0000 7fcae4547740 1 client.16056 shutdown 2024-09-21T00:58:51.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.458+0000 7fcae4547740 1 -- 172.21.15.1:0/55579967 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560282c5c1b0 msgr2=0x56028304aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:51.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.458+0000 7fcae4547740 1 --2- 172.21.15.1:0/55579967 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560282c5c1b0 0x56028304aaa0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x560282f92280 tx=0x7fcacc010800 comp rx=0 tx=0).stop 2024-09-21T00:58:51.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.458+0000 7fcae4547740 1 -- 172.21.15.1:0/55579967 shutdown_connections 2024-09-21T00:58:51.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.458+0000 7fcae4547740 1 --2- 172.21.15.1:0/55579967 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560282c85070 0x5602830b6b50 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:51.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.458+0000 7fcae4547740 1 --2- 172.21.15.1:0/55579967 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560282c64390 0x56028304afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:51.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.458+0000 7fcae4547740 1 --2- 172.21.15.1:0/55579967 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560282c5c1b0 0x56028304aaa0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:51.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.458+0000 7fcab6ffd640 0 client.16056 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:58:51.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.458+0000 7fcae4547740 1 --2- 172.21.15.1:0/55579967 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560282c439f0 0x56028304d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:51.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.458+0000 7fcae4547740 1 -- 172.21.15.1:0/55579967 >> 172.21.15.1:0/55579967 conn(0x560282c79460 msgr2=0x560283043a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:51.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.459+0000 7fcae4547740 1 -- 172.21.15.1:0/55579967 shutdown_connections 2024-09-21T00:58:51.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.459+0000 7fcae4547740 1 -- 172.21.15.1:0/55579967 wait complete. 2024-09-21T00:58:51.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.459+0000 7fcae4547740 20 client.16056 trim_cache size 0 max 16384 2024-09-21T00:58:51.464 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T00:58:51.465 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "no active scrubs running", 2024-09-21T00:58:51.465 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": {}, 2024-09-21T00:58:51.465 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_stats": { 2024-09-21T00:58:51.465 INFO:teuthology.orchestra.run.smithi001.stdout: "bee49cce-b407-4617-a959-331ffd8dc5b0": { 2024-09-21T00:58:51.465 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:58:17.883027+0000", 2024-09-21T00:58:51.465 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T00:58:51.465 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T00:58:51.465 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T00:58:51.465 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T00:58:51.465 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T00:58:51.465 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T00:58:51.465 INFO:teuthology.orchestra.run.smithi001.stdout: "7cb1bc3f-e2d2-4bf7-b13e-8f3371d7aac1": { 2024-09-21T00:58:51.465 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:58:02.751142+0000", 2024-09-21T00:58:51.465 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T00:58:51.466 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T00:58:51.466 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T00:58:51.466 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T00:58:51.466 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T00:58:51.466 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T00:58:51.466 INFO:teuthology.orchestra.run.smithi001.stdout: "2383a19c-993d-4440-99f7-93b43dcf33b4": { 2024-09-21T00:58:51.466 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:47.609257+0000", 2024-09-21T00:58:51.466 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T00:58:51.466 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T00:58:51.466 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T00:58:51.466 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T00:58:51.466 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T00:58:51.466 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T00:58:51.466 INFO:teuthology.orchestra.run.smithi001.stdout: "53fa74e4-5aa8-408b-9724-7c93618f7636": { 2024-09-21T00:58:51.467 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:01.730608+0000", 2024-09-21T00:58:51.467 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T00:58:51.467 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T00:58:51.467 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T00:58:51.467 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T00:58:51.467 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T00:58:51.467 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T00:58:51.467 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T00:58:51.467 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T00:58:51.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.459+0000 7fcaddfd3640 1 -- 172.21.15.1:0/249388985 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fcac00b6510 msgr2=0x7fcac00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:51.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.459+0000 7fcaddfd3640 1 --2- 172.21.15.1:0/249388985 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fcac00b6510 0x7fcac00b8a20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcac800cfd0 tx=0x7fcac8076600 comp rx=0 tx=0).stop 2024-09-21T00:58:51.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.459+0000 7fcaddfd3640 1 -- 172.21.15.1:0/249388985 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcad8102070 msgr2=0x7fcad8103010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:51.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.459+0000 7fcaddfd3640 1 --2- 172.21.15.1:0/249388985 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcad8102070 0x7fcad8103010 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcac800e9c0 tx=0x7fcac800ee80 comp rx=0 tx=0).stop 2024-09-21T00:58:51.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.459+0000 7fcaddfd3640 1 -- 172.21.15.1:0/249388985 shutdown_connections 2024-09-21T00:58:51.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.459+0000 7fcaddfd3640 1 --2- 172.21.15.1:0/249388985 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcad8106c10 0x7fcad8103a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:51.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.459+0000 7fcaddfd3640 1 --2- 172.21.15.1:0/249388985 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fcac00b6510 0x7fcac00b8a20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:51.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.459+0000 7fcaddfd3640 1 --2- 172.21.15.1:0/249388985 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcad81062c0 0x7fcad8103550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:51.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.459+0000 7fcaddfd3640 1 --2- 172.21.15.1:0/249388985 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcad8102070 0x7fcad8103010 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:51.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.459+0000 7fcaddfd3640 1 -- 172.21.15.1:0/249388985 >> 172.21.15.1:0/249388985 conn(0x7fcad8079e10 msgr2=0x7fcad81074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:51.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.459+0000 7fcaddfd3640 1 -- 172.21.15.1:0/249388985 shutdown_connections 2024-09-21T00:58:51.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:51.459+0000 7fcaddfd3640 1 -- 172.21.15.1:0/249388985 wait complete. 2024-09-21T00:58:51.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:51 smithi001 ceph-mon[31211]: pgmap v407: 97 pgs: 97 active+clean; 75 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 1.8 MiB/s wr, 476 op/s 2024-09-21T00:58:52.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:51 smithi193 ceph-mon[34660]: pgmap v407: 97 pgs: 97 active+clean; 75 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 1.8 MiB/s wr, 476 op/s 2024-09-21T00:58:52.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:51 smithi042 ceph-mon[34481]: pgmap v407: 97 pgs: 97 active+clean; 75 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 1.8 MiB/s wr, 476 op/s 2024-09-21T00:58:52.344 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T00:58:52.344 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:58:52.615 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:58:53.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.325+0000 7f3a3b59e640 1 -- 172.21.15.1:0/438450935 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a3c1047c0 msgr2=0x7f3a3c104bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:53.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.325+0000 7f3a3b59e640 1 --2- 172.21.15.1:0/438450935 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a3c1047c0 0x7f3a3c104bd0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c009900 tx=0x7f3a2c02a410 comp rx=0 tx=0).stop 2024-09-21T00:58:53.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.325+0000 7f3a3b59e640 1 -- 172.21.15.1:0/438450935 shutdown_connections 2024-09-21T00:58:53.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.325+0000 7f3a3b59e640 1 --2- 172.21.15.1:0/438450935 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a3c10dc20 0x7f3a3c110110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:53.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.325+0000 7f3a3b59e640 1 --2- 172.21.15.1:0/438450935 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a3c105110 0x7f3a3c10d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:53.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.325+0000 7f3a3b59e640 1 --2- 172.21.15.1:0/438450935 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a3c1047c0 0x7f3a3c104bd0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:53.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.325+0000 7f3a3b59e640 1 -- 172.21.15.1:0/438450935 >> 172.21.15.1:0/438450935 conn(0x7f3a3c0fe2c0 msgr2=0x7f3a3c100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:53.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.325+0000 7f3a3b59e640 1 -- 172.21.15.1:0/438450935 shutdown_connections 2024-09-21T00:58:53.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.325+0000 7f3a3b59e640 1 -- 172.21.15.1:0/438450935 wait complete. 2024-09-21T00:58:53.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.326+0000 7f3a3b59e640 1 Processor -- start 2024-09-21T00:58:53.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.326+0000 7f3a3b59e640 1 -- start start 2024-09-21T00:58:53.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.326+0000 7f3a3b59e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a3c1047c0 0x7f3a3c102500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:53.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.326+0000 7f3a3b59e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a3c105110 0x7f3a3c102a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:53.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.326+0000 7f3a3b59e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a3c10dc20 0x7f3a3c102f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:53.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.326+0000 7f3a3b59e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3a3c113880 con 0x7f3a3c10dc20 2024-09-21T00:58:53.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.326+0000 7f3a3b59e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3a3c113700 con 0x7f3a3c105110 2024-09-21T00:58:53.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.326+0000 7f3a3b59e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3a3c113a00 con 0x7f3a3c1047c0 2024-09-21T00:58:53.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.326+0000 7f3a3ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a3c10dc20 0x7f3a3c102f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:53.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.326+0000 7f3a39d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a3c105110 0x7f3a3c102a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:53.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.326+0000 7f3a3a59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a3c1047c0 0x7f3a3c102500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:53.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.326+0000 7f3a39d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a3c105110 0x7f3a3c102a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:52856/0 (socket says 172.21.15.1:52856) 2024-09-21T00:58:53.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.326+0000 7f3a3a59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a3c1047c0 0x7f3a3c102500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:46324/0 (socket says 172.21.15.1:46324) 2024-09-21T00:58:53.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.326+0000 7f3a3a59c640 1 -- 172.21.15.1:0/1065533994 learned_addr learned my addr 172.21.15.1:0/1065533994 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:53.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.326+0000 7f3a3ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a3c10dc20 0x7f3a3c102f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33792/0 (socket says 172.21.15.1:33792) 2024-09-21T00:58:53.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.327+0000 7f3a3a59c640 1 -- 172.21.15.1:0/1065533994 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a3c105110 msgr2=0x7f3a3c102a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:53.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.327+0000 7f3a3a59c640 1 --2- 172.21.15.1:0/1065533994 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a3c105110 0x7f3a3c102a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:53.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.327+0000 7f3a3a59c640 1 -- 172.21.15.1:0/1065533994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a3c10dc20 msgr2=0x7f3a3c102f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:53.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.327+0000 7f3a3a59c640 1 --2- 172.21.15.1:0/1065533994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a3c10dc20 0x7f3a3c102f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:53.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.327+0000 7f3a3a59c640 1 -- 172.21.15.1:0/1065533994 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a3c1a8590 con 0x7f3a3c1047c0 2024-09-21T00:58:53.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.327+0000 7f3a3ad9d640 1 --2- 172.21.15.1:0/1065533994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a3c10dc20 0x7f3a3c102f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:53.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.327+0000 7f3a3a59c640 1 --2- 172.21.15.1:0/1065533994 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a3c1047c0 0x7f3a3c102500 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c005940 tx=0x7f3a2c0040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:53.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.327+0000 7f3a2b7fe640 1 -- 172.21.15.1:0/1065533994 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c03f030 con 0x7f3a3c1047c0 2024-09-21T00:58:53.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.327+0000 7f3a2b7fe640 1 -- 172.21.15.1:0/1065533994 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a2c0044c0 con 0x7f3a3c1047c0 2024-09-21T00:58:53.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.327+0000 7f3a3b59e640 1 -- 172.21.15.1:0/1065533994 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a3c1a8820 con 0x7f3a3c1047c0 2024-09-21T00:58:53.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.327+0000 7f3a2b7fe640 1 -- 172.21.15.1:0/1065533994 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c035070 con 0x7f3a3c1047c0 2024-09-21T00:58:53.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.327+0000 7f3a3b59e640 1 -- 172.21.15.1:0/1065533994 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a3c1a8d00 con 0x7f3a3c1047c0 2024-09-21T00:58:53.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.328+0000 7f3a3b59e640 1 -- 172.21.15.1:0/1065533994 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a3c104bd0 con 0x7f3a3c1047c0 2024-09-21T00:58:53.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.330+0000 7f3a2b7fe640 1 -- 172.21.15.1:0/1065533994 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f3a2c042030 con 0x7f3a3c1047c0 2024-09-21T00:58:53.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.330+0000 7f3a2b7fe640 1 --2- 172.21.15.1:0/1065533994 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f3a240b6590 0x7f3a240b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:53.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.331+0000 7f3a39d9b640 1 --2- 172.21.15.1:0/1065533994 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f3a240b6590 0x7f3a240b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:53.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.331+0000 7f3a2b7fe640 1 -- 172.21.15.1:0/1065533994 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f3a2c107940 con 0x7f3a3c1047c0 2024-09-21T00:58:53.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.331+0000 7f3a39d9b640 1 --2- 172.21.15.1:0/1065533994 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f3a240b6590 0x7f3a240b8aa0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c110290 tx=0x7f3a30005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:53.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.333+0000 7f3a2b7fe640 1 -- 172.21.15.1:0/1065533994 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3a2c0d2530 con 0x7f3a3c1047c0 2024-09-21T00:58:53.556 INFO:tasks.workunit.client.0.smithi001.stdout: 38 696174 619 400429 420 320485 1995 2024-09-21T00:58:53.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.571+0000 7f3a3b59e640 1 -- 172.21.15.1:0/1065533994 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3a3c1a9070 con 0x7f3a3c1047c0 2024-09-21T00:58:53.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.571+0000 7f3a2b7fe640 1 -- 172.21.15.1:0/1065533994 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11969 (secure 0 0 0) 0x7f3a2c0d7470 con 0x7f3a3c1047c0 2024-09-21T00:58:53.572 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:58:53.572 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":31,"btime":"2024-09-21T00:58:37:805319+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2810186677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2810186677},{"type":"v1","addr":"172.21.15.1:6835","nonce":2810186677}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14736,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3935320478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3935320478},{"type":"v1","addr":"172.21.15.1:6837","nonce":3935320478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:54:58.592853+0000","modified":"2024-09-21T00:58:36.853977+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24653,"mds_1":24637,"mds_2":24626,"mds_3":24622,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/2125703572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2125703572},{"type":"v1","addr":"172.21.15.1:6839","nonce":2125703572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/3860445313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860445313},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860445313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6833/712170939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":712170939},{"type":"v1","addr":"172.21.15.193:6833","nonce":712170939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6833/1653911656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1653911656},{"type":"v1","addr":"172.21.15.42:6833","nonce":1653911656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6835/793085918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":793085918},{"type":"v1","addr":"172.21.15.42:6835","nonce":793085918}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6835/3631682268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":3631682268},{"type":"v1","addr":"172.21.15.193:6835","nonce":3631682268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.193:6837/909252228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":909252228},{"type":"v1","addr":"172.21.15.193:6837","nonce":909252228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.42:6837/2395608508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2395608508},{"type":"v1","addr":"172.21.15.42:6837","nonce":2395608508}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.193:6839/1365361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1365361177},{"type":"v1","addr":"172.21.15.193:6839","nonce":1365361177}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6839/2526476666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2526476666},{"type":"v1","addr":"172.21.15.42:6839","nonce":2526476666}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24610,24622,24626,24637,24653]},"id":1}]} 2024-09-21T00:58:53.573 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 31 2024-09-21T00:58:53.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.574+0000 7f3a3b59e640 1 -- 172.21.15.1:0/1065533994 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f3a240b6590 msgr2=0x7f3a240b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:53.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.574+0000 7f3a3b59e640 1 --2- 172.21.15.1:0/1065533994 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f3a240b6590 0x7f3a240b8aa0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c110290 tx=0x7f3a30005f90 comp rx=0 tx=0).stop 2024-09-21T00:58:53.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.574+0000 7f3a3b59e640 1 -- 172.21.15.1:0/1065533994 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a3c1047c0 msgr2=0x7f3a3c102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:53.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.574+0000 7f3a3b59e640 1 --2- 172.21.15.1:0/1065533994 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a3c1047c0 0x7f3a3c102500 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c005940 tx=0x7f3a2c0040c0 comp rx=0 tx=0).stop 2024-09-21T00:58:53.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.574+0000 7f3a3b59e640 1 -- 172.21.15.1:0/1065533994 shutdown_connections 2024-09-21T00:58:53.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.574+0000 7f3a3b59e640 1 --2- 172.21.15.1:0/1065533994 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f3a240b6590 0x7f3a240b8aa0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:53.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.574+0000 7f3a3b59e640 1 --2- 172.21.15.1:0/1065533994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a3c10dc20 0x7f3a3c102f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:53.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.574+0000 7f3a3b59e640 1 --2- 172.21.15.1:0/1065533994 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a3c105110 0x7f3a3c102a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:53.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.574+0000 7f3a3b59e640 1 --2- 172.21.15.1:0/1065533994 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a3c1047c0 0x7f3a3c102500 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:53.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.574+0000 7f3a3b59e640 1 -- 172.21.15.1:0/1065533994 >> 172.21.15.1:0/1065533994 conn(0x7f3a3c0fe2c0 msgr2=0x7f3a3c107780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:53.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.574+0000 7f3a3b59e640 1 -- 172.21.15.1:0/1065533994 shutdown_connections 2024-09-21T00:58:53.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:53.574+0000 7f3a3b59e640 1 -- 172.21.15.1:0/1065533994 wait complete. 2024-09-21T00:58:54.186 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:53 smithi001 ceph-mon[31211]: pgmap v408: 97 pgs: 97 active+clean; 79 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 2.0 MiB/s wr, 526 op/s 2024-09-21T00:58:54.186 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:53 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1065533994' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:58:54.215 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T00:58:54.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:53 smithi193 ceph-mon[34660]: pgmap v408: 97 pgs: 97 active+clean; 79 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 2.0 MiB/s wr, 526 op/s 2024-09-21T00:58:54.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:53 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/1065533994' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:58:54.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:53 smithi042 ceph-mon[34481]: pgmap v408: 97 pgs: 97 active+clean; 79 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 2.0 MiB/s wr, 526 op/s 2024-09-21T00:58:54.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:53 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/1065533994' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:58:54.721 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:58:55.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.350+0000 7f04d7fff640 1 -- 172.21.15.1:0/982178117 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04d0098310 msgr2=0x7f04d0098720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:55.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.350+0000 7f04d7fff640 1 --2- 172.21.15.1:0/982178117 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04d0098310 0x7f04d0098720 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f04c801a910 tx=0x7f04c803b430 comp rx=0 tx=0).stop 2024-09-21T00:58:55.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.350+0000 7f04d7fff640 1 -- 172.21.15.1:0/982178117 shutdown_connections 2024-09-21T00:58:55.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.350+0000 7f04d7fff640 1 --2- 172.21.15.1:0/982178117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04d009e5a0 0x7f04d00a4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:55.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.350+0000 7f04d7fff640 1 --2- 172.21.15.1:0/982178117 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04d009dc50 0x7f04d009e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:55.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.350+0000 7f04d7fff640 1 --2- 172.21.15.1:0/982178117 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04d0098310 0x7f04d0098720 secure :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f04c801a910 tx=0x7f04c803b430 comp rx=0 tx=0).stop 2024-09-21T00:58:55.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.350+0000 7f04d7fff640 1 -- 172.21.15.1:0/982178117 >> 172.21.15.1:0/982178117 conn(0x7f04d000fed0 msgr2=0x7f04d00102e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:55.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.350+0000 7f04d7fff640 1 -- 172.21.15.1:0/982178117 shutdown_connections 2024-09-21T00:58:55.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.350+0000 7f04d7fff640 1 -- 172.21.15.1:0/982178117 wait complete. 2024-09-21T00:58:55.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.351+0000 7f04d7fff640 1 Processor -- start 2024-09-21T00:58:55.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.352+0000 7f04d7fff640 1 -- start start 2024-09-21T00:58:55.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.352+0000 7f04d7fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04d009dc50 0x7f04d00a42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:55.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.352+0000 7f04d7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04d009e5a0 0x7f04d00a4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:55.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.352+0000 7f04d7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04d00ae530 0x7f04d00ae940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:55.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.352+0000 7f04d7fff640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f04d000af90 con 0x7f04d009e5a0 2024-09-21T00:58:55.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.352+0000 7f04d7fff640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f04d000ae10 con 0x7f04d00ae530 2024-09-21T00:58:55.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.352+0000 7f04d7fff640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f04d000b110 con 0x7f04d009dc50 2024-09-21T00:58:55.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.353+0000 7f04d6ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04d009dc50 0x7f04d00a42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:55.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.353+0000 7f04d6ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04d009dc50 0x7f04d00a42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:46346/0 (socket says 172.21.15.1:46346) 2024-09-21T00:58:55.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.353+0000 7f04d6ffd640 1 -- 172.21.15.1:0/2948472571 learned_addr learned my addr 172.21.15.1:0/2948472571 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:55.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.353+0000 7f04d77fe640 1 --2- 172.21.15.1:0/2948472571 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04d00ae530 0x7f04d00ae940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:55.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.354+0000 7f04d6ffd640 1 -- 172.21.15.1:0/2948472571 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04d00ae530 msgr2=0x7f04d00ae940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:55.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.354+0000 7f04d6ffd640 1 --2- 172.21.15.1:0/2948472571 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04d00ae530 0x7f04d00ae940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:55.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.354+0000 7f04d6ffd640 1 -- 172.21.15.1:0/2948472571 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04d009e5a0 msgr2=0x7f04d00a4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:55.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.354+0000 7f04d6ffd640 1 --2- 172.21.15.1:0/2948472571 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04d009e5a0 0x7f04d00a4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:55.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.354+0000 7f04d6ffd640 1 -- 172.21.15.1:0/2948472571 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d00af110 con 0x7f04d009dc50 2024-09-21T00:58:55.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.354+0000 7f04d6ffd640 1 --2- 172.21.15.1:0/2948472571 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04d009dc50 0x7f04d00a42e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f04c803ba20 tx=0x7f04c8005440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:55.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.354+0000 7f04dc8b6640 1 -- 172.21.15.1:0/2948472571 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c8046070 con 0x7f04d009dc50 2024-09-21T00:58:55.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.355+0000 7f04dc8b6640 1 -- 172.21.15.1:0/2948472571 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04c8051070 con 0x7f04d009dc50 2024-09-21T00:58:55.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.355+0000 7f04d7fff640 1 -- 172.21.15.1:0/2948472571 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04d00ab3b0 con 0x7f04d009dc50 2024-09-21T00:58:55.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.355+0000 7f04d7fff640 1 -- 172.21.15.1:0/2948472571 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04d00ab7d0 con 0x7f04d009dc50 2024-09-21T00:58:55.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.355+0000 7f04dc8b6640 1 -- 172.21.15.1:0/2948472571 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c8003c90 con 0x7f04d009dc50 2024-09-21T00:58:55.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.362+0000 7f04e3e2c740 1 Processor -- start 2024-09-21T00:58:55.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.362+0000 7f04e3e2c740 1 -- start start 2024-09-21T00:58:55.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.362+0000 7f04e3e2c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645ae653070 0x5645ae9fa860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:55.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.362+0000 7f04dc8b6640 1 -- 172.21.15.1:0/2948472571 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f04c8040510 con 0x7f04d009dc50 2024-09-21T00:58:55.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.363+0000 7f04e3e2c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ae62a1b0 0x5645ae9fada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:55.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.363+0000 7f04d77fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645ae653070 0x5645ae9fa860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:55.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.363+0000 7f04d77fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645ae653070 0x5645ae9fa860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:46362/0 (socket says 172.21.15.1:46362) 2024-09-21T00:58:55.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.363+0000 7f04d77fe640 1 -- 172.21.15.1:0/2300006594 learned_addr learned my addr 172.21.15.1:0/2300006594 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:55.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.363+0000 7f04e3e2c740 1 --2- 172.21.15.1:0/2300006594 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645ae632390 0x5645ae9fb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:55.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.363+0000 7f04e3e2c740 1 -- 172.21.15.1:0/2300006594 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5645ae970ea0 con 0x5645ae632390 2024-09-21T00:58:55.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.363+0000 7f04e3e2c740 1 -- 172.21.15.1:0/2300006594 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5645ae9602d0 con 0x5645ae62a1b0 2024-09-21T00:58:55.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.363+0000 7f04e3e2c740 1 -- 172.21.15.1:0/2300006594 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5645ae9640e0 con 0x5645ae653070 2024-09-21T00:58:55.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.364+0000 7f04d67fc640 1 --2- 172.21.15.1:0/2300006594 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645ae632390 0x5645ae9fb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:55.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.364+0000 7f04d6ffd640 1 --2- 172.21.15.1:0/2300006594 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ae62a1b0 0x5645ae9fada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:55.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.364+0000 7f04d77fe640 1 -- 172.21.15.1:0/2300006594 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ae62a1b0 msgr2=0x5645ae9fada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:55.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.364+0000 7f04d77fe640 1 --2- 172.21.15.1:0/2300006594 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ae62a1b0 0x5645ae9fada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:55.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.364+0000 7f04d77fe640 1 -- 172.21.15.1:0/2300006594 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645ae632390 msgr2=0x5645ae9fb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:55.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.364+0000 7f04d77fe640 1 --2- 172.21.15.1:0/2300006594 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645ae632390 0x5645ae9fb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:55.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.364+0000 7f04d77fe640 1 -- 172.21.15.1:0/2300006594 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645ae6be650 con 0x5645ae653070 2024-09-21T00:58:55.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.364+0000 7f04dc8b6640 1 --2- 172.21.15.1:0/2948472571 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f04c00b6610 0x7f04c00b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:55.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.365+0000 7f04dc8b6640 1 -- 172.21.15.1:0/2948472571 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f04c8118460 con 0x7f04d009dc50 2024-09-21T00:58:55.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.365+0000 7f04d6ffd640 1 --2- 172.21.15.1:0/2948472571 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f04c00b6610 0x7f04c00b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:55.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.365+0000 7f04d77fe640 1 --2- 172.21.15.1:0/2300006594 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645ae653070 0x5645ae9fa860 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f04d8069050 tx=0x7f04d8064940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9da15c1922c8191b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:55.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.366+0000 7f04d6ffd640 1 --2- 172.21.15.1:0/2948472571 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f04c00b6610 0x7f04c00b8b20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f04c80db010 tx=0x7f04c8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:55.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.367+0000 7f04bdffb640 1 -- 172.21.15.1:0/2300006594 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d8077630 con 0x5645ae653070 2024-09-21T00:58:55.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.367+0000 7f04bdffb640 1 -- 172.21.15.1:0/2300006594 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04d8077c80 con 0x5645ae653070 2024-09-21T00:58:55.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.367+0000 7f04bdffb640 1 -- 172.21.15.1:0/2300006594 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d8080af0 con 0x5645ae653070 2024-09-21T00:58:55.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.368+0000 7f04d67fc640 1 --2- 172.21.15.1:0/2300006594 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645ae632390 0x5645ae9fb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:58:55.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.369+0000 7f04e3e2c740 1 -- 172.21.15.1:0/2300006594 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645ae653070 msgr2=0x5645ae9fa860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:55.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.369+0000 7f04e3e2c740 1 --2- 172.21.15.1:0/2300006594 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645ae653070 0x5645ae9fa860 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f04d8069050 tx=0x7f04d8064940 comp rx=0 tx=0).stop 2024-09-21T00:58:55.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.369+0000 7f04e3e2c740 1 -- 172.21.15.1:0/2300006594 shutdown_connections 2024-09-21T00:58:55.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.369+0000 7f04e3e2c740 1 --2- 172.21.15.1:0/2300006594 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645ae632390 0x5645ae9fb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:55.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.369+0000 7f04e3e2c740 1 --2- 172.21.15.1:0/2300006594 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ae62a1b0 0x5645ae9fada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:55.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.369+0000 7f04e3e2c740 1 --2- 172.21.15.1:0/2300006594 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645ae653070 0x5645ae9fa860 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:55.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.369+0000 7f04e3e2c740 1 -- 172.21.15.1:0/2300006594 >> 172.21.15.1:0/2300006594 conn(0x5645ae647460 msgr2=0x5645ae9f8750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:55.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.371+0000 7f04e3e2c740 1 -- 172.21.15.1:0/2300006594 shutdown_connections 2024-09-21T00:58:55.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.371+0000 7f04e3e2c740 1 -- 172.21.15.1:0/2300006594 wait complete. 2024-09-21T00:58:55.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.372+0000 7f04e3e2c740 1 -- start start 2024-09-21T00:58:55.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.373+0000 7f04e3e2c740 1 Processor -- start 2024-09-21T00:58:55.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.373+0000 7f04e3e2c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645ae62a1b0 0x5645aea05f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:55.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.374+0000 7f04e3e2c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645ae632390 0x5645aea06480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:55.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.374+0000 7f04e3e2c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ae653070 0x5645aea06a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:55.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.374+0000 7f04e3e2c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5645ae7c1700 con 0x5645ae62a1b0 2024-09-21T00:58:55.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.374+0000 7f04e3e2c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5645ae8fb160 con 0x5645ae653070 2024-09-21T00:58:55.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.374+0000 7f04e3e2c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5645aea09040 con 0x5645ae632390 2024-09-21T00:58:55.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.374+0000 7f04e3e2c740 10 client.0 _ll_register_callbacks cb 0x5645ae9149e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:55.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.375+0000 7f04d77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645ae62a1b0 0x5645aea05f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:55.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.375+0000 7f04d77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645ae62a1b0 0x5645aea05f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33830/0 (socket says 172.21.15.1:33830) 2024-09-21T00:58:55.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.375+0000 7f04d77fe640 1 -- 172.21.15.1:0/4148071834 learned_addr learned my addr 172.21.15.1:0/4148071834 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:55.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.375+0000 7f04d67fc640 1 --2- 172.21.15.1:0/4148071834 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645ae632390 0x5645aea06480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:55.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.375+0000 7f04d77fe640 1 --2- 172.21.15.1:0/4148071834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ae653070 0x5645aea06a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:55.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.376+0000 7f04d77fe640 1 -- 172.21.15.1:0/4148071834 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645ae632390 msgr2=0x5645aea06480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:55.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.376+0000 7f04d77fe640 1 --2- 172.21.15.1:0/4148071834 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645ae632390 0x5645aea06480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:55.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.376+0000 7f04d77fe640 1 -- 172.21.15.1:0/4148071834 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645ae62a1b0 msgr2=0x5645aea05f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:55.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.376+0000 7f04d77fe640 1 --2- 172.21.15.1:0/4148071834 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645ae62a1b0 0x5645aea05f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:55.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.376+0000 7f04d77fe640 1 -- 172.21.15.1:0/4148071834 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645ae928c90 con 0x5645ae653070 2024-09-21T00:58:55.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.377+0000 7f04d77fe640 1 --2- 172.21.15.1:0/4148071834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ae653070 0x5645aea06a00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f04d8066480 tx=0x7f04d8051660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45b265c96fa8d6d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:55.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.377+0000 7f04b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T00:58:55.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.377+0000 7f04b6ffd640 1 -- 172.21.15.1:0/4148071834 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d808b050 con 0x5645ae653070 2024-09-21T00:58:55.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.377+0000 7f04b6ffd640 1 -- 172.21.15.1:0/4148071834 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f04d8082a40 con 0x5645ae653070 2024-09-21T00:58:55.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.378+0000 7f04e3e2c740 1 -- 172.21.15.1:0/4148071834 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04d8077c80 con 0x5645ae653070 2024-09-21T00:58:55.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.379+0000 7f04b6ffd640 1 -- 172.21.15.1:0/4148071834 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f04d8082c40 con 0x5645ae653070 2024-09-21T00:58:55.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.379+0000 7f04e3e2c740 10 client.25733 fetch_fsmap learned FSMap version 31 2024-09-21T00:58:55.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.379+0000 7f04e3e2c740 1 -- 172.21.15.1:0/4148071834 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5645aea14cb0 con 0x5645ae653070 2024-09-21T00:58:55.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.380+0000 7f04b6ffd640 1 -- 172.21.15.1:0/4148071834 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04d8086020 con 0x5645ae653070 2024-09-21T00:58:55.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.380+0000 7f04b6ffd640 1 -- 172.21.15.1:0/4148071834 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7f04d8090400 con 0x5645ae653070 2024-09-21T00:58:55.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.380+0000 7f04e3e2c740 10 client.25733 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:58:55.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.380+0000 7f04e3e2c740 10 client.25733 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T00:58:55.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.380+0000 7f04e3e2c740 20 client.25733 populate_metadata read hostname 'smithi001' 2024-09-21T00:58:55.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.380+0000 7f04e3e2c740 1 --2- 172.21.15.1:0/4148071834 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x5645ae6119f0 0x5645aea18070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:55.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.380+0000 7f04e3e2c740 4 client.25733 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:58:55.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.380+0000 7f04e3e2c740 1 -- 172.21.15.1:0/4148071834 --> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f04d8077c80 con 0x5645ae6119f0 2024-09-21T00:58:55.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.380+0000 7f04d67fc640 1 --2- 172.21.15.1:0/4148071834 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x5645ae6119f0 0x5645aea18070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:55.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.382+0000 7f04d67fc640 1 --2- 172.21.15.1:0/4148071834 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x5645ae6119f0 0x5645aea18070 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7464a3a9a4d8cb21 server_cookie=c0a190225b78e94 in_seq=0 out_seq=0 2024-09-21T00:58:55.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.382+0000 7f04b6ffd640 10 client.25733 ms_handle_connect on v2:172.21.15.193:6834/3631682268 2024-09-21T00:58:55.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.383+0000 7f04b6ffd640 1 -- 172.21.15.1:0/4148071834 <== mds.4 v2:172.21.15.193:6834/3631682268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f04d8077c80 con 0x5645ae6119f0 2024-09-21T00:58:55.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.383+0000 7f04b6ffd640 10 client.25733 handle_command_reply: tid=0 2024-09-21T00:58:55.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.383+0000 7f04e3e2c740 1 client.25733 shutdown 2024-09-21T00:58:55.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.383+0000 7f04e3e2c740 1 -- 172.21.15.1:0/4148071834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ae653070 msgr2=0x5645aea06a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:55.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.383+0000 7f04e3e2c740 1 --2- 172.21.15.1:0/4148071834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ae653070 0x5645aea06a00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f04d8066480 tx=0x7f04d8051660 comp rx=0 tx=0).stop 2024-09-21T00:58:55.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.383+0000 7f04e3e2c740 1 -- 172.21.15.1:0/4148071834 shutdown_connections 2024-09-21T00:58:55.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.383+0000 7f04e3e2c740 1 --2- 172.21.15.1:0/4148071834 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x5645ae6119f0 0x5645aea18070 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:55.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.384+0000 7f04e3e2c740 1 --2- 172.21.15.1:0/4148071834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ae653070 0x5645aea06a00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:55.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.384+0000 7f04e3e2c740 1 --2- 172.21.15.1:0/4148071834 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645ae632390 0x5645aea06480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:55.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.384+0000 7f04e3e2c740 1 --2- 172.21.15.1:0/4148071834 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645ae62a1b0 0x5645aea05f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:55.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.384+0000 7f04e3e2c740 1 -- 172.21.15.1:0/4148071834 >> 172.21.15.1:0/4148071834 conn(0x5645ae647460 msgr2=0x5645ae9fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:55.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.384+0000 7f04b6ffd640 0 client.25733 ms_handle_reset on v2:172.21.15.193:6834/3631682268 2024-09-21T00:58:55.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.384+0000 7f04e3e2c740 1 -- 172.21.15.1:0/4148071834 shutdown_connections 2024-09-21T00:58:55.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.384+0000 7f04e3e2c740 1 -- 172.21.15.1:0/4148071834 wait complete. 2024-09-21T00:58:55.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.384+0000 7f04e3e2c740 20 client.25733 trim_cache size 0 max 16384 2024-09-21T00:58:55.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.408+0000 7f04e3e2c740 1 Processor -- start 2024-09-21T00:58:55.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.408+0000 7f04e3e2c740 1 -- start start 2024-09-21T00:58:55.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.409+0000 7f04e3e2c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645ae62a1b0 0x5645aea07b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:55.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.409+0000 7f04e3e2c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645ae632390 0x5645aea03130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:55.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.409+0000 7f04e3e2c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ae653070 0x5645aea03670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:55.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.409+0000 7f04e3e2c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f04c400e5f0 con 0x5645ae632390 2024-09-21T00:58:55.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.409+0000 7f04e3e2c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f04c40102b0 con 0x5645ae653070 2024-09-21T00:58:55.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.409+0000 7f04e3e2c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f04c400ecc0 con 0x5645ae62a1b0 2024-09-21T00:58:55.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.409+0000 7f04d77fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645ae62a1b0 0x5645aea07b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:55.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.409+0000 7f04d67fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645ae632390 0x5645aea03130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:55.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.409+0000 7f04d77fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645ae62a1b0 0x5645aea07b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:46382/0 (socket says 172.21.15.1:46382) 2024-09-21T00:58:55.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.409+0000 7f04d77fe640 1 -- 172.21.15.1:0/3708641089 learned_addr learned my addr 172.21.15.1:0/3708641089 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:55.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.409+0000 7f04d77fe640 1 --2- 172.21.15.1:0/3708641089 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ae653070 0x5645aea03670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:55.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.409+0000 7f04d77fe640 1 -- 172.21.15.1:0/3708641089 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ae653070 msgr2=0x5645aea03670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:55.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.409+0000 7f04d77fe640 1 --2- 172.21.15.1:0/3708641089 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ae653070 0x5645aea03670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:55.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.409+0000 7f04d77fe640 1 -- 172.21.15.1:0/3708641089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645ae632390 msgr2=0x5645aea03130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:55.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.409+0000 7f04d77fe640 1 --2- 172.21.15.1:0/3708641089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645ae632390 0x5645aea03130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:55.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.409+0000 7f04d77fe640 1 -- 172.21.15.1:0/3708641089 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645ae9fd4a0 con 0x5645ae62a1b0 2024-09-21T00:58:55.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.409+0000 7f04d67fc640 1 --2- 172.21.15.1:0/3708641089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645ae632390 0x5645aea03130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:55.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.410+0000 7f04d77fe640 1 --2- 172.21.15.1:0/3708641089 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645ae62a1b0 0x5645aea07b70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f04d80521d0 tx=0x7f04d8084040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=921693b948210184 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:55.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.410+0000 7f04bd7fa640 1 -- 172.21.15.1:0/3708641089 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d808b070 con 0x5645ae62a1b0 2024-09-21T00:58:55.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.410+0000 7f04bd7fa640 1 -- 172.21.15.1:0/3708641089 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04d8086040 con 0x5645ae62a1b0 2024-09-21T00:58:55.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.410+0000 7f04bd7fa640 1 -- 172.21.15.1:0/3708641089 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d8082aa0 con 0x5645ae62a1b0 2024-09-21T00:58:55.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.411+0000 7f04e3e2c740 1 -- 172.21.15.1:0/3708641089 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645ae62a1b0 msgr2=0x5645aea07b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:55.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.411+0000 7f04e3e2c740 1 --2- 172.21.15.1:0/3708641089 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645ae62a1b0 0x5645aea07b70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f04d80521d0 tx=0x7f04d8084040 comp rx=0 tx=0).stop 2024-09-21T00:58:55.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.411+0000 7f04e3e2c740 1 -- 172.21.15.1:0/3708641089 shutdown_connections 2024-09-21T00:58:55.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.411+0000 7f04e3e2c740 1 --2- 172.21.15.1:0/3708641089 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ae653070 0x5645aea03670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:55.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.411+0000 7f04e3e2c740 1 --2- 172.21.15.1:0/3708641089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645ae632390 0x5645aea03130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:55.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.411+0000 7f04e3e2c740 1 --2- 172.21.15.1:0/3708641089 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645ae62a1b0 0x5645aea07b70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:55.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.411+0000 7f04e3e2c740 1 -- 172.21.15.1:0/3708641089 >> 172.21.15.1:0/3708641089 conn(0x5645ae647460 msgr2=0x5645aea07460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:55.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.411+0000 7f04e3e2c740 1 -- 172.21.15.1:0/3708641089 shutdown_connections 2024-09-21T00:58:55.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.411+0000 7f04e3e2c740 1 -- 172.21.15.1:0/3708641089 wait complete. 2024-09-21T00:58:55.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.411+0000 7f04e3e2c740 1 -- start start 2024-09-21T00:58:55.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.412+0000 7f04e3e2c740 1 Processor -- start 2024-09-21T00:58:55.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.412+0000 7f04e3e2c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645ae62a1b0 0x5645aea0e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:55.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.412+0000 7f04e3e2c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645ae632390 0x5645aea0bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:55.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.412+0000 7f04e3e2c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ae653070 0x5645aea0c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:55.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.412+0000 7f04e3e2c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f04c400fb20 con 0x5645ae632390 2024-09-21T00:58:55.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.412+0000 7f04e3e2c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f04c400f450 con 0x5645ae653070 2024-09-21T00:58:55.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.412+0000 7f04e3e2c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f04c400c5d0 con 0x5645ae62a1b0 2024-09-21T00:58:55.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.412+0000 7f04e3e2c740 10 client.0 _ll_register_callbacks cb 0x7f04d806a190 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:55.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.412+0000 7f04d67fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645ae632390 0x5645aea0bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:55.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.412+0000 7f04d67fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645ae632390 0x5645aea0bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33846/0 (socket says 172.21.15.1:33846) 2024-09-21T00:58:55.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.412+0000 7f04d67fc640 1 -- 172.21.15.1:0/1439558467 learned_addr learned my addr 172.21.15.1:0/1439558467 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:55.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.412+0000 7f04d77fe640 1 --2- 172.21.15.1:0/1439558467 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645ae62a1b0 0x5645aea0e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:55.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.412+0000 7f04d77fe640 1 --2- 172.21.15.1:0/1439558467 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ae653070 0x5645aea0c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:55.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.413+0000 7f04d67fc640 1 -- 172.21.15.1:0/1439558467 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645ae62a1b0 msgr2=0x5645aea0e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:55.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.413+0000 7f04d67fc640 1 --2- 172.21.15.1:0/1439558467 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645ae62a1b0 0x5645aea0e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:55.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.413+0000 7f04d67fc640 1 -- 172.21.15.1:0/1439558467 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ae653070 msgr2=0x5645aea0c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:55.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.413+0000 7f04d67fc640 1 --2- 172.21.15.1:0/1439558467 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ae653070 0x5645aea0c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:55.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.413+0000 7f04d67fc640 1 -- 172.21.15.1:0/1439558467 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645aea0c760 con 0x5645ae632390 2024-09-21T00:58:55.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.413+0000 7f04d67fc640 1 --2- 172.21.15.1:0/1439558467 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645ae632390 0x5645aea0bce0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f04d00074e0 tx=0x7f04cc012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b82a0390bc9773 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:55.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.413+0000 7f04b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:58:55.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.413+0000 7f04b6ffd640 1 -- 172.21.15.1:0/1439558467 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04cc005250 con 0x5645ae632390 2024-09-21T00:58:55.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.413+0000 7f04e3e2c740 1 -- 172.21.15.1:0/1439558467 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04d8086040 con 0x5645ae632390 2024-09-21T00:58:55.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.413+0000 7f04b6ffd640 1 -- 172.21.15.1:0/1439558467 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f04cc0053f0 con 0x5645ae632390 2024-09-21T00:58:55.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.413+0000 7f04b6ffd640 1 -- 172.21.15.1:0/1439558467 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f04cc0055f0 con 0x5645ae632390 2024-09-21T00:58:55.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.413+0000 7f04e3e2c740 10 client.16074 fetch_fsmap learned FSMap version 31 2024-09-21T00:58:55.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.413+0000 7f04e3e2c740 1 -- 172.21.15.1:0/1439558467 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5645aea82540 con 0x5645ae632390 2024-09-21T00:58:55.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.414+0000 7f04b6ffd640 1 -- 172.21.15.1:0/1439558467 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04d8086040 con 0x5645ae632390 2024-09-21T00:58:55.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.414+0000 7f04b6ffd640 1 -- 172.21.15.1:0/1439558467 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7f04cc00f040 con 0x5645ae632390 2024-09-21T00:58:55.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.414+0000 7f04e3e2c740 10 client.16074 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:58:55.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.414+0000 7f04e3e2c740 10 client.16074 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T00:58:55.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.414+0000 7f04e3e2c740 20 client.16074 populate_metadata read hostname 'smithi001' 2024-09-21T00:58:55.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.414+0000 7f04e3e2c740 1 --2- 172.21.15.1:0/1439558467 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x5645ae5e6da0 0x5645aea84ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:55.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.414+0000 7f04e3e2c740 4 client.16074 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:58:55.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.414+0000 7f04e3e2c740 1 -- 172.21.15.1:0/1439558467 --> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5645ae972df0 con 0x5645ae5e6da0 2024-09-21T00:58:55.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.414+0000 7f04d77fe640 1 --2- 172.21.15.1:0/1439558467 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x5645ae5e6da0 0x5645aea84ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:55.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.414+0000 7f04b6ffd640 10 client.16074 ms_handle_connect on v2:172.21.15.193:6834/3631682268 2024-09-21T00:58:55.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.414+0000 7f04d77fe640 1 --2- 172.21.15.1:0/1439558467 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x5645ae5e6da0 0x5645aea84ce0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9ddd20b649ab45ba server_cookie=d73f3a8b933fbc1a in_seq=0 out_seq=0 2024-09-21T00:58:55.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.415+0000 7f04b6ffd640 1 -- 172.21.15.1:0/1439558467 <== mds.4 v2:172.21.15.193:6834/3631682268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5645ae972df0 con 0x5645ae5e6da0 2024-09-21T00:58:55.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.415+0000 7f04b6ffd640 10 client.16074 handle_command_reply: tid=0 2024-09-21T00:58:55.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.415+0000 7f04e3e2c740 1 client.16074 shutdown 2024-09-21T00:58:55.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.415+0000 7f04e3e2c740 1 -- 172.21.15.1:0/1439558467 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645ae632390 msgr2=0x5645aea0bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:55.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.415+0000 7f04e3e2c740 1 --2- 172.21.15.1:0/1439558467 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645ae632390 0x5645aea0bce0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f04d00074e0 tx=0x7f04cc012820 comp rx=0 tx=0).stop 2024-09-21T00:58:55.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.415+0000 7f04e3e2c740 1 -- 172.21.15.1:0/1439558467 shutdown_connections 2024-09-21T00:58:55.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.415+0000 7f04e3e2c740 1 --2- 172.21.15.1:0/1439558467 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x5645ae5e6da0 0x5645aea84ce0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:55.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.415+0000 7f04e3e2c740 1 --2- 172.21.15.1:0/1439558467 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ae653070 0x5645aea0c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:55.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.415+0000 7f04e3e2c740 1 --2- 172.21.15.1:0/1439558467 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645ae632390 0x5645aea0bce0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:55.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.415+0000 7f04e3e2c740 1 --2- 172.21.15.1:0/1439558467 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5645ae62a1b0 0x5645aea0e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:55.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.415+0000 7f04e3e2c740 1 -- 172.21.15.1:0/1439558467 >> 172.21.15.1:0/1439558467 conn(0x5645ae647460 msgr2=0x5645ae9fdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:55.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.415+0000 7f04b6ffd640 0 client.16074 ms_handle_reset on v2:172.21.15.193:6834/3631682268 2024-09-21T00:58:55.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.416+0000 7f04e3e2c740 1 -- 172.21.15.1:0/1439558467 shutdown_connections 2024-09-21T00:58:55.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.416+0000 7f04e3e2c740 1 -- 172.21.15.1:0/1439558467 wait complete. 2024-09-21T00:58:55.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.416+0000 7f04e3e2c740 20 client.16074 trim_cache size 0 max 16384 2024-09-21T00:58:55.421 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T00:58:55.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.417+0000 7f04d7fff640 1 -- 172.21.15.1:0/2948472571 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f04c00b6610 msgr2=0x7f04c00b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:55.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.417+0000 7f04d7fff640 1 --2- 172.21.15.1:0/2948472571 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f04c00b6610 0x7f04c00b8b20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f04c80db010 tx=0x7f04c8000bc0 comp rx=0 tx=0).stop 2024-09-21T00:58:55.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.417+0000 7f04d7fff640 1 -- 172.21.15.1:0/2948472571 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04d009dc50 msgr2=0x7f04d00a42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:55.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.417+0000 7f04d7fff640 1 --2- 172.21.15.1:0/2948472571 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04d009dc50 0x7f04d00a42e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f04c803ba20 tx=0x7f04c8005440 comp rx=0 tx=0).stop 2024-09-21T00:58:55.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.418+0000 7f04d7fff640 1 -- 172.21.15.1:0/2948472571 shutdown_connections 2024-09-21T00:58:55.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.418+0000 7f04d7fff640 1 --2- 172.21.15.1:0/2948472571 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04d00ae530 0x7f04d00ae940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:55.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.418+0000 7f04d7fff640 1 --2- 172.21.15.1:0/2948472571 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f04c00b6610 0x7f04c00b8b20 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:55.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.418+0000 7f04d7fff640 1 --2- 172.21.15.1:0/2948472571 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04d009e5a0 0x7f04d00a4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:55.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.418+0000 7f04d7fff640 1 --2- 172.21.15.1:0/2948472571 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04d009dc50 0x7f04d00a42e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:55.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.418+0000 7f04d7fff640 1 -- 172.21.15.1:0/2948472571 >> 172.21.15.1:0/2948472571 conn(0x7f04d000fed0 msgr2=0x7f04d009ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:55.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.418+0000 7f04d7fff640 1 -- 172.21.15.1:0/2948472571 shutdown_connections 2024-09-21T00:58:55.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:55.418+0000 7f04d7fff640 1 -- 172.21.15.1:0/2948472571 wait complete. 2024-09-21T00:58:56.172 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:55 smithi001 ceph-mon[31211]: pgmap v409: 97 pgs: 97 active+clean; 80 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 1.8 MiB/s wr, 424 op/s 2024-09-21T00:58:56.200 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T00:58:56.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:55 smithi193 ceph-mon[34660]: pgmap v409: 97 pgs: 97 active+clean; 80 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 1.8 MiB/s wr, 424 op/s 2024-09-21T00:58:56.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:55 smithi042 ceph-mon[34481]: pgmap v409: 97 pgs: 97 active+clean; 80 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 1.8 MiB/s wr, 424 op/s 2024-09-21T00:58:56.484 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:58:56.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.991+0000 7fd1cf7fe640 1 -- 172.21.15.1:0/3327085826 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c40318a0 con 0x7fd1d0103b60 2024-09-21T00:58:56.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.992+0000 7fd1d7089640 1 -- 172.21.15.1:0/3327085826 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1d0103b60 msgr2=0x7fd1d0103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:56.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.992+0000 7fd1d7089640 1 --2- 172.21.15.1:0/3327085826 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1d0103b60 0x7fd1d0103f70 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4009900 tx=0x7fd1c402a410 comp rx=0 tx=0).stop 2024-09-21T00:58:56.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.992+0000 7fd1d7089640 1 -- 172.21.15.1:0/3327085826 shutdown_connections 2024-09-21T00:58:56.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.992+0000 7fd1d7089640 1 --2- 172.21.15.1:0/3327085826 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd1d0109df0 0x7fd1d0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:56.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.992+0000 7fd1d7089640 1 --2- 172.21.15.1:0/3327085826 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1d01094a0 0x7fd1d01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:56.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.992+0000 7fd1d7089640 1 --2- 172.21.15.1:0/3327085826 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1d0103b60 0x7fd1d0103f70 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:56.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.992+0000 7fd1d7089640 1 -- 172.21.15.1:0/3327085826 >> 172.21.15.1:0/3327085826 conn(0x7fd1d007b850 msgr2=0x7fd1d007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:56.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.992+0000 7fd1d7089640 1 -- 172.21.15.1:0/3327085826 shutdown_connections 2024-09-21T00:58:56.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.992+0000 7fd1d7089640 1 -- 172.21.15.1:0/3327085826 wait complete. 2024-09-21T00:58:56.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.993+0000 7fd1d7089640 1 Processor -- start 2024-09-21T00:58:56.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.993+0000 7fd1d7089640 1 -- start start 2024-09-21T00:58:56.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.993+0000 7fd1d7089640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1d0103b60 0x7fd1d019c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:56.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.993+0000 7fd1d7089640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1d01094a0 0x7fd1d019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:56.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.993+0000 7fd1d7089640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd1d0109df0 0x7fd1d01a1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:56.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.993+0000 7fd1d7089640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d0076d50 con 0x7fd1d0103b60 2024-09-21T00:58:56.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.993+0000 7fd1d7089640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d0076bd0 con 0x7fd1d01094a0 2024-09-21T00:58:56.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.993+0000 7fd1d7089640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d0076ed0 con 0x7fd1d0109df0 2024-09-21T00:58:56.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.993+0000 7fd1d4e25640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1d0103b60 0x7fd1d019c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:56.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.993+0000 7fd1d4e25640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1d0103b60 0x7fd1d019c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33864/0 (socket says 172.21.15.1:33864) 2024-09-21T00:58:56.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.993+0000 7fd1d4e25640 1 -- 172.21.15.1:0/1031684827 learned_addr learned my addr 172.21.15.1:0/1031684827 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:56.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.993+0000 7fd1cffff640 1 --2- 172.21.15.1:0/1031684827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1d01094a0 0x7fd1d019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:56.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.993+0000 7fd1d5626640 1 --2- 172.21.15.1:0/1031684827 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd1d0109df0 0x7fd1d01a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:56.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.994+0000 7fd1d4e25640 1 -- 172.21.15.1:0/1031684827 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd1d0109df0 msgr2=0x7fd1d01a1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:56.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.994+0000 7fd1d4e25640 1 --2- 172.21.15.1:0/1031684827 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd1d0109df0 0x7fd1d01a1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:56.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.994+0000 7fd1d4e25640 1 -- 172.21.15.1:0/1031684827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1d01094a0 msgr2=0x7fd1d019cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:56.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.994+0000 7fd1d4e25640 1 --2- 172.21.15.1:0/1031684827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1d01094a0 0x7fd1d019cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:56.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.994+0000 7fd1d4e25640 1 -- 172.21.15.1:0/1031684827 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1d01a2540 con 0x7fd1d0103b60 2024-09-21T00:58:56.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.994+0000 7fd1cffff640 1 --2- 172.21.15.1:0/1031684827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1d01094a0 0x7fd1d019cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:56.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.994+0000 7fd1d4e25640 1 --2- 172.21.15.1:0/1031684827 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1d0103b60 0x7fd1d019c690 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4005940 tx=0x7fd1c4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:56.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.994+0000 7fd1cdffb640 1 -- 172.21.15.1:0/1031684827 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c403f030 con 0x7fd1d0103b60 2024-09-21T00:58:56.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.994+0000 7fd1d7089640 1 -- 172.21.15.1:0/1031684827 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1d01a27d0 con 0x7fd1d0103b60 2024-09-21T00:58:56.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.994+0000 7fd1cdffb640 1 -- 172.21.15.1:0/1031684827 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1c4003aa0 con 0x7fd1d0103b60 2024-09-21T00:58:56.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.994+0000 7fd1cdffb640 1 -- 172.21.15.1:0/1031684827 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4035070 con 0x7fd1d0103b60 2024-09-21T00:58:56.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.994+0000 7fd1d7089640 1 -- 172.21.15.1:0/1031684827 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1d01a2d00 con 0x7fd1d0103b60 2024-09-21T00:58:56.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.998+0000 7fd1dd5fd740 1 Processor -- start 2024-09-21T00:58:56.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.998+0000 7fd1dd5fd740 1 -- start start 2024-09-21T00:58:57.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.999+0000 7fd1dd5fd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564679049070 0x5646793f06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:57.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.999+0000 7fd1dd5fd740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5646790201b0 0x5646793f0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:57.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.999+0000 7fd1dd5fd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564679028390 0x5646793f1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:57.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.999+0000 7fd1dd5fd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564679366ea0 con 0x564679049070 2024-09-21T00:58:57.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.999+0000 7fd1dd5fd740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5646793562d0 con 0x5646790201b0 2024-09-21T00:58:57.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.999+0000 7fd1dd5fd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56467935a0e0 con 0x564679028390 2024-09-21T00:58:57.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.999+0000 7fd1cdffb640 1 -- 172.21.15.1:0/1031684827 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7fd1c4042030 con 0x7fd1d0103b60 2024-09-21T00:58:57.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.999+0000 7fd1cffff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564679028390 0x5646793f1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:57.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.999+0000 7fd1d4e25640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5646790201b0 0x5646793f0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:57.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.999+0000 7fd1cffff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564679028390 0x5646793f1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:46414/0 (socket says 172.21.15.1:46414) 2024-09-21T00:58:57.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.999+0000 7fd1cffff640 1 -- 172.21.15.1:0/3783350646 learned_addr learned my addr 172.21.15.1:0/3783350646 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:57.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.999+0000 7fd1d5626640 1 --2- 172.21.15.1:0/3783350646 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564679049070 0x5646793f06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:57.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.999+0000 7fd1cffff640 1 -- 172.21.15.1:0/3783350646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5646790201b0 msgr2=0x5646793f0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:57.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.999+0000 7fd1cffff640 1 --2- 172.21.15.1:0/3783350646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5646790201b0 0x5646793f0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:57.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.999+0000 7fd1cffff640 1 -- 172.21.15.1:0/3783350646 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564679049070 msgr2=0x5646793f06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:57.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.999+0000 7fd1cffff640 1 --2- 172.21.15.1:0/3783350646 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564679049070 0x5646793f06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:57.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:56.999+0000 7fd1cffff640 1 -- 172.21.15.1:0/3783350646 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646790b4650 con 0x564679028390 2024-09-21T00:58:57.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.000+0000 7fd1cffff640 1 --2- 172.21.15.1:0/3783350646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564679028390 0x5646793f1120 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc011470 tx=0x7fd1bc011930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd12e8dad4a33608 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:57.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.000+0000 7fd1baffd640 1 -- 172.21.15.1:0/3783350646 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc01e070 con 0x564679028390 2024-09-21T00:58:57.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.000+0000 7fd1cdffb640 1 --2- 172.21.15.1:0/1031684827 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd1c00b6540 0x7fd1c00b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:57.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.000+0000 7fd1baffd640 1 -- 172.21.15.1:0/3783350646 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1bc0035f0 con 0x564679028390 2024-09-21T00:58:57.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.000+0000 7fd1baffd640 1 -- 172.21.15.1:0/3783350646 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc00f860 con 0x564679028390 2024-09-21T00:58:57.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.000+0000 7fd1d5626640 1 --2- 172.21.15.1:0/1031684827 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd1c00b6540 0x7fd1c00b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:57.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.000+0000 7fd1cdffb640 1 -- 172.21.15.1:0/1031684827 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fd1c41077a0 con 0x7fd1d0103b60 2024-09-21T00:58:57.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.001+0000 7fd1dd5fd740 1 -- 172.21.15.1:0/3783350646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564679028390 msgr2=0x5646793f1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:57.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.001+0000 7fd1d5626640 1 --2- 172.21.15.1:0/1031684827 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd1c00b6540 0x7fd1c00b8a50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8007f80 tx=0x7fd1c8007520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:57.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.001+0000 7fd1dd5fd740 1 --2- 172.21.15.1:0/3783350646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564679028390 0x5646793f1120 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc011470 tx=0x7fd1bc011930 comp rx=0 tx=0).stop 2024-09-21T00:58:57.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.001+0000 7fd1dd5fd740 1 -- 172.21.15.1:0/3783350646 shutdown_connections 2024-09-21T00:58:57.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.001+0000 7fd1dd5fd740 1 --2- 172.21.15.1:0/3783350646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564679028390 0x5646793f1120 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:57.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.001+0000 7fd1dd5fd740 1 --2- 172.21.15.1:0/3783350646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5646790201b0 0x5646793f0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:57.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.001+0000 7fd1dd5fd740 1 --2- 172.21.15.1:0/3783350646 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564679049070 0x5646793f06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:57.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.001+0000 7fd1dd5fd740 1 -- 172.21.15.1:0/3783350646 >> 172.21.15.1:0/3783350646 conn(0x56467903d460 msgr2=0x5646793ee590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:57.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.001+0000 7fd1dd5fd740 1 -- 172.21.15.1:0/3783350646 shutdown_connections 2024-09-21T00:58:57.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.001+0000 7fd1dd5fd740 1 -- 172.21.15.1:0/3783350646 wait complete. 2024-09-21T00:58:57.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.002+0000 7fd1dd5fd740 1 -- start start 2024-09-21T00:58:57.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.002+0000 7fd1dd5fd740 1 Processor -- start 2024-09-21T00:58:57.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.002+0000 7fd1dd5fd740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5646790201b0 0x5646793fbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:57.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.002+0000 7fd1dd5fd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564679028390 0x5646793fc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:57.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.002+0000 7fd1dd5fd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564679049070 0x5646794081a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:57.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.002+0000 7fd1dd5fd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5646791b7700 con 0x564679049070 2024-09-21T00:58:57.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.002+0000 7fd1dd5fd740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5646792f1160 con 0x5646790201b0 2024-09-21T00:58:57.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.002+0000 7fd1dd5fd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5646793fee80 con 0x564679028390 2024-09-21T00:58:57.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.003+0000 7fd1dd5fd740 10 client.0 _ll_register_callbacks cb 0x56467930a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:57.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.003+0000 7fd1d4e25640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5646790201b0 0x5646793fbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:57.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.003+0000 7fd1d5626640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564679049070 0x5646794081a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:57.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.003+0000 7fd1d4e25640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5646790201b0 0x5646793fbd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:52948/0 (socket says 172.21.15.1:52948) 2024-09-21T00:58:57.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.003+0000 7fd1d4e25640 1 -- 172.21.15.1:0/218173884 learned_addr learned my addr 172.21.15.1:0/218173884 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:57.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.003+0000 7fd1cffff640 1 --2- 172.21.15.1:0/218173884 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564679028390 0x5646793fc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:57.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.003+0000 7fd1d4e25640 1 -- 172.21.15.1:0/218173884 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564679028390 msgr2=0x5646793fc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:57.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.003+0000 7fd1d4e25640 1 --2- 172.21.15.1:0/218173884 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564679028390 0x5646793fc2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:57.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.003+0000 7fd1d4e25640 1 -- 172.21.15.1:0/218173884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564679049070 msgr2=0x5646794081a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:57.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.003+0000 7fd1d4e25640 1 --2- 172.21.15.1:0/218173884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564679049070 0x5646794081a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:57.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.003+0000 7fd1d4e25640 1 -- 172.21.15.1:0/218173884 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56467931ec90 con 0x5646790201b0 2024-09-21T00:58:57.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.003+0000 7fd1cffff640 1 --2- 172.21.15.1:0/218173884 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564679028390 0x5646793fc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:57.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.003+0000 7fd1d5626640 1 --2- 172.21.15.1:0/218173884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564679049070 0x5646794081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:57.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.003+0000 7fd1d4e25640 1 --2- 172.21.15.1:0/218173884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5646790201b0 0x5646793fbd90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4105280 tx=0x7fd1c4009620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df3f1325cf0e010 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:57.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.003+0000 7fd1affff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T00:58:57.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.003+0000 7fd1affff640 1 -- 172.21.15.1:0/218173884 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4107e60 con 0x5646790201b0 2024-09-21T00:58:57.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.003+0000 7fd1dd5fd740 1 -- 172.21.15.1:0/218173884 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1bc0035f0 con 0x5646790201b0 2024-09-21T00:58:57.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.003+0000 7fd1affff640 1 -- 172.21.15.1:0/218173884 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fd1c40d6ea0 con 0x5646790201b0 2024-09-21T00:58:57.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.004+0000 7fd1affff640 1 -- 172.21.15.1:0/218173884 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd1c4049030 con 0x5646790201b0 2024-09-21T00:58:57.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.004+0000 7fd1dd5fd740 10 client.25751 fetch_fsmap learned FSMap version 31 2024-09-21T00:58:57.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.004+0000 7fd1dd5fd740 1 -- 172.21.15.1:0/218173884 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56467940ab90 con 0x5646790201b0 2024-09-21T00:58:57.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.004+0000 7fd1affff640 1 -- 172.21.15.1:0/218173884 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1bc0035f0 con 0x5646790201b0 2024-09-21T00:58:57.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.004+0000 7fd1affff640 1 -- 172.21.15.1:0/218173884 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7fd1c40ccc20 con 0x5646790201b0 2024-09-21T00:58:57.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.004+0000 7fd1dd5fd740 10 client.25751 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:58:57.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.004+0000 7fd1dd5fd740 10 client.25751 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-21T00:58:57.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.004+0000 7fd1dd5fd740 20 client.25751 populate_metadata read hostname 'smithi001' 2024-09-21T00:58:57.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.004+0000 7fd1dd5fd740 1 --2- 172.21.15.1:0/218173884 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x5646790079f0 0x56467940e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:57.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.004+0000 7fd1dd5fd740 4 client.25751 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:58:57.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.004+0000 7fd1dd5fd740 1 -- 172.21.15.1:0/218173884 --> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564679368df0 con 0x5646790079f0 2024-09-21T00:58:57.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.005+0000 7fd1cffff640 1 --2- 172.21.15.1:0/218173884 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x5646790079f0 0x56467940e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:57.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.005+0000 7fd1cffff640 1 --2- 172.21.15.1:0/218173884 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x5646790079f0 0x56467940e090 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=bc1ccc791cf95e1 server_cookie=49bf9c945e8492ac in_seq=0 out_seq=0 2024-09-21T00:58:57.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.005+0000 7fd1affff640 10 client.25751 ms_handle_connect on v2:172.21.15.193:6836/909252228 2024-09-21T00:58:57.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.006+0000 7fd1affff640 1 -- 172.21.15.1:0/218173884 <== mds.3 v2:172.21.15.193:6836/909252228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564679368df0 con 0x5646790079f0 2024-09-21T00:58:57.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.006+0000 7fd1affff640 10 client.25751 handle_command_reply: tid=0 2024-09-21T00:58:57.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.006+0000 7fd1dd5fd740 1 client.25751 shutdown 2024-09-21T00:58:57.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.006+0000 7fd1dd5fd740 1 -- 172.21.15.1:0/218173884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5646790201b0 msgr2=0x5646793fbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:57.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.006+0000 7fd1dd5fd740 1 --2- 172.21.15.1:0/218173884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5646790201b0 0x5646793fbd90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4105280 tx=0x7fd1c4009620 comp rx=0 tx=0).stop 2024-09-21T00:58:57.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.006+0000 7fd1dd5fd740 1 -- 172.21.15.1:0/218173884 shutdown_connections 2024-09-21T00:58:57.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.006+0000 7fd1dd5fd740 1 --2- 172.21.15.1:0/218173884 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x5646790079f0 0x56467940e090 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:57.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.006+0000 7fd1dd5fd740 1 --2- 172.21.15.1:0/218173884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564679049070 0x5646794081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:57.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.006+0000 7fd1dd5fd740 1 --2- 172.21.15.1:0/218173884 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564679028390 0x5646793fc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:57.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.006+0000 7fd1affff640 0 client.25751 ms_handle_reset on v2:172.21.15.193:6836/909252228 2024-09-21T00:58:57.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.006+0000 7fd1dd5fd740 1 --2- 172.21.15.1:0/218173884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5646790201b0 0x5646793fbd90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:57.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.006+0000 7fd1dd5fd740 1 -- 172.21.15.1:0/218173884 >> 172.21.15.1:0/218173884 conn(0x56467903d460 msgr2=0x5646793f3880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:57.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.006+0000 7fd1dd5fd740 1 -- 172.21.15.1:0/218173884 shutdown_connections 2024-09-21T00:58:57.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.006+0000 7fd1dd5fd740 1 -- 172.21.15.1:0/218173884 wait complete. 2024-09-21T00:58:57.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.006+0000 7fd1dd5fd740 20 client.25751 trim_cache size 0 max 16384 2024-09-21T00:58:57.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.021+0000 7fd1dd5fd740 1 Processor -- start 2024-09-21T00:58:57.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.022+0000 7fd1dd5fd740 1 -- start start 2024-09-21T00:58:57.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.022+0000 7fd1dd5fd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646790201b0 0x5646793f37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:57.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.022+0000 7fd1dd5fd740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564679028390 0x5646793f3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:57.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.022+0000 7fd1dd5fd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564679049070 0x5646793f8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:57.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.022+0000 7fd1dd5fd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d01b15c0 con 0x5646790201b0 2024-09-21T00:58:57.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.022+0000 7fd1dd5fd740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d01b3280 con 0x564679028390 2024-09-21T00:58:57.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.022+0000 7fd1dd5fd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d01b1c90 con 0x564679049070 2024-09-21T00:58:57.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.022+0000 7fd1d4e25640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646790201b0 0x5646793f37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:57.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.022+0000 7fd1d4e25640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646790201b0 0x5646793f37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33896/0 (socket says 172.21.15.1:33896) 2024-09-21T00:58:57.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.022+0000 7fd1d4e25640 1 -- 172.21.15.1:0/271636705 learned_addr learned my addr 172.21.15.1:0/271636705 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:57.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.022+0000 7fd1cffff640 1 --2- 172.21.15.1:0/271636705 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564679028390 0x5646793f3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:57.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.022+0000 7fd1d5626640 1 --2- 172.21.15.1:0/271636705 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564679049070 0x5646793f8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:57.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.022+0000 7fd1d4e25640 1 -- 172.21.15.1:0/271636705 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564679049070 msgr2=0x5646793f8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:57.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.022+0000 7fd1d4e25640 1 --2- 172.21.15.1:0/271636705 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564679049070 0x5646793f8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:57.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.022+0000 7fd1d4e25640 1 -- 172.21.15.1:0/271636705 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564679028390 msgr2=0x5646793f3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:57.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.022+0000 7fd1d4e25640 1 --2- 172.21.15.1:0/271636705 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564679028390 0x5646793f3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:57.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.022+0000 7fd1d4e25640 1 -- 172.21.15.1:0/271636705 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646793f14b0 con 0x5646790201b0 2024-09-21T00:58:57.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.022+0000 7fd1d5626640 1 --2- 172.21.15.1:0/271636705 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564679049070 0x5646793f8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:58:57.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.023+0000 7fd1d4e25640 1 --2- 172.21.15.1:0/271636705 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646790201b0 0x5646793f37a0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd1c40cd6c0 tx=0x7fd1c40c9220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48db039722269ffa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:57.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.023+0000 7fd1ba7fc640 1 -- 172.21.15.1:0/271636705 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c40cd310 con 0x5646790201b0 2024-09-21T00:58:57.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.023+0000 7fd1ba7fc640 1 -- 172.21.15.1:0/271636705 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1c40cd4d0 con 0x5646790201b0 2024-09-21T00:58:57.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.023+0000 7fd1ba7fc640 1 -- 172.21.15.1:0/271636705 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c40c9c30 con 0x5646790201b0 2024-09-21T00:58:57.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.024+0000 7fd1dd5fd740 1 -- 172.21.15.1:0/271636705 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646790201b0 msgr2=0x5646793f37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:57.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.024+0000 7fd1dd5fd740 1 --2- 172.21.15.1:0/271636705 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646790201b0 0x5646793f37a0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd1c40cd6c0 tx=0x7fd1c40c9220 comp rx=0 tx=0).stop 2024-09-21T00:58:57.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.024+0000 7fd1dd5fd740 1 -- 172.21.15.1:0/271636705 shutdown_connections 2024-09-21T00:58:57.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.024+0000 7fd1dd5fd740 1 --2- 172.21.15.1:0/271636705 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564679049070 0x5646793f8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:57.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.024+0000 7fd1dd5fd740 1 --2- 172.21.15.1:0/271636705 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564679028390 0x5646793f3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:57.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.024+0000 7fd1dd5fd740 1 --2- 172.21.15.1:0/271636705 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646790201b0 0x5646793f37a0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:57.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.024+0000 7fd1dd5fd740 1 -- 172.21.15.1:0/271636705 >> 172.21.15.1:0/271636705 conn(0x56467903d460 msgr2=0x5646793fa610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:57.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.024+0000 7fd1dd5fd740 1 -- 172.21.15.1:0/271636705 shutdown_connections 2024-09-21T00:58:57.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.024+0000 7fd1dd5fd740 1 -- 172.21.15.1:0/271636705 wait complete. 2024-09-21T00:58:57.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.024+0000 7fd1dd5fd740 1 -- start start 2024-09-21T00:58:57.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.024+0000 7fd1dd5fd740 1 Processor -- start 2024-09-21T00:58:57.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.025+0000 7fd1dd5fd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646790201b0 0x564679400800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:57.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.025+0000 7fd1dd5fd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564679028390 0x564679400d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:57.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.025+0000 7fd1dd5fd740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564679049070 0x564679477a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:57.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.025+0000 7fd1dd5fd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d01b2af0 con 0x5646790201b0 2024-09-21T00:58:57.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.025+0000 7fd1dd5fd740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d01b2420 con 0x564679049070 2024-09-21T00:58:57.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.025+0000 7fd1dd5fd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d01af5a0 con 0x564679028390 2024-09-21T00:58:57.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.025+0000 7fd1dd5fd740 10 client.0 _ll_register_callbacks cb 0x7fd1c4005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:57.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.025+0000 7fd1d4e25640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646790201b0 0x564679400800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:57.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.025+0000 7fd1d4e25640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646790201b0 0x564679400800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33912/0 (socket says 172.21.15.1:33912) 2024-09-21T00:58:57.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.025+0000 7fd1d4e25640 1 -- 172.21.15.1:0/2579287406 learned_addr learned my addr 172.21.15.1:0/2579287406 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:57.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.025+0000 7fd1d5626640 1 --2- 172.21.15.1:0/2579287406 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564679049070 0x564679477a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:57.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.025+0000 7fd1d4e25640 1 -- 172.21.15.1:0/2579287406 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564679028390 msgr2=0x564679400d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:57.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.025+0000 7fd1cffff640 1 --2- 172.21.15.1:0/2579287406 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564679028390 0x564679400d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:57.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.025+0000 7fd1d4e25640 1 --2- 172.21.15.1:0/2579287406 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564679028390 0x564679400d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:57.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.025+0000 7fd1d4e25640 1 -- 172.21.15.1:0/2579287406 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564679049070 msgr2=0x564679477a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:57.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.025+0000 7fd1d4e25640 1 --2- 172.21.15.1:0/2579287406 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564679049070 0x564679477a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:57.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.025+0000 7fd1d4e25640 1 -- 172.21.15.1:0/2579287406 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564679477fd0 con 0x5646790201b0 2024-09-21T00:58:57.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.026+0000 7fd1d4e25640 1 --2- 172.21.15.1:0/2579287406 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646790201b0 0x564679400800 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd1c40cd950 tx=0x7fd1c40cd060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db4e91c099505ce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:57.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.026+0000 7fd1affff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:58:57.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.026+0000 7fd1affff640 1 -- 172.21.15.1:0/2579287406 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c40cd310 con 0x5646790201b0 2024-09-21T00:58:57.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.026+0000 7fd1affff640 1 -- 172.21.15.1:0/2579287406 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fd1c40d6ea0 con 0x5646790201b0 2024-09-21T00:58:57.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.026+0000 7fd1dd5fd740 1 -- 172.21.15.1:0/2579287406 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1c40cd4d0 con 0x5646790201b0 2024-09-21T00:58:57.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.026+0000 7fd1affff640 1 -- 172.21.15.1:0/2579287406 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd1c40d7330 con 0x5646790201b0 2024-09-21T00:58:57.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.026+0000 7fd1dd5fd740 10 client.16092 fetch_fsmap learned FSMap version 31 2024-09-21T00:58:57.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.026+0000 7fd1dd5fd740 1 -- 172.21.15.1:0/2579287406 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564679477fd0 con 0x5646790201b0 2024-09-21T00:58:57.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.026+0000 7fd1affff640 1 -- 172.21.15.1:0/2579287406 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1c40cd4d0 con 0x5646790201b0 2024-09-21T00:58:57.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.026+0000 7fd1affff640 1 -- 172.21.15.1:0/2579287406 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7fd1c40c93a0 con 0x5646790201b0 2024-09-21T00:58:57.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.026+0000 7fd1dd5fd740 10 client.16092 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:58:57.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.026+0000 7fd1dd5fd740 10 client.16092 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-21T00:58:57.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.026+0000 7fd1dd5fd740 20 client.16092 populate_metadata read hostname 'smithi001' 2024-09-21T00:58:57.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.026+0000 7fd1dd5fd740 1 --2- 172.21.15.1:0/2579287406 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x564678fdcda0 0x56467947b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:57.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.026+0000 7fd1dd5fd740 4 client.16092 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:58:57.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.027+0000 7fd1dd5fd740 1 -- 172.21.15.1:0/2579287406 --> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5646793648a0 con 0x564678fdcda0 2024-09-21T00:58:57.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.027+0000 7fd1cffff640 1 --2- 172.21.15.1:0/2579287406 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x564678fdcda0 0x56467947b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:57.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.027+0000 7fd1cffff640 1 --2- 172.21.15.1:0/2579287406 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x564678fdcda0 0x56467947b4c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a70d52349aed5938 server_cookie=d7efe2852c453914 in_seq=0 out_seq=0 2024-09-21T00:58:57.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.027+0000 7fd1affff640 10 client.16092 ms_handle_connect on v2:172.21.15.193:6836/909252228 2024-09-21T00:58:57.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.028+0000 7fd1affff640 1 -- 172.21.15.1:0/2579287406 <== mds.3 v2:172.21.15.193:6836/909252228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5646793648a0 con 0x564678fdcda0 2024-09-21T00:58:57.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.028+0000 7fd1affff640 10 client.16092 handle_command_reply: tid=0 2024-09-21T00:58:57.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.028+0000 7fd1dd5fd740 1 client.16092 shutdown 2024-09-21T00:58:57.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.028+0000 7fd1dd5fd740 1 -- 172.21.15.1:0/2579287406 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646790201b0 msgr2=0x564679400800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:57.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.028+0000 7fd1dd5fd740 1 --2- 172.21.15.1:0/2579287406 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646790201b0 0x564679400800 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd1c40cd950 tx=0x7fd1c40cd060 comp rx=0 tx=0).stop 2024-09-21T00:58:57.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.028+0000 7fd1dd5fd740 1 -- 172.21.15.1:0/2579287406 shutdown_connections 2024-09-21T00:58:57.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.028+0000 7fd1dd5fd740 1 --2- 172.21.15.1:0/2579287406 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x564678fdcda0 0x56467947b4c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:57.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.028+0000 7fd1dd5fd740 1 --2- 172.21.15.1:0/2579287406 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564679049070 0x564679477a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:57.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.028+0000 7fd1dd5fd740 1 --2- 172.21.15.1:0/2579287406 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564679028390 0x564679400d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:57.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.028+0000 7fd1dd5fd740 1 --2- 172.21.15.1:0/2579287406 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646790201b0 0x564679400800 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:57.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.028+0000 7fd1dd5fd740 1 -- 172.21.15.1:0/2579287406 >> 172.21.15.1:0/2579287406 conn(0x56467903d460 msgr2=0x5646793f37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:57.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.028+0000 7fd1affff640 0 client.16092 ms_handle_reset on v2:172.21.15.193:6836/909252228 2024-09-21T00:58:57.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.029+0000 7fd1dd5fd740 1 -- 172.21.15.1:0/2579287406 shutdown_connections 2024-09-21T00:58:57.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.029+0000 7fd1dd5fd740 1 -- 172.21.15.1:0/2579287406 wait complete. 2024-09-21T00:58:57.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.029+0000 7fd1dd5fd740 20 client.16092 trim_cache size 0 max 16384 2024-09-21T00:58:57.034 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T00:58:57.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.030+0000 7fd1d7089640 1 -- 172.21.15.1:0/1031684827 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd1c00b6540 msgr2=0x7fd1c00b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:57.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.030+0000 7fd1d7089640 1 --2- 172.21.15.1:0/1031684827 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd1c00b6540 0x7fd1c00b8a50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8007f80 tx=0x7fd1c8007520 comp rx=0 tx=0).stop 2024-09-21T00:58:57.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.030+0000 7fd1d7089640 1 -- 172.21.15.1:0/1031684827 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1d0103b60 msgr2=0x7fd1d019c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:57.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.030+0000 7fd1d7089640 1 --2- 172.21.15.1:0/1031684827 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1d0103b60 0x7fd1d019c690 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4005940 tx=0x7fd1c4004270 comp rx=0 tx=0).stop 2024-09-21T00:58:57.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.030+0000 7fd1d7089640 1 -- 172.21.15.1:0/1031684827 shutdown_connections 2024-09-21T00:58:57.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.030+0000 7fd1d7089640 1 --2- 172.21.15.1:0/1031684827 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd1d0109df0 0x7fd1d01a1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:57.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.030+0000 7fd1d7089640 1 --2- 172.21.15.1:0/1031684827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1d01094a0 0x7fd1d019cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:57.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.030+0000 7fd1d7089640 1 --2- 172.21.15.1:0/1031684827 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd1c00b6540 0x7fd1c00b8a50 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:57.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.030+0000 7fd1d7089640 1 --2- 172.21.15.1:0/1031684827 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1d0103b60 0x7fd1d019c690 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:57.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.030+0000 7fd1d7089640 1 -- 172.21.15.1:0/1031684827 >> 172.21.15.1:0/1031684827 conn(0x7fd1d007b850 msgr2=0x7fd1d01072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:57.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.031+0000 7fd1d7089640 1 -- 172.21.15.1:0/1031684827 shutdown_connections 2024-09-21T00:58:57.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:57.031+0000 7fd1d7089640 1 -- 172.21.15.1:0/1031684827 wait complete. 2024-09-21T00:58:57.989 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T00:58:58.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:57 smithi001 ceph-mon[31211]: pgmap v410: 97 pgs: 97 active+clean; 119 MiB data, 523 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.0 MiB/s wr, 583 op/s 2024-09-21T00:58:58.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:57 smithi193 ceph-mon[34660]: pgmap v410: 97 pgs: 97 active+clean; 119 MiB data, 523 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.0 MiB/s wr, 583 op/s 2024-09-21T00:58:58.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:57 smithi042 ceph-mon[34481]: pgmap v410: 97 pgs: 97 active+clean; 119 MiB data, 523 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.0 MiB/s wr, 583 op/s 2024-09-21T00:58:58.255 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:58:58.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.756+0000 7f6d33286640 1 -- 172.21.15.1:0/1716913927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d2c102ab0 msgr2=0x7f6d2c102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:58.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.756+0000 7f6d33286640 1 --2- 172.21.15.1:0/1716913927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d2c102ab0 0x7f6d2c102ec0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f6d28009900 tx=0x7f6d2802a410 comp rx=0 tx=0).stop 2024-09-21T00:58:58.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.756+0000 7f6d33286640 1 -- 172.21.15.1:0/1716913927 shutdown_connections 2024-09-21T00:58:58.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.756+0000 7f6d33286640 1 --2- 172.21.15.1:0/1716913927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d2c108d40 0x7f6d2c10f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:58.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.756+0000 7f6d33286640 1 --2- 172.21.15.1:0/1716913927 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d2c1083f0 0x7f6d2c108800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:58.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.756+0000 7f6d33286640 1 --2- 172.21.15.1:0/1716913927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d2c102ab0 0x7f6d2c102ec0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:58.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.756+0000 7f6d33286640 1 -- 172.21.15.1:0/1716913927 >> 172.21.15.1:0/1716913927 conn(0x7f6d2c079670 msgr2=0x7f6d2c079a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:58.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.756+0000 7f6d33286640 1 -- 172.21.15.1:0/1716913927 shutdown_connections 2024-09-21T00:58:58.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.756+0000 7f6d33286640 1 -- 172.21.15.1:0/1716913927 wait complete. 2024-09-21T00:58:58.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.757+0000 7f6d33286640 1 Processor -- start 2024-09-21T00:58:58.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.757+0000 7f6d33286640 1 -- start start 2024-09-21T00:58:58.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.757+0000 7f6d33286640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d2c102ab0 0x7f6d2c19b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:58.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.757+0000 7f6d33286640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d2c1083f0 0x7f6d2c19b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:58.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.757+0000 7f6d33286640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d2c108d40 0x7f6d2c19bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:58.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.758+0000 7f6d33286640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c112a00 con 0x7f6d2c102ab0 2024-09-21T00:58:58.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.758+0000 7f6d33286640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c112880 con 0x7f6d2c108d40 2024-09-21T00:58:58.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.758+0000 7f6d33286640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c112b80 con 0x7f6d2c1083f0 2024-09-21T00:58:58.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.758+0000 7f6d31022640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d2c102ab0 0x7f6d2c19b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:58.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.758+0000 7f6d31022640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d2c102ab0 0x7f6d2c19b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33918/0 (socket says 172.21.15.1:33918) 2024-09-21T00:58:58.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.758+0000 7f6d31022640 1 -- 172.21.15.1:0/887985032 learned_addr learned my addr 172.21.15.1:0/887985032 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:58.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.758+0000 7f6d31823640 1 --2- 172.21.15.1:0/887985032 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d2c108d40 0x7f6d2c19bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:58.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.758+0000 7f6d30821640 1 --2- 172.21.15.1:0/887985032 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d2c1083f0 0x7f6d2c19b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:58.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.758+0000 7f6d31022640 1 -- 172.21.15.1:0/887985032 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d2c1083f0 msgr2=0x7f6d2c19b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:58.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.758+0000 7f6d31022640 1 --2- 172.21.15.1:0/887985032 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d2c1083f0 0x7f6d2c19b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:58.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.758+0000 7f6d31022640 1 -- 172.21.15.1:0/887985032 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d2c108d40 msgr2=0x7f6d2c19bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:58.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.758+0000 7f6d31022640 1 --2- 172.21.15.1:0/887985032 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d2c108d40 0x7f6d2c19bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:58.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.758+0000 7f6d31022640 1 -- 172.21.15.1:0/887985032 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d2c1a6570 con 0x7f6d2c102ab0 2024-09-21T00:58:58.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.758+0000 7f6d30821640 1 --2- 172.21.15.1:0/887985032 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d2c1083f0 0x7f6d2c19b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:58:58.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.758+0000 7f6d31022640 1 --2- 172.21.15.1:0/887985032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d2c102ab0 0x7f6d2c19b2b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f6d28005940 tx=0x7f6d28004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:58.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.758+0000 7f6d227fc640 1 -- 172.21.15.1:0/887985032 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d2803f030 con 0x7f6d2c102ab0 2024-09-21T00:58:58.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.758+0000 7f6d33286640 1 -- 172.21.15.1:0/887985032 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d2c1a6800 con 0x7f6d2c102ab0 2024-09-21T00:58:58.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.758+0000 7f6d227fc640 1 -- 172.21.15.1:0/887985032 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d28003aa0 con 0x7f6d2c102ab0 2024-09-21T00:58:58.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.759+0000 7f6d227fc640 1 -- 172.21.15.1:0/887985032 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d28035070 con 0x7f6d2c102ab0 2024-09-21T00:58:58.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.759+0000 7f6d33286640 1 -- 172.21.15.1:0/887985032 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d2c1a6d30 con 0x7f6d2c102ab0 2024-09-21T00:58:58.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.762+0000 7f6d397fa740 1 Processor -- start 2024-09-21T00:58:58.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.762+0000 7f6d397fa740 1 -- start start 2024-09-21T00:58:58.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.762+0000 7f6d397fa740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562f31543070 0x562f318ea6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:58.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.762+0000 7f6d397fa740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f3151a1b0 0x562f318eabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:58.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.762+0000 7f6d397fa740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f31522390 0x562f318eb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:58.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.762+0000 7f6d397fa740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562f31860ea0 con 0x562f31522390 2024-09-21T00:58:58.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.762+0000 7f6d397fa740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562f318502d0 con 0x562f3151a1b0 2024-09-21T00:58:58.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.762+0000 7f6d397fa740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x562f318540e0 con 0x562f31543070 2024-09-21T00:58:58.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.762+0000 7f6d227fc640 1 -- 172.21.15.1:0/887985032 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f6d28042030 con 0x7f6d2c102ab0 2024-09-21T00:58:58.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.762+0000 7f6d30821640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f31522390 0x562f318eb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:58.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.762+0000 7f6d31823640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562f31543070 0x562f318ea6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:58.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.762+0000 7f6d30821640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f31522390 0x562f318eb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33924/0 (socket says 172.21.15.1:33924) 2024-09-21T00:58:58.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.763+0000 7f6d30821640 1 -- 172.21.15.1:0/1074135647 learned_addr learned my addr 172.21.15.1:0/1074135647 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:58.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.763+0000 7f6d31823640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562f31543070 0x562f318ea6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:46482/0 (socket says 172.21.15.1:46482) 2024-09-21T00:58:58.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.763+0000 7f6d31022640 1 --2- 172.21.15.1:0/1074135647 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f3151a1b0 0x562f318eabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:58.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.763+0000 7f6d30821640 1 -- 172.21.15.1:0/1074135647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562f31543070 msgr2=0x562f318ea6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:58.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.763+0000 7f6d30821640 1 --2- 172.21.15.1:0/1074135647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562f31543070 0x562f318ea6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:58.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.763+0000 7f6d30821640 1 -- 172.21.15.1:0/1074135647 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f3151a1b0 msgr2=0x562f318eabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:58.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.763+0000 7f6d30821640 1 --2- 172.21.15.1:0/1074135647 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f3151a1b0 0x562f318eabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:58.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.763+0000 7f6d30821640 1 -- 172.21.15.1:0/1074135647 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f315ae650 con 0x562f31522390 2024-09-21T00:58:58.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.763+0000 7f6d31823640 1 --2- 172.21.15.1:0/1074135647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562f31543070 0x562f318ea6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:58.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.763+0000 7f6d30821640 1 --2- 172.21.15.1:0/1074135647 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f31522390 0x562f318eb120 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c00bcd0 tx=0x7f6d1c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe9b1f3af9d60f5a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:58.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.763+0000 7f6d177fe640 1 -- 172.21.15.1:0/1074135647 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c005020 con 0x562f31522390 2024-09-21T00:58:58.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.763+0000 7f6d177fe640 1 -- 172.21.15.1:0/1074135647 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d1c0047a0 con 0x562f31522390 2024-09-21T00:58:58.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.763+0000 7f6d177fe640 1 -- 172.21.15.1:0/1074135647 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c0116a0 con 0x562f31522390 2024-09-21T00:58:58.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.763+0000 7f6d227fc640 1 --2- 172.21.15.1:0/887985032 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6d180b6590 0x7f6d180b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:58.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.764+0000 7f6d31823640 1 --2- 172.21.15.1:0/887985032 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6d180b6590 0x7f6d180b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:58.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.764+0000 7f6d227fc640 1 -- 172.21.15.1:0/887985032 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f6d28107770 con 0x7f6d2c102ab0 2024-09-21T00:58:58.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.764+0000 7f6d397fa740 1 -- 172.21.15.1:0/1074135647 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f31522390 msgr2=0x562f318eb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:58.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.764+0000 7f6d31823640 1 --2- 172.21.15.1:0/887985032 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6d180b6590 0x7f6d180b8aa0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6d24009fd0 tx=0x7f6d24009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:58.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.764+0000 7f6d397fa740 1 --2- 172.21.15.1:0/1074135647 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f31522390 0x562f318eb120 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c00bcd0 tx=0x7f6d1c00f730 comp rx=0 tx=0).stop 2024-09-21T00:58:58.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.764+0000 7f6d397fa740 1 -- 172.21.15.1:0/1074135647 shutdown_connections 2024-09-21T00:58:58.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.764+0000 7f6d397fa740 1 --2- 172.21.15.1:0/1074135647 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f31522390 0x562f318eb120 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:58.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.764+0000 7f6d397fa740 1 --2- 172.21.15.1:0/1074135647 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f3151a1b0 0x562f318eabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:58.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.764+0000 7f6d397fa740 1 --2- 172.21.15.1:0/1074135647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562f31543070 0x562f318ea6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:58.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.764+0000 7f6d397fa740 1 -- 172.21.15.1:0/1074135647 >> 172.21.15.1:0/1074135647 conn(0x562f31537460 msgr2=0x562f318e8590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:58.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.764+0000 7f6d397fa740 1 -- 172.21.15.1:0/1074135647 shutdown_connections 2024-09-21T00:58:58.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.765+0000 7f6d397fa740 1 -- 172.21.15.1:0/1074135647 wait complete. 2024-09-21T00:58:58.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.765+0000 7f6d397fa740 1 -- start start 2024-09-21T00:58:58.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.765+0000 7f6d397fa740 1 Processor -- start 2024-09-21T00:58:58.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.766+0000 7f6d397fa740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f3151a1b0 0x562f318f5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:58.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.766+0000 7f6d397fa740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562f31522390 0x562f318f6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:58.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.766+0000 7f6d397fa740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f31543070 0x562f319021a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:58.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.766+0000 7f6d397fa740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562f316b1700 con 0x562f31543070 2024-09-21T00:58:58.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.766+0000 7f6d397fa740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562f317eb160 con 0x562f3151a1b0 2024-09-21T00:58:58.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.766+0000 7f6d397fa740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x562f318f8e80 con 0x562f31522390 2024-09-21T00:58:58.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.766+0000 7f6d397fa740 10 client.0 _ll_register_callbacks cb 0x562f318049e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:58.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.766+0000 7f6d31823640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f31543070 0x562f319021a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:58.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.766+0000 7f6d31022640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f3151a1b0 0x562f318f5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:58.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.766+0000 7f6d31022640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f3151a1b0 0x562f318f5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:52996/0 (socket says 172.21.15.1:52996) 2024-09-21T00:58:58.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.766+0000 7f6d31022640 1 -- 172.21.15.1:0/2360027717 learned_addr learned my addr 172.21.15.1:0/2360027717 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:58.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.766+0000 7f6d31823640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f31543070 0x562f319021a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33936/0 (socket says 172.21.15.1:33936) 2024-09-21T00:58:58.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.766+0000 7f6d30821640 1 --2- 172.21.15.1:0/2360027717 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562f31522390 0x562f318f6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:58.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.766+0000 7f6d31823640 1 -- 172.21.15.1:0/2360027717 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562f31522390 msgr2=0x562f318f6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:58.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.766+0000 7f6d31823640 1 --2- 172.21.15.1:0/2360027717 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562f31522390 0x562f318f6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:58.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.766+0000 7f6d31823640 1 -- 172.21.15.1:0/2360027717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f3151a1b0 msgr2=0x562f318f5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:58.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.766+0000 7f6d31823640 1 --2- 172.21.15.1:0/2360027717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f3151a1b0 0x562f318f5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:58.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.766+0000 7f6d31823640 1 -- 172.21.15.1:0/2360027717 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f31818c90 con 0x562f31543070 2024-09-21T00:58:58.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.766+0000 7f6d31022640 1 --2- 172.21.15.1:0/2360027717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f3151a1b0 0x562f318f5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:58.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.766+0000 7f6d31823640 1 --2- 172.21.15.1:0/2360027717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f31543070 0x562f319021a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f6d24009d20 tx=0x7f6d24004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d21a0eb4911205ad server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:58.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.766+0000 7f6d14ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:58:58.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.767+0000 7f6d14ff9640 1 -- 172.21.15.1:0/2360027717 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d24003c40 con 0x562f31543070 2024-09-21T00:58:58.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.767+0000 7f6d14ff9640 1 -- 172.21.15.1:0/2360027717 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f6d24017030 con 0x562f31543070 2024-09-21T00:58:58.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.767+0000 7f6d397fa740 1 -- 172.21.15.1:0/2360027717 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d1c0047a0 con 0x562f31543070 2024-09-21T00:58:58.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.767+0000 7f6d14ff9640 1 -- 172.21.15.1:0/2360027717 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f6d24003de0 con 0x562f31543070 2024-09-21T00:58:58.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.767+0000 7f6d397fa740 10 client.16104 fetch_fsmap learned FSMap version 31 2024-09-21T00:58:58.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.767+0000 7f6d397fa740 1 -- 172.21.15.1:0/2360027717 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562f31904bc0 con 0x562f31543070 2024-09-21T00:58:58.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.767+0000 7f6d14ff9640 1 -- 172.21.15.1:0/2360027717 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d1c0047a0 con 0x562f31543070 2024-09-21T00:58:58.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.767+0000 7f6d14ff9640 1 -- 172.21.15.1:0/2360027717 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7f6d2401f8d0 con 0x562f31543070 2024-09-21T00:58:58.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.767+0000 7f6d397fa740 10 client.16104 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:58:58.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.767+0000 7f6d397fa740 10 client.16104 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T00:58:58.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.767+0000 7f6d397fa740 20 client.16104 populate_metadata read hostname 'smithi001' 2024-09-21T00:58:58.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.767+0000 7f6d397fa740 1 --2- 172.21.15.1:0/2360027717 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x562f315019f0 0x562f31908180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:58.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.767+0000 7f6d397fa740 4 client.16104 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:58:58.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.767+0000 7f6d397fa740 1 -- 172.21.15.1:0/2360027717 --> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f31862df0 con 0x562f315019f0 2024-09-21T00:58:58.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.768+0000 7f6d31022640 1 --2- 172.21.15.1:0/2360027717 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x562f315019f0 0x562f31908180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:58.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.768+0000 7f6d31022640 1 --2- 172.21.15.1:0/2360027717 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x562f315019f0 0x562f31908180 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ea2bb5198e522835 server_cookie=99a9231ff7dff069 in_seq=0 out_seq=0 2024-09-21T00:58:58.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.768+0000 7f6d14ff9640 10 client.16104 ms_handle_connect on v2:172.21.15.42:6836/2395608508 2024-09-21T00:58:58.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.831+0000 7f6d14ff9640 1 -- 172.21.15.1:0/2360027717 <== mds.2 v2:172.21.15.42:6836/2395608508 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562f31862df0 con 0x562f315019f0 2024-09-21T00:58:58.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.831+0000 7f6d14ff9640 10 client.16104 handle_command_reply: tid=0 2024-09-21T00:58:58.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.831+0000 7f6d397fa740 1 client.16104 shutdown 2024-09-21T00:58:58.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.832+0000 7f6d397fa740 1 -- 172.21.15.1:0/2360027717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f31543070 msgr2=0x562f319021a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:58.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.832+0000 7f6d397fa740 1 --2- 172.21.15.1:0/2360027717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f31543070 0x562f319021a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f6d24009d20 tx=0x7f6d24004ab0 comp rx=0 tx=0).stop 2024-09-21T00:58:58.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.832+0000 7f6d397fa740 1 -- 172.21.15.1:0/2360027717 shutdown_connections 2024-09-21T00:58:58.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.832+0000 7f6d397fa740 1 --2- 172.21.15.1:0/2360027717 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x562f315019f0 0x562f31908180 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:58.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.832+0000 7f6d397fa740 1 --2- 172.21.15.1:0/2360027717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f31543070 0x562f319021a0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:58.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.832+0000 7f6d397fa740 1 --2- 172.21.15.1:0/2360027717 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562f31522390 0x562f318f6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:58.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.832+0000 7f6d397fa740 1 --2- 172.21.15.1:0/2360027717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f3151a1b0 0x562f318f5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:58.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.832+0000 7f6d397fa740 1 -- 172.21.15.1:0/2360027717 >> 172.21.15.1:0/2360027717 conn(0x562f31537460 msgr2=0x562f318ed830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:58.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.832+0000 7f6d14ff9640 0 client.16104 ms_handle_reset on v2:172.21.15.42:6836/2395608508 2024-09-21T00:58:58.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.832+0000 7f6d397fa740 1 -- 172.21.15.1:0/2360027717 shutdown_connections 2024-09-21T00:58:58.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.832+0000 7f6d397fa740 1 -- 172.21.15.1:0/2360027717 wait complete. 2024-09-21T00:58:58.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.832+0000 7f6d397fa740 20 client.16104 trim_cache size 0 max 16384 2024-09-21T00:58:58.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.846+0000 7f6d397fa740 1 Processor -- start 2024-09-21T00:58:58.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.846+0000 7f6d397fa740 1 -- start start 2024-09-21T00:58:58.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.846+0000 7f6d397fa740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f3151a1b0 0x562f318ec090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:58.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.846+0000 7f6d397fa740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f31522390 0x562f318f7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:58.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.846+0000 7f6d397fa740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562f31543070 0x562f318e7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:58.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.846+0000 7f6d397fa740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c1af490 con 0x562f3151a1b0 2024-09-21T00:58:58.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.846+0000 7f6d397fa740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c1b1150 con 0x562f31522390 2024-09-21T00:58:58.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.846+0000 7f6d397fa740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c1afb60 con 0x562f31543070 2024-09-21T00:58:58.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.846+0000 7f6d31022640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f3151a1b0 0x562f318ec090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:58.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.846+0000 7f6d31022640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f3151a1b0 0x562f318ec090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33944/0 (socket says 172.21.15.1:33944) 2024-09-21T00:58:58.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.846+0000 7f6d31823640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562f31543070 0x562f318e7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:58.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.846+0000 7f6d31022640 1 -- 172.21.15.1:0/1730088623 learned_addr learned my addr 172.21.15.1:0/1730088623 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:58.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.846+0000 7f6d30821640 1 --2- 172.21.15.1:0/1730088623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f31522390 0x562f318f7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:58.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.847+0000 7f6d31022640 1 -- 172.21.15.1:0/1730088623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562f31543070 msgr2=0x562f318e7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:58.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.847+0000 7f6d31022640 1 --2- 172.21.15.1:0/1730088623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562f31543070 0x562f318e7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:58.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.847+0000 7f6d31022640 1 -- 172.21.15.1:0/1730088623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f31522390 msgr2=0x562f318f7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:58.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.847+0000 7f6d31022640 1 --2- 172.21.15.1:0/1730088623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f31522390 0x562f318f7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:58.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.847+0000 7f6d31022640 1 -- 172.21.15.1:0/1730088623 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f318e8e80 con 0x562f3151a1b0 2024-09-21T00:58:58.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.847+0000 7f6d31823640 1 --2- 172.21.15.1:0/1730088623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562f31543070 0x562f318e7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:58.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.847+0000 7f6d31022640 1 --2- 172.21.15.1:0/1730088623 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f3151a1b0 0x562f318ec090 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f6d280cab50 tx=0x7f6d28105120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=620023c26676ce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:58.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.847+0000 7f6d16ffd640 1 -- 172.21.15.1:0/1730088623 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d28049040 con 0x562f3151a1b0 2024-09-21T00:58:58.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.847+0000 7f6d16ffd640 1 -- 172.21.15.1:0/1730088623 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d280cd3f0 con 0x562f3151a1b0 2024-09-21T00:58:58.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.847+0000 7f6d16ffd640 1 -- 172.21.15.1:0/1730088623 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d280d7300 con 0x562f3151a1b0 2024-09-21T00:58:58.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.848+0000 7f6d397fa740 1 -- 172.21.15.1:0/1730088623 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f3151a1b0 msgr2=0x562f318ec090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:58.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.848+0000 7f6d397fa740 1 --2- 172.21.15.1:0/1730088623 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f3151a1b0 0x562f318ec090 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f6d280cab50 tx=0x7f6d28105120 comp rx=0 tx=0).stop 2024-09-21T00:58:58.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.848+0000 7f6d397fa740 1 -- 172.21.15.1:0/1730088623 shutdown_connections 2024-09-21T00:58:58.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.848+0000 7f6d397fa740 1 --2- 172.21.15.1:0/1730088623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562f31543070 0x562f318e7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:58.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.848+0000 7f6d397fa740 1 --2- 172.21.15.1:0/1730088623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f31522390 0x562f318f7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:58.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.848+0000 7f6d397fa740 1 --2- 172.21.15.1:0/1730088623 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f3151a1b0 0x562f318ec090 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:58.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.848+0000 7f6d397fa740 1 -- 172.21.15.1:0/1730088623 >> 172.21.15.1:0/1730088623 conn(0x562f31537460 msgr2=0x562f318f7220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:58.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.848+0000 7f6d397fa740 1 -- 172.21.15.1:0/1730088623 shutdown_connections 2024-09-21T00:58:58.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.848+0000 7f6d397fa740 1 -- 172.21.15.1:0/1730088623 wait complete. 2024-09-21T00:58:58.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.849+0000 7f6d397fa740 1 -- start start 2024-09-21T00:58:58.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.849+0000 7f6d397fa740 1 Processor -- start 2024-09-21T00:58:58.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.849+0000 7f6d397fa740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f3151a1b0 0x562f318fea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:58.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.849+0000 7f6d397fa740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562f31522390 0x562f318f9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:58.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.849+0000 7f6d397fa740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f31543070 0x562f318fa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:58.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.850+0000 7f6d397fa740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c1b09c0 con 0x562f31543070 2024-09-21T00:58:58.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.850+0000 7f6d397fa740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c1b02f0 con 0x562f3151a1b0 2024-09-21T00:58:58.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.850+0000 7f6d397fa740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c1ad470 con 0x562f31522390 2024-09-21T00:58:58.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.850+0000 7f6d397fa740 10 client.0 _ll_register_callbacks cb 0x7f6d24009be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:58.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.850+0000 7f6d31022640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f3151a1b0 0x562f318fea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:58.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.850+0000 7f6d30821640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562f31522390 0x562f318f9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:58.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.850+0000 7f6d30821640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562f31522390 0x562f318f9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:46516/0 (socket says 172.21.15.1:46516) 2024-09-21T00:58:58.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.850+0000 7f6d30821640 1 -- 172.21.15.1:0/3928610596 learned_addr learned my addr 172.21.15.1:0/3928610596 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:58:58.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.850+0000 7f6d31823640 1 --2- 172.21.15.1:0/3928610596 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f31543070 0x562f318fa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:58.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.850+0000 7f6d31823640 1 -- 172.21.15.1:0/3928610596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562f31522390 msgr2=0x562f318f9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:58.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.850+0000 7f6d31823640 1 --2- 172.21.15.1:0/3928610596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562f31522390 0x562f318f9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:58.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.850+0000 7f6d31823640 1 -- 172.21.15.1:0/3928610596 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f3151a1b0 msgr2=0x562f318fea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:58.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.850+0000 7f6d31823640 1 --2- 172.21.15.1:0/3928610596 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f3151a1b0 0x562f318fea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:58.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.850+0000 7f6d31823640 1 -- 172.21.15.1:0/3928610596 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f318fad70 con 0x562f31543070 2024-09-21T00:58:58.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.850+0000 7f6d31022640 1 --2- 172.21.15.1:0/3928610596 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f3151a1b0 0x562f318fea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:58.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.850+0000 7f6d31823640 1 --2- 172.21.15.1:0/3928610596 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f31543070 0x562f318fa5e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f6d24018040 tx=0x7f6d24005c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3af2b9c73fa804 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:58.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.850+0000 7f6d14ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:58:58.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.850+0000 7f6d14ff9640 1 -- 172.21.15.1:0/3928610596 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d2401fa00 con 0x562f31543070 2024-09-21T00:58:58.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.850+0000 7f6d14ff9640 1 -- 172.21.15.1:0/3928610596 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f6d2401c6e0 con 0x562f31543070 2024-09-21T00:58:58.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.851+0000 7f6d397fa740 1 -- 172.21.15.1:0/3928610596 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d280cd3f0 con 0x562f31543070 2024-09-21T00:58:58.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.851+0000 7f6d14ff9640 1 -- 172.21.15.1:0/3928610596 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f6d24043050 con 0x562f31543070 2024-09-21T00:58:58.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.851+0000 7f6d397fa740 10 client.16110 fetch_fsmap learned FSMap version 31 2024-09-21T00:58:58.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.851+0000 7f6d397fa740 1 -- 172.21.15.1:0/3928610596 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562f31972c30 con 0x562f31543070 2024-09-21T00:58:58.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.851+0000 7f6d14ff9640 1 -- 172.21.15.1:0/3928610596 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d280cd3f0 con 0x562f31543070 2024-09-21T00:58:58.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.851+0000 7f6d14ff9640 1 -- 172.21.15.1:0/3928610596 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7f6d24004420 con 0x562f31543070 2024-09-21T00:58:58.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.851+0000 7f6d397fa740 10 client.16110 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:58:58.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.851+0000 7f6d397fa740 10 client.16110 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T00:58:58.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.851+0000 7f6d397fa740 20 client.16110 populate_metadata read hostname 'smithi001' 2024-09-21T00:58:58.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.851+0000 7f6d397fa740 1 --2- 172.21.15.1:0/3928610596 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x562f314d6da0 0x562f31975420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:58.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.851+0000 7f6d397fa740 4 client.16110 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:58:58.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.851+0000 7f6d397fa740 1 -- 172.21.15.1:0/3928610596 --> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562f3185e8a0 con 0x562f314d6da0 2024-09-21T00:58:58.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.851+0000 7f6d31022640 1 --2- 172.21.15.1:0/3928610596 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x562f314d6da0 0x562f31975420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:58.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.852+0000 7f6d14ff9640 10 client.16110 ms_handle_connect on v2:172.21.15.42:6836/2395608508 2024-09-21T00:58:58.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.852+0000 7f6d31022640 1 --2- 172.21.15.1:0/3928610596 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x562f314d6da0 0x562f31975420 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=719c3963c8887fb0 server_cookie=86767cbe8017e009 in_seq=0 out_seq=0 2024-09-21T00:58:58.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.854+0000 7f6d14ff9640 1 -- 172.21.15.1:0/3928610596 <== mds.2 v2:172.21.15.42:6836/2395608508 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562f3185e8a0 con 0x562f314d6da0 2024-09-21T00:58:58.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.854+0000 7f6d14ff9640 10 client.16110 handle_command_reply: tid=0 2024-09-21T00:58:58.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.854+0000 7f6d397fa740 1 client.16110 shutdown 2024-09-21T00:58:58.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.855+0000 7f6d397fa740 1 -- 172.21.15.1:0/3928610596 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f31543070 msgr2=0x562f318fa5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:58.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.855+0000 7f6d397fa740 1 --2- 172.21.15.1:0/3928610596 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f31543070 0x562f318fa5e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f6d24018040 tx=0x7f6d24005c40 comp rx=0 tx=0).stop 2024-09-21T00:58:58.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.855+0000 7f6d397fa740 1 -- 172.21.15.1:0/3928610596 shutdown_connections 2024-09-21T00:58:58.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.855+0000 7f6d397fa740 1 --2- 172.21.15.1:0/3928610596 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x562f314d6da0 0x562f31975420 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:58.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.855+0000 7f6d14ff9640 0 client.16110 ms_handle_reset on v2:172.21.15.42:6836/2395608508 2024-09-21T00:58:58.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.855+0000 7f6d397fa740 1 --2- 172.21.15.1:0/3928610596 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f31543070 0x562f318fa5e0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:58.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.855+0000 7f6d397fa740 1 --2- 172.21.15.1:0/3928610596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562f31522390 0x562f318f9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:58.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.855+0000 7f6d397fa740 1 --2- 172.21.15.1:0/3928610596 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f3151a1b0 0x562f318fea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:58.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.855+0000 7f6d397fa740 1 -- 172.21.15.1:0/3928610596 >> 172.21.15.1:0/3928610596 conn(0x562f31537460 msgr2=0x562f318ebe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:58.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.855+0000 7f6d397fa740 1 -- 172.21.15.1:0/3928610596 shutdown_connections 2024-09-21T00:58:58.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.856+0000 7f6d397fa740 1 -- 172.21.15.1:0/3928610596 wait complete. 2024-09-21T00:58:58.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.856+0000 7f6d397fa740 20 client.16110 trim_cache size 0 max 16384 2024-09-21T00:58:58.857 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T00:58:58.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.856+0000 7f6d33286640 1 -- 172.21.15.1:0/887985032 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6d180b6590 msgr2=0x7f6d180b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:58.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.856+0000 7f6d33286640 1 --2- 172.21.15.1:0/887985032 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6d180b6590 0x7f6d180b8aa0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6d24009fd0 tx=0x7f6d24009500 comp rx=0 tx=0).stop 2024-09-21T00:58:58.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.856+0000 7f6d33286640 1 -- 172.21.15.1:0/887985032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d2c102ab0 msgr2=0x7f6d2c19b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:58.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.856+0000 7f6d33286640 1 --2- 172.21.15.1:0/887985032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d2c102ab0 0x7f6d2c19b2b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f6d28005940 tx=0x7f6d28004270 comp rx=0 tx=0).stop 2024-09-21T00:58:58.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.857+0000 7f6d33286640 1 -- 172.21.15.1:0/887985032 shutdown_connections 2024-09-21T00:58:58.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.857+0000 7f6d33286640 1 --2- 172.21.15.1:0/887985032 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d2c108d40 0x7f6d2c19bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:58.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.857+0000 7f6d33286640 1 --2- 172.21.15.1:0/887985032 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d2c1083f0 0x7f6d2c19b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:58.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.857+0000 7f6d33286640 1 --2- 172.21.15.1:0/887985032 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6d180b6590 0x7f6d180b8aa0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:58.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.857+0000 7f6d33286640 1 --2- 172.21.15.1:0/887985032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d2c102ab0 0x7f6d2c19b2b0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:58.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.857+0000 7f6d33286640 1 -- 172.21.15.1:0/887985032 >> 172.21.15.1:0/887985032 conn(0x7f6d2c079670 msgr2=0x7f6d2c106440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:58.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.857+0000 7f6d33286640 1 -- 172.21.15.1:0/887985032 shutdown_connections 2024-09-21T00:58:58.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:58:58.857+0000 7f6d33286640 1 -- 172.21.15.1:0/887985032 wait complete. 2024-09-21T00:58:59.795 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T00:59:00.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.019+0000 7ff09f694640 1 -- 172.21.15.1:0/1127391186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff098109510 msgr2=0x7ff09810b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:00.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.019+0000 7ff09f694640 1 --2- 172.21.15.1:0/1127391186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff098109510 0x7ff09810b930 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff090009ca0 tx=0x7ff09002a8c0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.019+0000 7ff09f694640 1 -- 172.21.15.1:0/1127391186 shutdown_connections 2024-09-21T00:59:00.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.019+0000 7ff09f694640 1 --2- 172.21.15.1:0/1127391186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff098109510 0x7ff09810b930 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.019+0000 7ff09f694640 1 --2- 172.21.15.1:0/1127391186 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff098106bb0 0x7ff098108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.019+0000 7ff09f694640 1 --2- 172.21.15.1:0/1127391186 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff098101a60 0x7ff098101e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.019+0000 7ff09f694640 1 -- 172.21.15.1:0/1127391186 >> 172.21.15.1:0/1127391186 conn(0x7ff0980fd660 msgr2=0x7ff0980ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:00.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.019+0000 7ff09f694640 1 -- 172.21.15.1:0/1127391186 shutdown_connections 2024-09-21T00:59:00.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.019+0000 7ff09f694640 1 -- 172.21.15.1:0/1127391186 wait complete. 2024-09-21T00:59:00.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.020+0000 7ff09f694640 1 Processor -- start 2024-09-21T00:59:00.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.020+0000 7ff09f694640 1 -- start start 2024-09-21T00:59:00.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.020+0000 7ff09f694640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff098101a60 0x7ff098199ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.020+0000 7ff09f694640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff098106bb0 0x7ff09819a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.020+0000 7ff09f694640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff098109510 0x7ff09819b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.020+0000 7ff09f694640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff09810f2c0 con 0x7ff098106bb0 2024-09-21T00:59:00.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.021+0000 7ff09f694640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff09810f140 con 0x7ff098101a60 2024-09-21T00:59:00.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.021+0000 7ff09f694640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff09810f440 con 0x7ff098109510 2024-09-21T00:59:00.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.021+0000 7ff09cc2f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff098106bb0 0x7ff09819a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.021+0000 7ff09d430640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff098101a60 0x7ff098199ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.021+0000 7ff09cc2f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff098106bb0 0x7ff09819a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59940/0 (socket says 172.21.15.1:59940) 2024-09-21T00:59:00.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.021+0000 7ff09dc31640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff098109510 0x7ff09819b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.021+0000 7ff09cc2f640 1 -- 172.21.15.1:0/2250849300 learned_addr learned my addr 172.21.15.1:0/2250849300 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:00.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.021+0000 7ff09d430640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff098101a60 0x7ff098199ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:54600/0 (socket says 172.21.15.1:54600) 2024-09-21T00:59:00.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.021+0000 7ff09cc2f640 1 -- 172.21.15.1:0/2250849300 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff098109510 msgr2=0x7ff09819b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:00.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.021+0000 7ff09cc2f640 1 --2- 172.21.15.1:0/2250849300 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff098109510 0x7ff09819b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.021+0000 7ff09cc2f640 1 -- 172.21.15.1:0/2250849300 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff098101a60 msgr2=0x7ff098199ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:00.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.021+0000 7ff09cc2f640 1 --2- 172.21.15.1:0/2250849300 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff098101a60 0x7ff098199ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.021+0000 7ff09cc2f640 1 -- 172.21.15.1:0/2250849300 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff09819b900 con 0x7ff098106bb0 2024-09-21T00:59:00.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.021+0000 7ff09cc2f640 1 --2- 172.21.15.1:0/2250849300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff098106bb0 0x7ff09819a530 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7ff09400e9f0 tx=0x7ff09400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:00.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.021+0000 7ff08e7fc640 1 -- 172.21.15.1:0/2250849300 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09400cd80 con 0x7ff098106bb0 2024-09-21T00:59:00.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.022+0000 7ff08e7fc640 1 -- 172.21.15.1:0/2250849300 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0940108e0 con 0x7ff098106bb0 2024-09-21T00:59:00.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.022+0000 7ff09f694640 1 -- 172.21.15.1:0/2250849300 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff09819bbf0 con 0x7ff098106bb0 2024-09-21T00:59:00.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.022+0000 7ff08e7fc640 1 -- 172.21.15.1:0/2250849300 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff094018980 con 0x7ff098106bb0 2024-09-21T00:59:00.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.022+0000 7ff09f694640 1 -- 172.21.15.1:0/2250849300 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0981a22e0 con 0x7ff098106bb0 2024-09-21T00:59:00.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.025+0000 7ff0a6606740 1 Processor -- start 2024-09-21T00:59:00.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.025+0000 7ff0a6606740 1 -- start start 2024-09-21T00:59:00.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.025+0000 7ff08e7fc640 1 -- 172.21.15.1:0/2250849300 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7ff094018b20 con 0x7ff098106bb0 2024-09-21T00:59:00.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.025+0000 7ff0a6606740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cedeabc1b0 0x55cedee63e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.025+0000 7ff0a6606740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cedea932f0 0x55cedee644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.025+0000 7ff0a6606740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cedea9b4d0 0x55cedee65010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.025+0000 7ff0a6606740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55cededd66f0 con 0x55cedea9b4d0 2024-09-21T00:59:00.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.025+0000 7ff0a6606740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55cededc5b20 con 0x55cedea932f0 2024-09-21T00:59:00.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.025+0000 7ff0a6606740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55cededc9930 con 0x55cedeabc1b0 2024-09-21T00:59:00.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.026+0000 7ff09dc31640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cedeabc1b0 0x55cedee63e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.026+0000 7ff09d430640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cedea932f0 0x55cedee644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.026+0000 7ff09d430640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cedea932f0 0x55cedee644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:54604/0 (socket says 172.21.15.1:54604) 2024-09-21T00:59:00.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.026+0000 7ff09dc31640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cedeabc1b0 0x55cedee63e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:59064/0 (socket says 172.21.15.1:59064) 2024-09-21T00:59:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.026+0000 7ff09d430640 1 -- 172.21.15.1:0/2016225034 learned_addr learned my addr 172.21.15.1:0/2016225034 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.026+0000 7ff09cc2f640 1 --2- 172.21.15.1:0/2016225034 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cedea9b4d0 0x55cedee65010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.026+0000 7ff09dc31640 1 -- 172.21.15.1:0/2016225034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cedea932f0 msgr2=0x55cedee644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.026+0000 7ff09dc31640 1 --2- 172.21.15.1:0/2016225034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cedea932f0 0x55cedee644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.026+0000 7ff09dc31640 1 -- 172.21.15.1:0/2016225034 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cedea9b4d0 msgr2=0x55cedee65010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.026+0000 7ff09dc31640 1 --2- 172.21.15.1:0/2016225034 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cedea9b4d0 0x55cedee65010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.026+0000 7ff09dc31640 1 -- 172.21.15.1:0/2016225034 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ceded8b530 con 0x55cedeabc1b0 2024-09-21T00:59:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.026+0000 7ff09dc31640 1 --2- 172.21.15.1:0/2016225034 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cedeabc1b0 0x55cedee63e50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff090031b50 tx=0x7ff09002f410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45f639513884e35 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:00.029 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.027+0000 7ff08e7fc640 1 --2- 172.21.15.1:0/2250849300 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff0840b6590 0x7ff0840b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.029 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.027+0000 7ff0837fe640 1 -- 172.21.15.1:0/2016225034 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff090031650 con 0x55cedeabc1b0 2024-09-21T00:59:00.029 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.027+0000 7ff0837fe640 1 -- 172.21.15.1:0/2016225034 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff090036030 con 0x55cedeabc1b0 2024-09-21T00:59:00.029 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.027+0000 7ff08e7fc640 1 -- 172.21.15.1:0/2250849300 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7ff0940e75e0 con 0x7ff098106bb0 2024-09-21T00:59:00.029 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.027+0000 7ff09d430640 1 --2- 172.21.15.1:0/2250849300 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff0840b6590 0x7ff0840b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.027+0000 7ff0837fe640 1 -- 172.21.15.1:0/2016225034 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0900046d0 con 0x55cedeabc1b0 2024-09-21T00:59:00.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.028+0000 7ff0a6606740 1 -- 172.21.15.1:0/2016225034 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cedeabc1b0 msgr2=0x55cedee63e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:00.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.028+0000 7ff09d430640 1 --2- 172.21.15.1:0/2250849300 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff0840b6590 0x7ff0840b8aa0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff088005bc0 tx=0x7ff088005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:00.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.028+0000 7ff0a6606740 1 --2- 172.21.15.1:0/2016225034 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cedeabc1b0 0x55cedee63e50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff090031b50 tx=0x7ff09002f410 comp rx=0 tx=0).stop 2024-09-21T00:59:00.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.028+0000 7ff0a6606740 1 -- 172.21.15.1:0/2016225034 shutdown_connections 2024-09-21T00:59:00.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.028+0000 7ff0a6606740 1 --2- 172.21.15.1:0/2016225034 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cedea9b4d0 0x55cedee65010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.028+0000 7ff0a6606740 1 --2- 172.21.15.1:0/2016225034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cedea932f0 0x55cedee644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.028+0000 7ff0a6606740 1 --2- 172.21.15.1:0/2016225034 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cedeabc1b0 0x55cedee63e50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.028+0000 7ff0a6606740 1 -- 172.21.15.1:0/2016225034 >> 172.21.15.1:0/2016225034 conn(0x55cedeab0300 msgr2=0x55cedee5f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:00.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.029+0000 7ff0a6606740 1 -- 172.21.15.1:0/2016225034 shutdown_connections 2024-09-21T00:59:00.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.029+0000 7ff0a6606740 1 -- 172.21.15.1:0/2016225034 wait complete. 2024-09-21T00:59:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.029+0000 7ff0a6606740 1 -- start start 2024-09-21T00:59:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.029+0000 7ff0a6606740 1 Processor -- start 2024-09-21T00:59:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.030+0000 7ff0a6606740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cedea932f0 0x55cedee6d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.030+0000 7ff0a6606740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cedea9b4d0 0x55cedee6db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.030+0000 7ff09d430640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cedea932f0 0x55cedee6d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.030+0000 7ff09d430640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cedea932f0 0x55cedee6d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59950/0 (socket says 172.21.15.1:59950) 2024-09-21T00:59:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.030+0000 7ff09d430640 1 -- 172.21.15.1:0/1980089839 learned_addr learned my addr 172.21.15.1:0/1980089839 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.030+0000 7ff09cc2f640 1 --2- 172.21.15.1:0/1980089839 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cedea9b4d0 0x55cedee6db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.030+0000 7ff0a6606740 1 --2- 172.21.15.1:0/1980089839 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cedeabc1b0 0x55cedee6e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.030+0000 7ff0a6606740 1 -- 172.21.15.1:0/1980089839 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55cedecfdab0 con 0x55cedea932f0 2024-09-21T00:59:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.030+0000 7ff0a6606740 1 -- 172.21.15.1:0/1980089839 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ceded6b730 con 0x55cedeabc1b0 2024-09-21T00:59:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.030+0000 7ff0a6606740 1 -- 172.21.15.1:0/1980089839 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55cedee659a0 con 0x55cedea9b4d0 2024-09-21T00:59:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.030+0000 7ff0a6606740 10 client.0 _ll_register_callbacks cb 0x55cededbf6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.030+0000 7ff09dc31640 1 --2- 172.21.15.1:0/1980089839 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cedeabc1b0 0x55cedee6e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.031+0000 7ff09d430640 1 -- 172.21.15.1:0/1980089839 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cedea9b4d0 msgr2=0x55cedee6db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.031+0000 7ff09d430640 1 --2- 172.21.15.1:0/1980089839 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cedea9b4d0 0x55cedee6db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.031+0000 7ff09d430640 1 -- 172.21.15.1:0/1980089839 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cedeabc1b0 msgr2=0x55cedee6e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.031+0000 7ff09d430640 1 --2- 172.21.15.1:0/1980089839 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cedeabc1b0 0x55cedee6e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.031+0000 7ff09d430640 1 -- 172.21.15.1:0/1980089839 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cedeb27790 con 0x55cedea932f0 2024-09-21T00:59:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.031+0000 7ff09dc31640 1 --2- 172.21.15.1:0/1980089839 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cedeabc1b0 0x55cedee6e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:59:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.031+0000 7ff09cc2f640 1 --2- 172.21.15.1:0/1980089839 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cedea9b4d0 0x55cedee6db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.031+0000 7ff09d430640 1 --2- 172.21.15.1:0/1980089839 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cedea932f0 0x55cedee6d440 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ff08801e9d0 tx=0x7ff088004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc8f2aa104362844 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.031+0000 7ff080ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:59:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.031+0000 7ff080ff9640 1 -- 172.21.15.1:0/1980089839 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08802e060 con 0x55cedea932f0 2024-09-21T00:59:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.031+0000 7ff080ff9640 1 -- 172.21.15.1:0/1980089839 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7ff088018030 con 0x55cedea932f0 2024-09-21T00:59:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.031+0000 7ff0a6606740 1 -- 172.21.15.1:0/1980089839 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff090036030 con 0x55cedea932f0 2024-09-21T00:59:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.031+0000 7ff080ff9640 1 -- 172.21.15.1:0/1980089839 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ff088009b30 con 0x55cedea932f0 2024-09-21T00:59:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.031+0000 7ff0a6606740 10 client.16122 fetch_fsmap learned FSMap version 31 2024-09-21T00:59:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.031+0000 7ff0a6606740 1 -- 172.21.15.1:0/1980089839 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55cedeba0620 con 0x55cedea932f0 2024-09-21T00:59:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.032+0000 7ff080ff9640 1 -- 172.21.15.1:0/1980089839 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff090036030 con 0x55cedea932f0 2024-09-21T00:59:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.032+0000 7ff080ff9640 1 -- 172.21.15.1:0/1980089839 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7ff08801c580 con 0x55cedea932f0 2024-09-21T00:59:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.032+0000 7ff0a6606740 10 client.16122 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:59:00.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.032+0000 7ff0a6606740 10 client.16122 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:00.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.032+0000 7ff0a6606740 20 client.16122 populate_metadata read hostname 'smithi001' 2024-09-21T00:59:00.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.032+0000 7ff0a6606740 1 --2- 172.21.15.1:0/1980089839 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55cedea7ad80 0x55cedee7ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.032+0000 7ff0a6606740 4 client.16122 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:59:00.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.032+0000 7ff0a6606740 1 -- 172.21.15.1:0/1980089839 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cededd8640 con 0x55cedea7ad80 2024-09-21T00:59:00.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.032+0000 7ff09cc2f640 1 --2- 172.21.15.1:0/1980089839 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55cedea7ad80 0x55cedee7ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.032+0000 7ff080ff9640 10 client.16122 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:00.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.033+0000 7ff09cc2f640 1 --2- 172.21.15.1:0/1980089839 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55cedea7ad80 0x55cedee7ad20 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f4effe9f9cb1968 server_cookie=b09a557f865fb7b2 in_seq=0 out_seq=0 2024-09-21T00:59:00.037 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.034+0000 7ff080ff9640 1 -- 172.21.15.1:0/1980089839 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cededd8640 con 0x55cedea7ad80 2024-09-21T00:59:00.037 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.034+0000 7ff080ff9640 10 client.16122 handle_command_reply: tid=0 2024-09-21T00:59:00.037 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.034+0000 7ff0a6606740 1 client.16122 shutdown 2024-09-21T00:59:00.037 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.034+0000 7ff0a6606740 1 -- 172.21.15.1:0/1980089839 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cedea932f0 msgr2=0x55cedee6d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:00.037 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.034+0000 7ff0a6606740 1 --2- 172.21.15.1:0/1980089839 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cedea932f0 0x55cedee6d440 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ff08801e9d0 tx=0x7ff088004730 comp rx=0 tx=0).stop 2024-09-21T00:59:00.037 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.034+0000 7ff0a6606740 1 -- 172.21.15.1:0/1980089839 shutdown_connections 2024-09-21T00:59:00.038 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.034+0000 7ff0a6606740 1 --2- 172.21.15.1:0/1980089839 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55cedea7ad80 0x55cedee7ad20 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.038 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.034+0000 7ff0a6606740 1 --2- 172.21.15.1:0/1980089839 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cedeabc1b0 0x55cedee6e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.038 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.034+0000 7ff0a6606740 1 --2- 172.21.15.1:0/1980089839 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cedea9b4d0 0x55cedee6db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.038 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.034+0000 7ff080ff9640 0 client.16122 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:00.038 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.034+0000 7ff0a6606740 1 --2- 172.21.15.1:0/1980089839 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cedea932f0 0x55cedee6d440 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.038 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.034+0000 7ff0a6606740 1 -- 172.21.15.1:0/1980089839 >> 172.21.15.1:0/1980089839 conn(0x55cedeab0300 msgr2=0x55cedee5dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:00.038 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.035+0000 7ff0a6606740 1 -- 172.21.15.1:0/1980089839 shutdown_connections 2024-09-21T00:59:00.038 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.035+0000 7ff0a6606740 1 -- 172.21.15.1:0/1980089839 wait complete. 2024-09-21T00:59:00.038 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.035+0000 7ff0a6606740 20 client.16122 trim_cache size 0 max 16384 2024-09-21T00:59:00.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.052+0000 7ff0a6606740 1 Processor -- start 2024-09-21T00:59:00.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.052+0000 7ff0a6606740 1 -- start start 2024-09-21T00:59:00.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.052+0000 7ff0a6606740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cedea932f0 0x55cedee67fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.052+0000 7ff0a6606740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cedea9b4d0 0x55cedee684e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.052+0000 7ff0a6606740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cedeabc1b0 0x55cedee69330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.052+0000 7ff0a6606740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff0981aaf30 con 0x55cedea932f0 2024-09-21T00:59:00.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.052+0000 7ff0a6606740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff0981acbf0 con 0x55cedeabc1b0 2024-09-21T00:59:00.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.052+0000 7ff0a6606740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff0981ab600 con 0x55cedea9b4d0 2024-09-21T00:59:00.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.053+0000 7ff09d430640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cedea932f0 0x55cedee67fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.053+0000 7ff09cc2f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cedea9b4d0 0x55cedee684e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.053+0000 7ff09dc31640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cedeabc1b0 0x55cedee69330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.053+0000 7ff09d430640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cedea932f0 0x55cedee67fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59954/0 (socket says 172.21.15.1:59954) 2024-09-21T00:59:00.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.053+0000 7ff09d430640 1 -- 172.21.15.1:0/990092889 learned_addr learned my addr 172.21.15.1:0/990092889 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:00.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.053+0000 7ff09d430640 1 -- 172.21.15.1:0/990092889 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cedea9b4d0 msgr2=0x55cedee684e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:00.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.053+0000 7ff09d430640 1 --2- 172.21.15.1:0/990092889 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cedea9b4d0 0x55cedee684e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.053+0000 7ff09d430640 1 -- 172.21.15.1:0/990092889 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cedeabc1b0 msgr2=0x55cedee69330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:00.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.053+0000 7ff09d430640 1 --2- 172.21.15.1:0/990092889 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cedeabc1b0 0x55cedee69330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.053+0000 7ff09d430640 1 -- 172.21.15.1:0/990092889 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cedee65b20 con 0x55cedea932f0 2024-09-21T00:59:00.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.053+0000 7ff09cc2f640 1 --2- 172.21.15.1:0/990092889 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cedea9b4d0 0x55cedee684e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:00.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.053+0000 7ff09d430640 1 --2- 172.21.15.1:0/990092889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cedea932f0 0x55cedee67fa0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ff088019040 tx=0x7ff088000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ec500b5b44fb7d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:00.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.053+0000 7ff082ffd640 1 -- 172.21.15.1:0/990092889 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff088041070 con 0x55cedea932f0 2024-09-21T00:59:00.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.053+0000 7ff082ffd640 1 -- 172.21.15.1:0/990092889 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff08801cd50 con 0x55cedea932f0 2024-09-21T00:59:00.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.054+0000 7ff082ffd640 1 -- 172.21.15.1:0/990092889 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08803cd40 con 0x55cedea932f0 2024-09-21T00:59:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.055+0000 7ff0a6606740 1 -- 172.21.15.1:0/990092889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cedea932f0 msgr2=0x55cedee67fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.055+0000 7ff0a6606740 1 --2- 172.21.15.1:0/990092889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cedea932f0 0x55cedee67fa0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ff088019040 tx=0x7ff088000bc0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.055+0000 7ff0a6606740 1 -- 172.21.15.1:0/990092889 shutdown_connections 2024-09-21T00:59:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.055+0000 7ff0a6606740 1 --2- 172.21.15.1:0/990092889 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cedeabc1b0 0x55cedee69330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.055+0000 7ff0a6606740 1 --2- 172.21.15.1:0/990092889 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cedea9b4d0 0x55cedee684e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.055+0000 7ff0a6606740 1 --2- 172.21.15.1:0/990092889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cedea932f0 0x55cedee67fa0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.055+0000 7ff0a6606740 1 -- 172.21.15.1:0/990092889 >> 172.21.15.1:0/990092889 conn(0x55cedeab0300 msgr2=0x55cedee6b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.055+0000 7ff0a6606740 1 -- 172.21.15.1:0/990092889 shutdown_connections 2024-09-21T00:59:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.055+0000 7ff0a6606740 1 -- 172.21.15.1:0/990092889 wait complete. 2024-09-21T00:59:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.055+0000 7ff0a6606740 1 -- start start 2024-09-21T00:59:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.055+0000 7ff0a6606740 1 Processor -- start 2024-09-21T00:59:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.056+0000 7ff0a6606740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cedea932f0 0x55cedee74360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.056+0000 7ff0a6606740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cedea9b4d0 0x55cedee748a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.056+0000 7ff0a6606740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cedeabc1b0 0x55cedee74de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.056+0000 7ff0a6606740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff0981ac460 con 0x55cedeabc1b0 2024-09-21T00:59:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.056+0000 7ff0a6606740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff0981abd90 con 0x55cedea932f0 2024-09-21T00:59:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.056+0000 7ff0a6606740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff0981a8f10 con 0x55cedea9b4d0 2024-09-21T00:59:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.056+0000 7ff0a6606740 10 client.0 _ll_register_callbacks cb 0x7ff088009660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.056+0000 7ff09cc2f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cedea9b4d0 0x55cedee748a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.056+0000 7ff09dc31640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cedeabc1b0 0x55cedee74de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.056+0000 7ff09d430640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cedea932f0 0x55cedee74360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.056+0000 7ff09cc2f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cedea9b4d0 0x55cedee748a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:59100/0 (socket says 172.21.15.1:59100) 2024-09-21T00:59:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.056+0000 7ff09dc31640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cedeabc1b0 0x55cedee74de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59968/0 (socket says 172.21.15.1:59968) 2024-09-21T00:59:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.056+0000 7ff09cc2f640 1 -- 172.21.15.1:0/1278629743 learned_addr learned my addr 172.21.15.1:0/1278629743 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.057+0000 7ff09cc2f640 1 -- 172.21.15.1:0/1278629743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cedea932f0 msgr2=0x55cedee74360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.057+0000 7ff09cc2f640 1 --2- 172.21.15.1:0/1278629743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cedea932f0 0x55cedee74360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.057+0000 7ff09cc2f640 1 -- 172.21.15.1:0/1278629743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cedeabc1b0 msgr2=0x55cedee74de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.057+0000 7ff09cc2f640 1 --2- 172.21.15.1:0/1278629743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cedeabc1b0 0x55cedee74de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.057+0000 7ff09cc2f640 1 -- 172.21.15.1:0/1278629743 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cedee73050 con 0x55cedea9b4d0 2024-09-21T00:59:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.057+0000 7ff09d430640 1 --2- 172.21.15.1:0/1278629743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cedea932f0 0x55cedee74360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.057+0000 7ff09cc2f640 1 --2- 172.21.15.1:0/1278629743 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cedea9b4d0 0x55cedee748a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff0940a9dd0 tx=0x7ff0940eaf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bec921a912604863 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.057+0000 7ff080ff9640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T00:59:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.057+0000 7ff080ff9640 1 -- 172.21.15.1:0/1278629743 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0940acf70 con 0x55cedea9b4d0 2024-09-21T00:59:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.057+0000 7ff080ff9640 1 -- 172.21.15.1:0/1278629743 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7ff0940aca60 con 0x55cedea9b4d0 2024-09-21T00:59:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.057+0000 7ff0a6606740 1 -- 172.21.15.1:0/1278629743 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff08801cd50 con 0x55cedea9b4d0 2024-09-21T00:59:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.057+0000 7ff080ff9640 1 -- 172.21.15.1:0/1278629743 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ff0940ad310 con 0x55cedea9b4d0 2024-09-21T00:59:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.057+0000 7ff0a6606740 10 client.25711 fetch_fsmap learned FSMap version 31 2024-09-21T00:59:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.057+0000 7ff0a6606740 1 -- 172.21.15.1:0/1278629743 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55cedeee5b40 con 0x55cedea9b4d0 2024-09-21T00:59:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.057+0000 7ff080ff9640 1 -- 172.21.15.1:0/1278629743 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff08801cd50 con 0x55cedea9b4d0 2024-09-21T00:59:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.058+0000 7ff080ff9640 1 -- 172.21.15.1:0/1278629743 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7ff0940a91e0 con 0x55cedea9b4d0 2024-09-21T00:59:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.058+0000 7ff0a6606740 10 client.25711 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:59:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.058+0000 7ff0a6606740 10 client.25711 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.058+0000 7ff0a6606740 20 client.25711 populate_metadata read hostname 'smithi001' 2024-09-21T00:59:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.058+0000 7ff0a6606740 1 --2- 172.21.15.1:0/1278629743 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55cedea501c0 0x55cedeee8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.058+0000 7ff0a6606740 4 client.25711 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T00:59:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.058+0000 7ff0a6606740 1 -- 172.21.15.1:0/1278629743 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cededd40f0 con 0x55cedea501c0 2024-09-21T00:59:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.058+0000 7ff09d430640 1 --2- 172.21.15.1:0/1278629743 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55cedea501c0 0x55cedeee8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.058+0000 7ff080ff9640 10 client.25711 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.058+0000 7ff09d430640 1 --2- 172.21.15.1:0/1278629743 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55cedea501c0 0x55cedeee8510 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d87b58adb22f7e6 server_cookie=1ab881bb23b8cfc3 in_seq=0 out_seq=0 2024-09-21T00:59:00.091 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:59:00.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:58:59 smithi001 ceph-mon[31211]: pgmap v411: 97 pgs: 97 active+clean; 156 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 8.0 MiB/s wr, 688 op/s 2024-09-21T00:59:00.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:58:59 smithi193 ceph-mon[34660]: pgmap v411: 97 pgs: 97 active+clean; 156 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 8.0 MiB/s wr, 688 op/s 2024-09-21T00:59:00.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:58:59 smithi042 ceph-mon[34481]: pgmap v411: 97 pgs: 97 active+clean; 156 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 8.0 MiB/s wr, 688 op/s 2024-09-21T00:59:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.474+0000 7ff080ff9640 1 -- 172.21.15.1:0/1278629743 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cededd40f0 con 0x55cedea501c0 2024-09-21T00:59:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.475+0000 7ff080ff9640 10 client.25711 handle_command_reply: tid=0 2024-09-21T00:59:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.475+0000 7ff0a6606740 1 client.25711 shutdown 2024-09-21T00:59:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.475+0000 7ff0a6606740 1 -- 172.21.15.1:0/1278629743 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cedea9b4d0 msgr2=0x55cedee748a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.475+0000 7ff0a6606740 1 --2- 172.21.15.1:0/1278629743 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cedea9b4d0 0x55cedee748a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff0940a9dd0 tx=0x7ff0940eaf90 comp rx=0 tx=0).stop 2024-09-21T00:59:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.475+0000 7ff0a6606740 1 -- 172.21.15.1:0/1278629743 shutdown_connections 2024-09-21T00:59:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.475+0000 7ff0a6606740 1 --2- 172.21.15.1:0/1278629743 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55cedea501c0 0x55cedeee8510 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.475+0000 7ff0a6606740 1 --2- 172.21.15.1:0/1278629743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cedeabc1b0 0x55cedee74de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.475+0000 7ff0a6606740 1 --2- 172.21.15.1:0/1278629743 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cedea9b4d0 0x55cedee748a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.475+0000 7ff0a6606740 1 --2- 172.21.15.1:0/1278629743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cedea932f0 0x55cedee74360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.475+0000 7ff080ff9640 0 client.25711 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:00.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.475+0000 7ff0a6606740 1 -- 172.21.15.1:0/1278629743 >> 172.21.15.1:0/1278629743 conn(0x55cedeab0300 msgr2=0x55cedee6b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:00.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.475+0000 7ff0a6606740 1 -- 172.21.15.1:0/1278629743 shutdown_connections 2024-09-21T00:59:00.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.475+0000 7ff0a6606740 1 -- 172.21.15.1:0/1278629743 wait complete. 2024-09-21T00:59:00.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.475+0000 7ff0a6606740 20 client.25711 trim_cache size 0 max 16384 2024-09-21T00:59:00.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T00:59:00.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T00:59:00.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T00:59:00.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T00:59:00.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.476+0000 7ff09f694640 1 -- 172.21.15.1:0/2250849300 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff0840b6590 msgr2=0x7ff0840b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:00.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.476+0000 7ff09f694640 1 --2- 172.21.15.1:0/2250849300 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff0840b6590 0x7ff0840b8aa0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff088005bc0 tx=0x7ff088005f90 comp rx=0 tx=0).stop 2024-09-21T00:59:00.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.476+0000 7ff09f694640 1 -- 172.21.15.1:0/2250849300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff098106bb0 msgr2=0x7ff09819a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:00.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.476+0000 7ff09f694640 1 --2- 172.21.15.1:0/2250849300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff098106bb0 0x7ff09819a530 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7ff09400e9f0 tx=0x7ff09400eeb0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.476+0000 7ff09f694640 1 -- 172.21.15.1:0/2250849300 shutdown_connections 2024-09-21T00:59:00.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.476+0000 7ff09f694640 1 --2- 172.21.15.1:0/2250849300 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff098109510 0x7ff09819b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.476+0000 7ff09f694640 1 --2- 172.21.15.1:0/2250849300 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ff0840b6590 0x7ff0840b8aa0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.476+0000 7ff09f694640 1 --2- 172.21.15.1:0/2250849300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff098106bb0 0x7ff09819a530 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.476+0000 7ff09f694640 1 --2- 172.21.15.1:0/2250849300 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff098101a60 0x7ff098199ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.479 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.476+0000 7ff09f694640 1 -- 172.21.15.1:0/2250849300 >> 172.21.15.1:0/2250849300 conn(0x7ff0980fd660 msgr2=0x7ff098107980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:00.479 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.476+0000 7ff09f694640 1 -- 172.21.15.1:0/2250849300 shutdown_connections 2024-09-21T00:59:00.479 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:00.476+0000 7ff09f694640 1 -- 172.21.15.1:0/2250849300 wait complete. 2024-09-21T00:59:00.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.628+0000 7ffaf0a63640 1 -- 172.21.15.1:0/3177394498 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffaec1094d0 msgr2=0x7ffaec1098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:00.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.628+0000 7ffaf0a63640 1 --2- 172.21.15.1:0/3177394498 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffaec1094d0 0x7ffaec1098e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009ca0 tx=0x7ffae002a8c0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.628+0000 7ffaf0a63640 1 -- 172.21.15.1:0/3177394498 shutdown_connections 2024-09-21T00:59:00.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.628+0000 7ffaf0a63640 1 --2- 172.21.15.1:0/3177394498 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffaec109e20 0x7ffaec110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.628+0000 7ffaf0a63640 1 --2- 172.21.15.1:0/3177394498 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffaec1094d0 0x7ffaec1098e0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.628+0000 7ffaf0a63640 1 --2- 172.21.15.1:0/3177394498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffaec103b90 0x7ffaec103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.628+0000 7ffaf0a63640 1 -- 172.21.15.1:0/3177394498 >> 172.21.15.1:0/3177394498 conn(0x7ffaec0ff600 msgr2=0x7ffaec101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:00.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.628+0000 7ffaf0a63640 1 -- 172.21.15.1:0/3177394498 shutdown_connections 2024-09-21T00:59:00.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.628+0000 7ffaf0a63640 1 -- 172.21.15.1:0/3177394498 wait complete. 2024-09-21T00:59:00.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.629+0000 7ffaf0a63640 1 Processor -- start 2024-09-21T00:59:00.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.629+0000 7ffaf0a63640 1 -- start start 2024-09-21T00:59:00.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.629+0000 7ffaf0a63640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffaec103b90 0x7ffaec19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.629+0000 7ffaf0a63640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffaec1094d0 0x7ffaec19aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.629+0000 7ffaf0a63640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffaec109e20 0x7ffaec19fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.629+0000 7ffaf0a63640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffaec113ae0 con 0x7ffaec1094d0 2024-09-21T00:59:00.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.629+0000 7ffaf0a63640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ffaec113960 con 0x7ffaec103b90 2024-09-21T00:59:00.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.629+0000 7ffaf0a63640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ffaec113c60 con 0x7ffaec109e20 2024-09-21T00:59:00.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.630+0000 7ffaea59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffaec103b90 0x7ffaec19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.630+0000 7ffae9d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffaec1094d0 0x7ffaec19aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.630+0000 7ffaea59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffaec103b90 0x7ffaec19a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:54642/0 (socket says 172.21.15.1:54642) 2024-09-21T00:59:00.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.630+0000 7ffaea59c640 1 -- 172.21.15.1:0/2914507431 learned_addr learned my addr 172.21.15.1:0/2914507431 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:00.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.630+0000 7ffaead9d640 1 --2- 172.21.15.1:0/2914507431 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffaec109e20 0x7ffaec19fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.630+0000 7ffaea59c640 1 -- 172.21.15.1:0/2914507431 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffaec109e20 msgr2=0x7ffaec19fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:00.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.630+0000 7ffaea59c640 1 --2- 172.21.15.1:0/2914507431 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffaec109e20 0x7ffaec19fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.630+0000 7ffaea59c640 1 -- 172.21.15.1:0/2914507431 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffaec1094d0 msgr2=0x7ffaec19aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:00.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.630+0000 7ffaea59c640 1 --2- 172.21.15.1:0/2914507431 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffaec1094d0 0x7ffaec19aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.630+0000 7ffaea59c640 1 -- 172.21.15.1:0/2914507431 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaec1a0420 con 0x7ffaec103b90 2024-09-21T00:59:00.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.630+0000 7ffaea59c640 1 --2- 172.21.15.1:0/2914507431 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffaec103b90 0x7ffaec19a4b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffadc00e9f0 tx=0x7ffadc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:00.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.630+0000 7ffadb7fe640 1 -- 172.21.15.1:0/2914507431 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffadc00cd80 con 0x7ffaec103b90 2024-09-21T00:59:00.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.630+0000 7ffadb7fe640 1 -- 172.21.15.1:0/2914507431 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffadc0108e0 con 0x7ffaec103b90 2024-09-21T00:59:00.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.631+0000 7ffadb7fe640 1 -- 172.21.15.1:0/2914507431 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffadc018980 con 0x7ffaec103b90 2024-09-21T00:59:00.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.631+0000 7ffaf0a63640 1 -- 172.21.15.1:0/2914507431 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaec1a0710 con 0x7ffaec103b90 2024-09-21T00:59:00.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.631+0000 7ffaf0a63640 1 -- 172.21.15.1:0/2914507431 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaec1a6e70 con 0x7ffaec103b90 2024-09-21T00:59:00.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.634+0000 7ffaf6fd7740 1 Processor -- start 2024-09-21T00:59:00.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.634+0000 7ffaf6fd7740 1 -- start start 2024-09-21T00:59:00.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.635+0000 7ffaf6fd7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557943346070 0x5579436ed6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.635+0000 7ffaf6fd7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55794331d1b0 0x5579436edbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.635+0000 7ffaf6fd7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557943325390 0x5579436ee120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.635+0000 7ffaf6fd7740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557943663ea0 con 0x55794331d1b0 2024-09-21T00:59:00.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.635+0000 7ffaf6fd7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5579436532d0 con 0x557943325390 2024-09-21T00:59:00.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.635+0000 7ffaf6fd7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5579436570e0 con 0x557943346070 2024-09-21T00:59:00.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.635+0000 7ffae9d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557943325390 0x5579436ee120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.635+0000 7ffaead9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557943346070 0x5579436ed6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.635+0000 7ffae9d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557943325390 0x5579436ee120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:54656/0 (socket says 172.21.15.1:54656) 2024-09-21T00:59:00.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.635+0000 7ffae9d9b640 1 -- 172.21.15.1:0/1740599504 learned_addr learned my addr 172.21.15.1:0/1740599504 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:00.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.635+0000 7ffadb7fe640 1 -- 172.21.15.1:0/2914507431 <== mon.2 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7ffadc010430 con 0x7ffaec103b90 2024-09-21T00:59:00.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.635+0000 7ffaead9d640 1 -- 172.21.15.1:0/1740599504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557943325390 msgr2=0x5579436ee120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:00.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.635+0000 7ffaead9d640 1 --2- 172.21.15.1:0/1740599504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557943325390 0x5579436ee120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.635+0000 7ffaead9d640 1 -- 172.21.15.1:0/1740599504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55794331d1b0 msgr2=0x5579436edbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:00.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.635+0000 7ffaea59c640 1 --2- 172.21.15.1:0/1740599504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55794331d1b0 0x5579436edbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.635+0000 7ffaead9d640 1 --2- 172.21.15.1:0/1740599504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55794331d1b0 0x5579436edbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.635+0000 7ffaead9d640 1 -- 172.21.15.1:0/1740599504 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579433b1650 con 0x557943346070 2024-09-21T00:59:00.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.635+0000 7ffaea59c640 1 --2- 172.21.15.1:0/1740599504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55794331d1b0 0x5579436edbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:59:00.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.636+0000 7ffaead9d640 1 --2- 172.21.15.1:0/1740599504 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557943346070 0x5579436ed6a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ffae4009b80 tx=0x7ffae4011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ac6d0567a16e6cf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:00.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.636+0000 7ffad8ff9640 1 -- 172.21.15.1:0/1740599504 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae4004030 con 0x557943346070 2024-09-21T00:59:00.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.636+0000 7ffad8ff9640 1 -- 172.21.15.1:0/1740599504 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffae4005020 con 0x557943346070 2024-09-21T00:59:00.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.636+0000 7ffad8ff9640 1 -- 172.21.15.1:0/1740599504 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae4004c40 con 0x557943346070 2024-09-21T00:59:00.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.636+0000 7ffadb7fe640 1 --2- 172.21.15.1:0/2914507431 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ffad40b6590 0x7ffad40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.636+0000 7ffaea59c640 1 --2- 172.21.15.1:0/2914507431 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ffad40b6590 0x7ffad40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.637+0000 7ffadb7fe640 1 -- 172.21.15.1:0/2914507431 <== mon.2 v2:172.21.15.42:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7ffadc0e75d0 con 0x7ffaec103b90 2024-09-21T00:59:00.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.637+0000 7ffaf6fd7740 1 -- 172.21.15.1:0/1740599504 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557943346070 msgr2=0x5579436ed6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:00.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.637+0000 7ffaf6fd7740 1 --2- 172.21.15.1:0/1740599504 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557943346070 0x5579436ed6a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ffae4009b80 tx=0x7ffae4011810 comp rx=0 tx=0).stop 2024-09-21T00:59:00.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.637+0000 7ffaea59c640 1 --2- 172.21.15.1:0/2914507431 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ffad40b6590 0x7ffad40b8aa0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x5579436ec320 tx=0x7ffadc00cf20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:00.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.637+0000 7ffaf6fd7740 1 -- 172.21.15.1:0/1740599504 shutdown_connections 2024-09-21T00:59:00.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.637+0000 7ffaf6fd7740 1 --2- 172.21.15.1:0/1740599504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557943325390 0x5579436ee120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.637+0000 7ffaf6fd7740 1 --2- 172.21.15.1:0/1740599504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55794331d1b0 0x5579436edbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.637+0000 7ffaf6fd7740 1 --2- 172.21.15.1:0/1740599504 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557943346070 0x5579436ed6a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.637+0000 7ffaf6fd7740 1 -- 172.21.15.1:0/1740599504 >> 172.21.15.1:0/1740599504 conn(0x55794333a460 msgr2=0x5579436eb590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:00.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.637+0000 7ffaf6fd7740 1 -- 172.21.15.1:0/1740599504 shutdown_connections 2024-09-21T00:59:00.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.637+0000 7ffaf6fd7740 1 -- 172.21.15.1:0/1740599504 wait complete. 2024-09-21T00:59:00.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.638+0000 7ffaf6fd7740 1 -- start start 2024-09-21T00:59:00.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.638+0000 7ffaf6fd7740 1 Processor -- start 2024-09-21T00:59:00.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.638+0000 7ffaf6fd7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55794331d1b0 0x5579436f8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.638+0000 7ffaf6fd7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557943325390 0x5579436f92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.638+0000 7ffaf6fd7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557943346070 0x5579437051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.638+0000 7ffaf6fd7740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5579434b4700 con 0x557943325390 2024-09-21T00:59:00.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.638+0000 7ffaf6fd7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5579435ee160 con 0x55794331d1b0 2024-09-21T00:59:00.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.638+0000 7ffaead9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55794331d1b0 0x5579436f8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.638+0000 7ffaf6fd7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5579436fbe80 con 0x557943346070 2024-09-21T00:59:00.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.639+0000 7ffaead9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55794331d1b0 0x5579436f8d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:54662/0 (socket says 172.21.15.1:54662) 2024-09-21T00:59:00.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.639+0000 7ffaead9d640 1 -- 172.21.15.1:0/3170505785 learned_addr learned my addr 172.21.15.1:0/3170505785 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:00.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.639+0000 7ffae9d9b640 1 --2- 172.21.15.1:0/3170505785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557943325390 0x5579436f92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.639+0000 7ffaead9d640 1 --2- 172.21.15.1:0/3170505785 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557943346070 0x5579437051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.639+0000 7ffaf6fd7740 10 client.0 _ll_register_callbacks cb 0x5579436079e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:00.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.639+0000 7ffaead9d640 1 -- 172.21.15.1:0/3170505785 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557943346070 msgr2=0x5579437051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:00.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.639+0000 7ffaead9d640 1 --2- 172.21.15.1:0/3170505785 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557943346070 0x5579437051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.639+0000 7ffaead9d640 1 -- 172.21.15.1:0/3170505785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557943325390 msgr2=0x5579436f92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:00.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.639+0000 7ffaead9d640 1 --2- 172.21.15.1:0/3170505785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557943325390 0x5579436f92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.639+0000 7ffaead9d640 1 -- 172.21.15.1:0/3170505785 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55794361bc90 con 0x55794331d1b0 2024-09-21T00:59:00.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.639+0000 7ffaead9d640 1 --2- 172.21.15.1:0/3170505785 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55794331d1b0 0x5579436f8d60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffae4004940 tx=0x7ffae4004840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cdab01d5f57b8ee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:00.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.639+0000 7ffad1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T00:59:00.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.640+0000 7ffad1ffb640 1 -- 172.21.15.1:0/3170505785 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae402c060 con 0x55794331d1b0 2024-09-21T00:59:00.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.640+0000 7ffad1ffb640 1 -- 172.21.15.1:0/3170505785 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7ffae4004260 con 0x55794331d1b0 2024-09-21T00:59:00.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.640+0000 7ffaf6fd7740 1 -- 172.21.15.1:0/3170505785 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffae4005020 con 0x55794331d1b0 2024-09-21T00:59:00.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.640+0000 7ffad1ffb640 1 -- 172.21.15.1:0/3170505785 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ffae4005590 con 0x55794331d1b0 2024-09-21T00:59:00.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.640+0000 7ffaf6fd7740 10 client.25805 fetch_fsmap learned FSMap version 31 2024-09-21T00:59:00.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.640+0000 7ffaf6fd7740 1 -- 172.21.15.1:0/3170505785 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x557943707ab0 con 0x55794331d1b0 2024-09-21T00:59:00.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.640+0000 7ffad1ffb640 1 -- 172.21.15.1:0/3170505785 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffae4005020 con 0x55794331d1b0 2024-09-21T00:59:00.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.641+0000 7ffad1ffb640 1 -- 172.21.15.1:0/3170505785 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7ffae4018070 con 0x55794331d1b0 2024-09-21T00:59:00.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.641+0000 7ffaf6fd7740 10 client.25805 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:59:00.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.641+0000 7ffaf6fd7740 10 client.25805 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T00:59:00.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.641+0000 7ffaf6fd7740 20 client.25805 populate_metadata read hostname 'smithi001' 2024-09-21T00:59:00.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.641+0000 7ffaf6fd7740 1 --2- 172.21.15.1:0/3170505785 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5579433049f0 0x55794370af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.641+0000 7ffaf6fd7740 4 client.25805 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:59:00.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.641+0000 7ffaf6fd7740 1 -- 172.21.15.1:0/3170505785 --> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557943665df0 con 0x5579433049f0 2024-09-21T00:59:00.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.641+0000 7ffae9d9b640 1 --2- 172.21.15.1:0/3170505785 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5579433049f0 0x55794370af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.642+0000 7ffad1ffb640 10 client.25805 ms_handle_connect on v2:172.21.15.193:6838/1365361177 2024-09-21T00:59:00.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.642+0000 7ffae9d9b640 1 --2- 172.21.15.1:0/3170505785 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5579433049f0 0x55794370af20 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=85fcaa8f865310f6 server_cookie=461397f0486e1db in_seq=0 out_seq=0 2024-09-21T00:59:00.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.643+0000 7ffad1ffb640 1 -- 172.21.15.1:0/3170505785 <== mds.1 v2:172.21.15.193:6838/1365361177 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557943665df0 con 0x5579433049f0 2024-09-21T00:59:00.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.643+0000 7ffad1ffb640 10 client.25805 handle_command_reply: tid=0 2024-09-21T00:59:00.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.643+0000 7ffaf6fd7740 1 client.25805 shutdown 2024-09-21T00:59:00.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.643+0000 7ffaf6fd7740 1 -- 172.21.15.1:0/3170505785 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55794331d1b0 msgr2=0x5579436f8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:00.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.643+0000 7ffaf6fd7740 1 --2- 172.21.15.1:0/3170505785 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55794331d1b0 0x5579436f8d60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffae4004940 tx=0x7ffae4004840 comp rx=0 tx=0).stop 2024-09-21T00:59:00.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.643+0000 7ffaf6fd7740 1 -- 172.21.15.1:0/3170505785 shutdown_connections 2024-09-21T00:59:00.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.643+0000 7ffaf6fd7740 1 --2- 172.21.15.1:0/3170505785 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5579433049f0 0x55794370af20 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.643+0000 7ffaf6fd7740 1 --2- 172.21.15.1:0/3170505785 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557943346070 0x5579437051a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.643+0000 7ffaf6fd7740 1 --2- 172.21.15.1:0/3170505785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557943325390 0x5579436f92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.643+0000 7ffaf6fd7740 1 --2- 172.21.15.1:0/3170505785 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55794331d1b0 0x5579436f8d60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.643+0000 7ffaf6fd7740 1 -- 172.21.15.1:0/3170505785 >> 172.21.15.1:0/3170505785 conn(0x55794333a460 msgr2=0x5579436f0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:00.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.643+0000 7ffad1ffb640 0 client.25805 ms_handle_reset on v2:172.21.15.193:6838/1365361177 2024-09-21T00:59:00.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.643+0000 7ffaf6fd7740 1 -- 172.21.15.1:0/3170505785 shutdown_connections 2024-09-21T00:59:00.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.643+0000 7ffaf6fd7740 1 -- 172.21.15.1:0/3170505785 wait complete. 2024-09-21T00:59:00.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.643+0000 7ffaf6fd7740 20 client.25805 trim_cache size 0 max 16384 2024-09-21T00:59:00.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.657+0000 7ffaf6fd7740 1 Processor -- start 2024-09-21T00:59:00.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.657+0000 7ffaf6fd7740 1 -- start start 2024-09-21T00:59:00.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.657+0000 7ffaf6fd7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55794331d1b0 0x5579436eede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.657+0000 7ffaf6fd7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557943325390 0x5579436eabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.657+0000 7ffaf6fd7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557943346070 0x5579436eb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.657+0000 7ffaf6fd7740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffaec1af490 con 0x55794331d1b0 2024-09-21T00:59:00.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.657+0000 7ffaf6fd7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ffaec1b1150 con 0x557943346070 2024-09-21T00:59:00.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.657+0000 7ffaf6fd7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ffaec1afb60 con 0x557943325390 2024-09-21T00:59:00.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.658+0000 7ffaead9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55794331d1b0 0x5579436eede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.658+0000 7ffaead9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55794331d1b0 0x5579436eede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60014/0 (socket says 172.21.15.1:60014) 2024-09-21T00:59:00.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.658+0000 7ffaead9d640 1 -- 172.21.15.1:0/4143195567 learned_addr learned my addr 172.21.15.1:0/4143195567 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:00.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.658+0000 7ffae9d9b640 1 --2- 172.21.15.1:0/4143195567 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557943325390 0x5579436eabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.658+0000 7ffaead9d640 1 --2- 172.21.15.1:0/4143195567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557943346070 0x5579436eb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.658+0000 7ffaead9d640 1 -- 172.21.15.1:0/4143195567 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557943325390 msgr2=0x5579436eabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:00.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.658+0000 7ffaead9d640 1 --2- 172.21.15.1:0/4143195567 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557943325390 0x5579436eabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.658+0000 7ffaead9d640 1 -- 172.21.15.1:0/4143195567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557943346070 msgr2=0x5579436eb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:00.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.658+0000 7ffaead9d640 1 --2- 172.21.15.1:0/4143195567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557943346070 0x5579436eb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.658+0000 7ffaead9d640 1 -- 172.21.15.1:0/4143195567 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579436fbd60 con 0x55794331d1b0 2024-09-21T00:59:00.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.658+0000 7ffaead9d640 1 --2- 172.21.15.1:0/4143195567 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55794331d1b0 0x5579436eede0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ffae4006010 tx=0x7ffae4009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be3b61095fdb22d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:00.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.658+0000 7ffad3fff640 1 -- 172.21.15.1:0/4143195567 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae402c070 con 0x55794331d1b0 2024-09-21T00:59:00.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.658+0000 7ffad3fff640 1 -- 172.21.15.1:0/4143195567 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffae4005020 con 0x55794331d1b0 2024-09-21T00:59:00.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.659+0000 7ffad3fff640 1 -- 172.21.15.1:0/4143195567 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae4003940 con 0x55794331d1b0 2024-09-21T00:59:00.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.659+0000 7ffaf6fd7740 1 -- 172.21.15.1:0/4143195567 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55794331d1b0 msgr2=0x5579436eede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:00.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.659+0000 7ffaf6fd7740 1 --2- 172.21.15.1:0/4143195567 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55794331d1b0 0x5579436eede0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ffae4006010 tx=0x7ffae4009f30 comp rx=0 tx=0).stop 2024-09-21T00:59:00.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.659+0000 7ffaf6fd7740 1 -- 172.21.15.1:0/4143195567 shutdown_connections 2024-09-21T00:59:00.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.659+0000 7ffaf6fd7740 1 --2- 172.21.15.1:0/4143195567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557943346070 0x5579436eb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.659+0000 7ffaf6fd7740 1 --2- 172.21.15.1:0/4143195567 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557943325390 0x5579436eabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.659+0000 7ffaf6fd7740 1 --2- 172.21.15.1:0/4143195567 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55794331d1b0 0x5579436eede0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.659+0000 7ffaf6fd7740 1 -- 172.21.15.1:0/4143195567 >> 172.21.15.1:0/4143195567 conn(0x55794333a460 msgr2=0x5579436ee6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:00.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.660+0000 7ffaf6fd7740 1 -- 172.21.15.1:0/4143195567 shutdown_connections 2024-09-21T00:59:00.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.660+0000 7ffaf6fd7740 1 -- 172.21.15.1:0/4143195567 wait complete. 2024-09-21T00:59:00.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.660+0000 7ffaf6fd7740 1 -- start start 2024-09-21T00:59:00.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.660+0000 7ffaf6fd7740 1 Processor -- start 2024-09-21T00:59:00.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.661+0000 7ffaf6fd7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55794331d1b0 0x5579437017a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.661+0000 7ffaf6fd7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557943325390 0x5579436fcc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.661+0000 7ffaf6fd7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557943346070 0x5579436fd190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.661+0000 7ffaf6fd7740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffaec1b09c0 con 0x557943325390 2024-09-21T00:59:00.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.661+0000 7ffaf6fd7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ffaec1b02f0 con 0x55794331d1b0 2024-09-21T00:59:00.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.661+0000 7ffaf6fd7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ffaec1ad470 con 0x557943346070 2024-09-21T00:59:00.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.661+0000 7ffaf6fd7740 10 client.0 _ll_register_callbacks cb 0x7ffae4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:00.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.661+0000 7ffae9d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557943325390 0x5579436fcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.661+0000 7ffaead9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55794331d1b0 0x5579437017a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.661+0000 7ffae9d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557943325390 0x5579436fcc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60022/0 (socket says 172.21.15.1:60022) 2024-09-21T00:59:00.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.661+0000 7ffae9d9b640 1 -- 172.21.15.1:0/2738526560 learned_addr learned my addr 172.21.15.1:0/2738526560 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:00.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.661+0000 7ffaead9d640 1 --2- 172.21.15.1:0/2738526560 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557943346070 0x5579436fd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.661+0000 7ffaead9d640 1 -- 172.21.15.1:0/2738526560 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557943346070 msgr2=0x5579436fd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:00.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.661+0000 7ffaead9d640 1 --2- 172.21.15.1:0/2738526560 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557943346070 0x5579436fd190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.661+0000 7ffaead9d640 1 -- 172.21.15.1:0/2738526560 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557943325390 msgr2=0x5579436fcc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:00.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.661+0000 7ffaead9d640 1 --2- 172.21.15.1:0/2738526560 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557943325390 0x5579436fcc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.661+0000 7ffaead9d640 1 -- 172.21.15.1:0/2738526560 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579436fd7d0 con 0x55794331d1b0 2024-09-21T00:59:00.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.662+0000 7ffaead9d640 1 --2- 172.21.15.1:0/2738526560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55794331d1b0 0x5579437017a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ffae4032640 tx=0x7ffae4011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d0196771275b8fc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:00.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.662+0000 7ffad1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T00:59:00.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.662+0000 7ffad1ffb640 1 -- 172.21.15.1:0/2738526560 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae402c040 con 0x55794331d1b0 2024-09-21T00:59:00.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.662+0000 7ffad1ffb640 1 -- 172.21.15.1:0/2738526560 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7ffae40036c0 con 0x55794331d1b0 2024-09-21T00:59:00.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.662+0000 7ffaf6fd7740 1 -- 172.21.15.1:0/2738526560 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffae4005020 con 0x55794331d1b0 2024-09-21T00:59:00.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.662+0000 7ffad1ffb640 1 -- 172.21.15.1:0/2738526560 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ffae4003af0 con 0x55794331d1b0 2024-09-21T00:59:00.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.662+0000 7ffaf6fd7740 10 client.25811 fetch_fsmap learned FSMap version 31 2024-09-21T00:59:00.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.662+0000 7ffaf6fd7740 1 -- 172.21.15.1:0/2738526560 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x557943775510 con 0x55794331d1b0 2024-09-21T00:59:00.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.663+0000 7ffad1ffb640 1 -- 172.21.15.1:0/2738526560 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffae4005020 con 0x55794331d1b0 2024-09-21T00:59:00.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.663+0000 7ffad1ffb640 1 -- 172.21.15.1:0/2738526560 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7ffae403b070 con 0x55794331d1b0 2024-09-21T00:59:00.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.663+0000 7ffaf6fd7740 10 client.25811 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:59:00.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.663+0000 7ffaf6fd7740 10 client.25811 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T00:59:00.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.663+0000 7ffaf6fd7740 20 client.25811 populate_metadata read hostname 'smithi001' 2024-09-21T00:59:00.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.663+0000 7ffaf6fd7740 1 --2- 172.21.15.1:0/2738526560 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5579432d9da0 0x557943777b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.663+0000 7ffaf6fd7740 4 client.25811 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:59:00.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.663+0000 7ffaf6fd7740 1 -- 172.21.15.1:0/2738526560 --> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5579436618a0 con 0x5579432d9da0 2024-09-21T00:59:00.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.664+0000 7ffae9d9b640 1 --2- 172.21.15.1:0/2738526560 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5579432d9da0 0x557943777b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.664+0000 7ffad1ffb640 10 client.25811 ms_handle_connect on v2:172.21.15.193:6838/1365361177 2024-09-21T00:59:00.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.664+0000 7ffae9d9b640 1 --2- 172.21.15.1:0/2738526560 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5579432d9da0 0x557943777b20 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9d2ed32c659b3d3 server_cookie=f67f1b15cb9de557 in_seq=0 out_seq=0 2024-09-21T00:59:00.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.664+0000 7ffad1ffb640 1 -- 172.21.15.1:0/2738526560 <== mds.1 v2:172.21.15.193:6838/1365361177 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5579436618a0 con 0x5579432d9da0 2024-09-21T00:59:00.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.664+0000 7ffad1ffb640 10 client.25811 handle_command_reply: tid=0 2024-09-21T00:59:00.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.664+0000 7ffaf6fd7740 1 client.25811 shutdown 2024-09-21T00:59:00.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.664+0000 7ffaf6fd7740 1 -- 172.21.15.1:0/2738526560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55794331d1b0 msgr2=0x5579437017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:00.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.664+0000 7ffaf6fd7740 1 --2- 172.21.15.1:0/2738526560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55794331d1b0 0x5579437017a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ffae4032640 tx=0x7ffae4011810 comp rx=0 tx=0).stop 2024-09-21T00:59:00.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.665+0000 7ffaf6fd7740 1 -- 172.21.15.1:0/2738526560 shutdown_connections 2024-09-21T00:59:00.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.665+0000 7ffaf6fd7740 1 --2- 172.21.15.1:0/2738526560 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5579432d9da0 0x557943777b20 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.665+0000 7ffaf6fd7740 1 --2- 172.21.15.1:0/2738526560 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557943346070 0x5579436fd190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.665+0000 7ffaf6fd7740 1 --2- 172.21.15.1:0/2738526560 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557943325390 0x5579436fcc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.665+0000 7ffad1ffb640 0 client.25811 ms_handle_reset on v2:172.21.15.193:6838/1365361177 2024-09-21T00:59:00.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.665+0000 7ffaf6fd7740 1 --2- 172.21.15.1:0/2738526560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55794331d1b0 0x5579437017a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.665+0000 7ffaf6fd7740 1 -- 172.21.15.1:0/2738526560 >> 172.21.15.1:0/2738526560 conn(0x55794333a460 msgr2=0x5579436fa210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:00.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.665+0000 7ffaf6fd7740 1 -- 172.21.15.1:0/2738526560 shutdown_connections 2024-09-21T00:59:00.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.665+0000 7ffaf6fd7740 1 -- 172.21.15.1:0/2738526560 wait complete. 2024-09-21T00:59:00.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.665+0000 7ffaf6fd7740 20 client.25811 trim_cache size 0 max 16384 2024-09-21T00:59:00.668 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T00:59:00.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.665+0000 7ffaf0a63640 1 -- 172.21.15.1:0/2914507431 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ffad40b6590 msgr2=0x7ffad40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:00.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.665+0000 7ffaf0a63640 1 --2- 172.21.15.1:0/2914507431 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ffad40b6590 0x7ffad40b8aa0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x5579436ec320 tx=0x7ffadc00cf20 comp rx=0 tx=0).stop 2024-09-21T00:59:00.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.665+0000 7ffaf0a63640 1 -- 172.21.15.1:0/2914507431 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffaec103b90 msgr2=0x7ffaec19a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:00.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.665+0000 7ffaf0a63640 1 --2- 172.21.15.1:0/2914507431 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffaec103b90 0x7ffaec19a4b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffadc00e9f0 tx=0x7ffadc00eeb0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.665+0000 7ffaf0a63640 1 -- 172.21.15.1:0/2914507431 shutdown_connections 2024-09-21T00:59:00.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.665+0000 7ffaf0a63640 1 --2- 172.21.15.1:0/2914507431 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffaec109e20 0x7ffaec19fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.665+0000 7ffaf0a63640 1 --2- 172.21.15.1:0/2914507431 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7ffad40b6590 0x7ffad40b8aa0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.665+0000 7ffaf0a63640 1 --2- 172.21.15.1:0/2914507431 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffaec1094d0 0x7ffaec19aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.666+0000 7ffaf0a63640 1 --2- 172.21.15.1:0/2914507431 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffaec103b90 0x7ffaec19a4b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.666+0000 7ffaf0a63640 1 -- 172.21.15.1:0/2914507431 >> 172.21.15.1:0/2914507431 conn(0x7ffaec0ff600 msgr2=0x7ffaec101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:00.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.666+0000 7ffaf0a63640 1 -- 172.21.15.1:0/2914507431 shutdown_connections 2024-09-21T00:59:00.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:00.666+0000 7ffaf0a63640 1 -- 172.21.15.1:0/2914507431 wait complete. 2024-09-21T00:59:01.383 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T00:59:02.043 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:59:02.195 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:01 smithi001 ceph-mon[31211]: pgmap v412: 97 pgs: 97 active+clean; 180 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 9.7 MiB/s wr, 800 op/s 2024-09-21T00:59:02.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:01 smithi193 ceph-mon[34660]: pgmap v412: 97 pgs: 97 active+clean; 180 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 9.7 MiB/s wr, 800 op/s 2024-09-21T00:59:02.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:01 smithi042 ceph-mon[34481]: pgmap v412: 97 pgs: 97 active+clean; 180 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 9.7 MiB/s wr, 800 op/s 2024-09-21T00:59:03.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.202+0000 7f607b0cb640 1 -- 172.21.15.1:0/3042272604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6074109e10 msgr2=0x7f6074110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:03.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.202+0000 7f607b0cb640 1 --2- 172.21.15.1:0/3042272604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6074109e10 0x7f6074110640 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f606c009ca0 tx=0x7f606c02a8c0 comp rx=0 tx=0).stop 2024-09-21T00:59:03.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.202+0000 7f607b0cb640 1 -- 172.21.15.1:0/3042272604 shutdown_connections 2024-09-21T00:59:03.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.202+0000 7f607b0cb640 1 --2- 172.21.15.1:0/3042272604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6074109e10 0x7f6074110640 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:03.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.202+0000 7f607b0cb640 1 --2- 172.21.15.1:0/3042272604 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f60741094c0 0x7f60741098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:03.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.202+0000 7f607b0cb640 1 --2- 172.21.15.1:0/3042272604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6074103b80 0x7f6074103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:03.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.202+0000 7f607b0cb640 1 -- 172.21.15.1:0/3042272604 >> 172.21.15.1:0/3042272604 conn(0x7f60740ff610 msgr2=0x7f6074101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:03.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.203+0000 7f607b0cb640 1 -- 172.21.15.1:0/3042272604 shutdown_connections 2024-09-21T00:59:03.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.203+0000 7f607b0cb640 1 -- 172.21.15.1:0/3042272604 wait complete. 2024-09-21T00:59:03.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.204+0000 7f607b0cb640 1 Processor -- start 2024-09-21T00:59:03.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.204+0000 7f607b0cb640 1 -- start start 2024-09-21T00:59:03.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.205+0000 7f607b0cb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6074103b80 0x7f607419a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:03.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.205+0000 7f607b0cb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f60741094c0 0x7f607419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:03.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.205+0000 7f607b0cb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6074109e10 0x7f607419fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:03.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.205+0000 7f607b0cb640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6074113ad0 con 0x7f6074109e10 2024-09-21T00:59:03.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.205+0000 7f607b0cb640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6074113950 con 0x7f6074103b80 2024-09-21T00:59:03.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.205+0000 7f607b0cb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6074113c50 con 0x7f60741094c0 2024-09-21T00:59:03.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.205+0000 7f6078e67640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6074103b80 0x7f607419a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:03.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.205+0000 7f6073fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f60741094c0 0x7f607419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:03.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.205+0000 7f6079668640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6074109e10 0x7f607419fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:03.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.205+0000 7f6078e67640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6074103b80 0x7f607419a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:54700/0 (socket says 172.21.15.1:54700) 2024-09-21T00:59:03.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.205+0000 7f6078e67640 1 -- 172.21.15.1:0/3997123089 learned_addr learned my addr 172.21.15.1:0/3997123089 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:03.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.205+0000 7f6073fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f60741094c0 0x7f607419a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:59168/0 (socket says 172.21.15.1:59168) 2024-09-21T00:59:03.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.205+0000 7f6073fff640 1 -- 172.21.15.1:0/3997123089 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6074103b80 msgr2=0x7f607419a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:03.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.205+0000 7f6073fff640 1 --2- 172.21.15.1:0/3997123089 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6074103b80 0x7f607419a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:03.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.205+0000 7f6073fff640 1 -- 172.21.15.1:0/3997123089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6074109e10 msgr2=0x7f607419fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:03.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.205+0000 7f6073fff640 1 --2- 172.21.15.1:0/3997123089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6074109e10 0x7f607419fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:03.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.205+0000 7f6073fff640 1 -- 172.21.15.1:0/3997123089 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60741a0390 con 0x7f60741094c0 2024-09-21T00:59:03.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.206+0000 7f6073fff640 1 --2- 172.21.15.1:0/3997123089 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f60741094c0 0x7f607419a9c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f607406aa90 tx=0x7f606000ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:03.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.206+0000 7f6071ffb640 1 -- 172.21.15.1:0/3997123089 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f606000cc40 con 0x7f60741094c0 2024-09-21T00:59:03.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.206+0000 7f6071ffb640 1 -- 172.21.15.1:0/3997123089 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f606000cde0 con 0x7f60741094c0 2024-09-21T00:59:03.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.206+0000 7f6071ffb640 1 -- 172.21.15.1:0/3997123089 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6060018780 con 0x7f60741094c0 2024-09-21T00:59:03.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.206+0000 7f607b0cb640 1 -- 172.21.15.1:0/3997123089 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60741a0680 con 0x7f60741094c0 2024-09-21T00:59:03.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.206+0000 7f607b0cb640 1 -- 172.21.15.1:0/3997123089 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60740755f0 con 0x7f60741094c0 2024-09-21T00:59:03.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.209+0000 7f6071ffb640 1 -- 172.21.15.1:0/3997123089 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f6060010430 con 0x7f60741094c0 2024-09-21T00:59:03.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.211+0000 7f608163f740 1 Processor -- start 2024-09-21T00:59:03.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.211+0000 7f608163f740 1 -- start start 2024-09-21T00:59:03.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.211+0000 7f608163f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e890fff070 0x55e8913a62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:03.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.211+0000 7f608163f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e890fd61b0 0x55e8913a6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:03.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.211+0000 7f608163f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e890fde390 0x55e8913a6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:03.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.211+0000 7f6079668640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e890fff070 0x55e8913a62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:03.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.211+0000 7f6079668640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e890fff070 0x55e8913a62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:59178/0 (socket says 172.21.15.1:59178) 2024-09-21T00:59:03.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.211+0000 7f6079668640 1 -- 172.21.15.1:0/2664987894 learned_addr learned my addr 172.21.15.1:0/2664987894 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:03.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.212+0000 7f6078e67640 1 --2- 172.21.15.1:0/2664987894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e890fd61b0 0x55e8913a6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:03.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.212+0000 7f608163f740 1 -- 172.21.15.1:0/2664987894 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e89131cea0 con 0x55e890fd61b0 2024-09-21T00:59:03.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.212+0000 7f6073fff640 1 --2- 172.21.15.1:0/2664987894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e890fde390 0x55e8913a6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:03.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.212+0000 7f608163f740 1 -- 172.21.15.1:0/2664987894 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e89130c2d0 con 0x55e890fde390 2024-09-21T00:59:03.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.212+0000 7f608163f740 1 -- 172.21.15.1:0/2664987894 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55e8913100e0 con 0x55e890fff070 2024-09-21T00:59:03.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.212+0000 7f6071ffb640 1 --2- 172.21.15.1:0/3997123089 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f60640b6610 0x7f60640b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:03.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.212+0000 7f6079668640 1 -- 172.21.15.1:0/2664987894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e890fde390 msgr2=0x55e8913a6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:03.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.212+0000 7f6079668640 1 --2- 172.21.15.1:0/2664987894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e890fde390 0x55e8913a6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:03.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.212+0000 7f6079668640 1 -- 172.21.15.1:0/2664987894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e890fd61b0 msgr2=0x55e8913a6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:03.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.212+0000 7f6079668640 1 --2- 172.21.15.1:0/2664987894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e890fd61b0 0x55e8913a6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:03.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.212+0000 7f6079668640 1 -- 172.21.15.1:0/2664987894 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e89106a650 con 0x55e890fff070 2024-09-21T00:59:03.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.212+0000 7f6078e67640 1 --2- 172.21.15.1:0/2664987894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e890fd61b0 0x55e8913a6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:03.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.212+0000 7f6071ffb640 1 -- 172.21.15.1:0/3997123089 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f60600e75a0 con 0x7f60741094c0 2024-09-21T00:59:03.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.212+0000 7f6079668640 1 --2- 172.21.15.1:0/3997123089 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f60640b6610 0x7f60640b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:03.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.212+0000 7f6073fff640 1 --2- 172.21.15.1:0/2664987894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e890fde390 0x55e8913a6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:59:03.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.212+0000 7f6079668640 1 --2- 172.21.15.1:0/2664987894 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e890fff070 0x55e8913a62c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f606c009480 tx=0x7f606c009800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5d7c731db51a6b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:03.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.213+0000 7f605effd640 1 -- 172.21.15.1:0/2664987894 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f606c042040 con 0x55e890fff070 2024-09-21T00:59:03.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.213+0000 7f605effd640 1 -- 172.21.15.1:0/2664987894 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f606c036070 con 0x55e890fff070 2024-09-21T00:59:03.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.213+0000 7f605effd640 1 -- 172.21.15.1:0/2664987894 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f606c02f660 con 0x55e890fff070 2024-09-21T00:59:03.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.214+0000 7f608163f740 1 -- 172.21.15.1:0/2664987894 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e890fff070 msgr2=0x55e8913a62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:03.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.214+0000 7f6079668640 1 --2- 172.21.15.1:0/3997123089 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f60640b6610 0x7f60640b8b20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f606c04d000 tx=0x7f606c04e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:03.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.214+0000 7f608163f740 1 --2- 172.21.15.1:0/2664987894 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e890fff070 0x55e8913a62c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f606c009480 tx=0x7f606c009800 comp rx=0 tx=0).stop 2024-09-21T00:59:03.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.214+0000 7f608163f740 1 -- 172.21.15.1:0/2664987894 shutdown_connections 2024-09-21T00:59:03.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.214+0000 7f608163f740 1 --2- 172.21.15.1:0/2664987894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e890fde390 0x55e8913a6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:03.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.214+0000 7f608163f740 1 --2- 172.21.15.1:0/2664987894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e890fd61b0 0x55e8913a6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:03.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.214+0000 7f608163f740 1 --2- 172.21.15.1:0/2664987894 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e890fff070 0x55e8913a62c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:03.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.214+0000 7f608163f740 1 -- 172.21.15.1:0/2664987894 >> 172.21.15.1:0/2664987894 conn(0x55e890ff3460 msgr2=0x55e8913a41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:03.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.214+0000 7f608163f740 1 -- 172.21.15.1:0/2664987894 shutdown_connections 2024-09-21T00:59:03.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.214+0000 7f608163f740 1 -- 172.21.15.1:0/2664987894 wait complete. 2024-09-21T00:59:03.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.214+0000 7f608163f740 1 -- start start 2024-09-21T00:59:03.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.215+0000 7f608163f740 1 Processor -- start 2024-09-21T00:59:03.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.215+0000 7f608163f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e890fd61b0 0x55e8913ba180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:03.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.215+0000 7f608163f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e890fde390 0x55e8913ba6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:03.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.215+0000 7f608163f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e890fff070 0x55e8913c6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:03.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.215+0000 7f608163f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e89116d700 con 0x55e890fde390 2024-09-21T00:59:03.374 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T00:59:03.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.215+0000 7f608163f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e8912a7160 con 0x55e890fff070 2024-09-21T00:59:03.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.215+0000 7f608163f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55e8913bd1d0 con 0x55e890fd61b0 2024-09-21T00:59:03.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.215+0000 7f6078e67640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e890fd61b0 0x55e8913ba180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:03.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.215+0000 7f6073fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e890fde390 0x55e8913ba6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:03.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.215+0000 7f6078e67640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e890fd61b0 0x55e8913ba180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:59188/0 (socket says 172.21.15.1:59188) 2024-09-21T00:59:03.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.215+0000 7f6078e67640 1 -- 172.21.15.1:0/2056544641 learned_addr learned my addr 172.21.15.1:0/2056544641 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:03.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.215+0000 7f6079668640 1 --2- 172.21.15.1:0/2056544641 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e890fff070 0x55e8913c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:03.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.215+0000 7f608163f740 10 client.0 _ll_register_callbacks cb 0x55e8912c09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:03.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.216+0000 7f6078e67640 1 -- 172.21.15.1:0/2056544641 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e890fff070 msgr2=0x55e8913c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:03.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.216+0000 7f6078e67640 1 --2- 172.21.15.1:0/2056544641 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e890fff070 0x55e8913c6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:03.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.216+0000 7f6078e67640 1 -- 172.21.15.1:0/2056544641 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e890fde390 msgr2=0x55e8913ba6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:03.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.216+0000 7f6078e67640 1 --2- 172.21.15.1:0/2056544641 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e890fde390 0x55e8913ba6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:03.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.216+0000 7f6078e67640 1 -- 172.21.15.1:0/2056544641 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8912d4c90 con 0x55e890fd61b0 2024-09-21T00:59:03.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.216+0000 7f6079668640 1 --2- 172.21.15.1:0/2056544641 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e890fff070 0x55e8913c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:59:03.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.216+0000 7f6078e67640 1 --2- 172.21.15.1:0/2056544641 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e890fd61b0 0x55e8913ba180 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6068012790 tx=0x7f6068012c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bb3aa6672221332 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:03.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.216+0000 7f6053fff640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T00:59:03.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.216+0000 7f6053fff640 1 -- 172.21.15.1:0/2056544641 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f606800f920 con 0x55e890fd61b0 2024-09-21T00:59:03.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.216+0000 7f6053fff640 1 -- 172.21.15.1:0/2056544641 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f606800fac0 con 0x55e890fd61b0 2024-09-21T00:59:03.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.216+0000 7f608163f740 1 -- 172.21.15.1:0/2056544641 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f606c036070 con 0x55e890fd61b0 2024-09-21T00:59:03.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.216+0000 7f6053fff640 1 -- 172.21.15.1:0/2056544641 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f606800fcc0 con 0x55e890fd61b0 2024-09-21T00:59:03.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.216+0000 7f608163f740 10 client.25741 fetch_fsmap learned FSMap version 31 2024-09-21T00:59:03.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.216+0000 7f608163f740 1 -- 172.21.15.1:0/2056544641 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55e8913c8eb0 con 0x55e890fd61b0 2024-09-21T00:59:03.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.216+0000 7f6053fff640 1 -- 172.21.15.1:0/2056544641 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f606c036070 con 0x55e890fd61b0 2024-09-21T00:59:03.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.217+0000 7f6053fff640 1 -- 172.21.15.1:0/2056544641 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7f6068026420 con 0x55e890fd61b0 2024-09-21T00:59:03.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.217+0000 7f608163f740 10 client.25741 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:59:03.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.217+0000 7f608163f740 10 client.25741 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:03.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.217+0000 7f608163f740 20 client.25741 populate_metadata read hostname 'smithi001' 2024-09-21T00:59:03.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.217+0000 7f608163f740 1 --2- 172.21.15.1:0/2056544641 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55e890fbd9f0 0x55e8913cc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:03.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.217+0000 7f608163f740 4 client.25741 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:59:03.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.217+0000 7f608163f740 1 -- 172.21.15.1:0/2056544641 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e89131edf0 con 0x55e890fbd9f0 2024-09-21T00:59:03.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.217+0000 7f6073fff640 1 --2- 172.21.15.1:0/2056544641 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55e890fbd9f0 0x55e8913cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:03.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.217+0000 7f6053fff640 10 client.25741 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:03.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.217+0000 7f6073fff640 1 --2- 172.21.15.1:0/2056544641 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55e890fbd9f0 0x55e8913cc440 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb46106e5cad0ee9 server_cookie=ef250180907af815 in_seq=0 out_seq=0 2024-09-21T00:59:03.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.219+0000 7f6053fff640 1 -- 172.21.15.1:0/2056544641 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e89131edf0 con 0x55e890fbd9f0 2024-09-21T00:59:03.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.219+0000 7f6053fff640 10 client.25741 handle_command_reply: tid=0 2024-09-21T00:59:03.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.219+0000 7f608163f740 1 client.25741 shutdown 2024-09-21T00:59:03.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.220+0000 7f608163f740 1 -- 172.21.15.1:0/2056544641 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e890fd61b0 msgr2=0x55e8913ba180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:03.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.220+0000 7f608163f740 1 --2- 172.21.15.1:0/2056544641 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e890fd61b0 0x55e8913ba180 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6068012790 tx=0x7f6068012c50 comp rx=0 tx=0).stop 2024-09-21T00:59:03.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.220+0000 7f608163f740 1 -- 172.21.15.1:0/2056544641 shutdown_connections 2024-09-21T00:59:03.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.220+0000 7f608163f740 1 --2- 172.21.15.1:0/2056544641 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55e890fbd9f0 0x55e8913cc440 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:03.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.220+0000 7f608163f740 1 --2- 172.21.15.1:0/2056544641 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e890fff070 0x55e8913c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:03.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.220+0000 7f608163f740 1 --2- 172.21.15.1:0/2056544641 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e890fde390 0x55e8913ba6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:03.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.220+0000 7f608163f740 1 --2- 172.21.15.1:0/2056544641 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e890fd61b0 0x55e8913ba180 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:03.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.220+0000 7f608163f740 1 -- 172.21.15.1:0/2056544641 >> 172.21.15.1:0/2056544641 conn(0x55e890ff3460 msgr2=0x55e8913a2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:03.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.220+0000 7f6053fff640 0 client.25741 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:03.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.220+0000 7f608163f740 1 -- 172.21.15.1:0/2056544641 shutdown_connections 2024-09-21T00:59:03.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.220+0000 7f608163f740 1 -- 172.21.15.1:0/2056544641 wait complete. 2024-09-21T00:59:03.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.220+0000 7f608163f740 20 client.25741 trim_cache size 0 max 16384 2024-09-21T00:59:03.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.235+0000 7f608163f740 1 Processor -- start 2024-09-21T00:59:03.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.235+0000 7f608163f740 1 -- start start 2024-09-21T00:59:03.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.235+0000 7f608163f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e890fd61b0 0x55e8913a4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:03.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.235+0000 7f608163f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e890fde390 0x55e8913c6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:03.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.235+0000 7f608163f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e890fff070 0x55e8913b7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:03.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.235+0000 7f608163f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f60741ad210 con 0x55e890fde390 2024-09-21T00:59:03.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.235+0000 7f608163f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f60741aeed0 con 0x55e890fd61b0 2024-09-21T00:59:03.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.235+0000 7f608163f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f60741ad8e0 con 0x55e890fff070 2024-09-21T00:59:03.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.235+0000 7f6073fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e890fde390 0x55e8913c6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:03.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.236+0000 7f6079668640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e890fff070 0x55e8913b7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:03.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.236+0000 7f6078e67640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e890fd61b0 0x55e8913a4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:03.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.236+0000 7f6073fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e890fde390 0x55e8913c6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60048/0 (socket says 172.21.15.1:60048) 2024-09-21T00:59:03.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.236+0000 7f6079668640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e890fff070 0x55e8913b7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:59204/0 (socket says 172.21.15.1:59204) 2024-09-21T00:59:03.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.236+0000 7f6073fff640 1 -- 172.21.15.1:0/2007546837 learned_addr learned my addr 172.21.15.1:0/2007546837 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:03.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.236+0000 7f6073fff640 1 -- 172.21.15.1:0/2007546837 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e890fff070 msgr2=0x55e8913b7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:03.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.236+0000 7f6073fff640 1 --2- 172.21.15.1:0/2007546837 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e890fff070 0x55e8913b7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:03.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.236+0000 7f6073fff640 1 -- 172.21.15.1:0/2007546837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e890fd61b0 msgr2=0x55e8913a4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:03.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.236+0000 7f6073fff640 1 --2- 172.21.15.1:0/2007546837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e890fd61b0 0x55e8913a4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:03.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.236+0000 7f6073fff640 1 -- 172.21.15.1:0/2007546837 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8913bd0b0 con 0x55e890fde390 2024-09-21T00:59:03.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.236+0000 7f6078e67640 1 --2- 172.21.15.1:0/2007546837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e890fd61b0 0x55e8913a4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:03.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.236+0000 7f6079668640 1 --2- 172.21.15.1:0/2007546837 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e890fff070 0x55e8913b7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:03.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.236+0000 7f6073fff640 1 --2- 172.21.15.1:0/2007546837 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e890fde390 0x55e8913c6400 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f60600a9d30 tx=0x7f60600e9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad000a2d873af84c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:03.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.236+0000 7f605e7fc640 1 -- 172.21.15.1:0/2007546837 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60600a7e60 con 0x55e890fde390 2024-09-21T00:59:03.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.237+0000 7f605e7fc640 1 -- 172.21.15.1:0/2007546837 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60600a99d0 con 0x55e890fde390 2024-09-21T00:59:03.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.237+0000 7f605e7fc640 1 -- 172.21.15.1:0/2007546837 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60600e70b0 con 0x55e890fde390 2024-09-21T00:59:03.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.237+0000 7f608163f740 1 -- 172.21.15.1:0/2007546837 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e890fde390 msgr2=0x55e8913c6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:03.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.237+0000 7f608163f740 1 --2- 172.21.15.1:0/2007546837 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e890fde390 0x55e8913c6400 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f60600a9d30 tx=0x7f60600e9040 comp rx=0 tx=0).stop 2024-09-21T00:59:03.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.238+0000 7f608163f740 1 -- 172.21.15.1:0/2007546837 shutdown_connections 2024-09-21T00:59:03.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.238+0000 7f608163f740 1 --2- 172.21.15.1:0/2007546837 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e890fff070 0x55e8913b7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:03.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.238+0000 7f608163f740 1 --2- 172.21.15.1:0/2007546837 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e890fde390 0x55e8913c6400 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:03.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.238+0000 7f608163f740 1 --2- 172.21.15.1:0/2007546837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e890fd61b0 0x55e8913a4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:03.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.238+0000 7f608163f740 1 -- 172.21.15.1:0/2007546837 >> 172.21.15.1:0/2007546837 conn(0x55e890ff3460 msgr2=0x55e8913a3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:03.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.238+0000 7f608163f740 1 -- 172.21.15.1:0/2007546837 shutdown_connections 2024-09-21T00:59:03.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.238+0000 7f608163f740 1 -- 172.21.15.1:0/2007546837 wait complete. 2024-09-21T00:59:03.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.238+0000 7f608163f740 1 -- start start 2024-09-21T00:59:03.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.238+0000 7f608163f740 1 Processor -- start 2024-09-21T00:59:03.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.239+0000 7f608163f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e890fd61b0 0x55e8913be790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:03.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.239+0000 7f608163f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e890fde390 0x55e8913becd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:03.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.239+0000 7f608163f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e890fff070 0x55e891435e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:03.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.239+0000 7f608163f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f60741ae740 con 0x55e890fde390 2024-09-21T00:59:03.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.239+0000 7f608163f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f60741ae070 con 0x55e890fff070 2024-09-21T00:59:03.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.239+0000 7f608163f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f60741ab1f0 con 0x55e890fd61b0 2024-09-21T00:59:03.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.239+0000 7f608163f740 10 client.0 _ll_register_callbacks cb 0x7f6068009940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:03.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.239+0000 7f6073fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e890fde390 0x55e8913becd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:03.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.239+0000 7f6073fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e890fde390 0x55e8913becd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60062/0 (socket says 172.21.15.1:60062) 2024-09-21T00:59:03.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.239+0000 7f6078e67640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e890fd61b0 0x55e8913be790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:03.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.239+0000 7f6073fff640 1 -- 172.21.15.1:0/2323135374 learned_addr learned my addr 172.21.15.1:0/2323135374 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:03.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.239+0000 7f6079668640 1 --2- 172.21.15.1:0/2323135374 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e890fff070 0x55e891435e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:03.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.239+0000 7f6073fff640 1 -- 172.21.15.1:0/2323135374 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e890fd61b0 msgr2=0x55e8913be790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:03.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.239+0000 7f6073fff640 1 --2- 172.21.15.1:0/2323135374 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e890fd61b0 0x55e8913be790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:03.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.239+0000 7f6073fff640 1 -- 172.21.15.1:0/2323135374 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e890fff070 msgr2=0x55e891435e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:03.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.239+0000 7f6073fff640 1 --2- 172.21.15.1:0/2323135374 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e890fff070 0x55e891435e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:03.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.239+0000 7f6073fff640 1 -- 172.21.15.1:0/2323135374 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8913bf570 con 0x55e890fde390 2024-09-21T00:59:03.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.239+0000 7f6073fff640 1 --2- 172.21.15.1:0/2323135374 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e890fde390 0x55e8913becd0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f60600aa9d0 tx=0x7f6060009700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc063964c94963d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:03.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.239+0000 7f6053fff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:59:03.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.240+0000 7f6053fff640 1 -- 172.21.15.1:0/2323135374 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60600d4070 con 0x55e890fde390 2024-09-21T00:59:03.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.240+0000 7f6053fff640 1 -- 172.21.15.1:0/2323135374 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f60600e70c0 con 0x55e890fde390 2024-09-21T00:59:03.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.240+0000 7f608163f740 1 -- 172.21.15.1:0/2323135374 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60600a99d0 con 0x55e890fde390 2024-09-21T00:59:03.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.240+0000 7f6053fff640 1 -- 172.21.15.1:0/2323135374 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f60600a7e60 con 0x55e890fde390 2024-09-21T00:59:03.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.240+0000 7f608163f740 10 client.16161 fetch_fsmap learned FSMap version 31 2024-09-21T00:59:03.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.240+0000 7f608163f740 1 -- 172.21.15.1:0/2323135374 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55e8914373d0 con 0x55e890fde390 2024-09-21T00:59:03.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.240+0000 7f6053fff640 1 -- 172.21.15.1:0/2323135374 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60600a99d0 con 0x55e890fde390 2024-09-21T00:59:03.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.240+0000 7f6053fff640 1 -- 172.21.15.1:0/2323135374 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7f60600cf320 con 0x55e890fde390 2024-09-21T00:59:03.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.240+0000 7f608163f740 10 client.16161 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:59:03.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.240+0000 7f608163f740 10 client.16161 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:03.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.240+0000 7f608163f740 20 client.16161 populate_metadata read hostname 'smithi001' 2024-09-21T00:59:03.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.240+0000 7f608163f740 1 --2- 172.21.15.1:0/2323135374 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55e890f92da0 0x55e891439ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:03.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.240+0000 7f608163f740 4 client.16161 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:59:03.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.240+0000 7f608163f740 1 -- 172.21.15.1:0/2323135374 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e89131a8a0 con 0x55e890f92da0 2024-09-21T00:59:03.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.241+0000 7f6078e67640 1 --2- 172.21.15.1:0/2323135374 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55e890f92da0 0x55e891439ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:03.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.241+0000 7f6078e67640 1 --2- 172.21.15.1:0/2323135374 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55e890f92da0 0x55e891439ba0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8e4d9baed956215 server_cookie=1ee13d922f9e252d in_seq=0 out_seq=0 2024-09-21T00:59:03.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.241+0000 7f6053fff640 10 client.16161 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:03.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.241+0000 7f6053fff640 1 -- 172.21.15.1:0/2323135374 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e89131a8a0 con 0x55e890f92da0 2024-09-21T00:59:03.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.241+0000 7f6053fff640 10 client.16161 handle_command_reply: tid=0 2024-09-21T00:59:03.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.241+0000 7f608163f740 1 client.16161 shutdown 2024-09-21T00:59:03.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.241+0000 7f608163f740 1 -- 172.21.15.1:0/2323135374 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e890fde390 msgr2=0x55e8913becd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:03.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.241+0000 7f608163f740 1 --2- 172.21.15.1:0/2323135374 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e890fde390 0x55e8913becd0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f60600aa9d0 tx=0x7f6060009700 comp rx=0 tx=0).stop 2024-09-21T00:59:03.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.242+0000 7f608163f740 1 -- 172.21.15.1:0/2323135374 shutdown_connections 2024-09-21T00:59:03.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.242+0000 7f608163f740 1 --2- 172.21.15.1:0/2323135374 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55e890f92da0 0x55e891439ba0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:03.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.242+0000 7f608163f740 1 --2- 172.21.15.1:0/2323135374 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e890fff070 0x55e891435e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:03.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.242+0000 7f608163f740 1 --2- 172.21.15.1:0/2323135374 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e890fde390 0x55e8913becd0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:03.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.242+0000 7f608163f740 1 --2- 172.21.15.1:0/2323135374 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e890fd61b0 0x55e8913be790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:03.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.242+0000 7f608163f740 1 -- 172.21.15.1:0/2323135374 >> 172.21.15.1:0/2323135374 conn(0x55e890ff3460 msgr2=0x55e8913ab430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:03.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.242+0000 7f6053fff640 0 client.16161 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:03.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.242+0000 7f608163f740 1 -- 172.21.15.1:0/2323135374 shutdown_connections 2024-09-21T00:59:03.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.242+0000 7f608163f740 1 -- 172.21.15.1:0/2323135374 wait complete. 2024-09-21T00:59:03.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.242+0000 7f608163f740 20 client.16161 trim_cache size 0 max 16384 2024-09-21T00:59:03.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.242+0000 7f607b0cb640 1 -- 172.21.15.1:0/3997123089 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f60640b6610 msgr2=0x7f60640b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:03.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.242+0000 7f607b0cb640 1 --2- 172.21.15.1:0/3997123089 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f60640b6610 0x7f60640b8b20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f606c04d000 tx=0x7f606c04e000 comp rx=0 tx=0).stop 2024-09-21T00:59:03.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.243+0000 7f607b0cb640 1 -- 172.21.15.1:0/3997123089 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f60741094c0 msgr2=0x7f607419a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:03.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.243+0000 7f607b0cb640 1 --2- 172.21.15.1:0/3997123089 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f60741094c0 0x7f607419a9c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f607406aa90 tx=0x7f606000ee50 comp rx=0 tx=0).stop 2024-09-21T00:59:03.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.243+0000 7f607b0cb640 1 -- 172.21.15.1:0/3997123089 shutdown_connections 2024-09-21T00:59:03.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.243+0000 7f607b0cb640 1 --2- 172.21.15.1:0/3997123089 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f60640b6610 0x7f60640b8b20 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:03.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.243+0000 7f607b0cb640 1 --2- 172.21.15.1:0/3997123089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6074109e10 0x7f607419fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:03.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.243+0000 7f607b0cb640 1 --2- 172.21.15.1:0/3997123089 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f60741094c0 0x7f607419a9c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:03.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.243+0000 7f607b0cb640 1 --2- 172.21.15.1:0/3997123089 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6074103b80 0x7f607419a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:03.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.243+0000 7f607b0cb640 1 -- 172.21.15.1:0/3997123089 >> 172.21.15.1:0/3997123089 conn(0x7f60740ff610 msgr2=0x7f6074108b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:03.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.243+0000 7f607b0cb640 1 -- 172.21.15.1:0/3997123089 shutdown_connections 2024-09-21T00:59:03.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:03.243+0000 7f607b0cb640 1 -- 172.21.15.1:0/3997123089 wait complete. 2024-09-21T00:59:03.556 INFO:tasks.workunit.client.0.smithi001.stdout: 43 431735 315 258055 160 240905 1057 2024-09-21T00:59:04.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:03 smithi001 ceph-mon[31211]: pgmap v413: 97 pgs: 97 active+clean; 186 MiB data, 629 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 11 MiB/s wr, 901 op/s 2024-09-21T00:59:04.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:03 smithi193 ceph-mon[34660]: pgmap v413: 97 pgs: 97 active+clean; 186 MiB data, 629 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 11 MiB/s wr, 901 op/s 2024-09-21T00:59:04.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:03 smithi042 ceph-mon[34481]: pgmap v413: 97 pgs: 97 active+clean; 186 MiB data, 629 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 11 MiB/s wr, 901 op/s 2024-09-21T00:59:05.446 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T00:59:05.446 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T00:59:05.722 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:59:06.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:05 smithi001 ceph-mon[31211]: pgmap v414: 97 pgs: 97 active+clean; 183 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 11 MiB/s wr, 885 op/s 2024-09-21T00:59:06.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:05 smithi193 ceph-mon[34660]: pgmap v414: 97 pgs: 97 active+clean; 183 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 11 MiB/s wr, 885 op/s 2024-09-21T00:59:06.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:05 smithi042 ceph-mon[34481]: pgmap v414: 97 pgs: 97 active+clean; 183 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 11 MiB/s wr, 885 op/s 2024-09-21T00:59:06.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.503+0000 7fa77a6f6640 1 -- 172.21.15.1:0/1534406514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa76c0a50e0 msgr2=0x7fa76c0a54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:06.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.503+0000 7fa77a6f6640 1 --2- 172.21.15.1:0/1534406514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa76c0a50e0 0x7fa76c0a54f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa768009900 tx=0x7fa76802a3f0 comp rx=0 tx=0).stop 2024-09-21T00:59:06.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.504+0000 7fa77a6f6640 1 -- 172.21.15.1:0/1534406514 shutdown_connections 2024-09-21T00:59:06.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.504+0000 7fa77a6f6640 1 --2- 172.21.15.1:0/1534406514 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa76c0ab1a0 0x7fa76c0ab9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:06.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.504+0000 7fa77a6f6640 1 --2- 172.21.15.1:0/1534406514 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa76c0aa850 0x7fa76c0aac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:06.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.504+0000 7fa77a6f6640 1 --2- 172.21.15.1:0/1534406514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa76c0a50e0 0x7fa76c0a54f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:06.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.504+0000 7fa77a6f6640 1 -- 172.21.15.1:0/1534406514 >> 172.21.15.1:0/1534406514 conn(0x7fa76c01cc60 msgr2=0x7fa76c01d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:06.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.505+0000 7fa77a6f6640 1 -- 172.21.15.1:0/1534406514 shutdown_connections 2024-09-21T00:59:06.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.505+0000 7fa77a6f6640 1 -- 172.21.15.1:0/1534406514 wait complete. 2024-09-21T00:59:06.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.506+0000 7fa77a6f6640 1 Processor -- start 2024-09-21T00:59:06.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.507+0000 7fa77a6f6640 1 -- start start 2024-09-21T00:59:06.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.507+0000 7fa77a6f6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa76c0a50e0 0x7fa76c0baa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:06.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.507+0000 7fa77a6f6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa76c0aa850 0x7fa76c0bafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:06.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.507+0000 7fa77a6f6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa76c0ab1a0 0x7fa76c0b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:06.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.507+0000 7fa77a6f6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c0ad2c0 con 0x7fa76c0ab1a0 2024-09-21T00:59:06.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.507+0000 7fa77a6f6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c0ad140 con 0x7fa76c0a50e0 2024-09-21T00:59:06.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.507+0000 7fa77a6f6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c0ad440 con 0x7fa76c0aa850 2024-09-21T00:59:06.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.508+0000 7fa773fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa76c0a50e0 0x7fa76c0baa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:06.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.508+0000 7fa773fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa76c0a50e0 0x7fa76c0baa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:54762/0 (socket says 172.21.15.1:54762) 2024-09-21T00:59:06.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.508+0000 7fa773fff640 1 -- 172.21.15.1:0/166363881 learned_addr learned my addr 172.21.15.1:0/166363881 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:06.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.508+0000 7fa773fff640 1 -- 172.21.15.1:0/166363881 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa76c0aa850 msgr2=0x7fa76c0bafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:06.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.508+0000 7fa778c93640 1 --2- 172.21.15.1:0/166363881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa76c0ab1a0 0x7fa76c0b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:06.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.508+0000 7fa7737fe640 1 --2- 172.21.15.1:0/166363881 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa76c0aa850 0x7fa76c0bafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:06.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.508+0000 7fa773fff640 1 --2- 172.21.15.1:0/166363881 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa76c0aa850 0x7fa76c0bafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:06.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.508+0000 7fa773fff640 1 -- 172.21.15.1:0/166363881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa76c0ab1a0 msgr2=0x7fa76c0b4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:06.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.508+0000 7fa773fff640 1 --2- 172.21.15.1:0/166363881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa76c0ab1a0 0x7fa76c0b4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:06.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.509+0000 7fa773fff640 1 -- 172.21.15.1:0/166363881 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa76c0b5660 con 0x7fa76c0a50e0 2024-09-21T00:59:06.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.509+0000 7fa778c93640 1 --2- 172.21.15.1:0/166363881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa76c0ab1a0 0x7fa76c0b4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:59:06.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.509+0000 7fa773fff640 1 --2- 172.21.15.1:0/166363881 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa76c0a50e0 0x7fa76c0baa60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa76802a960 tx=0x7fa768031550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:06.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.510+0000 7fa7717fa640 1 -- 172.21.15.1:0/166363881 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76803f030 con 0x7fa76c0a50e0 2024-09-21T00:59:06.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.510+0000 7fa7717fa640 1 -- 172.21.15.1:0/166363881 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa768003db0 con 0x7fa76c0a50e0 2024-09-21T00:59:06.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.510+0000 7fa7717fa640 1 -- 172.21.15.1:0/166363881 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa768035070 con 0x7fa76c0a50e0 2024-09-21T00:59:06.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.510+0000 7fa77a6f6640 1 -- 172.21.15.1:0/166363881 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa76c0b58f0 con 0x7fa76c0a50e0 2024-09-21T00:59:06.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.511+0000 7fa77a6f6640 1 -- 172.21.15.1:0/166363881 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa76c159110 con 0x7fa76c0a50e0 2024-09-21T00:59:06.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.514+0000 7fa7717fa640 1 -- 172.21.15.1:0/166363881 <== mon.2 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7fa768042030 con 0x7fa76c0a50e0 2024-09-21T00:59:06.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.515+0000 7fa7717fa640 1 --2- 172.21.15.1:0/166363881 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa7640b6640 0x7fa7640b8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:06.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.515+0000 7fa7717fa640 1 -- 172.21.15.1:0/166363881 <== mon.2 v2:172.21.15.42:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fa768107840 con 0x7fa76c0a50e0 2024-09-21T00:59:06.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.515+0000 7fa7737fe640 1 --2- 172.21.15.1:0/166363881 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa7640b6640 0x7fa7640b8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:06.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.515+0000 7fa780c6a740 1 Processor -- start 2024-09-21T00:59:06.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.515+0000 7fa780c6a740 1 -- start start 2024-09-21T00:59:06.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.516+0000 7fa780c6a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0adee0350 0x55d0ae287610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:06.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.516+0000 7fa780c6a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0adeb7490 0x55d0ae287b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:06.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.516+0000 7fa780c6a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0adebf670 0x55d0ae288090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:06.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.516+0000 7fa7737fe640 1 --2- 172.21.15.1:0/166363881 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa7640b6640 0x7fa7640b8b50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa76c004aa0 tx=0x7fa760005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:06.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.516+0000 7fa773fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0adee0350 0x55d0ae287610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:06.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.516+0000 7fa773fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0adee0350 0x55d0ae287610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:59242/0 (socket says 172.21.15.1:59242) 2024-09-21T00:59:06.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.516+0000 7fa773fff640 1 -- 172.21.15.1:0/4147370181 learned_addr learned my addr 172.21.15.1:0/4147370181 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:06.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.516+0000 7fa780c6a740 1 -- 172.21.15.1:0/4147370181 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d0ae1fde60 con 0x55d0adebf670 2024-09-21T00:59:06.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.516+0000 7fa780c6a740 1 -- 172.21.15.1:0/4147370181 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d0ae1ed290 con 0x55d0adeb7490 2024-09-21T00:59:06.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.516+0000 7fa780c6a740 1 -- 172.21.15.1:0/4147370181 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d0ae1f10a0 con 0x55d0adee0350 2024-09-21T00:59:06.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.516+0000 7fa778c93640 1 --2- 172.21.15.1:0/4147370181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0adebf670 0x55d0ae288090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:06.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.516+0000 7fa7737fe640 1 --2- 172.21.15.1:0/4147370181 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0adeb7490 0x55d0ae287b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:06.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.517+0000 7fa7737fe640 1 -- 172.21.15.1:0/4147370181 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0adee0350 msgr2=0x55d0ae287610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:06.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.517+0000 7fa7737fe640 1 --2- 172.21.15.1:0/4147370181 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0adee0350 0x55d0ae287610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:06.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.517+0000 7fa7737fe640 1 -- 172.21.15.1:0/4147370181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0adebf670 msgr2=0x55d0ae288090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:06.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.517+0000 7fa7737fe640 1 --2- 172.21.15.1:0/4147370181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0adebf670 0x55d0ae288090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:06.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.517+0000 7fa7737fe640 1 -- 172.21.15.1:0/4147370181 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0adf4b930 con 0x55d0adeb7490 2024-09-21T00:59:06.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.517+0000 7fa773fff640 1 --2- 172.21.15.1:0/4147370181 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0adee0350 0x55d0ae287610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:06.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.517+0000 7fa778c93640 1 --2- 172.21.15.1:0/4147370181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0adebf670 0x55d0ae288090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:06.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.518+0000 7fa7737fe640 1 --2- 172.21.15.1:0/4147370181 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0adeb7490 0x55d0ae287b50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa76c018460 tx=0x7fa760013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3be3404c9998bdfd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:06.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.518+0000 7fa75e7fc640 1 -- 172.21.15.1:0/4147370181 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa760023070 con 0x55d0adeb7490 2024-09-21T00:59:06.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.518+0000 7fa75e7fc640 1 -- 172.21.15.1:0/4147370181 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa760012e30 con 0x55d0adeb7490 2024-09-21T00:59:06.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.518+0000 7fa75e7fc640 1 -- 172.21.15.1:0/4147370181 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76001f450 con 0x55d0adeb7490 2024-09-21T00:59:06.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.519+0000 7fa780c6a740 1 -- 172.21.15.1:0/4147370181 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0adeb7490 msgr2=0x55d0ae287b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:06.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.519+0000 7fa780c6a740 1 --2- 172.21.15.1:0/4147370181 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0adeb7490 0x55d0ae287b50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa76c018460 tx=0x7fa760013000 comp rx=0 tx=0).stop 2024-09-21T00:59:06.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.520+0000 7fa780c6a740 1 -- 172.21.15.1:0/4147370181 shutdown_connections 2024-09-21T00:59:06.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.520+0000 7fa780c6a740 1 --2- 172.21.15.1:0/4147370181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0adebf670 0x55d0ae288090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:06.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.520+0000 7fa780c6a740 1 --2- 172.21.15.1:0/4147370181 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0adeb7490 0x55d0ae287b50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:06.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.520+0000 7fa780c6a740 1 --2- 172.21.15.1:0/4147370181 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0adee0350 0x55d0ae287610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:06.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.520+0000 7fa780c6a740 1 -- 172.21.15.1:0/4147370181 >> 172.21.15.1:0/4147370181 conn(0x55d0aded4740 msgr2=0x55d0ae285500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:06.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.520+0000 7fa780c6a740 1 -- 172.21.15.1:0/4147370181 shutdown_connections 2024-09-21T00:59:06.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.520+0000 7fa780c6a740 1 -- 172.21.15.1:0/4147370181 wait complete. 2024-09-21T00:59:06.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.520+0000 7fa780c6a740 1 -- start start 2024-09-21T00:59:06.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.521+0000 7fa780c6a740 1 Processor -- start 2024-09-21T00:59:06.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.521+0000 7fa780c6a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0adeb7490 0x55d0ae293240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:06.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.522+0000 7fa780c6a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0adebf670 0x55d0ae293780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:06.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.522+0000 7fa780c6a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0adee0350 0x55d0ae29f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:06.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.522+0000 7fa773fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0adeb7490 0x55d0ae293240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:06.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.522+0000 7fa773fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0adeb7490 0x55d0ae293240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60092/0 (socket says 172.21.15.1:60092) 2024-09-21T00:59:06.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.522+0000 7fa773fff640 1 -- 172.21.15.1:0/3408788880 learned_addr learned my addr 172.21.15.1:0/3408788880 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:06.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.522+0000 7fa7737fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0adebf670 0x55d0ae293780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:06.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.522+0000 7fa778c93640 1 --2- 172.21.15.1:0/3408788880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0adee0350 0x55d0ae29f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:06.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.522+0000 7fa780c6a740 1 -- 172.21.15.1:0/3408788880 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d0ae04e890 con 0x55d0adeb7490 2024-09-21T00:59:06.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.522+0000 7fa780c6a740 1 -- 172.21.15.1:0/3408788880 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d0ae187d40 con 0x55d0adee0350 2024-09-21T00:59:06.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.522+0000 7fa780c6a740 1 -- 172.21.15.1:0/3408788880 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d0ae295df0 con 0x55d0adebf670 2024-09-21T00:59:06.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.523+0000 7fa7737fe640 1 -- 172.21.15.1:0/3408788880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0adee0350 msgr2=0x55d0ae29f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:06.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.523+0000 7fa7737fe640 1 --2- 172.21.15.1:0/3408788880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0adee0350 0x55d0ae29f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:06.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.523+0000 7fa7737fe640 1 -- 172.21.15.1:0/3408788880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0adeb7490 msgr2=0x55d0ae293240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:06.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.523+0000 7fa7737fe640 1 --2- 172.21.15.1:0/3408788880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0adeb7490 0x55d0ae293240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:06.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.523+0000 7fa7737fe640 1 -- 172.21.15.1:0/3408788880 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0ae29f760 con 0x55d0adebf670 2024-09-21T00:59:06.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.523+0000 7fa773fff640 1 --2- 172.21.15.1:0/3408788880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0adeb7490 0x55d0ae293240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:59:06.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.523+0000 7fa7737fe640 1 --2- 172.21.15.1:0/3408788880 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0adebf670 0x55d0ae293780 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x55d0ae286290 tx=0x7fa7600048d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=253d9403c68b3d02 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:06.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.523+0000 7fa780c6a740 10 client.0 _ll_register_callbacks cb 0x55d0ae1ebc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:06.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.523+0000 7fa7537fe640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T00:59:06.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.523+0000 7fa7537fe640 1 -- 172.21.15.1:0/3408788880 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa760036060 con 0x55d0adebf670 2024-09-21T00:59:06.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.523+0000 7fa7537fe640 1 -- 172.21.15.1:0/3408788880 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fa76001f6e0 con 0x55d0adebf670 2024-09-21T00:59:06.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.523+0000 7fa780c6a740 1 -- 172.21.15.1:0/3408788880 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa760012e30 con 0x55d0adebf670 2024-09-21T00:59:06.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.524+0000 7fa7537fe640 1 -- 172.21.15.1:0/3408788880 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fa760023050 con 0x55d0adebf670 2024-09-21T00:59:06.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.524+0000 7fa780c6a740 10 client.25756 fetch_fsmap learned FSMap version 31 2024-09-21T00:59:06.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.524+0000 7fa780c6a740 1 -- 172.21.15.1:0/3408788880 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({fsmap=31}) -- 0x55d0ae2a1dd0 con 0x55d0adebf670 2024-09-21T00:59:06.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.524+0000 7fa7537fe640 1 -- 172.21.15.1:0/3408788880 <== mon.1 v2:172.21.15.193:3300/0 4 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7fa76000f040 con 0x55d0adebf670 2024-09-21T00:59:06.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.524+0000 7fa780c6a740 10 client.25756 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:59:06.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.524+0000 7fa780c6a740 10 client.25756 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:06.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.524+0000 7fa780c6a740 20 client.25756 populate_metadata read hostname 'smithi001' 2024-09-21T00:59:06.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.524+0000 7fa780c6a740 1 --2- 172.21.15.1:0/3408788880 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d0ade9ecd0 0x55d0ae2a5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:06.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.524+0000 7fa780c6a740 4 client.25756 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:59:06.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.524+0000 7fa780c6a740 1 -- 172.21.15.1:0/3408788880 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa760012e30 con 0x55d0ade9ecd0 2024-09-21T00:59:06.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.525+0000 7fa773fff640 1 --2- 172.21.15.1:0/3408788880 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d0ade9ecd0 0x55d0ae2a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:06.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.526+0000 7fa773fff640 1 --2- 172.21.15.1:0/3408788880 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d0ade9ecd0 0x55d0ae2a5190 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63106733878edd3f server_cookie=3db633809306a8e4 in_seq=0 out_seq=0 2024-09-21T00:59:06.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.526+0000 7fa7537fe640 10 client.25756 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:06.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.527+0000 7fa7537fe640 1 -- 172.21.15.1:0/3408788880 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fa760012e30 con 0x55d0ade9ecd0 2024-09-21T00:59:06.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.527+0000 7fa7537fe640 10 client.25756 handle_command_reply: tid=0 2024-09-21T00:59:06.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.527+0000 7fa780c6a740 1 client.25756 shutdown 2024-09-21T00:59:06.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.527+0000 7fa780c6a740 1 -- 172.21.15.1:0/3408788880 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0adebf670 msgr2=0x55d0ae293780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:06.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.527+0000 7fa780c6a740 1 --2- 172.21.15.1:0/3408788880 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0adebf670 0x55d0ae293780 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x55d0ae286290 tx=0x7fa7600048d0 comp rx=0 tx=0).stop 2024-09-21T00:59:06.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.527+0000 7fa780c6a740 1 -- 172.21.15.1:0/3408788880 shutdown_connections 2024-09-21T00:59:06.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.527+0000 7fa780c6a740 1 --2- 172.21.15.1:0/3408788880 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d0ade9ecd0 0x55d0ae2a5190 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:06.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.527+0000 7fa7537fe640 0 client.25756 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:06.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.527+0000 7fa780c6a740 1 --2- 172.21.15.1:0/3408788880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0adee0350 0x55d0ae29f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:06.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.527+0000 7fa780c6a740 1 --2- 172.21.15.1:0/3408788880 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0adebf670 0x55d0ae293780 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:06.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.527+0000 7fa780c6a740 1 --2- 172.21.15.1:0/3408788880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0adeb7490 0x55d0ae293240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:06.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.527+0000 7fa780c6a740 1 -- 172.21.15.1:0/3408788880 >> 172.21.15.1:0/3408788880 conn(0x55d0aded4740 msgr2=0x55d0ae28a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:06.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.528+0000 7fa780c6a740 1 -- 172.21.15.1:0/3408788880 shutdown_connections 2024-09-21T00:59:06.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.528+0000 7fa780c6a740 1 -- 172.21.15.1:0/3408788880 wait complete. 2024-09-21T00:59:06.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.529+0000 7fa780c6a740 20 client.25756 trim_cache size 0 max 16384 2024-09-21T00:59:06.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.548+0000 7fa780c6a740 1 Processor -- start 2024-09-21T00:59:06.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.548+0000 7fa780c6a740 1 -- start start 2024-09-21T00:59:06.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.548+0000 7fa780c6a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0adeb7490 0x55d0ae29f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:06.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.548+0000 7fa780c6a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0adebf670 0x55d0ae28c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:06.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.548+0000 7fa780c6a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0adee0350 0x55d0ae28cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:06.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.548+0000 7fa780c6a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c161730 con 0x55d0adeb7490 2024-09-21T00:59:06.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.548+0000 7fa780c6a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c1633f0 con 0x55d0adebf670 2024-09-21T00:59:06.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.548+0000 7fa780c6a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c161e00 con 0x55d0adee0350 2024-09-21T00:59:06.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.549+0000 7fa773fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0adeb7490 0x55d0ae29f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:06.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.549+0000 7fa778c93640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0adee0350 0x55d0ae28cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:06.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.549+0000 7fa7737fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0adebf670 0x55d0ae28c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:06.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.549+0000 7fa778c93640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0adee0350 0x55d0ae28cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:59254/0 (socket says 172.21.15.1:59254) 2024-09-21T00:59:06.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.549+0000 7fa778c93640 1 -- 172.21.15.1:0/1504163037 learned_addr learned my addr 172.21.15.1:0/1504163037 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:06.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.549+0000 7fa778c93640 1 -- 172.21.15.1:0/1504163037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0adebf670 msgr2=0x55d0ae28c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:06.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.549+0000 7fa778c93640 1 --2- 172.21.15.1:0/1504163037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0adebf670 0x55d0ae28c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:06.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.549+0000 7fa778c93640 1 -- 172.21.15.1:0/1504163037 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0adeb7490 msgr2=0x55d0ae29f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:06.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.549+0000 7fa778c93640 1 --2- 172.21.15.1:0/1504163037 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0adeb7490 0x55d0ae29f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:06.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.549+0000 7fa778c93640 1 -- 172.21.15.1:0/1504163037 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0ae28e8d0 con 0x55d0adee0350 2024-09-21T00:59:06.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.549+0000 7fa778c93640 1 --2- 172.21.15.1:0/1504163037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0adee0350 0x55d0ae28cc60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa77402ec00 tx=0x7fa774064940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=169d67009535607e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:06.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.549+0000 7fa75dffb640 1 -- 172.21.15.1:0/1504163037 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa774079450 con 0x55d0adee0350 2024-09-21T00:59:06.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.550+0000 7fa75dffb640 1 -- 172.21.15.1:0/1504163037 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa774079aa0 con 0x55d0adee0350 2024-09-21T00:59:06.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.550+0000 7fa75dffb640 1 -- 172.21.15.1:0/1504163037 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa774083a00 con 0x55d0adee0350 2024-09-21T00:59:06.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.550+0000 7fa780c6a740 1 -- 172.21.15.1:0/1504163037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0adee0350 msgr2=0x55d0ae28cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:06.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.550+0000 7fa780c6a740 1 --2- 172.21.15.1:0/1504163037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0adee0350 0x55d0ae28cc60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa77402ec00 tx=0x7fa774064940 comp rx=0 tx=0).stop 2024-09-21T00:59:06.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.551+0000 7fa780c6a740 1 -- 172.21.15.1:0/1504163037 shutdown_connections 2024-09-21T00:59:06.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.551+0000 7fa780c6a740 1 --2- 172.21.15.1:0/1504163037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0adee0350 0x55d0ae28cc60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:06.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.551+0000 7fa780c6a740 1 --2- 172.21.15.1:0/1504163037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0adebf670 0x55d0ae28c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:06.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.551+0000 7fa780c6a740 1 --2- 172.21.15.1:0/1504163037 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0adeb7490 0x55d0ae29f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:06.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.551+0000 7fa780c6a740 1 -- 172.21.15.1:0/1504163037 >> 172.21.15.1:0/1504163037 conn(0x55d0aded4740 msgr2=0x55d0ae2918c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:06.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.551+0000 7fa780c6a740 1 -- 172.21.15.1:0/1504163037 shutdown_connections 2024-09-21T00:59:06.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.551+0000 7fa780c6a740 1 -- 172.21.15.1:0/1504163037 wait complete. 2024-09-21T00:59:06.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.551+0000 7fa780c6a740 1 -- start start 2024-09-21T00:59:06.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.551+0000 7fa780c6a740 1 Processor -- start 2024-09-21T00:59:06.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.552+0000 7fa780c6a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0adeb7490 0x55d0ae297a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:06.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.552+0000 7fa780c6a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0adebf670 0x55d0ae298050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:06.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.552+0000 7fa780c6a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0adee0350 0x55d0ae308a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:06.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.552+0000 7fa780c6a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c162c60 con 0x55d0adee0350 2024-09-21T00:59:06.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.552+0000 7fa780c6a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c162590 con 0x55d0adebf670 2024-09-21T00:59:06.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.552+0000 7fa780c6a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c15f710 con 0x55d0adeb7490 2024-09-21T00:59:06.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.552+0000 7fa780c6a740 10 client.0 _ll_register_callbacks cb 0x7fa774069800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:06.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.552+0000 7fa773fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0adeb7490 0x55d0ae297a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:06.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.552+0000 7fa7737fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0adebf670 0x55d0ae298050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:06.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.552+0000 7fa773fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0adeb7490 0x55d0ae297a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:59264/0 (socket says 172.21.15.1:59264) 2024-09-21T00:59:06.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.552+0000 7fa773fff640 1 -- 172.21.15.1:0/4020443412 learned_addr learned my addr 172.21.15.1:0/4020443412 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:06.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.552+0000 7fa7737fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0adebf670 0x55d0ae298050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:54796/0 (socket says 172.21.15.1:54796) 2024-09-21T00:59:06.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.552+0000 7fa778c93640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0adee0350 0x55d0ae308a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:06.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.552+0000 7fa773fff640 1 -- 172.21.15.1:0/4020443412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0adebf670 msgr2=0x55d0ae298050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:06.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.552+0000 7fa773fff640 1 --2- 172.21.15.1:0/4020443412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0adebf670 0x55d0ae298050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:06.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.552+0000 7fa773fff640 1 -- 172.21.15.1:0/4020443412 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0adee0350 msgr2=0x55d0ae308a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:06.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.552+0000 7fa773fff640 1 --2- 172.21.15.1:0/4020443412 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0adee0350 0x55d0ae308a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:06.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.552+0000 7fa773fff640 1 -- 172.21.15.1:0/4020443412 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0ae309070 con 0x55d0adeb7490 2024-09-21T00:59:06.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.552+0000 7fa7737fe640 1 --2- 172.21.15.1:0/4020443412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0adebf670 0x55d0ae298050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:06.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.553+0000 7fa773fff640 1 --2- 172.21.15.1:0/4020443412 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0adeb7490 0x55d0ae297a70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa7680cd650 tx=0x7fa76803b9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fcb2830064b8652 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:06.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.553+0000 7fa7537fe640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T00:59:06.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.553+0000 7fa7537fe640 1 -- 172.21.15.1:0/4020443412 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa768049040 con 0x55d0adeb7490 2024-09-21T00:59:06.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.553+0000 7fa7537fe640 1 -- 172.21.15.1:0/4020443412 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fa76803b610 con 0x55d0adeb7490 2024-09-21T00:59:06.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.553+0000 7fa780c6a740 1 -- 172.21.15.1:0/4020443412 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa774079aa0 con 0x55d0adeb7490 2024-09-21T00:59:06.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.553+0000 7fa7537fe640 1 -- 172.21.15.1:0/4020443412 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fa7680c9fa0 con 0x55d0adeb7490 2024-09-21T00:59:06.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.553+0000 7fa780c6a740 10 client.25762 fetch_fsmap learned FSMap version 31 2024-09-21T00:59:06.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.553+0000 7fa780c6a740 1 -- 172.21.15.1:0/4020443412 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d0ae3103f0 con 0x55d0adeb7490 2024-09-21T00:59:06.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.553+0000 7fa7537fe640 1 -- 172.21.15.1:0/4020443412 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa774079aa0 con 0x55d0adeb7490 2024-09-21T00:59:06.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.553+0000 7fa7537fe640 1 -- 172.21.15.1:0/4020443412 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7fa7680ccbb0 con 0x55d0adeb7490 2024-09-21T00:59:06.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.553+0000 7fa780c6a740 10 client.25762 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:59:06.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.553+0000 7fa780c6a740 10 client.25762 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:06.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.553+0000 7fa780c6a740 20 client.25762 populate_metadata read hostname 'smithi001' 2024-09-21T00:59:06.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.553+0000 7fa780c6a740 1 --2- 172.21.15.1:0/4020443412 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d0ade74080 0x55d0ae312c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:06.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.553+0000 7fa780c6a740 4 client.25762 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T00:59:06.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.553+0000 7fa780c6a740 1 -- 172.21.15.1:0/4020443412 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d0ae1ffdb0 con 0x55d0ade74080 2024-09-21T00:59:06.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.554+0000 7fa7737fe640 1 --2- 172.21.15.1:0/4020443412 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d0ade74080 0x55d0ae312c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:06.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.554+0000 7fa7537fe640 10 client.25762 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:06.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.554+0000 7fa7737fe640 1 --2- 172.21.15.1:0/4020443412 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d0ade74080 0x55d0ae312c70 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9dc30c2c69c5b25 server_cookie=7a9c35a3609bf1c6 in_seq=0 out_seq=0 2024-09-21T00:59:06.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.555+0000 7fa7537fe640 1 -- 172.21.15.1:0/4020443412 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d0ae1ffdb0 con 0x55d0ade74080 2024-09-21T00:59:06.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.555+0000 7fa7537fe640 10 client.25762 handle_command_reply: tid=0 2024-09-21T00:59:06.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.555+0000 7fa780c6a740 1 client.25762 shutdown 2024-09-21T00:59:06.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.555+0000 7fa780c6a740 1 -- 172.21.15.1:0/4020443412 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0adeb7490 msgr2=0x55d0ae297a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:06.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.555+0000 7fa780c6a740 1 --2- 172.21.15.1:0/4020443412 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0adeb7490 0x55d0ae297a70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa7680cd650 tx=0x7fa76803b9b0 comp rx=0 tx=0).stop 2024-09-21T00:59:06.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.555+0000 7fa780c6a740 1 -- 172.21.15.1:0/4020443412 shutdown_connections 2024-09-21T00:59:06.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.555+0000 7fa780c6a740 1 --2- 172.21.15.1:0/4020443412 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d0ade74080 0x55d0ae312c70 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:06.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.555+0000 7fa780c6a740 1 --2- 172.21.15.1:0/4020443412 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0adee0350 0x55d0ae308a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:06.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.555+0000 7fa780c6a740 1 --2- 172.21.15.1:0/4020443412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0adebf670 0x55d0ae298050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:06.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.555+0000 7fa780c6a740 1 --2- 172.21.15.1:0/4020443412 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0adeb7490 0x55d0ae297a70 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:06.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.556+0000 7fa780c6a740 1 -- 172.21.15.1:0/4020443412 >> 172.21.15.1:0/4020443412 conn(0x55d0aded4740 msgr2=0x55d0ae28c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:06.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.556+0000 7fa7537fe640 0 client.25762 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:06.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.556+0000 7fa780c6a740 1 -- 172.21.15.1:0/4020443412 shutdown_connections 2024-09-21T00:59:06.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.556+0000 7fa780c6a740 1 -- 172.21.15.1:0/4020443412 wait complete. 2024-09-21T00:59:06.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.556+0000 7fa780c6a740 20 client.25762 trim_cache size 0 max 16384 2024-09-21T00:59:06.560 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T00:59:06.560 INFO:teuthology.orchestra.run.smithi001.stdout: "return_code": 0, 2024-09-21T00:59:06.560 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_tag": "f826f2c1-768a-47bb-b868-785b351ac6b4", 2024-09-21T00:59:06.560 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": "asynchronous" 2024-09-21T00:59:06.560 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T00:59:06.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.556+0000 7fa77a6f6640 1 -- 172.21.15.1:0/166363881 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa7640b6640 msgr2=0x7fa7640b8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:06.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.556+0000 7fa77a6f6640 1 --2- 172.21.15.1:0/166363881 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa7640b6640 0x7fa7640b8b50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa76c004aa0 tx=0x7fa760005f90 comp rx=0 tx=0).stop 2024-09-21T00:59:06.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.556+0000 7fa77a6f6640 1 -- 172.21.15.1:0/166363881 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa76c0a50e0 msgr2=0x7fa76c0baa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:06.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.556+0000 7fa77a6f6640 1 --2- 172.21.15.1:0/166363881 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa76c0a50e0 0x7fa76c0baa60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa76802a960 tx=0x7fa768031550 comp rx=0 tx=0).stop 2024-09-21T00:59:06.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.557+0000 7fa77a6f6640 1 -- 172.21.15.1:0/166363881 shutdown_connections 2024-09-21T00:59:06.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.557+0000 7fa77a6f6640 1 --2- 172.21.15.1:0/166363881 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa7640b6640 0x7fa7640b8b50 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:06.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.557+0000 7fa77a6f6640 1 --2- 172.21.15.1:0/166363881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa76c0ab1a0 0x7fa76c0b4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:06.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.557+0000 7fa77a6f6640 1 --2- 172.21.15.1:0/166363881 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa76c0aa850 0x7fa76c0bafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:06.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.557+0000 7fa77a6f6640 1 --2- 172.21.15.1:0/166363881 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa76c0a50e0 0x7fa76c0baa60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:06.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.557+0000 7fa77a6f6640 1 -- 172.21.15.1:0/166363881 >> 172.21.15.1:0/166363881 conn(0x7fa76c01cc60 msgr2=0x7fa76c0a39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:06.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.557+0000 7fa77a6f6640 1 -- 172.21.15.1:0/166363881 shutdown_connections 2024-09-21T00:59:06.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:06.557+0000 7fa77a6f6640 1 -- 172.21.15.1:0/166363881 wait complete. 2024-09-21T00:59:07.390 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T00:59:07.803 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:59:08.203 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:07 smithi001 ceph-mon[31211]: pgmap v415: 97 pgs: 97 active+clean; 182 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 11 MiB/s wr, 915 op/s 2024-09-21T00:59:08.204 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:07 smithi001 ceph-mon[31211]: scrub queued for path: / 2024-09-21T00:59:08.204 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:07 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T00:59:08.204 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:07 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T00:59:08.204 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:07 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T00:59:08.204 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:07 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T00:59:08.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:07 smithi193 ceph-mon[34660]: pgmap v415: 97 pgs: 97 active+clean; 182 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 11 MiB/s wr, 915 op/s 2024-09-21T00:59:08.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:07 smithi193 ceph-mon[34660]: scrub queued for path: / 2024-09-21T00:59:08.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:07 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T00:59:08.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:07 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T00:59:08.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:07 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T00:59:08.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:07 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T00:59:08.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:07 smithi042 ceph-mon[34481]: pgmap v415: 97 pgs: 97 active+clean; 182 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 11 MiB/s wr, 915 op/s 2024-09-21T00:59:08.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:07 smithi042 ceph-mon[34481]: scrub queued for path: / 2024-09-21T00:59:08.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:07 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T00:59:08.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:07 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T00:59:08.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:07 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T00:59:08.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:07 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T00:59:08.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.585+0000 7fe1f5468640 1 -- 172.21.15.1:0/1615149136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1f010a9e0 msgr2=0x7fe1f010adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:08.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.585+0000 7fe1f5468640 1 --2- 172.21.15.1:0/1615149136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1f010a9e0 0x7fe1f010adf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0009900 tx=0x7fe1e002a410 comp rx=0 tx=0).stop 2024-09-21T00:59:08.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.585+0000 7fe1f5468640 1 -- 172.21.15.1:0/1615149136 shutdown_connections 2024-09-21T00:59:08.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.585+0000 7fe1f5468640 1 --2- 172.21.15.1:0/1615149136 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1f011cc30 0x7fe1f011f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.585+0000 7fe1f5468640 1 --2- 172.21.15.1:0/1615149136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1f010a9e0 0x7fe1f010adf0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.585+0000 7fe1f5468640 1 --2- 172.21.15.1:0/1615149136 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1f0111f40 0x7fe1f010a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.585+0000 7fe1f5468640 1 -- 172.21.15.1:0/1615149136 >> 172.21.15.1:0/1615149136 conn(0x7fe1f0070ec0 msgr2=0x7fe1f00712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:08.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.586+0000 7fe1f5468640 1 -- 172.21.15.1:0/1615149136 shutdown_connections 2024-09-21T00:59:08.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.586+0000 7fe1f5468640 1 -- 172.21.15.1:0/1615149136 wait complete. 2024-09-21T00:59:08.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.588+0000 7fe1f5468640 1 Processor -- start 2024-09-21T00:59:08.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.588+0000 7fe1f5468640 1 -- start start 2024-09-21T00:59:08.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.588+0000 7fe1f5468640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1f010a9e0 0x7fe1f011a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:08.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.589+0000 7fe1f5468640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1f0111f40 0x7fe1f01136e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:08.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.589+0000 7fe1f5468640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1f011cc30 0x7fe1f0113c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:08.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.589+0000 7fe1f5468640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f0122900 con 0x7fe1f010a9e0 2024-09-21T00:59:08.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.589+0000 7fe1f5468640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f0122780 con 0x7fe1f0111f40 2024-09-21T00:59:08.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.589+0000 7fe1f5468640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f0122a80 con 0x7fe1f011cc30 2024-09-21T00:59:08.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.589+0000 7fe1eeffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1f010a9e0 0x7fe1f011a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:08.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.590+0000 7fe1eeffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1f010a9e0 0x7fe1f011a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60138/0 (socket says 172.21.15.1:60138) 2024-09-21T00:59:08.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.590+0000 7fe1eeffd640 1 -- 172.21.15.1:0/1581902321 learned_addr learned my addr 172.21.15.1:0/1581902321 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:08.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.590+0000 7fe1ee7fc640 1 --2- 172.21.15.1:0/1581902321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1f0111f40 0x7fe1f01136e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:08.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.590+0000 7fe1ef7fe640 1 --2- 172.21.15.1:0/1581902321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1f011cc30 0x7fe1f0113c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:08.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.590+0000 7fe1ee7fc640 1 -- 172.21.15.1:0/1581902321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1f011cc30 msgr2=0x7fe1f0113c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:08.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.590+0000 7fe1ee7fc640 1 --2- 172.21.15.1:0/1581902321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1f011cc30 0x7fe1f0113c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.590+0000 7fe1ee7fc640 1 -- 172.21.15.1:0/1581902321 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1f010a9e0 msgr2=0x7fe1f011a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:08.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.591+0000 7fe1ee7fc640 1 --2- 172.21.15.1:0/1581902321 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1f010a9e0 0x7fe1f011a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.591+0000 7fe1ee7fc640 1 -- 172.21.15.1:0/1581902321 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1f01144a0 con 0x7fe1f0111f40 2024-09-21T00:59:08.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.591+0000 7fe1eeffd640 1 --2- 172.21.15.1:0/1581902321 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1f010a9e0 0x7fe1f011a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:08.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.591+0000 7fe1ee7fc640 1 --2- 172.21.15.1:0/1581902321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1f0111f40 0x7fe1f01136e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe1e002a930 tx=0x7fe1e0003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:08.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.591+0000 7fe1d7fff640 1 -- 172.21.15.1:0/1581902321 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e003f070 con 0x7fe1f0111f40 2024-09-21T00:59:08.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.591+0000 7fe1d7fff640 1 -- 172.21.15.1:0/1581902321 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1e0031b60 con 0x7fe1f0111f40 2024-09-21T00:59:08.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.592+0000 7fe1f5468640 1 -- 172.21.15.1:0/1581902321 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1f01190e0 con 0x7fe1f0111f40 2024-09-21T00:59:08.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.592+0000 7fe1d7fff640 1 -- 172.21.15.1:0/1581902321 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0035030 con 0x7fe1f0111f40 2024-09-21T00:59:08.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.592+0000 7fe1f5468640 1 -- 172.21.15.1:0/1581902321 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1f01195e0 con 0x7fe1f0111f40 2024-09-21T00:59:08.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.596+0000 7fe1d7fff640 1 -- 172.21.15.1:0/1581902321 <== mon.2 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7fe1e0042070 con 0x7fe1f0111f40 2024-09-21T00:59:08.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.598+0000 7fe1d7fff640 1 --2- 172.21.15.1:0/1581902321 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe1d80b6590 0x7fe1d80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:08.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.598+0000 7fe1d7fff640 1 -- 172.21.15.1:0/1581902321 <== mon.2 v2:172.21.15.42:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fe1e01076e0 con 0x7fe1f0111f40 2024-09-21T00:59:08.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.599+0000 7fe1eeffd640 1 --2- 172.21.15.1:0/1581902321 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe1d80b6590 0x7fe1d80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:08.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.600+0000 7fe1eeffd640 1 --2- 172.21.15.1:0/1581902321 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe1d80b6590 0x7fe1d80b8aa0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe1e800f820 tx=0x7fe1e8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:08.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.602+0000 7fe1fb9dc740 1 Processor -- start 2024-09-21T00:59:08.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.602+0000 7fe1fb9dc740 1 -- start start 2024-09-21T00:59:08.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.603+0000 7fe1fb9dc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8fffa2070 0x55d900349650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:08.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.603+0000 7fe1fb9dc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d8fff791b0 0x55d900349b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:08.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.603+0000 7fe1fb9dc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d8fff81390 0x55d90034a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:08.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.603+0000 7fe1fb9dc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d9002bfe50 con 0x55d8fffa2070 2024-09-21T00:59:08.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.604+0000 7fe1ef7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d8fff81390 0x55d90034a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:08.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.604+0000 7fe1ef7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d8fff81390 0x55d90034a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:54814/0 (socket says 172.21.15.1:54814) 2024-09-21T00:59:08.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.604+0000 7fe1ef7fe640 1 -- 172.21.15.1:0/1357311474 learned_addr learned my addr 172.21.15.1:0/1357311474 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:08.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.604+0000 7fe1ee7fc640 1 --2- 172.21.15.1:0/1357311474 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d8fff791b0 0x55d900349b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:08.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.604+0000 7fe1eeffd640 1 --2- 172.21.15.1:0/1357311474 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8fffa2070 0x55d900349650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:08.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.604+0000 7fe1fb9dc740 1 -- 172.21.15.1:0/1357311474 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d9002af280 con 0x55d8fff81390 2024-09-21T00:59:08.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.604+0000 7fe1fb9dc740 1 -- 172.21.15.1:0/1357311474 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d9002b3090 con 0x55d8fff791b0 2024-09-21T00:59:08.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.604+0000 7fe1ef7fe640 1 -- 172.21.15.1:0/1357311474 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d8fff791b0 msgr2=0x55d900349b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:08.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.604+0000 7fe1ef7fe640 1 --2- 172.21.15.1:0/1357311474 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d8fff791b0 0x55d900349b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.604+0000 7fe1ef7fe640 1 -- 172.21.15.1:0/1357311474 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8fffa2070 msgr2=0x55d900349650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:08.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.605+0000 7fe1ef7fe640 1 --2- 172.21.15.1:0/1357311474 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8fffa2070 0x55d900349650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.605+0000 7fe1ef7fe640 1 -- 172.21.15.1:0/1357311474 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d90000d650 con 0x55d8fff81390 2024-09-21T00:59:08.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.605+0000 7fe1eeffd640 1 --2- 172.21.15.1:0/1357311474 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8fffa2070 0x55d900349650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:08.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.605+0000 7fe1ee7fc640 1 --2- 172.21.15.1:0/1357311474 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d8fff791b0 0x55d900349b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:08.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.605+0000 7fe1ef7fe640 1 --2- 172.21.15.1:0/1357311474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d8fff81390 0x55d90034a0d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4005bc0 tx=0x7fe1e40117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=117c6bbbb9186a49 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:08.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.606+0000 7fe1d57fa640 1 -- 172.21.15.1:0/1357311474 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e4012450 con 0x55d8fff81390 2024-09-21T00:59:08.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.606+0000 7fe1d57fa640 1 -- 172.21.15.1:0/1357311474 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1e4012aa0 con 0x55d8fff81390 2024-09-21T00:59:08.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.606+0000 7fe1d57fa640 1 -- 172.21.15.1:0/1357311474 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e400faa0 con 0x55d8fff81390 2024-09-21T00:59:08.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.607+0000 7fe1fb9dc740 1 -- 172.21.15.1:0/1357311474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d8fff81390 msgr2=0x55d90034a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:08.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.607+0000 7fe1fb9dc740 1 --2- 172.21.15.1:0/1357311474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d8fff81390 0x55d90034a0d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4005bc0 tx=0x7fe1e40117b0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.607+0000 7fe1fb9dc740 1 -- 172.21.15.1:0/1357311474 shutdown_connections 2024-09-21T00:59:08.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.607+0000 7fe1fb9dc740 1 --2- 172.21.15.1:0/1357311474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d8fff81390 0x55d90034a0d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.607+0000 7fe1fb9dc740 1 --2- 172.21.15.1:0/1357311474 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d8fff791b0 0x55d900349b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.607+0000 7fe1fb9dc740 1 --2- 172.21.15.1:0/1357311474 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8fffa2070 0x55d900349650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.607+0000 7fe1fb9dc740 1 -- 172.21.15.1:0/1357311474 >> 172.21.15.1:0/1357311474 conn(0x55d8fff96460 msgr2=0x55d900347540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:08.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.607+0000 7fe1fb9dc740 1 -- 172.21.15.1:0/1357311474 shutdown_connections 2024-09-21T00:59:08.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.608+0000 7fe1fb9dc740 1 -- 172.21.15.1:0/1357311474 wait complete. 2024-09-21T00:59:08.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.608+0000 7fe1fb9dc740 1 -- start start 2024-09-21T00:59:08.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.609+0000 7fe1fb9dc740 1 Processor -- start 2024-09-21T00:59:08.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.609+0000 7fe1fb9dc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8fff791b0 0x55d900354cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:08.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.609+0000 7fe1fb9dc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d8fff81390 0x55d900355230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:08.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.609+0000 7fe1fb9dc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d8fffa2070 0x55d900355770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:08.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.609+0000 7fe1fb9dc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d900110700 con 0x55d8fff791b0 2024-09-21T00:59:08.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.609+0000 7fe1fb9dc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d90024a110 con 0x55d8fffa2070 2024-09-21T00:59:08.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.609+0000 7fe1fb9dc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d900357e30 con 0x55d8fff81390 2024-09-21T00:59:08.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.609+0000 7fe1fb9dc740 10 client.0 _ll_register_callbacks cb 0x55d900263990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:08.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.609+0000 7fe1ef7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d8fffa2070 0x55d900355770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:08.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.609+0000 7fe1ee7fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d8fff81390 0x55d900355230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:08.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.609+0000 7fe1ef7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d8fffa2070 0x55d900355770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:54822/0 (socket says 172.21.15.1:54822) 2024-09-21T00:59:08.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.609+0000 7fe1ef7fe640 1 -- 172.21.15.1:0/2832803505 learned_addr learned my addr 172.21.15.1:0/2832803505 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:08.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.610+0000 7fe1eeffd640 1 --2- 172.21.15.1:0/2832803505 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8fff791b0 0x55d900354cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:08.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.610+0000 7fe1ef7fe640 1 -- 172.21.15.1:0/2832803505 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d8fff81390 msgr2=0x55d900355230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:08.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.610+0000 7fe1ef7fe640 1 --2- 172.21.15.1:0/2832803505 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d8fff81390 0x55d900355230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.610+0000 7fe1ef7fe640 1 -- 172.21.15.1:0/2832803505 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8fff791b0 msgr2=0x55d900354cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:08.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.610+0000 7fe1ef7fe640 1 --2- 172.21.15.1:0/2832803505 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8fff791b0 0x55d900354cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.610+0000 7fe1ef7fe640 1 -- 172.21.15.1:0/2832803505 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d900277c40 con 0x55d8fffa2070 2024-09-21T00:59:08.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.610+0000 7fe1ef7fe640 1 --2- 172.21.15.1:0/2832803505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d8fffa2070 0x55d900355770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4012fa0 tx=0x7fe1e400f440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27b4f5be140feef3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:08.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.610+0000 7fe1d2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T00:59:08.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.610+0000 7fe1d2ff5640 1 -- 172.21.15.1:0/2832803505 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e4028070 con 0x55d8fffa2070 2024-09-21T00:59:08.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.610+0000 7fe1fb9dc740 1 -- 172.21.15.1:0/2832803505 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1e4012aa0 con 0x55d8fffa2070 2024-09-21T00:59:08.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.610+0000 7fe1d2ff5640 1 -- 172.21.15.1:0/2832803505 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fe1e400fc40 con 0x55d8fffa2070 2024-09-21T00:59:08.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.610+0000 7fe1d2ff5640 1 -- 172.21.15.1:0/2832803505 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fe1e4034050 con 0x55d8fffa2070 2024-09-21T00:59:08.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.610+0000 7fe1fb9dc740 10 client.25856 fetch_fsmap learned FSMap version 31 2024-09-21T00:59:08.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.610+0000 7fe1fb9dc740 1 -- 172.21.15.1:0/2832803505 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d900363aa0 con 0x55d8fffa2070 2024-09-21T00:59:08.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.611+0000 7fe1d2ff5640 1 -- 172.21.15.1:0/2832803505 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1e4012aa0 con 0x55d8fffa2070 2024-09-21T00:59:08.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.611+0000 7fe1d2ff5640 1 -- 172.21.15.1:0/2832803505 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7fe1e40046c0 con 0x55d8fffa2070 2024-09-21T00:59:08.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.611+0000 7fe1fb9dc740 10 client.25856 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:59:08.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.611+0000 7fe1fb9dc740 10 client.25856 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:08.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.611+0000 7fe1fb9dc740 20 client.25856 populate_metadata read hostname 'smithi001' 2024-09-21T00:59:08.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.611+0000 7fe1fb9dc740 1 --2- 172.21.15.1:0/2832803505 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d8fff609f0 0x55d900366e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:08.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.611+0000 7fe1fb9dc740 4 client.25856 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:59:08.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.611+0000 7fe1fb9dc740 1 -- 172.21.15.1:0/2832803505 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9002c1da0 con 0x55d8fff609f0 2024-09-21T00:59:08.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.612+0000 7fe1eeffd640 1 --2- 172.21.15.1:0/2832803505 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d8fff609f0 0x55d900366e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:08.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.613+0000 7fe1d2ff5640 10 client.25856 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:08.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.613+0000 7fe1eeffd640 1 --2- 172.21.15.1:0/2832803505 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d8fff609f0 0x55d900366e60 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca9d488e0d9b035e server_cookie=98c41ad5026d28d0 in_seq=0 out_seq=0 2024-09-21T00:59:08.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.613+0000 7fe1d2ff5640 1 -- 172.21.15.1:0/2832803505 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d9002c1da0 con 0x55d8fff609f0 2024-09-21T00:59:08.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.613+0000 7fe1d2ff5640 10 client.25856 handle_command_reply: tid=0 2024-09-21T00:59:08.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.613+0000 7fe1fb9dc740 1 client.25856 shutdown 2024-09-21T00:59:08.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.614+0000 7fe1fb9dc740 1 -- 172.21.15.1:0/2832803505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d8fffa2070 msgr2=0x55d900355770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:08.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.614+0000 7fe1fb9dc740 1 --2- 172.21.15.1:0/2832803505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d8fffa2070 0x55d900355770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4012fa0 tx=0x7fe1e400f440 comp rx=0 tx=0).stop 2024-09-21T00:59:08.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.614+0000 7fe1fb9dc740 1 -- 172.21.15.1:0/2832803505 shutdown_connections 2024-09-21T00:59:08.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.614+0000 7fe1fb9dc740 1 --2- 172.21.15.1:0/2832803505 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d8fff609f0 0x55d900366e60 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.614+0000 7fe1fb9dc740 1 --2- 172.21.15.1:0/2832803505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d8fffa2070 0x55d900355770 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.614+0000 7fe1d2ff5640 0 client.25856 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:08.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.614+0000 7fe1fb9dc740 1 --2- 172.21.15.1:0/2832803505 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d8fff81390 0x55d900355230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.614+0000 7fe1fb9dc740 1 --2- 172.21.15.1:0/2832803505 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8fff791b0 0x55d900354cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.614+0000 7fe1fb9dc740 1 -- 172.21.15.1:0/2832803505 >> 172.21.15.1:0/2832803505 conn(0x55d8fff96460 msgr2=0x55d90034c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:08.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.614+0000 7fe1fb9dc740 1 -- 172.21.15.1:0/2832803505 shutdown_connections 2024-09-21T00:59:08.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.614+0000 7fe1fb9dc740 1 -- 172.21.15.1:0/2832803505 wait complete. 2024-09-21T00:59:08.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.614+0000 7fe1fb9dc740 20 client.25856 trim_cache size 0 max 16384 2024-09-21T00:59:08.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.642+0000 7fe1fb9dc740 1 Processor -- start 2024-09-21T00:59:08.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.642+0000 7fe1fb9dc740 1 -- start start 2024-09-21T00:59:08.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.642+0000 7fe1fb9dc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d8fff791b0 0x55d90034b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:08.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.642+0000 7fe1fb9dc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8fff81390 0x55d900356920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:08.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.642+0000 7fe1fb9dc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d8fffa2070 0x55d900346b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:08.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.642+0000 7fe1fb9dc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe1dc00e520 con 0x55d8fff81390 2024-09-21T00:59:08.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.642+0000 7fe1fb9dc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe1dc0101e0 con 0x55d8fff791b0 2024-09-21T00:59:08.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.642+0000 7fe1fb9dc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe1dc00ebf0 con 0x55d8fffa2070 2024-09-21T00:59:08.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.642+0000 7fe1ef7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d8fffa2070 0x55d900346b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:08.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.642+0000 7fe1eeffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d8fff791b0 0x55d90034b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:08.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.642+0000 7fe1eeffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d8fff791b0 0x55d90034b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:54830/0 (socket says 172.21.15.1:54830) 2024-09-21T00:59:08.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.642+0000 7fe1eeffd640 1 -- 172.21.15.1:0/2215384461 learned_addr learned my addr 172.21.15.1:0/2215384461 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:08.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.642+0000 7fe1ef7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d8fffa2070 0x55d900346b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:59314/0 (socket says 172.21.15.1:59314) 2024-09-21T00:59:08.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.643+0000 7fe1ee7fc640 1 --2- 172.21.15.1:0/2215384461 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8fff81390 0x55d900356920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:08.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.643+0000 7fe1ef7fe640 1 -- 172.21.15.1:0/2215384461 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d8fff791b0 msgr2=0x55d90034b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:08.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.643+0000 7fe1ef7fe640 1 --2- 172.21.15.1:0/2215384461 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d8fff791b0 0x55d90034b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.643+0000 7fe1ef7fe640 1 -- 172.21.15.1:0/2215384461 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8fff81390 msgr2=0x55d900356920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:08.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.643+0000 7fe1ef7fe640 1 --2- 172.21.15.1:0/2215384461 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8fff81390 0x55d900356920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.643+0000 7fe1ef7fe640 1 -- 172.21.15.1:0/2215384461 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d90034b940 con 0x55d8fffa2070 2024-09-21T00:59:08.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.643+0000 7fe1ef7fe640 1 --2- 172.21.15.1:0/2215384461 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d8fffa2070 0x55d900346b70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4004c30 tx=0x7fe1e4009ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8dd0594f1bef9ad8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:08.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.644+0000 7fe1d4ff9640 1 -- 172.21.15.1:0/2215384461 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e4028040 con 0x55d8fffa2070 2024-09-21T00:59:08.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.644+0000 7fe1d4ff9640 1 -- 172.21.15.1:0/2215384461 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1e400f770 con 0x55d8fffa2070 2024-09-21T00:59:08.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.644+0000 7fe1d4ff9640 1 -- 172.21.15.1:0/2215384461 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e400faa0 con 0x55d8fffa2070 2024-09-21T00:59:08.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.646+0000 7fe1fb9dc740 1 -- 172.21.15.1:0/2215384461 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d8fffa2070 msgr2=0x55d900346b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:08.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.646+0000 7fe1fb9dc740 1 --2- 172.21.15.1:0/2215384461 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d8fffa2070 0x55d900346b70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4004c30 tx=0x7fe1e4009ad0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.646+0000 7fe1fb9dc740 1 -- 172.21.15.1:0/2215384461 shutdown_connections 2024-09-21T00:59:08.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.646+0000 7fe1fb9dc740 1 --2- 172.21.15.1:0/2215384461 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d8fffa2070 0x55d900346b70 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.646+0000 7fe1fb9dc740 1 --2- 172.21.15.1:0/2215384461 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8fff81390 0x55d900356920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.646+0000 7fe1fb9dc740 1 --2- 172.21.15.1:0/2215384461 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d8fff791b0 0x55d90034b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.646+0000 7fe1fb9dc740 1 -- 172.21.15.1:0/2215384461 >> 172.21.15.1:0/2215384461 conn(0x55d8fff96460 msgr2=0x55d900356210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:08.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.646+0000 7fe1fb9dc740 1 -- 172.21.15.1:0/2215384461 shutdown_connections 2024-09-21T00:59:08.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.646+0000 7fe1fb9dc740 1 -- 172.21.15.1:0/2215384461 wait complete. 2024-09-21T00:59:08.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.647+0000 7fe1fb9dc740 1 -- start start 2024-09-21T00:59:08.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.647+0000 7fe1fb9dc740 1 Processor -- start 2024-09-21T00:59:08.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.648+0000 7fe1fb9dc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d8fff791b0 0x55d90035d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:08.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.648+0000 7fe1fb9dc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8fff81390 0x55d900358e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:08.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.648+0000 7fe1fb9dc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d8fffa2070 0x55d9003594a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:08.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.648+0000 7fe1fb9dc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe1dc00fa50 con 0x55d8fff81390 2024-09-21T00:59:08.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.648+0000 7fe1eeffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d8fff791b0 0x55d90035d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:08.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.648+0000 7fe1eeffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d8fff791b0 0x55d90035d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:59324/0 (socket says 172.21.15.1:59324) 2024-09-21T00:59:08.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.648+0000 7fe1eeffd640 1 -- 172.21.15.1:0/1849628779 learned_addr learned my addr 172.21.15.1:0/1849628779 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:08.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.648+0000 7fe1ee7fc640 1 --2- 172.21.15.1:0/1849628779 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8fff81390 0x55d900358e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:08.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.648+0000 7fe1ef7fe640 1 --2- 172.21.15.1:0/1849628779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d8fffa2070 0x55d9003594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:08.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.648+0000 7fe1fb9dc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe1dc00f380 con 0x55d8fffa2070 2024-09-21T00:59:08.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.648+0000 7fe1fb9dc740 1 -- 172.21.15.1:0/1849628779 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe1dc00c500 con 0x55d8fff791b0 2024-09-21T00:59:08.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.649+0000 7fe1fb9dc740 10 client.0 _ll_register_callbacks cb 0x7fe1e8009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:08.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.649+0000 7fe1eeffd640 1 -- 172.21.15.1:0/1849628779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d8fffa2070 msgr2=0x55d9003594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:08.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.649+0000 7fe1eeffd640 1 --2- 172.21.15.1:0/1849628779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d8fffa2070 0x55d9003594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.649+0000 7fe1eeffd640 1 -- 172.21.15.1:0/1849628779 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8fff81390 msgr2=0x55d900358e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:08.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.649+0000 7fe1eeffd640 1 --2- 172.21.15.1:0/1849628779 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8fff81390 0x55d900358e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.649+0000 7fe1eeffd640 1 -- 172.21.15.1:0/1849628779 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d900359c10 con 0x55d8fff791b0 2024-09-21T00:59:08.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.649+0000 7fe1ee7fc640 1 --2- 172.21.15.1:0/1849628779 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8fff81390 0x55d900358e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:59:08.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.649+0000 7fe1ef7fe640 1 --2- 172.21.15.1:0/1849628779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d8fffa2070 0x55d9003594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:59:08.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.649+0000 7fe1eeffd640 1 --2- 172.21.15.1:0/1849628779 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d8fff791b0 0x55d90035d9a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8003a60 tx=0x7fe1e8004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6a8999d135b8d87 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:08.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.649+0000 7fe1d2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T00:59:08.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.649+0000 7fe1d2ff5640 1 -- 172.21.15.1:0/1849628779 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e8004230 con 0x55d8fff791b0 2024-09-21T00:59:08.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.650+0000 7fe1d2ff5640 1 -- 172.21.15.1:0/1849628779 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fe1e80043d0 con 0x55d8fff791b0 2024-09-21T00:59:08.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.650+0000 7fe1fb9dc740 1 -- 172.21.15.1:0/1849628779 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1e400f770 con 0x55d8fff791b0 2024-09-21T00:59:08.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.650+0000 7fe1d2ff5640 1 -- 172.21.15.1:0/1849628779 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fe1e80045d0 con 0x55d8fff791b0 2024-09-21T00:59:08.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.650+0000 7fe1fb9dc740 10 client.25780 fetch_fsmap learned FSMap version 31 2024-09-21T00:59:08.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.650+0000 7fe1fb9dc740 1 -- 172.21.15.1:0/1849628779 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d9003d1750 con 0x55d8fff791b0 2024-09-21T00:59:08.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.650+0000 7fe1d2ff5640 1 -- 172.21.15.1:0/1849628779 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1e400f770 con 0x55d8fff791b0 2024-09-21T00:59:08.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.650+0000 7fe1d2ff5640 1 -- 172.21.15.1:0/1849628779 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7fe1e801d420 con 0x55d8fff791b0 2024-09-21T00:59:08.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.651+0000 7fe1fb9dc740 10 client.25780 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:59:08.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.651+0000 7fe1fb9dc740 10 client.25780 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:08.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.651+0000 7fe1fb9dc740 20 client.25780 populate_metadata read hostname 'smithi001' 2024-09-21T00:59:08.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.651+0000 7fe1fb9dc740 1 --2- 172.21.15.1:0/1849628779 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d8fff35da0 0x55d9003d4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:08.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.651+0000 7fe1fb9dc740 4 client.25780 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T00:59:08.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.651+0000 7fe1fb9dc740 1 -- 172.21.15.1:0/1849628779 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d9002bd850 con 0x55d8fff35da0 2024-09-21T00:59:08.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.651+0000 7fe1ee7fc640 1 --2- 172.21.15.1:0/1849628779 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d8fff35da0 0x55d9003d4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:08.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.651+0000 7fe1d2ff5640 10 client.25780 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:08.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.651+0000 7fe1ee7fc640 1 --2- 172.21.15.1:0/1849628779 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d8fff35da0 0x55d9003d4030 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2602d62870694b7f server_cookie=1476024fcd4bf1c4 in_seq=0 out_seq=0 2024-09-21T00:59:08.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.652+0000 7fe1d2ff5640 1 -- 172.21.15.1:0/1849628779 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1706 (crc 0 0 0) 0x55d9002bd850 con 0x55d8fff35da0 2024-09-21T00:59:08.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.652+0000 7fe1d2ff5640 10 client.25780 handle_command_reply: tid=0 2024-09-21T00:59:08.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.652+0000 7fe1fb9dc740 1 client.25780 shutdown 2024-09-21T00:59:08.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.652+0000 7fe1fb9dc740 1 -- 172.21.15.1:0/1849628779 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d8fff791b0 msgr2=0x55d90035d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:08.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.652+0000 7fe1fb9dc740 1 --2- 172.21.15.1:0/1849628779 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d8fff791b0 0x55d90035d9a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8003a60 tx=0x7fe1e8004ab0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.652+0000 7fe1fb9dc740 1 -- 172.21.15.1:0/1849628779 shutdown_connections 2024-09-21T00:59:08.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.652+0000 7fe1fb9dc740 1 --2- 172.21.15.1:0/1849628779 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d8fff35da0 0x55d9003d4030 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.652+0000 7fe1fb9dc740 1 --2- 172.21.15.1:0/1849628779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d8fffa2070 0x55d9003594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.652+0000 7fe1fb9dc740 1 --2- 172.21.15.1:0/1849628779 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8fff81390 0x55d900358e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.652+0000 7fe1d2ff5640 0 client.25780 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:08.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.652+0000 7fe1fb9dc740 1 --2- 172.21.15.1:0/1849628779 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d8fff791b0 0x55d90035d9a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.652+0000 7fe1fb9dc740 1 -- 172.21.15.1:0/1849628779 >> 172.21.15.1:0/1849628779 conn(0x55d8fff96460 msgr2=0x55d90034ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:08.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.652+0000 7fe1fb9dc740 1 -- 172.21.15.1:0/1849628779 shutdown_connections 2024-09-21T00:59:08.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.652+0000 7fe1fb9dc740 1 -- 172.21.15.1:0/1849628779 wait complete. 2024-09-21T00:59:08.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.653+0000 7fe1fb9dc740 20 client.25780 trim_cache size 0 max 16384 2024-09-21T00:59:08.656 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T00:59:08.656 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T00:59:08.656 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": { 2024-09-21T00:59:08.656 INFO:teuthology.orchestra.run.smithi001.stdout: "f826f2c1-768a-47bb-b868-785b351ac6b4": { 2024-09-21T00:59:08.656 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T00:59:08.656 INFO:teuthology.orchestra.run.smithi001.stdout: "tag": "f826f2c1-768a-47bb-b868-785b351ac6b4", 2024-09-21T00:59:08.656 INFO:teuthology.orchestra.run.smithi001.stdout: "options": "recursive,force" 2024-09-21T00:59:08.656 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T00:59:08.656 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T00:59:08.656 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_stats": { 2024-09-21T00:59:08.656 INFO:teuthology.orchestra.run.smithi001.stdout: "f826f2c1-768a-47bb-b868-785b351ac6b4": { 2024-09-21T00:59:08.657 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:59:06.554657+0000", 2024-09-21T00:59:08.657 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T00:59:08.657 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T00:59:08.657 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T00:59:08.657 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T00:59:08.657 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T00:59:08.657 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T00:59:08.657 INFO:teuthology.orchestra.run.smithi001.stdout: "bee49cce-b407-4617-a959-331ffd8dc5b0": { 2024-09-21T00:59:08.657 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:58:17.883027+0000", 2024-09-21T00:59:08.657 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T00:59:08.657 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T00:59:08.657 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T00:59:08.657 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T00:59:08.657 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T00:59:08.657 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T00:59:08.658 INFO:teuthology.orchestra.run.smithi001.stdout: "7cb1bc3f-e2d2-4bf7-b13e-8f3371d7aac1": { 2024-09-21T00:59:08.658 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:58:02.751142+0000", 2024-09-21T00:59:08.658 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T00:59:08.658 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T00:59:08.658 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T00:59:08.658 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T00:59:08.658 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T00:59:08.658 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T00:59:08.658 INFO:teuthology.orchestra.run.smithi001.stdout: "2383a19c-993d-4440-99f7-93b43dcf33b4": { 2024-09-21T00:59:08.658 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:47.609257+0000", 2024-09-21T00:59:08.658 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T00:59:08.658 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T00:59:08.658 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T00:59:08.659 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T00:59:08.659 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T00:59:08.659 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T00:59:08.659 INFO:teuthology.orchestra.run.smithi001.stdout: "53fa74e4-5aa8-408b-9724-7c93618f7636": { 2024-09-21T00:59:08.659 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:01.730608+0000", 2024-09-21T00:59:08.659 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T00:59:08.659 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T00:59:08.659 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T00:59:08.659 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T00:59:08.659 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T00:59:08.659 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T00:59:08.659 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T00:59:08.659 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T00:59:08.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.653+0000 7fe1f5468640 1 -- 172.21.15.1:0/1581902321 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe1d80b6590 msgr2=0x7fe1d80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:08.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.653+0000 7fe1f5468640 1 --2- 172.21.15.1:0/1581902321 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe1d80b6590 0x7fe1d80b8aa0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe1e800f820 tx=0x7fe1e8009500 comp rx=0 tx=0).stop 2024-09-21T00:59:08.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.653+0000 7fe1f5468640 1 -- 172.21.15.1:0/1581902321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1f0111f40 msgr2=0x7fe1f01136e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:08.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.653+0000 7fe1f5468640 1 --2- 172.21.15.1:0/1581902321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1f0111f40 0x7fe1f01136e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe1e002a930 tx=0x7fe1e0003c10 comp rx=0 tx=0).stop 2024-09-21T00:59:08.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.654+0000 7fe1f5468640 1 -- 172.21.15.1:0/1581902321 shutdown_connections 2024-09-21T00:59:08.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.654+0000 7fe1f5468640 1 --2- 172.21.15.1:0/1581902321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1f011cc30 0x7fe1f0113c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.654+0000 7fe1f5468640 1 --2- 172.21.15.1:0/1581902321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1f0111f40 0x7fe1f01136e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.654+0000 7fe1f5468640 1 --2- 172.21.15.1:0/1581902321 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe1d80b6590 0x7fe1d80b8aa0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.654+0000 7fe1f5468640 1 --2- 172.21.15.1:0/1581902321 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1f010a9e0 0x7fe1f011a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.654+0000 7fe1f5468640 1 -- 172.21.15.1:0/1581902321 >> 172.21.15.1:0/1581902321 conn(0x7fe1f0070ec0 msgr2=0x7fe1f011d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:08.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.654+0000 7fe1f5468640 1 -- 172.21.15.1:0/1581902321 shutdown_connections 2024-09-21T00:59:08.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:08.654+0000 7fe1f5468640 1 -- 172.21.15.1:0/1581902321 wait complete. 2024-09-21T00:59:10.150 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:09 smithi001 ceph-mon[31211]: pgmap v416: 97 pgs: 97 active+clean; 187 MiB data, 607 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 7.7 MiB/s wr, 733 op/s 2024-09-21T00:59:10.150 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:09 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:59:10.209 INFO:tasks.cephfs.filesystem:scrub status for tag:f826f2c1-768a-47bb-b868-785b351ac6b4 - {'path': '/', 'tag': 'f826f2c1-768a-47bb-b868-785b351ac6b4', 'options': 'recursive,force'} 2024-09-21T00:59:10.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:09 smithi193 ceph-mon[34660]: pgmap v416: 97 pgs: 97 active+clean; 187 MiB data, 607 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 7.7 MiB/s wr, 733 op/s 2024-09-21T00:59:10.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:09 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:59:10.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:09 smithi042 ceph-mon[34481]: pgmap v416: 97 pgs: 97 active+clean; 187 MiB data, 607 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 7.7 MiB/s wr, 733 op/s 2024-09-21T00:59:10.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:09 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:59:11.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:10 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:59:11.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:10 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:59:11.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:10 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:59:11.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:10 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:59:11.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:10 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:59:11.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:10 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:59:11.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:10 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:59:11.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:10 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:59:11.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:10 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T00:59:12.129 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:11 smithi193 ceph-mon[34660]: pgmap v417: 97 pgs: 97 active+clean; 186 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.4 MiB/s wr, 559 op/s 2024-09-21T00:59:12.142 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:11 smithi042 ceph-mon[34481]: pgmap v417: 97 pgs: 97 active+clean; 186 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.4 MiB/s wr, 559 op/s 2024-09-21T00:59:12.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:11 smithi001 ceph-mon[31211]: pgmap v417: 97 pgs: 97 active+clean; 186 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.4 MiB/s wr, 559 op/s 2024-09-21T00:59:13.557 INFO:tasks.workunit.client.0.smithi001.stdout: 53 1390960 590 778877 648 721070 1151 2024-09-21T00:59:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.593+0000 7fb412a27640 1 -- 172.21.15.1:0/2890560238 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb40c1036e0 msgr2=0x7fb40c103b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.593+0000 7fb412a27640 1 --2- 172.21.15.1:0/2890560238 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb40c1036e0 0x7fb40c103b50 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc009900 tx=0x7fb3fc02a410 comp rx=0 tx=0).stop 2024-09-21T00:59:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.593+0000 7fb412a27640 1 -- 172.21.15.1:0/2890560238 shutdown_connections 2024-09-21T00:59:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.593+0000 7fb412a27640 1 --2- 172.21.15.1:0/2890560238 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb40c105100 0x7fb40c10baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.593+0000 7fb412a27640 1 --2- 172.21.15.1:0/2890560238 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb40c104760 0x7fb40c104b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.593+0000 7fb412a27640 1 --2- 172.21.15.1:0/2890560238 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb40c1036e0 0x7fb40c103b50 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.593+0000 7fb412a27640 1 -- 172.21.15.1:0/2890560238 >> 172.21.15.1:0/2890560238 conn(0x7fb40c0ff020 msgr2=0x7fb40c1014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.593+0000 7fb412a27640 1 -- 172.21.15.1:0/2890560238 shutdown_connections 2024-09-21T00:59:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.593+0000 7fb412a27640 1 -- 172.21.15.1:0/2890560238 wait complete. 2024-09-21T00:59:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.593+0000 7fb412a27640 1 Processor -- start 2024-09-21T00:59:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.593+0000 7fb412a27640 1 -- start start 2024-09-21T00:59:13.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.594+0000 7fb412a27640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb40c1036e0 0x7fb40c199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:13.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.594+0000 7fb412a27640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb40c104760 0x7fb40c19a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:13.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.594+0000 7fb412a27640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb40c105100 0x7fb40c19b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:13.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.594+0000 7fb412a27640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb40c10f350 con 0x7fb40c104760 2024-09-21T00:59:13.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.594+0000 7fb412a27640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb40c10f1d0 con 0x7fb40c105100 2024-09-21T00:59:13.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.594+0000 7fb412a27640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb40c10f4d0 con 0x7fb40c1036e0 2024-09-21T00:59:13.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.594+0000 7fb40b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb40c104760 0x7fb40c19a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:13.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.594+0000 7fb40b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb40c104760 0x7fb40c19a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56934/0 (socket says 172.21.15.1:56934) 2024-09-21T00:59:13.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.594+0000 7fb40b7fe640 1 -- 172.21.15.1:0/1864996719 learned_addr learned my addr 172.21.15.1:0/1864996719 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:13.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.594+0000 7fb410fc4640 1 --2- 172.21.15.1:0/1864996719 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb40c105100 0x7fb40c19b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:13.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.594+0000 7fb40bfff640 1 --2- 172.21.15.1:0/1864996719 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb40c1036e0 0x7fb40c199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:13.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.594+0000 7fb40b7fe640 1 -- 172.21.15.1:0/1864996719 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb40c1036e0 msgr2=0x7fb40c199f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:13.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.594+0000 7fb40b7fe640 1 --2- 172.21.15.1:0/1864996719 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb40c1036e0 0x7fb40c199f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.594+0000 7fb40b7fe640 1 -- 172.21.15.1:0/1864996719 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb40c105100 msgr2=0x7fb40c19b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:13.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.594+0000 7fb40b7fe640 1 --2- 172.21.15.1:0/1864996719 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb40c105100 0x7fb40c19b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.594+0000 7fb40b7fe640 1 -- 172.21.15.1:0/1864996719 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb40c19b980 con 0x7fb40c104760 2024-09-21T00:59:13.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.594+0000 7fb40bfff640 1 --2- 172.21.15.1:0/1864996719 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb40c1036e0 0x7fb40c199f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:59:13.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.595+0000 7fb40b7fe640 1 --2- 172.21.15.1:0/1864996719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb40c104760 0x7fb40c19a5b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fb40000e9f0 tx=0x7fb40000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:13.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.595+0000 7fb4097fa640 1 -- 172.21.15.1:0/1864996719 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb40000cd80 con 0x7fb40c104760 2024-09-21T00:59:13.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.595+0000 7fb4097fa640 1 -- 172.21.15.1:0/1864996719 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4000108e0 con 0x7fb40c104760 2024-09-21T00:59:13.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.595+0000 7fb412a27640 1 -- 172.21.15.1:0/1864996719 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb40c19bc70 con 0x7fb40c104760 2024-09-21T00:59:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.595+0000 7fb4097fa640 1 -- 172.21.15.1:0/1864996719 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb400018980 con 0x7fb40c104760 2024-09-21T00:59:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.595+0000 7fb412a27640 1 -- 172.21.15.1:0/1864996719 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb40c1a2360 con 0x7fb40c104760 2024-09-21T00:59:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.598+0000 7fb419a6a740 1 Processor -- start 2024-09-21T00:59:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.598+0000 7fb419a6a740 1 -- start start 2024-09-21T00:59:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.598+0000 7fb419a6a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d312161b0 0x560d315bde50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.598+0000 7fb419a6a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d311ed2f0 0x560d315be4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.598+0000 7fb419a6a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d311f54d0 0x560d315bf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.598+0000 7fb419a6a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560d315306f0 con 0x560d311f54d0 2024-09-21T00:59:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.598+0000 7fb419a6a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560d3151fb20 con 0x560d312161b0 2024-09-21T00:59:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.598+0000 7fb419a6a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560d31523930 con 0x560d311ed2f0 2024-09-21T00:59:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.598+0000 7fb4097fa640 1 -- 172.21.15.1:0/1864996719 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7fb400010430 con 0x7fb40c104760 2024-09-21T00:59:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.598+0000 7fb410fc4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d312161b0 0x560d315bde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.598+0000 7fb410fc4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d312161b0 0x560d315bde50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:39672/0 (socket says 172.21.15.1:39672) 2024-09-21T00:59:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.599+0000 7fb410fc4640 1 -- 172.21.15.1:0/2467711907 learned_addr learned my addr 172.21.15.1:0/2467711907 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.599+0000 7fb40b7fe640 1 --2- 172.21.15.1:0/2467711907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d311f54d0 0x560d315bf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.599+0000 7fb40bfff640 1 --2- 172.21.15.1:0/2467711907 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d311ed2f0 0x560d315be4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.599+0000 7fb40b7fe640 1 -- 172.21.15.1:0/2467711907 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d311ed2f0 msgr2=0x560d315be4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.599+0000 7fb40b7fe640 1 --2- 172.21.15.1:0/2467711907 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d311ed2f0 0x560d315be4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.599+0000 7fb40b7fe640 1 -- 172.21.15.1:0/2467711907 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d312161b0 msgr2=0x560d315bde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.599+0000 7fb40b7fe640 1 --2- 172.21.15.1:0/2467711907 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d312161b0 0x560d315bde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.599+0000 7fb40b7fe640 1 -- 172.21.15.1:0/2467711907 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d314e5530 con 0x560d311f54d0 2024-09-21T00:59:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.599+0000 7fb4097fa640 1 --2- 172.21.15.1:0/1864996719 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb3f40b6510 0x7fb3f40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.599+0000 7fb40b7fe640 1 --2- 172.21.15.1:0/2467711907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d311f54d0 0x560d315bf010 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fb4000e51a0 tx=0x7fb4000ef690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e25d4aa32c329c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.599+0000 7fb410fc4640 1 --2- 172.21.15.1:0/1864996719 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb3f40b6510 0x7fb3f40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.600+0000 7fb3f27fc640 1 -- 172.21.15.1:0/2467711907 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4000a9eb0 con 0x560d311f54d0 2024-09-21T00:59:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.600+0000 7fb4097fa640 1 -- 172.21.15.1:0/1864996719 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fb4000e76f0 con 0x7fb40c104760 2024-09-21T00:59:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.600+0000 7fb3f27fc640 1 -- 172.21.15.1:0/2467711907 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb400010720 con 0x560d311f54d0 2024-09-21T00:59:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.600+0000 7fb3f27fc640 1 -- 172.21.15.1:0/2467711907 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4000713b0 con 0x560d311f54d0 2024-09-21T00:59:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.601+0000 7fb419a6a740 1 -- 172.21.15.1:0/2467711907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d311f54d0 msgr2=0x560d315bf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.601+0000 7fb419a6a740 1 --2- 172.21.15.1:0/2467711907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d311f54d0 0x560d315bf010 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fb4000e51a0 tx=0x7fb4000ef690 comp rx=0 tx=0).stop 2024-09-21T00:59:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.601+0000 7fb410fc4640 1 --2- 172.21.15.1:0/1864996719 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb3f40b6510 0x7fb3f40b8a20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb4040116b0 tx=0x7fb404009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.601+0000 7fb419a6a740 1 -- 172.21.15.1:0/2467711907 shutdown_connections 2024-09-21T00:59:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.601+0000 7fb419a6a740 1 --2- 172.21.15.1:0/2467711907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d311f54d0 0x560d315bf010 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.601+0000 7fb419a6a740 1 --2- 172.21.15.1:0/2467711907 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d311ed2f0 0x560d315be4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.601+0000 7fb419a6a740 1 --2- 172.21.15.1:0/2467711907 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d312161b0 0x560d315bde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.601+0000 7fb419a6a740 1 -- 172.21.15.1:0/2467711907 >> 172.21.15.1:0/2467711907 conn(0x560d3120a300 msgr2=0x560d315b98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.601+0000 7fb419a6a740 1 -- 172.21.15.1:0/2467711907 shutdown_connections 2024-09-21T00:59:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.601+0000 7fb419a6a740 1 -- 172.21.15.1:0/2467711907 wait complete. 2024-09-21T00:59:13.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.601+0000 7fb419a6a740 1 -- start start 2024-09-21T00:59:13.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.602+0000 7fb419a6a740 1 Processor -- start 2024-09-21T00:59:13.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.602+0000 7fb419a6a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d311ed2f0 0x560d315c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:13.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.602+0000 7fb419a6a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d311f54d0 0x560d315c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:13.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.602+0000 7fb419a6a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d312161b0 0x560d315c8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:13.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.602+0000 7fb419a6a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560d31457ab0 con 0x560d311ed2f0 2024-09-21T00:59:13.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.602+0000 7fb419a6a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560d314c5730 con 0x560d312161b0 2024-09-21T00:59:13.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.602+0000 7fb419a6a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560d315bfb30 con 0x560d311f54d0 2024-09-21T00:59:13.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.602+0000 7fb419a6a740 10 client.0 _ll_register_callbacks cb 0x560d315196b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:13.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.602+0000 7fb40bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d311ed2f0 0x560d315c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:13.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.602+0000 7fb40bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d311ed2f0 0x560d315c7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56952/0 (socket says 172.21.15.1:56952) 2024-09-21T00:59:13.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.602+0000 7fb40bfff640 1 -- 172.21.15.1:0/3117284754 learned_addr learned my addr 172.21.15.1:0/3117284754 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:13.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.602+0000 7fb410fc4640 1 --2- 172.21.15.1:0/3117284754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d312161b0 0x560d315c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:13.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.602+0000 7fb40b7fe640 1 --2- 172.21.15.1:0/3117284754 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d311f54d0 0x560d315c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:13.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.603+0000 7fb40bfff640 1 -- 172.21.15.1:0/3117284754 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d311f54d0 msgr2=0x560d315c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:13.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.603+0000 7fb40bfff640 1 --2- 172.21.15.1:0/3117284754 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d311f54d0 0x560d315c7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.603+0000 7fb40bfff640 1 -- 172.21.15.1:0/3117284754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d312161b0 msgr2=0x560d315c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:13.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.603+0000 7fb40bfff640 1 --2- 172.21.15.1:0/3117284754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d312161b0 0x560d315c8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.603+0000 7fb40bfff640 1 -- 172.21.15.1:0/3117284754 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d31281790 con 0x560d311ed2f0 2024-09-21T00:59:13.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.603+0000 7fb40bfff640 1 --2- 172.21.15.1:0/3117284754 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d311ed2f0 0x560d315c7660 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc009230 tx=0x7fb3fc005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20b9c23384132241 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:13.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.603+0000 7fb3eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:59:13.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.603+0000 7fb3eb7fe640 1 -- 172.21.15.1:0/3117284754 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc035040 con 0x560d311ed2f0 2024-09-21T00:59:13.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.603+0000 7fb3eb7fe640 1 -- 172.21.15.1:0/3117284754 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fb3fc0048c0 con 0x560d311ed2f0 2024-09-21T00:59:13.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.603+0000 7fb419a6a740 1 -- 172.21.15.1:0/3117284754 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560d31532640 con 0x560d311ed2f0 2024-09-21T00:59:13.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.603+0000 7fb3eb7fe640 1 -- 172.21.15.1:0/3117284754 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb3fc04b070 con 0x560d311ed2f0 2024-09-21T00:59:13.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.603+0000 7fb419a6a740 10 client.16203 fetch_fsmap learned FSMap version 31 2024-09-21T00:59:13.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.603+0000 7fb419a6a740 1 -- 172.21.15.1:0/3117284754 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x560d312fa620 con 0x560d311ed2f0 2024-09-21T00:59:13.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.604+0000 7fb3eb7fe640 1 -- 172.21.15.1:0/3117284754 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x560d31532640 con 0x560d311ed2f0 2024-09-21T00:59:13.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.604+0000 7fb3eb7fe640 1 -- 172.21.15.1:0/3117284754 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7fb3fc003cc0 con 0x560d311ed2f0 2024-09-21T00:59:13.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.604+0000 7fb419a6a740 10 client.16203 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:59:13.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.604+0000 7fb419a6a740 10 client.16203 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:13.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.604+0000 7fb419a6a740 20 client.16203 populate_metadata read hostname 'smithi001' 2024-09-21T00:59:13.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.604+0000 7fb419a6a740 1 --2- 172.21.15.1:0/3117284754 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560d311d4d80 0x560d315d4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:13.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.604+0000 7fb419a6a740 4 client.16203 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:59:13.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.604+0000 7fb419a6a740 1 -- 172.21.15.1:0/3117284754 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d3152e0f0 con 0x560d311d4d80 2024-09-21T00:59:13.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.605+0000 7fb40b7fe640 1 --2- 172.21.15.1:0/3117284754 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560d311d4d80 0x560d315d4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:13.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.606+0000 7fb3eb7fe640 10 client.16203 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:13.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.606+0000 7fb40b7fe640 1 --2- 172.21.15.1:0/3117284754 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560d311d4d80 0x560d315d4f00 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=120fc0d9c83da132 server_cookie=1de3dc1d3d811957 in_seq=0 out_seq=0 2024-09-21T00:59:13.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.610+0000 7fb3eb7fe640 1 -- 172.21.15.1:0/3117284754 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560d3152e0f0 con 0x560d311d4d80 2024-09-21T00:59:13.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.610+0000 7fb3eb7fe640 10 client.16203 handle_command_reply: tid=0 2024-09-21T00:59:13.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.610+0000 7fb419a6a740 1 client.16203 shutdown 2024-09-21T00:59:13.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.610+0000 7fb419a6a740 1 -- 172.21.15.1:0/3117284754 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d311ed2f0 msgr2=0x560d315c7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:13.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.610+0000 7fb419a6a740 1 --2- 172.21.15.1:0/3117284754 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d311ed2f0 0x560d315c7660 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc009230 tx=0x7fb3fc005270 comp rx=0 tx=0).stop 2024-09-21T00:59:13.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.610+0000 7fb419a6a740 1 -- 172.21.15.1:0/3117284754 shutdown_connections 2024-09-21T00:59:13.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.610+0000 7fb419a6a740 1 --2- 172.21.15.1:0/3117284754 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560d311d4d80 0x560d315d4f00 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.610+0000 7fb419a6a740 1 --2- 172.21.15.1:0/3117284754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d312161b0 0x560d315c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.610+0000 7fb3eb7fe640 0 client.16203 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:13.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.610+0000 7fb419a6a740 1 --2- 172.21.15.1:0/3117284754 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d311f54d0 0x560d315c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.610+0000 7fb419a6a740 1 --2- 172.21.15.1:0/3117284754 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d311ed2f0 0x560d315c7660 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.610+0000 7fb419a6a740 1 -- 172.21.15.1:0/3117284754 >> 172.21.15.1:0/3117284754 conn(0x560d3120a300 msgr2=0x560d315b7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:13.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.610+0000 7fb419a6a740 1 -- 172.21.15.1:0/3117284754 shutdown_connections 2024-09-21T00:59:13.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.610+0000 7fb419a6a740 1 -- 172.21.15.1:0/3117284754 wait complete. 2024-09-21T00:59:13.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.610+0000 7fb419a6a740 20 client.16203 trim_cache size 0 max 16384 2024-09-21T00:59:13.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.627+0000 7fb419a6a740 1 Processor -- start 2024-09-21T00:59:13.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.627+0000 7fb419a6a740 1 -- start start 2024-09-21T00:59:13.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.627+0000 7fb419a6a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d311ed2f0 0x560d315b8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:13.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.627+0000 7fb419a6a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d311f54d0 0x560d315b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:13.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.627+0000 7fb419a6a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d312161b0 0x560d315c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:13.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.627+0000 7fb419a6a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb40c1ab0b0 con 0x560d312161b0 2024-09-21T00:59:13.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.627+0000 7fb419a6a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb40c1acd70 con 0x560d311f54d0 2024-09-21T00:59:13.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.627+0000 7fb419a6a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb40c1ab780 con 0x560d311ed2f0 2024-09-21T00:59:13.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.627+0000 7fb410fc4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d312161b0 0x560d315c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:13.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.627+0000 7fb410fc4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d312161b0 0x560d315c5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56960/0 (socket says 172.21.15.1:56960) 2024-09-21T00:59:13.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.627+0000 7fb410fc4640 1 -- 172.21.15.1:0/4074664691 learned_addr learned my addr 172.21.15.1:0/4074664691 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:13.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.627+0000 7fb40b7fe640 1 --2- 172.21.15.1:0/4074664691 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d311f54d0 0x560d315b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:13.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.627+0000 7fb40bfff640 1 --2- 172.21.15.1:0/4074664691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d311ed2f0 0x560d315b8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:13.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.627+0000 7fb410fc4640 1 -- 172.21.15.1:0/4074664691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d311ed2f0 msgr2=0x560d315b8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:13.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.627+0000 7fb410fc4640 1 --2- 172.21.15.1:0/4074664691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d311ed2f0 0x560d315b8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.627+0000 7fb410fc4640 1 -- 172.21.15.1:0/4074664691 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d311f54d0 msgr2=0x560d315b8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:13.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.627+0000 7fb410fc4640 1 --2- 172.21.15.1:0/4074664691 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d311f54d0 0x560d315b8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.627+0000 7fb410fc4640 1 -- 172.21.15.1:0/4074664691 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d315d1630 con 0x560d312161b0 2024-09-21T00:59:13.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.628+0000 7fb410fc4640 1 --2- 172.21.15.1:0/4074664691 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d312161b0 0x560d315c5b70 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fb40400f740 tx=0x7fb404019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3960c85a9c813976 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:13.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.628+0000 7fb3f1ffb640 1 -- 172.21.15.1:0/4074664691 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb404003a30 con 0x560d312161b0 2024-09-21T00:59:13.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.628+0000 7fb3f1ffb640 1 -- 172.21.15.1:0/4074664691 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb404003bd0 con 0x560d312161b0 2024-09-21T00:59:13.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.628+0000 7fb3f1ffb640 1 -- 172.21.15.1:0/4074664691 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb404004470 con 0x560d312161b0 2024-09-21T00:59:13.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.629+0000 7fb419a6a740 1 -- 172.21.15.1:0/4074664691 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d312161b0 msgr2=0x560d315c5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:13.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.629+0000 7fb419a6a740 1 --2- 172.21.15.1:0/4074664691 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d312161b0 0x560d315c5b70 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fb40400f740 tx=0x7fb404019000 comp rx=0 tx=0).stop 2024-09-21T00:59:13.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.629+0000 7fb419a6a740 1 -- 172.21.15.1:0/4074664691 shutdown_connections 2024-09-21T00:59:13.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.629+0000 7fb419a6a740 1 --2- 172.21.15.1:0/4074664691 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d312161b0 0x560d315c5b70 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.629+0000 7fb419a6a740 1 --2- 172.21.15.1:0/4074664691 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d311f54d0 0x560d315b8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.629+0000 7fb419a6a740 1 --2- 172.21.15.1:0/4074664691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d311ed2f0 0x560d315b8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.629+0000 7fb419a6a740 1 -- 172.21.15.1:0/4074664691 >> 172.21.15.1:0/4074664691 conn(0x560d3120a300 msgr2=0x560d315b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:13.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.629+0000 7fb419a6a740 1 -- 172.21.15.1:0/4074664691 shutdown_connections 2024-09-21T00:59:13.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.629+0000 7fb419a6a740 1 -- 172.21.15.1:0/4074664691 wait complete. 2024-09-21T00:59:13.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.629+0000 7fb419a6a740 1 -- start start 2024-09-21T00:59:13.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.629+0000 7fb419a6a740 1 Processor -- start 2024-09-21T00:59:13.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.630+0000 7fb419a6a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d311ed2f0 0x560d315cf410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:13.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.630+0000 7fb419a6a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d311f54d0 0x560d315ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:13.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.630+0000 7fb419a6a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d312161b0 0x560d315ce630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:13.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.630+0000 7fb419a6a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb40c1ac5e0 con 0x560d312161b0 2024-09-21T00:59:13.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.630+0000 7fb419a6a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb40c1abf10 con 0x560d311ed2f0 2024-09-21T00:59:13.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.630+0000 7fb419a6a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb40c1a9090 con 0x560d311f54d0 2024-09-21T00:59:13.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.630+0000 7fb419a6a740 10 client.0 _ll_register_callbacks cb 0x7fb4040093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:13.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.630+0000 7fb410fc4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d312161b0 0x560d315ce630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:13.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.630+0000 7fb410fc4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d312161b0 0x560d315ce630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56962/0 (socket says 172.21.15.1:56962) 2024-09-21T00:59:13.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.630+0000 7fb410fc4640 1 -- 172.21.15.1:0/886834601 learned_addr learned my addr 172.21.15.1:0/886834601 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:13.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.630+0000 7fb40bfff640 1 --2- 172.21.15.1:0/886834601 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d311ed2f0 0x560d315cf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.630+0000 7fb40b7fe640 1 --2- 172.21.15.1:0/886834601 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d311f54d0 0x560d315ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.630+0000 7fb410fc4640 1 -- 172.21.15.1:0/886834601 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d311f54d0 msgr2=0x560d315ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.630+0000 7fb410fc4640 1 --2- 172.21.15.1:0/886834601 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d311f54d0 0x560d315ce0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.630+0000 7fb410fc4640 1 -- 172.21.15.1:0/886834601 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d311ed2f0 msgr2=0x560d315cf410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.630+0000 7fb410fc4640 1 --2- 172.21.15.1:0/886834601 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d311ed2f0 0x560d315cf410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.630+0000 7fb410fc4640 1 -- 172.21.15.1:0/886834601 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d315cedc0 con 0x560d312161b0 2024-09-21T00:59:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.630+0000 7fb410fc4640 1 --2- 172.21.15.1:0/886834601 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d312161b0 0x560d315ce630 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb404006010 tx=0x7fb404011280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de51b980158fd52e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.630+0000 7fb3eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:59:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.631+0000 7fb3eb7fe640 1 -- 172.21.15.1:0/886834601 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb404010870 con 0x560d312161b0 2024-09-21T00:59:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.631+0000 7fb3eb7fe640 1 -- 172.21.15.1:0/886834601 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fb404010a10 con 0x560d312161b0 2024-09-21T00:59:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.631+0000 7fb419a6a740 1 -- 172.21.15.1:0/886834601 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb404003bd0 con 0x560d312161b0 2024-09-21T00:59:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.631+0000 7fb3eb7fe640 1 -- 172.21.15.1:0/886834601 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb4040041f0 con 0x560d312161b0 2024-09-21T00:59:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.631+0000 7fb419a6a740 10 client.16209 fetch_fsmap learned FSMap version 31 2024-09-21T00:59:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.631+0000 7fb419a6a740 1 -- 172.21.15.1:0/886834601 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x560d3163f8c0 con 0x560d312161b0 2024-09-21T00:59:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.631+0000 7fb3eb7fe640 1 -- 172.21.15.1:0/886834601 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb404003bd0 con 0x560d312161b0 2024-09-21T00:59:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.631+0000 7fb3eb7fe640 1 -- 172.21.15.1:0/886834601 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7fb404031070 con 0x560d312161b0 2024-09-21T00:59:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.631+0000 7fb419a6a740 10 client.16209 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:59:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.631+0000 7fb419a6a740 10 client.16209 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.632+0000 7fb419a6a740 20 client.16209 populate_metadata read hostname 'smithi001' 2024-09-21T00:59:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.632+0000 7fb419a6a740 1 --2- 172.21.15.1:0/886834601 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560d311aa1c0 0x560d316422f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.632+0000 7fb419a6a740 4 client.16209 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T00:59:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.632+0000 7fb419a6a740 1 -- 172.21.15.1:0/886834601 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560d3152b520 con 0x560d311aa1c0 2024-09-21T00:59:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.632+0000 7fb40bfff640 1 --2- 172.21.15.1:0/886834601 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560d311aa1c0 0x560d316422f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.632+0000 7fb40bfff640 1 --2- 172.21.15.1:0/886834601 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560d311aa1c0 0x560d316422f0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52e5d1219073f3d0 server_cookie=de11869f28f7fce2 in_seq=0 out_seq=0 2024-09-21T00:59:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.632+0000 7fb3eb7fe640 10 client.16209 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:13.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.793+0000 7fb3eb7fe640 1 -- 172.21.15.1:0/886834601 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560d3152b520 con 0x560d311aa1c0 2024-09-21T00:59:13.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.793+0000 7fb3eb7fe640 10 client.16209 handle_command_reply: tid=0 2024-09-21T00:59:13.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.793+0000 7fb419a6a740 1 client.16209 shutdown 2024-09-21T00:59:13.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.793+0000 7fb419a6a740 1 -- 172.21.15.1:0/886834601 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d312161b0 msgr2=0x560d315ce630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:13.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.793+0000 7fb419a6a740 1 --2- 172.21.15.1:0/886834601 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d312161b0 0x560d315ce630 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb404006010 tx=0x7fb404011280 comp rx=0 tx=0).stop 2024-09-21T00:59:13.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.793+0000 7fb419a6a740 1 -- 172.21.15.1:0/886834601 shutdown_connections 2024-09-21T00:59:13.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.793+0000 7fb419a6a740 1 --2- 172.21.15.1:0/886834601 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560d311aa1c0 0x560d316422f0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.793+0000 7fb419a6a740 1 --2- 172.21.15.1:0/886834601 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d312161b0 0x560d315ce630 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.793+0000 7fb419a6a740 1 --2- 172.21.15.1:0/886834601 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d311f54d0 0x560d315ce0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.793+0000 7fb3eb7fe640 0 client.16209 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:13.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.793+0000 7fb419a6a740 1 --2- 172.21.15.1:0/886834601 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d311ed2f0 0x560d315cf410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.793+0000 7fb419a6a740 1 -- 172.21.15.1:0/886834601 >> 172.21.15.1:0/886834601 conn(0x560d3120a300 msgr2=0x560d315b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:13.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.794+0000 7fb419a6a740 1 -- 172.21.15.1:0/886834601 shutdown_connections 2024-09-21T00:59:13.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.794+0000 7fb419a6a740 1 -- 172.21.15.1:0/886834601 wait complete. 2024-09-21T00:59:13.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.794+0000 7fb419a6a740 20 client.16209 trim_cache size 0 max 16384 2024-09-21T00:59:13.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T00:59:13.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T00:59:13.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T00:59:13.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T00:59:13.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.794+0000 7fb412a27640 1 -- 172.21.15.1:0/1864996719 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb3f40b6510 msgr2=0x7fb3f40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:13.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.794+0000 7fb412a27640 1 --2- 172.21.15.1:0/1864996719 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb3f40b6510 0x7fb3f40b8a20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb4040116b0 tx=0x7fb404009500 comp rx=0 tx=0).stop 2024-09-21T00:59:13.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.794+0000 7fb412a27640 1 -- 172.21.15.1:0/1864996719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb40c104760 msgr2=0x7fb40c19a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:13.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.794+0000 7fb412a27640 1 --2- 172.21.15.1:0/1864996719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb40c104760 0x7fb40c19a5b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fb40000e9f0 tx=0x7fb40000eeb0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.795+0000 7fb412a27640 1 -- 172.21.15.1:0/1864996719 shutdown_connections 2024-09-21T00:59:13.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.795+0000 7fb412a27640 1 --2- 172.21.15.1:0/1864996719 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb40c105100 0x7fb40c19b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.795+0000 7fb412a27640 1 --2- 172.21.15.1:0/1864996719 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb3f40b6510 0x7fb3f40b8a20 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.795+0000 7fb412a27640 1 --2- 172.21.15.1:0/1864996719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb40c104760 0x7fb40c19a5b0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.795+0000 7fb412a27640 1 --2- 172.21.15.1:0/1864996719 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb40c1036e0 0x7fb40c199f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.795+0000 7fb412a27640 1 -- 172.21.15.1:0/1864996719 >> 172.21.15.1:0/1864996719 conn(0x7fb40c0ff020 msgr2=0x7fb40c107a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:13.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.795+0000 7fb412a27640 1 -- 172.21.15.1:0/1864996719 shutdown_connections 2024-09-21T00:59:13.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:13.795+0000 7fb412a27640 1 -- 172.21.15.1:0/1864996719 wait complete. 2024-09-21T00:59:14.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:13 smithi001 ceph-mon[31211]: pgmap v418: 97 pgs: 97 active+clean; 189 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.4 MiB/s wr, 371 op/s 2024-09-21T00:59:14.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:13 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T00:59:14.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:13 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T00:59:14.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:13 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T00:59:14.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:13 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T00:59:14.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:13 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T00:59:14.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:13 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T00:59:14.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:13 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T00:59:14.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:13 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T00:59:14.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:13 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T00:59:14.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:13 smithi193 ceph-mon[34660]: pgmap v418: 97 pgs: 97 active+clean; 189 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.4 MiB/s wr, 371 op/s 2024-09-21T00:59:14.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:13 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T00:59:14.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:13 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T00:59:14.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:13 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T00:59:14.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:13 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T00:59:14.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:13 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T00:59:14.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:13 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T00:59:14.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:13 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T00:59:14.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:13 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T00:59:14.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:13 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T00:59:14.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:13 smithi042 ceph-mon[34481]: pgmap v418: 97 pgs: 97 active+clean; 189 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.4 MiB/s wr, 371 op/s 2024-09-21T00:59:14.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:13 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T00:59:14.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:13 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T00:59:14.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:13 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T00:59:14.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:13 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T00:59:14.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:13 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T00:59:14.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:13 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T00:59:14.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:13 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T00:59:14.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:13 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T00:59:14.243 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:13 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T00:59:15.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:14 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T00:59:15.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:14 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T00:59:15.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:14 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T00:59:16.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:15 smithi001 ceph-mon[31211]: pgmap v419: 97 pgs: 97 active+clean; 194 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.9 MiB/s wr, 244 op/s 2024-09-21T00:59:16.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:15 smithi193 ceph-mon[34660]: pgmap v419: 97 pgs: 97 active+clean; 194 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.9 MiB/s wr, 244 op/s 2024-09-21T00:59:16.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:15 smithi042 ceph-mon[34481]: pgmap v419: 97 pgs: 97 active+clean; 194 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.9 MiB/s wr, 244 op/s 2024-09-21T00:59:18.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:17 smithi001 ceph-mon[31211]: pgmap v420: 97 pgs: 97 active+clean; 195 MiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.8 MiB/s wr, 282 op/s 2024-09-21T00:59:18.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:17 smithi193 ceph-mon[34660]: pgmap v420: 97 pgs: 97 active+clean; 195 MiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.8 MiB/s wr, 282 op/s 2024-09-21T00:59:18.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:17 smithi042 ceph-mon[34481]: pgmap v420: 97 pgs: 97 active+clean; 195 MiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.8 MiB/s wr, 282 op/s 2024-09-21T00:59:20.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:19 smithi001 ceph-mon[31211]: pgmap v421: 97 pgs: 97 active+clean; 200 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.2 MiB/s wr, 390 op/s 2024-09-21T00:59:20.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:19 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T00:59:20.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:19 smithi193 ceph-mon[34660]: pgmap v421: 97 pgs: 97 active+clean; 200 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.2 MiB/s wr, 390 op/s 2024-09-21T00:59:20.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:19 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T00:59:20.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:19 smithi042 ceph-mon[34481]: pgmap v421: 97 pgs: 97 active+clean; 200 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.2 MiB/s wr, 390 op/s 2024-09-21T00:59:20.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:19 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T00:59:22.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:21 smithi001 ceph-mon[31211]: pgmap v422: 97 pgs: 97 active+clean; 202 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 396 op/s 2024-09-21T00:59:22.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:21 smithi193 ceph-mon[34660]: pgmap v422: 97 pgs: 97 active+clean; 202 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 396 op/s 2024-09-21T00:59:22.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:21 smithi042 ceph-mon[34481]: pgmap v422: 97 pgs: 97 active+clean; 202 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 396 op/s 2024-09-21T00:59:23.557 INFO:tasks.workunit.client.0.smithi001.stdout: 53 21390 3 9709 2 9216 7 2024-09-21T00:59:24.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:23 smithi001 ceph-mon[31211]: pgmap v423: 97 pgs: 97 active+clean; 207 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 535 op/s 2024-09-21T00:59:24.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:23 smithi193 ceph-mon[34660]: pgmap v423: 97 pgs: 97 active+clean; 207 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 535 op/s 2024-09-21T00:59:24.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:23 smithi042 ceph-mon[34481]: pgmap v423: 97 pgs: 97 active+clean; 207 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 535 op/s 2024-09-21T00:59:26.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:25 smithi001 ceph-mon[31211]: pgmap v424: 97 pgs: 97 active+clean; 208 MiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 520 op/s 2024-09-21T00:59:26.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:25 smithi193 ceph-mon[34660]: pgmap v424: 97 pgs: 97 active+clean; 208 MiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 520 op/s 2024-09-21T00:59:26.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:25 smithi042 ceph-mon[34481]: pgmap v424: 97 pgs: 97 active+clean; 208 MiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 520 op/s 2024-09-21T00:59:26.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.903+0000 7facadc0e640 1 -- 172.21.15.1:0/1738018244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faca81050d0 msgr2=0x7faca810ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:26.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.903+0000 7facadc0e640 1 --2- 172.21.15.1:0/1738018244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faca81050d0 0x7faca810ba70 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7faca0009ca0 tx=0x7faca002a8c0 comp rx=0 tx=0).stop 2024-09-21T00:59:26.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.903+0000 7facadc0e640 1 -- 172.21.15.1:0/1738018244 shutdown_connections 2024-09-21T00:59:26.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.903+0000 7facadc0e640 1 --2- 172.21.15.1:0/1738018244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faca81050d0 0x7faca810ba70 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:26.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.903+0000 7facadc0e640 1 --2- 172.21.15.1:0/1738018244 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faca8104730 0x7faca8104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:26.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.903+0000 7facadc0e640 1 --2- 172.21.15.1:0/1738018244 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faca81036b0 0x7faca8103b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:26.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.903+0000 7facadc0e640 1 -- 172.21.15.1:0/1738018244 >> 172.21.15.1:0/1738018244 conn(0x7faca80feff0 msgr2=0x7faca81014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:26.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.903+0000 7facadc0e640 1 -- 172.21.15.1:0/1738018244 shutdown_connections 2024-09-21T00:59:26.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.903+0000 7facadc0e640 1 -- 172.21.15.1:0/1738018244 wait complete. 2024-09-21T00:59:26.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.904+0000 7facadc0e640 1 Processor -- start 2024-09-21T00:59:26.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.904+0000 7facadc0e640 1 -- start start 2024-09-21T00:59:26.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.904+0000 7facadc0e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faca81036b0 0x7faca8199ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:26.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.904+0000 7facadc0e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faca8104730 0x7faca819a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:26.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.904+0000 7facadc0e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faca81050d0 0x7faca819b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:26.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.904+0000 7facadc0e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faca810f300 con 0x7faca81050d0 2024-09-21T00:59:26.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.904+0000 7facadc0e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7faca810f180 con 0x7faca81036b0 2024-09-21T00:59:26.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.904+0000 7facadc0e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faca810f480 con 0x7faca8104730 2024-09-21T00:59:26.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.904+0000 7faca7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faca81050d0 0x7faca819b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:26.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.904+0000 7faca77fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faca81036b0 0x7faca8199ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:26.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.904+0000 7faca7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faca81050d0 0x7faca819b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42566/0 (socket says 172.21.15.1:42566) 2024-09-21T00:59:26.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.904+0000 7faca77fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faca81036b0 0x7faca8199ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:53178/0 (socket says 172.21.15.1:53178) 2024-09-21T00:59:26.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.904+0000 7faca7fff640 1 -- 172.21.15.1:0/1196332783 learned_addr learned my addr 172.21.15.1:0/1196332783 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:26.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.905+0000 7faca6ffd640 1 --2- 172.21.15.1:0/1196332783 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faca8104730 0x7faca819a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:26.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.905+0000 7faca7fff640 1 -- 172.21.15.1:0/1196332783 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faca8104730 msgr2=0x7faca819a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:26.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.905+0000 7faca7fff640 1 --2- 172.21.15.1:0/1196332783 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faca8104730 0x7faca819a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:26.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.905+0000 7faca7fff640 1 -- 172.21.15.1:0/1196332783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faca81036b0 msgr2=0x7faca8199ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:26.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.905+0000 7faca7fff640 1 --2- 172.21.15.1:0/1196332783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faca81036b0 0x7faca8199ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:26.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.905+0000 7faca7fff640 1 -- 172.21.15.1:0/1196332783 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca819b930 con 0x7faca81050d0 2024-09-21T00:59:26.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.905+0000 7faca7fff640 1 --2- 172.21.15.1:0/1196332783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faca81050d0 0x7faca819b110 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7faca0006010 tx=0x7faca0003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:26.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.905+0000 7faca4ff9640 1 -- 172.21.15.1:0/1196332783 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca0004240 con 0x7faca81050d0 2024-09-21T00:59:26.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.905+0000 7facadc0e640 1 -- 172.21.15.1:0/1196332783 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faca819bbc0 con 0x7faca81050d0 2024-09-21T00:59:26.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.905+0000 7faca4ff9640 1 -- 172.21.15.1:0/1196332783 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faca00317e0 con 0x7faca81050d0 2024-09-21T00:59:26.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.905+0000 7faca4ff9640 1 -- 172.21.15.1:0/1196332783 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca002fac0 con 0x7faca81050d0 2024-09-21T00:59:26.910 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.905+0000 7facadc0e640 1 -- 172.21.15.1:0/1196332783 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faca81a2310 con 0x7faca81050d0 2024-09-21T00:59:26.911 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.908+0000 7faca4ff9640 1 -- 172.21.15.1:0/1196332783 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7faca002fca0 con 0x7faca81050d0 2024-09-21T00:59:26.912 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.908+0000 7facb4c58740 1 Processor -- start 2024-09-21T00:59:26.912 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.908+0000 7facb4c58740 1 -- start start 2024-09-21T00:59:26.912 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.908+0000 7facb4c58740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a1ac94e1b0 0x55a1accf5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:26.912 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.908+0000 7facb4c58740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1ac9252f0 0x55a1accf64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:26.912 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.908+0000 7facb4c58740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a1ac92d4d0 0x55a1accf7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:26.912 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.908+0000 7facb4c58740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a1acc686f0 con 0x55a1ac94e1b0 2024-09-21T00:59:26.912 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.908+0000 7facb4c58740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a1acc57b20 con 0x55a1ac9252f0 2024-09-21T00:59:26.912 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.908+0000 7facb4c58740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a1acc5b930 con 0x55a1ac92d4d0 2024-09-21T00:59:26.912 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.908+0000 7faca6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a1ac94e1b0 0x55a1accf5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:26.912 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.908+0000 7faca6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a1ac94e1b0 0x55a1accf5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42568/0 (socket says 172.21.15.1:42568) 2024-09-21T00:59:26.912 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.908+0000 7faca6ffd640 1 -- 172.21.15.1:0/941276664 learned_addr learned my addr 172.21.15.1:0/941276664 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:26.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.909+0000 7faca77fe640 1 --2- 172.21.15.1:0/941276664 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1ac9252f0 0x55a1accf64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:26.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.909+0000 7faca6ffd640 1 --2- 172.21.15.1:0/941276664 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a1ac92d4d0 0x55a1accf7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:26.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.909+0000 7faca4ff9640 1 --2- 172.21.15.1:0/1196332783 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fac900b6510 0x7fac900b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:26.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.909+0000 7faca6ffd640 1 -- 172.21.15.1:0/941276664 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a1ac92d4d0 msgr2=0x55a1accf7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:26.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.909+0000 7faca6ffd640 1 --2- 172.21.15.1:0/941276664 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a1ac92d4d0 0x55a1accf7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:26.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.909+0000 7faca6ffd640 1 -- 172.21.15.1:0/941276664 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1ac9252f0 msgr2=0x55a1accf64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:26.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.909+0000 7faca6ffd640 1 --2- 172.21.15.1:0/941276664 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1ac9252f0 0x55a1accf64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:26.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.909+0000 7faca6ffd640 1 -- 172.21.15.1:0/941276664 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1acc1d530 con 0x55a1ac94e1b0 2024-09-21T00:59:26.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.909+0000 7faca77fe640 1 --2- 172.21.15.1:0/941276664 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1ac9252f0 0x55a1accf64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:26.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.909+0000 7faca7fff640 1 --2- 172.21.15.1:0/1196332783 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fac900b6510 0x7fac900b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:26.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.909+0000 7faca4ff9640 1 -- 172.21.15.1:0/1196332783 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7faca01086c0 con 0x7faca81050d0 2024-09-21T00:59:26.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.909+0000 7faca6ffd640 1 --2- 172.21.15.1:0/941276664 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a1ac94e1b0 0x55a1accf5e50 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fac9c009ee0 tx=0x7fac9c0097a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e354902cfc3c6f54 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:26.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.910+0000 7fac8dffb640 1 -- 172.21.15.1:0/941276664 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac9c013d10 con 0x55a1ac94e1b0 2024-09-21T00:59:26.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.910+0000 7fac8dffb640 1 -- 172.21.15.1:0/941276664 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac9c00fd40 con 0x55a1ac94e1b0 2024-09-21T00:59:26.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.910+0000 7fac8dffb640 1 -- 172.21.15.1:0/941276664 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac9c010b00 con 0x55a1ac94e1b0 2024-09-21T00:59:26.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.911+0000 7facb4c58740 1 -- 172.21.15.1:0/941276664 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a1ac94e1b0 msgr2=0x55a1accf5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:26.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.911+0000 7facb4c58740 1 --2- 172.21.15.1:0/941276664 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a1ac94e1b0 0x55a1accf5e50 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fac9c009ee0 tx=0x7fac9c0097a0 comp rx=0 tx=0).stop 2024-09-21T00:59:26.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.911+0000 7faca7fff640 1 --2- 172.21.15.1:0/1196332783 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fac900b6510 0x7fac900b8a20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7faca00ce4d0 tx=0x7faca00ff270 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:26.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.911+0000 7facb4c58740 1 -- 172.21.15.1:0/941276664 shutdown_connections 2024-09-21T00:59:26.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.911+0000 7facb4c58740 1 --2- 172.21.15.1:0/941276664 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a1ac92d4d0 0x55a1accf7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:26.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.911+0000 7facb4c58740 1 --2- 172.21.15.1:0/941276664 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1ac9252f0 0x55a1accf64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:26.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.911+0000 7facb4c58740 1 --2- 172.21.15.1:0/941276664 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a1ac94e1b0 0x55a1accf5e50 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:26.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.911+0000 7facb4c58740 1 -- 172.21.15.1:0/941276664 >> 172.21.15.1:0/941276664 conn(0x55a1ac942300 msgr2=0x55a1accf18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:26.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.911+0000 7facb4c58740 1 -- 172.21.15.1:0/941276664 shutdown_connections 2024-09-21T00:59:26.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.911+0000 7facb4c58740 1 -- 172.21.15.1:0/941276664 wait complete. 2024-09-21T00:59:26.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.911+0000 7facb4c58740 1 -- start start 2024-09-21T00:59:26.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.911+0000 7facb4c58740 1 Processor -- start 2024-09-21T00:59:26.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.912+0000 7facb4c58740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a1ac9252f0 0x55a1accff5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:26.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.912+0000 7facb4c58740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a1ac92d4d0 0x55a1accffca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:26.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.912+0000 7facb4c58740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1ac94e1b0 0x55a1acd00810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:26.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.912+0000 7facb4c58740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a1acb8fab0 con 0x55a1ac92d4d0 2024-09-21T00:59:26.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.912+0000 7facb4c58740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a1acbfd730 con 0x55a1ac94e1b0 2024-09-21T00:59:26.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.912+0000 7facb4c58740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a1accf7b30 con 0x55a1ac9252f0 2024-09-21T00:59:26.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.912+0000 7facb4c58740 10 client.0 _ll_register_callbacks cb 0x55a1acc516b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:26.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.912+0000 7faca77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a1ac92d4d0 0x55a1accffca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:26.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.912+0000 7faca6ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a1ac9252f0 0x55a1accff5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:26.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.912+0000 7faca77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a1ac92d4d0 0x55a1accffca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42580/0 (socket says 172.21.15.1:42580) 2024-09-21T00:59:26.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.912+0000 7faca77fe640 1 -- 172.21.15.1:0/1834569865 learned_addr learned my addr 172.21.15.1:0/1834569865 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:26.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.912+0000 7faca6ffd640 1 --2- 172.21.15.1:0/1834569865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1ac94e1b0 0x55a1acd00810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:26.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.912+0000 7faca77fe640 1 -- 172.21.15.1:0/1834569865 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a1ac9252f0 msgr2=0x55a1accff5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:26.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.912+0000 7faca77fe640 1 --2- 172.21.15.1:0/1834569865 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a1ac9252f0 0x55a1accff5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:26.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.912+0000 7faca77fe640 1 -- 172.21.15.1:0/1834569865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1ac94e1b0 msgr2=0x55a1acd00810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:26.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.912+0000 7faca77fe640 1 --2- 172.21.15.1:0/1834569865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1ac94e1b0 0x55a1acd00810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:26.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.912+0000 7faca77fe640 1 -- 172.21.15.1:0/1834569865 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1ac9b9790 con 0x55a1ac92d4d0 2024-09-21T00:59:26.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.912+0000 7faca6ffd640 1 --2- 172.21.15.1:0/1834569865 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a1ac9252f0 0x55a1accff5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:26.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.912+0000 7faca77fe640 1 --2- 172.21.15.1:0/1834569865 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a1ac92d4d0 0x55a1accffca0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fac98012810 tx=0x7fac98012cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e70d1b5c7ed83f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:26.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.912+0000 7fac86ffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:59:26.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.912+0000 7fac86ffd640 1 -- 172.21.15.1:0/1834569865 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac98004020 con 0x55a1ac92d4d0 2024-09-21T00:59:26.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.912+0000 7facb4c58740 1 -- 172.21.15.1:0/1834569865 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac9c00fd40 con 0x55a1ac92d4d0 2024-09-21T00:59:26.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.912+0000 7fac86ffd640 1 -- 172.21.15.1:0/1834569865 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fac980041c0 con 0x55a1ac92d4d0 2024-09-21T00:59:26.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.913+0000 7fac86ffd640 1 -- 172.21.15.1:0/1834569865 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fac980043c0 con 0x55a1ac92d4d0 2024-09-21T00:59:26.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.913+0000 7facb4c58740 10 client.16221 fetch_fsmap learned FSMap version 31 2024-09-21T00:59:26.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.913+0000 7facb4c58740 1 -- 172.21.15.1:0/1834569865 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a1aca32620 con 0x55a1ac92d4d0 2024-09-21T00:59:26.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.913+0000 7fac86ffd640 1 -- 172.21.15.1:0/1834569865 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac9c00fd40 con 0x55a1ac92d4d0 2024-09-21T00:59:26.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.913+0000 7fac86ffd640 1 -- 172.21.15.1:0/1834569865 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7fac98003a30 con 0x55a1ac92d4d0 2024-09-21T00:59:26.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.913+0000 7facb4c58740 10 client.16221 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:59:26.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.913+0000 7facb4c58740 10 client.16221 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:26.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.913+0000 7facb4c58740 20 client.16221 populate_metadata read hostname 'smithi001' 2024-09-21T00:59:26.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.913+0000 7facb4c58740 1 --2- 172.21.15.1:0/1834569865 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a1ac90cd80 0x55a1acd0cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:26.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.913+0000 7facb4c58740 4 client.16221 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:59:26.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.913+0000 7facb4c58740 1 -- 172.21.15.1:0/1834569865 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1acc6a640 con 0x55a1ac90cd80 2024-09-21T00:59:26.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.914+0000 7faca6ffd640 1 --2- 172.21.15.1:0/1834569865 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a1ac90cd80 0x55a1acd0cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:26.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.914+0000 7faca6ffd640 1 --2- 172.21.15.1:0/1834569865 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a1ac90cd80 0x55a1acd0cef0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95d91ab6696f8181 server_cookie=b9f2079f99dfe02d in_seq=0 out_seq=0 2024-09-21T00:59:26.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.914+0000 7fac86ffd640 10 client.16221 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:26.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.915+0000 7fac86ffd640 1 -- 172.21.15.1:0/1834569865 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a1acc6a640 con 0x55a1ac90cd80 2024-09-21T00:59:26.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.915+0000 7fac86ffd640 10 client.16221 handle_command_reply: tid=0 2024-09-21T00:59:26.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.915+0000 7facb4c58740 1 client.16221 shutdown 2024-09-21T00:59:26.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.915+0000 7facb4c58740 1 -- 172.21.15.1:0/1834569865 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a1ac92d4d0 msgr2=0x55a1accffca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:26.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.915+0000 7facb4c58740 1 --2- 172.21.15.1:0/1834569865 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a1ac92d4d0 0x55a1accffca0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fac98012810 tx=0x7fac98012cd0 comp rx=0 tx=0).stop 2024-09-21T00:59:26.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.915+0000 7facb4c58740 1 -- 172.21.15.1:0/1834569865 shutdown_connections 2024-09-21T00:59:26.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.915+0000 7facb4c58740 1 --2- 172.21.15.1:0/1834569865 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a1ac90cd80 0x55a1acd0cef0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:26.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.915+0000 7fac86ffd640 0 client.16221 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:26.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.915+0000 7facb4c58740 1 --2- 172.21.15.1:0/1834569865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1ac94e1b0 0x55a1acd00810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:26.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.915+0000 7facb4c58740 1 --2- 172.21.15.1:0/1834569865 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a1ac92d4d0 0x55a1accffca0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:26.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.915+0000 7facb4c58740 1 --2- 172.21.15.1:0/1834569865 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a1ac9252f0 0x55a1accff5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:26.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.916+0000 7facb4c58740 1 -- 172.21.15.1:0/1834569865 >> 172.21.15.1:0/1834569865 conn(0x55a1ac942300 msgr2=0x55a1accefea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:26.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.916+0000 7facb4c58740 1 -- 172.21.15.1:0/1834569865 shutdown_connections 2024-09-21T00:59:26.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.916+0000 7facb4c58740 1 -- 172.21.15.1:0/1834569865 wait complete. 2024-09-21T00:59:26.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.916+0000 7facb4c58740 20 client.16221 trim_cache size 0 max 16384 2024-09-21T00:59:26.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.932+0000 7facb4c58740 1 Processor -- start 2024-09-21T00:59:26.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.932+0000 7facb4c58740 1 -- start start 2024-09-21T00:59:26.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.932+0000 7facb4c58740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a1ac9252f0 0x55a1accfe200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:26.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.932+0000 7facb4c58740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1ac92d4d0 0x55a1accf5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:26.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.932+0000 7facb4c58740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a1ac94e1b0 0x55a1accf6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:26.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.932+0000 7facb4c58740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faca81ab020 con 0x55a1ac94e1b0 2024-09-21T00:59:26.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.932+0000 7facb4c58740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7faca81acce0 con 0x55a1ac92d4d0 2024-09-21T00:59:26.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.932+0000 7facb4c58740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faca81ab6f0 con 0x55a1ac9252f0 2024-09-21T00:59:26.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.932+0000 7faca6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a1ac94e1b0 0x55a1accf6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:26.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.932+0000 7faca6ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a1ac9252f0 0x55a1accfe200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:26.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.932+0000 7faca77fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1ac92d4d0 0x55a1accf5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:26.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.932+0000 7faca6ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a1ac9252f0 0x55a1accfe200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:44112/0 (socket says 172.21.15.1:44112) 2024-09-21T00:59:26.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.932+0000 7faca6ffd640 1 -- 172.21.15.1:0/1381661685 learned_addr learned my addr 172.21.15.1:0/1381661685 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:26.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.933+0000 7faca77fe640 1 -- 172.21.15.1:0/1381661685 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a1ac9252f0 msgr2=0x55a1accfe200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:26.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.933+0000 7faca77fe640 1 --2- 172.21.15.1:0/1381661685 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a1ac9252f0 0x55a1accfe200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:26.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.933+0000 7faca77fe640 1 -- 172.21.15.1:0/1381661685 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a1ac94e1b0 msgr2=0x55a1accf6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:26.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.933+0000 7faca77fe640 1 --2- 172.21.15.1:0/1381661685 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a1ac94e1b0 0x55a1accf6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:26.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.933+0000 7faca77fe640 1 -- 172.21.15.1:0/1381661685 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1accf6870 con 0x55a1ac92d4d0 2024-09-21T00:59:26.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.933+0000 7faca6ffd640 1 --2- 172.21.15.1:0/1381661685 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a1ac9252f0 0x55a1accfe200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:26.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.933+0000 7faca77fe640 1 --2- 172.21.15.1:0/1381661685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1ac92d4d0 0x55a1accf5df0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fac98012810 tx=0x7fac980096e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8660a28e4b5ab5f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:26.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.933+0000 7fac8d7fa640 1 -- 172.21.15.1:0/1381661685 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac98012360 con 0x55a1ac92d4d0 2024-09-21T00:59:26.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.933+0000 7fac8d7fa640 1 -- 172.21.15.1:0/1381661685 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac9800fdd0 con 0x55a1ac92d4d0 2024-09-21T00:59:26.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.933+0000 7fac8d7fa640 1 -- 172.21.15.1:0/1381661685 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac98005030 con 0x55a1ac92d4d0 2024-09-21T00:59:26.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.934+0000 7facb4c58740 1 -- 172.21.15.1:0/1381661685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1ac92d4d0 msgr2=0x55a1accf5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:26.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.934+0000 7facb4c58740 1 --2- 172.21.15.1:0/1381661685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1ac92d4d0 0x55a1accf5df0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fac98012810 tx=0x7fac980096e0 comp rx=0 tx=0).stop 2024-09-21T00:59:26.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.934+0000 7facb4c58740 1 -- 172.21.15.1:0/1381661685 shutdown_connections 2024-09-21T00:59:26.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.934+0000 7facb4c58740 1 --2- 172.21.15.1:0/1381661685 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a1ac94e1b0 0x55a1accf6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:26.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.934+0000 7facb4c58740 1 --2- 172.21.15.1:0/1381661685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1ac92d4d0 0x55a1accf5df0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:26.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.934+0000 7facb4c58740 1 --2- 172.21.15.1:0/1381661685 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a1ac9252f0 0x55a1accfe200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:26.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.934+0000 7facb4c58740 1 -- 172.21.15.1:0/1381661685 >> 172.21.15.1:0/1381661685 conn(0x55a1ac942300 msgr2=0x55a1accfdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:26.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.934+0000 7facb4c58740 1 -- 172.21.15.1:0/1381661685 shutdown_connections 2024-09-21T00:59:26.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.934+0000 7facb4c58740 1 -- 172.21.15.1:0/1381661685 wait complete. 2024-09-21T00:59:26.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.935+0000 7facb4c58740 1 -- start start 2024-09-21T00:59:26.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.935+0000 7facb4c58740 1 Processor -- start 2024-09-21T00:59:26.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.935+0000 7facb4c58740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a1ac9252f0 0x55a1acd02120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:26.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.935+0000 7facb4c58740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1ac92d4d0 0x55a1acd027e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:26.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.935+0000 7facb4c58740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a1ac94e1b0 0x55a1acd03350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:26.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.935+0000 7facb4c58740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faca81ac550 con 0x55a1ac9252f0 2024-09-21T00:59:26.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.935+0000 7facb4c58740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7faca81abe80 con 0x55a1ac92d4d0 2024-09-21T00:59:26.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.935+0000 7facb4c58740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faca81a9000 con 0x55a1ac94e1b0 2024-09-21T00:59:26.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.935+0000 7facb4c58740 10 client.0 _ll_register_callbacks cb 0x7fac98009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.935+0000 7faca6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a1ac9252f0 0x55a1acd02120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.935+0000 7faca6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a1ac9252f0 0x55a1acd02120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42602/0 (socket says 172.21.15.1:42602) 2024-09-21T00:59:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.935+0000 7faca6ffd640 1 -- 172.21.15.1:0/2941451849 learned_addr learned my addr 172.21.15.1:0/2941451849 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.935+0000 7faca77fe640 1 --2- 172.21.15.1:0/2941451849 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1ac92d4d0 0x55a1acd027e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.935+0000 7faca6ffd640 1 --2- 172.21.15.1:0/2941451849 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a1ac94e1b0 0x55a1acd03350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.936+0000 7faca6ffd640 1 -- 172.21.15.1:0/2941451849 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a1ac94e1b0 msgr2=0x55a1acd03350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.936+0000 7faca6ffd640 1 --2- 172.21.15.1:0/2941451849 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a1ac94e1b0 0x55a1acd03350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.936+0000 7faca6ffd640 1 -- 172.21.15.1:0/2941451849 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1ac92d4d0 msgr2=0x55a1acd027e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.936+0000 7faca6ffd640 1 --2- 172.21.15.1:0/2941451849 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1ac92d4d0 0x55a1acd027e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.936+0000 7faca6ffd640 1 -- 172.21.15.1:0/2941451849 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1acd03ab0 con 0x55a1ac9252f0 2024-09-21T00:59:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.936+0000 7faca6ffd640 1 --2- 172.21.15.1:0/2941451849 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a1ac9252f0 0x55a1acd02120 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fac9c009fd0 tx=0x7fac9c0099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c96d8c9148b3cbb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.936+0000 7fac86ffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:59:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.936+0000 7fac86ffd640 1 -- 172.21.15.1:0/2941451849 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac9c0050c0 con 0x55a1ac9252f0 2024-09-21T00:59:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.936+0000 7fac86ffd640 1 -- 172.21.15.1:0/2941451849 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fac9c005260 con 0x55a1ac9252f0 2024-09-21T00:59:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.936+0000 7facb4c58740 1 -- 172.21.15.1:0/2941451849 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac9800fdd0 con 0x55a1ac9252f0 2024-09-21T00:59:26.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.936+0000 7fac86ffd640 1 -- 172.21.15.1:0/2941451849 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fac9c005460 con 0x55a1ac9252f0 2024-09-21T00:59:26.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.936+0000 7facb4c58740 10 client.16227 fetch_fsmap learned FSMap version 31 2024-09-21T00:59:26.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.936+0000 7facb4c58740 1 -- 172.21.15.1:0/2941451849 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a1acd06e40 con 0x55a1ac9252f0 2024-09-21T00:59:26.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.936+0000 7fac86ffd640 1 -- 172.21.15.1:0/2941451849 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac9800fdd0 con 0x55a1ac9252f0 2024-09-21T00:59:26.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.937+0000 7fac86ffd640 1 -- 172.21.15.1:0/2941451849 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7fac9c030040 con 0x55a1ac9252f0 2024-09-21T00:59:26.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.937+0000 7facb4c58740 10 client.16227 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:59:26.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.937+0000 7facb4c58740 10 client.16227 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:26.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.937+0000 7facb4c58740 20 client.16227 populate_metadata read hostname 'smithi001' 2024-09-21T00:59:26.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.937+0000 7facb4c58740 1 --2- 172.21.15.1:0/2941451849 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a1ac8e21c0 0x55a1acd79900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:26.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.937+0000 7facb4c58740 4 client.16227 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T00:59:26.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.937+0000 7facb4c58740 1 -- 172.21.15.1:0/2941451849 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a1acc660f0 con 0x55a1ac8e21c0 2024-09-21T00:59:26.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.937+0000 7faca77fe640 1 --2- 172.21.15.1:0/2941451849 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a1ac8e21c0 0x55a1acd79900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:26.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.937+0000 7faca77fe640 1 --2- 172.21.15.1:0/2941451849 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a1ac8e21c0 0x55a1acd79900 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f6a42ddb4f035e server_cookie=be0702da047f3120 in_seq=0 out_seq=0 2024-09-21T00:59:26.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:26.937+0000 7fac86ffd640 10 client.16227 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:27.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:26 smithi001 ceph-mon[31211]: pgmap v425: 97 pgs: 97 active+clean; 213 MiB data, 657 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 529 op/s 2024-09-21T00:59:27.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:26 smithi193 ceph-mon[34660]: pgmap v425: 97 pgs: 97 active+clean; 213 MiB data, 657 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 529 op/s 2024-09-21T00:59:27.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:26 smithi042 ceph-mon[34481]: pgmap v425: 97 pgs: 97 active+clean; 213 MiB data, 657 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 529 op/s 2024-09-21T00:59:27.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:27.416+0000 7fac86ffd640 1 -- 172.21.15.1:0/2941451849 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a1acc660f0 con 0x55a1ac8e21c0 2024-09-21T00:59:27.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:27.416+0000 7fac86ffd640 10 client.16227 handle_command_reply: tid=0 2024-09-21T00:59:27.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:27.416+0000 7facb4c58740 1 client.16227 shutdown 2024-09-21T00:59:27.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:27.416+0000 7facb4c58740 1 -- 172.21.15.1:0/2941451849 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a1ac9252f0 msgr2=0x55a1acd02120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:27.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:27.416+0000 7facb4c58740 1 --2- 172.21.15.1:0/2941451849 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a1ac9252f0 0x55a1acd02120 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fac9c009fd0 tx=0x7fac9c0099c0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:27.416+0000 7facb4c58740 1 -- 172.21.15.1:0/2941451849 shutdown_connections 2024-09-21T00:59:27.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:27.416+0000 7facb4c58740 1 --2- 172.21.15.1:0/2941451849 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a1ac8e21c0 0x55a1acd79900 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:27.416+0000 7facb4c58740 1 --2- 172.21.15.1:0/2941451849 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a1ac94e1b0 0x55a1acd03350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:27.416+0000 7facb4c58740 1 --2- 172.21.15.1:0/2941451849 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1ac92d4d0 0x55a1acd027e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:27.416+0000 7fac86ffd640 0 client.16227 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:27.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:27.416+0000 7facb4c58740 1 --2- 172.21.15.1:0/2941451849 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a1ac9252f0 0x55a1acd02120 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:27.416+0000 7facb4c58740 1 -- 172.21.15.1:0/2941451849 >> 172.21.15.1:0/2941451849 conn(0x55a1ac942300 msgr2=0x55a1accfdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:27.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:27.416+0000 7facb4c58740 1 -- 172.21.15.1:0/2941451849 shutdown_connections 2024-09-21T00:59:27.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:27.416+0000 7facb4c58740 1 -- 172.21.15.1:0/2941451849 wait complete. 2024-09-21T00:59:27.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:27.417+0000 7facb4c58740 20 client.16227 trim_cache size 0 max 16384 2024-09-21T00:59:27.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T00:59:27.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T00:59:27.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T00:59:27.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T00:59:27.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:27.417+0000 7facadc0e640 1 -- 172.21.15.1:0/1196332783 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fac900b6510 msgr2=0x7fac900b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:27.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:27.417+0000 7facadc0e640 1 --2- 172.21.15.1:0/1196332783 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fac900b6510 0x7fac900b8a20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7faca00ce4d0 tx=0x7faca00ff270 comp rx=0 tx=0).stop 2024-09-21T00:59:27.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:27.417+0000 7facadc0e640 1 -- 172.21.15.1:0/1196332783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faca81050d0 msgr2=0x7faca819b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:27.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:27.417+0000 7facadc0e640 1 --2- 172.21.15.1:0/1196332783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faca81050d0 0x7faca819b110 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7faca0006010 tx=0x7faca0003c20 comp rx=0 tx=0).stop 2024-09-21T00:59:27.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:27.417+0000 7facadc0e640 1 -- 172.21.15.1:0/1196332783 shutdown_connections 2024-09-21T00:59:27.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:27.417+0000 7facadc0e640 1 --2- 172.21.15.1:0/1196332783 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fac900b6510 0x7fac900b8a20 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:27.417+0000 7facadc0e640 1 --2- 172.21.15.1:0/1196332783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faca81050d0 0x7faca819b110 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:27.417+0000 7facadc0e640 1 --2- 172.21.15.1:0/1196332783 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faca8104730 0x7faca819a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:27.417+0000 7facadc0e640 1 --2- 172.21.15.1:0/1196332783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faca81036b0 0x7faca8199ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:27.417+0000 7facadc0e640 1 -- 172.21.15.1:0/1196332783 >> 172.21.15.1:0/1196332783 conn(0x7faca80feff0 msgr2=0x7faca8107a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:27.422 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:27.417+0000 7facadc0e640 1 -- 172.21.15.1:0/1196332783 shutdown_connections 2024-09-21T00:59:27.422 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:27.417+0000 7facadc0e640 1 -- 172.21.15.1:0/1196332783 wait complete. 2024-09-21T00:59:29.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:29 smithi193 ceph-mon[34660]: pgmap v426: 97 pgs: 97 active+clean; 222 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.0 MiB/s wr, 515 op/s 2024-09-21T00:59:29.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:29 smithi042 ceph-mon[34481]: pgmap v426: 97 pgs: 97 active+clean; 222 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.0 MiB/s wr, 515 op/s 2024-09-21T00:59:29.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:29 smithi001 ceph-mon[31211]: pgmap v426: 97 pgs: 97 active+clean; 222 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.0 MiB/s wr, 515 op/s 2024-09-21T00:59:31.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:31 smithi193 ceph-mon[34660]: pgmap v427: 97 pgs: 97 active+clean; 228 MiB data, 697 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 411 op/s 2024-09-21T00:59:31.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:31 smithi042 ceph-mon[34481]: pgmap v427: 97 pgs: 97 active+clean; 228 MiB data, 697 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 411 op/s 2024-09-21T00:59:31.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:31 smithi001 ceph-mon[31211]: pgmap v427: 97 pgs: 97 active+clean; 228 MiB data, 697 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 411 op/s 2024-09-21T00:59:33.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:33 smithi193 ceph-mon[34660]: pgmap v428: 97 pgs: 97 active+clean; 236 MiB data, 730 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.6 MiB/s wr, 402 op/s 2024-09-21T00:59:33.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:33 smithi042 ceph-mon[34481]: pgmap v428: 97 pgs: 97 active+clean; 236 MiB data, 730 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.6 MiB/s wr, 402 op/s 2024-09-21T00:59:33.557 INFO:tasks.workunit.client.0.smithi001.stdout: 54 18191 101 11369 43 10985 217 2024-09-21T00:59:33.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:33 smithi001 ceph-mon[31211]: pgmap v428: 97 pgs: 97 active+clean; 236 MiB data, 730 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.6 MiB/s wr, 402 op/s 2024-09-21T00:59:35.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:35 smithi042 ceph-mon[34481]: pgmap v429: 97 pgs: 97 active+clean; 244 MiB data, 738 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.7 MiB/s wr, 281 op/s 2024-09-21T00:59:35.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:35 smithi001 ceph-mon[31211]: pgmap v429: 97 pgs: 97 active+clean; 244 MiB data, 738 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.7 MiB/s wr, 281 op/s 2024-09-21T00:59:35.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:35 smithi193 ceph-mon[34660]: pgmap v429: 97 pgs: 97 active+clean; 244 MiB data, 738 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.7 MiB/s wr, 281 op/s 2024-09-21T00:59:37.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:37 smithi042 ceph-mon[34481]: pgmap v430: 97 pgs: 97 active+clean; 245 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.7 MiB/s wr, 289 op/s 2024-09-21T00:59:37.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:37 smithi001 ceph-mon[31211]: pgmap v430: 97 pgs: 97 active+clean; 245 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.7 MiB/s wr, 289 op/s 2024-09-21T00:59:37.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:37 smithi193 ceph-mon[34660]: pgmap v430: 97 pgs: 97 active+clean; 245 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.7 MiB/s wr, 289 op/s 2024-09-21T00:59:38.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:38 smithi042 ceph-mon[34481]: scrub summary: idle 2024-09-21T00:59:38.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:38 smithi001 ceph-mon[31211]: scrub summary: idle 2024-09-21T00:59:38.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:38 smithi193 ceph-mon[34660]: scrub summary: idle 2024-09-21T00:59:39.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:39 smithi042 ceph-mon[34481]: scrub summary: idle 2024-09-21T00:59:39.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:39 smithi042 ceph-mon[34481]: scrub summary: idle 2024-09-21T00:59:39.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:39 smithi042 ceph-mon[34481]: scrub summary: idle 2024-09-21T00:59:39.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:39 smithi042 ceph-mon[34481]: scrub summary: idle 2024-09-21T00:59:39.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:39 smithi042 ceph-mon[34481]: pgmap v431: 97 pgs: 97 active+clean; 251 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.7 MiB/s wr, 286 op/s 2024-09-21T00:59:39.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:39 smithi001 ceph-mon[31211]: scrub summary: idle 2024-09-21T00:59:39.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:39 smithi001 ceph-mon[31211]: scrub summary: idle 2024-09-21T00:59:39.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:39 smithi001 ceph-mon[31211]: scrub summary: idle 2024-09-21T00:59:39.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:39 smithi001 ceph-mon[31211]: scrub summary: idle 2024-09-21T00:59:39.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:39 smithi001 ceph-mon[31211]: pgmap v431: 97 pgs: 97 active+clean; 251 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.7 MiB/s wr, 286 op/s 2024-09-21T00:59:39.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:39 smithi193 ceph-mon[34660]: scrub summary: idle 2024-09-21T00:59:39.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:39 smithi193 ceph-mon[34660]: scrub summary: idle 2024-09-21T00:59:39.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:39 smithi193 ceph-mon[34660]: scrub summary: idle 2024-09-21T00:59:39.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:39 smithi193 ceph-mon[34660]: scrub summary: idle 2024-09-21T00:59:39.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:39 smithi193 ceph-mon[34660]: pgmap v431: 97 pgs: 97 active+clean; 251 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.7 MiB/s wr, 286 op/s 2024-09-21T00:59:40.210 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T00:59:40.625 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:59:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.628+0000 7fc6bf790640 1 -- 172.21.15.1:0/4077612627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6b8109450 msgr2=0x7fc6b810b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.628+0000 7fc6bf790640 1 --2- 172.21.15.1:0/4077612627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6b8109450 0x7fc6b810b8f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0009900 tx=0x7fc6b002a410 comp rx=0 tx=0).stop 2024-09-21T00:59:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.628+0000 7fc6bf790640 1 -- 172.21.15.1:0/4077612627 shutdown_connections 2024-09-21T00:59:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.628+0000 7fc6bf790640 1 --2- 172.21.15.1:0/4077612627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6b8109450 0x7fc6b810b8f0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.628+0000 7fc6bf790640 1 --2- 172.21.15.1:0/4077612627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6b8106af0 0x7fc6b8108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.628+0000 7fc6bf790640 1 --2- 172.21.15.1:0/4077612627 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc6b8101a60 0x7fc6b8101e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.628+0000 7fc6bf790640 1 -- 172.21.15.1:0/4077612627 >> 172.21.15.1:0/4077612627 conn(0x7fc6b80fd660 msgr2=0x7fc6b80ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.628+0000 7fc6bf790640 1 -- 172.21.15.1:0/4077612627 shutdown_connections 2024-09-21T00:59:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.628+0000 7fc6bf790640 1 -- 172.21.15.1:0/4077612627 wait complete. 2024-09-21T00:59:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.629+0000 7fc6bf790640 1 Processor -- start 2024-09-21T00:59:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.629+0000 7fc6bf790640 1 -- start start 2024-09-21T00:59:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.630+0000 7fc6bf790640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc6b8101a60 0x7fc6b8199ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.630+0000 7fc6bf790640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6b8106af0 0x7fc6b819a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.630+0000 7fc6bf790640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6b8109450 0x7fc6b819b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.630+0000 7fc6bf790640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b810f320 con 0x7fc6b8106af0 2024-09-21T00:59:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.630+0000 7fc6bf790640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b810f1a0 con 0x7fc6b8109450 2024-09-21T00:59:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.630+0000 7fc6bf790640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b810f4a0 con 0x7fc6b8101a60 2024-09-21T00:59:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.630+0000 7fc6bd52c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc6b8101a60 0x7fc6b8199ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.630+0000 7fc6bcd2b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6b8106af0 0x7fc6b819a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.630+0000 7fc6bd52c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc6b8101a60 0x7fc6b8199ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:36190/0 (socket says 172.21.15.1:36190) 2024-09-21T00:59:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.630+0000 7fc6bd52c640 1 -- 172.21.15.1:0/1693182528 learned_addr learned my addr 172.21.15.1:0/1693182528 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.630+0000 7fc6bdd2d640 1 --2- 172.21.15.1:0/1693182528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6b8109450 0x7fc6b819b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.630+0000 7fc6bd52c640 1 -- 172.21.15.1:0/1693182528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6b8109450 msgr2=0x7fc6b819b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.630+0000 7fc6bd52c640 1 --2- 172.21.15.1:0/1693182528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6b8109450 0x7fc6b819b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.630+0000 7fc6bd52c640 1 -- 172.21.15.1:0/1693182528 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6b8106af0 msgr2=0x7fc6b819a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.630+0000 7fc6bd52c640 1 --2- 172.21.15.1:0/1693182528 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6b8106af0 0x7fc6b819a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.630+0000 7fc6bd52c640 1 -- 172.21.15.1:0/1693182528 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b819b920 con 0x7fc6b8101a60 2024-09-21T00:59:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.630+0000 7fc6bdd2d640 1 --2- 172.21.15.1:0/1693182528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6b8109450 0x7fc6b819b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:59:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.631+0000 7fc6bd52c640 1 --2- 172.21.15.1:0/1693182528 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc6b8101a60 0x7fc6b8199ee0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc6a800ebc0 tx=0x7fc6a800c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.631+0000 7fc6b67fc640 1 -- 172.21.15.1:0/1693182528 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a8010630 con 0x7fc6b8101a60 2024-09-21T00:59:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.631+0000 7fc6b67fc640 1 -- 172.21.15.1:0/1693182528 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6a8010c80 con 0x7fc6b8101a60 2024-09-21T00:59:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.631+0000 7fc6bf790640 1 -- 172.21.15.1:0/1693182528 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6b819bc10 con 0x7fc6b8101a60 2024-09-21T00:59:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.631+0000 7fc6b67fc640 1 -- 172.21.15.1:0/1693182528 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a8018b60 con 0x7fc6b8101a60 2024-09-21T00:59:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.631+0000 7fc6bf790640 1 -- 172.21.15.1:0/1693182528 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6b81a2300 con 0x7fc6b8101a60 2024-09-21T00:59:40.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.634+0000 7fc6b67fc640 1 -- 172.21.15.1:0/1693182528 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7fc6a8018d00 con 0x7fc6b8101a60 2024-09-21T00:59:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.635+0000 7fc6c67df740 1 Processor -- start 2024-09-21T00:59:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.635+0000 7fc6c67df740 1 -- start start 2024-09-21T00:59:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.636+0000 7fc6c67df740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0f94f01b0 0x55d0f9897e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.636+0000 7fc6c67df740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0f94c72f0 0x55d0f98984c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.636+0000 7fc6b67fc640 1 --2- 172.21.15.1:0/1693182528 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc6a00b6510 0x7fc6a00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.636+0000 7fc6c67df740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0f94cf4d0 0x55d0f9899010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.636+0000 7fc6c67df740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d0f980a6f0 con 0x55d0f94cf4d0 2024-09-21T00:59:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.636+0000 7fc6c67df740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d0f97f9b20 con 0x55d0f94f01b0 2024-09-21T00:59:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.636+0000 7fc6c67df740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d0f97fd930 con 0x55d0f94c72f0 2024-09-21T00:59:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.636+0000 7fc6bdd2d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0f94f01b0 0x55d0f9897e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.636+0000 7fc6bcd2b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0f94c72f0 0x55d0f98984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.636+0000 7fc6bcd2b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0f94c72f0 0x55d0f98984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:36206/0 (socket says 172.21.15.1:36206) 2024-09-21T00:59:40.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.636+0000 7fc6bcd2b640 1 -- 172.21.15.1:0/1213972029 learned_addr learned my addr 172.21.15.1:0/1213972029 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:40.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.636+0000 7fc6bdd2d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0f94f01b0 0x55d0f9897e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:36698/0 (socket says 172.21.15.1:36698) 2024-09-21T00:59:40.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.636+0000 7fc6bd52c640 1 --2- 172.21.15.1:0/1693182528 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc6a00b6510 0x7fc6a00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:40.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.636+0000 7fc6bdd2d640 1 --2- 172.21.15.1:0/1213972029 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0f94cf4d0 0x55d0f9899010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:40.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.636+0000 7fc6b67fc640 1 -- 172.21.15.1:0/1693182528 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fc6a80e79a0 con 0x7fc6b8101a60 2024-09-21T00:59:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.637+0000 7fc6bcd2b640 1 -- 172.21.15.1:0/1213972029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0f94f01b0 msgr2=0x55d0f9897e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.637+0000 7fc6bcd2b640 1 --2- 172.21.15.1:0/1213972029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0f94f01b0 0x55d0f9897e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.637+0000 7fc6bcd2b640 1 -- 172.21.15.1:0/1213972029 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0f94cf4d0 msgr2=0x55d0f9899010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.637+0000 7fc6bcd2b640 1 --2- 172.21.15.1:0/1213972029 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0f94cf4d0 0x55d0f9899010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.637+0000 7fc6bcd2b640 1 -- 172.21.15.1:0/1213972029 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0f97bf530 con 0x55d0f94c72f0 2024-09-21T00:59:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.637+0000 7fc6bdd2d640 1 --2- 172.21.15.1:0/1213972029 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0f94cf4d0 0x55d0f9899010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:59:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.637+0000 7fc6bd52c640 1 --2- 172.21.15.1:0/1693182528 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc6a00b6510 0x7fc6a00b8a20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc6a800cba0 tx=0x7fc6a806cbc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.637+0000 7fc6bcd2b640 1 --2- 172.21.15.1:0/1213972029 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0f94c72f0 0x55d0f98984c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac009cf0 tx=0x7fc6ac011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=753211937f794f98 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.637+0000 7fc69f7fe640 1 -- 172.21.15.1:0/1213972029 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac004230 con 0x55d0f94c72f0 2024-09-21T00:59:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.637+0000 7fc69f7fe640 1 -- 172.21.15.1:0/1213972029 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6ac0043d0 con 0x55d0f94c72f0 2024-09-21T00:59:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.637+0000 7fc69f7fe640 1 -- 172.21.15.1:0/1213972029 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac019880 con 0x55d0f94c72f0 2024-09-21T00:59:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.638+0000 7fc6c67df740 1 -- 172.21.15.1:0/1213972029 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0f94c72f0 msgr2=0x55d0f98984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.638+0000 7fc6c67df740 1 --2- 172.21.15.1:0/1213972029 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0f94c72f0 0x55d0f98984c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac009cf0 tx=0x7fc6ac011810 comp rx=0 tx=0).stop 2024-09-21T00:59:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.638+0000 7fc6c67df740 1 -- 172.21.15.1:0/1213972029 shutdown_connections 2024-09-21T00:59:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.638+0000 7fc6c67df740 1 --2- 172.21.15.1:0/1213972029 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0f94cf4d0 0x55d0f9899010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.638+0000 7fc6c67df740 1 --2- 172.21.15.1:0/1213972029 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0f94c72f0 0x55d0f98984c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.638+0000 7fc6c67df740 1 --2- 172.21.15.1:0/1213972029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0f94f01b0 0x55d0f9897e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.638+0000 7fc6c67df740 1 -- 172.21.15.1:0/1213972029 >> 172.21.15.1:0/1213972029 conn(0x55d0f94e4300 msgr2=0x55d0f98938e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.638+0000 7fc6c67df740 1 -- 172.21.15.1:0/1213972029 shutdown_connections 2024-09-21T00:59:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.638+0000 7fc6c67df740 1 -- 172.21.15.1:0/1213972029 wait complete. 2024-09-21T00:59:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.639+0000 7fc6c67df740 1 -- start start 2024-09-21T00:59:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.639+0000 7fc6c67df740 1 Processor -- start 2024-09-21T00:59:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.639+0000 7fc6c67df740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0f94c72f0 0x55d0f98a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.639+0000 7fc6c67df740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0f94cf4d0 0x55d0f98a1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.639+0000 7fc6c67df740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0f94f01b0 0x55d0f98a27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.639+0000 7fc6c67df740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d0f9731ab0 con 0x55d0f94cf4d0 2024-09-21T00:59:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.639+0000 7fc6c67df740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d0f979f730 con 0x55d0f94f01b0 2024-09-21T00:59:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.639+0000 7fc6c67df740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d0f9899b30 con 0x55d0f94c72f0 2024-09-21T00:59:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.640+0000 7fc6c67df740 10 client.0 _ll_register_callbacks cb 0x55d0f97f36b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.640+0000 7fc6bdd2d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0f94c72f0 0x55d0f98a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.640+0000 7fc6bcd2b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0f94cf4d0 0x55d0f98a1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.640+0000 7fc6bcd2b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0f94cf4d0 0x55d0f98a1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42492/0 (socket says 172.21.15.1:42492) 2024-09-21T00:59:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.640+0000 7fc6bdd2d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0f94c72f0 0x55d0f98a15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:36220/0 (socket says 172.21.15.1:36220) 2024-09-21T00:59:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.640+0000 7fc6bcd2b640 1 -- 172.21.15.1:0/2856747272 learned_addr learned my addr 172.21.15.1:0/2856747272 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:40.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.640+0000 7fc6bdd2d640 1 --2- 172.21.15.1:0/2856747272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0f94f01b0 0x55d0f98a27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:40.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.640+0000 7fc6bcd2b640 1 -- 172.21.15.1:0/2856747272 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0f94c72f0 msgr2=0x55d0f98a15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:40.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.640+0000 7fc6bcd2b640 1 --2- 172.21.15.1:0/2856747272 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0f94c72f0 0x55d0f98a15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.640+0000 7fc6bcd2b640 1 -- 172.21.15.1:0/2856747272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0f94f01b0 msgr2=0x55d0f98a27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:40.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.640+0000 7fc6bcd2b640 1 --2- 172.21.15.1:0/2856747272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0f94f01b0 0x55d0f98a27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.640+0000 7fc6bcd2b640 1 -- 172.21.15.1:0/2856747272 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0f955b790 con 0x55d0f94cf4d0 2024-09-21T00:59:40.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.640+0000 7fc6bdd2d640 1 --2- 172.21.15.1:0/2856747272 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0f94c72f0 0x55d0f98a15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:40.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.640+0000 7fc6bcd2b640 1 --2- 172.21.15.1:0/2856747272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0f94cf4d0 0x55d0f98a1c70 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac000c00 tx=0x7fc6ac003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d44b3b11dd0257c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:40.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.640+0000 7fc69cff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:59:40.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.641+0000 7fc69cff9640 1 -- 172.21.15.1:0/2856747272 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac027070 con 0x55d0f94cf4d0 2024-09-21T00:59:40.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.641+0000 7fc69cff9640 1 -- 172.21.15.1:0/2856747272 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fc6ac005240 con 0x55d0f94cf4d0 2024-09-21T00:59:40.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.641+0000 7fc6c67df740 1 -- 172.21.15.1:0/2856747272 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6ac0043d0 con 0x55d0f94cf4d0 2024-09-21T00:59:40.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.641+0000 7fc69cff9640 1 -- 172.21.15.1:0/2856747272 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fc6ac009910 con 0x55d0f94cf4d0 2024-09-21T00:59:40.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.641+0000 7fc6c67df740 10 client.16239 fetch_fsmap learned FSMap version 31 2024-09-21T00:59:40.646 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.641+0000 7fc6c67df740 1 -- 172.21.15.1:0/2856747272 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d0f95d4620 con 0x55d0f94cf4d0 2024-09-21T00:59:40.646 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.641+0000 7fc69cff9640 1 -- 172.21.15.1:0/2856747272 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6ac0043d0 con 0x55d0f94cf4d0 2024-09-21T00:59:40.646 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.642+0000 7fc69cff9640 1 -- 172.21.15.1:0/2856747272 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7fc6ac0195c0 con 0x55d0f94cf4d0 2024-09-21T00:59:40.646 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.642+0000 7fc6c67df740 10 client.16239 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:59:40.646 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.642+0000 7fc6c67df740 10 client.16239 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:40.646 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.642+0000 7fc6c67df740 20 client.16239 populate_metadata read hostname 'smithi001' 2024-09-21T00:59:40.646 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.642+0000 7fc6c67df740 1 --2- 172.21.15.1:0/2856747272 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d0f94aed80 0x55d0f98aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:40.646 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.642+0000 7fc6c67df740 4 client.16239 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:59:40.646 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.642+0000 7fc6c67df740 1 -- 172.21.15.1:0/2856747272 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0f980c640 con 0x55d0f94aed80 2024-09-21T00:59:40.646 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.642+0000 7fc6bdd2d640 1 --2- 172.21.15.1:0/2856747272 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d0f94aed80 0x55d0f98aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:40.646 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.643+0000 7fc69cff9640 10 client.16239 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:40.646 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.643+0000 7fc6bdd2d640 1 --2- 172.21.15.1:0/2856747272 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d0f94aed80 0x55d0f98aebb0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2011890f3e34ef87 server_cookie=a62686f23e338f92 in_seq=0 out_seq=0 2024-09-21T00:59:40.647 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.645+0000 7fc69cff9640 1 -- 172.21.15.1:0/2856747272 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d0f980c640 con 0x55d0f94aed80 2024-09-21T00:59:40.647 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.645+0000 7fc69cff9640 10 client.16239 handle_command_reply: tid=0 2024-09-21T00:59:40.647 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.645+0000 7fc6c67df740 1 client.16239 shutdown 2024-09-21T00:59:40.647 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.647+0000 7fc6c67df740 1 -- 172.21.15.1:0/2856747272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0f94cf4d0 msgr2=0x55d0f98a1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:40.647 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.647+0000 7fc6c67df740 1 --2- 172.21.15.1:0/2856747272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0f94cf4d0 0x55d0f98a1c70 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac000c00 tx=0x7fc6ac003820 comp rx=0 tx=0).stop 2024-09-21T00:59:40.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.648+0000 7fc6c67df740 1 -- 172.21.15.1:0/2856747272 shutdown_connections 2024-09-21T00:59:40.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.648+0000 7fc6c67df740 1 --2- 172.21.15.1:0/2856747272 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d0f94aed80 0x55d0f98aebb0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.648+0000 7fc6c67df740 1 --2- 172.21.15.1:0/2856747272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0f94f01b0 0x55d0f98a27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.649 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.648+0000 7fc6c67df740 1 --2- 172.21.15.1:0/2856747272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0f94cf4d0 0x55d0f98a1c70 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.649 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.648+0000 7fc6c67df740 1 --2- 172.21.15.1:0/2856747272 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0f94c72f0 0x55d0f98a15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.649 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.648+0000 7fc6c67df740 1 -- 172.21.15.1:0/2856747272 >> 172.21.15.1:0/2856747272 conn(0x55d0f94e4300 msgr2=0x55d0f9891ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:40.649 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.648+0000 7fc69cff9640 0 client.16239 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:40.649 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.648+0000 7fc6c67df740 1 -- 172.21.15.1:0/2856747272 shutdown_connections 2024-09-21T00:59:40.649 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.648+0000 7fc6c67df740 1 -- 172.21.15.1:0/2856747272 wait complete. 2024-09-21T00:59:40.649 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.648+0000 7fc6c67df740 20 client.16239 trim_cache size 0 max 16384 2024-09-21T00:59:40.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.682+0000 7fc6c67df740 1 Processor -- start 2024-09-21T00:59:40.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.682+0000 7fc6c67df740 1 -- start start 2024-09-21T00:59:40.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.683+0000 7fc6c67df740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0f94c72f0 0x55d0f989fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:40.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.683+0000 7fc6c67df740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0f94cf4d0 0x55d0f98a0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:40.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.683+0000 7fc6bdd2d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0f94c72f0 0x55d0f989fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:40.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.683+0000 7fc6bdd2d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0f94c72f0 0x55d0f989fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42500/0 (socket says 172.21.15.1:42500) 2024-09-21T00:59:40.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.683+0000 7fc6bdd2d640 1 -- 172.21.15.1:0/3436199256 learned_addr learned my addr 172.21.15.1:0/3436199256 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:40.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.683+0000 7fc6c67df740 1 --2- 172.21.15.1:0/3436199256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0f94f01b0 0x55d0f98a27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:40.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.683+0000 7fc6c67df740 1 -- 172.21.15.1:0/3436199256 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b81ab020 con 0x55d0f94c72f0 2024-09-21T00:59:40.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.683+0000 7fc6c67df740 1 -- 172.21.15.1:0/3436199256 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b81acce0 con 0x55d0f94f01b0 2024-09-21T00:59:40.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.683+0000 7fc6c67df740 1 -- 172.21.15.1:0/3436199256 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b81ab6f0 con 0x55d0f94cf4d0 2024-09-21T00:59:40.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.683+0000 7fc6bcd2b640 1 --2- 172.21.15.1:0/3436199256 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0f94cf4d0 0x55d0f98a0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:40.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.684+0000 7fc6bcd2b640 1 -- 172.21.15.1:0/3436199256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0f94f01b0 msgr2=0x55d0f98a27e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T00:59:40.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.684+0000 7fc6bcd2b640 1 --2- 172.21.15.1:0/3436199256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0f94f01b0 0x55d0f98a27e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.684+0000 7fc6bcd2b640 1 -- 172.21.15.1:0/3436199256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0f94c72f0 msgr2=0x55d0f989fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:40.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.684+0000 7fc6bcd2b640 1 --2- 172.21.15.1:0/3436199256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0f94c72f0 0x55d0f989fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.684+0000 7fc6bcd2b640 1 -- 172.21.15.1:0/3436199256 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0f98a1340 con 0x55d0f94cf4d0 2024-09-21T00:59:40.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.684+0000 7fc6bdd2d640 1 --2- 172.21.15.1:0/3436199256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0f94c72f0 0x55d0f989fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:40.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.684+0000 7fc6bcd2b640 1 --2- 172.21.15.1:0/3436199256 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0f94cf4d0 0x55d0f98a0000 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac014040 tx=0x7fc6ac005b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f47af2f915e373e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:40.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.684+0000 7fc69effd640 1 -- 172.21.15.1:0/3436199256 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac027070 con 0x55d0f94cf4d0 2024-09-21T00:59:40.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.685+0000 7fc69effd640 1 -- 172.21.15.1:0/3436199256 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6ac0042c0 con 0x55d0f94cf4d0 2024-09-21T00:59:40.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.685+0000 7fc69effd640 1 -- 172.21.15.1:0/3436199256 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac033030 con 0x55d0f94cf4d0 2024-09-21T00:59:40.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.686+0000 7fc6c67df740 1 -- 172.21.15.1:0/3436199256 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0f94cf4d0 msgr2=0x55d0f98a0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:40.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.686+0000 7fc6c67df740 1 --2- 172.21.15.1:0/3436199256 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0f94cf4d0 0x55d0f98a0000 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac014040 tx=0x7fc6ac005b90 comp rx=0 tx=0).stop 2024-09-21T00:59:40.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.686+0000 7fc6c67df740 1 -- 172.21.15.1:0/3436199256 shutdown_connections 2024-09-21T00:59:40.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.686+0000 7fc6c67df740 1 --2- 172.21.15.1:0/3436199256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0f94f01b0 0x55d0f98a27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.686+0000 7fc6c67df740 1 --2- 172.21.15.1:0/3436199256 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0f94cf4d0 0x55d0f98a0000 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.686+0000 7fc6c67df740 1 --2- 172.21.15.1:0/3436199256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0f94c72f0 0x55d0f989fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.686+0000 7fc6c67df740 1 -- 172.21.15.1:0/3436199256 >> 172.21.15.1:0/3436199256 conn(0x55d0f94e4300 msgr2=0x55d0f98a15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:40.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.686+0000 7fc6c67df740 1 -- 172.21.15.1:0/3436199256 shutdown_connections 2024-09-21T00:59:40.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.686+0000 7fc6c67df740 1 -- 172.21.15.1:0/3436199256 wait complete. 2024-09-21T00:59:40.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.686+0000 7fc6c67df740 1 -- start start 2024-09-21T00:59:40.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.686+0000 7fc6c67df740 1 Processor -- start 2024-09-21T00:59:40.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.687+0000 7fc6c67df740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0f94c72f0 0x55d0f98a8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:40.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.687+0000 7fc6c67df740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0f94cf4d0 0x55d0f98a7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:40.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.687+0000 7fc6c67df740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0f94f01b0 0x55d0f98a7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:40.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.687+0000 7fc6c67df740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b81ac550 con 0x55d0f94f01b0 2024-09-21T00:59:40.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.687+0000 7fc6c67df740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b81abe80 con 0x55d0f94c72f0 2024-09-21T00:59:40.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.687+0000 7fc6c67df740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b81a9000 con 0x55d0f94cf4d0 2024-09-21T00:59:40.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.687+0000 7fc6c67df740 10 client.0 _ll_register_callbacks cb 0x7fc6ac009b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:40.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.687+0000 7fc6bdd2d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0f94c72f0 0x55d0f98a8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:40.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.687+0000 7fc6bcd2b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0f94cf4d0 0x55d0f98a7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:40.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.687+0000 7fc6bdd2d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0f94c72f0 0x55d0f98a8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:36720/0 (socket says 172.21.15.1:36720) 2024-09-21T00:59:40.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.687+0000 7fc6bdd2d640 1 -- 172.21.15.1:0/2616858150 learned_addr learned my addr 172.21.15.1:0/2616858150 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:40.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.687+0000 7fc6bdd2d640 1 --2- 172.21.15.1:0/2616858150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0f94f01b0 0x55d0f98a7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:40.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.688+0000 7fc6bcd2b640 1 -- 172.21.15.1:0/2616858150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0f94c72f0 msgr2=0x55d0f98a8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:40.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.688+0000 7fc6bcd2b640 1 --2- 172.21.15.1:0/2616858150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0f94c72f0 0x55d0f98a8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.688+0000 7fc6bcd2b640 1 -- 172.21.15.1:0/2616858150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0f94f01b0 msgr2=0x55d0f98a7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:40.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.688+0000 7fc6bcd2b640 1 --2- 172.21.15.1:0/2616858150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0f94f01b0 0x55d0f98a7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.688+0000 7fc6bcd2b640 1 -- 172.21.15.1:0/2616858150 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0f98a82b0 con 0x55d0f94cf4d0 2024-09-21T00:59:40.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.688+0000 7fc6bdd2d640 1 --2- 172.21.15.1:0/2616858150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0f94c72f0 0x55d0f98a8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:40.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.688+0000 7fc6bcd2b640 1 --2- 172.21.15.1:0/2616858150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0f94cf4d0 0x55d0f98a7830 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac019e80 tx=0x7fc6ac012f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0798c97b617f318 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:40.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.688+0000 7fc69cff9640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T00:59:40.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.688+0000 7fc69cff9640 1 -- 172.21.15.1:0/2616858150 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac03d070 con 0x55d0f94cf4d0 2024-09-21T00:59:40.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.688+0000 7fc69cff9640 1 -- 172.21.15.1:0/2616858150 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fc6ac038470 con 0x55d0f94cf4d0 2024-09-21T00:59:40.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.688+0000 7fc6c67df740 1 -- 172.21.15.1:0/2616858150 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6ac0042c0 con 0x55d0f94cf4d0 2024-09-21T00:59:40.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.689+0000 7fc69cff9640 1 -- 172.21.15.1:0/2616858150 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fc6ac033070 con 0x55d0f94cf4d0 2024-09-21T00:59:40.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.689+0000 7fc6c67df740 10 client.25834 fetch_fsmap learned FSMap version 31 2024-09-21T00:59:40.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.689+0000 7fc6c67df740 1 -- 172.21.15.1:0/2616858150 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d0f98a6fe0 con 0x55d0f94cf4d0 2024-09-21T00:59:40.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.689+0000 7fc69cff9640 1 -- 172.21.15.1:0/2616858150 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6ac0042c0 con 0x55d0f94cf4d0 2024-09-21T00:59:40.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.689+0000 7fc69cff9640 1 -- 172.21.15.1:0/2616858150 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7fc6ac040030 con 0x55d0f94cf4d0 2024-09-21T00:59:40.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.689+0000 7fc6c67df740 10 client.25834 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:59:40.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.689+0000 7fc6c67df740 10 client.25834 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:40.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.689+0000 7fc6c67df740 20 client.25834 populate_metadata read hostname 'smithi001' 2024-09-21T00:59:40.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.689+0000 7fc6c67df740 1 --2- 172.21.15.1:0/2616858150 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d0f94841c0 0x55d0f991bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:40.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.689+0000 7fc6c67df740 4 client.25834 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T00:59:40.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.689+0000 7fc6c67df740 1 -- 172.21.15.1:0/2616858150 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d0f98080f0 con 0x55d0f94841c0 2024-09-21T00:59:40.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.689+0000 7fc6bdd2d640 1 --2- 172.21.15.1:0/2616858150 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d0f94841c0 0x55d0f991bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:40.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.690+0000 7fc69cff9640 10 client.25834 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:40.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:40.690+0000 7fc6bdd2d640 1 --2- 172.21.15.1:0/2616858150 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d0f94841c0 0x55d0f991bbf0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=565a6d13bbf622f5 server_cookie=f0baff2a46a44ada in_seq=0 out_seq=0 2024-09-21T00:59:41.165 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:41.164+0000 7fc69cff9640 1 -- 172.21.15.1:0/2616858150 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d0f98080f0 con 0x55d0f94841c0 2024-09-21T00:59:41.165 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:41.164+0000 7fc69cff9640 10 client.25834 handle_command_reply: tid=0 2024-09-21T00:59:41.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:41.164+0000 7fc6c67df740 1 client.25834 shutdown 2024-09-21T00:59:41.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:41.164+0000 7fc6c67df740 1 -- 172.21.15.1:0/2616858150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0f94cf4d0 msgr2=0x55d0f98a7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:41.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:41.164+0000 7fc6c67df740 1 --2- 172.21.15.1:0/2616858150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0f94cf4d0 0x55d0f98a7830 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac019e80 tx=0x7fc6ac012f30 comp rx=0 tx=0).stop 2024-09-21T00:59:41.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:41.165+0000 7fc6c67df740 1 -- 172.21.15.1:0/2616858150 shutdown_connections 2024-09-21T00:59:41.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:41.165+0000 7fc6c67df740 1 --2- 172.21.15.1:0/2616858150 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d0f94841c0 0x55d0f991bbf0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:41.165+0000 7fc6c67df740 1 --2- 172.21.15.1:0/2616858150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0f94f01b0 0x55d0f98a7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:41.165+0000 7fc6c67df740 1 --2- 172.21.15.1:0/2616858150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0f94cf4d0 0x55d0f98a7830 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:41.165+0000 7fc6c67df740 1 --2- 172.21.15.1:0/2616858150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d0f94c72f0 0x55d0f98a8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:41.165+0000 7fc6c67df740 1 -- 172.21.15.1:0/2616858150 >> 172.21.15.1:0/2616858150 conn(0x55d0f94e4300 msgr2=0x55d0f989bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:41.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:41.165+0000 7fc69cff9640 0 client.25834 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:41.167 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:41.165+0000 7fc6c67df740 1 -- 172.21.15.1:0/2616858150 shutdown_connections 2024-09-21T00:59:41.167 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:41.165+0000 7fc6c67df740 1 -- 172.21.15.1:0/2616858150 wait complete. 2024-09-21T00:59:41.168 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:41.166+0000 7fc6c67df740 20 client.25834 trim_cache size 0 max 16384 2024-09-21T00:59:41.168 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T00:59:41.168 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T00:59:41.168 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T00:59:41.168 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T00:59:41.169 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:41.166+0000 7fc6bf790640 1 -- 172.21.15.1:0/1693182528 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc6a00b6510 msgr2=0x7fc6a00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:41.169 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:41.166+0000 7fc6bf790640 1 --2- 172.21.15.1:0/1693182528 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc6a00b6510 0x7fc6a00b8a20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc6a800cba0 tx=0x7fc6a806cbc0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:41.167+0000 7fc6bf790640 1 -- 172.21.15.1:0/1693182528 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc6b8101a60 msgr2=0x7fc6b8199ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:41.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:41.167+0000 7fc6bf790640 1 --2- 172.21.15.1:0/1693182528 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc6b8101a60 0x7fc6b8199ee0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc6a800ebc0 tx=0x7fc6a800c6a0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:41.167+0000 7fc6bf790640 1 -- 172.21.15.1:0/1693182528 shutdown_connections 2024-09-21T00:59:41.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:41.167+0000 7fc6bf790640 1 --2- 172.21.15.1:0/1693182528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6b8109450 0x7fc6b819b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:41.167+0000 7fc6bf790640 1 --2- 172.21.15.1:0/1693182528 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc6a00b6510 0x7fc6a00b8a20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:41.167+0000 7fc6bf790640 1 --2- 172.21.15.1:0/1693182528 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6b8106af0 0x7fc6b819a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:41.167+0000 7fc6bf790640 1 --2- 172.21.15.1:0/1693182528 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc6b8101a60 0x7fc6b8199ee0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:41.167+0000 7fc6bf790640 1 -- 172.21.15.1:0/1693182528 >> 172.21.15.1:0/1693182528 conn(0x7fc6b80fd660 msgr2=0x7fc6b81078c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:41.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:41.167+0000 7fc6bf790640 1 -- 172.21.15.1:0/1693182528 shutdown_connections 2024-09-21T00:59:41.171 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:41.167+0000 7fc6bf790640 1 -- 172.21.15.1:0/1693182528 wait complete. 2024-09-21T00:59:41.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.202+0000 7f4a438f5640 1 -- 172.21.15.1:0/3743310319 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a3c1094d0 msgr2=0x7f4a3c1098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:41.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.202+0000 7f4a438f5640 1 --2- 172.21.15.1:0/3743310319 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a3c1094d0 0x7f4a3c1098e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c009900 tx=0x7f4a2c02a410 comp rx=0 tx=0).stop 2024-09-21T00:59:41.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.202+0000 7f4a438f5640 1 -- 172.21.15.1:0/3743310319 shutdown_connections 2024-09-21T00:59:41.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.202+0000 7f4a438f5640 1 --2- 172.21.15.1:0/3743310319 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4a3c109e20 0x7f4a3c110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.202+0000 7f4a438f5640 1 --2- 172.21.15.1:0/3743310319 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a3c1094d0 0x7f4a3c1098e0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.202+0000 7f4a438f5640 1 --2- 172.21.15.1:0/3743310319 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a3c103b90 0x7f4a3c103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.202+0000 7f4a438f5640 1 -- 172.21.15.1:0/3743310319 >> 172.21.15.1:0/3743310319 conn(0x7f4a3c0ff5e0 msgr2=0x7f4a3c101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:41.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.202+0000 7f4a438f5640 1 -- 172.21.15.1:0/3743310319 shutdown_connections 2024-09-21T00:59:41.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.202+0000 7f4a438f5640 1 -- 172.21.15.1:0/3743310319 wait complete. 2024-09-21T00:59:41.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.203+0000 7f4a438f5640 1 Processor -- start 2024-09-21T00:59:41.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.203+0000 7f4a438f5640 1 -- start start 2024-09-21T00:59:41.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.203+0000 7f4a438f5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4a3c103b90 0x7f4a3c19a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:41.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.203+0000 7f4a438f5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a3c1094d0 0x7f4a3c19aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:41.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.203+0000 7f4a438f5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a3c109e20 0x7f4a3c19fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:41.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.203+0000 7f4a438f5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c113ae0 con 0x7f4a3c109e20 2024-09-21T00:59:41.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.203+0000 7f4a438f5640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c113960 con 0x7f4a3c1094d0 2024-09-21T00:59:41.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.203+0000 7f4a438f5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c113c60 con 0x7f4a3c103b90 2024-09-21T00:59:41.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.203+0000 7f4a41e92640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a3c109e20 0x7f4a3c19fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:41.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.203+0000 7f4a41e92640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a3c109e20 0x7f4a3c19fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42532/0 (socket says 172.21.15.1:42532) 2024-09-21T00:59:41.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.203+0000 7f4a41e92640 1 -- 172.21.15.1:0/2904104569 learned_addr learned my addr 172.21.15.1:0/2904104569 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:41.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.203+0000 7f4a40e90640 1 --2- 172.21.15.1:0/2904104569 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a3c1094d0 0x7f4a3c19aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:41.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.203+0000 7f4a41691640 1 --2- 172.21.15.1:0/2904104569 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4a3c103b90 0x7f4a3c19a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:41.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.204+0000 7f4a41e92640 1 -- 172.21.15.1:0/2904104569 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4a3c103b90 msgr2=0x7f4a3c19a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:41.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.204+0000 7f4a41e92640 1 --2- 172.21.15.1:0/2904104569 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4a3c103b90 0x7f4a3c19a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.204+0000 7f4a41e92640 1 -- 172.21.15.1:0/2904104569 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a3c1094d0 msgr2=0x7f4a3c19aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:41.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.204+0000 7f4a41e92640 1 --2- 172.21.15.1:0/2904104569 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a3c1094d0 0x7f4a3c19aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.204+0000 7f4a41e92640 1 -- 172.21.15.1:0/2904104569 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a3c1a0440 con 0x7f4a3c109e20 2024-09-21T00:59:41.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.204+0000 7f4a40e90640 1 --2- 172.21.15.1:0/2904104569 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a3c1094d0 0x7f4a3c19aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:41.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.204+0000 7f4a41e92640 1 --2- 172.21.15.1:0/2904104569 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a3c109e20 0x7f4a3c19fd10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f4a3400eb10 tx=0x7f4a3400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:41.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.204+0000 7f4a327fc640 1 -- 172.21.15.1:0/2904104569 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a34004b20 con 0x7f4a3c109e20 2024-09-21T00:59:41.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.204+0000 7f4a327fc640 1 -- 172.21.15.1:0/2904104569 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a34004cc0 con 0x7f4a3c109e20 2024-09-21T00:59:41.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.204+0000 7f4a327fc640 1 -- 172.21.15.1:0/2904104569 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a34010670 con 0x7f4a3c109e20 2024-09-21T00:59:41.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.204+0000 7f4a438f5640 1 -- 172.21.15.1:0/2904104569 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a3c1a0730 con 0x7f4a3c109e20 2024-09-21T00:59:41.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.205+0000 7f4a438f5640 1 -- 172.21.15.1:0/2904104569 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a3c1a6e90 con 0x7f4a3c109e20 2024-09-21T00:59:41.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.208+0000 7f4a49e69740 1 Processor -- start 2024-09-21T00:59:41.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.209+0000 7f4a327fc640 1 -- 172.21.15.1:0/2904104569 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f4a34005020 con 0x7f4a3c109e20 2024-09-21T00:59:41.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.209+0000 7f4a49e69740 1 -- start start 2024-09-21T00:59:41.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.209+0000 7f4a49e69740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564794e42070 0x5647951eda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:41.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.209+0000 7f4a49e69740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564794e191b0 0x5647951edfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:41.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.209+0000 7f4a49e69740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564794e21390 0x5647951ee4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:41.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.210+0000 7f4a49e69740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56479515fe50 con 0x564794e42070 2024-09-21T00:59:41.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.210+0000 7f4a49e69740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56479514f280 con 0x564794e191b0 2024-09-21T00:59:41.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.210+0000 7f4a49e69740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564795153090 con 0x564794e21390 2024-09-21T00:59:41.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.210+0000 7f4a41691640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564794e191b0 0x5647951edfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:41.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.210+0000 7f4a41691640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564794e191b0 0x5647951edfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:36738/0 (socket says 172.21.15.1:36738) 2024-09-21T00:59:41.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.210+0000 7f4a40e90640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564794e42070 0x5647951eda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:41.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.210+0000 7f4a41691640 1 -- 172.21.15.1:0/59519282 learned_addr learned my addr 172.21.15.1:0/59519282 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:41.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.210+0000 7f4a40e90640 1 --2- 172.21.15.1:0/59519282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564794e21390 0x5647951ee4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:41.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.210+0000 7f4a40e90640 1 -- 172.21.15.1:0/59519282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564794e21390 msgr2=0x5647951ee4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:41.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.210+0000 7f4a40e90640 1 --2- 172.21.15.1:0/59519282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564794e21390 0x5647951ee4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.210+0000 7f4a40e90640 1 -- 172.21.15.1:0/59519282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564794e191b0 msgr2=0x5647951edfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:41.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.210+0000 7f4a40e90640 1 --2- 172.21.15.1:0/59519282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564794e191b0 0x5647951edfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.210+0000 7f4a40e90640 1 -- 172.21.15.1:0/59519282 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564794ead650 con 0x564794e42070 2024-09-21T00:59:41.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.211+0000 7f4a327fc640 1 --2- 172.21.15.1:0/2904104569 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4a280b6590 0x7f4a280b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:41.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.211+0000 7f4a40e90640 1 --2- 172.21.15.1:0/59519282 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564794e42070 0x5647951eda60 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c02a930 tx=0x7f4a2c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc0f592837124d4d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:41.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.211+0000 7f4a327fc640 1 -- 172.21.15.1:0/2904104569 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f4a340e7870 con 0x7f4a3c109e20 2024-09-21T00:59:41.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.211+0000 7f4a41691640 1 --2- 172.21.15.1:0/2904104569 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4a280b6590 0x7f4a280b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:41.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.211+0000 7f4a277fe640 1 -- 172.21.15.1:0/59519282 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c035040 con 0x564794e42070 2024-09-21T00:59:41.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.211+0000 7f4a277fe640 1 -- 172.21.15.1:0/59519282 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a2c004230 con 0x564794e42070 2024-09-21T00:59:41.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.211+0000 7f4a277fe640 1 -- 172.21.15.1:0/59519282 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c03c400 con 0x564794e42070 2024-09-21T00:59:41.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.212+0000 7f4a49e69740 1 -- 172.21.15.1:0/59519282 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564794e42070 msgr2=0x5647951eda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:41.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.212+0000 7f4a49e69740 1 --2- 172.21.15.1:0/59519282 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564794e42070 0x5647951eda60 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c02a930 tx=0x7f4a2c000bc0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.212+0000 7f4a41691640 1 --2- 172.21.15.1:0/2904104569 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4a280b6590 0x7f4a280b8aa0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x5647951ec6e0 tx=0x7f4a38005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:41.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.212+0000 7f4a49e69740 1 -- 172.21.15.1:0/59519282 shutdown_connections 2024-09-21T00:59:41.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.212+0000 7f4a49e69740 1 --2- 172.21.15.1:0/59519282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564794e21390 0x5647951ee4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.212+0000 7f4a49e69740 1 --2- 172.21.15.1:0/59519282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564794e191b0 0x5647951edfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.212+0000 7f4a49e69740 1 --2- 172.21.15.1:0/59519282 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564794e42070 0x5647951eda60 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.212+0000 7f4a49e69740 1 -- 172.21.15.1:0/59519282 >> 172.21.15.1:0/59519282 conn(0x564794e36460 msgr2=0x5647951eb950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:41.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.213+0000 7f4a49e69740 1 -- 172.21.15.1:0/59519282 shutdown_connections 2024-09-21T00:59:41.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.213+0000 7f4a49e69740 1 -- 172.21.15.1:0/59519282 wait complete. 2024-09-21T00:59:41.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.213+0000 7f4a49e69740 1 -- start start 2024-09-21T00:59:41.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.213+0000 7f4a49e69740 1 Processor -- start 2024-09-21T00:59:41.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.213+0000 7f4a49e69740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564794e191b0 0x5647951e80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:41.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.213+0000 7f4a49e69740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564794e21390 0x5647951e85f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:41.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.214+0000 7f4a49e69740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564794e42070 0x564795209830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:41.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.214+0000 7f4a49e69740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564794fb0700 con 0x564794e42070 2024-09-21T00:59:41.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.214+0000 7f4a49e69740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5647950ea110 con 0x564794e191b0 2024-09-21T00:59:41.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.214+0000 7f4a49e69740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5647952005c0 con 0x564794e21390 2024-09-21T00:59:41.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.214+0000 7f4a49e69740 10 client.0 _ll_register_callbacks cb 0x564795103990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:41.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.214+0000 7f4a41e92640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564794e42070 0x564795209830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:41.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.214+0000 7f4a41691640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564794e191b0 0x5647951e80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:41.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.214+0000 7f4a41e92640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564794e42070 0x564795209830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42550/0 (socket says 172.21.15.1:42550) 2024-09-21T00:59:41.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.214+0000 7f4a41e92640 1 -- 172.21.15.1:0/3069952124 learned_addr learned my addr 172.21.15.1:0/3069952124 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:41.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.214+0000 7f4a41691640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564794e191b0 0x5647951e80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:36754/0 (socket says 172.21.15.1:36754) 2024-09-21T00:59:41.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.214+0000 7f4a40e90640 1 --2- 172.21.15.1:0/3069952124 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564794e21390 0x5647951e85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:41.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.214+0000 7f4a41e92640 1 -- 172.21.15.1:0/3069952124 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564794e21390 msgr2=0x5647951e85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:41.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.214+0000 7f4a41e92640 1 --2- 172.21.15.1:0/3069952124 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564794e21390 0x5647951e85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.214+0000 7f4a41e92640 1 -- 172.21.15.1:0/3069952124 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564794e191b0 msgr2=0x5647951e80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:41.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.214+0000 7f4a41e92640 1 --2- 172.21.15.1:0/3069952124 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564794e191b0 0x5647951e80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.214+0000 7f4a41e92640 1 -- 172.21.15.1:0/3069952124 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564795117c40 con 0x564794e42070 2024-09-21T00:59:41.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.214+0000 7f4a41691640 1 --2- 172.21.15.1:0/3069952124 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564794e191b0 0x5647951e80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:41.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.214+0000 7f4a41e92640 1 --2- 172.21.15.1:0/3069952124 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564794e42070 0x564795209830 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f4a3400cfb0 tx=0x7f4a340ad7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5613c4c4ff69923 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:41.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.214+0000 7f4a24ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:59:41.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.214+0000 7f4a24ff9640 1 -- 172.21.15.1:0/3069952124 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a340b2020 con 0x564794e42070 2024-09-21T00:59:41.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.214+0000 7f4a24ff9640 1 -- 172.21.15.1:0/3069952124 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f4a340ace50 con 0x564794e42070 2024-09-21T00:59:41.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.215+0000 7f4a49e69740 1 -- 172.21.15.1:0/3069952124 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a2c004230 con 0x564794e42070 2024-09-21T00:59:41.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.215+0000 7f4a24ff9640 1 -- 172.21.15.1:0/3069952124 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f4a340ad4f0 con 0x564794e42070 2024-09-21T00:59:41.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.215+0000 7f4a49e69740 10 client.16257 fetch_fsmap learned FSMap version 31 2024-09-21T00:59:41.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.215+0000 7f4a49e69740 1 -- 172.21.15.1:0/3069952124 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56479520c270 con 0x564794e42070 2024-09-21T00:59:41.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.215+0000 7f4a24ff9640 1 -- 172.21.15.1:0/3069952124 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a2c004230 con 0x564794e42070 2024-09-21T00:59:41.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.215+0000 7f4a24ff9640 1 -- 172.21.15.1:0/3069952124 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7f4a340ac6b0 con 0x564794e42070 2024-09-21T00:59:41.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.215+0000 7f4a49e69740 10 client.16257 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:59:41.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.215+0000 7f4a49e69740 10 client.16257 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:41.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.215+0000 7f4a49e69740 20 client.16257 populate_metadata read hostname 'smithi001' 2024-09-21T00:59:41.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.215+0000 7f4a49e69740 1 --2- 172.21.15.1:0/3069952124 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x564794e009f0 0x56479520f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:41.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.215+0000 7f4a49e69740 4 client.16257 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:59:41.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.215+0000 7f4a49e69740 1 -- 172.21.15.1:0/3069952124 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564795161da0 con 0x564794e009f0 2024-09-21T00:59:41.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.215+0000 7f4a41691640 1 --2- 172.21.15.1:0/3069952124 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x564794e009f0 0x56479520f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:41.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.216+0000 7f4a24ff9640 10 client.16257 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:41.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.216+0000 7f4a41691640 1 --2- 172.21.15.1:0/3069952124 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x564794e009f0 0x56479520f780 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7033aa2b5f052e69 server_cookie=d32c3f7b2f49b3a7 in_seq=0 out_seq=0 2024-09-21T00:59:41.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.217+0000 7f4a24ff9640 1 -- 172.21.15.1:0/3069952124 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564795161da0 con 0x564794e009f0 2024-09-21T00:59:41.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.217+0000 7f4a24ff9640 10 client.16257 handle_command_reply: tid=0 2024-09-21T00:59:41.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.217+0000 7f4a49e69740 1 client.16257 shutdown 2024-09-21T00:59:41.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.217+0000 7f4a49e69740 1 -- 172.21.15.1:0/3069952124 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564794e42070 msgr2=0x564795209830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:41.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.217+0000 7f4a49e69740 1 --2- 172.21.15.1:0/3069952124 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564794e42070 0x564795209830 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f4a3400cfb0 tx=0x7f4a340ad7b0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.217+0000 7f4a49e69740 1 -- 172.21.15.1:0/3069952124 shutdown_connections 2024-09-21T00:59:41.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.217+0000 7f4a49e69740 1 --2- 172.21.15.1:0/3069952124 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x564794e009f0 0x56479520f780 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.217+0000 7f4a49e69740 1 --2- 172.21.15.1:0/3069952124 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564794e42070 0x564795209830 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.217+0000 7f4a49e69740 1 --2- 172.21.15.1:0/3069952124 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564794e21390 0x5647951e85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.217+0000 7f4a49e69740 1 --2- 172.21.15.1:0/3069952124 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564794e191b0 0x5647951e80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.217+0000 7f4a49e69740 1 -- 172.21.15.1:0/3069952124 >> 172.21.15.1:0/3069952124 conn(0x564794e36460 msgr2=0x5647951f0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:41.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.217+0000 7f4a24ff9640 0 client.16257 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:41.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.217+0000 7f4a49e69740 1 -- 172.21.15.1:0/3069952124 shutdown_connections 2024-09-21T00:59:41.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.217+0000 7f4a49e69740 1 -- 172.21.15.1:0/3069952124 wait complete. 2024-09-21T00:59:41.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.217+0000 7f4a49e69740 20 client.16257 trim_cache size 0 max 16384 2024-09-21T00:59:41.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.236+0000 7f4a49e69740 1 Processor -- start 2024-09-21T00:59:41.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.236+0000 7f4a49e69740 1 -- start start 2024-09-21T00:59:41.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.236+0000 7f4a49e69740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564794e36460 0x5647951e8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:41.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.236+0000 7f4a49e69740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564794e191b0 0x5647951ffd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:41.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.236+0000 7f4a49e69740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564794e21390 0x5647952097b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:41.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.236+0000 7f4a49e69740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c1ad2d0 con 0x564794e21390 2024-09-21T00:59:41.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.236+0000 7f4a49e69740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c1aef90 con 0x564794e191b0 2024-09-21T00:59:41.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.236+0000 7f4a49e69740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c1ad9a0 con 0x564794e36460 2024-09-21T00:59:41.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.236+0000 7f4a41e92640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564794e21390 0x5647952097b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:41.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.237+0000 7f4a41691640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564794e36460 0x5647951e8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:41.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.237+0000 7f4a41691640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564794e36460 0x5647951e8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:36302/0 (socket says 172.21.15.1:36302) 2024-09-21T00:59:41.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.237+0000 7f4a41691640 1 -- 172.21.15.1:0/1527038540 learned_addr learned my addr 172.21.15.1:0/1527038540 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:41.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.237+0000 7f4a41e92640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564794e21390 0x5647952097b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42552/0 (socket says 172.21.15.1:42552) 2024-09-21T00:59:41.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.237+0000 7f4a40e90640 1 --2- 172.21.15.1:0/1527038540 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564794e191b0 0x5647951ffd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:41.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.237+0000 7f4a41691640 1 -- 172.21.15.1:0/1527038540 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564794e191b0 msgr2=0x5647951ffd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:41.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.237+0000 7f4a41691640 1 --2- 172.21.15.1:0/1527038540 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564794e191b0 0x5647951ffd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.237+0000 7f4a41691640 1 -- 172.21.15.1:0/1527038540 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564794e21390 msgr2=0x5647952097b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:41.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.237+0000 7f4a41691640 1 --2- 172.21.15.1:0/1527038540 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564794e21390 0x5647952097b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.237+0000 7f4a41691640 1 -- 172.21.15.1:0/1527038540 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647951eb100 con 0x564794e36460 2024-09-21T00:59:41.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.237+0000 7f4a41e92640 1 --2- 172.21.15.1:0/1527038540 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564794e21390 0x5647952097b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:41.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.237+0000 7f4a41691640 1 --2- 172.21.15.1:0/1527038540 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564794e36460 0x5647951e8570 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4a38005bc0 tx=0x7f4a3801b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4ed6f56ec9f0ea3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:41.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.237+0000 7f4a26ffd640 1 -- 172.21.15.1:0/1527038540 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3800f5c0 con 0x564794e36460 2024-09-21T00:59:41.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.237+0000 7f4a26ffd640 1 -- 172.21.15.1:0/1527038540 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a38037070 con 0x564794e36460 2024-09-21T00:59:41.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.237+0000 7f4a26ffd640 1 -- 172.21.15.1:0/1527038540 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3802caa0 con 0x564794e36460 2024-09-21T00:59:41.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.238+0000 7f4a49e69740 1 -- 172.21.15.1:0/1527038540 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564794e36460 msgr2=0x5647951e8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:41.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.238+0000 7f4a49e69740 1 --2- 172.21.15.1:0/1527038540 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564794e36460 0x5647951e8570 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4a38005bc0 tx=0x7f4a3801b000 comp rx=0 tx=0).stop 2024-09-21T00:59:41.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.238+0000 7f4a49e69740 1 -- 172.21.15.1:0/1527038540 shutdown_connections 2024-09-21T00:59:41.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.238+0000 7f4a49e69740 1 --2- 172.21.15.1:0/1527038540 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564794e21390 0x5647952097b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.238+0000 7f4a49e69740 1 --2- 172.21.15.1:0/1527038540 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564794e191b0 0x5647951ffd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.238+0000 7f4a49e69740 1 --2- 172.21.15.1:0/1527038540 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564794e36460 0x5647951e8570 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.238+0000 7f4a49e69740 1 -- 172.21.15.1:0/1527038540 >> 172.21.15.1:0/1527038540 conn(0x56479520fab0 msgr2=0x5647951e7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:41.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.238+0000 7f4a49e69740 1 -- 172.21.15.1:0/1527038540 shutdown_connections 2024-09-21T00:59:41.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.238+0000 7f4a49e69740 1 -- 172.21.15.1:0/1527038540 wait complete. 2024-09-21T00:59:41.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.239+0000 7f4a49e69740 1 -- start start 2024-09-21T00:59:41.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.239+0000 7f4a49e69740 1 Processor -- start 2024-09-21T00:59:41.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.239+0000 7f4a49e69740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564794e191b0 0x564795205810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:41.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.239+0000 7f4a49e69740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564794e21390 0x564795205d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:41.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.239+0000 7f4a49e69740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564794e36460 0x5647952027e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:41.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.240+0000 7f4a49e69740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c1ae800 con 0x564794e36460 2024-09-21T00:59:41.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.240+0000 7f4a49e69740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c1ae130 con 0x564794e191b0 2024-09-21T00:59:41.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.240+0000 7f4a49e69740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c1ab2b0 con 0x564794e21390 2024-09-21T00:59:41.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.240+0000 7f4a49e69740 10 client.0 _ll_register_callbacks cb 0x7f4a340a9880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:41.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.240+0000 7f4a41691640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564794e191b0 0x564795205810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:41.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.240+0000 7f4a41691640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564794e191b0 0x564795205810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:36782/0 (socket says 172.21.15.1:36782) 2024-09-21T00:59:41.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.240+0000 7f4a41691640 1 -- 172.21.15.1:0/1094620715 learned_addr learned my addr 172.21.15.1:0/1094620715 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:41.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.240+0000 7f4a41e92640 1 --2- 172.21.15.1:0/1094620715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564794e36460 0x5647952027e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:41.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.240+0000 7f4a40e90640 1 --2- 172.21.15.1:0/1094620715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564794e21390 0x564795205d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:41.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.240+0000 7f4a41691640 1 -- 172.21.15.1:0/1094620715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564794e21390 msgr2=0x564795205d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:41.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.240+0000 7f4a41691640 1 --2- 172.21.15.1:0/1094620715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564794e21390 0x564795205d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.240+0000 7f4a41691640 1 -- 172.21.15.1:0/1094620715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564794e36460 msgr2=0x5647952027e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:41.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.240+0000 7f4a41691640 1 --2- 172.21.15.1:0/1094620715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564794e36460 0x5647952027e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.240+0000 7f4a41691640 1 -- 172.21.15.1:0/1094620715 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647951e2b90 con 0x564794e191b0 2024-09-21T00:59:41.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.240+0000 7f4a41e92640 1 --2- 172.21.15.1:0/1094620715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564794e36460 0x5647952027e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:41.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.240+0000 7f4a41691640 1 --2- 172.21.15.1:0/1094620715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564794e191b0 0x564795205810 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4a38009c90 tx=0x7f4a3802c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a199d3f0edee07f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:41.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.240+0000 7f4a24ff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T00:59:41.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.241+0000 7f4a24ff9640 1 -- 172.21.15.1:0/1094620715 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3803f070 con 0x564794e191b0 2024-09-21T00:59:41.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.241+0000 7f4a49e69740 1 -- 172.21.15.1:0/1094620715 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a38037070 con 0x564794e191b0 2024-09-21T00:59:41.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.241+0000 7f4a24ff9640 1 -- 172.21.15.1:0/1094620715 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f4a38005380 con 0x564794e191b0 2024-09-21T00:59:41.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.247+0000 7f4a24ff9640 1 -- 172.21.15.1:0/1094620715 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f4a380055c0 con 0x564794e191b0 2024-09-21T00:59:41.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.247+0000 7f4a49e69740 10 client.25928 fetch_fsmap learned FSMap version 31 2024-09-21T00:59:41.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.247+0000 7f4a49e69740 1 -- 172.21.15.1:0/1094620715 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5647951e17f0 con 0x564794e191b0 2024-09-21T00:59:41.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.248+0000 7f4a24ff9640 1 -- 172.21.15.1:0/1094620715 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a38037070 con 0x564794e191b0 2024-09-21T00:59:41.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.248+0000 7f4a24ff9640 1 -- 172.21.15.1:0/1094620715 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7f4a38004bf0 con 0x564794e191b0 2024-09-21T00:59:41.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.248+0000 7f4a49e69740 10 client.25928 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:59:41.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.248+0000 7f4a49e69740 10 client.25928 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:41.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.248+0000 7f4a49e69740 20 client.25928 populate_metadata read hostname 'smithi001' 2024-09-21T00:59:41.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.248+0000 7f4a49e69740 1 --2- 172.21.15.1:0/1094620715 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x564794e42070 0x56479527ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:41.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.248+0000 7f4a49e69740 4 client.25928 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T00:59:41.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.248+0000 7f4a49e69740 1 -- 172.21.15.1:0/1094620715 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56479515d850 con 0x564794e42070 2024-09-21T00:59:41.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.248+0000 7f4a40e90640 1 --2- 172.21.15.1:0/1094620715 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x564794e42070 0x56479527ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:41.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.249+0000 7f4a24ff9640 10 client.25928 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:41.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.249+0000 7f4a40e90640 1 --2- 172.21.15.1:0/1094620715 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x564794e42070 0x56479527ca50 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61609ca096151406 server_cookie=3f3c098c003e2aa1 in_seq=0 out_seq=0 2024-09-21T00:59:41.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.250+0000 7f4a24ff9640 1 -- 172.21.15.1:0/1094620715 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1510 (crc 0 0 0) 0x56479515d850 con 0x564794e42070 2024-09-21T00:59:41.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.250+0000 7f4a24ff9640 10 client.25928 handle_command_reply: tid=0 2024-09-21T00:59:41.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.250+0000 7f4a49e69740 1 client.25928 shutdown 2024-09-21T00:59:41.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.250+0000 7f4a49e69740 1 -- 172.21.15.1:0/1094620715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564794e191b0 msgr2=0x564795205810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:41.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.250+0000 7f4a49e69740 1 --2- 172.21.15.1:0/1094620715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564794e191b0 0x564795205810 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4a38009c90 tx=0x7f4a3802c480 comp rx=0 tx=0).stop 2024-09-21T00:59:41.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.250+0000 7f4a49e69740 1 -- 172.21.15.1:0/1094620715 shutdown_connections 2024-09-21T00:59:41.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.250+0000 7f4a49e69740 1 --2- 172.21.15.1:0/1094620715 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x564794e42070 0x56479527ca50 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.250+0000 7f4a49e69740 1 --2- 172.21.15.1:0/1094620715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564794e36460 0x5647952027e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.250+0000 7f4a24ff9640 0 client.25928 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:41.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.250+0000 7f4a49e69740 1 --2- 172.21.15.1:0/1094620715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564794e21390 0x564795205d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.250+0000 7f4a49e69740 1 --2- 172.21.15.1:0/1094620715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564794e191b0 0x564795205810 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.250+0000 7f4a49e69740 1 -- 172.21.15.1:0/1094620715 >> 172.21.15.1:0/1094620715 conn(0x56479520fab0 msgr2=0x5647951e9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:41.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.250+0000 7f4a49e69740 1 -- 172.21.15.1:0/1094620715 shutdown_connections 2024-09-21T00:59:41.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.250+0000 7f4a49e69740 1 -- 172.21.15.1:0/1094620715 wait complete. 2024-09-21T00:59:41.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.251+0000 7f4a49e69740 20 client.25928 trim_cache size 0 max 16384 2024-09-21T00:59:41.252 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T00:59:41.252 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "no active scrubs running", 2024-09-21T00:59:41.252 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": {}, 2024-09-21T00:59:41.253 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_stats": { 2024-09-21T00:59:41.253 INFO:teuthology.orchestra.run.smithi001.stdout: "f826f2c1-768a-47bb-b868-785b351ac6b4": { 2024-09-21T00:59:41.253 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:59:06.554657+0000", 2024-09-21T00:59:41.253 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T00:59:41.253 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T00:59:41.253 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T00:59:41.253 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T00:59:41.253 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T00:59:41.253 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T00:59:41.253 INFO:teuthology.orchestra.run.smithi001.stdout: "bee49cce-b407-4617-a959-331ffd8dc5b0": { 2024-09-21T00:59:41.253 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:58:17.883027+0000", 2024-09-21T00:59:41.253 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T00:59:41.253 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T00:59:41.253 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T00:59:41.254 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T00:59:41.254 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T00:59:41.254 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T00:59:41.254 INFO:teuthology.orchestra.run.smithi001.stdout: "7cb1bc3f-e2d2-4bf7-b13e-8f3371d7aac1": { 2024-09-21T00:59:41.254 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:58:02.751142+0000", 2024-09-21T00:59:41.254 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T00:59:41.254 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T00:59:41.254 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T00:59:41.254 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T00:59:41.254 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T00:59:41.254 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T00:59:41.254 INFO:teuthology.orchestra.run.smithi001.stdout: "2383a19c-993d-4440-99f7-93b43dcf33b4": { 2024-09-21T00:59:41.254 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:47.609257+0000", 2024-09-21T00:59:41.254 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T00:59:41.255 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T00:59:41.255 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T00:59:41.255 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T00:59:41.255 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T00:59:41.255 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T00:59:41.255 INFO:teuthology.orchestra.run.smithi001.stdout: "53fa74e4-5aa8-408b-9724-7c93618f7636": { 2024-09-21T00:59:41.255 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:01.730608+0000", 2024-09-21T00:59:41.255 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T00:59:41.255 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T00:59:41.255 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T00:59:41.255 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T00:59:41.255 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T00:59:41.255 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T00:59:41.255 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T00:59:41.255 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T00:59:41.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.251+0000 7f4a438f5640 1 -- 172.21.15.1:0/2904104569 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4a280b6590 msgr2=0x7f4a280b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:41.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.251+0000 7f4a438f5640 1 --2- 172.21.15.1:0/2904104569 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4a280b6590 0x7f4a280b8aa0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x5647951ec6e0 tx=0x7f4a38005f90 comp rx=0 tx=0).stop 2024-09-21T00:59:41.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.251+0000 7f4a438f5640 1 -- 172.21.15.1:0/2904104569 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a3c109e20 msgr2=0x7f4a3c19fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:41.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.251+0000 7f4a438f5640 1 --2- 172.21.15.1:0/2904104569 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a3c109e20 0x7f4a3c19fd10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f4a3400eb10 tx=0x7f4a3400c2d0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.251+0000 7f4a438f5640 1 -- 172.21.15.1:0/2904104569 shutdown_connections 2024-09-21T00:59:41.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.251+0000 7f4a438f5640 1 --2- 172.21.15.1:0/2904104569 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4a280b6590 0x7f4a280b8aa0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.251+0000 7f4a438f5640 1 --2- 172.21.15.1:0/2904104569 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a3c109e20 0x7f4a3c19fd10 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.251+0000 7f4a438f5640 1 --2- 172.21.15.1:0/2904104569 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a3c1094d0 0x7f4a3c19aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.251+0000 7f4a438f5640 1 --2- 172.21.15.1:0/2904104569 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4a3c103b90 0x7f4a3c19a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:41.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.251+0000 7f4a438f5640 1 -- 172.21.15.1:0/2904104569 >> 172.21.15.1:0/2904104569 conn(0x7f4a3c0ff5e0 msgr2=0x7f4a3c101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:41.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.252+0000 7f4a438f5640 1 -- 172.21.15.1:0/2904104569 shutdown_connections 2024-09-21T00:59:41.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:41.252+0000 7f4a438f5640 1 -- 172.21.15.1:0/2904104569 wait complete. 2024-09-21T00:59:41.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:41 smithi001 ceph-mon[31211]: pgmap v432: 97 pgs: 97 active+clean; 253 MiB data, 751 MiB used, 1.0 TiB / 1.0 TiB avail; 1013 KiB/s rd, 2.9 MiB/s wr, 231 op/s 2024-09-21T00:59:41.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:41 smithi193 ceph-mon[34660]: pgmap v432: 97 pgs: 97 active+clean; 253 MiB data, 751 MiB used, 1.0 TiB / 1.0 TiB avail; 1013 KiB/s rd, 2.9 MiB/s wr, 231 op/s 2024-09-21T00:59:41.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:41 smithi042 ceph-mon[34481]: pgmap v432: 97 pgs: 97 active+clean; 253 MiB data, 751 MiB used, 1.0 TiB / 1.0 TiB avail; 1013 KiB/s rd, 2.9 MiB/s wr, 231 op/s 2024-09-21T00:59:42.210 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T00:59:42.210 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:59:43.275 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:59:43.531 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:43 smithi193 ceph-mon[34660]: pgmap v433: 97 pgs: 97 active+clean; 260 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.1 MiB/s wr, 277 op/s 2024-09-21T00:59:43.543 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:43 smithi042 ceph-mon[34481]: pgmap v433: 97 pgs: 97 active+clean; 260 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.1 MiB/s wr, 277 op/s 2024-09-21T00:59:43.557 INFO:tasks.workunit.client.0.smithi001.stdout: 59 845235 419 504655 380 438733 1346 2024-09-21T00:59:43.606 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:43 smithi001 ceph-mon[31211]: pgmap v433: 97 pgs: 97 active+clean; 260 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.1 MiB/s wr, 277 op/s 2024-09-21T00:59:44.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.068+0000 7f6c3e5cd640 1 -- 172.21.15.1:0/962495218 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c3811cc30 msgr2=0x7f6c3811f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:44.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.068+0000 7f6c3e5cd640 1 --2- 172.21.15.1:0/962495218 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c3811cc30 0x7f6c3811f140 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6c30009ca0 tx=0x7f6c3002a8f0 comp rx=0 tx=0).stop 2024-09-21T00:59:44.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.069+0000 7f6c3e5cd640 1 -- 172.21.15.1:0/962495218 shutdown_connections 2024-09-21T00:59:44.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.069+0000 7f6c3e5cd640 1 --2- 172.21.15.1:0/962495218 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c3811cc30 0x7f6c3811f140 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:44.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.069+0000 7f6c3e5cd640 1 --2- 172.21.15.1:0/962495218 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c3810a9e0 0x7f6c3810adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:44.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.069+0000 7f6c3e5cd640 1 --2- 172.21.15.1:0/962495218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c38111f40 0x7f6c3810a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:44.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.069+0000 7f6c3e5cd640 1 -- 172.21.15.1:0/962495218 >> 172.21.15.1:0/962495218 conn(0x7f6c38070ec0 msgr2=0x7f6c380712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:44.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.069+0000 7f6c3e5cd640 1 -- 172.21.15.1:0/962495218 shutdown_connections 2024-09-21T00:59:44.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.069+0000 7f6c3e5cd640 1 -- 172.21.15.1:0/962495218 wait complete. 2024-09-21T00:59:44.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.070+0000 7f6c3e5cd640 1 Processor -- start 2024-09-21T00:59:44.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.070+0000 7f6c3e5cd640 1 -- start start 2024-09-21T00:59:44.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.071+0000 7f6c3e5cd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c3810a9e0 0x7f6c381a8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:44.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.071+0000 7f6c3e5cd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c38111f40 0x7f6c381a9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:44.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.071+0000 7f6c3e5cd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c381ae6f0 0x7f6c381aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:44.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.071+0000 7f6c3e5cd640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6c38122960 con 0x7f6c38111f40 2024-09-21T00:59:44.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.071+0000 7f6c3e5cd640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6c381227e0 con 0x7f6c381ae6f0 2024-09-21T00:59:44.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.071+0000 7f6c3e5cd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6c38122ae0 con 0x7f6c3810a9e0 2024-09-21T00:59:44.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.072+0000 7f6c37fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c3810a9e0 0x7f6c381a8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:44.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.072+0000 7f6c37fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c3810a9e0 0x7f6c381a8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:36314/0 (socket says 172.21.15.1:36314) 2024-09-21T00:59:44.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.072+0000 7f6c37fff640 1 -- 172.21.15.1:0/2985666894 learned_addr learned my addr 172.21.15.1:0/2985666894 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:44.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.072+0000 7f6c377fe640 1 --2- 172.21.15.1:0/2985666894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c38111f40 0x7f6c381a9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:44.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.072+0000 7f6c3cb6a640 1 --2- 172.21.15.1:0/2985666894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c381ae6f0 0x7f6c381aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:44.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.072+0000 7f6c37fff640 1 -- 172.21.15.1:0/2985666894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c381ae6f0 msgr2=0x7f6c381aeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:44.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.072+0000 7f6c37fff640 1 --2- 172.21.15.1:0/2985666894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c381ae6f0 0x7f6c381aeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:44.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.072+0000 7f6c37fff640 1 -- 172.21.15.1:0/2985666894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c38111f40 msgr2=0x7f6c381a9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:44.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.072+0000 7f6c37fff640 1 --2- 172.21.15.1:0/2985666894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c38111f40 0x7f6c381a9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:44.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.072+0000 7f6c37fff640 1 -- 172.21.15.1:0/2985666894 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c381af340 con 0x7f6c3810a9e0 2024-09-21T00:59:44.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.074+0000 7f6c37fff640 1 --2- 172.21.15.1:0/2985666894 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c3810a9e0 0x7f6c381a8f70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6c2800d950 tx=0x7f6c2800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:44.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.078+0000 7f6c357fa640 1 -- 172.21.15.1:0/2985666894 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c28017070 con 0x7f6c3810a9e0 2024-09-21T00:59:44.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.078+0000 7f6c357fa640 1 -- 172.21.15.1:0/2985666894 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c28009c30 con 0x7f6c3810a9e0 2024-09-21T00:59:44.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.078+0000 7f6c357fa640 1 -- 172.21.15.1:0/2985666894 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2800f620 con 0x7f6c3810a9e0 2024-09-21T00:59:44.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.078+0000 7f6c3e5cd640 1 -- 172.21.15.1:0/2985666894 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c38112380 con 0x7f6c3810a9e0 2024-09-21T00:59:44.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.078+0000 7f6c3e5cd640 1 -- 172.21.15.1:0/2985666894 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c38112870 con 0x7f6c3810a9e0 2024-09-21T00:59:44.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.083+0000 7f6c3e5cd640 1 -- 172.21.15.1:0/2985666894 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c24005290 con 0x7f6c3810a9e0 2024-09-21T00:59:44.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.086+0000 7f6c357fa640 1 -- 172.21.15.1:0/2985666894 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f6c28005030 con 0x7f6c3810a9e0 2024-09-21T00:59:44.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.088+0000 7f6c357fa640 1 --2- 172.21.15.1:0/2985666894 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6c200b6710 0x7f6c200b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:44.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.088+0000 7f6c357fa640 1 -- 172.21.15.1:0/2985666894 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f6c280e6e80 con 0x7f6c3810a9e0 2024-09-21T00:59:44.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.089+0000 7f6c377fe640 1 --2- 172.21.15.1:0/2985666894 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6c200b6710 0x7f6c200b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:44.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.089+0000 7f6c357fa640 1 -- 172.21.15.1:0/2985666894 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6c280ad790 con 0x7f6c3810a9e0 2024-09-21T00:59:44.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.089+0000 7f6c377fe640 1 --2- 172.21.15.1:0/2985666894 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6c200b6710 0x7f6c200b8c20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6c3811f1d0 tx=0x7f6c2c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:44.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.599+0000 7f6c3e5cd640 1 -- 172.21.15.1:0/2985666894 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c24005580 con 0x7f6c3810a9e0 2024-09-21T00:59:44.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.600+0000 7f6c357fa640 1 -- 172.21.15.1:0/2985666894 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11969 (secure 0 0 0) 0x7f6c28009de0 con 0x7f6c3810a9e0 2024-09-21T00:59:44.601 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T00:59:44.602 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":31,"btime":"2024-09-21T00:58:37:805319+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2810186677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2810186677},{"type":"v1","addr":"172.21.15.1:6835","nonce":2810186677}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14736,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3935320478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3935320478},{"type":"v1","addr":"172.21.15.1:6837","nonce":3935320478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:54:58.592853+0000","modified":"2024-09-21T00:58:36.853977+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24653,"mds_1":24637,"mds_2":24626,"mds_3":24622,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/2125703572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2125703572},{"type":"v1","addr":"172.21.15.1:6839","nonce":2125703572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/3860445313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860445313},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860445313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6833/712170939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":712170939},{"type":"v1","addr":"172.21.15.193:6833","nonce":712170939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6833/1653911656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1653911656},{"type":"v1","addr":"172.21.15.42:6833","nonce":1653911656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6835/793085918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":793085918},{"type":"v1","addr":"172.21.15.42:6835","nonce":793085918}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6835/3631682268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":3631682268},{"type":"v1","addr":"172.21.15.193:6835","nonce":3631682268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.193:6837/909252228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":909252228},{"type":"v1","addr":"172.21.15.193:6837","nonce":909252228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.42:6837/2395608508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2395608508},{"type":"v1","addr":"172.21.15.42:6837","nonce":2395608508}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.193:6839/1365361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1365361177},{"type":"v1","addr":"172.21.15.193:6839","nonce":1365361177}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6839/2526476666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2526476666},{"type":"v1","addr":"172.21.15.42:6839","nonce":2526476666}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24610,24622,24626,24637,24653]},"id":1}]} 2024-09-21T00:59:44.602 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 31 2024-09-21T00:59:44.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.610+0000 7f6c3e5cd640 1 -- 172.21.15.1:0/2985666894 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6c200b6710 msgr2=0x7f6c200b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:44.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.611+0000 7f6c3e5cd640 1 --2- 172.21.15.1:0/2985666894 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6c200b6710 0x7f6c200b8c20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6c3811f1d0 tx=0x7f6c2c008040 comp rx=0 tx=0).stop 2024-09-21T00:59:44.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.611+0000 7f6c3e5cd640 1 -- 172.21.15.1:0/2985666894 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c3810a9e0 msgr2=0x7f6c381a8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:44.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.611+0000 7f6c3e5cd640 1 --2- 172.21.15.1:0/2985666894 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c3810a9e0 0x7f6c381a8f70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6c2800d950 tx=0x7f6c2800de10 comp rx=0 tx=0).stop 2024-09-21T00:59:44.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.615+0000 7f6c3e5cd640 1 -- 172.21.15.1:0/2985666894 shutdown_connections 2024-09-21T00:59:44.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.615+0000 7f6c3e5cd640 1 --2- 172.21.15.1:0/2985666894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c381ae6f0 0x7f6c381aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:44.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.615+0000 7f6c3e5cd640 1 --2- 172.21.15.1:0/2985666894 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6c200b6710 0x7f6c200b8c20 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:44.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.615+0000 7f6c3e5cd640 1 --2- 172.21.15.1:0/2985666894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c38111f40 0x7f6c381a9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:44.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.615+0000 7f6c3e5cd640 1 --2- 172.21.15.1:0/2985666894 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c3810a9e0 0x7f6c381a8f70 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:44.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.615+0000 7f6c3e5cd640 1 -- 172.21.15.1:0/2985666894 >> 172.21.15.1:0/2985666894 conn(0x7f6c38070ec0 msgr2=0x7f6c3811cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:44.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.615+0000 7f6c3e5cd640 1 -- 172.21.15.1:0/2985666894 shutdown_connections 2024-09-21T00:59:44.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:44.615+0000 7f6c3e5cd640 1 -- 172.21.15.1:0/2985666894 wait complete. 2024-09-21T00:59:45.412 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:45 smithi001 ceph-mon[31211]: pgmap v434: 97 pgs: 97 active+clean; 263 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 296 op/s 2024-09-21T00:59:45.412 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:45 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/2985666894' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:59:45.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:45 smithi193 ceph-mon[34660]: pgmap v434: 97 pgs: 97 active+clean; 263 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 296 op/s 2024-09-21T00:59:45.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:45 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/2985666894' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:59:45.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:45 smithi042 ceph-mon[34481]: pgmap v434: 97 pgs: 97 active+clean; 263 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 296 op/s 2024-09-21T00:59:45.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:45 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/2985666894' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:59:45.750 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T00:59:47.125 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:59:47.405 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:47 smithi001 ceph-mon[31211]: pgmap v435: 97 pgs: 97 active+clean; 273 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.2 MiB/s wr, 432 op/s 2024-09-21T00:59:47.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.685+0000 7f05d1082640 1 -- 172.21.15.1:0/467316320 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05cc105300 msgr2=0x7f05cc10d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:47.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.685+0000 7f05d1082640 1 --2- 172.21.15.1:0/467316320 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05cc105300 0x7f05cc10d850 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f05c0009900 tx=0x7f05c002a410 comp rx=0 tx=0).stop 2024-09-21T00:59:47.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.685+0000 7f05d1082640 1 -- 172.21.15.1:0/467316320 shutdown_connections 2024-09-21T00:59:47.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.685+0000 7f05d1082640 1 --2- 172.21.15.1:0/467316320 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05cc10de10 0x7f05cc110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.685+0000 7f05d1082640 1 --2- 172.21.15.1:0/467316320 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05cc105300 0x7f05cc10d850 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.685+0000 7f05d1082640 1 --2- 172.21.15.1:0/467316320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05cc1049b0 0x7f05cc104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.685+0000 7f05d1082640 1 -- 172.21.15.1:0/467316320 >> 172.21.15.1:0/467316320 conn(0x7f05cc079730 msgr2=0x7f05cc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:47.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.685+0000 7f05d1082640 1 -- 172.21.15.1:0/467316320 shutdown_connections 2024-09-21T00:59:47.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.685+0000 7f05d1082640 1 -- 172.21.15.1:0/467316320 wait complete. 2024-09-21T00:59:47.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.686+0000 7f05d1082640 1 Processor -- start 2024-09-21T00:59:47.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.687+0000 7f05d1082640 1 -- start start 2024-09-21T00:59:47.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.687+0000 7f05d1082640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05cc1049b0 0x7f05cc19a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:47.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.687+0000 7f05d1082640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05cc105300 0x7f05cc19aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:47.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.687+0000 7f05d1082640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05cc10de10 0x7f05cc19fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:47.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.687+0000 7f05cb59e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05cc10de10 0x7f05cc19fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:47.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.687+0000 7f05cb59e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05cc10de10 0x7f05cc19fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42594/0 (socket says 172.21.15.1:42594) 2024-09-21T00:59:47.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.687+0000 7f05cb59e640 1 -- 172.21.15.1:0/2210590916 learned_addr learned my addr 172.21.15.1:0/2210590916 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:47.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.687+0000 7f05d1082640 1 -- 172.21.15.1:0/2210590916 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f05cc113a70 con 0x7f05cc10de10 2024-09-21T00:59:47.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.687+0000 7f05d1082640 1 -- 172.21.15.1:0/2210590916 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f05cc1138f0 con 0x7f05cc105300 2024-09-21T00:59:47.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.687+0000 7f05d1082640 1 -- 172.21.15.1:0/2210590916 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f05cc113bf0 con 0x7f05cc1049b0 2024-09-21T00:59:47.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.687+0000 7f05cad9d640 1 --2- 172.21.15.1:0/2210590916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05cc1049b0 0x7f05cc19a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:47.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.687+0000 7f05ca59c640 1 --2- 172.21.15.1:0/2210590916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05cc105300 0x7f05cc19aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:47.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.688+0000 7f05cb59e640 1 -- 172.21.15.1:0/2210590916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05cc1049b0 msgr2=0x7f05cc19a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:47.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.688+0000 7f05cb59e640 1 --2- 172.21.15.1:0/2210590916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05cc1049b0 0x7f05cc19a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.688+0000 7f05cb59e640 1 -- 172.21.15.1:0/2210590916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05cc105300 msgr2=0x7f05cc19aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:47.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.688+0000 7f05cb59e640 1 --2- 172.21.15.1:0/2210590916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05cc105300 0x7f05cc19aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.688+0000 7f05cb59e640 1 -- 172.21.15.1:0/2210590916 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05cc1a0430 con 0x7f05cc10de10 2024-09-21T00:59:47.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.688+0000 7f05cad9d640 1 --2- 172.21.15.1:0/2210590916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05cc1049b0 0x7f05cc19a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:59:47.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.688+0000 7f05cb59e640 1 --2- 172.21.15.1:0/2210590916 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05cc10de10 0x7f05cc19fd00 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f05c4009d10 tx=0x7f05c4007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:47.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.689+0000 7f05b3fff640 1 -- 172.21.15.1:0/2210590916 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c4004b20 con 0x7f05cc10de10 2024-09-21T00:59:47.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.689+0000 7f05d1082640 1 -- 172.21.15.1:0/2210590916 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05cc1a06c0 con 0x7f05cc10de10 2024-09-21T00:59:47.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.689+0000 7f05b3fff640 1 -- 172.21.15.1:0/2210590916 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05c4004cc0 con 0x7f05cc10de10 2024-09-21T00:59:47.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.689+0000 7f05b3fff640 1 -- 172.21.15.1:0/2210590916 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c400ed00 con 0x7f05cc10de10 2024-09-21T00:59:47.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.689+0000 7f05d1082640 1 -- 172.21.15.1:0/2210590916 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05cc1025d0 con 0x7f05cc10de10 2024-09-21T00:59:47.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.693+0000 7f05d75f6740 1 Processor -- start 2024-09-21T00:59:47.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.693+0000 7f05b3fff640 1 -- 172.21.15.1:0/2210590916 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f05c4005000 con 0x7f05cc10de10 2024-09-21T00:59:47.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.693+0000 7f05d75f6740 1 -- start start 2024-09-21T00:59:47.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.694+0000 7f05d75f6740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56341f465070 0x56341f80c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:47.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.694+0000 7f05d75f6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56341f43c1b0 0x56341f80cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:47.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.694+0000 7f05d75f6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56341f444390 0x56341f80d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:47.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.694+0000 7f05d75f6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56341f782ea0 con 0x56341f444390 2024-09-21T00:59:47.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.694+0000 7f05d75f6740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56341f7722d0 con 0x56341f465070 2024-09-21T00:59:47.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.694+0000 7f05d75f6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56341f7760e0 con 0x56341f43c1b0 2024-09-21T00:59:47.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.694+0000 7f05ca59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56341f465070 0x56341f80c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:47.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.694+0000 7f05ca59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56341f465070 0x56341f80c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:36844/0 (socket says 172.21.15.1:36844) 2024-09-21T00:59:47.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.694+0000 7f05ca59c640 1 -- 172.21.15.1:0/1644325643 learned_addr learned my addr 172.21.15.1:0/1644325643 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:47.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.694+0000 7f05ca59c640 1 --2- 172.21.15.1:0/1644325643 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56341f444390 0x56341f80d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:47.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.694+0000 7f05cad9d640 1 --2- 172.21.15.1:0/1644325643 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56341f43c1b0 0x56341f80cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:47.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.694+0000 7f05ca59c640 1 -- 172.21.15.1:0/1644325643 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56341f43c1b0 msgr2=0x56341f80cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:47.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.694+0000 7f05ca59c640 1 --2- 172.21.15.1:0/1644325643 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56341f43c1b0 0x56341f80cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.694+0000 7f05ca59c640 1 -- 172.21.15.1:0/1644325643 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56341f444390 msgr2=0x56341f80d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:47.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.694+0000 7f05ca59c640 1 --2- 172.21.15.1:0/1644325643 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56341f444390 0x56341f80d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.694+0000 7f05ca59c640 1 -- 172.21.15.1:0/1644325643 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56341f4d0650 con 0x56341f465070 2024-09-21T00:59:47.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.695+0000 7f05ca59c640 1 --2- 172.21.15.1:0/1644325643 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56341f465070 0x56341f80c6a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f05c00057c0 tx=0x7f05c0000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf6ef8c79f65135e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:47.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.695+0000 7f05b3fff640 1 --2- 172.21.15.1:0/2210590916 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f05b40b6590 0x7f05b40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:47.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.695+0000 7f05cad9d640 1 --2- 172.21.15.1:0/2210590916 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f05b40b6590 0x7f05b40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:47.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.695+0000 7f05b17fa640 1 -- 172.21.15.1:0/1644325643 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c0035070 con 0x56341f465070 2024-09-21T00:59:47.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.695+0000 7f05b3fff640 1 -- 172.21.15.1:0/2210590916 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f05c40ea9b0 con 0x7f05cc10de10 2024-09-21T00:59:47.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.695+0000 7f05b17fa640 1 -- 172.21.15.1:0/1644325643 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05c00316a0 con 0x56341f465070 2024-09-21T00:59:47.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.695+0000 7f05b17fa640 1 -- 172.21.15.1:0/1644325643 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c0003cc0 con 0x56341f465070 2024-09-21T00:59:47.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.696+0000 7f05d75f6740 1 -- 172.21.15.1:0/1644325643 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56341f465070 msgr2=0x56341f80c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:47.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.696+0000 7f05cad9d640 1 --2- 172.21.15.1:0/2210590916 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f05b40b6590 0x7f05b40b8aa0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x56341f80b320 tx=0x7f05bc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:47.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.696+0000 7f05d75f6740 1 --2- 172.21.15.1:0/1644325643 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56341f465070 0x56341f80c6a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f05c00057c0 tx=0x7f05c0000bc0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.696+0000 7f05d75f6740 1 -- 172.21.15.1:0/1644325643 shutdown_connections 2024-09-21T00:59:47.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.696+0000 7f05d75f6740 1 --2- 172.21.15.1:0/1644325643 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56341f444390 0x56341f80d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.696+0000 7f05d75f6740 1 --2- 172.21.15.1:0/1644325643 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56341f43c1b0 0x56341f80cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.696+0000 7f05d75f6740 1 --2- 172.21.15.1:0/1644325643 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56341f465070 0x56341f80c6a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.696+0000 7f05d75f6740 1 -- 172.21.15.1:0/1644325643 >> 172.21.15.1:0/1644325643 conn(0x56341f459460 msgr2=0x56341f80a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:47.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.697+0000 7f05d75f6740 1 -- 172.21.15.1:0/1644325643 shutdown_connections 2024-09-21T00:59:47.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.697+0000 7f05d75f6740 1 -- 172.21.15.1:0/1644325643 wait complete. 2024-09-21T00:59:47.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.697+0000 7f05d75f6740 1 -- start start 2024-09-21T00:59:47.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.697+0000 7f05d75f6740 1 Processor -- start 2024-09-21T00:59:47.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.698+0000 7f05d75f6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56341f43c1b0 0x56341f817db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:47.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.698+0000 7f05d75f6740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56341f444390 0x56341f8182f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:47.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.698+0000 7f05d75f6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56341f465070 0x56341f824110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:47.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.698+0000 7f05d75f6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56341f5d3700 con 0x56341f43c1b0 2024-09-21T00:59:47.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.698+0000 7f05d75f6740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56341f70d160 con 0x56341f444390 2024-09-21T00:59:47.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.698+0000 7f05d75f6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56341f81ae20 con 0x56341f465070 2024-09-21T00:59:47.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.698+0000 7f05d75f6740 10 client.0 _ll_register_callbacks cb 0x56341f7269e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:47.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.698+0000 7f05cad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56341f43c1b0 0x56341f817db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:47.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.698+0000 7f05cb59e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56341f465070 0x56341f824110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:47.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.698+0000 7f05cad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56341f43c1b0 0x56341f817db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42604/0 (socket says 172.21.15.1:42604) 2024-09-21T00:59:47.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.698+0000 7f05cad9d640 1 -- 172.21.15.1:0/4211025681 learned_addr learned my addr 172.21.15.1:0/4211025681 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:47.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.699+0000 7f05ca59c640 1 --2- 172.21.15.1:0/4211025681 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56341f444390 0x56341f8182f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:47.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.699+0000 7f05cad9d640 1 -- 172.21.15.1:0/4211025681 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56341f465070 msgr2=0x56341f824110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:47.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.699+0000 7f05cad9d640 1 --2- 172.21.15.1:0/4211025681 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56341f465070 0x56341f824110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.699+0000 7f05cad9d640 1 -- 172.21.15.1:0/4211025681 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56341f444390 msgr2=0x56341f8182f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:47.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.699+0000 7f05cad9d640 1 --2- 172.21.15.1:0/4211025681 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56341f444390 0x56341f8182f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.699+0000 7f05cad9d640 1 -- 172.21.15.1:0/4211025681 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56341f73ac90 con 0x56341f43c1b0 2024-09-21T00:59:47.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.699+0000 7f05cad9d640 1 --2- 172.21.15.1:0/4211025681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56341f43c1b0 0x56341f817db0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f05bc01dc80 tx=0x7f05bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853320342a443f34 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:47.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.700+0000 7f05aeff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:59:47.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.700+0000 7f05aeff5640 1 -- 172.21.15.1:0/4211025681 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05bc01d250 con 0x56341f43c1b0 2024-09-21T00:59:47.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.700+0000 7f05aeff5640 1 -- 172.21.15.1:0/4211025681 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f05bc01b460 con 0x56341f43c1b0 2024-09-21T00:59:47.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.700+0000 7f05d75f6740 1 -- 172.21.15.1:0/4211025681 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05c00316a0 con 0x56341f43c1b0 2024-09-21T00:59:47.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.701+0000 7f05aeff5640 1 -- 172.21.15.1:0/4211025681 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f05bc01b660 con 0x56341f43c1b0 2024-09-21T00:59:47.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.701+0000 7f05d75f6740 10 client.16281 fetch_fsmap learned FSMap version 31 2024-09-21T00:59:47.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.701+0000 7f05d75f6740 1 -- 172.21.15.1:0/4211025681 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56341f826bf0 con 0x56341f43c1b0 2024-09-21T00:59:47.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.701+0000 7f05aeff5640 1 -- 172.21.15.1:0/4211025681 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05c00316a0 con 0x56341f43c1b0 2024-09-21T00:59:47.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.702+0000 7f05aeff5640 1 -- 172.21.15.1:0/4211025681 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7f05bc024070 con 0x56341f43c1b0 2024-09-21T00:59:47.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.702+0000 7f05d75f6740 10 client.16281 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:59:47.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.702+0000 7f05d75f6740 10 client.16281 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T00:59:47.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.702+0000 7f05d75f6740 20 client.16281 populate_metadata read hostname 'smithi001' 2024-09-21T00:59:47.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.702+0000 7f05d75f6740 1 --2- 172.21.15.1:0/4211025681 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x56341f4239f0 0x56341f82a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:47.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.703+0000 7f05d75f6740 4 client.16281 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:59:47.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.703+0000 7f05d75f6740 1 -- 172.21.15.1:0/4211025681 --> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56341f784df0 con 0x56341f4239f0 2024-09-21T00:59:47.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.703+0000 7f05ca59c640 1 --2- 172.21.15.1:0/4211025681 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x56341f4239f0 0x56341f82a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:47.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.704+0000 7f05aeff5640 10 client.16281 ms_handle_connect on v2:172.21.15.193:6834/3631682268 2024-09-21T00:59:47.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.705+0000 7f05ca59c640 1 --2- 172.21.15.1:0/4211025681 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x56341f4239f0 0x56341f82a0e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=feb3e2a7acff53f6 server_cookie=5fe185769e7de259 in_seq=0 out_seq=0 2024-09-21T00:59:47.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.706+0000 7f05aeff5640 1 -- 172.21.15.1:0/4211025681 <== mds.4 v2:172.21.15.193:6834/3631682268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56341f784df0 con 0x56341f4239f0 2024-09-21T00:59:47.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.706+0000 7f05aeff5640 10 client.16281 handle_command_reply: tid=0 2024-09-21T00:59:47.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.706+0000 7f05d75f6740 1 client.16281 shutdown 2024-09-21T00:59:47.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.707+0000 7f05d75f6740 1 -- 172.21.15.1:0/4211025681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56341f43c1b0 msgr2=0x56341f817db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:47.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.707+0000 7f05d75f6740 1 --2- 172.21.15.1:0/4211025681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56341f43c1b0 0x56341f817db0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f05bc01dc80 tx=0x7f05bc0046c0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.707+0000 7f05d75f6740 1 -- 172.21.15.1:0/4211025681 shutdown_connections 2024-09-21T00:59:47.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.707+0000 7f05d75f6740 1 --2- 172.21.15.1:0/4211025681 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x56341f4239f0 0x56341f82a0e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.707+0000 7f05d75f6740 1 --2- 172.21.15.1:0/4211025681 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56341f465070 0x56341f824110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.707+0000 7f05aeff5640 0 client.16281 ms_handle_reset on v2:172.21.15.193:6834/3631682268 2024-09-21T00:59:47.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.707+0000 7f05d75f6740 1 --2- 172.21.15.1:0/4211025681 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56341f444390 0x56341f8182f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.707+0000 7f05d75f6740 1 --2- 172.21.15.1:0/4211025681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56341f43c1b0 0x56341f817db0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.707+0000 7f05d75f6740 1 -- 172.21.15.1:0/4211025681 >> 172.21.15.1:0/4211025681 conn(0x56341f459460 msgr2=0x56341f80f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:47.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.707+0000 7f05d75f6740 1 -- 172.21.15.1:0/4211025681 shutdown_connections 2024-09-21T00:59:47.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.708+0000 7f05d75f6740 1 -- 172.21.15.1:0/4211025681 wait complete. 2024-09-21T00:59:47.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.708+0000 7f05d75f6740 20 client.16281 trim_cache size 0 max 16384 2024-09-21T00:59:47.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:47 smithi193 ceph-mon[34660]: pgmap v435: 97 pgs: 97 active+clean; 273 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.2 MiB/s wr, 432 op/s 2024-09-21T00:59:47.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.731+0000 7f05d75f6740 1 Processor -- start 2024-09-21T00:59:47.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.731+0000 7f05d75f6740 1 -- start start 2024-09-21T00:59:47.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.731+0000 7f05d75f6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56341f4239f0 0x56341f819c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:47.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.732+0000 7f05d75f6740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56341f43c1b0 0x56341f80dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:47.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.732+0000 7f05d75f6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56341f444390 0x56341f824010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:47.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.732+0000 7f05d75f6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f05cc1ad360 con 0x56341f444390 2024-09-21T00:59:47.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.732+0000 7f05d75f6740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f05cc1af020 con 0x56341f43c1b0 2024-09-21T00:59:47.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.732+0000 7f05d75f6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f05cc1ada30 con 0x56341f4239f0 2024-09-21T00:59:47.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.732+0000 7f05cad9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56341f4239f0 0x56341f819c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:47.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.732+0000 7f05cad9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56341f4239f0 0x56341f819c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:36368/0 (socket says 172.21.15.1:36368) 2024-09-21T00:59:47.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.732+0000 7f05cad9d640 1 -- 172.21.15.1:0/947347219 learned_addr learned my addr 172.21.15.1:0/947347219 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:47.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.732+0000 7f05ca59c640 1 --2- 172.21.15.1:0/947347219 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56341f43c1b0 0x56341f80dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:47.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.732+0000 7f05cb59e640 1 --2- 172.21.15.1:0/947347219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56341f444390 0x56341f824010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:47.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.732+0000 7f05ca59c640 1 -- 172.21.15.1:0/947347219 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56341f4239f0 msgr2=0x56341f819c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:47.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.732+0000 7f05ca59c640 1 --2- 172.21.15.1:0/947347219 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56341f4239f0 0x56341f819c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.732+0000 7f05ca59c640 1 -- 172.21.15.1:0/947347219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56341f444390 msgr2=0x56341f824010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:47.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.732+0000 7f05ca59c640 1 --2- 172.21.15.1:0/947347219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56341f444390 0x56341f824010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.732+0000 7f05ca59c640 1 -- 172.21.15.1:0/947347219 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56341f80af00 con 0x56341f43c1b0 2024-09-21T00:59:47.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.732+0000 7f05ca59c640 1 --2- 172.21.15.1:0/947347219 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56341f43c1b0 0x56341f80dde0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x56341f82a840 tx=0x7f05c0003960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=775d7ff45982dcdc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:47.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.733+0000 7f05b0ff9640 1 -- 172.21.15.1:0/947347219 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c0035040 con 0x56341f43c1b0 2024-09-21T00:59:47.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.733+0000 7f05b0ff9640 1 -- 172.21.15.1:0/947347219 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05c0031660 con 0x56341f43c1b0 2024-09-21T00:59:47.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.733+0000 7f05b0ff9640 1 -- 172.21.15.1:0/947347219 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c0005320 con 0x56341f43c1b0 2024-09-21T00:59:47.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.734+0000 7f05d75f6740 1 -- 172.21.15.1:0/947347219 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56341f43c1b0 msgr2=0x56341f80dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:47.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.734+0000 7f05d75f6740 1 --2- 172.21.15.1:0/947347219 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56341f43c1b0 0x56341f80dde0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x56341f82a840 tx=0x7f05c0003960 comp rx=0 tx=0).stop 2024-09-21T00:59:47.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.734+0000 7f05d75f6740 1 -- 172.21.15.1:0/947347219 shutdown_connections 2024-09-21T00:59:47.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.734+0000 7f05d75f6740 1 --2- 172.21.15.1:0/947347219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56341f444390 0x56341f824010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.734+0000 7f05d75f6740 1 --2- 172.21.15.1:0/947347219 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56341f43c1b0 0x56341f80dde0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.734+0000 7f05d75f6740 1 --2- 172.21.15.1:0/947347219 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56341f4239f0 0x56341f819c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.734+0000 7f05d75f6740 1 -- 172.21.15.1:0/947347219 >> 172.21.15.1:0/947347219 conn(0x56341f459460 msgr2=0x56341f80d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:47.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.734+0000 7f05d75f6740 1 -- 172.21.15.1:0/947347219 shutdown_connections 2024-09-21T00:59:47.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.734+0000 7f05d75f6740 1 -- 172.21.15.1:0/947347219 wait complete. 2024-09-21T00:59:47.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.735+0000 7f05d75f6740 1 -- start start 2024-09-21T00:59:47.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.735+0000 7f05d75f6740 1 Processor -- start 2024-09-21T00:59:47.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.735+0000 7f05d75f6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56341f4239f0 0x56341f81e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:47.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.735+0000 7f05d75f6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56341f43c1b0 0x56341f81e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:47.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.735+0000 7f05d75f6740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56341f444390 0x56341f81ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:47.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.735+0000 7f05d75f6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f05cc1ae890 con 0x56341f43c1b0 2024-09-21T00:59:47.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.735+0000 7f05d75f6740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f05cc1ae1c0 con 0x56341f444390 2024-09-21T00:59:47.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.735+0000 7f05d75f6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f05cc1ab340 con 0x56341f4239f0 2024-09-21T00:59:47.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.735+0000 7f05d75f6740 10 client.0 _ll_register_callbacks cb 0x7f05bc009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:47.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.735+0000 7f05cad9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56341f4239f0 0x56341f81e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:47.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.735+0000 7f05cad9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56341f4239f0 0x56341f81e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:36378/0 (socket says 172.21.15.1:36378) 2024-09-21T00:59:47.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.735+0000 7f05cad9d640 1 -- 172.21.15.1:0/2022556229 learned_addr learned my addr 172.21.15.1:0/2022556229 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:47.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.736+0000 7f05cb59e640 1 --2- 172.21.15.1:0/2022556229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56341f444390 0x56341f81ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:47.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.736+0000 7f05ca59c640 1 --2- 172.21.15.1:0/2022556229 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56341f43c1b0 0x56341f81e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:47.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.736+0000 7f05cad9d640 1 -- 172.21.15.1:0/2022556229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56341f444390 msgr2=0x56341f81ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:47.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.736+0000 7f05cad9d640 1 --2- 172.21.15.1:0/2022556229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56341f444390 0x56341f81ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.736+0000 7f05cad9d640 1 -- 172.21.15.1:0/2022556229 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56341f43c1b0 msgr2=0x56341f81e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:47.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.736+0000 7f05cad9d640 1 --2- 172.21.15.1:0/2022556229 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56341f43c1b0 0x56341f81e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.736+0000 7f05cad9d640 1 -- 172.21.15.1:0/2022556229 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56341f893cb0 con 0x56341f4239f0 2024-09-21T00:59:47.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.736+0000 7f05ca59c640 1 --2- 172.21.15.1:0/2022556229 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56341f43c1b0 0x56341f81e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:59:47.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.736+0000 7f05cad9d640 1 --2- 172.21.15.1:0/2022556229 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56341f4239f0 0x56341f81e230 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f05bc026ae0 tx=0x7f05bc01d2f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=137588e94509659c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:47.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.736+0000 7f05aeff5640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T00:59:47.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.736+0000 7f05aeff5640 1 -- 172.21.15.1:0/2022556229 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05bc026650 con 0x56341f4239f0 2024-09-21T00:59:47.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.736+0000 7f05aeff5640 1 -- 172.21.15.1:0/2022556229 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f05bc010f10 con 0x56341f4239f0 2024-09-21T00:59:47.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.736+0000 7f05d75f6740 1 -- 172.21.15.1:0/2022556229 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05c0031660 con 0x56341f4239f0 2024-09-21T00:59:47.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.737+0000 7f05aeff5640 1 -- 172.21.15.1:0/2022556229 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f05bc011110 con 0x56341f4239f0 2024-09-21T00:59:47.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.737+0000 7f05d75f6740 10 client.25870 fetch_fsmap learned FSMap version 31 2024-09-21T00:59:47.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.737+0000 7f05d75f6740 1 -- 172.21.15.1:0/2022556229 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56341f894f20 con 0x56341f4239f0 2024-09-21T00:59:47.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.737+0000 7f05aeff5640 1 -- 172.21.15.1:0/2022556229 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05c0031660 con 0x56341f4239f0 2024-09-21T00:59:47.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.738+0000 7f05aeff5640 1 -- 172.21.15.1:0/2022556229 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7f05bc024040 con 0x56341f4239f0 2024-09-21T00:59:47.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.738+0000 7f05d75f6740 10 client.25870 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:59:47.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.738+0000 7f05d75f6740 10 client.25870 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T00:59:47.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.738+0000 7f05d75f6740 20 client.25870 populate_metadata read hostname 'smithi001' 2024-09-21T00:59:47.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.738+0000 7f05d75f6740 1 --2- 172.21.15.1:0/2022556229 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x56341f465070 0x56341f897710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:47.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.738+0000 7f05d75f6740 4 client.25870 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:59:47.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.738+0000 7f05d75f6740 1 -- 172.21.15.1:0/2022556229 --> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56341f7808a0 con 0x56341f465070 2024-09-21T00:59:47.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.739+0000 7f05ca59c640 1 --2- 172.21.15.1:0/2022556229 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x56341f465070 0x56341f897710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:47.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.739+0000 7f05aeff5640 10 client.25870 ms_handle_connect on v2:172.21.15.193:6834/3631682268 2024-09-21T00:59:47.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.739+0000 7f05ca59c640 1 --2- 172.21.15.1:0/2022556229 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x56341f465070 0x56341f897710 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=33fdd5346b7a374e server_cookie=1dc929918c6c1a69 in_seq=0 out_seq=0 2024-09-21T00:59:47.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.740+0000 7f05aeff5640 1 -- 172.21.15.1:0/2022556229 <== mds.4 v2:172.21.15.193:6834/3631682268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56341f7808a0 con 0x56341f465070 2024-09-21T00:59:47.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.740+0000 7f05aeff5640 10 client.25870 handle_command_reply: tid=0 2024-09-21T00:59:47.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.740+0000 7f05d75f6740 1 client.25870 shutdown 2024-09-21T00:59:47.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.740+0000 7f05d75f6740 1 -- 172.21.15.1:0/2022556229 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56341f4239f0 msgr2=0x56341f81e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:47.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.740+0000 7f05d75f6740 1 --2- 172.21.15.1:0/2022556229 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56341f4239f0 0x56341f81e230 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f05bc026ae0 tx=0x7f05bc01d2f0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.740+0000 7f05d75f6740 1 -- 172.21.15.1:0/2022556229 shutdown_connections 2024-09-21T00:59:47.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.740+0000 7f05d75f6740 1 --2- 172.21.15.1:0/2022556229 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x56341f465070 0x56341f897710 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.740+0000 7f05d75f6740 1 --2- 172.21.15.1:0/2022556229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56341f444390 0x56341f81ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.740+0000 7f05d75f6740 1 --2- 172.21.15.1:0/2022556229 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56341f43c1b0 0x56341f81e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.740+0000 7f05aeff5640 0 client.25870 ms_handle_reset on v2:172.21.15.193:6834/3631682268 2024-09-21T00:59:47.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.740+0000 7f05d75f6740 1 --2- 172.21.15.1:0/2022556229 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56341f4239f0 0x56341f81e230 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.740+0000 7f05d75f6740 1 -- 172.21.15.1:0/2022556229 >> 172.21.15.1:0/2022556229 conn(0x56341f459460 msgr2=0x56341f8199f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:47.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.740+0000 7f05d75f6740 1 -- 172.21.15.1:0/2022556229 shutdown_connections 2024-09-21T00:59:47.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.740+0000 7f05d75f6740 1 -- 172.21.15.1:0/2022556229 wait complete. 2024-09-21T00:59:47.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.740+0000 7f05d75f6740 20 client.25870 trim_cache size 0 max 16384 2024-09-21T00:59:47.744 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T00:59:47.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.741+0000 7f05d1082640 1 -- 172.21.15.1:0/2210590916 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f05b40b6590 msgr2=0x7f05b40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:47.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.741+0000 7f05d1082640 1 --2- 172.21.15.1:0/2210590916 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f05b40b6590 0x7f05b40b8aa0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x56341f80b320 tx=0x7f05bc005f90 comp rx=0 tx=0).stop 2024-09-21T00:59:47.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.741+0000 7f05d1082640 1 -- 172.21.15.1:0/2210590916 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05cc10de10 msgr2=0x7f05cc19fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:47.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.741+0000 7f05d1082640 1 --2- 172.21.15.1:0/2210590916 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05cc10de10 0x7f05cc19fd00 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f05c4009d10 tx=0x7f05c4007590 comp rx=0 tx=0).stop 2024-09-21T00:59:47.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.741+0000 7f05d1082640 1 -- 172.21.15.1:0/2210590916 shutdown_connections 2024-09-21T00:59:47.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.741+0000 7f05d1082640 1 --2- 172.21.15.1:0/2210590916 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f05b40b6590 0x7f05b40b8aa0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.741+0000 7f05d1082640 1 --2- 172.21.15.1:0/2210590916 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05cc10de10 0x7f05cc19fd00 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.741+0000 7f05d1082640 1 --2- 172.21.15.1:0/2210590916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05cc105300 0x7f05cc19aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.741+0000 7f05d1082640 1 --2- 172.21.15.1:0/2210590916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05cc1049b0 0x7f05cc19a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.741+0000 7f05d1082640 1 -- 172.21.15.1:0/2210590916 >> 172.21.15.1:0/2210590916 conn(0x7f05cc079730 msgr2=0x7f05cc100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:47.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.742+0000 7f05d1082640 1 -- 172.21.15.1:0/2210590916 shutdown_connections 2024-09-21T00:59:47.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:47.742+0000 7f05d1082640 1 -- 172.21.15.1:0/2210590916 wait complete. 2024-09-21T00:59:47.746 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:47 smithi042 ceph-mon[34481]: pgmap v435: 97 pgs: 97 active+clean; 273 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.2 MiB/s wr, 432 op/s 2024-09-21T00:59:48.648 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T00:59:48.979 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:59:49.354 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:49 smithi001 ceph-mon[31211]: pgmap v436: 97 pgs: 97 active+clean; 276 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.5 MiB/s wr, 443 op/s 2024-09-21T00:59:49.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:49 smithi193 ceph-mon[34660]: pgmap v436: 97 pgs: 97 active+clean; 276 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.5 MiB/s wr, 443 op/s 2024-09-21T00:59:49.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:49 smithi042 ceph-mon[34481]: pgmap v436: 97 pgs: 97 active+clean; 276 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.5 MiB/s wr, 443 op/s 2024-09-21T00:59:49.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.785+0000 7f8228f3e640 1 -- 172.21.15.1:0/2668049141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8224110490 msgr2=0x7f822407b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:49.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.785+0000 7f8228f3e640 1 --2- 172.21.15.1:0/2668049141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8224110490 0x7f822407b690 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f821c009be0 tx=0x7f821c02a6f0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.789+0000 7f8228f3e640 1 -- 172.21.15.1:0/2668049141 shutdown_connections 2024-09-21T00:59:49.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.789+0000 7f8228f3e640 1 --2- 172.21.15.1:0/2668049141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8224110490 0x7f822407b690 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.789+0000 7f8228f3e640 1 --2- 172.21.15.1:0/2668049141 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f822410fb40 0x7f822410ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.789+0000 7f8228f3e640 1 --2- 172.21.15.1:0/2668049141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f822410baf0 0x7f822410bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.789+0000 7f8228f3e640 1 -- 172.21.15.1:0/2668049141 >> 172.21.15.1:0/2668049141 conn(0x7f8224070ec0 msgr2=0x7f82240712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:49.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.791+0000 7f8228f3e640 1 -- 172.21.15.1:0/2668049141 shutdown_connections 2024-09-21T00:59:49.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.791+0000 7f8228f3e640 1 -- 172.21.15.1:0/2668049141 wait complete. 2024-09-21T00:59:49.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.793+0000 7f8228f3e640 1 Processor -- start 2024-09-21T00:59:49.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.798+0000 7f8228f3e640 1 -- start start 2024-09-21T00:59:49.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.798+0000 7f8228f3e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f822410baf0 0x7f8224075bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:49.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.798+0000 7f8228f3e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f822410fb40 0x7f8224076110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:49.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.798+0000 7f8228f3e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8224110490 0x7f8224076650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:49.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.798+0000 7f8228f3e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f822407e290 con 0x7f822410fb40 2024-09-21T00:59:49.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.798+0000 7f8228f3e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f822407e110 con 0x7f8224110490 2024-09-21T00:59:49.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.798+0000 7f8228f3e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f822407e410 con 0x7f822410baf0 2024-09-21T00:59:49.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.799+0000 7f821bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f822410fb40 0x7f8224076110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:49.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.799+0000 7f821bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f822410fb40 0x7f8224076110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35614/0 (socket says 172.21.15.1:35614) 2024-09-21T00:59:49.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.799+0000 7f821bfff640 1 -- 172.21.15.1:0/1707389839 learned_addr learned my addr 172.21.15.1:0/1707389839 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:49.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.799+0000 7f8222d9d640 1 --2- 172.21.15.1:0/1707389839 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8224110490 0x7f8224076650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:49.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.800+0000 7f821bfff640 1 -- 172.21.15.1:0/1707389839 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f822410baf0 msgr2=0x7f8224075bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T00:59:49.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.800+0000 7f821bfff640 1 --2- 172.21.15.1:0/1707389839 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f822410baf0 0x7f8224075bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.800+0000 7f821bfff640 1 -- 172.21.15.1:0/1707389839 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8224110490 msgr2=0x7f8224076650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:49.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.800+0000 7f821bfff640 1 --2- 172.21.15.1:0/1707389839 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8224110490 0x7f8224076650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.800+0000 7f821bfff640 1 -- 172.21.15.1:0/1707389839 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8224138e30 con 0x7f822410fb40 2024-09-21T00:59:49.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.800+0000 7f821bfff640 1 --2- 172.21.15.1:0/1707389839 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f822410fb40 0x7f8224076110 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f820c00c8c0 tx=0x7f820c00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:49.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.801+0000 7f821b7fe640 1 -- 172.21.15.1:0/1707389839 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820c007bb0 con 0x7f822410fb40 2024-09-21T00:59:49.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.801+0000 7f821b7fe640 1 -- 172.21.15.1:0/1707389839 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f820c007d50 con 0x7f822410fb40 2024-09-21T00:59:49.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.801+0000 7f821b7fe640 1 -- 172.21.15.1:0/1707389839 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820c018790 con 0x7f822410fb40 2024-09-21T00:59:49.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.804+0000 7f8228f3e640 1 -- 172.21.15.1:0/1707389839 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8224139120 con 0x7f822410fb40 2024-09-21T00:59:49.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.804+0000 7f8228f3e640 1 -- 172.21.15.1:0/1707389839 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82241395e0 con 0x7f822410fb40 2024-09-21T00:59:49.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.808+0000 7f822f4b2740 1 Processor -- start 2024-09-21T00:59:49.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.816+0000 7f822f4b2740 1 -- start start 2024-09-21T00:59:49.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.816+0000 7f822f4b2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56210753f070 0x5621078e62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:49.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.816+0000 7f822f4b2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5621075161b0 0x5621078e6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:49.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.817+0000 7f822f4b2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56210751e390 0x5621078e6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:49.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.817+0000 7f822f4b2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56210785cea0 con 0x56210753f070 2024-09-21T00:59:49.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.817+0000 7f822f4b2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56210784c2d0 con 0x5621075161b0 2024-09-21T00:59:49.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.817+0000 7f822f4b2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5621078500e0 con 0x56210751e390 2024-09-21T00:59:49.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.817+0000 7f821b7fe640 1 -- 172.21.15.1:0/1707389839 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f820c00fa00 con 0x7f822410fb40 2024-09-21T00:59:49.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.818+0000 7f821bfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56210751e390 0x5621078e6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:49.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.818+0000 7f821bfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56210751e390 0x5621078e6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:48906/0 (socket says 172.21.15.1:48906) 2024-09-21T00:59:49.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.818+0000 7f821bfff640 1 -- 172.21.15.1:0/2698480539 learned_addr learned my addr 172.21.15.1:0/2698480539 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:49.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.818+0000 7f8222d9d640 1 --2- 172.21.15.1:0/2698480539 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56210753f070 0x5621078e62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:49.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.818+0000 7f822259c640 1 --2- 172.21.15.1:0/2698480539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5621075161b0 0x5621078e6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:49.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.818+0000 7f821bfff640 1 -- 172.21.15.1:0/2698480539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5621075161b0 msgr2=0x5621078e6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:49.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.818+0000 7f821bfff640 1 --2- 172.21.15.1:0/2698480539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5621075161b0 0x5621078e6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.818+0000 7f821bfff640 1 -- 172.21.15.1:0/2698480539 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56210753f070 msgr2=0x5621078e62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:49.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.818+0000 7f821bfff640 1 --2- 172.21.15.1:0/2698480539 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56210753f070 0x5621078e62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.818+0000 7f821bfff640 1 -- 172.21.15.1:0/2698480539 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621075aa650 con 0x56210751e390 2024-09-21T00:59:49.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.819+0000 7f821bfff640 1 --2- 172.21.15.1:0/2698480539 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56210751e390 0x5621078e6d40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f820c0e4040 tx=0x7f820c0eac60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c617a6775d085f14 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:49.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.820+0000 7f8218ff9640 1 -- 172.21.15.1:0/2698480539 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820c0eb060 con 0x56210751e390 2024-09-21T00:59:49.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.820+0000 7f8218ff9640 1 -- 172.21.15.1:0/2698480539 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f820c0eae50 con 0x56210751e390 2024-09-21T00:59:49.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.820+0000 7f821b7fe640 1 --2- 172.21.15.1:0/1707389839 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f82100b6710 0x7f82100b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:49.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.821+0000 7f821b7fe640 1 -- 172.21.15.1:0/1707389839 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f820c0ea170 con 0x7f822410fb40 2024-09-21T00:59:49.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.821+0000 7f822f4b2740 1 -- 172.21.15.1:0/2698480539 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56210751e390 msgr2=0x5621078e6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:49.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.821+0000 7f822f4b2740 1 --2- 172.21.15.1:0/2698480539 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56210751e390 0x5621078e6d40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f820c0e4040 tx=0x7f820c0eac60 comp rx=0 tx=0).stop 2024-09-21T00:59:49.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.821+0000 7f8222d9d640 1 --2- 172.21.15.1:0/2698480539 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56210753f070 0x5621078e62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:59:49.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.822+0000 7f8222d9d640 1 --2- 172.21.15.1:0/1707389839 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f82100b6710 0x7f82100b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:49.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.822+0000 7f822f4b2740 1 -- 172.21.15.1:0/2698480539 shutdown_connections 2024-09-21T00:59:49.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.822+0000 7f822f4b2740 1 --2- 172.21.15.1:0/2698480539 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56210751e390 0x5621078e6d40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.822+0000 7f822f4b2740 1 --2- 172.21.15.1:0/2698480539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5621075161b0 0x5621078e6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.822+0000 7f822f4b2740 1 --2- 172.21.15.1:0/2698480539 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56210753f070 0x5621078e62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.822+0000 7f822f4b2740 1 -- 172.21.15.1:0/2698480539 >> 172.21.15.1:0/2698480539 conn(0x562107533460 msgr2=0x5621078e41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:49.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.825+0000 7f822f4b2740 1 -- 172.21.15.1:0/2698480539 shutdown_connections 2024-09-21T00:59:49.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.825+0000 7f8222d9d640 1 --2- 172.21.15.1:0/1707389839 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f82100b6710 0x7f82100b8c20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f821c02ace0 tx=0x7f821c005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:49.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.826+0000 7f822f4b2740 1 -- 172.21.15.1:0/2698480539 wait complete. 2024-09-21T00:59:49.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.826+0000 7f822f4b2740 1 -- start start 2024-09-21T00:59:49.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.827+0000 7f822f4b2740 1 Processor -- start 2024-09-21T00:59:49.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.828+0000 7f822f4b2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621075161b0 0x5621078f18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:49.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.828+0000 7f822f4b2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56210751e390 0x5621078f1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:49.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.828+0000 7f822f4b2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56210753f070 0x5621078f2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:49.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.829+0000 7f821bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56210751e390 0x5621078f1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:49.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.829+0000 7f821bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56210751e390 0x5621078f1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:56976/0 (socket says 172.21.15.1:56976) 2024-09-21T00:59:49.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.829+0000 7f822f4b2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5621076ad700 con 0x56210753f070 2024-09-21T00:59:49.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.829+0000 7f822f4b2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5621077e7160 con 0x56210751e390 2024-09-21T00:59:49.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.829+0000 7f822f4b2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5621078f4a90 con 0x5621075161b0 2024-09-21T00:59:49.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.829+0000 7f822f4b2740 10 client.0 _ll_register_callbacks cb 0x5621078009e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:49.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.829+0000 7f821bfff640 1 -- 172.21.15.1:0/3252986846 learned_addr learned my addr 172.21.15.1:0/3252986846 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:49.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.829+0000 7f8222d9d640 1 --2- 172.21.15.1:0/3252986846 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56210753f070 0x5621078f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:49.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.829+0000 7f821bfff640 1 -- 172.21.15.1:0/3252986846 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621075161b0 msgr2=0x5621078f18c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T00:59:49.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.829+0000 7f821bfff640 1 --2- 172.21.15.1:0/3252986846 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621075161b0 0x5621078f18c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.829+0000 7f821bfff640 1 -- 172.21.15.1:0/3252986846 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56210753f070 msgr2=0x5621078f2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:49.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.829+0000 7f821bfff640 1 --2- 172.21.15.1:0/3252986846 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56210753f070 0x5621078f2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.829+0000 7f821bfff640 1 -- 172.21.15.1:0/3252986846 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562107814c90 con 0x56210751e390 2024-09-21T00:59:49.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.830+0000 7f821bfff640 1 --2- 172.21.15.1:0/3252986846 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56210751e390 0x5621078f1e00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f820c0a8de0 tx=0x7f820c00fcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b84ed5049dcdab0b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:49.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.830+0000 7f8222d9d640 1 --2- 172.21.15.1:0/3252986846 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56210753f070 0x5621078f2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:59:49.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.831+0000 7f8209ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T00:59:49.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.831+0000 7f8209ffb640 1 -- 172.21.15.1:0/3252986846 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820c0a8e60 con 0x56210751e390 2024-09-21T00:59:49.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.831+0000 7f822f4b2740 1 -- 172.21.15.1:0/3252986846 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f820c0eae50 con 0x56210751e390 2024-09-21T00:59:49.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.831+0000 7f8209ffb640 1 -- 172.21.15.1:0/3252986846 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f820c0e68b0 con 0x56210751e390 2024-09-21T00:59:49.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.831+0000 7f8209ffb640 1 -- 172.21.15.1:0/3252986846 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f820c0e6e90 con 0x56210751e390 2024-09-21T00:59:49.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.833+0000 7f822f4b2740 10 client.25961 fetch_fsmap learned FSMap version 31 2024-09-21T00:59:49.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.833+0000 7f822f4b2740 1 -- 172.21.15.1:0/3252986846 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5621079006d0 con 0x56210751e390 2024-09-21T00:59:49.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.836+0000 7f8209ffb640 1 -- 172.21.15.1:0/3252986846 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f820c0eae50 con 0x56210751e390 2024-09-21T00:59:49.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.836+0000 7f8209ffb640 1 -- 172.21.15.1:0/3252986846 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7f820c0f1040 con 0x56210751e390 2024-09-21T00:59:49.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.838+0000 7f822f4b2740 10 client.25961 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:59:49.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.838+0000 7f822f4b2740 10 client.25961 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-21T00:59:49.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.838+0000 7f822f4b2740 20 client.25961 populate_metadata read hostname 'smithi001' 2024-09-21T00:59:49.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.838+0000 7f822f4b2740 1 --2- 172.21.15.1:0/3252986846 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x5621074fd9f0 0x562107903c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:49.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.838+0000 7f822f4b2740 4 client.25961 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:59:49.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.838+0000 7f822f4b2740 1 -- 172.21.15.1:0/3252986846 --> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56210785edf0 con 0x5621074fd9f0 2024-09-21T00:59:49.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.839+0000 7f822259c640 1 --2- 172.21.15.1:0/3252986846 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x5621074fd9f0 0x562107903c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:49.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.842+0000 7f822259c640 1 --2- 172.21.15.1:0/3252986846 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x5621074fd9f0 0x562107903c80 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7696ff118c2d7172 server_cookie=f8e7dfde1a99219f in_seq=0 out_seq=0 2024-09-21T00:59:49.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.843+0000 7f8209ffb640 10 client.25961 ms_handle_connect on v2:172.21.15.193:6836/909252228 2024-09-21T00:59:49.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.846+0000 7f8209ffb640 1 -- 172.21.15.1:0/3252986846 <== mds.3 v2:172.21.15.193:6836/909252228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56210785edf0 con 0x5621074fd9f0 2024-09-21T00:59:49.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.846+0000 7f8209ffb640 10 client.25961 handle_command_reply: tid=0 2024-09-21T00:59:49.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.846+0000 7f822f4b2740 1 client.25961 shutdown 2024-09-21T00:59:49.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.849+0000 7f822f4b2740 1 -- 172.21.15.1:0/3252986846 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56210751e390 msgr2=0x5621078f1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:49.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.849+0000 7f822f4b2740 1 --2- 172.21.15.1:0/3252986846 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56210751e390 0x5621078f1e00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f820c0a8de0 tx=0x7f820c00fcf0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.851+0000 7f822f4b2740 1 -- 172.21.15.1:0/3252986846 shutdown_connections 2024-09-21T00:59:49.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.851+0000 7f822f4b2740 1 --2- 172.21.15.1:0/3252986846 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x5621074fd9f0 0x562107903c80 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.851+0000 7f822f4b2740 1 --2- 172.21.15.1:0/3252986846 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56210753f070 0x5621078f2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.851+0000 7f822f4b2740 1 --2- 172.21.15.1:0/3252986846 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56210751e390 0x5621078f1e00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.851+0000 7f822f4b2740 1 --2- 172.21.15.1:0/3252986846 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621075161b0 0x5621078f18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.851+0000 7f822f4b2740 1 -- 172.21.15.1:0/3252986846 >> 172.21.15.1:0/3252986846 conn(0x562107533460 msgr2=0x5621078e94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:49.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.852+0000 7f8209ffb640 0 client.25961 ms_handle_reset on v2:172.21.15.193:6836/909252228 2024-09-21T00:59:49.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.854+0000 7f822f4b2740 1 -- 172.21.15.1:0/3252986846 shutdown_connections 2024-09-21T00:59:49.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.858+0000 7f822f4b2740 1 -- 172.21.15.1:0/3252986846 wait complete. 2024-09-21T00:59:49.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.859+0000 7f822f4b2740 20 client.25961 trim_cache size 0 max 16384 2024-09-21T00:59:49.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.892+0000 7f822f4b2740 1 Processor -- start 2024-09-21T00:59:49.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.892+0000 7f822f4b2740 1 -- start start 2024-09-21T00:59:49.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.892+0000 7f822f4b2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621075161b0 0x5621078e7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:49.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.892+0000 7f822f4b2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56210751e390 0x5621078f37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:49.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.892+0000 7f822f4b2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56210753f070 0x5621078f1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:49.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.893+0000 7f822259c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621075161b0 0x5621078e7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:49.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.893+0000 7f822259c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621075161b0 0x5621078e7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:48918/0 (socket says 172.21.15.1:48918) 2024-09-21T00:59:49.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.893+0000 7f822259c640 1 -- 172.21.15.1:0/1242958556 learned_addr learned my addr 172.21.15.1:0/1242958556 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:49.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.893+0000 7f8222d9d640 1 --2- 172.21.15.1:0/1242958556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56210753f070 0x5621078f1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:49.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.893+0000 7f822f4b2740 1 -- 172.21.15.1:0/1242958556 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f82241d7c30 con 0x56210751e390 2024-09-21T00:59:49.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.893+0000 7f822f4b2740 1 -- 172.21.15.1:0/1242958556 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f82241d98f0 con 0x56210753f070 2024-09-21T00:59:49.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.893+0000 7f822f4b2740 1 -- 172.21.15.1:0/1242958556 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f82241d8300 con 0x5621075161b0 2024-09-21T00:59:49.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.893+0000 7f821bfff640 1 --2- 172.21.15.1:0/1242958556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56210751e390 0x5621078f37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:49.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.894+0000 7f821bfff640 1 -- 172.21.15.1:0/1242958556 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621075161b0 msgr2=0x5621078e7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:49.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.894+0000 7f821bfff640 1 --2- 172.21.15.1:0/1242958556 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621075161b0 0x5621078e7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.894+0000 7f821bfff640 1 -- 172.21.15.1:0/1242958556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56210753f070 msgr2=0x5621078f1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:49.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.894+0000 7f821bfff640 1 --2- 172.21.15.1:0/1242958556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56210753f070 0x5621078f1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.894+0000 7f821bfff640 1 -- 172.21.15.1:0/1242958556 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621078e46f0 con 0x56210751e390 2024-09-21T00:59:49.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.894+0000 7f821bfff640 1 --2- 172.21.15.1:0/1242958556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56210751e390 0x5621078f37a0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f820c0ac7a0 tx=0x7f820c0e64f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b38dc8f0f4d22e08 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:49.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.895+0000 7f820bfff640 1 -- 172.21.15.1:0/1242958556 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820c0abf80 con 0x56210751e390 2024-09-21T00:59:49.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.895+0000 7f820bfff640 1 -- 172.21.15.1:0/1242958556 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f820c0eae50 con 0x56210751e390 2024-09-21T00:59:49.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.897+0000 7f822f4b2740 1 -- 172.21.15.1:0/1242958556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56210751e390 msgr2=0x5621078f37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:49.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.897+0000 7f822f4b2740 1 --2- 172.21.15.1:0/1242958556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56210751e390 0x5621078f37a0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f820c0ac7a0 tx=0x7f820c0e64f0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.898+0000 7f822f4b2740 1 -- 172.21.15.1:0/1242958556 shutdown_connections 2024-09-21T00:59:49.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.898+0000 7f822f4b2740 1 --2- 172.21.15.1:0/1242958556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56210753f070 0x5621078f1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.898+0000 7f822f4b2740 1 --2- 172.21.15.1:0/1242958556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56210751e390 0x5621078f37a0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.898+0000 7f822f4b2740 1 --2- 172.21.15.1:0/1242958556 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621075161b0 0x5621078e7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.898+0000 7f822f4b2740 1 -- 172.21.15.1:0/1242958556 >> 172.21.15.1:0/1242958556 conn(0x562107533460 msgr2=0x5621078f1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:49.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.900+0000 7f822f4b2740 1 -- 172.21.15.1:0/1242958556 shutdown_connections 2024-09-21T00:59:49.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.900+0000 7f822f4b2740 1 -- 172.21.15.1:0/1242958556 wait complete. 2024-09-21T00:59:49.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.901+0000 7f822f4b2740 1 -- start start 2024-09-21T00:59:49.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.901+0000 7f822f4b2740 1 Processor -- start 2024-09-21T00:59:49.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.902+0000 7f822f4b2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621075161b0 0x5621078f5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:49.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.902+0000 7f822f4b2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56210751e390 0x5621078f5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:49.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.902+0000 7f822f4b2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56210753f070 0x5621079666b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:49.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.902+0000 7f822f4b2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f82241d9160 con 0x56210751e390 2024-09-21T00:59:49.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.902+0000 7f822f4b2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f82241d8a90 con 0x56210753f070 2024-09-21T00:59:49.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.902+0000 7f822f4b2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f82241d5c10 con 0x5621075161b0 2024-09-21T00:59:49.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.902+0000 7f822f4b2740 10 client.0 _ll_register_callbacks cb 0x7f820c0ea650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:49.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.902+0000 7f8222d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56210753f070 0x5621079666b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:49.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.902+0000 7f8222d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56210753f070 0x5621079666b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:57000/0 (socket says 172.21.15.1:57000) 2024-09-21T00:59:49.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.902+0000 7f8222d9d640 1 -- 172.21.15.1:0/866352121 learned_addr learned my addr 172.21.15.1:0/866352121 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:49.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.902+0000 7f822259c640 1 --2- 172.21.15.1:0/866352121 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621075161b0 0x5621078f5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:49.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.903+0000 7f8222d9d640 1 -- 172.21.15.1:0/866352121 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621075161b0 msgr2=0x5621078f5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:49.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.903+0000 7f8222d9d640 1 --2- 172.21.15.1:0/866352121 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621075161b0 0x5621078f5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.903+0000 7f8222d9d640 1 -- 172.21.15.1:0/866352121 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56210751e390 msgr2=0x5621078f5c30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T00:59:49.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.903+0000 7f8222d9d640 1 --2- 172.21.15.1:0/866352121 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56210751e390 0x5621078f5c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.903+0000 7f8222d9d640 1 -- 172.21.15.1:0/866352121 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562107966d20 con 0x56210753f070 2024-09-21T00:59:49.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.903+0000 7f8222d9d640 1 --2- 172.21.15.1:0/866352121 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56210753f070 0x5621079666b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f821c009be0 tx=0x7f821c02a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75d77d6f557c11da server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:49.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.908+0000 7f8209ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T00:59:49.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.908+0000 7f8209ffb640 1 -- 172.21.15.1:0/866352121 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c04f070 con 0x56210753f070 2024-09-21T00:59:49.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.908+0000 7f822f4b2740 1 -- 172.21.15.1:0/866352121 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f820c0eae50 con 0x56210753f070 2024-09-21T00:59:49.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.908+0000 7f8209ffb640 1 -- 172.21.15.1:0/866352121 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f821c030e40 con 0x56210753f070 2024-09-21T00:59:49.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.908+0000 7f8209ffb640 1 -- 172.21.15.1:0/866352121 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f821c05b050 con 0x56210753f070 2024-09-21T00:59:49.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.910+0000 7f822f4b2740 10 client.25967 fetch_fsmap learned FSMap version 31 2024-09-21T00:59:49.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.910+0000 7f822f4b2740 1 -- 172.21.15.1:0/866352121 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56210796e070 con 0x56210753f070 2024-09-21T00:59:49.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.910+0000 7f8209ffb640 1 -- 172.21.15.1:0/866352121 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f820c0eae50 con 0x56210753f070 2024-09-21T00:59:49.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.911+0000 7f8209ffb640 1 -- 172.21.15.1:0/866352121 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7f821c004450 con 0x56210753f070 2024-09-21T00:59:49.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.911+0000 7f822f4b2740 10 client.25967 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:59:49.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.911+0000 7f822f4b2740 10 client.25967 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-21T00:59:49.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.911+0000 7f822f4b2740 20 client.25967 populate_metadata read hostname 'smithi001' 2024-09-21T00:59:49.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.911+0000 7f822f4b2740 1 --2- 172.21.15.1:0/866352121 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x5621074d2da0 0x562107970840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:49.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.911+0000 7f822f4b2740 4 client.25967 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:59:49.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.911+0000 7f822f4b2740 1 -- 172.21.15.1:0/866352121 --> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56210785a8a0 con 0x5621074d2da0 2024-09-21T00:59:49.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.911+0000 7f822259c640 1 --2- 172.21.15.1:0/866352121 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x5621074d2da0 0x562107970840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:49.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.912+0000 7f822259c640 1 --2- 172.21.15.1:0/866352121 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x5621074d2da0 0x562107970840 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=eae43008aa8dff08 server_cookie=9ead355e8063371f in_seq=0 out_seq=0 2024-09-21T00:59:49.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.912+0000 7f8209ffb640 10 client.25967 ms_handle_connect on v2:172.21.15.193:6836/909252228 2024-09-21T00:59:49.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.912+0000 7f8209ffb640 1 -- 172.21.15.1:0/866352121 <== mds.3 v2:172.21.15.193:6836/909252228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56210785a8a0 con 0x5621074d2da0 2024-09-21T00:59:49.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.912+0000 7f8209ffb640 10 client.25967 handle_command_reply: tid=0 2024-09-21T00:59:49.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.912+0000 7f822f4b2740 1 client.25967 shutdown 2024-09-21T00:59:49.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.914+0000 7f822f4b2740 1 -- 172.21.15.1:0/866352121 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56210753f070 msgr2=0x5621079666b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:49.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.914+0000 7f822f4b2740 1 --2- 172.21.15.1:0/866352121 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56210753f070 0x5621079666b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f821c009be0 tx=0x7f821c02a6f0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.914+0000 7f822f4b2740 1 -- 172.21.15.1:0/866352121 shutdown_connections 2024-09-21T00:59:49.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.914+0000 7f822f4b2740 1 --2- 172.21.15.1:0/866352121 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x5621074d2da0 0x562107970840 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.914+0000 7f822f4b2740 1 --2- 172.21.15.1:0/866352121 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56210753f070 0x5621079666b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.914+0000 7f822f4b2740 1 --2- 172.21.15.1:0/866352121 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56210751e390 0x5621078f5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.914+0000 7f822f4b2740 1 --2- 172.21.15.1:0/866352121 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621075161b0 0x5621078f5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.914+0000 7f8209ffb640 0 client.25967 ms_handle_reset on v2:172.21.15.193:6836/909252228 2024-09-21T00:59:49.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.914+0000 7f822f4b2740 1 -- 172.21.15.1:0/866352121 >> 172.21.15.1:0/866352121 conn(0x562107533460 msgr2=0x5621078f2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:49.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.915+0000 7f822f4b2740 1 -- 172.21.15.1:0/866352121 shutdown_connections 2024-09-21T00:59:49.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.915+0000 7f822f4b2740 1 -- 172.21.15.1:0/866352121 wait complete. 2024-09-21T00:59:49.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.915+0000 7f822f4b2740 20 client.25967 trim_cache size 0 max 16384 2024-09-21T00:59:49.917 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T00:59:49.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.917+0000 7f8228f3e640 1 -- 172.21.15.1:0/1707389839 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f82100b6710 msgr2=0x7f82100b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:49.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.917+0000 7f8228f3e640 1 --2- 172.21.15.1:0/1707389839 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f82100b6710 0x7f82100b8c20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f821c02ace0 tx=0x7f821c005fd0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.917+0000 7f8228f3e640 1 -- 172.21.15.1:0/1707389839 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f822410fb40 msgr2=0x7f8224076110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:49.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.917+0000 7f8228f3e640 1 --2- 172.21.15.1:0/1707389839 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f822410fb40 0x7f8224076110 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f820c00c8c0 tx=0x7f820c00cd80 comp rx=0 tx=0).stop 2024-09-21T00:59:49.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.918+0000 7f8228f3e640 1 -- 172.21.15.1:0/1707389839 shutdown_connections 2024-09-21T00:59:49.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.918+0000 7f8228f3e640 1 --2- 172.21.15.1:0/1707389839 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8224110490 0x7f8224076650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.918+0000 7f8228f3e640 1 --2- 172.21.15.1:0/1707389839 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f82100b6710 0x7f82100b8c20 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.918+0000 7f8228f3e640 1 --2- 172.21.15.1:0/1707389839 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f822410fb40 0x7f8224076110 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.918+0000 7f8228f3e640 1 --2- 172.21.15.1:0/1707389839 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f822410baf0 0x7f8224075bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.918+0000 7f8228f3e640 1 -- 172.21.15.1:0/1707389839 >> 172.21.15.1:0/1707389839 conn(0x7f8224070ec0 msgr2=0x7f822410cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:49.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.918+0000 7f8228f3e640 1 -- 172.21.15.1:0/1707389839 shutdown_connections 2024-09-21T00:59:49.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:49.918+0000 7f8228f3e640 1 -- 172.21.15.1:0/1707389839 wait complete. 2024-09-21T00:59:51.157 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T00:59:51.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:51 smithi001 ceph-mon[31211]: pgmap v437: 97 pgs: 97 active+clean; 277 MiB data, 782 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.2 MiB/s wr, 436 op/s 2024-09-21T00:59:51.583 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:59:51.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:51 smithi193 ceph-mon[34660]: pgmap v437: 97 pgs: 97 active+clean; 277 MiB data, 782 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.2 MiB/s wr, 436 op/s 2024-09-21T00:59:51.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:51 smithi042 ceph-mon[34481]: pgmap v437: 97 pgs: 97 active+clean; 277 MiB data, 782 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.2 MiB/s wr, 436 op/s 2024-09-21T00:59:52.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.314+0000 7fb5b6683640 1 -- 172.21.15.1:0/4158275576 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5b0109570 msgr2=0x7fb5b0109980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:52.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.314+0000 7fb5b6683640 1 --2- 172.21.15.1:0/4158275576 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5b0109570 0x7fb5b0109980 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4009900 tx=0x7fb5a402a410 comp rx=0 tx=0).stop 2024-09-21T00:59:52.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.315+0000 7fb5b6683640 1 -- 172.21.15.1:0/4158275576 shutdown_connections 2024-09-21T00:59:52.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.315+0000 7fb5b6683640 1 --2- 172.21.15.1:0/4158275576 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5b0109ec0 0x7fb5b01106f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.315+0000 7fb5b6683640 1 --2- 172.21.15.1:0/4158275576 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5b0109570 0x7fb5b0109980 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.315+0000 7fb5b6683640 1 --2- 172.21.15.1:0/4158275576 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb5b0103c30 0x7fb5b0104040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.315+0000 7fb5b6683640 1 -- 172.21.15.1:0/4158275576 >> 172.21.15.1:0/4158275576 conn(0x7fb5b007b8d0 msgr2=0x7fb5b007bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:52.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.315+0000 7fb5b6683640 1 -- 172.21.15.1:0/4158275576 shutdown_connections 2024-09-21T00:59:52.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.315+0000 7fb5b6683640 1 -- 172.21.15.1:0/4158275576 wait complete. 2024-09-21T00:59:52.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.317+0000 7fb5b6683640 1 Processor -- start 2024-09-21T00:59:52.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.318+0000 7fb5b6683640 1 -- start start 2024-09-21T00:59:52.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.319+0000 7fb5b6683640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5b0103c30 0x7fb5b019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:52.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.319+0000 7fb5affff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5b0103c30 0x7fb5b019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:52.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.319+0000 7fb5affff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5b0103c30 0x7fb5b019a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35662/0 (socket says 172.21.15.1:35662) 2024-09-21T00:59:52.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.319+0000 7fb5affff640 1 -- 172.21.15.1:0/2292565146 learned_addr learned my addr 172.21.15.1:0/2292565146 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:52.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.319+0000 7fb5b6683640 1 --2- 172.21.15.1:0/2292565146 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5b0109570 0x7fb5b019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:52.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.320+0000 7fb5b6683640 1 --2- 172.21.15.1:0/2292565146 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb5b0109ec0 0x7fb5b019fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:52.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.320+0000 7fb5af7fe640 1 --2- 172.21.15.1:0/2292565146 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5b0109570 0x7fb5b019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:52.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.320+0000 7fb5b6683640 1 -- 172.21.15.1:0/2292565146 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b0113b30 con 0x7fb5b0103c30 2024-09-21T00:59:52.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.320+0000 7fb5b4c20640 1 --2- 172.21.15.1:0/2292565146 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb5b0109ec0 0x7fb5b019fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:52.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.320+0000 7fb5b6683640 1 -- 172.21.15.1:0/2292565146 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b01139b0 con 0x7fb5b0109570 2024-09-21T00:59:52.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.320+0000 7fb5b6683640 1 -- 172.21.15.1:0/2292565146 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b0113cb0 con 0x7fb5b0109ec0 2024-09-21T00:59:52.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.323+0000 7fb5af7fe640 1 -- 172.21.15.1:0/2292565146 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb5b0109ec0 msgr2=0x7fb5b019fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:52.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.323+0000 7fb5af7fe640 1 --2- 172.21.15.1:0/2292565146 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb5b0109ec0 0x7fb5b019fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.323+0000 7fb5af7fe640 1 -- 172.21.15.1:0/2292565146 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5b0103c30 msgr2=0x7fb5b019a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:52.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.323+0000 7fb5af7fe640 1 --2- 172.21.15.1:0/2292565146 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5b0103c30 0x7fb5b019a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.323+0000 7fb5af7fe640 1 -- 172.21.15.1:0/2292565146 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b01a0410 con 0x7fb5b0109570 2024-09-21T00:59:52.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.323+0000 7fb5af7fe640 1 --2- 172.21.15.1:0/2292565146 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5b0109570 0x7fb5b019aa40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4009230 tx=0x7fb5a4003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:52.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.325+0000 7fb5ad7fa640 1 -- 172.21.15.1:0/2292565146 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a403f070 con 0x7fb5b0109570 2024-09-21T00:59:52.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.325+0000 7fb5ad7fa640 1 -- 172.21.15.1:0/2292565146 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5a4031b60 con 0x7fb5b0109570 2024-09-21T00:59:52.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.325+0000 7fb5ad7fa640 1 -- 172.21.15.1:0/2292565146 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a4035030 con 0x7fb5b0109570 2024-09-21T00:59:52.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.325+0000 7fb5b6683640 1 -- 172.21.15.1:0/2292565146 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5b01a06a0 con 0x7fb5b0109570 2024-09-21T00:59:52.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.325+0000 7fb5b6683640 1 -- 172.21.15.1:0/2292565146 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5b01a0a40 con 0x7fb5b0109570 2024-09-21T00:59:52.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.329+0000 7fb5ad7fa640 1 -- 172.21.15.1:0/2292565146 <== mon.2 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7fb5a4042070 con 0x7fb5b0109570 2024-09-21T00:59:52.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.331+0000 7fb5bcbf7740 1 Processor -- start 2024-09-21T00:59:52.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.331+0000 7fb5bcbf7740 1 -- start start 2024-09-21T00:59:52.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.331+0000 7fb5ad7fa640 1 --2- 172.21.15.1:0/2292565146 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb5980b6660 0x7fb5980b8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:52.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.331+0000 7fb5bcbf7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55990ce32070 0x55990d1d92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:52.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.331+0000 7fb5bcbf7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55990ce091b0 0x55990d1d9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:52.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.331+0000 7fb5bcbf7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55990ce11390 0x55990d1d9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:52.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.331+0000 7fb5bcbf7740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55990d14fea0 con 0x55990ce091b0 2024-09-21T00:59:52.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.331+0000 7fb5bcbf7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55990d13f2d0 con 0x55990ce11390 2024-09-21T00:59:52.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.331+0000 7fb5bcbf7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55990d1430e0 con 0x55990ce32070 2024-09-21T00:59:52.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.332+0000 7fb5b4c20640 1 --2- 172.21.15.1:0/2292565146 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb5980b6660 0x7fb5980b8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:52.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.332+0000 7fb5b4c20640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55990ce11390 0x55990d1d9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:52.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.332+0000 7fb5affff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55990ce32070 0x55990d1d92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:52.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.332+0000 7fb5b4c20640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55990ce11390 0x55990d1d9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:57024/0 (socket says 172.21.15.1:57024) 2024-09-21T00:59:52.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.332+0000 7fb5b4c20640 1 -- 172.21.15.1:0/1044209085 learned_addr learned my addr 172.21.15.1:0/1044209085 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:52.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.332+0000 7fb5affff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55990ce32070 0x55990d1d92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:48948/0 (socket says 172.21.15.1:48948) 2024-09-21T00:59:52.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.332+0000 7fb5af7fe640 1 --2- 172.21.15.1:0/1044209085 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55990ce091b0 0x55990d1d9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:52.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.333+0000 7fb5b4c20640 1 -- 172.21.15.1:0/1044209085 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55990ce32070 msgr2=0x55990d1d92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:52.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.333+0000 7fb5b4c20640 1 --2- 172.21.15.1:0/1044209085 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55990ce32070 0x55990d1d92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.333+0000 7fb5b4c20640 1 -- 172.21.15.1:0/1044209085 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55990ce091b0 msgr2=0x55990d1d9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:52.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.333+0000 7fb5b4c20640 1 --2- 172.21.15.1:0/1044209085 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55990ce091b0 0x55990d1d9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.333+0000 7fb5b4c20640 1 -- 172.21.15.1:0/1044209085 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55990ce9d650 con 0x55990ce11390 2024-09-21T00:59:52.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.333+0000 7fb5affff640 1 --2- 172.21.15.1:0/1044209085 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55990ce32070 0x55990d1d92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:52.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.333+0000 7fb5ad7fa640 1 -- 172.21.15.1:0/2292565146 <== mon.2 v2:172.21.15.42:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fb5a41078f0 con 0x7fb5b0109570 2024-09-21T00:59:52.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.333+0000 7fb5b4c20640 1 --2- 172.21.15.1:0/2292565146 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb5980b6660 0x7fb5980b8b70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8014820 tx=0x7fb5a8014c20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:52.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.334+0000 7fb5b4c20640 1 --2- 172.21.15.1:0/1044209085 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55990ce11390 0x55990d1d9d40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8009ce0 tx=0x7fb5a801e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5afb2bd9d40c9ef0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:52.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.335+0000 7fb5967fc640 1 -- 172.21.15.1:0/1044209085 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a8003970 con 0x55990ce11390 2024-09-21T00:59:52.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.335+0000 7fb5967fc640 1 -- 172.21.15.1:0/1044209085 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5a80238a0 con 0x55990ce11390 2024-09-21T00:59:52.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.335+0000 7fb5967fc640 1 -- 172.21.15.1:0/1044209085 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a800eb90 con 0x55990ce11390 2024-09-21T00:59:52.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.336+0000 7fb5bcbf7740 1 -- 172.21.15.1:0/1044209085 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55990ce11390 msgr2=0x55990d1d9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:52.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.336+0000 7fb5bcbf7740 1 --2- 172.21.15.1:0/1044209085 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55990ce11390 0x55990d1d9d40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8009ce0 tx=0x7fb5a801e000 comp rx=0 tx=0).stop 2024-09-21T00:59:52.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.336+0000 7fb5bcbf7740 1 -- 172.21.15.1:0/1044209085 shutdown_connections 2024-09-21T00:59:52.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.336+0000 7fb5bcbf7740 1 --2- 172.21.15.1:0/1044209085 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55990ce11390 0x55990d1d9d40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.336+0000 7fb5bcbf7740 1 --2- 172.21.15.1:0/1044209085 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55990ce091b0 0x55990d1d9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.336+0000 7fb5bcbf7740 1 --2- 172.21.15.1:0/1044209085 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55990ce32070 0x55990d1d92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.336+0000 7fb5bcbf7740 1 -- 172.21.15.1:0/1044209085 >> 172.21.15.1:0/1044209085 conn(0x55990ce26460 msgr2=0x55990d1d71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:52.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.336+0000 7fb5bcbf7740 1 -- 172.21.15.1:0/1044209085 shutdown_connections 2024-09-21T00:59:52.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.336+0000 7fb5bcbf7740 1 -- 172.21.15.1:0/1044209085 wait complete. 2024-09-21T00:59:52.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.337+0000 7fb5bcbf7740 1 -- start start 2024-09-21T00:59:52.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.337+0000 7fb5bcbf7740 1 Processor -- start 2024-09-21T00:59:52.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.337+0000 7fb5bcbf7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55990ce091b0 0x55990d1e4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:52.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.337+0000 7fb5bcbf7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55990ce11390 0x55990d1e4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:52.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.337+0000 7fb5bcbf7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55990ce32070 0x55990d1f0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:52.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.337+0000 7fb5bcbf7740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55990cfa0700 con 0x55990ce32070 2024-09-21T00:59:52.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.337+0000 7fb5bcbf7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55990d0da160 con 0x55990ce091b0 2024-09-21T00:59:52.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.337+0000 7fb5bcbf7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55990d1e79e0 con 0x55990ce11390 2024-09-21T00:59:52.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.337+0000 7fb5bcbf7740 10 client.0 _ll_register_callbacks cb 0x55990d0f39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:52.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.338+0000 7fb5af7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55990ce11390 0x55990d1e4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:52.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.338+0000 7fb5affff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55990ce091b0 0x55990d1e4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:52.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.338+0000 7fb5af7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55990ce11390 0x55990d1e4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:48956/0 (socket says 172.21.15.1:48956) 2024-09-21T00:59:52.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.338+0000 7fb5affff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55990ce091b0 0x55990d1e4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:57030/0 (socket says 172.21.15.1:57030) 2024-09-21T00:59:52.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.338+0000 7fb5af7fe640 1 -- 172.21.15.1:0/3337946834 learned_addr learned my addr 172.21.15.1:0/3337946834 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:52.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.338+0000 7fb5b4c20640 1 --2- 172.21.15.1:0/3337946834 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55990ce32070 0x55990d1f0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:52.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.338+0000 7fb5affff640 1 -- 172.21.15.1:0/3337946834 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55990ce11390 msgr2=0x55990d1e4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:52.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.338+0000 7fb5affff640 1 --2- 172.21.15.1:0/3337946834 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55990ce11390 0x55990d1e4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.338+0000 7fb5affff640 1 -- 172.21.15.1:0/3337946834 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55990ce32070 msgr2=0x55990d1f0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:52.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.338+0000 7fb5affff640 1 --2- 172.21.15.1:0/3337946834 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55990ce32070 0x55990d1f0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.338+0000 7fb5affff640 1 -- 172.21.15.1:0/3337946834 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55990d107c90 con 0x55990ce091b0 2024-09-21T00:59:52.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.339+0000 7fb5b4c20640 1 --2- 172.21.15.1:0/3337946834 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55990ce32070 0x55990d1f0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:52.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.342+0000 7fb5affff640 1 --2- 172.21.15.1:0/3337946834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55990ce091b0 0x55990d1e4a10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0004640 tx=0x7fb5a000bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1589d70fc320ef3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:52.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.342+0000 7fb58f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T00:59:52.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.343+0000 7fb58f7fe640 1 -- 172.21.15.1:0/3337946834 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a0005020 con 0x55990ce091b0 2024-09-21T00:59:52.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.343+0000 7fb58f7fe640 1 -- 172.21.15.1:0/3337946834 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fb5a00051c0 con 0x55990ce091b0 2024-09-21T00:59:52.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.343+0000 7fb5bcbf7740 1 -- 172.21.15.1:0/3337946834 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5a80238a0 con 0x55990ce091b0 2024-09-21T00:59:52.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.343+0000 7fb58f7fe640 1 -- 172.21.15.1:0/3337946834 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb5a00053c0 con 0x55990ce091b0 2024-09-21T00:59:52.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.344+0000 7fb5bcbf7740 10 client.25979 fetch_fsmap learned FSMap version 31 2024-09-21T00:59:52.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.344+0000 7fb5bcbf7740 1 -- 172.21.15.1:0/3337946834 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55990d1fc000 con 0x55990ce091b0 2024-09-21T00:59:52.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.344+0000 7fb58f7fe640 1 -- 172.21.15.1:0/3337946834 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5a80238a0 con 0x55990ce091b0 2024-09-21T00:59:52.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.346+0000 7fb58f7fe640 1 -- 172.21.15.1:0/3337946834 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7fb5a0011560 con 0x55990ce091b0 2024-09-21T00:59:52.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.346+0000 7fb5bcbf7740 10 client.25979 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:59:52.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.346+0000 7fb5bcbf7740 10 client.25979 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T00:59:52.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.346+0000 7fb5bcbf7740 20 client.25979 populate_metadata read hostname 'smithi001' 2024-09-21T00:59:52.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.346+0000 7fb5bcbf7740 1 --2- 172.21.15.1:0/3337946834 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x55990cdf09f0 0x55990d1ff530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:52.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.346+0000 7fb5bcbf7740 4 client.25979 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:59:52.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.346+0000 7fb5bcbf7740 1 -- 172.21.15.1:0/3337946834 --> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55990d151df0 con 0x55990cdf09f0 2024-09-21T00:59:52.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.347+0000 7fb5af7fe640 1 --2- 172.21.15.1:0/3337946834 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x55990cdf09f0 0x55990d1ff530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:52.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.348+0000 7fb58f7fe640 10 client.25979 ms_handle_connect on v2:172.21.15.42:6836/2395608508 2024-09-21T00:59:52.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.348+0000 7fb5af7fe640 1 --2- 172.21.15.1:0/3337946834 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x55990cdf09f0 0x55990d1ff530 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=81197118d63c8a8c server_cookie=ea89e8f65e173d78 in_seq=0 out_seq=0 2024-09-21T00:59:52.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.353+0000 7fb58f7fe640 1 -- 172.21.15.1:0/3337946834 <== mds.2 v2:172.21.15.42:6836/2395608508 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55990d151df0 con 0x55990cdf09f0 2024-09-21T00:59:52.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.353+0000 7fb58f7fe640 10 client.25979 handle_command_reply: tid=0 2024-09-21T00:59:52.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.353+0000 7fb5bcbf7740 1 client.25979 shutdown 2024-09-21T00:59:52.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.353+0000 7fb5bcbf7740 1 -- 172.21.15.1:0/3337946834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55990ce091b0 msgr2=0x55990d1e4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:52.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.353+0000 7fb5bcbf7740 1 --2- 172.21.15.1:0/3337946834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55990ce091b0 0x55990d1e4a10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0004640 tx=0x7fb5a000bf60 comp rx=0 tx=0).stop 2024-09-21T00:59:52.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.353+0000 7fb5bcbf7740 1 -- 172.21.15.1:0/3337946834 shutdown_connections 2024-09-21T00:59:52.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.353+0000 7fb5bcbf7740 1 --2- 172.21.15.1:0/3337946834 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x55990cdf09f0 0x55990d1ff530 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.353+0000 7fb5bcbf7740 1 --2- 172.21.15.1:0/3337946834 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55990ce32070 0x55990d1f0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.353+0000 7fb5bcbf7740 1 --2- 172.21.15.1:0/3337946834 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55990ce11390 0x55990d1e4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.353+0000 7fb5bcbf7740 1 --2- 172.21.15.1:0/3337946834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55990ce091b0 0x55990d1e4a10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.353+0000 7fb5bcbf7740 1 -- 172.21.15.1:0/3337946834 >> 172.21.15.1:0/3337946834 conn(0x55990ce26460 msgr2=0x55990d1dc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:52.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.353+0000 7fb58f7fe640 0 client.25979 ms_handle_reset on v2:172.21.15.42:6836/2395608508 2024-09-21T00:59:52.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.353+0000 7fb5bcbf7740 1 -- 172.21.15.1:0/3337946834 shutdown_connections 2024-09-21T00:59:52.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.354+0000 7fb5bcbf7740 1 -- 172.21.15.1:0/3337946834 wait complete. 2024-09-21T00:59:52.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.354+0000 7fb5bcbf7740 20 client.25979 trim_cache size 0 max 16384 2024-09-21T00:59:52.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.383+0000 7fb5bcbf7740 1 Processor -- start 2024-09-21T00:59:52.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.383+0000 7fb5bcbf7740 1 -- start start 2024-09-21T00:59:52.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.384+0000 7fb5bcbf7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55990ce091b0 0x55990d1e4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:52.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.384+0000 7fb5bcbf7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55990ce11390 0x55990d1dc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:52.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.384+0000 7fb5bcbf7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55990ce32070 0x55990d1dc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:52.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.384+0000 7fb5bcbf7740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b00752d0 con 0x55990ce091b0 2024-09-21T00:59:52.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.384+0000 7fb5bcbf7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b0076f90 con 0x55990ce32070 2024-09-21T00:59:52.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.384+0000 7fb5bcbf7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b00759a0 con 0x55990ce11390 2024-09-21T00:59:52.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.384+0000 7fb5affff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55990ce091b0 0x55990d1e4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:52.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.384+0000 7fb5b4c20640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55990ce32070 0x55990d1dc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:52.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.384+0000 7fb5b4c20640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55990ce32070 0x55990d1dc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:57036/0 (socket says 172.21.15.1:57036) 2024-09-21T00:59:52.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.384+0000 7fb5affff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55990ce091b0 0x55990d1e4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35686/0 (socket says 172.21.15.1:35686) 2024-09-21T00:59:52.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.384+0000 7fb5b4c20640 1 -- 172.21.15.1:0/2257443901 learned_addr learned my addr 172.21.15.1:0/2257443901 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:52.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.385+0000 7fb5af7fe640 1 --2- 172.21.15.1:0/2257443901 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55990ce11390 0x55990d1dc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:52.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.385+0000 7fb5b4c20640 1 -- 172.21.15.1:0/2257443901 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55990ce11390 msgr2=0x55990d1dc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:52.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.385+0000 7fb5b4c20640 1 --2- 172.21.15.1:0/2257443901 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55990ce11390 0x55990d1dc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.385+0000 7fb5b4c20640 1 -- 172.21.15.1:0/2257443901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55990ce091b0 msgr2=0x55990d1e4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:52.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.385+0000 7fb5b4c20640 1 --2- 172.21.15.1:0/2257443901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55990ce091b0 0x55990d1e4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.385+0000 7fb5b4c20640 1 -- 172.21.15.1:0/2257443901 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55990d1e5cd0 con 0x55990ce32070 2024-09-21T00:59:52.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.385+0000 7fb5af7fe640 1 --2- 172.21.15.1:0/2257443901 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55990ce11390 0x55990d1dc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:59:52.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.385+0000 7fb5b4c20640 1 --2- 172.21.15.1:0/2257443901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55990ce32070 0x55990d1dc900 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8009ce0 tx=0x7fb5a8014590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a09309f028996146 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:52.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.386+0000 7fb595ffb640 1 -- 172.21.15.1:0/2257443901 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a80238a0 con 0x55990ce32070 2024-09-21T00:59:52.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.386+0000 7fb595ffb640 1 -- 172.21.15.1:0/2257443901 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5a8003e20 con 0x55990ce32070 2024-09-21T00:59:52.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.386+0000 7fb595ffb640 1 -- 172.21.15.1:0/2257443901 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a80233b0 con 0x55990ce32070 2024-09-21T00:59:52.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.387+0000 7fb5bcbf7740 1 -- 172.21.15.1:0/2257443901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55990ce32070 msgr2=0x55990d1dc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:52.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.387+0000 7fb5bcbf7740 1 --2- 172.21.15.1:0/2257443901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55990ce32070 0x55990d1dc900 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8009ce0 tx=0x7fb5a8014590 comp rx=0 tx=0).stop 2024-09-21T00:59:52.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.387+0000 7fb5bcbf7740 1 -- 172.21.15.1:0/2257443901 shutdown_connections 2024-09-21T00:59:52.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.387+0000 7fb5bcbf7740 1 --2- 172.21.15.1:0/2257443901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55990ce32070 0x55990d1dc900 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.387+0000 7fb5bcbf7740 1 --2- 172.21.15.1:0/2257443901 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55990ce11390 0x55990d1dc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.387+0000 7fb5bcbf7740 1 --2- 172.21.15.1:0/2257443901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55990ce091b0 0x55990d1e4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.387+0000 7fb5bcbf7740 1 -- 172.21.15.1:0/2257443901 >> 172.21.15.1:0/2257443901 conn(0x55990ce26460 msgr2=0x55990d1e47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:52.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.387+0000 7fb5bcbf7740 1 -- 172.21.15.1:0/2257443901 shutdown_connections 2024-09-21T00:59:52.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.388+0000 7fb5bcbf7740 1 -- 172.21.15.1:0/2257443901 wait complete. 2024-09-21T00:59:52.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.388+0000 7fb5bcbf7740 1 -- start start 2024-09-21T00:59:52.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.389+0000 7fb5bcbf7740 1 Processor -- start 2024-09-21T00:59:52.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.389+0000 7fb5bcbf7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55990ce091b0 0x55990d1ed5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:52.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.390+0000 7fb5bcbf7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55990ce11390 0x55990d1e8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:52.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.390+0000 7fb5bcbf7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55990ce32070 0x55990d1e91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:52.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.390+0000 7fb5bcbf7740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b0076800 con 0x55990ce11390 2024-09-21T00:59:52.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.390+0000 7fb5bcbf7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b0076130 con 0x55990ce32070 2024-09-21T00:59:52.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.390+0000 7fb5bcbf7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b0073290 con 0x55990ce091b0 2024-09-21T00:59:52.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.390+0000 7fb5bcbf7740 10 client.0 _ll_register_callbacks cb 0x7fb5a0004250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:52.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.390+0000 7fb5affff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55990ce091b0 0x55990d1ed5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:52.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.390+0000 7fb5affff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55990ce091b0 0x55990d1ed5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:48964/0 (socket says 172.21.15.1:48964) 2024-09-21T00:59:52.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.390+0000 7fb5affff640 1 -- 172.21.15.1:0/3427951854 learned_addr learned my addr 172.21.15.1:0/3427951854 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:52.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.390+0000 7fb5af7fe640 1 --2- 172.21.15.1:0/3427951854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55990ce11390 0x55990d1e8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:52.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.390+0000 7fb5b4c20640 1 --2- 172.21.15.1:0/3427951854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55990ce32070 0x55990d1e91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:52.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.391+0000 7fb5af7fe640 1 -- 172.21.15.1:0/3427951854 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55990ce091b0 msgr2=0x55990d1ed5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:52.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.391+0000 7fb5af7fe640 1 --2- 172.21.15.1:0/3427951854 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55990ce091b0 0x55990d1ed5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.391+0000 7fb5af7fe640 1 -- 172.21.15.1:0/3427951854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55990ce32070 msgr2=0x55990d1e91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:52.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.391+0000 7fb5af7fe640 1 --2- 172.21.15.1:0/3427951854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55990ce32070 0x55990d1e91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.391+0000 7fb5af7fe640 1 -- 172.21.15.1:0/3427951854 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55990d268ef0 con 0x55990ce11390 2024-09-21T00:59:52.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.391+0000 7fb5af7fe640 1 --2- 172.21.15.1:0/3427951854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55990ce11390 0x55990d1e8aa0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4006010 tx=0x7fb5a40d2040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=991eb073f72cc623 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:52.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.391+0000 7fb58f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:59:52.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.392+0000 7fb58f7fe640 1 -- 172.21.15.1:0/3427951854 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a4049040 con 0x55990ce11390 2024-09-21T00:59:52.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.392+0000 7fb58f7fe640 1 -- 172.21.15.1:0/3427951854 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fb5a40c9cd0 con 0x55990ce11390 2024-09-21T00:59:52.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.392+0000 7fb5bcbf7740 1 -- 172.21.15.1:0/3427951854 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5a8003e20 con 0x55990ce11390 2024-09-21T00:59:52.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.393+0000 7fb58f7fe640 1 -- 172.21.15.1:0/3427951854 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb5a40c91d0 con 0x55990ce11390 2024-09-21T00:59:52.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.393+0000 7fb5bcbf7740 10 client.16317 fetch_fsmap learned FSMap version 31 2024-09-21T00:59:52.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.393+0000 7fb5bcbf7740 1 -- 172.21.15.1:0/3427951854 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55990d26a010 con 0x55990ce11390 2024-09-21T00:59:52.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.393+0000 7fb58f7fe640 1 -- 172.21.15.1:0/3427951854 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5a8003e20 con 0x55990ce11390 2024-09-21T00:59:52.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.393+0000 7fb58f7fe640 1 -- 172.21.15.1:0/3427951854 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7fb5a40cdcc0 con 0x55990ce11390 2024-09-21T00:59:52.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.393+0000 7fb5bcbf7740 10 client.16317 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:59:52.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.393+0000 7fb5bcbf7740 10 client.16317 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T00:59:52.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.393+0000 7fb5bcbf7740 20 client.16317 populate_metadata read hostname 'smithi001' 2024-09-21T00:59:52.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.393+0000 7fb5bcbf7740 1 --2- 172.21.15.1:0/3427951854 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x55990cdc5da0 0x55990d26c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:52.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.394+0000 7fb5bcbf7740 4 client.16317 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:59:52.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.394+0000 7fb5bcbf7740 1 -- 172.21.15.1:0/3427951854 --> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55990d14d8a0 con 0x55990cdc5da0 2024-09-21T00:59:52.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.394+0000 7fb5affff640 1 --2- 172.21.15.1:0/3427951854 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x55990cdc5da0 0x55990d26c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:52.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.394+0000 7fb58f7fe640 10 client.16317 ms_handle_connect on v2:172.21.15.42:6836/2395608508 2024-09-21T00:59:52.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.395+0000 7fb5affff640 1 --2- 172.21.15.1:0/3427951854 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x55990cdc5da0 0x55990d26c840 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9b706153f04c8944 server_cookie=f4cbca350b655f8e in_seq=0 out_seq=0 2024-09-21T00:59:52.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.399+0000 7fb58f7fe640 1 -- 172.21.15.1:0/3427951854 <== mds.2 v2:172.21.15.42:6836/2395608508 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55990d14d8a0 con 0x55990cdc5da0 2024-09-21T00:59:52.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.399+0000 7fb58f7fe640 10 client.16317 handle_command_reply: tid=0 2024-09-21T00:59:52.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.399+0000 7fb5bcbf7740 1 client.16317 shutdown 2024-09-21T00:59:52.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.399+0000 7fb5bcbf7740 1 -- 172.21.15.1:0/3427951854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55990ce11390 msgr2=0x55990d1e8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:52.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.399+0000 7fb5bcbf7740 1 --2- 172.21.15.1:0/3427951854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55990ce11390 0x55990d1e8aa0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4006010 tx=0x7fb5a40d2040 comp rx=0 tx=0).stop 2024-09-21T00:59:52.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.400+0000 7fb5bcbf7740 1 -- 172.21.15.1:0/3427951854 shutdown_connections 2024-09-21T00:59:52.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.400+0000 7fb5bcbf7740 1 --2- 172.21.15.1:0/3427951854 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x55990cdc5da0 0x55990d26c840 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.400+0000 7fb58f7fe640 0 client.16317 ms_handle_reset on v2:172.21.15.42:6836/2395608508 2024-09-21T00:59:52.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.400+0000 7fb5bcbf7740 1 --2- 172.21.15.1:0/3427951854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55990ce32070 0x55990d1e91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.400+0000 7fb5bcbf7740 1 --2- 172.21.15.1:0/3427951854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55990ce11390 0x55990d1e8aa0 secure :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4006010 tx=0x7fb5a40d2040 comp rx=0 tx=0).stop 2024-09-21T00:59:52.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.400+0000 7fb5bcbf7740 1 --2- 172.21.15.1:0/3427951854 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55990ce091b0 0x55990d1ed5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.400+0000 7fb5bcbf7740 1 -- 172.21.15.1:0/3427951854 >> 172.21.15.1:0/3427951854 conn(0x55990ce26460 msgr2=0x55990d1dc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:52.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.400+0000 7fb5bcbf7740 1 -- 172.21.15.1:0/3427951854 shutdown_connections 2024-09-21T00:59:52.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.400+0000 7fb5bcbf7740 1 -- 172.21.15.1:0/3427951854 wait complete. 2024-09-21T00:59:52.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.400+0000 7fb5bcbf7740 20 client.16317 trim_cache size 0 max 16384 2024-09-21T00:59:52.402 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T00:59:52.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.404+0000 7fb5b6683640 1 -- 172.21.15.1:0/2292565146 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb5980b6660 msgr2=0x7fb5980b8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:52.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.404+0000 7fb5b6683640 1 --2- 172.21.15.1:0/2292565146 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb5980b6660 0x7fb5980b8b70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8014820 tx=0x7fb5a8014c20 comp rx=0 tx=0).stop 2024-09-21T00:59:52.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.404+0000 7fb5b6683640 1 -- 172.21.15.1:0/2292565146 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5b0109570 msgr2=0x7fb5b019aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:52.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.404+0000 7fb5b6683640 1 --2- 172.21.15.1:0/2292565146 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5b0109570 0x7fb5b019aa40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4009230 tx=0x7fb5a4003c10 comp rx=0 tx=0).stop 2024-09-21T00:59:52.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.404+0000 7fb5b6683640 1 -- 172.21.15.1:0/2292565146 shutdown_connections 2024-09-21T00:59:52.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.404+0000 7fb5b6683640 1 --2- 172.21.15.1:0/2292565146 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb5b0109ec0 0x7fb5b019fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.404+0000 7fb5b6683640 1 --2- 172.21.15.1:0/2292565146 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5b0109570 0x7fb5b019aa40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.404+0000 7fb5b6683640 1 --2- 172.21.15.1:0/2292565146 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb5980b6660 0x7fb5980b8b70 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.404+0000 7fb5b6683640 1 --2- 172.21.15.1:0/2292565146 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5b0103c30 0x7fb5b019a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.404+0000 7fb5b6683640 1 -- 172.21.15.1:0/2292565146 >> 172.21.15.1:0/2292565146 conn(0x7fb5b007b8d0 msgr2=0x7fb5b01055e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:52.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.404+0000 7fb5b6683640 1 -- 172.21.15.1:0/2292565146 shutdown_connections 2024-09-21T00:59:52.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:52.404+0000 7fb5b6683640 1 -- 172.21.15.1:0/2292565146 wait complete. 2024-09-21T00:59:53.213 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T00:59:53.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:53 smithi001 ceph-mon[31211]: pgmap v438: 97 pgs: 97 active+clean; 279 MiB data, 790 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.1 MiB/s wr, 449 op/s 2024-09-21T00:59:53.557 INFO:tasks.workunit.client.0.smithi001.stdout: 67 1574385 641 968718 454 831827 1410 2024-09-21T00:59:53.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:53 smithi193 ceph-mon[34660]: pgmap v438: 97 pgs: 97 active+clean; 279 MiB data, 790 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.1 MiB/s wr, 449 op/s 2024-09-21T00:59:53.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:53 smithi042 ceph-mon[34481]: pgmap v438: 97 pgs: 97 active+clean; 279 MiB data, 790 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.1 MiB/s wr, 449 op/s 2024-09-21T00:59:53.844 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:59:54.272 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.271+0000 7f69c32be640 1 -- 172.21.15.1:0/3477345122 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69bc109510 msgr2=0x7f69bc10b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:54.273 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.271+0000 7f69c32be640 1 --2- 172.21.15.1:0/3477345122 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69bc109510 0x7f69bc10b930 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f69b4009be0 tx=0x7f69b402a6c0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.273 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.272+0000 7f69c32be640 1 -- 172.21.15.1:0/3477345122 shutdown_connections 2024-09-21T00:59:54.273 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.272+0000 7f69c32be640 1 --2- 172.21.15.1:0/3477345122 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69bc109510 0x7f69bc10b930 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.273 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.272+0000 7f69c32be640 1 --2- 172.21.15.1:0/3477345122 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69bc106bb0 0x7f69bc108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.273 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.272+0000 7f69c32be640 1 --2- 172.21.15.1:0/3477345122 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f69bc101a60 0x7f69bc101e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.273 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.272+0000 7f69c32be640 1 -- 172.21.15.1:0/3477345122 >> 172.21.15.1:0/3477345122 conn(0x7f69bc0fd660 msgr2=0x7f69bc0ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:54.273 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.272+0000 7f69c32be640 1 -- 172.21.15.1:0/3477345122 shutdown_connections 2024-09-21T00:59:54.273 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.272+0000 7f69c32be640 1 -- 172.21.15.1:0/3477345122 wait complete. 2024-09-21T00:59:54.275 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.272+0000 7f69c32be640 1 Processor -- start 2024-09-21T00:59:54.275 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.272+0000 7f69c32be640 1 -- start start 2024-09-21T00:59:54.275 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.273+0000 7f69c32be640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69bc101a60 0x7f69bc199f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.273+0000 7f69c32be640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69bc106bb0 0x7f69bc19a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.273+0000 7f69c32be640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f69bc109510 0x7f69bc19b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.273+0000 7f69c32be640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f69bc10f2e0 con 0x7f69bc101a60 2024-09-21T00:59:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.273+0000 7f69c32be640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f69bc10f160 con 0x7f69bc106bb0 2024-09-21T00:59:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.273+0000 7f69c32be640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f69bc10f460 con 0x7f69bc109510 2024-09-21T00:59:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.273+0000 7f69c105a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69bc101a60 0x7f69bc199f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.273+0000 7f69c0859640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69bc106bb0 0x7f69bc19a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.273+0000 7f69c0859640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69bc106bb0 0x7f69bc19a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:57058/0 (socket says 172.21.15.1:57058) 2024-09-21T00:59:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.273+0000 7f69c105a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69bc101a60 0x7f69bc199f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35706/0 (socket says 172.21.15.1:35706) 2024-09-21T00:59:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.273+0000 7f69c0859640 1 -- 172.21.15.1:0/54376776 learned_addr learned my addr 172.21.15.1:0/54376776 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.273+0000 7f69c185b640 1 --2- 172.21.15.1:0/54376776 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f69bc109510 0x7f69bc19b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.273+0000 7f69c0859640 1 -- 172.21.15.1:0/54376776 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f69bc109510 msgr2=0x7f69bc19b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.273+0000 7f69c0859640 1 --2- 172.21.15.1:0/54376776 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f69bc109510 0x7f69bc19b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.273+0000 7f69c0859640 1 -- 172.21.15.1:0/54376776 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69bc101a60 msgr2=0x7f69bc199f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.273+0000 7f69c0859640 1 --2- 172.21.15.1:0/54376776 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69bc101a60 0x7f69bc199f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.273+0000 7f69c0859640 1 -- 172.21.15.1:0/54376776 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69bc19b940 con 0x7f69bc106bb0 2024-09-21T00:59:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.273+0000 7f69c105a640 1 --2- 172.21.15.1:0/54376776 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69bc101a60 0x7f69bc199f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.273+0000 7f69c0859640 1 --2- 172.21.15.1:0/54376776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69bc106bb0 0x7f69bc19a570 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f69ac00e9c0 tx=0x7f69ac00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.274+0000 7f69b27fc640 1 -- 172.21.15.1:0/54376776 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ac00cde0 con 0x7f69bc106bb0 2024-09-21T00:59:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.274+0000 7f69c32be640 1 -- 172.21.15.1:0/54376776 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69bc19bc30 con 0x7f69bc106bb0 2024-09-21T00:59:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.274+0000 7f69b27fc640 1 -- 172.21.15.1:0/54376776 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69ac0035f0 con 0x7f69bc106bb0 2024-09-21T00:59:54.278 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.274+0000 7f69b27fc640 1 -- 172.21.15.1:0/54376776 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ac010690 con 0x7f69bc106bb0 2024-09-21T00:59:54.278 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.274+0000 7f69c32be640 1 -- 172.21.15.1:0/54376776 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69bc1a2320 con 0x7f69bc106bb0 2024-09-21T00:59:54.280 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.277+0000 7f69ca223740 1 Processor -- start 2024-09-21T00:59:54.280 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.277+0000 7f69ca223740 1 -- start start 2024-09-21T00:59:54.281 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.277+0000 7f69b27fc640 1 -- 172.21.15.1:0/54376776 <== mon.2 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f69ac010830 con 0x7f69bc106bb0 2024-09-21T00:59:54.281 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.277+0000 7f69ca223740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a99b6ed1b0 0x55a99ba94e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.281 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.277+0000 7f69ca223740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a99b6c42f0 0x55a99ba954c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.281 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.277+0000 7f69ca223740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a99b6cc4d0 0x55a99ba96010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.281 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.277+0000 7f69ca223740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a99ba076f0 con 0x55a99b6cc4d0 2024-09-21T00:59:54.281 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.277+0000 7f69ca223740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a99b9f6b20 con 0x55a99b6ed1b0 2024-09-21T00:59:54.281 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.277+0000 7f69ca223740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a99b9fa930 con 0x55a99b6c42f0 2024-09-21T00:59:54.281 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.277+0000 7f69c0859640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a99b6cc4d0 0x55a99ba96010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.281 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.277+0000 7f69c185b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a99b6ed1b0 0x55a99ba94e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.281 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.277+0000 7f69c105a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a99b6c42f0 0x55a99ba954c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.281 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.277+0000 7f69c185b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a99b6ed1b0 0x55a99ba94e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:57074/0 (socket says 172.21.15.1:57074) 2024-09-21T00:59:54.281 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.277+0000 7f69c185b640 1 -- 172.21.15.1:0/3780221597 learned_addr learned my addr 172.21.15.1:0/3780221597 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:54.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.277+0000 7f69c185b640 1 -- 172.21.15.1:0/3780221597 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a99b6c42f0 msgr2=0x55a99ba954c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:54.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.277+0000 7f69c185b640 1 --2- 172.21.15.1:0/3780221597 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a99b6c42f0 0x55a99ba954c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.277+0000 7f69c185b640 1 -- 172.21.15.1:0/3780221597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a99b6cc4d0 msgr2=0x55a99ba96010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:54.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.277+0000 7f69c185b640 1 --2- 172.21.15.1:0/3780221597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a99b6cc4d0 0x55a99ba96010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.277+0000 7f69c185b640 1 -- 172.21.15.1:0/3780221597 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a99b9bc530 con 0x55a99b6ed1b0 2024-09-21T00:59:54.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.278+0000 7f69b27fc640 1 --2- 172.21.15.1:0/54376776 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f69a80b6510 0x7f69a80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.278+0000 7f69c185b640 1 --2- 172.21.15.1:0/3780221597 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a99b6ed1b0 0x55a99ba94e50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f69b4009be0 tx=0x7f69b40093a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b9fd379256b6025 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:54.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.278+0000 7f69c105a640 1 --2- 172.21.15.1:0/54376776 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f69a80b6510 0x7f69a80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.278+0000 7f69b27fc640 1 -- 172.21.15.1:0/54376776 <== mon.2 v2:172.21.15.42:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f69ac0e76a0 con 0x7f69bc106bb0 2024-09-21T00:59:54.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.278+0000 7f69a77fe640 1 -- 172.21.15.1:0/3780221597 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b4041030 con 0x55a99b6ed1b0 2024-09-21T00:59:54.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.278+0000 7f69a77fe640 1 -- 172.21.15.1:0/3780221597 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69b4030520 con 0x55a99b6ed1b0 2024-09-21T00:59:54.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.278+0000 7f69a77fe640 1 -- 172.21.15.1:0/3780221597 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b4036040 con 0x55a99b6ed1b0 2024-09-21T00:59:54.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.279+0000 7f69c105a640 1 --2- 172.21.15.1:0/54376776 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f69a80b6510 0x7f69a80b8a20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f69b8005fd0 tx=0x7f69b800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:54.284 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.279+0000 7f69ca223740 1 -- 172.21.15.1:0/3780221597 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a99b6ed1b0 msgr2=0x55a99ba94e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:54.284 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.279+0000 7f69ca223740 1 --2- 172.21.15.1:0/3780221597 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a99b6ed1b0 0x55a99ba94e50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f69b4009be0 tx=0x7f69b40093a0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.284 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.279+0000 7f69ca223740 1 -- 172.21.15.1:0/3780221597 shutdown_connections 2024-09-21T00:59:54.284 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.279+0000 7f69ca223740 1 --2- 172.21.15.1:0/3780221597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a99b6cc4d0 0x55a99ba96010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.284 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.279+0000 7f69ca223740 1 --2- 172.21.15.1:0/3780221597 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a99b6c42f0 0x55a99ba954c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.284 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.279+0000 7f69ca223740 1 --2- 172.21.15.1:0/3780221597 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a99b6ed1b0 0x55a99ba94e50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.284 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.279+0000 7f69ca223740 1 -- 172.21.15.1:0/3780221597 >> 172.21.15.1:0/3780221597 conn(0x55a99b6e1300 msgr2=0x55a99ba908e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:54.284 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.279+0000 7f69ca223740 1 -- 172.21.15.1:0/3780221597 shutdown_connections 2024-09-21T00:59:54.284 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.279+0000 7f69ca223740 1 -- 172.21.15.1:0/3780221597 wait complete. 2024-09-21T00:59:54.284 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.280+0000 7f69ca223740 1 -- start start 2024-09-21T00:59:54.284 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.280+0000 7f69ca223740 1 Processor -- start 2024-09-21T00:59:54.288 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.280+0000 7f69ca223740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a99b6c42f0 0x55a99ba9e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.288 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.280+0000 7f69ca223740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a99b6cc4d0 0x55a99ba9ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.288 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.280+0000 7f69ca223740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a99b6ed1b0 0x55a99ba9f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.288 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.280+0000 7f69ca223740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a99b92eab0 con 0x55a99b6c42f0 2024-09-21T00:59:54.288 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.280+0000 7f69ca223740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a99b99c730 con 0x55a99b6cc4d0 2024-09-21T00:59:54.288 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.280+0000 7f69ca223740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a99ba96ad0 con 0x55a99b6ed1b0 2024-09-21T00:59:54.288 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.280+0000 7f69ca223740 10 client.0 _ll_register_callbacks cb 0x55a99b9f06b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:54.288 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.281+0000 7f69c0859640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a99b6cc4d0 0x55a99ba9ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.288 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.281+0000 7f69c105a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a99b6c42f0 0x55a99ba9e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.288 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.281+0000 7f69c0859640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a99b6cc4d0 0x55a99ba9ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:57080/0 (socket says 172.21.15.1:57080) 2024-09-21T00:59:54.289 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.281+0000 7f69c0859640 1 -- 172.21.15.1:0/3704335163 learned_addr learned my addr 172.21.15.1:0/3704335163 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:54.289 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.281+0000 7f69c185b640 1 --2- 172.21.15.1:0/3704335163 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a99b6ed1b0 0x55a99ba9f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.289 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.281+0000 7f69c105a640 1 -- 172.21.15.1:0/3704335163 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a99b6ed1b0 msgr2=0x55a99ba9f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:54.289 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.281+0000 7f69c105a640 1 --2- 172.21.15.1:0/3704335163 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a99b6ed1b0 0x55a99ba9f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.289 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.281+0000 7f69c105a640 1 -- 172.21.15.1:0/3704335163 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a99b6cc4d0 msgr2=0x55a99ba9ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:54.289 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.281+0000 7f69c105a640 1 --2- 172.21.15.1:0/3704335163 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a99b6cc4d0 0x55a99ba9ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.289 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.281+0000 7f69c105a640 1 -- 172.21.15.1:0/3704335163 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a99b758790 con 0x55a99b6c42f0 2024-09-21T00:59:54.289 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.281+0000 7f69c185b640 1 --2- 172.21.15.1:0/3704335163 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a99b6ed1b0 0x55a99ba9f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:54.289 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.281+0000 7f69c0859640 1 --2- 172.21.15.1:0/3704335163 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a99b6cc4d0 0x55a99ba9ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:54.289 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.281+0000 7f69c105a640 1 --2- 172.21.15.1:0/3704335163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a99b6c42f0 0x55a99ba9e590 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f69b8004050 tx=0x7f69b8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c7ba65182053be server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:54.289 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.281+0000 7f69a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:59:54.289 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.281+0000 7f69a4ff9640 1 -- 172.21.15.1:0/3704335163 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b802c060 con 0x55a99b6c42f0 2024-09-21T00:59:54.289 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.281+0000 7f69a4ff9640 1 -- 172.21.15.1:0/3704335163 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f69b8017030 con 0x55a99b6c42f0 2024-09-21T00:59:54.289 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.281+0000 7f69ca223740 1 -- 172.21.15.1:0/3704335163 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69b4030520 con 0x55a99b6c42f0 2024-09-21T00:59:54.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.282+0000 7f69a4ff9640 1 -- 172.21.15.1:0/3704335163 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f69b8027410 con 0x55a99b6c42f0 2024-09-21T00:59:54.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.282+0000 7f69ca223740 10 client.16329 fetch_fsmap learned FSMap version 31 2024-09-21T00:59:54.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.282+0000 7f69ca223740 1 -- 172.21.15.1:0/3704335163 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a99b7d1620 con 0x55a99b6c42f0 2024-09-21T00:59:54.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.282+0000 7f69a4ff9640 1 -- 172.21.15.1:0/3704335163 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69b4030520 con 0x55a99b6c42f0 2024-09-21T00:59:54.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.282+0000 7f69a4ff9640 1 -- 172.21.15.1:0/3704335163 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7f69b8032720 con 0x55a99b6c42f0 2024-09-21T00:59:54.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.282+0000 7f69ca223740 10 client.16329 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:59:54.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.282+0000 7f69ca223740 10 client.16329 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:54.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.282+0000 7f69ca223740 20 client.16329 populate_metadata read hostname 'smithi001' 2024-09-21T00:59:54.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.282+0000 7f69ca223740 1 --2- 172.21.15.1:0/3704335163 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a99b6abd80 0x55a99baabe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.282+0000 7f69ca223740 4 client.16329 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:59:54.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.282+0000 7f69ca223740 1 -- 172.21.15.1:0/3704335163 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a99ba09640 con 0x55a99b6abd80 2024-09-21T00:59:54.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.282+0000 7f69c0859640 1 --2- 172.21.15.1:0/3704335163 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a99b6abd80 0x55a99baabe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.283+0000 7f69a4ff9640 10 client.16329 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:54.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.283+0000 7f69c0859640 1 --2- 172.21.15.1:0/3704335163 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a99b6abd80 0x55a99baabe20 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e7aaff05780b700 server_cookie=ec42dc9e023c6427 in_seq=0 out_seq=0 2024-09-21T00:59:54.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.284+0000 7f69a4ff9640 1 -- 172.21.15.1:0/3704335163 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a99ba09640 con 0x55a99b6abd80 2024-09-21T00:59:54.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.284+0000 7f69a4ff9640 10 client.16329 handle_command_reply: tid=0 2024-09-21T00:59:54.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.284+0000 7f69ca223740 1 client.16329 shutdown 2024-09-21T00:59:54.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.284+0000 7f69ca223740 1 -- 172.21.15.1:0/3704335163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a99b6c42f0 msgr2=0x55a99ba9e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:54.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.284+0000 7f69ca223740 1 --2- 172.21.15.1:0/3704335163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a99b6c42f0 0x55a99ba9e590 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f69b8004050 tx=0x7f69b8004730 comp rx=0 tx=0).stop 2024-09-21T00:59:54.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.284+0000 7f69ca223740 1 -- 172.21.15.1:0/3704335163 shutdown_connections 2024-09-21T00:59:54.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.284+0000 7f69ca223740 1 --2- 172.21.15.1:0/3704335163 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a99b6abd80 0x55a99baabe20 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.284+0000 7f69ca223740 1 --2- 172.21.15.1:0/3704335163 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a99b6ed1b0 0x55a99ba9f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.284+0000 7f69ca223740 1 --2- 172.21.15.1:0/3704335163 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a99b6cc4d0 0x55a99ba9ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.284+0000 7f69ca223740 1 --2- 172.21.15.1:0/3704335163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a99b6c42f0 0x55a99ba9e590 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.284+0000 7f69a4ff9640 0 client.16329 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:54.292 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.284+0000 7f69ca223740 1 -- 172.21.15.1:0/3704335163 >> 172.21.15.1:0/3704335163 conn(0x55a99b6e1300 msgr2=0x55a99ba8eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:54.292 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.284+0000 7f69ca223740 1 -- 172.21.15.1:0/3704335163 shutdown_connections 2024-09-21T00:59:54.292 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.284+0000 7f69ca223740 1 -- 172.21.15.1:0/3704335163 wait complete. 2024-09-21T00:59:54.292 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.284+0000 7f69ca223740 20 client.16329 trim_cache size 0 max 16384 2024-09-21T00:59:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.299+0000 7f69ca223740 1 Processor -- start 2024-09-21T00:59:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.299+0000 7f69ca223740 1 -- start start 2024-09-21T00:59:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.299+0000 7f69ca223740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a99b6c42f0 0x55a99ba8b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.299+0000 7f69ca223740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a99b6cc4d0 0x55a99ba8f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.299+0000 7f69ca223740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a99b6ed1b0 0x55a99ba8fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.299+0000 7f69ca223740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f69bc1ab000 con 0x55a99b6c42f0 2024-09-21T00:59:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.299+0000 7f69ca223740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f69bc1accc0 con 0x55a99b6ed1b0 2024-09-21T00:59:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.299+0000 7f69ca223740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f69bc1ab6d0 con 0x55a99b6cc4d0 2024-09-21T00:59:54.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.299+0000 7f69c105a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a99b6c42f0 0x55a99ba8b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.299+0000 7f69c185b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a99b6ed1b0 0x55a99ba8fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.299+0000 7f69c105a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a99b6c42f0 0x55a99ba8b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35736/0 (socket says 172.21.15.1:35736) 2024-09-21T00:59:54.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.299+0000 7f69c105a640 1 -- 172.21.15.1:0/3685064275 learned_addr learned my addr 172.21.15.1:0/3685064275 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:54.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.299+0000 7f69c0859640 1 --2- 172.21.15.1:0/3685064275 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a99b6cc4d0 0x55a99ba8f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.299+0000 7f69c105a640 1 -- 172.21.15.1:0/3685064275 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a99b6cc4d0 msgr2=0x55a99ba8f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:54.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.299+0000 7f69c105a640 1 --2- 172.21.15.1:0/3685064275 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a99b6cc4d0 0x55a99ba8f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.299+0000 7f69c105a640 1 -- 172.21.15.1:0/3685064275 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a99b6ed1b0 msgr2=0x55a99ba8fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:54.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.299+0000 7f69c105a640 1 --2- 172.21.15.1:0/3685064275 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a99b6ed1b0 0x55a99ba8fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.299+0000 7f69c105a640 1 -- 172.21.15.1:0/3685064275 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a99ba9dea0 con 0x55a99b6c42f0 2024-09-21T00:59:54.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.299+0000 7f69c0859640 1 --2- 172.21.15.1:0/3685064275 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a99b6cc4d0 0x55a99ba8f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:59:54.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.300+0000 7f69c105a640 1 --2- 172.21.15.1:0/3685064275 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a99b6c42f0 0x55a99ba8b5c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f69b8005fa0 tx=0x7f69b8032610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e855f39aa4843a9d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:54.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.300+0000 7f69a6ffd640 1 -- 172.21.15.1:0/3685064275 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b80275b0 con 0x55a99b6c42f0 2024-09-21T00:59:54.309 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.300+0000 7f69a6ffd640 1 -- 172.21.15.1:0/3685064275 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69b8027c00 con 0x55a99b6c42f0 2024-09-21T00:59:54.309 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.300+0000 7f69a6ffd640 1 -- 172.21.15.1:0/3685064275 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b8011af0 con 0x55a99b6c42f0 2024-09-21T00:59:54.309 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.301+0000 7f69ca223740 1 -- 172.21.15.1:0/3685064275 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a99b6c42f0 msgr2=0x55a99ba8b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:54.309 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.301+0000 7f69ca223740 1 --2- 172.21.15.1:0/3685064275 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a99b6c42f0 0x55a99ba8b5c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f69b8005fa0 tx=0x7f69b8032610 comp rx=0 tx=0).stop 2024-09-21T00:59:54.309 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.301+0000 7f69ca223740 1 -- 172.21.15.1:0/3685064275 shutdown_connections 2024-09-21T00:59:54.309 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.301+0000 7f69ca223740 1 --2- 172.21.15.1:0/3685064275 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a99b6ed1b0 0x55a99ba8fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.309 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.301+0000 7f69ca223740 1 --2- 172.21.15.1:0/3685064275 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a99b6cc4d0 0x55a99ba8f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.309 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.301+0000 7f69ca223740 1 --2- 172.21.15.1:0/3685064275 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a99b6c42f0 0x55a99ba8b5c0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.309 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.301+0000 7f69ca223740 1 -- 172.21.15.1:0/3685064275 >> 172.21.15.1:0/3685064275 conn(0x55a99b6e1300 msgr2=0x55a99ba9d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:54.309 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.301+0000 7f69ca223740 1 -- 172.21.15.1:0/3685064275 shutdown_connections 2024-09-21T00:59:54.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.301+0000 7f69ca223740 1 -- 172.21.15.1:0/3685064275 wait complete. 2024-09-21T00:59:54.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.301+0000 7f69ca223740 1 -- start start 2024-09-21T00:59:54.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.302+0000 7f69ca223740 1 Processor -- start 2024-09-21T00:59:54.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.302+0000 7f69ca223740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a99b6c42f0 0x55a99bb11ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.302+0000 7f69ca223740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a99b6cc4d0 0x55a99bb12590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.302+0000 7f69ca223740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a99b6ed1b0 0x55a99bb13100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.302+0000 7f69ca223740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f69bc1ac530 con 0x55a99b6ed1b0 2024-09-21T00:59:54.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.302+0000 7f69ca223740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f69bc1abe60 con 0x55a99b6c42f0 2024-09-21T00:59:54.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.302+0000 7f69ca223740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f69bc1a8fe0 con 0x55a99b6cc4d0 2024-09-21T00:59:54.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.302+0000 7f69ca223740 10 client.0 _ll_register_callbacks cb 0x7f69b8003f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:54.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.302+0000 7f69c185b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a99b6ed1b0 0x55a99bb13100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.302+0000 7f69c105a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a99b6c42f0 0x55a99bb11ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.311 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.302+0000 7f69c185b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a99b6ed1b0 0x55a99bb13100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35748/0 (socket says 172.21.15.1:35748) 2024-09-21T00:59:54.311 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.302+0000 7f69c185b640 1 -- 172.21.15.1:0/1618166866 learned_addr learned my addr 172.21.15.1:0/1618166866 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:54.311 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.302+0000 7f69c0859640 1 --2- 172.21.15.1:0/1618166866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a99b6cc4d0 0x55a99bb12590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.311 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.303+0000 7f69c185b640 1 -- 172.21.15.1:0/1618166866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a99b6cc4d0 msgr2=0x55a99bb12590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:54.311 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.303+0000 7f69c185b640 1 --2- 172.21.15.1:0/1618166866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a99b6cc4d0 0x55a99bb12590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.311 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.303+0000 7f69c185b640 1 -- 172.21.15.1:0/1618166866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a99b6c42f0 msgr2=0x55a99bb11ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:54.311 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.303+0000 7f69c185b640 1 --2- 172.21.15.1:0/1618166866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a99b6c42f0 0x55a99bb11ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.311 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.303+0000 7f69c185b640 1 -- 172.21.15.1:0/1618166866 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a99bb13860 con 0x55a99b6ed1b0 2024-09-21T00:59:54.311 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.303+0000 7f69c185b640 1 --2- 172.21.15.1:0/1618166866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a99b6ed1b0 0x55a99bb13100 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f69b402acb0 tx=0x7f69b402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f84f425e56ff7f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:54.311 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.303+0000 7f69a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:59:54.311 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.303+0000 7f69a4ff9640 1 -- 172.21.15.1:0/1618166866 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b4036070 con 0x55a99b6ed1b0 2024-09-21T00:59:54.311 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.303+0000 7f69a4ff9640 1 -- 172.21.15.1:0/1618166866 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f69b4030db0 con 0x55a99b6ed1b0 2024-09-21T00:59:54.311 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.303+0000 7f69ca223740 1 -- 172.21.15.1:0/1618166866 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69b8027c00 con 0x55a99b6ed1b0 2024-09-21T00:59:54.311 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.303+0000 7f69a4ff9640 1 -- 172.21.15.1:0/1618166866 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f69b4041040 con 0x55a99b6ed1b0 2024-09-21T00:59:54.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.303+0000 7f69ca223740 10 client.16335 fetch_fsmap learned FSMap version 31 2024-09-21T00:59:54.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.303+0000 7f69ca223740 1 -- 172.21.15.1:0/1618166866 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a99bb1ab30 con 0x55a99b6ed1b0 2024-09-21T00:59:54.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.304+0000 7f69a4ff9640 1 -- 172.21.15.1:0/1618166866 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69b8027c00 con 0x55a99b6ed1b0 2024-09-21T00:59:54.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.304+0000 7f69a4ff9640 1 -- 172.21.15.1:0/1618166866 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7f69b4004690 con 0x55a99b6ed1b0 2024-09-21T00:59:54.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.304+0000 7f69ca223740 10 client.16335 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:59:54.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.304+0000 7f69ca223740 10 client.16335 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:54.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.304+0000 7f69ca223740 20 client.16335 populate_metadata read hostname 'smithi001' 2024-09-21T00:59:54.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.304+0000 7f69ca223740 1 --2- 172.21.15.1:0/1618166866 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a99b6811c0 0x55a99bb1d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.304+0000 7f69ca223740 4 client.16335 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T00:59:54.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.304+0000 7f69ca223740 1 -- 172.21.15.1:0/1618166866 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a99ba050f0 con 0x55a99b6811c0 2024-09-21T00:59:54.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.304+0000 7f69c105a640 1 --2- 172.21.15.1:0/1618166866 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a99b6811c0 0x55a99bb1d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.305+0000 7f69a4ff9640 10 client.16335 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:54.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:54.305+0000 7f69c105a640 1 --2- 172.21.15.1:0/1618166866 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a99b6811c0 0x55a99bb1d240 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16b1d4590f1145a8 server_cookie=6c508cb2074978cd in_seq=0 out_seq=0 2024-09-21T00:59:54.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.482+0000 7fe3e6f61640 1 -- 172.21.15.1:0/2222297332 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3e0111f40 msgr2=0x7fe3e010a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:54.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.482+0000 7fe3e6f61640 1 --2- 172.21.15.1:0/2222297332 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3e0111f40 0x7fe3e010a3c0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fe3d801acb0 tx=0x7fe3d803b900 comp rx=0 tx=0).stop 2024-09-21T00:59:54.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.489+0000 7fe3e6f61640 1 -- 172.21.15.1:0/2222297332 shutdown_connections 2024-09-21T00:59:54.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.489+0000 7fe3e6f61640 1 --2- 172.21.15.1:0/2222297332 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3e011cc30 0x7fe3e011f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.489+0000 7fe3e6f61640 1 --2- 172.21.15.1:0/2222297332 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3e010a9e0 0x7fe3e010adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.489+0000 7fe3e6f61640 1 --2- 172.21.15.1:0/2222297332 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3e0111f40 0x7fe3e010a3c0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.489+0000 7fe3e6f61640 1 -- 172.21.15.1:0/2222297332 >> 172.21.15.1:0/2222297332 conn(0x7fe3e0070ec0 msgr2=0x7fe3e00712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:54.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.498+0000 7fe3e6f61640 1 -- 172.21.15.1:0/2222297332 shutdown_connections 2024-09-21T00:59:54.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.500+0000 7fe3e6f61640 1 -- 172.21.15.1:0/2222297332 wait complete. 2024-09-21T00:59:54.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.501+0000 7fe3e6f61640 1 Processor -- start 2024-09-21T00:59:54.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.501+0000 7fe3e6f61640 1 -- start start 2024-09-21T00:59:54.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.501+0000 7fe3e6f61640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3e010a9e0 0x7fe3e011c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.501+0000 7fe3e6f61640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3e0111f40 0x7fe3e01187a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.501+0000 7fe3e6f61640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3e011cc30 0x7fe3e0118db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.501+0000 7fe3e6f61640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e0114c90 con 0x7fe3e010a9e0 2024-09-21T00:59:54.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.501+0000 7fe3e6f61640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e0114b10 con 0x7fe3e011cc30 2024-09-21T00:59:54.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.501+0000 7fe3e6f61640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e0114e10 con 0x7fe3e0111f40 2024-09-21T00:59:54.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.502+0000 7fe3e54fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3e011cc30 0x7fe3e0118db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.502+0000 7fe3e54fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3e011cc30 0x7fe3e0118db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:57108/0 (socket says 172.21.15.1:57108) 2024-09-21T00:59:54.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.502+0000 7fe3e54fe640 1 -- 172.21.15.1:0/4253194916 learned_addr learned my addr 172.21.15.1:0/4253194916 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:54.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.502+0000 7fe3dffff640 1 --2- 172.21.15.1:0/4253194916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3e0111f40 0x7fe3e01187a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.503+0000 7fe3e54fe640 1 -- 172.21.15.1:0/4253194916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3e0111f40 msgr2=0x7fe3e01187a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:54.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.503+0000 7fe3e54fe640 1 --2- 172.21.15.1:0/4253194916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3e0111f40 0x7fe3e01187a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.503+0000 7fe3e54fe640 1 -- 172.21.15.1:0/4253194916 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3e010a9e0 msgr2=0x7fe3e011c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:54.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.503+0000 7fe3e54fe640 1 --2- 172.21.15.1:0/4253194916 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3e010a9e0 0x7fe3e011c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.503+0000 7fe3e54fe640 1 -- 172.21.15.1:0/4253194916 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3e01195d0 con 0x7fe3e011cc30 2024-09-21T00:59:54.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.504+0000 7fe3e54fe640 1 --2- 172.21.15.1:0/4253194916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3e011cc30 0x7fe3e0118db0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe3d400b3f0 tx=0x7fe3d400b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:54.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.508+0000 7fe3ddffb640 1 -- 172.21.15.1:0/4253194916 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d4015020 con 0x7fe3e011cc30 2024-09-21T00:59:54.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.508+0000 7fe3e6f61640 1 -- 172.21.15.1:0/4253194916 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3e01acef0 con 0x7fe3e011cc30 2024-09-21T00:59:54.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.508+0000 7fe3e6f61640 1 -- 172.21.15.1:0/4253194916 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3e01ad340 con 0x7fe3e011cc30 2024-09-21T00:59:54.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.510+0000 7fe3ddffb640 1 -- 172.21.15.1:0/4253194916 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3d4011ce0 con 0x7fe3e011cc30 2024-09-21T00:59:54.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.510+0000 7fe3ddffb640 1 -- 172.21.15.1:0/4253194916 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d4010dc0 con 0x7fe3e011cc30 2024-09-21T00:59:54.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.516+0000 7fe3ddffb640 1 -- 172.21.15.1:0/4253194916 <== mon.2 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7fe3d4018020 con 0x7fe3e011cc30 2024-09-21T00:59:54.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.520+0000 7fe3ddffb640 1 --2- 172.21.15.1:0/4253194916 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe3c80b6660 0x7fe3c80b8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.521+0000 7fe3e4cfd640 1 --2- 172.21.15.1:0/4253194916 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe3c80b6660 0x7fe3c80b8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.522+0000 7fe3ed4d5740 1 Processor -- start 2024-09-21T00:59:54.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.522+0000 7fe3ed4d5740 1 -- start start 2024-09-21T00:59:54.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.522+0000 7fe3ed4d5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562026a0b070 0x562026db26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.522+0000 7fe3ed4d5740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620269e21b0 0x562026db2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.522+0000 7fe3ed4d5740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620269ea390 0x562026db3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.523+0000 7fe3dffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620269e21b0 0x562026db2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.523+0000 7fe3dffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620269e21b0 0x562026db2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:57110/0 (socket says 172.21.15.1:57110) 2024-09-21T00:59:54.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.523+0000 7fe3e54fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620269ea390 0x562026db3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.523+0000 7fe3e54fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620269ea390 0x562026db3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:49040/0 (socket says 172.21.15.1:49040) 2024-09-21T00:59:54.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.523+0000 7fe3dffff640 1 -- 172.21.15.1:0/186127467 learned_addr learned my addr 172.21.15.1:0/186127467 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:54.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.523+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/186127467 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562026d28ea0 con 0x562026a0b070 2024-09-21T00:59:54.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.523+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/186127467 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562026d182d0 con 0x5620269e21b0 2024-09-21T00:59:54.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.523+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/186127467 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x562026d1c0e0 con 0x5620269ea390 2024-09-21T00:59:54.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.524+0000 7fe3dffff640 1 -- 172.21.15.1:0/186127467 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620269ea390 msgr2=0x562026db3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:54.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.524+0000 7fe3dffff640 1 --2- 172.21.15.1:0/186127467 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620269ea390 0x562026db3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.524+0000 7fe3dffff640 1 -- 172.21.15.1:0/186127467 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562026a0b070 msgr2=0x562026db26a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T00:59:54.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.524+0000 7fe3dffff640 1 --2- 172.21.15.1:0/186127467 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562026a0b070 0x562026db26a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.524+0000 7fe3dffff640 1 -- 172.21.15.1:0/186127467 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562026a76650 con 0x5620269e21b0 2024-09-21T00:59:54.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.529+0000 7fe3e4cfd640 1 --2- 172.21.15.1:0/4253194916 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe3c80b6660 0x7fe3c80b8b70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe3d803be20 tx=0x7fe3d8000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:54.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.529+0000 7fe3ddffb640 1 -- 172.21.15.1:0/4253194916 <== mon.2 v2:172.21.15.42:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fe3d40e7920 con 0x7fe3e011cc30 2024-09-21T00:59:54.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.531+0000 7fe3dffff640 1 --2- 172.21.15.1:0/186127467 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620269e21b0 0x562026db2be0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0009c20 tx=0x7fe3d0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba31b0e93fe76c2d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:54.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.533+0000 7fe3c6ffd640 1 -- 172.21.15.1:0/186127467 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d0004220 con 0x5620269e21b0 2024-09-21T00:59:54.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.533+0000 7fe3c6ffd640 1 -- 172.21.15.1:0/186127467 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3d00043c0 con 0x5620269e21b0 2024-09-21T00:59:54.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.534+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/186127467 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620269e21b0 msgr2=0x562026db2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:54.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.534+0000 7fe3ed4d5740 1 --2- 172.21.15.1:0/186127467 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620269e21b0 0x562026db2be0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0009c20 tx=0x7fe3d0011810 comp rx=0 tx=0).stop 2024-09-21T00:59:54.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.535+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/186127467 shutdown_connections 2024-09-21T00:59:54.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.535+0000 7fe3ed4d5740 1 --2- 172.21.15.1:0/186127467 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620269ea390 0x562026db3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.535+0000 7fe3ed4d5740 1 --2- 172.21.15.1:0/186127467 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620269e21b0 0x562026db2be0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.535+0000 7fe3ed4d5740 1 --2- 172.21.15.1:0/186127467 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562026a0b070 0x562026db26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.535+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/186127467 >> 172.21.15.1:0/186127467 conn(0x5620269ff460 msgr2=0x562026db0590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:54.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.535+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/186127467 shutdown_connections 2024-09-21T00:59:54.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.535+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/186127467 wait complete. 2024-09-21T00:59:54.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.536+0000 7fe3ed4d5740 1 -- start start 2024-09-21T00:59:54.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.536+0000 7fe3ed4d5740 1 Processor -- start 2024-09-21T00:59:54.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.539+0000 7fe3ed4d5740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620269ea390 0x562026dc0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.539+0000 7fe3ed4d5740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562026a0b070 0x562026dbd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.539+0000 7fe3ed4d5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620269c99f0 0x562026dbe030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.540+0000 7fe3e4cfd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620269ea390 0x562026dc0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.540+0000 7fe3e4cfd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620269ea390 0x562026dc0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:49052/0 (socket says 172.21.15.1:49052) 2024-09-21T00:59:54.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.540+0000 7fe3dffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562026a0b070 0x562026dbd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.540+0000 7fe3e54fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620269c99f0 0x562026dbe030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.540+0000 7fe3e54fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620269c99f0 0x562026dbe030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35770/0 (socket says 172.21.15.1:35770) 2024-09-21T00:59:54.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.540+0000 7fe3e4cfd640 1 -- 172.21.15.1:0/248737003 learned_addr learned my addr 172.21.15.1:0/248737003 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:54.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.540+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/248737003 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562026b79700 con 0x5620269c99f0 2024-09-21T00:59:54.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.540+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/248737003 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562026cb3160 con 0x562026a0b070 2024-09-21T00:59:54.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.540+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/248737003 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x562026dc0ed0 con 0x5620269ea390 2024-09-21T00:59:54.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.541+0000 7fe3e54fe640 1 -- 172.21.15.1:0/248737003 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620269ea390 msgr2=0x562026dc0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:54.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.541+0000 7fe3e54fe640 1 --2- 172.21.15.1:0/248737003 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620269ea390 0x562026dc0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.541+0000 7fe3e54fe640 1 -- 172.21.15.1:0/248737003 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562026a0b070 msgr2=0x562026dbd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:54.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.541+0000 7fe3e54fe640 1 --2- 172.21.15.1:0/248737003 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562026a0b070 0x562026dbd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.541+0000 7fe3e54fe640 1 -- 172.21.15.1:0/248737003 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562026ce0c90 con 0x5620269c99f0 2024-09-21T00:59:54.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.541+0000 7fe3e54fe640 1 --2- 172.21.15.1:0/248737003 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620269c99f0 0x562026dbe030 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fe3d40e5450 tx=0x7fe3d40ad990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=901e2e069a4900c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:54.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.542+0000 7fe3ed4d5740 10 client.0 _ll_register_callbacks cb 0x562026ccc9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:54.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.542+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/248737003 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562026d2adf0 con 0x5620269c99f0 2024-09-21T00:59:54.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.543+0000 7fe3bffff640 10 client.16341 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:59:54.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.543+0000 7fe3bffff640 1 -- 172.21.15.1:0/248737003 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d40107e0 con 0x5620269c99f0 2024-09-21T00:59:54.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.543+0000 7fe3bffff640 1 -- 172.21.15.1:0/248737003 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fe3d4011830 con 0x5620269c99f0 2024-09-21T00:59:54.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.545+0000 7fe3bffff640 1 -- 172.21.15.1:0/248737003 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fe3d40ad5a0 con 0x5620269c99f0 2024-09-21T00:59:54.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.545+0000 7fe3ed4d5740 10 client.16341 fetch_fsmap learned FSMap version 31 2024-09-21T00:59:54.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.545+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/248737003 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({fsmap=31}) -- 0x562026dcc760 con 0x5620269c99f0 2024-09-21T00:59:54.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.545+0000 7fe3bffff640 1 -- 172.21.15.1:0/248737003 <== mon.0 v2:172.21.15.1:3300/0 4 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7fe3d40b2120 con 0x5620269c99f0 2024-09-21T00:59:54.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.546+0000 7fe3ed4d5740 10 client.16341 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:59:54.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.546+0000 7fe3ed4d5740 10 client.16341 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T00:59:54.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.546+0000 7fe3ed4d5740 20 client.16341 populate_metadata read hostname 'smithi001' 2024-09-21T00:59:54.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.546+0000 7fe3ed4d5740 1 --2- 172.21.15.1:0/248737003 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x56202699eda0 0x562026dd0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.546+0000 7fe3ed4d5740 4 client.16341 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:59:54.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.546+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/248737003 --> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562026d2adf0 con 0x56202699eda0 2024-09-21T00:59:54.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.549+0000 7fe3e4cfd640 1 --2- 172.21.15.1:0/248737003 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x56202699eda0 0x562026dd0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.567+0000 7fe3e4cfd640 1 --2- 172.21.15.1:0/248737003 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x56202699eda0 0x562026dd0040 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7b58e54525069d5c server_cookie=82ddff36edc6fb08 in_seq=0 out_seq=0 2024-09-21T00:59:54.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.567+0000 7fe3bffff640 10 client.16341 ms_handle_connect on v2:172.21.15.193:6838/1365361177 2024-09-21T00:59:54.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.570+0000 7fe3bffff640 1 -- 172.21.15.1:0/248737003 <== mds.1 v2:172.21.15.193:6838/1365361177 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562026d2adf0 con 0x56202699eda0 2024-09-21T00:59:54.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.570+0000 7fe3bffff640 10 client.16341 handle_command_reply: tid=0 2024-09-21T00:59:54.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.570+0000 7fe3ed4d5740 1 client.16341 shutdown 2024-09-21T00:59:54.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.571+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/248737003 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620269c99f0 msgr2=0x562026dbe030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:54.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.571+0000 7fe3ed4d5740 1 --2- 172.21.15.1:0/248737003 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620269c99f0 0x562026dbe030 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fe3d40e5450 tx=0x7fe3d40ad990 comp rx=0 tx=0).stop 2024-09-21T00:59:54.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.571+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/248737003 shutdown_connections 2024-09-21T00:59:54.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.571+0000 7fe3ed4d5740 1 --2- 172.21.15.1:0/248737003 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x56202699eda0 0x562026dd0040 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.571+0000 7fe3ed4d5740 1 --2- 172.21.15.1:0/248737003 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620269c99f0 0x562026dbe030 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.571+0000 7fe3ed4d5740 1 --2- 172.21.15.1:0/248737003 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562026a0b070 0x562026dbd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.571+0000 7fe3ed4d5740 1 --2- 172.21.15.1:0/248737003 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620269ea390 0x562026dc0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.571+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/248737003 >> 172.21.15.1:0/248737003 conn(0x5620269ff460 msgr2=0x562026db5880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:54.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.571+0000 7fe3bffff640 0 client.16341 ms_handle_reset on v2:172.21.15.193:6838/1365361177 2024-09-21T00:59:54.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.571+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/248737003 shutdown_connections 2024-09-21T00:59:54.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.571+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/248737003 wait complete. 2024-09-21T00:59:54.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.571+0000 7fe3ed4d5740 20 client.16341 trim_cache size 0 max 16384 2024-09-21T00:59:54.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.612+0000 7fe3ed4d5740 1 Processor -- start 2024-09-21T00:59:54.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.612+0000 7fe3ed4d5740 1 -- start start 2024-09-21T00:59:54.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.613+0000 7fe3ed4d5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620269c99f0 0x562026dcff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.617+0000 7fe3e4cfd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620269c99f0 0x562026dcff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.617+0000 7fe3e4cfd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620269c99f0 0x562026dcff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35782/0 (socket says 172.21.15.1:35782) 2024-09-21T00:59:54.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.617+0000 7fe3e4cfd640 1 -- 172.21.15.1:0/3302908502 learned_addr learned my addr 172.21.15.1:0/3302908502 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:54.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.617+0000 7fe3ed4d5740 1 --2- 172.21.15.1:0/3302908502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620269ea390 0x562026db7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.617+0000 7fe3ed4d5740 1 --2- 172.21.15.1:0/3302908502 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562026a0b070 0x562026db7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.617+0000 7fe3dffff640 1 --2- 172.21.15.1:0/3302908502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620269ea390 0x562026db7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.618+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/3302908502 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe3cc00e620 con 0x5620269c99f0 2024-09-21T00:59:54.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.618+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/3302908502 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe3cc0102e0 con 0x5620269ea390 2024-09-21T00:59:54.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.618+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/3302908502 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe3cc00ecf0 con 0x562026a0b070 2024-09-21T00:59:54.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.618+0000 7fe3e54fe640 1 --2- 172.21.15.1:0/3302908502 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562026a0b070 0x562026db7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.619+0000 7fe3e4cfd640 1 -- 172.21.15.1:0/3302908502 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562026a0b070 msgr2=0x562026db7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:54.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.619+0000 7fe3e4cfd640 1 --2- 172.21.15.1:0/3302908502 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562026a0b070 0x562026db7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.619+0000 7fe3e4cfd640 1 -- 172.21.15.1:0/3302908502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620269ea390 msgr2=0x562026db7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:54.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.619+0000 7fe3e4cfd640 1 --2- 172.21.15.1:0/3302908502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620269ea390 0x562026db7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.619+0000 7fe3e4cfd640 1 -- 172.21.15.1:0/3302908502 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562026dca810 con 0x5620269c99f0 2024-09-21T00:59:54.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.619+0000 7fe3e4cfd640 1 --2- 172.21.15.1:0/3302908502 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620269c99f0 0x562026dcff50 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fe3d801acb0 tx=0x7fe3d804d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f677625055ebfcd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:54.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.625+0000 7fe3c67fc640 1 -- 172.21.15.1:0/3302908502 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d8045050 con 0x5620269c99f0 2024-09-21T00:59:54.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.625+0000 7fe3c67fc640 1 -- 172.21.15.1:0/3302908502 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3d8011030 con 0x5620269c99f0 2024-09-21T00:59:54.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.625+0000 7fe3c67fc640 1 -- 172.21.15.1:0/3302908502 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d80042a0 con 0x5620269c99f0 2024-09-21T00:59:54.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.626+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/3302908502 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620269c99f0 msgr2=0x562026dcff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:54.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.626+0000 7fe3ed4d5740 1 --2- 172.21.15.1:0/3302908502 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620269c99f0 0x562026dcff50 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fe3d801acb0 tx=0x7fe3d804d000 comp rx=0 tx=0).stop 2024-09-21T00:59:54.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.627+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/3302908502 shutdown_connections 2024-09-21T00:59:54.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.627+0000 7fe3ed4d5740 1 --2- 172.21.15.1:0/3302908502 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562026a0b070 0x562026db7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.627+0000 7fe3ed4d5740 1 --2- 172.21.15.1:0/3302908502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620269ea390 0x562026db7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.627+0000 7fe3ed4d5740 1 --2- 172.21.15.1:0/3302908502 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620269c99f0 0x562026dcff50 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.627+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/3302908502 >> 172.21.15.1:0/3302908502 conn(0x5620269ff460 msgr2=0x562026db8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:54.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.634+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/3302908502 shutdown_connections 2024-09-21T00:59:54.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.634+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/3302908502 wait complete. 2024-09-21T00:59:54.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.635+0000 7fe3ed4d5740 1 -- start start 2024-09-21T00:59:54.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.635+0000 7fe3ed4d5740 1 Processor -- start 2024-09-21T00:59:54.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.636+0000 7fe3ed4d5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620269c99f0 0x562026dc2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.637+0000 7fe3e4cfd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620269c99f0 0x562026dc2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.637+0000 7fe3e4cfd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620269c99f0 0x562026dc2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35790/0 (socket says 172.21.15.1:35790) 2024-09-21T00:59:54.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.637+0000 7fe3e4cfd640 1 -- 172.21.15.1:0/3366413797 learned_addr learned my addr 172.21.15.1:0/3366413797 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:54.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.637+0000 7fe3ed4d5740 1 --2- 172.21.15.1:0/3366413797 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620269ea390 0x562026dc2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.637+0000 7fe3ed4d5740 1 --2- 172.21.15.1:0/3366413797 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562026a0b070 0x562026dc2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.637+0000 7fe3dffff640 1 --2- 172.21.15.1:0/3366413797 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620269ea390 0x562026dc2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.637+0000 7fe3e54fe640 1 --2- 172.21.15.1:0/3366413797 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562026a0b070 0x562026dc2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.637+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/3366413797 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe3cc00fb50 con 0x5620269c99f0 2024-09-21T00:59:54.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.638+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/3366413797 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe3cc00f480 con 0x562026a0b070 2024-09-21T00:59:54.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.638+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/3366413797 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe3cc00c600 con 0x5620269ea390 2024-09-21T00:59:54.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.642+0000 7fe3e4cfd640 1 -- 172.21.15.1:0/3366413797 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620269ea390 msgr2=0x562026dc2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:54.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.642+0000 7fe3e4cfd640 1 --2- 172.21.15.1:0/3366413797 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620269ea390 0x562026dc2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.642+0000 7fe3e4cfd640 1 -- 172.21.15.1:0/3366413797 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562026a0b070 msgr2=0x562026dc2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:54.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.642+0000 7fe3e4cfd640 1 --2- 172.21.15.1:0/3366413797 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562026a0b070 0x562026dc2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.642+0000 7fe3e4cfd640 1 -- 172.21.15.1:0/3366413797 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562026e39a40 con 0x5620269c99f0 2024-09-21T00:59:54.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.643+0000 7fe3ed4d5740 10 client.0 _ll_register_callbacks cb 0x7fe3d40aa0e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:54.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.643+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/3366413797 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3d8011030 con 0x5620269c99f0 2024-09-21T00:59:54.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.643+0000 7fe3e4cfd640 1 --2- 172.21.15.1:0/3366413797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620269c99f0 0x562026dc2120 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fe3d801a1c0 tx=0x7fe3d8040580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e8589bbc838145 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:54.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.644+0000 7fe3bffff640 10 client.16347 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T00:59:54.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.645+0000 7fe3bffff640 1 -- 172.21.15.1:0/3366413797 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d8041600 con 0x5620269c99f0 2024-09-21T00:59:54.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.648+0000 7fe3bffff640 1 -- 172.21.15.1:0/3366413797 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fe3d80417a0 con 0x5620269c99f0 2024-09-21T00:59:54.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.648+0000 7fe3bffff640 1 -- 172.21.15.1:0/3366413797 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fe3d8066050 con 0x5620269c99f0 2024-09-21T00:59:54.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.649+0000 7fe3ed4d5740 10 client.16347 fetch_fsmap learned FSMap version 31 2024-09-21T00:59:54.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.649+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/3366413797 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({fsmap=31}) -- 0x562026e3aa00 con 0x5620269c99f0 2024-09-21T00:59:54.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.650+0000 7fe3bffff640 1 -- 172.21.15.1:0/3366413797 <== mon.0 v2:172.21.15.1:3300/0 4 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7fe3d8004040 con 0x5620269c99f0 2024-09-21T00:59:54.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.651+0000 7fe3ed4d5740 10 client.16347 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:59:54.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.651+0000 7fe3ed4d5740 10 client.16347 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T00:59:54.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.651+0000 7fe3ed4d5740 20 client.16347 populate_metadata read hostname 'smithi001' 2024-09-21T00:59:54.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.651+0000 7fe3ed4d5740 1 --2- 172.21.15.1:0/3366413797 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x562026e3af60 0x562026e3d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.651+0000 7fe3ed4d5740 4 client.16347 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:59:54.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.651+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/3366413797 --> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562026d268a0 con 0x562026e3af60 2024-09-21T00:59:54.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.654+0000 7fe3dffff640 1 --2- 172.21.15.1:0/3366413797 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x562026e3af60 0x562026e3d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.669+0000 7fe3dffff640 1 --2- 172.21.15.1:0/3366413797 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x562026e3af60 0x562026e3d400 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=13688a9e1b27413b server_cookie=2b0099b03cd22c48 in_seq=0 out_seq=0 2024-09-21T00:59:54.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.670+0000 7fe3bffff640 10 client.16347 ms_handle_connect on v2:172.21.15.193:6838/1365361177 2024-09-21T00:59:54.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.671+0000 7fe3bffff640 1 -- 172.21.15.1:0/3366413797 <== mds.1 v2:172.21.15.193:6838/1365361177 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562026d268a0 con 0x562026e3af60 2024-09-21T00:59:54.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.671+0000 7fe3bffff640 10 client.16347 handle_command_reply: tid=0 2024-09-21T00:59:54.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.673+0000 7fe3ed4d5740 1 client.16347 shutdown 2024-09-21T00:59:54.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.674+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/3366413797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620269c99f0 msgr2=0x562026dc2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:54.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.674+0000 7fe3ed4d5740 1 --2- 172.21.15.1:0/3366413797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620269c99f0 0x562026dc2120 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fe3d801a1c0 tx=0x7fe3d8040580 comp rx=0 tx=0).stop 2024-09-21T00:59:54.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.679+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/3366413797 shutdown_connections 2024-09-21T00:59:54.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.679+0000 7fe3ed4d5740 1 --2- 172.21.15.1:0/3366413797 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x562026e3af60 0x562026e3d400 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.679+0000 7fe3ed4d5740 1 --2- 172.21.15.1:0/3366413797 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562026a0b070 0x562026dc2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.679+0000 7fe3ed4d5740 1 --2- 172.21.15.1:0/3366413797 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620269ea390 0x562026dc2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.679+0000 7fe3ed4d5740 1 --2- 172.21.15.1:0/3366413797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620269c99f0 0x562026dc2120 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.679+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/3366413797 >> 172.21.15.1:0/3366413797 conn(0x5620269ff460 msgr2=0x562026db36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:54.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.681+0000 7fe3bffff640 0 client.16347 ms_handle_reset on v2:172.21.15.193:6838/1365361177 2024-09-21T00:59:54.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.681+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/3366413797 shutdown_connections 2024-09-21T00:59:54.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.681+0000 7fe3ed4d5740 1 -- 172.21.15.1:0/3366413797 wait complete. 2024-09-21T00:59:54.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.681+0000 7fe3ed4d5740 20 client.16347 trim_cache size 0 max 16384 2024-09-21T00:59:54.682 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T00:59:54.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.683+0000 7fe3e6f61640 1 -- 172.21.15.1:0/4253194916 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe3c80b6660 msgr2=0x7fe3c80b8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:54.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.683+0000 7fe3e6f61640 1 --2- 172.21.15.1:0/4253194916 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe3c80b6660 0x7fe3c80b8b70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe3d803be20 tx=0x7fe3d8000f40 comp rx=0 tx=0).stop 2024-09-21T00:59:54.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.683+0000 7fe3e6f61640 1 -- 172.21.15.1:0/4253194916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3e011cc30 msgr2=0x7fe3e0118db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:54.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.683+0000 7fe3e6f61640 1 --2- 172.21.15.1:0/4253194916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3e011cc30 0x7fe3e0118db0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe3d400b3f0 tx=0x7fe3d400b8b0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.686+0000 7fe3e6f61640 1 -- 172.21.15.1:0/4253194916 shutdown_connections 2024-09-21T00:59:54.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.686+0000 7fe3e6f61640 1 --2- 172.21.15.1:0/4253194916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3e011cc30 0x7fe3e0118db0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.686+0000 7fe3e6f61640 1 --2- 172.21.15.1:0/4253194916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3e0111f40 0x7fe3e01187a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.686+0000 7fe3e6f61640 1 --2- 172.21.15.1:0/4253194916 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe3c80b6660 0x7fe3c80b8b70 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.686+0000 7fe3e6f61640 1 --2- 172.21.15.1:0/4253194916 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3e010a9e0 0x7fe3e011c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.686+0000 7fe3e6f61640 1 -- 172.21.15.1:0/4253194916 >> 172.21.15.1:0/4253194916 conn(0x7fe3e0070ec0 msgr2=0x7fe3e010ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:54.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.690+0000 7fe3e6f61640 1 -- 172.21.15.1:0/4253194916 shutdown_connections 2024-09-21T00:59:54.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:54.691+0000 7fe3e6f61640 1 -- 172.21.15.1:0/4253194916 wait complete. 2024-09-21T00:59:55.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:55.233+0000 7f69a4ff9640 1 -- 172.21.15.1:0/1618166866 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a99ba050f0 con 0x55a99b6811c0 2024-09-21T00:59:55.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:55.233+0000 7f69a4ff9640 10 client.16335 handle_command_reply: tid=0 2024-09-21T00:59:55.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:55.233+0000 7f69ca223740 1 client.16335 shutdown 2024-09-21T00:59:55.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:55.233+0000 7f69ca223740 1 -- 172.21.15.1:0/1618166866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a99b6ed1b0 msgr2=0x55a99bb13100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:55.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:55.233+0000 7f69ca223740 1 --2- 172.21.15.1:0/1618166866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a99b6ed1b0 0x55a99bb13100 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f69b402acb0 tx=0x7f69b402a6c0 comp rx=0 tx=0).stop 2024-09-21T00:59:55.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:55.233+0000 7f69ca223740 1 -- 172.21.15.1:0/1618166866 shutdown_connections 2024-09-21T00:59:55.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:55.233+0000 7f69ca223740 1 --2- 172.21.15.1:0/1618166866 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a99b6811c0 0x55a99bb1d240 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:55.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:55.233+0000 7f69ca223740 1 --2- 172.21.15.1:0/1618166866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a99b6ed1b0 0x55a99bb13100 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:55.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:55.233+0000 7f69ca223740 1 --2- 172.21.15.1:0/1618166866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a99b6cc4d0 0x55a99bb12590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:55.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:55.233+0000 7f69ca223740 1 --2- 172.21.15.1:0/1618166866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a99b6c42f0 0x55a99bb11ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:55.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:55.234+0000 7f69ca223740 1 -- 172.21.15.1:0/1618166866 >> 172.21.15.1:0/1618166866 conn(0x55a99b6e1300 msgr2=0x55a99ba9d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:55.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:55.234+0000 7f69a4ff9640 0 client.16335 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:55.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:55.234+0000 7f69ca223740 1 -- 172.21.15.1:0/1618166866 shutdown_connections 2024-09-21T00:59:55.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:55.234+0000 7f69ca223740 1 -- 172.21.15.1:0/1618166866 wait complete. 2024-09-21T00:59:55.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:55.234+0000 7f69ca223740 20 client.16335 trim_cache size 0 max 16384 2024-09-21T00:59:55.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T00:59:55.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T00:59:55.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T00:59:55.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T00:59:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:55.254+0000 7f69c32be640 1 -- 172.21.15.1:0/54376776 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f69a80b6510 msgr2=0x7f69a80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:55.254+0000 7f69c32be640 1 --2- 172.21.15.1:0/54376776 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f69a80b6510 0x7f69a80b8a20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f69b8005fd0 tx=0x7f69b800b390 comp rx=0 tx=0).stop 2024-09-21T00:59:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:55.254+0000 7f69c32be640 1 -- 172.21.15.1:0/54376776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69bc106bb0 msgr2=0x7f69bc19a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:55.254+0000 7f69c32be640 1 --2- 172.21.15.1:0/54376776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69bc106bb0 0x7f69bc19a570 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f69ac00e9c0 tx=0x7f69ac00ee80 comp rx=0 tx=0).stop 2024-09-21T00:59:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:55.254+0000 7f69c32be640 1 -- 172.21.15.1:0/54376776 shutdown_connections 2024-09-21T00:59:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:55.254+0000 7f69c32be640 1 --2- 172.21.15.1:0/54376776 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f69bc109510 0x7f69bc19b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:55.256 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:55.254+0000 7f69c32be640 1 --2- 172.21.15.1:0/54376776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69bc106bb0 0x7f69bc19a570 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:55.256 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:55.254+0000 7f69c32be640 1 --2- 172.21.15.1:0/54376776 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f69a80b6510 0x7f69a80b8a20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:55.256 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:55.254+0000 7f69c32be640 1 --2- 172.21.15.1:0/54376776 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69bc101a60 0x7f69bc199f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:55.256 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:55.254+0000 7f69c32be640 1 -- 172.21.15.1:0/54376776 >> 172.21.15.1:0/54376776 conn(0x7f69bc0fd660 msgr2=0x7f69bc1079a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:55.256 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:55.254+0000 7f69c32be640 1 -- 172.21.15.1:0/54376776 shutdown_connections 2024-09-21T00:59:55.256 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T00:59:55.254+0000 7f69c32be640 1 -- 172.21.15.1:0/54376776 wait complete. 2024-09-21T00:59:55.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:55 smithi001 ceph-mon[31211]: pgmap v439: 97 pgs: 97 active+clean; 286 MiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.1 MiB/s wr, 382 op/s 2024-09-21T00:59:55.536 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T00:59:55.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:55 smithi193 ceph-mon[34660]: pgmap v439: 97 pgs: 97 active+clean; 286 MiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.1 MiB/s wr, 382 op/s 2024-09-21T00:59:55.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:55 smithi042 ceph-mon[34481]: pgmap v439: 97 pgs: 97 active+clean; 286 MiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.1 MiB/s wr, 382 op/s 2024-09-21T00:59:56.837 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:59:57.347 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:57 smithi001 ceph-mon[31211]: pgmap v440: 97 pgs: 97 active+clean; 284 MiB data, 800 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.6 MiB/s wr, 350 op/s 2024-09-21T00:59:57.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.701+0000 7f6ff8716640 1 -- 172.21.15.1:0/4011060111 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ff0111f40 msgr2=0x7f6ff010a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:57.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.701+0000 7f6ff8716640 1 --2- 172.21.15.1:0/4011060111 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ff0111f40 0x7f6ff010a3c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8009ca0 tx=0x7f6fe802a8d0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.701+0000 7f6ff8716640 1 -- 172.21.15.1:0/4011060111 shutdown_connections 2024-09-21T00:59:57.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.701+0000 7f6ff8716640 1 --2- 172.21.15.1:0/4011060111 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ff011cc30 0x7f6ff011f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.701+0000 7f6ff8716640 1 --2- 172.21.15.1:0/4011060111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ff010a9e0 0x7f6ff010adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.701+0000 7f6ff8716640 1 --2- 172.21.15.1:0/4011060111 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ff0111f40 0x7f6ff010a3c0 secure :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8009ca0 tx=0x7f6fe802a8d0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.701+0000 7f6ff8716640 1 -- 172.21.15.1:0/4011060111 >> 172.21.15.1:0/4011060111 conn(0x7f6ff0070ec0 msgr2=0x7f6ff00712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:57.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.701+0000 7f6ff8716640 1 -- 172.21.15.1:0/4011060111 shutdown_connections 2024-09-21T00:59:57.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.701+0000 7f6ff8716640 1 -- 172.21.15.1:0/4011060111 wait complete. 2024-09-21T00:59:57.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.705+0000 7f6ff8716640 1 Processor -- start 2024-09-21T00:59:57.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.705+0000 7f6ff8716640 1 -- start start 2024-09-21T00:59:57.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.705+0000 7f6ff8716640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ff010a9e0 0x7f6ff01a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:57.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.705+0000 7f6ff8716640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ff011cc30 0x7f6ff01a9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:57.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.705+0000 7f6ff8716640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ff01aec50 0x7f6ff01af060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:57.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.705+0000 7f6ff8716640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff0122960 con 0x7f6ff010a9e0 2024-09-21T00:59:57.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.705+0000 7f6ff8716640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff01227e0 con 0x7f6ff011cc30 2024-09-21T00:59:57.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.705+0000 7f6ff8716640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff0122ae0 con 0x7f6ff01aec50 2024-09-21T00:59:57.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.706+0000 7f6ff64b2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ff010a9e0 0x7f6ff01a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:57.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.706+0000 7f6ff64b2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ff010a9e0 0x7f6ff01a94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35806/0 (socket says 172.21.15.1:35806) 2024-09-21T00:59:57.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.706+0000 7f6ff64b2640 1 -- 172.21.15.1:0/438392037 learned_addr learned my addr 172.21.15.1:0/438392037 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:57.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.707+0000 7f6ff64b2640 1 -- 172.21.15.1:0/438392037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ff01aec50 msgr2=0x7f6ff01af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:57.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.707+0000 7f6ff6cb3640 1 --2- 172.21.15.1:0/438392037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ff01aec50 0x7f6ff01af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:57.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.708+0000 7f6ff64b2640 1 --2- 172.21.15.1:0/438392037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ff01aec50 0x7f6ff01af060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.708+0000 7f6ff5cb1640 1 --2- 172.21.15.1:0/438392037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ff011cc30 0x7f6ff01a9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:57.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.708+0000 7f6ff64b2640 1 -- 172.21.15.1:0/438392037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ff011cc30 msgr2=0x7f6ff01a9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:57.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.708+0000 7f6ff64b2640 1 --2- 172.21.15.1:0/438392037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ff011cc30 0x7f6ff01a9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.708+0000 7f6ff64b2640 1 -- 172.21.15.1:0/438392037 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff01af830 con 0x7f6ff010a9e0 2024-09-21T00:59:57.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.709+0000 7f6ff64b2640 1 --2- 172.21.15.1:0/438392037 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ff010a9e0 0x7f6ff01a94d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f6fe802aec0 tx=0x7f6fe8003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:57.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.709+0000 7f6ff6cb3640 1 --2- 172.21.15.1:0/438392037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ff01aec50 0x7f6ff01af060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:59:57.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.710+0000 7f6fe77fe640 1 -- 172.21.15.1:0/438392037 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe8004240 con 0x7f6ff010a9e0 2024-09-21T00:59:57.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.710+0000 7f6fe77fe640 1 -- 172.21.15.1:0/438392037 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6fe8040030 con 0x7f6ff010a9e0 2024-09-21T00:59:57.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.710+0000 7f6ff8716640 1 -- 172.21.15.1:0/438392037 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ff01b5dd0 con 0x7f6ff010a9e0 2024-09-21T00:59:57.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.710+0000 7f6fe77fe640 1 -- 172.21.15.1:0/438392037 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe803b430 con 0x7f6ff010a9e0 2024-09-21T00:59:57.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.710+0000 7f6ff8716640 1 -- 172.21.15.1:0/438392037 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ff01b6170 con 0x7f6ff010a9e0 2024-09-21T00:59:57.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.712+0000 7f6ff5cb1640 1 --2- 172.21.15.1:0/438392037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ff011cc30 0x7f6ff01a9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:59:57.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.716+0000 7f6ffec8a740 1 Processor -- start 2024-09-21T00:59:57.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.717+0000 7f6ffec8a740 1 -- start start 2024-09-21T00:59:57.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.718+0000 7f6fe77fe640 1 -- 172.21.15.1:0/438392037 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f6fe803b5d0 con 0x7f6ff010a9e0 2024-09-21T00:59:57.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.718+0000 7f6ffec8a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647c9ec8070 0x5647ca26f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:57.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.719+0000 7f6ffec8a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647c9e9f1b0 0x5647ca26fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:57.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.719+0000 7f6ff6cb3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647c9ec8070 0x5647ca26f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:57.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.719+0000 7f6ff6cb3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647c9ec8070 0x5647ca26f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:57148/0 (socket says 172.21.15.1:57148) 2024-09-21T00:59:57.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.719+0000 7f6ff6cb3640 1 -- 172.21.15.1:0/3514657896 learned_addr learned my addr 172.21.15.1:0/3514657896 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:57.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.719+0000 7f6ffec8a740 1 --2- 172.21.15.1:0/3514657896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5647c9ea7390 0x5647ca270120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:57.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.719+0000 7f6ffec8a740 1 -- 172.21.15.1:0/3514657896 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5647ca1e5ea0 con 0x5647c9e9f1b0 2024-09-21T00:59:57.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.719+0000 7f6ffec8a740 1 -- 172.21.15.1:0/3514657896 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5647ca1d52d0 con 0x5647c9ec8070 2024-09-21T00:59:57.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.719+0000 7f6ffec8a740 1 -- 172.21.15.1:0/3514657896 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5647ca1d90e0 con 0x5647c9ea7390 2024-09-21T00:59:57.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.720+0000 7f6ff5cb1640 1 --2- 172.21.15.1:0/3514657896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5647c9ea7390 0x5647ca270120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:57.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.721+0000 7f6fe77fe640 1 --2- 172.21.15.1:0/438392037 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6fdc0b6660 0x7f6fdc0b8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:57.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.721+0000 7f6fe77fe640 1 -- 172.21.15.1:0/438392037 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f6fe81081a0 con 0x7f6ff010a9e0 2024-09-21T00:59:57.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.721+0000 7f6ff64b2640 1 --2- 172.21.15.1:0/3514657896 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647c9e9f1b0 0x5647ca26fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:57.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.722+0000 7f6ff6cb3640 1 --2- 172.21.15.1:0/438392037 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6fdc0b6660 0x7f6fdc0b8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:57.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.722+0000 7f6ff6cb3640 1 -- 172.21.15.1:0/3514657896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5647c9ea7390 msgr2=0x5647ca270120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:57.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.722+0000 7f6ff6cb3640 1 --2- 172.21.15.1:0/3514657896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5647c9ea7390 0x5647ca270120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.722+0000 7f6ff6cb3640 1 -- 172.21.15.1:0/3514657896 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647c9e9f1b0 msgr2=0x5647ca26fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:57.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.722+0000 7f6ff6cb3640 1 --2- 172.21.15.1:0/3514657896 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647c9e9f1b0 0x5647ca26fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.723+0000 7f6ff6cb3640 1 -- 172.21.15.1:0/3514657896 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647c9f33650 con 0x5647c9ec8070 2024-09-21T00:59:57.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.723+0000 7f6ff6cb3640 1 --2- 172.21.15.1:0/3514657896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647c9ec8070 0x5647ca26f6a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6fec015870 tx=0x7f6fec015d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=466cd0d98a54fa35 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:57.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.723+0000 7f6ff64b2640 1 --2- 172.21.15.1:0/3514657896 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647c9e9f1b0 0x5647ca26fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:59:57.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.723+0000 7f6ff5cb1640 1 --2- 172.21.15.1:0/3514657896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5647c9ea7390 0x5647ca270120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:59:57.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.723+0000 7f6ff6cb3640 1 --2- 172.21.15.1:0/438392037 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6fdc0b6660 0x7f6fdc0b8b70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6fec01f000 tx=0x7f6fec01b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:57.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.724+0000 7f6fe4ff9640 1 -- 172.21.15.1:0/3514657896 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec022070 con 0x5647c9ec8070 2024-09-21T00:59:57.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.724+0000 7f6fe4ff9640 1 -- 172.21.15.1:0/3514657896 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6fec010380 con 0x5647c9ec8070 2024-09-21T00:59:57.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.725+0000 7f6ffec8a740 1 -- 172.21.15.1:0/3514657896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647c9ec8070 msgr2=0x5647ca26f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:57.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.725+0000 7f6ffec8a740 1 --2- 172.21.15.1:0/3514657896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647c9ec8070 0x5647ca26f6a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6fec015870 tx=0x7f6fec015d30 comp rx=0 tx=0).stop 2024-09-21T00:59:57.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:57 smithi193 ceph-mon[34660]: pgmap v440: 97 pgs: 97 active+clean; 284 MiB data, 800 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.6 MiB/s wr, 350 op/s 2024-09-21T00:59:57.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.730+0000 7f6ffec8a740 1 -- 172.21.15.1:0/3514657896 shutdown_connections 2024-09-21T00:59:57.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.730+0000 7f6ffec8a740 1 --2- 172.21.15.1:0/3514657896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5647c9ea7390 0x5647ca270120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.730+0000 7f6ffec8a740 1 --2- 172.21.15.1:0/3514657896 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647c9e9f1b0 0x5647ca26fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.730+0000 7f6ffec8a740 1 --2- 172.21.15.1:0/3514657896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647c9ec8070 0x5647ca26f6a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.730+0000 7f6ffec8a740 1 -- 172.21.15.1:0/3514657896 >> 172.21.15.1:0/3514657896 conn(0x5647c9ebc460 msgr2=0x5647ca26d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:57.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.733+0000 7f6ffec8a740 1 -- 172.21.15.1:0/3514657896 shutdown_connections 2024-09-21T00:59:57.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.734+0000 7f6ffec8a740 1 -- 172.21.15.1:0/3514657896 wait complete. 2024-09-21T00:59:57.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.735+0000 7f6ffec8a740 1 -- start start 2024-09-21T00:59:57.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.735+0000 7f6ffec8a740 1 Processor -- start 2024-09-21T00:59:57.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.736+0000 7f6ffec8a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647c9e9f1b0 0x5647ca27aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:57.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.736+0000 7f6ff64b2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647c9e9f1b0 0x5647ca27aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:57.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.736+0000 7f6ff64b2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647c9e9f1b0 0x5647ca27aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:57152/0 (socket says 172.21.15.1:57152) 2024-09-21T00:59:57.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.736+0000 7f6ff64b2640 1 -- 172.21.15.1:0/1241927927 learned_addr learned my addr 172.21.15.1:0/1241927927 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:57.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.737+0000 7f6ffec8a740 1 --2- 172.21.15.1:0/1241927927 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5647c9ea7390 0x5647ca27b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:57.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.737+0000 7f6ffec8a740 1 --2- 172.21.15.1:0/1241927927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647c9ec8070 0x5647ca27b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:57.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.737+0000 7f6ff6cb3640 1 --2- 172.21.15.1:0/1241927927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647c9ec8070 0x5647ca27b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:57.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.737+0000 7f6ffec8a740 1 -- 172.21.15.1:0/1241927927 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5647ca036700 con 0x5647c9ec8070 2024-09-21T00:59:57.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.737+0000 7f6ffec8a740 1 -- 172.21.15.1:0/1241927927 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5647ca170160 con 0x5647c9e9f1b0 2024-09-21T00:59:57.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.737+0000 7f6ffec8a740 1 -- 172.21.15.1:0/1241927927 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5647ca27de70 con 0x5647c9ea7390 2024-09-21T00:59:57.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.738+0000 7f6ffec8a740 10 client.0 _ll_register_callbacks cb 0x5647ca1899e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:57.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.738+0000 7f6ff64b2640 1 -- 172.21.15.1:0/1241927927 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5647c9ea7390 msgr2=0x5647ca27b1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T00:59:57.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.738+0000 7f6ff64b2640 1 --2- 172.21.15.1:0/1241927927 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5647c9ea7390 0x5647ca27b1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.738+0000 7f6ff64b2640 1 -- 172.21.15.1:0/1241927927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647c9ec8070 msgr2=0x5647ca27b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:57.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.738+0000 7f6ff64b2640 1 --2- 172.21.15.1:0/1241927927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647c9ec8070 0x5647ca27b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.738+0000 7f6ff64b2640 1 -- 172.21.15.1:0/1241927927 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647ca19dc90 con 0x5647c9e9f1b0 2024-09-21T00:59:57.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.738+0000 7f6ff64b2640 1 --2- 172.21.15.1:0/1241927927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647c9e9f1b0 0x5647ca27aca0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8005e30 tx=0x7f6fe80ce2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1034ab59a31dfd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:57.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.739+0000 7f6fd9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T00:59:57.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.739+0000 7f6fd9ffb640 1 -- 172.21.15.1:0/1241927927 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe804a040 con 0x5647c9e9f1b0 2024-09-21T00:59:57.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.739+0000 7f6ffec8a740 1 -- 172.21.15.1:0/1241927927 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6fec010380 con 0x5647c9e9f1b0 2024-09-21T00:59:57.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.739+0000 7f6fd9ffb640 1 -- 172.21.15.1:0/1241927927 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f6fe80d7aa0 con 0x5647c9e9f1b0 2024-09-21T00:59:57.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:57 smithi042 ceph-mon[34481]: pgmap v440: 97 pgs: 97 active+clean; 284 MiB data, 800 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.6 MiB/s wr, 350 op/s 2024-09-21T00:59:57.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.742+0000 7f6fd9ffb640 1 -- 172.21.15.1:0/1241927927 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f6fe80d7040 con 0x5647c9e9f1b0 2024-09-21T00:59:57.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.742+0000 7f6ffec8a740 10 client.26024 fetch_fsmap learned FSMap version 31 2024-09-21T00:59:57.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.742+0000 7f6ffec8a740 1 -- 172.21.15.1:0/1241927927 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5647ca289a20 con 0x5647c9e9f1b0 2024-09-21T00:59:57.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.743+0000 7f6fd9ffb640 1 -- 172.21.15.1:0/1241927927 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6fec010380 con 0x5647c9e9f1b0 2024-09-21T00:59:57.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.743+0000 7f6fd9ffb640 1 -- 172.21.15.1:0/1241927927 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7f6fe80c9e20 con 0x5647c9e9f1b0 2024-09-21T00:59:57.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.743+0000 7f6ffec8a740 10 client.26024 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:59:57.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.744+0000 7f6ffec8a740 10 client.26024 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:57.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.744+0000 7f6ffec8a740 20 client.26024 populate_metadata read hostname 'smithi001' 2024-09-21T00:59:57.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.744+0000 7f6ffec8a740 1 --2- 172.21.15.1:0/1241927927 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5647c9e869f0 0x5647ca28d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:57.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.744+0000 7f6ffec8a740 4 client.26024 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:59:57.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.744+0000 7f6ffec8a740 1 -- 172.21.15.1:0/1241927927 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5647ca1e7df0 con 0x5647c9e869f0 2024-09-21T00:59:57.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.745+0000 7f6ff5cb1640 1 --2- 172.21.15.1:0/1241927927 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5647c9e869f0 0x5647ca28d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:57.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.747+0000 7f6ff5cb1640 1 --2- 172.21.15.1:0/1241927927 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5647c9e869f0 0x5647ca28d160 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc9010a83a2dd8d1 server_cookie=c5afe1ef2577f75a in_seq=0 out_seq=0 2024-09-21T00:59:57.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.747+0000 7f6fd9ffb640 10 client.26024 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:57.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.748+0000 7f6fd9ffb640 1 -- 172.21.15.1:0/1241927927 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5647ca1e7df0 con 0x5647c9e869f0 2024-09-21T00:59:57.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.748+0000 7f6fd9ffb640 10 client.26024 handle_command_reply: tid=0 2024-09-21T00:59:57.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.748+0000 7f6ffec8a740 1 client.26024 shutdown 2024-09-21T00:59:57.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.748+0000 7f6ffec8a740 1 -- 172.21.15.1:0/1241927927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647c9e9f1b0 msgr2=0x5647ca27aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:57.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.748+0000 7f6ffec8a740 1 --2- 172.21.15.1:0/1241927927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647c9e9f1b0 0x5647ca27aca0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8005e30 tx=0x7f6fe80ce2a0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.749+0000 7f6ffec8a740 1 -- 172.21.15.1:0/1241927927 shutdown_connections 2024-09-21T00:59:57.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.749+0000 7f6ffec8a740 1 --2- 172.21.15.1:0/1241927927 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5647c9e869f0 0x5647ca28d160 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.749+0000 7f6ffec8a740 1 --2- 172.21.15.1:0/1241927927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647c9ec8070 0x5647ca27b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.749+0000 7f6ffec8a740 1 --2- 172.21.15.1:0/1241927927 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5647c9ea7390 0x5647ca27b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.749+0000 7f6ffec8a740 1 --2- 172.21.15.1:0/1241927927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647c9e9f1b0 0x5647ca27aca0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.749+0000 7f6ffec8a740 1 -- 172.21.15.1:0/1241927927 >> 172.21.15.1:0/1241927927 conn(0x5647c9ebc460 msgr2=0x5647ca272830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:57.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.749+0000 7f6fd9ffb640 0 client.26024 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:57.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.750+0000 7f6ffec8a740 1 -- 172.21.15.1:0/1241927927 shutdown_connections 2024-09-21T00:59:57.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.750+0000 7f6ffec8a740 1 -- 172.21.15.1:0/1241927927 wait complete. 2024-09-21T00:59:57.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.750+0000 7f6ffec8a740 20 client.26024 trim_cache size 0 max 16384 2024-09-21T00:59:57.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.775+0000 7f6ffec8a740 1 Processor -- start 2024-09-21T00:59:57.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.775+0000 7f6ffec8a740 1 -- start start 2024-09-21T00:59:57.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.776+0000 7f6ffec8a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647c9e9f1b0 0x5647ca271090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:57.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.776+0000 7f6ffec8a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5647c9ea7390 0x5647ca27c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:57.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.776+0000 7f6ffec8a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647c9ec8070 0x5647ca26cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:57.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.776+0000 7f6ffec8a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff01be9d0 con 0x5647c9e9f1b0 2024-09-21T00:59:57.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.776+0000 7f6ffec8a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff01c0690 con 0x5647c9ec8070 2024-09-21T00:59:57.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.776+0000 7f6ffec8a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff01bf0a0 con 0x5647c9ea7390 2024-09-21T00:59:57.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.777+0000 7f6ff5cb1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5647c9ea7390 0x5647ca27c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:57.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.777+0000 7f6ff5cb1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5647c9ea7390 0x5647ca27c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:49132/0 (socket says 172.21.15.1:49132) 2024-09-21T00:59:57.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.777+0000 7f6ff5cb1640 1 -- 172.21.15.1:0/3962902318 learned_addr learned my addr 172.21.15.1:0/3962902318 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:57.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.777+0000 7f6ff64b2640 1 --2- 172.21.15.1:0/3962902318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647c9e9f1b0 0x5647ca271090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:57.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.777+0000 7f6ff6cb3640 1 --2- 172.21.15.1:0/3962902318 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647c9ec8070 0x5647ca26cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:57.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.777+0000 7f6ff5cb1640 1 -- 172.21.15.1:0/3962902318 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647c9ec8070 msgr2=0x5647ca26cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:57.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.777+0000 7f6ff5cb1640 1 --2- 172.21.15.1:0/3962902318 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647c9ec8070 0x5647ca26cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.777+0000 7f6ff5cb1640 1 -- 172.21.15.1:0/3962902318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647c9e9f1b0 msgr2=0x5647ca271090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:57.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.777+0000 7f6ff5cb1640 1 --2- 172.21.15.1:0/3962902318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647c9e9f1b0 0x5647ca271090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.777+0000 7f6ff5cb1640 1 -- 172.21.15.1:0/3962902318 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647ca271990 con 0x5647c9ea7390 2024-09-21T00:59:57.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.778+0000 7f6ff64b2640 1 --2- 172.21.15.1:0/3962902318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647c9e9f1b0 0x5647ca271090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:57.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.778+0000 7f6ff5cb1640 1 --2- 172.21.15.1:0/3962902318 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5647c9ea7390 0x5647ca27c8d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6fe000b860 tx=0x7f6fe0014410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4d74f4b93d3e8b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:57.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.778+0000 7f6fdbfff640 1 -- 172.21.15.1:0/3962902318 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe001e020 con 0x5647c9ea7390 2024-09-21T00:59:57.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.778+0000 7f6fdbfff640 1 -- 172.21.15.1:0/3962902318 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6fe0014e50 con 0x5647c9ea7390 2024-09-21T00:59:57.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.778+0000 7f6fdbfff640 1 -- 172.21.15.1:0/3962902318 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe0012810 con 0x5647c9ea7390 2024-09-21T00:59:57.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.780+0000 7f6ffec8a740 1 -- 172.21.15.1:0/3962902318 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5647c9ea7390 msgr2=0x5647ca27c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:57.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.780+0000 7f6ffec8a740 1 --2- 172.21.15.1:0/3962902318 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5647c9ea7390 0x5647ca27c8d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6fe000b860 tx=0x7f6fe0014410 comp rx=0 tx=0).stop 2024-09-21T00:59:57.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.780+0000 7f6ffec8a740 1 -- 172.21.15.1:0/3962902318 shutdown_connections 2024-09-21T00:59:57.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.780+0000 7f6ffec8a740 1 --2- 172.21.15.1:0/3962902318 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647c9ec8070 0x5647ca26cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.780+0000 7f6ffec8a740 1 --2- 172.21.15.1:0/3962902318 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5647c9ea7390 0x5647ca27c8d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.780+0000 7f6ffec8a740 1 --2- 172.21.15.1:0/3962902318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647c9e9f1b0 0x5647ca271090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.780+0000 7f6ffec8a740 1 -- 172.21.15.1:0/3962902318 >> 172.21.15.1:0/3962902318 conn(0x5647c9ebc460 msgr2=0x5647ca27c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:57.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.780+0000 7f6ffec8a740 1 -- 172.21.15.1:0/3962902318 shutdown_connections 2024-09-21T00:59:57.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.780+0000 7f6ffec8a740 1 -- 172.21.15.1:0/3962902318 wait complete. 2024-09-21T00:59:57.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.781+0000 7f6ffec8a740 1 -- start start 2024-09-21T00:59:57.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.781+0000 7f6ffec8a740 1 Processor -- start 2024-09-21T00:59:57.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.781+0000 7f6ffec8a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647c9e9f1b0 0x5647ca2838d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:57.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.782+0000 7f6ffec8a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647c9ea7390 0x5647ca27ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:57.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.782+0000 7f6ffec8a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5647c9ec8070 0x5647ca27f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:57.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.782+0000 7f6ffec8a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff01bff00 con 0x5647c9ea7390 2024-09-21T00:59:57.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.782+0000 7f6ffec8a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff01bf830 con 0x5647c9e9f1b0 2024-09-21T00:59:57.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.782+0000 7f6ffec8a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff01bc9b0 con 0x5647c9ec8070 2024-09-21T00:59:57.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.782+0000 7f6ffec8a740 10 client.0 _ll_register_callbacks cb 0x7f6fe8009410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:57.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.782+0000 7f6ff64b2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647c9e9f1b0 0x5647ca2838d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:57.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.782+0000 7f6ff6cb3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5647c9ec8070 0x5647ca27f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:57.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.782+0000 7f6ff64b2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647c9e9f1b0 0x5647ca2838d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:57172/0 (socket says 172.21.15.1:57172) 2024-09-21T00:59:57.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.782+0000 7f6ff64b2640 1 -- 172.21.15.1:0/2810247311 learned_addr learned my addr 172.21.15.1:0/2810247311 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T00:59:57.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.782+0000 7f6ff5cb1640 1 --2- 172.21.15.1:0/2810247311 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647c9ea7390 0x5647ca27ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:57.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.782+0000 7f6ff6cb3640 1 -- 172.21.15.1:0/2810247311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647c9e9f1b0 msgr2=0x5647ca2838d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:57.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.782+0000 7f6ff6cb3640 1 --2- 172.21.15.1:0/2810247311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647c9e9f1b0 0x5647ca2838d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.782+0000 7f6ff6cb3640 1 -- 172.21.15.1:0/2810247311 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647c9ea7390 msgr2=0x5647ca27ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:57.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.782+0000 7f6ff6cb3640 1 --2- 172.21.15.1:0/2810247311 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647c9ea7390 0x5647ca27ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.782+0000 7f6ff6cb3640 1 -- 172.21.15.1:0/2810247311 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647ca27fa00 con 0x5647c9ec8070 2024-09-21T00:59:57.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.782+0000 7f6ff64b2640 1 --2- 172.21.15.1:0/2810247311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647c9e9f1b0 0x5647ca2838d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:57.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.783+0000 7f6ff6cb3640 1 --2- 172.21.15.1:0/2810247311 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5647c9ec8070 0x5647ca27f2c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6fec015710 tx=0x7f6fec009480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2774794301b90223 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:57.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.783+0000 7f6fd9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T00:59:57.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.783+0000 7f6fd9ffb640 1 -- 172.21.15.1:0/2810247311 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec035060 con 0x5647c9ec8070 2024-09-21T00:59:57.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.783+0000 7f6ffec8a740 1 -- 172.21.15.1:0/2810247311 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6fe0014e50 con 0x5647c9ec8070 2024-09-21T00:59:57.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.783+0000 7f6fd9ffb640 1 -- 172.21.15.1:0/2810247311 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f6fec005040 con 0x5647c9ec8070 2024-09-21T00:59:57.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.783+0000 7f6fd9ffb640 1 -- 172.21.15.1:0/2810247311 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f6fec022070 con 0x5647c9ec8070 2024-09-21T00:59:57.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.783+0000 7f6ffec8a740 10 client.25939 fetch_fsmap learned FSMap version 31 2024-09-21T00:59:57.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.783+0000 7f6ffec8a740 1 -- 172.21.15.1:0/2810247311 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5647ca2f7a10 con 0x5647c9ec8070 2024-09-21T00:59:57.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.784+0000 7f6fd9ffb640 1 -- 172.21.15.1:0/2810247311 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6fe0014e50 con 0x5647c9ec8070 2024-09-21T00:59:57.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.784+0000 7f6fd9ffb640 1 -- 172.21.15.1:0/2810247311 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7f6fec0257a0 con 0x5647c9ec8070 2024-09-21T00:59:57.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.784+0000 7f6ffec8a740 10 client.25939 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T00:59:57.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.784+0000 7f6ffec8a740 10 client.25939 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:57.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.784+0000 7f6ffec8a740 20 client.25939 populate_metadata read hostname 'smithi001' 2024-09-21T00:59:57.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.784+0000 7f6ffec8a740 1 --2- 172.21.15.1:0/2810247311 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5647c9e5bda0 0x5647ca2fa070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:57.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.784+0000 7f6ffec8a740 4 client.25939 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:59:57.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.784+0000 7f6ffec8a740 1 -- 172.21.15.1:0/2810247311 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5647ca1e38a0 con 0x5647c9e5bda0 2024-09-21T00:59:57.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.784+0000 7f6ff64b2640 1 --2- 172.21.15.1:0/2810247311 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5647c9e5bda0 0x5647ca2fa070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:57.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.785+0000 7f6ff64b2640 1 --2- 172.21.15.1:0/2810247311 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5647c9e5bda0 0x5647ca2fa070 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=957d2f8a4586026b server_cookie=d8b20dadc07b6d10 in_seq=0 out_seq=0 2024-09-21T00:59:57.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.785+0000 7f6fd9ffb640 10 client.25939 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:57.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.785+0000 7f6fd9ffb640 1 -- 172.21.15.1:0/2810247311 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5647ca1e38a0 con 0x5647c9e5bda0 2024-09-21T00:59:57.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.785+0000 7f6fd9ffb640 10 client.25939 handle_command_reply: tid=0 2024-09-21T00:59:57.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.785+0000 7f6ffec8a740 1 client.25939 shutdown 2024-09-21T00:59:57.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.786+0000 7f6ffec8a740 1 -- 172.21.15.1:0/2810247311 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5647c9ec8070 msgr2=0x5647ca27f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:57.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.786+0000 7f6ffec8a740 1 --2- 172.21.15.1:0/2810247311 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5647c9ec8070 0x5647ca27f2c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6fec015710 tx=0x7f6fec009480 comp rx=0 tx=0).stop 2024-09-21T00:59:57.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.786+0000 7f6ffec8a740 1 -- 172.21.15.1:0/2810247311 shutdown_connections 2024-09-21T00:59:57.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.786+0000 7f6ffec8a740 1 --2- 172.21.15.1:0/2810247311 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5647c9e5bda0 0x5647ca2fa070 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.786+0000 7f6ffec8a740 1 --2- 172.21.15.1:0/2810247311 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5647c9ec8070 0x5647ca27f2c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.786+0000 7f6ffec8a740 1 --2- 172.21.15.1:0/2810247311 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647c9ea7390 0x5647ca27ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.786+0000 7f6ffec8a740 1 --2- 172.21.15.1:0/2810247311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647c9e9f1b0 0x5647ca2838d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.786+0000 7f6ffec8a740 1 -- 172.21.15.1:0/2810247311 >> 172.21.15.1:0/2810247311 conn(0x5647c9ebc460 msgr2=0x5647ca27ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:57.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.786+0000 7f6fd9ffb640 0 client.25939 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T00:59:57.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.786+0000 7f6ffec8a740 1 -- 172.21.15.1:0/2810247311 shutdown_connections 2024-09-21T00:59:57.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.786+0000 7f6ffec8a740 1 -- 172.21.15.1:0/2810247311 wait complete. 2024-09-21T00:59:57.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.786+0000 7f6ffec8a740 20 client.25939 trim_cache size 0 max 16384 2024-09-21T00:59:57.789 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T00:59:57.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.787+0000 7f6ff8716640 1 -- 172.21.15.1:0/438392037 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6fdc0b6660 msgr2=0x7f6fdc0b8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:57.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.787+0000 7f6ff8716640 1 --2- 172.21.15.1:0/438392037 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6fdc0b6660 0x7f6fdc0b8b70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6fec01f000 tx=0x7f6fec01b000 comp rx=0 tx=0).stop 2024-09-21T00:59:57.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.787+0000 7f6ff8716640 1 -- 172.21.15.1:0/438392037 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ff010a9e0 msgr2=0x7f6ff01a94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:57.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.787+0000 7f6ff8716640 1 --2- 172.21.15.1:0/438392037 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ff010a9e0 0x7f6ff01a94d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f6fe802aec0 tx=0x7f6fe8003ce0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.787+0000 7f6ff8716640 1 -- 172.21.15.1:0/438392037 shutdown_connections 2024-09-21T00:59:57.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.787+0000 7f6ff8716640 1 --2- 172.21.15.1:0/438392037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ff01aec50 0x7f6ff01af060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.787+0000 7f6ff8716640 1 --2- 172.21.15.1:0/438392037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ff011cc30 0x7f6ff01a9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.787+0000 7f6ff8716640 1 --2- 172.21.15.1:0/438392037 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6fdc0b6660 0x7f6fdc0b8b70 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.787+0000 7f6ff8716640 1 --2- 172.21.15.1:0/438392037 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ff010a9e0 0x7f6ff01a94d0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.787+0000 7f6ff8716640 1 -- 172.21.15.1:0/438392037 >> 172.21.15.1:0/438392037 conn(0x7f6ff0070ec0 msgr2=0x7f6ff0071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:57.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.787+0000 7f6ff8716640 1 -- 172.21.15.1:0/438392037 shutdown_connections 2024-09-21T00:59:57.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T00:59:57.787+0000 7f6ff8716640 1 -- 172.21.15.1:0/438392037 wait complete. 2024-09-21T00:59:59.665 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T00:59:59.666 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T00:59:59.693 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 00:59:59 smithi001 ceph-mon[31211]: pgmap v441: 97 pgs: 97 active+clean; 289 MiB data, 799 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 212 op/s 2024-09-21T00:59:59.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 00:59:59 smithi193 ceph-mon[34660]: pgmap v441: 97 pgs: 97 active+clean; 289 MiB data, 799 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 212 op/s 2024-09-21T00:59:59.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 00:59:59 smithi042 ceph-mon[34481]: pgmap v441: 97 pgs: 97 active+clean; 289 MiB data, 799 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 212 op/s 2024-09-21T01:00:00.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:00 smithi001 ceph-mon[31211]: overall HEALTH_OK 2024-09-21T01:00:00.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:00 smithi193 ceph-mon[34660]: overall HEALTH_OK 2024-09-21T01:00:00.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:00 smithi042 ceph-mon[34481]: overall HEALTH_OK 2024-09-21T01:00:01.131 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:00:01.714 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:01 smithi001 ceph-mon[31211]: pgmap v442: 97 pgs: 97 active+clean; 289 MiB data, 805 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.8 MiB/s wr, 210 op/s 2024-09-21T01:00:01.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:01 smithi193 ceph-mon[34660]: pgmap v442: 97 pgs: 97 active+clean; 289 MiB data, 805 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.8 MiB/s wr, 210 op/s 2024-09-21T01:00:01.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:01 smithi042 ceph-mon[34481]: pgmap v442: 97 pgs: 97 active+clean; 289 MiB data, 805 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.8 MiB/s wr, 210 op/s 2024-09-21T01:00:02.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.378+0000 7f1138f60640 1 -- 172.21.15.1:0/3573878804 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1134103b90 msgr2=0x7f1134103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:02.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.378+0000 7f1138f60640 1 --2- 172.21.15.1:0/3573878804 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1134103b90 0x7f1134103fa0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1128009900 tx=0x7f1128032c30 comp rx=0 tx=0).stop 2024-09-21T01:00:02.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.383+0000 7f1138f60640 1 -- 172.21.15.1:0/3573878804 shutdown_connections 2024-09-21T01:00:02.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.383+0000 7f1138f60640 1 --2- 172.21.15.1:0/3573878804 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1134109e20 0x7f1134110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:02.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.383+0000 7f1138f60640 1 --2- 172.21.15.1:0/3573878804 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11341094d0 0x7f11341098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:02.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.383+0000 7f1138f60640 1 --2- 172.21.15.1:0/3573878804 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1134103b90 0x7f1134103fa0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:02.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.383+0000 7f1138f60640 1 -- 172.21.15.1:0/3573878804 >> 172.21.15.1:0/3573878804 conn(0x7f11340ff5e0 msgr2=0x7f1134101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:02.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.386+0000 7f1138f60640 1 -- 172.21.15.1:0/3573878804 shutdown_connections 2024-09-21T01:00:02.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.387+0000 7f1138f60640 1 -- 172.21.15.1:0/3573878804 wait complete. 2024-09-21T01:00:02.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.389+0000 7f1138f60640 1 Processor -- start 2024-09-21T01:00:02.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.396+0000 7f1138f60640 1 -- start start 2024-09-21T01:00:02.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.397+0000 7f1138f60640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1134103b90 0x7f1134074d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:02.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.397+0000 7f1138f60640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11341094d0 0x7f113406e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:02.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.397+0000 7f1138f60640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1134109e20 0x7f113406e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:02.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.397+0000 7f1138f60640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1134111990 con 0x7f1134103b90 2024-09-21T01:00:02.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.397+0000 7f1138f60640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1134111810 con 0x7f11341094d0 2024-09-21T01:00:02.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.397+0000 7f1138f60640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1134111b10 con 0x7f1134109e20 2024-09-21T01:00:02.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.398+0000 7f1131d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11341094d0 0x7f113406e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:02.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.398+0000 7f1131d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11341094d0 0x7f113406e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:57194/0 (socket says 172.21.15.1:57194) 2024-09-21T01:00:02.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.398+0000 7f113259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1134103b90 0x7f1134074d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:02.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.398+0000 7f1131d9b640 1 -- 172.21.15.1:0/343594635 learned_addr learned my addr 172.21.15.1:0/343594635 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:02.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.398+0000 7f1132d9d640 1 --2- 172.21.15.1:0/343594635 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1134109e20 0x7f113406e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:02.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.399+0000 7f113259c640 1 -- 172.21.15.1:0/343594635 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1134109e20 msgr2=0x7f113406e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:02.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.399+0000 7f113259c640 1 --2- 172.21.15.1:0/343594635 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1134109e20 0x7f113406e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:02.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.399+0000 7f113259c640 1 -- 172.21.15.1:0/343594635 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11341094d0 msgr2=0x7f113406e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:02.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.399+0000 7f113259c640 1 --2- 172.21.15.1:0/343594635 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11341094d0 0x7f113406e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:02.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.399+0000 7f113259c640 1 -- 172.21.15.1:0/343594635 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f113406ed00 con 0x7f1134103b90 2024-09-21T01:00:02.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.399+0000 7f1131d9b640 1 --2- 172.21.15.1:0/343594635 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11341094d0 0x7f113406e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:02.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.399+0000 7f113259c640 1 --2- 172.21.15.1:0/343594635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1134103b90 0x7f1134074d70 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f1128033220 tx=0x7f11280045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:02.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.399+0000 7f1132d9d640 1 --2- 172.21.15.1:0/343594635 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1134109e20 0x7f113406e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:00:02.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.400+0000 7f11237fe640 1 -- 172.21.15.1:0/343594635 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1128005210 con 0x7f1134103b90 2024-09-21T01:00:02.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.401+0000 7f11237fe640 1 -- 172.21.15.1:0/343594635 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11280146c0 con 0x7f1134103b90 2024-09-21T01:00:02.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.401+0000 7f11237fe640 1 -- 172.21.15.1:0/343594635 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1128003970 con 0x7f1134103b90 2024-09-21T01:00:02.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.401+0000 7f1138f60640 1 -- 172.21.15.1:0/343594635 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11340739e0 con 0x7f1134103b90 2024-09-21T01:00:02.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.401+0000 7f1138f60640 1 -- 172.21.15.1:0/343594635 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1134073e40 con 0x7f1134103b90 2024-09-21T01:00:02.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.408+0000 7f113f4d4740 1 Processor -- start 2024-09-21T01:00:02.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.408+0000 7f113f4d4740 1 -- start start 2024-09-21T01:00:02.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.409+0000 7f113f4d4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b98553350 0x564b988fa430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:02.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.410+0000 7f113f4d4740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b9852a490 0x564b988fa970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:02.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.410+0000 7f113f4d4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b98532670 0x564b988faeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:02.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.410+0000 7f113f4d4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564b98870e60 con 0x564b98532670 2024-09-21T01:00:02.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.410+0000 7f113f4d4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564b98860290 con 0x564b98553350 2024-09-21T01:00:02.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.410+0000 7f113f4d4740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564b988640a0 con 0x564b9852a490 2024-09-21T01:00:02.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.410+0000 7f1132d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b98553350 0x564b988fa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:02.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.410+0000 7f1132d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b98553350 0x564b988fa430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:57198/0 (socket says 172.21.15.1:57198) 2024-09-21T01:00:02.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.410+0000 7f1132d9d640 1 -- 172.21.15.1:0/2953329500 learned_addr learned my addr 172.21.15.1:0/2953329500 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:02.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.412+0000 7f1131d9b640 1 --2- 172.21.15.1:0/2953329500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b98532670 0x564b988faeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:02.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.414+0000 7f11237fe640 1 -- 172.21.15.1:0/343594635 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f11280053b0 con 0x7f1134103b90 2024-09-21T01:00:02.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.414+0000 7f113259c640 1 --2- 172.21.15.1:0/2953329500 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b9852a490 0x564b988fa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:02.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.415+0000 7f113259c640 1 -- 172.21.15.1:0/2953329500 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b98553350 msgr2=0x564b988fa430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:02.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.415+0000 7f113259c640 1 --2- 172.21.15.1:0/2953329500 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b98553350 0x564b988fa430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:02.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.415+0000 7f113259c640 1 -- 172.21.15.1:0/2953329500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b98532670 msgr2=0x564b988faeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:02.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.415+0000 7f113259c640 1 --2- 172.21.15.1:0/2953329500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b98532670 0x564b988faeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:02.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.415+0000 7f113259c640 1 -- 172.21.15.1:0/2953329500 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b985be930 con 0x564b9852a490 2024-09-21T01:00:02.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.430+0000 7f11237fe640 1 --2- 172.21.15.1:0/343594635 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f111c0b6710 0x7f111c0b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:02.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.430+0000 7f11237fe640 1 -- 172.21.15.1:0/343594635 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f11281077a0 con 0x7f1134103b90 2024-09-21T01:00:02.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.430+0000 7f113259c640 1 --2- 172.21.15.1:0/2953329500 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b9852a490 0x564b988fa970 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f11281051c0 tx=0x7f112810db20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef1dfdaef77fa8ff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:02.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.434+0000 7f1120ff9640 1 -- 172.21.15.1:0/2953329500 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1128049070 con 0x564b9852a490 2024-09-21T01:00:02.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.434+0000 7f1120ff9640 1 -- 172.21.15.1:0/2953329500 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11280056a0 con 0x564b9852a490 2024-09-21T01:00:02.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.435+0000 7f1132d9d640 1 --2- 172.21.15.1:0/343594635 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f111c0b6710 0x7f111c0b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:02.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.436+0000 7f113f4d4740 1 -- 172.21.15.1:0/2953329500 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b9852a490 msgr2=0x564b988fa970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:02.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.436+0000 7f113f4d4740 1 --2- 172.21.15.1:0/2953329500 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b9852a490 0x564b988fa970 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f11281051c0 tx=0x7f112810db20 comp rx=0 tx=0).stop 2024-09-21T01:00:02.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.436+0000 7f113f4d4740 1 -- 172.21.15.1:0/2953329500 shutdown_connections 2024-09-21T01:00:02.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.436+0000 7f113f4d4740 1 --2- 172.21.15.1:0/2953329500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b98532670 0x564b988faeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:02.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.436+0000 7f113f4d4740 1 --2- 172.21.15.1:0/2953329500 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b9852a490 0x564b988fa970 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:02.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.436+0000 7f113f4d4740 1 --2- 172.21.15.1:0/2953329500 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b98553350 0x564b988fa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:02.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.437+0000 7f113f4d4740 1 -- 172.21.15.1:0/2953329500 >> 172.21.15.1:0/2953329500 conn(0x564b98547740 msgr2=0x564b988f8320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:02.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.440+0000 7f1132d9d640 1 --2- 172.21.15.1:0/343594635 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f111c0b6710 0x7f111c0b8c20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f112c00a510 tx=0x7f112c0096e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:02.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.440+0000 7f113f4d4740 1 -- 172.21.15.1:0/2953329500 shutdown_connections 2024-09-21T01:00:02.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.443+0000 7f113f4d4740 1 -- 172.21.15.1:0/2953329500 wait complete. 2024-09-21T01:00:02.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.444+0000 7f113f4d4740 1 -- start start 2024-09-21T01:00:02.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.444+0000 7f113f4d4740 1 Processor -- start 2024-09-21T01:00:02.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.446+0000 7f113f4d4740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b9852a490 0x564b98905eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:02.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.446+0000 7f113f4d4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b98532670 0x564b989063f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:02.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.446+0000 7f113f4d4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b98553350 0x564b98911d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:02.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.446+0000 7f113f4d4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564b986c1890 con 0x564b98532670 2024-09-21T01:00:02.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.447+0000 7f113f4d4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564b987fad40 con 0x564b98553350 2024-09-21T01:00:02.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.447+0000 7f113f4d4740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564b989089d0 con 0x564b9852a490 2024-09-21T01:00:02.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.447+0000 7f113f4d4740 10 client.0 _ll_register_callbacks cb 0x564b9885ec80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:02.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.447+0000 7f1132d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b98553350 0x564b98911d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:02.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.447+0000 7f1132d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b98553350 0x564b98911d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:57202/0 (socket says 172.21.15.1:57202) 2024-09-21T01:00:02.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.448+0000 7f1132d9d640 1 -- 172.21.15.1:0/1754755874 learned_addr learned my addr 172.21.15.1:0/1754755874 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:02.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.452+0000 7f1132d9d640 1 -- 172.21.15.1:0/1754755874 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b9852a490 msgr2=0x564b98905eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:00:02.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.452+0000 7f1132d9d640 1 --2- 172.21.15.1:0/1754755874 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b9852a490 0x564b98905eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:02.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.452+0000 7f1132d9d640 1 -- 172.21.15.1:0/1754755874 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b98532670 msgr2=0x564b989063f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:02.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.452+0000 7f1132d9d640 1 --2- 172.21.15.1:0/1754755874 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b98532670 0x564b989063f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:02.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.452+0000 7f1132d9d640 1 -- 172.21.15.1:0/1754755874 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b98912260 con 0x564b98553350 2024-09-21T01:00:02.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.453+0000 7f1132d9d640 1 --2- 172.21.15.1:0/1754755874 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b98553350 0x564b98911d20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f112c009530 tx=0x7f112c004b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab004938938fd06d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:02.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.457+0000 7f1119ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:00:02.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.457+0000 7f1119ffb640 1 -- 172.21.15.1:0/1754755874 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112c028060 con 0x564b98553350 2024-09-21T01:00:02.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.457+0000 7f1119ffb640 1 -- 172.21.15.1:0/1754755874 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f112c023410 con 0x564b98553350 2024-09-21T01:00:02.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.457+0000 7f113f4d4740 1 -- 172.21.15.1:0/1754755874 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11280056a0 con 0x564b98553350 2024-09-21T01:00:02.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.458+0000 7f1119ffb640 1 -- 172.21.15.1:0/1754755874 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f112c023610 con 0x564b98553350 2024-09-21T01:00:02.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.462+0000 7f113f4d4740 10 client.26042 fetch_fsmap learned FSMap version 31 2024-09-21T01:00:02.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.462+0000 7f113f4d4740 1 -- 172.21.15.1:0/1754755874 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564b98914b60 con 0x564b98553350 2024-09-21T01:00:02.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.463+0000 7f1119ffb640 1 -- 172.21.15.1:0/1754755874 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11280056a0 con 0x564b98553350 2024-09-21T01:00:02.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.463+0000 7f1119ffb640 1 -- 172.21.15.1:0/1754755874 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7f112c018800 con 0x564b98553350 2024-09-21T01:00:02.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.463+0000 7f113f4d4740 10 client.26042 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T01:00:02.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.463+0000 7f113f4d4740 10 client.26042 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:00:02.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.463+0000 7f113f4d4740 20 client.26042 populate_metadata read hostname 'smithi001' 2024-09-21T01:00:02.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.463+0000 7f113f4d4740 1 --2- 172.21.15.1:0/1754755874 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x564b98511cd0 0x564b989185a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:02.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.463+0000 7f113f4d4740 4 client.26042 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:00:02.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.463+0000 7f113f4d4740 1 -- 172.21.15.1:0/1754755874 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b98872db0 con 0x564b98511cd0 2024-09-21T01:00:02.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.465+0000 7f113259c640 1 --2- 172.21.15.1:0/1754755874 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x564b98511cd0 0x564b989185a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:02.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.473+0000 7f113259c640 1 --2- 172.21.15.1:0/1754755874 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x564b98511cd0 0x564b989185a0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9796720acddaff37 server_cookie=5ed35e2d924c2b2a in_seq=0 out_seq=0 2024-09-21T01:00:02.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.473+0000 7f1119ffb640 10 client.26042 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:02.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.477+0000 7f1119ffb640 1 -- 172.21.15.1:0/1754755874 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564b98872db0 con 0x564b98511cd0 2024-09-21T01:00:02.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.477+0000 7f1119ffb640 10 client.26042 handle_command_reply: tid=0 2024-09-21T01:00:02.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.477+0000 7f113f4d4740 1 client.26042 shutdown 2024-09-21T01:00:02.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.481+0000 7f113f4d4740 1 -- 172.21.15.1:0/1754755874 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b98553350 msgr2=0x564b98911d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:02.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.481+0000 7f113f4d4740 1 --2- 172.21.15.1:0/1754755874 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b98553350 0x564b98911d20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f112c009530 tx=0x7f112c004b50 comp rx=0 tx=0).stop 2024-09-21T01:00:02.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.481+0000 7f113f4d4740 1 -- 172.21.15.1:0/1754755874 shutdown_connections 2024-09-21T01:00:02.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.481+0000 7f113f4d4740 1 --2- 172.21.15.1:0/1754755874 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x564b98511cd0 0x564b989185a0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:02.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.481+0000 7f113f4d4740 1 --2- 172.21.15.1:0/1754755874 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b98553350 0x564b98911d20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:02.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.481+0000 7f113f4d4740 1 --2- 172.21.15.1:0/1754755874 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b98532670 0x564b989063f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:02.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.481+0000 7f113f4d4740 1 --2- 172.21.15.1:0/1754755874 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b9852a490 0x564b98905eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:02.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.481+0000 7f113f4d4740 1 -- 172.21.15.1:0/1754755874 >> 172.21.15.1:0/1754755874 conn(0x564b98547740 msgr2=0x564b988fbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:02.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.481+0000 7f1119ffb640 0 client.26042 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:02.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.482+0000 7f113f4d4740 1 -- 172.21.15.1:0/1754755874 shutdown_connections 2024-09-21T01:00:02.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.484+0000 7f113f4d4740 1 -- 172.21.15.1:0/1754755874 wait complete. 2024-09-21T01:00:02.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.487+0000 7f113f4d4740 20 client.26042 trim_cache size 0 max 16384 2024-09-21T01:00:02.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.526+0000 7f113f4d4740 1 Processor -- start 2024-09-21T01:00:02.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.527+0000 7f113f4d4740 1 -- start start 2024-09-21T01:00:02.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.529+0000 7f113f4d4740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b9852a490 0x564b98904530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:02.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.529+0000 7f113f4d4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b98532670 0x564b98904a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:02.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.529+0000 7f113f4d4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b98553350 0x564b988f7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:02.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.529+0000 7f113f4d4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f111400e690 con 0x564b98553350 2024-09-21T01:00:02.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.529+0000 7f113f4d4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1114010350 con 0x564b98532670 2024-09-21T01:00:02.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.529+0000 7f113f4d4740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f111400ed60 con 0x564b9852a490 2024-09-21T01:00:02.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.530+0000 7f1131d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b98532670 0x564b98904a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:02.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.530+0000 7f1131d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b98532670 0x564b98904a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:57212/0 (socket says 172.21.15.1:57212) 2024-09-21T01:00:02.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.530+0000 7f1131d9b640 1 -- 172.21.15.1:0/2605579062 learned_addr learned my addr 172.21.15.1:0/2605579062 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:02.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.530+0000 7f1131d9b640 1 -- 172.21.15.1:0/2605579062 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b9852a490 msgr2=0x564b98904530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:00:02.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.530+0000 7f1131d9b640 1 --2- 172.21.15.1:0/2605579062 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b9852a490 0x564b98904530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:02.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.530+0000 7f1131d9b640 1 -- 172.21.15.1:0/2605579062 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b98553350 msgr2=0x564b988f7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:02.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.530+0000 7f1131d9b640 1 --2- 172.21.15.1:0/2605579062 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b98553350 0x564b988f7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:02.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.530+0000 7f1131d9b640 1 -- 172.21.15.1:0/2605579062 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b98914990 con 0x564b98532670 2024-09-21T01:00:02.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.531+0000 7f1131d9b640 1 --2- 172.21.15.1:0/2605579062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b98532670 0x564b98904a70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f112400c620 tx=0x7f112400cae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ce20cca85e6838 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:02.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.534+0000 7f111bfff640 1 -- 172.21.15.1:0/2605579062 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112401e070 con 0x564b98532670 2024-09-21T01:00:02.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.534+0000 7f111bfff640 1 -- 172.21.15.1:0/2605579062 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f112400b950 con 0x564b98532670 2024-09-21T01:00:02.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.534+0000 7f111bfff640 1 -- 172.21.15.1:0/2605579062 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11240198f0 con 0x564b98532670 2024-09-21T01:00:02.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.535+0000 7f113f4d4740 1 -- 172.21.15.1:0/2605579062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b98532670 msgr2=0x564b98904a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:02.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.535+0000 7f113f4d4740 1 --2- 172.21.15.1:0/2605579062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b98532670 0x564b98904a70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f112400c620 tx=0x7f112400cae0 comp rx=0 tx=0).stop 2024-09-21T01:00:02.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.537+0000 7f113f4d4740 1 -- 172.21.15.1:0/2605579062 shutdown_connections 2024-09-21T01:00:02.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.537+0000 7f113f4d4740 1 --2- 172.21.15.1:0/2605579062 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b98553350 0x564b988f7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:02.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.537+0000 7f113f4d4740 1 --2- 172.21.15.1:0/2605579062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b98532670 0x564b98904a70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:02.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.537+0000 7f113f4d4740 1 --2- 172.21.15.1:0/2605579062 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b9852a490 0x564b98904530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:02.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.537+0000 7f113f4d4740 1 -- 172.21.15.1:0/2605579062 >> 172.21.15.1:0/2605579062 conn(0x564b98547740 msgr2=0x564b98900e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:02.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.543+0000 7f113f4d4740 1 -- 172.21.15.1:0/2605579062 shutdown_connections 2024-09-21T01:00:02.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.546+0000 7f113f4d4740 1 -- 172.21.15.1:0/2605579062 wait complete. 2024-09-21T01:00:02.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.546+0000 7f113f4d4740 1 -- start start 2024-09-21T01:00:02.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.547+0000 7f113f4d4740 1 Processor -- start 2024-09-21T01:00:02.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.547+0000 7f113f4d4740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b9852a490 0x564b9890a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:02.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.547+0000 7f113f4d4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b98532670 0x564b9890a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:02.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.547+0000 7f113259c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b9852a490 0x564b9890a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:02.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.547+0000 7f113259c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b9852a490 0x564b9890a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:35990/0 (socket says 172.21.15.1:35990) 2024-09-21T01:00:02.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.547+0000 7f113259c640 1 -- 172.21.15.1:0/2343096300 learned_addr learned my addr 172.21.15.1:0/2343096300 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:02.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.547+0000 7f113f4d4740 1 --2- 172.21.15.1:0/2343096300 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b98553350 0x564b98981fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:02.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.548+0000 7f113f4d4740 1 -- 172.21.15.1:0/2343096300 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f111400fbc0 con 0x564b98532670 2024-09-21T01:00:02.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.548+0000 7f113f4d4740 1 -- 172.21.15.1:0/2343096300 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f111400f4f0 con 0x564b98553350 2024-09-21T01:00:02.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.548+0000 7f113f4d4740 1 -- 172.21.15.1:0/2343096300 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f111400c670 con 0x564b9852a490 2024-09-21T01:00:02.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.548+0000 7f113f4d4740 10 client.0 _ll_register_callbacks cb 0x7f112c009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:02.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.548+0000 7f1132d9d640 1 --2- 172.21.15.1:0/2343096300 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b98553350 0x564b98981fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:02.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.548+0000 7f1131d9b640 1 --2- 172.21.15.1:0/2343096300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b98532670 0x564b9890a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:02.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.548+0000 7f1132d9d640 1 -- 172.21.15.1:0/2343096300 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b9852a490 msgr2=0x564b9890a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:02.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.548+0000 7f1132d9d640 1 --2- 172.21.15.1:0/2343096300 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b9852a490 0x564b9890a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:02.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.548+0000 7f1132d9d640 1 -- 172.21.15.1:0/2343096300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b98532670 msgr2=0x564b9890a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:02.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.548+0000 7f1132d9d640 1 --2- 172.21.15.1:0/2343096300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b98532670 0x564b9890a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:02.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.548+0000 7f1132d9d640 1 -- 172.21.15.1:0/2343096300 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b989824e0 con 0x564b98553350 2024-09-21T01:00:02.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.549+0000 7f113259c640 1 --2- 172.21.15.1:0/2343096300 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b9852a490 0x564b9890a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:00:02.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.549+0000 7f1132d9d640 1 --2- 172.21.15.1:0/2343096300 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b98553350 0x564b98981fa0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f112c00ae40 tx=0x7f112c018870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7710779557f5d417 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:02.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.549+0000 7f1119ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:00:02.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.550+0000 7f1119ffb640 1 -- 172.21.15.1:0/2343096300 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112c032080 con 0x564b98553350 2024-09-21T01:00:02.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.550+0000 7f113f4d4740 1 -- 172.21.15.1:0/2343096300 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f112400b950 con 0x564b98553350 2024-09-21T01:00:02.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.550+0000 7f1119ffb640 1 -- 172.21.15.1:0/2343096300 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f112c0239b0 con 0x564b98553350 2024-09-21T01:00:02.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.553+0000 7f1119ffb640 1 -- 172.21.15.1:0/2343096300 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f112c028020 con 0x564b98553350 2024-09-21T01:00:02.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.553+0000 7f113f4d4740 10 client.26048 fetch_fsmap learned FSMap version 31 2024-09-21T01:00:02.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.553+0000 7f113f4d4740 1 -- 172.21.15.1:0/2343096300 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564b98983610 con 0x564b98553350 2024-09-21T01:00:02.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.556+0000 7f1119ffb640 1 -- 172.21.15.1:0/2343096300 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f112400b950 con 0x564b98553350 2024-09-21T01:00:02.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.556+0000 7f1119ffb640 1 -- 172.21.15.1:0/2343096300 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7f112c02ca50 con 0x564b98553350 2024-09-21T01:00:02.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.556+0000 7f113f4d4740 10 client.26048 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T01:00:02.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.556+0000 7f113f4d4740 10 client.26048 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:00:02.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.556+0000 7f113f4d4740 20 client.26048 populate_metadata read hostname 'smithi001' 2024-09-21T01:00:02.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.556+0000 7f113f4d4740 1 --2- 172.21.15.1:0/2343096300 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x564b984e7080 0x564b98985e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:02.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.556+0000 7f113f4d4740 4 client.26048 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T01:00:02.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.556+0000 7f113f4d4740 1 -- 172.21.15.1:0/2343096300 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564b9886e860 con 0x564b984e7080 2024-09-21T01:00:02.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.561+0000 7f113259c640 1 --2- 172.21.15.1:0/2343096300 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x564b984e7080 0x564b98985e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:02.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.563+0000 7f113259c640 1 --2- 172.21.15.1:0/2343096300 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x564b984e7080 0x564b98985e70 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be10479ac55bd3f4 server_cookie=c069af8bb36476ae in_seq=0 out_seq=0 2024-09-21T01:00:02.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.564+0000 7f1119ffb640 10 client.26048 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:02.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.569+0000 7f1119ffb640 1 -- 172.21.15.1:0/2343096300 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564b9886e860 con 0x564b984e7080 2024-09-21T01:00:02.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.569+0000 7f1119ffb640 10 client.26048 handle_command_reply: tid=0 2024-09-21T01:00:02.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.569+0000 7f113f4d4740 1 client.26048 shutdown 2024-09-21T01:00:02.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.575+0000 7f113f4d4740 1 -- 172.21.15.1:0/2343096300 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b98553350 msgr2=0x564b98981fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:02.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.575+0000 7f113f4d4740 1 --2- 172.21.15.1:0/2343096300 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b98553350 0x564b98981fa0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f112c00ae40 tx=0x7f112c018870 comp rx=0 tx=0).stop 2024-09-21T01:00:02.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.577+0000 7f113f4d4740 1 -- 172.21.15.1:0/2343096300 shutdown_connections 2024-09-21T01:00:02.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.577+0000 7f113f4d4740 1 --2- 172.21.15.1:0/2343096300 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x564b984e7080 0x564b98985e70 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:02.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.577+0000 7f113f4d4740 1 --2- 172.21.15.1:0/2343096300 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b98553350 0x564b98981fa0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:02.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.577+0000 7f113f4d4740 1 --2- 172.21.15.1:0/2343096300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564b98532670 0x564b9890a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:02.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.577+0000 7f113f4d4740 1 --2- 172.21.15.1:0/2343096300 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b9852a490 0x564b9890a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:02.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.577+0000 7f113f4d4740 1 -- 172.21.15.1:0/2343096300 >> 172.21.15.1:0/2343096300 conn(0x564b98547740 msgr2=0x564b98904100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:02.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.577+0000 7f1119ffb640 0 client.26048 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:02.584 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T01:00:02.584 INFO:teuthology.orchestra.run.smithi001.stdout: "return_code": 0, 2024-09-21T01:00:02.585 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_tag": "1bffed0d-34b1-4e8b-9cab-7501131ef79d", 2024-09-21T01:00:02.585 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": "asynchronous" 2024-09-21T01:00:02.585 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T01:00:02.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.579+0000 7f113f4d4740 1 -- 172.21.15.1:0/2343096300 shutdown_connections 2024-09-21T01:00:02.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.581+0000 7f113f4d4740 1 -- 172.21.15.1:0/2343096300 wait complete. 2024-09-21T01:00:02.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.581+0000 7f113f4d4740 20 client.26048 trim_cache size 0 max 16384 2024-09-21T01:00:02.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.583+0000 7f1138f60640 1 -- 172.21.15.1:0/343594635 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f111c0b6710 msgr2=0x7f111c0b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:02.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.583+0000 7f1138f60640 1 --2- 172.21.15.1:0/343594635 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f111c0b6710 0x7f111c0b8c20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f112c00a510 tx=0x7f112c0096e0 comp rx=0 tx=0).stop 2024-09-21T01:00:02.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.583+0000 7f1138f60640 1 -- 172.21.15.1:0/343594635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1134103b90 msgr2=0x7f1134074d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:02.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.583+0000 7f1138f60640 1 --2- 172.21.15.1:0/343594635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1134103b90 0x7f1134074d70 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f1128033220 tx=0x7f11280045e0 comp rx=0 tx=0).stop 2024-09-21T01:00:02.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.583+0000 7f1138f60640 1 -- 172.21.15.1:0/343594635 shutdown_connections 2024-09-21T01:00:02.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.583+0000 7f1138f60640 1 --2- 172.21.15.1:0/343594635 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1134109e20 0x7f113406e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:02.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.583+0000 7f1138f60640 1 --2- 172.21.15.1:0/343594635 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11341094d0 0x7f113406e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:02.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.583+0000 7f1138f60640 1 --2- 172.21.15.1:0/343594635 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f111c0b6710 0x7f111c0b8c20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:02.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.583+0000 7f1138f60640 1 --2- 172.21.15.1:0/343594635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1134103b90 0x7f1134074d70 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:02.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.583+0000 7f1138f60640 1 -- 172.21.15.1:0/343594635 >> 172.21.15.1:0/343594635 conn(0x7f11340ff5e0 msgr2=0x7f1134108ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:02.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.588+0000 7f1138f60640 1 -- 172.21.15.1:0/343594635 shutdown_connections 2024-09-21T01:00:02.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:02.589+0000 7f1138f60640 1 -- 172.21.15.1:0/343594635 wait complete. 2024-09-21T01:00:03.563 INFO:tasks.workunit.client.0.smithi001.stdout: 75 1821570 419 1128625 395 955306 1184 2024-09-21T01:00:03.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:03 smithi001 ceph-mon[31211]: pgmap v443: 97 pgs: 97 active+clean; 297 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.3 MiB/s wr, 201 op/s 2024-09-21T01:00:03.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:03 smithi001 ceph-mon[31211]: scrub queued for path: / 2024-09-21T01:00:03.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:03 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:03.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:03 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:00:03.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:03 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:00:03.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:03 smithi193 ceph-mon[34660]: pgmap v443: 97 pgs: 97 active+clean; 297 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.3 MiB/s wr, 201 op/s 2024-09-21T01:00:03.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:03 smithi193 ceph-mon[34660]: scrub queued for path: / 2024-09-21T01:00:03.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:03 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:03.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:03 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:00:03.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:03 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:00:03.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:03 smithi042 ceph-mon[34481]: pgmap v443: 97 pgs: 97 active+clean; 297 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.3 MiB/s wr, 201 op/s 2024-09-21T01:00:03.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:03 smithi042 ceph-mon[34481]: scrub queued for path: / 2024-09-21T01:00:03.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:03 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:03.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:03 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:00:03.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:03 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:00:03.784 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:00:04.703 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:00:05.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:05 smithi001 ceph-mon[31211]: pgmap v444: 97 pgs: 97 active+clean; 329 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.9 MiB/s wr, 334 op/s 2024-09-21T01:00:05.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:05 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:05.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.702+0000 7f1e5993d640 1 -- 172.21.15.1:0/2721537134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e541083b0 msgr2=0x7f1e541087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:05.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.702+0000 7f1e5993d640 1 --2- 172.21.15.1:0/2721537134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e541083b0 0x7f1e541087c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f1e48009900 tx=0x7f1e4802a410 comp rx=0 tx=0).stop 2024-09-21T01:00:05.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.702+0000 7f1e5993d640 1 -- 172.21.15.1:0/2721537134 shutdown_connections 2024-09-21T01:00:05.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.702+0000 7f1e5993d640 1 --2- 172.21.15.1:0/2721537134 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e54108d00 0x7f1e5410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:05.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.702+0000 7f1e5993d640 1 --2- 172.21.15.1:0/2721537134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e541083b0 0x7f1e541087c0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:05.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.702+0000 7f1e5993d640 1 --2- 172.21.15.1:0/2721537134 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e54103140 0x7f1e54103550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:05.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.702+0000 7f1e5993d640 1 -- 172.21.15.1:0/2721537134 >> 172.21.15.1:0/2721537134 conn(0x7f1e54077c60 msgr2=0x7f1e540780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:05.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.702+0000 7f1e5993d640 1 -- 172.21.15.1:0/2721537134 shutdown_connections 2024-09-21T01:00:05.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.702+0000 7f1e5993d640 1 -- 172.21.15.1:0/2721537134 wait complete. 2024-09-21T01:00:05.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.703+0000 7f1e5993d640 1 Processor -- start 2024-09-21T01:00:05.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.703+0000 7f1e5993d640 1 -- start start 2024-09-21T01:00:05.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.704+0000 7f1e5993d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e54103140 0x7f1e5419b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:05.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.704+0000 7f1e5993d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e541083b0 0x7f1e5419b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:05.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.704+0000 7f1e5993d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e54108d00 0x7f1e5419bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:05.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.704+0000 7f1e5993d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1e54112a10 con 0x7f1e54103140 2024-09-21T01:00:05.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.704+0000 7f1e5993d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1e54112890 con 0x7f1e541083b0 2024-09-21T01:00:05.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.704+0000 7f1e5993d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1e54112b90 con 0x7f1e54108d00 2024-09-21T01:00:05.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.704+0000 7f1e52ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e54103140 0x7f1e5419b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:05.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.704+0000 7f1e527fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e541083b0 0x7f1e5419b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:05.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.704+0000 7f1e52ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e54103140 0x7f1e5419b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35224/0 (socket says 172.21.15.1:35224) 2024-09-21T01:00:05.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.704+0000 7f1e52ffd640 1 -- 172.21.15.1:0/1005420464 learned_addr learned my addr 172.21.15.1:0/1005420464 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:05.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.704+0000 7f1e537fe640 1 --2- 172.21.15.1:0/1005420464 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e54108d00 0x7f1e5419bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:05.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.704+0000 7f1e52ffd640 1 -- 172.21.15.1:0/1005420464 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e54108d00 msgr2=0x7f1e5419bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:05.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.704+0000 7f1e52ffd640 1 --2- 172.21.15.1:0/1005420464 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e54108d00 0x7f1e5419bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:05.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.704+0000 7f1e52ffd640 1 -- 172.21.15.1:0/1005420464 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e541083b0 msgr2=0x7f1e5419b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:05.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.704+0000 7f1e52ffd640 1 --2- 172.21.15.1:0/1005420464 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e541083b0 0x7f1e5419b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:05.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.705+0000 7f1e52ffd640 1 -- 172.21.15.1:0/1005420464 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e541a6570 con 0x7f1e54103140 2024-09-21T01:00:05.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.705+0000 7f1e537fe640 1 --2- 172.21.15.1:0/1005420464 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e54108d00 0x7f1e5419bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:05.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.705+0000 7f1e52ffd640 1 --2- 172.21.15.1:0/1005420464 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e54103140 0x7f1e5419b2e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f1e4400e9f0 tx=0x7f1e4400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:05.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.705+0000 7f1e5893b640 1 -- 172.21.15.1:0/1005420464 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4400cd80 con 0x7f1e54103140 2024-09-21T01:00:05.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.705+0000 7f1e5993d640 1 -- 172.21.15.1:0/1005420464 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e541a6860 con 0x7f1e54103140 2024-09-21T01:00:05.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.705+0000 7f1e5993d640 1 -- 172.21.15.1:0/1005420464 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e541a6dc0 con 0x7f1e54103140 2024-09-21T01:00:05.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.705+0000 7f1e5893b640 1 -- 172.21.15.1:0/1005420464 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e440108e0 con 0x7f1e54103140 2024-09-21T01:00:05.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.705+0000 7f1e5893b640 1 -- 172.21.15.1:0/1005420464 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4400cd80 con 0x7f1e54103140 2024-09-21T01:00:05.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.708+0000 7f1e5893b640 1 -- 172.21.15.1:0/1005420464 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f1e44018780 con 0x7f1e54103140 2024-09-21T01:00:05.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.709+0000 7f1e5feb1740 1 Processor -- start 2024-09-21T01:00:05.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.709+0000 7f1e5feb1740 1 -- start start 2024-09-21T01:00:05.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.709+0000 7f1e5feb1740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b43bdce070 0x55b43c175650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:05.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.709+0000 7f1e5feb1740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b43bda51b0 0x55b43c175b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:05.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.709+0000 7f1e5feb1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b43bdad390 0x55b43c1760d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:05.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.709+0000 7f1e5feb1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b43c0ebe50 con 0x55b43bdad390 2024-09-21T01:00:05.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.709+0000 7f1e5feb1740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b43c0db280 con 0x55b43bdce070 2024-09-21T01:00:05.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.709+0000 7f1e5feb1740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b43c0df090 con 0x55b43bda51b0 2024-09-21T01:00:05.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.709+0000 7f1e52ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b43bda51b0 0x55b43c175b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:05.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.709+0000 7f1e527fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b43bdad390 0x55b43c1760d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:05.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.709+0000 7f1e52ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b43bda51b0 0x55b43c175b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:36016/0 (socket says 172.21.15.1:36016) 2024-09-21T01:00:05.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.709+0000 7f1e52ffd640 1 -- 172.21.15.1:0/3188754065 learned_addr learned my addr 172.21.15.1:0/3188754065 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:05.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.709+0000 7f1e537fe640 1 --2- 172.21.15.1:0/3188754065 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b43bdce070 0x55b43c175650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:05.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.710+0000 7f1e5893b640 1 --2- 172.21.15.1:0/1005420464 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f1e3c0b6740 0x7f1e3c0b8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:05.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.710+0000 7f1e527fc640 1 -- 172.21.15.1:0/3188754065 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b43bda51b0 msgr2=0x55b43c175b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:05.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.710+0000 7f1e527fc640 1 --2- 172.21.15.1:0/3188754065 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b43bda51b0 0x55b43c175b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:05.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.710+0000 7f1e527fc640 1 -- 172.21.15.1:0/3188754065 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b43bdce070 msgr2=0x55b43c175650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:05.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.710+0000 7f1e527fc640 1 --2- 172.21.15.1:0/3188754065 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b43bdce070 0x55b43c175650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:05.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.710+0000 7f1e527fc640 1 -- 172.21.15.1:0/3188754065 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b43be39650 con 0x55b43bdad390 2024-09-21T01:00:05.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.710+0000 7f1e537fe640 1 --2- 172.21.15.1:0/1005420464 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f1e3c0b6740 0x7f1e3c0b8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:05.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.710+0000 7f1e5893b640 1 -- 172.21.15.1:0/1005420464 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f1e440e7140 con 0x7f1e54103140 2024-09-21T01:00:05.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.710+0000 7f1e527fc640 1 --2- 172.21.15.1:0/3188754065 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b43bdad390 0x55b43c1760d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f1e54075820 tx=0x7f1e48004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d15d1b1429c87706 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:05.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.710+0000 7f1e39ffb640 1 -- 172.21.15.1:0/3188754065 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e48040070 con 0x55b43bdad390 2024-09-21T01:00:05.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.711+0000 7f1e39ffb640 1 -- 172.21.15.1:0/3188754065 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e48005500 con 0x55b43bdad390 2024-09-21T01:00:05.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.711+0000 7f1e39ffb640 1 -- 172.21.15.1:0/3188754065 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e48035040 con 0x55b43bdad390 2024-09-21T01:00:05.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.711+0000 7f1e537fe640 1 --2- 172.21.15.1:0/1005420464 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f1e3c0b6740 0x7f1e3c0b8c50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c009fd0 tx=0x7f1e4c004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:05.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.712+0000 7f1e5feb1740 1 -- 172.21.15.1:0/3188754065 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b43bdad390 msgr2=0x55b43c1760d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:05.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.712+0000 7f1e5feb1740 1 --2- 172.21.15.1:0/3188754065 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b43bdad390 0x55b43c1760d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f1e54075820 tx=0x7f1e48004040 comp rx=0 tx=0).stop 2024-09-21T01:00:05.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.712+0000 7f1e5feb1740 1 -- 172.21.15.1:0/3188754065 shutdown_connections 2024-09-21T01:00:05.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.712+0000 7f1e5feb1740 1 --2- 172.21.15.1:0/3188754065 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b43bdad390 0x55b43c1760d0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:05.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.712+0000 7f1e5feb1740 1 --2- 172.21.15.1:0/3188754065 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b43bda51b0 0x55b43c175b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:05.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.712+0000 7f1e5feb1740 1 --2- 172.21.15.1:0/3188754065 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b43bdce070 0x55b43c175650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:05.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.712+0000 7f1e5feb1740 1 -- 172.21.15.1:0/3188754065 >> 172.21.15.1:0/3188754065 conn(0x55b43bdc2460 msgr2=0x55b43c173540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:05.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.712+0000 7f1e5feb1740 1 -- 172.21.15.1:0/3188754065 shutdown_connections 2024-09-21T01:00:05.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.712+0000 7f1e5feb1740 1 -- 172.21.15.1:0/3188754065 wait complete. 2024-09-21T01:00:05.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.713+0000 7f1e5feb1740 1 -- start start 2024-09-21T01:00:05.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.713+0000 7f1e5feb1740 1 Processor -- start 2024-09-21T01:00:05.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.713+0000 7f1e5feb1740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b43bda51b0 0x55b43c185040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:05.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.713+0000 7f1e5feb1740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b43bdad390 0x55b43c185580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:05.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.713+0000 7f1e5feb1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b43bdce070 0x55b43c185ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:05.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.713+0000 7f1e5feb1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b43bf3c700 con 0x55b43bdce070 2024-09-21T01:00:05.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.713+0000 7f1e5feb1740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b43c076110 con 0x55b43bda51b0 2024-09-21T01:00:05.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.713+0000 7f1e5feb1740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b43c188100 con 0x55b43bdad390 2024-09-21T01:00:05.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.714+0000 7f1e5feb1740 10 client.0 _ll_register_callbacks cb 0x55b43c08f990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:05.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.714+0000 7f1e527fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b43bdad390 0x55b43c185580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:05.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.714+0000 7f1e537fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b43bdce070 0x55b43c185ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:05.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.714+0000 7f1e527fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b43bdad390 0x55b43c185580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:36020/0 (socket says 172.21.15.1:36020) 2024-09-21T01:00:05.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.714+0000 7f1e527fc640 1 -- 172.21.15.1:0/801845458 learned_addr learned my addr 172.21.15.1:0/801845458 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:05.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.714+0000 7f1e52ffd640 1 --2- 172.21.15.1:0/801845458 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b43bda51b0 0x55b43c185040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:05.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.714+0000 7f1e527fc640 1 -- 172.21.15.1:0/801845458 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b43bda51b0 msgr2=0x55b43c185040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:05.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.714+0000 7f1e527fc640 1 --2- 172.21.15.1:0/801845458 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b43bda51b0 0x55b43c185040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:05.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.714+0000 7f1e527fc640 1 -- 172.21.15.1:0/801845458 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b43bdce070 msgr2=0x55b43c185ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:05.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.714+0000 7f1e527fc640 1 --2- 172.21.15.1:0/801845458 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b43bdce070 0x55b43c185ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:05.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.714+0000 7f1e527fc640 1 -- 172.21.15.1:0/801845458 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b43c0a3c40 con 0x55b43bdad390 2024-09-21T01:00:05.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.714+0000 7f1e537fe640 1 --2- 172.21.15.1:0/801845458 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b43bdce070 0x55b43c185ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:05.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.715+0000 7f1e527fc640 1 --2- 172.21.15.1:0/801845458 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b43bdad390 0x55b43c185580 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1e48005ab0 tx=0x7f1e48004f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a63e09a7cce238a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:05.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.715+0000 7f1e32ffd640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T01:00:05.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.715+0000 7f1e32ffd640 1 -- 172.21.15.1:0/801845458 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e48040030 con 0x55b43bdad390 2024-09-21T01:00:05.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.715+0000 7f1e32ffd640 1 -- 172.21.15.1:0/801845458 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f1e480048c0 con 0x55b43bdad390 2024-09-21T01:00:05.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.715+0000 7f1e5feb1740 1 -- 172.21.15.1:0/801845458 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e48005500 con 0x55b43bdad390 2024-09-21T01:00:05.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.715+0000 7f1e32ffd640 1 -- 172.21.15.1:0/801845458 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f1e48035040 con 0x55b43bdad390 2024-09-21T01:00:05.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.715+0000 7f1e5feb1740 10 client.25960 fetch_fsmap learned FSMap version 31 2024-09-21T01:00:05.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.716+0000 7f1e5feb1740 1 -- 172.21.15.1:0/801845458 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55b43c193dd0 con 0x55b43bdad390 2024-09-21T01:00:05.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.716+0000 7f1e32ffd640 1 -- 172.21.15.1:0/801845458 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e48005500 con 0x55b43bdad390 2024-09-21T01:00:05.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.716+0000 7f1e32ffd640 1 -- 172.21.15.1:0/801845458 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7f1e48003a70 con 0x55b43bdad390 2024-09-21T01:00:05.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.716+0000 7f1e5feb1740 10 client.25960 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T01:00:05.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.716+0000 7f1e5feb1740 10 client.25960 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:00:05.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.716+0000 7f1e5feb1740 20 client.25960 populate_metadata read hostname 'smithi001' 2024-09-21T01:00:05.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.716+0000 7f1e5feb1740 1 --2- 172.21.15.1:0/801845458 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55b43bd8c9f0 0x55b43c197130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:05.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.716+0000 7f1e5feb1740 4 client.25960 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:00:05.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.716+0000 7f1e5feb1740 1 -- 172.21.15.1:0/801845458 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b43c0edda0 con 0x55b43bd8c9f0 2024-09-21T01:00:05.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.716+0000 7f1e52ffd640 1 --2- 172.21.15.1:0/801845458 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55b43bd8c9f0 0x55b43c197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:05.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.717+0000 7f1e32ffd640 10 client.25960 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:05.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.717+0000 7f1e52ffd640 1 --2- 172.21.15.1:0/801845458 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55b43bd8c9f0 0x55b43c197130 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e05e172f011c729 server_cookie=d26e17fb2a1bc7e4 in_seq=0 out_seq=0 2024-09-21T01:00:05.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.721+0000 7f1e32ffd640 1 -- 172.21.15.1:0/801845458 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b43c0edda0 con 0x55b43bd8c9f0 2024-09-21T01:00:05.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.721+0000 7f1e32ffd640 10 client.25960 handle_command_reply: tid=0 2024-09-21T01:00:05.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.721+0000 7f1e5feb1740 1 client.25960 shutdown 2024-09-21T01:00:05.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.721+0000 7f1e5feb1740 1 -- 172.21.15.1:0/801845458 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b43bdad390 msgr2=0x55b43c185580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:05.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.721+0000 7f1e5feb1740 1 --2- 172.21.15.1:0/801845458 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b43bdad390 0x55b43c185580 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1e48005ab0 tx=0x7f1e48004f60 comp rx=0 tx=0).stop 2024-09-21T01:00:05.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.721+0000 7f1e5feb1740 1 -- 172.21.15.1:0/801845458 shutdown_connections 2024-09-21T01:00:05.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.721+0000 7f1e5feb1740 1 --2- 172.21.15.1:0/801845458 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55b43bd8c9f0 0x55b43c197130 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:05.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.721+0000 7f1e5feb1740 1 --2- 172.21.15.1:0/801845458 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b43bdce070 0x55b43c185ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:05.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.721+0000 7f1e5feb1740 1 --2- 172.21.15.1:0/801845458 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b43bdad390 0x55b43c185580 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:05.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.721+0000 7f1e5feb1740 1 --2- 172.21.15.1:0/801845458 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b43bda51b0 0x55b43c185040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:05.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.721+0000 7f1e5feb1740 1 -- 172.21.15.1:0/801845458 >> 172.21.15.1:0/801845458 conn(0x55b43bdc2460 msgr2=0x55b43c1787e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:05.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.721+0000 7f1e32ffd640 0 client.25960 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:05.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.722+0000 7f1e5feb1740 1 -- 172.21.15.1:0/801845458 shutdown_connections 2024-09-21T01:00:05.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.722+0000 7f1e5feb1740 1 -- 172.21.15.1:0/801845458 wait complete. 2024-09-21T01:00:05.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.722+0000 7f1e5feb1740 20 client.25960 trim_cache size 0 max 16384 2024-09-21T01:00:05.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:05 smithi193 ceph-mon[34660]: pgmap v444: 97 pgs: 97 active+clean; 329 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.9 MiB/s wr, 334 op/s 2024-09-21T01:00:05.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:05 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:05.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:05 smithi042 ceph-mon[34481]: pgmap v444: 97 pgs: 97 active+clean; 329 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.9 MiB/s wr, 334 op/s 2024-09-21T01:00:05.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:05 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:05.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.742+0000 7f1e5feb1740 1 Processor -- start 2024-09-21T01:00:05.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.742+0000 7f1e5feb1740 1 -- start start 2024-09-21T01:00:05.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.742+0000 7f1e5feb1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b43bda51b0 0x55b43c186c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:05.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.742+0000 7f1e5feb1740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b43bdad390 0x55b43c182230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:05.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.743+0000 7f1e5feb1740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b43bdce070 0x55b43c182770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:05.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.743+0000 7f1e5feb1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4000e4f0 con 0x55b43bda51b0 2024-09-21T01:00:05.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.743+0000 7f1e5feb1740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1e400101b0 con 0x55b43bdce070 2024-09-21T01:00:05.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.743+0000 7f1e5feb1740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4000ebc0 con 0x55b43bdad390 2024-09-21T01:00:05.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.743+0000 7f1e52ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b43bda51b0 0x55b43c186c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:05.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.743+0000 7f1e52ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b43bda51b0 0x55b43c186c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35248/0 (socket says 172.21.15.1:35248) 2024-09-21T01:00:05.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.743+0000 7f1e52ffd640 1 -- 172.21.15.1:0/2285436866 learned_addr learned my addr 172.21.15.1:0/2285436866 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:05.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.743+0000 7f1e527fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b43bdad390 0x55b43c182230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:05.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.743+0000 7f1e537fe640 1 --2- 172.21.15.1:0/2285436866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b43bdce070 0x55b43c182770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:05.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.743+0000 7f1e52ffd640 1 -- 172.21.15.1:0/2285436866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b43bdad390 msgr2=0x55b43c182230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:05.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.743+0000 7f1e52ffd640 1 --2- 172.21.15.1:0/2285436866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b43bdad390 0x55b43c182230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:05.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.743+0000 7f1e52ffd640 1 -- 172.21.15.1:0/2285436866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b43bdce070 msgr2=0x55b43c182770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:05.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.743+0000 7f1e52ffd640 1 --2- 172.21.15.1:0/2285436866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b43bdce070 0x55b43c182770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:05.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.743+0000 7f1e52ffd640 1 -- 172.21.15.1:0/2285436866 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b43c183540 con 0x55b43bda51b0 2024-09-21T01:00:05.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.743+0000 7f1e52ffd640 1 --2- 172.21.15.1:0/2285436866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b43bda51b0 0x55b43c186c70 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f1e440a9880 tx=0x7f1e440eac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dcff75f49b52967 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:05.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.743+0000 7f1e397fa640 1 -- 172.21.15.1:0/2285436866 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e440ad080 con 0x55b43bda51b0 2024-09-21T01:00:05.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.744+0000 7f1e397fa640 1 -- 172.21.15.1:0/2285436866 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e440acdc0 con 0x55b43bda51b0 2024-09-21T01:00:05.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.744+0000 7f1e397fa640 1 -- 172.21.15.1:0/2285436866 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e440aca20 con 0x55b43bda51b0 2024-09-21T01:00:05.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.745+0000 7f1e5feb1740 1 -- 172.21.15.1:0/2285436866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b43bda51b0 msgr2=0x55b43c186c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:05.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.745+0000 7f1e5feb1740 1 --2- 172.21.15.1:0/2285436866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b43bda51b0 0x55b43c186c70 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f1e440a9880 tx=0x7f1e440eac20 comp rx=0 tx=0).stop 2024-09-21T01:00:05.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.745+0000 7f1e5feb1740 1 -- 172.21.15.1:0/2285436866 shutdown_connections 2024-09-21T01:00:05.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.745+0000 7f1e5feb1740 1 --2- 172.21.15.1:0/2285436866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b43bdce070 0x55b43c182770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:05.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.745+0000 7f1e5feb1740 1 --2- 172.21.15.1:0/2285436866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b43bdad390 0x55b43c182230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:05.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.745+0000 7f1e5feb1740 1 --2- 172.21.15.1:0/2285436866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b43bda51b0 0x55b43c186c70 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:05.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.745+0000 7f1e5feb1740 1 -- 172.21.15.1:0/2285436866 >> 172.21.15.1:0/2285436866 conn(0x55b43bdc2460 msgr2=0x55b43c186560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:05.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.745+0000 7f1e5feb1740 1 -- 172.21.15.1:0/2285436866 shutdown_connections 2024-09-21T01:00:05.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.746+0000 7f1e5feb1740 1 -- 172.21.15.1:0/2285436866 wait complete. 2024-09-21T01:00:05.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.746+0000 7f1e5feb1740 1 -- start start 2024-09-21T01:00:05.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.746+0000 7f1e5feb1740 1 Processor -- start 2024-09-21T01:00:05.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.747+0000 7f1e5feb1740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b43bda51b0 0x55b43c17f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:05.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.747+0000 7f1e5feb1740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b43bdad390 0x55b43c17ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:05.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.747+0000 7f1e5feb1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b43bdce070 0x55b43c17bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:05.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.747+0000 7f1e537fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b43bdce070 0x55b43c17bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:05.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.747+0000 7f1e537fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b43bdce070 0x55b43c17bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35262/0 (socket says 172.21.15.1:35262) 2024-09-21T01:00:05.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.747+0000 7f1e537fe640 1 -- 172.21.15.1:0/672616579 learned_addr learned my addr 172.21.15.1:0/672616579 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:05.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.747+0000 7f1e5feb1740 1 -- 172.21.15.1:0/672616579 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4000fa20 con 0x55b43bdce070 2024-09-21T01:00:05.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.747+0000 7f1e5feb1740 1 -- 172.21.15.1:0/672616579 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4000f350 con 0x55b43bdad390 2024-09-21T01:00:05.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.747+0000 7f1e5feb1740 1 -- 172.21.15.1:0/672616579 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4000c4d0 con 0x55b43bda51b0 2024-09-21T01:00:05.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.747+0000 7f1e52ffd640 1 --2- 172.21.15.1:0/672616579 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b43bda51b0 0x55b43c17f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:05.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.748+0000 7f1e527fc640 1 --2- 172.21.15.1:0/672616579 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b43bdad390 0x55b43c17ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:05.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.748+0000 7f1e537fe640 1 -- 172.21.15.1:0/672616579 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b43bda51b0 msgr2=0x55b43c17f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:05.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.748+0000 7f1e537fe640 1 --2- 172.21.15.1:0/672616579 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b43bda51b0 0x55b43c17f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:05.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.748+0000 7f1e537fe640 1 -- 172.21.15.1:0/672616579 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b43bdad390 msgr2=0x55b43c17ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:05.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.748+0000 7f1e537fe640 1 --2- 172.21.15.1:0/672616579 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b43bdad390 0x55b43c17ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:05.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.748+0000 7f1e537fe640 1 -- 172.21.15.1:0/672616579 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b43c17c740 con 0x55b43bdce070 2024-09-21T01:00:05.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.748+0000 7f1e527fc640 1 --2- 172.21.15.1:0/672616579 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b43bdad390 0x55b43c17ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:00:05.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.748+0000 7f1e5feb1740 10 client.0 _ll_register_callbacks cb 0x7f1e4c009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:05.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.748+0000 7f1e5feb1740 1 -- 172.21.15.1:0/672616579 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e440acdc0 con 0x55b43bdce070 2024-09-21T01:00:05.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.748+0000 7f1e537fe640 1 --2- 172.21.15.1:0/672616579 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b43bdce070 0x55b43c17bfd0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c0207f0 tx=0x7f1e4c009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e470183064cb4a54 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:05.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.748+0000 7f1e32ffd640 10 client.16389 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:00:05.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.749+0000 7f1e32ffd640 1 -- 172.21.15.1:0/672616579 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c01fdd0 con 0x55b43bdce070 2024-09-21T01:00:05.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.749+0000 7f1e32ffd640 1 -- 172.21.15.1:0/672616579 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f1e4c02c410 con 0x55b43bdce070 2024-09-21T01:00:05.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.749+0000 7f1e32ffd640 1 -- 172.21.15.1:0/672616579 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f1e4c02c650 con 0x55b43bdce070 2024-09-21T01:00:05.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.749+0000 7f1e5feb1740 10 client.16389 fetch_fsmap learned FSMap version 31 2024-09-21T01:00:05.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.749+0000 7f1e5feb1740 1 -- 172.21.15.1:0/672616579 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({fsmap=31}) -- 0x55b43c18df20 con 0x55b43bdce070 2024-09-21T01:00:05.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.749+0000 7f1e32ffd640 1 -- 172.21.15.1:0/672616579 <== mon.0 v2:172.21.15.1:3300/0 4 ==== fsmap(e 31) ==== 8394+0+0 (secure 0 0 0) 0x7f1e4c02c7f0 con 0x55b43bdce070 2024-09-21T01:00:05.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.749+0000 7f1e5feb1740 10 client.16389 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T01:00:05.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.749+0000 7f1e5feb1740 10 client.16389 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:00:05.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.750+0000 7f1e5feb1740 20 client.16389 populate_metadata read hostname 'smithi001' 2024-09-21T01:00:05.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.750+0000 7f1e5feb1740 1 --2- 172.21.15.1:0/672616579 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55b43bd61da0 0x55b43c2084f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:05.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.750+0000 7f1e5feb1740 4 client.16389 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:00:05.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.750+0000 7f1e5feb1740 1 -- 172.21.15.1:0/672616579 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b43c0e9850 con 0x55b43bd61da0 2024-09-21T01:00:05.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.750+0000 7f1e52ffd640 1 --2- 172.21.15.1:0/672616579 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55b43bd61da0 0x55b43c2084f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:05.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.751+0000 7f1e52ffd640 1 --2- 172.21.15.1:0/672616579 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55b43bd61da0 0x55b43c2084f0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2faf371c720cbcc server_cookie=172c68946c5a91d9 in_seq=0 out_seq=0 2024-09-21T01:00:05.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.751+0000 7f1e32ffd640 10 client.16389 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:05.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.756+0000 7f1e32ffd640 1 -- 172.21.15.1:0/672616579 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1996 (crc 0 0 0) 0x55b43c0e9850 con 0x55b43bd61da0 2024-09-21T01:00:05.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.756+0000 7f1e32ffd640 10 client.16389 handle_command_reply: tid=0 2024-09-21T01:00:05.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.756+0000 7f1e5feb1740 1 client.16389 shutdown 2024-09-21T01:00:05.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.757+0000 7f1e5feb1740 1 -- 172.21.15.1:0/672616579 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b43bdce070 msgr2=0x55b43c17bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:05.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.757+0000 7f1e5feb1740 1 --2- 172.21.15.1:0/672616579 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b43bdce070 0x55b43c17bfd0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c0207f0 tx=0x7f1e4c009500 comp rx=0 tx=0).stop 2024-09-21T01:00:05.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.757+0000 7f1e5feb1740 1 -- 172.21.15.1:0/672616579 shutdown_connections 2024-09-21T01:00:05.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.757+0000 7f1e5feb1740 1 --2- 172.21.15.1:0/672616579 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55b43bd61da0 0x55b43c2084f0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:05.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.757+0000 7f1e5feb1740 1 --2- 172.21.15.1:0/672616579 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b43bdce070 0x55b43c17bfd0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:05.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.757+0000 7f1e5feb1740 1 --2- 172.21.15.1:0/672616579 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b43bdad390 0x55b43c17ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:05.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.757+0000 7f1e32ffd640 0 client.16389 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:05.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.757+0000 7f1e5feb1740 1 --2- 172.21.15.1:0/672616579 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b43bda51b0 0x55b43c17f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:05.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.757+0000 7f1e5feb1740 1 -- 172.21.15.1:0/672616579 >> 172.21.15.1:0/672616579 conn(0x55b43bdc2460 msgr2=0x55b43c177040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:05.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.757+0000 7f1e5feb1740 1 -- 172.21.15.1:0/672616579 shutdown_connections 2024-09-21T01:00:05.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.757+0000 7f1e5feb1740 1 -- 172.21.15.1:0/672616579 wait complete. 2024-09-21T01:00:05.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.757+0000 7f1e5feb1740 20 client.16389 trim_cache size 0 max 16384 2024-09-21T01:00:05.759 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T01:00:05.759 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "scrub active (5 inodes in the stack)", 2024-09-21T01:00:05.759 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": { 2024-09-21T01:00:05.759 INFO:teuthology.orchestra.run.smithi001.stdout: "1bffed0d-34b1-4e8b-9cab-7501131ef79d": { 2024-09-21T01:00:05.759 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:00:05.759 INFO:teuthology.orchestra.run.smithi001.stdout: "tag": "1bffed0d-34b1-4e8b-9cab-7501131ef79d", 2024-09-21T01:00:05.760 INFO:teuthology.orchestra.run.smithi001.stdout: "options": "recursive,force" 2024-09-21T01:00:05.760 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:00:05.760 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:00:05.760 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_stats": { 2024-09-21T01:00:05.760 INFO:teuthology.orchestra.run.smithi001.stdout: "f826f2c1-768a-47bb-b868-785b351ac6b4": { 2024-09-21T01:00:05.760 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:59:06.554657+0000", 2024-09-21T01:00:05.760 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:00:05.760 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:00:05.760 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:00:05.760 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:00:05.760 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:00:05.760 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:00:05.760 INFO:teuthology.orchestra.run.smithi001.stdout: "1bffed0d-34b1-4e8b-9cab-7501131ef79d": { 2024-09-21T01:00:05.761 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:00:02.564228+0000", 2024-09-21T01:00:05.761 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:00:05.761 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:00:05.761 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:00:05.761 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:00:05.761 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:00:05.761 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:00:05.761 INFO:teuthology.orchestra.run.smithi001.stdout: "bee49cce-b407-4617-a959-331ffd8dc5b0": { 2024-09-21T01:00:05.761 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:58:17.883027+0000", 2024-09-21T01:00:05.761 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:00:05.761 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:00:05.761 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:00:05.761 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:00:05.761 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:00:05.761 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:00:05.762 INFO:teuthology.orchestra.run.smithi001.stdout: "7cb1bc3f-e2d2-4bf7-b13e-8f3371d7aac1": { 2024-09-21T01:00:05.762 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:58:02.751142+0000", 2024-09-21T01:00:05.762 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:00:05.762 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:00:05.762 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:00:05.762 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:00:05.762 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:00:05.762 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:00:05.762 INFO:teuthology.orchestra.run.smithi001.stdout: "2383a19c-993d-4440-99f7-93b43dcf33b4": { 2024-09-21T01:00:05.762 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:47.609257+0000", 2024-09-21T01:00:05.762 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:00:05.762 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:00:05.762 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:00:05.762 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:00:05.763 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:00:05.763 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:00:05.763 INFO:teuthology.orchestra.run.smithi001.stdout: "53fa74e4-5aa8-408b-9724-7c93618f7636": { 2024-09-21T01:00:05.763 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:01.730608+0000", 2024-09-21T01:00:05.763 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:00:05.763 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:00:05.763 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:00:05.763 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:00:05.763 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:00:05.763 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:00:05.763 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:00:05.763 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T01:00:05.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.759+0000 7f1e5993d640 1 -- 172.21.15.1:0/1005420464 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f1e3c0b6740 msgr2=0x7f1e3c0b8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:05.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.759+0000 7f1e5993d640 1 --2- 172.21.15.1:0/1005420464 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f1e3c0b6740 0x7f1e3c0b8c50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c009fd0 tx=0x7f1e4c004ab0 comp rx=0 tx=0).stop 2024-09-21T01:00:05.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.759+0000 7f1e5993d640 1 -- 172.21.15.1:0/1005420464 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e54103140 msgr2=0x7f1e5419b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:05.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.759+0000 7f1e5993d640 1 --2- 172.21.15.1:0/1005420464 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e54103140 0x7f1e5419b2e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f1e4400e9f0 tx=0x7f1e4400eeb0 comp rx=0 tx=0).stop 2024-09-21T01:00:05.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.759+0000 7f1e5993d640 1 -- 172.21.15.1:0/1005420464 shutdown_connections 2024-09-21T01:00:05.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.759+0000 7f1e5993d640 1 --2- 172.21.15.1:0/1005420464 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e54108d00 0x7f1e5419bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:05.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.759+0000 7f1e5993d640 1 --2- 172.21.15.1:0/1005420464 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e541083b0 0x7f1e5419b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:05.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.759+0000 7f1e5993d640 1 --2- 172.21.15.1:0/1005420464 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f1e3c0b6740 0x7f1e3c0b8c50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:05.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.759+0000 7f1e5993d640 1 --2- 172.21.15.1:0/1005420464 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e54103140 0x7f1e5419b2e0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:05.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.759+0000 7f1e5993d640 1 -- 172.21.15.1:0/1005420464 >> 172.21.15.1:0/1005420464 conn(0x7f1e54077c60 msgr2=0x7f1e54106440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:05.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.759+0000 7f1e5993d640 1 -- 172.21.15.1:0/1005420464 shutdown_connections 2024-09-21T01:00:05.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:05.759+0000 7f1e5993d640 1 -- 172.21.15.1:0/1005420464 wait complete. 2024-09-21T01:00:06.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:06 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:00:06.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:06 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:00:06.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:06 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:00:06.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:06 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:06.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:06 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:06.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:06 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:00:06.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:06 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:00:06.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:06 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:00:06.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:06 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:06.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:06 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:06.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:06 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:00:06.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:06 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:00:06.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:06 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:00:06.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:06 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:06.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:06 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:06.958 INFO:tasks.cephfs.filesystem:scrub status for tag:1bffed0d-34b1-4e8b-9cab-7501131ef79d - {'path': '/', 'tag': '1bffed0d-34b1-4e8b-9cab-7501131ef79d', 'options': 'recursive,force'} 2024-09-21T01:00:07.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:07 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:07.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:07 smithi001 ceph-mon[31211]: pgmap v445: 97 pgs: 97 active+clean; 376 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 8.2 MiB/s wr, 628 op/s 2024-09-21T01:00:07.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:07 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:00:07.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:07 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:07.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:07 smithi193 ceph-mon[34660]: pgmap v445: 97 pgs: 97 active+clean; 376 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 8.2 MiB/s wr, 628 op/s 2024-09-21T01:00:07.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:07 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:00:07.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:07 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:07.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:07 smithi042 ceph-mon[34481]: pgmap v445: 97 pgs: 97 active+clean; 376 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 8.2 MiB/s wr, 628 op/s 2024-09-21T01:00:07.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:07 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:00:08.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.447+0000 7fd448ed3640 1 -- 172.21.15.1:0/1059859879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd444103650 msgr2=0x7fd444103a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:08.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.447+0000 7fd448ed3640 1 --2- 172.21.15.1:0/1059859879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd444103650 0x7fd444103a60 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd438009900 tx=0x7fd43802a410 comp rx=0 tx=0).stop 2024-09-21T01:00:08.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.447+0000 7fd448ed3640 1 -- 172.21.15.1:0/1059859879 shutdown_connections 2024-09-21T01:00:08.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.447+0000 7fd448ed3640 1 --2- 172.21.15.1:0/1059859879 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd444103ff0 0x7fd44410a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:08.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.447+0000 7fd448ed3640 1 --2- 172.21.15.1:0/1059859879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd444103650 0x7fd444103a60 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:08.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.447+0000 7fd448ed3640 1 --2- 172.21.15.1:0/1059859879 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd4441025d0 0x7fd444102a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:08.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.447+0000 7fd448ed3640 1 -- 172.21.15.1:0/1059859879 >> 172.21.15.1:0/1059859879 conn(0x7fd4440fdf30 msgr2=0x7fd4441003c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:08.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.447+0000 7fd448ed3640 1 -- 172.21.15.1:0/1059859879 shutdown_connections 2024-09-21T01:00:08.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.447+0000 7fd448ed3640 1 -- 172.21.15.1:0/1059859879 wait complete. 2024-09-21T01:00:08.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.448+0000 7fd448ed3640 1 Processor -- start 2024-09-21T01:00:08.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.448+0000 7fd448ed3640 1 -- start start 2024-09-21T01:00:08.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.448+0000 7fd448ed3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4441025d0 0x7fd44419c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:08.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.448+0000 7fd448ed3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd444103650 0x7fd44419c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:08.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.448+0000 7fd448ed3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd444103ff0 0x7fd44419d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:08.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.448+0000 7fd448ed3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd44410e200 con 0x7fd4441025d0 2024-09-21T01:00:08.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.448+0000 7fd448ed3640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd44410e080 con 0x7fd444103ff0 2024-09-21T01:00:08.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.448+0000 7fd448ed3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd44410e380 con 0x7fd444103650 2024-09-21T01:00:08.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.448+0000 7fd44259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4441025d0 0x7fd44419c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:08.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.448+0000 7fd44259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4441025d0 0x7fd44419c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35270/0 (socket says 172.21.15.1:35270) 2024-09-21T01:00:08.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.448+0000 7fd44259c640 1 -- 172.21.15.1:0/1712254661 learned_addr learned my addr 172.21.15.1:0/1712254661 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:08.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.448+0000 7fd442d9d640 1 --2- 172.21.15.1:0/1712254661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd444103ff0 0x7fd44419d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:08.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.449+0000 7fd44259c640 1 -- 172.21.15.1:0/1712254661 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd444103650 msgr2=0x7fd44419c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:08.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.449+0000 7fd44259c640 1 --2- 172.21.15.1:0/1712254661 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd444103650 0x7fd44419c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:08.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.449+0000 7fd44259c640 1 -- 172.21.15.1:0/1712254661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd444103ff0 msgr2=0x7fd44419d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:08.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.449+0000 7fd44259c640 1 --2- 172.21.15.1:0/1712254661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd444103ff0 0x7fd44419d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:08.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.449+0000 7fd44259c640 1 -- 172.21.15.1:0/1712254661 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd44419dbe0 con 0x7fd4441025d0 2024-09-21T01:00:08.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.449+0000 7fd44259c640 1 --2- 172.21.15.1:0/1712254661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4441025d0 0x7fd44419c1a0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fd43400e9f0 tx=0x7fd43400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:08.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.449+0000 7fd4337fe640 1 -- 172.21.15.1:0/1712254661 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43400ccc0 con 0x7fd4441025d0 2024-09-21T01:00:08.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.449+0000 7fd448ed3640 1 -- 172.21.15.1:0/1712254661 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd44419ded0 con 0x7fd4441025d0 2024-09-21T01:00:08.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.449+0000 7fd4337fe640 1 -- 172.21.15.1:0/1712254661 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4340108e0 con 0x7fd4441025d0 2024-09-21T01:00:08.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.449+0000 7fd4337fe640 1 -- 172.21.15.1:0/1712254661 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd434018880 con 0x7fd4441025d0 2024-09-21T01:00:08.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.449+0000 7fd448ed3640 1 -- 172.21.15.1:0/1712254661 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4441a45c0 con 0x7fd4441025d0 2024-09-21T01:00:08.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.452+0000 7fd44fe44740 1 Processor -- start 2024-09-21T01:00:08.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.452+0000 7fd44fe44740 1 -- start start 2024-09-21T01:00:08.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.452+0000 7fd44fe44740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb93c0a1b0 0x55fb93fb1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:08.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.452+0000 7fd44fe44740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb93be12f0 0x55fb93fb24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:08.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.453+0000 7fd44fe44740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb93be94d0 0x55fb93fb3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:08.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.453+0000 7fd44fe44740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fb93f246f0 con 0x55fb93be94d0 2024-09-21T01:00:08.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.453+0000 7fd44fe44740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55fb93f13b20 con 0x55fb93be12f0 2024-09-21T01:00:08.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.453+0000 7fd44fe44740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55fb93f17930 con 0x55fb93c0a1b0 2024-09-21T01:00:08.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.453+0000 7fd4337fe640 1 -- 172.21.15.1:0/1712254661 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7fd434010430 con 0x7fd4441025d0 2024-09-21T01:00:08.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.453+0000 7fd441d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb93be94d0 0x55fb93fb3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:08.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.453+0000 7fd441d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb93be94d0 0x55fb93fb3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35284/0 (socket says 172.21.15.1:35284) 2024-09-21T01:00:08.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.453+0000 7fd441d9b640 1 -- 172.21.15.1:0/3846664884 learned_addr learned my addr 172.21.15.1:0/3846664884 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:08.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.453+0000 7fd442d9d640 1 --2- 172.21.15.1:0/3846664884 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb93c0a1b0 0x55fb93fb1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:08.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.453+0000 7fd44259c640 1 --2- 172.21.15.1:0/3846664884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb93be12f0 0x55fb93fb24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:08.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.453+0000 7fd441d9b640 1 -- 172.21.15.1:0/3846664884 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb93c0a1b0 msgr2=0x55fb93fb1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:08.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.453+0000 7fd441d9b640 1 --2- 172.21.15.1:0/3846664884 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb93c0a1b0 0x55fb93fb1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:08.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.453+0000 7fd441d9b640 1 -- 172.21.15.1:0/3846664884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb93be12f0 msgr2=0x55fb93fb24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:08.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.453+0000 7fd441d9b640 1 --2- 172.21.15.1:0/3846664884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb93be12f0 0x55fb93fb24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:08.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.453+0000 7fd441d9b640 1 -- 172.21.15.1:0/3846664884 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb93ed9530 con 0x55fb93be94d0 2024-09-21T01:00:08.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.453+0000 7fd442d9d640 1 --2- 172.21.15.1:0/3846664884 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb93c0a1b0 0x55fb93fb1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:08.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.453+0000 7fd441d9b640 1 --2- 172.21.15.1:0/3846664884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb93be94d0 0x55fb93fb3010 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fd438031500 tx=0x7fd438000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a88d8d7729a39 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:08.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.454+0000 7fd430ff9640 1 -- 172.21.15.1:0/3846664884 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43803e070 con 0x55fb93be94d0 2024-09-21T01:00:08.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.454+0000 7fd4337fe640 1 --2- 172.21.15.1:0/1712254661 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd42c0b6510 0x7fd42c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:08.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.454+0000 7fd430ff9640 1 -- 172.21.15.1:0/3846664884 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd438004050 con 0x55fb93be94d0 2024-09-21T01:00:08.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.454+0000 7fd430ff9640 1 -- 172.21.15.1:0/3846664884 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd438035040 con 0x55fb93be94d0 2024-09-21T01:00:08.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.454+0000 7fd442d9d640 1 --2- 172.21.15.1:0/1712254661 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd42c0b6510 0x7fd42c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:08.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.454+0000 7fd4337fe640 1 -- 172.21.15.1:0/1712254661 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fd4340e77f0 con 0x7fd4441025d0 2024-09-21T01:00:08.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.455+0000 7fd44fe44740 1 -- 172.21.15.1:0/3846664884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb93be94d0 msgr2=0x55fb93fb3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:08.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.455+0000 7fd442d9d640 1 --2- 172.21.15.1:0/1712254661 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd42c0b6510 0x7fd42c0b8a20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd43c005fd0 tx=0x7fd43c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:08.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.455+0000 7fd44fe44740 1 --2- 172.21.15.1:0/3846664884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb93be94d0 0x55fb93fb3010 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fd438031500 tx=0x7fd438000bc0 comp rx=0 tx=0).stop 2024-09-21T01:00:08.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.455+0000 7fd44fe44740 1 -- 172.21.15.1:0/3846664884 shutdown_connections 2024-09-21T01:00:08.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.455+0000 7fd44fe44740 1 --2- 172.21.15.1:0/3846664884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb93be94d0 0x55fb93fb3010 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:08.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.455+0000 7fd44fe44740 1 --2- 172.21.15.1:0/3846664884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb93be12f0 0x55fb93fb24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:08.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.455+0000 7fd44fe44740 1 --2- 172.21.15.1:0/3846664884 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb93c0a1b0 0x55fb93fb1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:08.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.455+0000 7fd44fe44740 1 -- 172.21.15.1:0/3846664884 >> 172.21.15.1:0/3846664884 conn(0x55fb93bfe300 msgr2=0x55fb93fad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:08.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.455+0000 7fd44fe44740 1 -- 172.21.15.1:0/3846664884 shutdown_connections 2024-09-21T01:00:08.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.455+0000 7fd44fe44740 1 -- 172.21.15.1:0/3846664884 wait complete. 2024-09-21T01:00:08.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.455+0000 7fd44fe44740 1 -- start start 2024-09-21T01:00:08.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.455+0000 7fd44fe44740 1 Processor -- start 2024-09-21T01:00:08.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.456+0000 7fd44fe44740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb93be12f0 0x55fb93fbb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:08.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.456+0000 7fd44fe44740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb93be94d0 0x55fb93fbbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:08.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.456+0000 7fd44fe44740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb93c0a1b0 0x55fb93fbc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:08.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.456+0000 7fd44fe44740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fb93e4bab0 con 0x55fb93c0a1b0 2024-09-21T01:00:08.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.456+0000 7fd44fe44740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55fb93eb9730 con 0x55fb93be12f0 2024-09-21T01:00:08.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.456+0000 7fd44fe44740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55fb93fb3ad0 con 0x55fb93be94d0 2024-09-21T01:00:08.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.456+0000 7fd44fe44740 10 client.0 _ll_register_callbacks cb 0x55fb93f0d6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:08.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.456+0000 7fd442d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb93c0a1b0 0x55fb93fbc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:08.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.456+0000 7fd442d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb93c0a1b0 0x55fb93fbc740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35286/0 (socket says 172.21.15.1:35286) 2024-09-21T01:00:08.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.456+0000 7fd442d9d640 1 -- 172.21.15.1:0/13523871 learned_addr learned my addr 172.21.15.1:0/13523871 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:08.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.456+0000 7fd44259c640 1 --2- 172.21.15.1:0/13523871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb93be12f0 0x55fb93fbb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:08.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.456+0000 7fd441d9b640 1 --2- 172.21.15.1:0/13523871 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb93be94d0 0x55fb93fbbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:08.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.456+0000 7fd442d9d640 1 -- 172.21.15.1:0/13523871 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb93be94d0 msgr2=0x55fb93fbbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:08.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.456+0000 7fd442d9d640 1 --2- 172.21.15.1:0/13523871 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb93be94d0 0x55fb93fbbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:08.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.456+0000 7fd442d9d640 1 -- 172.21.15.1:0/13523871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb93be12f0 msgr2=0x55fb93fbb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:08.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.456+0000 7fd442d9d640 1 --2- 172.21.15.1:0/13523871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb93be12f0 0x55fb93fbb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:08.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.456+0000 7fd442d9d640 1 -- 172.21.15.1:0/13523871 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb93c75790 con 0x55fb93c0a1b0 2024-09-21T01:00:08.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.456+0000 7fd44259c640 1 --2- 172.21.15.1:0/13523871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb93be12f0 0x55fb93fbb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:08.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.456+0000 7fd442d9d640 1 --2- 172.21.15.1:0/13523871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb93c0a1b0 0x55fb93fbc740 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd43c00f6c0 tx=0x7fd43c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a86279b590c1c8e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:08.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.456+0000 7fd429ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:00:08.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.457+0000 7fd429ffb640 1 -- 172.21.15.1:0/13523871 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43c003b80 con 0x55fb93c0a1b0 2024-09-21T01:00:08.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.457+0000 7fd429ffb640 1 -- 172.21.15.1:0/13523871 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fd43c003d20 con 0x55fb93c0a1b0 2024-09-21T01:00:08.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.457+0000 7fd44fe44740 1 -- 172.21.15.1:0/13523871 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd438004050 con 0x55fb93c0a1b0 2024-09-21T01:00:08.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.457+0000 7fd429ffb640 1 -- 172.21.15.1:0/13523871 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd43c004050 con 0x55fb93c0a1b0 2024-09-21T01:00:08.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.457+0000 7fd44fe44740 10 client.16401 fetch_fsmap learned FSMap version 32 2024-09-21T01:00:08.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.457+0000 7fd44fe44740 1 -- 172.21.15.1:0/13523871 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55fb93cee620 con 0x55fb93c0a1b0 2024-09-21T01:00:08.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.457+0000 7fd429ffb640 1 -- 172.21.15.1:0/13523871 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd438004050 con 0x55fb93c0a1b0 2024-09-21T01:00:08.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.457+0000 7fd429ffb640 1 -- 172.21.15.1:0/13523871 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 32) ==== 8382+0+0 (secure 0 0 0) 0x7fd43c027020 con 0x55fb93c0a1b0 2024-09-21T01:00:08.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.457+0000 7fd44fe44740 10 client.16401 fetch_fsmap finished waiting for FSMap version 32 2024-09-21T01:00:08.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.457+0000 7fd44fe44740 10 client.16401 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:00:08.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.457+0000 7fd44fe44740 20 client.16401 populate_metadata read hostname 'smithi001' 2024-09-21T01:00:08.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.457+0000 7fd44fe44740 1 --2- 172.21.15.1:0/13523871 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55fb93bc8d80 0x55fb93fc8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:08.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.457+0000 7fd44fe44740 4 client.16401 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:00:08.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.457+0000 7fd44fe44740 1 -- 172.21.15.1:0/13523871 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb93f26640 con 0x55fb93bc8d80 2024-09-21T01:00:08.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.457+0000 7fd44259c640 1 --2- 172.21.15.1:0/13523871 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55fb93bc8d80 0x55fb93fc8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:08.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.458+0000 7fd429ffb640 10 client.16401 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:08.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.458+0000 7fd44259c640 1 --2- 172.21.15.1:0/13523871 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55fb93bc8d80 0x55fb93fc8e30 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d779982102024a0d server_cookie=aeee5180049acfa0 in_seq=0 out_seq=0 2024-09-21T01:00:08.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.460+0000 7fd429ffb640 1 -- 172.21.15.1:0/13523871 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fb93f26640 con 0x55fb93bc8d80 2024-09-21T01:00:08.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.460+0000 7fd429ffb640 10 client.16401 handle_command_reply: tid=0 2024-09-21T01:00:08.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.460+0000 7fd44fe44740 1 client.16401 shutdown 2024-09-21T01:00:08.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.460+0000 7fd44fe44740 1 -- 172.21.15.1:0/13523871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb93c0a1b0 msgr2=0x55fb93fbc740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:08.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.460+0000 7fd44fe44740 1 --2- 172.21.15.1:0/13523871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb93c0a1b0 0x55fb93fbc740 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd43c00f6c0 tx=0x7fd43c004ab0 comp rx=0 tx=0).stop 2024-09-21T01:00:08.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.460+0000 7fd44fe44740 1 -- 172.21.15.1:0/13523871 shutdown_connections 2024-09-21T01:00:08.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.460+0000 7fd44fe44740 1 --2- 172.21.15.1:0/13523871 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55fb93bc8d80 0x55fb93fc8e30 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:08.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.460+0000 7fd44fe44740 1 --2- 172.21.15.1:0/13523871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb93c0a1b0 0x55fb93fbc740 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:08.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.460+0000 7fd44fe44740 1 --2- 172.21.15.1:0/13523871 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb93be94d0 0x55fb93fbbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:08.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.460+0000 7fd429ffb640 0 client.16401 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:08.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.460+0000 7fd44fe44740 1 --2- 172.21.15.1:0/13523871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb93be12f0 0x55fb93fbb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:08.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.460+0000 7fd44fe44740 1 -- 172.21.15.1:0/13523871 >> 172.21.15.1:0/13523871 conn(0x55fb93bfe300 msgr2=0x55fb93fabea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:08.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.460+0000 7fd44fe44740 1 -- 172.21.15.1:0/13523871 shutdown_connections 2024-09-21T01:00:08.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.460+0000 7fd44fe44740 1 -- 172.21.15.1:0/13523871 wait complete. 2024-09-21T01:00:08.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.460+0000 7fd44fe44740 20 client.16401 trim_cache size 0 max 16384 2024-09-21T01:00:08.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.476+0000 7fd44fe44740 1 Processor -- start 2024-09-21T01:00:08.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.476+0000 7fd44fe44740 1 -- start start 2024-09-21T01:00:08.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.476+0000 7fd44fe44740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb93be12f0 0x55fb93fb1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:08.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.477+0000 7fd44fe44740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb93be94d0 0x55fb93fb2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:08.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.477+0000 7fd44fe44740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb93c0a1b0 0x55fb93fb5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:08.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.477+0000 7fd44fe44740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd4441ad2f0 con 0x55fb93be94d0 2024-09-21T01:00:08.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.477+0000 7fd44fe44740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd4441aef20 con 0x55fb93c0a1b0 2024-09-21T01:00:08.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.477+0000 7fd44fe44740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd4441ad9c0 con 0x55fb93be12f0 2024-09-21T01:00:08.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.477+0000 7fd441d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb93be94d0 0x55fb93fb2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:08.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.477+0000 7fd441d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb93be94d0 0x55fb93fb2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35298/0 (socket says 172.21.15.1:35298) 2024-09-21T01:00:08.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.477+0000 7fd441d9b640 1 -- 172.21.15.1:0/2847143612 learned_addr learned my addr 172.21.15.1:0/2847143612 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:08.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.477+0000 7fd442d9d640 1 --2- 172.21.15.1:0/2847143612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb93c0a1b0 0x55fb93fb5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:08.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.477+0000 7fd44259c640 1 --2- 172.21.15.1:0/2847143612 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb93be12f0 0x55fb93fb1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:08.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.477+0000 7fd441d9b640 1 -- 172.21.15.1:0/2847143612 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb93be12f0 msgr2=0x55fb93fb1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:08.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.477+0000 7fd441d9b640 1 --2- 172.21.15.1:0/2847143612 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb93be12f0 0x55fb93fb1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:08.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.477+0000 7fd441d9b640 1 -- 172.21.15.1:0/2847143612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb93c0a1b0 msgr2=0x55fb93fb5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:08.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.477+0000 7fd441d9b640 1 --2- 172.21.15.1:0/2847143612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb93c0a1b0 0x55fb93fb5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:08.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.477+0000 7fd441d9b640 1 -- 172.21.15.1:0/2847143612 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb93fc39e0 con 0x55fb93be94d0 2024-09-21T01:00:08.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.477+0000 7fd441d9b640 1 --2- 172.21.15.1:0/2847143612 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb93be94d0 0x55fb93fb2330 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd438005f70 tx=0x7fd438009230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7fe48684ea98e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:08.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.477+0000 7fd42bfff640 1 -- 172.21.15.1:0/2847143612 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd438035040 con 0x55fb93be94d0 2024-09-21T01:00:08.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.477+0000 7fd42bfff640 1 -- 172.21.15.1:0/2847143612 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4380318a0 con 0x55fb93be94d0 2024-09-21T01:00:08.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.478+0000 7fd42bfff640 1 -- 172.21.15.1:0/2847143612 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43803e040 con 0x55fb93be94d0 2024-09-21T01:00:08.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.478+0000 7fd44fe44740 1 -- 172.21.15.1:0/2847143612 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb93be94d0 msgr2=0x55fb93fb2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:08.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.478+0000 7fd44fe44740 1 --2- 172.21.15.1:0/2847143612 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb93be94d0 0x55fb93fb2330 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd438005f70 tx=0x7fd438009230 comp rx=0 tx=0).stop 2024-09-21T01:00:08.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.478+0000 7fd44fe44740 1 -- 172.21.15.1:0/2847143612 shutdown_connections 2024-09-21T01:00:08.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.478+0000 7fd44fe44740 1 --2- 172.21.15.1:0/2847143612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb93c0a1b0 0x55fb93fb5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:08.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.478+0000 7fd44fe44740 1 --2- 172.21.15.1:0/2847143612 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb93be94d0 0x55fb93fb2330 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:08.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.478+0000 7fd44fe44740 1 --2- 172.21.15.1:0/2847143612 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb93be12f0 0x55fb93fb1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:08.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.478+0000 7fd44fe44740 1 -- 172.21.15.1:0/2847143612 >> 172.21.15.1:0/2847143612 conn(0x55fb93bfe300 msgr2=0x55fb93fba710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:08.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.478+0000 7fd44fe44740 1 -- 172.21.15.1:0/2847143612 shutdown_connections 2024-09-21T01:00:08.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.478+0000 7fd44fe44740 1 -- 172.21.15.1:0/2847143612 wait complete. 2024-09-21T01:00:08.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.479+0000 7fd44fe44740 1 -- start start 2024-09-21T01:00:08.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.479+0000 7fd44fe44740 1 Processor -- start 2024-09-21T01:00:08.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.479+0000 7fd44fe44740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb93be12f0 0x55fb93fc2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:08.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.479+0000 7fd44fe44740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb93be94d0 0x55fb93fc33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:08.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.479+0000 7fd44fe44740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb93c0a1b0 0x55fb93fc1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:08.491 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.479+0000 7fd44fe44740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd4441ae820 con 0x55fb93be12f0 2024-09-21T01:00:08.491 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.479+0000 7fd44fe44740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd4441ae150 con 0x55fb93be94d0 2024-09-21T01:00:08.491 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.479+0000 7fd44fe44740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd4441ab2d0 con 0x55fb93c0a1b0 2024-09-21T01:00:08.491 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.479+0000 7fd44fe44740 10 client.0 _ll_register_callbacks cb 0x7fd43c009bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:08.491 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.479+0000 7fd44259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb93be12f0 0x55fb93fc2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:08.491 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.479+0000 7fd44259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb93be12f0 0x55fb93fc2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35302/0 (socket says 172.21.15.1:35302) 2024-09-21T01:00:08.492 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.479+0000 7fd44259c640 1 -- 172.21.15.1:0/1556361822 learned_addr learned my addr 172.21.15.1:0/1556361822 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:08.492 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.479+0000 7fd441d9b640 1 --2- 172.21.15.1:0/1556361822 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb93be94d0 0x55fb93fc33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:08.492 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.479+0000 7fd442d9d640 1 --2- 172.21.15.1:0/1556361822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb93c0a1b0 0x55fb93fc1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:08.492 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.479+0000 7fd44259c640 1 -- 172.21.15.1:0/1556361822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb93c0a1b0 msgr2=0x55fb93fc1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:08.492 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.479+0000 7fd44259c640 1 --2- 172.21.15.1:0/1556361822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb93c0a1b0 0x55fb93fc1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:08.492 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.479+0000 7fd44259c640 1 -- 172.21.15.1:0/1556361822 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb93be94d0 msgr2=0x55fb93fc33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:08.492 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.480+0000 7fd44259c640 1 --2- 172.21.15.1:0/1556361822 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb93be94d0 0x55fb93fc33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:08.493 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.480+0000 7fd44259c640 1 -- 172.21.15.1:0/1556361822 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb93fc2280 con 0x55fb93be12f0 2024-09-21T01:00:08.493 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.480+0000 7fd44259c640 1 --2- 172.21.15.1:0/1556361822 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb93be12f0 0x55fb93fc2d20 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd43401e000 tx=0x7fd434009760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a32de915a99898e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:08.493 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.480+0000 7fd429ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:00:08.493 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.480+0000 7fd429ffb640 1 -- 172.21.15.1:0/1556361822 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4340a90d0 con 0x55fb93be12f0 2024-09-21T01:00:08.493 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.480+0000 7fd429ffb640 1 -- 172.21.15.1:0/1556361822 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fd4340a92b0 con 0x55fb93be12f0 2024-09-21T01:00:08.493 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.480+0000 7fd44fe44740 1 -- 172.21.15.1:0/1556361822 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4380318a0 con 0x55fb93be12f0 2024-09-21T01:00:08.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.480+0000 7fd429ffb640 1 -- 172.21.15.1:0/1556361822 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd434010720 con 0x55fb93be12f0 2024-09-21T01:00:08.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.480+0000 7fd44fe44740 10 client.16407 fetch_fsmap learned FSMap version 32 2024-09-21T01:00:08.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.480+0000 7fd44fe44740 1 -- 172.21.15.1:0/1556361822 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55fb93fc1180 con 0x55fb93be12f0 2024-09-21T01:00:08.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.480+0000 7fd429ffb640 1 -- 172.21.15.1:0/1556361822 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4380318a0 con 0x55fb93be12f0 2024-09-21T01:00:08.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.480+0000 7fd429ffb640 1 -- 172.21.15.1:0/1556361822 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 32) ==== 8382+0+0 (secure 0 0 0) 0x7fd4340a94b0 con 0x55fb93be12f0 2024-09-21T01:00:08.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.480+0000 7fd44fe44740 10 client.16407 fetch_fsmap finished waiting for FSMap version 32 2024-09-21T01:00:08.495 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.480+0000 7fd44fe44740 10 client.16407 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:00:08.495 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.480+0000 7fd44fe44740 20 client.16407 populate_metadata read hostname 'smithi001' 2024-09-21T01:00:08.495 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.481+0000 7fd44fe44740 1 --2- 172.21.15.1:0/1556361822 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55fb93b9e1c0 0x55fb94035d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:08.495 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.481+0000 7fd44fe44740 4 client.16407 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:00:08.495 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.481+0000 7fd44fe44740 1 -- 172.21.15.1:0/1556361822 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fb93fb3420 con 0x55fb93b9e1c0 2024-09-21T01:00:08.495 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.481+0000 7fd441d9b640 1 --2- 172.21.15.1:0/1556361822 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55fb93b9e1c0 0x55fb94035d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:08.495 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.481+0000 7fd441d9b640 1 --2- 172.21.15.1:0/1556361822 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55fb93b9e1c0 0x55fb94035d90 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9346f0bddfb53389 server_cookie=f0518af231afc898 in_seq=0 out_seq=0 2024-09-21T01:00:08.496 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.481+0000 7fd429ffb640 10 client.16407 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:08.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.639+0000 7fd429ffb640 1 -- 172.21.15.1:0/1556361822 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fb93fb3420 con 0x55fb93b9e1c0 2024-09-21T01:00:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.639+0000 7fd429ffb640 10 client.16407 handle_command_reply: tid=0 2024-09-21T01:00:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.639+0000 7fd44fe44740 1 client.16407 shutdown 2024-09-21T01:00:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.639+0000 7fd44fe44740 1 -- 172.21.15.1:0/1556361822 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb93be12f0 msgr2=0x55fb93fc2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.639+0000 7fd44fe44740 1 --2- 172.21.15.1:0/1556361822 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb93be12f0 0x55fb93fc2d20 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd43401e000 tx=0x7fd434009760 comp rx=0 tx=0).stop 2024-09-21T01:00:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.639+0000 7fd44fe44740 1 -- 172.21.15.1:0/1556361822 shutdown_connections 2024-09-21T01:00:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.639+0000 7fd44fe44740 1 --2- 172.21.15.1:0/1556361822 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55fb93b9e1c0 0x55fb94035d90 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.639+0000 7fd44fe44740 1 --2- 172.21.15.1:0/1556361822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb93c0a1b0 0x55fb93fc1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.639+0000 7fd429ffb640 0 client.16407 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.639+0000 7fd44fe44740 1 --2- 172.21.15.1:0/1556361822 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb93be94d0 0x55fb93fc33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.639+0000 7fd44fe44740 1 --2- 172.21.15.1:0/1556361822 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb93be12f0 0x55fb93fc2d20 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.639+0000 7fd44fe44740 1 -- 172.21.15.1:0/1556361822 >> 172.21.15.1:0/1556361822 conn(0x55fb93bfe300 msgr2=0x55fb93fba710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.640+0000 7fd44fe44740 1 -- 172.21.15.1:0/1556361822 shutdown_connections 2024-09-21T01:00:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.640+0000 7fd44fe44740 1 -- 172.21.15.1:0/1556361822 wait complete. 2024-09-21T01:00:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.640+0000 7fd44fe44740 20 client.16407 trim_cache size 0 max 16384 2024-09-21T01:00:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T01:00:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T01:00:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T01:00:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T01:00:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.640+0000 7fd448ed3640 1 -- 172.21.15.1:0/1712254661 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd42c0b6510 msgr2=0x7fd42c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.640+0000 7fd448ed3640 1 --2- 172.21.15.1:0/1712254661 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd42c0b6510 0x7fd42c0b8a20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd43c005fd0 tx=0x7fd43c009500 comp rx=0 tx=0).stop 2024-09-21T01:00:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.640+0000 7fd448ed3640 1 -- 172.21.15.1:0/1712254661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4441025d0 msgr2=0x7fd44419c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.640+0000 7fd448ed3640 1 --2- 172.21.15.1:0/1712254661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4441025d0 0x7fd44419c1a0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fd43400e9f0 tx=0x7fd43400edf0 comp rx=0 tx=0).stop 2024-09-21T01:00:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.640+0000 7fd448ed3640 1 -- 172.21.15.1:0/1712254661 shutdown_connections 2024-09-21T01:00:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.640+0000 7fd448ed3640 1 --2- 172.21.15.1:0/1712254661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd444103ff0 0x7fd44419d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.640+0000 7fd448ed3640 1 --2- 172.21.15.1:0/1712254661 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd444103650 0x7fd44419c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.640+0000 7fd448ed3640 1 --2- 172.21.15.1:0/1712254661 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd42c0b6510 0x7fd42c0b8a20 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.640+0000 7fd448ed3640 1 --2- 172.21.15.1:0/1712254661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4441025d0 0x7fd44419c1a0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:08.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.640+0000 7fd448ed3640 1 -- 172.21.15.1:0/1712254661 >> 172.21.15.1:0/1712254661 conn(0x7fd4440fdf30 msgr2=0x7fd4440ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:08.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.640+0000 7fd448ed3640 1 -- 172.21.15.1:0/1712254661 shutdown_connections 2024-09-21T01:00:08.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:08.640+0000 7fd448ed3640 1 -- 172.21.15.1:0/1712254661 wait complete. 2024-09-21T01:00:08.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:08 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:00:08.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:08 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:00:08.712 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:08 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:08.712 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:08 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:08.712 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:08 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:08.712 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:08 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:00:08.712 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:08 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:08.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:08 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:00:08.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:08 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:00:08.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:08 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:08.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:08 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:08.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:08 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:08.731 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:08 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:00:08.731 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:08 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:08.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:08 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:00:08.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:08 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:00:08.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:08 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:08.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:08 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:08.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:08 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:08.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:08 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:00:08.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:08 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:09.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:09 smithi001 ceph-mon[31211]: pgmap v446: 97 pgs: 97 active+clean; 395 MiB data, 954 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.9 MiB/s wr, 677 op/s 2024-09-21T01:00:09.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:09 smithi001 ceph-mon[31211]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:00:09.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:09 smithi193 ceph-mon[34660]: pgmap v446: 97 pgs: 97 active+clean; 395 MiB data, 954 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.9 MiB/s wr, 677 op/s 2024-09-21T01:00:09.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:09 smithi193 ceph-mon[34660]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:00:09.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:09 smithi042 ceph-mon[34481]: pgmap v446: 97 pgs: 97 active+clean; 395 MiB data, 954 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.9 MiB/s wr, 677 op/s 2024-09-21T01:00:09.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:09 smithi042 ceph-mon[34481]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:00:11.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:11 smithi001 ceph-mon[31211]: pgmap v447: 97 pgs: 97 active+clean; 402 MiB data, 964 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 10 MiB/s wr, 789 op/s 2024-09-21T01:00:11.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:11 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:00:11.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:11 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:00:11.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:11 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:00:11.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:11 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T01:00:11.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:11 smithi193 ceph-mon[34660]: pgmap v447: 97 pgs: 97 active+clean; 402 MiB data, 964 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 10 MiB/s wr, 789 op/s 2024-09-21T01:00:11.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:11 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:00:11.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:11 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:00:11.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:11 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:00:11.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:11 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T01:00:11.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:11 smithi042 ceph-mon[34481]: pgmap v447: 97 pgs: 97 active+clean; 402 MiB data, 964 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 10 MiB/s wr, 789 op/s 2024-09-21T01:00:11.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:00:11.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:00:11.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:00:11.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T01:00:13.559 INFO:tasks.workunit.client.0.smithi001.stdout: 75 274761 2 171611 2 151714 4 2024-09-21T01:00:13.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:13 smithi001 ceph-mon[31211]: pgmap v448: 97 pgs: 97 active+clean; 401 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 11 MiB/s wr, 957 op/s 2024-09-21T01:00:13.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:13 smithi193 ceph-mon[34660]: pgmap v448: 97 pgs: 97 active+clean; 401 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 11 MiB/s wr, 957 op/s 2024-09-21T01:00:13.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:13 smithi042 ceph-mon[34481]: pgmap v448: 97 pgs: 97 active+clean; 401 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 11 MiB/s wr, 957 op/s 2024-09-21T01:00:15.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:15 smithi001 ceph-mon[31211]: pgmap v449: 97 pgs: 97 active+clean; 398 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 10 MiB/s wr, 1.00k op/s 2024-09-21T01:00:15.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:15 smithi193 ceph-mon[34660]: pgmap v449: 97 pgs: 97 active+clean; 398 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 10 MiB/s wr, 1.00k op/s 2024-09-21T01:00:15.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:15 smithi042 ceph-mon[34481]: pgmap v449: 97 pgs: 97 active+clean; 398 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 10 MiB/s wr, 1.00k op/s 2024-09-21T01:00:17.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:17 smithi001 ceph-mon[31211]: pgmap v450: 97 pgs: 97 active+clean; 398 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.3 MiB/s wr, 812 op/s 2024-09-21T01:00:17.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:17 smithi193 ceph-mon[34660]: pgmap v450: 97 pgs: 97 active+clean; 398 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.3 MiB/s wr, 812 op/s 2024-09-21T01:00:17.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:17 smithi042 ceph-mon[34481]: pgmap v450: 97 pgs: 97 active+clean; 398 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.3 MiB/s wr, 812 op/s 2024-09-21T01:00:18.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:18 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:18.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:18 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:18.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:18 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:19.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:19 smithi001 ceph-mon[31211]: pgmap v451: 97 pgs: 97 active+clean; 398 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 500 op/s 2024-09-21T01:00:19.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:19 smithi193 ceph-mon[34660]: pgmap v451: 97 pgs: 97 active+clean; 398 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 500 op/s 2024-09-21T01:00:19.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:19 smithi042 ceph-mon[34481]: pgmap v451: 97 pgs: 97 active+clean; 398 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 500 op/s 2024-09-21T01:00:21.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:21 smithi001 ceph-mon[31211]: pgmap v452: 97 pgs: 97 active+clean; 404 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 439 op/s 2024-09-21T01:00:21.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:21 smithi193 ceph-mon[34660]: pgmap v452: 97 pgs: 97 active+clean; 404 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 439 op/s 2024-09-21T01:00:21.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:21 smithi042 ceph-mon[34481]: pgmap v452: 97 pgs: 97 active+clean; 404 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 439 op/s 2024-09-21T01:00:21.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.743+0000 7fed54ade640 1 -- 172.21.15.1:0/2376743115 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed50103fe0 msgr2=0x7fed5010a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:21.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.743+0000 7fed54ade640 1 --2- 172.21.15.1:0/2376743115 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed50103fe0 0x7fed5010a980 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fed48009ca0 tx=0x7fed4802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:00:21.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.743+0000 7fed54ade640 1 -- 172.21.15.1:0/2376743115 shutdown_connections 2024-09-21T01:00:21.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.743+0000 7fed54ade640 1 --2- 172.21.15.1:0/2376743115 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed50103fe0 0x7fed5010a980 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:21.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.743+0000 7fed54ade640 1 --2- 172.21.15.1:0/2376743115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed50103640 0x7fed50103a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:21.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.743+0000 7fed54ade640 1 --2- 172.21.15.1:0/2376743115 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed501025c0 0x7fed50102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:21.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.743+0000 7fed54ade640 1 -- 172.21.15.1:0/2376743115 >> 172.21.15.1:0/2376743115 conn(0x7fed500fdf00 msgr2=0x7fed501003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:21.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.743+0000 7fed54ade640 1 -- 172.21.15.1:0/2376743115 shutdown_connections 2024-09-21T01:00:21.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.743+0000 7fed54ade640 1 -- 172.21.15.1:0/2376743115 wait complete. 2024-09-21T01:00:21.746 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.744+0000 7fed54ade640 1 Processor -- start 2024-09-21T01:00:21.746 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.744+0000 7fed54ade640 1 -- start start 2024-09-21T01:00:21.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.744+0000 7fed54ade640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed501025c0 0x7fed5006c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:21.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.745+0000 7fed54ade640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed50103640 0x7fed5019ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:21.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.745+0000 7fed54ade640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed50103fe0 0x7fed501a11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:21.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.745+0000 7fed54ade640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fed5010e210 con 0x7fed50103fe0 2024-09-21T01:00:21.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.745+0000 7fed54ade640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fed5010e090 con 0x7fed50103640 2024-09-21T01:00:21.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.745+0000 7fed54ade640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fed5010e390 con 0x7fed501025c0 2024-09-21T01:00:21.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.745+0000 7fed47fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed50103640 0x7fed5019ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:21.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.745+0000 7fed4ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed50103fe0 0x7fed501a11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:21.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.745+0000 7fed47fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed50103640 0x7fed5019ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:45728/0 (socket says 172.21.15.1:45728) 2024-09-21T01:00:21.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.745+0000 7fed47fff640 1 -- 172.21.15.1:0/2350886336 learned_addr learned my addr 172.21.15.1:0/2350886336 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:21.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.745+0000 7fed4e59c640 1 --2- 172.21.15.1:0/2350886336 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed501025c0 0x7fed5006c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:21.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.745+0000 7fed47fff640 1 -- 172.21.15.1:0/2350886336 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed501025c0 msgr2=0x7fed5006c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:21.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.745+0000 7fed47fff640 1 --2- 172.21.15.1:0/2350886336 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed501025c0 0x7fed5006c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:21.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.745+0000 7fed47fff640 1 -- 172.21.15.1:0/2350886336 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed50103fe0 msgr2=0x7fed501a11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:21.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.745+0000 7fed47fff640 1 --2- 172.21.15.1:0/2350886336 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed50103fe0 0x7fed501a11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:21.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.745+0000 7fed47fff640 1 -- 172.21.15.1:0/2350886336 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed501a19a0 con 0x7fed50103640 2024-09-21T01:00:21.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.745+0000 7fed4e59c640 1 --2- 172.21.15.1:0/2350886336 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed501025c0 0x7fed5006c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:00:21.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.745+0000 7fed47fff640 1 --2- 172.21.15.1:0/2350886336 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed50103640 0x7fed5019ec50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fed3800e9f0 tx=0x7fed3800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:21.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.745+0000 7fed477fe640 1 -- 172.21.15.1:0/2350886336 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3800cd80 con 0x7fed50103640 2024-09-21T01:00:21.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.746+0000 7fed54ade640 1 -- 172.21.15.1:0/2350886336 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed501a1c90 con 0x7fed50103640 2024-09-21T01:00:21.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.746+0000 7fed477fe640 1 -- 172.21.15.1:0/2350886336 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed380108e0 con 0x7fed50103640 2024-09-21T01:00:21.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.746+0000 7fed477fe640 1 -- 172.21.15.1:0/2350886336 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed38018980 con 0x7fed50103640 2024-09-21T01:00:21.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.746+0000 7fed54ade640 1 -- 172.21.15.1:0/2350886336 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed501a2180 con 0x7fed50103640 2024-09-21T01:00:21.750 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.748+0000 7fed5ba50740 1 Processor -- start 2024-09-21T01:00:21.750 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.748+0000 7fed5ba50740 1 -- start start 2024-09-21T01:00:21.750 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.748+0000 7fed477fe640 1 -- 172.21.15.1:0/2350886336 <== mon.2 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7fed38010430 con 0x7fed50103640 2024-09-21T01:00:21.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.748+0000 7fed5ba50740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569b90fe1b0 0x5569b94a5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:21.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.748+0000 7fed5ba50740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569b90d52f0 0x5569b94a64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:21.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.748+0000 7fed5ba50740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5569b90dd4d0 0x5569b94a7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:21.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.748+0000 7fed5ba50740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5569b94186f0 con 0x5569b90fe1b0 2024-09-21T01:00:21.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.748+0000 7fed5ba50740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5569b9407b20 con 0x5569b90dd4d0 2024-09-21T01:00:21.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.748+0000 7fed5ba50740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5569b940b930 con 0x5569b90d52f0 2024-09-21T01:00:21.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.749+0000 7fed4ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569b90fe1b0 0x5569b94a5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:21.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.749+0000 7fed4ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569b90fe1b0 0x5569b94a5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37412/0 (socket says 172.21.15.1:37412) 2024-09-21T01:00:21.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.749+0000 7fed4ed9d640 1 -- 172.21.15.1:0/2364893681 learned_addr learned my addr 172.21.15.1:0/2364893681 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:21.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.749+0000 7fed47fff640 1 --2- 172.21.15.1:0/2364893681 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5569b90dd4d0 0x5569b94a7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:21.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.749+0000 7fed4e59c640 1 --2- 172.21.15.1:0/2364893681 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569b90d52f0 0x5569b94a64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:21.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.749+0000 7fed4ed9d640 1 -- 172.21.15.1:0/2364893681 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569b90d52f0 msgr2=0x5569b94a64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:21.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.749+0000 7fed4ed9d640 1 --2- 172.21.15.1:0/2364893681 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569b90d52f0 0x5569b94a64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:21.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.749+0000 7fed4ed9d640 1 -- 172.21.15.1:0/2364893681 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5569b90dd4d0 msgr2=0x5569b94a7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:21.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.749+0000 7fed4ed9d640 1 --2- 172.21.15.1:0/2364893681 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5569b90dd4d0 0x5569b94a7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:21.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.749+0000 7fed4ed9d640 1 -- 172.21.15.1:0/2364893681 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569b93cd530 con 0x5569b90fe1b0 2024-09-21T01:00:21.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.749+0000 7fed4ed9d640 1 --2- 172.21.15.1:0/2364893681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569b90fe1b0 0x5569b94a5e50 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fed48035000 tx=0x7fed4802f410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11e814366f6e0f46 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:21.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.749+0000 7fed477fe640 1 --2- 172.21.15.1:0/2350886336 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fed3c0b6510 0x7fed3c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:21.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.749+0000 7fed44ff9640 1 -- 172.21.15.1:0/2364893681 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed48031650 con 0x5569b90fe1b0 2024-09-21T01:00:21.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.749+0000 7fed44ff9640 1 -- 172.21.15.1:0/2364893681 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed48036030 con 0x5569b90fe1b0 2024-09-21T01:00:21.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.749+0000 7fed44ff9640 1 -- 172.21.15.1:0/2364893681 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed48004790 con 0x5569b90fe1b0 2024-09-21T01:00:21.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.749+0000 7fed4e59c640 1 --2- 172.21.15.1:0/2350886336 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fed3c0b6510 0x7fed3c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:21.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.750+0000 7fed477fe640 1 -- 172.21.15.1:0/2350886336 <== mon.2 v2:172.21.15.42:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fed380e7700 con 0x7fed50103640 2024-09-21T01:00:21.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.750+0000 7fed5ba50740 1 -- 172.21.15.1:0/2364893681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569b90fe1b0 msgr2=0x5569b94a5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:21.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.750+0000 7fed4e59c640 1 --2- 172.21.15.1:0/2350886336 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fed3c0b6510 0x7fed3c0b8a20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fed40009d00 tx=0x7fed40005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:21.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.750+0000 7fed5ba50740 1 --2- 172.21.15.1:0/2364893681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569b90fe1b0 0x5569b94a5e50 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fed48035000 tx=0x7fed4802f410 comp rx=0 tx=0).stop 2024-09-21T01:00:21.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.750+0000 7fed5ba50740 1 -- 172.21.15.1:0/2364893681 shutdown_connections 2024-09-21T01:00:21.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.750+0000 7fed5ba50740 1 --2- 172.21.15.1:0/2364893681 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5569b90dd4d0 0x5569b94a7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:21.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.750+0000 7fed5ba50740 1 --2- 172.21.15.1:0/2364893681 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569b90d52f0 0x5569b94a64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:21.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.750+0000 7fed5ba50740 1 --2- 172.21.15.1:0/2364893681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569b90fe1b0 0x5569b94a5e50 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:21.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.750+0000 7fed5ba50740 1 -- 172.21.15.1:0/2364893681 >> 172.21.15.1:0/2364893681 conn(0x5569b90f2300 msgr2=0x5569b94a18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:21.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.751+0000 7fed5ba50740 1 -- 172.21.15.1:0/2364893681 shutdown_connections 2024-09-21T01:00:21.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.751+0000 7fed5ba50740 1 -- 172.21.15.1:0/2364893681 wait complete. 2024-09-21T01:00:21.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.751+0000 7fed5ba50740 1 -- start start 2024-09-21T01:00:21.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.751+0000 7fed5ba50740 1 Processor -- start 2024-09-21T01:00:21.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.751+0000 7fed5ba50740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569b90d52f0 0x5569b94af440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:21.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.751+0000 7fed5ba50740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569b90dd4d0 0x5569b94afb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:21.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.751+0000 7fed5ba50740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5569b90fe1b0 0x5569b94b0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:21.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.751+0000 7fed5ba50740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5569b933fab0 con 0x5569b90dd4d0 2024-09-21T01:00:21.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.751+0000 7fed5ba50740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5569b93ad730 con 0x5569b90fe1b0 2024-09-21T01:00:21.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.751+0000 7fed5ba50740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5569b94a7950 con 0x5569b90d52f0 2024-09-21T01:00:21.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.751+0000 7fed5ba50740 10 client.0 _ll_register_callbacks cb 0x5569b94016b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:21.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.751+0000 7fed47fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569b90dd4d0 0x5569b94afb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:21.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.751+0000 7fed4e59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569b90d52f0 0x5569b94af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:21.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.751+0000 7fed47fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569b90dd4d0 0x5569b94afb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37416/0 (socket says 172.21.15.1:37416) 2024-09-21T01:00:21.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.751+0000 7fed47fff640 1 -- 172.21.15.1:0/2599590421 learned_addr learned my addr 172.21.15.1:0/2599590421 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:21.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.751+0000 7fed4ed9d640 1 --2- 172.21.15.1:0/2599590421 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5569b90fe1b0 0x5569b94b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:21.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.752+0000 7fed4e59c640 1 -- 172.21.15.1:0/2599590421 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5569b90fe1b0 msgr2=0x5569b94b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:21.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.752+0000 7fed4e59c640 1 --2- 172.21.15.1:0/2599590421 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5569b90fe1b0 0x5569b94b0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:21.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.752+0000 7fed4e59c640 1 -- 172.21.15.1:0/2599590421 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569b90dd4d0 msgr2=0x5569b94afb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:21.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.752+0000 7fed4e59c640 1 --2- 172.21.15.1:0/2599590421 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569b90dd4d0 0x5569b94afb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:21.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.752+0000 7fed4e59c640 1 -- 172.21.15.1:0/2599590421 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569b9169790 con 0x5569b90d52f0 2024-09-21T01:00:21.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.752+0000 7fed47fff640 1 --2- 172.21.15.1:0/2599590421 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569b90dd4d0 0x5569b94afb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:21.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.752+0000 7fed4e59c640 1 --2- 172.21.15.1:0/2599590421 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569b90d52f0 0x5569b94af440 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fed40011a00 tx=0x7fed400046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f4408d89a336484 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:21.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.752+0000 7fed35ffb640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T01:00:21.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.752+0000 7fed35ffb640 1 -- 172.21.15.1:0/2599590421 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4001f790 con 0x5569b90d52f0 2024-09-21T01:00:21.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.752+0000 7fed5ba50740 1 -- 172.21.15.1:0/2599590421 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed48036030 con 0x5569b90d52f0 2024-09-21T01:00:21.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.752+0000 7fed35ffb640 1 -- 172.21.15.1:0/2599590421 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fed4001f930 con 0x5569b90d52f0 2024-09-21T01:00:21.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.752+0000 7fed35ffb640 1 -- 172.21.15.1:0/2599590421 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fed4001fb30 con 0x5569b90d52f0 2024-09-21T01:00:21.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.752+0000 7fed5ba50740 10 client.25993 fetch_fsmap learned FSMap version 32 2024-09-21T01:00:21.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.753+0000 7fed5ba50740 1 -- 172.21.15.1:0/2599590421 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5569b91e2620 con 0x5569b90d52f0 2024-09-21T01:00:21.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.753+0000 7fed35ffb640 1 -- 172.21.15.1:0/2599590421 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed48036030 con 0x5569b90d52f0 2024-09-21T01:00:21.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.753+0000 7fed35ffb640 1 -- 172.21.15.1:0/2599590421 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 32) ==== 8382+0+0 (secure 0 0 0) 0x7fed40032420 con 0x5569b90d52f0 2024-09-21T01:00:21.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.753+0000 7fed5ba50740 10 client.25993 fetch_fsmap finished waiting for FSMap version 32 2024-09-21T01:00:21.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.753+0000 7fed5ba50740 10 client.25993 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:00:21.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.753+0000 7fed5ba50740 20 client.25993 populate_metadata read hostname 'smithi001' 2024-09-21T01:00:21.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.753+0000 7fed5ba50740 1 --2- 172.21.15.1:0/2599590421 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5569b90bcd80 0x5569b94bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:21.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.753+0000 7fed5ba50740 4 client.25993 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:00:21.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.753+0000 7fed5ba50740 1 -- 172.21.15.1:0/2599590421 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569b941a640 con 0x5569b90bcd80 2024-09-21T01:00:21.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.753+0000 7fed47fff640 1 --2- 172.21.15.1:0/2599590421 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5569b90bcd80 0x5569b94bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:21.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.754+0000 7fed35ffb640 10 client.25993 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:21.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.754+0000 7fed47fff640 1 --2- 172.21.15.1:0/2599590421 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5569b90bcd80 0x5569b94bcc80 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fa23a8628da2dab server_cookie=2b27a7c2444f73a4 in_seq=0 out_seq=0 2024-09-21T01:00:21.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.755+0000 7fed35ffb640 1 -- 172.21.15.1:0/2599590421 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5569b941a640 con 0x5569b90bcd80 2024-09-21T01:00:21.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.755+0000 7fed35ffb640 10 client.25993 handle_command_reply: tid=0 2024-09-21T01:00:21.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.755+0000 7fed5ba50740 1 client.25993 shutdown 2024-09-21T01:00:21.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.755+0000 7fed5ba50740 1 -- 172.21.15.1:0/2599590421 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569b90d52f0 msgr2=0x5569b94af440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:21.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.755+0000 7fed5ba50740 1 --2- 172.21.15.1:0/2599590421 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569b90d52f0 0x5569b94af440 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fed40011a00 tx=0x7fed400046c0 comp rx=0 tx=0).stop 2024-09-21T01:00:21.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.755+0000 7fed5ba50740 1 -- 172.21.15.1:0/2599590421 shutdown_connections 2024-09-21T01:00:21.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.755+0000 7fed5ba50740 1 --2- 172.21.15.1:0/2599590421 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5569b90bcd80 0x5569b94bcc80 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:21.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.755+0000 7fed5ba50740 1 --2- 172.21.15.1:0/2599590421 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5569b90fe1b0 0x5569b94b0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:21.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.755+0000 7fed5ba50740 1 --2- 172.21.15.1:0/2599590421 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569b90dd4d0 0x5569b94afb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:21.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.755+0000 7fed5ba50740 1 --2- 172.21.15.1:0/2599590421 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569b90d52f0 0x5569b94af440 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:21.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.755+0000 7fed35ffb640 0 client.25993 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:21.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.755+0000 7fed5ba50740 1 -- 172.21.15.1:0/2599590421 >> 172.21.15.1:0/2599590421 conn(0x5569b90f2300 msgr2=0x5569b949fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:21.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.755+0000 7fed5ba50740 1 -- 172.21.15.1:0/2599590421 shutdown_connections 2024-09-21T01:00:21.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.755+0000 7fed5ba50740 1 -- 172.21.15.1:0/2599590421 wait complete. 2024-09-21T01:00:21.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.755+0000 7fed5ba50740 20 client.25993 trim_cache size 0 max 16384 2024-09-21T01:00:21.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.770+0000 7fed5ba50740 1 Processor -- start 2024-09-21T01:00:21.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.770+0000 7fed5ba50740 1 -- start start 2024-09-21T01:00:21.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.770+0000 7fed5ba50740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569b90d52f0 0x5569b94a1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.770+0000 7fed5ba50740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5569b90dd4d0 0x5569b94a5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.770+0000 7fed5ba50740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569b90fe1b0 0x5569b94a6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.770+0000 7fed5ba50740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fed501aaec0 con 0x5569b90d52f0 2024-09-21T01:00:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.770+0000 7fed5ba50740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fed501acaf0 con 0x5569b90dd4d0 2024-09-21T01:00:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.770+0000 7fed5ba50740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fed501ab590 con 0x5569b90fe1b0 2024-09-21T01:00:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.770+0000 7fed4e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569b90d52f0 0x5569b94a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.770+0000 7fed4e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569b90d52f0 0x5569b94a1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37430/0 (socket says 172.21.15.1:37430) 2024-09-21T01:00:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.770+0000 7fed4e59c640 1 -- 172.21.15.1:0/169165566 learned_addr learned my addr 172.21.15.1:0/169165566 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.770+0000 7fed47fff640 1 --2- 172.21.15.1:0/169165566 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5569b90dd4d0 0x5569b94a5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.770+0000 7fed4ed9d640 1 --2- 172.21.15.1:0/169165566 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569b90fe1b0 0x5569b94a6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.770+0000 7fed4e59c640 1 -- 172.21.15.1:0/169165566 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569b90fe1b0 msgr2=0x5569b94a6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.770+0000 7fed4e59c640 1 --2- 172.21.15.1:0/169165566 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569b90fe1b0 0x5569b94a6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.770+0000 7fed4e59c640 1 -- 172.21.15.1:0/169165566 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5569b90dd4d0 msgr2=0x5569b94a5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.770+0000 7fed4e59c640 1 --2- 172.21.15.1:0/169165566 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5569b90dd4d0 0x5569b94a5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.770+0000 7fed4e59c640 1 -- 172.21.15.1:0/169165566 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569b94b7910 con 0x5569b90d52f0 2024-09-21T01:00:21.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.770+0000 7fed4e59c640 1 --2- 172.21.15.1:0/169165566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569b90d52f0 0x5569b94a1220 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fed40005eb0 tx=0x7fed40013dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb489222c5cbe0f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:21.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.771+0000 7fed37fff640 1 -- 172.21.15.1:0/169165566 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed40032620 con 0x5569b90d52f0 2024-09-21T01:00:21.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.771+0000 7fed37fff640 1 -- 172.21.15.1:0/169165566 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed40032e50 con 0x5569b90d52f0 2024-09-21T01:00:21.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.771+0000 7fed37fff640 1 -- 172.21.15.1:0/169165566 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed400055b0 con 0x5569b90d52f0 2024-09-21T01:00:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.771+0000 7fed5ba50740 1 -- 172.21.15.1:0/169165566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569b90d52f0 msgr2=0x5569b94a1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.771+0000 7fed5ba50740 1 --2- 172.21.15.1:0/169165566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569b90d52f0 0x5569b94a1220 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fed40005eb0 tx=0x7fed40013dc0 comp rx=0 tx=0).stop 2024-09-21T01:00:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.771+0000 7fed5ba50740 1 -- 172.21.15.1:0/169165566 shutdown_connections 2024-09-21T01:00:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.771+0000 7fed5ba50740 1 --2- 172.21.15.1:0/169165566 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569b90fe1b0 0x5569b94a6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.771+0000 7fed5ba50740 1 --2- 172.21.15.1:0/169165566 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5569b90dd4d0 0x5569b94a5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.771+0000 7fed5ba50740 1 --2- 172.21.15.1:0/169165566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569b90d52f0 0x5569b94a1220 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.771+0000 7fed5ba50740 1 -- 172.21.15.1:0/169165566 >> 172.21.15.1:0/169165566 conn(0x5569b90f2300 msgr2=0x5569b949c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.771+0000 7fed5ba50740 1 -- 172.21.15.1:0/169165566 shutdown_connections 2024-09-21T01:00:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.771+0000 7fed5ba50740 1 -- 172.21.15.1:0/169165566 wait complete. 2024-09-21T01:00:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.772+0000 7fed5ba50740 1 -- start start 2024-09-21T01:00:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.772+0000 7fed5ba50740 1 Processor -- start 2024-09-21T01:00:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.772+0000 7fed5ba50740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569b90d52f0 0x5569b94b6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:21.777 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.772+0000 7fed5ba50740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5569b90dd4d0 0x5569b94b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:21.777 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.772+0000 7fed5ba50740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569b90fe1b0 0x5569b94b6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:21.777 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.772+0000 7fed5ba50740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fed501ac3f0 con 0x5569b90d52f0 2024-09-21T01:00:21.777 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.772+0000 7fed5ba50740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fed501abd20 con 0x5569b90dd4d0 2024-09-21T01:00:21.777 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.772+0000 7fed5ba50740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fed501a8ea0 con 0x5569b90fe1b0 2024-09-21T01:00:21.777 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.772+0000 7fed5ba50740 10 client.0 _ll_register_callbacks cb 0x7fed400099f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:21.777 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.772+0000 7fed4e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569b90d52f0 0x5569b94b6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:21.777 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.772+0000 7fed4e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569b90d52f0 0x5569b94b6e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37432/0 (socket says 172.21.15.1:37432) 2024-09-21T01:00:21.777 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.772+0000 7fed4e59c640 1 -- 172.21.15.1:0/384111751 learned_addr learned my addr 172.21.15.1:0/384111751 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:21.777 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.772+0000 7fed47fff640 1 --2- 172.21.15.1:0/384111751 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5569b90dd4d0 0x5569b94b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:21.777 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.772+0000 7fed4ed9d640 1 --2- 172.21.15.1:0/384111751 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569b90fe1b0 0x5569b94b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:21.777 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.772+0000 7fed4e59c640 1 -- 172.21.15.1:0/384111751 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569b90fe1b0 msgr2=0x5569b94b6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:21.777 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.772+0000 7fed4e59c640 1 --2- 172.21.15.1:0/384111751 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569b90fe1b0 0x5569b94b6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:21.777 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.772+0000 7fed4e59c640 1 -- 172.21.15.1:0/384111751 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5569b90dd4d0 msgr2=0x5569b94b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:21.777 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.772+0000 7fed4e59c640 1 --2- 172.21.15.1:0/384111751 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5569b90dd4d0 0x5569b94b5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:21.778 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.772+0000 7fed4e59c640 1 -- 172.21.15.1:0/384111751 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569b94b6560 con 0x5569b90d52f0 2024-09-21T01:00:21.778 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.773+0000 7fed4e59c640 1 --2- 172.21.15.1:0/384111751 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569b90d52f0 0x5569b94b6e20 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fed40013cc0 tx=0x7fed40005970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d716fd5170495b2d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:21.778 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.773+0000 7fed35ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:00:21.778 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.773+0000 7fed35ffb640 1 -- 172.21.15.1:0/384111751 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed400054f0 con 0x5569b90d52f0 2024-09-21T01:00:21.778 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.773+0000 7fed35ffb640 1 -- 172.21.15.1:0/384111751 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fed4001f590 con 0x5569b90d52f0 2024-09-21T01:00:21.778 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.773+0000 7fed5ba50740 1 -- 172.21.15.1:0/384111751 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed40032e50 con 0x5569b90d52f0 2024-09-21T01:00:21.778 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.773+0000 7fed35ffb640 1 -- 172.21.15.1:0/384111751 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fed40050050 con 0x5569b90d52f0 2024-09-21T01:00:21.778 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.773+0000 7fed5ba50740 10 client.16425 fetch_fsmap learned FSMap version 32 2024-09-21T01:00:21.778 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.773+0000 7fed5ba50740 1 -- 172.21.15.1:0/384111751 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5569b94b5420 con 0x5569b90d52f0 2024-09-21T01:00:21.778 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.773+0000 7fed35ffb640 1 -- 172.21.15.1:0/384111751 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed40032e50 con 0x5569b90d52f0 2024-09-21T01:00:21.778 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.773+0000 7fed35ffb640 1 -- 172.21.15.1:0/384111751 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 32) ==== 8382+0+0 (secure 0 0 0) 0x7fed40020ce0 con 0x5569b90d52f0 2024-09-21T01:00:21.778 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.773+0000 7fed5ba50740 10 client.16425 fetch_fsmap finished waiting for FSMap version 32 2024-09-21T01:00:21.778 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.774+0000 7fed5ba50740 10 client.16425 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:00:21.778 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.774+0000 7fed5ba50740 20 client.16425 populate_metadata read hostname 'smithi001' 2024-09-21T01:00:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.774+0000 7fed5ba50740 1 --2- 172.21.15.1:0/384111751 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5569b90921c0 0x5569b9529e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.774+0000 7fed5ba50740 4 client.16425 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:00:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.774+0000 7fed5ba50740 1 -- 172.21.15.1:0/384111751 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5569b94160f0 con 0x5569b90921c0 2024-09-21T01:00:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.774+0000 7fed47fff640 1 --2- 172.21.15.1:0/384111751 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5569b90921c0 0x5569b9529e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.774+0000 7fed47fff640 1 --2- 172.21.15.1:0/384111751 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5569b90921c0 0x5569b9529e10 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a28fa88e80cd2ad server_cookie=6654e31284bdcc0f in_seq=0 out_seq=0 2024-09-21T01:00:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.774+0000 7fed35ffb640 10 client.16425 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:21.834 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.833+0000 7fed35ffb640 1 -- 172.21.15.1:0/384111751 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5569b94160f0 con 0x5569b90921c0 2024-09-21T01:00:21.834 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.833+0000 7fed35ffb640 10 client.16425 handle_command_reply: tid=0 2024-09-21T01:00:21.834 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.833+0000 7fed5ba50740 1 client.16425 shutdown 2024-09-21T01:00:21.834 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.833+0000 7fed5ba50740 1 -- 172.21.15.1:0/384111751 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569b90d52f0 msgr2=0x5569b94b6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:21.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.833+0000 7fed5ba50740 1 --2- 172.21.15.1:0/384111751 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569b90d52f0 0x5569b94b6e20 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fed40013cc0 tx=0x7fed40005970 comp rx=0 tx=0).stop 2024-09-21T01:00:21.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.833+0000 7fed5ba50740 1 -- 172.21.15.1:0/384111751 shutdown_connections 2024-09-21T01:00:21.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.833+0000 7fed5ba50740 1 --2- 172.21.15.1:0/384111751 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5569b90921c0 0x5569b9529e10 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:21.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.833+0000 7fed5ba50740 1 --2- 172.21.15.1:0/384111751 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569b90fe1b0 0x5569b94b6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:21.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.833+0000 7fed5ba50740 1 --2- 172.21.15.1:0/384111751 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5569b90dd4d0 0x5569b94b5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:21.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.833+0000 7fed5ba50740 1 --2- 172.21.15.1:0/384111751 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569b90d52f0 0x5569b94b6e20 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:21.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.833+0000 7fed35ffb640 0 client.16425 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:21.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.833+0000 7fed5ba50740 1 -- 172.21.15.1:0/384111751 >> 172.21.15.1:0/384111751 conn(0x5569b90f2300 msgr2=0x5569b94a5df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:21.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.833+0000 7fed5ba50740 1 -- 172.21.15.1:0/384111751 shutdown_connections 2024-09-21T01:00:21.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.833+0000 7fed5ba50740 1 -- 172.21.15.1:0/384111751 wait complete. 2024-09-21T01:00:21.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.834+0000 7fed5ba50740 20 client.16425 trim_cache size 0 max 16384 2024-09-21T01:00:21.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T01:00:21.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T01:00:21.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T01:00:21.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T01:00:21.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.834+0000 7fed54ade640 1 -- 172.21.15.1:0/2350886336 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fed3c0b6510 msgr2=0x7fed3c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:21.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.834+0000 7fed54ade640 1 --2- 172.21.15.1:0/2350886336 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fed3c0b6510 0x7fed3c0b8a20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fed40009d00 tx=0x7fed40005f90 comp rx=0 tx=0).stop 2024-09-21T01:00:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.834+0000 7fed54ade640 1 -- 172.21.15.1:0/2350886336 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed50103640 msgr2=0x7fed5019ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.834+0000 7fed54ade640 1 --2- 172.21.15.1:0/2350886336 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed50103640 0x7fed5019ec50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fed3800e9f0 tx=0x7fed3800eeb0 comp rx=0 tx=0).stop 2024-09-21T01:00:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.834+0000 7fed54ade640 1 -- 172.21.15.1:0/2350886336 shutdown_connections 2024-09-21T01:00:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.834+0000 7fed54ade640 1 --2- 172.21.15.1:0/2350886336 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fed3c0b6510 0x7fed3c0b8a20 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.834+0000 7fed54ade640 1 --2- 172.21.15.1:0/2350886336 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed50103fe0 0x7fed501a11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.834+0000 7fed54ade640 1 --2- 172.21.15.1:0/2350886336 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed50103640 0x7fed5019ec50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.834+0000 7fed54ade640 1 --2- 172.21.15.1:0/2350886336 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed501025c0 0x7fed5006c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.834+0000 7fed54ade640 1 -- 172.21.15.1:0/2350886336 >> 172.21.15.1:0/2350886336 conn(0x7fed500fdf00 msgr2=0x7fed50106960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.834+0000 7fed54ade640 1 -- 172.21.15.1:0/2350886336 shutdown_connections 2024-09-21T01:00:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:21.834+0000 7fed54ade640 1 -- 172.21.15.1:0/2350886336 wait complete. 2024-09-21T01:00:23.559 INFO:tasks.workunit.client.0.smithi001.stdout: 75 4462 3 2774 1 1807 3 2024-09-21T01:00:23.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:23 smithi001 ceph-mon[31211]: pgmap v453: 97 pgs: 97 active+clean; 408 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 360 op/s 2024-09-21T01:00:23.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:23 smithi193 ceph-mon[34660]: pgmap v453: 97 pgs: 97 active+clean; 408 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 360 op/s 2024-09-21T01:00:23.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:23 smithi042 ceph-mon[34481]: pgmap v453: 97 pgs: 97 active+clean; 408 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 360 op/s 2024-09-21T01:00:25.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:25 smithi001 ceph-mon[31211]: pgmap v454: 97 pgs: 97 active+clean; 411 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 204 op/s 2024-09-21T01:00:25.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:25 smithi193 ceph-mon[34660]: pgmap v454: 97 pgs: 97 active+clean; 411 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 204 op/s 2024-09-21T01:00:25.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:25 smithi042 ceph-mon[34481]: pgmap v454: 97 pgs: 97 active+clean; 411 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 204 op/s 2024-09-21T01:00:27.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:27 smithi001 ceph-mon[31211]: pgmap v455: 97 pgs: 97 active+clean; 411 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 144 op/s 2024-09-21T01:00:27.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:27 smithi193 ceph-mon[34660]: pgmap v455: 97 pgs: 97 active+clean; 411 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 144 op/s 2024-09-21T01:00:27.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:27 smithi042 ceph-mon[34481]: pgmap v455: 97 pgs: 97 active+clean; 411 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 144 op/s 2024-09-21T01:00:29.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:29 smithi001 ceph-mon[31211]: pgmap v456: 97 pgs: 97 active+clean; 415 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 186 op/s 2024-09-21T01:00:29.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:29 smithi193 ceph-mon[34660]: pgmap v456: 97 pgs: 97 active+clean; 415 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 186 op/s 2024-09-21T01:00:29.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:29 smithi042 ceph-mon[34481]: pgmap v456: 97 pgs: 97 active+clean; 415 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 186 op/s 2024-09-21T01:00:31.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:31 smithi001 ceph-mon[31211]: pgmap v457: 97 pgs: 97 active+clean; 415 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 187 op/s 2024-09-21T01:00:31.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:31 smithi193 ceph-mon[34660]: pgmap v457: 97 pgs: 97 active+clean; 415 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 187 op/s 2024-09-21T01:00:31.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:31 smithi042 ceph-mon[34481]: pgmap v457: 97 pgs: 97 active+clean; 415 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 187 op/s 2024-09-21T01:00:33.559 INFO:tasks.workunit.client.0.smithi001.stdout: 79 32702 119 20888 115 18668 321 2024-09-21T01:00:33.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:33 smithi001 ceph-mon[31211]: pgmap v458: 97 pgs: 97 active+clean; 418 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 179 op/s 2024-09-21T01:00:33.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:33 smithi001 ceph-mon[31211]: scrub summary: idle 2024-09-21T01:00:33.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:33 smithi001 ceph-mon[31211]: scrub summary: idle 2024-09-21T01:00:33.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:33 smithi193 ceph-mon[34660]: pgmap v458: 97 pgs: 97 active+clean; 418 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 179 op/s 2024-09-21T01:00:33.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:33 smithi193 ceph-mon[34660]: scrub summary: idle 2024-09-21T01:00:33.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:33 smithi193 ceph-mon[34660]: scrub summary: idle 2024-09-21T01:00:33.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:33 smithi042 ceph-mon[34481]: pgmap v458: 97 pgs: 97 active+clean; 418 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 179 op/s 2024-09-21T01:00:33.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:33 smithi042 ceph-mon[34481]: scrub summary: idle 2024-09-21T01:00:33.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:33 smithi042 ceph-mon[34481]: scrub summary: idle 2024-09-21T01:00:34.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:34 smithi001 ceph-mon[31211]: scrub summary: idle 2024-09-21T01:00:34.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:34 smithi001 ceph-mon[31211]: scrub summary: idle 2024-09-21T01:00:34.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:34 smithi001 ceph-mon[31211]: scrub summary: idle 2024-09-21T01:00:34.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:34 smithi001 ceph-mon[31211]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:00:34.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:34 smithi193 ceph-mon[34660]: scrub summary: idle 2024-09-21T01:00:34.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:34 smithi193 ceph-mon[34660]: scrub summary: idle 2024-09-21T01:00:34.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:34 smithi193 ceph-mon[34660]: scrub summary: idle 2024-09-21T01:00:34.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:34 smithi193 ceph-mon[34660]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:00:34.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:34 smithi042 ceph-mon[34481]: scrub summary: idle 2024-09-21T01:00:34.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:34 smithi042 ceph-mon[34481]: scrub summary: idle 2024-09-21T01:00:34.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:34 smithi042 ceph-mon[34481]: scrub summary: idle 2024-09-21T01:00:34.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:34 smithi042 ceph-mon[34481]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:00:34.937 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.937+0000 7f6e77db0640 1 -- 172.21.15.1:0/1416019840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e70103fd0 msgr2=0x7f6e7010a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:34.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.937+0000 7f6e77db0640 1 --2- 172.21.15.1:0/1416019840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e70103fd0 0x7f6e7010a970 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f6e68009ca0 tx=0x7f6e6802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:00:34.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.937+0000 7f6e77db0640 1 -- 172.21.15.1:0/1416019840 shutdown_connections 2024-09-21T01:00:34.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.937+0000 7f6e77db0640 1 --2- 172.21.15.1:0/1416019840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e70103fd0 0x7f6e7010a970 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:34.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.937+0000 7f6e77db0640 1 --2- 172.21.15.1:0/1416019840 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e70103630 0x7f6e70103a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:34.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.937+0000 7f6e77db0640 1 --2- 172.21.15.1:0/1416019840 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6e701025b0 0x7f6e70102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:34.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.937+0000 7f6e77db0640 1 -- 172.21.15.1:0/1416019840 >> 172.21.15.1:0/1416019840 conn(0x7f6e700fdf30 msgr2=0x7f6e701003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:34.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.937+0000 7f6e77db0640 1 -- 172.21.15.1:0/1416019840 shutdown_connections 2024-09-21T01:00:34.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.937+0000 7f6e77db0640 1 -- 172.21.15.1:0/1416019840 wait complete. 2024-09-21T01:00:34.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.937+0000 7f6e77db0640 1 Processor -- start 2024-09-21T01:00:34.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.937+0000 7f6e77db0640 1 -- start start 2024-09-21T01:00:34.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.938+0000 7f6e77db0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6e701025b0 0x7f6e70199f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:34.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.938+0000 7f6e77db0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e70103630 0x7f6e7019a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:34.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.938+0000 7f6e77db0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e70103fd0 0x7f6e7019b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:34.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.938+0000 7f6e77db0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7010e210 con 0x7f6e70103fd0 2024-09-21T01:00:34.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.938+0000 7f6e77db0640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7010e090 con 0x7f6e70103630 2024-09-21T01:00:34.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.938+0000 7f6e77db0640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7010e390 con 0x7f6e701025b0 2024-09-21T01:00:34.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.938+0000 7f6e7634d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e70103fd0 0x7f6e7019b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:34.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.938+0000 7f6e75b4c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6e701025b0 0x7f6e70199f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:34.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.938+0000 7f6e7534b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e70103630 0x7f6e7019a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:34.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.938+0000 7f6e7634d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e70103fd0 0x7f6e7019b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33060/0 (socket says 172.21.15.1:33060) 2024-09-21T01:00:34.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.938+0000 7f6e75b4c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6e701025b0 0x7f6e70199f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:49202/0 (socket says 172.21.15.1:49202) 2024-09-21T01:00:34.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.938+0000 7f6e7634d640 1 -- 172.21.15.1:0/2466432528 learned_addr learned my addr 172.21.15.1:0/2466432528 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:34.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.938+0000 7f6e7534b640 1 -- 172.21.15.1:0/2466432528 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6e701025b0 msgr2=0x7f6e70199f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:34.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.938+0000 7f6e7534b640 1 --2- 172.21.15.1:0/2466432528 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6e701025b0 0x7f6e70199f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:34.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.938+0000 7f6e7534b640 1 -- 172.21.15.1:0/2466432528 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e70103fd0 msgr2=0x7f6e7019b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:34.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.938+0000 7f6e7534b640 1 --2- 172.21.15.1:0/2466432528 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e70103fd0 0x7f6e7019b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:34.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.938+0000 7f6e7534b640 1 -- 172.21.15.1:0/2466432528 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e7019b940 con 0x7f6e70103630 2024-09-21T01:00:34.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.938+0000 7f6e7634d640 1 --2- 172.21.15.1:0/2466432528 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e70103fd0 0x7f6e7019b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:34.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.939+0000 7f6e7534b640 1 --2- 172.21.15.1:0/2466432528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e70103630 0x7f6e7019a570 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6e6000e9f0 tx=0x7f6e6000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:34.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.939+0000 7f6e66ffd640 1 -- 172.21.15.1:0/2466432528 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e6000ccc0 con 0x7f6e70103630 2024-09-21T01:00:34.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.939+0000 7f6e77db0640 1 -- 172.21.15.1:0/2466432528 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e7019bc30 con 0x7f6e70103630 2024-09-21T01:00:34.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.939+0000 7f6e66ffd640 1 -- 172.21.15.1:0/2466432528 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e600108e0 con 0x7f6e70103630 2024-09-21T01:00:34.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.939+0000 7f6e66ffd640 1 -- 172.21.15.1:0/2466432528 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e60018880 con 0x7f6e70103630 2024-09-21T01:00:34.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.939+0000 7f6e77db0640 1 -- 172.21.15.1:0/2466432528 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e701a2320 con 0x7f6e70103630 2024-09-21T01:00:34.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.942+0000 7f6e7edf5740 1 Processor -- start 2024-09-21T01:00:34.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.942+0000 7f6e7edf5740 1 -- start start 2024-09-21T01:00:34.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.942+0000 7f6e7edf5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5624a811c1b0 0x5624a84c3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:34.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.942+0000 7f6e7edf5740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624a80f32f0 0x5624a84c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:34.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.942+0000 7f6e7edf5740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5624a80fb4d0 0x5624a84c5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:34.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.942+0000 7f6e7edf5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5624a84366f0 con 0x5624a811c1b0 2024-09-21T01:00:34.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.942+0000 7f6e7edf5740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5624a8425b20 con 0x5624a80fb4d0 2024-09-21T01:00:34.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.942+0000 7f6e7edf5740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5624a8429930 con 0x5624a80f32f0 2024-09-21T01:00:34.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.942+0000 7f6e75b4c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624a80f32f0 0x5624a84c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:34.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.942+0000 7f6e7634d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5624a811c1b0 0x5624a84c3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:34.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.942+0000 7f6e75b4c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624a80f32f0 0x5624a84c44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:49216/0 (socket says 172.21.15.1:49216) 2024-09-21T01:00:34.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.942+0000 7f6e75b4c640 1 -- 172.21.15.1:0/2294798501 learned_addr learned my addr 172.21.15.1:0/2294798501 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:34.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.943+0000 7f6e75b4c640 1 -- 172.21.15.1:0/2294798501 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5624a80fb4d0 msgr2=0x5624a84c5010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:00:34.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.943+0000 7f6e75b4c640 1 --2- 172.21.15.1:0/2294798501 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5624a80fb4d0 0x5624a84c5010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:34.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.943+0000 7f6e75b4c640 1 -- 172.21.15.1:0/2294798501 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5624a811c1b0 msgr2=0x5624a84c3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:34.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.943+0000 7f6e75b4c640 1 --2- 172.21.15.1:0/2294798501 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5624a811c1b0 0x5624a84c3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:34.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.943+0000 7f6e75b4c640 1 -- 172.21.15.1:0/2294798501 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624a83eb530 con 0x5624a80f32f0 2024-09-21T01:00:34.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.943+0000 7f6e66ffd640 1 -- 172.21.15.1:0/2466432528 <== mon.2 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f6e60010430 con 0x7f6e70103630 2024-09-21T01:00:34.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.943+0000 7f6e75b4c640 1 --2- 172.21.15.1:0/2294798501 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624a80f32f0 0x5624a84c44c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c00b760 tx=0x7f6e6c00bc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8633883029984313 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:34.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.943+0000 7f6e5bfff640 1 -- 172.21.15.1:0/2294798501 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c003dd0 con 0x5624a80f32f0 2024-09-21T01:00:34.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.943+0000 7f6e5bfff640 1 -- 172.21.15.1:0/2294798501 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e6c015070 con 0x5624a80f32f0 2024-09-21T01:00:34.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.943+0000 7f6e5bfff640 1 -- 172.21.15.1:0/2294798501 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c004d90 con 0x5624a80f32f0 2024-09-21T01:00:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.944+0000 7f6e66ffd640 1 --2- 172.21.15.1:0/2466432528 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6e5c0b6510 0x7f6e5c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.944+0000 7f6e7634d640 1 --2- 172.21.15.1:0/2466432528 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6e5c0b6510 0x7f6e5c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.944+0000 7f6e66ffd640 1 -- 172.21.15.1:0/2466432528 <== mon.2 v2:172.21.15.42:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f6e600e7650 con 0x7f6e70103630 2024-09-21T01:00:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.944+0000 7f6e7edf5740 1 -- 172.21.15.1:0/2294798501 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624a80f32f0 msgr2=0x5624a84c44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.944+0000 7f6e7edf5740 1 --2- 172.21.15.1:0/2294798501 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624a80f32f0 0x5624a84c44c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c00b760 tx=0x7f6e6c00bc20 comp rx=0 tx=0).stop 2024-09-21T01:00:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.944+0000 7f6e7634d640 1 --2- 172.21.15.1:0/2466432528 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6e5c0b6510 0x7f6e5c0b8a20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6e68033040 tx=0x7f6e68031af0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.945+0000 7f6e7edf5740 1 -- 172.21.15.1:0/2294798501 shutdown_connections 2024-09-21T01:00:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.945+0000 7f6e7edf5740 1 --2- 172.21.15.1:0/2294798501 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5624a80fb4d0 0x5624a84c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.945+0000 7f6e7edf5740 1 --2- 172.21.15.1:0/2294798501 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624a80f32f0 0x5624a84c44c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.945+0000 7f6e7edf5740 1 --2- 172.21.15.1:0/2294798501 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5624a811c1b0 0x5624a84c3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.945+0000 7f6e7edf5740 1 -- 172.21.15.1:0/2294798501 >> 172.21.15.1:0/2294798501 conn(0x5624a8110300 msgr2=0x5624a84bf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.945+0000 7f6e7edf5740 1 -- 172.21.15.1:0/2294798501 shutdown_connections 2024-09-21T01:00:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.945+0000 7f6e7edf5740 1 -- 172.21.15.1:0/2294798501 wait complete. 2024-09-21T01:00:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.945+0000 7f6e7edf5740 1 -- start start 2024-09-21T01:00:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.945+0000 7f6e7edf5740 1 Processor -- start 2024-09-21T01:00:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.946+0000 7f6e7edf5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5624a80f32f0 0x5624a84cd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.946+0000 7f6e7edf5740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5624a80fb4d0 0x5624a84cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.946+0000 7f6e7edf5740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624a811c1b0 0x5624a84ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.946+0000 7f6e7edf5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5624a835dab0 con 0x5624a80f32f0 2024-09-21T01:00:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.946+0000 7f6e7edf5740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5624a83cb730 con 0x5624a80fb4d0 2024-09-21T01:00:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.946+0000 7f6e7edf5740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5624a84c5b30 con 0x5624a811c1b0 2024-09-21T01:00:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.946+0000 7f6e7edf5740 10 client.0 _ll_register_callbacks cb 0x5624a841f6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.946+0000 7f6e75b4c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5624a80f32f0 0x5624a84cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.946+0000 7f6e75b4c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5624a80f32f0 0x5624a84cd610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33082/0 (socket says 172.21.15.1:33082) 2024-09-21T01:00:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.946+0000 7f6e75b4c640 1 -- 172.21.15.1:0/3433297270 learned_addr learned my addr 172.21.15.1:0/3433297270 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.946+0000 7f6e7534b640 1 --2- 172.21.15.1:0/3433297270 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5624a80fb4d0 0x5624a84cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.946+0000 7f6e7634d640 1 --2- 172.21.15.1:0/3433297270 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624a811c1b0 0x5624a84ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.946+0000 7f6e75b4c640 1 -- 172.21.15.1:0/3433297270 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624a811c1b0 msgr2=0x5624a84ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.946+0000 7f6e75b4c640 1 --2- 172.21.15.1:0/3433297270 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624a811c1b0 0x5624a84ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.946+0000 7f6e75b4c640 1 -- 172.21.15.1:0/3433297270 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5624a80fb4d0 msgr2=0x5624a84cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.946+0000 7f6e75b4c640 1 --2- 172.21.15.1:0/3433297270 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5624a80fb4d0 0x5624a84cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.946+0000 7f6e75b4c640 1 -- 172.21.15.1:0/3433297270 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624a8187790 con 0x5624a80f32f0 2024-09-21T01:00:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.947+0000 7f6e75b4c640 1 --2- 172.21.15.1:0/3433297270 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5624a80f32f0 0x5624a84cd610 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c003e00 tx=0x7f6e6c003e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ad5b8d23f5b91f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.947+0000 7f6e597fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:00:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.947+0000 7f6e597fa640 1 -- 172.21.15.1:0/3433297270 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c028060 con 0x5624a80f32f0 2024-09-21T01:00:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.947+0000 7f6e597fa640 1 -- 172.21.15.1:0/3433297270 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f6e6c011850 con 0x5624a80f32f0 2024-09-21T01:00:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.947+0000 7f6e7edf5740 1 -- 172.21.15.1:0/3433297270 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e6c015070 con 0x5624a80f32f0 2024-09-21T01:00:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.947+0000 7f6e597fa640 1 -- 172.21.15.1:0/3433297270 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f6e6c0046c0 con 0x5624a80f32f0 2024-09-21T01:00:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.947+0000 7f6e7edf5740 10 client.16437 fetch_fsmap learned FSMap version 33 2024-09-21T01:00:34.952 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.947+0000 7f6e7edf5740 1 -- 172.21.15.1:0/3433297270 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5624a8200620 con 0x5624a80f32f0 2024-09-21T01:00:34.952 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.947+0000 7f6e597fa640 1 -- 172.21.15.1:0/3433297270 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e6c015070 con 0x5624a80f32f0 2024-09-21T01:00:34.952 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.947+0000 7f6e597fa640 1 -- 172.21.15.1:0/3433297270 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f6e6c022070 con 0x5624a80f32f0 2024-09-21T01:00:34.952 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.947+0000 7f6e7edf5740 10 client.16437 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:00:34.952 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.947+0000 7f6e7edf5740 10 client.16437 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:00:34.952 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.947+0000 7f6e7edf5740 20 client.16437 populate_metadata read hostname 'smithi001' 2024-09-21T01:00:34.952 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.948+0000 7f6e7edf5740 1 --2- 172.21.15.1:0/3433297270 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5624a80dad80 0x5624a84daa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:34.952 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.948+0000 7f6e7edf5740 4 client.16437 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:00:34.952 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.948+0000 7f6e7edf5740 1 -- 172.21.15.1:0/3433297270 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5624a8438640 con 0x5624a80dad80 2024-09-21T01:00:34.952 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.948+0000 7f6e7534b640 1 --2- 172.21.15.1:0/3433297270 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5624a80dad80 0x5624a84daa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:34.952 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.948+0000 7f6e7534b640 1 --2- 172.21.15.1:0/3433297270 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5624a80dad80 0x5624a84daa30 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7284bd780754ea66 server_cookie=7dc1aa8e7447991 in_seq=0 out_seq=0 2024-09-21T01:00:34.952 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.948+0000 7f6e597fa640 10 client.16437 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:34.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.949+0000 7f6e597fa640 1 -- 172.21.15.1:0/3433297270 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5624a8438640 con 0x5624a80dad80 2024-09-21T01:00:34.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.949+0000 7f6e597fa640 10 client.16437 handle_command_reply: tid=0 2024-09-21T01:00:34.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.949+0000 7f6e7edf5740 1 client.16437 shutdown 2024-09-21T01:00:34.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.949+0000 7f6e7edf5740 1 -- 172.21.15.1:0/3433297270 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5624a80f32f0 msgr2=0x5624a84cd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:34.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.949+0000 7f6e7edf5740 1 --2- 172.21.15.1:0/3433297270 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5624a80f32f0 0x5624a84cd610 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c003e00 tx=0x7f6e6c003e30 comp rx=0 tx=0).stop 2024-09-21T01:00:34.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.950+0000 7f6e7edf5740 1 -- 172.21.15.1:0/3433297270 shutdown_connections 2024-09-21T01:00:34.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.950+0000 7f6e7edf5740 1 --2- 172.21.15.1:0/3433297270 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5624a80dad80 0x5624a84daa30 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:34.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.950+0000 7f6e7edf5740 1 --2- 172.21.15.1:0/3433297270 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624a811c1b0 0x5624a84ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:34.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.950+0000 7f6e597fa640 0 client.16437 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:34.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.950+0000 7f6e7edf5740 1 --2- 172.21.15.1:0/3433297270 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5624a80fb4d0 0x5624a84cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:34.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.950+0000 7f6e7edf5740 1 --2- 172.21.15.1:0/3433297270 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5624a80f32f0 0x5624a84cd610 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:34.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.950+0000 7f6e7edf5740 1 -- 172.21.15.1:0/3433297270 >> 172.21.15.1:0/3433297270 conn(0x5624a8110300 msgr2=0x5624a84bdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:34.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.950+0000 7f6e7edf5740 1 -- 172.21.15.1:0/3433297270 shutdown_connections 2024-09-21T01:00:34.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.950+0000 7f6e7edf5740 1 -- 172.21.15.1:0/3433297270 wait complete. 2024-09-21T01:00:34.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.950+0000 7f6e7edf5740 20 client.16437 trim_cache size 0 max 16384 2024-09-21T01:00:34.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.965+0000 7f6e7edf5740 1 Processor -- start 2024-09-21T01:00:34.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.965+0000 7f6e7edf5740 1 -- start start 2024-09-21T01:00:34.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.966+0000 7f6e7edf5740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624a80dad80 0x5624a84c3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:34.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.966+0000 7f6e7edf5740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5624a80f32f0 0x5624a84c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:34.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.966+0000 7f6e7edf5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5624a80fb4d0 0x5624a84d5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:34.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.966+0000 7f6e7edf5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6e701ab0a0 con 0x5624a80fb4d0 2024-09-21T01:00:34.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.966+0000 7f6e7edf5740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6e701acca0 con 0x5624a80f32f0 2024-09-21T01:00:34.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.966+0000 7f6e7edf5740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6e701ab770 con 0x5624a80dad80 2024-09-21T01:00:34.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.966+0000 7f6e7534b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5624a80f32f0 0x5624a84c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:34.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.966+0000 7f6e7534b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5624a80f32f0 0x5624a84c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:58670/0 (socket says 172.21.15.1:58670) 2024-09-21T01:00:34.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.966+0000 7f6e7534b640 1 -- 172.21.15.1:0/3388770958 learned_addr learned my addr 172.21.15.1:0/3388770958 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:34.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.966+0000 7f6e7634d640 1 --2- 172.21.15.1:0/3388770958 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5624a80fb4d0 0x5624a84d5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:34.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.966+0000 7f6e75b4c640 1 --2- 172.21.15.1:0/3388770958 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624a80dad80 0x5624a84c3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:34.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.966+0000 7f6e7534b640 1 -- 172.21.15.1:0/3388770958 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624a80dad80 msgr2=0x5624a84c3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:34.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.966+0000 7f6e7534b640 1 --2- 172.21.15.1:0/3388770958 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624a80dad80 0x5624a84c3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:34.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.966+0000 7f6e7534b640 1 -- 172.21.15.1:0/3388770958 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5624a80fb4d0 msgr2=0x5624a84d5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:34.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.966+0000 7f6e7534b640 1 --2- 172.21.15.1:0/3388770958 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5624a80fb4d0 0x5624a84d5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:34.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.966+0000 7f6e7534b640 1 -- 172.21.15.1:0/3388770958 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624a84cebb0 con 0x5624a80f32f0 2024-09-21T01:00:34.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.966+0000 7f6e7534b640 1 --2- 172.21.15.1:0/3388770958 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5624a80f32f0 0x5624a84c4330 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6e6000e9c0 tx=0x7f6e6000ce60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7dafe7c1d8730d3f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:34.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.967+0000 7f6e5b7fe640 1 -- 172.21.15.1:0/3388770958 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e600b22a0 con 0x5624a80f32f0 2024-09-21T01:00:34.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.967+0000 7f6e5b7fe640 1 -- 172.21.15.1:0/3388770958 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e600b71e0 con 0x5624a80f32f0 2024-09-21T01:00:34.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.967+0000 7f6e5b7fe640 1 -- 172.21.15.1:0/3388770958 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e600a9420 con 0x5624a80f32f0 2024-09-21T01:00:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.968+0000 7f6e7edf5740 1 -- 172.21.15.1:0/3388770958 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5624a80f32f0 msgr2=0x5624a84c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.968+0000 7f6e7edf5740 1 --2- 172.21.15.1:0/3388770958 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5624a80f32f0 0x5624a84c4330 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6e6000e9c0 tx=0x7f6e6000ce60 comp rx=0 tx=0).stop 2024-09-21T01:00:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.968+0000 7f6e7edf5740 1 -- 172.21.15.1:0/3388770958 shutdown_connections 2024-09-21T01:00:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.968+0000 7f6e7edf5740 1 --2- 172.21.15.1:0/3388770958 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5624a80fb4d0 0x5624a84d5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.968+0000 7f6e7edf5740 1 --2- 172.21.15.1:0/3388770958 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5624a80f32f0 0x5624a84c4330 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.968+0000 7f6e7edf5740 1 --2- 172.21.15.1:0/3388770958 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624a80dad80 0x5624a84c3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.968+0000 7f6e7edf5740 1 -- 172.21.15.1:0/3388770958 >> 172.21.15.1:0/3388770958 conn(0x5624a8110300 msgr2=0x5624a84be650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.968+0000 7f6e7edf5740 1 -- 172.21.15.1:0/3388770958 shutdown_connections 2024-09-21T01:00:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.968+0000 7f6e7edf5740 1 -- 172.21.15.1:0/3388770958 wait complete. 2024-09-21T01:00:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.968+0000 7f6e7edf5740 1 -- start start 2024-09-21T01:00:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.968+0000 7f6e7edf5740 1 Processor -- start 2024-09-21T01:00:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.969+0000 7f6e7edf5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5624a80dad80 0x5624a84d5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.969+0000 7f6e7edf5740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5624a80f32f0 0x5624a84d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.969+0000 7f6e7edf5740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624a80fb4d0 0x5624a84d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.969+0000 7f6e7edf5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6e701ac5d0 con 0x5624a80dad80 2024-09-21T01:00:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.969+0000 7f6e7edf5740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6e701abf00 con 0x5624a80f32f0 2024-09-21T01:00:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.969+0000 7f6e7edf5740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6e701a9080 con 0x5624a80fb4d0 2024-09-21T01:00:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.969+0000 7f6e7edf5740 10 client.0 _ll_register_callbacks cb 0x7f6e68009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.969+0000 7f6e7534b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5624a80f32f0 0x5624a84d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.969+0000 7f6e75b4c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5624a80dad80 0x5624a84d5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.969+0000 7f6e7534b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5624a80f32f0 0x5624a84d0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:58682/0 (socket says 172.21.15.1:58682) 2024-09-21T01:00:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.969+0000 7f6e7534b640 1 -- 172.21.15.1:0/3555826024 learned_addr learned my addr 172.21.15.1:0/3555826024 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.969+0000 7f6e7634d640 1 --2- 172.21.15.1:0/3555826024 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624a80fb4d0 0x5624a84d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.969+0000 7f6e7534b640 1 -- 172.21.15.1:0/3555826024 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624a80fb4d0 msgr2=0x5624a84d13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.969+0000 7f6e7534b640 1 --2- 172.21.15.1:0/3555826024 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624a80fb4d0 0x5624a84d13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.969+0000 7f6e7534b640 1 -- 172.21.15.1:0/3555826024 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5624a80dad80 msgr2=0x5624a84d5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.969+0000 7f6e7534b640 1 --2- 172.21.15.1:0/3555826024 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5624a80dad80 0x5624a84d5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:34.974 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.969+0000 7f6e7534b640 1 -- 172.21.15.1:0/3555826024 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624a84d5900 con 0x5624a80f32f0 2024-09-21T01:00:34.974 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.969+0000 7f6e7534b640 1 --2- 172.21.15.1:0/3555826024 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5624a80f32f0 0x5624a84d0e80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6e600ad520 tx=0x7f6e600b21d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84ea9c4579cb1079 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:34.974 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.969+0000 7f6e597fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:00:34.974 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.969+0000 7f6e597fa640 1 -- 172.21.15.1:0/3555826024 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e600aeaf0 con 0x5624a80f32f0 2024-09-21T01:00:34.974 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.969+0000 7f6e597fa640 1 -- 172.21.15.1:0/3555826024 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f6e600aec90 con 0x5624a80f32f0 2024-09-21T01:00:34.974 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.969+0000 7f6e7edf5740 1 -- 172.21.15.1:0/3555826024 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e600b71e0 con 0x5624a80f32f0 2024-09-21T01:00:34.974 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.970+0000 7f6e597fa640 1 -- 172.21.15.1:0/3555826024 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f6e600a91c0 con 0x5624a80f32f0 2024-09-21T01:00:34.974 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.970+0000 7f6e7edf5740 10 client.26114 fetch_fsmap learned FSMap version 33 2024-09-21T01:00:34.974 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.970+0000 7f6e7edf5740 1 -- 172.21.15.1:0/3555826024 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5624a8545320 con 0x5624a80f32f0 2024-09-21T01:00:34.974 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.970+0000 7f6e597fa640 1 -- 172.21.15.1:0/3555826024 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e600b71e0 con 0x5624a80f32f0 2024-09-21T01:00:34.974 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.970+0000 7f6e597fa640 1 -- 172.21.15.1:0/3555826024 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f6e600b35c0 con 0x5624a80f32f0 2024-09-21T01:00:34.974 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.970+0000 7f6e7edf5740 10 client.26114 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:00:34.974 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.970+0000 7f6e7edf5740 10 client.26114 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:00:34.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.970+0000 7f6e7edf5740 20 client.26114 populate_metadata read hostname 'smithi001' 2024-09-21T01:00:34.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.970+0000 7f6e7edf5740 1 --2- 172.21.15.1:0/3555826024 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5624a811c1b0 0x5624a8547af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:34.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.970+0000 7f6e7edf5740 4 client.26114 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:00:34.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.970+0000 7f6e7edf5740 1 -- 172.21.15.1:0/3555826024 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5624a84340f0 con 0x5624a811c1b0 2024-09-21T01:00:34.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.970+0000 7f6e75b4c640 1 --2- 172.21.15.1:0/3555826024 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5624a811c1b0 0x5624a8547af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:34.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.971+0000 7f6e597fa640 10 client.26114 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:34.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:34.971+0000 7f6e75b4c640 1 --2- 172.21.15.1:0/3555826024 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5624a811c1b0 0x5624a8547af0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17600a3be70002f9 server_cookie=f09756f07d3ffbf1 in_seq=0 out_seq=0 2024-09-21T01:00:35.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:35.324+0000 7f6e597fa640 1 -- 172.21.15.1:0/3555826024 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5624a84340f0 con 0x5624a811c1b0 2024-09-21T01:00:35.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:35.324+0000 7f6e597fa640 10 client.26114 handle_command_reply: tid=0 2024-09-21T01:00:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:35.324+0000 7f6e7edf5740 1 client.26114 shutdown 2024-09-21T01:00:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:35.324+0000 7f6e7edf5740 1 -- 172.21.15.1:0/3555826024 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5624a80f32f0 msgr2=0x5624a84d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:35.324+0000 7f6e7edf5740 1 --2- 172.21.15.1:0/3555826024 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5624a80f32f0 0x5624a84d0e80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6e600ad520 tx=0x7f6e600b21d0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:35.324+0000 7f6e7edf5740 1 -- 172.21.15.1:0/3555826024 shutdown_connections 2024-09-21T01:00:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:35.324+0000 7f6e7edf5740 1 --2- 172.21.15.1:0/3555826024 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5624a811c1b0 0x5624a8547af0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:35.324+0000 7f6e7edf5740 1 --2- 172.21.15.1:0/3555826024 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624a80fb4d0 0x5624a84d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:35.324+0000 7f6e7edf5740 1 --2- 172.21.15.1:0/3555826024 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5624a80f32f0 0x5624a84d0e80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:35.324+0000 7f6e7edf5740 1 --2- 172.21.15.1:0/3555826024 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5624a80dad80 0x5624a84d5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:35.324+0000 7f6e597fa640 0 client.26114 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:35.324+0000 7f6e7edf5740 1 -- 172.21.15.1:0/3555826024 >> 172.21.15.1:0/3555826024 conn(0x5624a8110300 msgr2=0x5624a84ccea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:35.324+0000 7f6e7edf5740 1 -- 172.21.15.1:0/3555826024 shutdown_connections 2024-09-21T01:00:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:35.324+0000 7f6e7edf5740 1 -- 172.21.15.1:0/3555826024 wait complete. 2024-09-21T01:00:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:35.325+0000 7f6e7edf5740 20 client.26114 trim_cache size 0 max 16384 2024-09-21T01:00:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T01:00:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T01:00:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T01:00:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T01:00:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:35.325+0000 7f6e77db0640 1 -- 172.21.15.1:0/2466432528 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6e5c0b6510 msgr2=0x7f6e5c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:35.325+0000 7f6e77db0640 1 --2- 172.21.15.1:0/2466432528 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6e5c0b6510 0x7f6e5c0b8a20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6e68033040 tx=0x7f6e68031af0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:35.325+0000 7f6e77db0640 1 -- 172.21.15.1:0/2466432528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e70103630 msgr2=0x7f6e7019a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:35.325+0000 7f6e77db0640 1 --2- 172.21.15.1:0/2466432528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e70103630 0x7f6e7019a570 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6e6000e9f0 tx=0x7f6e6000eeb0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:35.325+0000 7f6e77db0640 1 -- 172.21.15.1:0/2466432528 shutdown_connections 2024-09-21T01:00:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:35.325+0000 7f6e77db0640 1 --2- 172.21.15.1:0/2466432528 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f6e5c0b6510 0x7f6e5c0b8a20 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:35.325+0000 7f6e77db0640 1 --2- 172.21.15.1:0/2466432528 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e70103fd0 0x7f6e7019b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:35.325+0000 7f6e77db0640 1 --2- 172.21.15.1:0/2466432528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e70103630 0x7f6e7019a570 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:35.325+0000 7f6e77db0640 1 --2- 172.21.15.1:0/2466432528 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6e701025b0 0x7f6e70199f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:35.325+0000 7f6e77db0640 1 -- 172.21.15.1:0/2466432528 >> 172.21.15.1:0/2466432528 conn(0x7f6e700fdf30 msgr2=0x7f6e7006b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:35.325+0000 7f6e77db0640 1 -- 172.21.15.1:0/2466432528 shutdown_connections 2024-09-21T01:00:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:35.325+0000 7f6e77db0640 1 -- 172.21.15.1:0/2466432528 wait complete. 2024-09-21T01:00:35.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:35 smithi001 ceph-mon[31211]: pgmap v459: 97 pgs: 97 active+clean; 423 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 133 op/s 2024-09-21T01:00:35.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:35 smithi193 ceph-mon[34660]: pgmap v459: 97 pgs: 97 active+clean; 423 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 133 op/s 2024-09-21T01:00:35.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:35 smithi042 ceph-mon[34481]: pgmap v459: 97 pgs: 97 active+clean; 423 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 133 op/s 2024-09-21T01:00:36.961 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:00:37.361 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:37 smithi001 ceph-mon[31211]: pgmap v460: 97 pgs: 97 active+clean; 426 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 975 KiB/s rd, 1.5 MiB/s wr, 131 op/s 2024-09-21T01:00:37.665 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:00:37.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:37 smithi193 ceph-mon[34660]: pgmap v460: 97 pgs: 97 active+clean; 426 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 975 KiB/s rd, 1.5 MiB/s wr, 131 op/s 2024-09-21T01:00:37.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:37 smithi042 ceph-mon[34481]: pgmap v460: 97 pgs: 97 active+clean; 426 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 975 KiB/s rd, 1.5 MiB/s wr, 131 op/s 2024-09-21T01:00:38.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.280+0000 7f1a12960640 1 -- 172.21.15.1:0/940612037 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a0c102a60 msgr2=0x7f1a0c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:38.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.280+0000 7f1a12960640 1 --2- 172.21.15.1:0/940612037 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a0c102a60 0x7f1a0c102e70 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f1a0000d910 tx=0x7f1a0002a160 comp rx=0 tx=0).stop 2024-09-21T01:00:38.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.280+0000 7f1a12960640 1 -- 172.21.15.1:0/940612037 shutdown_connections 2024-09-21T01:00:38.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.280+0000 7f1a12960640 1 --2- 172.21.15.1:0/940612037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1a0c108cf0 0x7f1a0c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.280+0000 7f1a12960640 1 --2- 172.21.15.1:0/940612037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a0c1083a0 0x7f1a0c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.280+0000 7f1a12960640 1 --2- 172.21.15.1:0/940612037 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a0c102a60 0x7f1a0c102e70 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.280+0000 7f1a12960640 1 -- 172.21.15.1:0/940612037 >> 172.21.15.1:0/940612037 conn(0x7f1a0c079730 msgr2=0x7f1a0c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:38.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.280+0000 7f1a12960640 1 -- 172.21.15.1:0/940612037 shutdown_connections 2024-09-21T01:00:38.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.280+0000 7f1a12960640 1 -- 172.21.15.1:0/940612037 wait complete. 2024-09-21T01:00:38.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.281+0000 7f1a12960640 1 Processor -- start 2024-09-21T01:00:38.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.281+0000 7f1a12960640 1 -- start start 2024-09-21T01:00:38.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.282+0000 7f1a12960640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a0c102a60 0x7f1a0c198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:38.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.282+0000 7f1a12960640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a0c1083a0 0x7f1a0c1987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:38.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.282+0000 7f1a12960640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1a0c108cf0 0x7f1a0c19da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:38.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.282+0000 7f1a12960640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0c111860 con 0x7f1a0c1083a0 2024-09-21T01:00:38.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.282+0000 7f1a12960640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0c1116e0 con 0x7f1a0c102a60 2024-09-21T01:00:38.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.282+0000 7f1a12960640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0c1119e0 con 0x7f1a0c108cf0 2024-09-21T01:00:38.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.282+0000 7f1a0b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a0c1083a0 0x7f1a0c1987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:38.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.282+0000 7f1a0bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a0c102a60 0x7f1a0c198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:38.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.282+0000 7f1a0bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a0c102a60 0x7f1a0c198210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:58706/0 (socket says 172.21.15.1:58706) 2024-09-21T01:00:38.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.282+0000 7f1a0bfff640 1 -- 172.21.15.1:0/23827511 learned_addr learned my addr 172.21.15.1:0/23827511 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:38.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.282+0000 7f1a10efd640 1 --2- 172.21.15.1:0/23827511 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1a0c108cf0 0x7f1a0c19da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:38.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.282+0000 7f1a0bfff640 1 -- 172.21.15.1:0/23827511 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1a0c108cf0 msgr2=0x7f1a0c19da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:38.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.282+0000 7f1a0bfff640 1 --2- 172.21.15.1:0/23827511 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1a0c108cf0 0x7f1a0c19da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.282+0000 7f1a0bfff640 1 -- 172.21.15.1:0/23827511 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a0c1083a0 msgr2=0x7f1a0c1987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:38.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.282+0000 7f1a0bfff640 1 --2- 172.21.15.1:0/23827511 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a0c1083a0 0x7f1a0c1987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.283+0000 7f1a0bfff640 1 -- 172.21.15.1:0/23827511 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a0c19e180 con 0x7f1a0c102a60 2024-09-21T01:00:38.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.283+0000 7f1a0bfff640 1 --2- 172.21.15.1:0/23827511 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a0c102a60 0x7f1a0c198210 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1a00005ab0 tx=0x7f1a0002cff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:38.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.283+0000 7f1a097fa640 1 -- 172.21.15.1:0/23827511 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a00004a50 con 0x7f1a0c102a60 2024-09-21T01:00:38.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.283+0000 7f1a12960640 1 -- 172.21.15.1:0/23827511 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a0c19e410 con 0x7f1a0c102a60 2024-09-21T01:00:38.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.283+0000 7f1a097fa640 1 -- 172.21.15.1:0/23827511 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a00004030 con 0x7f1a0c102a60 2024-09-21T01:00:38.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.283+0000 7f1a097fa640 1 -- 172.21.15.1:0/23827511 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a00003bf0 con 0x7f1a0c102a60 2024-09-21T01:00:38.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.283+0000 7f1a12960640 1 -- 172.21.15.1:0/23827511 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a0c1a4bd0 con 0x7f1a0c102a60 2024-09-21T01:00:38.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.286+0000 7f1a097fa640 1 -- 172.21.15.1:0/23827511 <== mon.2 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f1a0003a070 con 0x7f1a0c102a60 2024-09-21T01:00:38.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.287+0000 7f1a097fa640 1 --2- 172.21.15.1:0/23827511 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f19f40b6510 0x7f19f40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:38.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.287+0000 7f1a18ed4740 1 Processor -- start 2024-09-21T01:00:38.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.287+0000 7f1a097fa640 1 -- 172.21.15.1:0/23827511 <== mon.2 v2:172.21.15.42:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f1a00106be0 con 0x7f1a0c102a60 2024-09-21T01:00:38.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.287+0000 7f1a0b7fe640 1 --2- 172.21.15.1:0/23827511 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f19f40b6510 0x7f19f40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:38.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.287+0000 7f1a18ed4740 1 -- start start 2024-09-21T01:00:38.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.288+0000 7f1a18ed4740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560615696070 0x560615a45e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:38.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.288+0000 7f1a18ed4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56061566d1b0 0x560615a46380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:38.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.288+0000 7f1a18ed4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560615675390 0x560615a468c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:38.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.288+0000 7f1a18ed4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5606159b3e50 con 0x56061566d1b0 2024-09-21T01:00:38.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.288+0000 7f1a18ed4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5606159a3280 con 0x560615675390 2024-09-21T01:00:38.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.288+0000 7f1a18ed4740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5606159a7090 con 0x560615696070 2024-09-21T01:00:38.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.288+0000 7f1a10efd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560615675390 0x560615a468c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:38.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.288+0000 7f1a10efd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560615675390 0x560615a468c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:58722/0 (socket says 172.21.15.1:58722) 2024-09-21T01:00:38.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.288+0000 7f1a10efd640 1 -- 172.21.15.1:0/1371682296 learned_addr learned my addr 172.21.15.1:0/1371682296 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:38.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.288+0000 7f1a0bfff640 1 --2- 172.21.15.1:0/1371682296 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560615696070 0x560615a45e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:38.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.288+0000 7f1a0b7fe640 1 --2- 172.21.15.1:0/1371682296 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56061566d1b0 0x560615a46380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:38.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.288+0000 7f1a10efd640 1 -- 172.21.15.1:0/1371682296 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560615696070 msgr2=0x560615a45e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:38.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.288+0000 7f1a10efd640 1 --2- 172.21.15.1:0/1371682296 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560615696070 0x560615a45e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.288+0000 7f1a10efd640 1 -- 172.21.15.1:0/1371682296 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56061566d1b0 msgr2=0x560615a46380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:38.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.288+0000 7f1a10efd640 1 --2- 172.21.15.1:0/1371682296 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56061566d1b0 0x560615a46380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.288+0000 7f1a10efd640 1 -- 172.21.15.1:0/1371682296 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560615701650 con 0x560615675390 2024-09-21T01:00:38.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.288+0000 7f1a0b7fe640 1 --2- 172.21.15.1:0/1371682296 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56061566d1b0 0x560615a46380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:00:38.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.288+0000 7f1a0b7fe640 1 --2- 172.21.15.1:0/23827511 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f19f40b6510 0x7f19f40b8a20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c100b70 tx=0x7f19fc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:38.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.289+0000 7f1a10efd640 1 --2- 172.21.15.1:0/1371682296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560615675390 0x560615a468c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1a04009fd0 tx=0x7f1a040118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1153ec80f48473d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:38.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.289+0000 7f19f27fc640 1 -- 172.21.15.1:0/1371682296 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a04004d20 con 0x560615675390 2024-09-21T01:00:38.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.289+0000 7f19f27fc640 1 -- 172.21.15.1:0/1371682296 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a04004050 con 0x560615675390 2024-09-21T01:00:38.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.289+0000 7f19f27fc640 1 -- 172.21.15.1:0/1371682296 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a04005280 con 0x560615675390 2024-09-21T01:00:38.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.290+0000 7f1a18ed4740 1 -- 172.21.15.1:0/1371682296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560615675390 msgr2=0x560615a468c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:38.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.290+0000 7f1a18ed4740 1 --2- 172.21.15.1:0/1371682296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560615675390 0x560615a468c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1a04009fd0 tx=0x7f1a040118d0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.290+0000 7f1a18ed4740 1 -- 172.21.15.1:0/1371682296 shutdown_connections 2024-09-21T01:00:38.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.290+0000 7f1a18ed4740 1 --2- 172.21.15.1:0/1371682296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560615675390 0x560615a468c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.290+0000 7f1a18ed4740 1 --2- 172.21.15.1:0/1371682296 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56061566d1b0 0x560615a46380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.290+0000 7f1a18ed4740 1 --2- 172.21.15.1:0/1371682296 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560615696070 0x560615a45e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.290+0000 7f1a18ed4740 1 -- 172.21.15.1:0/1371682296 >> 172.21.15.1:0/1371682296 conn(0x56061568a460 msgr2=0x560615a43d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:38.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.290+0000 7f1a18ed4740 1 -- 172.21.15.1:0/1371682296 shutdown_connections 2024-09-21T01:00:38.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.290+0000 7f1a18ed4740 1 -- 172.21.15.1:0/1371682296 wait complete. 2024-09-21T01:00:38.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.291+0000 7f1a18ed4740 1 -- start start 2024-09-21T01:00:38.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.291+0000 7f1a18ed4740 1 Processor -- start 2024-09-21T01:00:38.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.291+0000 7f1a18ed4740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56061566d1b0 0x560615a514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:38.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.292+0000 7f1a18ed4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560615675390 0x560615a51a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:38.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.292+0000 7f1a18ed4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560615696070 0x560615a51fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:38.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.292+0000 7f1a0b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560615675390 0x560615a51a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:38.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.292+0000 7f1a0bfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56061566d1b0 0x560615a514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:38.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.292+0000 7f1a0bfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56061566d1b0 0x560615a514e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:49272/0 (socket says 172.21.15.1:49272) 2024-09-21T01:00:38.522 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T01:00:38.522 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "no active scrubs running", 2024-09-21T01:00:38.522 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": {}, 2024-09-21T01:00:38.522 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_stats": { 2024-09-21T01:00:38.522 INFO:teuthology.orchestra.run.smithi001.stdout: "f826f2c1-768a-47bb-b868-785b351ac6b4": { 2024-09-21T01:00:38.522 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:59:06.554657+0000", 2024-09-21T01:00:38.522 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:00:38.522 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:00:38.522 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:00:38.522 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:00:38.523 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:00:38.523 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:00:38.523 INFO:teuthology.orchestra.run.smithi001.stdout: "1bffed0d-34b1-4e8b-9cab-7501131ef79d": { 2024-09-21T01:00:38.523 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:00:02.564228+0000", 2024-09-21T01:00:38.523 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:00:38.523 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:00:38.523 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:00:38.523 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:00:38.523 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:00:38.523 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:00:38.523 INFO:teuthology.orchestra.run.smithi001.stdout: "bee49cce-b407-4617-a959-331ffd8dc5b0": { 2024-09-21T01:00:38.523 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:58:17.883027+0000", 2024-09-21T01:00:38.523 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:00:38.523 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:00:38.523 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:00:38.524 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:00:38.524 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:00:38.524 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:00:38.524 INFO:teuthology.orchestra.run.smithi001.stdout: "7cb1bc3f-e2d2-4bf7-b13e-8f3371d7aac1": { 2024-09-21T01:00:38.524 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:58:02.751142+0000", 2024-09-21T01:00:38.524 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:00:38.524 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:00:38.524 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:00:38.524 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:00:38.524 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:00:38.524 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:00:38.524 INFO:teuthology.orchestra.run.smithi001.stdout: "2383a19c-993d-4440-99f7-93b43dcf33b4": { 2024-09-21T01:00:38.524 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:47.609257+0000", 2024-09-21T01:00:38.524 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:00:38.525 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:00:38.525 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:00:38.525 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:00:38.525 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:00:38.525 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:00:38.525 INFO:teuthology.orchestra.run.smithi001.stdout: "53fa74e4-5aa8-408b-9724-7c93618f7636": { 2024-09-21T01:00:38.525 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:01.730608+0000", 2024-09-21T01:00:38.525 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:00:38.525 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:00:38.525 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:00:38.525 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:00:38.525 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:00:38.525 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:00:38.525 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:00:38.525 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T01:00:38.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.292+0000 7f1a0bfff640 1 -- 172.21.15.1:0/945486223 learned_addr learned my addr 172.21.15.1:0/945486223 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:38.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.292+0000 7f1a10efd640 1 --2- 172.21.15.1:0/945486223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560615696070 0x560615a51fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:38.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.292+0000 7f1a0b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560615675390 0x560615a51a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:58724/0 (socket says 172.21.15.1:58724) 2024-09-21T01:00:38.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.292+0000 7f1a18ed4740 1 -- 172.21.15.1:0/945486223 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560615804700 con 0x560615696070 2024-09-21T01:00:38.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.292+0000 7f1a18ed4740 1 -- 172.21.15.1:0/945486223 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56061593e110 con 0x560615675390 2024-09-21T01:00:38.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.292+0000 7f1a18ed4740 1 -- 172.21.15.1:0/945486223 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560615a54620 con 0x56061566d1b0 2024-09-21T01:00:38.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.292+0000 7f1a18ed4740 10 client.0 _ll_register_callbacks cb 0x560615957990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:38.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.293+0000 7f1a0bfff640 1 -- 172.21.15.1:0/945486223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560615675390 msgr2=0x560615a51a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:38.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.293+0000 7f1a0bfff640 1 --2- 172.21.15.1:0/945486223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560615675390 0x560615a51a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.293+0000 7f1a0bfff640 1 -- 172.21.15.1:0/945486223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560615696070 msgr2=0x560615a51fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:38.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.293+0000 7f1a0b7fe640 1 --2- 172.21.15.1:0/945486223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560615675390 0x560615a51a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:00:38.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.293+0000 7f1a0bfff640 1 --2- 172.21.15.1:0/945486223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560615696070 0x560615a51fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.293+0000 7f1a0bfff640 1 -- 172.21.15.1:0/945486223 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56061596bc40 con 0x56061566d1b0 2024-09-21T01:00:38.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.293+0000 7f1a10efd640 1 --2- 172.21.15.1:0/945486223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560615696070 0x560615a51fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:38.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.293+0000 7f1a0bfff640 1 --2- 172.21.15.1:0/945486223 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56061566d1b0 0x560615a514e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1a001046c0 tx=0x7f1a000ccb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac8b34579c08a5f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:38.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.293+0000 7f19eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T01:00:38.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.293+0000 7f19eb7fe640 1 -- 172.21.15.1:0/945486223 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a000cc860 con 0x56061566d1b0 2024-09-21T01:00:38.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.293+0000 7f19eb7fe640 1 -- 172.21.15.1:0/945486223 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f1a000f4170 con 0x56061566d1b0 2024-09-21T01:00:38.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.293+0000 7f1a18ed4740 1 -- 172.21.15.1:0/945486223 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a04004050 con 0x56061566d1b0 2024-09-21T01:00:38.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.293+0000 7f19eb7fe640 1 -- 172.21.15.1:0/945486223 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f1a000b8110 con 0x56061566d1b0 2024-09-21T01:00:38.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.293+0000 7f1a18ed4740 10 client.26029 fetch_fsmap learned FSMap version 33 2024-09-21T01:00:38.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.294+0000 7f1a18ed4740 1 -- 172.21.15.1:0/945486223 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560615a602b0 con 0x56061566d1b0 2024-09-21T01:00:38.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.294+0000 7f19eb7fe640 1 -- 172.21.15.1:0/945486223 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a04004050 con 0x56061566d1b0 2024-09-21T01:00:38.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.294+0000 7f19eb7fe640 1 -- 172.21.15.1:0/945486223 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f1a0004c060 con 0x56061566d1b0 2024-09-21T01:00:38.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.294+0000 7f1a18ed4740 10 client.26029 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:00:38.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.294+0000 7f1a18ed4740 10 client.26029 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:00:38.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.294+0000 7f1a18ed4740 20 client.26029 populate_metadata read hostname 'smithi001' 2024-09-21T01:00:38.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.294+0000 7f1a18ed4740 1 --2- 172.21.15.1:0/945486223 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5606156549f0 0x560615a63570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:38.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.294+0000 7f1a18ed4740 4 client.26029 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:00:38.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.294+0000 7f1a18ed4740 1 -- 172.21.15.1:0/945486223 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5606159b5da0 con 0x5606156549f0 2024-09-21T01:00:38.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.295+0000 7f1a0b7fe640 1 --2- 172.21.15.1:0/945486223 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5606156549f0 0x560615a63570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:38.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.295+0000 7f19eb7fe640 10 client.26029 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:38.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.295+0000 7f1a0b7fe640 1 --2- 172.21.15.1:0/945486223 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5606156549f0 0x560615a63570 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b7af4e79cdf49f8 server_cookie=5383b2f288a52ddc in_seq=0 out_seq=0 2024-09-21T01:00:38.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.296+0000 7f19eb7fe640 1 -- 172.21.15.1:0/945486223 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5606159b5da0 con 0x5606156549f0 2024-09-21T01:00:38.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.296+0000 7f19eb7fe640 10 client.26029 handle_command_reply: tid=0 2024-09-21T01:00:38.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.296+0000 7f1a18ed4740 1 client.26029 shutdown 2024-09-21T01:00:38.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.296+0000 7f1a18ed4740 1 -- 172.21.15.1:0/945486223 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56061566d1b0 msgr2=0x560615a514e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:38.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.296+0000 7f1a18ed4740 1 --2- 172.21.15.1:0/945486223 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56061566d1b0 0x560615a514e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1a001046c0 tx=0x7f1a000ccb20 comp rx=0 tx=0).stop 2024-09-21T01:00:38.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.296+0000 7f1a18ed4740 1 -- 172.21.15.1:0/945486223 shutdown_connections 2024-09-21T01:00:38.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.296+0000 7f1a18ed4740 1 --2- 172.21.15.1:0/945486223 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5606156549f0 0x560615a63570 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.297+0000 7f1a18ed4740 1 --2- 172.21.15.1:0/945486223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560615696070 0x560615a51fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.297+0000 7f19eb7fe640 0 client.26029 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:38.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.297+0000 7f1a18ed4740 1 --2- 172.21.15.1:0/945486223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560615675390 0x560615a51a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.297+0000 7f1a18ed4740 1 --2- 172.21.15.1:0/945486223 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56061566d1b0 0x560615a514e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.297+0000 7f1a18ed4740 1 -- 172.21.15.1:0/945486223 >> 172.21.15.1:0/945486223 conn(0x56061568a460 msgr2=0x560615a48fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:38.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.297+0000 7f1a18ed4740 1 -- 172.21.15.1:0/945486223 shutdown_connections 2024-09-21T01:00:38.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.297+0000 7f1a18ed4740 1 -- 172.21.15.1:0/945486223 wait complete. 2024-09-21T01:00:38.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.297+0000 7f1a18ed4740 20 client.26029 trim_cache size 0 max 16384 2024-09-21T01:00:38.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.316+0000 7f1a18ed4740 1 Processor -- start 2024-09-21T01:00:38.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.316+0000 7f1a18ed4740 1 -- start start 2024-09-21T01:00:38.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.316+0000 7f1a18ed4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5606156549f0 0x560615a519a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:38.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.316+0000 7f1a18ed4740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56061566d1b0 0x560615a4e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:38.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.316+0000 7f1a18ed4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560615675390 0x560615a4ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:38.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.316+0000 7f1a18ed4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0c1ad170 con 0x5606156549f0 2024-09-21T01:00:38.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.316+0000 7f1a18ed4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0c1aed70 con 0x560615675390 2024-09-21T01:00:38.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.316+0000 7f1a18ed4740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0c1ad840 con 0x56061566d1b0 2024-09-21T01:00:38.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.317+0000 7f1a0bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5606156549f0 0x560615a519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:38.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.317+0000 7f1a0b7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56061566d1b0 0x560615a4e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:38.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.317+0000 7f1a0b7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56061566d1b0 0x560615a4e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:49274/0 (socket says 172.21.15.1:49274) 2024-09-21T01:00:38.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.317+0000 7f1a0bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5606156549f0 0x560615a519a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33132/0 (socket says 172.21.15.1:33132) 2024-09-21T01:00:38.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.317+0000 7f1a0b7fe640 1 -- 172.21.15.1:0/2873356420 learned_addr learned my addr 172.21.15.1:0/2873356420 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:38.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.317+0000 7f1a10efd640 1 --2- 172.21.15.1:0/2873356420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560615675390 0x560615a4ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:38.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.317+0000 7f1a0bfff640 1 -- 172.21.15.1:0/2873356420 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56061566d1b0 msgr2=0x560615a4e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:38.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.317+0000 7f1a0bfff640 1 --2- 172.21.15.1:0/2873356420 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56061566d1b0 0x560615a4e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.317+0000 7f1a0bfff640 1 -- 172.21.15.1:0/2873356420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560615675390 msgr2=0x560615a4ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:38.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.317+0000 7f1a0bfff640 1 --2- 172.21.15.1:0/2873356420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560615675390 0x560615a4ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.317+0000 7f1a0bfff640 1 -- 172.21.15.1:0/2873356420 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560615a63a80 con 0x5606156549f0 2024-09-21T01:00:38.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.317+0000 7f1a0bfff640 1 --2- 172.21.15.1:0/2873356420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5606156549f0 0x560615a519a0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f1a000036a0 tx=0x7f1a000ccc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7943835e19bed7cd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:38.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.317+0000 7f19f1ffb640 1 -- 172.21.15.1:0/2873356420 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a000c93a0 con 0x5606156549f0 2024-09-21T01:00:38.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.318+0000 7f19f1ffb640 1 -- 172.21.15.1:0/2873356420 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a0002e040 con 0x5606156549f0 2024-09-21T01:00:38.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.318+0000 7f19f1ffb640 1 -- 172.21.15.1:0/2873356420 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a000cc6a0 con 0x5606156549f0 2024-09-21T01:00:38.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.318+0000 7f1a18ed4740 1 -- 172.21.15.1:0/2873356420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5606156549f0 msgr2=0x560615a519a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:38.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.318+0000 7f1a18ed4740 1 --2- 172.21.15.1:0/2873356420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5606156549f0 0x560615a519a0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f1a000036a0 tx=0x7f1a000ccc50 comp rx=0 tx=0).stop 2024-09-21T01:00:38.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.319+0000 7f1a18ed4740 1 -- 172.21.15.1:0/2873356420 shutdown_connections 2024-09-21T01:00:38.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.319+0000 7f1a18ed4740 1 --2- 172.21.15.1:0/2873356420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560615675390 0x560615a4ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.319+0000 7f1a18ed4740 1 --2- 172.21.15.1:0/2873356420 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56061566d1b0 0x560615a4e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.319+0000 7f1a18ed4740 1 --2- 172.21.15.1:0/2873356420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5606156549f0 0x560615a519a0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.319+0000 7f1a18ed4740 1 -- 172.21.15.1:0/2873356420 >> 172.21.15.1:0/2873356420 conn(0x56061568a460 msgr2=0x560615a51290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:38.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.319+0000 7f1a18ed4740 1 -- 172.21.15.1:0/2873356420 shutdown_connections 2024-09-21T01:00:38.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.319+0000 7f1a18ed4740 1 -- 172.21.15.1:0/2873356420 wait complete. 2024-09-21T01:00:38.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.319+0000 7f1a18ed4740 1 -- start start 2024-09-21T01:00:38.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.319+0000 7f1a18ed4740 1 Processor -- start 2024-09-21T01:00:38.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.320+0000 7f1a18ed4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606156549f0 0x560615a59f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:38.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.320+0000 7f1a18ed4740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56061566d1b0 0x560615a553c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:38.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.320+0000 7f1a18ed4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560615675390 0x560615a55900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:38.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.320+0000 7f1a18ed4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0c1ae6a0 con 0x560615675390 2024-09-21T01:00:38.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.320+0000 7f1a0bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606156549f0 0x560615a59f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:38.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.320+0000 7f1a18ed4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0c1adfd0 con 0x5606156549f0 2024-09-21T01:00:38.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.320+0000 7f1a18ed4740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0c1ab150 con 0x56061566d1b0 2024-09-21T01:00:38.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.320+0000 7f1a0bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606156549f0 0x560615a59f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:58728/0 (socket says 172.21.15.1:58728) 2024-09-21T01:00:38.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.320+0000 7f1a0bfff640 1 -- 172.21.15.1:0/2632879298 learned_addr learned my addr 172.21.15.1:0/2632879298 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:38.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.320+0000 7f1a18ed4740 10 client.0 _ll_register_callbacks cb 0x7f1a00009230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:38.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.320+0000 7f1a10efd640 1 --2- 172.21.15.1:0/2632879298 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560615675390 0x560615a55900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:38.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.320+0000 7f1a0b7fe640 1 --2- 172.21.15.1:0/2632879298 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56061566d1b0 0x560615a553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:38.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.320+0000 7f1a0bfff640 1 -- 172.21.15.1:0/2632879298 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56061566d1b0 msgr2=0x560615a553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:38.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.320+0000 7f1a0bfff640 1 --2- 172.21.15.1:0/2632879298 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56061566d1b0 0x560615a553c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.320+0000 7f1a0bfff640 1 -- 172.21.15.1:0/2632879298 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560615675390 msgr2=0x560615a55900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:38.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.320+0000 7f1a0bfff640 1 --2- 172.21.15.1:0/2632879298 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560615675390 0x560615a55900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.320+0000 7f1a0bfff640 1 -- 172.21.15.1:0/2632879298 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560615a55f10 con 0x5606156549f0 2024-09-21T01:00:38.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.321+0000 7f1a0b7fe640 1 --2- 172.21.15.1:0/2632879298 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56061566d1b0 0x560615a553c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:00:38.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.321+0000 7f1a0bfff640 1 --2- 172.21.15.1:0/2632879298 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606156549f0 0x560615a59f10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1a00004c30 tx=0x7f1a000cc1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b76f138a5d1e4ee2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:38.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.321+0000 7f19eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:00:38.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.321+0000 7f19eb7fe640 1 -- 172.21.15.1:0/2632879298 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a000cc6a0 con 0x5606156549f0 2024-09-21T01:00:38.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.321+0000 7f19eb7fe640 1 -- 172.21.15.1:0/2632879298 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f1a000f00f0 con 0x5606156549f0 2024-09-21T01:00:38.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.321+0000 7f1a18ed4740 1 -- 172.21.15.1:0/2632879298 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a0002e040 con 0x5606156549f0 2024-09-21T01:00:38.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.321+0000 7f19eb7fe640 1 -- 172.21.15.1:0/2632879298 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f1a000ac070 con 0x5606156549f0 2024-09-21T01:00:38.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.321+0000 7f1a18ed4740 10 client.26129 fetch_fsmap learned FSMap version 33 2024-09-21T01:00:38.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.321+0000 7f1a18ed4740 1 -- 172.21.15.1:0/2632879298 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560615a55f10 con 0x5606156549f0 2024-09-21T01:00:38.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.321+0000 7f19eb7fe640 1 -- 172.21.15.1:0/2632879298 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a000cc860 con 0x5606156549f0 2024-09-21T01:00:38.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.322+0000 7f19eb7fe640 1 -- 172.21.15.1:0/2632879298 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f1a000cba20 con 0x5606156549f0 2024-09-21T01:00:38.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.322+0000 7f1a18ed4740 10 client.26129 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:00:38.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.322+0000 7f1a18ed4740 10 client.26129 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:00:38.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.322+0000 7f1a18ed4740 20 client.26129 populate_metadata read hostname 'smithi001' 2024-09-21T01:00:38.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.322+0000 7f1a18ed4740 1 --2- 172.21.15.1:0/2632879298 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560615696070 0x560615ad0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:38.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.322+0000 7f1a18ed4740 4 client.26129 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:00:38.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.322+0000 7f1a18ed4740 1 -- 172.21.15.1:0/2632879298 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f1a0002e040 con 0x560615696070 2024-09-21T01:00:38.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.322+0000 7f1a0b7fe640 1 --2- 172.21.15.1:0/2632879298 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560615696070 0x560615ad0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:38.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.323+0000 7f19eb7fe640 10 client.26129 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:38.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.323+0000 7f1a0b7fe640 1 --2- 172.21.15.1:0/2632879298 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560615696070 0x560615ad0040 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b278a98355a8780 server_cookie=a2c11483d951eca5 in_seq=0 out_seq=0 2024-09-21T01:00:38.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.323+0000 7f19eb7fe640 1 -- 172.21.15.1:0/2632879298 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1794 (crc 0 0 0) 0x7f1a0002e040 con 0x560615696070 2024-09-21T01:00:38.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.323+0000 7f19eb7fe640 10 client.26129 handle_command_reply: tid=0 2024-09-21T01:00:38.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.323+0000 7f1a18ed4740 1 client.26129 shutdown 2024-09-21T01:00:38.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.323+0000 7f1a18ed4740 1 -- 172.21.15.1:0/2632879298 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606156549f0 msgr2=0x560615a59f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:38.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.323+0000 7f1a18ed4740 1 --2- 172.21.15.1:0/2632879298 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606156549f0 0x560615a59f10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1a00004c30 tx=0x7f1a000cc1e0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.323+0000 7f1a18ed4740 1 -- 172.21.15.1:0/2632879298 shutdown_connections 2024-09-21T01:00:38.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.323+0000 7f1a18ed4740 1 --2- 172.21.15.1:0/2632879298 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560615696070 0x560615ad0040 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.323+0000 7f1a18ed4740 1 --2- 172.21.15.1:0/2632879298 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560615675390 0x560615a55900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.323+0000 7f1a18ed4740 1 --2- 172.21.15.1:0/2632879298 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56061566d1b0 0x560615a553c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.323+0000 7f19eb7fe640 0 client.26129 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:38.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.323+0000 7f1a18ed4740 1 --2- 172.21.15.1:0/2632879298 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606156549f0 0x560615a59f10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.323+0000 7f1a18ed4740 1 -- 172.21.15.1:0/2632879298 >> 172.21.15.1:0/2632879298 conn(0x56061568a460 msgr2=0x560615a52990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:38.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.323+0000 7f1a18ed4740 1 -- 172.21.15.1:0/2632879298 shutdown_connections 2024-09-21T01:00:38.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.323+0000 7f1a18ed4740 1 -- 172.21.15.1:0/2632879298 wait complete. 2024-09-21T01:00:38.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.324+0000 7f1a18ed4740 20 client.26129 trim_cache size 0 max 16384 2024-09-21T01:00:38.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.324+0000 7f1a12960640 1 -- 172.21.15.1:0/23827511 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f19f40b6510 msgr2=0x7f19f40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:38.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.324+0000 7f1a12960640 1 --2- 172.21.15.1:0/23827511 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f19f40b6510 0x7f19f40b8a20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c100b70 tx=0x7f19fc005f90 comp rx=0 tx=0).stop 2024-09-21T01:00:38.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.324+0000 7f1a12960640 1 -- 172.21.15.1:0/23827511 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a0c102a60 msgr2=0x7f1a0c198210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:38.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.324+0000 7f1a12960640 1 --2- 172.21.15.1:0/23827511 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a0c102a60 0x7f1a0c198210 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1a00005ab0 tx=0x7f1a0002cff0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.324+0000 7f1a12960640 1 -- 172.21.15.1:0/23827511 shutdown_connections 2024-09-21T01:00:38.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.324+0000 7f1a12960640 1 --2- 172.21.15.1:0/23827511 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1a0c108cf0 0x7f1a0c19da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.324+0000 7f1a12960640 1 --2- 172.21.15.1:0/23827511 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f19f40b6510 0x7f19f40b8a20 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.324+0000 7f1a12960640 1 --2- 172.21.15.1:0/23827511 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a0c1083a0 0x7f1a0c1987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.324+0000 7f1a12960640 1 --2- 172.21.15.1:0/23827511 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a0c102a60 0x7f1a0c198210 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.324+0000 7f1a12960640 1 -- 172.21.15.1:0/23827511 >> 172.21.15.1:0/23827511 conn(0x7f1a0c079730 msgr2=0x7f1a0c101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:38.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.325+0000 7f1a12960640 1 -- 172.21.15.1:0/23827511 shutdown_connections 2024-09-21T01:00:38.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:38.325+0000 7f1a12960640 1 -- 172.21.15.1:0/23827511 wait complete. 2024-09-21T01:00:39.506 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T01:00:39.506 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:00:39.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:39 smithi001 ceph-mon[31211]: pgmap v461: 97 pgs: 97 active+clean; 428 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 149 op/s 2024-09-21T01:00:39.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:39 smithi193 ceph-mon[34660]: pgmap v461: 97 pgs: 97 active+clean; 428 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 149 op/s 2024-09-21T01:00:39.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:39 smithi042 ceph-mon[34481]: pgmap v461: 97 pgs: 97 active+clean; 428 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 149 op/s 2024-09-21T01:00:39.782 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:00:40.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.414+0000 7fc9b578d640 1 -- 172.21.15.1:0/2803138071 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9b0108d20 msgr2=0x7fc9b010f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:40.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.414+0000 7fc9b578d640 1 --2- 172.21.15.1:0/2803138071 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9b0108d20 0x7fc9b010f550 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8009900 tx=0x7fc9a802a410 comp rx=0 tx=0).stop 2024-09-21T01:00:40.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.414+0000 7fc9b578d640 1 -- 172.21.15.1:0/2803138071 shutdown_connections 2024-09-21T01:00:40.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.414+0000 7fc9b578d640 1 --2- 172.21.15.1:0/2803138071 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9b0108d20 0x7fc9b010f550 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:40.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.414+0000 7fc9b578d640 1 --2- 172.21.15.1:0/2803138071 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9b01083d0 0x7fc9b01087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:40.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.414+0000 7fc9b578d640 1 --2- 172.21.15.1:0/2803138071 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc9b0102ae0 0x7fc9b0102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:40.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.414+0000 7fc9b578d640 1 -- 172.21.15.1:0/2803138071 >> 172.21.15.1:0/2803138071 conn(0x7fc9b0079790 msgr2=0x7fc9b0079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:40.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.414+0000 7fc9b578d640 1 -- 172.21.15.1:0/2803138071 shutdown_connections 2024-09-21T01:00:40.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.414+0000 7fc9b578d640 1 -- 172.21.15.1:0/2803138071 wait complete. 2024-09-21T01:00:40.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.415+0000 7fc9b578d640 1 Processor -- start 2024-09-21T01:00:40.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.415+0000 7fc9b578d640 1 -- start start 2024-09-21T01:00:40.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.416+0000 7fc9b578d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9b0102ae0 0x7fc9b0199050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:40.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.416+0000 7fc9b578d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9b01083d0 0x7fc9b0199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:40.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.416+0000 7fc9b578d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc9b0108d20 0x7fc9b0199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:40.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.416+0000 7fc9b578d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b0112a30 con 0x7fc9b0102ae0 2024-09-21T01:00:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.416+0000 7fc9b578d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b01128b0 con 0x7fc9b01083d0 2024-09-21T01:00:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.416+0000 7fc9b578d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b0112bb0 con 0x7fc9b0108d20 2024-09-21T01:00:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.416+0000 7fc9aeffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9b0102ae0 0x7fc9b0199050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.416+0000 7fc9ae7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9b01083d0 0x7fc9b0199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.416+0000 7fc9aeffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9b0102ae0 0x7fc9b0199050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54786/0 (socket says 172.21.15.1:54786) 2024-09-21T01:00:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.416+0000 7fc9aeffd640 1 -- 172.21.15.1:0/2208263796 learned_addr learned my addr 172.21.15.1:0/2208263796 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.416+0000 7fc9af7fe640 1 --2- 172.21.15.1:0/2208263796 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc9b0108d20 0x7fc9b0199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.416+0000 7fc9ae7fc640 1 -- 172.21.15.1:0/2208263796 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc9b0108d20 msgr2=0x7fc9b0199ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.416+0000 7fc9ae7fc640 1 --2- 172.21.15.1:0/2208263796 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc9b0108d20 0x7fc9b0199ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.416+0000 7fc9ae7fc640 1 -- 172.21.15.1:0/2208263796 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9b0102ae0 msgr2=0x7fc9b0199050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.416+0000 7fc9ae7fc640 1 --2- 172.21.15.1:0/2208263796 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9b0102ae0 0x7fc9b0199050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.416+0000 7fc9ae7fc640 1 -- 172.21.15.1:0/2208263796 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b01a86d0 con 0x7fc9b01083d0 2024-09-21T01:00:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.416+0000 7fc9aeffd640 1 --2- 172.21.15.1:0/2208263796 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9b0102ae0 0x7fc9b0199050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.416+0000 7fc9ae7fc640 1 --2- 172.21.15.1:0/2208263796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9b01083d0 0x7fc9b0199590 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc9b006ab20 tx=0x7fc9a400ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.417+0000 7fc997fff640 1 -- 172.21.15.1:0/2208263796 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4010430 con 0x7fc9b01083d0 2024-09-21T01:00:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.417+0000 7fc9b578d640 1 -- 172.21.15.1:0/2208263796 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9b01a8960 con 0x7fc9b01083d0 2024-09-21T01:00:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.417+0000 7fc997fff640 1 -- 172.21.15.1:0/2208263796 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9a4010a80 con 0x7fc9b01083d0 2024-09-21T01:00:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.417+0000 7fc997fff640 1 -- 172.21.15.1:0/2208263796 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4017a20 con 0x7fc9b01083d0 2024-09-21T01:00:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.417+0000 7fc9b578d640 1 -- 172.21.15.1:0/2208263796 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9b01a8ef0 con 0x7fc9b01083d0 2024-09-21T01:00:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.418+0000 7fc9b578d640 1 -- 172.21.15.1:0/2208263796 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9b0102ef0 con 0x7fc9b01083d0 2024-09-21T01:00:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.420+0000 7fc997fff640 1 -- 172.21.15.1:0/2208263796 <== mon.2 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7fc9a4017be0 con 0x7fc9b01083d0 2024-09-21T01:00:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.421+0000 7fc997fff640 1 --2- 172.21.15.1:0/2208263796 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc9980b6510 0x7fc9980b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.421+0000 7fc9aeffd640 1 --2- 172.21.15.1:0/2208263796 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc9980b6510 0x7fc9980b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.421+0000 7fc997fff640 1 -- 172.21.15.1:0/2208263796 <== mon.2 v2:172.21.15.42:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fc9a40e7d20 con 0x7fc9b01083d0 2024-09-21T01:00:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.421+0000 7fc9aeffd640 1 --2- 172.21.15.1:0/2208263796 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc9980b6510 0x7fc9980b8a20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0104a90 tx=0x7fc9a000a380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:40.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.428+0000 7fc997fff640 1 -- 172.21.15.1:0/2208263796 <== mon.2 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc9a40ae620 con 0x7fc9b01083d0 2024-09-21T01:00:40.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.663+0000 7fc9b578d640 1 -- 172.21.15.1:0/2208263796 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc9b006bc30 con 0x7fc9b01083d0 2024-09-21T01:00:40.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.664+0000 7fc997fff640 1 -- 172.21.15.1:0/2208263796 <== mon.2 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11962 (secure 0 0 0) 0x7fc9b006bc30 con 0x7fc9b01083d0 2024-09-21T01:00:40.666 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T01:00:40.666 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":33,"btime":"2024-09-21T01:00:33:343470+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2810186677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2810186677},{"type":"v1","addr":"172.21.15.1:6835","nonce":2810186677}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14736,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3935320478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3935320478},{"type":"v1","addr":"172.21.15.1:6837","nonce":3935320478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:54:58.592853+0000","modified":"2024-09-21T01:00:33.134699+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24653,"mds_1":24637,"mds_2":24626,"mds_3":24622,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/2125703572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2125703572},{"type":"v1","addr":"172.21.15.1:6839","nonce":2125703572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/3860445313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860445313},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860445313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6833/712170939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":712170939},{"type":"v1","addr":"172.21.15.193:6833","nonce":712170939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6833/1653911656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1653911656},{"type":"v1","addr":"172.21.15.42:6833","nonce":1653911656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6835/793085918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":793085918},{"type":"v1","addr":"172.21.15.42:6835","nonce":793085918}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6835/3631682268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":3631682268},{"type":"v1","addr":"172.21.15.193:6835","nonce":3631682268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.193:6837/909252228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":909252228},{"type":"v1","addr":"172.21.15.193:6837","nonce":909252228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.42:6837/2395608508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2395608508},{"type":"v1","addr":"172.21.15.42:6837","nonce":2395608508}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.193:6839/1365361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1365361177},{"type":"v1","addr":"172.21.15.193:6839","nonce":1365361177}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6839/2526476666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2526476666},{"type":"v1","addr":"172.21.15.42:6839","nonce":2526476666}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24610,24622,24626,24637,24653]},"id":1}]} 2024-09-21T01:00:40.667 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 33 2024-09-21T01:00:40.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.667+0000 7fc9b578d640 1 -- 172.21.15.1:0/2208263796 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc9980b6510 msgr2=0x7fc9980b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:40.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.667+0000 7fc9b578d640 1 --2- 172.21.15.1:0/2208263796 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc9980b6510 0x7fc9980b8a20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0104a90 tx=0x7fc9a000a380 comp rx=0 tx=0).stop 2024-09-21T01:00:40.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.667+0000 7fc9b578d640 1 -- 172.21.15.1:0/2208263796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9b01083d0 msgr2=0x7fc9b0199590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:40.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.667+0000 7fc9b578d640 1 --2- 172.21.15.1:0/2208263796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9b01083d0 0x7fc9b0199590 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc9b006ab20 tx=0x7fc9a400ef90 comp rx=0 tx=0).stop 2024-09-21T01:00:40.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.667+0000 7fc9b578d640 1 -- 172.21.15.1:0/2208263796 shutdown_connections 2024-09-21T01:00:40.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.667+0000 7fc9b578d640 1 --2- 172.21.15.1:0/2208263796 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc9b0108d20 0x7fc9b0199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:40.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.667+0000 7fc9b578d640 1 --2- 172.21.15.1:0/2208263796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9b01083d0 0x7fc9b0199590 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:40.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.667+0000 7fc9b578d640 1 --2- 172.21.15.1:0/2208263796 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc9980b6510 0x7fc9980b8a20 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:40.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.667+0000 7fc9b578d640 1 --2- 172.21.15.1:0/2208263796 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9b0102ae0 0x7fc9b0199050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:40.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.667+0000 7fc9b578d640 1 -- 172.21.15.1:0/2208263796 >> 172.21.15.1:0/2208263796 conn(0x7fc9b0079790 msgr2=0x7fc9b0106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:40.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.667+0000 7fc9b578d640 1 -- 172.21.15.1:0/2208263796 shutdown_connections 2024-09-21T01:00:40.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:40.667+0000 7fc9b578d640 1 -- 172.21.15.1:0/2208263796 wait complete. 2024-09-21T01:00:41.507 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T01:00:41.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:41 smithi001 ceph-mon[31211]: pgmap v462: 97 pgs: 97 active+clean; 428 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 791 KiB/s rd, 1.4 MiB/s wr, 122 op/s 2024-09-21T01:00:41.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:41 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/2208263796' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:00:41.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:41 smithi193 ceph-mon[34660]: pgmap v462: 97 pgs: 97 active+clean; 428 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 791 KiB/s rd, 1.4 MiB/s wr, 122 op/s 2024-09-21T01:00:41.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:41 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/2208263796' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:00:41.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:41 smithi042 ceph-mon[34481]: pgmap v462: 97 pgs: 97 active+clean; 428 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 791 KiB/s rd, 1.4 MiB/s wr, 122 op/s 2024-09-21T01:00:41.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:41 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/2208263796' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:00:41.769 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:00:42.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.311+0000 7f1ffa90e640 1 -- 172.21.15.1:0/326089514 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ff4109e40 msgr2=0x7f1ff4110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:42.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.311+0000 7f1ffa90e640 1 --2- 172.21.15.1:0/326089514 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ff4109e40 0x7f1ff4110670 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f1fec009ca0 tx=0x7f1fec02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.311+0000 7f1ffa90e640 1 -- 172.21.15.1:0/326089514 shutdown_connections 2024-09-21T01:00:42.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.311+0000 7f1ffa90e640 1 --2- 172.21.15.1:0/326089514 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ff4109e40 0x7f1ff4110670 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.311+0000 7f1ffa90e640 1 --2- 172.21.15.1:0/326089514 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ff41094f0 0x7f1ff4109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.311+0000 7f1ffa90e640 1 --2- 172.21.15.1:0/326089514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ff4103bb0 0x7f1ff4103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.311+0000 7f1ffa90e640 1 -- 172.21.15.1:0/326089514 >> 172.21.15.1:0/326089514 conn(0x7f1ff40ff600 msgr2=0x7f1ff4101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:42.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.311+0000 7f1ffa90e640 1 -- 172.21.15.1:0/326089514 shutdown_connections 2024-09-21T01:00:42.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.311+0000 7f1ffa90e640 1 -- 172.21.15.1:0/326089514 wait complete. 2024-09-21T01:00:42.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.312+0000 7f1ffa90e640 1 Processor -- start 2024-09-21T01:00:42.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.312+0000 7f1ffa90e640 1 -- start start 2024-09-21T01:00:42.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.312+0000 7f1ffa90e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ff4103bb0 0x7f1ff419c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.312+0000 7f1ffa90e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ff41094f0 0x7f1ff419cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.312+0000 7f1ffa90e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ff4109e40 0x7f1ff41a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.312+0000 7f1ffa90e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff4113b00 con 0x7f1ff4103bb0 2024-09-21T01:00:42.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.312+0000 7f1ffa90e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff4113980 con 0x7f1ff41094f0 2024-09-21T01:00:42.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.312+0000 7f1ffa90e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff4113c80 con 0x7f1ff4109e40 2024-09-21T01:00:42.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.312+0000 7f1ff3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ff4103bb0 0x7f1ff419c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.312+0000 7f1ff3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ff4103bb0 0x7f1ff419c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54808/0 (socket says 172.21.15.1:54808) 2024-09-21T01:00:42.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.312+0000 7f1ff3fff640 1 -- 172.21.15.1:0/3129576047 learned_addr learned my addr 172.21.15.1:0/3129576047 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:42.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.312+0000 7f1ff37fe640 1 --2- 172.21.15.1:0/3129576047 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ff41094f0 0x7f1ff419cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.313+0000 7f1ff8eab640 1 --2- 172.21.15.1:0/3129576047 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ff4109e40 0x7f1ff41a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.313+0000 7f1ff3fff640 1 -- 172.21.15.1:0/3129576047 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ff4109e40 msgr2=0x7f1ff41a1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:42.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.313+0000 7f1ff3fff640 1 --2- 172.21.15.1:0/3129576047 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ff4109e40 0x7f1ff41a1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.313+0000 7f1ff3fff640 1 -- 172.21.15.1:0/3129576047 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ff41094f0 msgr2=0x7f1ff419cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:42.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.313+0000 7f1ff3fff640 1 --2- 172.21.15.1:0/3129576047 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ff41094f0 0x7f1ff419cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.313+0000 7f1ff3fff640 1 -- 172.21.15.1:0/3129576047 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff41a25e0 con 0x7f1ff4103bb0 2024-09-21T01:00:42.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.313+0000 7f1ff8eab640 1 --2- 172.21.15.1:0/3129576047 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ff4109e40 0x7f1ff41a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:00:42.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.313+0000 7f1ff3fff640 1 --2- 172.21.15.1:0/3129576047 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ff4103bb0 0x7f1ff419c670 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f1fe400e9f0 tx=0x7f1fe400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:42.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.313+0000 7f1ff17fa640 1 -- 172.21.15.1:0/3129576047 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe400cd80 con 0x7f1ff4103bb0 2024-09-21T01:00:42.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.313+0000 7f1ffa90e640 1 -- 172.21.15.1:0/3129576047 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ff41a28d0 con 0x7f1ff4103bb0 2024-09-21T01:00:42.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.313+0000 7f1ff17fa640 1 -- 172.21.15.1:0/3129576047 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1fe40108e0 con 0x7f1ff4103bb0 2024-09-21T01:00:42.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.313+0000 7f1ff17fa640 1 -- 172.21.15.1:0/3129576047 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe4018980 con 0x7f1ff4103bb0 2024-09-21T01:00:42.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.313+0000 7f1ffa90e640 1 -- 172.21.15.1:0/3129576047 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ff41a9030 con 0x7f1ff4103bb0 2024-09-21T01:00:42.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.316+0000 7f2000e82740 1 Processor -- start 2024-09-21T01:00:42.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.316+0000 7f2000e82740 1 -- start start 2024-09-21T01:00:42.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.316+0000 7f1ff17fa640 1 -- 172.21.15.1:0/3129576047 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f1fe4018b20 con 0x7f1ff4103bb0 2024-09-21T01:00:42.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.316+0000 7f2000e82740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564aafe16070 0x564ab01bd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.316+0000 7f2000e82740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564aafded1b0 0x564ab01bd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.316+0000 7f2000e82740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564aafdf5390 0x564ab01bdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.316+0000 7f2000e82740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564ab0133ea0 con 0x564aafded1b0 2024-09-21T01:00:42.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.316+0000 7f2000e82740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564ab01232d0 con 0x564aafdf5390 2024-09-21T01:00:42.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.316+0000 7f2000e82740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564ab01270e0 con 0x564aafe16070 2024-09-21T01:00:42.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.316+0000 7f1ff3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564aafded1b0 0x564ab01bd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.316+0000 7f1ff37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564aafdf5390 0x564ab01bdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.316+0000 7f1ff3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564aafded1b0 0x564ab01bd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54816/0 (socket says 172.21.15.1:54816) 2024-09-21T01:00:42.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.316+0000 7f1ff3fff640 1 -- 172.21.15.1:0/642641801 learned_addr learned my addr 172.21.15.1:0/642641801 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:42.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.316+0000 7f1ff8eab640 1 --2- 172.21.15.1:0/642641801 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564aafe16070 0x564ab01bd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.317+0000 7f1ff3fff640 1 -- 172.21.15.1:0/642641801 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564aafe16070 msgr2=0x564ab01bd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:42.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.317+0000 7f1ff3fff640 1 --2- 172.21.15.1:0/642641801 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564aafe16070 0x564ab01bd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.317+0000 7f1ff3fff640 1 -- 172.21.15.1:0/642641801 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564aafdf5390 msgr2=0x564ab01bdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:42.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.317+0000 7f1ff3fff640 1 --2- 172.21.15.1:0/642641801 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564aafdf5390 0x564ab01bdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.317+0000 7f1ff3fff640 1 -- 172.21.15.1:0/642641801 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564aafe81650 con 0x564aafded1b0 2024-09-21T01:00:42.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.317+0000 7f1ff37fe640 1 --2- 172.21.15.1:0/642641801 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564aafdf5390 0x564ab01bdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:42.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.317+0000 7f1ff3fff640 1 --2- 172.21.15.1:0/642641801 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564aafded1b0 0x564ab01bd800 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f1fe40edc10 tx=0x7f1fe40ef690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=920fe7cc5c3907fb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:42.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.317+0000 7f1ff17fa640 1 --2- 172.21.15.1:0/3129576047 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f1fdc0b6510 0x7f1fdc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.317+0000 7f1fda7fc640 1 -- 172.21.15.1:0/642641801 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe40f6070 con 0x564aafded1b0 2024-09-21T01:00:42.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.317+0000 7f1ff8eab640 1 --2- 172.21.15.1:0/3129576047 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f1fdc0b6510 0x7f1fdc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.317+0000 7f1fda7fc640 1 -- 172.21.15.1:0/642641801 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1fe40713c0 con 0x564aafded1b0 2024-09-21T01:00:42.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.317+0000 7f1fda7fc640 1 -- 172.21.15.1:0/642641801 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe40ad670 con 0x564aafded1b0 2024-09-21T01:00:42.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.317+0000 7f1ff17fa640 1 -- 172.21.15.1:0/3129576047 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f1fe40e7730 con 0x7f1ff4103bb0 2024-09-21T01:00:42.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.318+0000 7f2000e82740 1 -- 172.21.15.1:0/642641801 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564aafded1b0 msgr2=0x564ab01bd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:42.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.318+0000 7f1ff8eab640 1 --2- 172.21.15.1:0/3129576047 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f1fdc0b6510 0x7f1fdc0b8a20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1fec004af0 tx=0x7f1fec005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:42.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.318+0000 7f2000e82740 1 --2- 172.21.15.1:0/642641801 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564aafded1b0 0x564ab01bd800 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f1fe40edc10 tx=0x7f1fe40ef690 comp rx=0 tx=0).stop 2024-09-21T01:00:42.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.318+0000 7f2000e82740 1 -- 172.21.15.1:0/642641801 shutdown_connections 2024-09-21T01:00:42.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.318+0000 7f2000e82740 1 --2- 172.21.15.1:0/642641801 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564aafdf5390 0x564ab01bdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.318+0000 7f2000e82740 1 --2- 172.21.15.1:0/642641801 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564aafded1b0 0x564ab01bd800 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.318+0000 7f2000e82740 1 --2- 172.21.15.1:0/642641801 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564aafe16070 0x564ab01bd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.318+0000 7f2000e82740 1 -- 172.21.15.1:0/642641801 >> 172.21.15.1:0/642641801 conn(0x564aafe0a460 msgr2=0x564ab01bb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:42.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.318+0000 7f2000e82740 1 -- 172.21.15.1:0/642641801 shutdown_connections 2024-09-21T01:00:42.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.318+0000 7f2000e82740 1 -- 172.21.15.1:0/642641801 wait complete. 2024-09-21T01:00:42.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.319+0000 7f2000e82740 1 -- start start 2024-09-21T01:00:42.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.319+0000 7f2000e82740 1 Processor -- start 2024-09-21T01:00:42.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.320+0000 7f2000e82740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564aafded1b0 0x564ab01c8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.320+0000 7f2000e82740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564aafdf5390 0x564ab01c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.320+0000 7f2000e82740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564aafe16070 0x564ab01d4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.320+0000 7f2000e82740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564aaff84700 con 0x564aafded1b0 2024-09-21T01:00:42.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.320+0000 7f2000e82740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564ab00be160 con 0x564aafdf5390 2024-09-21T01:00:42.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.320+0000 7f2000e82740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564ab01cbaa0 con 0x564aafe16070 2024-09-21T01:00:42.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.320+0000 7f2000e82740 10 client.0 _ll_register_callbacks cb 0x564ab00d79e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:42.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.320+0000 7f1ff3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564aafded1b0 0x564ab01c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.320+0000 7f1ff37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564aafdf5390 0x564ab01c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.320+0000 7f1ff3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564aafded1b0 0x564ab01c8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54820/0 (socket says 172.21.15.1:54820) 2024-09-21T01:00:42.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.320+0000 7f1ff3fff640 1 -- 172.21.15.1:0/3268742675 learned_addr learned my addr 172.21.15.1:0/3268742675 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:42.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.320+0000 7f1ff8eab640 1 --2- 172.21.15.1:0/3268742675 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564aafe16070 0x564ab01d4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.321+0000 7f1ff3fff640 1 -- 172.21.15.1:0/3268742675 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564aafe16070 msgr2=0x564ab01d4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:42.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.321+0000 7f1ff3fff640 1 --2- 172.21.15.1:0/3268742675 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564aafe16070 0x564ab01d4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.321+0000 7f1ff3fff640 1 -- 172.21.15.1:0/3268742675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564aafdf5390 msgr2=0x564ab01c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:42.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.321+0000 7f1ff3fff640 1 --2- 172.21.15.1:0/3268742675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564aafdf5390 0x564ab01c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.321+0000 7f1ff3fff640 1 -- 172.21.15.1:0/3268742675 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ab00ebc90 con 0x564aafded1b0 2024-09-21T01:00:42.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.321+0000 7f1ff8eab640 1 --2- 172.21.15.1:0/3268742675 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564aafe16070 0x564ab01d4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:00:42.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.321+0000 7f1ff37fe640 1 --2- 172.21.15.1:0/3268742675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564aafdf5390 0x564ab01c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:42.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.321+0000 7f1ff3fff640 1 --2- 172.21.15.1:0/3268742675 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564aafded1b0 0x564ab01c8990 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f1fe40ad5a0 tx=0x7f1fe4018420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3aafd364f2cd8b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:42.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.321+0000 7f1fd37fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:00:42.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.321+0000 7f1fd37fe640 1 -- 172.21.15.1:0/3268742675 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe40a1480 con 0x564aafded1b0 2024-09-21T01:00:42.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.321+0000 7f1fd37fe640 1 -- 172.21.15.1:0/3268742675 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f1fe401f660 con 0x564aafded1b0 2024-09-21T01:00:42.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.321+0000 7f2000e82740 1 -- 172.21.15.1:0/3268742675 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1fe40713c0 con 0x564aafded1b0 2024-09-21T01:00:42.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.321+0000 7f1fd37fe640 1 -- 172.21.15.1:0/3268742675 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f1fe40f6030 con 0x564aafded1b0 2024-09-21T01:00:42.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.321+0000 7f2000e82740 10 client.16479 fetch_fsmap learned FSMap version 33 2024-09-21T01:00:42.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.321+0000 7f2000e82740 1 -- 172.21.15.1:0/3268742675 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564ab01d77a0 con 0x564aafded1b0 2024-09-21T01:00:42.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.321+0000 7f1fd37fe640 1 -- 172.21.15.1:0/3268742675 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1fe40713c0 con 0x564aafded1b0 2024-09-21T01:00:42.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.322+0000 7f1fd37fe640 1 -- 172.21.15.1:0/3268742675 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f1fe40e7be0 con 0x564aafded1b0 2024-09-21T01:00:42.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.322+0000 7f2000e82740 10 client.16479 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:00:42.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.322+0000 7f2000e82740 10 client.16479 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T01:00:42.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.322+0000 7f2000e82740 20 client.16479 populate_metadata read hostname 'smithi001' 2024-09-21T01:00:42.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.322+0000 7f2000e82740 1 --2- 172.21.15.1:0/3268742675 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x564aafdd49f0 0x564ab01dab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.322+0000 7f2000e82740 4 client.16479 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:00:42.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.322+0000 7f2000e82740 1 -- 172.21.15.1:0/3268742675 --> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ab0135df0 con 0x564aafdd49f0 2024-09-21T01:00:42.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.322+0000 7f1ff37fe640 1 --2- 172.21.15.1:0/3268742675 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x564aafdd49f0 0x564ab01dab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.322+0000 7f1ff37fe640 1 --2- 172.21.15.1:0/3268742675 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x564aafdd49f0 0x564ab01dab00 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=923c89f2c0199aca server_cookie=25adc82dd1abcf99 in_seq=0 out_seq=0 2024-09-21T01:00:42.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.322+0000 7f1fd37fe640 10 client.16479 ms_handle_connect on v2:172.21.15.193:6834/3631682268 2024-09-21T01:00:42.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.323+0000 7f1fd37fe640 1 -- 172.21.15.1:0/3268742675 <== mds.4 v2:172.21.15.193:6834/3631682268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564ab0135df0 con 0x564aafdd49f0 2024-09-21T01:00:42.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.323+0000 7f1fd37fe640 10 client.16479 handle_command_reply: tid=0 2024-09-21T01:00:42.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.323+0000 7f2000e82740 1 client.16479 shutdown 2024-09-21T01:00:42.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.324+0000 7f2000e82740 1 -- 172.21.15.1:0/3268742675 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564aafded1b0 msgr2=0x564ab01c8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:42.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.324+0000 7f2000e82740 1 --2- 172.21.15.1:0/3268742675 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564aafded1b0 0x564ab01c8990 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f1fe40ad5a0 tx=0x7f1fe4018420 comp rx=0 tx=0).stop 2024-09-21T01:00:42.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.324+0000 7f2000e82740 1 -- 172.21.15.1:0/3268742675 shutdown_connections 2024-09-21T01:00:42.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.324+0000 7f2000e82740 1 --2- 172.21.15.1:0/3268742675 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x564aafdd49f0 0x564ab01dab00 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.324+0000 7f2000e82740 1 --2- 172.21.15.1:0/3268742675 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564aafe16070 0x564ab01d4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.324+0000 7f2000e82740 1 --2- 172.21.15.1:0/3268742675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564aafdf5390 0x564ab01c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.324+0000 7f1fd37fe640 0 client.16479 ms_handle_reset on v2:172.21.15.193:6834/3631682268 2024-09-21T01:00:42.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.324+0000 7f2000e82740 1 --2- 172.21.15.1:0/3268742675 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564aafded1b0 0x564ab01c8990 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.324+0000 7f2000e82740 1 -- 172.21.15.1:0/3268742675 >> 172.21.15.1:0/3268742675 conn(0x564aafe0a460 msgr2=0x564ab01c0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:42.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.324+0000 7f2000e82740 1 -- 172.21.15.1:0/3268742675 shutdown_connections 2024-09-21T01:00:42.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.324+0000 7f2000e82740 1 -- 172.21.15.1:0/3268742675 wait complete. 2024-09-21T01:00:42.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.324+0000 7f2000e82740 20 client.16479 trim_cache size 0 max 16384 2024-09-21T01:00:42.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.337+0000 7f2000e82740 1 Processor -- start 2024-09-21T01:00:42.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.337+0000 7f2000e82740 1 -- start start 2024-09-21T01:00:42.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.338+0000 7f2000e82740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564aafded1b0 0x564ab01c4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.338+0000 7f2000e82740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564aafdf5390 0x564ab01bea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.338+0000 7f2000e82740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564aafe16070 0x564ab01d4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.338+0000 7f2000e82740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff41b1770 con 0x564aafdf5390 2024-09-21T01:00:42.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.338+0000 7f2000e82740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff41b3370 con 0x564aafded1b0 2024-09-21T01:00:42.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.338+0000 7f2000e82740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff41b1e40 con 0x564aafe16070 2024-09-21T01:00:42.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.338+0000 7f1ff37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564aafdf5390 0x564ab01bea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.338+0000 7f1ff37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564aafdf5390 0x564ab01bea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54826/0 (socket says 172.21.15.1:54826) 2024-09-21T01:00:42.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.338+0000 7f1ff37fe640 1 -- 172.21.15.1:0/3821459050 learned_addr learned my addr 172.21.15.1:0/3821459050 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:42.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.338+0000 7f1ff3fff640 1 --2- 172.21.15.1:0/3821459050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564aafded1b0 0x564ab01c4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.338+0000 7f1ff37fe640 1 -- 172.21.15.1:0/3821459050 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564aafe16070 msgr2=0x564ab01d4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:42.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.338+0000 7f1ff8eab640 1 --2- 172.21.15.1:0/3821459050 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564aafe16070 0x564ab01d4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.338+0000 7f1ff37fe640 1 --2- 172.21.15.1:0/3821459050 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564aafe16070 0x564ab01d4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.338+0000 7f1ff37fe640 1 -- 172.21.15.1:0/3821459050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564aafded1b0 msgr2=0x564ab01c4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:42.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.338+0000 7f1ff37fe640 1 --2- 172.21.15.1:0/3821459050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564aafded1b0 0x564ab01c4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.338+0000 7f1ff37fe640 1 -- 172.21.15.1:0/3821459050 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ab01b65d0 con 0x564aafdf5390 2024-09-21T01:00:42.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.338+0000 7f1ff8eab640 1 --2- 172.21.15.1:0/3821459050 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564aafe16070 0x564ab01d4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:00:42.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.338+0000 7f1ff3fff640 1 --2- 172.21.15.1:0/3821459050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564aafded1b0 0x564ab01c4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:42.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.338+0000 7f1ff37fe640 1 --2- 172.21.15.1:0/3821459050 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564aafdf5390 0x564ab01bea00 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80058c0 tx=0x7f1fe800a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e7703e1d564784a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:42.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.339+0000 7f1fd9ffb640 1 -- 172.21.15.1:0/3821459050 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe8004220 con 0x564aafdf5390 2024-09-21T01:00:42.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.339+0000 7f1fd9ffb640 1 -- 172.21.15.1:0/3821459050 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1fe80043c0 con 0x564aafdf5390 2024-09-21T01:00:42.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.339+0000 7f1fd9ffb640 1 -- 172.21.15.1:0/3821459050 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe8004a00 con 0x564aafdf5390 2024-09-21T01:00:42.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.340+0000 7f2000e82740 1 -- 172.21.15.1:0/3821459050 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564aafdf5390 msgr2=0x564ab01bea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:42.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.340+0000 7f2000e82740 1 --2- 172.21.15.1:0/3821459050 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564aafdf5390 0x564ab01bea00 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80058c0 tx=0x7f1fe800a2d0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.340+0000 7f2000e82740 1 -- 172.21.15.1:0/3821459050 shutdown_connections 2024-09-21T01:00:42.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.340+0000 7f2000e82740 1 --2- 172.21.15.1:0/3821459050 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564aafe16070 0x564ab01d4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.340+0000 7f2000e82740 1 --2- 172.21.15.1:0/3821459050 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564aafdf5390 0x564ab01bea00 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.340+0000 7f2000e82740 1 --2- 172.21.15.1:0/3821459050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564aafded1b0 0x564ab01c4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.340+0000 7f2000e82740 1 -- 172.21.15.1:0/3821459050 >> 172.21.15.1:0/3821459050 conn(0x564aafe0a460 msgr2=0x564ab01be2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:42.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.340+0000 7f2000e82740 1 -- 172.21.15.1:0/3821459050 shutdown_connections 2024-09-21T01:00:42.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.340+0000 7f2000e82740 1 -- 172.21.15.1:0/3821459050 wait complete. 2024-09-21T01:00:42.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.340+0000 7f2000e82740 1 -- start start 2024-09-21T01:00:42.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.340+0000 7f2000e82740 1 Processor -- start 2024-09-21T01:00:42.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.341+0000 7f2000e82740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564aafded1b0 0x564ab01de030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.341+0000 7f2000e82740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564aafdf5390 0x564ab01db500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.341+0000 7f2000e82740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564aafe16070 0x564ab01dba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.341+0000 7f2000e82740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff41b2ca0 con 0x564aafded1b0 2024-09-21T01:00:42.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.341+0000 7f2000e82740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff41b25d0 con 0x564aafe16070 2024-09-21T01:00:42.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.341+0000 7f1ff3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564aafded1b0 0x564ab01de030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.341+0000 7f2000e82740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff41af750 con 0x564aafdf5390 2024-09-21T01:00:42.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.341+0000 7f2000e82740 10 client.0 _ll_register_callbacks cb 0x7f1fe800a590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:42.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.341+0000 7f1ff3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564aafded1b0 0x564ab01de030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54836/0 (socket says 172.21.15.1:54836) 2024-09-21T01:00:42.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.341+0000 7f1ff8eab640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564aafe16070 0x564ab01dba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.341+0000 7f1ff3fff640 1 -- 172.21.15.1:0/4210622917 learned_addr learned my addr 172.21.15.1:0/4210622917 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:42.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.341+0000 7f1ff37fe640 1 --2- 172.21.15.1:0/4210622917 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564aafdf5390 0x564ab01db500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.341+0000 7f1ff3fff640 1 -- 172.21.15.1:0/4210622917 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564aafdf5390 msgr2=0x564ab01db500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:42.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.341+0000 7f1ff3fff640 1 --2- 172.21.15.1:0/4210622917 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564aafdf5390 0x564ab01db500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.341+0000 7f1ff3fff640 1 -- 172.21.15.1:0/4210622917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564aafe16070 msgr2=0x564ab01dba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:42.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.341+0000 7f1ff3fff640 1 --2- 172.21.15.1:0/4210622917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564aafe16070 0x564ab01dba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.341+0000 7f1ff3fff640 1 -- 172.21.15.1:0/4210622917 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ab01dbf80 con 0x564aafded1b0 2024-09-21T01:00:42.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.341+0000 7f1ff37fe640 1 --2- 172.21.15.1:0/4210622917 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564aafdf5390 0x564ab01db500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:00:42.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.342+0000 7f1ff3fff640 1 --2- 172.21.15.1:0/4210622917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564aafded1b0 0x564ab01de030 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f1fe400e9c0 tx=0x7f1fe40a90b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=648d87c77d66058e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:42.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.342+0000 7f1fd37fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:00:42.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.342+0000 7f1fd37fe640 1 -- 172.21.15.1:0/4210622917 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe409ff70 con 0x564aafded1b0 2024-09-21T01:00:42.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.342+0000 7f1fd37fe640 1 -- 172.21.15.1:0/4210622917 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f1fe40ed320 con 0x564aafded1b0 2024-09-21T01:00:42.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.342+0000 7f2000e82740 1 -- 172.21.15.1:0/4210622917 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1fe80043c0 con 0x564aafded1b0 2024-09-21T01:00:42.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.342+0000 7f1fd37fe640 1 -- 172.21.15.1:0/4210622917 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f1fe409f2f0 con 0x564aafded1b0 2024-09-21T01:00:42.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.342+0000 7f2000e82740 10 client.16485 fetch_fsmap learned FSMap version 33 2024-09-21T01:00:42.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.342+0000 7f2000e82740 1 -- 172.21.15.1:0/4210622917 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564ab01dbf80 con 0x564aafded1b0 2024-09-21T01:00:42.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.342+0000 7f1fd37fe640 1 -- 172.21.15.1:0/4210622917 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1fe80043c0 con 0x564aafded1b0 2024-09-21T01:00:42.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.342+0000 7f1fd37fe640 1 -- 172.21.15.1:0/4210622917 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f1fe40aebd0 con 0x564aafded1b0 2024-09-21T01:00:42.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.342+0000 7f2000e82740 10 client.16485 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:00:42.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.342+0000 7f2000e82740 10 client.16485 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T01:00:42.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.342+0000 7f2000e82740 20 client.16485 populate_metadata read hostname 'smithi001' 2024-09-21T01:00:42.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.342+0000 7f2000e82740 1 --2- 172.21.15.1:0/4210622917 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x564aafda9da0 0x564ab0247210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.342+0000 7f2000e82740 4 client.16485 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:00:42.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.342+0000 7f2000e82740 1 -- 172.21.15.1:0/4210622917 --> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564ab01318a0 con 0x564aafda9da0 2024-09-21T01:00:42.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.343+0000 7f1ff37fe640 1 --2- 172.21.15.1:0/4210622917 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x564aafda9da0 0x564ab0247210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.343+0000 7f1ff37fe640 1 --2- 172.21.15.1:0/4210622917 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x564aafda9da0 0x564ab0247210 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e3dfbf34dd88de8d server_cookie=9883d4de8c0bcbcd in_seq=0 out_seq=0 2024-09-21T01:00:42.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.343+0000 7f1fd37fe640 10 client.16485 ms_handle_connect on v2:172.21.15.193:6834/3631682268 2024-09-21T01:00:42.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.344+0000 7f1fd37fe640 1 -- 172.21.15.1:0/4210622917 <== mds.4 v2:172.21.15.193:6834/3631682268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564ab01318a0 con 0x564aafda9da0 2024-09-21T01:00:42.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.344+0000 7f1fd37fe640 10 client.16485 handle_command_reply: tid=0 2024-09-21T01:00:42.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.344+0000 7f2000e82740 1 client.16485 shutdown 2024-09-21T01:00:42.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.344+0000 7f2000e82740 1 -- 172.21.15.1:0/4210622917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564aafded1b0 msgr2=0x564ab01de030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:42.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.344+0000 7f2000e82740 1 --2- 172.21.15.1:0/4210622917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564aafded1b0 0x564ab01de030 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f1fe400e9c0 tx=0x7f1fe40a90b0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.344+0000 7f2000e82740 1 -- 172.21.15.1:0/4210622917 shutdown_connections 2024-09-21T01:00:42.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.344+0000 7f2000e82740 1 --2- 172.21.15.1:0/4210622917 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x564aafda9da0 0x564ab0247210 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.344+0000 7f2000e82740 1 --2- 172.21.15.1:0/4210622917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564aafe16070 0x564ab01dba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.344+0000 7f2000e82740 1 --2- 172.21.15.1:0/4210622917 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564aafdf5390 0x564ab01db500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.344+0000 7f1fd37fe640 0 client.16485 ms_handle_reset on v2:172.21.15.193:6834/3631682268 2024-09-21T01:00:42.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.344+0000 7f2000e82740 1 --2- 172.21.15.1:0/4210622917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564aafded1b0 0x564ab01de030 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.344+0000 7f2000e82740 1 -- 172.21.15.1:0/4210622917 >> 172.21.15.1:0/4210622917 conn(0x564aafe0a460 msgr2=0x564ab01be2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:42.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.344+0000 7f2000e82740 1 -- 172.21.15.1:0/4210622917 shutdown_connections 2024-09-21T01:00:42.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.344+0000 7f2000e82740 1 -- 172.21.15.1:0/4210622917 wait complete. 2024-09-21T01:00:42.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.344+0000 7f2000e82740 20 client.16485 trim_cache size 0 max 16384 2024-09-21T01:00:42.350 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T01:00:42.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.345+0000 7f1ffa90e640 1 -- 172.21.15.1:0/3129576047 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f1fdc0b6510 msgr2=0x7f1fdc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:42.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.345+0000 7f1ffa90e640 1 --2- 172.21.15.1:0/3129576047 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f1fdc0b6510 0x7f1fdc0b8a20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1fec004af0 tx=0x7f1fec005d80 comp rx=0 tx=0).stop 2024-09-21T01:00:42.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.345+0000 7f1ffa90e640 1 -- 172.21.15.1:0/3129576047 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ff4103bb0 msgr2=0x7f1ff419c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:42.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.345+0000 7f1ffa90e640 1 --2- 172.21.15.1:0/3129576047 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ff4103bb0 0x7f1ff419c670 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f1fe400e9f0 tx=0x7f1fe400eeb0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.345+0000 7f1ffa90e640 1 -- 172.21.15.1:0/3129576047 shutdown_connections 2024-09-21T01:00:42.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.345+0000 7f1ffa90e640 1 --2- 172.21.15.1:0/3129576047 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ff4109e40 0x7f1ff41a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.345+0000 7f1ffa90e640 1 --2- 172.21.15.1:0/3129576047 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ff41094f0 0x7f1ff419cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.345+0000 7f1ffa90e640 1 --2- 172.21.15.1:0/3129576047 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f1fdc0b6510 0x7f1fdc0b8a20 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.345+0000 7f1ffa90e640 1 --2- 172.21.15.1:0/3129576047 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ff4103bb0 0x7f1ff419c670 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.345+0000 7f1ffa90e640 1 -- 172.21.15.1:0/3129576047 >> 172.21.15.1:0/3129576047 conn(0x7f1ff40ff600 msgr2=0x7f1ff4106ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:42.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.345+0000 7f1ffa90e640 1 -- 172.21.15.1:0/3129576047 shutdown_connections 2024-09-21T01:00:42.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:42.345+0000 7f1ffa90e640 1 -- 172.21.15.1:0/3129576047 wait complete. 2024-09-21T01:00:43.203 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T01:00:43.481 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:00:43.559 INFO:tasks.workunit.client.0.smithi001.stdout: 85 482833 589 302420 362 261342 1656 2024-09-21T01:00:43.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:43 smithi001 ceph-mon[31211]: pgmap v463: 97 pgs: 97 active+clean; 433 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.9 MiB/s wr, 148 op/s 2024-09-21T01:00:43.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:43 smithi193 ceph-mon[34660]: pgmap v463: 97 pgs: 97 active+clean; 433 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.9 MiB/s wr, 148 op/s 2024-09-21T01:00:43.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:43 smithi042 ceph-mon[34481]: pgmap v463: 97 pgs: 97 active+clean; 433 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.9 MiB/s wr, 148 op/s 2024-09-21T01:00:44.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.177+0000 7f63fa27e640 1 -- 172.21.15.1:0/2401852351 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63f4111f40 msgr2=0x7f63f410a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:44.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.177+0000 7f63fa27e640 1 --2- 172.21.15.1:0/2401852351 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63f4111f40 0x7f63f410a3c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f63e4009900 tx=0x7f63e402a440 comp rx=0 tx=0).stop 2024-09-21T01:00:44.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.185+0000 7f63fa27e640 1 -- 172.21.15.1:0/2401852351 shutdown_connections 2024-09-21T01:00:44.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.185+0000 7f63fa27e640 1 --2- 172.21.15.1:0/2401852351 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63f411cc30 0x7f63f411f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.185+0000 7f63fa27e640 1 --2- 172.21.15.1:0/2401852351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63f410a9e0 0x7f63f410adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.185+0000 7f63fa27e640 1 --2- 172.21.15.1:0/2401852351 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63f4111f40 0x7f63f410a3c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.185+0000 7f63fa27e640 1 -- 172.21.15.1:0/2401852351 >> 172.21.15.1:0/2401852351 conn(0x7f63f4070ec0 msgr2=0x7f63f40712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:44.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.193+0000 7f63fa27e640 1 -- 172.21.15.1:0/2401852351 shutdown_connections 2024-09-21T01:00:44.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.196+0000 7f63fa27e640 1 -- 172.21.15.1:0/2401852351 wait complete. 2024-09-21T01:00:44.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.197+0000 7f63fa27e640 1 Processor -- start 2024-09-21T01:00:44.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.198+0000 7f63fa27e640 1 -- start start 2024-09-21T01:00:44.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.198+0000 7f63fa27e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63f410a9e0 0x7f63f411a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:44.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.198+0000 7f63fa27e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63f4111f40 0x7f63f4113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:44.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.198+0000 7f63fa27e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63f411cc30 0x7f63f4113d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:44.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.199+0000 7f63fa27e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f63f4122980 con 0x7f63f4111f40 2024-09-21T01:00:44.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.199+0000 7f63fa27e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f63f4122800 con 0x7f63f410a9e0 2024-09-21T01:00:44.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.199+0000 7f63fa27e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f63f4122b00 con 0x7f63f411cc30 2024-09-21T01:00:44.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.200+0000 7f63f37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63f4111f40 0x7f63f4113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:44.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.200+0000 7f63f37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63f4111f40 0x7f63f4113750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54858/0 (socket says 172.21.15.1:54858) 2024-09-21T01:00:44.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.200+0000 7f63f37fe640 1 -- 172.21.15.1:0/2165997330 learned_addr learned my addr 172.21.15.1:0/2165997330 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:44.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.200+0000 7f63f3fff640 1 --2- 172.21.15.1:0/2165997330 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63f410a9e0 0x7f63f411a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:44.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.200+0000 7f63f37fe640 1 -- 172.21.15.1:0/2165997330 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63f411cc30 msgr2=0x7f63f4113d50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:00:44.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.200+0000 7f63f37fe640 1 --2- 172.21.15.1:0/2165997330 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63f411cc30 0x7f63f4113d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.200+0000 7f63f37fe640 1 -- 172.21.15.1:0/2165997330 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63f410a9e0 msgr2=0x7f63f411a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:44.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.200+0000 7f63f37fe640 1 --2- 172.21.15.1:0/2165997330 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63f410a9e0 0x7f63f411a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.200+0000 7f63f37fe640 1 -- 172.21.15.1:0/2165997330 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63f41144e0 con 0x7f63f4111f40 2024-09-21T01:00:44.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.201+0000 7f63f37fe640 1 --2- 172.21.15.1:0/2165997330 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63f4111f40 0x7f63f4113750 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f63e800c970 tx=0x7f63e800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:44.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.201+0000 7f63f17fa640 1 -- 172.21.15.1:0/2165997330 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e8007c70 con 0x7f63f4111f40 2024-09-21T01:00:44.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.202+0000 7f63f17fa640 1 -- 172.21.15.1:0/2165997330 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63e8007e10 con 0x7f63f4111f40 2024-09-21T01:00:44.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.202+0000 7f63f17fa640 1 -- 172.21.15.1:0/2165997330 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e8018820 con 0x7f63f4111f40 2024-09-21T01:00:44.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.203+0000 7f63fa27e640 1 -- 172.21.15.1:0/2165997330 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63f41191b0 con 0x7f63f4111f40 2024-09-21T01:00:44.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.203+0000 7f63fa27e640 1 -- 172.21.15.1:0/2165997330 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63f41196a0 con 0x7f63f4111f40 2024-09-21T01:00:44.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.207+0000 7f64007f2740 1 Processor -- start 2024-09-21T01:00:44.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.207+0000 7f64007f2740 1 -- start start 2024-09-21T01:00:44.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.207+0000 7f64007f2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589b7921070 0x5589b7cc86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:44.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.212+0000 7f64007f2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589b78f81b0 0x5589b7cc8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:44.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.212+0000 7f64007f2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589b7900390 0x5589b7cc9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:44.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.212+0000 7f64007f2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5589b7c3eea0 con 0x5589b7921070 2024-09-21T01:00:44.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.212+0000 7f64007f2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5589b7c2e2d0 con 0x5589b7900390 2024-09-21T01:00:44.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.212+0000 7f64007f2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5589b7c320e0 con 0x5589b78f81b0 2024-09-21T01:00:44.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.212+0000 7f63f881b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589b7921070 0x5589b7cc86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:44.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.212+0000 7f63f881b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589b7921070 0x5589b7cc86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54862/0 (socket says 172.21.15.1:54862) 2024-09-21T01:00:44.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.212+0000 7f63f881b640 1 -- 172.21.15.1:0/3558989365 learned_addr learned my addr 172.21.15.1:0/3558989365 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:44.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.213+0000 7f63f881b640 1 -- 172.21.15.1:0/3558989365 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589b78f81b0 msgr2=0x5589b7cc8be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:00:44.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.213+0000 7f63f881b640 1 --2- 172.21.15.1:0/3558989365 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589b78f81b0 0x5589b7cc8be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.213+0000 7f63f881b640 1 -- 172.21.15.1:0/3558989365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589b7900390 msgr2=0x5589b7cc9120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:00:44.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.213+0000 7f63f881b640 1 --2- 172.21.15.1:0/3558989365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589b7900390 0x5589b7cc9120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.213+0000 7f63f881b640 1 -- 172.21.15.1:0/3558989365 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589b798c650 con 0x5589b7921070 2024-09-21T01:00:44.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.214+0000 7f63f881b640 1 --2- 172.21.15.1:0/3558989365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589b7921070 0x5589b7cc86a0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f63ec009d20 tx=0x7f63ec00b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83bc2faae0cc5974 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:44.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.222+0000 7f63f17fa640 1 -- 172.21.15.1:0/2165997330 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f63e800fb20 con 0x7f63f4111f40 2024-09-21T01:00:44.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.223+0000 7f63da7fc640 1 -- 172.21.15.1:0/3558989365 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ec00bd40 con 0x5589b7921070 2024-09-21T01:00:44.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.223+0000 7f63da7fc640 1 -- 172.21.15.1:0/3558989365 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63ec017070 con 0x5589b7921070 2024-09-21T01:00:44.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.223+0000 7f63f17fa640 1 --2- 172.21.15.1:0/2165997330 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f63dc0b6710 0x7f63dc0b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:44.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.224+0000 7f63f17fa640 1 -- 172.21.15.1:0/2165997330 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f63e80e78f0 con 0x7f63f4111f40 2024-09-21T01:00:44.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.224+0000 7f64007f2740 1 -- 172.21.15.1:0/3558989365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589b7921070 msgr2=0x5589b7cc86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:44.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.224+0000 7f64007f2740 1 --2- 172.21.15.1:0/3558989365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589b7921070 0x5589b7cc86a0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f63ec009d20 tx=0x7f63ec00b420 comp rx=0 tx=0).stop 2024-09-21T01:00:44.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.223+0000 7f63da7fc640 1 -- 172.21.15.1:0/3558989365 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 0 0 0) 0x7f63ec011630 con 0x5589b7921070 2024-09-21T01:00:44.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.224+0000 7f64007f2740 1 -- 172.21.15.1:0/3558989365 shutdown_connections 2024-09-21T01:00:44.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.224+0000 7f64007f2740 1 --2- 172.21.15.1:0/3558989365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589b7900390 0x5589b7cc9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.224+0000 7f64007f2740 1 --2- 172.21.15.1:0/3558989365 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589b78f81b0 0x5589b7cc8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.224+0000 7f64007f2740 1 --2- 172.21.15.1:0/3558989365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589b7921070 0x5589b7cc86a0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.224+0000 7f64007f2740 1 -- 172.21.15.1:0/3558989365 >> 172.21.15.1:0/3558989365 conn(0x5589b7915460 msgr2=0x5589b7cc6590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:44.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.228+0000 7f63f3fff640 1 --2- 172.21.15.1:0/2165997330 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f63dc0b6710 0x7f63dc0b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:44.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.231+0000 7f64007f2740 1 -- 172.21.15.1:0/3558989365 shutdown_connections 2024-09-21T01:00:44.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.234+0000 7f63f3fff640 1 --2- 172.21.15.1:0/2165997330 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f63dc0b6710 0x7f63dc0b8c20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f63e40096c0 tx=0x7f63e4005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:44.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.235+0000 7f64007f2740 1 -- 172.21.15.1:0/3558989365 wait complete. 2024-09-21T01:00:44.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.235+0000 7f64007f2740 1 -- start start 2024-09-21T01:00:44.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.241+0000 7f64007f2740 1 Processor -- start 2024-09-21T01:00:44.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.243+0000 7f64007f2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589b78f81b0 0x5589b7cd3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:44.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.243+0000 7f64007f2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589b7900390 0x5589b7cd4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:44.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.243+0000 7f64007f2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589b7921070 0x5589b7ce0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:44.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.243+0000 7f64007f2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5589b7a8f700 con 0x5589b7921070 2024-09-21T01:00:44.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.243+0000 7f64007f2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5589b7bc9160 con 0x5589b7900390 2024-09-21T01:00:44.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.243+0000 7f64007f2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5589b7cd6ed0 con 0x5589b78f81b0 2024-09-21T01:00:44.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.243+0000 7f64007f2740 10 client.0 _ll_register_callbacks cb 0x5589b7be29e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:44.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.244+0000 7f63f37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589b7900390 0x5589b7cd4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:44.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.244+0000 7f63f37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589b7900390 0x5589b7cd4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:43742/0 (socket says 172.21.15.1:43742) 2024-09-21T01:00:44.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.244+0000 7f63f37fe640 1 -- 172.21.15.1:0/3211436986 learned_addr learned my addr 172.21.15.1:0/3211436986 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:44.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.244+0000 7f63f881b640 1 --2- 172.21.15.1:0/3211436986 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589b7921070 0x5589b7ce0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:44.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.245+0000 7f63f37fe640 1 -- 172.21.15.1:0/3211436986 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589b78f81b0 msgr2=0x5589b7cd3e00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:00:44.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.245+0000 7f63f37fe640 1 --2- 172.21.15.1:0/3211436986 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589b78f81b0 0x5589b7cd3e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.245+0000 7f63f37fe640 1 -- 172.21.15.1:0/3211436986 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589b7921070 msgr2=0x5589b7ce0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:44.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.245+0000 7f63f37fe640 1 --2- 172.21.15.1:0/3211436986 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589b7921070 0x5589b7ce0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.245+0000 7f63f37fe640 1 -- 172.21.15.1:0/3211436986 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589b7bf6c90 con 0x5589b7900390 2024-09-21T01:00:44.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.245+0000 7f63f881b640 1 --2- 172.21.15.1:0/3211436986 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589b7921070 0x5589b7ce0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:00:44.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.245+0000 7f63f37fe640 1 --2- 172.21.15.1:0/3211436986 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589b7900390 0x5589b7cd4340 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f63e80aacf0 tx=0x7f63e80ad4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd8bfc156c78ae55 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:44.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.245+0000 7f63d37fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:00:44.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.246+0000 7f63d37fe640 1 -- 172.21.15.1:0/3211436986 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e80b2320 con 0x5589b7900390 2024-09-21T01:00:44.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.246+0000 7f64007f2740 1 -- 172.21.15.1:0/3211436986 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63ec017070 con 0x5589b7900390 2024-09-21T01:00:44.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.246+0000 7f63d37fe640 1 -- 172.21.15.1:0/3211436986 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f63e80a93d0 con 0x5589b7900390 2024-09-21T01:00:44.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.246+0000 7f63d37fe640 1 -- 172.21.15.1:0/3211436986 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f63e80ae180 con 0x5589b7900390 2024-09-21T01:00:44.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.248+0000 7f64007f2740 10 client.26159 fetch_fsmap learned FSMap version 33 2024-09-21T01:00:44.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.248+0000 7f64007f2740 1 -- 172.21.15.1:0/3211436986 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5589b7ce2d10 con 0x5589b7900390 2024-09-21T01:00:44.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.249+0000 7f63d37fe640 1 -- 172.21.15.1:0/3211436986 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63ec017070 con 0x5589b7900390 2024-09-21T01:00:44.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.249+0000 7f63d37fe640 1 -- 172.21.15.1:0/3211436986 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f63e8020070 con 0x5589b7900390 2024-09-21T01:00:44.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.249+0000 7f64007f2740 10 client.26159 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:00:44.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.249+0000 7f64007f2740 10 client.26159 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-21T01:00:44.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.249+0000 7f64007f2740 20 client.26159 populate_metadata read hostname 'smithi001' 2024-09-21T01:00:44.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.249+0000 7f64007f2740 1 --2- 172.21.15.1:0/3211436986 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x5589b78df9f0 0x5589b7ce6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:44.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.249+0000 7f64007f2740 4 client.26159 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:00:44.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.249+0000 7f64007f2740 1 -- 172.21.15.1:0/3211436986 --> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5589b7c40df0 con 0x5589b78df9f0 2024-09-21T01:00:44.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.250+0000 7f63f3fff640 1 --2- 172.21.15.1:0/3211436986 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x5589b78df9f0 0x5589b7ce6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:44.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.256+0000 7f63f3fff640 1 --2- 172.21.15.1:0/3211436986 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x5589b78df9f0 0x5589b7ce6630 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e786191f0ba1df95 server_cookie=b969cfe63dfbd782 in_seq=0 out_seq=0 2024-09-21T01:00:44.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.257+0000 7f63d37fe640 10 client.26159 ms_handle_connect on v2:172.21.15.193:6836/909252228 2024-09-21T01:00:44.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.261+0000 7f63d37fe640 1 -- 172.21.15.1:0/3211436986 <== mds.3 v2:172.21.15.193:6836/909252228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5589b7c40df0 con 0x5589b78df9f0 2024-09-21T01:00:44.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.261+0000 7f63d37fe640 10 client.26159 handle_command_reply: tid=0 2024-09-21T01:00:44.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.261+0000 7f64007f2740 1 client.26159 shutdown 2024-09-21T01:00:44.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.263+0000 7f64007f2740 1 -- 172.21.15.1:0/3211436986 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589b7900390 msgr2=0x5589b7cd4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:44.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.263+0000 7f64007f2740 1 --2- 172.21.15.1:0/3211436986 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589b7900390 0x5589b7cd4340 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f63e80aacf0 tx=0x7f63e80ad4d0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.269+0000 7f64007f2740 1 -- 172.21.15.1:0/3211436986 shutdown_connections 2024-09-21T01:00:44.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.269+0000 7f64007f2740 1 --2- 172.21.15.1:0/3211436986 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x5589b78df9f0 0x5589b7ce6630 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.269+0000 7f64007f2740 1 --2- 172.21.15.1:0/3211436986 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589b7921070 0x5589b7ce0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.269+0000 7f64007f2740 1 --2- 172.21.15.1:0/3211436986 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589b7900390 0x5589b7cd4340 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.269+0000 7f64007f2740 1 --2- 172.21.15.1:0/3211436986 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589b78f81b0 0x5589b7cd3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.269+0000 7f64007f2740 1 -- 172.21.15.1:0/3211436986 >> 172.21.15.1:0/3211436986 conn(0x5589b7915460 msgr2=0x5589b7ccb880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:44.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.269+0000 7f63d37fe640 0 client.26159 ms_handle_reset on v2:172.21.15.193:6836/909252228 2024-09-21T01:00:44.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.273+0000 7f64007f2740 1 -- 172.21.15.1:0/3211436986 shutdown_connections 2024-09-21T01:00:44.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.277+0000 7f64007f2740 1 -- 172.21.15.1:0/3211436986 wait complete. 2024-09-21T01:00:44.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.279+0000 7f64007f2740 20 client.26159 trim_cache size 0 max 16384 2024-09-21T01:00:44.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.315+0000 7f64007f2740 1 Processor -- start 2024-09-21T01:00:44.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.315+0000 7f64007f2740 1 -- start start 2024-09-21T01:00:44.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.316+0000 7f64007f2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589b78f81b0 0x5589b7ce0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:44.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.316+0000 7f64007f2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589b7900390 0x5589b7cc9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:44.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.316+0000 7f64007f2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589b7921070 0x5589b7cebe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:44.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.317+0000 7f63f881b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589b7921070 0x5589b7cebe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:44.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.317+0000 7f63f881b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589b7921070 0x5589b7cebe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54884/0 (socket says 172.21.15.1:54884) 2024-09-21T01:00:44.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.317+0000 7f63f881b640 1 -- 172.21.15.1:0/486059645 learned_addr learned my addr 172.21.15.1:0/486059645 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:44.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.317+0000 7f64007f2740 1 -- 172.21.15.1:0/486059645 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f63f41b5e00 con 0x5589b7921070 2024-09-21T01:00:44.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.317+0000 7f64007f2740 1 -- 172.21.15.1:0/486059645 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f63f41b7a00 con 0x5589b78f81b0 2024-09-21T01:00:44.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.317+0000 7f64007f2740 1 -- 172.21.15.1:0/486059645 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f63f41b64d0 con 0x5589b7900390 2024-09-21T01:00:44.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.317+0000 7f63f881b640 1 -- 172.21.15.1:0/486059645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589b7900390 msgr2=0x5589b7cc9d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:00:44.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.317+0000 7f63f881b640 1 --2- 172.21.15.1:0/486059645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589b7900390 0x5589b7cc9d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.317+0000 7f63f881b640 1 -- 172.21.15.1:0/486059645 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589b78f81b0 msgr2=0x5589b7ce0140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:00:44.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.317+0000 7f63f881b640 1 --2- 172.21.15.1:0/486059645 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589b78f81b0 0x5589b7ce0140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.317+0000 7f63f881b640 1 -- 172.21.15.1:0/486059645 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589b7cd6540 con 0x5589b7921070 2024-09-21T01:00:44.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.318+0000 7f63f881b640 1 --2- 172.21.15.1:0/486059645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589b7921070 0x5589b7cebe30 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f63ec012e60 tx=0x7f63ec003a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=467895a1136df26c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:44.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.321+0000 7f63d9ffb640 1 -- 172.21.15.1:0/486059645 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ec003e40 con 0x5589b7921070 2024-09-21T01:00:44.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.321+0000 7f63d9ffb640 1 -- 172.21.15.1:0/486059645 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63ec017040 con 0x5589b7921070 2024-09-21T01:00:44.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.321+0000 7f63d9ffb640 1 -- 172.21.15.1:0/486059645 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ec004650 con 0x5589b7921070 2024-09-21T01:00:44.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.323+0000 7f64007f2740 1 -- 172.21.15.1:0/486059645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589b7921070 msgr2=0x5589b7cebe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:44.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.324+0000 7f64007f2740 1 --2- 172.21.15.1:0/486059645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589b7921070 0x5589b7cebe30 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f63ec012e60 tx=0x7f63ec003a10 comp rx=0 tx=0).stop 2024-09-21T01:00:44.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.325+0000 7f64007f2740 1 -- 172.21.15.1:0/486059645 shutdown_connections 2024-09-21T01:00:44.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.325+0000 7f64007f2740 1 --2- 172.21.15.1:0/486059645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589b7921070 0x5589b7cebe30 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.325+0000 7f64007f2740 1 --2- 172.21.15.1:0/486059645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589b7900390 0x5589b7cc9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.325+0000 7f64007f2740 1 --2- 172.21.15.1:0/486059645 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589b78f81b0 0x5589b7ce0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.325+0000 7f64007f2740 1 -- 172.21.15.1:0/486059645 >> 172.21.15.1:0/486059645 conn(0x5589b7915460 msgr2=0x5589b7cc9680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:44.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.331+0000 7f64007f2740 1 -- 172.21.15.1:0/486059645 shutdown_connections 2024-09-21T01:00:44.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.335+0000 7f64007f2740 1 -- 172.21.15.1:0/486059645 wait complete. 2024-09-21T01:00:44.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.335+0000 7f64007f2740 1 -- start start 2024-09-21T01:00:44.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.336+0000 7f64007f2740 1 Processor -- start 2024-09-21T01:00:44.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.336+0000 7f64007f2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589b78f81b0 0x5589b7cda310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:44.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.336+0000 7f64007f2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589b7900390 0x5589b7cda850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:44.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.336+0000 7f64007f2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589b7921070 0x5589b7cdad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:44.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.337+0000 7f63f3fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589b78f81b0 0x5589b7cda310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:44.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.337+0000 7f63f881b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589b7921070 0x5589b7cdad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:44.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.337+0000 7f63f3fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589b78f81b0 0x5589b7cda310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:43750/0 (socket says 172.21.15.1:43750) 2024-09-21T01:00:44.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.337+0000 7f63f881b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589b7921070 0x5589b7cdad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54898/0 (socket says 172.21.15.1:54898) 2024-09-21T01:00:44.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.337+0000 7f63f3fff640 1 -- 172.21.15.1:0/2218292263 learned_addr learned my addr 172.21.15.1:0/2218292263 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:44.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.337+0000 7f64007f2740 1 -- 172.21.15.1:0/2218292263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f63f41b7330 con 0x5589b7921070 2024-09-21T01:00:44.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.337+0000 7f64007f2740 1 -- 172.21.15.1:0/2218292263 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f63f41b6c60 con 0x5589b78f81b0 2024-09-21T01:00:44.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.337+0000 7f64007f2740 1 -- 172.21.15.1:0/2218292263 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f63f410adf0 con 0x5589b7900390 2024-09-21T01:00:44.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.338+0000 7f63f881b640 1 -- 172.21.15.1:0/2218292263 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589b7900390 msgr2=0x5589b7cda850 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:00:44.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.338+0000 7f63f881b640 1 --2- 172.21.15.1:0/2218292263 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589b7900390 0x5589b7cda850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.338+0000 7f63f881b640 1 -- 172.21.15.1:0/2218292263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589b78f81b0 msgr2=0x5589b7cda310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:44.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.338+0000 7f63f881b640 1 --2- 172.21.15.1:0/2218292263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589b78f81b0 0x5589b7cda310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.338+0000 7f63f881b640 1 -- 172.21.15.1:0/2218292263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589b7d50110 con 0x5589b7921070 2024-09-21T01:00:44.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.339+0000 7f63f881b640 1 --2- 172.21.15.1:0/2218292263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589b7921070 0x5589b7cdad90 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f63ec012e90 tx=0x7f63ec0047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b58d507a4b0aba54 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:44.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.340+0000 7f64007f2740 10 client.0 _ll_register_callbacks cb 0x7f63e80aa0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:44.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.340+0000 7f64007f2740 1 -- 172.21.15.1:0/2218292263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63ec017040 con 0x5589b7921070 2024-09-21T01:00:44.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.340+0000 7f63d37fe640 10 client.16500 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:00:44.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.340+0000 7f63d37fe640 1 -- 172.21.15.1:0/2218292263 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ec033020 con 0x5589b7921070 2024-09-21T01:00:44.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.341+0000 7f63d37fe640 1 -- 172.21.15.1:0/2218292263 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f63ec012430 con 0x5589b7921070 2024-09-21T01:00:44.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.341+0000 7f63d37fe640 1 -- 172.21.15.1:0/2218292263 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f63ec004960 con 0x5589b7921070 2024-09-21T01:00:44.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.342+0000 7f64007f2740 10 client.16500 fetch_fsmap learned FSMap version 33 2024-09-21T01:00:44.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.342+0000 7f64007f2740 1 -- 172.21.15.1:0/2218292263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({fsmap=33}) -- 0x5589b7d51020 con 0x5589b7921070 2024-09-21T01:00:44.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.343+0000 7f63d37fe640 1 -- 172.21.15.1:0/2218292263 <== mon.0 v2:172.21.15.1:3300/0 4 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f63ec011070 con 0x5589b7921070 2024-09-21T01:00:44.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.346+0000 7f64007f2740 10 client.16500 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:00:44.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.346+0000 7f64007f2740 10 client.16500 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-21T01:00:44.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.346+0000 7f64007f2740 20 client.16500 populate_metadata read hostname 'smithi001' 2024-09-21T01:00:44.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.346+0000 7f64007f2740 1 --2- 172.21.15.1:0/2218292263 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x5589b78b4da0 0x5589b7d534e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:44.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.346+0000 7f64007f2740 4 client.16500 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:00:44.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.346+0000 7f64007f2740 1 -- 172.21.15.1:0/2218292263 --> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f63ec017040 con 0x5589b78b4da0 2024-09-21T01:00:44.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.349+0000 7f63f3fff640 1 --2- 172.21.15.1:0/2218292263 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x5589b78b4da0 0x5589b7d534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:44.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.351+0000 7f63f3fff640 1 --2- 172.21.15.1:0/2218292263 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x5589b78b4da0 0x5589b7d534e0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=31982328aff89960 server_cookie=5f1db75c336cbe67 in_seq=0 out_seq=0 2024-09-21T01:00:44.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.352+0000 7f63d37fe640 10 client.16500 ms_handle_connect on v2:172.21.15.193:6836/909252228 2024-09-21T01:00:44.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.352+0000 7f63d37fe640 1 -- 172.21.15.1:0/2218292263 <== mds.3 v2:172.21.15.193:6836/909252228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f63ec017040 con 0x5589b78b4da0 2024-09-21T01:00:44.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.352+0000 7f63d37fe640 10 client.16500 handle_command_reply: tid=0 2024-09-21T01:00:44.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.355+0000 7f64007f2740 1 client.16500 shutdown 2024-09-21T01:00:44.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.367+0000 7f64007f2740 1 -- 172.21.15.1:0/2218292263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589b7921070 msgr2=0x5589b7cdad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:44.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.367+0000 7f64007f2740 1 --2- 172.21.15.1:0/2218292263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589b7921070 0x5589b7cdad90 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f63ec012e90 tx=0x7f63ec0047f0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.371+0000 7f64007f2740 1 -- 172.21.15.1:0/2218292263 shutdown_connections 2024-09-21T01:00:44.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.371+0000 7f64007f2740 1 --2- 172.21.15.1:0/2218292263 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x5589b78b4da0 0x5589b7d534e0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.371+0000 7f64007f2740 1 --2- 172.21.15.1:0/2218292263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589b7921070 0x5589b7cdad90 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.371+0000 7f64007f2740 1 --2- 172.21.15.1:0/2218292263 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589b7900390 0x5589b7cda850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.371+0000 7f64007f2740 1 --2- 172.21.15.1:0/2218292263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589b78f81b0 0x5589b7cda310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.371+0000 7f64007f2740 1 -- 172.21.15.1:0/2218292263 >> 172.21.15.1:0/2218292263 conn(0x5589b7915460 msgr2=0x5589b7ccbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:44.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.371+0000 7f63d37fe640 0 client.16500 ms_handle_reset on v2:172.21.15.193:6836/909252228 2024-09-21T01:00:44.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.375+0000 7f64007f2740 1 -- 172.21.15.1:0/2218292263 shutdown_connections 2024-09-21T01:00:44.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.378+0000 7f64007f2740 1 -- 172.21.15.1:0/2218292263 wait complete. 2024-09-21T01:00:44.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.378+0000 7f64007f2740 20 client.16500 trim_cache size 0 max 16384 2024-09-21T01:00:44.384 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T01:00:44.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.382+0000 7f63fa27e640 1 -- 172.21.15.1:0/2165997330 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f63dc0b6710 msgr2=0x7f63dc0b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:44.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.383+0000 7f63fa27e640 1 --2- 172.21.15.1:0/2165997330 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f63dc0b6710 0x7f63dc0b8c20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f63e40096c0 tx=0x7f63e4005fd0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.383+0000 7f63fa27e640 1 -- 172.21.15.1:0/2165997330 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63f4111f40 msgr2=0x7f63f4113750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:44.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.383+0000 7f63fa27e640 1 --2- 172.21.15.1:0/2165997330 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63f4111f40 0x7f63f4113750 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f63e800c970 tx=0x7f63e800ce30 comp rx=0 tx=0).stop 2024-09-21T01:00:44.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.383+0000 7f63fa27e640 1 -- 172.21.15.1:0/2165997330 shutdown_connections 2024-09-21T01:00:44.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.383+0000 7f63fa27e640 1 --2- 172.21.15.1:0/2165997330 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63f411cc30 0x7f63f4113d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.383+0000 7f63fa27e640 1 --2- 172.21.15.1:0/2165997330 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f63dc0b6710 0x7f63dc0b8c20 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.383+0000 7f63fa27e640 1 --2- 172.21.15.1:0/2165997330 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63f4111f40 0x7f63f4113750 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.383+0000 7f63fa27e640 1 --2- 172.21.15.1:0/2165997330 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63f410a9e0 0x7f63f411a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.384+0000 7f63fa27e640 1 -- 172.21.15.1:0/2165997330 >> 172.21.15.1:0/2165997330 conn(0x7f63f4070ec0 msgr2=0x7f63f4071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:44.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.384+0000 7f63fa27e640 1 -- 172.21.15.1:0/2165997330 shutdown_connections 2024-09-21T01:00:44.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:44.384+0000 7f63fa27e640 1 -- 172.21.15.1:0/2165997330 wait complete. 2024-09-21T01:00:45.262 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T01:00:45.595 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:00:45.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:45 smithi001 ceph-mon[31211]: pgmap v464: 97 pgs: 97 active+clean; 432 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.7 MiB/s wr, 148 op/s 2024-09-21T01:00:45.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:45 smithi193 ceph-mon[34660]: pgmap v464: 97 pgs: 97 active+clean; 432 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.7 MiB/s wr, 148 op/s 2024-09-21T01:00:45.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:45 smithi042 ceph-mon[34481]: pgmap v464: 97 pgs: 97 active+clean; 432 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.7 MiB/s wr, 148 op/s 2024-09-21T01:00:46.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.267+0000 7f2087a42640 1 -- 172.21.15.1:0/408933437 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2080104880 msgr2=0x7f2080104c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:46.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.267+0000 7f2087a42640 1 --2- 172.21.15.1:0/408933437 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2080104880 0x7f2080104c90 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f207c009900 tx=0x7f207c02a410 comp rx=0 tx=0).stop 2024-09-21T01:00:46.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.267+0000 7f2087a42640 1 -- 172.21.15.1:0/408933437 shutdown_connections 2024-09-21T01:00:46.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.267+0000 7f2087a42640 1 --2- 172.21.15.1:0/408933437 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f208010de30 0x7f2080110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:46.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.267+0000 7f2087a42640 1 --2- 172.21.15.1:0/408933437 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20801052b0 0x7f208010d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:46.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.267+0000 7f2087a42640 1 --2- 172.21.15.1:0/408933437 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2080104880 0x7f2080104c90 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:46.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.267+0000 7f2087a42640 1 -- 172.21.15.1:0/408933437 >> 172.21.15.1:0/408933437 conn(0x7f20800797e0 msgr2=0x7f2080079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:46.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.267+0000 7f2087a42640 1 -- 172.21.15.1:0/408933437 shutdown_connections 2024-09-21T01:00:46.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.267+0000 7f2087a42640 1 -- 172.21.15.1:0/408933437 wait complete. 2024-09-21T01:00:46.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.268+0000 7f2087a42640 1 Processor -- start 2024-09-21T01:00:46.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.268+0000 7f2087a42640 1 -- start start 2024-09-21T01:00:46.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.268+0000 7f2087a42640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2080104880 0x7f208019a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:46.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.268+0000 7f2087a42640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20801052b0 0x7f208019aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:46.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.268+0000 7f2087a42640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f208010de30 0x7f208019fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:46.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.268+0000 7f2087a42640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2080113ad0 con 0x7f2080104880 2024-09-21T01:00:46.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.268+0000 7f2087a42640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2080113950 con 0x7f208010de30 2024-09-21T01:00:46.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.268+0000 7f2087a42640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2080113c50 con 0x7f20801052b0 2024-09-21T01:00:46.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.268+0000 7f20857de640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2080104880 0x7f208019a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:46.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.268+0000 7f20857de640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2080104880 0x7f208019a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54922/0 (socket says 172.21.15.1:54922) 2024-09-21T01:00:46.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.268+0000 7f20857de640 1 -- 172.21.15.1:0/3977391320 learned_addr learned my addr 172.21.15.1:0/3977391320 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:46.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.268+0000 7f2084fdd640 1 --2- 172.21.15.1:0/3977391320 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20801052b0 0x7f208019aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:46.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.269+0000 7f2085fdf640 1 --2- 172.21.15.1:0/3977391320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f208010de30 0x7f208019fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:46.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.269+0000 7f20857de640 1 -- 172.21.15.1:0/3977391320 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20801052b0 msgr2=0x7f208019aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:46.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.269+0000 7f20857de640 1 --2- 172.21.15.1:0/3977391320 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20801052b0 0x7f208019aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:46.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.269+0000 7f20857de640 1 -- 172.21.15.1:0/3977391320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f208010de30 msgr2=0x7f208019fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:46.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.269+0000 7f20857de640 1 --2- 172.21.15.1:0/3977391320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f208010de30 0x7f208019fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:46.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.269+0000 7f20857de640 1 -- 172.21.15.1:0/3977391320 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20801a0470 con 0x7f2080104880 2024-09-21T01:00:46.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.269+0000 7f2084fdd640 1 --2- 172.21.15.1:0/3977391320 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20801052b0 0x7f208019aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:46.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.269+0000 7f20857de640 1 --2- 172.21.15.1:0/3977391320 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2080104880 0x7f208019a500 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f207c032fd0 tx=0x7f207c031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:46.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.269+0000 7f20767fc640 1 -- 172.21.15.1:0/3977391320 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c03f030 con 0x7f2080104880 2024-09-21T01:00:46.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.270+0000 7f20767fc640 1 -- 172.21.15.1:0/3977391320 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f207c004490 con 0x7f2080104880 2024-09-21T01:00:46.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.270+0000 7f20767fc640 1 -- 172.21.15.1:0/3977391320 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c035070 con 0x7f2080104880 2024-09-21T01:00:46.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.270+0000 7f2087a42640 1 -- 172.21.15.1:0/3977391320 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20801a0700 con 0x7f2080104880 2024-09-21T01:00:46.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.270+0000 7f2087a42640 1 -- 172.21.15.1:0/3977391320 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20801a0ad0 con 0x7f2080104880 2024-09-21T01:00:46.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.273+0000 7f208dfb6740 1 Processor -- start 2024-09-21T01:00:46.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.273+0000 7f208dfb6740 1 -- start start 2024-09-21T01:00:46.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.273+0000 7f208dfb6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ccd6ce070 0x564ccda752c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:46.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.273+0000 7f208dfb6740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564ccd6a51b0 0x564ccda75800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:46.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.273+0000 7f208dfb6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ccd6ad390 0x564ccda75d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:46.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.274+0000 7f208dfb6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564ccd9ebea0 con 0x564ccd6ce070 2024-09-21T01:00:46.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.274+0000 7f208dfb6740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564ccd9db2d0 con 0x564ccd6a51b0 2024-09-21T01:00:46.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.274+0000 7f208dfb6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564ccd9df0e0 con 0x564ccd6ad390 2024-09-21T01:00:46.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.274+0000 7f20767fc640 1 -- 172.21.15.1:0/3977391320 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f207c042030 con 0x7f2080104880 2024-09-21T01:00:46.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.274+0000 7f20857de640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564ccd6a51b0 0x564ccda75800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:46.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.274+0000 7f2085fdf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ccd6ce070 0x564ccda752c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:46.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.274+0000 7f2084fdd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ccd6ad390 0x564ccda75d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:46.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.274+0000 7f20857de640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564ccd6a51b0 0x564ccda75800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:43770/0 (socket says 172.21.15.1:43770) 2024-09-21T01:00:46.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.274+0000 7f2085fdf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ccd6ce070 0x564ccda752c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54938/0 (socket says 172.21.15.1:54938) 2024-09-21T01:00:46.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.274+0000 7f20857de640 1 -- 172.21.15.1:0/4124582117 learned_addr learned my addr 172.21.15.1:0/4124582117 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:46.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.274+0000 7f20857de640 1 -- 172.21.15.1:0/4124582117 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ccd6ad390 msgr2=0x564ccda75d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:46.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.274+0000 7f20857de640 1 --2- 172.21.15.1:0/4124582117 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ccd6ad390 0x564ccda75d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:46.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.274+0000 7f20857de640 1 -- 172.21.15.1:0/4124582117 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ccd6ce070 msgr2=0x564ccda752c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:46.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.274+0000 7f20857de640 1 --2- 172.21.15.1:0/4124582117 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ccd6ce070 0x564ccda752c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:46.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.274+0000 7f20857de640 1 -- 172.21.15.1:0/4124582117 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ccd739650 con 0x564ccd6a51b0 2024-09-21T01:00:46.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.274+0000 7f2084fdd640 1 --2- 172.21.15.1:0/4124582117 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ccd6ad390 0x564ccda75d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:46.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.275+0000 7f20857de640 1 --2- 172.21.15.1:0/4124582117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564ccd6a51b0 0x564ccda75800 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f207c10dc10 tx=0x7f207c10dd00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a949f42dc756987d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:46.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.275+0000 7f206b7fe640 1 -- 172.21.15.1:0/4124582117 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c116070 con 0x564ccd6a51b0 2024-09-21T01:00:46.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.275+0000 7f206b7fe640 1 -- 172.21.15.1:0/4124582117 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f207c109520 con 0x564ccd6a51b0 2024-09-21T01:00:46.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.275+0000 7f206b7fe640 1 -- 172.21.15.1:0/4124582117 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c111b50 con 0x564ccd6a51b0 2024-09-21T01:00:46.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.275+0000 7f20767fc640 1 --2- 172.21.15.1:0/3977391320 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f206c0b6510 0x7f206c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:46.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.275+0000 7f2085fdf640 1 --2- 172.21.15.1:0/3977391320 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f206c0b6510 0x7f206c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:46.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.276+0000 7f20767fc640 1 -- 172.21.15.1:0/3977391320 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f207c107710 con 0x7f2080104880 2024-09-21T01:00:46.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.276+0000 7f208dfb6740 1 -- 172.21.15.1:0/4124582117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564ccd6a51b0 msgr2=0x564ccda75800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:46.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.276+0000 7f208dfb6740 1 --2- 172.21.15.1:0/4124582117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564ccd6a51b0 0x564ccda75800 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f207c10dc10 tx=0x7f207c10dd00 comp rx=0 tx=0).stop 2024-09-21T01:00:46.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.276+0000 7f2085fdf640 1 --2- 172.21.15.1:0/3977391320 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f206c0b6510 0x7f206c0b8a20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2078005fd0 tx=0x7f2078009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:46.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.276+0000 7f208dfb6740 1 -- 172.21.15.1:0/4124582117 shutdown_connections 2024-09-21T01:00:46.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.276+0000 7f208dfb6740 1 --2- 172.21.15.1:0/4124582117 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ccd6ad390 0x564ccda75d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:46.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.276+0000 7f208dfb6740 1 --2- 172.21.15.1:0/4124582117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564ccd6a51b0 0x564ccda75800 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:46.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.276+0000 7f208dfb6740 1 --2- 172.21.15.1:0/4124582117 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ccd6ce070 0x564ccda752c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:46.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.276+0000 7f208dfb6740 1 -- 172.21.15.1:0/4124582117 >> 172.21.15.1:0/4124582117 conn(0x564ccd6c2460 msgr2=0x564ccda731b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:46.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.277+0000 7f208dfb6740 1 -- 172.21.15.1:0/4124582117 shutdown_connections 2024-09-21T01:00:46.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.277+0000 7f208dfb6740 1 -- 172.21.15.1:0/4124582117 wait complete. 2024-09-21T01:00:46.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.277+0000 7f208dfb6740 1 -- start start 2024-09-21T01:00:46.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.277+0000 7f208dfb6740 1 Processor -- start 2024-09-21T01:00:46.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.278+0000 7f208dfb6740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564ccd6a51b0 0x564ccda809c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:46.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.278+0000 7f208dfb6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ccd6ad390 0x564ccda80f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:46.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.278+0000 7f208dfb6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ccd6ce070 0x564ccda81460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:46.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.278+0000 7f208dfb6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564ccd83c700 con 0x564ccd6ce070 2024-09-21T01:00:46.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.278+0000 7f208dfb6740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564ccd976160 con 0x564ccd6a51b0 2024-09-21T01:00:46.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.278+0000 7f208dfb6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564ccda83860 con 0x564ccd6ad390 2024-09-21T01:00:46.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.278+0000 7f20857de640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564ccd6a51b0 0x564ccda809c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:46.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.278+0000 7f20857de640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564ccd6a51b0 0x564ccda809c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:43784/0 (socket says 172.21.15.1:43784) 2024-09-21T01:00:46.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.278+0000 7f20857de640 1 -- 172.21.15.1:0/742969394 learned_addr learned my addr 172.21.15.1:0/742969394 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:46.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.278+0000 7f2084fdd640 1 --2- 172.21.15.1:0/742969394 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ccd6ad390 0x564ccda80f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:46.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.279+0000 7f208dfb6740 10 client.0 _ll_register_callbacks cb 0x564ccd98f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:46.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.279+0000 7f20857de640 1 -- 172.21.15.1:0/742969394 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ccd6ad390 msgr2=0x564ccda80f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:46.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.279+0000 7f20857de640 1 --2- 172.21.15.1:0/742969394 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ccd6ad390 0x564ccda80f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:46.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.279+0000 7f20857de640 1 -- 172.21.15.1:0/742969394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ccd6ce070 msgr2=0x564ccda81460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:46.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.279+0000 7f20857de640 1 --2- 172.21.15.1:0/742969394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ccd6ce070 0x564ccda81460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:46.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.279+0000 7f20857de640 1 -- 172.21.15.1:0/742969394 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ccd9a3c90 con 0x564ccd6a51b0 2024-09-21T01:00:46.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.279+0000 7f2084fdd640 1 --2- 172.21.15.1:0/742969394 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ccd6ad390 0x564ccda80f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:46.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.279+0000 7f20857de640 1 --2- 172.21.15.1:0/742969394 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564ccd6a51b0 0x564ccda809c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f207c0c9e50 tx=0x7f207c005cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43f32be693c2f06d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:46.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.279+0000 7f2068ff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:00:46.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.279+0000 7f2068ff9640 1 -- 172.21.15.1:0/742969394 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c049070 con 0x564ccd6a51b0 2024-09-21T01:00:46.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.280+0000 7f208dfb6740 1 -- 172.21.15.1:0/742969394 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f207c109520 con 0x564ccd6a51b0 2024-09-21T01:00:46.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.280+0000 7f2068ff9640 1 -- 172.21.15.1:0/742969394 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f207c111460 con 0x564ccd6a51b0 2024-09-21T01:00:46.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.280+0000 7f2068ff9640 1 -- 172.21.15.1:0/742969394 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f207c116030 con 0x564ccd6a51b0 2024-09-21T01:00:46.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.280+0000 7f208dfb6740 10 client.26174 fetch_fsmap learned FSMap version 33 2024-09-21T01:00:46.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.280+0000 7f208dfb6740 1 -- 172.21.15.1:0/742969394 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564ccda8f440 con 0x564ccd6a51b0 2024-09-21T01:00:46.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.280+0000 7f2068ff9640 1 -- 172.21.15.1:0/742969394 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f207c109520 con 0x564ccd6a51b0 2024-09-21T01:00:46.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.280+0000 7f2068ff9640 1 -- 172.21.15.1:0/742969394 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f207c0c9af0 con 0x564ccd6a51b0 2024-09-21T01:00:46.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.280+0000 7f208dfb6740 10 client.26174 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:00:46.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.280+0000 7f208dfb6740 10 client.26174 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T01:00:46.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.280+0000 7f208dfb6740 20 client.26174 populate_metadata read hostname 'smithi001' 2024-09-21T01:00:46.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.280+0000 7f208dfb6740 1 --2- 172.21.15.1:0/742969394 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x564ccd68c9f0 0x564ccda92970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:46.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.281+0000 7f208dfb6740 4 client.26174 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:00:46.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.281+0000 7f208dfb6740 1 -- 172.21.15.1:0/742969394 --> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ccd9eddf0 con 0x564ccd68c9f0 2024-09-21T01:00:46.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.281+0000 7f2084fdd640 1 --2- 172.21.15.1:0/742969394 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x564ccd68c9f0 0x564ccda92970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:46.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.281+0000 7f2068ff9640 10 client.26174 ms_handle_connect on v2:172.21.15.42:6836/2395608508 2024-09-21T01:00:46.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.281+0000 7f2084fdd640 1 --2- 172.21.15.1:0/742969394 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x564ccd68c9f0 0x564ccda92970 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ce01ad9868549b62 server_cookie=beaa5b96ca1f8f6a in_seq=0 out_seq=0 2024-09-21T01:00:46.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.284+0000 7f2068ff9640 1 -- 172.21.15.1:0/742969394 <== mds.2 v2:172.21.15.42:6836/2395608508 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564ccd9eddf0 con 0x564ccd68c9f0 2024-09-21T01:00:46.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.284+0000 7f2068ff9640 10 client.26174 handle_command_reply: tid=0 2024-09-21T01:00:46.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.284+0000 7f208dfb6740 1 client.26174 shutdown 2024-09-21T01:00:46.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.284+0000 7f208dfb6740 1 -- 172.21.15.1:0/742969394 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564ccd6a51b0 msgr2=0x564ccda809c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:46.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.284+0000 7f208dfb6740 1 --2- 172.21.15.1:0/742969394 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564ccd6a51b0 0x564ccda809c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f207c0c9e50 tx=0x7f207c005cb0 comp rx=0 tx=0).stop 2024-09-21T01:00:46.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.285+0000 7f208dfb6740 1 -- 172.21.15.1:0/742969394 shutdown_connections 2024-09-21T01:00:46.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.285+0000 7f208dfb6740 1 --2- 172.21.15.1:0/742969394 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x564ccd68c9f0 0x564ccda92970 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:46.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.285+0000 7f208dfb6740 1 --2- 172.21.15.1:0/742969394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ccd6ce070 0x564ccda81460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:46.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.285+0000 7f208dfb6740 1 --2- 172.21.15.1:0/742969394 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ccd6ad390 0x564ccda80f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:46.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.285+0000 7f208dfb6740 1 --2- 172.21.15.1:0/742969394 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564ccd6a51b0 0x564ccda809c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:46.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.285+0000 7f2068ff9640 0 client.26174 ms_handle_reset on v2:172.21.15.42:6836/2395608508 2024-09-21T01:00:46.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.285+0000 7f208dfb6740 1 -- 172.21.15.1:0/742969394 >> 172.21.15.1:0/742969394 conn(0x564ccd6c2460 msgr2=0x564ccda784a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:46.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.285+0000 7f208dfb6740 1 -- 172.21.15.1:0/742969394 shutdown_connections 2024-09-21T01:00:46.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.285+0000 7f208dfb6740 1 -- 172.21.15.1:0/742969394 wait complete. 2024-09-21T01:00:46.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.285+0000 7f208dfb6740 20 client.26174 trim_cache size 0 max 16384 2024-09-21T01:00:46.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.309+0000 7f208dfb6740 1 Processor -- start 2024-09-21T01:00:46.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.309+0000 7f208dfb6740 1 -- start start 2024-09-21T01:00:46.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.310+0000 7f208dfb6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ccd68c9f0 0x564ccda76cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:46.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.310+0000 7f208dfb6740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564ccd6a51b0 0x564ccda825f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:46.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.310+0000 7f208dfb6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ccd6ad390 0x564ccda72760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:46.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.310+0000 7f208dfb6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f20801ad2c0 con 0x564ccd68c9f0 2024-09-21T01:00:46.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.310+0000 7f208dfb6740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f20801aeec0 con 0x564ccd6a51b0 2024-09-21T01:00:46.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.310+0000 7f208dfb6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f20801ad990 con 0x564ccd6ad390 2024-09-21T01:00:46.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.310+0000 7f20857de640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ccd68c9f0 0x564ccda76cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:46.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.310+0000 7f20857de640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ccd68c9f0 0x564ccda76cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54964/0 (socket says 172.21.15.1:54964) 2024-09-21T01:00:46.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.310+0000 7f20857de640 1 -- 172.21.15.1:0/3819010542 learned_addr learned my addr 172.21.15.1:0/3819010542 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:46.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.310+0000 7f2084fdd640 1 --2- 172.21.15.1:0/3819010542 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564ccd6a51b0 0x564ccda825f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:46.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.310+0000 7f2085fdf640 1 --2- 172.21.15.1:0/3819010542 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ccd6ad390 0x564ccda72760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:46.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.310+0000 7f20857de640 1 -- 172.21.15.1:0/3819010542 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ccd6ad390 msgr2=0x564ccda72760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:46.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.310+0000 7f20857de640 1 --2- 172.21.15.1:0/3819010542 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ccd6ad390 0x564ccda72760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:46.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.310+0000 7f20857de640 1 -- 172.21.15.1:0/3819010542 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564ccd6a51b0 msgr2=0x564ccda825f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:46.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.310+0000 7f20857de640 1 --2- 172.21.15.1:0/3819010542 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564ccd6a51b0 0x564ccda825f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:46.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.310+0000 7f20857de640 1 -- 172.21.15.1:0/3819010542 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ccda7b5f0 con 0x564ccd68c9f0 2024-09-21T01:00:46.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.310+0000 7f20857de640 1 --2- 172.21.15.1:0/3819010542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ccd68c9f0 0x564ccda76cb0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f207c10de30 tx=0x7f207c03b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb21fc3dbc13a04 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:46.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.311+0000 7f206affd640 1 -- 172.21.15.1:0/3819010542 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c0cd390 con 0x564ccd68c9f0 2024-09-21T01:00:46.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.311+0000 7f206affd640 1 -- 172.21.15.1:0/3819010542 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f207c0cdf80 con 0x564ccd68c9f0 2024-09-21T01:00:46.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.311+0000 7f206affd640 1 -- 172.21.15.1:0/3819010542 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c0d2360 con 0x564ccd68c9f0 2024-09-21T01:00:46.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.311+0000 7f208dfb6740 1 -- 172.21.15.1:0/3819010542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ccd68c9f0 msgr2=0x564ccda76cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:46.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.311+0000 7f208dfb6740 1 --2- 172.21.15.1:0/3819010542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ccd68c9f0 0x564ccda76cb0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f207c10de30 tx=0x7f207c03b560 comp rx=0 tx=0).stop 2024-09-21T01:00:46.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.312+0000 7f208dfb6740 1 -- 172.21.15.1:0/3819010542 shutdown_connections 2024-09-21T01:00:46.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.312+0000 7f208dfb6740 1 --2- 172.21.15.1:0/3819010542 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ccd6ad390 0x564ccda72760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:46.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.312+0000 7f208dfb6740 1 --2- 172.21.15.1:0/3819010542 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564ccd6a51b0 0x564ccda825f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:46.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.312+0000 7f208dfb6740 1 --2- 172.21.15.1:0/3819010542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ccd68c9f0 0x564ccda76cb0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:46.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.312+0000 7f208dfb6740 1 -- 172.21.15.1:0/3819010542 >> 172.21.15.1:0/3819010542 conn(0x564ccd6c2460 msgr2=0x564ccda81ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:46.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.312+0000 7f208dfb6740 1 -- 172.21.15.1:0/3819010542 shutdown_connections 2024-09-21T01:00:46.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.312+0000 7f208dfb6740 1 -- 172.21.15.1:0/3819010542 wait complete. 2024-09-21T01:00:46.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.312+0000 7f208dfb6740 1 -- start start 2024-09-21T01:00:46.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.312+0000 7f208dfb6740 1 Processor -- start 2024-09-21T01:00:46.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.313+0000 7f208dfb6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ccd68c9f0 0x564ccda88f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:46.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.313+0000 7f208dfb6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ccd6a51b0 0x564ccda84450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:46.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.313+0000 7f208dfb6740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564ccd6ad390 0x564ccda84990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:46.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.313+0000 7f208dfb6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f20801ae7f0 con 0x564ccd68c9f0 2024-09-21T01:00:46.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.313+0000 7f208dfb6740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f20801ae120 con 0x564ccd6ad390 2024-09-21T01:00:46.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.313+0000 7f208dfb6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f20801ab2a0 con 0x564ccd6a51b0 2024-09-21T01:00:46.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.313+0000 7f208dfb6740 10 client.0 _ll_register_callbacks cb 0x7f2078009920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:46.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.313+0000 7f20857de640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ccd68c9f0 0x564ccda88f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:46.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.313+0000 7f2085fdf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564ccd6ad390 0x564ccda84990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:46.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.313+0000 7f2084fdd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ccd6a51b0 0x564ccda84450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:46.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.313+0000 7f2085fdf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564ccd6ad390 0x564ccda84990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:43800/0 (socket says 172.21.15.1:43800) 2024-09-21T01:00:46.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.313+0000 7f2084fdd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ccd6a51b0 0x564ccda84450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:36324/0 (socket says 172.21.15.1:36324) 2024-09-21T01:00:46.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.313+0000 7f20857de640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ccd68c9f0 0x564ccda88f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54968/0 (socket says 172.21.15.1:54968) 2024-09-21T01:00:46.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.313+0000 7f2085fdf640 1 -- 172.21.15.1:0/3838245866 learned_addr learned my addr 172.21.15.1:0/3838245866 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:46.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.313+0000 7f2084fdd640 1 -- 172.21.15.1:0/3838245866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564ccd6ad390 msgr2=0x564ccda84990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:46.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.313+0000 7f2084fdd640 1 --2- 172.21.15.1:0/3838245866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564ccd6ad390 0x564ccda84990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:46.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.313+0000 7f2084fdd640 1 -- 172.21.15.1:0/3838245866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ccd68c9f0 msgr2=0x564ccda88f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:46.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.313+0000 7f2084fdd640 1 --2- 172.21.15.1:0/3838245866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ccd68c9f0 0x564ccda88f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:46.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.313+0000 7f2084fdd640 1 -- 172.21.15.1:0/3838245866 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ccda84ed0 con 0x564ccd6a51b0 2024-09-21T01:00:46.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.313+0000 7f20857de640 1 --2- 172.21.15.1:0/3838245866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ccd68c9f0 0x564ccda88f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:46.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.314+0000 7f2084fdd640 1 --2- 172.21.15.1:0/3838245866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ccd6a51b0 0x564ccda84450 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x564ccda930a0 tx=0x7f20700039c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f01e9bd4129a4fb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:46.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.314+0000 7f2068ff9640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T01:00:46.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.314+0000 7f2068ff9640 1 -- 172.21.15.1:0/3838245866 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2070005220 con 0x564ccd6a51b0 2024-09-21T01:00:46.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.314+0000 7f208dfb6740 1 -- 172.21.15.1:0/3838245866 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f207c0cdf80 con 0x564ccd6a51b0 2024-09-21T01:00:46.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.314+0000 7f2068ff9640 1 -- 172.21.15.1:0/3838245866 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f20700053c0 con 0x564ccd6a51b0 2024-09-21T01:00:46.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.314+0000 7f2068ff9640 1 -- 172.21.15.1:0/3838245866 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f20700044c0 con 0x564ccd6a51b0 2024-09-21T01:00:46.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.314+0000 7f208dfb6740 10 client.26062 fetch_fsmap learned FSMap version 33 2024-09-21T01:00:46.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.314+0000 7f208dfb6740 1 -- 172.21.15.1:0/3838245866 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564ccdafcf90 con 0x564ccd6a51b0 2024-09-21T01:00:46.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.314+0000 7f2068ff9640 1 -- 172.21.15.1:0/3838245866 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f207c0cdf80 con 0x564ccd6a51b0 2024-09-21T01:00:46.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.314+0000 7f2068ff9640 1 -- 172.21.15.1:0/3838245866 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f2070010930 con 0x564ccd6a51b0 2024-09-21T01:00:46.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.314+0000 7f208dfb6740 10 client.26062 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:00:46.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.314+0000 7f208dfb6740 10 client.26062 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T01:00:46.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.314+0000 7f208dfb6740 20 client.26062 populate_metadata read hostname 'smithi001' 2024-09-21T01:00:46.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.314+0000 7f208dfb6740 1 --2- 172.21.15.1:0/3838245866 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x564ccd6ce070 0x564ccdaff7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:46.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.315+0000 7f208dfb6740 4 client.26062 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:00:46.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.315+0000 7f208dfb6740 1 -- 172.21.15.1:0/3838245866 --> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564ccd9e98a0 con 0x564ccd6ce070 2024-09-21T01:00:46.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.315+0000 7f20857de640 1 --2- 172.21.15.1:0/3838245866 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x564ccd6ce070 0x564ccdaff7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:46.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.315+0000 7f2068ff9640 10 client.26062 ms_handle_connect on v2:172.21.15.42:6836/2395608508 2024-09-21T01:00:46.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.315+0000 7f20857de640 1 --2- 172.21.15.1:0/3838245866 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x564ccd6ce070 0x564ccdaff7e0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a6f1686b4a39a85c server_cookie=138c88811079cdfe in_seq=0 out_seq=0 2024-09-21T01:00:46.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.320+0000 7f2068ff9640 1 -- 172.21.15.1:0/3838245866 <== mds.2 v2:172.21.15.42:6836/2395608508 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564ccd9e98a0 con 0x564ccd6ce070 2024-09-21T01:00:46.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.320+0000 7f2068ff9640 10 client.26062 handle_command_reply: tid=0 2024-09-21T01:00:46.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.320+0000 7f208dfb6740 1 client.26062 shutdown 2024-09-21T01:00:46.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.320+0000 7f208dfb6740 1 -- 172.21.15.1:0/3838245866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ccd6a51b0 msgr2=0x564ccda84450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:46.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.320+0000 7f208dfb6740 1 --2- 172.21.15.1:0/3838245866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ccd6a51b0 0x564ccda84450 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x564ccda930a0 tx=0x7f20700039c0 comp rx=0 tx=0).stop 2024-09-21T01:00:46.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.320+0000 7f208dfb6740 1 -- 172.21.15.1:0/3838245866 shutdown_connections 2024-09-21T01:00:46.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.320+0000 7f208dfb6740 1 --2- 172.21.15.1:0/3838245866 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x564ccd6ce070 0x564ccdaff7e0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:46.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.320+0000 7f208dfb6740 1 --2- 172.21.15.1:0/3838245866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564ccd6ad390 0x564ccda84990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:46.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.320+0000 7f208dfb6740 1 --2- 172.21.15.1:0/3838245866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ccd6a51b0 0x564ccda84450 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:46.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.320+0000 7f2068ff9640 0 client.26062 ms_handle_reset on v2:172.21.15.42:6836/2395608508 2024-09-21T01:00:46.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.320+0000 7f208dfb6740 1 --2- 172.21.15.1:0/3838245866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ccd68c9f0 0x564ccda88f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:46.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.320+0000 7f208dfb6740 1 -- 172.21.15.1:0/3838245866 >> 172.21.15.1:0/3838245866 conn(0x564ccd6c2460 msgr2=0x564ccda76a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:46.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.320+0000 7f208dfb6740 1 -- 172.21.15.1:0/3838245866 shutdown_connections 2024-09-21T01:00:46.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.320+0000 7f208dfb6740 1 -- 172.21.15.1:0/3838245866 wait complete. 2024-09-21T01:00:46.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.320+0000 7f208dfb6740 20 client.26062 trim_cache size 0 max 16384 2024-09-21T01:00:46.323 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T01:00:46.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.321+0000 7f2087a42640 1 -- 172.21.15.1:0/3977391320 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f206c0b6510 msgr2=0x7f206c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:46.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.321+0000 7f2087a42640 1 --2- 172.21.15.1:0/3977391320 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f206c0b6510 0x7f206c0b8a20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2078005fd0 tx=0x7f2078009500 comp rx=0 tx=0).stop 2024-09-21T01:00:46.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.321+0000 7f2087a42640 1 -- 172.21.15.1:0/3977391320 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2080104880 msgr2=0x7f208019a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:46.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.321+0000 7f2087a42640 1 --2- 172.21.15.1:0/3977391320 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2080104880 0x7f208019a500 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f207c032fd0 tx=0x7f207c031a20 comp rx=0 tx=0).stop 2024-09-21T01:00:46.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.321+0000 7f2087a42640 1 -- 172.21.15.1:0/3977391320 shutdown_connections 2024-09-21T01:00:46.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.321+0000 7f2087a42640 1 --2- 172.21.15.1:0/3977391320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f208010de30 0x7f208019fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:46.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.321+0000 7f2087a42640 1 --2- 172.21.15.1:0/3977391320 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20801052b0 0x7f208019aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:46.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.321+0000 7f2087a42640 1 --2- 172.21.15.1:0/3977391320 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f206c0b6510 0x7f206c0b8a20 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:46.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.321+0000 7f2087a42640 1 --2- 172.21.15.1:0/3977391320 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2080104880 0x7f208019a500 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:46.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.321+0000 7f2087a42640 1 -- 172.21.15.1:0/3977391320 >> 172.21.15.1:0/3977391320 conn(0x7f20800797e0 msgr2=0x7f20801068c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:46.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.321+0000 7f2087a42640 1 -- 172.21.15.1:0/3977391320 shutdown_connections 2024-09-21T01:00:46.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:46.321+0000 7f2087a42640 1 -- 172.21.15.1:0/3977391320 wait complete. 2024-09-21T01:00:47.105 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T01:00:47.401 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:00:47.684 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:47 smithi001 ceph-mon[31211]: pgmap v465: 97 pgs: 97 active+clean; 436 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 171 op/s 2024-09-21T01:00:47.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:47 smithi193 ceph-mon[34660]: pgmap v465: 97 pgs: 97 active+clean; 436 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 171 op/s 2024-09-21T01:00:47.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:47 smithi042 ceph-mon[34481]: pgmap v465: 97 pgs: 97 active+clean; 436 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 171 op/s 2024-09-21T01:00:47.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.919+0000 7f83fea88640 1 -- 172.21.15.1:0/4259679596 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83f8105350 msgr2=0x7f83f810d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:47.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.919+0000 7f83fea88640 1 --2- 172.21.15.1:0/4259679596 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83f8105350 0x7f83f810d8a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f83e8009900 tx=0x7f83e802a410 comp rx=0 tx=0).stop 2024-09-21T01:00:47.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.919+0000 7f83fea88640 1 -- 172.21.15.1:0/4259679596 shutdown_connections 2024-09-21T01:00:47.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.920+0000 7f83fea88640 1 --2- 172.21.15.1:0/4259679596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83f810de60 0x7f83f8110350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:47.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.920+0000 7f83fea88640 1 --2- 172.21.15.1:0/4259679596 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83f8105350 0x7f83f810d8a0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:47.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.920+0000 7f83fea88640 1 --2- 172.21.15.1:0/4259679596 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83f8104a00 0x7f83f8104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:47.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.920+0000 7f83fea88640 1 -- 172.21.15.1:0/4259679596 >> 172.21.15.1:0/4259679596 conn(0x7f83f80796b0 msgr2=0x7f83f8079ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:47.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.920+0000 7f83fea88640 1 -- 172.21.15.1:0/4259679596 shutdown_connections 2024-09-21T01:00:47.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.920+0000 7f83fea88640 1 -- 172.21.15.1:0/4259679596 wait complete. 2024-09-21T01:00:47.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.921+0000 7f83fea88640 1 Processor -- start 2024-09-21T01:00:47.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.921+0000 7f83fea88640 1 -- start start 2024-09-21T01:00:47.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.921+0000 7f83fea88640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83f8104a00 0x7f83f819c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:47.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.921+0000 7f83fea88640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83f8105350 0x7f83f819cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:47.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.921+0000 7f83fea88640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83f810de60 0x7f83f81a1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:47.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.921+0000 7f83fea88640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f83f8113ac0 con 0x7f83f8104a00 2024-09-21T01:00:47.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.921+0000 7f83fea88640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f83f8113940 con 0x7f83f810de60 2024-09-21T01:00:47.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.921+0000 7f83fea88640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f83f8113c40 con 0x7f83f8105350 2024-09-21T01:00:47.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.921+0000 7f83fc824640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83f8104a00 0x7f83f819c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:47.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.921+0000 7f83fd025640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83f810de60 0x7f83f81a1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:47.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.921+0000 7f83effff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83f8105350 0x7f83f819cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:47.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.921+0000 7f83fc824640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83f8104a00 0x7f83f819c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54986/0 (socket says 172.21.15.1:54986) 2024-09-21T01:00:47.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.921+0000 7f83fc824640 1 -- 172.21.15.1:0/1059791375 learned_addr learned my addr 172.21.15.1:0/1059791375 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:47.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.922+0000 7f83effff640 1 -- 172.21.15.1:0/1059791375 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83f810de60 msgr2=0x7f83f81a1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:47.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.922+0000 7f83effff640 1 --2- 172.21.15.1:0/1059791375 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83f810de60 0x7f83f81a1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:47.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.922+0000 7f83effff640 1 -- 172.21.15.1:0/1059791375 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83f8104a00 msgr2=0x7f83f819c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:47.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.922+0000 7f83effff640 1 --2- 172.21.15.1:0/1059791375 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83f8104a00 0x7f83f819c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:47.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.922+0000 7f83effff640 1 -- 172.21.15.1:0/1059791375 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83f81a2660 con 0x7f83f8105350 2024-09-21T01:00:47.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.922+0000 7f83fd025640 1 --2- 172.21.15.1:0/1059791375 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83f810de60 0x7f83f81a1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:47.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.922+0000 7f83effff640 1 --2- 172.21.15.1:0/1059791375 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83f8105350 0x7f83f819cc90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f83e802a930 tx=0x7f83e8031a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:47.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.922+0000 7f83edffb640 1 -- 172.21.15.1:0/1059791375 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e803f070 con 0x7f83f8105350 2024-09-21T01:00:47.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.922+0000 7f83fea88640 1 -- 172.21.15.1:0/1059791375 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83f81a28f0 con 0x7f83f8105350 2024-09-21T01:00:47.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.922+0000 7f83edffb640 1 -- 172.21.15.1:0/1059791375 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83e8004490 con 0x7f83f8105350 2024-09-21T01:00:47.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.922+0000 7f83edffb640 1 -- 172.21.15.1:0/1059791375 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e8035070 con 0x7f83f8105350 2024-09-21T01:00:47.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.923+0000 7f83fea88640 1 -- 172.21.15.1:0/1059791375 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83f81a90b0 con 0x7f83f8105350 2024-09-21T01:00:47.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.926+0000 7f83edffb640 1 -- 172.21.15.1:0/1059791375 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f83e803b460 con 0x7f83f8105350 2024-09-21T01:00:47.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.926+0000 7f8404ffc740 1 Processor -- start 2024-09-21T01:00:47.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.926+0000 7f8404ffc740 1 -- start start 2024-09-21T01:00:47.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.927+0000 7f8404ffc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55924a089070 0x55924a4302c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:47.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.927+0000 7f8404ffc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55924a0601b0 0x55924a430800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:47.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.927+0000 7f8404ffc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924a068390 0x55924a430d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:47.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.927+0000 7f8404ffc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55924a3a6ea0 con 0x55924a068390 2024-09-21T01:00:47.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.927+0000 7f8404ffc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55924a3962d0 con 0x55924a0601b0 2024-09-21T01:00:47.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.927+0000 7f8404ffc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55924a39a0e0 con 0x55924a089070 2024-09-21T01:00:47.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.927+0000 7f83fd025640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55924a089070 0x55924a4302c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:47.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.927+0000 7f83fd025640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55924a089070 0x55924a4302c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:36354/0 (socket says 172.21.15.1:36354) 2024-09-21T01:00:47.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.927+0000 7f83fd025640 1 -- 172.21.15.1:0/1946469193 learned_addr learned my addr 172.21.15.1:0/1946469193 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:47.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.927+0000 7f83effff640 1 --2- 172.21.15.1:0/1946469193 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924a068390 0x55924a430d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:47.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.927+0000 7f83fd025640 1 -- 172.21.15.1:0/1946469193 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55924a0601b0 msgr2=0x55924a430800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:47.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.927+0000 7f83fd025640 1 --2- 172.21.15.1:0/1946469193 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55924a0601b0 0x55924a430800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:47.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.927+0000 7f83fd025640 1 -- 172.21.15.1:0/1946469193 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924a068390 msgr2=0x55924a430d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:47.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.927+0000 7f83fd025640 1 --2- 172.21.15.1:0/1946469193 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924a068390 0x55924a430d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:47.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.928+0000 7f83fd025640 1 -- 172.21.15.1:0/1946469193 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55924a0f4650 con 0x55924a089070 2024-09-21T01:00:47.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.928+0000 7f83edffb640 1 --2- 172.21.15.1:0/1059791375 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f83e00b6510 0x7f83e00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:47.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.928+0000 7f83fd025640 1 --2- 172.21.15.1:0/1946469193 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55924a089070 0x55924a4302c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f83f00117e0 tx=0x7f83f0011ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2c78f374bfb911e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:47.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.928+0000 7f83fc824640 1 --2- 172.21.15.1:0/1059791375 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f83e00b6510 0x7f83e00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:47.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.928+0000 7f83edffb640 1 -- 172.21.15.1:0/1059791375 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f83e81077b0 con 0x7f83f8105350 2024-09-21T01:00:47.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.928+0000 7f83deffd640 1 -- 172.21.15.1:0/1946469193 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f0011310 con 0x55924a089070 2024-09-21T01:00:47.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.928+0000 7f83deffd640 1 -- 172.21.15.1:0/1946469193 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83f0003e20 con 0x55924a089070 2024-09-21T01:00:47.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.928+0000 7f83deffd640 1 -- 172.21.15.1:0/1946469193 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f00044f0 con 0x55924a089070 2024-09-21T01:00:47.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.929+0000 7f8404ffc740 1 -- 172.21.15.1:0/1946469193 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55924a089070 msgr2=0x55924a4302c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:47.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.929+0000 7f8404ffc740 1 --2- 172.21.15.1:0/1946469193 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55924a089070 0x55924a4302c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f83f00117e0 tx=0x7f83f0011ca0 comp rx=0 tx=0).stop 2024-09-21T01:00:47.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.929+0000 7f83fc824640 1 --2- 172.21.15.1:0/1059791375 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f83e00b6510 0x7f83e00b8a20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x55924a42ef40 tx=0x7f83f4009530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:47.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.929+0000 7f8404ffc740 1 -- 172.21.15.1:0/1946469193 shutdown_connections 2024-09-21T01:00:47.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.929+0000 7f8404ffc740 1 --2- 172.21.15.1:0/1946469193 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924a068390 0x55924a430d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:47.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.929+0000 7f8404ffc740 1 --2- 172.21.15.1:0/1946469193 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55924a0601b0 0x55924a430800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:47.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.929+0000 7f8404ffc740 1 --2- 172.21.15.1:0/1946469193 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55924a089070 0x55924a4302c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:47.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.929+0000 7f8404ffc740 1 -- 172.21.15.1:0/1946469193 >> 172.21.15.1:0/1946469193 conn(0x55924a07d460 msgr2=0x55924a42e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:47.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.929+0000 7f8404ffc740 1 -- 172.21.15.1:0/1946469193 shutdown_connections 2024-09-21T01:00:47.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.929+0000 7f8404ffc740 1 -- 172.21.15.1:0/1946469193 wait complete. 2024-09-21T01:00:47.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.930+0000 7f8404ffc740 1 -- start start 2024-09-21T01:00:47.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.930+0000 7f8404ffc740 1 Processor -- start 2024-09-21T01:00:47.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.930+0000 7f8404ffc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55924a0601b0 0x55924a43b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:47.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.930+0000 7f8404ffc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55924a068390 0x55924a43bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:47.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.930+0000 7f8404ffc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924a089070 0x55924a447d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:47.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.931+0000 7f8404ffc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55924a1f7700 con 0x55924a089070 2024-09-21T01:00:47.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.931+0000 7f8404ffc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55924a331160 con 0x55924a068390 2024-09-21T01:00:47.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.931+0000 7f8404ffc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55924a43eaa0 con 0x55924a0601b0 2024-09-21T01:00:47.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.931+0000 7f8404ffc740 10 client.0 _ll_register_callbacks cb 0x55924a34a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:47.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.931+0000 7f83fc824640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55924a0601b0 0x55924a43b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:47.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.931+0000 7f83fc824640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55924a0601b0 0x55924a43b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:36360/0 (socket says 172.21.15.1:36360) 2024-09-21T01:00:47.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.931+0000 7f83fc824640 1 -- 172.21.15.1:0/350937691 learned_addr learned my addr 172.21.15.1:0/350937691 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:47.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.931+0000 7f83effff640 1 --2- 172.21.15.1:0/350937691 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55924a068390 0x55924a43bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:47.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.931+0000 7f83fd025640 1 --2- 172.21.15.1:0/350937691 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924a089070 0x55924a447d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:47.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.931+0000 7f83effff640 1 -- 172.21.15.1:0/350937691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55924a0601b0 msgr2=0x55924a43b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:47.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.931+0000 7f83effff640 1 --2- 172.21.15.1:0/350937691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55924a0601b0 0x55924a43b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:47.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.931+0000 7f83effff640 1 -- 172.21.15.1:0/350937691 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924a089070 msgr2=0x55924a447d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:47.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.931+0000 7f83effff640 1 --2- 172.21.15.1:0/350937691 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924a089070 0x55924a447d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:47.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.931+0000 7f83effff640 1 -- 172.21.15.1:0/350937691 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55924a35ec90 con 0x55924a068390 2024-09-21T01:00:47.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.931+0000 7f83fc824640 1 --2- 172.21.15.1:0/350937691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55924a0601b0 0x55924a43b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:47.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.932+0000 7f83effff640 1 --2- 172.21.15.1:0/350937691 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55924a068390 0x55924a43bf20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f83e80cd670 tx=0x7f83e802a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4812c91c7285e8c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:47.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.932+0000 7f83d7fff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:00:47.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.932+0000 7f83d7fff640 1 -- 172.21.15.1:0/350937691 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e8048030 con 0x55924a068390 2024-09-21T01:00:47.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.932+0000 7f83d7fff640 1 -- 172.21.15.1:0/350937691 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f83e8107ba0 con 0x55924a068390 2024-09-21T01:00:47.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.932+0000 7f8404ffc740 1 -- 172.21.15.1:0/350937691 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83f0003e20 con 0x55924a068390 2024-09-21T01:00:47.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.932+0000 7f83d7fff640 1 -- 172.21.15.1:0/350937691 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f83e80cd0e0 con 0x55924a068390 2024-09-21T01:00:47.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.932+0000 7f8404ffc740 10 client.26189 fetch_fsmap learned FSMap version 33 2024-09-21T01:00:47.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.932+0000 7f8404ffc740 1 -- 172.21.15.1:0/350937691 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55924a44a810 con 0x55924a068390 2024-09-21T01:00:47.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.933+0000 7f83d7fff640 1 -- 172.21.15.1:0/350937691 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83f0003e20 con 0x55924a068390 2024-09-21T01:00:47.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.933+0000 7f83d7fff640 1 -- 172.21.15.1:0/350937691 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f83e804b060 con 0x55924a068390 2024-09-21T01:00:47.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.933+0000 7f8404ffc740 10 client.26189 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:00:47.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.933+0000 7f8404ffc740 10 client.26189 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T01:00:47.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.933+0000 7f8404ffc740 20 client.26189 populate_metadata read hostname 'smithi001' 2024-09-21T01:00:47.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.933+0000 7f8404ffc740 1 --2- 172.21.15.1:0/350937691 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x55924a0479f0 0x55924a44dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:47.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.933+0000 7f8404ffc740 4 client.26189 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:00:47.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.933+0000 7f8404ffc740 1 -- 172.21.15.1:0/350937691 --> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55924a3a8df0 con 0x55924a0479f0 2024-09-21T01:00:47.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.933+0000 7f83fc824640 1 --2- 172.21.15.1:0/350937691 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x55924a0479f0 0x55924a44dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:47.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.934+0000 7f83fc824640 1 --2- 172.21.15.1:0/350937691 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x55924a0479f0 0x55924a44dc10 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a74e35c362210c2b server_cookie=f8ca5b33f72dca5d in_seq=0 out_seq=0 2024-09-21T01:00:47.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.934+0000 7f83d7fff640 10 client.26189 ms_handle_connect on v2:172.21.15.193:6838/1365361177 2024-09-21T01:00:47.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.935+0000 7f83d7fff640 1 -- 172.21.15.1:0/350937691 <== mds.1 v2:172.21.15.193:6838/1365361177 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55924a3a8df0 con 0x55924a0479f0 2024-09-21T01:00:47.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.935+0000 7f83d7fff640 10 client.26189 handle_command_reply: tid=0 2024-09-21T01:00:47.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.935+0000 7f8404ffc740 1 client.26189 shutdown 2024-09-21T01:00:47.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.935+0000 7f8404ffc740 1 -- 172.21.15.1:0/350937691 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55924a068390 msgr2=0x55924a43bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:47.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.935+0000 7f8404ffc740 1 --2- 172.21.15.1:0/350937691 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55924a068390 0x55924a43bf20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f83e80cd670 tx=0x7f83e802a410 comp rx=0 tx=0).stop 2024-09-21T01:00:47.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.935+0000 7f8404ffc740 1 -- 172.21.15.1:0/350937691 shutdown_connections 2024-09-21T01:00:47.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.935+0000 7f8404ffc740 1 --2- 172.21.15.1:0/350937691 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x55924a0479f0 0x55924a44dc10 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:47.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.935+0000 7f8404ffc740 1 --2- 172.21.15.1:0/350937691 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924a089070 0x55924a447d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:47.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.935+0000 7f8404ffc740 1 --2- 172.21.15.1:0/350937691 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55924a068390 0x55924a43bf20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:47.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.935+0000 7f8404ffc740 1 --2- 172.21.15.1:0/350937691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55924a0601b0 0x55924a43b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:47.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.935+0000 7f83d7fff640 0 client.26189 ms_handle_reset on v2:172.21.15.193:6838/1365361177 2024-09-21T01:00:47.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.935+0000 7f8404ffc740 1 -- 172.21.15.1:0/350937691 >> 172.21.15.1:0/350937691 conn(0x55924a07d460 msgr2=0x55924a433450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:47.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.936+0000 7f8404ffc740 1 -- 172.21.15.1:0/350937691 shutdown_connections 2024-09-21T01:00:47.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.936+0000 7f8404ffc740 1 -- 172.21.15.1:0/350937691 wait complete. 2024-09-21T01:00:47.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.936+0000 7f8404ffc740 20 client.26189 trim_cache size 0 max 16384 2024-09-21T01:00:47.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.962+0000 7f8404ffc740 1 Processor -- start 2024-09-21T01:00:47.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.966+0000 7f8404ffc740 1 -- start start 2024-09-21T01:00:47.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.966+0000 7f8404ffc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55924a0601b0 0x55924a433ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:47.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.966+0000 7f8404ffc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55924a068390 0x55924a43b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:47.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.966+0000 7f8404ffc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924a089070 0x55924a43bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:47.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.966+0000 7f8404ffc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f83f81b1680 con 0x55924a089070 2024-09-21T01:00:47.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.966+0000 7f8404ffc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f83f81b3280 con 0x55924a0601b0 2024-09-21T01:00:47.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.966+0000 7f8404ffc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f83f81b1d50 con 0x55924a068390 2024-09-21T01:00:47.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.967+0000 7f83effff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55924a068390 0x55924a43b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:47.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.967+0000 7f83effff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55924a068390 0x55924a43b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:36372/0 (socket says 172.21.15.1:36372) 2024-09-21T01:00:47.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.967+0000 7f83effff640 1 -- 172.21.15.1:0/3269292153 learned_addr learned my addr 172.21.15.1:0/3269292153 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:47.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.967+0000 7f83effff640 1 -- 172.21.15.1:0/3269292153 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55924a0601b0 msgr2=0x55924a433ad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:00:47.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.967+0000 7f83effff640 1 --2- 172.21.15.1:0/3269292153 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55924a0601b0 0x55924a433ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:47.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.967+0000 7f83effff640 1 -- 172.21.15.1:0/3269292153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924a089070 msgr2=0x55924a43bcd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:00:47.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.967+0000 7f83effff640 1 --2- 172.21.15.1:0/3269292153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924a089070 0x55924a43bcd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:47.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.967+0000 7f83effff640 1 -- 172.21.15.1:0/3269292153 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55924a439ee0 con 0x55924a068390 2024-09-21T01:00:47.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.968+0000 7f83effff640 1 --2- 172.21.15.1:0/3269292153 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55924a068390 0x55924a43b790 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f83e80d0040 tx=0x7f83e8005760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fec7d843e977833 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:47.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.968+0000 7f83de7fc640 1 -- 172.21.15.1:0/3269292153 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e8048070 con 0x55924a068390 2024-09-21T01:00:47.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.968+0000 7f83de7fc640 1 -- 172.21.15.1:0/3269292153 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83e80c9610 con 0x55924a068390 2024-09-21T01:00:47.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.970+0000 7f8404ffc740 1 -- 172.21.15.1:0/3269292153 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55924a068390 msgr2=0x55924a43b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:47.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.970+0000 7f8404ffc740 1 --2- 172.21.15.1:0/3269292153 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55924a068390 0x55924a43b790 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f83e80d0040 tx=0x7f83e8005760 comp rx=0 tx=0).stop 2024-09-21T01:00:47.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.976+0000 7f8404ffc740 1 -- 172.21.15.1:0/3269292153 shutdown_connections 2024-09-21T01:00:47.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.976+0000 7f8404ffc740 1 --2- 172.21.15.1:0/3269292153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924a089070 0x55924a43bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:47.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.976+0000 7f8404ffc740 1 --2- 172.21.15.1:0/3269292153 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55924a068390 0x55924a43b790 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:47.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.976+0000 7f8404ffc740 1 --2- 172.21.15.1:0/3269292153 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55924a0601b0 0x55924a433ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:47.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.976+0000 7f8404ffc740 1 -- 172.21.15.1:0/3269292153 >> 172.21.15.1:0/3269292153 conn(0x55924a07d460 msgr2=0x55924a4333c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:47.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.979+0000 7f8404ffc740 1 -- 172.21.15.1:0/3269292153 shutdown_connections 2024-09-21T01:00:47.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.979+0000 7f8404ffc740 1 -- 172.21.15.1:0/3269292153 wait complete. 2024-09-21T01:00:47.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.980+0000 7f8404ffc740 1 -- start start 2024-09-21T01:00:47.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.980+0000 7f8404ffc740 1 Processor -- start 2024-09-21T01:00:47.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.981+0000 7f8404ffc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55924a0601b0 0x55924a444690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:47.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.981+0000 7f8404ffc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924a068390 0x55924a43fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:47.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.981+0000 7f8404ffc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55924a089070 0x55924a440230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:47.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.981+0000 7f8404ffc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f83f81b2bb0 con 0x55924a068390 2024-09-21T01:00:47.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.981+0000 7f8404ffc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f83f81b24e0 con 0x55924a0601b0 2024-09-21T01:00:47.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.981+0000 7f8404ffc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f83f81af660 con 0x55924a089070 2024-09-21T01:00:47.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.981+0000 7f8404ffc740 10 client.0 _ll_register_callbacks cb 0x7f83e8005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:47.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.983+0000 7f83fc824640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55924a0601b0 0x55924a444690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:47.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.983+0000 7f83effff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924a068390 0x55924a43fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:47.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.983+0000 7f83effff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924a068390 0x55924a43fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55004/0 (socket says 172.21.15.1:55004) 2024-09-21T01:00:47.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.983+0000 7f83effff640 1 -- 172.21.15.1:0/3114902353 learned_addr learned my addr 172.21.15.1:0/3114902353 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:47.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.983+0000 7f83fd025640 1 --2- 172.21.15.1:0/3114902353 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55924a089070 0x55924a440230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:47.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.986+0000 7f83effff640 1 -- 172.21.15.1:0/3114902353 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55924a089070 msgr2=0x55924a440230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:47.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.986+0000 7f83effff640 1 --2- 172.21.15.1:0/3114902353 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55924a089070 0x55924a440230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:47.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.986+0000 7f83effff640 1 -- 172.21.15.1:0/3114902353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55924a0601b0 msgr2=0x55924a444690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:47.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.986+0000 7f83effff640 1 --2- 172.21.15.1:0/3114902353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55924a0601b0 0x55924a444690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:47.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.986+0000 7f83effff640 1 -- 172.21.15.1:0/3114902353 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55924a4b75d0 con 0x55924a068390 2024-09-21T01:00:47.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.990+0000 7f83effff640 1 --2- 172.21.15.1:0/3114902353 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924a068390 0x55924a43fb40 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f83e80d0010 tx=0x7f83e80cd480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c0c2fd018341ee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:47.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.990+0000 7f83d7fff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:00:47.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.990+0000 7f83d7fff640 1 -- 172.21.15.1:0/3114902353 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e8048070 con 0x55924a068390 2024-09-21T01:00:47.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.991+0000 7f83d7fff640 1 -- 172.21.15.1:0/3114902353 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f83e80ccdd0 con 0x55924a068390 2024-09-21T01:00:47.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.996+0000 7f8404ffc740 1 -- 172.21.15.1:0/3114902353 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83e80c9610 con 0x55924a068390 2024-09-21T01:00:47.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.997+0000 7f83d7fff640 1 -- 172.21.15.1:0/3114902353 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f83e80cd740 con 0x55924a068390 2024-09-21T01:00:47.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.997+0000 7f8404ffc740 10 client.16530 fetch_fsmap learned FSMap version 33 2024-09-21T01:00:47.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.997+0000 7f8404ffc740 1 -- 172.21.15.1:0/3114902353 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55924a4b75d0 con 0x55924a068390 2024-09-21T01:00:47.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:47.998+0000 7f83d7fff640 1 -- 172.21.15.1:0/3114902353 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83e80c9610 con 0x55924a068390 2024-09-21T01:00:48.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.000+0000 7f83d7fff640 1 -- 172.21.15.1:0/3114902353 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f83e80f4070 con 0x55924a068390 2024-09-21T01:00:48.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.000+0000 7f8404ffc740 10 client.16530 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:00:48.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.000+0000 7f8404ffc740 10 client.16530 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T01:00:48.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.000+0000 7f8404ffc740 20 client.16530 populate_metadata read hostname 'smithi001' 2024-09-21T01:00:48.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.000+0000 7f8404ffc740 1 --2- 172.21.15.1:0/3114902353 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x55924a01cda0 0x55924a4ba9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.000+0000 7f8404ffc740 4 client.16530 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:00:48.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.000+0000 7f8404ffc740 1 -- 172.21.15.1:0/3114902353 --> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55924a3a48a0 con 0x55924a01cda0 2024-09-21T01:00:48.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.005+0000 7f83fc824640 1 --2- 172.21.15.1:0/3114902353 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x55924a01cda0 0x55924a4ba9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.018+0000 7f83d7fff640 10 client.16530 ms_handle_connect on v2:172.21.15.193:6838/1365361177 2024-09-21T01:00:48.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.018+0000 7f83fc824640 1 --2- 172.21.15.1:0/3114902353 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x55924a01cda0 0x55924a4ba9a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ed1905bb572e600a server_cookie=1ae93b6d20d49369 in_seq=0 out_seq=0 2024-09-21T01:00:48.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.019+0000 7f83d7fff640 1 -- 172.21.15.1:0/3114902353 <== mds.1 v2:172.21.15.193:6838/1365361177 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55924a3a48a0 con 0x55924a01cda0 2024-09-21T01:00:48.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.019+0000 7f83d7fff640 10 client.16530 handle_command_reply: tid=0 2024-09-21T01:00:48.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.019+0000 7f8404ffc740 1 client.16530 shutdown 2024-09-21T01:00:48.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.020+0000 7f8404ffc740 1 -- 172.21.15.1:0/3114902353 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924a068390 msgr2=0x55924a43fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:48.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.020+0000 7f8404ffc740 1 --2- 172.21.15.1:0/3114902353 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924a068390 0x55924a43fb40 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f83e80d0010 tx=0x7f83e80cd480 comp rx=0 tx=0).stop 2024-09-21T01:00:48.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.020+0000 7f8404ffc740 1 -- 172.21.15.1:0/3114902353 shutdown_connections 2024-09-21T01:00:48.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.020+0000 7f8404ffc740 1 --2- 172.21.15.1:0/3114902353 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x55924a01cda0 0x55924a4ba9a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.020+0000 7f8404ffc740 1 --2- 172.21.15.1:0/3114902353 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55924a089070 0x55924a440230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.020+0000 7f8404ffc740 1 --2- 172.21.15.1:0/3114902353 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924a068390 0x55924a43fb40 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.020+0000 7f8404ffc740 1 --2- 172.21.15.1:0/3114902353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55924a0601b0 0x55924a444690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.020+0000 7f8404ffc740 1 -- 172.21.15.1:0/3114902353 >> 172.21.15.1:0/3114902353 conn(0x55924a07d460 msgr2=0x55924a43b790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:48.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.020+0000 7f83d7fff640 0 client.16530 ms_handle_reset on v2:172.21.15.193:6838/1365361177 2024-09-21T01:00:48.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.022+0000 7f8404ffc740 1 -- 172.21.15.1:0/3114902353 shutdown_connections 2024-09-21T01:00:48.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.022+0000 7f8404ffc740 1 -- 172.21.15.1:0/3114902353 wait complete. 2024-09-21T01:00:48.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.023+0000 7f8404ffc740 20 client.16530 trim_cache size 0 max 16384 2024-09-21T01:00:48.026 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T01:00:48.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.026+0000 7f83fea88640 1 -- 172.21.15.1:0/1059791375 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f83e00b6510 msgr2=0x7f83e00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:48.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.026+0000 7f83fea88640 1 --2- 172.21.15.1:0/1059791375 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f83e00b6510 0x7f83e00b8a20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x55924a42ef40 tx=0x7f83f4009530 comp rx=0 tx=0).stop 2024-09-21T01:00:48.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.026+0000 7f83fea88640 1 -- 172.21.15.1:0/1059791375 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83f8105350 msgr2=0x7f83f819cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:48.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.026+0000 7f83fea88640 1 --2- 172.21.15.1:0/1059791375 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83f8105350 0x7f83f819cc90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f83e802a930 tx=0x7f83e8031a20 comp rx=0 tx=0).stop 2024-09-21T01:00:48.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.026+0000 7f83fea88640 1 -- 172.21.15.1:0/1059791375 shutdown_connections 2024-09-21T01:00:48.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.026+0000 7f83fea88640 1 --2- 172.21.15.1:0/1059791375 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83f810de60 0x7f83f81a1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.026+0000 7f83fea88640 1 --2- 172.21.15.1:0/1059791375 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83f8105350 0x7f83f819cc90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.026+0000 7f83fea88640 1 --2- 172.21.15.1:0/1059791375 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f83e00b6510 0x7f83e00b8a20 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.026+0000 7f83fea88640 1 --2- 172.21.15.1:0/1059791375 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83f8104a00 0x7f83f819c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.026+0000 7f83fea88640 1 -- 172.21.15.1:0/1059791375 >> 172.21.15.1:0/1059791375 conn(0x7f83f80796b0 msgr2=0x7f83f810cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:48.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.026+0000 7f83fea88640 1 -- 172.21.15.1:0/1059791375 shutdown_connections 2024-09-21T01:00:48.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:48.026+0000 7f83fea88640 1 -- 172.21.15.1:0/1059791375 wait complete. 2024-09-21T01:00:48.505 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.503+0000 7f57b4a25640 1 -- 172.21.15.1:0/1214186320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f57b0103640 msgr2=0x7f57b0103a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:48.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.503+0000 7f57b4a25640 1 --2- 172.21.15.1:0/1214186320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f57b0103640 0x7f57b0103a50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f57a4009900 tx=0x7f57a402a400 comp rx=0 tx=0).stop 2024-09-21T01:00:48.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.503+0000 7f57b4a25640 1 -- 172.21.15.1:0/1214186320 shutdown_connections 2024-09-21T01:00:48.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.503+0000 7f57b4a25640 1 --2- 172.21.15.1:0/1214186320 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57b0103fe0 0x7f57b010a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.503+0000 7f57b4a25640 1 --2- 172.21.15.1:0/1214186320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f57b0103640 0x7f57b0103a50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.503+0000 7f57b4a25640 1 --2- 172.21.15.1:0/1214186320 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b01025c0 0x7f57b0102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.503+0000 7f57b4a25640 1 -- 172.21.15.1:0/1214186320 >> 172.21.15.1:0/1214186320 conn(0x7f57b00fdf00 msgr2=0x7f57b01003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:48.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.506+0000 7f57b4a25640 1 -- 172.21.15.1:0/1214186320 shutdown_connections 2024-09-21T01:00:48.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.507+0000 7f57b4a25640 1 -- 172.21.15.1:0/1214186320 wait complete. 2024-09-21T01:00:48.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.508+0000 7f57b4a25640 1 Processor -- start 2024-09-21T01:00:48.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.508+0000 7f57b4a25640 1 -- start start 2024-09-21T01:00:48.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.508+0000 7f57b4a25640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b01025c0 0x7f57b01a0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.508+0000 7f57b4a25640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f57b0103640 0x7f57b01a0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.509+0000 7f57b4a25640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57b0103fe0 0x7f57b01a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.509+0000 7f57b4a25640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f57b010d1b0 con 0x7f57b01025c0 2024-09-21T01:00:48.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.509+0000 7f57b4a25640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f57b010d030 con 0x7f57b0103640 2024-09-21T01:00:48.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.509+0000 7f57b4a25640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f57b010d330 con 0x7f57b0103fe0 2024-09-21T01:00:48.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.509+0000 7f57ae59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b01025c0 0x7f57b01a0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.509+0000 7f57ae59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b01025c0 0x7f57b01a0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55020/0 (socket says 172.21.15.1:55020) 2024-09-21T01:00:48.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.509+0000 7f57ae59c640 1 -- 172.21.15.1:0/2184401207 learned_addr learned my addr 172.21.15.1:0/2184401207 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:48.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.509+0000 7f57aed9d640 1 --2- 172.21.15.1:0/2184401207 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57b0103fe0 0x7f57b01a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.509+0000 7f57add9b640 1 --2- 172.21.15.1:0/2184401207 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f57b0103640 0x7f57b01a0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.510+0000 7f57aed9d640 1 -- 172.21.15.1:0/2184401207 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f57b0103640 msgr2=0x7f57b01a0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:48.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.510+0000 7f57aed9d640 1 --2- 172.21.15.1:0/2184401207 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f57b0103640 0x7f57b01a0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.510+0000 7f57aed9d640 1 -- 172.21.15.1:0/2184401207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b01025c0 msgr2=0x7f57b01a0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:48.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.510+0000 7f57aed9d640 1 --2- 172.21.15.1:0/2184401207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b01025c0 0x7f57b01a0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.510+0000 7f57aed9d640 1 -- 172.21.15.1:0/2184401207 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b01a1f90 con 0x7f57b0103fe0 2024-09-21T01:00:48.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.511+0000 7f57aed9d640 1 --2- 172.21.15.1:0/2184401207 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57b0103fe0 0x7f57b01a1770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f57a800ca30 tx=0x7f57a800cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:48.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.511+0000 7f579f7fe640 1 -- 172.21.15.1:0/2184401207 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a8007d90 con 0x7f57b0103fe0 2024-09-21T01:00:48.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.511+0000 7f579f7fe640 1 -- 172.21.15.1:0/2184401207 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57a8005020 con 0x7f57b0103fe0 2024-09-21T01:00:48.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.511+0000 7f579f7fe640 1 -- 172.21.15.1:0/2184401207 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a800f6b0 con 0x7f57b0103fe0 2024-09-21T01:00:48.514 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.512+0000 7f57b4a25640 1 -- 172.21.15.1:0/2184401207 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57b01a2280 con 0x7f57b0103fe0 2024-09-21T01:00:48.514 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.512+0000 7f57b4a25640 1 -- 172.21.15.1:0/2184401207 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57b01a8970 con 0x7f57b0103fe0 2024-09-21T01:00:48.519 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.517+0000 7f579f7fe640 1 -- 172.21.15.1:0/2184401207 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f57a80051d0 con 0x7f57b0103fe0 2024-09-21T01:00:48.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.521+0000 7f579f7fe640 1 --2- 172.21.15.1:0/2184401207 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f57980b65c0 0x7f57980b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.522+0000 7f579f7fe640 1 -- 172.21.15.1:0/2184401207 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f57a80e7630 con 0x7f57b0103fe0 2024-09-21T01:00:48.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.523+0000 7f57ae59c640 1 --2- 172.21.15.1:0/2184401207 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f57980b65c0 0x7f57980b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.527 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.523+0000 7f57bba72740 1 Processor -- start 2024-09-21T01:00:48.527 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.524+0000 7f57bba72740 1 -- start start 2024-09-21T01:00:48.527 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.524+0000 7f57bba72740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558bc48a11b0 0x558bc4c48e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.527 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.524+0000 7f57bba72740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc48782f0 0x558bc4c494c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.524+0000 7f57bba72740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558bc48804d0 0x558bc4c4a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.524+0000 7f57bba72740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558bc4bbb6f0 con 0x558bc48782f0 2024-09-21T01:00:48.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.524+0000 7f57bba72740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558bc4baab20 con 0x558bc48804d0 2024-09-21T01:00:48.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.524+0000 7f57bba72740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558bc4bae930 con 0x558bc48a11b0 2024-09-21T01:00:48.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.524+0000 7f57add9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc48782f0 0x558bc4c494c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.524+0000 7f57ae59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558bc48a11b0 0x558bc4c48e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.524+0000 7f57ae59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558bc48a11b0 0x558bc4c48e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:36418/0 (socket says 172.21.15.1:36418) 2024-09-21T01:00:48.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.524+0000 7f57ae59c640 1 -- 172.21.15.1:0/3943016918 learned_addr learned my addr 172.21.15.1:0/3943016918 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:48.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.524+0000 7f57add9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc48782f0 0x558bc4c494c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55028/0 (socket says 172.21.15.1:55028) 2024-09-21T01:00:48.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.525+0000 7f57ae59c640 1 --2- 172.21.15.1:0/2184401207 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f57980b65c0 0x7f57980b8ad0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f57a0009a40 tx=0x7f57a00091c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:48.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.525+0000 7f57aed9d640 1 --2- 172.21.15.1:0/3943016918 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558bc48804d0 0x558bc4c4a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.525+0000 7f57ae59c640 1 -- 172.21.15.1:0/3943016918 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558bc48804d0 msgr2=0x558bc4c4a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:48.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.525+0000 7f57ae59c640 1 --2- 172.21.15.1:0/3943016918 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558bc48804d0 0x558bc4c4a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.525+0000 7f57ae59c640 1 -- 172.21.15.1:0/3943016918 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc48782f0 msgr2=0x558bc4c494c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:48.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.525+0000 7f57ae59c640 1 --2- 172.21.15.1:0/3943016918 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc48782f0 0x558bc4c494c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.525+0000 7f57ae59c640 1 -- 172.21.15.1:0/3943016918 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bc4b70530 con 0x558bc48a11b0 2024-09-21T01:00:48.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.525+0000 7f57aed9d640 1 --2- 172.21.15.1:0/3943016918 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558bc48804d0 0x558bc4c4a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:00:48.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.526+0000 7f57ae59c640 1 --2- 172.21.15.1:0/3943016918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558bc48a11b0 0x558bc4c48e50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f57a000ec70 tx=0x7f57a0011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1aa1df400808a578 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:48.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.526+0000 7f579cff9640 1 -- 172.21.15.1:0/3943016918 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a001b040 con 0x558bc48a11b0 2024-09-21T01:00:48.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.526+0000 7f579cff9640 1 -- 172.21.15.1:0/3943016918 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57a0024070 con 0x558bc48a11b0 2024-09-21T01:00:48.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.527+0000 7f579cff9640 1 -- 172.21.15.1:0/3943016918 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a001f3f0 con 0x558bc48a11b0 2024-09-21T01:00:48.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.528+0000 7f57bba72740 1 -- 172.21.15.1:0/3943016918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558bc48a11b0 msgr2=0x558bc4c48e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:48.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.528+0000 7f57bba72740 1 --2- 172.21.15.1:0/3943016918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558bc48a11b0 0x558bc4c48e50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f57a000ec70 tx=0x7f57a0011000 comp rx=0 tx=0).stop 2024-09-21T01:00:48.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.528+0000 7f57bba72740 1 -- 172.21.15.1:0/3943016918 shutdown_connections 2024-09-21T01:00:48.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.528+0000 7f57bba72740 1 --2- 172.21.15.1:0/3943016918 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558bc48804d0 0x558bc4c4a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.529+0000 7f57bba72740 1 --2- 172.21.15.1:0/3943016918 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc48782f0 0x558bc4c494c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.529+0000 7f57bba72740 1 --2- 172.21.15.1:0/3943016918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558bc48a11b0 0x558bc4c48e50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.529+0000 7f57bba72740 1 -- 172.21.15.1:0/3943016918 >> 172.21.15.1:0/3943016918 conn(0x558bc4895300 msgr2=0x558bc4c448e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:48.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.530+0000 7f57bba72740 1 -- 172.21.15.1:0/3943016918 shutdown_connections 2024-09-21T01:00:48.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.530+0000 7f57bba72740 1 -- 172.21.15.1:0/3943016918 wait complete. 2024-09-21T01:00:48.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.531+0000 7f57bba72740 1 -- start start 2024-09-21T01:00:48.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.531+0000 7f57bba72740 1 Processor -- start 2024-09-21T01:00:48.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.531+0000 7f57bba72740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558bc48782f0 0x558bc4c52670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.531+0000 7f57bba72740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc48804d0 0x558bc4c52d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.532+0000 7f57bba72740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558bc48a11b0 0x558bc4c538a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.532+0000 7f57bba72740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558bc4ae2ab0 con 0x558bc48804d0 2024-09-21T01:00:48.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.532+0000 7f57bba72740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558bc4b50730 con 0x558bc48782f0 2024-09-21T01:00:48.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.532+0000 7f57bba72740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558bc4c4ab80 con 0x558bc48a11b0 2024-09-21T01:00:48.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.532+0000 7f57bba72740 10 client.0 _ll_register_callbacks cb 0x558bc4ba46b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:48.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.532+0000 7f57ae59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558bc48782f0 0x558bc4c52670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.532+0000 7f57ae59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558bc48782f0 0x558bc4c52670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:43864/0 (socket says 172.21.15.1:43864) 2024-09-21T01:00:48.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.532+0000 7f57ae59c640 1 -- 172.21.15.1:0/3031768194 learned_addr learned my addr 172.21.15.1:0/3031768194 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:48.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.532+0000 7f57aed9d640 1 --2- 172.21.15.1:0/3031768194 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558bc48a11b0 0x558bc4c538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.532+0000 7f57add9b640 1 --2- 172.21.15.1:0/3031768194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc48804d0 0x558bc4c52d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.532+0000 7f57aed9d640 1 -- 172.21.15.1:0/3031768194 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558bc48782f0 msgr2=0x558bc4c52670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:48.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.532+0000 7f57aed9d640 1 --2- 172.21.15.1:0/3031768194 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558bc48782f0 0x558bc4c52670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.532+0000 7f57aed9d640 1 -- 172.21.15.1:0/3031768194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc48804d0 msgr2=0x558bc4c52d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:48.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.532+0000 7f57aed9d640 1 --2- 172.21.15.1:0/3031768194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc48804d0 0x558bc4c52d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.532+0000 7f57aed9d640 1 -- 172.21.15.1:0/3031768194 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bc490c790 con 0x558bc48a11b0 2024-09-21T01:00:48.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.533+0000 7f57aed9d640 1 --2- 172.21.15.1:0/3031768194 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558bc48a11b0 0x558bc4c538a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f57a80e50b0 tx=0x7f57a80ad380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffe92131c5640717 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:48.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.533+0000 7f5795ffb640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T01:00:48.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.533+0000 7f5795ffb640 1 -- 172.21.15.1:0/3031768194 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a801d040 con 0x558bc48a11b0 2024-09-21T01:00:48.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.533+0000 7f57bba72740 1 -- 172.21.15.1:0/3031768194 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57a0024070 con 0x558bc48a11b0 2024-09-21T01:00:48.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.534+0000 7f5795ffb640 1 -- 172.21.15.1:0/3031768194 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f57a80ac9a0 con 0x558bc48a11b0 2024-09-21T01:00:48.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.534+0000 7f5795ffb640 1 -- 172.21.15.1:0/3031768194 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f57a80b7160 con 0x558bc48a11b0 2024-09-21T01:00:48.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.534+0000 7f57bba72740 10 client.26089 fetch_fsmap learned FSMap version 33 2024-09-21T01:00:48.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.534+0000 7f57bba72740 1 -- 172.21.15.1:0/3031768194 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558bc4985620 con 0x558bc48a11b0 2024-09-21T01:00:48.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.534+0000 7f5795ffb640 1 -- 172.21.15.1:0/3031768194 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57a0024070 con 0x558bc48a11b0 2024-09-21T01:00:48.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.535+0000 7f5795ffb640 1 -- 172.21.15.1:0/3031768194 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f57a80b33b0 con 0x558bc48a11b0 2024-09-21T01:00:48.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.535+0000 7f57bba72740 10 client.26089 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:00:48.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.535+0000 7f57bba72740 10 client.26089 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:00:48.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.535+0000 7f57bba72740 20 client.26089 populate_metadata read hostname 'smithi001' 2024-09-21T01:00:48.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.535+0000 7f57bba72740 1 --2- 172.21.15.1:0/3031768194 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558bc485fd80 0x558bc4c5fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.535+0000 7f57bba72740 4 client.26089 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:00:48.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.535+0000 7f57bba72740 1 -- 172.21.15.1:0/3031768194 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558bc4bbd640 con 0x558bc485fd80 2024-09-21T01:00:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.536+0000 7f57ae59c640 1 --2- 172.21.15.1:0/3031768194 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558bc485fd80 0x558bc4c5fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.537+0000 7f5795ffb640 10 client.26089 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:48.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.537+0000 7f57ae59c640 1 --2- 172.21.15.1:0/3031768194 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558bc485fd80 0x558bc4c5fd30 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5eb2d4e6e2e1294 server_cookie=e74c4c0d66fca3cb in_seq=0 out_seq=0 2024-09-21T01:00:48.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.539+0000 7f5795ffb640 1 -- 172.21.15.1:0/3031768194 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558bc4bbd640 con 0x558bc485fd80 2024-09-21T01:00:48.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.539+0000 7f5795ffb640 10 client.26089 handle_command_reply: tid=0 2024-09-21T01:00:48.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.539+0000 7f57bba72740 1 client.26089 shutdown 2024-09-21T01:00:48.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.539+0000 7f57bba72740 1 -- 172.21.15.1:0/3031768194 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558bc48a11b0 msgr2=0x558bc4c538a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:48.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.539+0000 7f57bba72740 1 --2- 172.21.15.1:0/3031768194 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558bc48a11b0 0x558bc4c538a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f57a80e50b0 tx=0x7f57a80ad380 comp rx=0 tx=0).stop 2024-09-21T01:00:48.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.540+0000 7f57bba72740 1 -- 172.21.15.1:0/3031768194 shutdown_connections 2024-09-21T01:00:48.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.540+0000 7f57bba72740 1 --2- 172.21.15.1:0/3031768194 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558bc485fd80 0x558bc4c5fd30 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.540+0000 7f57bba72740 1 --2- 172.21.15.1:0/3031768194 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558bc48a11b0 0x558bc4c538a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.540+0000 7f5795ffb640 0 client.26089 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:48.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.540+0000 7f57bba72740 1 --2- 172.21.15.1:0/3031768194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc48804d0 0x558bc4c52d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.540+0000 7f57bba72740 1 --2- 172.21.15.1:0/3031768194 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558bc48782f0 0x558bc4c52670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.540+0000 7f57bba72740 1 -- 172.21.15.1:0/3031768194 >> 172.21.15.1:0/3031768194 conn(0x558bc4895300 msgr2=0x558bc4c42ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:48.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.541+0000 7f57bba72740 1 -- 172.21.15.1:0/3031768194 shutdown_connections 2024-09-21T01:00:48.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.542+0000 7f57bba72740 1 -- 172.21.15.1:0/3031768194 wait complete. 2024-09-21T01:00:48.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.542+0000 7f57bba72740 20 client.26089 trim_cache size 0 max 16384 2024-09-21T01:00:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.572+0000 7f57bba72740 1 Processor -- start 2024-09-21T01:00:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.573+0000 7f57bba72740 1 -- start start 2024-09-21T01:00:48.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.573+0000 7f57bba72740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558bc485fd80 0x558bc4c52d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.574+0000 7f57bba72740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc48782f0 0x558bc4c4d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.576 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.574+0000 7f57ae59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558bc485fd80 0x558bc4c52d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.576 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.574+0000 7f57ae59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558bc485fd80 0x558bc4c52d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:43876/0 (socket says 172.21.15.1:43876) 2024-09-21T01:00:48.576 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.574+0000 7f57ae59c640 1 -- 172.21.15.1:0/3776965783 learned_addr learned my addr 172.21.15.1:0/3776965783 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:48.576 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.574+0000 7f57bba72740 1 --2- 172.21.15.1:0/3776965783 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558bc48804d0 0x558bc4c3f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.576 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.574+0000 7f57bba72740 1 -- 172.21.15.1:0/3776965783 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f57b01b1660 con 0x558bc48782f0 2024-09-21T01:00:48.576 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.574+0000 7f57bba72740 1 -- 172.21.15.1:0/3776965783 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f57b01b3260 con 0x558bc485fd80 2024-09-21T01:00:48.576 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.574+0000 7f57bba72740 1 -- 172.21.15.1:0/3776965783 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f57b01b1d30 con 0x558bc48804d0 2024-09-21T01:00:48.577 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.575+0000 7f57add9b640 1 --2- 172.21.15.1:0/3776965783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc48782f0 0x558bc4c4d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.577 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.575+0000 7f57aed9d640 1 --2- 172.21.15.1:0/3776965783 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558bc48804d0 0x558bc4c3f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.577 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.576+0000 7f57add9b640 1 -- 172.21.15.1:0/3776965783 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558bc48804d0 msgr2=0x558bc4c3f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:48.577 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.576+0000 7f57add9b640 1 --2- 172.21.15.1:0/3776965783 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558bc48804d0 0x558bc4c3f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.578 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.576+0000 7f57add9b640 1 -- 172.21.15.1:0/3776965783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558bc485fd80 msgr2=0x558bc4c52d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:48.578 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.576+0000 7f57add9b640 1 --2- 172.21.15.1:0/3776965783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558bc485fd80 0x558bc4c52d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.578 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.576+0000 7f57add9b640 1 -- 172.21.15.1:0/3776965783 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bc4c52ad0 con 0x558bc48782f0 2024-09-21T01:00:48.578 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.576+0000 7f57add9b640 1 --2- 172.21.15.1:0/3776965783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc48782f0 0x558bc4c4d960 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f57a4006010 tx=0x7f57a4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829e1981a8c2f575 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:48.578 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.577+0000 7f5797fff640 1 -- 172.21.15.1:0/3776965783 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a4035040 con 0x558bc48782f0 2024-09-21T01:00:48.579 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.577+0000 7f5797fff640 1 -- 172.21.15.1:0/3776965783 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57a4031d10 con 0x558bc48782f0 2024-09-21T01:00:48.579 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.577+0000 7f5797fff640 1 -- 172.21.15.1:0/3776965783 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a403c440 con 0x558bc48782f0 2024-09-21T01:00:48.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.578+0000 7f57bba72740 1 -- 172.21.15.1:0/3776965783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc48782f0 msgr2=0x558bc4c4d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:48.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.578+0000 7f57bba72740 1 --2- 172.21.15.1:0/3776965783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc48782f0 0x558bc4c4d960 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f57a4006010 tx=0x7f57a4000bc0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.579+0000 7f57bba72740 1 -- 172.21.15.1:0/3776965783 shutdown_connections 2024-09-21T01:00:48.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.579+0000 7f57bba72740 1 --2- 172.21.15.1:0/3776965783 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558bc48804d0 0x558bc4c3f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.579+0000 7f57bba72740 1 --2- 172.21.15.1:0/3776965783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc48782f0 0x558bc4c4d960 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.579+0000 7f57bba72740 1 --2- 172.21.15.1:0/3776965783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558bc485fd80 0x558bc4c52d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.579+0000 7f57bba72740 1 -- 172.21.15.1:0/3776965783 >> 172.21.15.1:0/3776965783 conn(0x558bc4895300 msgr2=0x558bc4c49db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:48.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.579+0000 7f57bba72740 1 -- 172.21.15.1:0/3776965783 shutdown_connections 2024-09-21T01:00:48.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.579+0000 7f57bba72740 1 -- 172.21.15.1:0/3776965783 wait complete. 2024-09-21T01:00:48.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.579+0000 7f57bba72740 1 -- start start 2024-09-21T01:00:48.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.580+0000 7f57bba72740 1 Processor -- start 2024-09-21T01:00:48.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.580+0000 7f57bba72740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558bc485fd80 0x558bc4c5a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.580+0000 7f57bba72740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc48782f0 0x558bc4c58ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.580+0000 7f57bba72740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558bc48804d0 0x558bc4c593e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.580+0000 7f57ae59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558bc485fd80 0x558bc4c5a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.580+0000 7f57ae59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558bc485fd80 0x558bc4c5a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:36446/0 (socket says 172.21.15.1:36446) 2024-09-21T01:00:48.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.580+0000 7f57ae59c640 1 -- 172.21.15.1:0/775047609 learned_addr learned my addr 172.21.15.1:0/775047609 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:48.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.580+0000 7f57bba72740 1 -- 172.21.15.1:0/775047609 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f57b01b2b90 con 0x558bc48782f0 2024-09-21T01:00:48.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.580+0000 7f57bba72740 1 -- 172.21.15.1:0/775047609 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f57b01b24c0 con 0x558bc48804d0 2024-09-21T01:00:48.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.580+0000 7f57bba72740 1 -- 172.21.15.1:0/775047609 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f57b01af640 con 0x558bc485fd80 2024-09-21T01:00:48.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.581+0000 7f57aed9d640 1 --2- 172.21.15.1:0/775047609 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558bc48804d0 0x558bc4c593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.581+0000 7f57add9b640 1 --2- 172.21.15.1:0/775047609 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc48782f0 0x558bc4c58ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.581+0000 7f57bba72740 10 client.0 _ll_register_callbacks cb 0x7f57a80a95e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:48.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.581+0000 7f57ae59c640 1 -- 172.21.15.1:0/775047609 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558bc48804d0 msgr2=0x558bc4c593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:48.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.581+0000 7f57ae59c640 1 --2- 172.21.15.1:0/775047609 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558bc48804d0 0x558bc4c593e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.581+0000 7f57ae59c640 1 -- 172.21.15.1:0/775047609 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc48782f0 msgr2=0x558bc4c58ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:48.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.581+0000 7f57ae59c640 1 --2- 172.21.15.1:0/775047609 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc48782f0 0x558bc4c58ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.581+0000 7f57ae59c640 1 -- 172.21.15.1:0/775047609 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bc4c59920 con 0x558bc485fd80 2024-09-21T01:00:48.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.581+0000 7f57ae59c640 1 --2- 172.21.15.1:0/775047609 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558bc485fd80 0x558bc4c5a1e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f57a0000c00 tx=0x7f57a0009850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f04f9bc233d1e77 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:48.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.581+0000 7f5795ffb640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T01:00:48.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.581+0000 7f5795ffb640 1 -- 172.21.15.1:0/775047609 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a0013650 con 0x558bc485fd80 2024-09-21T01:00:48.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.582+0000 7f57bba72740 1 -- 172.21.15.1:0/775047609 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57a4031d10 con 0x558bc485fd80 2024-09-21T01:00:48.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.582+0000 7f5795ffb640 1 -- 172.21.15.1:0/775047609 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f57a00137f0 con 0x558bc485fd80 2024-09-21T01:00:48.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.582+0000 7f5795ffb640 1 -- 172.21.15.1:0/775047609 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f57a0042070 con 0x558bc485fd80 2024-09-21T01:00:48.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.582+0000 7f57bba72740 10 client.26095 fetch_fsmap learned FSMap version 33 2024-09-21T01:00:48.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.582+0000 7f57bba72740 1 -- 172.21.15.1:0/775047609 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558bc4c58830 con 0x558bc485fd80 2024-09-21T01:00:48.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.582+0000 7f5795ffb640 1 -- 172.21.15.1:0/775047609 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57a4031d10 con 0x558bc485fd80 2024-09-21T01:00:48.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.582+0000 7f5795ffb640 1 -- 172.21.15.1:0/775047609 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f57a001e030 con 0x558bc485fd80 2024-09-21T01:00:48.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.582+0000 7f57bba72740 10 client.26095 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:00:48.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.582+0000 7f57bba72740 10 client.26095 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:00:48.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.582+0000 7f57bba72740 20 client.26095 populate_metadata read hostname 'smithi001' 2024-09-21T01:00:48.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.582+0000 7f57bba72740 1 --2- 172.21.15.1:0/775047609 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558bc48a11b0 0x558bc4cccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.582+0000 7f57bba72740 4 client.26095 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:00:48.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.582+0000 7f57bba72740 1 -- 172.21.15.1:0/775047609 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558bc4bb90f0 con 0x558bc48a11b0 2024-09-21T01:00:48.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.583+0000 7f57add9b640 1 --2- 172.21.15.1:0/775047609 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558bc48a11b0 0x558bc4cccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.583+0000 7f57add9b640 1 --2- 172.21.15.1:0/775047609 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558bc48a11b0 0x558bc4cccbd0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=267f127e2733009 server_cookie=c323608f82a6b0a2 in_seq=0 out_seq=0 2024-09-21T01:00:48.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:48.583+0000 7f5795ffb640 10 client.26095 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:48.803 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T01:00:49.064 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:00:49.454 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:49 smithi001 ceph-mon[31211]: pgmap v466: 97 pgs: 97 active+clean; 440 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.0 MiB/s wr, 192 op/s 2024-09-21T01:00:49.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.549+0000 7f4da623f640 1 -- 172.21.15.1:0/2821496636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4da01081c0 msgr2=0x7f4da01085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:49.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.549+0000 7f4da623f640 1 --2- 172.21.15.1:0/2821496636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4da01081c0 0x7f4da01085d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f4d90009900 tx=0x7f4d9002a410 comp rx=0 tx=0).stop 2024-09-21T01:00:49.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.549+0000 7f4da623f640 1 -- 172.21.15.1:0/2821496636 shutdown_connections 2024-09-21T01:00:49.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.549+0000 7f4da623f640 1 --2- 172.21.15.1:0/2821496636 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4da0108b10 0x7f4da010f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.549+0000 7f4da623f640 1 --2- 172.21.15.1:0/2821496636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4da01081c0 0x7f4da01085d0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.549+0000 7f4da623f640 1 --2- 172.21.15.1:0/2821496636 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4da0102880 0x7f4da0102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.549+0000 7f4da623f640 1 -- 172.21.15.1:0/2821496636 >> 172.21.15.1:0/2821496636 conn(0x7f4da00fe2d0 msgr2=0x7f4da0100720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:49.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.549+0000 7f4da623f640 1 -- 172.21.15.1:0/2821496636 shutdown_connections 2024-09-21T01:00:49.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.549+0000 7f4da623f640 1 -- 172.21.15.1:0/2821496636 wait complete. 2024-09-21T01:00:49.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.550+0000 7f4da623f640 1 Processor -- start 2024-09-21T01:00:49.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.550+0000 7f4da623f640 1 -- start start 2024-09-21T01:00:49.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.550+0000 7f4da623f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4da0102880 0x7f4da0198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:49.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.550+0000 7f4da623f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4da01081c0 0x7f4da0199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:49.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.550+0000 7f4da623f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4da0108b10 0x7f4da0199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:49.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.550+0000 7f4da623f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4da01127a0 con 0x7f4da0102880 2024-09-21T01:00:49.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.550+0000 7f4da623f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4da0112620 con 0x7f4da0108b10 2024-09-21T01:00:49.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.550+0000 7f4da623f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4da0112920 con 0x7f4da01081c0 2024-09-21T01:00:49.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.550+0000 7f4da523d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4da0102880 0x7f4da0198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:49.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.550+0000 7f4da523d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4da0102880 0x7f4da0198f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38362/0 (socket says 172.21.15.1:38362) 2024-09-21T01:00:49.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.550+0000 7f4da523d640 1 -- 172.21.15.1:0/3017909978 learned_addr learned my addr 172.21.15.1:0/3017909978 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:49.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.550+0000 7f4da5a3e640 1 --2- 172.21.15.1:0/3017909978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4da0108b10 0x7f4da0199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:49.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.550+0000 7f4da4a3c640 1 --2- 172.21.15.1:0/3017909978 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4da01081c0 0x7f4da0199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:49.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.551+0000 7f4da523d640 1 -- 172.21.15.1:0/3017909978 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4da01081c0 msgr2=0x7f4da0199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:49.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.551+0000 7f4da523d640 1 --2- 172.21.15.1:0/3017909978 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4da01081c0 0x7f4da0199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.551+0000 7f4da523d640 1 -- 172.21.15.1:0/3017909978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4da0108b10 msgr2=0x7f4da0199980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:49.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.551+0000 7f4da523d640 1 --2- 172.21.15.1:0/3017909978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4da0108b10 0x7f4da0199980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.551+0000 7f4da523d640 1 -- 172.21.15.1:0/3017909978 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4da01a85b0 con 0x7f4da0102880 2024-09-21T01:00:49.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.551+0000 7f4da523d640 1 --2- 172.21.15.1:0/3017909978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4da0102880 0x7f4da0198f00 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c00d770 tx=0x7f4d9c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:49.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.551+0000 7f4d967fc640 1 -- 172.21.15.1:0/3017909978 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c017070 con 0x7f4da0102880 2024-09-21T01:00:49.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.551+0000 7f4d967fc640 1 -- 172.21.15.1:0/3017909978 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d9c0054d0 con 0x7f4da0102880 2024-09-21T01:00:49.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.551+0000 7f4d967fc640 1 -- 172.21.15.1:0/3017909978 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c004c30 con 0x7f4da0102880 2024-09-21T01:00:49.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.551+0000 7f4da623f640 1 -- 172.21.15.1:0/3017909978 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4da01a88a0 con 0x7f4da0102880 2024-09-21T01:00:49.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.551+0000 7f4da623f640 1 -- 172.21.15.1:0/3017909978 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4da01a8d60 con 0x7f4da0102880 2024-09-21T01:00:49.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.554+0000 7f4dada15740 1 Processor -- start 2024-09-21T01:00:49.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.554+0000 7f4dada15740 1 -- start start 2024-09-21T01:00:49.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.554+0000 7f4dada15740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559a326ce070 0x559a32a75460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:49.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.554+0000 7f4dada15740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559a326a51b0 0x559a32a759a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:49.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.554+0000 7f4dada15740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a326ad390 0x559a32a75ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:49.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.554+0000 7f4dada15740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559a329ebea0 con 0x559a326a51b0 2024-09-21T01:00:49.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.554+0000 7f4dada15740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559a329db2d0 con 0x559a326ce070 2024-09-21T01:00:49.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.554+0000 7f4dada15740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559a329df0e0 con 0x559a326ad390 2024-09-21T01:00:49.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.554+0000 7f4d967fc640 1 -- 172.21.15.1:0/3017909978 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f4d9c004e10 con 0x7f4da0102880 2024-09-21T01:00:49.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.554+0000 7f4da5a3e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559a326ce070 0x559a32a75460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:49.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.554+0000 7f4da5a3e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559a326ce070 0x559a32a75460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:39976/0 (socket says 172.21.15.1:39976) 2024-09-21T01:00:49.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.554+0000 7f4da5a3e640 1 -- 172.21.15.1:0/1369870726 learned_addr learned my addr 172.21.15.1:0/1369870726 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:49.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.554+0000 7f4da4a3c640 1 --2- 172.21.15.1:0/1369870726 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a326ad390 0x559a32a75ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:49.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.555+0000 7f4da523d640 1 --2- 172.21.15.1:0/1369870726 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559a326a51b0 0x559a32a759a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:49.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.555+0000 7f4da5a3e640 1 -- 172.21.15.1:0/1369870726 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a326ad390 msgr2=0x559a32a75ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:49.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.555+0000 7f4da5a3e640 1 --2- 172.21.15.1:0/1369870726 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a326ad390 0x559a32a75ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.555+0000 7f4da5a3e640 1 -- 172.21.15.1:0/1369870726 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559a326a51b0 msgr2=0x559a32a759a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:49.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.555+0000 7f4da5a3e640 1 --2- 172.21.15.1:0/1369870726 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559a326a51b0 0x559a32a759a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.555+0000 7f4da5a3e640 1 -- 172.21.15.1:0/1369870726 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a32739650 con 0x559a326ce070 2024-09-21T01:00:49.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.555+0000 7f4da4a3c640 1 --2- 172.21.15.1:0/1369870726 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a326ad390 0x559a32a75ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:49.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.555+0000 7f4da5a3e640 1 --2- 172.21.15.1:0/1369870726 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559a326ce070 0x559a32a75460 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4d98009fd0 tx=0x7f4d980118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5654553a9bfef18f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:49.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.555+0000 7f4d8b7fe640 1 -- 172.21.15.1:0/1369870726 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d98004d20 con 0x559a326ce070 2024-09-21T01:00:49.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.555+0000 7f4d967fc640 1 --2- 172.21.15.1:0/3017909978 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4d8c0b6590 0x7f4d8c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:49.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.555+0000 7f4d8b7fe640 1 -- 172.21.15.1:0/1369870726 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d98004050 con 0x559a326ce070 2024-09-21T01:00:49.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.555+0000 7f4d8b7fe640 1 -- 172.21.15.1:0/1369870726 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d98005280 con 0x559a326ce070 2024-09-21T01:00:49.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.556+0000 7f4da523d640 1 --2- 172.21.15.1:0/3017909978 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4d8c0b6590 0x7f4d8c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:49.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.556+0000 7f4d967fc640 1 -- 172.21.15.1:0/3017909978 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f4d9c0e6d10 con 0x7f4da0102880 2024-09-21T01:00:49.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.556+0000 7f4dada15740 1 -- 172.21.15.1:0/1369870726 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559a326ce070 msgr2=0x559a32a75460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:49.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.556+0000 7f4da523d640 1 --2- 172.21.15.1:0/3017909978 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4d8c0b6590 0x7f4d8c0b8aa0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x559a32a740e0 tx=0x7f4d9c094040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:49.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.556+0000 7f4dada15740 1 --2- 172.21.15.1:0/1369870726 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559a326ce070 0x559a32a75460 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4d98009fd0 tx=0x7f4d980118d0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.556+0000 7f4dada15740 1 -- 172.21.15.1:0/1369870726 shutdown_connections 2024-09-21T01:00:49.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.556+0000 7f4dada15740 1 --2- 172.21.15.1:0/1369870726 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a326ad390 0x559a32a75ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.556+0000 7f4dada15740 1 --2- 172.21.15.1:0/1369870726 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559a326a51b0 0x559a32a759a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.556+0000 7f4dada15740 1 --2- 172.21.15.1:0/1369870726 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559a326ce070 0x559a32a75460 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.556+0000 7f4dada15740 1 -- 172.21.15.1:0/1369870726 >> 172.21.15.1:0/1369870726 conn(0x559a326c2460 msgr2=0x559a32a73350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:49.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.557+0000 7f4dada15740 1 -- 172.21.15.1:0/1369870726 shutdown_connections 2024-09-21T01:00:49.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.557+0000 7f4dada15740 1 -- 172.21.15.1:0/1369870726 wait complete. 2024-09-21T01:00:49.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.557+0000 7f4dada15740 1 -- start start 2024-09-21T01:00:49.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.557+0000 7f4dada15740 1 Processor -- start 2024-09-21T01:00:49.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.557+0000 7f4dada15740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559a326a51b0 0x559a32a80b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:49.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.557+0000 7f4dada15740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a326ad390 0x559a32a81040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:49.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.557+0000 7f4dada15740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559a326ce070 0x559a32a81580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:49.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.558+0000 7f4dada15740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559a3283c700 con 0x559a326a51b0 2024-09-21T01:00:49.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.558+0000 7f4dada15740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559a32976160 con 0x559a326ce070 2024-09-21T01:00:49.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.558+0000 7f4dada15740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559a32a83c40 con 0x559a326ad390 2024-09-21T01:00:49.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.558+0000 7f4dada15740 10 client.0 _ll_register_callbacks cb 0x559a3298f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:49.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.558+0000 7f4da5a3e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559a326a51b0 0x559a32a80b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:49.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.558+0000 7f4da5a3e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559a326a51b0 0x559a32a80b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38380/0 (socket says 172.21.15.1:38380) 2024-09-21T01:00:49.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.558+0000 7f4da5a3e640 1 -- 172.21.15.1:0/2816025490 learned_addr learned my addr 172.21.15.1:0/2816025490 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:49.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.558+0000 7f4da4a3c640 1 --2- 172.21.15.1:0/2816025490 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a326ad390 0x559a32a81040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:49.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.558+0000 7f4da5a3e640 1 --2- 172.21.15.1:0/2816025490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559a326ce070 0x559a32a81580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:49.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.558+0000 7f4da5a3e640 1 -- 172.21.15.1:0/2816025490 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a326ad390 msgr2=0x559a32a81040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:49.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.558+0000 7f4da5a3e640 1 --2- 172.21.15.1:0/2816025490 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a326ad390 0x559a32a81040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.558+0000 7f4da5a3e640 1 -- 172.21.15.1:0/2816025490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559a326ce070 msgr2=0x559a32a81580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:49.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.558+0000 7f4da5a3e640 1 --2- 172.21.15.1:0/2816025490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559a326ce070 0x559a32a81580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.558+0000 7f4da5a3e640 1 -- 172.21.15.1:0/2816025490 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a329a3c90 con 0x559a326a51b0 2024-09-21T01:00:49.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.558+0000 7f4da5a3e640 1 --2- 172.21.15.1:0/2816025490 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559a326a51b0 0x559a32a80b00 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f4d98003fd0 tx=0x7f4d98009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a59b646c63ae5b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:49.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.558+0000 7f4d88ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:00:49.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.559+0000 7f4d88ff9640 1 -- 172.21.15.1:0/2816025490 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d98004c50 con 0x559a326a51b0 2024-09-21T01:00:49.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.559+0000 7f4d88ff9640 1 -- 172.21.15.1:0/2816025490 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f4d98004df0 con 0x559a326a51b0 2024-09-21T01:00:49.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.559+0000 7f4dada15740 1 -- 172.21.15.1:0/2816025490 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d98004050 con 0x559a326a51b0 2024-09-21T01:00:49.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.559+0000 7f4d88ff9640 1 -- 172.21.15.1:0/2816025490 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f4d98005040 con 0x559a326a51b0 2024-09-21T01:00:49.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.559+0000 7f4dada15740 10 client.16557 fetch_fsmap learned FSMap version 33 2024-09-21T01:00:49.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.559+0000 7f4dada15740 1 -- 172.21.15.1:0/2816025490 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x559a32a8f8b0 con 0x559a326a51b0 2024-09-21T01:00:49.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.559+0000 7f4d88ff9640 1 -- 172.21.15.1:0/2816025490 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d98004050 con 0x559a326a51b0 2024-09-21T01:00:49.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.559+0000 7f4d88ff9640 1 -- 172.21.15.1:0/2816025490 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f4d9800f710 con 0x559a326a51b0 2024-09-21T01:00:49.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.559+0000 7f4dada15740 10 client.16557 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:00:49.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.559+0000 7f4dada15740 10 client.16557 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:00:49.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.559+0000 7f4dada15740 20 client.16557 populate_metadata read hostname 'smithi001' 2024-09-21T01:00:49.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.559+0000 7f4dada15740 1 --2- 172.21.15.1:0/2816025490 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x559a3268c9f0 0x559a32a92d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:49.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.559+0000 7f4dada15740 4 client.16557 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:00:49.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.559+0000 7f4dada15740 1 -- 172.21.15.1:0/2816025490 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a329eddf0 con 0x559a3268c9f0 2024-09-21T01:00:49.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.560+0000 7f4da4a3c640 1 --2- 172.21.15.1:0/2816025490 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x559a3268c9f0 0x559a32a92d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:49.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.560+0000 7f4d88ff9640 10 client.16557 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:49.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.560+0000 7f4da4a3c640 1 --2- 172.21.15.1:0/2816025490 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x559a3268c9f0 0x559a32a92d20 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55edf3881a685c0d server_cookie=3c350c890cc07ba8 in_seq=0 out_seq=0 2024-09-21T01:00:49.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.561+0000 7f4d88ff9640 1 -- 172.21.15.1:0/2816025490 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559a329eddf0 con 0x559a3268c9f0 2024-09-21T01:00:49.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.561+0000 7f4d88ff9640 10 client.16557 handle_command_reply: tid=0 2024-09-21T01:00:49.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.561+0000 7f4dada15740 1 client.16557 shutdown 2024-09-21T01:00:49.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.561+0000 7f4dada15740 1 -- 172.21.15.1:0/2816025490 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559a326a51b0 msgr2=0x559a32a80b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:49.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.561+0000 7f4dada15740 1 --2- 172.21.15.1:0/2816025490 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559a326a51b0 0x559a32a80b00 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f4d98003fd0 tx=0x7f4d98009c00 comp rx=0 tx=0).stop 2024-09-21T01:00:49.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.561+0000 7f4dada15740 1 -- 172.21.15.1:0/2816025490 shutdown_connections 2024-09-21T01:00:49.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.561+0000 7f4dada15740 1 --2- 172.21.15.1:0/2816025490 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x559a3268c9f0 0x559a32a92d20 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.561+0000 7f4dada15740 1 --2- 172.21.15.1:0/2816025490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559a326ce070 0x559a32a81580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.561+0000 7f4dada15740 1 --2- 172.21.15.1:0/2816025490 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a326ad390 0x559a32a81040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.561+0000 7f4dada15740 1 --2- 172.21.15.1:0/2816025490 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559a326a51b0 0x559a32a80b00 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.561+0000 7f4dada15740 1 -- 172.21.15.1:0/2816025490 >> 172.21.15.1:0/2816025490 conn(0x559a326c2460 msgr2=0x559a32a785f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:49.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.561+0000 7f4d88ff9640 0 client.16557 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:49.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.561+0000 7f4dada15740 1 -- 172.21.15.1:0/2816025490 shutdown_connections 2024-09-21T01:00:49.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.561+0000 7f4dada15740 1 -- 172.21.15.1:0/2816025490 wait complete. 2024-09-21T01:00:49.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.561+0000 7f4dada15740 20 client.16557 trim_cache size 0 max 16384 2024-09-21T01:00:49.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.575+0000 7f4dada15740 1 Processor -- start 2024-09-21T01:00:49.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.575+0000 7f4dada15740 1 -- start start 2024-09-21T01:00:49.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.575+0000 7f4dada15740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559a326a51b0 0x559a32a829e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:49.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.575+0000 7f4dada15740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559a326ad390 0x559a32a76490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:49.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.575+0000 7f4dada15740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a326ce070 0x559a32a8c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:49.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.575+0000 7f4dada15740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4da01b1460 con 0x559a326ad390 2024-09-21T01:00:49.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.575+0000 7f4dada15740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4da01b3060 con 0x559a326a51b0 2024-09-21T01:00:49.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.575+0000 7f4dada15740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4da01b1b30 con 0x559a326ce070 2024-09-21T01:00:49.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.575+0000 7f4da4a3c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559a326ad390 0x559a32a76490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:49.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.575+0000 7f4da5a3e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559a326a51b0 0x559a32a829e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:49.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.575+0000 7f4da4a3c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559a326ad390 0x559a32a76490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38382/0 (socket says 172.21.15.1:38382) 2024-09-21T01:00:49.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.575+0000 7f4da4a3c640 1 -- 172.21.15.1:0/792889147 learned_addr learned my addr 172.21.15.1:0/792889147 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:49.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.575+0000 7f4da5a3e640 1 --2- 172.21.15.1:0/792889147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a326ce070 0x559a32a8c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:49.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.575+0000 7f4da4a3c640 1 -- 172.21.15.1:0/792889147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a326ce070 msgr2=0x559a32a8c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:49.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.575+0000 7f4da4a3c640 1 --2- 172.21.15.1:0/792889147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a326ce070 0x559a32a8c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.575+0000 7f4da4a3c640 1 -- 172.21.15.1:0/792889147 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559a326a51b0 msgr2=0x559a32a829e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:49.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.575+0000 7f4da4a3c640 1 --2- 172.21.15.1:0/792889147 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559a326a51b0 0x559a32a829e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.575+0000 7f4da4a3c640 1 -- 172.21.15.1:0/792889147 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a32a77980 con 0x559a326ad390 2024-09-21T01:00:49.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.576+0000 7f4da4a3c640 1 --2- 172.21.15.1:0/792889147 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559a326ad390 0x559a32a76490 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f4d90005940 tx=0x7f4d90031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3566f1671d819af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:49.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.576+0000 7f4d8affd640 1 -- 172.21.15.1:0/792889147 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d90035040 con 0x559a326ad390 2024-09-21T01:00:49.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.576+0000 7f4d8affd640 1 -- 172.21.15.1:0/792889147 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d900054f0 con 0x559a326ad390 2024-09-21T01:00:49.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.576+0000 7f4d8affd640 1 -- 172.21.15.1:0/792889147 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d90004be0 con 0x559a326ad390 2024-09-21T01:00:49.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.577+0000 7f4dada15740 1 -- 172.21.15.1:0/792889147 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559a326ad390 msgr2=0x559a32a76490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:49.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.577+0000 7f4dada15740 1 --2- 172.21.15.1:0/792889147 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559a326ad390 0x559a32a76490 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f4d90005940 tx=0x7f4d90031400 comp rx=0 tx=0).stop 2024-09-21T01:00:49.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.577+0000 7f4dada15740 1 -- 172.21.15.1:0/792889147 shutdown_connections 2024-09-21T01:00:49.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.577+0000 7f4dada15740 1 --2- 172.21.15.1:0/792889147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a326ce070 0x559a32a8c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.577+0000 7f4dada15740 1 --2- 172.21.15.1:0/792889147 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559a326ad390 0x559a32a76490 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.577+0000 7f4dada15740 1 --2- 172.21.15.1:0/792889147 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559a326a51b0 0x559a32a829e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.577+0000 7f4dada15740 1 -- 172.21.15.1:0/792889147 >> 172.21.15.1:0/792889147 conn(0x559a326c2460 msgr2=0x559a32a8be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:49.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.577+0000 7f4dada15740 1 -- 172.21.15.1:0/792889147 shutdown_connections 2024-09-21T01:00:49.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.577+0000 7f4dada15740 1 -- 172.21.15.1:0/792889147 wait complete. 2024-09-21T01:00:49.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.577+0000 7f4dada15740 1 -- start start 2024-09-21T01:00:49.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.577+0000 7f4dada15740 1 Processor -- start 2024-09-21T01:00:49.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.578+0000 7f4dada15740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a326a51b0 0x559a32af5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:49.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.578+0000 7f4dada15740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559a326ad390 0x559a32af5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:49.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.578+0000 7f4dada15740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559a326ce070 0x559a32a88d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:49.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.578+0000 7f4dada15740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4da01b2990 con 0x559a326ad390 2024-09-21T01:00:49.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.578+0000 7f4dada15740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4da01b22c0 con 0x559a326ce070 2024-09-21T01:00:49.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.578+0000 7f4dada15740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4da01af440 con 0x559a326a51b0 2024-09-21T01:00:49.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.578+0000 7f4dada15740 10 client.0 _ll_register_callbacks cb 0x7f4d9c0ea6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:49.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.578+0000 7f4da4a3c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559a326ad390 0x559a32af5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:49.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.578+0000 7f4da4a3c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559a326ad390 0x559a32af5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38392/0 (socket says 172.21.15.1:38392) 2024-09-21T01:00:49.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.578+0000 7f4da4a3c640 1 -- 172.21.15.1:0/1204761680 learned_addr learned my addr 172.21.15.1:0/1204761680 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:49.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.578+0000 7f4da5a3e640 1 --2- 172.21.15.1:0/1204761680 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559a326ce070 0x559a32a88d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:49.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.578+0000 7f4da5a3e640 1 --2- 172.21.15.1:0/1204761680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a326a51b0 0x559a32af5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:49.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.578+0000 7f4da4a3c640 1 -- 172.21.15.1:0/1204761680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a326a51b0 msgr2=0x559a32af5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:49.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.578+0000 7f4da4a3c640 1 --2- 172.21.15.1:0/1204761680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a326a51b0 0x559a32af5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.578+0000 7f4da4a3c640 1 -- 172.21.15.1:0/1204761680 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559a326ce070 msgr2=0x559a32a88d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:49.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.578+0000 7f4da4a3c640 1 --2- 172.21.15.1:0/1204761680 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559a326ce070 0x559a32a88d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.579+0000 7f4da4a3c640 1 -- 172.21.15.1:0/1204761680 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a32a89390 con 0x559a326ad390 2024-09-21T01:00:49.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.579+0000 7f4da5a3e640 1 --2- 172.21.15.1:0/1204761680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a326a51b0 0x559a32af5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:00:49.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.579+0000 7f4da4a3c640 1 --2- 172.21.15.1:0/1204761680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559a326ad390 0x559a32af5d70 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f4d90004620 tx=0x7f4d900047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4904d69a953a354 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:49.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.579+0000 7f4d88ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:00:49.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.579+0000 7f4d88ff9640 1 -- 172.21.15.1:0/1204761680 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d90035040 con 0x559a326ad390 2024-09-21T01:00:49.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.579+0000 7f4d88ff9640 1 -- 172.21.15.1:0/1204761680 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f4d90004960 con 0x559a326ad390 2024-09-21T01:00:49.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.579+0000 7f4dada15740 1 -- 172.21.15.1:0/1204761680 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d900054f0 con 0x559a326ad390 2024-09-21T01:00:49.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.579+0000 7f4d88ff9640 1 -- 172.21.15.1:0/1204761680 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f4d90004b60 con 0x559a326ad390 2024-09-21T01:00:49.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.579+0000 7f4dada15740 10 client.16563 fetch_fsmap learned FSMap version 33 2024-09-21T01:00:49.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.579+0000 7f4dada15740 1 -- 172.21.15.1:0/1204761680 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x559a32afcfd0 con 0x559a326ad390 2024-09-21T01:00:49.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.579+0000 7f4d88ff9640 1 -- 172.21.15.1:0/1204761680 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d900054f0 con 0x559a326ad390 2024-09-21T01:00:49.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.580+0000 7f4d88ff9640 1 -- 172.21.15.1:0/1204761680 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f4d900314a0 con 0x559a326ad390 2024-09-21T01:00:49.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.580+0000 7f4dada15740 10 client.16563 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:00:49.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.580+0000 7f4dada15740 10 client.16563 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:00:49.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.580+0000 7f4dada15740 20 client.16563 populate_metadata read hostname 'smithi001' 2024-09-21T01:00:49.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.580+0000 7f4dada15740 1 --2- 172.21.15.1:0/1204761680 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x559a32661da0 0x559a32aff660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:49.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.580+0000 7f4dada15740 4 client.16563 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:00:49.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.580+0000 7f4dada15740 1 -- 172.21.15.1:0/1204761680 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559a329e98a0 con 0x559a32661da0 2024-09-21T01:00:49.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.580+0000 7f4da5a3e640 1 --2- 172.21.15.1:0/1204761680 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x559a32661da0 0x559a32aff660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:49.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.580+0000 7f4d88ff9640 10 client.16563 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:49.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.581+0000 7f4da5a3e640 1 --2- 172.21.15.1:0/1204761680 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x559a32661da0 0x559a32aff660 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3099fb0f57fc3622 server_cookie=518887846ed15408 in_seq=0 out_seq=0 2024-09-21T01:00:49.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.581+0000 7f4d88ff9640 1 -- 172.21.15.1:0/1204761680 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559a329e98a0 con 0x559a32661da0 2024-09-21T01:00:49.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.581+0000 7f4d88ff9640 10 client.16563 handle_command_reply: tid=0 2024-09-21T01:00:49.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.581+0000 7f4dada15740 1 client.16563 shutdown 2024-09-21T01:00:49.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.581+0000 7f4dada15740 1 -- 172.21.15.1:0/1204761680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559a326ad390 msgr2=0x559a32af5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:49.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.581+0000 7f4dada15740 1 --2- 172.21.15.1:0/1204761680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559a326ad390 0x559a32af5d70 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f4d90004620 tx=0x7f4d900047c0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.581+0000 7f4dada15740 1 -- 172.21.15.1:0/1204761680 shutdown_connections 2024-09-21T01:00:49.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.581+0000 7f4dada15740 1 --2- 172.21.15.1:0/1204761680 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x559a32661da0 0x559a32aff660 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.581+0000 7f4dada15740 1 --2- 172.21.15.1:0/1204761680 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559a326ce070 0x559a32a88d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.581+0000 7f4dada15740 1 --2- 172.21.15.1:0/1204761680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559a326ad390 0x559a32af5d70 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.581+0000 7f4dada15740 1 --2- 172.21.15.1:0/1204761680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a326a51b0 0x559a32af5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.581+0000 7f4d88ff9640 0 client.16563 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:49.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.581+0000 7f4dada15740 1 -- 172.21.15.1:0/1204761680 >> 172.21.15.1:0/1204761680 conn(0x559a326c2460 msgr2=0x559a32a8be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:49.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.582+0000 7f4dada15740 1 -- 172.21.15.1:0/1204761680 shutdown_connections 2024-09-21T01:00:49.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.582+0000 7f4dada15740 1 -- 172.21.15.1:0/1204761680 wait complete. 2024-09-21T01:00:49.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.582+0000 7f4dada15740 20 client.16563 trim_cache size 0 max 16384 2024-09-21T01:00:49.586 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T01:00:49.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.582+0000 7f4da623f640 1 -- 172.21.15.1:0/3017909978 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4d8c0b6590 msgr2=0x7f4d8c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:49.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.582+0000 7f4da623f640 1 --2- 172.21.15.1:0/3017909978 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4d8c0b6590 0x7f4d8c0b8aa0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x559a32a740e0 tx=0x7f4d9c094040 comp rx=0 tx=0).stop 2024-09-21T01:00:49.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.582+0000 7f4da623f640 1 -- 172.21.15.1:0/3017909978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4da0102880 msgr2=0x7f4da0198f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:49.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.582+0000 7f4da623f640 1 --2- 172.21.15.1:0/3017909978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4da0102880 0x7f4da0198f00 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c00d770 tx=0x7f4d9c00dc30 comp rx=0 tx=0).stop 2024-09-21T01:00:49.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.582+0000 7f4da623f640 1 -- 172.21.15.1:0/3017909978 shutdown_connections 2024-09-21T01:00:49.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.582+0000 7f4da623f640 1 --2- 172.21.15.1:0/3017909978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4da0108b10 0x7f4da0199980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.582+0000 7f4da623f640 1 --2- 172.21.15.1:0/3017909978 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4da01081c0 0x7f4da0199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.582+0000 7f4da623f640 1 --2- 172.21.15.1:0/3017909978 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4d8c0b6590 0x7f4d8c0b8aa0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.582+0000 7f4da623f640 1 --2- 172.21.15.1:0/3017909978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4da0102880 0x7f4da0198f00 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.582+0000 7f4da623f640 1 -- 172.21.15.1:0/3017909978 >> 172.21.15.1:0/3017909978 conn(0x7f4da00fe2d0 msgr2=0x7f4da01006f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:49.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.583+0000 7f4da623f640 1 -- 172.21.15.1:0/3017909978 shutdown_connections 2024-09-21T01:00:49.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:49.583+0000 7f4da623f640 1 -- 172.21.15.1:0/3017909978 wait complete. 2024-09-21T01:00:49.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:49 smithi193 ceph-mon[34660]: pgmap v466: 97 pgs: 97 active+clean; 440 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.0 MiB/s wr, 192 op/s 2024-09-21T01:00:49.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:49 smithi042 ceph-mon[34481]: pgmap v466: 97 pgs: 97 active+clean; 440 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.0 MiB/s wr, 192 op/s 2024-09-21T01:00:49.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:49.878+0000 7f5795ffb640 1 -- 172.21.15.1:0/775047609 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558bc4bb90f0 con 0x558bc48a11b0 2024-09-21T01:00:49.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:49.878+0000 7f5795ffb640 10 client.26095 handle_command_reply: tid=0 2024-09-21T01:00:49.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:49.878+0000 7f57bba72740 1 client.26095 shutdown 2024-09-21T01:00:49.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:49.879+0000 7f57bba72740 1 -- 172.21.15.1:0/775047609 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558bc485fd80 msgr2=0x558bc4c5a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:49.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:49.879+0000 7f57bba72740 1 --2- 172.21.15.1:0/775047609 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558bc485fd80 0x558bc4c5a1e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f57a0000c00 tx=0x7f57a0009850 comp rx=0 tx=0).stop 2024-09-21T01:00:49.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:49.879+0000 7f57bba72740 1 -- 172.21.15.1:0/775047609 shutdown_connections 2024-09-21T01:00:49.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:49.879+0000 7f57bba72740 1 --2- 172.21.15.1:0/775047609 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558bc48a11b0 0x558bc4cccbd0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:49.879+0000 7f57bba72740 1 --2- 172.21.15.1:0/775047609 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558bc48804d0 0x558bc4c593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:49.879+0000 7f5795ffb640 0 client.26095 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:49.879+0000 7f57bba72740 1 --2- 172.21.15.1:0/775047609 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc48782f0 0x558bc4c58ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:49.879+0000 7f57bba72740 1 --2- 172.21.15.1:0/775047609 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558bc485fd80 0x558bc4c5a1e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:49.879+0000 7f57bba72740 1 -- 172.21.15.1:0/775047609 >> 172.21.15.1:0/775047609 conn(0x558bc4895300 msgr2=0x558bc4c49db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:49.879+0000 7f57bba72740 1 -- 172.21.15.1:0/775047609 shutdown_connections 2024-09-21T01:00:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:49.879+0000 7f57bba72740 1 -- 172.21.15.1:0/775047609 wait complete. 2024-09-21T01:00:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:49.879+0000 7f57bba72740 20 client.26095 trim_cache size 0 max 16384 2024-09-21T01:00:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T01:00:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T01:00:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T01:00:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T01:00:49.883 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:49.880+0000 7f57b4a25640 1 -- 172.21.15.1:0/2184401207 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f57980b65c0 msgr2=0x7f57980b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:49.883 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:49.880+0000 7f57b4a25640 1 --2- 172.21.15.1:0/2184401207 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f57980b65c0 0x7f57980b8ad0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f57a0009a40 tx=0x7f57a00091c0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.883 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:49.880+0000 7f57b4a25640 1 -- 172.21.15.1:0/2184401207 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57b0103fe0 msgr2=0x7f57b01a1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:49.883 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:49.880+0000 7f57b4a25640 1 --2- 172.21.15.1:0/2184401207 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57b0103fe0 0x7f57b01a1770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f57a800ca30 tx=0x7f57a800cef0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.883 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:49.880+0000 7f57b4a25640 1 -- 172.21.15.1:0/2184401207 shutdown_connections 2024-09-21T01:00:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:49.880+0000 7f57b4a25640 1 --2- 172.21.15.1:0/2184401207 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57b0103fe0 0x7f57b01a1770 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:49.880+0000 7f57b4a25640 1 --2- 172.21.15.1:0/2184401207 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f57b0103640 0x7f57b01a0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:49.880+0000 7f57b4a25640 1 --2- 172.21.15.1:0/2184401207 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f57980b65c0 0x7f57980b8ad0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:49.880+0000 7f57b4a25640 1 --2- 172.21.15.1:0/2184401207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b01025c0 0x7f57b01a0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:49.880+0000 7f57b4a25640 1 -- 172.21.15.1:0/2184401207 >> 172.21.15.1:0/2184401207 conn(0x7f57b00fdf00 msgr2=0x7f57b010fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:49.880+0000 7f57b4a25640 1 -- 172.21.15.1:0/2184401207 shutdown_connections 2024-09-21T01:00:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:00:49.880+0000 7f57b4a25640 1 -- 172.21.15.1:0/2184401207 wait complete. 2024-09-21T01:00:51.547 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T01:00:51.547 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T01:00:51.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:51 smithi001 ceph-mon[31211]: pgmap v467: 97 pgs: 97 active+clean; 460 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.6 MiB/s wr, 351 op/s 2024-09-21T01:00:51.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:51 smithi193 ceph-mon[34660]: pgmap v467: 97 pgs: 97 active+clean; 460 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.6 MiB/s wr, 351 op/s 2024-09-21T01:00:51.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:51 smithi042 ceph-mon[34481]: pgmap v467: 97 pgs: 97 active+clean; 460 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.6 MiB/s wr, 351 op/s 2024-09-21T01:00:51.820 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:00:52.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.332+0000 7fe21fc71640 1 -- 172.21.15.1:0/3535051314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe21810de60 msgr2=0x7fe218110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:52.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.332+0000 7fe21fc71640 1 --2- 172.21.15.1:0/3535051314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe21810de60 0x7fe218110330 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fe210009ca0 tx=0x7fe21002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:00:52.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.332+0000 7fe21fc71640 1 -- 172.21.15.1:0/3535051314 shutdown_connections 2024-09-21T01:00:52.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.332+0000 7fe21fc71640 1 --2- 172.21.15.1:0/3535051314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe21810de60 0x7fe218110330 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:52.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.332+0000 7fe21fc71640 1 --2- 172.21.15.1:0/3535051314 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe218105380 0x7fe21810d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:52.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.332+0000 7fe21fc71640 1 --2- 172.21.15.1:0/3535051314 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe218104a30 0x7fe218104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:52.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.332+0000 7fe21fc71640 1 -- 172.21.15.1:0/3535051314 >> 172.21.15.1:0/3535051314 conn(0x7fe218079790 msgr2=0x7fe218079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:52.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.332+0000 7fe21fc71640 1 -- 172.21.15.1:0/3535051314 shutdown_connections 2024-09-21T01:00:52.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.332+0000 7fe21fc71640 1 -- 172.21.15.1:0/3535051314 wait complete. 2024-09-21T01:00:52.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.333+0000 7fe21fc71640 1 Processor -- start 2024-09-21T01:00:52.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.333+0000 7fe21fc71640 1 -- start start 2024-09-21T01:00:52.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.334+0000 7fe21fc71640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe218104a30 0x7fe218102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:52.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.334+0000 7fe21fc71640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe218105380 0x7fe218102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:52.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.334+0000 7fe21fc71640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe21810de60 0x7fe2181031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:52.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.334+0000 7fe21fc71640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe218113b10 con 0x7fe21810de60 2024-09-21T01:00:52.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.334+0000 7fe21fc71640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe218113990 con 0x7fe218105380 2024-09-21T01:00:52.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.334+0000 7fe21fc71640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe218113c90 con 0x7fe218104a30 2024-09-21T01:00:52.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.334+0000 7fe21e20e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe21810de60 0x7fe2181031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:52.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.334+0000 7fe21da0d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe218104a30 0x7fe218102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:52.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.334+0000 7fe21e20e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe21810de60 0x7fe2181031f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38410/0 (socket says 172.21.15.1:38410) 2024-09-21T01:00:52.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.334+0000 7fe21d20c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe218105380 0x7fe218102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:52.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.334+0000 7fe21e20e640 1 -- 172.21.15.1:0/147154788 learned_addr learned my addr 172.21.15.1:0/147154788 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:52.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.334+0000 7fe21d20c640 1 -- 172.21.15.1:0/147154788 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe218104a30 msgr2=0x7fe218102770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:52.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.334+0000 7fe21d20c640 1 --2- 172.21.15.1:0/147154788 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe218104a30 0x7fe218102770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:52.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.334+0000 7fe21d20c640 1 -- 172.21.15.1:0/147154788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe21810de60 msgr2=0x7fe2181031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:52.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.334+0000 7fe21d20c640 1 --2- 172.21.15.1:0/147154788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe21810de60 0x7fe2181031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:52.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.334+0000 7fe21d20c640 1 -- 172.21.15.1:0/147154788 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2181a86c0 con 0x7fe218105380 2024-09-21T01:00:52.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.334+0000 7fe21d20c640 1 --2- 172.21.15.1:0/147154788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe218105380 0x7fe218102cb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe21806ab20 tx=0x7fe20800ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:52.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.335+0000 7fe20effd640 1 -- 172.21.15.1:0/147154788 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20800cc40 con 0x7fe218105380 2024-09-21T01:00:52.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.335+0000 7fe21fc71640 1 -- 172.21.15.1:0/147154788 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2181a89b0 con 0x7fe218105380 2024-09-21T01:00:52.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.335+0000 7fe20effd640 1 -- 172.21.15.1:0/147154788 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe20800cde0 con 0x7fe218105380 2024-09-21T01:00:52.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.335+0000 7fe20effd640 1 -- 172.21.15.1:0/147154788 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe208018760 con 0x7fe218105380 2024-09-21T01:00:52.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.335+0000 7fe21fc71640 1 -- 172.21.15.1:0/147154788 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2181a8ef0 con 0x7fe218105380 2024-09-21T01:00:52.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.337+0000 7fe2261e5740 1 Processor -- start 2024-09-21T01:00:52.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.337+0000 7fe2261e5740 1 -- start start 2024-09-21T01:00:52.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.338+0000 7fe2261e5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c74b061350 0x55c74b408430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:52.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.338+0000 7fe2261e5740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c74b038490 0x55c74b408970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:52.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.338+0000 7fe2261e5740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c74b040670 0x55c74b408eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:52.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.338+0000 7fe2261e5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c74b37ee60 con 0x55c74b061350 2024-09-21T01:00:52.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.338+0000 7fe2261e5740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c74b36e290 con 0x55c74b040670 2024-09-21T01:00:52.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.338+0000 7fe2261e5740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55c74b3720a0 con 0x55c74b038490 2024-09-21T01:00:52.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.338+0000 7fe21e20e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c74b061350 0x55c74b408430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:52.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.338+0000 7fe21e20e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c74b061350 0x55c74b408430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38416/0 (socket says 172.21.15.1:38416) 2024-09-21T01:00:52.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.338+0000 7fe21e20e640 1 -- 172.21.15.1:0/3196823781 learned_addr learned my addr 172.21.15.1:0/3196823781 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:52.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.338+0000 7fe21da0d640 1 --2- 172.21.15.1:0/3196823781 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c74b038490 0x55c74b408970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:52.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.338+0000 7fe20effd640 1 -- 172.21.15.1:0/147154788 <== mon.2 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7fe208018900 con 0x7fe218105380 2024-09-21T01:00:52.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.338+0000 7fe21e20e640 1 -- 172.21.15.1:0/3196823781 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c74b038490 msgr2=0x55c74b408970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:52.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.338+0000 7fe21e20e640 1 --2- 172.21.15.1:0/3196823781 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c74b038490 0x55c74b408970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:52.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.338+0000 7fe21e20e640 1 -- 172.21.15.1:0/3196823781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c74b040670 msgr2=0x55c74b408eb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:00:52.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.338+0000 7fe21e20e640 1 --2- 172.21.15.1:0/3196823781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c74b040670 0x55c74b408eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:52.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.338+0000 7fe21e20e640 1 -- 172.21.15.1:0/3196823781 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c74b0cc930 con 0x55c74b061350 2024-09-21T01:00:52.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.338+0000 7fe21da0d640 1 --2- 172.21.15.1:0/3196823781 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c74b038490 0x55c74b408970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:52.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.339+0000 7fe21e20e640 1 --2- 172.21.15.1:0/3196823781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c74b061350 0x55c74b408430 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fe2100094c0 tx=0x7fe210009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d0eaf1789e2552 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:52.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.339+0000 7fe203fff640 1 -- 172.21.15.1:0/3196823781 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe210031db0 con 0x55c74b061350 2024-09-21T01:00:52.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.339+0000 7fe203fff640 1 -- 172.21.15.1:0/3196823781 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe210036030 con 0x55c74b061350 2024-09-21T01:00:52.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.339+0000 7fe203fff640 1 -- 172.21.15.1:0/3196823781 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe210004240 con 0x55c74b061350 2024-09-21T01:00:52.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.339+0000 7fe20effd640 1 --2- 172.21.15.1:0/147154788 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe2040b6510 0x7fe2040b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:52.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.339+0000 7fe21da0d640 1 --2- 172.21.15.1:0/147154788 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe2040b6510 0x7fe2040b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:52.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.339+0000 7fe20effd640 1 -- 172.21.15.1:0/147154788 <== mon.2 v2:172.21.15.42:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fe2080e75e0 con 0x7fe218105380 2024-09-21T01:00:52.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.340+0000 7fe2261e5740 1 -- 172.21.15.1:0/3196823781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c74b061350 msgr2=0x55c74b408430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:52.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.340+0000 7fe21da0d640 1 --2- 172.21.15.1:0/147154788 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe2040b6510 0x7fe2040b8a20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x55c74b4070b0 tx=0x7fe214005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:52.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.340+0000 7fe2261e5740 1 --2- 172.21.15.1:0/3196823781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c74b061350 0x55c74b408430 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fe2100094c0 tx=0x7fe210009a10 comp rx=0 tx=0).stop 2024-09-21T01:00:52.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.340+0000 7fe2261e5740 1 -- 172.21.15.1:0/3196823781 shutdown_connections 2024-09-21T01:00:52.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.340+0000 7fe2261e5740 1 --2- 172.21.15.1:0/3196823781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c74b040670 0x55c74b408eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:52.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.340+0000 7fe2261e5740 1 --2- 172.21.15.1:0/3196823781 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c74b038490 0x55c74b408970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:52.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.340+0000 7fe2261e5740 1 --2- 172.21.15.1:0/3196823781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c74b061350 0x55c74b408430 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:52.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.340+0000 7fe2261e5740 1 -- 172.21.15.1:0/3196823781 >> 172.21.15.1:0/3196823781 conn(0x55c74b055740 msgr2=0x55c74b406320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:52.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.340+0000 7fe2261e5740 1 -- 172.21.15.1:0/3196823781 shutdown_connections 2024-09-21T01:00:52.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.340+0000 7fe2261e5740 1 -- 172.21.15.1:0/3196823781 wait complete. 2024-09-21T01:00:52.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.340+0000 7fe2261e5740 1 -- start start 2024-09-21T01:00:52.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.341+0000 7fe2261e5740 1 Processor -- start 2024-09-21T01:00:52.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.341+0000 7fe2261e5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c74b038490 0x55c74b414080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:52.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.341+0000 7fe2261e5740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c74b040670 0x55c74b414640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:52.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.341+0000 7fe2261e5740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c74b061350 0x55c74b41fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:52.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.341+0000 7fe2261e5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c74b1cf890 con 0x55c74b038490 2024-09-21T01:00:52.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.341+0000 7fe2261e5740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c74b308d40 con 0x55c74b061350 2024-09-21T01:00:52.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.341+0000 7fe2261e5740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55c74b416a30 con 0x55c74b040670 2024-09-21T01:00:52.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.341+0000 7fe2261e5740 10 client.0 _ll_register_callbacks cb 0x55c74b36cc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:52.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.341+0000 7fe21da0d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c74b038490 0x55c74b414080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:52.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.341+0000 7fe21da0d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c74b038490 0x55c74b414080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38418/0 (socket says 172.21.15.1:38418) 2024-09-21T01:00:52.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.341+0000 7fe21da0d640 1 -- 172.21.15.1:0/1522929931 learned_addr learned my addr 172.21.15.1:0/1522929931 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:52.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.341+0000 7fe21e20e640 1 --2- 172.21.15.1:0/1522929931 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c74b061350 0x55c74b41fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:52.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.341+0000 7fe21d20c640 1 --2- 172.21.15.1:0/1522929931 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c74b040670 0x55c74b414640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:52.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.342+0000 7fe21da0d640 1 -- 172.21.15.1:0/1522929931 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c74b040670 msgr2=0x55c74b414640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:52.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.342+0000 7fe21da0d640 1 --2- 172.21.15.1:0/1522929931 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c74b040670 0x55c74b414640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:52.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.342+0000 7fe21da0d640 1 -- 172.21.15.1:0/1522929931 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c74b061350 msgr2=0x55c74b41fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:52.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.342+0000 7fe21da0d640 1 --2- 172.21.15.1:0/1522929931 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c74b061350 0x55c74b41fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:52.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.342+0000 7fe21da0d640 1 -- 172.21.15.1:0/1522929931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c74b420390 con 0x55c74b038490 2024-09-21T01:00:52.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.342+0000 7fe21e20e640 1 --2- 172.21.15.1:0/1522929931 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c74b061350 0x55c74b41fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:52.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.342+0000 7fe21da0d640 1 --2- 172.21.15.1:0/1522929931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c74b038490 0x55c74b414080 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fe214004610 tx=0x7fe214004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=768e9c64bf42a60d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:52.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.342+0000 7fe2017fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:00:52.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.342+0000 7fe2017fa640 1 -- 172.21.15.1:0/1522929931 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21401f700 con 0x55c74b038490 2024-09-21T01:00:52.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.342+0000 7fe2017fa640 1 -- 172.21.15.1:0/1522929931 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fe21401f8a0 con 0x55c74b038490 2024-09-21T01:00:52.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.342+0000 7fe2261e5740 1 -- 172.21.15.1:0/1522929931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe210036030 con 0x55c74b038490 2024-09-21T01:00:52.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.342+0000 7fe2017fa640 1 -- 172.21.15.1:0/1522929931 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fe21401faa0 con 0x55c74b038490 2024-09-21T01:00:52.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.342+0000 7fe2261e5740 10 client.16575 fetch_fsmap learned FSMap version 33 2024-09-21T01:00:52.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.342+0000 7fe2261e5740 1 -- 172.21.15.1:0/1522929931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55c74b422d00 con 0x55c74b038490 2024-09-21T01:00:52.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.343+0000 7fe2017fa640 1 -- 172.21.15.1:0/1522929931 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe210036030 con 0x55c74b038490 2024-09-21T01:00:52.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.343+0000 7fe2017fa640 1 -- 172.21.15.1:0/1522929931 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fe214027070 con 0x55c74b038490 2024-09-21T01:00:52.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.343+0000 7fe2261e5740 10 client.16575 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:00:52.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.343+0000 7fe2261e5740 10 client.16575 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:00:52.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.343+0000 7fe2261e5740 20 client.16575 populate_metadata read hostname 'smithi001' 2024-09-21T01:00:52.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.343+0000 7fe2261e5740 1 --2- 172.21.15.1:0/1522929931 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55c74b01fcd0 0x55c74b4261d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:52.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.343+0000 7fe2261e5740 4 client.16575 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:00:52.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.343+0000 7fe2261e5740 1 -- 172.21.15.1:0/1522929931 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c74b380db0 con 0x55c74b01fcd0 2024-09-21T01:00:52.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.343+0000 7fe21d20c640 1 --2- 172.21.15.1:0/1522929931 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55c74b01fcd0 0x55c74b4261d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:52.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.344+0000 7fe2017fa640 10 client.16575 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:52.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.344+0000 7fe21d20c640 1 --2- 172.21.15.1:0/1522929931 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55c74b01fcd0 0x55c74b4261d0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a309bcab1c5ebedb server_cookie=7b7ab063f9bbefcf in_seq=0 out_seq=0 2024-09-21T01:00:52.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.344+0000 7fe2017fa640 1 -- 172.21.15.1:0/1522929931 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c74b380db0 con 0x55c74b01fcd0 2024-09-21T01:00:52.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.344+0000 7fe2017fa640 10 client.16575 handle_command_reply: tid=0 2024-09-21T01:00:52.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.344+0000 7fe2261e5740 1 client.16575 shutdown 2024-09-21T01:00:52.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.344+0000 7fe2261e5740 1 -- 172.21.15.1:0/1522929931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c74b038490 msgr2=0x55c74b414080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:52.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.344+0000 7fe2261e5740 1 --2- 172.21.15.1:0/1522929931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c74b038490 0x55c74b414080 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fe214004610 tx=0x7fe214004730 comp rx=0 tx=0).stop 2024-09-21T01:00:52.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.345+0000 7fe2261e5740 1 -- 172.21.15.1:0/1522929931 shutdown_connections 2024-09-21T01:00:52.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.345+0000 7fe2261e5740 1 --2- 172.21.15.1:0/1522929931 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55c74b01fcd0 0x55c74b4261d0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:52.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.345+0000 7fe2261e5740 1 --2- 172.21.15.1:0/1522929931 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c74b061350 0x55c74b41fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:52.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.345+0000 7fe2261e5740 1 --2- 172.21.15.1:0/1522929931 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c74b040670 0x55c74b414640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:52.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.345+0000 7fe2017fa640 0 client.16575 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:52.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.345+0000 7fe2261e5740 1 --2- 172.21.15.1:0/1522929931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c74b038490 0x55c74b414080 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:52.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.345+0000 7fe2261e5740 1 -- 172.21.15.1:0/1522929931 >> 172.21.15.1:0/1522929931 conn(0x55c74b055740 msgr2=0x55c74b40b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:52.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.345+0000 7fe2261e5740 1 -- 172.21.15.1:0/1522929931 shutdown_connections 2024-09-21T01:00:52.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.345+0000 7fe2261e5740 1 -- 172.21.15.1:0/1522929931 wait complete. 2024-09-21T01:00:52.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.345+0000 7fe2261e5740 20 client.16575 trim_cache size 0 max 16384 2024-09-21T01:00:52.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.367+0000 7fe2261e5740 1 Processor -- start 2024-09-21T01:00:52.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.367+0000 7fe2261e5740 1 -- start start 2024-09-21T01:00:52.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.367+0000 7fe2261e5740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c74b038490 0x55c74b40bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:52.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.367+0000 7fe2261e5740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c74b040670 0x55c74b415ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:52.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.367+0000 7fe2261e5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c74b061350 0x55c74b40d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:52.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.367+0000 7fe2261e5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe2181b15e0 con 0x55c74b061350 2024-09-21T01:00:52.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.367+0000 7fe2261e5740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe2181b31e0 con 0x55c74b040670 2024-09-21T01:00:52.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.367+0000 7fe2261e5740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe2181b1cb0 con 0x55c74b038490 2024-09-21T01:00:52.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.367+0000 7fe21da0d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c74b038490 0x55c74b40bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:52.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.367+0000 7fe21e20e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c74b061350 0x55c74b40d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:52.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.367+0000 7fe21d20c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c74b040670 0x55c74b415ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:52.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.368+0000 7fe21da0d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c74b038490 0x55c74b40bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:45088/0 (socket says 172.21.15.1:45088) 2024-09-21T01:00:52.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.368+0000 7fe21e20e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c74b061350 0x55c74b40d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38434/0 (socket says 172.21.15.1:38434) 2024-09-21T01:00:52.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.368+0000 7fe21da0d640 1 -- 172.21.15.1:0/1682560135 learned_addr learned my addr 172.21.15.1:0/1682560135 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:52.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.368+0000 7fe21da0d640 1 -- 172.21.15.1:0/1682560135 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c74b040670 msgr2=0x55c74b415ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:52.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.368+0000 7fe21da0d640 1 --2- 172.21.15.1:0/1682560135 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c74b040670 0x55c74b415ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:52.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.368+0000 7fe21da0d640 1 -- 172.21.15.1:0/1682560135 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c74b061350 msgr2=0x55c74b40d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:52.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.368+0000 7fe21da0d640 1 --2- 172.21.15.1:0/1682560135 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c74b061350 0x55c74b40d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:52.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.368+0000 7fe21da0d640 1 -- 172.21.15.1:0/1682560135 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c74b406c10 con 0x55c74b038490 2024-09-21T01:00:52.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.368+0000 7fe21e20e640 1 --2- 172.21.15.1:0/1682560135 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c74b061350 0x55c74b40d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:52.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.368+0000 7fe21da0d640 1 --2- 172.21.15.1:0/1682560135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c74b038490 0x55c74b40bba0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe214009d50 tx=0x7fe214004640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66fcdf632b69ed80 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:52.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.368+0000 7fe2037fe640 1 -- 172.21.15.1:0/1682560135 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21401f900 con 0x55c74b038490 2024-09-21T01:00:52.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.368+0000 7fe2037fe640 1 -- 172.21.15.1:0/1682560135 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2140054d0 con 0x55c74b038490 2024-09-21T01:00:52.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.368+0000 7fe2037fe640 1 -- 172.21.15.1:0/1682560135 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2140296a0 con 0x55c74b038490 2024-09-21T01:00:52.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.369+0000 7fe2261e5740 1 -- 172.21.15.1:0/1682560135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c74b038490 msgr2=0x55c74b40bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:52.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.369+0000 7fe2261e5740 1 --2- 172.21.15.1:0/1682560135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c74b038490 0x55c74b40bba0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe214009d50 tx=0x7fe214004640 comp rx=0 tx=0).stop 2024-09-21T01:00:52.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.369+0000 7fe2261e5740 1 -- 172.21.15.1:0/1682560135 shutdown_connections 2024-09-21T01:00:52.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.369+0000 7fe2261e5740 1 --2- 172.21.15.1:0/1682560135 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c74b061350 0x55c74b40d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:52.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.369+0000 7fe2261e5740 1 --2- 172.21.15.1:0/1682560135 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c74b040670 0x55c74b415ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:52.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.369+0000 7fe2261e5740 1 --2- 172.21.15.1:0/1682560135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c74b038490 0x55c74b40bba0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:52.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.369+0000 7fe2261e5740 1 -- 172.21.15.1:0/1682560135 >> 172.21.15.1:0/1682560135 conn(0x55c74b055740 msgr2=0x55c74b4153a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:52.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.369+0000 7fe2261e5740 1 -- 172.21.15.1:0/1682560135 shutdown_connections 2024-09-21T01:00:52.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.370+0000 7fe2261e5740 1 -- 172.21.15.1:0/1682560135 wait complete. 2024-09-21T01:00:52.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.370+0000 7fe2261e5740 1 -- start start 2024-09-21T01:00:52.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.370+0000 7fe2261e5740 1 Processor -- start 2024-09-21T01:00:52.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.371+0000 7fe2261e5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c74b038490 0x55c74b417e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:52.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.371+0000 7fe2261e5740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c74b040670 0x55c74b4183c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:52.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.371+0000 7fe2261e5740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c74b061350 0x55c74b418900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:52.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.371+0000 7fe2261e5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe2181b2b10 con 0x55c74b038490 2024-09-21T01:00:52.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.371+0000 7fe2261e5740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe2181b2440 con 0x55c74b040670 2024-09-21T01:00:52.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.371+0000 7fe2261e5740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe2181af5c0 con 0x55c74b061350 2024-09-21T01:00:52.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.371+0000 7fe21da0d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c74b038490 0x55c74b417e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:52.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.371+0000 7fe21d20c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c74b040670 0x55c74b4183c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:52.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.371+0000 7fe21d20c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c74b040670 0x55c74b4183c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:40064/0 (socket says 172.21.15.1:40064) 2024-09-21T01:00:52.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.371+0000 7fe21da0d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c74b038490 0x55c74b417e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38448/0 (socket says 172.21.15.1:38448) 2024-09-21T01:00:52.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.371+0000 7fe2261e5740 10 client.0 _ll_register_callbacks cb 0x7fe214009c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:52.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.371+0000 7fe21d20c640 1 -- 172.21.15.1:0/1352820965 learned_addr learned my addr 172.21.15.1:0/1352820965 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:52.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.371+0000 7fe21e20e640 1 --2- 172.21.15.1:0/1352820965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c74b061350 0x55c74b418900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:52.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.371+0000 7fe21d20c640 1 -- 172.21.15.1:0/1352820965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c74b061350 msgr2=0x55c74b418900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:52.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.371+0000 7fe21d20c640 1 --2- 172.21.15.1:0/1352820965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c74b061350 0x55c74b418900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:52.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.371+0000 7fe21d20c640 1 -- 172.21.15.1:0/1352820965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c74b038490 msgr2=0x55c74b417e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:52.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.371+0000 7fe21d20c640 1 --2- 172.21.15.1:0/1352820965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c74b038490 0x55c74b417e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:52.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.371+0000 7fe21d20c640 1 -- 172.21.15.1:0/1352820965 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c74b48fd90 con 0x55c74b040670 2024-09-21T01:00:52.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.371+0000 7fe21d20c640 1 --2- 172.21.15.1:0/1352820965 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c74b040670 0x55c74b4183c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe2080a9770 tx=0x7fe2080e7040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=880dce3de489af06 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:52.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.371+0000 7fe2017fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:00:52.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.371+0000 7fe2017fa640 1 -- 172.21.15.1:0/1352820965 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2080d3030 con 0x55c74b040670 2024-09-21T01:00:52.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.372+0000 7fe2261e5740 1 -- 172.21.15.1:0/1352820965 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2140054d0 con 0x55c74b040670 2024-09-21T01:00:52.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.372+0000 7fe2017fa640 1 -- 172.21.15.1:0/1352820965 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fe2080a9a70 con 0x55c74b040670 2024-09-21T01:00:52.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.372+0000 7fe2017fa640 1 -- 172.21.15.1:0/1352820965 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fe2080b2230 con 0x55c74b040670 2024-09-21T01:00:52.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.372+0000 7fe2261e5740 10 client.26240 fetch_fsmap learned FSMap version 33 2024-09-21T01:00:52.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.372+0000 7fe2261e5740 1 -- 172.21.15.1:0/1352820965 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55c74b491090 con 0x55c74b040670 2024-09-21T01:00:52.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.372+0000 7fe2017fa640 1 -- 172.21.15.1:0/1352820965 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2140054d0 con 0x55c74b040670 2024-09-21T01:00:52.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.372+0000 7fe2017fa640 1 -- 172.21.15.1:0/1352820965 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fe2080e71d0 con 0x55c74b040670 2024-09-21T01:00:52.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.372+0000 7fe2261e5740 10 client.26240 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:00:52.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.372+0000 7fe2261e5740 10 client.26240 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:00:52.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.372+0000 7fe2261e5740 20 client.26240 populate_metadata read hostname 'smithi001' 2024-09-21T01:00:52.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.372+0000 7fe2261e5740 1 --2- 172.21.15.1:0/1352820965 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55c74aff5080 0x55c74b493750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:52.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.372+0000 7fe2261e5740 4 client.26240 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T01:00:52.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.372+0000 7fe2261e5740 1 -- 172.21.15.1:0/1352820965 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c74b37c860 con 0x55c74aff5080 2024-09-21T01:00:52.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.372+0000 7fe21da0d640 1 --2- 172.21.15.1:0/1352820965 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55c74aff5080 0x55c74b493750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:52.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.373+0000 7fe2017fa640 10 client.26240 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:52.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.373+0000 7fe21da0d640 1 --2- 172.21.15.1:0/1352820965 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55c74aff5080 0x55c74b493750 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c775e6b8fd28b990 server_cookie=e7ce7d3b2bc923f7 in_seq=0 out_seq=0 2024-09-21T01:00:52.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.375+0000 7fe2017fa640 1 -- 172.21.15.1:0/1352820965 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c74b37c860 con 0x55c74aff5080 2024-09-21T01:00:52.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.375+0000 7fe2017fa640 10 client.26240 handle_command_reply: tid=0 2024-09-21T01:00:52.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.375+0000 7fe2261e5740 1 client.26240 shutdown 2024-09-21T01:00:52.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.375+0000 7fe2261e5740 1 -- 172.21.15.1:0/1352820965 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c74b040670 msgr2=0x55c74b4183c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:52.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.375+0000 7fe2261e5740 1 --2- 172.21.15.1:0/1352820965 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c74b040670 0x55c74b4183c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe2080a9770 tx=0x7fe2080e7040 comp rx=0 tx=0).stop 2024-09-21T01:00:52.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.375+0000 7fe2261e5740 1 -- 172.21.15.1:0/1352820965 shutdown_connections 2024-09-21T01:00:52.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.375+0000 7fe2261e5740 1 --2- 172.21.15.1:0/1352820965 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55c74aff5080 0x55c74b493750 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:52.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.375+0000 7fe2261e5740 1 --2- 172.21.15.1:0/1352820965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c74b061350 0x55c74b418900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:52.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.375+0000 7fe2261e5740 1 --2- 172.21.15.1:0/1352820965 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c74b040670 0x55c74b4183c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:52.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.375+0000 7fe2017fa640 0 client.26240 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:52.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.375+0000 7fe2261e5740 1 --2- 172.21.15.1:0/1352820965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c74b038490 0x55c74b417e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:52.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.375+0000 7fe2261e5740 1 -- 172.21.15.1:0/1352820965 >> 172.21.15.1:0/1352820965 conn(0x55c74b055740 msgr2=0x55c74b415310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:52.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.375+0000 7fe2261e5740 1 -- 172.21.15.1:0/1352820965 shutdown_connections 2024-09-21T01:00:52.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.375+0000 7fe2261e5740 1 -- 172.21.15.1:0/1352820965 wait complete. 2024-09-21T01:00:52.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.375+0000 7fe2261e5740 20 client.26240 trim_cache size 0 max 16384 2024-09-21T01:00:52.379 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T01:00:52.380 INFO:teuthology.orchestra.run.smithi001.stdout: "return_code": 0, 2024-09-21T01:00:52.380 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_tag": "c2addc95-c922-4a70-b746-0b5fd2af59bf", 2024-09-21T01:00:52.380 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": "asynchronous" 2024-09-21T01:00:52.380 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T01:00:52.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.376+0000 7fe21fc71640 1 -- 172.21.15.1:0/147154788 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe2040b6510 msgr2=0x7fe2040b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:52.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.376+0000 7fe21fc71640 1 --2- 172.21.15.1:0/147154788 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe2040b6510 0x7fe2040b8a20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x55c74b4070b0 tx=0x7fe214005f90 comp rx=0 tx=0).stop 2024-09-21T01:00:52.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.376+0000 7fe21fc71640 1 -- 172.21.15.1:0/147154788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe218105380 msgr2=0x7fe218102cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:52.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.376+0000 7fe21fc71640 1 --2- 172.21.15.1:0/147154788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe218105380 0x7fe218102cb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe21806ab20 tx=0x7fe20800ee50 comp rx=0 tx=0).stop 2024-09-21T01:00:52.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.376+0000 7fe21fc71640 1 -- 172.21.15.1:0/147154788 shutdown_connections 2024-09-21T01:00:52.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.376+0000 7fe21fc71640 1 --2- 172.21.15.1:0/147154788 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe2040b6510 0x7fe2040b8a20 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:52.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.376+0000 7fe21fc71640 1 --2- 172.21.15.1:0/147154788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe21810de60 0x7fe2181031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:52.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.376+0000 7fe21fc71640 1 --2- 172.21.15.1:0/147154788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe218105380 0x7fe218102cb0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:52.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.376+0000 7fe21fc71640 1 --2- 172.21.15.1:0/147154788 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe218104a30 0x7fe218102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:52.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.376+0000 7fe21fc71640 1 -- 172.21.15.1:0/147154788 >> 172.21.15.1:0/147154788 conn(0x7fe218079790 msgr2=0x7fe218101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:52.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.376+0000 7fe21fc71640 1 -- 172.21.15.1:0/147154788 shutdown_connections 2024-09-21T01:00:52.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:52.376+0000 7fe21fc71640 1 -- 172.21.15.1:0/147154788 wait complete. 2024-09-21T01:00:53.426 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:00:53.560 INFO:tasks.workunit.client.0.smithi001.stdout: 91 498923 462 312882 410 272112 1156 2024-09-21T01:00:53.688 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:00:53.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:53 smithi001 ceph-mon[31211]: pgmap v468: 97 pgs: 97 active+clean; 484 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 5.7 MiB/s wr, 546 op/s 2024-09-21T01:00:53.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:53 smithi001 ceph-mon[31211]: scrub queued for path: / 2024-09-21T01:00:53.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:53 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:53.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:53 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:00:53.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:53 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:00:53.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:53 smithi193 ceph-mon[34660]: pgmap v468: 97 pgs: 97 active+clean; 484 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 5.7 MiB/s wr, 546 op/s 2024-09-21T01:00:53.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:53 smithi193 ceph-mon[34660]: scrub queued for path: / 2024-09-21T01:00:53.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:53 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:53.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:53 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:00:53.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:53 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:00:53.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:53 smithi042 ceph-mon[34481]: pgmap v468: 97 pgs: 97 active+clean; 484 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 5.7 MiB/s wr, 546 op/s 2024-09-21T01:00:53.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:53 smithi042 ceph-mon[34481]: scrub queued for path: / 2024-09-21T01:00:53.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:53 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:53.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:53 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:00:53.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:53 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:00:54.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.538+0000 7fbc38e8c640 1 -- 172.21.15.1:0/1897716670 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc3410a9e0 msgr2=0x7fbc3410adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:54.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.538+0000 7fbc38e8c640 1 --2- 172.21.15.1:0/1897716670 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc3410a9e0 0x7fbc3410adf0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fbc24009900 tx=0x7fbc2402a440 comp rx=0 tx=0).stop 2024-09-21T01:00:54.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.542+0000 7fbc38e8c640 1 -- 172.21.15.1:0/1897716670 shutdown_connections 2024-09-21T01:00:54.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.542+0000 7fbc38e8c640 1 --2- 172.21.15.1:0/1897716670 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc3411cc30 0x7fbc3411f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:54.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.542+0000 7fbc38e8c640 1 --2- 172.21.15.1:0/1897716670 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc3410a9e0 0x7fbc3410adf0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:54.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.542+0000 7fbc38e8c640 1 --2- 172.21.15.1:0/1897716670 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc34111f40 0x7fbc3410a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:54.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.542+0000 7fbc38e8c640 1 -- 172.21.15.1:0/1897716670 >> 172.21.15.1:0/1897716670 conn(0x7fbc34070ec0 msgr2=0x7fbc340712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:54.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.544+0000 7fbc38e8c640 1 -- 172.21.15.1:0/1897716670 shutdown_connections 2024-09-21T01:00:54.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.547+0000 7fbc38e8c640 1 -- 172.21.15.1:0/1897716670 wait complete. 2024-09-21T01:00:54.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.548+0000 7fbc38e8c640 1 Processor -- start 2024-09-21T01:00:54.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.550+0000 7fbc38e8c640 1 -- start start 2024-09-21T01:00:54.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.550+0000 7fbc38e8c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc3410a9e0 0x7fbc341a9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:54.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.550+0000 7fbc38e8c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc34111f40 0x7fbc341a9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:54.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.551+0000 7fbc38e8c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc3411cc30 0x7fbc341aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:54.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.551+0000 7fbc31d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc34111f40 0x7fbc341a9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:54.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.551+0000 7fbc31d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc34111f40 0x7fbc341a9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:40086/0 (socket says 172.21.15.1:40086) 2024-09-21T01:00:54.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.551+0000 7fbc31d9b640 1 -- 172.21.15.1:0/2870334416 learned_addr learned my addr 172.21.15.1:0/2870334416 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:54.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.551+0000 7fbc3259c640 1 --2- 172.21.15.1:0/2870334416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc3410a9e0 0x7fbc341a9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:54.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.551+0000 7fbc32d9d640 1 --2- 172.21.15.1:0/2870334416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc3411cc30 0x7fbc341aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:54.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.551+0000 7fbc38e8c640 1 -- 172.21.15.1:0/2870334416 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbc34122a00 con 0x7fbc3411cc30 2024-09-21T01:00:54.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.551+0000 7fbc38e8c640 1 -- 172.21.15.1:0/2870334416 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbc34122880 con 0x7fbc34111f40 2024-09-21T01:00:54.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.551+0000 7fbc38e8c640 1 -- 172.21.15.1:0/2870334416 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbc34122b80 con 0x7fbc3410a9e0 2024-09-21T01:00:54.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.555+0000 7fbc31d9b640 1 -- 172.21.15.1:0/2870334416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc3410a9e0 msgr2=0x7fbc341a9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:54.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.555+0000 7fbc31d9b640 1 --2- 172.21.15.1:0/2870334416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc3410a9e0 0x7fbc341a9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:54.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.555+0000 7fbc31d9b640 1 -- 172.21.15.1:0/2870334416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc3411cc30 msgr2=0x7fbc341aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:54.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.555+0000 7fbc31d9b640 1 --2- 172.21.15.1:0/2870334416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc3411cc30 0x7fbc341aebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:54.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.555+0000 7fbc31d9b640 1 -- 172.21.15.1:0/2870334416 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc341af300 con 0x7fbc34111f40 2024-09-21T01:00:54.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.555+0000 7fbc32d9d640 1 --2- 172.21.15.1:0/2870334416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc3411cc30 0x7fbc341aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:54.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.557+0000 7fbc31d9b640 1 --2- 172.21.15.1:0/2870334416 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc34111f40 0x7fbc341a9930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbc2402aa30 tx=0x7fbc24030940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:54.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.558+0000 7fbc237fe640 1 -- 172.21.15.1:0/2870334416 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2403f070 con 0x7fbc34111f40 2024-09-21T01:00:54.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.558+0000 7fbc237fe640 1 -- 172.21.15.1:0/2870334416 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc240314a0 con 0x7fbc34111f40 2024-09-21T01:00:54.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.558+0000 7fbc38e8c640 1 -- 172.21.15.1:0/2870334416 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc341af590 con 0x7fbc34111f40 2024-09-21T01:00:54.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.559+0000 7fbc38e8c640 1 -- 172.21.15.1:0/2870334416 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc3407b620 con 0x7fbc34111f40 2024-09-21T01:00:54.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.564+0000 7fbc237fe640 1 -- 172.21.15.1:0/2870334416 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc24035070 con 0x7fbc34111f40 2024-09-21T01:00:54.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.566+0000 7fbc237fe640 1 -- 172.21.15.1:0/2870334416 <== mon.2 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7fbc24042070 con 0x7fbc34111f40 2024-09-21T01:00:54.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.572+0000 7fbc237fe640 1 --2- 172.21.15.1:0/2870334416 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fbc1c0b6720 0x7fbc1c0b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:54.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.572+0000 7fbc237fe640 1 -- 172.21.15.1:0/2870334416 <== mon.2 v2:172.21.15.42:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fbc24108770 con 0x7fbc34111f40 2024-09-21T01:00:54.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.574+0000 7fbc3f400740 1 Processor -- start 2024-09-21T01:00:54.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.574+0000 7fbc3259c640 1 --2- 172.21.15.1:0/2870334416 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fbc1c0b6720 0x7fbc1c0b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:54.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.576+0000 7fbc3259c640 1 --2- 172.21.15.1:0/2870334416 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fbc1c0b6720 0x7fbc1c0b8c30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbc28006fd0 tx=0x7fbc280090e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:54.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.576+0000 7fbc3f400740 1 -- start start 2024-09-21T01:00:54.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.577+0000 7fbc3f400740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d63e976070 0x55d63ed1d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:54.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.577+0000 7fbc3259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d63e976070 0x55d63ed1d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:54.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.577+0000 7fbc3259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d63e976070 0x55d63ed1d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38478/0 (socket says 172.21.15.1:38478) 2024-09-21T01:00:54.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.578+0000 7fbc3259c640 1 -- 172.21.15.1:0/778449165 learned_addr learned my addr 172.21.15.1:0/778449165 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:54.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.578+0000 7fbc3f400740 1 --2- 172.21.15.1:0/778449165 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d63e94d1b0 0x55d63ed1d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:54.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.578+0000 7fbc3f400740 1 --2- 172.21.15.1:0/778449165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d63e955390 0x55d63ed1dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:54.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.578+0000 7fbc3f400740 1 -- 172.21.15.1:0/778449165 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d63ec93e50 con 0x55d63e976070 2024-09-21T01:00:54.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.578+0000 7fbc3f400740 1 -- 172.21.15.1:0/778449165 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d63ec83280 con 0x55d63e955390 2024-09-21T01:00:54.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.578+0000 7fbc32d9d640 1 --2- 172.21.15.1:0/778449165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d63e955390 0x55d63ed1dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:54.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.578+0000 7fbc3f400740 1 -- 172.21.15.1:0/778449165 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d63ec87090 con 0x55d63e94d1b0 2024-09-21T01:00:54.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.581+0000 7fbc31d9b640 1 --2- 172.21.15.1:0/778449165 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d63e94d1b0 0x55d63ed1d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:54.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.582+0000 7fbc31d9b640 1 -- 172.21.15.1:0/778449165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d63e955390 msgr2=0x55d63ed1dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:54.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.582+0000 7fbc31d9b640 1 --2- 172.21.15.1:0/778449165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d63e955390 0x55d63ed1dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:54.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.582+0000 7fbc31d9b640 1 -- 172.21.15.1:0/778449165 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d63e976070 msgr2=0x55d63ed1d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:54.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.582+0000 7fbc31d9b640 1 --2- 172.21.15.1:0/778449165 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d63e976070 0x55d63ed1d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:54.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.582+0000 7fbc31d9b640 1 -- 172.21.15.1:0/778449165 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d63e9e1650 con 0x55d63e94d1b0 2024-09-21T01:00:54.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.582+0000 7fbc31d9b640 1 --2- 172.21.15.1:0/778449165 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d63e94d1b0 0x55d63ed1d7b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbc240cae70 tx=0x7fbc24005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21dc8f0ca6f56525 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:54.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.583+0000 7fbc20ff9640 1 -- 172.21.15.1:0/778449165 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc24049040 con 0x55d63e94d1b0 2024-09-21T01:00:54.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.583+0000 7fbc20ff9640 1 -- 172.21.15.1:0/778449165 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc240d3360 con 0x55d63e94d1b0 2024-09-21T01:00:54.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.583+0000 7fbc20ff9640 1 -- 172.21.15.1:0/778449165 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc240ca450 con 0x55d63e94d1b0 2024-09-21T01:00:54.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.584+0000 7fbc3f400740 1 -- 172.21.15.1:0/778449165 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d63e94d1b0 msgr2=0x55d63ed1d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:54.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.584+0000 7fbc3f400740 1 --2- 172.21.15.1:0/778449165 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d63e94d1b0 0x55d63ed1d7b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbc240cae70 tx=0x7fbc24005fd0 comp rx=0 tx=0).stop 2024-09-21T01:00:54.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.585+0000 7fbc32d9d640 1 --2- 172.21.15.1:0/778449165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d63e955390 0x55d63ed1dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:00:54.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.590+0000 7fbc3f400740 1 -- 172.21.15.1:0/778449165 shutdown_connections 2024-09-21T01:00:54.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.590+0000 7fbc3f400740 1 --2- 172.21.15.1:0/778449165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d63e955390 0x55d63ed1dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:54.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.590+0000 7fbc3f400740 1 --2- 172.21.15.1:0/778449165 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d63e94d1b0 0x55d63ed1d7b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:54.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.590+0000 7fbc3f400740 1 --2- 172.21.15.1:0/778449165 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d63e976070 0x55d63ed1d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:54.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.590+0000 7fbc3f400740 1 -- 172.21.15.1:0/778449165 >> 172.21.15.1:0/778449165 conn(0x55d63e96a460 msgr2=0x55d63ed1b160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:54.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.594+0000 7fbc3f400740 1 -- 172.21.15.1:0/778449165 shutdown_connections 2024-09-21T01:00:54.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.597+0000 7fbc3f400740 1 -- 172.21.15.1:0/778449165 wait complete. 2024-09-21T01:00:54.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.597+0000 7fbc3f400740 1 -- start start 2024-09-21T01:00:54.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.598+0000 7fbc3f400740 1 Processor -- start 2024-09-21T01:00:54.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.599+0000 7fbc3f400740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d63e94d1b0 0x55d63ed28a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:54.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.599+0000 7fbc3259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d63e94d1b0 0x55d63ed28a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:54.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.600+0000 7fbc3259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d63e94d1b0 0x55d63ed28a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38492/0 (socket says 172.21.15.1:38492) 2024-09-21T01:00:54.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.600+0000 7fbc3259c640 1 -- 172.21.15.1:0/2527343021 learned_addr learned my addr 172.21.15.1:0/2527343021 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:54.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.600+0000 7fbc3f400740 1 --2- 172.21.15.1:0/2527343021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d63e955390 0x55d63ed28f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:54.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.600+0000 7fbc3f400740 1 --2- 172.21.15.1:0/2527343021 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d63e976070 0x55d63ed349e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:54.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.600+0000 7fbc31d9b640 1 --2- 172.21.15.1:0/2527343021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d63e955390 0x55d63ed28f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:54.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.600+0000 7fbc3f400740 1 -- 172.21.15.1:0/2527343021 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d63eae4700 con 0x55d63e94d1b0 2024-09-21T01:00:54.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.600+0000 7fbc3f400740 1 -- 172.21.15.1:0/2527343021 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d63ec1e110 con 0x55d63e955390 2024-09-21T01:00:54.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.600+0000 7fbc3f400740 1 -- 172.21.15.1:0/2527343021 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d63ec87090 con 0x55d63e976070 2024-09-21T01:00:54.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.600+0000 7fbc3f400740 10 client.0 _ll_register_callbacks cb 0x55d63ec37990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:54.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.600+0000 7fbc32d9d640 1 --2- 172.21.15.1:0/2527343021 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d63e976070 0x55d63ed349e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:54.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.601+0000 7fbc32d9d640 1 -- 172.21.15.1:0/2527343021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d63e955390 msgr2=0x55d63ed28f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:54.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.601+0000 7fbc32d9d640 1 --2- 172.21.15.1:0/2527343021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d63e955390 0x55d63ed28f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:54.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.601+0000 7fbc32d9d640 1 -- 172.21.15.1:0/2527343021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d63e94d1b0 msgr2=0x55d63ed28a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:54.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.601+0000 7fbc32d9d640 1 --2- 172.21.15.1:0/2527343021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d63e94d1b0 0x55d63ed28a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:54.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.601+0000 7fbc32d9d640 1 -- 172.21.15.1:0/2527343021 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d63ec4bc40 con 0x55d63e976070 2024-09-21T01:00:54.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.602+0000 7fbc32d9d640 1 --2- 172.21.15.1:0/2527343021 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d63e976070 0x55d63ed349e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c00af80 tx=0x7fbc2c007740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e65fde09a65f749 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:54.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.603+0000 7fbc3259c640 1 --2- 172.21.15.1:0/2527343021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d63e94d1b0 0x55d63ed28a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:00:54.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.603+0000 7fbc31d9b640 1 --2- 172.21.15.1:0/2527343021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d63e955390 0x55d63ed28f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:00:54.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.604+0000 7fbc19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T01:00:54.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.605+0000 7fbc19ffb640 1 -- 172.21.15.1:0/2527343021 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c014760 con 0x55d63e976070 2024-09-21T01:00:54.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.605+0000 7fbc19ffb640 1 -- 172.21.15.1:0/2527343021 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fbc2c014900 con 0x55d63e976070 2024-09-21T01:00:54.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.608+0000 7fbc3f400740 1 -- 172.21.15.1:0/2527343021 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc240d3360 con 0x55d63e976070 2024-09-21T01:00:54.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.612+0000 7fbc19ffb640 1 -- 172.21.15.1:0/2527343021 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fbc2c014b00 con 0x55d63e976070 2024-09-21T01:00:54.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.612+0000 7fbc3f400740 10 client.26140 fetch_fsmap learned FSMap version 33 2024-09-21T01:00:54.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.612+0000 7fbc3f400740 1 -- 172.21.15.1:0/2527343021 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55d63ed37480 con 0x55d63e976070 2024-09-21T01:00:54.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.614+0000 7fbc19ffb640 1 -- 172.21.15.1:0/2527343021 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc2c01a070 con 0x55d63e976070 2024-09-21T01:00:54.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.614+0000 7fbc19ffb640 1 -- 172.21.15.1:0/2527343021 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fbc2c0153f0 con 0x55d63e976070 2024-09-21T01:00:54.633 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:54 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:54.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.618+0000 7fbc3f400740 10 client.26140 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:00:54.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.618+0000 7fbc3f400740 10 client.26140 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:00:54.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.618+0000 7fbc3f400740 20 client.26140 populate_metadata read hostname 'smithi001' 2024-09-21T01:00:54.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.618+0000 7fbc3f400740 1 --2- 172.21.15.1:0/2527343021 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d63e9349f0 0x55d63ed3aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:54.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.618+0000 7fbc3f400740 4 client.26140 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:00:54.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.618+0000 7fbc3f400740 1 -- 172.21.15.1:0/2527343021 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fbc240d3360 con 0x55d63e9349f0 2024-09-21T01:00:54.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.621+0000 7fbc3259c640 1 --2- 172.21.15.1:0/2527343021 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d63e9349f0 0x55d63ed3aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:54.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.625+0000 7fbc3259c640 1 --2- 172.21.15.1:0/2527343021 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d63e9349f0 0x55d63ed3aa40 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f47f38f1c6ee18e2 server_cookie=a27281d68d8cff53 in_seq=0 out_seq=0 2024-09-21T01:00:54.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.625+0000 7fbc19ffb640 10 client.26140 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:54.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.626+0000 7fbc19ffb640 1 -- 172.21.15.1:0/2527343021 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fbc240d3360 con 0x55d63e9349f0 2024-09-21T01:00:54.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.626+0000 7fbc19ffb640 10 client.26140 handle_command_reply: tid=0 2024-09-21T01:00:54.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.629+0000 7fbc3f400740 1 client.26140 shutdown 2024-09-21T01:00:54.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.632+0000 7fbc3f400740 1 -- 172.21.15.1:0/2527343021 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d63e976070 msgr2=0x55d63ed349e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:54.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.632+0000 7fbc3f400740 1 --2- 172.21.15.1:0/2527343021 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d63e976070 0x55d63ed349e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c00af80 tx=0x7fbc2c007740 comp rx=0 tx=0).stop 2024-09-21T01:00:54.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.636+0000 7fbc3f400740 1 -- 172.21.15.1:0/2527343021 shutdown_connections 2024-09-21T01:00:54.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.636+0000 7fbc3f400740 1 --2- 172.21.15.1:0/2527343021 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d63e9349f0 0x55d63ed3aa40 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:54.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.636+0000 7fbc3f400740 1 --2- 172.21.15.1:0/2527343021 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d63e976070 0x55d63ed349e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:54.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.636+0000 7fbc3f400740 1 --2- 172.21.15.1:0/2527343021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d63e955390 0x55d63ed28f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:54.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.636+0000 7fbc19ffb640 0 client.26140 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:54.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.636+0000 7fbc3f400740 1 --2- 172.21.15.1:0/2527343021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d63e94d1b0 0x55d63ed28a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:54.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.636+0000 7fbc3f400740 1 -- 172.21.15.1:0/2527343021 >> 172.21.15.1:0/2527343021 conn(0x55d63e96a460 msgr2=0x55d63ed20400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:54.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.638+0000 7fbc3f400740 1 -- 172.21.15.1:0/2527343021 shutdown_connections 2024-09-21T01:00:54.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.640+0000 7fbc3f400740 1 -- 172.21.15.1:0/2527343021 wait complete. 2024-09-21T01:00:54.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.641+0000 7fbc3f400740 20 client.26140 trim_cache size 0 max 16384 2024-09-21T01:00:54.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.689+0000 7fbc3f400740 1 Processor -- start 2024-09-21T01:00:54.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.690+0000 7fbc3f400740 1 -- start start 2024-09-21T01:00:54.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.691+0000 7fbc3f400740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d63e9349f0 0x55d63ed2a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:54.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.691+0000 7fbc3f400740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d63e94d1b0 0x55d63ed25bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:54.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.691+0000 7fbc3f400740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d63e955390 0x55d63ed26130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:54.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.691+0000 7fbc31d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d63e94d1b0 0x55d63ed25bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:54.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.692+0000 7fbc31d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d63e94d1b0 0x55d63ed25bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:40128/0 (socket says 172.21.15.1:40128) 2024-09-21T01:00:54.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.692+0000 7fbc31d9b640 1 -- 172.21.15.1:0/362630505 learned_addr learned my addr 172.21.15.1:0/362630505 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:54.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.692+0000 7fbc32d9d640 1 --2- 172.21.15.1:0/362630505 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d63e955390 0x55d63ed26130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:54.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.692+0000 7fbc3f400740 1 -- 172.21.15.1:0/362630505 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1400e630 con 0x55d63e955390 2024-09-21T01:00:54.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.692+0000 7fbc3f400740 1 -- 172.21.15.1:0/362630505 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbc14010230 con 0x55d63e94d1b0 2024-09-21T01:00:54.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.693+0000 7fbc3f400740 1 -- 172.21.15.1:0/362630505 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1400ed00 con 0x55d63e9349f0 2024-09-21T01:00:54.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.694+0000 7fbc3259c640 1 --2- 172.21.15.1:0/362630505 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d63e9349f0 0x55d63ed2a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:54.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.695+0000 7fbc32d9d640 1 -- 172.21.15.1:0/362630505 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d63e9349f0 msgr2=0x55d63ed2a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:54.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.695+0000 7fbc32d9d640 1 --2- 172.21.15.1:0/362630505 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d63e9349f0 0x55d63ed2a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:54.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.695+0000 7fbc32d9d640 1 -- 172.21.15.1:0/362630505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d63e94d1b0 msgr2=0x55d63ed25bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:54.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.695+0000 7fbc32d9d640 1 --2- 172.21.15.1:0/362630505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d63e94d1b0 0x55d63ed25bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:54.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.695+0000 7fbc32d9d640 1 -- 172.21.15.1:0/362630505 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d63ed29aa0 con 0x55d63e955390 2024-09-21T01:00:54.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.695+0000 7fbc32d9d640 1 --2- 172.21.15.1:0/362630505 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d63e955390 0x55d63ed26130 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c00af80 tx=0x7fbc2c009d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41522ac96da682b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:54.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.697+0000 7fbc1bfff640 1 -- 172.21.15.1:0/362630505 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c02c070 con 0x55d63e955390 2024-09-21T01:00:54.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.697+0000 7fbc1bfff640 1 -- 172.21.15.1:0/362630505 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc2c01a050 con 0x55d63e955390 2024-09-21T01:00:54.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.697+0000 7fbc1bfff640 1 -- 172.21.15.1:0/362630505 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c0277b0 con 0x55d63e955390 2024-09-21T01:00:54.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.699+0000 7fbc3f400740 1 -- 172.21.15.1:0/362630505 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d63e955390 msgr2=0x55d63ed26130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:54.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.699+0000 7fbc3f400740 1 --2- 172.21.15.1:0/362630505 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d63e955390 0x55d63ed26130 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c00af80 tx=0x7fbc2c009d60 comp rx=0 tx=0).stop 2024-09-21T01:00:54.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.704+0000 7fbc3f400740 1 -- 172.21.15.1:0/362630505 shutdown_connections 2024-09-21T01:00:54.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.704+0000 7fbc3f400740 1 --2- 172.21.15.1:0/362630505 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d63e955390 0x55d63ed26130 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:54.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.704+0000 7fbc3f400740 1 --2- 172.21.15.1:0/362630505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d63e94d1b0 0x55d63ed25bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:54.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.704+0000 7fbc3f400740 1 --2- 172.21.15.1:0/362630505 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d63e9349f0 0x55d63ed2a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:54.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.704+0000 7fbc3f400740 1 -- 172.21.15.1:0/362630505 >> 172.21.15.1:0/362630505 conn(0x55d63e96a460 msgr2=0x55d63ed209e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:54.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.711+0000 7fbc3f400740 1 -- 172.21.15.1:0/362630505 shutdown_connections 2024-09-21T01:00:54.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.711+0000 7fbc3f400740 1 -- 172.21.15.1:0/362630505 wait complete. 2024-09-21T01:00:54.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.712+0000 7fbc3f400740 1 -- start start 2024-09-21T01:00:54.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.712+0000 7fbc3f400740 1 Processor -- start 2024-09-21T01:00:54.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.713+0000 7fbc3f400740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d63e9349f0 0x55d63ed2f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:54.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.714+0000 7fbc3259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d63e9349f0 0x55d63ed2f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:54.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.714+0000 7fbc3259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d63e9349f0 0x55d63ed2f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:40130/0 (socket says 172.21.15.1:40130) 2024-09-21T01:00:54.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.714+0000 7fbc3259c640 1 -- 172.21.15.1:0/2173724593 learned_addr learned my addr 172.21.15.1:0/2173724593 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:00:54.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.715+0000 7fbc3f400740 1 --2- 172.21.15.1:0/2173724593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d63e94d1b0 0x55d63ed2f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:54.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.715+0000 7fbc31d9b640 1 --2- 172.21.15.1:0/2173724593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d63e94d1b0 0x55d63ed2f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:54.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.715+0000 7fbc3f400740 1 --2- 172.21.15.1:0/2173724593 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d63e955390 0x55d63eda4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:54.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.716+0000 7fbc32d9d640 1 --2- 172.21.15.1:0/2173724593 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d63e955390 0x55d63eda4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:54.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.717+0000 7fbc3f400740 1 -- 172.21.15.1:0/2173724593 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1400fb60 con 0x55d63e955390 2024-09-21T01:00:54.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.717+0000 7fbc3f400740 1 -- 172.21.15.1:0/2173724593 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1400f490 con 0x55d63e9349f0 2024-09-21T01:00:54.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.717+0000 7fbc3f400740 1 -- 172.21.15.1:0/2173724593 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1400c610 con 0x55d63e94d1b0 2024-09-21T01:00:54.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.717+0000 7fbc3259c640 1 -- 172.21.15.1:0/2173724593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d63e94d1b0 msgr2=0x55d63ed2f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:54.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.717+0000 7fbc3259c640 1 --2- 172.21.15.1:0/2173724593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d63e94d1b0 0x55d63ed2f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:54.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.717+0000 7fbc3259c640 1 -- 172.21.15.1:0/2173724593 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d63e955390 msgr2=0x55d63eda4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:54.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.717+0000 7fbc3259c640 1 --2- 172.21.15.1:0/2173724593 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d63e955390 0x55d63eda4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:54.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.717+0000 7fbc3259c640 1 -- 172.21.15.1:0/2173724593 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d63eda4950 con 0x55d63e9349f0 2024-09-21T01:00:54.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.723+0000 7fbc3259c640 1 --2- 172.21.15.1:0/2173724593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d63e9349f0 0x55d63ed2f0b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x55d63ed1bc30 tx=0x7fbc280046e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f9bb2082f1ce691 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:54.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.724+0000 7fbc3f400740 10 client.0 _ll_register_callbacks cb 0x7fbc2c009e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:54.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.724+0000 7fbc3f400740 1 -- 172.21.15.1:0/2173724593 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc2c01a050 con 0x55d63e9349f0 2024-09-21T01:00:54.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.726+0000 7fbc19ffb640 10 client.26249 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:00:54.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.726+0000 7fbc19ffb640 1 -- 172.21.15.1:0/2173724593 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2800ed20 con 0x55d63e9349f0 2024-09-21T01:00:54.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.726+0000 7fbc19ffb640 1 -- 172.21.15.1:0/2173724593 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fbc2800f040 con 0x55d63e9349f0 2024-09-21T01:00:54.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.726+0000 7fbc19ffb640 1 -- 172.21.15.1:0/2173724593 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fbc28030470 con 0x55d63e9349f0 2024-09-21T01:00:54.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:54 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:54.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.727+0000 7fbc3f400740 10 client.26249 fetch_fsmap learned FSMap version 33 2024-09-21T01:00:54.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.727+0000 7fbc3f400740 1 -- 172.21.15.1:0/2173724593 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({fsmap=33}) -- 0x55d63eda5a00 con 0x55d63e9349f0 2024-09-21T01:00:54.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.730+0000 7fbc19ffb640 1 -- 172.21.15.1:0/2173724593 <== mon.2 v2:172.21.15.42:3300/0 4 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fbc28030610 con 0x55d63e9349f0 2024-09-21T01:00:54.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.732+0000 7fbc3f400740 10 client.26249 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:00:54.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.732+0000 7fbc3f400740 10 client.26249 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:00:54.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.732+0000 7fbc3f400740 20 client.26249 populate_metadata read hostname 'smithi001' 2024-09-21T01:00:54.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.732+0000 7fbc3f400740 1 --2- 172.21.15.1:0/2173724593 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d63e976070 0x55d63eda8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:54.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.732+0000 7fbc3f400740 4 client.26249 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:00:54.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.732+0000 7fbc3f400740 1 -- 172.21.15.1:0/2173724593 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fbc2c01a050 con 0x55d63e976070 2024-09-21T01:00:54.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.733+0000 7fbc31d9b640 1 --2- 172.21.15.1:0/2173724593 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d63e976070 0x55d63eda8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:54.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.734+0000 7fbc31d9b640 1 --2- 172.21.15.1:0/2173724593 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d63e976070 0x55d63eda8100 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4cdf057c5879a27 server_cookie=e03f5ca73ebdf56e in_seq=0 out_seq=0 2024-09-21T01:00:54.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.734+0000 7fbc19ffb640 10 client.26249 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:54.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.739+0000 7fbc19ffb640 1 -- 172.21.15.1:0/2173724593 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2274 (crc 0 0 0) 0x7fbc2c01a050 con 0x55d63e976070 2024-09-21T01:00:54.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.739+0000 7fbc19ffb640 10 client.26249 handle_command_reply: tid=0 2024-09-21T01:00:54.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:54 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:54.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.740+0000 7fbc3f400740 1 client.26249 shutdown 2024-09-21T01:00:54.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.752+0000 7fbc3f400740 1 -- 172.21.15.1:0/2173724593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d63e9349f0 msgr2=0x55d63ed2f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:54.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.752+0000 7fbc3f400740 1 --2- 172.21.15.1:0/2173724593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d63e9349f0 0x55d63ed2f0b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x55d63ed1bc30 tx=0x7fbc280046e0 comp rx=0 tx=0).stop 2024-09-21T01:00:54.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.756+0000 7fbc3f400740 1 -- 172.21.15.1:0/2173724593 shutdown_connections 2024-09-21T01:00:54.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.756+0000 7fbc3f400740 1 --2- 172.21.15.1:0/2173724593 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55d63e976070 0x55d63eda8100 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:54.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.756+0000 7fbc3f400740 1 --2- 172.21.15.1:0/2173724593 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d63e955390 0x55d63eda4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:54.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.756+0000 7fbc3f400740 1 --2- 172.21.15.1:0/2173724593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d63e94d1b0 0x55d63ed2f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:54.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.756+0000 7fbc3f400740 1 --2- 172.21.15.1:0/2173724593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d63e9349f0 0x55d63ed2f0b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:54.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.756+0000 7fbc3f400740 1 -- 172.21.15.1:0/2173724593 >> 172.21.15.1:0/2173724593 conn(0x55d63e96a460 msgr2=0x55d63ed209e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:54.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.756+0000 7fbc19ffb640 0 client.26249 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:00:54.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.756+0000 7fbc3f400740 1 -- 172.21.15.1:0/2173724593 shutdown_connections 2024-09-21T01:00:54.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.756+0000 7fbc3f400740 1 -- 172.21.15.1:0/2173724593 wait complete. 2024-09-21T01:00:54.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.758+0000 7fbc3f400740 20 client.26249 trim_cache size 0 max 16384 2024-09-21T01:00:54.762 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T01:00:54.762 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T01:00:54.762 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": { 2024-09-21T01:00:54.762 INFO:teuthology.orchestra.run.smithi001.stdout: "c2addc95-c922-4a70-b746-0b5fd2af59bf": { 2024-09-21T01:00:54.762 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:00:54.762 INFO:teuthology.orchestra.run.smithi001.stdout: "tag": "c2addc95-c922-4a70-b746-0b5fd2af59bf", 2024-09-21T01:00:54.762 INFO:teuthology.orchestra.run.smithi001.stdout: "options": "recursive,force" 2024-09-21T01:00:54.762 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:00:54.763 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:00:54.763 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_stats": { 2024-09-21T01:00:54.763 INFO:teuthology.orchestra.run.smithi001.stdout: "c2addc95-c922-4a70-b746-0b5fd2af59bf": { 2024-09-21T01:00:54.763 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:00:52.374848+0000", 2024-09-21T01:00:54.763 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:00:54.763 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:00:54.763 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:00:54.763 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:00:54.763 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:00:54.763 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:00:54.763 INFO:teuthology.orchestra.run.smithi001.stdout: "f826f2c1-768a-47bb-b868-785b351ac6b4": { 2024-09-21T01:00:54.763 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:59:06.554657+0000", 2024-09-21T01:00:54.763 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:00:54.763 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:00:54.764 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:00:54.764 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:00:54.764 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:00:54.764 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:00:54.764 INFO:teuthology.orchestra.run.smithi001.stdout: "1bffed0d-34b1-4e8b-9cab-7501131ef79d": { 2024-09-21T01:00:54.764 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:00:02.564228+0000", 2024-09-21T01:00:54.764 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:00:54.764 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:00:54.764 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:00:54.764 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:00:54.764 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:00:54.764 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:00:54.764 INFO:teuthology.orchestra.run.smithi001.stdout: "bee49cce-b407-4617-a959-331ffd8dc5b0": { 2024-09-21T01:00:54.764 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:58:17.883027+0000", 2024-09-21T01:00:54.764 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:00:54.765 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:00:54.765 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:00:54.765 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:00:54.765 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:00:54.765 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:00:54.765 INFO:teuthology.orchestra.run.smithi001.stdout: "7cb1bc3f-e2d2-4bf7-b13e-8f3371d7aac1": { 2024-09-21T01:00:54.765 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:58:02.751142+0000", 2024-09-21T01:00:54.765 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:00:54.765 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:00:54.765 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:00:54.765 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:00:54.765 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:00:54.765 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:00:54.765 INFO:teuthology.orchestra.run.smithi001.stdout: "2383a19c-993d-4440-99f7-93b43dcf33b4": { 2024-09-21T01:00:54.766 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:47.609257+0000", 2024-09-21T01:00:54.766 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:00:54.766 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:00:54.766 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:00:54.766 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:00:54.766 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:00:54.766 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:00:54.766 INFO:teuthology.orchestra.run.smithi001.stdout: "53fa74e4-5aa8-408b-9724-7c93618f7636": { 2024-09-21T01:00:54.766 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:01.730608+0000", 2024-09-21T01:00:54.766 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:00:54.766 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:00:54.766 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:00:54.766 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:00:54.766 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:00:54.766 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:00:54.767 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:00:54.767 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T01:00:54.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.761+0000 7fbc38e8c640 1 -- 172.21.15.1:0/2870334416 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fbc1c0b6720 msgr2=0x7fbc1c0b8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:54.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.761+0000 7fbc38e8c640 1 --2- 172.21.15.1:0/2870334416 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fbc1c0b6720 0x7fbc1c0b8c30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbc28006fd0 tx=0x7fbc280090e0 comp rx=0 tx=0).stop 2024-09-21T01:00:54.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.761+0000 7fbc38e8c640 1 -- 172.21.15.1:0/2870334416 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc34111f40 msgr2=0x7fbc341a9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:54.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.761+0000 7fbc38e8c640 1 --2- 172.21.15.1:0/2870334416 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc34111f40 0x7fbc341a9930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbc2402aa30 tx=0x7fbc24030940 comp rx=0 tx=0).stop 2024-09-21T01:00:54.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.761+0000 7fbc38e8c640 1 -- 172.21.15.1:0/2870334416 shutdown_connections 2024-09-21T01:00:54.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.761+0000 7fbc38e8c640 1 --2- 172.21.15.1:0/2870334416 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fbc1c0b6720 0x7fbc1c0b8c30 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:54.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.761+0000 7fbc38e8c640 1 --2- 172.21.15.1:0/2870334416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc3411cc30 0x7fbc341aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:54.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.761+0000 7fbc38e8c640 1 --2- 172.21.15.1:0/2870334416 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc34111f40 0x7fbc341a9930 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:54.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.761+0000 7fbc38e8c640 1 --2- 172.21.15.1:0/2870334416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc3410a9e0 0x7fbc341a9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:54.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.761+0000 7fbc38e8c640 1 -- 172.21.15.1:0/2870334416 >> 172.21.15.1:0/2870334416 conn(0x7fbc34070ec0 msgr2=0x7fbc3411d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:54.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.761+0000 7fbc38e8c640 1 -- 172.21.15.1:0/2870334416 shutdown_connections 2024-09-21T01:00:54.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:00:54.761+0000 7fbc38e8c640 1 -- 172.21.15.1:0/2870334416 wait complete. 2024-09-21T01:00:55.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:55 smithi001 ceph-mon[31211]: pgmap v469: 97 pgs: 97 active+clean; 492 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.0 MiB/s wr, 595 op/s 2024-09-21T01:00:55.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:55 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:00:55.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:55 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:00:55.639 INFO:tasks.cephfs.filesystem:scrub status for tag:c2addc95-c922-4a70-b746-0b5fd2af59bf - {'path': '/', 'tag': 'c2addc95-c922-4a70-b746-0b5fd2af59bf', 'options': 'recursive,force'} 2024-09-21T01:00:55.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:55 smithi193 ceph-mon[34660]: pgmap v469: 97 pgs: 97 active+clean; 492 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.0 MiB/s wr, 595 op/s 2024-09-21T01:00:55.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:55 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:00:55.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:55 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:00:55.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:55 smithi042 ceph-mon[34481]: pgmap v469: 97 pgs: 97 active+clean; 492 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.0 MiB/s wr, 595 op/s 2024-09-21T01:00:55.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:55 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:00:55.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:55 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:00:56.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:56 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:00:56.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:56 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:00:56.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:56 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:56.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:56 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:56.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:56 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:00:56.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:56 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:00:56.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:56 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:56.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:56 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:56.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:56 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:56.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:56 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:00:56.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:56 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:00:56.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:56 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:56.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:56 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:56.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:56 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:00:56.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:56 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:00:56.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:56 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:56.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:56 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:56.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:56 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:56.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:56 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:00:56.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:56 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:00:56.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:56 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:56.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:56 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:56.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:56 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:00:56.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:56 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:00:56.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:56 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:56.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:56 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:56.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:56 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:57.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:57 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:57.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:57 smithi001 ceph-mon[31211]: pgmap v470: 97 pgs: 97 active+clean; 498 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 6.6 MiB/s wr, 672 op/s 2024-09-21T01:00:57.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:57 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:57.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:57 smithi193 ceph-mon[34660]: pgmap v470: 97 pgs: 97 active+clean; 498 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 6.6 MiB/s wr, 672 op/s 2024-09-21T01:00:57.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:57 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:57.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:57 smithi042 ceph-mon[34481]: pgmap v470: 97 pgs: 97 active+clean; 498 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 6.6 MiB/s wr, 672 op/s 2024-09-21T01:00:59.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:00:59 smithi001 ceph-mon[31211]: pgmap v471: 97 pgs: 97 active+clean; 501 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 6.5 MiB/s wr, 728 op/s 2024-09-21T01:00:59.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:00:59 smithi193 ceph-mon[34660]: pgmap v471: 97 pgs: 97 active+clean; 501 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 6.5 MiB/s wr, 728 op/s 2024-09-21T01:00:59.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:00:59 smithi042 ceph-mon[34481]: pgmap v471: 97 pgs: 97 active+clean; 501 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 6.5 MiB/s wr, 728 op/s 2024-09-21T01:01:01.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:01 smithi193 ceph-mon[34660]: pgmap v472: 97 pgs: 97 active+clean; 504 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.5 MiB/s wr, 788 op/s 2024-09-21T01:01:01.687 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:01 smithi042 ceph-mon[34481]: pgmap v472: 97 pgs: 97 active+clean; 504 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.5 MiB/s wr, 788 op/s 2024-09-21T01:01:01.709 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:01 smithi001 ceph-mon[31211]: pgmap v472: 97 pgs: 97 active+clean; 504 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.5 MiB/s wr, 788 op/s 2024-09-21T01:01:02.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.990+0000 7fe0b7ab4640 1 -- 172.21.15.1:0/3481755413 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0b0103640 msgr2=0x7fe0b0103a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:02.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.990+0000 7fe0b7ab4640 1 --2- 172.21.15.1:0/3481755413 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0b0103640 0x7fe0b0103a50 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4009900 tx=0x7fe0a402a410 comp rx=0 tx=0).stop 2024-09-21T01:01:02.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.990+0000 7fe0b7ab4640 1 -- 172.21.15.1:0/3481755413 shutdown_connections 2024-09-21T01:01:02.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.990+0000 7fe0b7ab4640 1 --2- 172.21.15.1:0/3481755413 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0b0103fe0 0x7fe0b010a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:02.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.990+0000 7fe0b7ab4640 1 --2- 172.21.15.1:0/3481755413 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0b0103640 0x7fe0b0103a50 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:02.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.990+0000 7fe0b7ab4640 1 --2- 172.21.15.1:0/3481755413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0b01025c0 0x7fe0b0102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:02.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.990+0000 7fe0b7ab4640 1 -- 172.21.15.1:0/3481755413 >> 172.21.15.1:0/3481755413 conn(0x7fe0b00fdf00 msgr2=0x7fe0b01003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:02.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.990+0000 7fe0b7ab4640 1 -- 172.21.15.1:0/3481755413 shutdown_connections 2024-09-21T01:01:02.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.990+0000 7fe0b7ab4640 1 -- 172.21.15.1:0/3481755413 wait complete. 2024-09-21T01:01:02.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.991+0000 7fe0b7ab4640 1 Processor -- start 2024-09-21T01:01:02.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.991+0000 7fe0b7ab4640 1 -- start start 2024-09-21T01:01:02.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.991+0000 7fe0b7ab4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0b01025c0 0x7fe0b01061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:02.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.991+0000 7fe0b7ab4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0b0103640 0x7fe0b0104a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:02.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.991+0000 7fe0b7ab4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0b0103fe0 0x7fe0b0104fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:02.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.991+0000 7fe0b7ab4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b010e210 con 0x7fe0b0103640 2024-09-21T01:01:02.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.991+0000 7fe0b7ab4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b010e090 con 0x7fe0b01025c0 2024-09-21T01:01:02.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.991+0000 7fe0b7ab4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b010e390 con 0x7fe0b0103fe0 2024-09-21T01:01:02.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.991+0000 7fe0b504f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0b0103640 0x7fe0b0104a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:02.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.991+0000 7fe0b5850640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0b01025c0 0x7fe0b01061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:02.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.991+0000 7fe0b504f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0b0103640 0x7fe0b0104a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47724/0 (socket says 172.21.15.1:47724) 2024-09-21T01:01:02.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.991+0000 7fe0b504f640 1 -- 172.21.15.1:0/1287037213 learned_addr learned my addr 172.21.15.1:0/1287037213 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:02.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.991+0000 7fe0b6051640 1 --2- 172.21.15.1:0/1287037213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0b0103fe0 0x7fe0b0104fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:02.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.992+0000 7fe0b504f640 1 -- 172.21.15.1:0/1287037213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0b0103fe0 msgr2=0x7fe0b0104fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:02.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.992+0000 7fe0b504f640 1 --2- 172.21.15.1:0/1287037213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0b0103fe0 0x7fe0b0104fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:02.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.992+0000 7fe0b504f640 1 -- 172.21.15.1:0/1287037213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0b01025c0 msgr2=0x7fe0b01061b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:02.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.992+0000 7fe0b504f640 1 --2- 172.21.15.1:0/1287037213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0b01025c0 0x7fe0b01061b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:02.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.992+0000 7fe0b504f640 1 -- 172.21.15.1:0/1287037213 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0b01056e0 con 0x7fe0b0103640 2024-09-21T01:01:02.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.992+0000 7fe0b5850640 1 --2- 172.21.15.1:0/1287037213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0b01025c0 0x7fe0b01061b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:01:02.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.992+0000 7fe0b6051640 1 --2- 172.21.15.1:0/1287037213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0b0103fe0 0x7fe0b0104fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:01:02.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.992+0000 7fe0b504f640 1 --2- 172.21.15.1:0/1287037213 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0b0103640 0x7fe0b0104a70 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4006010 tx=0x7fe0a40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:02.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.992+0000 7fe0aeffd640 1 -- 172.21.15.1:0/1287037213 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a403f030 con 0x7fe0b0103640 2024-09-21T01:01:02.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.992+0000 7fe0aeffd640 1 -- 172.21.15.1:0/1287037213 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0a4032e50 con 0x7fe0b0103640 2024-09-21T01:01:02.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.992+0000 7fe0b7ab4640 1 -- 172.21.15.1:0/1287037213 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0b01a4000 con 0x7fe0b0103640 2024-09-21T01:01:02.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.992+0000 7fe0aeffd640 1 -- 172.21.15.1:0/1287037213 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a4035070 con 0x7fe0b0103640 2024-09-21T01:01:02.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.992+0000 7fe0b7ab4640 1 -- 172.21.15.1:0/1287037213 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0b01a4400 con 0x7fe0b0103640 2024-09-21T01:01:02.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.996+0000 7fe0bea26740 1 Processor -- start 2024-09-21T01:01:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.996+0000 7fe0bea26740 1 -- start start 2024-09-21T01:01:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.996+0000 7fe0bea26740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d9687c1b0 0x556d96c23e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.996+0000 7fe0bea26740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d968532f0 0x556d96c244c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.996+0000 7fe0bea26740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d9685b4d0 0x556d96c25010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.996+0000 7fe0bea26740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556d96b966f0 con 0x556d9687c1b0 2024-09-21T01:01:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.996+0000 7fe0bea26740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556d96b85b20 con 0x556d9685b4d0 2024-09-21T01:01:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.996+0000 7fe0bea26740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556d96b89930 con 0x556d968532f0 2024-09-21T01:01:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.996+0000 7fe0b6051640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d9687c1b0 0x556d96c23e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.996+0000 7fe0b6051640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d9687c1b0 0x556d96c23e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47728/0 (socket says 172.21.15.1:47728) 2024-09-21T01:01:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.997+0000 7fe0b6051640 1 -- 172.21.15.1:0/1916118289 learned_addr learned my addr 172.21.15.1:0/1916118289 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.997+0000 7fe0b5850640 1 --2- 172.21.15.1:0/1916118289 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d968532f0 0x556d96c244c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.997+0000 7fe0b6051640 1 -- 172.21.15.1:0/1916118289 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d968532f0 msgr2=0x556d96c244c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.997+0000 7fe0b6051640 1 --2- 172.21.15.1:0/1916118289 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d968532f0 0x556d96c244c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.997+0000 7fe0aeffd640 1 -- 172.21.15.1:0/1287037213 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7fe0a4042030 con 0x7fe0b0103640 2024-09-21T01:01:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.997+0000 7fe0b6051640 1 -- 172.21.15.1:0/1916118289 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d9685b4d0 msgr2=0x556d96c25010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:01:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.997+0000 7fe0b6051640 1 --2- 172.21.15.1:0/1916118289 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d9685b4d0 0x556d96c25010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.997+0000 7fe0b6051640 1 -- 172.21.15.1:0/1916118289 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d96b4b530 con 0x556d9687c1b0 2024-09-21T01:01:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.997+0000 7fe0b6051640 1 --2- 172.21.15.1:0/1916118289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d9687c1b0 0x556d96c23e50 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8011540 tx=0x7fe0a8011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1555d610175a6829 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.997+0000 7fe097fff640 1 -- 172.21.15.1:0/1916118289 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a800f5c0 con 0x556d9687c1b0 2024-09-21T01:01:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.997+0000 7fe097fff640 1 -- 172.21.15.1:0/1916118289 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0a800fc10 con 0x556d9687c1b0 2024-09-21T01:01:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.997+0000 7fe097fff640 1 -- 172.21.15.1:0/1916118289 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a8019c30 con 0x556d9687c1b0 2024-09-21T01:01:03.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.998+0000 7fe0aeffd640 1 --2- 172.21.15.1:0/1287037213 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe0980b6510 0x7fe0980b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:03.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.998+0000 7fe0b5850640 1 --2- 172.21.15.1:0/1287037213 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe0980b6510 0x7fe0980b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:03.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.998+0000 7fe0aeffd640 1 -- 172.21.15.1:0/1287037213 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fe0a4107880 con 0x7fe0b0103640 2024-09-21T01:01:03.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.998+0000 7fe0bea26740 1 -- 172.21.15.1:0/1916118289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d9687c1b0 msgr2=0x556d96c23e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:03.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.998+0000 7fe0bea26740 1 --2- 172.21.15.1:0/1916118289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d9687c1b0 0x556d96c23e50 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8011540 tx=0x7fe0a8011a00 comp rx=0 tx=0).stop 2024-09-21T01:01:03.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.998+0000 7fe0bea26740 1 -- 172.21.15.1:0/1916118289 shutdown_connections 2024-09-21T01:01:03.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.998+0000 7fe0bea26740 1 --2- 172.21.15.1:0/1916118289 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d9685b4d0 0x556d96c25010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:03.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.998+0000 7fe0bea26740 1 --2- 172.21.15.1:0/1916118289 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d968532f0 0x556d96c244c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:03.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.998+0000 7fe0bea26740 1 --2- 172.21.15.1:0/1916118289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d9687c1b0 0x556d96c23e50 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:03.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.998+0000 7fe0bea26740 1 -- 172.21.15.1:0/1916118289 >> 172.21.15.1:0/1916118289 conn(0x556d96870300 msgr2=0x556d96c1f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:03.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.998+0000 7fe0b5850640 1 --2- 172.21.15.1:0/1287037213 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe0980b6510 0x7fe0980b8a20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0009fd0 tx=0x7fe0a0009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:03.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.998+0000 7fe0bea26740 1 -- 172.21.15.1:0/1916118289 shutdown_connections 2024-09-21T01:01:03.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.998+0000 7fe0bea26740 1 -- 172.21.15.1:0/1916118289 wait complete. 2024-09-21T01:01:03.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.999+0000 7fe0bea26740 1 -- start start 2024-09-21T01:01:03.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.999+0000 7fe0bea26740 1 Processor -- start 2024-09-21T01:01:03.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.999+0000 7fe0bea26740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d968532f0 0x556d96c2d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:03.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.999+0000 7fe0bea26740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d9685b4d0 0x556d96c2dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:03.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.999+0000 7fe0bea26740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d9687c1b0 0x556d96c2e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:03.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.999+0000 7fe0bea26740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556d96abdab0 con 0x556d9687c1b0 2024-09-21T01:01:03.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.999+0000 7fe0bea26740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556d96b2b730 con 0x556d968532f0 2024-09-21T01:01:03.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.999+0000 7fe0bea26740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556d96c25b30 con 0x556d9685b4d0 2024-09-21T01:01:03.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:02.999+0000 7fe0bea26740 10 client.0 _ll_register_callbacks cb 0x556d96b7f6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:01:03.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.000+0000 7fe0b6051640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d9687c1b0 0x556d96c2e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:03.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.000+0000 7fe0b5850640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d968532f0 0x556d96c2d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:03.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.000+0000 7fe0b6051640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d9687c1b0 0x556d96c2e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47734/0 (socket says 172.21.15.1:47734) 2024-09-21T01:01:03.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.000+0000 7fe0b6051640 1 -- 172.21.15.1:0/1179372148 learned_addr learned my addr 172.21.15.1:0/1179372148 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:03.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.000+0000 7fe0b504f640 1 --2- 172.21.15.1:0/1179372148 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d9685b4d0 0x556d96c2dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:03.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.000+0000 7fe0b6051640 1 -- 172.21.15.1:0/1179372148 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d9685b4d0 msgr2=0x556d96c2dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:03.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.000+0000 7fe0b6051640 1 --2- 172.21.15.1:0/1179372148 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d9685b4d0 0x556d96c2dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:03.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.000+0000 7fe0b6051640 1 -- 172.21.15.1:0/1179372148 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d968532f0 msgr2=0x556d96c2d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:03.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.000+0000 7fe0b6051640 1 --2- 172.21.15.1:0/1179372148 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d968532f0 0x556d96c2d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:03.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.000+0000 7fe0b6051640 1 -- 172.21.15.1:0/1179372148 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d968e7790 con 0x556d9687c1b0 2024-09-21T01:01:03.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.000+0000 7fe0b6051640 1 --2- 172.21.15.1:0/1179372148 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d9687c1b0 0x556d96c2e8c0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fe0a80040c0 tx=0x7fe0a80040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a68353275599b6e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:03.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.000+0000 7fe0957fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:01:03.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.000+0000 7fe0957fa640 1 -- 172.21.15.1:0/1179372148 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a8026020 con 0x556d9687c1b0 2024-09-21T01:01:03.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.000+0000 7fe0bea26740 1 -- 172.21.15.1:0/1179372148 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0a800fc10 con 0x556d9687c1b0 2024-09-21T01:01:03.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.000+0000 7fe0957fa640 1 -- 172.21.15.1:0/1179372148 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fe0a800f5c0 con 0x556d9687c1b0 2024-09-21T01:01:03.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.000+0000 7fe0957fa640 1 -- 172.21.15.1:0/1179372148 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fe0a8031050 con 0x556d9687c1b0 2024-09-21T01:01:03.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.001+0000 7fe0bea26740 10 client.16608 fetch_fsmap learned FSMap version 33 2024-09-21T01:01:03.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.001+0000 7fe0bea26740 1 -- 172.21.15.1:0/1179372148 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x556d96960620 con 0x556d9687c1b0 2024-09-21T01:01:03.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.001+0000 7fe0957fa640 1 -- 172.21.15.1:0/1179372148 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0a800fc10 con 0x556d9687c1b0 2024-09-21T01:01:03.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.001+0000 7fe0957fa640 1 -- 172.21.15.1:0/1179372148 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fe0a8003710 con 0x556d9687c1b0 2024-09-21T01:01:03.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.001+0000 7fe0bea26740 10 client.16608 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:01:03.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.001+0000 7fe0bea26740 10 client.16608 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:01:03.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.001+0000 7fe0bea26740 20 client.16608 populate_metadata read hostname 'smithi001' 2024-09-21T01:01:03.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.001+0000 7fe0bea26740 1 --2- 172.21.15.1:0/1179372148 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x556d9683ad80 0x556d96c3ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:03.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.001+0000 7fe0bea26740 4 client.16608 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:01:03.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.001+0000 7fe0bea26740 1 -- 172.21.15.1:0/1179372148 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d96b98640 con 0x556d9683ad80 2024-09-21T01:01:03.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.001+0000 7fe0b5850640 1 --2- 172.21.15.1:0/1179372148 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x556d9683ad80 0x556d96c3ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:03.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.002+0000 7fe0b5850640 1 --2- 172.21.15.1:0/1179372148 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x556d9683ad80 0x556d96c3ac90 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22204b4063dbbdf server_cookie=40ba4320863251e3 in_seq=0 out_seq=0 2024-09-21T01:01:03.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.002+0000 7fe0957fa640 10 client.16608 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:01:03.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.002+0000 7fe0957fa640 1 -- 172.21.15.1:0/1179372148 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556d96b98640 con 0x556d9683ad80 2024-09-21T01:01:03.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.002+0000 7fe0957fa640 10 client.16608 handle_command_reply: tid=0 2024-09-21T01:01:03.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.002+0000 7fe0bea26740 1 client.16608 shutdown 2024-09-21T01:01:03.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.003+0000 7fe0bea26740 1 -- 172.21.15.1:0/1179372148 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d9687c1b0 msgr2=0x556d96c2e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:03.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.003+0000 7fe0bea26740 1 --2- 172.21.15.1:0/1179372148 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d9687c1b0 0x556d96c2e8c0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fe0a80040c0 tx=0x7fe0a80040f0 comp rx=0 tx=0).stop 2024-09-21T01:01:03.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.003+0000 7fe0bea26740 1 -- 172.21.15.1:0/1179372148 shutdown_connections 2024-09-21T01:01:03.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.003+0000 7fe0bea26740 1 --2- 172.21.15.1:0/1179372148 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x556d9683ad80 0x556d96c3ac90 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:03.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.003+0000 7fe0bea26740 1 --2- 172.21.15.1:0/1179372148 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d9687c1b0 0x556d96c2e8c0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:03.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.003+0000 7fe0bea26740 1 --2- 172.21.15.1:0/1179372148 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d9685b4d0 0x556d96c2dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:03.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.003+0000 7fe0957fa640 0 client.16608 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:01:03.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.003+0000 7fe0bea26740 1 --2- 172.21.15.1:0/1179372148 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d968532f0 0x556d96c2d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:03.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.003+0000 7fe0bea26740 1 -- 172.21.15.1:0/1179372148 >> 172.21.15.1:0/1179372148 conn(0x556d96870300 msgr2=0x556d96c1dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:03.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.003+0000 7fe0bea26740 1 -- 172.21.15.1:0/1179372148 shutdown_connections 2024-09-21T01:01:03.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.003+0000 7fe0bea26740 1 -- 172.21.15.1:0/1179372148 wait complete. 2024-09-21T01:01:03.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.003+0000 7fe0bea26740 20 client.16608 trim_cache size 0 max 16384 2024-09-21T01:01:03.019 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.018+0000 7fe0bea26740 1 Processor -- start 2024-09-21T01:01:03.019 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.018+0000 7fe0bea26740 1 -- start start 2024-09-21T01:01:03.019 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.018+0000 7fe0bea26740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d968532f0 0x556d96c2c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:03.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.018+0000 7fe0bea26740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d9685b4d0 0x556d96c1f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:03.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.018+0000 7fe0bea26740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d9687c1b0 0x556d96c357a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:03.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.018+0000 7fe0bea26740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b01ad200 con 0x556d968532f0 2024-09-21T01:01:03.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.018+0000 7fe0bea26740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b01aee00 con 0x556d9685b4d0 2024-09-21T01:01:03.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.018+0000 7fe0bea26740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b01ad8d0 con 0x556d9687c1b0 2024-09-21T01:01:03.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.018+0000 7fe0b5850640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d968532f0 0x556d96c2c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:03.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.018+0000 7fe0b5850640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d968532f0 0x556d96c2c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47750/0 (socket says 172.21.15.1:47750) 2024-09-21T01:01:03.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.018+0000 7fe0b5850640 1 -- 172.21.15.1:0/2312712142 learned_addr learned my addr 172.21.15.1:0/2312712142 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:03.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.018+0000 7fe0b504f640 1 --2- 172.21.15.1:0/2312712142 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d9685b4d0 0x556d96c1f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:03.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.018+0000 7fe0b6051640 1 --2- 172.21.15.1:0/2312712142 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d9687c1b0 0x556d96c357a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:03.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.018+0000 7fe0b5850640 1 -- 172.21.15.1:0/2312712142 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d9687c1b0 msgr2=0x556d96c357a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:03.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.018+0000 7fe0b5850640 1 --2- 172.21.15.1:0/2312712142 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d9687c1b0 0x556d96c357a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:03.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.018+0000 7fe0b5850640 1 -- 172.21.15.1:0/2312712142 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d9685b4d0 msgr2=0x556d96c1f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:03.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.018+0000 7fe0b5850640 1 --2- 172.21.15.1:0/2312712142 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d9685b4d0 0x556d96c1f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:03.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.018+0000 7fe0b5850640 1 -- 172.21.15.1:0/2312712142 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d96c2e080 con 0x556d968532f0 2024-09-21T01:01:03.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.019+0000 7fe0b5850640 1 --2- 172.21.15.1:0/2312712142 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d968532f0 0x556d96c2c050 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x556d96c3b3f0 tx=0x7fe0a0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d47f04786c0cd53 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:03.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.019+0000 7fe0977fe640 1 -- 172.21.15.1:0/2312712142 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0004040 con 0x556d968532f0 2024-09-21T01:01:03.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.019+0000 7fe0977fe640 1 -- 172.21.15.1:0/2312712142 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0a0004690 con 0x556d968532f0 2024-09-21T01:01:03.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.019+0000 7fe0977fe640 1 -- 172.21.15.1:0/2312712142 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a002bda0 con 0x556d968532f0 2024-09-21T01:01:03.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.019+0000 7fe0bea26740 1 -- 172.21.15.1:0/2312712142 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d968532f0 msgr2=0x556d96c2c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:03.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.019+0000 7fe0bea26740 1 --2- 172.21.15.1:0/2312712142 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d968532f0 0x556d96c2c050 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x556d96c3b3f0 tx=0x7fe0a0012000 comp rx=0 tx=0).stop 2024-09-21T01:01:03.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.020+0000 7fe0bea26740 1 -- 172.21.15.1:0/2312712142 shutdown_connections 2024-09-21T01:01:03.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.020+0000 7fe0bea26740 1 --2- 172.21.15.1:0/2312712142 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d9687c1b0 0x556d96c357a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:03.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.020+0000 7fe0bea26740 1 --2- 172.21.15.1:0/2312712142 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d9685b4d0 0x556d96c1f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:03.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.020+0000 7fe0bea26740 1 --2- 172.21.15.1:0/2312712142 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d968532f0 0x556d96c2c050 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:03.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.020+0000 7fe0bea26740 1 -- 172.21.15.1:0/2312712142 >> 172.21.15.1:0/2312712142 conn(0x556d96870300 msgr2=0x556d96c1a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:03.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.020+0000 7fe0bea26740 1 -- 172.21.15.1:0/2312712142 shutdown_connections 2024-09-21T01:01:03.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.020+0000 7fe0bea26740 1 -- 172.21.15.1:0/2312712142 wait complete. 2024-09-21T01:01:03.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.020+0000 7fe0bea26740 1 -- start start 2024-09-21T01:01:03.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.020+0000 7fe0bea26740 1 Processor -- start 2024-09-21T01:01:03.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.020+0000 7fe0bea26740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d968532f0 0x556d96c30900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:03.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.020+0000 7fe0bea26740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d9685b4d0 0x556d96c30fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:03.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.020+0000 7fe0bea26740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d9687c1b0 0x556d96c31b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:03.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.020+0000 7fe0bea26740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b01ae730 con 0x556d968532f0 2024-09-21T01:01:03.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.020+0000 7fe0bea26740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b01ae060 con 0x556d9687c1b0 2024-09-21T01:01:03.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.020+0000 7fe0bea26740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b01ab1e0 con 0x556d9685b4d0 2024-09-21T01:01:03.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.020+0000 7fe0bea26740 10 client.0 _ll_register_callbacks cb 0x7fe0a0009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:01:03.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.021+0000 7fe0b5850640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d968532f0 0x556d96c30900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:03.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.021+0000 7fe0b5850640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d968532f0 0x556d96c30900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47756/0 (socket says 172.21.15.1:47756) 2024-09-21T01:01:03.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.021+0000 7fe0b5850640 1 -- 172.21.15.1:0/2004588962 learned_addr learned my addr 172.21.15.1:0/2004588962 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:03.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.021+0000 7fe0b504f640 1 --2- 172.21.15.1:0/2004588962 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d9685b4d0 0x556d96c30fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:03.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.021+0000 7fe0b6051640 1 --2- 172.21.15.1:0/2004588962 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d9687c1b0 0x556d96c31b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:03.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.021+0000 7fe0b5850640 1 -- 172.21.15.1:0/2004588962 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d9685b4d0 msgr2=0x556d96c30fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:03.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.021+0000 7fe0b5850640 1 --2- 172.21.15.1:0/2004588962 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d9685b4d0 0x556d96c30fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:03.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.021+0000 7fe0b5850640 1 -- 172.21.15.1:0/2004588962 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d9687c1b0 msgr2=0x556d96c31b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:03.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.021+0000 7fe0b5850640 1 --2- 172.21.15.1:0/2004588962 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d9687c1b0 0x556d96c31b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:03.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.021+0000 7fe0b5850640 1 -- 172.21.15.1:0/2004588962 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d96c32290 con 0x556d968532f0 2024-09-21T01:01:03.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.021+0000 7fe0b5850640 1 --2- 172.21.15.1:0/2004588962 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d968532f0 0x556d96c30900 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fe0a00127c0 tx=0x7fe0a00122c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffef7a4986d1100e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:03.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.021+0000 7fe0957fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:01:03.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.021+0000 7fe0957fa640 1 -- 172.21.15.1:0/2004588962 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a002bce0 con 0x556d968532f0 2024-09-21T01:01:03.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.021+0000 7fe0957fa640 1 -- 172.21.15.1:0/2004588962 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fe0a0004a40 con 0x556d968532f0 2024-09-21T01:01:03.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.021+0000 7fe0bea26740 1 -- 172.21.15.1:0/2004588962 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0a0004690 con 0x556d968532f0 2024-09-21T01:01:03.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.021+0000 7fe0957fa640 1 -- 172.21.15.1:0/2004588962 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fe0a002b4f0 con 0x556d968532f0 2024-09-21T01:01:03.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.022+0000 7fe0bea26740 10 client.16614 fetch_fsmap learned FSMap version 33 2024-09-21T01:01:03.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.022+0000 7fe0bea26740 1 -- 172.21.15.1:0/2004588962 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x556d96c355c0 con 0x556d968532f0 2024-09-21T01:01:03.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.022+0000 7fe0957fa640 1 -- 172.21.15.1:0/2004588962 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0a0004690 con 0x556d968532f0 2024-09-21T01:01:03.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.022+0000 7fe0957fa640 1 -- 172.21.15.1:0/2004588962 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fe0a0039070 con 0x556d968532f0 2024-09-21T01:01:03.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.022+0000 7fe0bea26740 10 client.16614 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:01:03.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.022+0000 7fe0bea26740 10 client.16614 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:01:03.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.022+0000 7fe0bea26740 20 client.16614 populate_metadata read hostname 'smithi001' 2024-09-21T01:01:03.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.022+0000 7fe0bea26740 1 --2- 172.21.15.1:0/2004588962 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x556d968101c0 0x556d96ca7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:03.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.022+0000 7fe0bea26740 4 client.16614 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:01:03.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.022+0000 7fe0bea26740 1 -- 172.21.15.1:0/2004588962 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556d96b940f0 con 0x556d968101c0 2024-09-21T01:01:03.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.022+0000 7fe0b504f640 1 --2- 172.21.15.1:0/2004588962 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x556d968101c0 0x556d96ca7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:03.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.023+0000 7fe0b504f640 1 --2- 172.21.15.1:0/2004588962 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x556d968101c0 0x556d96ca7850 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9f11291dc33843f server_cookie=e1902a45f9518218 in_seq=0 out_seq=0 2024-09-21T01:01:03.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.023+0000 7fe0957fa640 10 client.16614 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:01:03.114 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.112+0000 7fe0957fa640 1 -- 172.21.15.1:0/2004588962 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556d96b940f0 con 0x556d968101c0 2024-09-21T01:01:03.114 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.112+0000 7fe0957fa640 10 client.16614 handle_command_reply: tid=0 2024-09-21T01:01:03.114 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.112+0000 7fe0bea26740 1 client.16614 shutdown 2024-09-21T01:01:03.114 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.113+0000 7fe0bea26740 1 -- 172.21.15.1:0/2004588962 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d968532f0 msgr2=0x556d96c30900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:03.114 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.113+0000 7fe0bea26740 1 --2- 172.21.15.1:0/2004588962 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d968532f0 0x556d96c30900 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fe0a00127c0 tx=0x7fe0a00122c0 comp rx=0 tx=0).stop 2024-09-21T01:01:03.114 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.113+0000 7fe0bea26740 1 -- 172.21.15.1:0/2004588962 shutdown_connections 2024-09-21T01:01:03.114 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.113+0000 7fe0bea26740 1 --2- 172.21.15.1:0/2004588962 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x556d968101c0 0x556d96ca7850 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:03.114 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.113+0000 7fe0bea26740 1 --2- 172.21.15.1:0/2004588962 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d9687c1b0 0x556d96c31b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:03.114 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.113+0000 7fe0bea26740 1 --2- 172.21.15.1:0/2004588962 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d9685b4d0 0x556d96c30fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:03.114 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.113+0000 7fe0bea26740 1 --2- 172.21.15.1:0/2004588962 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d968532f0 0x556d96c30900 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:03.114 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.113+0000 7fe0957fa640 0 client.16614 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:01:03.115 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.113+0000 7fe0bea26740 1 -- 172.21.15.1:0/2004588962 >> 172.21.15.1:0/2004588962 conn(0x556d96870300 msgr2=0x556d96c1a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:03.115 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.113+0000 7fe0bea26740 1 -- 172.21.15.1:0/2004588962 shutdown_connections 2024-09-21T01:01:03.115 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.113+0000 7fe0bea26740 1 -- 172.21.15.1:0/2004588962 wait complete. 2024-09-21T01:01:03.115 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.113+0000 7fe0bea26740 20 client.16614 trim_cache size 0 max 16384 2024-09-21T01:01:03.115 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T01:01:03.115 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T01:01:03.115 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T01:01:03.115 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T01:01:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.114+0000 7fe0b7ab4640 1 -- 172.21.15.1:0/1287037213 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe0980b6510 msgr2=0x7fe0980b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.114+0000 7fe0b7ab4640 1 --2- 172.21.15.1:0/1287037213 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe0980b6510 0x7fe0980b8a20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0009fd0 tx=0x7fe0a0009500 comp rx=0 tx=0).stop 2024-09-21T01:01:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.114+0000 7fe0b7ab4640 1 -- 172.21.15.1:0/1287037213 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0b0103640 msgr2=0x7fe0b0104a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.114+0000 7fe0b7ab4640 1 --2- 172.21.15.1:0/1287037213 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0b0103640 0x7fe0b0104a70 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4006010 tx=0x7fe0a40042f0 comp rx=0 tx=0).stop 2024-09-21T01:01:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.114+0000 7fe0b7ab4640 1 -- 172.21.15.1:0/1287037213 shutdown_connections 2024-09-21T01:01:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.114+0000 7fe0b7ab4640 1 --2- 172.21.15.1:0/1287037213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0b0103fe0 0x7fe0b0104fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.114+0000 7fe0b7ab4640 1 --2- 172.21.15.1:0/1287037213 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe0980b6510 0x7fe0980b8a20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.114+0000 7fe0b7ab4640 1 --2- 172.21.15.1:0/1287037213 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0b0103640 0x7fe0b0104a70 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.114+0000 7fe0b7ab4640 1 --2- 172.21.15.1:0/1287037213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0b01025c0 0x7fe0b01061b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.114+0000 7fe0b7ab4640 1 -- 172.21.15.1:0/1287037213 >> 172.21.15.1:0/1287037213 conn(0x7fe0b00fdf00 msgr2=0x7fe0b00ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.114+0000 7fe0b7ab4640 1 -- 172.21.15.1:0/1287037213 shutdown_connections 2024-09-21T01:01:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:03.114+0000 7fe0b7ab4640 1 -- 172.21.15.1:0/1287037213 wait complete. 2024-09-21T01:01:03.560 INFO:tasks.workunit.client.0.smithi001.stdout: 91 339101 7 216427 97 185325 122 2024-09-21T01:01:03.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:03 smithi001 ceph-mon[31211]: pgmap v473: 97 pgs: 97 active+clean; 504 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.7 MiB/s wr, 649 op/s 2024-09-21T01:01:03.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:03 smithi193 ceph-mon[34660]: pgmap v473: 97 pgs: 97 active+clean; 504 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.7 MiB/s wr, 649 op/s 2024-09-21T01:01:03.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:03 smithi042 ceph-mon[34481]: pgmap v473: 97 pgs: 97 active+clean; 504 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.7 MiB/s wr, 649 op/s 2024-09-21T01:01:05.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:05 smithi001 ceph-mon[31211]: pgmap v474: 97 pgs: 97 active+clean; 509 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 538 op/s 2024-09-21T01:01:05.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:05 smithi193 ceph-mon[34660]: pgmap v474: 97 pgs: 97 active+clean; 509 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 538 op/s 2024-09-21T01:01:05.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:05 smithi042 ceph-mon[34481]: pgmap v474: 97 pgs: 97 active+clean; 509 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 538 op/s 2024-09-21T01:01:07.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:07 smithi001 ceph-mon[31211]: pgmap v475: 97 pgs: 97 active+clean; 509 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 465 op/s 2024-09-21T01:01:07.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:07 smithi193 ceph-mon[34660]: pgmap v475: 97 pgs: 97 active+clean; 509 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 465 op/s 2024-09-21T01:01:07.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:07 smithi042 ceph-mon[34481]: pgmap v475: 97 pgs: 97 active+clean; 509 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 465 op/s 2024-09-21T01:01:08.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:08 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:08.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:08 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:08.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:08 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:09.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:09 smithi001 ceph-mon[31211]: pgmap v476: 97 pgs: 97 active+clean; 508 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 412 op/s 2024-09-21T01:01:09.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:09 smithi193 ceph-mon[34660]: pgmap v476: 97 pgs: 97 active+clean; 508 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 412 op/s 2024-09-21T01:01:09.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:09 smithi042 ceph-mon[34481]: pgmap v476: 97 pgs: 97 active+clean; 508 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 412 op/s 2024-09-21T01:01:11.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:11 smithi001 ceph-mon[31211]: pgmap v477: 97 pgs: 97 active+clean; 509 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 320 op/s 2024-09-21T01:01:11.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:11 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:01:11.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:11 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:01:11.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:11 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:01:11.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:11 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T01:01:11.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:11 smithi193 ceph-mon[34660]: pgmap v477: 97 pgs: 97 active+clean; 509 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 320 op/s 2024-09-21T01:01:11.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:11 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:01:11.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:11 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:01:11.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:11 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:01:11.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:11 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T01:01:11.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:11 smithi042 ceph-mon[34481]: pgmap v477: 97 pgs: 97 active+clean; 509 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 320 op/s 2024-09-21T01:01:11.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:01:11.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:01:11.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:01:11.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T01:01:13.560 INFO:tasks.workunit.client.0.smithi001.stdout: 91 5901 0 3202 2 1688 1 2024-09-21T01:01:13.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:13 smithi001 ceph-mon[31211]: pgmap v478: 97 pgs: 97 active+clean; 510 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 1.1 MiB/s wr, 244 op/s 2024-09-21T01:01:13.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:13 smithi193 ceph-mon[34660]: pgmap v478: 97 pgs: 97 active+clean; 510 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 1.1 MiB/s wr, 244 op/s 2024-09-21T01:01:13.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:13 smithi042 ceph-mon[34481]: pgmap v478: 97 pgs: 97 active+clean; 510 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 1.1 MiB/s wr, 244 op/s 2024-09-21T01:01:15.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:15 smithi001 ceph-mon[31211]: pgmap v479: 97 pgs: 97 active+clean; 515 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 333 op/s 2024-09-21T01:01:15.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:15 smithi193 ceph-mon[34660]: pgmap v479: 97 pgs: 97 active+clean; 515 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 333 op/s 2024-09-21T01:01:15.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:15 smithi042 ceph-mon[34481]: pgmap v479: 97 pgs: 97 active+clean; 515 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 333 op/s 2024-09-21T01:01:16.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.214+0000 7f70466b6640 1 -- 172.21.15.1:0/1165417883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7040103fd0 msgr2=0x7f704010a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:16.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.214+0000 7f70466b6640 1 --2- 172.21.15.1:0/1165417883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7040103fd0 0x7f704010a970 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7038009ca0 tx=0x7f703802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.214+0000 7f70466b6640 1 -- 172.21.15.1:0/1165417883 shutdown_connections 2024-09-21T01:01:16.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.214+0000 7f70466b6640 1 --2- 172.21.15.1:0/1165417883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7040103fd0 0x7f704010a970 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.214+0000 7f70466b6640 1 --2- 172.21.15.1:0/1165417883 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7040103630 0x7f7040103a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.214+0000 7f70466b6640 1 --2- 172.21.15.1:0/1165417883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f70401025b0 0x7f7040102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.214+0000 7f70466b6640 1 -- 172.21.15.1:0/1165417883 >> 172.21.15.1:0/1165417883 conn(0x7f70400fdf30 msgr2=0x7f70401003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:16.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.214+0000 7f70466b6640 1 -- 172.21.15.1:0/1165417883 shutdown_connections 2024-09-21T01:01:16.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.214+0000 7f70466b6640 1 -- 172.21.15.1:0/1165417883 wait complete. 2024-09-21T01:01:16.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.215+0000 7f70466b6640 1 Processor -- start 2024-09-21T01:01:16.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.215+0000 7f70466b6640 1 -- start start 2024-09-21T01:01:16.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.215+0000 7f70466b6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f70401025b0 0x7f7040198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:16.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.215+0000 7f70466b6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7040103630 0x7f7040199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:16.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.215+0000 7f70466b6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7040103fd0 0x7f704019a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:16.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.215+0000 7f70466b6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f704010e1f0 con 0x7f7040103fd0 2024-09-21T01:01:16.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.215+0000 7f70466b6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f704010e070 con 0x7f7040103630 2024-09-21T01:01:16.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.215+0000 7f70466b6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f704010e370 con 0x7f70401025b0 2024-09-21T01:01:16.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.215+0000 7f7044c53640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7040103fd0 0x7f704019a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:16.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.215+0000 7f7044c53640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7040103fd0 0x7f704019a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41886/0 (socket says 172.21.15.1:41886) 2024-09-21T01:01:16.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.215+0000 7f7044c53640 1 -- 172.21.15.1:0/425291806 learned_addr learned my addr 172.21.15.1:0/425291806 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:16.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.215+0000 7f703f7fe640 1 --2- 172.21.15.1:0/425291806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7040103630 0x7f7040199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:16.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.215+0000 7f703ffff640 1 --2- 172.21.15.1:0/425291806 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f70401025b0 0x7f7040198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:16.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.216+0000 7f7044c53640 1 -- 172.21.15.1:0/425291806 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f70401025b0 msgr2=0x7f7040198de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:16.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.216+0000 7f7044c53640 1 --2- 172.21.15.1:0/425291806 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f70401025b0 0x7f7040198de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.216+0000 7f7044c53640 1 -- 172.21.15.1:0/425291806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7040103630 msgr2=0x7f7040199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:16.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.216+0000 7f7044c53640 1 --2- 172.21.15.1:0/425291806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7040103630 0x7f7040199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.216+0000 7f7044c53640 1 -- 172.21.15.1:0/425291806 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f704019a820 con 0x7f7040103fd0 2024-09-21T01:01:16.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.216+0000 7f703f7fe640 1 --2- 172.21.15.1:0/425291806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7040103630 0x7f7040199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:01:16.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.216+0000 7f7044c53640 1 --2- 172.21.15.1:0/425291806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7040103fd0 0x7f704019a000 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f7038006010 tx=0x7f7038003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:16.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.216+0000 7f703d7fa640 1 -- 172.21.15.1:0/425291806 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7038004240 con 0x7f7040103fd0 2024-09-21T01:01:16.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.216+0000 7f703d7fa640 1 -- 172.21.15.1:0/425291806 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70380317e0 con 0x7f7040103fd0 2024-09-21T01:01:16.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.216+0000 7f70466b6640 1 -- 172.21.15.1:0/425291806 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f704019aab0 con 0x7f7040103fd0 2024-09-21T01:01:16.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.216+0000 7f703d7fa640 1 -- 172.21.15.1:0/425291806 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f703802fac0 con 0x7f7040103fd0 2024-09-21T01:01:16.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.216+0000 7f70466b6640 1 -- 172.21.15.1:0/425291806 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70401a1200 con 0x7f7040103fd0 2024-09-21T01:01:16.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.219+0000 7f703d7fa640 1 -- 172.21.15.1:0/425291806 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f703802fcc0 con 0x7f7040103fd0 2024-09-21T01:01:16.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.219+0000 7f704d61f740 1 Processor -- start 2024-09-21T01:01:16.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.219+0000 7f704d61f740 1 -- start start 2024-09-21T01:01:16.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.219+0000 7f704d61f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561ea68ef1b0 0x561ea6c99060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:16.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.219+0000 7f704d61f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ea68c62f0 0x561ea6c996d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:16.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.219+0000 7f704d61f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ea68ce4d0 0x561ea6c9a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:16.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.219+0000 7f704d61f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561ea6c096f0 con 0x561ea68c62f0 2024-09-21T01:01:16.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.219+0000 7f704d61f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561ea6bf8b20 con 0x561ea68ef1b0 2024-09-21T01:01:16.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.219+0000 7f704d61f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x561ea6bfc930 con 0x561ea68ce4d0 2024-09-21T01:01:16.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.219+0000 7f703ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ea68c62f0 0x561ea6c996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:16.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.219+0000 7f703f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561ea68ef1b0 0x561ea6c99060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:16.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.219+0000 7f703ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ea68c62f0 0x561ea6c996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41894/0 (socket says 172.21.15.1:41894) 2024-09-21T01:01:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.219+0000 7f703ffff640 1 -- 172.21.15.1:0/3593677994 learned_addr learned my addr 172.21.15.1:0/3593677994 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.219+0000 7f703f7fe640 1 --2- 172.21.15.1:0/3593677994 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ea68ce4d0 0x561ea6c9a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.220+0000 7f703ffff640 1 -- 172.21.15.1:0/3593677994 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ea68ce4d0 msgr2=0x561ea6c9a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.220+0000 7f703ffff640 1 --2- 172.21.15.1:0/3593677994 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ea68ce4d0 0x561ea6c9a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.220+0000 7f703ffff640 1 -- 172.21.15.1:0/3593677994 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561ea68ef1b0 msgr2=0x561ea6c99060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.220+0000 7f703ffff640 1 --2- 172.21.15.1:0/3593677994 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561ea68ef1b0 0x561ea6c99060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.220+0000 7f703ffff640 1 -- 172.21.15.1:0/3593677994 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ea6bbe530 con 0x561ea68c62f0 2024-09-21T01:01:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.220+0000 7f703d7fa640 1 --2- 172.21.15.1:0/425291806 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f70280b6510 0x7f70280b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.220+0000 7f703f7fe640 1 --2- 172.21.15.1:0/425291806 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f70280b6510 0x7f70280b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.220+0000 7f703ffff640 1 --2- 172.21.15.1:0/3593677994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ea68c62f0 0x561ea6c996d0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f7030009cf0 tx=0x7f7030011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b111510a0b7c4db5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.220+0000 7f703d7fa640 1 -- 172.21.15.1:0/425291806 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f70381086a0 con 0x7f7040103fd0 2024-09-21T01:01:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.220+0000 7f70267fc640 1 -- 172.21.15.1:0/3593677994 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f703001e070 con 0x561ea68c62f0 2024-09-21T01:01:16.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.220+0000 7f70267fc640 1 -- 172.21.15.1:0/3593677994 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7030009de0 con 0x561ea68c62f0 2024-09-21T01:01:16.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.220+0000 7f70267fc640 1 -- 172.21.15.1:0/3593677994 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7030019450 con 0x561ea68c62f0 2024-09-21T01:01:16.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.221+0000 7f704d61f740 1 -- 172.21.15.1:0/3593677994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ea68c62f0 msgr2=0x561ea6c996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:16.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.221+0000 7f704d61f740 1 --2- 172.21.15.1:0/3593677994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ea68c62f0 0x561ea6c996d0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f7030009cf0 tx=0x7f7030011810 comp rx=0 tx=0).stop 2024-09-21T01:01:16.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.221+0000 7f703f7fe640 1 --2- 172.21.15.1:0/425291806 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f70280b6510 0x7f70280b8a20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f70340058c0 tx=0x7f7034005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:16.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.221+0000 7f704d61f740 1 -- 172.21.15.1:0/3593677994 shutdown_connections 2024-09-21T01:01:16.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.221+0000 7f704d61f740 1 --2- 172.21.15.1:0/3593677994 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ea68ce4d0 0x561ea6c9a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.221+0000 7f704d61f740 1 --2- 172.21.15.1:0/3593677994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ea68c62f0 0x561ea6c996d0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.221+0000 7f704d61f740 1 --2- 172.21.15.1:0/3593677994 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561ea68ef1b0 0x561ea6c99060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.221+0000 7f704d61f740 1 -- 172.21.15.1:0/3593677994 >> 172.21.15.1:0/3593677994 conn(0x561ea68e3300 msgr2=0x561ea6c94af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:16.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.221+0000 7f704d61f740 1 -- 172.21.15.1:0/3593677994 shutdown_connections 2024-09-21T01:01:16.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.221+0000 7f704d61f740 1 -- 172.21.15.1:0/3593677994 wait complete. 2024-09-21T01:01:16.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.221+0000 7f704d61f740 1 -- start start 2024-09-21T01:01:16.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.222+0000 7f704d61f740 1 Processor -- start 2024-09-21T01:01:16.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.222+0000 7f704d61f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ea68c62f0 0x561ea6ca2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:16.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.222+0000 7f704d61f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ea68ce4d0 0x561ea6ca2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:16.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.222+0000 7f704d61f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561ea68ef1b0 0x561ea6ca39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:16.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.222+0000 7f704d61f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561ea6b30ab0 con 0x561ea68ce4d0 2024-09-21T01:01:16.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.222+0000 7f704d61f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561ea6b9e730 con 0x561ea68ef1b0 2024-09-21T01:01:16.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.222+0000 7f704d61f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x561ea6c9ad40 con 0x561ea68c62f0 2024-09-21T01:01:16.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.222+0000 7f704d61f740 10 client.0 _ll_register_callbacks cb 0x561ea6bf26b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:01:16.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.222+0000 7f703f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ea68ce4d0 0x561ea6ca2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:16.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.222+0000 7f703f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ea68ce4d0 0x561ea6ca2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41910/0 (socket says 172.21.15.1:41910) 2024-09-21T01:01:16.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.222+0000 7f703f7fe640 1 -- 172.21.15.1:0/4172767261 learned_addr learned my addr 172.21.15.1:0/4172767261 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:16.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.222+0000 7f7044c53640 1 --2- 172.21.15.1:0/4172767261 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561ea68ef1b0 0x561ea6ca39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:16.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.222+0000 7f703ffff640 1 --2- 172.21.15.1:0/4172767261 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ea68c62f0 0x561ea6ca2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:16.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.222+0000 7f703f7fe640 1 -- 172.21.15.1:0/4172767261 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ea68c62f0 msgr2=0x561ea6ca2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:16.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.222+0000 7f703f7fe640 1 --2- 172.21.15.1:0/4172767261 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ea68c62f0 0x561ea6ca2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.222+0000 7f703f7fe640 1 -- 172.21.15.1:0/4172767261 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561ea68ef1b0 msgr2=0x561ea6ca39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:16.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.222+0000 7f703f7fe640 1 --2- 172.21.15.1:0/4172767261 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561ea68ef1b0 0x561ea6ca39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.223+0000 7f703f7fe640 1 -- 172.21.15.1:0/4172767261 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ea695a790 con 0x561ea68ce4d0 2024-09-21T01:01:16.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.223+0000 7f7044c53640 1 --2- 172.21.15.1:0/4172767261 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561ea68ef1b0 0x561ea6ca39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:01:16.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.223+0000 7f703f7fe640 1 --2- 172.21.15.1:0/4172767261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ea68ce4d0 0x561ea6ca2e40 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f70340043e0 tx=0x7f7034004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c08b7fe50ad2bf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:16.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.223+0000 7f701f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:01:16.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.223+0000 7f701f7fe640 1 -- 172.21.15.1:0/4172767261 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f703402f060 con 0x561ea68ce4d0 2024-09-21T01:01:16.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.223+0000 7f701f7fe640 1 -- 172.21.15.1:0/4172767261 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f703401a070 con 0x561ea68ce4d0 2024-09-21T01:01:16.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.223+0000 7f704d61f740 1 -- 172.21.15.1:0/4172767261 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7030009de0 con 0x561ea68ce4d0 2024-09-21T01:01:16.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.223+0000 7f701f7fe640 1 -- 172.21.15.1:0/4172767261 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f703401fce0 con 0x561ea68ce4d0 2024-09-21T01:01:16.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.223+0000 7f704d61f740 10 client.16626 fetch_fsmap learned FSMap version 33 2024-09-21T01:01:16.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.223+0000 7f704d61f740 1 -- 172.21.15.1:0/4172767261 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x561ea69d3620 con 0x561ea68ce4d0 2024-09-21T01:01:16.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.223+0000 7f701f7fe640 1 -- 172.21.15.1:0/4172767261 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7030009de0 con 0x561ea68ce4d0 2024-09-21T01:01:16.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.224+0000 7f701f7fe640 1 -- 172.21.15.1:0/4172767261 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f703401d070 con 0x561ea68ce4d0 2024-09-21T01:01:16.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.224+0000 7f704d61f740 10 client.16626 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:01:16.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.224+0000 7f704d61f740 10 client.16626 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:01:16.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.224+0000 7f704d61f740 20 client.16626 populate_metadata read hostname 'smithi001' 2024-09-21T01:01:16.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.224+0000 7f704d61f740 1 --2- 172.21.15.1:0/4172767261 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x561ea68add80 0x561ea6cb00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:16.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.224+0000 7f704d61f740 4 client.16626 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:01:16.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.224+0000 7f704d61f740 1 -- 172.21.15.1:0/4172767261 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561ea6c0b640 con 0x561ea68add80 2024-09-21T01:01:16.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.224+0000 7f703ffff640 1 --2- 172.21.15.1:0/4172767261 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x561ea68add80 0x561ea6cb00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:16.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.224+0000 7f701f7fe640 10 client.16626 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:01:16.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.224+0000 7f703ffff640 1 --2- 172.21.15.1:0/4172767261 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x561ea68add80 0x561ea6cb00a0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9a6841c3fbf3f4d server_cookie=d5ab09fa498f7d92 in_seq=0 out_seq=0 2024-09-21T01:01:16.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.225+0000 7f701f7fe640 1 -- 172.21.15.1:0/4172767261 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561ea6c0b640 con 0x561ea68add80 2024-09-21T01:01:16.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.225+0000 7f701f7fe640 10 client.16626 handle_command_reply: tid=0 2024-09-21T01:01:16.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.225+0000 7f704d61f740 1 client.16626 shutdown 2024-09-21T01:01:16.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.225+0000 7f704d61f740 1 -- 172.21.15.1:0/4172767261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ea68ce4d0 msgr2=0x561ea6ca2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:16.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.225+0000 7f704d61f740 1 --2- 172.21.15.1:0/4172767261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ea68ce4d0 0x561ea6ca2e40 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f70340043e0 tx=0x7f7034004730 comp rx=0 tx=0).stop 2024-09-21T01:01:16.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.225+0000 7f704d61f740 1 -- 172.21.15.1:0/4172767261 shutdown_connections 2024-09-21T01:01:16.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.225+0000 7f704d61f740 1 --2- 172.21.15.1:0/4172767261 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x561ea68add80 0x561ea6cb00a0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.225+0000 7f704d61f740 1 --2- 172.21.15.1:0/4172767261 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561ea68ef1b0 0x561ea6ca39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.225+0000 7f704d61f740 1 --2- 172.21.15.1:0/4172767261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ea68ce4d0 0x561ea6ca2e40 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.225+0000 7f704d61f740 1 --2- 172.21.15.1:0/4172767261 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ea68c62f0 0x561ea6ca2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.225+0000 7f701f7fe640 0 client.16626 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:01:16.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.225+0000 7f704d61f740 1 -- 172.21.15.1:0/4172767261 >> 172.21.15.1:0/4172767261 conn(0x561ea68e3300 msgr2=0x561ea6c9a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:16.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.225+0000 7f704d61f740 1 -- 172.21.15.1:0/4172767261 shutdown_connections 2024-09-21T01:01:16.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.225+0000 7f704d61f740 1 -- 172.21.15.1:0/4172767261 wait complete. 2024-09-21T01:01:16.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.225+0000 7f704d61f740 20 client.16626 trim_cache size 0 max 16384 2024-09-21T01:01:16.241 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.240+0000 7f704d61f740 1 Processor -- start 2024-09-21T01:01:16.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.240+0000 7f704d61f740 1 -- start start 2024-09-21T01:01:16.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.240+0000 7f704d61f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ea68c62f0 0x561ea6c8d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:16.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.240+0000 7f704d61f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ea68ce4d0 0x561ea6c99000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:16.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.240+0000 7f704d61f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561ea68ef1b0 0x561ea6c99540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:16.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.240+0000 7f704d61f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f70401a8d90 con 0x561ea68c62f0 2024-09-21T01:01:16.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.240+0000 7f704d61f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f70401aa990 con 0x561ea68ef1b0 2024-09-21T01:01:16.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.240+0000 7f704d61f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f70401a9460 con 0x561ea68ce4d0 2024-09-21T01:01:16.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.240+0000 7f703ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ea68c62f0 0x561ea6c8d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:16.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.240+0000 7f703ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ea68c62f0 0x561ea6c8d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41926/0 (socket says 172.21.15.1:41926) 2024-09-21T01:01:16.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.240+0000 7f703ffff640 1 -- 172.21.15.1:0/3062258728 learned_addr learned my addr 172.21.15.1:0/3062258728 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:16.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.240+0000 7f7044c53640 1 --2- 172.21.15.1:0/3062258728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561ea68ef1b0 0x561ea6c99540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:16.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.240+0000 7f703f7fe640 1 --2- 172.21.15.1:0/3062258728 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ea68ce4d0 0x561ea6c99000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:16.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.240+0000 7f703ffff640 1 -- 172.21.15.1:0/3062258728 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ea68ce4d0 msgr2=0x561ea6c99000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:16.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.240+0000 7f703ffff640 1 --2- 172.21.15.1:0/3062258728 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ea68ce4d0 0x561ea6c99000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.243 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.240+0000 7f703ffff640 1 -- 172.21.15.1:0/3062258728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561ea68ef1b0 msgr2=0x561ea6c99540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:16.243 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.240+0000 7f703ffff640 1 --2- 172.21.15.1:0/3062258728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561ea68ef1b0 0x561ea6c99540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.243 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.240+0000 7f703ffff640 1 -- 172.21.15.1:0/3062258728 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ea6ca0910 con 0x561ea68c62f0 2024-09-21T01:01:16.243 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.240+0000 7f703f7fe640 1 --2- 172.21.15.1:0/3062258728 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ea68ce4d0 0x561ea6c99000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:01:16.243 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.240+0000 7f703ffff640 1 --2- 172.21.15.1:0/3062258728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ea68c62f0 0x561ea6c8d5c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7030009cf0 tx=0x7f7030003bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a7a9a8664aa528 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:16.243 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.241+0000 7f7025ffb640 1 -- 172.21.15.1:0/3062258728 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7030029030 con 0x561ea68c62f0 2024-09-21T01:01:16.243 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.241+0000 7f7025ffb640 1 -- 172.21.15.1:0/3062258728 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7030003970 con 0x561ea68c62f0 2024-09-21T01:01:16.243 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.241+0000 7f7025ffb640 1 -- 172.21.15.1:0/3062258728 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f703001e040 con 0x561ea68c62f0 2024-09-21T01:01:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.241+0000 7f704d61f740 1 -- 172.21.15.1:0/3062258728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ea68c62f0 msgr2=0x561ea6c8d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.241+0000 7f704d61f740 1 --2- 172.21.15.1:0/3062258728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ea68c62f0 0x561ea6c8d5c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7030009cf0 tx=0x7f7030003bd0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.241+0000 7f704d61f740 1 -- 172.21.15.1:0/3062258728 shutdown_connections 2024-09-21T01:01:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.241+0000 7f704d61f740 1 --2- 172.21.15.1:0/3062258728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561ea68ef1b0 0x561ea6c99540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.241+0000 7f704d61f740 1 --2- 172.21.15.1:0/3062258728 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ea68ce4d0 0x561ea6c99000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.241+0000 7f704d61f740 1 --2- 172.21.15.1:0/3062258728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ea68c62f0 0x561ea6c8d5c0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.241+0000 7f704d61f740 1 -- 172.21.15.1:0/3062258728 >> 172.21.15.1:0/3062258728 conn(0x561ea68e3300 msgr2=0x561ea6c99ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.241+0000 7f704d61f740 1 -- 172.21.15.1:0/3062258728 shutdown_connections 2024-09-21T01:01:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.242+0000 7f704d61f740 1 -- 172.21.15.1:0/3062258728 wait complete. 2024-09-21T01:01:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.242+0000 7f704d61f740 1 -- start start 2024-09-21T01:01:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.242+0000 7f704d61f740 1 Processor -- start 2024-09-21T01:01:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.242+0000 7f704d61f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ea68c62f0 0x561ea6ca53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.242+0000 7f704d61f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561ea68ce4d0 0x561ea6ca5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.242+0000 7f704d61f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ea68ef1b0 0x561ea6ca6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.242+0000 7f704d61f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f70401aa2c0 con 0x561ea68ef1b0 2024-09-21T01:01:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.242+0000 7f704d61f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f70401a9bf0 con 0x561ea68ce4d0 2024-09-21T01:01:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.242+0000 7f704d61f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f70401a6d70 con 0x561ea68c62f0 2024-09-21T01:01:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.242+0000 7f704d61f740 10 client.0 _ll_register_callbacks cb 0x7f70340118b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:01:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.242+0000 7f7044c53640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ea68ef1b0 0x561ea6ca6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.242+0000 7f7044c53640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ea68ef1b0 0x561ea6ca6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41934/0 (socket says 172.21.15.1:41934) 2024-09-21T01:01:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.242+0000 7f7044c53640 1 -- 172.21.15.1:0/3324684050 learned_addr learned my addr 172.21.15.1:0/3324684050 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.242+0000 7f703f7fe640 1 --2- 172.21.15.1:0/3324684050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561ea68ce4d0 0x561ea6ca5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.242+0000 7f703ffff640 1 --2- 172.21.15.1:0/3324684050 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ea68c62f0 0x561ea6ca53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:16.248 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.243+0000 7f7044c53640 1 -- 172.21.15.1:0/3324684050 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ea68c62f0 msgr2=0x561ea6ca53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:16.248 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.243+0000 7f7044c53640 1 --2- 172.21.15.1:0/3324684050 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ea68c62f0 0x561ea6ca53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.248 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.243+0000 7f7044c53640 1 -- 172.21.15.1:0/3324684050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561ea68ce4d0 msgr2=0x561ea6ca5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:16.248 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.243+0000 7f7044c53640 1 --2- 172.21.15.1:0/3324684050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561ea68ce4d0 0x561ea6ca5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.248 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.243+0000 7f7044c53640 1 -- 172.21.15.1:0/3324684050 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ea6ca6d70 con 0x561ea68ef1b0 2024-09-21T01:01:16.248 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.243+0000 7f703f7fe640 1 --2- 172.21.15.1:0/3324684050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561ea68ce4d0 0x561ea6ca5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:01:16.248 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.243+0000 7f7044c53640 1 --2- 172.21.15.1:0/3324684050 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ea68ef1b0 0x561ea6ca6610 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f70380097b0 tx=0x7f70380caee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6ccbaef7ad95004 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:16.248 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.243+0000 7f701f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:01:16.248 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.243+0000 7f701f7fe640 1 -- 172.21.15.1:0/3324684050 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f703802f310 con 0x561ea68ef1b0 2024-09-21T01:01:16.248 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.243+0000 7f701f7fe640 1 -- 172.21.15.1:0/3324684050 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f70380cc760 con 0x561ea68ef1b0 2024-09-21T01:01:16.248 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.243+0000 7f704d61f740 1 -- 172.21.15.1:0/3324684050 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7030003970 con 0x561ea68ef1b0 2024-09-21T01:01:16.248 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.243+0000 7f701f7fe640 1 -- 172.21.15.1:0/3324684050 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f70380e9e60 con 0x561ea68ef1b0 2024-09-21T01:01:16.248 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.243+0000 7f704d61f740 10 client.16632 fetch_fsmap learned FSMap version 33 2024-09-21T01:01:16.248 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.243+0000 7f704d61f740 1 -- 172.21.15.1:0/3324684050 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x561ea6caa0b0 con 0x561ea68ef1b0 2024-09-21T01:01:16.249 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.243+0000 7f701f7fe640 1 -- 172.21.15.1:0/3324684050 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7030003970 con 0x561ea68ef1b0 2024-09-21T01:01:16.249 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.244+0000 7f701f7fe640 1 -- 172.21.15.1:0/3324684050 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f70380f0310 con 0x561ea68ef1b0 2024-09-21T01:01:16.249 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.244+0000 7f704d61f740 10 client.16632 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:01:16.249 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.244+0000 7f704d61f740 10 client.16632 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:01:16.249 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.244+0000 7f704d61f740 20 client.16632 populate_metadata read hostname 'smithi001' 2024-09-21T01:01:16.249 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.244+0000 7f704d61f740 1 --2- 172.21.15.1:0/3324684050 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x561ea68831c0 0x561ea6d1ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:16.249 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.244+0000 7f704d61f740 4 client.16632 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:01:16.249 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.244+0000 7f704d61f740 1 -- 172.21.15.1:0/3324684050 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561ea6c070f0 con 0x561ea68831c0 2024-09-21T01:01:16.249 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.244+0000 7f703ffff640 1 --2- 172.21.15.1:0/3324684050 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x561ea68831c0 0x561ea6d1ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:16.249 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.244+0000 7f701f7fe640 10 client.16632 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:01:16.249 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.244+0000 7f703ffff640 1 --2- 172.21.15.1:0/3324684050 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x561ea68831c0 0x561ea6d1ca70 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b65804d1bff7f21 server_cookie=5fca8621d32f94af in_seq=0 out_seq=0 2024-09-21T01:01:16.266 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.265+0000 7f701f7fe640 1 -- 172.21.15.1:0/3324684050 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561ea6c070f0 con 0x561ea68831c0 2024-09-21T01:01:16.266 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.265+0000 7f701f7fe640 10 client.16632 handle_command_reply: tid=0 2024-09-21T01:01:16.266 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.265+0000 7f704d61f740 1 client.16632 shutdown 2024-09-21T01:01:16.266 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.265+0000 7f704d61f740 1 -- 172.21.15.1:0/3324684050 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ea68ef1b0 msgr2=0x561ea6ca6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:16.266 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.265+0000 7f704d61f740 1 --2- 172.21.15.1:0/3324684050 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ea68ef1b0 0x561ea6ca6610 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f70380097b0 tx=0x7f70380caee0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.266 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.265+0000 7f704d61f740 1 -- 172.21.15.1:0/3324684050 shutdown_connections 2024-09-21T01:01:16.266 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.265+0000 7f704d61f740 1 --2- 172.21.15.1:0/3324684050 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x561ea68831c0 0x561ea6d1ca70 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.267 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.265+0000 7f704d61f740 1 --2- 172.21.15.1:0/3324684050 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ea68ef1b0 0x561ea6ca6610 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.267 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.265+0000 7f704d61f740 1 --2- 172.21.15.1:0/3324684050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561ea68ce4d0 0x561ea6ca5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.267 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.265+0000 7f701f7fe640 0 client.16632 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:01:16.267 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.265+0000 7f704d61f740 1 --2- 172.21.15.1:0/3324684050 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ea68c62f0 0x561ea6ca53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.267 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.265+0000 7f704d61f740 1 -- 172.21.15.1:0/3324684050 >> 172.21.15.1:0/3324684050 conn(0x561ea68e3300 msgr2=0x561ea6c99ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:16.267 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.265+0000 7f704d61f740 1 -- 172.21.15.1:0/3324684050 shutdown_connections 2024-09-21T01:01:16.267 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.265+0000 7f704d61f740 1 -- 172.21.15.1:0/3324684050 wait complete. 2024-09-21T01:01:16.267 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.265+0000 7f704d61f740 20 client.16632 trim_cache size 0 max 16384 2024-09-21T01:01:16.267 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T01:01:16.267 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T01:01:16.267 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T01:01:16.268 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T01:01:16.268 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.266+0000 7f70466b6640 1 -- 172.21.15.1:0/425291806 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f70280b6510 msgr2=0x7f70280b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:16.268 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.266+0000 7f70466b6640 1 --2- 172.21.15.1:0/425291806 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f70280b6510 0x7f70280b8a20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f70340058c0 tx=0x7f7034005850 comp rx=0 tx=0).stop 2024-09-21T01:01:16.268 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.266+0000 7f70466b6640 1 -- 172.21.15.1:0/425291806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7040103fd0 msgr2=0x7f704019a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:16.268 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.266+0000 7f70466b6640 1 --2- 172.21.15.1:0/425291806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7040103fd0 0x7f704019a000 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f7038006010 tx=0x7f7038003c20 comp rx=0 tx=0).stop 2024-09-21T01:01:16.268 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.266+0000 7f70466b6640 1 -- 172.21.15.1:0/425291806 shutdown_connections 2024-09-21T01:01:16.268 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.266+0000 7f70466b6640 1 --2- 172.21.15.1:0/425291806 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f70280b6510 0x7f70280b8a20 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.266+0000 7f70466b6640 1 --2- 172.21.15.1:0/425291806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7040103fd0 0x7f704019a000 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.266+0000 7f70466b6640 1 --2- 172.21.15.1:0/425291806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7040103630 0x7f7040199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.266+0000 7f70466b6640 1 --2- 172.21.15.1:0/425291806 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f70401025b0 0x7f7040198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.266+0000 7f70466b6640 1 -- 172.21.15.1:0/425291806 >> 172.21.15.1:0/425291806 conn(0x7f70400fdf30 msgr2=0x7f7040106930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:16.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.266+0000 7f70466b6640 1 -- 172.21.15.1:0/425291806 shutdown_connections 2024-09-21T01:01:16.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:16.266+0000 7f70466b6640 1 -- 172.21.15.1:0/425291806 wait complete. 2024-09-21T01:01:17.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:17 smithi001 ceph-mon[31211]: pgmap v480: 97 pgs: 97 active+clean; 523 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 361 op/s 2024-09-21T01:01:17.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:17 smithi193 ceph-mon[34660]: pgmap v480: 97 pgs: 97 active+clean; 523 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 361 op/s 2024-09-21T01:01:17.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:17 smithi042 ceph-mon[34481]: pgmap v480: 97 pgs: 97 active+clean; 523 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 361 op/s 2024-09-21T01:01:19.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:19 smithi001 ceph-mon[31211]: pgmap v481: 97 pgs: 97 active+clean; 525 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 387 op/s 2024-09-21T01:01:19.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:19 smithi193 ceph-mon[34660]: pgmap v481: 97 pgs: 97 active+clean; 525 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 387 op/s 2024-09-21T01:01:19.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:19 smithi042 ceph-mon[34481]: pgmap v481: 97 pgs: 97 active+clean; 525 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 387 op/s 2024-09-21T01:01:21.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:21 smithi001 ceph-mon[31211]: pgmap v482: 97 pgs: 97 active+clean; 529 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 1.9 MiB/s wr, 373 op/s 2024-09-21T01:01:21.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:21 smithi193 ceph-mon[34660]: pgmap v482: 97 pgs: 97 active+clean; 529 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 1.9 MiB/s wr, 373 op/s 2024-09-21T01:01:21.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:21 smithi042 ceph-mon[34481]: pgmap v482: 97 pgs: 97 active+clean; 529 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 1.9 MiB/s wr, 373 op/s 2024-09-21T01:01:23.560 INFO:tasks.workunit.client.0.smithi001.stdout: 95 16482 130 10855 143 10029 326 2024-09-21T01:01:23.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:23 smithi001 ceph-mon[31211]: pgmap v483: 97 pgs: 97 active+clean; 532 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.2 MiB/s wr, 391 op/s 2024-09-21T01:01:23.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:23 smithi001 ceph-mon[31211]: scrub summary: idle 2024-09-21T01:01:23.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:23 smithi001 ceph-mon[31211]: scrub summary: idle 2024-09-21T01:01:23.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:23 smithi193 ceph-mon[34660]: pgmap v483: 97 pgs: 97 active+clean; 532 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.2 MiB/s wr, 391 op/s 2024-09-21T01:01:23.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:23 smithi193 ceph-mon[34660]: scrub summary: idle 2024-09-21T01:01:23.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:23 smithi193 ceph-mon[34660]: scrub summary: idle 2024-09-21T01:01:23.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:23 smithi042 ceph-mon[34481]: pgmap v483: 97 pgs: 97 active+clean; 532 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.2 MiB/s wr, 391 op/s 2024-09-21T01:01:23.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:23 smithi042 ceph-mon[34481]: scrub summary: idle 2024-09-21T01:01:23.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:23 smithi042 ceph-mon[34481]: scrub summary: idle 2024-09-21T01:01:24.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:24 smithi001 ceph-mon[31211]: scrub summary: idle 2024-09-21T01:01:24.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:24 smithi001 ceph-mon[31211]: scrub summary: idle 2024-09-21T01:01:24.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:24 smithi001 ceph-mon[31211]: scrub summary: idle 2024-09-21T01:01:24.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:24 smithi193 ceph-mon[34660]: scrub summary: idle 2024-09-21T01:01:24.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:24 smithi193 ceph-mon[34660]: scrub summary: idle 2024-09-21T01:01:24.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:24 smithi193 ceph-mon[34660]: scrub summary: idle 2024-09-21T01:01:24.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:24 smithi042 ceph-mon[34481]: scrub summary: idle 2024-09-21T01:01:24.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:24 smithi042 ceph-mon[34481]: scrub summary: idle 2024-09-21T01:01:24.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:24 smithi042 ceph-mon[34481]: scrub summary: idle 2024-09-21T01:01:25.641 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:01:25.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:25 smithi001 ceph-mon[31211]: pgmap v484: 97 pgs: 97 active+clean; 535 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 360 op/s 2024-09-21T01:01:25.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:25 smithi193 ceph-mon[34660]: pgmap v484: 97 pgs: 97 active+clean; 535 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 360 op/s 2024-09-21T01:01:25.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:25 smithi042 ceph-mon[34481]: pgmap v484: 97 pgs: 97 active+clean; 535 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 360 op/s 2024-09-21T01:01:25.914 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:01:26.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.513+0000 7f5e8c58a640 1 -- 172.21.15.1:0/3414157421 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e841083a0 msgr2=0x7f5e841087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:26.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.513+0000 7f5e8c58a640 1 --2- 172.21.15.1:0/3414157421 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e841083a0 0x7f5e841087b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f5e78009900 tx=0x7f5e7802a410 comp rx=0 tx=0).stop 2024-09-21T01:01:26.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.513+0000 7f5e8c58a640 1 -- 172.21.15.1:0/3414157421 shutdown_connections 2024-09-21T01:01:26.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.513+0000 7f5e8c58a640 1 --2- 172.21.15.1:0/3414157421 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e84108cf0 0x7f5e8410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:26.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.513+0000 7f5e8c58a640 1 --2- 172.21.15.1:0/3414157421 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e841083a0 0x7f5e841087b0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:26.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.513+0000 7f5e8c58a640 1 --2- 172.21.15.1:0/3414157421 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e84102a60 0x7f5e84102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:26.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.513+0000 7f5e8c58a640 1 -- 172.21.15.1:0/3414157421 >> 172.21.15.1:0/3414157421 conn(0x7f5e84079730 msgr2=0x7f5e84079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:26.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.513+0000 7f5e8c58a640 1 -- 172.21.15.1:0/3414157421 shutdown_connections 2024-09-21T01:01:26.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.513+0000 7f5e8c58a640 1 -- 172.21.15.1:0/3414157421 wait complete. 2024-09-21T01:01:26.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.514+0000 7f5e8c58a640 1 Processor -- start 2024-09-21T01:01:26.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.514+0000 7f5e8c58a640 1 -- start start 2024-09-21T01:01:26.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.514+0000 7f5e8c58a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e84102a60 0x7f5e8419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:26.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.514+0000 7f5e8c58a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e841083a0 0x7f5e8419ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:26.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.514+0000 7f5e8c58a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e84108cf0 0x7f5e8419fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:26.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.514+0000 7f5e8c58a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5e84113a80 con 0x7f5e841083a0 2024-09-21T01:01:26.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.514+0000 7f5e8c58a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5e84113900 con 0x7f5e84102a60 2024-09-21T01:01:26.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.514+0000 7f5e8c58a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5e84113c00 con 0x7f5e84108cf0 2024-09-21T01:01:26.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.515+0000 7f5e8a326640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e84102a60 0x7f5e8419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:26.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.515+0000 7f5e89b25640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e841083a0 0x7f5e8419ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:26.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.515+0000 7f5e8a326640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e84102a60 0x7f5e8419a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:38394/0 (socket says 172.21.15.1:38394) 2024-09-21T01:01:26.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.515+0000 7f5e8a326640 1 -- 172.21.15.1:0/111679545 learned_addr learned my addr 172.21.15.1:0/111679545 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:26.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.515+0000 7f5e8ab27640 1 --2- 172.21.15.1:0/111679545 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e84108cf0 0x7f5e8419fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:26.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.515+0000 7f5e8a326640 1 -- 172.21.15.1:0/111679545 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e84108cf0 msgr2=0x7f5e8419fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:26.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.515+0000 7f5e8a326640 1 --2- 172.21.15.1:0/111679545 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e84108cf0 0x7f5e8419fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:26.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.515+0000 7f5e8a326640 1 -- 172.21.15.1:0/111679545 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e841083a0 msgr2=0x7f5e8419ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:26.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.515+0000 7f5e8a326640 1 --2- 172.21.15.1:0/111679545 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e841083a0 0x7f5e8419ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:26.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.515+0000 7f5e8a326640 1 -- 172.21.15.1:0/111679545 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e841a0500 con 0x7f5e84102a60 2024-09-21T01:01:26.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.515+0000 7f5e8ab27640 1 --2- 172.21.15.1:0/111679545 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e84108cf0 0x7f5e8419fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:01:26.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.515+0000 7f5e89b25640 1 --2- 172.21.15.1:0/111679545 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e841083a0 0x7f5e8419ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:01:26.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.515+0000 7f5e8a326640 1 --2- 172.21.15.1:0/111679545 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e84102a60 0x7f5e8419a590 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5e7400eb90 tx=0x7f5e7400c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:26.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.515+0000 7f5e837fe640 1 -- 172.21.15.1:0/111679545 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e74004d20 con 0x7f5e84102a60 2024-09-21T01:01:26.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.515+0000 7f5e837fe640 1 -- 172.21.15.1:0/111679545 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e7400ee90 con 0x7f5e84102a60 2024-09-21T01:01:26.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.516+0000 7f5e8c58a640 1 -- 172.21.15.1:0/111679545 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e841a07f0 con 0x7f5e84102a60 2024-09-21T01:01:26.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.516+0000 7f5e837fe640 1 -- 172.21.15.1:0/111679545 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e74010670 con 0x7f5e84102a60 2024-09-21T01:01:26.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.516+0000 7f5e8c58a640 1 -- 172.21.15.1:0/111679545 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e841a6f50 con 0x7f5e84102a60 2024-09-21T01:01:26.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.518+0000 7f5e92afe740 1 Processor -- start 2024-09-21T01:01:26.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.518+0000 7f5e92afe740 1 -- start start 2024-09-21T01:01:26.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.519+0000 7f5e92afe740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5597ae2fe070 0x5597ae6a5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:26.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.519+0000 7f5e92afe740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ae2d51b0 0x5597ae6a5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:26.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.519+0000 7f5e92afe740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597ae2dd390 0x5597ae6a60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:26.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.519+0000 7f5e92afe740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5597ae61be50 con 0x5597ae2d51b0 2024-09-21T01:01:26.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.519+0000 7f5e92afe740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5597ae60b280 con 0x5597ae2dd390 2024-09-21T01:01:26.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.519+0000 7f5e92afe740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5597ae60f090 con 0x5597ae2fe070 2024-09-21T01:01:26.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.519+0000 7f5e837fe640 1 -- 172.21.15.1:0/111679545 <== mon.2 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f5e74005020 con 0x7f5e84102a60 2024-09-21T01:01:26.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.519+0000 7f5e89b25640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597ae2dd390 0x5597ae6a60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:26.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.519+0000 7f5e8ab27640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5597ae2fe070 0x5597ae6a5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:26.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.519+0000 7f5e89b25640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597ae2dd390 0x5597ae6a60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:38402/0 (socket says 172.21.15.1:38402) 2024-09-21T01:01:26.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.519+0000 7f5e89b25640 1 -- 172.21.15.1:0/2393766770 learned_addr learned my addr 172.21.15.1:0/2393766770 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:26.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.519+0000 7f5e8a326640 1 --2- 172.21.15.1:0/2393766770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ae2d51b0 0x5597ae6a5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:26.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.519+0000 7f5e89b25640 1 -- 172.21.15.1:0/2393766770 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5597ae2fe070 msgr2=0x5597ae6a5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:26.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.519+0000 7f5e89b25640 1 --2- 172.21.15.1:0/2393766770 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5597ae2fe070 0x5597ae6a5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:26.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.519+0000 7f5e89b25640 1 -- 172.21.15.1:0/2393766770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ae2d51b0 msgr2=0x5597ae6a5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:26.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.519+0000 7f5e89b25640 1 --2- 172.21.15.1:0/2393766770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ae2d51b0 0x5597ae6a5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:26.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.519+0000 7f5e89b25640 1 -- 172.21.15.1:0/2393766770 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597ae369650 con 0x5597ae2dd390 2024-09-21T01:01:26.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.519+0000 7f5e8a326640 1 --2- 172.21.15.1:0/2393766770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ae2d51b0 0x5597ae6a5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:01:26.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.520+0000 7f5e89b25640 1 --2- 172.21.15.1:0/2393766770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597ae2dd390 0x5597ae6a60d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5e78009900 tx=0x7f5e78005e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b414582276feac6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:26.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.520+0000 7f5e80ff9640 1 -- 172.21.15.1:0/2393766770 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e78040070 con 0x5597ae2dd390 2024-09-21T01:01:26.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.520+0000 7f5e80ff9640 1 -- 172.21.15.1:0/2393766770 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e78031720 con 0x5597ae2dd390 2024-09-21T01:01:26.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.520+0000 7f5e80ff9640 1 -- 172.21.15.1:0/2393766770 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e78035040 con 0x5597ae2dd390 2024-09-21T01:01:26.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.520+0000 7f5e837fe640 1 --2- 172.21.15.1:0/111679545 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5e6c0b6590 0x7f5e6c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:26.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.520+0000 7f5e8ab27640 1 --2- 172.21.15.1:0/111679545 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5e6c0b6590 0x7f5e6c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:26.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.520+0000 7f5e837fe640 1 -- 172.21.15.1:0/111679545 <== mon.2 v2:172.21.15.42:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f5e740e79d0 con 0x7f5e84102a60 2024-09-21T01:01:26.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.521+0000 7f5e92afe740 1 -- 172.21.15.1:0/2393766770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597ae2dd390 msgr2=0x5597ae6a60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:26.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.521+0000 7f5e8ab27640 1 --2- 172.21.15.1:0/111679545 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5e6c0b6590 0x7f5e6c0b8aa0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c013ef0 tx=0x7f5e7c015040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:26.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.521+0000 7f5e92afe740 1 --2- 172.21.15.1:0/2393766770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597ae2dd390 0x5597ae6a60d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5e78009900 tx=0x7f5e78005e20 comp rx=0 tx=0).stop 2024-09-21T01:01:26.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.521+0000 7f5e92afe740 1 -- 172.21.15.1:0/2393766770 shutdown_connections 2024-09-21T01:01:26.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.521+0000 7f5e92afe740 1 --2- 172.21.15.1:0/2393766770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597ae2dd390 0x5597ae6a60d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:26.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.521+0000 7f5e92afe740 1 --2- 172.21.15.1:0/2393766770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ae2d51b0 0x5597ae6a5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:26.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.521+0000 7f5e92afe740 1 --2- 172.21.15.1:0/2393766770 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5597ae2fe070 0x5597ae6a5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:26.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.521+0000 7f5e92afe740 1 -- 172.21.15.1:0/2393766770 >> 172.21.15.1:0/2393766770 conn(0x5597ae2f2460 msgr2=0x5597ae6a3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:26.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.521+0000 7f5e92afe740 1 -- 172.21.15.1:0/2393766770 shutdown_connections 2024-09-21T01:01:26.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.521+0000 7f5e92afe740 1 -- 172.21.15.1:0/2393766770 wait complete. 2024-09-21T01:01:26.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.521+0000 7f5e92afe740 1 -- start start 2024-09-21T01:01:26.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.522+0000 7f5e92afe740 1 Processor -- start 2024-09-21T01:01:26.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.522+0000 7f5e92afe740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5597ae2d51b0 0x5597ae6b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:26.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.522+0000 7f5e92afe740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597ae2dd390 0x5597ae6b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:26.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.522+0000 7f5e92afe740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ae2fe070 0x5597ae6bd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:26.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.522+0000 7f5e92afe740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5597ae46c700 con 0x5597ae2fe070 2024-09-21T01:01:26.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.522+0000 7f5e92afe740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5597ae5a6110 con 0x5597ae2dd390 2024-09-21T01:01:26.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.522+0000 7f5e92afe740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5597ae6b3dd0 con 0x5597ae2d51b0 2024-09-21T01:01:26.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.522+0000 7f5e92afe740 10 client.0 _ll_register_callbacks cb 0x5597ae5bf990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:01:26.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.522+0000 7f5e8ab27640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ae2fe070 0x5597ae6bd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:26.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.522+0000 7f5e89b25640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597ae2dd390 0x5597ae6b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:26.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.522+0000 7f5e8ab27640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ae2fe070 0x5597ae6bd0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46906/0 (socket says 172.21.15.1:46906) 2024-09-21T01:01:26.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.522+0000 7f5e8ab27640 1 -- 172.21.15.1:0/4282948596 learned_addr learned my addr 172.21.15.1:0/4282948596 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:26.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.522+0000 7f5e8a326640 1 --2- 172.21.15.1:0/4282948596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5597ae2d51b0 0x5597ae6b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:26.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.522+0000 7f5e8ab27640 1 -- 172.21.15.1:0/4282948596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5597ae2d51b0 msgr2=0x5597ae6b0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:26.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.522+0000 7f5e8ab27640 1 --2- 172.21.15.1:0/4282948596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5597ae2d51b0 0x5597ae6b0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:26.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.522+0000 7f5e8ab27640 1 -- 172.21.15.1:0/4282948596 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597ae2dd390 msgr2=0x5597ae6b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:26.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.522+0000 7f5e8ab27640 1 --2- 172.21.15.1:0/4282948596 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597ae2dd390 0x5597ae6b12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:26.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.522+0000 7f5e8ab27640 1 -- 172.21.15.1:0/4282948596 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597ae5d3c40 con 0x5597ae2fe070 2024-09-21T01:01:26.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.523+0000 7f5e8ab27640 1 --2- 172.21.15.1:0/4282948596 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ae2fe070 0x5597ae6bd0f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c01fb90 tx=0x7f5e7c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8c86dab5a10eebf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:26.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.523+0000 7f5e69ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:01:26.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.523+0000 7f5e69ffb640 1 -- 172.21.15.1:0/4282948596 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c02d020 con 0x5597ae2fe070 2024-09-21T01:01:26.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.523+0000 7f5e92afe740 1 -- 172.21.15.1:0/4282948596 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e78031720 con 0x5597ae2fe070 2024-09-21T01:01:26.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.523+0000 7f5e69ffb640 1 -- 172.21.15.1:0/4282948596 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f5e7c01dc00 con 0x5597ae2fe070 2024-09-21T01:01:26.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.523+0000 7f5e69ffb640 1 -- 172.21.15.1:0/4282948596 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f5e7c038050 con 0x5597ae2fe070 2024-09-21T01:01:26.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.523+0000 7f5e92afe740 10 client.16644 fetch_fsmap learned FSMap version 33 2024-09-21T01:01:26.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.523+0000 7f5e92afe740 1 -- 172.21.15.1:0/4282948596 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5597ae6bfbd0 con 0x5597ae2fe070 2024-09-21T01:01:26.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.523+0000 7f5e69ffb640 1 -- 172.21.15.1:0/4282948596 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e78031720 con 0x5597ae2fe070 2024-09-21T01:01:26.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.524+0000 7f5e69ffb640 1 -- 172.21.15.1:0/4282948596 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f5e7c028030 con 0x5597ae2fe070 2024-09-21T01:01:26.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.524+0000 7f5e92afe740 10 client.16644 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:01:26.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.524+0000 7f5e92afe740 10 client.16644 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:01:26.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.524+0000 7f5e92afe740 20 client.16644 populate_metadata read hostname 'smithi001' 2024-09-21T01:01:26.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.524+0000 7f5e92afe740 1 --2- 172.21.15.1:0/4282948596 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5597ae2bc9f0 0x5597ae6c30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:26.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.524+0000 7f5e92afe740 4 client.16644 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:01:26.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.524+0000 7f5e92afe740 1 -- 172.21.15.1:0/4282948596 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597ae61dda0 con 0x5597ae2bc9f0 2024-09-21T01:01:26.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.524+0000 7f5e8a326640 1 --2- 172.21.15.1:0/4282948596 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5597ae2bc9f0 0x5597ae6c30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:26.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.524+0000 7f5e69ffb640 10 client.16644 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:01:26.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.524+0000 7f5e8a326640 1 --2- 172.21.15.1:0/4282948596 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5597ae2bc9f0 0x5597ae6c30e0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8e26e5cafeff6a9 server_cookie=9aa8a66301e72bcd in_seq=0 out_seq=0 2024-09-21T01:01:26.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.525+0000 7f5e69ffb640 1 -- 172.21.15.1:0/4282948596 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5597ae61dda0 con 0x5597ae2bc9f0 2024-09-21T01:01:26.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.525+0000 7f5e69ffb640 10 client.16644 handle_command_reply: tid=0 2024-09-21T01:01:26.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.525+0000 7f5e92afe740 1 client.16644 shutdown 2024-09-21T01:01:26.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.525+0000 7f5e92afe740 1 -- 172.21.15.1:0/4282948596 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ae2fe070 msgr2=0x5597ae6bd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:26.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.525+0000 7f5e92afe740 1 --2- 172.21.15.1:0/4282948596 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ae2fe070 0x5597ae6bd0f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c01fb90 tx=0x7f5e7c004730 comp rx=0 tx=0).stop 2024-09-21T01:01:26.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.525+0000 7f5e92afe740 1 -- 172.21.15.1:0/4282948596 shutdown_connections 2024-09-21T01:01:26.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.525+0000 7f5e92afe740 1 --2- 172.21.15.1:0/4282948596 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5597ae2bc9f0 0x5597ae6c30e0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:26.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.525+0000 7f5e92afe740 1 --2- 172.21.15.1:0/4282948596 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ae2fe070 0x5597ae6bd0f0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:26.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.525+0000 7f5e92afe740 1 --2- 172.21.15.1:0/4282948596 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597ae2dd390 0x5597ae6b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:26.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.525+0000 7f5e92afe740 1 --2- 172.21.15.1:0/4282948596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5597ae2d51b0 0x5597ae6b0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:26.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.525+0000 7f5e69ffb640 0 client.16644 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:01:26.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.525+0000 7f5e92afe740 1 -- 172.21.15.1:0/4282948596 >> 172.21.15.1:0/4282948596 conn(0x5597ae2f2460 msgr2=0x5597ae6a87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:26.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.525+0000 7f5e92afe740 1 -- 172.21.15.1:0/4282948596 shutdown_connections 2024-09-21T01:01:26.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.525+0000 7f5e92afe740 1 -- 172.21.15.1:0/4282948596 wait complete. 2024-09-21T01:01:26.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.526+0000 7f5e92afe740 20 client.16644 trim_cache size 0 max 16384 2024-09-21T01:01:26.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.544+0000 7f5e92afe740 1 Processor -- start 2024-09-21T01:01:26.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.544+0000 7f5e92afe740 1 -- start start 2024-09-21T01:01:26.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.545+0000 7f5e92afe740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597ae2d51b0 0x5597ae6b29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:26.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.545+0000 7f5e92afe740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ae2dd390 0x5597ae6bcff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:26.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.545+0000 7f5e92afe740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5597ae2fe070 0x5597ae6adf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:26.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.545+0000 7f5e92afe740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5e841ad270 con 0x5597ae2dd390 2024-09-21T01:01:26.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.545+0000 7f5e92afe740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5e841aee70 con 0x5597ae2d51b0 2024-09-21T01:01:26.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.545+0000 7f5e92afe740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5e841ad940 con 0x5597ae2fe070 2024-09-21T01:01:26.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.545+0000 7f5e89b25640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ae2dd390 0x5597ae6bcff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:26.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.545+0000 7f5e8a326640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597ae2d51b0 0x5597ae6b29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:26.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.545+0000 7f5e8a326640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597ae2d51b0 0x5597ae6b29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:38410/0 (socket says 172.21.15.1:38410) 2024-09-21T01:01:26.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.545+0000 7f5e8a326640 1 -- 172.21.15.1:0/3823600274 learned_addr learned my addr 172.21.15.1:0/3823600274 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:26.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.545+0000 7f5e8ab27640 1 --2- 172.21.15.1:0/3823600274 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5597ae2fe070 0x5597ae6adf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:26.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.545+0000 7f5e8a326640 1 -- 172.21.15.1:0/3823600274 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5597ae2fe070 msgr2=0x5597ae6adf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:26.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.545+0000 7f5e8a326640 1 --2- 172.21.15.1:0/3823600274 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5597ae2fe070 0x5597ae6adf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:26.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.545+0000 7f5e8a326640 1 -- 172.21.15.1:0/3823600274 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ae2dd390 msgr2=0x5597ae6bcff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:26.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.545+0000 7f5e8a326640 1 --2- 172.21.15.1:0/3823600274 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ae2dd390 0x5597ae6bcff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:26.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.545+0000 7f5e8a326640 1 -- 172.21.15.1:0/3823600274 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597ae6af280 con 0x5597ae2d51b0 2024-09-21T01:01:26.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.545+0000 7f5e89b25640 1 --2- 172.21.15.1:0/3823600274 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ae2dd390 0x5597ae6bcff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:01:26.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.545+0000 7f5e8ab27640 1 --2- 172.21.15.1:0/3823600274 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5597ae2fe070 0x5597ae6adf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:01:26.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.545+0000 7f5e8a326640 1 --2- 172.21.15.1:0/3823600274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597ae2d51b0 0x5597ae6b29b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5e7400cba0 tx=0x7f5e74095040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2083bcb04fa33f86 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:26.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.546+0000 7f5e6bfff640 1 -- 172.21.15.1:0/3823600274 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e740ad2b0 con 0x5597ae2d51b0 2024-09-21T01:01:26.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.546+0000 7f5e6bfff640 1 -- 172.21.15.1:0/3823600274 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e740ad650 con 0x5597ae2d51b0 2024-09-21T01:01:26.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.546+0000 7f5e6bfff640 1 -- 172.21.15.1:0/3823600274 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e740a92b0 con 0x5597ae2d51b0 2024-09-21T01:01:26.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.546+0000 7f5e92afe740 1 -- 172.21.15.1:0/3823600274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597ae2d51b0 msgr2=0x5597ae6b29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:26.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.546+0000 7f5e92afe740 1 --2- 172.21.15.1:0/3823600274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597ae2d51b0 0x5597ae6b29b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5e7400cba0 tx=0x7f5e74095040 comp rx=0 tx=0).stop 2024-09-21T01:01:26.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.547+0000 7f5e92afe740 1 -- 172.21.15.1:0/3823600274 shutdown_connections 2024-09-21T01:01:26.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.547+0000 7f5e92afe740 1 --2- 172.21.15.1:0/3823600274 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5597ae2fe070 0x5597ae6adf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:26.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.547+0000 7f5e92afe740 1 --2- 172.21.15.1:0/3823600274 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ae2dd390 0x5597ae6bcff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:26.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.547+0000 7f5e92afe740 1 --2- 172.21.15.1:0/3823600274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597ae2d51b0 0x5597ae6b29b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:26.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.547+0000 7f5e92afe740 1 -- 172.21.15.1:0/3823600274 >> 172.21.15.1:0/3823600274 conn(0x5597ae2f2460 msgr2=0x5597ae6b22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:26.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.547+0000 7f5e92afe740 1 -- 172.21.15.1:0/3823600274 shutdown_connections 2024-09-21T01:01:26.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.547+0000 7f5e92afe740 1 -- 172.21.15.1:0/3823600274 wait complete. 2024-09-21T01:01:26.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.547+0000 7f5e92afe740 1 -- start start 2024-09-21T01:01:26.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.547+0000 7f5e92afe740 1 Processor -- start 2024-09-21T01:01:26.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.548+0000 7f5e92afe740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597ae2d51b0 0x5597ae6b97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:26.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.548+0000 7f5e92afe740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ae2dd390 0x5597ae6b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:26.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.548+0000 7f5e92afe740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5597ae2fe070 0x5597ae6b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:26.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.548+0000 7f5e92afe740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5e841ae7a0 con 0x5597ae2dd390 2024-09-21T01:01:26.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.548+0000 7f5e92afe740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5e841ae0d0 con 0x5597ae2d51b0 2024-09-21T01:01:26.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.548+0000 7f5e92afe740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5e841ab250 con 0x5597ae2fe070 2024-09-21T01:01:26.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.548+0000 7f5e92afe740 10 client.0 _ll_register_callbacks cb 0x7f5e7c013b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:01:26.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.548+0000 7f5e89b25640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ae2dd390 0x5597ae6b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:26.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.548+0000 7f5e89b25640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ae2dd390 0x5597ae6b4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46922/0 (socket says 172.21.15.1:46922) 2024-09-21T01:01:26.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.548+0000 7f5e89b25640 1 -- 172.21.15.1:0/4109260360 learned_addr learned my addr 172.21.15.1:0/4109260360 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:26.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.548+0000 7f5e8a326640 1 --2- 172.21.15.1:0/4109260360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597ae2d51b0 0x5597ae6b97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:26.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.548+0000 7f5e8ab27640 1 --2- 172.21.15.1:0/4109260360 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5597ae2fe070 0x5597ae6b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:26.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.548+0000 7f5e89b25640 1 -- 172.21.15.1:0/4109260360 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5597ae2fe070 msgr2=0x5597ae6b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:26.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.548+0000 7f5e89b25640 1 --2- 172.21.15.1:0/4109260360 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5597ae2fe070 0x5597ae6b51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:26.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.548+0000 7f5e89b25640 1 -- 172.21.15.1:0/4109260360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597ae2d51b0 msgr2=0x5597ae6b97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:26.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.548+0000 7f5e89b25640 1 --2- 172.21.15.1:0/4109260360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597ae2d51b0 0x5597ae6b97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:26.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.548+0000 7f5e89b25640 1 -- 172.21.15.1:0/4109260360 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597ae6b5900 con 0x5597ae2dd390 2024-09-21T01:01:26.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.548+0000 7f5e8a326640 1 --2- 172.21.15.1:0/4109260360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597ae2d51b0 0x5597ae6b97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:01:26.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.548+0000 7f5e69ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:01:26.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.548+0000 7f5e89b25640 1 --2- 172.21.15.1:0/4109260360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ae2dd390 0x5597ae6b4c80 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f5e7802a930 tx=0x7f5e78005380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df053eae269adf32 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:26.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.549+0000 7f5e69ffb640 1 -- 172.21.15.1:0/4109260360 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e78035050 con 0x5597ae2dd390 2024-09-21T01:01:26.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.549+0000 7f5e69ffb640 1 -- 172.21.15.1:0/4109260360 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f5e78004240 con 0x5597ae2dd390 2024-09-21T01:01:26.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.549+0000 7f5e92afe740 1 -- 172.21.15.1:0/4109260360 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e740ad650 con 0x5597ae2dd390 2024-09-21T01:01:26.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.549+0000 7f5e69ffb640 1 -- 172.21.15.1:0/4109260360 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f5e78040040 con 0x5597ae2dd390 2024-09-21T01:01:26.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.549+0000 7f5e92afe740 10 client.16650 fetch_fsmap learned FSMap version 33 2024-09-21T01:01:26.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.549+0000 7f5e92afe740 1 -- 172.21.15.1:0/4109260360 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5597ae72d8f0 con 0x5597ae2dd390 2024-09-21T01:01:26.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.549+0000 7f5e69ffb640 1 -- 172.21.15.1:0/4109260360 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e740ad650 con 0x5597ae2dd390 2024-09-21T01:01:26.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.549+0000 7f5e69ffb640 1 -- 172.21.15.1:0/4109260360 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f5e7804f460 con 0x5597ae2dd390 2024-09-21T01:01:26.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.549+0000 7f5e92afe740 10 client.16650 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:01:26.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.549+0000 7f5e92afe740 10 client.16650 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:01:26.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.549+0000 7f5e92afe740 20 client.16650 populate_metadata read hostname 'smithi001' 2024-09-21T01:01:26.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.549+0000 7f5e92afe740 1 --2- 172.21.15.1:0/4109260360 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5597ae291da0 0x5597ae72fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:26.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.549+0000 7f5e92afe740 4 client.16650 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:01:26.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.549+0000 7f5e92afe740 1 -- 172.21.15.1:0/4109260360 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5597ae619850 con 0x5597ae291da0 2024-09-21T01:01:26.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.550+0000 7f5e8a326640 1 --2- 172.21.15.1:0/4109260360 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5597ae291da0 0x5597ae72fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:26.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.550+0000 7f5e8a326640 1 --2- 172.21.15.1:0/4109260360 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5597ae291da0 0x5597ae72fcc0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4deb3499e21260d server_cookie=80e3d5a2d8303839 in_seq=0 out_seq=0 2024-09-21T01:01:26.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.550+0000 7f5e69ffb640 10 client.16650 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:01:26.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.550+0000 7f5e69ffb640 1 -- 172.21.15.1:0/4109260360 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2078 (crc 0 0 0) 0x5597ae619850 con 0x5597ae291da0 2024-09-21T01:01:26.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.550+0000 7f5e69ffb640 10 client.16650 handle_command_reply: tid=0 2024-09-21T01:01:26.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.550+0000 7f5e92afe740 1 client.16650 shutdown 2024-09-21T01:01:26.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.550+0000 7f5e92afe740 1 -- 172.21.15.1:0/4109260360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ae2dd390 msgr2=0x5597ae6b4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:26.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.550+0000 7f5e92afe740 1 --2- 172.21.15.1:0/4109260360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ae2dd390 0x5597ae6b4c80 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f5e7802a930 tx=0x7f5e78005380 comp rx=0 tx=0).stop 2024-09-21T01:01:26.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.550+0000 7f5e92afe740 1 -- 172.21.15.1:0/4109260360 shutdown_connections 2024-09-21T01:01:26.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.550+0000 7f5e92afe740 1 --2- 172.21.15.1:0/4109260360 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5597ae291da0 0x5597ae72fcc0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:26.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.550+0000 7f5e92afe740 1 --2- 172.21.15.1:0/4109260360 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5597ae2fe070 0x5597ae6b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:26.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.550+0000 7f5e92afe740 1 --2- 172.21.15.1:0/4109260360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ae2dd390 0x5597ae6b4c80 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:26.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.550+0000 7f5e69ffb640 0 client.16650 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:01:26.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.550+0000 7f5e92afe740 1 --2- 172.21.15.1:0/4109260360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597ae2d51b0 0x5597ae6b97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:26.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.550+0000 7f5e92afe740 1 -- 172.21.15.1:0/4109260360 >> 172.21.15.1:0/4109260360 conn(0x5597ae2f2460 msgr2=0x5597ae6b2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:26.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.551+0000 7f5e92afe740 1 -- 172.21.15.1:0/4109260360 shutdown_connections 2024-09-21T01:01:26.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.551+0000 7f5e92afe740 1 -- 172.21.15.1:0/4109260360 wait complete. 2024-09-21T01:01:26.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.551+0000 7f5e92afe740 20 client.16650 trim_cache size 0 max 16384 2024-09-21T01:01:26.556 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T01:01:26.557 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "no active scrubs running", 2024-09-21T01:01:26.557 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": {}, 2024-09-21T01:01:26.557 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_stats": { 2024-09-21T01:01:26.557 INFO:teuthology.orchestra.run.smithi001.stdout: "c2addc95-c922-4a70-b746-0b5fd2af59bf": { 2024-09-21T01:01:26.557 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:00:52.374848+0000", 2024-09-21T01:01:26.557 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:01:26.557 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:01:26.557 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:01:26.557 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:01:26.557 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:01:26.557 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:01:26.557 INFO:teuthology.orchestra.run.smithi001.stdout: "f826f2c1-768a-47bb-b868-785b351ac6b4": { 2024-09-21T01:01:26.557 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:59:06.554657+0000", 2024-09-21T01:01:26.557 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:01:26.557 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:01:26.558 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:01:26.558 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:01:26.558 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:01:26.558 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:01:26.558 INFO:teuthology.orchestra.run.smithi001.stdout: "1bffed0d-34b1-4e8b-9cab-7501131ef79d": { 2024-09-21T01:01:26.558 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:00:02.564228+0000", 2024-09-21T01:01:26.558 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:01:26.558 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:01:26.558 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:01:26.558 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:01:26.558 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:01:26.558 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:01:26.558 INFO:teuthology.orchestra.run.smithi001.stdout: "bee49cce-b407-4617-a959-331ffd8dc5b0": { 2024-09-21T01:01:26.558 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:58:17.883027+0000", 2024-09-21T01:01:26.558 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:01:26.558 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:01:26.559 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:01:26.559 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:01:26.559 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:01:26.559 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:01:26.559 INFO:teuthology.orchestra.run.smithi001.stdout: "7cb1bc3f-e2d2-4bf7-b13e-8f3371d7aac1": { 2024-09-21T01:01:26.559 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:58:02.751142+0000", 2024-09-21T01:01:26.559 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:01:26.559 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:01:26.559 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:01:26.559 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:01:26.559 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:01:26.559 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:01:26.559 INFO:teuthology.orchestra.run.smithi001.stdout: "2383a19c-993d-4440-99f7-93b43dcf33b4": { 2024-09-21T01:01:26.559 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:47.609257+0000", 2024-09-21T01:01:26.560 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:01:26.560 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:01:26.560 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:01:26.560 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:01:26.560 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:01:26.560 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:01:26.560 INFO:teuthology.orchestra.run.smithi001.stdout: "53fa74e4-5aa8-408b-9724-7c93618f7636": { 2024-09-21T01:01:26.560 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:01.730608+0000", 2024-09-21T01:01:26.560 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:01:26.560 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:01:26.560 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:01:26.560 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:01:26.560 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:01:26.560 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:01:26.560 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:01:26.561 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T01:01:26.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.551+0000 7f5e8c58a640 1 -- 172.21.15.1:0/111679545 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5e6c0b6590 msgr2=0x7f5e6c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:26.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.551+0000 7f5e8c58a640 1 --2- 172.21.15.1:0/111679545 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5e6c0b6590 0x7f5e6c0b8aa0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c013ef0 tx=0x7f5e7c015040 comp rx=0 tx=0).stop 2024-09-21T01:01:26.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.551+0000 7f5e8c58a640 1 -- 172.21.15.1:0/111679545 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e84102a60 msgr2=0x7f5e8419a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:26.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.551+0000 7f5e8c58a640 1 --2- 172.21.15.1:0/111679545 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e84102a60 0x7f5e8419a590 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5e7400eb90 tx=0x7f5e7400c6a0 comp rx=0 tx=0).stop 2024-09-21T01:01:26.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.551+0000 7f5e8c58a640 1 -- 172.21.15.1:0/111679545 shutdown_connections 2024-09-21T01:01:26.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.551+0000 7f5e8c58a640 1 --2- 172.21.15.1:0/111679545 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e84108cf0 0x7f5e8419fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:26.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.551+0000 7f5e8c58a640 1 --2- 172.21.15.1:0/111679545 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5e6c0b6590 0x7f5e6c0b8aa0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:26.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.551+0000 7f5e8c58a640 1 --2- 172.21.15.1:0/111679545 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e841083a0 0x7f5e8419ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:26.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.551+0000 7f5e8c58a640 1 --2- 172.21.15.1:0/111679545 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e84102a60 0x7f5e8419a590 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:26.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.551+0000 7f5e8c58a640 1 -- 172.21.15.1:0/111679545 >> 172.21.15.1:0/111679545 conn(0x7f5e84079730 msgr2=0x7f5e841044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:26.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.551+0000 7f5e8c58a640 1 -- 172.21.15.1:0/111679545 shutdown_connections 2024-09-21T01:01:26.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:26.551+0000 7f5e8c58a640 1 -- 172.21.15.1:0/111679545 wait complete. 2024-09-21T01:01:27.357 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T01:01:27.358 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:01:27.650 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:01:27.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:27 smithi001 ceph-mon[31211]: pgmap v485: 97 pgs: 97 active+clean; 536 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 978 KiB/s rd, 1.9 MiB/s wr, 264 op/s 2024-09-21T01:01:27.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:27 smithi193 ceph-mon[34660]: pgmap v485: 97 pgs: 97 active+clean; 536 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 978 KiB/s rd, 1.9 MiB/s wr, 264 op/s 2024-09-21T01:01:27.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:27 smithi042 ceph-mon[34481]: pgmap v485: 97 pgs: 97 active+clean; 536 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 978 KiB/s rd, 1.9 MiB/s wr, 264 op/s 2024-09-21T01:01:28.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.195+0000 7f13e8871640 1 -- 172.21.15.1:0/2976493336 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc0318a0 con 0x7f13e410de10 2024-09-21T01:01:28.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.196+0000 7f13ebad7640 1 -- 172.21.15.1:0/2976493336 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13e410de10 msgr2=0x7f13e4110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:28.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.196+0000 7f13ebad7640 1 --2- 172.21.15.1:0/2976493336 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13e410de10 0x7f13e4110300 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f13dc009900 tx=0x7f13dc02a410 comp rx=0 tx=0).stop 2024-09-21T01:01:28.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.196+0000 7f13ebad7640 1 -- 172.21.15.1:0/2976493336 shutdown_connections 2024-09-21T01:01:28.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.196+0000 7f13ebad7640 1 --2- 172.21.15.1:0/2976493336 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13e410de10 0x7f13e4110300 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:28.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.196+0000 7f13ebad7640 1 --2- 172.21.15.1:0/2976493336 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13e4105300 0x7f13e410d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:28.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.196+0000 7f13ebad7640 1 --2- 172.21.15.1:0/2976493336 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13e41049b0 0x7f13e4104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:28.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.196+0000 7f13ebad7640 1 -- 172.21.15.1:0/2976493336 >> 172.21.15.1:0/2976493336 conn(0x7f13e4079730 msgr2=0x7f13e4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:28.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.196+0000 7f13ebad7640 1 -- 172.21.15.1:0/2976493336 shutdown_connections 2024-09-21T01:01:28.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.196+0000 7f13ebad7640 1 -- 172.21.15.1:0/2976493336 wait complete. 2024-09-21T01:01:28.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.197+0000 7f13ebad7640 1 Processor -- start 2024-09-21T01:01:28.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.197+0000 7f13ebad7640 1 -- start start 2024-09-21T01:01:28.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.197+0000 7f13ebad7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13e41049b0 0x7f13e419a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:28.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.197+0000 7f13ebad7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13e4105300 0x7f13e419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:28.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.197+0000 7f13ebad7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13e410de10 0x7f13e419fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:28.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.197+0000 7f13ebad7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f13e4113a90 con 0x7f13e4105300 2024-09-21T01:01:28.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.197+0000 7f13ebad7640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f13e4113910 con 0x7f13e41049b0 2024-09-21T01:01:28.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.197+0000 7f13ebad7640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f13e4113c10 con 0x7f13e410de10 2024-09-21T01:01:28.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.197+0000 7f13e9072640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13e4105300 0x7f13e419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:28.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.197+0000 7f13e9873640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13e41049b0 0x7f13e419a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:28.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.197+0000 7f13e9873640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13e41049b0 0x7f13e419a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:38442/0 (socket says 172.21.15.1:38442) 2024-09-21T01:01:28.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.197+0000 7f13e9072640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13e4105300 0x7f13e419a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46942/0 (socket says 172.21.15.1:46942) 2024-09-21T01:01:28.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.197+0000 7f13e9873640 1 -- 172.21.15.1:0/3920380566 learned_addr learned my addr 172.21.15.1:0/3920380566 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:28.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.198+0000 7f13ea074640 1 --2- 172.21.15.1:0/3920380566 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13e410de10 0x7f13e419fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:28.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.198+0000 7f13e9873640 1 -- 172.21.15.1:0/3920380566 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13e410de10 msgr2=0x7f13e419fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:28.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.198+0000 7f13e9873640 1 --2- 172.21.15.1:0/3920380566 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13e410de10 0x7f13e419fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:28.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.198+0000 7f13e9873640 1 -- 172.21.15.1:0/3920380566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13e4105300 msgr2=0x7f13e419a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:28.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.198+0000 7f13e9873640 1 --2- 172.21.15.1:0/3920380566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13e4105300 0x7f13e419a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:28.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.198+0000 7f13e9873640 1 -- 172.21.15.1:0/3920380566 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e41a0390 con 0x7f13e41049b0 2024-09-21T01:01:28.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.198+0000 7f13ea074640 1 --2- 172.21.15.1:0/3920380566 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13e410de10 0x7f13e419fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:01:28.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.198+0000 7f13e9873640 1 --2- 172.21.15.1:0/3920380566 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13e41049b0 0x7f13e419a420 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f13e000eb70 tx=0x7f13e000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:28.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.198+0000 7f13daffd640 1 -- 172.21.15.1:0/3920380566 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e0003b70 con 0x7f13e41049b0 2024-09-21T01:01:28.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.199+0000 7f13ebad7640 1 -- 172.21.15.1:0/3920380566 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13e41a0680 con 0x7f13e41049b0 2024-09-21T01:01:28.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.199+0000 7f13daffd640 1 -- 172.21.15.1:0/3920380566 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13e000ee70 con 0x7f13e41049b0 2024-09-21T01:01:28.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.199+0000 7f13ebad7640 1 -- 172.21.15.1:0/3920380566 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13e41a6de0 con 0x7f13e41049b0 2024-09-21T01:01:28.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.199+0000 7f13daffd640 1 -- 172.21.15.1:0/3920380566 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e0010650 con 0x7f13e41049b0 2024-09-21T01:01:28.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.200+0000 7f13ebad7640 1 -- 172.21.15.1:0/3920380566 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13e4104dc0 con 0x7f13e41049b0 2024-09-21T01:01:28.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.203+0000 7f13daffd640 1 -- 172.21.15.1:0/3920380566 <== mon.2 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f13e0004a40 con 0x7f13e41049b0 2024-09-21T01:01:28.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.203+0000 7f13daffd640 1 --2- 172.21.15.1:0/3920380566 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f13d00b6510 0x7f13d00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:28.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.204+0000 7f13daffd640 1 -- 172.21.15.1:0/3920380566 <== mon.2 v2:172.21.15.42:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f13e00e7ae0 con 0x7f13e41049b0 2024-09-21T01:01:28.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.204+0000 7f13e9072640 1 --2- 172.21.15.1:0/3920380566 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f13d00b6510 0x7f13d00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:28.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.204+0000 7f13e9072640 1 --2- 172.21.15.1:0/3920380566 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f13d00b6510 0x7f13d00b8a20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f13e410fba0 tx=0x7f13d4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:28.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.207+0000 7f13daffd640 1 -- 172.21.15.1:0/3920380566 <== mon.2 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f13e00ae350 con 0x7f13e41049b0 2024-09-21T01:01:28.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.482+0000 7f13ebad7640 1 -- 172.21.15.1:0/3920380566 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13e419b550 con 0x7f13e41049b0 2024-09-21T01:01:28.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.483+0000 7f13daffd640 1 -- 172.21.15.1:0/3920380566 <== mon.2 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11962 (secure 0 0 0) 0x7f13e00b2730 con 0x7f13e41049b0 2024-09-21T01:01:28.484 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T01:01:28.484 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":33,"btime":"2024-09-21T01:00:33:343470+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2810186677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2810186677},{"type":"v1","addr":"172.21.15.1:6835","nonce":2810186677}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14736,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3935320478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3935320478},{"type":"v1","addr":"172.21.15.1:6837","nonce":3935320478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:54:58.592853+0000","modified":"2024-09-21T01:00:33.134699+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24653,"mds_1":24637,"mds_2":24626,"mds_3":24622,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/2125703572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2125703572},{"type":"v1","addr":"172.21.15.1:6839","nonce":2125703572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/3860445313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860445313},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860445313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6833/712170939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":712170939},{"type":"v1","addr":"172.21.15.193:6833","nonce":712170939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6833/1653911656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1653911656},{"type":"v1","addr":"172.21.15.42:6833","nonce":1653911656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6835/793085918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":793085918},{"type":"v1","addr":"172.21.15.42:6835","nonce":793085918}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6835/3631682268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":3631682268},{"type":"v1","addr":"172.21.15.193:6835","nonce":3631682268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.193:6837/909252228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":909252228},{"type":"v1","addr":"172.21.15.193:6837","nonce":909252228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.42:6837/2395608508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2395608508},{"type":"v1","addr":"172.21.15.42:6837","nonce":2395608508}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.193:6839/1365361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1365361177},{"type":"v1","addr":"172.21.15.193:6839","nonce":1365361177}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6839/2526476666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2526476666},{"type":"v1","addr":"172.21.15.42:6839","nonce":2526476666}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24610,24622,24626,24637,24653]},"id":1}]} 2024-09-21T01:01:28.484 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 33 2024-09-21T01:01:28.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.486+0000 7f13ebad7640 1 -- 172.21.15.1:0/3920380566 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f13d00b6510 msgr2=0x7f13d00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:28.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.486+0000 7f13ebad7640 1 --2- 172.21.15.1:0/3920380566 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f13d00b6510 0x7f13d00b8a20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f13e410fba0 tx=0x7f13d4005f90 comp rx=0 tx=0).stop 2024-09-21T01:01:28.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.486+0000 7f13ebad7640 1 -- 172.21.15.1:0/3920380566 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13e41049b0 msgr2=0x7f13e419a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:28.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.486+0000 7f13ebad7640 1 --2- 172.21.15.1:0/3920380566 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13e41049b0 0x7f13e419a420 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f13e000eb70 tx=0x7f13e000c6a0 comp rx=0 tx=0).stop 2024-09-21T01:01:28.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.486+0000 7f13ebad7640 1 -- 172.21.15.1:0/3920380566 shutdown_connections 2024-09-21T01:01:28.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.486+0000 7f13ebad7640 1 --2- 172.21.15.1:0/3920380566 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13e410de10 0x7f13e419fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:28.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.486+0000 7f13ebad7640 1 --2- 172.21.15.1:0/3920380566 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f13d00b6510 0x7f13d00b8a20 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:28.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.486+0000 7f13ebad7640 1 --2- 172.21.15.1:0/3920380566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13e4105300 0x7f13e419a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:28.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.486+0000 7f13ebad7640 1 --2- 172.21.15.1:0/3920380566 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13e41049b0 0x7f13e419a420 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:28.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.486+0000 7f13ebad7640 1 -- 172.21.15.1:0/3920380566 >> 172.21.15.1:0/3920380566 conn(0x7f13e4079730 msgr2=0x7f13e40ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:28.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.486+0000 7f13ebad7640 1 -- 172.21.15.1:0/3920380566 shutdown_connections 2024-09-21T01:01:28.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:28.486+0000 7f13ebad7640 1 -- 172.21.15.1:0/3920380566 wait complete. 2024-09-21T01:01:29.284 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T01:01:29.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.414+0000 7fe9819ad640 1 -- 172.21.15.1:0/342818090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe97c1025c0 msgr2=0x7fe97c102a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:29.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.414+0000 7fe9819ad640 1 --2- 172.21.15.1:0/342818090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe97c1025c0 0x7fe97c102a30 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fe96c009900 tx=0x7fe96c02a410 comp rx=0 tx=0).stop 2024-09-21T01:01:29.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.414+0000 7fe9819ad640 1 -- 172.21.15.1:0/342818090 shutdown_connections 2024-09-21T01:01:29.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.414+0000 7fe9819ad640 1 --2- 172.21.15.1:0/342818090 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe97c103fe0 0x7fe97c10a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:29.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.414+0000 7fe9819ad640 1 --2- 172.21.15.1:0/342818090 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe97c103640 0x7fe97c103a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:29.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.414+0000 7fe9819ad640 1 --2- 172.21.15.1:0/342818090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe97c1025c0 0x7fe97c102a30 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:29.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.414+0000 7fe9819ad640 1 -- 172.21.15.1:0/342818090 >> 172.21.15.1:0/342818090 conn(0x7fe97c0fdf00 msgr2=0x7fe97c1003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:29.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.414+0000 7fe9819ad640 1 -- 172.21.15.1:0/342818090 shutdown_connections 2024-09-21T01:01:29.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.414+0000 7fe9819ad640 1 -- 172.21.15.1:0/342818090 wait complete. 2024-09-21T01:01:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.415+0000 7fe9819ad640 1 Processor -- start 2024-09-21T01:01:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.415+0000 7fe9819ad640 1 -- start start 2024-09-21T01:01:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.416+0000 7fe9819ad640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe97c1025c0 0x7fe97c199f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.416+0000 7fe9819ad640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe97c103640 0x7fe97c19a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.416+0000 7fe9819ad640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe97c103fe0 0x7fe97c19b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.416+0000 7fe9819ad640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c10e200 con 0x7fe97c103fe0 2024-09-21T01:01:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.416+0000 7fe9819ad640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c10e080 con 0x7fe97c103640 2024-09-21T01:01:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.416+0000 7fe9819ad640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c10e380 con 0x7fe97c1025c0 2024-09-21T01:01:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.416+0000 7fe97b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe97c103fe0 0x7fe97c19b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.416+0000 7fe97a7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe97c103640 0x7fe97c19a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.416+0000 7fe97affd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe97c1025c0 0x7fe97c199f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.416+0000 7fe97b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe97c103fe0 0x7fe97c19b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46254/0 (socket says 172.21.15.1:46254) 2024-09-21T01:01:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.416+0000 7fe97b7fe640 1 -- 172.21.15.1:0/1129290175 learned_addr learned my addr 172.21.15.1:0/1129290175 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.416+0000 7fe97a7fc640 1 -- 172.21.15.1:0/1129290175 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe97c1025c0 msgr2=0x7fe97c199f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.416+0000 7fe97a7fc640 1 --2- 172.21.15.1:0/1129290175 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe97c1025c0 0x7fe97c199f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.416+0000 7fe97a7fc640 1 -- 172.21.15.1:0/1129290175 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe97c103fe0 msgr2=0x7fe97c19b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.416+0000 7fe97a7fc640 1 --2- 172.21.15.1:0/1129290175 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe97c103fe0 0x7fe97c19b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.416+0000 7fe97a7fc640 1 -- 172.21.15.1:0/1129290175 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe97c19b9a0 con 0x7fe97c103640 2024-09-21T01:01:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.416+0000 7fe97b7fe640 1 --2- 172.21.15.1:0/1129290175 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe97c103fe0 0x7fe97c19b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:01:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.416+0000 7fe97a7fc640 1 --2- 172.21.15.1:0/1129290175 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe97c103640 0x7fe97c19a5d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe97000e9f0 tx=0x7fe97000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.417+0000 7fe9809ab640 1 -- 172.21.15.1:0/1129290175 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97000cd80 con 0x7fe97c103640 2024-09-21T01:01:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.417+0000 7fe9819ad640 1 -- 172.21.15.1:0/1129290175 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe97c19bc90 con 0x7fe97c103640 2024-09-21T01:01:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.417+0000 7fe9809ab640 1 -- 172.21.15.1:0/1129290175 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9700035f0 con 0x7fe97c103640 2024-09-21T01:01:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.417+0000 7fe9809ab640 1 -- 172.21.15.1:0/1129290175 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe970010690 con 0x7fe97c103640 2024-09-21T01:01:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.417+0000 7fe9819ad640 1 -- 172.21.15.1:0/1129290175 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe97c104b30 con 0x7fe97c103640 2024-09-21T01:01:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.419+0000 7fe9889fc740 1 Processor -- start 2024-09-21T01:01:29.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.420+0000 7fe9889fc740 1 -- start start 2024-09-21T01:01:29.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.420+0000 7fe9809ab640 1 -- 172.21.15.1:0/1129290175 <== mon.2 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7fe9700108f0 con 0x7fe97c103640 2024-09-21T01:01:29.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.420+0000 7fe9889fc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fe0e4e1b0 0x558fe11f5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:29.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.420+0000 7fe9889fc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe0e252f0 0x558fe11f64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:29.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.420+0000 7fe9889fc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558fe0e2d4d0 0x558fe11f7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:29.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.420+0000 7fe9889fc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558fe11686f0 con 0x558fe0e252f0 2024-09-21T01:01:29.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.420+0000 7fe9889fc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558fe1157b20 con 0x558fe0e4e1b0 2024-09-21T01:01:29.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.420+0000 7fe9889fc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558fe115b930 con 0x558fe0e2d4d0 2024-09-21T01:01:29.422 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.420+0000 7fe97a7fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558fe0e2d4d0 0x558fe11f7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:29.422 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.420+0000 7fe97affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe0e252f0 0x558fe11f64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:29.422 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.421+0000 7fe97affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe0e252f0 0x558fe11f64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46256/0 (socket says 172.21.15.1:46256) 2024-09-21T01:01:29.422 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.421+0000 7fe97affd640 1 -- 172.21.15.1:0/3580134510 learned_addr learned my addr 172.21.15.1:0/3580134510 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:29.422 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.421+0000 7fe97b7fe640 1 --2- 172.21.15.1:0/3580134510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fe0e4e1b0 0x558fe11f5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:29.422 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.421+0000 7fe97affd640 1 -- 172.21.15.1:0/3580134510 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558fe0e2d4d0 msgr2=0x558fe11f7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:29.423 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.421+0000 7fe97affd640 1 --2- 172.21.15.1:0/3580134510 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558fe0e2d4d0 0x558fe11f7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:29.423 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.421+0000 7fe97affd640 1 -- 172.21.15.1:0/3580134510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fe0e4e1b0 msgr2=0x558fe11f5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:29.423 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.421+0000 7fe97affd640 1 --2- 172.21.15.1:0/3580134510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fe0e4e1b0 0x558fe11f5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:29.423 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.421+0000 7fe97affd640 1 -- 172.21.15.1:0/3580134510 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fe111d530 con 0x558fe0e252f0 2024-09-21T01:01:29.423 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.422+0000 7fe97affd640 1 --2- 172.21.15.1:0/3580134510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe0e252f0 0x558fe11f64c0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe96c02a930 tx=0x7fe96c009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bdd0285662dcbcb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:29.423 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.423+0000 7fe961ffb640 1 -- 172.21.15.1:0/3580134510 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96c035030 con 0x558fe0e252f0 2024-09-21T01:01:29.424 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.423+0000 7fe961ffb640 1 -- 172.21.15.1:0/3580134510 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe96c040070 con 0x558fe0e252f0 2024-09-21T01:01:29.424 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.423+0000 7fe9809ab640 1 --2- 172.21.15.1:0/1129290175 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe9640b6590 0x7fe9640b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:29.424 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.424+0000 7fe961ffb640 1 -- 172.21.15.1:0/3580134510 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96c035030 con 0x558fe0e252f0 2024-09-21T01:01:29.425 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.424+0000 7fe97b7fe640 1 --2- 172.21.15.1:0/1129290175 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe9640b6590 0x7fe9640b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:29.425 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.424+0000 7fe9809ab640 1 -- 172.21.15.1:0/1129290175 <== mon.2 v2:172.21.15.42:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fe9700e7660 con 0x7fe97c103640 2024-09-21T01:01:29.425 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.424+0000 7fe9889fc740 1 -- 172.21.15.1:0/3580134510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe0e252f0 msgr2=0x558fe11f64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:29.425 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.424+0000 7fe9889fc740 1 --2- 172.21.15.1:0/3580134510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe0e252f0 0x558fe11f64c0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe96c02a930 tx=0x7fe96c009620 comp rx=0 tx=0).stop 2024-09-21T01:01:29.425 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.425+0000 7fe97b7fe640 1 --2- 172.21.15.1:0/1129290175 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe9640b6590 0x7fe9640b8aa0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe9740049d0 tx=0x7fe974009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.425+0000 7fe9889fc740 1 -- 172.21.15.1:0/3580134510 shutdown_connections 2024-09-21T01:01:29.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.426+0000 7fe9889fc740 1 --2- 172.21.15.1:0/3580134510 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558fe0e2d4d0 0x558fe11f7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:29.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.426+0000 7fe9889fc740 1 --2- 172.21.15.1:0/3580134510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe0e252f0 0x558fe11f64c0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:29.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.426+0000 7fe9889fc740 1 --2- 172.21.15.1:0/3580134510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fe0e4e1b0 0x558fe11f5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:29.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.426+0000 7fe9889fc740 1 -- 172.21.15.1:0/3580134510 >> 172.21.15.1:0/3580134510 conn(0x558fe0e42300 msgr2=0x558fe11f18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:29.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.426+0000 7fe9889fc740 1 -- 172.21.15.1:0/3580134510 shutdown_connections 2024-09-21T01:01:29.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.426+0000 7fe9889fc740 1 -- 172.21.15.1:0/3580134510 wait complete. 2024-09-21T01:01:29.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.426+0000 7fe9889fc740 1 -- start start 2024-09-21T01:01:29.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.426+0000 7fe9889fc740 1 Processor -- start 2024-09-21T01:01:29.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.427+0000 7fe9889fc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe0e252f0 0x558fe11ff620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:29.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.427+0000 7fe9889fc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558fe0e2d4d0 0x558fe11ffce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:29.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.427+0000 7fe9889fc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fe0e4e1b0 0x558fe12007e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:29.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.427+0000 7fe9889fc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558fe108fab0 con 0x558fe0e252f0 2024-09-21T01:01:29.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.427+0000 7fe9889fc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558fe10fd730 con 0x558fe0e4e1b0 2024-09-21T01:01:29.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.427+0000 7fe9889fc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558fe11f7b20 con 0x558fe0e2d4d0 2024-09-21T01:01:29.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.427+0000 7fe9889fc740 10 client.0 _ll_register_callbacks cb 0x558fe11516b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:01:29.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.427+0000 7fe97affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe0e252f0 0x558fe11ff620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:29.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.427+0000 7fe97affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe0e252f0 0x558fe11ff620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46270/0 (socket says 172.21.15.1:46270) 2024-09-21T01:01:29.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.427+0000 7fe97affd640 1 -- 172.21.15.1:0/3571891172 learned_addr learned my addr 172.21.15.1:0/3571891172 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:29.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.427+0000 7fe97a7fc640 1 --2- 172.21.15.1:0/3571891172 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558fe0e2d4d0 0x558fe11ffce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:29.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.427+0000 7fe97b7fe640 1 --2- 172.21.15.1:0/3571891172 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fe0e4e1b0 0x558fe12007e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:29.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.428+0000 7fe97a7fc640 1 -- 172.21.15.1:0/3571891172 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fe0e4e1b0 msgr2=0x558fe12007e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:29.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.428+0000 7fe97a7fc640 1 --2- 172.21.15.1:0/3571891172 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fe0e4e1b0 0x558fe12007e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:29.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.428+0000 7fe97a7fc640 1 -- 172.21.15.1:0/3571891172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe0e252f0 msgr2=0x558fe11ff620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:29.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.428+0000 7fe97a7fc640 1 --2- 172.21.15.1:0/3571891172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe0e252f0 0x558fe11ff620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:29.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.428+0000 7fe97a7fc640 1 -- 172.21.15.1:0/3571891172 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fe0eb9790 con 0x558fe0e2d4d0 2024-09-21T01:01:29.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.428+0000 7fe97affd640 1 --2- 172.21.15.1:0/3571891172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe0e252f0 0x558fe11ff620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:01:29.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.428+0000 7fe97b7fe640 1 --2- 172.21.15.1:0/3571891172 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fe0e4e1b0 0x558fe12007e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:01:29.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.428+0000 7fe97a7fc640 1 --2- 172.21.15.1:0/3571891172 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558fe0e2d4d0 0x558fe11ffce0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe970000c00 tx=0x7fe970003cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96736ba20d7368b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:29.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.428+0000 7fe95f7f6640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T01:01:29.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.428+0000 7fe95f7f6640 1 -- 172.21.15.1:0/3571891172 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9700acee0 con 0x558fe0e2d4d0 2024-09-21T01:01:29.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.428+0000 7fe9889fc740 1 -- 172.21.15.1:0/3571891172 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe96c040070 con 0x558fe0e2d4d0 2024-09-21T01:01:29.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.428+0000 7fe95f7f6640 1 -- 172.21.15.1:0/3571891172 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fe9700a99e0 con 0x558fe0e2d4d0 2024-09-21T01:01:29.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.429+0000 7fe95f7f6640 1 -- 172.21.15.1:0/3571891172 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fe9700ad280 con 0x558fe0e2d4d0 2024-09-21T01:01:29.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.429+0000 7fe9889fc740 10 client.26212 fetch_fsmap learned FSMap version 33 2024-09-21T01:01:29.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.429+0000 7fe9889fc740 1 -- 172.21.15.1:0/3571891172 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558fe0f32620 con 0x558fe0e2d4d0 2024-09-21T01:01:29.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.429+0000 7fe95f7f6640 1 -- 172.21.15.1:0/3571891172 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe96c040070 con 0x558fe0e2d4d0 2024-09-21T01:01:29.436 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.429+0000 7fe95f7f6640 1 -- 172.21.15.1:0/3571891172 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fe9700a90c0 con 0x558fe0e2d4d0 2024-09-21T01:01:29.436 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.429+0000 7fe9889fc740 10 client.26212 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:01:29.436 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.429+0000 7fe9889fc740 10 client.26212 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:01:29.436 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.429+0000 7fe9889fc740 20 client.26212 populate_metadata read hostname 'smithi001' 2024-09-21T01:01:29.436 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.429+0000 7fe9889fc740 1 --2- 172.21.15.1:0/3571891172 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558fe0e0cd80 0x558fe120cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:29.436 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.429+0000 7fe9889fc740 4 client.26212 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:01:29.436 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.429+0000 7fe9889fc740 1 -- 172.21.15.1:0/3571891172 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558fe116a640 con 0x558fe0e0cd80 2024-09-21T01:01:29.436 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.430+0000 7fe97affd640 1 --2- 172.21.15.1:0/3571891172 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558fe0e0cd80 0x558fe120cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:29.436 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.430+0000 7fe97affd640 1 --2- 172.21.15.1:0/3571891172 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558fe0e0cd80 0x558fe120cc80 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=445357b665fac94a server_cookie=b7fa581749744733 in_seq=0 out_seq=0 2024-09-21T01:01:29.436 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.430+0000 7fe95f7f6640 10 client.26212 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:01:29.436 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.431+0000 7fe95f7f6640 1 -- 172.21.15.1:0/3571891172 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558fe116a640 con 0x558fe0e0cd80 2024-09-21T01:01:29.436 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.431+0000 7fe95f7f6640 10 client.26212 handle_command_reply: tid=0 2024-09-21T01:01:29.436 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.431+0000 7fe9889fc740 1 client.26212 shutdown 2024-09-21T01:01:29.436 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.431+0000 7fe9889fc740 1 -- 172.21.15.1:0/3571891172 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558fe0e2d4d0 msgr2=0x558fe11ffce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:29.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.431+0000 7fe9889fc740 1 --2- 172.21.15.1:0/3571891172 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558fe0e2d4d0 0x558fe11ffce0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe970000c00 tx=0x7fe970003cf0 comp rx=0 tx=0).stop 2024-09-21T01:01:29.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.431+0000 7fe9889fc740 1 -- 172.21.15.1:0/3571891172 shutdown_connections 2024-09-21T01:01:29.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.431+0000 7fe9889fc740 1 --2- 172.21.15.1:0/3571891172 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558fe0e0cd80 0x558fe120cc80 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:29.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.431+0000 7fe9889fc740 1 --2- 172.21.15.1:0/3571891172 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fe0e4e1b0 0x558fe12007e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:29.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.431+0000 7fe9889fc740 1 --2- 172.21.15.1:0/3571891172 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558fe0e2d4d0 0x558fe11ffce0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:29.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.431+0000 7fe9889fc740 1 --2- 172.21.15.1:0/3571891172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe0e252f0 0x558fe11ff620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:29.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.432+0000 7fe9889fc740 1 -- 172.21.15.1:0/3571891172 >> 172.21.15.1:0/3571891172 conn(0x558fe0e42300 msgr2=0x558fe11f24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:29.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.432+0000 7fe95f7f6640 0 client.26212 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:01:29.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.432+0000 7fe9889fc740 1 -- 172.21.15.1:0/3571891172 shutdown_connections 2024-09-21T01:01:29.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.432+0000 7fe9889fc740 1 -- 172.21.15.1:0/3571891172 wait complete. 2024-09-21T01:01:29.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.432+0000 7fe9889fc740 20 client.26212 trim_cache size 0 max 16384 2024-09-21T01:01:29.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.450+0000 7fe9889fc740 1 Processor -- start 2024-09-21T01:01:29.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.450+0000 7fe9889fc740 1 -- start start 2024-09-21T01:01:29.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.450+0000 7fe9889fc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fe0e252f0 0x558fe11fe820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:29.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.450+0000 7fe9889fc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe0e2d4d0 0x558fe11ec5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:29.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.450+0000 7fe9889fc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558fe0e4e1b0 0x558fe11f1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:29.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.450+0000 7fe9889fc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c1ad240 con 0x558fe0e2d4d0 2024-09-21T01:01:29.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.450+0000 7fe9889fc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c1aee40 con 0x558fe0e252f0 2024-09-21T01:01:29.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.450+0000 7fe9889fc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c1ad910 con 0x558fe0e4e1b0 2024-09-21T01:01:29.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.451+0000 7fe97affd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fe0e252f0 0x558fe11fe820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:29.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.451+0000 7fe97b7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558fe0e4e1b0 0x558fe11f1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:29.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.451+0000 7fe97a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe0e2d4d0 0x558fe11ec5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:29.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.451+0000 7fe97affd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fe0e252f0 0x558fe11fe820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:51158/0 (socket says 172.21.15.1:51158) 2024-09-21T01:01:29.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.451+0000 7fe97affd640 1 -- 172.21.15.1:0/1283849219 learned_addr learned my addr 172.21.15.1:0/1283849219 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:29.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.451+0000 7fe97a7fc640 1 -- 172.21.15.1:0/1283849219 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558fe0e4e1b0 msgr2=0x558fe11f1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:29.453 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.451+0000 7fe97a7fc640 1 --2- 172.21.15.1:0/1283849219 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558fe0e4e1b0 0x558fe11f1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:29.453 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.451+0000 7fe97a7fc640 1 -- 172.21.15.1:0/1283849219 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fe0e252f0 msgr2=0x558fe11fe820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:29.453 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.451+0000 7fe97a7fc640 1 --2- 172.21.15.1:0/1283849219 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fe0e252f0 0x558fe11fe820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:29.453 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.451+0000 7fe97a7fc640 1 -- 172.21.15.1:0/1283849219 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fe1200b50 con 0x558fe0e2d4d0 2024-09-21T01:01:29.453 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.451+0000 7fe97affd640 1 --2- 172.21.15.1:0/1283849219 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fe0e252f0 0x558fe11fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:01:29.453 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.451+0000 7fe97a7fc640 1 --2- 172.21.15.1:0/1283849219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe0e2d4d0 0x558fe11ec5c0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fe97000cfd0 tx=0x7fe970014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a95668a02aca8d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:29.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.457+0000 7fe9617fa640 1 -- 172.21.15.1:0/1283849219 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9700d3070 con 0x558fe0e2d4d0 2024-09-21T01:01:29.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.457+0000 7fe9617fa640 1 -- 172.21.15.1:0/1283849219 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9700e7440 con 0x558fe0e2d4d0 2024-09-21T01:01:29.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.457+0000 7fe9617fa640 1 -- 172.21.15.1:0/1283849219 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9700a90c0 con 0x558fe0e2d4d0 2024-09-21T01:01:29.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.458+0000 7fe9889fc740 1 -- 172.21.15.1:0/1283849219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe0e2d4d0 msgr2=0x558fe11ec5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:29.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.458+0000 7fe9889fc740 1 --2- 172.21.15.1:0/1283849219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe0e2d4d0 0x558fe11ec5c0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fe97000cfd0 tx=0x7fe970014000 comp rx=0 tx=0).stop 2024-09-21T01:01:29.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.458+0000 7fe9889fc740 1 -- 172.21.15.1:0/1283849219 shutdown_connections 2024-09-21T01:01:29.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.458+0000 7fe9889fc740 1 --2- 172.21.15.1:0/1283849219 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558fe0e4e1b0 0x558fe11f1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:29.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.458+0000 7fe9889fc740 1 --2- 172.21.15.1:0/1283849219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe0e2d4d0 0x558fe11ec5c0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:29.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.458+0000 7fe9889fc740 1 --2- 172.21.15.1:0/1283849219 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fe0e252f0 0x558fe11fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:29.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.458+0000 7fe9889fc740 1 -- 172.21.15.1:0/1283849219 >> 172.21.15.1:0/1283849219 conn(0x558fe0e42300 msgr2=0x558fe11fe050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:29.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.458+0000 7fe9889fc740 1 -- 172.21.15.1:0/1283849219 shutdown_connections 2024-09-21T01:01:29.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.458+0000 7fe9889fc740 1 -- 172.21.15.1:0/1283849219 wait complete. 2024-09-21T01:01:29.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.459+0000 7fe9889fc740 1 -- start start 2024-09-21T01:01:29.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.459+0000 7fe9889fc740 1 Processor -- start 2024-09-21T01:01:29.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.459+0000 7fe9889fc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe0e252f0 0x558fe12042b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:29.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.459+0000 7fe9889fc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fe0e2d4d0 0x558fe1204970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:29.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.459+0000 7fe9889fc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558fe0e4e1b0 0x558fe12054e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:29.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.459+0000 7fe9889fc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c1ae770 con 0x558fe0e252f0 2024-09-21T01:01:29.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.459+0000 7fe9889fc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c1ae0a0 con 0x558fe0e2d4d0 2024-09-21T01:01:29.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.459+0000 7fe9889fc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c1ab220 con 0x558fe0e4e1b0 2024-09-21T01:01:29.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.459+0000 7fe9889fc740 10 client.0 _ll_register_callbacks cb 0x7fe970003d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:01:29.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.459+0000 7fe97affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe0e252f0 0x558fe12042b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:29.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.460+0000 7fe97affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe0e252f0 0x558fe12042b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46300/0 (socket says 172.21.15.1:46300) 2024-09-21T01:01:29.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.460+0000 7fe97affd640 1 -- 172.21.15.1:0/274091500 learned_addr learned my addr 172.21.15.1:0/274091500 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:29.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.460+0000 7fe97a7fc640 1 --2- 172.21.15.1:0/274091500 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fe0e2d4d0 0x558fe1204970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:29.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.460+0000 7fe97b7fe640 1 --2- 172.21.15.1:0/274091500 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558fe0e4e1b0 0x558fe12054e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:29.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.460+0000 7fe97affd640 1 -- 172.21.15.1:0/274091500 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558fe0e4e1b0 msgr2=0x558fe12054e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:29.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.460+0000 7fe97affd640 1 --2- 172.21.15.1:0/274091500 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558fe0e4e1b0 0x558fe12054e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:29.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.460+0000 7fe97affd640 1 -- 172.21.15.1:0/274091500 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fe0e2d4d0 msgr2=0x558fe1204970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:29.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.460+0000 7fe97affd640 1 --2- 172.21.15.1:0/274091500 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fe0e2d4d0 0x558fe1204970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:29.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.460+0000 7fe97affd640 1 -- 172.21.15.1:0/274091500 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fe1205c40 con 0x558fe0e252f0 2024-09-21T01:01:29.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.460+0000 7fe97a7fc640 1 --2- 172.21.15.1:0/274091500 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fe0e2d4d0 0x558fe1204970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:01:29.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.460+0000 7fe97affd640 1 --2- 172.21.15.1:0/274091500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe0e252f0 0x558fe12042b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x558fe120d3f0 tx=0x7fe96c0314c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0fc8b83646867d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:29.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.460+0000 7fe95f7f6640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:01:29.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.460+0000 7fe95f7f6640 1 -- 172.21.15.1:0/274091500 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96c035040 con 0x558fe0e252f0 2024-09-21T01:01:29.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.461+0000 7fe9889fc740 1 -- 172.21.15.1:0/274091500 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558fe11660f0 con 0x558fe0e252f0 2024-09-21T01:01:29.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.461+0000 7fe95f7f6640 1 -- 172.21.15.1:0/274091500 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fe96c004030 con 0x558fe0e252f0 2024-09-21T01:01:29.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.461+0000 7fe95f7f6640 1 -- 172.21.15.1:0/274091500 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fe96c004230 con 0x558fe0e252f0 2024-09-21T01:01:29.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.461+0000 7fe9889fc740 10 client.16674 fetch_fsmap learned FSMap version 33 2024-09-21T01:01:29.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.461+0000 7fe9889fc740 1 -- 172.21.15.1:0/274091500 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558fe1207030 con 0x558fe0e252f0 2024-09-21T01:01:29.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.461+0000 7fe95f7f6640 1 -- 172.21.15.1:0/274091500 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x558fe11660f0 con 0x558fe0e252f0 2024-09-21T01:01:29.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.461+0000 7fe95f7f6640 1 -- 172.21.15.1:0/274091500 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fe96c045470 con 0x558fe0e252f0 2024-09-21T01:01:29.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.461+0000 7fe9889fc740 10 client.16674 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:01:29.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.461+0000 7fe9889fc740 10 client.16674 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:01:29.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.461+0000 7fe9889fc740 20 client.16674 populate_metadata read hostname 'smithi001' 2024-09-21T01:01:29.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.461+0000 7fe9889fc740 1 --2- 172.21.15.1:0/274091500 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558fe0de21c0 0x558fe1279690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:29.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.461+0000 7fe9889fc740 4 client.16674 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:01:29.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.461+0000 7fe9889fc740 1 -- 172.21.15.1:0/274091500 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558fe1163520 con 0x558fe0de21c0 2024-09-21T01:01:29.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.462+0000 7fe97a7fc640 1 --2- 172.21.15.1:0/274091500 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558fe0de21c0 0x558fe1279690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:29.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.462+0000 7fe95f7f6640 10 client.16674 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:01:29.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.462+0000 7fe97a7fc640 1 --2- 172.21.15.1:0/274091500 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558fe0de21c0 0x558fe1279690 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1edd122e8c35afe6 server_cookie=bd136bb997c020e7 in_seq=0 out_seq=0 2024-09-21T01:01:29.707 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.706+0000 7fe95f7f6640 1 -- 172.21.15.1:0/274091500 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558fe1163520 con 0x558fe0de21c0 2024-09-21T01:01:29.707 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.706+0000 7fe95f7f6640 10 client.16674 handle_command_reply: tid=0 2024-09-21T01:01:29.707 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.706+0000 7fe9889fc740 1 client.16674 shutdown 2024-09-21T01:01:29.707 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.706+0000 7fe9889fc740 1 -- 172.21.15.1:0/274091500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe0e252f0 msgr2=0x558fe12042b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:29.707 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.706+0000 7fe9889fc740 1 --2- 172.21.15.1:0/274091500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe0e252f0 0x558fe12042b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x558fe120d3f0 tx=0x7fe96c0314c0 comp rx=0 tx=0).stop 2024-09-21T01:01:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T01:01:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T01:01:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T01:01:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T01:01:29.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:29 smithi001 ceph-mon[31211]: pgmap v486: 97 pgs: 97 active+clean; 537 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 1.4 MiB/s wr, 156 op/s 2024-09-21T01:01:29.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:29 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/3920380566' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:01:29.714 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.706+0000 7fe9889fc740 1 -- 172.21.15.1:0/274091500 shutdown_connections 2024-09-21T01:01:29.714 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.706+0000 7fe9889fc740 1 --2- 172.21.15.1:0/274091500 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558fe0de21c0 0x558fe1279690 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:29.714 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.706+0000 7fe9889fc740 1 --2- 172.21.15.1:0/274091500 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558fe0e4e1b0 0x558fe12054e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:29.714 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.706+0000 7fe9889fc740 1 --2- 172.21.15.1:0/274091500 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fe0e2d4d0 0x558fe1204970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:29.714 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.706+0000 7fe9889fc740 1 --2- 172.21.15.1:0/274091500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe0e252f0 0x558fe12042b0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:29.714 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.706+0000 7fe9889fc740 1 -- 172.21.15.1:0/274091500 >> 172.21.15.1:0/274091500 conn(0x558fe0e42300 msgr2=0x558fe11fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:29.714 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.706+0000 7fe95f7f6640 0 client.16674 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:01:29.714 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.707+0000 7fe9889fc740 1 -- 172.21.15.1:0/274091500 shutdown_connections 2024-09-21T01:01:29.714 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.707+0000 7fe9889fc740 1 -- 172.21.15.1:0/274091500 wait complete. 2024-09-21T01:01:29.714 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.707+0000 7fe9889fc740 20 client.16674 trim_cache size 0 max 16384 2024-09-21T01:01:29.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:29 smithi193 ceph-mon[34660]: pgmap v486: 97 pgs: 97 active+clean; 537 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 1.4 MiB/s wr, 156 op/s 2024-09-21T01:01:29.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:29 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/3920380566' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:01:29.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:29 smithi042 ceph-mon[34481]: pgmap v486: 97 pgs: 97 active+clean; 537 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 1.4 MiB/s wr, 156 op/s 2024-09-21T01:01:29.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:29 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/3920380566' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:01:29.804 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.803+0000 7fe9819ad640 1 -- 172.21.15.1:0/1129290175 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe9640b6590 msgr2=0x7fe9640b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:29.804 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.803+0000 7fe9819ad640 1 --2- 172.21.15.1:0/1129290175 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe9640b6590 0x7fe9640b8aa0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe9740049d0 tx=0x7fe974009500 comp rx=0 tx=0).stop 2024-09-21T01:01:29.804 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.803+0000 7fe9819ad640 1 -- 172.21.15.1:0/1129290175 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe97c103640 msgr2=0x7fe97c19a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:29.804 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.803+0000 7fe9819ad640 1 --2- 172.21.15.1:0/1129290175 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe97c103640 0x7fe97c19a5d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe97000e9f0 tx=0x7fe97000eeb0 comp rx=0 tx=0).stop 2024-09-21T01:01:29.804 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.803+0000 7fe9819ad640 1 -- 172.21.15.1:0/1129290175 shutdown_connections 2024-09-21T01:01:29.804 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.803+0000 7fe9819ad640 1 --2- 172.21.15.1:0/1129290175 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe9640b6590 0x7fe9640b8aa0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:29.804 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.803+0000 7fe9819ad640 1 --2- 172.21.15.1:0/1129290175 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe97c103fe0 0x7fe97c19b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:29.804 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.803+0000 7fe9819ad640 1 --2- 172.21.15.1:0/1129290175 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe97c103640 0x7fe97c19a5d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:29.804 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.803+0000 7fe9819ad640 1 --2- 172.21.15.1:0/1129290175 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe97c1025c0 0x7fe97c199f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:29.805 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.803+0000 7fe9819ad640 1 -- 172.21.15.1:0/1129290175 >> 172.21.15.1:0/1129290175 conn(0x7fe97c0fdf00 msgr2=0x7fe97c0ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.807+0000 7fe9819ad640 1 -- 172.21.15.1:0/1129290175 shutdown_connections 2024-09-21T01:01:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:29.807+0000 7fe9819ad640 1 -- 172.21.15.1:0/1129290175 wait complete. 2024-09-21T01:01:30.240 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:01:31.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.047+0000 7fdc12299640 1 -- 172.21.15.1:0/4049189118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc0c1082a0 msgr2=0x7fdc0c10ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:31.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.047+0000 7fdc12299640 1 --2- 172.21.15.1:0/4049189118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc0c1082a0 0x7fdc0c10ead0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fdc0401acb0 tx=0x7fdc0403d7d0 comp rx=0 tx=0).stop 2024-09-21T01:01:31.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.048+0000 7fdc12299640 1 -- 172.21.15.1:0/4049189118 shutdown_connections 2024-09-21T01:01:31.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.048+0000 7fdc12299640 1 --2- 172.21.15.1:0/4049189118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc0c1082a0 0x7fdc0c10ead0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:31.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.048+0000 7fdc12299640 1 --2- 172.21.15.1:0/4049189118 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc0c107950 0x7fdc0c107d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:31.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.048+0000 7fdc12299640 1 --2- 172.21.15.1:0/4049189118 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdc0c102010 0x7fdc0c102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:31.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.048+0000 7fdc12299640 1 -- 172.21.15.1:0/4049189118 >> 172.21.15.1:0/4049189118 conn(0x7fdc0c077aa0 msgr2=0x7fdc0c077ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:31.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.049+0000 7fdc12299640 1 -- 172.21.15.1:0/4049189118 shutdown_connections 2024-09-21T01:01:31.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.049+0000 7fdc12299640 1 -- 172.21.15.1:0/4049189118 wait complete. 2024-09-21T01:01:31.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.051+0000 7fdc12299640 1 Processor -- start 2024-09-21T01:01:31.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.051+0000 7fdc12299640 1 -- start start 2024-09-21T01:01:31.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.051+0000 7fdc12299640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc0c102010 0x7fdc0c10a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:31.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.051+0000 7fdc12299640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc0c107950 0x7fdc0c10ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:31.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.051+0000 7fdc12299640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdc0c1082a0 0x7fdc0c19b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:31.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.052+0000 7fdc12299640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c06ee60 con 0x7fdc0c107950 2024-09-21T01:01:31.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.052+0000 7fdc12299640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c06ece0 con 0x7fdc0c1082a0 2024-09-21T01:01:31.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.052+0000 7fdc12299640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c06efe0 con 0x7fdc0c102010 2024-09-21T01:01:31.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.052+0000 7fdc11a98640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdc0c1082a0 0x7fdc0c19b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:31.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.052+0000 7fdc11a98640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdc0c1082a0 0x7fdc0c19b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:51198/0 (socket says 172.21.15.1:51198) 2024-09-21T01:01:31.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.052+0000 7fdc11a98640 1 -- 172.21.15.1:0/2857257780 learned_addr learned my addr 172.21.15.1:0/2857257780 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:31.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.052+0000 7fdc11297640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc0c102010 0x7fdc0c10a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:31.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.052+0000 7fdc10a96640 1 --2- 172.21.15.1:0/2857257780 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc0c107950 0x7fdc0c10ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:31.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.053+0000 7fdc11297640 1 -- 172.21.15.1:0/2857257780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdc0c1082a0 msgr2=0x7fdc0c19b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:31.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.053+0000 7fdc11297640 1 --2- 172.21.15.1:0/2857257780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdc0c1082a0 0x7fdc0c19b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:31.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.053+0000 7fdc11297640 1 -- 172.21.15.1:0/2857257780 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc0c107950 msgr2=0x7fdc0c10ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:31.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.053+0000 7fdc11297640 1 --2- 172.21.15.1:0/2857257780 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc0c107950 0x7fdc0c10ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:31.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.053+0000 7fdc11297640 1 -- 172.21.15.1:0/2857257780 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc0c19bab0 con 0x7fdc0c102010 2024-09-21T01:01:31.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.053+0000 7fdc11a98640 1 --2- 172.21.15.1:0/2857257780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdc0c1082a0 0x7fdc0c19b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:01:31.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.053+0000 7fdc10a96640 1 --2- 172.21.15.1:0/2857257780 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc0c107950 0x7fdc0c10ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:01:31.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.053+0000 7fdc11297640 1 --2- 172.21.15.1:0/2857257780 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc0c102010 0x7fdc0c10a5f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdc0800b3f0 tx=0x7fdc0800b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:31.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.054+0000 7fdc027fc640 1 -- 172.21.15.1:0/2857257780 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc08015020 con 0x7fdc0c102010 2024-09-21T01:01:31.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.055+0000 7fdc027fc640 1 -- 172.21.15.1:0/2857257780 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc08011ce0 con 0x7fdc0c102010 2024-09-21T01:01:31.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.055+0000 7fdc027fc640 1 -- 172.21.15.1:0/2857257780 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc08010d60 con 0x7fdc0c102010 2024-09-21T01:01:31.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.055+0000 7fdc12299640 1 -- 172.21.15.1:0/2857257780 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc0c19bda0 con 0x7fdc0c102010 2024-09-21T01:01:31.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.055+0000 7fdc12299640 1 -- 172.21.15.1:0/2857257780 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc0c19c310 con 0x7fdc0c102010 2024-09-21T01:01:31.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.060+0000 7fdc027fc640 1 -- 172.21.15.1:0/2857257780 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7fdc08018020 con 0x7fdc0c102010 2024-09-21T01:01:31.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.061+0000 7fdc19a6f740 1 Processor -- start 2024-09-21T01:01:31.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.061+0000 7fdc19a6f740 1 -- start start 2024-09-21T01:01:31.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.061+0000 7fdc19a6f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ffc63a6070 0x55ffc674d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:31.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.062+0000 7fdc19a6f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ffc637d1b0 0x55ffc674dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:31.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.062+0000 7fdc19a6f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffc6385390 0x55ffc674e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:31.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.062+0000 7fdc19a6f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ffc66c3ea0 con 0x55ffc637d1b0 2024-09-21T01:01:31.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.062+0000 7fdc19a6f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ffc66b32d0 con 0x55ffc6385390 2024-09-21T01:01:31.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.062+0000 7fdc19a6f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ffc66b70e0 con 0x55ffc63a6070 2024-09-21T01:01:31.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.062+0000 7fdc11a98640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ffc63a6070 0x55ffc674d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:31.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.062+0000 7fdc11a98640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ffc63a6070 0x55ffc674d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:39866/0 (socket says 172.21.15.1:39866) 2024-09-21T01:01:31.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.062+0000 7fdc11a98640 1 -- 172.21.15.1:0/3048166272 learned_addr learned my addr 172.21.15.1:0/3048166272 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:31.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.062+0000 7fdc10a96640 1 --2- 172.21.15.1:0/3048166272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffc6385390 0x55ffc674e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:31.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.062+0000 7fdc10a96640 1 -- 172.21.15.1:0/3048166272 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ffc63a6070 msgr2=0x55ffc674d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:31.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.062+0000 7fdc10a96640 1 --2- 172.21.15.1:0/3048166272 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ffc63a6070 0x55ffc674d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:31.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.062+0000 7fdc10a96640 1 -- 172.21.15.1:0/3048166272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ffc637d1b0 msgr2=0x55ffc674dda0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:01:31.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.062+0000 7fdc10a96640 1 --2- 172.21.15.1:0/3048166272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ffc637d1b0 0x55ffc674dda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:31.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.062+0000 7fdc10a96640 1 -- 172.21.15.1:0/3048166272 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffc6411650 con 0x55ffc6385390 2024-09-21T01:01:31.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.063+0000 7fdc10a96640 1 --2- 172.21.15.1:0/3048166272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffc6385390 0x55ffc674e2e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c06cd20 tx=0x7fdbfc00e5a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a39a526f42e0502 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:31.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.063+0000 7fdc027fc640 1 --2- 172.21.15.1:0/2857257780 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fdbf80b6720 0x7fdbf80b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:31.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.063+0000 7fdc027fc640 1 -- 172.21.15.1:0/2857257780 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fdc080e68a0 con 0x7fdc0c102010 2024-09-21T01:01:31.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.064+0000 7fdc11a98640 1 --2- 172.21.15.1:0/3048166272 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ffc63a6070 0x55ffc674d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:01:31.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.065+0000 7fdc11a98640 1 --2- 172.21.15.1:0/2857257780 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fdbf80b6720 0x7fdbf80b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:31.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.066+0000 7fdbf77fe640 1 -- 172.21.15.1:0/3048166272 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc017070 con 0x55ffc6385390 2024-09-21T01:01:31.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.066+0000 7fdbf77fe640 1 -- 172.21.15.1:0/3048166272 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdbfc00ee90 con 0x55ffc6385390 2024-09-21T01:01:31.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.066+0000 7fdbf77fe640 1 -- 172.21.15.1:0/3048166272 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc0127a0 con 0x55ffc6385390 2024-09-21T01:01:31.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.069+0000 7fdc11a98640 1 --2- 172.21.15.1:0/2857257780 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fdbf80b6720 0x7fdbf80b8c30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdc0401aa10 tx=0x7fdc0401a470 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:31.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.069+0000 7fdc19a6f740 1 -- 172.21.15.1:0/3048166272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffc6385390 msgr2=0x55ffc674e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:31.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.069+0000 7fdc19a6f740 1 --2- 172.21.15.1:0/3048166272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffc6385390 0x55ffc674e2e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c06cd20 tx=0x7fdbfc00e5a0 comp rx=0 tx=0).stop 2024-09-21T01:01:31.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.069+0000 7fdc19a6f740 1 -- 172.21.15.1:0/3048166272 shutdown_connections 2024-09-21T01:01:31.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.069+0000 7fdc19a6f740 1 --2- 172.21.15.1:0/3048166272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffc6385390 0x55ffc674e2e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:31.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.069+0000 7fdc19a6f740 1 --2- 172.21.15.1:0/3048166272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ffc637d1b0 0x55ffc674dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:31.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.069+0000 7fdc19a6f740 1 --2- 172.21.15.1:0/3048166272 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ffc63a6070 0x55ffc674d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:31.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.069+0000 7fdc19a6f740 1 -- 172.21.15.1:0/3048166272 >> 172.21.15.1:0/3048166272 conn(0x55ffc639a460 msgr2=0x55ffc674b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:31.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.070+0000 7fdc19a6f740 1 -- 172.21.15.1:0/3048166272 shutdown_connections 2024-09-21T01:01:31.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.070+0000 7fdc19a6f740 1 -- 172.21.15.1:0/3048166272 wait complete. 2024-09-21T01:01:31.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.071+0000 7fdc19a6f740 1 -- start start 2024-09-21T01:01:31.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.071+0000 7fdc19a6f740 1 Processor -- start 2024-09-21T01:01:31.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.072+0000 7fdc19a6f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ffc637d1b0 0x55ffc6758f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:31.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.072+0000 7fdc19a6f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ffc6385390 0x55ffc67594b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:31.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.072+0000 7fdc19a6f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffc63a6070 0x55ffc6765330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:31.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.072+0000 7fdc19a6f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ffc6514700 con 0x55ffc637d1b0 2024-09-21T01:01:31.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.072+0000 7fdc19a6f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ffc664e160 con 0x55ffc63a6070 2024-09-21T01:01:31.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.072+0000 7fdc19a6f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ffc675c040 con 0x55ffc6385390 2024-09-21T01:01:31.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.073+0000 7fdc11a98640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffc63a6070 0x55ffc6765330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:31.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.073+0000 7fdc11a98640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffc63a6070 0x55ffc6765330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:51222/0 (socket says 172.21.15.1:51222) 2024-09-21T01:01:31.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.073+0000 7fdc11a98640 1 -- 172.21.15.1:0/1700328854 learned_addr learned my addr 172.21.15.1:0/1700328854 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:31.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.073+0000 7fdc19a6f740 10 client.0 _ll_register_callbacks cb 0x55ffc66679e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:01:31.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.073+0000 7fdc10a96640 1 --2- 172.21.15.1:0/1700328854 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ffc6385390 0x55ffc67594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:31.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.073+0000 7fdc11a98640 1 -- 172.21.15.1:0/1700328854 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ffc6385390 msgr2=0x55ffc67594b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:31.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.073+0000 7fdc11a98640 1 --2- 172.21.15.1:0/1700328854 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ffc6385390 0x55ffc67594b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:31.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.073+0000 7fdc11a98640 1 -- 172.21.15.1:0/1700328854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ffc637d1b0 msgr2=0x55ffc6758f70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:01:31.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.074+0000 7fdc11297640 1 --2- 172.21.15.1:0/1700328854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ffc637d1b0 0x55ffc6758f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:31.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.074+0000 7fdc11a98640 1 --2- 172.21.15.1:0/1700328854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ffc637d1b0 0x55ffc6758f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:31.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.074+0000 7fdc11a98640 1 -- 172.21.15.1:0/1700328854 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffc667bc90 con 0x55ffc63a6070 2024-09-21T01:01:31.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.074+0000 7fdc11297640 1 --2- 172.21.15.1:0/1700328854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ffc637d1b0 0x55ffc6758f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:01:31.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.074+0000 7fdc10a96640 1 --2- 172.21.15.1:0/1700328854 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ffc6385390 0x55ffc67594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:01:31.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.078+0000 7fdc11a98640 1 --2- 172.21.15.1:0/1700328854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffc63a6070 0x55ffc6765330 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdc0401aa70 tx=0x7fdc0403d7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=882d72419e9ce2a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:31.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.078+0000 7fdbf4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:01:31.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.078+0000 7fdbf4ff9640 1 -- 172.21.15.1:0/1700328854 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc04057050 con 0x55ffc63a6070 2024-09-21T01:01:31.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.079+0000 7fdc19a6f740 1 -- 172.21.15.1:0/1700328854 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbfc00ee90 con 0x55ffc63a6070 2024-09-21T01:01:31.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.079+0000 7fdbf4ff9640 1 -- 172.21.15.1:0/1700328854 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fdc040519f0 con 0x55ffc63a6070 2024-09-21T01:01:31.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.079+0000 7fdbf4ff9640 1 -- 172.21.15.1:0/1700328854 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fdc0404b040 con 0x55ffc63a6070 2024-09-21T01:01:31.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.079+0000 7fdc19a6f740 10 client.26330 fetch_fsmap learned FSMap version 33 2024-09-21T01:01:31.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.079+0000 7fdc19a6f740 1 -- 172.21.15.1:0/1700328854 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ffc6767d20 con 0x55ffc63a6070 2024-09-21T01:01:31.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.081+0000 7fdbf4ff9640 1 -- 172.21.15.1:0/1700328854 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc04061070 con 0x55ffc63a6070 2024-09-21T01:01:31.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.085+0000 7fdbf4ff9640 1 -- 172.21.15.1:0/1700328854 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fdc04043b20 con 0x55ffc63a6070 2024-09-21T01:01:31.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.086+0000 7fdc19a6f740 10 client.26330 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:01:31.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.086+0000 7fdc19a6f740 10 client.26330 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T01:01:31.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.086+0000 7fdc19a6f740 20 client.26330 populate_metadata read hostname 'smithi001' 2024-09-21T01:01:31.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.086+0000 7fdc19a6f740 1 --2- 172.21.15.1:0/1700328854 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x55ffc63649f0 0x55ffc676b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:31.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.086+0000 7fdc19a6f740 4 client.26330 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:01:31.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.086+0000 7fdc19a6f740 1 -- 172.21.15.1:0/1700328854 --> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fdbfc00ee90 con 0x55ffc63649f0 2024-09-21T01:01:31.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.086+0000 7fdc11297640 1 --2- 172.21.15.1:0/1700328854 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x55ffc63649f0 0x55ffc676b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:31.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.087+0000 7fdc11297640 1 --2- 172.21.15.1:0/1700328854 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x55ffc63649f0 0x55ffc676b6e0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=85003ecb92369d4b server_cookie=bb9305a4f465de4a in_seq=0 out_seq=0 2024-09-21T01:01:31.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.087+0000 7fdbf4ff9640 10 client.26330 ms_handle_connect on v2:172.21.15.193:6834/3631682268 2024-09-21T01:01:31.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.089+0000 7fdbf4ff9640 1 -- 172.21.15.1:0/1700328854 <== mds.4 v2:172.21.15.193:6834/3631682268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fdbfc00ee90 con 0x55ffc63649f0 2024-09-21T01:01:31.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.089+0000 7fdbf4ff9640 10 client.26330 handle_command_reply: tid=0 2024-09-21T01:01:31.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.089+0000 7fdc19a6f740 1 client.26330 shutdown 2024-09-21T01:01:31.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.090+0000 7fdc19a6f740 1 -- 172.21.15.1:0/1700328854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffc63a6070 msgr2=0x55ffc6765330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:31.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.090+0000 7fdc19a6f740 1 --2- 172.21.15.1:0/1700328854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffc63a6070 0x55ffc6765330 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdc0401aa70 tx=0x7fdc0403d7d0 comp rx=0 tx=0).stop 2024-09-21T01:01:31.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.090+0000 7fdc19a6f740 1 -- 172.21.15.1:0/1700328854 shutdown_connections 2024-09-21T01:01:31.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.090+0000 7fdc19a6f740 1 --2- 172.21.15.1:0/1700328854 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x55ffc63649f0 0x55ffc676b6e0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:31.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.090+0000 7fdc19a6f740 1 --2- 172.21.15.1:0/1700328854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffc63a6070 0x55ffc6765330 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:31.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.090+0000 7fdc19a6f740 1 --2- 172.21.15.1:0/1700328854 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ffc6385390 0x55ffc67594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:31.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.090+0000 7fdc19a6f740 1 --2- 172.21.15.1:0/1700328854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ffc637d1b0 0x55ffc6758f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:31.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.090+0000 7fdc19a6f740 1 -- 172.21.15.1:0/1700328854 >> 172.21.15.1:0/1700328854 conn(0x55ffc639a460 msgr2=0x55ffc67509f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:31.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.090+0000 7fdbf4ff9640 0 client.26330 ms_handle_reset on v2:172.21.15.193:6834/3631682268 2024-09-21T01:01:31.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.091+0000 7fdc19a6f740 1 -- 172.21.15.1:0/1700328854 shutdown_connections 2024-09-21T01:01:31.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.091+0000 7fdc19a6f740 1 -- 172.21.15.1:0/1700328854 wait complete. 2024-09-21T01:01:31.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.091+0000 7fdc19a6f740 20 client.26330 trim_cache size 0 max 16384 2024-09-21T01:01:31.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.124+0000 7fdc19a6f740 1 Processor -- start 2024-09-21T01:01:31.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.124+0000 7fdc19a6f740 1 -- start start 2024-09-21T01:01:31.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.124+0000 7fdc19a6f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ffc637d1b0 0x55ffc6751070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:31.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.124+0000 7fdc19a6f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ffc6385390 0x55ffc6765230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:31.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.124+0000 7fdc19a6f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffc63a6070 0x55ffc674b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:31.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.124+0000 7fdc19a6f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c1b5a00 con 0x55ffc637d1b0 2024-09-21T01:01:31.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.124+0000 7fdc19a6f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c1b7600 con 0x55ffc63a6070 2024-09-21T01:01:31.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.125+0000 7fdc11a98640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffc63a6070 0x55ffc674b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:31.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.125+0000 7fdc11a98640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffc63a6070 0x55ffc674b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:51238/0 (socket says 172.21.15.1:51238) 2024-09-21T01:01:31.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.125+0000 7fdc11a98640 1 -- 172.21.15.1:0/113754295 learned_addr learned my addr 172.21.15.1:0/113754295 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:31.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.125+0000 7fdc19a6f740 1 -- 172.21.15.1:0/113754295 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c1b60d0 con 0x55ffc6385390 2024-09-21T01:01:31.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.125+0000 7fdc11a98640 1 -- 172.21.15.1:0/113754295 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ffc6385390 msgr2=0x55ffc6765230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:01:31.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.125+0000 7fdc11a98640 1 --2- 172.21.15.1:0/113754295 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ffc6385390 0x55ffc6765230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:31.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.125+0000 7fdc11a98640 1 -- 172.21.15.1:0/113754295 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ffc637d1b0 msgr2=0x55ffc6751070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:31.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.125+0000 7fdc11a98640 1 --2- 172.21.15.1:0/113754295 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ffc637d1b0 0x55ffc6751070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:31.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.125+0000 7fdc11a98640 1 -- 172.21.15.1:0/113754295 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffc675a230 con 0x55ffc63a6070 2024-09-21T01:01:31.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.127+0000 7fdc11a98640 1 --2- 172.21.15.1:0/113754295 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffc63a6070 0x55ffc674b090 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdc04043fc0 tx=0x7fdc04003dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae3f43c5bdfa6783 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:31.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.128+0000 7fdbf6ffd640 1 -- 172.21.15.1:0/113754295 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc04057040 con 0x55ffc63a6070 2024-09-21T01:01:31.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.128+0000 7fdbf6ffd640 1 -- 172.21.15.1:0/113754295 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc04061070 con 0x55ffc63a6070 2024-09-21T01:01:31.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.129+0000 7fdc19a6f740 1 -- 172.21.15.1:0/113754295 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffc63a6070 msgr2=0x55ffc674b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:31.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.129+0000 7fdc19a6f740 1 --2- 172.21.15.1:0/113754295 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffc63a6070 0x55ffc674b090 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdc04043fc0 tx=0x7fdc04003dc0 comp rx=0 tx=0).stop 2024-09-21T01:01:31.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.130+0000 7fdc19a6f740 1 -- 172.21.15.1:0/113754295 shutdown_connections 2024-09-21T01:01:31.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.130+0000 7fdc19a6f740 1 --2- 172.21.15.1:0/113754295 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffc63a6070 0x55ffc674b090 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:31.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.130+0000 7fdc19a6f740 1 --2- 172.21.15.1:0/113754295 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ffc6385390 0x55ffc6765230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:31.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.130+0000 7fdc19a6f740 1 --2- 172.21.15.1:0/113754295 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ffc637d1b0 0x55ffc6751070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:31.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.130+0000 7fdc19a6f740 1 -- 172.21.15.1:0/113754295 >> 172.21.15.1:0/113754295 conn(0x55ffc639a460 msgr2=0x55ffc6750960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:31.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.131+0000 7fdc19a6f740 1 -- 172.21.15.1:0/113754295 shutdown_connections 2024-09-21T01:01:31.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.131+0000 7fdc19a6f740 1 -- 172.21.15.1:0/113754295 wait complete. 2024-09-21T01:01:31.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.132+0000 7fdc19a6f740 1 -- start start 2024-09-21T01:01:31.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.132+0000 7fdc19a6f740 1 Processor -- start 2024-09-21T01:01:31.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.133+0000 7fdc19a6f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ffc637d1b0 0x55ffc6761b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:31.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.133+0000 7fdc19a6f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffc6385390 0x55ffc675cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:31.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.133+0000 7fdc19a6f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ffc63a6070 0x55ffc675d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:31.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.133+0000 7fdc19a6f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c1b6f30 con 0x55ffc63a6070 2024-09-21T01:01:31.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.133+0000 7fdc19a6f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c1b6860 con 0x55ffc6385390 2024-09-21T01:01:31.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.133+0000 7fdc19a6f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c1b3a90 con 0x55ffc637d1b0 2024-09-21T01:01:31.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.133+0000 7fdc19a6f740 10 client.0 _ll_register_callbacks cb 0x7fdc0401ab30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:01:31.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.133+0000 7fdc10a96640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffc6385390 0x55ffc675cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:31.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.133+0000 7fdc11297640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ffc637d1b0 0x55ffc6761b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:31.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.134+0000 7fdc11297640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ffc637d1b0 0x55ffc6761b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:39882/0 (socket says 172.21.15.1:39882) 2024-09-21T01:01:31.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.134+0000 7fdc11297640 1 -- 172.21.15.1:0/4131964607 learned_addr learned my addr 172.21.15.1:0/4131964607 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:31.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.134+0000 7fdc11297640 1 -- 172.21.15.1:0/4131964607 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffc6385390 msgr2=0x55ffc675cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:31.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.134+0000 7fdc11297640 1 --2- 172.21.15.1:0/4131964607 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffc6385390 0x55ffc675cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:31.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.134+0000 7fdc11297640 1 -- 172.21.15.1:0/4131964607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ffc63a6070 msgr2=0x55ffc675d5e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:01:31.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.135+0000 7fdc11a98640 1 --2- 172.21.15.1:0/4131964607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ffc63a6070 0x55ffc675d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:31.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.135+0000 7fdc11297640 1 --2- 172.21.15.1:0/4131964607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ffc63a6070 0x55ffc675d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:31.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.135+0000 7fdc11297640 1 -- 172.21.15.1:0/4131964607 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffc675ddc0 con 0x55ffc637d1b0 2024-09-21T01:01:31.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.135+0000 7fdc11a98640 1 --2- 172.21.15.1:0/4131964607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ffc63a6070 0x55ffc675d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:01:31.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.136+0000 7fdc11297640 1 --2- 172.21.15.1:0/4131964607 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ffc637d1b0 0x55ffc6761b30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdc080a8a60 tx=0x7fdc08010380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3fac76b5a8c6d61 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:31.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.136+0000 7fdbf4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T01:01:31.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.136+0000 7fdbf4ff9640 1 -- 172.21.15.1:0/4131964607 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc080ad0b0 con 0x55ffc637d1b0 2024-09-21T01:01:31.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.136+0000 7fdc19a6f740 1 -- 172.21.15.1:0/4131964607 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc04061070 con 0x55ffc637d1b0 2024-09-21T01:01:31.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.136+0000 7fdbf4ff9640 1 -- 172.21.15.1:0/4131964607 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fdc08010410 con 0x55ffc637d1b0 2024-09-21T01:01:31.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.136+0000 7fdbf4ff9640 1 -- 172.21.15.1:0/4131964607 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fdc080b1490 con 0x55ffc637d1b0 2024-09-21T01:01:31.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.138+0000 7fdc19a6f740 10 client.26224 fetch_fsmap learned FSMap version 33 2024-09-21T01:01:31.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.138+0000 7fdc19a6f740 1 -- 172.21.15.1:0/4131964607 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ffc67d6130 con 0x55ffc637d1b0 2024-09-21T01:01:31.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.139+0000 7fdbf4ff9640 1 -- 172.21.15.1:0/4131964607 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc04061070 con 0x55ffc637d1b0 2024-09-21T01:01:31.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.139+0000 7fdbf4ff9640 1 -- 172.21.15.1:0/4131964607 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fdc080adce0 con 0x55ffc637d1b0 2024-09-21T01:01:31.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.139+0000 7fdc19a6f740 10 client.26224 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:01:31.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.139+0000 7fdc19a6f740 10 client.26224 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T01:01:31.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.139+0000 7fdc19a6f740 20 client.26224 populate_metadata read hostname 'smithi001' 2024-09-21T01:01:31.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.139+0000 7fdc19a6f740 1 --2- 172.21.15.1:0/4131964607 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x55ffc6339da0 0x55ffc67d8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:31.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.139+0000 7fdc19a6f740 4 client.26224 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:01:31.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.139+0000 7fdc19a6f740 1 -- 172.21.15.1:0/4131964607 --> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ffc66c5df0 con 0x55ffc6339da0 2024-09-21T01:01:31.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.140+0000 7fdc10a96640 1 --2- 172.21.15.1:0/4131964607 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x55ffc6339da0 0x55ffc67d8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:31.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.141+0000 7fdc10a96640 1 --2- 172.21.15.1:0/4131964607 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x55ffc6339da0 0x55ffc67d8a10 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8e394a40ed911738 server_cookie=f7c5fe11f07811 in_seq=0 out_seq=0 2024-09-21T01:01:31.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.141+0000 7fdbf4ff9640 10 client.26224 ms_handle_connect on v2:172.21.15.193:6834/3631682268 2024-09-21T01:01:31.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.141+0000 7fdbf4ff9640 1 -- 172.21.15.1:0/4131964607 <== mds.4 v2:172.21.15.193:6834/3631682268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ffc66c5df0 con 0x55ffc6339da0 2024-09-21T01:01:31.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.141+0000 7fdbf4ff9640 10 client.26224 handle_command_reply: tid=0 2024-09-21T01:01:31.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.141+0000 7fdc19a6f740 1 client.26224 shutdown 2024-09-21T01:01:31.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.141+0000 7fdc19a6f740 1 -- 172.21.15.1:0/4131964607 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ffc637d1b0 msgr2=0x55ffc6761b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:31.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.142+0000 7fdc19a6f740 1 --2- 172.21.15.1:0/4131964607 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ffc637d1b0 0x55ffc6761b30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdc080a8a60 tx=0x7fdc08010380 comp rx=0 tx=0).stop 2024-09-21T01:01:31.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.142+0000 7fdc19a6f740 1 -- 172.21.15.1:0/4131964607 shutdown_connections 2024-09-21T01:01:31.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.142+0000 7fdc19a6f740 1 --2- 172.21.15.1:0/4131964607 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x55ffc6339da0 0x55ffc67d8a10 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:31.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.142+0000 7fdc19a6f740 1 --2- 172.21.15.1:0/4131964607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ffc63a6070 0x55ffc675d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:31.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.142+0000 7fdc19a6f740 1 --2- 172.21.15.1:0/4131964607 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffc6385390 0x55ffc675cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:31.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.142+0000 7fdc19a6f740 1 --2- 172.21.15.1:0/4131964607 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ffc637d1b0 0x55ffc6761b30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:31.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.142+0000 7fdc19a6f740 1 -- 172.21.15.1:0/4131964607 >> 172.21.15.1:0/4131964607 conn(0x55ffc639a460 msgr2=0x55ffc67573f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:31.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.142+0000 7fdbf4ff9640 0 client.26224 ms_handle_reset on v2:172.21.15.193:6834/3631682268 2024-09-21T01:01:31.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.143+0000 7fdc19a6f740 1 -- 172.21.15.1:0/4131964607 shutdown_connections 2024-09-21T01:01:31.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.143+0000 7fdc19a6f740 1 -- 172.21.15.1:0/4131964607 wait complete. 2024-09-21T01:01:31.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.143+0000 7fdc19a6f740 20 client.26224 trim_cache size 0 max 16384 2024-09-21T01:01:31.146 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T01:01:31.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.146+0000 7fdc12299640 1 -- 172.21.15.1:0/2857257780 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fdbf80b6720 msgr2=0x7fdbf80b8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:31.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.146+0000 7fdc12299640 1 --2- 172.21.15.1:0/2857257780 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fdbf80b6720 0x7fdbf80b8c30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdc0401aa10 tx=0x7fdc0401a470 comp rx=0 tx=0).stop 2024-09-21T01:01:31.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.146+0000 7fdc12299640 1 -- 172.21.15.1:0/2857257780 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc0c102010 msgr2=0x7fdc0c10a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:31.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.146+0000 7fdc12299640 1 --2- 172.21.15.1:0/2857257780 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc0c102010 0x7fdc0c10a5f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdc0800b3f0 tx=0x7fdc0800b8b0 comp rx=0 tx=0).stop 2024-09-21T01:01:31.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.147+0000 7fdc12299640 1 -- 172.21.15.1:0/2857257780 shutdown_connections 2024-09-21T01:01:31.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.147+0000 7fdc12299640 1 --2- 172.21.15.1:0/2857257780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdc0c1082a0 0x7fdc0c19b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:31.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.147+0000 7fdc12299640 1 --2- 172.21.15.1:0/2857257780 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fdbf80b6720 0x7fdbf80b8c30 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:31.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.147+0000 7fdc12299640 1 --2- 172.21.15.1:0/2857257780 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc0c107950 0x7fdc0c10ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:31.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.147+0000 7fdc12299640 1 --2- 172.21.15.1:0/2857257780 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc0c102010 0x7fdc0c10a5f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:31.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.147+0000 7fdc12299640 1 -- 172.21.15.1:0/2857257780 >> 172.21.15.1:0/2857257780 conn(0x7fdc0c077aa0 msgr2=0x7fdc0c100af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:31.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.149+0000 7fdc12299640 1 -- 172.21.15.1:0/2857257780 shutdown_connections 2024-09-21T01:01:31.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:31.149+0000 7fdc12299640 1 -- 172.21.15.1:0/2857257780 wait complete. 2024-09-21T01:01:31.465 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:31 smithi001 ceph-mon[31211]: pgmap v487: 97 pgs: 97 active+clean; 538 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 1.4 MiB/s wr, 158 op/s 2024-09-21T01:01:31.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:31 smithi193 ceph-mon[34660]: pgmap v487: 97 pgs: 97 active+clean; 538 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 1.4 MiB/s wr, 158 op/s 2024-09-21T01:01:31.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:31 smithi042 ceph-mon[34481]: pgmap v487: 97 pgs: 97 active+clean; 538 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 1.4 MiB/s wr, 158 op/s 2024-09-21T01:01:32.621 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T01:01:33.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:33 smithi001 ceph-mon[31211]: pgmap v488: 97 pgs: 97 active+clean; 543 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.6 MiB/s wr, 183 op/s 2024-09-21T01:01:33.560 INFO:tasks.workunit.client.0.smithi001.stdout: 101 902130 401 577896 222 509128 1172 2024-09-21T01:01:33.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:33 smithi193 ceph-mon[34660]: pgmap v488: 97 pgs: 97 active+clean; 543 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.6 MiB/s wr, 183 op/s 2024-09-21T01:01:33.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:33 smithi042 ceph-mon[34481]: pgmap v488: 97 pgs: 97 active+clean; 543 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.6 MiB/s wr, 183 op/s 2024-09-21T01:01:34.295 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:01:35.632 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:35 smithi001 ceph-mon[31211]: pgmap v489: 97 pgs: 97 active+clean; 543 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 1.3 MiB/s wr, 217 op/s 2024-09-21T01:01:35.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.686+0000 7fa08f59e640 1 -- 172.21.15.1:0/3616436188 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa090111cd0 msgr2=0x7fa09010d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:35.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.686+0000 7fa08f59e640 1 --2- 172.21.15.1:0/3616436188 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa090111cd0 0x7fa09010d6b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa084009860 tx=0x7fa08402a380 comp rx=0 tx=0).stop 2024-09-21T01:01:35.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.688+0000 7fa08f59e640 1 -- 172.21.15.1:0/3616436188 shutdown_connections 2024-09-21T01:01:35.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.688+0000 7fa08f59e640 1 --2- 172.21.15.1:0/3616436188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa09011cba0 0x7fa09011efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:35.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.688+0000 7fa08f59e640 1 --2- 172.21.15.1:0/3616436188 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa09010dbf0 0x7fa09010e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:35.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.688+0000 7fa08f59e640 1 --2- 172.21.15.1:0/3616436188 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa090111cd0 0x7fa09010d6b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:35.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.688+0000 7fa08f59e640 1 -- 172.21.15.1:0/3616436188 >> 172.21.15.1:0/3616436188 conn(0x7fa09006e9f0 msgr2=0x7fa09006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:35.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.691+0000 7fa08f59e640 1 -- 172.21.15.1:0/3616436188 shutdown_connections 2024-09-21T01:01:35.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.695+0000 7fa08f59e640 1 -- 172.21.15.1:0/3616436188 wait complete. 2024-09-21T01:01:35.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.697+0000 7fa08f59e640 1 Processor -- start 2024-09-21T01:01:35.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.697+0000 7fa08f59e640 1 -- start start 2024-09-21T01:01:35.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.697+0000 7fa08f59e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa09010dbf0 0x7fa09011c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:35.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.697+0000 7fa08f59e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa090111cd0 0x7fa090116420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:35.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.697+0000 7fa08f59e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa09011cba0 0x7fa090116960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:35.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.697+0000 7fa08f59e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa090112850 con 0x7fa09010dbf0 2024-09-21T01:01:35.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.697+0000 7fa08f59e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa0901126d0 con 0x7fa09011cba0 2024-09-21T01:01:35.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.697+0000 7fa08f59e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa0901129d0 con 0x7fa090111cd0 2024-09-21T01:01:35.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.698+0000 7fa08ed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa09011cba0 0x7fa090116960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:35.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.698+0000 7fa08ed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa09011cba0 0x7fa090116960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:51254/0 (socket says 172.21.15.1:51254) 2024-09-21T01:01:35.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.698+0000 7fa08ed9d640 1 -- 172.21.15.1:0/1642716320 learned_addr learned my addr 172.21.15.1:0/1642716320 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:35.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.698+0000 7fa08dd9b640 1 --2- 172.21.15.1:0/1642716320 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa090111cd0 0x7fa090116420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:35.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.699+0000 7fa08e59c640 1 --2- 172.21.15.1:0/1642716320 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa09010dbf0 0x7fa09011c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:35.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.699+0000 7fa08e59c640 1 -- 172.21.15.1:0/1642716320 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa090111cd0 msgr2=0x7fa090116420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:35.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.699+0000 7fa08e59c640 1 --2- 172.21.15.1:0/1642716320 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa090111cd0 0x7fa090116420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:35.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.699+0000 7fa08e59c640 1 -- 172.21.15.1:0/1642716320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa09011cba0 msgr2=0x7fa090116960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:35.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.699+0000 7fa08e59c640 1 --2- 172.21.15.1:0/1642716320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa09011cba0 0x7fa090116960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:35.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.699+0000 7fa08e59c640 1 -- 172.21.15.1:0/1642716320 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa090116fa0 con 0x7fa09010dbf0 2024-09-21T01:01:35.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.700+0000 7fa08e59c640 1 --2- 172.21.15.1:0/1642716320 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa09010dbf0 0x7fa09011c160 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fa084009780 tx=0x7fa0840055e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:35.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.705+0000 7fa07f7fe640 1 -- 172.21.15.1:0/1642716320 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08403f020 con 0x7fa09010dbf0 2024-09-21T01:01:35.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.705+0000 7fa07f7fe640 1 -- 172.21.15.1:0/1642716320 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa084004220 con 0x7fa09010dbf0 2024-09-21T01:01:35.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.705+0000 7fa08f59e640 1 -- 172.21.15.1:0/1642716320 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa090117230 con 0x7fa09010dbf0 2024-09-21T01:01:35.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.705+0000 7fa08f59e640 1 -- 172.21.15.1:0/1642716320 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa090128560 con 0x7fa09010dbf0 2024-09-21T01:01:35.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.710+0000 7fa09b492740 1 Processor -- start 2024-09-21T01:01:35.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.710+0000 7fa09b492740 1 -- start start 2024-09-21T01:01:35.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.711+0000 7fa09b492740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633db0af070 0x5633db456860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:35.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.711+0000 7fa09b492740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633db0861b0 0x5633db456da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:35.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.711+0000 7fa09b492740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5633db08e390 0x5633db4572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:35.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.712+0000 7fa09b492740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5633db3ccea0 con 0x5633db08e390 2024-09-21T01:01:35.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.712+0000 7fa09b492740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5633db3bc2d0 con 0x5633db0af070 2024-09-21T01:01:35.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.712+0000 7fa09b492740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5633db3c00e0 con 0x5633db0861b0 2024-09-21T01:01:35.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.712+0000 7fa07f7fe640 1 -- 172.21.15.1:0/1642716320 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08403f020 con 0x7fa09010dbf0 2024-09-21T01:01:35.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.712+0000 7fa08dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5633db08e390 0x5633db4572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:35.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.712+0000 7fa08dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5633db08e390 0x5633db4572e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46366/0 (socket says 172.21.15.1:46366) 2024-09-21T01:01:35.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.712+0000 7fa08dd9b640 1 -- 172.21.15.1:0/3732948903 learned_addr learned my addr 172.21.15.1:0/3732948903 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:35.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.713+0000 7fa08ed9d640 1 --2- 172.21.15.1:0/3732948903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633db0af070 0x5633db456860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:35.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.713+0000 7fa08dd9b640 1 -- 172.21.15.1:0/3732948903 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633db0861b0 msgr2=0x5633db456da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:01:35.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.713+0000 7fa08dd9b640 1 --2- 172.21.15.1:0/3732948903 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633db0861b0 0x5633db456da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:35.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.713+0000 7fa08dd9b640 1 -- 172.21.15.1:0/3732948903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633db0af070 msgr2=0x5633db456860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:35.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.713+0000 7fa08dd9b640 1 --2- 172.21.15.1:0/3732948903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633db0af070 0x5633db456860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:35.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.713+0000 7fa08dd9b640 1 -- 172.21.15.1:0/3732948903 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633db11a650 con 0x5633db08e390 2024-09-21T01:01:35.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.714+0000 7fa08dd9b640 1 --2- 172.21.15.1:0/3732948903 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5633db08e390 0x5633db4572e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fa08000bc30 tx=0x7fa0800107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5862e6922894ff1c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:35.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.717+0000 7fa07cff9640 1 -- 172.21.15.1:0/3732948903 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08001c480 con 0x5633db08e390 2024-09-21T01:01:35.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.717+0000 7fa07cff9640 1 -- 172.21.15.1:0/3732948903 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa08001cad0 con 0x5633db08e390 2024-09-21T01:01:35.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.718+0000 7fa09b492740 1 -- 172.21.15.1:0/3732948903 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5633db08e390 msgr2=0x5633db4572e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:35.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.718+0000 7fa09b492740 1 --2- 172.21.15.1:0/3732948903 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5633db08e390 0x5633db4572e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fa08000bc30 tx=0x7fa0800107a0 comp rx=0 tx=0).stop 2024-09-21T01:01:35.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:35 smithi193 ceph-mon[34660]: pgmap v489: 97 pgs: 97 active+clean; 543 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 1.3 MiB/s wr, 217 op/s 2024-09-21T01:01:35.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.721+0000 7fa07f7fe640 1 -- 172.21.15.1:0/1642716320 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7fa084042070 con 0x7fa09010dbf0 2024-09-21T01:01:35.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:35 smithi042 ceph-mon[34481]: pgmap v489: 97 pgs: 97 active+clean; 543 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 1.3 MiB/s wr, 217 op/s 2024-09-21T01:01:35.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.723+0000 7fa09b492740 1 -- 172.21.15.1:0/3732948903 shutdown_connections 2024-09-21T01:01:35.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.723+0000 7fa09b492740 1 --2- 172.21.15.1:0/3732948903 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5633db08e390 0x5633db4572e0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:35.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.723+0000 7fa09b492740 1 --2- 172.21.15.1:0/3732948903 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633db0861b0 0x5633db456da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:35.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.723+0000 7fa09b492740 1 --2- 172.21.15.1:0/3732948903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633db0af070 0x5633db456860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:35.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.723+0000 7fa09b492740 1 -- 172.21.15.1:0/3732948903 >> 172.21.15.1:0/3732948903 conn(0x5633db0a3460 msgr2=0x5633db454750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:35.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.723+0000 7fa07f7fe640 1 --2- 172.21.15.1:0/1642716320 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa0780b6940 0x7fa0780b8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:35.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.723+0000 7fa07f7fe640 1 -- 172.21.15.1:0/1642716320 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fa084004020 con 0x7fa09010dbf0 2024-09-21T01:01:35.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.728+0000 7fa08dd9b640 1 --2- 172.21.15.1:0/1642716320 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa0780b6940 0x7fa0780b8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:35.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.730+0000 7fa08dd9b640 1 --2- 172.21.15.1:0/1642716320 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa0780b6940 0x7fa0780b8e50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa0800116e0 tx=0x7fa080013040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:35.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.734+0000 7fa09b492740 1 -- 172.21.15.1:0/3732948903 shutdown_connections 2024-09-21T01:01:35.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.740+0000 7fa09b492740 1 -- 172.21.15.1:0/3732948903 wait complete. 2024-09-21T01:01:35.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.740+0000 7fa09b492740 1 -- start start 2024-09-21T01:01:35.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.740+0000 7fa09b492740 1 Processor -- start 2024-09-21T01:01:35.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.744+0000 7fa09b492740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633db08e390 0x5633db461e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:35.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.744+0000 7fa09b492740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633db0af070 0x5633db462350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:35.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.744+0000 7fa09b492740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5633db06d9f0 0x5633db462890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:35.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.745+0000 7fa09b492740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5633db21d700 con 0x5633db06d9f0 2024-09-21T01:01:35.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.745+0000 7fa09b492740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5633db357160 con 0x5633db0af070 2024-09-21T01:01:35.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.745+0000 7fa09b492740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5633db465090 con 0x5633db08e390 2024-09-21T01:01:35.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.745+0000 7fa09b492740 10 client.0 _ll_register_callbacks cb 0x5633db3709e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:01:35.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.746+0000 7fa08ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5633db06d9f0 0x5633db462890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:35.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.746+0000 7fa08ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5633db06d9f0 0x5633db462890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46368/0 (socket says 172.21.15.1:46368) 2024-09-21T01:01:35.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.746+0000 7fa08ed9d640 1 -- 172.21.15.1:0/2694729064 learned_addr learned my addr 172.21.15.1:0/2694729064 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:35.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.746+0000 7fa08e59c640 1 --2- 172.21.15.1:0/2694729064 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633db08e390 0x5633db461e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:35.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.747+0000 7fa08ed9d640 1 -- 172.21.15.1:0/2694729064 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633db08e390 msgr2=0x5633db461e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:35.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.747+0000 7fa08ed9d640 1 --2- 172.21.15.1:0/2694729064 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633db08e390 0x5633db461e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:35.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.747+0000 7fa08ed9d640 1 -- 172.21.15.1:0/2694729064 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633db0af070 msgr2=0x5633db462350 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:01:35.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.747+0000 7fa08ed9d640 1 --2- 172.21.15.1:0/2694729064 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633db0af070 0x5633db462350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:35.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.747+0000 7fa08ed9d640 1 -- 172.21.15.1:0/2694729064 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633db384c90 con 0x5633db06d9f0 2024-09-21T01:01:35.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.749+0000 7fa08ed9d640 1 --2- 172.21.15.1:0/2694729064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5633db06d9f0 0x5633db462890 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fa08800fee0 tx=0x7fa08800e7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60871ea08bbca727 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:35.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.749+0000 7fa075ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:01:35.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.750+0000 7fa075ffb640 1 -- 172.21.15.1:0/2694729064 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08801e060 con 0x5633db06d9f0 2024-09-21T01:01:35.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.750+0000 7fa09b492740 1 -- 172.21.15.1:0/2694729064 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa08001cad0 con 0x5633db06d9f0 2024-09-21T01:01:35.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.750+0000 7fa075ffb640 1 -- 172.21.15.1:0/2694729064 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fa0880195f0 con 0x5633db06d9f0 2024-09-21T01:01:35.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.752+0000 7fa075ffb640 1 -- 172.21.15.1:0/2694729064 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fa0880197f0 con 0x5633db06d9f0 2024-09-21T01:01:35.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.752+0000 7fa09b492740 10 client.16692 fetch_fsmap learned FSMap version 33 2024-09-21T01:01:35.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.752+0000 7fa09b492740 1 -- 172.21.15.1:0/2694729064 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5633db470e20 con 0x5633db06d9f0 2024-09-21T01:01:35.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.753+0000 7fa075ffb640 1 -- 172.21.15.1:0/2694729064 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa08001cad0 con 0x5633db06d9f0 2024-09-21T01:01:35.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.753+0000 7fa075ffb640 1 -- 172.21.15.1:0/2694729064 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fa088018070 con 0x5633db06d9f0 2024-09-21T01:01:35.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.753+0000 7fa09b492740 10 client.16692 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:01:35.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.753+0000 7fa09b492740 10 client.16692 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-21T01:01:35.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.753+0000 7fa09b492740 20 client.16692 populate_metadata read hostname 'smithi001' 2024-09-21T01:01:35.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.754+0000 7fa09b492740 1 --2- 172.21.15.1:0/2694729064 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x5633db042da0 0x5633db474710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:35.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.754+0000 7fa09b492740 4 client.16692 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:01:35.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.754+0000 7fa09b492740 1 -- 172.21.15.1:0/2694729064 --> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633db3cedf0 con 0x5633db042da0 2024-09-21T01:01:35.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.754+0000 7fa08e59c640 1 --2- 172.21.15.1:0/2694729064 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x5633db042da0 0x5633db474710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:35.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.756+0000 7fa075ffb640 10 client.16692 ms_handle_connect on v2:172.21.15.193:6836/909252228 2024-09-21T01:01:35.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.757+0000 7fa08e59c640 1 --2- 172.21.15.1:0/2694729064 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x5633db042da0 0x5633db474710 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2a95d6287be75030 server_cookie=23d0338e64913914 in_seq=0 out_seq=0 2024-09-21T01:01:35.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.761+0000 7fa075ffb640 1 -- 172.21.15.1:0/2694729064 <== mds.3 v2:172.21.15.193:6836/909252228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5633db3cedf0 con 0x5633db042da0 2024-09-21T01:01:35.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.761+0000 7fa075ffb640 10 client.16692 handle_command_reply: tid=0 2024-09-21T01:01:35.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.761+0000 7fa09b492740 1 client.16692 shutdown 2024-09-21T01:01:35.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.761+0000 7fa09b492740 1 -- 172.21.15.1:0/2694729064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5633db06d9f0 msgr2=0x5633db462890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:35.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.761+0000 7fa09b492740 1 --2- 172.21.15.1:0/2694729064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5633db06d9f0 0x5633db462890 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fa08800fee0 tx=0x7fa08800e7c0 comp rx=0 tx=0).stop 2024-09-21T01:01:35.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.762+0000 7fa09b492740 1 -- 172.21.15.1:0/2694729064 shutdown_connections 2024-09-21T01:01:35.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.762+0000 7fa09b492740 1 --2- 172.21.15.1:0/2694729064 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x5633db042da0 0x5633db474710 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:35.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.762+0000 7fa09b492740 1 --2- 172.21.15.1:0/2694729064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5633db06d9f0 0x5633db462890 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:35.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.762+0000 7fa09b492740 1 --2- 172.21.15.1:0/2694729064 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633db0af070 0x5633db462350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:35.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.762+0000 7fa09b492740 1 --2- 172.21.15.1:0/2694729064 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633db08e390 0x5633db461e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:35.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.762+0000 7fa09b492740 1 -- 172.21.15.1:0/2694729064 >> 172.21.15.1:0/2694729064 conn(0x5633db0a3460 msgr2=0x5633db4599f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:35.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.762+0000 7fa075ffb640 0 client.16692 ms_handle_reset on v2:172.21.15.193:6836/909252228 2024-09-21T01:01:35.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.762+0000 7fa09b492740 1 -- 172.21.15.1:0/2694729064 shutdown_connections 2024-09-21T01:01:35.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.763+0000 7fa09b492740 1 -- 172.21.15.1:0/2694729064 wait complete. 2024-09-21T01:01:35.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.763+0000 7fa09b492740 20 client.16692 trim_cache size 0 max 16384 2024-09-21T01:01:35.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.799+0000 7fa09b492740 1 Processor -- start 2024-09-21T01:01:35.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.801+0000 7fa09b492740 1 -- start start 2024-09-21T01:01:35.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.801+0000 7fa09b492740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633db06d9f0 0x5633db458250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:35.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.802+0000 7fa09b492740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5633db08e390 0x5633db463a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:35.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.802+0000 7fa08e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633db06d9f0 0x5633db458250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:35.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.802+0000 7fa08e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633db06d9f0 0x5633db458250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:51278/0 (socket says 172.21.15.1:51278) 2024-09-21T01:01:35.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.804+0000 7fa08dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5633db08e390 0x5633db463a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:35.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.804+0000 7fa08dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5633db08e390 0x5633db463a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46378/0 (socket says 172.21.15.1:46378) 2024-09-21T01:01:35.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.804+0000 7fa08e59c640 1 -- 172.21.15.1:0/259479754 learned_addr learned my addr 172.21.15.1:0/259479754 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:35.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.804+0000 7fa09b492740 1 --2- 172.21.15.1:0/259479754 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633db0af070 0x5633db453d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:35.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.804+0000 7fa09b492740 1 -- 172.21.15.1:0/259479754 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa07000e540 con 0x5633db08e390 2024-09-21T01:01:35.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.804+0000 7fa09b492740 1 -- 172.21.15.1:0/259479754 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa070010140 con 0x5633db06d9f0 2024-09-21T01:01:35.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.805+0000 7fa09b492740 1 -- 172.21.15.1:0/259479754 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa07000ec10 con 0x5633db0af070 2024-09-21T01:01:35.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.805+0000 7fa08ed9d640 1 --2- 172.21.15.1:0/259479754 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633db0af070 0x5633db453d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:35.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.806+0000 7fa08dd9b640 1 -- 172.21.15.1:0/259479754 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633db0af070 msgr2=0x5633db453d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:35.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.806+0000 7fa08dd9b640 1 --2- 172.21.15.1:0/259479754 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633db0af070 0x5633db453d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:35.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.806+0000 7fa08dd9b640 1 -- 172.21.15.1:0/259479754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633db06d9f0 msgr2=0x5633db458250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:35.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.806+0000 7fa08dd9b640 1 --2- 172.21.15.1:0/259479754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633db06d9f0 0x5633db458250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:35.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.806+0000 7fa08dd9b640 1 -- 172.21.15.1:0/259479754 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633db4550c0 con 0x5633db08e390 2024-09-21T01:01:35.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.806+0000 7fa08dd9b640 1 --2- 172.21.15.1:0/259479754 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5633db08e390 0x5633db463a40 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fa080011580 tx=0x7fa0800107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e73f72664ffee95 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:35.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.807+0000 7fa077fff640 1 -- 172.21.15.1:0/259479754 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0800054d0 con 0x5633db08e390 2024-09-21T01:01:35.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.807+0000 7fa077fff640 1 -- 172.21.15.1:0/259479754 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa080003aa0 con 0x5633db08e390 2024-09-21T01:01:35.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.808+0000 7fa077fff640 1 -- 172.21.15.1:0/259479754 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08001c840 con 0x5633db08e390 2024-09-21T01:01:35.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.809+0000 7fa09b492740 1 -- 172.21.15.1:0/259479754 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5633db08e390 msgr2=0x5633db463a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:35.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.809+0000 7fa09b492740 1 --2- 172.21.15.1:0/259479754 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5633db08e390 0x5633db463a40 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fa080011580 tx=0x7fa0800107a0 comp rx=0 tx=0).stop 2024-09-21T01:01:35.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.810+0000 7fa09b492740 1 -- 172.21.15.1:0/259479754 shutdown_connections 2024-09-21T01:01:35.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.810+0000 7fa09b492740 1 --2- 172.21.15.1:0/259479754 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633db0af070 0x5633db453d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:35.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.810+0000 7fa09b492740 1 --2- 172.21.15.1:0/259479754 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5633db08e390 0x5633db463a40 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:35.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.810+0000 7fa09b492740 1 --2- 172.21.15.1:0/259479754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633db06d9f0 0x5633db458250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:35.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.810+0000 7fa09b492740 1 -- 172.21.15.1:0/259479754 >> 172.21.15.1:0/259479754 conn(0x5633db0a3460 msgr2=0x5633db463330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:35.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.811+0000 7fa09b492740 1 -- 172.21.15.1:0/259479754 shutdown_connections 2024-09-21T01:01:35.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.811+0000 7fa09b492740 1 -- 172.21.15.1:0/259479754 wait complete. 2024-09-21T01:01:35.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.812+0000 7fa09b492740 1 -- start start 2024-09-21T01:01:35.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.812+0000 7fa09b492740 1 Processor -- start 2024-09-21T01:01:35.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.813+0000 7fa09b492740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633db06d9f0 0x5633db466320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:35.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.813+0000 7fa09b492740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633db08e390 0x5633db466860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:35.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.813+0000 7fa08e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633db06d9f0 0x5633db466320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:35.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.813+0000 7fa08e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633db06d9f0 0x5633db466320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:51294/0 (socket says 172.21.15.1:51294) 2024-09-21T01:01:35.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.813+0000 7fa08e59c640 1 -- 172.21.15.1:0/1696894613 learned_addr learned my addr 172.21.15.1:0/1696894613 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:35.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.813+0000 7fa08dd9b640 1 --2- 172.21.15.1:0/1696894613 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633db08e390 0x5633db466860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:35.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.814+0000 7fa09b492740 1 --2- 172.21.15.1:0/1696894613 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5633db0af070 0x5633db466da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:35.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.816+0000 7fa08ed9d640 1 --2- 172.21.15.1:0/1696894613 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5633db0af070 0x5633db466da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:35.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.816+0000 7fa09b492740 1 -- 172.21.15.1:0/1696894613 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa07000fa70 con 0x5633db0af070 2024-09-21T01:01:35.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.816+0000 7fa09b492740 1 -- 172.21.15.1:0/1696894613 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa07000f3a0 con 0x5633db06d9f0 2024-09-21T01:01:35.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.816+0000 7fa09b492740 1 -- 172.21.15.1:0/1696894613 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa07000c520 con 0x5633db08e390 2024-09-21T01:01:35.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.818+0000 7fa08e59c640 1 -- 172.21.15.1:0/1696894613 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633db08e390 msgr2=0x5633db466860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:35.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.818+0000 7fa08e59c640 1 --2- 172.21.15.1:0/1696894613 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633db08e390 0x5633db466860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:35.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.818+0000 7fa08e59c640 1 -- 172.21.15.1:0/1696894613 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5633db0af070 msgr2=0x5633db466da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:35.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.818+0000 7fa08e59c640 1 --2- 172.21.15.1:0/1696894613 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5633db0af070 0x5633db466da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:35.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.818+0000 7fa08e59c640 1 -- 172.21.15.1:0/1696894613 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633db4de110 con 0x5633db06d9f0 2024-09-21T01:01:35.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.818+0000 7fa08ed9d640 1 --2- 172.21.15.1:0/1696894613 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5633db0af070 0x5633db466da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:01:35.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.823+0000 7fa08e59c640 1 --2- 172.21.15.1:0/1696894613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633db06d9f0 0x5633db466320 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa0840c8890 tx=0x7fa0840d4850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75bab61193255690 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:35.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.823+0000 7fa075ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:01:35.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.823+0000 7fa075ffb640 1 -- 172.21.15.1:0/1696894613 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0840c81e0 con 0x5633db06d9f0 2024-09-21T01:01:35.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.823+0000 7fa09b492740 10 client.0 _ll_register_callbacks cb 0x7fa088009c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:01:35.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.823+0000 7fa09b492740 1 -- 172.21.15.1:0/1696894613 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa080003aa0 con 0x5633db06d9f0 2024-09-21T01:01:35.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.823+0000 7fa075ffb640 1 -- 172.21.15.1:0/1696894613 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fa0841033e0 con 0x5633db06d9f0 2024-09-21T01:01:35.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.826+0000 7fa075ffb640 1 -- 172.21.15.1:0/1696894613 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fa084037070 con 0x5633db06d9f0 2024-09-21T01:01:35.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.826+0000 7fa09b492740 10 client.26351 fetch_fsmap learned FSMap version 33 2024-09-21T01:01:35.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.826+0000 7fa09b492740 1 -- 172.21.15.1:0/1696894613 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({fsmap=33}) -- 0x5633db4df180 con 0x5633db06d9f0 2024-09-21T01:01:35.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.828+0000 7fa075ffb640 1 -- 172.21.15.1:0/1696894613 <== mon.2 v2:172.21.15.42:3300/0 4 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fa08403a070 con 0x5633db06d9f0 2024-09-21T01:01:35.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.828+0000 7fa09b492740 10 client.26351 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:01:35.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.828+0000 7fa09b492740 10 client.26351 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-21T01:01:35.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.828+0000 7fa09b492740 20 client.26351 populate_metadata read hostname 'smithi001' 2024-09-21T01:01:35.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.828+0000 7fa09b492740 1 --2- 172.21.15.1:0/1696894613 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x5633db4df7f0 0x5633db4e1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:35.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.828+0000 7fa09b492740 4 client.26351 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:01:35.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.828+0000 7fa09b492740 1 -- 172.21.15.1:0/1696894613 --> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fa080003aa0 con 0x5633db4df7f0 2024-09-21T01:01:35.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.832+0000 7fa08dd9b640 1 --2- 172.21.15.1:0/1696894613 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x5633db4df7f0 0x5633db4e1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:35.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.844+0000 7fa08dd9b640 1 --2- 172.21.15.1:0/1696894613 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x5633db4df7f0 0x5633db4e1c40 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6db825a87281d4ff server_cookie=d46852e1c89505b2 in_seq=0 out_seq=0 2024-09-21T01:01:35.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.844+0000 7fa075ffb640 10 client.26351 ms_handle_connect on v2:172.21.15.193:6836/909252228 2024-09-21T01:01:35.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.845+0000 7fa075ffb640 1 -- 172.21.15.1:0/1696894613 <== mds.3 v2:172.21.15.193:6836/909252228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fa080003aa0 con 0x5633db4df7f0 2024-09-21T01:01:35.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.845+0000 7fa075ffb640 10 client.26351 handle_command_reply: tid=0 2024-09-21T01:01:35.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.846+0000 7fa09b492740 1 client.26351 shutdown 2024-09-21T01:01:35.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.846+0000 7fa09b492740 1 -- 172.21.15.1:0/1696894613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633db06d9f0 msgr2=0x5633db466320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:35.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.846+0000 7fa09b492740 1 --2- 172.21.15.1:0/1696894613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633db06d9f0 0x5633db466320 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa0840c8890 tx=0x7fa0840d4850 comp rx=0 tx=0).stop 2024-09-21T01:01:35.853 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T01:01:35.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.849+0000 7fa09b492740 1 -- 172.21.15.1:0/1696894613 shutdown_connections 2024-09-21T01:01:35.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.849+0000 7fa09b492740 1 --2- 172.21.15.1:0/1696894613 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x5633db4df7f0 0x5633db4e1c40 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:35.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.849+0000 7fa075ffb640 0 client.26351 ms_handle_reset on v2:172.21.15.193:6836/909252228 2024-09-21T01:01:35.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.849+0000 7fa09b492740 1 --2- 172.21.15.1:0/1696894613 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5633db0af070 0x5633db466da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:35.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.849+0000 7fa09b492740 1 --2- 172.21.15.1:0/1696894613 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633db08e390 0x5633db466860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:35.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.849+0000 7fa09b492740 1 --2- 172.21.15.1:0/1696894613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633db06d9f0 0x5633db466320 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:35.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.849+0000 7fa09b492740 1 -- 172.21.15.1:0/1696894613 >> 172.21.15.1:0/1696894613 conn(0x5633db0a3460 msgr2=0x5633db458020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:35.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.849+0000 7fa09b492740 1 -- 172.21.15.1:0/1696894613 shutdown_connections 2024-09-21T01:01:35.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.850+0000 7fa09b492740 1 -- 172.21.15.1:0/1696894613 wait complete. 2024-09-21T01:01:35.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.850+0000 7fa09b492740 20 client.26351 trim_cache size 0 max 16384 2024-09-21T01:01:35.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.857+0000 7fa08f59e640 1 -- 172.21.15.1:0/1642716320 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa0780b6940 msgr2=0x7fa0780b8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:35.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.857+0000 7fa08f59e640 1 --2- 172.21.15.1:0/1642716320 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa0780b6940 0x7fa0780b8e50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa0800116e0 tx=0x7fa080013040 comp rx=0 tx=0).stop 2024-09-21T01:01:35.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.858+0000 7fa08f59e640 1 -- 172.21.15.1:0/1642716320 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa09010dbf0 msgr2=0x7fa09011c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:35.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.858+0000 7fa08f59e640 1 --2- 172.21.15.1:0/1642716320 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa09010dbf0 0x7fa09011c160 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fa084009780 tx=0x7fa0840055e0 comp rx=0 tx=0).stop 2024-09-21T01:01:35.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.858+0000 7fa08f59e640 1 -- 172.21.15.1:0/1642716320 shutdown_connections 2024-09-21T01:01:35.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.858+0000 7fa08f59e640 1 --2- 172.21.15.1:0/1642716320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa09011cba0 0x7fa090116960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:35.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.858+0000 7fa08f59e640 1 --2- 172.21.15.1:0/1642716320 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa090111cd0 0x7fa090116420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:35.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.858+0000 7fa08f59e640 1 --2- 172.21.15.1:0/1642716320 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fa0780b6940 0x7fa0780b8e50 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:35.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.858+0000 7fa08f59e640 1 --2- 172.21.15.1:0/1642716320 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa09010dbf0 0x7fa09011c160 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:35.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.858+0000 7fa08f59e640 1 -- 172.21.15.1:0/1642716320 >> 172.21.15.1:0/1642716320 conn(0x7fa09006e9f0 msgr2=0x7fa09010c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:35.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.859+0000 7fa08f59e640 1 -- 172.21.15.1:0/1642716320 shutdown_connections 2024-09-21T01:01:35.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:35.859+0000 7fa08f59e640 1 -- 172.21.15.1:0/1642716320 wait complete. 2024-09-21T01:01:37.093 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T01:01:37.531 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:01:37.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:37 smithi193 ceph-mon[34660]: pgmap v490: 97 pgs: 97 active+clean; 541 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 1.1 MiB/s wr, 278 op/s 2024-09-21T01:01:37.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:37 smithi042 ceph-mon[34481]: pgmap v490: 97 pgs: 97 active+clean; 541 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 1.1 MiB/s wr, 278 op/s 2024-09-21T01:01:37.836 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:37 smithi001 ceph-mon[31211]: pgmap v490: 97 pgs: 97 active+clean; 541 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 1.1 MiB/s wr, 278 op/s 2024-09-21T01:01:38.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.216+0000 7f52716c8640 1 -- 172.21.15.1:0/3172935466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f526c1083a0 msgr2=0x7f526c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:38.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.216+0000 7f52716c8640 1 --2- 172.21.15.1:0/3172935466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f526c1083a0 0x7f526c1087b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f525c009900 tx=0x7f525c02a3f0 comp rx=0 tx=0).stop 2024-09-21T01:01:38.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.216+0000 7f52716c8640 1 -- 172.21.15.1:0/3172935466 shutdown_connections 2024-09-21T01:01:38.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.216+0000 7f52716c8640 1 --2- 172.21.15.1:0/3172935466 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f526c108cf0 0x7f526c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:38.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.216+0000 7f52716c8640 1 --2- 172.21.15.1:0/3172935466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f526c1083a0 0x7f526c1087b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:38.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.216+0000 7f52716c8640 1 --2- 172.21.15.1:0/3172935466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f526c102a60 0x7f526c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:38.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.216+0000 7f52716c8640 1 -- 172.21.15.1:0/3172935466 >> 172.21.15.1:0/3172935466 conn(0x7f526c079730 msgr2=0x7f526c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:38.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.216+0000 7f52716c8640 1 -- 172.21.15.1:0/3172935466 shutdown_connections 2024-09-21T01:01:38.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.216+0000 7f52716c8640 1 -- 172.21.15.1:0/3172935466 wait complete. 2024-09-21T01:01:38.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.217+0000 7f52716c8640 1 Processor -- start 2024-09-21T01:01:38.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.217+0000 7f52716c8640 1 -- start start 2024-09-21T01:01:38.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.218+0000 7f52716c8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f526c102a60 0x7f526c1980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:38.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.218+0000 7f52716c8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f526c1083a0 0x7f526c198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:38.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.218+0000 7f52716c8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f526c108cf0 0x7f526c19d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:38.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.218+0000 7f526a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f526c1083a0 0x7f526c198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:38.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.218+0000 7f526a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f526c1083a0 0x7f526c198630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46414/0 (socket says 172.21.15.1:46414) 2024-09-21T01:01:38.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.218+0000 7f526a7fc640 1 -- 172.21.15.1:0/1769874278 learned_addr learned my addr 172.21.15.1:0/1769874278 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:38.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.218+0000 7f52716c8640 1 -- 172.21.15.1:0/1769874278 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f526c112960 con 0x7f526c1083a0 2024-09-21T01:01:38.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.218+0000 7f52716c8640 1 -- 172.21.15.1:0/1769874278 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f526c1127e0 con 0x7f526c102a60 2024-09-21T01:01:38.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.218+0000 7f52716c8640 1 -- 172.21.15.1:0/1769874278 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f526c112ae0 con 0x7f526c108cf0 2024-09-21T01:01:38.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.218+0000 7f526b7fe640 1 --2- 172.21.15.1:0/1769874278 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f526c108cf0 0x7f526c19d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:38.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.218+0000 7f526affd640 1 --2- 172.21.15.1:0/1769874278 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f526c102a60 0x7f526c1980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:38.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.219+0000 7f526b7fe640 1 -- 172.21.15.1:0/1769874278 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f526c102a60 msgr2=0x7f526c1980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:38.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.219+0000 7f526b7fe640 1 --2- 172.21.15.1:0/1769874278 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f526c102a60 0x7f526c1980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:38.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.219+0000 7f526b7fe640 1 -- 172.21.15.1:0/1769874278 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f526c1083a0 msgr2=0x7f526c198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:38.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.219+0000 7f526b7fe640 1 --2- 172.21.15.1:0/1769874278 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f526c1083a0 0x7f526c198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:38.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.219+0000 7f526b7fe640 1 -- 172.21.15.1:0/1769874278 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f526c19e020 con 0x7f526c108cf0 2024-09-21T01:01:38.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.219+0000 7f526b7fe640 1 --2- 172.21.15.1:0/1769874278 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f526c108cf0 0x7f526c19d8f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f526000e970 tx=0x7f526000ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:38.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.219+0000 7f5253fff640 1 -- 172.21.15.1:0/1769874278 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526000ccc0 con 0x7f526c108cf0 2024-09-21T01:01:38.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.219+0000 7f5253fff640 1 -- 172.21.15.1:0/1769874278 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52600035f0 con 0x7f526c108cf0 2024-09-21T01:01:38.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.220+0000 7f5253fff640 1 -- 172.21.15.1:0/1769874278 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526000ce60 con 0x7f526c108cf0 2024-09-21T01:01:38.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.220+0000 7f52716c8640 1 -- 172.21.15.1:0/1769874278 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f526c19e2b0 con 0x7f526c108cf0 2024-09-21T01:01:38.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.220+0000 7f52716c8640 1 -- 172.21.15.1:0/1769874278 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f526c19ea60 con 0x7f526c108cf0 2024-09-21T01:01:38.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.224+0000 7f5277c3c740 1 Processor -- start 2024-09-21T01:01:38.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.224+0000 7f5253fff640 1 -- 172.21.15.1:0/1769874278 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f5260003ac0 con 0x7f526c108cf0 2024-09-21T01:01:38.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.224+0000 7f5277c3c740 1 -- start start 2024-09-21T01:01:38.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.225+0000 7f5277c3c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608fcc95070 0x5608fd03c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:38.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.225+0000 7f5277c3c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608fcc6c1b0 0x5608fd03cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:38.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.225+0000 7f5277c3c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608fcc74390 0x5608fd03d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:38.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.225+0000 7f5277c3c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5608fcfb2ea0 con 0x5608fcc6c1b0 2024-09-21T01:01:38.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.225+0000 7f5277c3c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5608fcfa22d0 con 0x5608fcc74390 2024-09-21T01:01:38.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.225+0000 7f5277c3c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5608fcfa60e0 con 0x5608fcc95070 2024-09-21T01:01:38.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.225+0000 7f526a7fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608fcc95070 0x5608fd03c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:38.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.225+0000 7f526affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608fcc6c1b0 0x5608fd03cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:38.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.225+0000 7f526a7fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608fcc95070 0x5608fd03c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:39934/0 (socket says 172.21.15.1:39934) 2024-09-21T01:01:38.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.225+0000 7f526a7fc640 1 -- 172.21.15.1:0/3926782333 learned_addr learned my addr 172.21.15.1:0/3926782333 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:38.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.225+0000 7f5253fff640 1 --2- 172.21.15.1:0/1769874278 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f52540b6660 0x7f52540b8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:38.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.225+0000 7f526a7fc640 1 --2- 172.21.15.1:0/3926782333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608fcc74390 0x5608fd03d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:38.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.226+0000 7f526b7fe640 1 --2- 172.21.15.1:0/1769874278 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f52540b6660 0x7f52540b8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:38.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.226+0000 7f5253fff640 1 -- 172.21.15.1:0/1769874278 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f52600e7520 con 0x7f526c108cf0 2024-09-21T01:01:38.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.226+0000 7f526affd640 1 -- 172.21.15.1:0/3926782333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608fcc95070 msgr2=0x5608fd03c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:38.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.226+0000 7f526affd640 1 --2- 172.21.15.1:0/3926782333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608fcc95070 0x5608fd03c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:38.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.226+0000 7f526affd640 1 -- 172.21.15.1:0/3926782333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608fcc74390 msgr2=0x5608fd03d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:38.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.226+0000 7f526affd640 1 --2- 172.21.15.1:0/3926782333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608fcc74390 0x5608fd03d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:38.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.226+0000 7f526affd640 1 -- 172.21.15.1:0/3926782333 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608fcd00650 con 0x5608fcc6c1b0 2024-09-21T01:01:38.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.226+0000 7f526a7fc640 1 --2- 172.21.15.1:0/3926782333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608fcc95070 0x5608fd03c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:01:38.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.226+0000 7f526b7fe640 1 --2- 172.21.15.1:0/1769874278 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f52540b6660 0x7f52540b8b70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f52600ad390 tx=0x7f52600717a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:38.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.226+0000 7f526affd640 1 --2- 172.21.15.1:0/3926782333 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608fcc6c1b0 0x5608fd03cbe0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f5264005fd0 tx=0x7f5264010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19b771864e4b9f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:38.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.227+0000 7f52517fa640 1 -- 172.21.15.1:0/3926782333 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5264016070 con 0x5608fcc6c1b0 2024-09-21T01:01:38.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.227+0000 7f52517fa640 1 -- 172.21.15.1:0/3926782333 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f526401bb10 con 0x5608fcc6c1b0 2024-09-21T01:01:38.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.227+0000 7f52517fa640 1 -- 172.21.15.1:0/3926782333 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5264012b30 con 0x5608fcc6c1b0 2024-09-21T01:01:38.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.228+0000 7f5277c3c740 1 -- 172.21.15.1:0/3926782333 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608fcc6c1b0 msgr2=0x5608fd03cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:38.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.228+0000 7f5277c3c740 1 --2- 172.21.15.1:0/3926782333 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608fcc6c1b0 0x5608fd03cbe0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f5264005fd0 tx=0x7f5264010740 comp rx=0 tx=0).stop 2024-09-21T01:01:38.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.228+0000 7f5277c3c740 1 -- 172.21.15.1:0/3926782333 shutdown_connections 2024-09-21T01:01:38.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.228+0000 7f5277c3c740 1 --2- 172.21.15.1:0/3926782333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608fcc74390 0x5608fd03d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:38.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.228+0000 7f5277c3c740 1 --2- 172.21.15.1:0/3926782333 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608fcc6c1b0 0x5608fd03cbe0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:38.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.228+0000 7f5277c3c740 1 --2- 172.21.15.1:0/3926782333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608fcc95070 0x5608fd03c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:38.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.228+0000 7f5277c3c740 1 -- 172.21.15.1:0/3926782333 >> 172.21.15.1:0/3926782333 conn(0x5608fcc89460 msgr2=0x5608fd03a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:38.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.228+0000 7f5277c3c740 1 -- 172.21.15.1:0/3926782333 shutdown_connections 2024-09-21T01:01:38.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.228+0000 7f5277c3c740 1 -- 172.21.15.1:0/3926782333 wait complete. 2024-09-21T01:01:38.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.229+0000 7f5277c3c740 1 -- start start 2024-09-21T01:01:38.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.229+0000 7f5277c3c740 1 Processor -- start 2024-09-21T01:01:38.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.230+0000 7f5277c3c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608fcc6c1b0 0x5608fd047d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:38.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.230+0000 7f5277c3c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608fcc74390 0x5608fd0482b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:38.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.230+0000 7f5277c3c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608fcc95070 0x5608fd054170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:38.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.230+0000 7f5277c3c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5608fce03700 con 0x5608fcc6c1b0 2024-09-21T01:01:38.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.230+0000 7f5277c3c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5608fcf3d160 con 0x5608fcc95070 2024-09-21T01:01:38.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.230+0000 7f5277c3c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5608fd04ae80 con 0x5608fcc74390 2024-09-21T01:01:38.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.230+0000 7f5277c3c740 10 client.0 _ll_register_callbacks cb 0x5608fcf569e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:01:38.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.230+0000 7f526a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608fcc6c1b0 0x5608fd047d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:38.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.231+0000 7f526affd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608fcc74390 0x5608fd0482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:38.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.231+0000 7f526a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608fcc6c1b0 0x5608fd047d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46434/0 (socket says 172.21.15.1:46434) 2024-09-21T01:01:38.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.231+0000 7f526a7fc640 1 -- 172.21.15.1:0/3397640022 learned_addr learned my addr 172.21.15.1:0/3397640022 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:38.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.231+0000 7f526a7fc640 1 --2- 172.21.15.1:0/3397640022 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608fcc95070 0x5608fd054170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:38.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.231+0000 7f526a7fc640 1 -- 172.21.15.1:0/3397640022 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608fcc74390 msgr2=0x5608fd0482b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:38.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.231+0000 7f526a7fc640 1 --2- 172.21.15.1:0/3397640022 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608fcc74390 0x5608fd0482b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:38.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.231+0000 7f526a7fc640 1 -- 172.21.15.1:0/3397640022 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608fcc95070 msgr2=0x5608fd054170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:38.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.231+0000 7f526a7fc640 1 --2- 172.21.15.1:0/3397640022 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608fcc95070 0x5608fd054170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:38.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.231+0000 7f526a7fc640 1 -- 172.21.15.1:0/3397640022 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608fcf6ac90 con 0x5608fcc6c1b0 2024-09-21T01:01:38.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.231+0000 7f526a7fc640 1 --2- 172.21.15.1:0/3397640022 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608fcc6c1b0 0x5608fd047d70 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f525c02a9d0 tx=0x7f525c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ead21e8366790e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:38.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.231+0000 7f524eff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:01:38.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.232+0000 7f524eff5640 1 -- 172.21.15.1:0/3397640022 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c035040 con 0x5608fcc6c1b0 2024-09-21T01:01:38.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.232+0000 7f524eff5640 1 -- 172.21.15.1:0/3397640022 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f525c0035f0 con 0x5608fcc6c1b0 2024-09-21T01:01:38.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.232+0000 7f5277c3c740 1 -- 172.21.15.1:0/3397640022 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f526401bb10 con 0x5608fcc6c1b0 2024-09-21T01:01:38.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.232+0000 7f524eff5640 1 -- 172.21.15.1:0/3397640022 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f525c051070 con 0x5608fcc6c1b0 2024-09-21T01:01:38.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.232+0000 7f5277c3c740 10 client.16710 fetch_fsmap learned FSMap version 33 2024-09-21T01:01:38.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.232+0000 7f5277c3c740 1 -- 172.21.15.1:0/3397640022 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5608fd056ba0 con 0x5608fcc6c1b0 2024-09-21T01:01:38.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.232+0000 7f524eff5640 1 -- 172.21.15.1:0/3397640022 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f526401bb10 con 0x5608fcc6c1b0 2024-09-21T01:01:38.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.232+0000 7f524eff5640 1 -- 172.21.15.1:0/3397640022 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f525c03d860 con 0x5608fcc6c1b0 2024-09-21T01:01:38.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.232+0000 7f5277c3c740 10 client.16710 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:01:38.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.233+0000 7f5277c3c740 10 client.16710 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T01:01:38.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.233+0000 7f5277c3c740 20 client.16710 populate_metadata read hostname 'smithi001' 2024-09-21T01:01:38.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.233+0000 7f5277c3c740 1 --2- 172.21.15.1:0/3397640022 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x5608fcc539f0 0x5608fd05a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:38.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.233+0000 7f5277c3c740 4 client.16710 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:01:38.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.233+0000 7f5277c3c740 1 -- 172.21.15.1:0/3397640022 --> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608fcfb4df0 con 0x5608fcc539f0 2024-09-21T01:01:38.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.233+0000 7f526affd640 1 --2- 172.21.15.1:0/3397640022 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x5608fcc539f0 0x5608fd05a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:38.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.233+0000 7f526affd640 1 --2- 172.21.15.1:0/3397640022 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x5608fcc539f0 0x5608fd05a0f0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7471d82aea883d1e server_cookie=f425a493561cd9b5 in_seq=0 out_seq=0 2024-09-21T01:01:38.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.233+0000 7f524eff5640 10 client.16710 ms_handle_connect on v2:172.21.15.42:6836/2395608508 2024-09-21T01:01:38.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.237+0000 7f524eff5640 1 -- 172.21.15.1:0/3397640022 <== mds.2 v2:172.21.15.42:6836/2395608508 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5608fcfb4df0 con 0x5608fcc539f0 2024-09-21T01:01:38.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.237+0000 7f524eff5640 10 client.16710 handle_command_reply: tid=0 2024-09-21T01:01:38.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.237+0000 7f5277c3c740 1 client.16710 shutdown 2024-09-21T01:01:38.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.238+0000 7f5277c3c740 1 -- 172.21.15.1:0/3397640022 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608fcc6c1b0 msgr2=0x5608fd047d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:38.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.238+0000 7f5277c3c740 1 --2- 172.21.15.1:0/3397640022 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608fcc6c1b0 0x5608fd047d70 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f525c02a9d0 tx=0x7f525c009260 comp rx=0 tx=0).stop 2024-09-21T01:01:38.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.238+0000 7f5277c3c740 1 -- 172.21.15.1:0/3397640022 shutdown_connections 2024-09-21T01:01:38.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.238+0000 7f5277c3c740 1 --2- 172.21.15.1:0/3397640022 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x5608fcc539f0 0x5608fd05a0f0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:38.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.238+0000 7f5277c3c740 1 --2- 172.21.15.1:0/3397640022 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608fcc95070 0x5608fd054170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:38.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.238+0000 7f5277c3c740 1 --2- 172.21.15.1:0/3397640022 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608fcc74390 0x5608fd0482b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:38.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.238+0000 7f5277c3c740 1 --2- 172.21.15.1:0/3397640022 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608fcc6c1b0 0x5608fd047d70 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:38.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.238+0000 7f5277c3c740 1 -- 172.21.15.1:0/3397640022 >> 172.21.15.1:0/3397640022 conn(0x5608fcc89460 msgr2=0x5608fd03f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:38.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.238+0000 7f524eff5640 0 client.16710 ms_handle_reset on v2:172.21.15.42:6836/2395608508 2024-09-21T01:01:38.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.238+0000 7f5277c3c740 1 -- 172.21.15.1:0/3397640022 shutdown_connections 2024-09-21T01:01:38.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.238+0000 7f5277c3c740 1 -- 172.21.15.1:0/3397640022 wait complete. 2024-09-21T01:01:38.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.239+0000 7f5277c3c740 20 client.16710 trim_cache size 0 max 16384 2024-09-21T01:01:38.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.266+0000 7f5277c3c740 1 Processor -- start 2024-09-21T01:01:38.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.266+0000 7f5277c3c740 1 -- start start 2024-09-21T01:01:38.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.266+0000 7f5277c3c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608fcc74390 0x5608fd0499a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:38.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.266+0000 7f5277c3c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608fcc95070 0x5608fd039bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:38.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.266+0000 7f5277c3c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608fcc28da0 0x5608fd03a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:38.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.266+0000 7f5277c3c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f526c1be310 con 0x5608fcc95070 2024-09-21T01:01:38.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.266+0000 7f5277c3c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f526c1bff10 con 0x5608fcc28da0 2024-09-21T01:01:38.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.266+0000 7f5277c3c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f526c1be9e0 con 0x5608fcc74390 2024-09-21T01:01:38.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.266+0000 7f526affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608fcc95070 0x5608fd039bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:38.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.266+0000 7f526affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608fcc95070 0x5608fd039bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46446/0 (socket says 172.21.15.1:46446) 2024-09-21T01:01:38.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.266+0000 7f526affd640 1 -- 172.21.15.1:0/508551043 learned_addr learned my addr 172.21.15.1:0/508551043 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:38.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.267+0000 7f526a7fc640 1 --2- 172.21.15.1:0/508551043 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608fcc74390 0x5608fd0499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:38.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.267+0000 7f526a7fc640 1 --2- 172.21.15.1:0/508551043 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608fcc28da0 0x5608fd03a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:38.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.267+0000 7f526affd640 1 -- 172.21.15.1:0/508551043 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608fcc74390 msgr2=0x5608fd0499a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:38.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.267+0000 7f526affd640 1 --2- 172.21.15.1:0/508551043 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608fcc74390 0x5608fd0499a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:38.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.267+0000 7f526affd640 1 -- 172.21.15.1:0/508551043 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608fcc28da0 msgr2=0x5608fd03a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:38.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.267+0000 7f526affd640 1 --2- 172.21.15.1:0/508551043 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608fcc28da0 0x5608fd03a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:38.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.267+0000 7f526affd640 1 -- 172.21.15.1:0/508551043 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608fd049030 con 0x5608fcc95070 2024-09-21T01:01:38.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.267+0000 7f526a7fc640 1 --2- 172.21.15.1:0/508551043 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608fcc74390 0x5608fd0499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:01:38.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.267+0000 7f526affd640 1 --2- 172.21.15.1:0/508551043 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608fcc95070 0x5608fd039bc0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f52640124c0 tx=0x7f5264009320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de1bc86a6b99e29a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:38.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.267+0000 7f5250ff9640 1 -- 172.21.15.1:0/508551043 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5264016040 con 0x5608fcc95070 2024-09-21T01:01:38.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.267+0000 7f5250ff9640 1 -- 172.21.15.1:0/508551043 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5264012cf0 con 0x5608fcc95070 2024-09-21T01:01:38.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.267+0000 7f5250ff9640 1 -- 172.21.15.1:0/508551043 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5264005590 con 0x5608fcc95070 2024-09-21T01:01:38.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.268+0000 7f5277c3c740 1 -- 172.21.15.1:0/508551043 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608fcc95070 msgr2=0x5608fd039bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:38.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.268+0000 7f5277c3c740 1 --2- 172.21.15.1:0/508551043 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608fcc95070 0x5608fd039bc0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f52640124c0 tx=0x7f5264009320 comp rx=0 tx=0).stop 2024-09-21T01:01:38.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.268+0000 7f5277c3c740 1 -- 172.21.15.1:0/508551043 shutdown_connections 2024-09-21T01:01:38.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.268+0000 7f5277c3c740 1 --2- 172.21.15.1:0/508551043 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608fcc28da0 0x5608fd03a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:38.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.268+0000 7f5277c3c740 1 --2- 172.21.15.1:0/508551043 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608fcc95070 0x5608fd039bc0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:38.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.268+0000 7f5277c3c740 1 --2- 172.21.15.1:0/508551043 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608fcc74390 0x5608fd0499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:38.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.268+0000 7f5277c3c740 1 -- 172.21.15.1:0/508551043 >> 172.21.15.1:0/508551043 conn(0x5608fcc89460 msgr2=0x5608fd049290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:38.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.268+0000 7f5277c3c740 1 -- 172.21.15.1:0/508551043 shutdown_connections 2024-09-21T01:01:38.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.269+0000 7f5277c3c740 1 -- 172.21.15.1:0/508551043 wait complete. 2024-09-21T01:01:38.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.269+0000 7f5277c3c740 1 -- start start 2024-09-21T01:01:38.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.269+0000 7f5277c3c740 1 Processor -- start 2024-09-21T01:01:38.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.270+0000 7f5277c3c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608fcc28da0 0x5608fd04c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:38.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.270+0000 7f526a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608fcc28da0 0x5608fd04c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:38.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.270+0000 7f526a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608fcc28da0 0x5608fd04c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46450/0 (socket says 172.21.15.1:46450) 2024-09-21T01:01:38.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.270+0000 7f5277c3c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608fcc74390 0x5608fd04c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:38.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.270+0000 7f526a7fc640 1 -- 172.21.15.1:0/1725387063 learned_addr learned my addr 172.21.15.1:0/1725387063 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:38.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.270+0000 7f5277c3c740 1 --2- 172.21.15.1:0/1725387063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608fcc95070 0x5608fd04cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:38.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.270+0000 7f5277c3c740 1 -- 172.21.15.1:0/1725387063 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f526c1bf840 con 0x5608fcc28da0 2024-09-21T01:01:38.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.270+0000 7f5277c3c740 1 -- 172.21.15.1:0/1725387063 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f526c1bf170 con 0x5608fcc95070 2024-09-21T01:01:38.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.270+0000 7f5277c3c740 1 -- 172.21.15.1:0/1725387063 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f526c1bc2f0 con 0x5608fcc74390 2024-09-21T01:01:38.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.270+0000 7f526affd640 1 --2- 172.21.15.1:0/1725387063 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608fcc74390 0x5608fd04c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:38.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.270+0000 7f526a7fc640 1 --2- 172.21.15.1:0/1725387063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608fcc95070 0x5608fd04cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:38.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.271+0000 7f526a7fc640 1 -- 172.21.15.1:0/1725387063 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608fcc74390 msgr2=0x5608fd04c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:38.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.271+0000 7f526a7fc640 1 --2- 172.21.15.1:0/1725387063 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608fcc74390 0x5608fd04c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:38.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.271+0000 7f526a7fc640 1 -- 172.21.15.1:0/1725387063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608fcc95070 msgr2=0x5608fd04cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:38.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.271+0000 7f526a7fc640 1 --2- 172.21.15.1:0/1725387063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608fcc95070 0x5608fd04cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:38.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.271+0000 7f526a7fc640 1 -- 172.21.15.1:0/1725387063 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608fd0c3ab0 con 0x5608fcc28da0 2024-09-21T01:01:38.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.271+0000 7f5277c3c740 10 client.0 _ll_register_callbacks cb 0x7f525c005850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:01:38.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.271+0000 7f5277c3c740 1 -- 172.21.15.1:0/1725387063 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5264012cf0 con 0x5608fcc28da0 2024-09-21T01:01:38.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.271+0000 7f526a7fc640 1 --2- 172.21.15.1:0/1725387063 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608fcc28da0 0x5608fd04c0a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f525c03ddd0 tx=0x7f525c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16345a5b356156a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:38.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.271+0000 7f524eff5640 10 client.16716 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:01:38.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.271+0000 7f524eff5640 1 -- 172.21.15.1:0/1725387063 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c035070 con 0x5608fcc28da0 2024-09-21T01:01:38.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.271+0000 7f524eff5640 1 -- 172.21.15.1:0/1725387063 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f525c005030 con 0x5608fcc28da0 2024-09-21T01:01:38.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.272+0000 7f524eff5640 1 -- 172.21.15.1:0/1725387063 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f525c005230 con 0x5608fcc28da0 2024-09-21T01:01:38.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.272+0000 7f5277c3c740 10 client.16716 fetch_fsmap learned FSMap version 33 2024-09-21T01:01:38.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.272+0000 7f5277c3c740 1 -- 172.21.15.1:0/1725387063 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({fsmap=33}) -- 0x5608fd0c4a50 con 0x5608fcc28da0 2024-09-21T01:01:38.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.272+0000 7f524eff5640 1 -- 172.21.15.1:0/1725387063 <== mon.0 v2:172.21.15.1:3300/0 4 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f525c0053d0 con 0x5608fcc28da0 2024-09-21T01:01:38.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.272+0000 7f5277c3c740 10 client.16716 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:01:38.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.272+0000 7f5277c3c740 10 client.16716 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T01:01:38.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.272+0000 7f5277c3c740 20 client.16716 populate_metadata read hostname 'smithi001' 2024-09-21T01:01:38.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.272+0000 7f5277c3c740 1 --2- 172.21.15.1:0/1725387063 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x5608fd0c51c0 0x5608fd0c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:38.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.272+0000 7f5277c3c740 4 client.16716 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:01:38.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.272+0000 7f5277c3c740 1 -- 172.21.15.1:0/1725387063 --> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5608fcfb08a0 con 0x5608fd0c51c0 2024-09-21T01:01:38.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.272+0000 7f526affd640 1 --2- 172.21.15.1:0/1725387063 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x5608fd0c51c0 0x5608fd0c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:38.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.273+0000 7f524eff5640 10 client.16716 ms_handle_connect on v2:172.21.15.42:6836/2395608508 2024-09-21T01:01:38.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.273+0000 7f526affd640 1 --2- 172.21.15.1:0/1725387063 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x5608fd0c51c0 0x5608fd0c76d0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2fbfde7d7c513d0e server_cookie=c058e4a096b38daf in_seq=0 out_seq=0 2024-09-21T01:01:38.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.277+0000 7f524eff5640 1 -- 172.21.15.1:0/1725387063 <== mds.2 v2:172.21.15.42:6836/2395608508 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5608fcfb08a0 con 0x5608fd0c51c0 2024-09-21T01:01:38.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.277+0000 7f524eff5640 10 client.16716 handle_command_reply: tid=0 2024-09-21T01:01:38.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.277+0000 7f5277c3c740 1 client.16716 shutdown 2024-09-21T01:01:38.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.278+0000 7f5277c3c740 1 -- 172.21.15.1:0/1725387063 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608fcc28da0 msgr2=0x5608fd04c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:38.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.278+0000 7f5277c3c740 1 --2- 172.21.15.1:0/1725387063 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608fcc28da0 0x5608fd04c0a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f525c03ddd0 tx=0x7f525c009260 comp rx=0 tx=0).stop 2024-09-21T01:01:38.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.278+0000 7f5277c3c740 1 -- 172.21.15.1:0/1725387063 shutdown_connections 2024-09-21T01:01:38.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.278+0000 7f5277c3c740 1 --2- 172.21.15.1:0/1725387063 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x5608fd0c51c0 0x5608fd0c76d0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:38.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.278+0000 7f5277c3c740 1 --2- 172.21.15.1:0/1725387063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608fcc95070 0x5608fd04cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:38.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.278+0000 7f524eff5640 0 client.16716 ms_handle_reset on v2:172.21.15.42:6836/2395608508 2024-09-21T01:01:38.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.278+0000 7f5277c3c740 1 --2- 172.21.15.1:0/1725387063 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608fcc74390 0x5608fd04c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:38.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.278+0000 7f5277c3c740 1 --2- 172.21.15.1:0/1725387063 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608fcc28da0 0x5608fd04c0a0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:38.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.278+0000 7f5277c3c740 1 -- 172.21.15.1:0/1725387063 >> 172.21.15.1:0/1725387063 conn(0x5608fcc89460 msgr2=0x5608fd03d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:38.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.278+0000 7f5277c3c740 1 -- 172.21.15.1:0/1725387063 shutdown_connections 2024-09-21T01:01:38.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.278+0000 7f5277c3c740 1 -- 172.21.15.1:0/1725387063 wait complete. 2024-09-21T01:01:38.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.278+0000 7f5277c3c740 20 client.16716 trim_cache size 0 max 16384 2024-09-21T01:01:38.280 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T01:01:38.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.279+0000 7f52716c8640 1 -- 172.21.15.1:0/1769874278 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f52540b6660 msgr2=0x7f52540b8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:38.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.279+0000 7f52716c8640 1 --2- 172.21.15.1:0/1769874278 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f52540b6660 0x7f52540b8b70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f52600ad390 tx=0x7f52600717a0 comp rx=0 tx=0).stop 2024-09-21T01:01:38.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.279+0000 7f52716c8640 1 -- 172.21.15.1:0/1769874278 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f526c108cf0 msgr2=0x7f526c19d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:38.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.279+0000 7f52716c8640 1 --2- 172.21.15.1:0/1769874278 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f526c108cf0 0x7f526c19d8f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f526000e970 tx=0x7f526000ee30 comp rx=0 tx=0).stop 2024-09-21T01:01:38.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.279+0000 7f52716c8640 1 -- 172.21.15.1:0/1769874278 shutdown_connections 2024-09-21T01:01:38.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.279+0000 7f52716c8640 1 --2- 172.21.15.1:0/1769874278 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f526c108cf0 0x7f526c19d8f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:38.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.279+0000 7f52716c8640 1 --2- 172.21.15.1:0/1769874278 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f52540b6660 0x7f52540b8b70 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:38.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.279+0000 7f52716c8640 1 --2- 172.21.15.1:0/1769874278 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f526c1083a0 0x7f526c198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:38.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.279+0000 7f52716c8640 1 --2- 172.21.15.1:0/1769874278 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f526c102a60 0x7f526c1980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:38.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.279+0000 7f52716c8640 1 -- 172.21.15.1:0/1769874278 >> 172.21.15.1:0/1769874278 conn(0x7f526c079730 msgr2=0x7f526c06b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:38.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.279+0000 7f52716c8640 1 -- 172.21.15.1:0/1769874278 shutdown_connections 2024-09-21T01:01:38.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:38.279+0000 7f52716c8640 1 -- 172.21.15.1:0/1769874278 wait complete. 2024-09-21T01:01:39.530 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T01:01:39.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:39 smithi042 ceph-mon[34481]: pgmap v491: 97 pgs: 97 active+clean; 546 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 275 op/s 2024-09-21T01:01:39.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:39 smithi001 ceph-mon[31211]: pgmap v491: 97 pgs: 97 active+clean; 546 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 275 op/s 2024-09-21T01:01:39.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:39 smithi193 ceph-mon[34660]: pgmap v491: 97 pgs: 97 active+clean; 546 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 275 op/s 2024-09-21T01:01:40.338 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:01:40.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.863+0000 7f99bd682640 1 -- 172.21.15.1:0/2539647024 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99b8104a30 msgr2=0x7f99b8104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:40.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.863+0000 7f99bd682640 1 --2- 172.21.15.1:0/2539647024 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99b8104a30 0x7f99b8104e40 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f99a8009ca0 tx=0x7f99a802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:01:40.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.863+0000 7f99bd682640 1 -- 172.21.15.1:0/2539647024 shutdown_connections 2024-09-21T01:01:40.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.863+0000 7f99bd682640 1 --2- 172.21.15.1:0/2539647024 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f99b810de60 0x7f99b8110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:40.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.863+0000 7f99bd682640 1 --2- 172.21.15.1:0/2539647024 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99b8105380 0x7f99b810d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:40.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.863+0000 7f99bd682640 1 --2- 172.21.15.1:0/2539647024 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99b8104a30 0x7f99b8104e40 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:40.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.863+0000 7f99bd682640 1 -- 172.21.15.1:0/2539647024 >> 172.21.15.1:0/2539647024 conn(0x7f99b80797b0 msgr2=0x7f99b8079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:40.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.863+0000 7f99bd682640 1 -- 172.21.15.1:0/2539647024 shutdown_connections 2024-09-21T01:01:40.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.863+0000 7f99bd682640 1 -- 172.21.15.1:0/2539647024 wait complete. 2024-09-21T01:01:40.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.864+0000 7f99bd682640 1 Processor -- start 2024-09-21T01:01:40.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.864+0000 7f99bd682640 1 -- start start 2024-09-21T01:01:40.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.865+0000 7f99bd682640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f99b8104a30 0x7f99b8102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:40.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.865+0000 7f99bd682640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99b8105380 0x7f99b8102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:40.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.865+0000 7f99bd682640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99b810de60 0x7f99b81031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:40.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.865+0000 7f99bd682640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f99b8113aa0 con 0x7f99b8105380 2024-09-21T01:01:40.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.865+0000 7f99bd682640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f99b8113920 con 0x7f99b810de60 2024-09-21T01:01:40.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.865+0000 7f99bd682640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f99b8113c20 con 0x7f99b8104a30 2024-09-21T01:01:40.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.865+0000 7f99b77fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99b810de60 0x7f99b81031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:40.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.865+0000 7f99b67fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99b8105380 0x7f99b8102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:40.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.865+0000 7f99b77fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99b810de60 0x7f99b81031f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:59524/0 (socket says 172.21.15.1:59524) 2024-09-21T01:01:40.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.865+0000 7f99b67fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99b8105380 0x7f99b8102cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37768/0 (socket says 172.21.15.1:37768) 2024-09-21T01:01:40.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.865+0000 7f99b77fe640 1 -- 172.21.15.1:0/542675086 learned_addr learned my addr 172.21.15.1:0/542675086 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:40.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.865+0000 7f99b6ffd640 1 --2- 172.21.15.1:0/542675086 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f99b8104a30 0x7f99b8102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:40.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.865+0000 7f99b77fe640 1 -- 172.21.15.1:0/542675086 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f99b8104a30 msgr2=0x7f99b8102770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:40.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.865+0000 7f99b77fe640 1 --2- 172.21.15.1:0/542675086 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f99b8104a30 0x7f99b8102770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:40.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.865+0000 7f99b77fe640 1 -- 172.21.15.1:0/542675086 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99b8105380 msgr2=0x7f99b8102cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:40.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.865+0000 7f99b77fe640 1 --2- 172.21.15.1:0/542675086 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99b8105380 0x7f99b8102cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:40.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.865+0000 7f99b77fe640 1 -- 172.21.15.1:0/542675086 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b81a8730 con 0x7f99b810de60 2024-09-21T01:01:40.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.866+0000 7f99b77fe640 1 --2- 172.21.15.1:0/542675086 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99b810de60 0x7f99b81031f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f99b000e970 tx=0x7f99b000ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:40.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.866+0000 7f99affff640 1 -- 172.21.15.1:0/542675086 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b000ccc0 con 0x7f99b810de60 2024-09-21T01:01:40.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.866+0000 7f99affff640 1 -- 172.21.15.1:0/542675086 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99b000ce60 con 0x7f99b810de60 2024-09-21T01:01:40.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.866+0000 7f99bd682640 1 -- 172.21.15.1:0/542675086 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99b81a8a20 con 0x7f99b810de60 2024-09-21T01:01:40.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.866+0000 7f99affff640 1 -- 172.21.15.1:0/542675086 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b0010430 con 0x7f99b810de60 2024-09-21T01:01:40.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.866+0000 7f99bd682640 1 -- 172.21.15.1:0/542675086 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99b81a8f10 con 0x7f99b810de60 2024-09-21T01:01:40.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.869+0000 7f99c3bf6740 1 Processor -- start 2024-09-21T01:01:40.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.869+0000 7f99affff640 1 -- 172.21.15.1:0/542675086 <== mon.2 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f99b00105d0 con 0x7f99b810de60 2024-09-21T01:01:40.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.869+0000 7f99c3bf6740 1 -- start start 2024-09-21T01:01:40.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.869+0000 7f99c3bf6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619a3459070 0x5619a38002c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:40.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.869+0000 7f99c3bf6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619a34301b0 0x5619a3800800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:40.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.869+0000 7f99c3bf6740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619a3438390 0x5619a3800d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:40.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.869+0000 7f99c3bf6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5619a3776ea0 con 0x5619a34301b0 2024-09-21T01:01:40.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.869+0000 7f99c3bf6740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5619a37662d0 con 0x5619a3438390 2024-09-21T01:01:40.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.869+0000 7f99c3bf6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5619a376a0e0 con 0x5619a3459070 2024-09-21T01:01:40.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.869+0000 7f99b6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619a34301b0 0x5619a3800800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:40.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.869+0000 7f99b6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619a34301b0 0x5619a3800800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37782/0 (socket says 172.21.15.1:37782) 2024-09-21T01:01:40.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.869+0000 7f99b6ffd640 1 -- 172.21.15.1:0/2000589076 learned_addr learned my addr 172.21.15.1:0/2000589076 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:40.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.869+0000 7f99b67fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619a3438390 0x5619a3800d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:40.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.870+0000 7f99b67fc640 1 --2- 172.21.15.1:0/2000589076 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619a3459070 0x5619a38002c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:40.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.870+0000 7f99affff640 1 --2- 172.21.15.1:0/542675086 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f99a40b6510 0x7f99a40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:40.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.870+0000 7f99b6ffd640 1 -- 172.21.15.1:0/2000589076 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619a3459070 msgr2=0x5619a38002c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:40.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.870+0000 7f99b6ffd640 1 --2- 172.21.15.1:0/2000589076 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619a3459070 0x5619a38002c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:40.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.870+0000 7f99b6ffd640 1 -- 172.21.15.1:0/2000589076 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619a3438390 msgr2=0x5619a3800d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:40.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.870+0000 7f99b6ffd640 1 --2- 172.21.15.1:0/2000589076 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619a3438390 0x5619a3800d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:40.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.870+0000 7f99b6ffd640 1 -- 172.21.15.1:0/2000589076 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619a34c4650 con 0x5619a34301b0 2024-09-21T01:01:40.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.870+0000 7f99b67fc640 1 --2- 172.21.15.1:0/2000589076 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619a3438390 0x5619a3800d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:01:40.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.870+0000 7f99b77fe640 1 --2- 172.21.15.1:0/542675086 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f99a40b6510 0x7f99a40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:40.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.870+0000 7f99affff640 1 -- 172.21.15.1:0/542675086 <== mon.2 v2:172.21.15.42:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f99b00e7730 con 0x7f99b810de60 2024-09-21T01:01:40.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.870+0000 7f99b6ffd640 1 --2- 172.21.15.1:0/2000589076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619a34301b0 0x5619a3800800 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f99a8009ca0 tx=0x7f99a8009410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8091381179e1460 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:40.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.871+0000 7f99ad7fa640 1 -- 172.21.15.1:0/2000589076 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a8031cf0 con 0x5619a34301b0 2024-09-21T01:01:40.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.871+0000 7f99ad7fa640 1 -- 172.21.15.1:0/2000589076 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99a8036030 con 0x5619a34301b0 2024-09-21T01:01:40.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.871+0000 7f99ad7fa640 1 -- 172.21.15.1:0/2000589076 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a80042a0 con 0x5619a34301b0 2024-09-21T01:01:40.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.871+0000 7f99c3bf6740 1 -- 172.21.15.1:0/2000589076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619a34301b0 msgr2=0x5619a3800800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:40.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.871+0000 7f99b77fe640 1 --2- 172.21.15.1:0/542675086 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f99a40b6510 0x7f99a40b8a20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f99b0004ff0 tx=0x7f99b007abd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:40.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.871+0000 7f99c3bf6740 1 --2- 172.21.15.1:0/2000589076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619a34301b0 0x5619a3800800 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f99a8009ca0 tx=0x7f99a8009410 comp rx=0 tx=0).stop 2024-09-21T01:01:40.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.872+0000 7f99c3bf6740 1 -- 172.21.15.1:0/2000589076 shutdown_connections 2024-09-21T01:01:40.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.872+0000 7f99c3bf6740 1 --2- 172.21.15.1:0/2000589076 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619a3438390 0x5619a3800d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:40.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.872+0000 7f99c3bf6740 1 --2- 172.21.15.1:0/2000589076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619a34301b0 0x5619a3800800 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:40.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.872+0000 7f99c3bf6740 1 --2- 172.21.15.1:0/2000589076 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619a3459070 0x5619a38002c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:40.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.872+0000 7f99c3bf6740 1 -- 172.21.15.1:0/2000589076 >> 172.21.15.1:0/2000589076 conn(0x5619a344d460 msgr2=0x5619a37fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:40.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.872+0000 7f99c3bf6740 1 -- 172.21.15.1:0/2000589076 shutdown_connections 2024-09-21T01:01:40.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.872+0000 7f99c3bf6740 1 -- 172.21.15.1:0/2000589076 wait complete. 2024-09-21T01:01:40.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.872+0000 7f99c3bf6740 1 -- start start 2024-09-21T01:01:40.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.872+0000 7f99c3bf6740 1 Processor -- start 2024-09-21T01:01:40.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.873+0000 7f99c3bf6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619a34301b0 0x5619a380b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:40.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.873+0000 7f99c3bf6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619a3438390 0x5619a380bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:40.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.873+0000 7f99c3bf6740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619a3459070 0x5619a3817be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:40.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.873+0000 7f99c3bf6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5619a35c7700 con 0x5619a34301b0 2024-09-21T01:01:40.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.873+0000 7f99c3bf6740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5619a3701160 con 0x5619a3459070 2024-09-21T01:01:40.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.873+0000 7f99c3bf6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5619a380e8c0 con 0x5619a3438390 2024-09-21T01:01:40.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.873+0000 7f99b67fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619a34301b0 0x5619a380b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:40.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.873+0000 7f99c3bf6740 10 client.0 _ll_register_callbacks cb 0x5619a371a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:01:40.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.873+0000 7f99b67fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619a34301b0 0x5619a380b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37798/0 (socket says 172.21.15.1:37798) 2024-09-21T01:01:40.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.873+0000 7f99b67fc640 1 -- 172.21.15.1:0/84149743 learned_addr learned my addr 172.21.15.1:0/84149743 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:40.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.873+0000 7f99b6ffd640 1 --2- 172.21.15.1:0/84149743 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619a3438390 0x5619a380bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:40.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.873+0000 7f99b67fc640 1 --2- 172.21.15.1:0/84149743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619a3459070 0x5619a3817be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:40.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.873+0000 7f99b6ffd640 1 -- 172.21.15.1:0/84149743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619a3459070 msgr2=0x5619a3817be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:40.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.873+0000 7f99b6ffd640 1 --2- 172.21.15.1:0/84149743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619a3459070 0x5619a3817be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:40.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.873+0000 7f99b6ffd640 1 -- 172.21.15.1:0/84149743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619a34301b0 msgr2=0x5619a380b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:40.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.873+0000 7f99b6ffd640 1 --2- 172.21.15.1:0/84149743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619a34301b0 0x5619a380b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:40.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.874+0000 7f99b6ffd640 1 -- 172.21.15.1:0/84149743 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619a372ec90 con 0x5619a3438390 2024-09-21T01:01:40.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.874+0000 7f99b6ffd640 1 --2- 172.21.15.1:0/84149743 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619a3438390 0x5619a380bed0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f99a802ade0 tx=0x7f99a802a8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b837bf27c6f183b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:40.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.874+0000 7f999e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T01:01:40.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.874+0000 7f999e7fc640 1 -- 172.21.15.1:0/84149743 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a804a040 con 0x5619a3438390 2024-09-21T01:01:40.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.874+0000 7f999e7fc640 1 -- 172.21.15.1:0/84149743 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f99a8031650 con 0x5619a3438390 2024-09-21T01:01:40.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.874+0000 7f99c3bf6740 1 -- 172.21.15.1:0/84149743 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99a8036030 con 0x5619a3438390 2024-09-21T01:01:40.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.874+0000 7f999e7fc640 1 -- 172.21.15.1:0/84149743 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f99a8031890 con 0x5619a3438390 2024-09-21T01:01:40.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.874+0000 7f99c3bf6740 10 client.26269 fetch_fsmap learned FSMap version 33 2024-09-21T01:01:40.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.874+0000 7f99c3bf6740 1 -- 172.21.15.1:0/84149743 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5619a381a5c0 con 0x5619a3438390 2024-09-21T01:01:40.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.874+0000 7f999e7fc640 1 -- 172.21.15.1:0/84149743 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99a8036030 con 0x5619a3438390 2024-09-21T01:01:40.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.875+0000 7f999e7fc640 1 -- 172.21.15.1:0/84149743 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f99a804d030 con 0x5619a3438390 2024-09-21T01:01:40.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.875+0000 7f99c3bf6740 10 client.26269 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:01:40.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.875+0000 7f99c3bf6740 10 client.26269 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T01:01:40.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.875+0000 7f99c3bf6740 20 client.26269 populate_metadata read hostname 'smithi001' 2024-09-21T01:01:40.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.875+0000 7f99c3bf6740 1 --2- 172.21.15.1:0/84149743 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5619a34179f0 0x5619a381d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:40.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.875+0000 7f99c3bf6740 4 client.26269 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:01:40.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.875+0000 7f99c3bf6740 1 -- 172.21.15.1:0/84149743 --> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5619a3778df0 con 0x5619a34179f0 2024-09-21T01:01:40.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.875+0000 7f99b67fc640 1 --2- 172.21.15.1:0/84149743 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5619a34179f0 0x5619a381d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:40.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.875+0000 7f999e7fc640 10 client.26269 ms_handle_connect on v2:172.21.15.193:6838/1365361177 2024-09-21T01:01:40.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.876+0000 7f99b67fc640 1 --2- 172.21.15.1:0/84149743 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5619a34179f0 0x5619a381d920 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=11068051bf8b60d2 server_cookie=4a502b4981547292 in_seq=0 out_seq=0 2024-09-21T01:01:40.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.876+0000 7f999e7fc640 1 -- 172.21.15.1:0/84149743 <== mds.1 v2:172.21.15.193:6838/1365361177 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5619a3778df0 con 0x5619a34179f0 2024-09-21T01:01:40.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.876+0000 7f999e7fc640 10 client.26269 handle_command_reply: tid=0 2024-09-21T01:01:40.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.876+0000 7f99c3bf6740 1 client.26269 shutdown 2024-09-21T01:01:40.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.876+0000 7f99c3bf6740 1 -- 172.21.15.1:0/84149743 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619a3438390 msgr2=0x5619a380bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:40.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.876+0000 7f99c3bf6740 1 --2- 172.21.15.1:0/84149743 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619a3438390 0x5619a380bed0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f99a802ade0 tx=0x7f99a802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:01:40.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.877+0000 7f99c3bf6740 1 -- 172.21.15.1:0/84149743 shutdown_connections 2024-09-21T01:01:40.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.877+0000 7f99c3bf6740 1 --2- 172.21.15.1:0/84149743 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5619a34179f0 0x5619a381d920 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:40.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.877+0000 7f99c3bf6740 1 --2- 172.21.15.1:0/84149743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619a3459070 0x5619a3817be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:40.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.877+0000 7f99c3bf6740 1 --2- 172.21.15.1:0/84149743 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619a3438390 0x5619a380bed0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:40.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.877+0000 7f999e7fc640 0 client.26269 ms_handle_reset on v2:172.21.15.193:6838/1365361177 2024-09-21T01:01:40.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.877+0000 7f99c3bf6740 1 --2- 172.21.15.1:0/84149743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619a34301b0 0x5619a380b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:40.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.877+0000 7f99c3bf6740 1 -- 172.21.15.1:0/84149743 >> 172.21.15.1:0/84149743 conn(0x5619a344d460 msgr2=0x5619a3803450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:40.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.877+0000 7f99c3bf6740 1 -- 172.21.15.1:0/84149743 shutdown_connections 2024-09-21T01:01:40.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.877+0000 7f99c3bf6740 1 -- 172.21.15.1:0/84149743 wait complete. 2024-09-21T01:01:40.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.877+0000 7f99c3bf6740 20 client.26269 trim_cache size 0 max 16384 2024-09-21T01:01:40.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.890+0000 7f99c3bf6740 1 Processor -- start 2024-09-21T01:01:40.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.891+0000 7f99c3bf6740 1 -- start start 2024-09-21T01:01:40.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.891+0000 7f99c3bf6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619a34301b0 0x5619a3801cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:40.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.891+0000 7f99c3bf6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619a3438390 0x5619a380d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:40.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.891+0000 7f99c3bf6740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619a3459070 0x5619a3817ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:40.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.891+0000 7f99c3bf6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f99b81b1450 con 0x5619a34301b0 2024-09-21T01:01:40.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.891+0000 7f99c3bf6740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f99b81b3050 con 0x5619a3459070 2024-09-21T01:01:40.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.891+0000 7f99c3bf6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f99b81b1b20 con 0x5619a3438390 2024-09-21T01:01:40.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.891+0000 7f99b67fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619a34301b0 0x5619a3801cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:40.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.891+0000 7f99b67fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619a34301b0 0x5619a3801cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37810/0 (socket says 172.21.15.1:37810) 2024-09-21T01:01:40.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.891+0000 7f99b67fc640 1 -- 172.21.15.1:0/3763255994 learned_addr learned my addr 172.21.15.1:0/3763255994 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:40.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.891+0000 7f99b67fc640 1 --2- 172.21.15.1:0/3763255994 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619a3459070 0x5619a3817ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:40.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.891+0000 7f99b6ffd640 1 --2- 172.21.15.1:0/3763255994 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619a3438390 0x5619a380d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:40.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.892+0000 7f99b67fc640 1 -- 172.21.15.1:0/3763255994 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619a3438390 msgr2=0x5619a380d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:40.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.892+0000 7f99b67fc640 1 --2- 172.21.15.1:0/3763255994 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619a3438390 0x5619a380d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:40.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.892+0000 7f99b67fc640 1 -- 172.21.15.1:0/3763255994 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619a3459070 msgr2=0x5619a3817ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:40.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.892+0000 7f99b67fc640 1 --2- 172.21.15.1:0/3763255994 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619a3459070 0x5619a3817ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:40.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.892+0000 7f99b67fc640 1 -- 172.21.15.1:0/3763255994 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619a380e6f0 con 0x5619a34301b0 2024-09-21T01:01:40.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.892+0000 7f99b67fc640 1 --2- 172.21.15.1:0/3763255994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619a34301b0 0x5619a3801cb0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x5619a381df70 tx=0x7f99a001a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f722f1e851e7b658 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:40.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.892+0000 7f99acff9640 1 -- 172.21.15.1:0/3763255994 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a0003d40 con 0x5619a34301b0 2024-09-21T01:01:40.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.892+0000 7f99acff9640 1 -- 172.21.15.1:0/3763255994 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99a00054d0 con 0x5619a34301b0 2024-09-21T01:01:40.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.892+0000 7f99acff9640 1 -- 172.21.15.1:0/3763255994 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a0004db0 con 0x5619a34301b0 2024-09-21T01:01:40.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.893+0000 7f99c3bf6740 1 -- 172.21.15.1:0/3763255994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619a34301b0 msgr2=0x5619a3801cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:40.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.893+0000 7f99c3bf6740 1 --2- 172.21.15.1:0/3763255994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619a34301b0 0x5619a3801cb0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x5619a381df70 tx=0x7f99a001a040 comp rx=0 tx=0).stop 2024-09-21T01:01:40.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.893+0000 7f99c3bf6740 1 -- 172.21.15.1:0/3763255994 shutdown_connections 2024-09-21T01:01:40.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.893+0000 7f99c3bf6740 1 --2- 172.21.15.1:0/3763255994 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619a3459070 0x5619a3817ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:40.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.893+0000 7f99c3bf6740 1 --2- 172.21.15.1:0/3763255994 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619a3438390 0x5619a380d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:40.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.893+0000 7f99c3bf6740 1 --2- 172.21.15.1:0/3763255994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619a34301b0 0x5619a3801cb0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:40.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.893+0000 7f99c3bf6740 1 -- 172.21.15.1:0/3763255994 >> 172.21.15.1:0/3763255994 conn(0x5619a344d460 msgr2=0x5619a380ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:40.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.893+0000 7f99c3bf6740 1 -- 172.21.15.1:0/3763255994 shutdown_connections 2024-09-21T01:01:40.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.893+0000 7f99c3bf6740 1 -- 172.21.15.1:0/3763255994 wait complete. 2024-09-21T01:01:40.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.894+0000 7f99c3bf6740 1 -- start start 2024-09-21T01:01:40.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.894+0000 7f99c3bf6740 1 Processor -- start 2024-09-21T01:01:40.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.894+0000 7f99c3bf6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619a34301b0 0x5619a3812600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:40.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.894+0000 7f99c3bf6740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619a3438390 0x5619a3812ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:40.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.894+0000 7f99c3bf6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619a3459070 0x5619a38801d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:40.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.894+0000 7f99c3bf6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f99b81b2980 con 0x5619a34301b0 2024-09-21T01:01:40.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.894+0000 7f99c3bf6740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f99b81b22b0 con 0x5619a3438390 2024-09-21T01:01:40.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.894+0000 7f99c3bf6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f99b81af430 con 0x5619a3459070 2024-09-21T01:01:40.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.894+0000 7f99c3bf6740 10 client.0 _ll_register_callbacks cb 0x7f99a0009850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:01:40.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.894+0000 7f99b67fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619a34301b0 0x5619a3812600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:40.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.894+0000 7f99b6ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619a3438390 0x5619a3812ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:40.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.894+0000 7f99b67fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619a34301b0 0x5619a3812600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37814/0 (socket says 172.21.15.1:37814) 2024-09-21T01:01:40.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.894+0000 7f99b67fc640 1 -- 172.21.15.1:0/1003085156 learned_addr learned my addr 172.21.15.1:0/1003085156 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:40.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.895+0000 7f99b6ffd640 1 -- 172.21.15.1:0/1003085156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619a3459070 msgr2=0x5619a38801d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:40.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.895+0000 7f99b6ffd640 1 --2- 172.21.15.1:0/1003085156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619a3459070 0x5619a38801d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:40.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.895+0000 7f99b6ffd640 1 -- 172.21.15.1:0/1003085156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619a34301b0 msgr2=0x5619a3812600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:40.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.895+0000 7f99b6ffd640 1 --2- 172.21.15.1:0/1003085156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619a34301b0 0x5619a3812600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:40.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.895+0000 7f99b6ffd640 1 -- 172.21.15.1:0/1003085156 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619a3880840 con 0x5619a3438390 2024-09-21T01:01:40.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.895+0000 7f99b67fc640 1 --2- 172.21.15.1:0/1003085156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619a34301b0 0x5619a3812600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:01:40.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.895+0000 7f99b6ffd640 1 --2- 172.21.15.1:0/1003085156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619a3438390 0x5619a3812ba0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f99a8004050 tx=0x7f99a8031680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b097e7c2c7ab010 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:40.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.895+0000 7f999e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:01:40.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.895+0000 7f999e7fc640 1 -- 172.21.15.1:0/1003085156 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a8009360 con 0x5619a3438390 2024-09-21T01:01:40.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.895+0000 7f999e7fc640 1 -- 172.21.15.1:0/1003085156 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f99a802f660 con 0x5619a3438390 2024-09-21T01:01:40.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.895+0000 7f99c3bf6740 1 -- 172.21.15.1:0/1003085156 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99a00054d0 con 0x5619a3438390 2024-09-21T01:01:40.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.896+0000 7f999e7fc640 1 -- 172.21.15.1:0/1003085156 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f99a806a050 con 0x5619a3438390 2024-09-21T01:01:40.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.896+0000 7f99c3bf6740 10 client.26387 fetch_fsmap learned FSMap version 33 2024-09-21T01:01:40.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.896+0000 7f99c3bf6740 1 -- 172.21.15.1:0/1003085156 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5619a3888d40 con 0x5619a3438390 2024-09-21T01:01:40.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.896+0000 7f999e7fc640 1 -- 172.21.15.1:0/1003085156 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99a00054d0 con 0x5619a3438390 2024-09-21T01:01:40.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.896+0000 7f999e7fc640 1 -- 172.21.15.1:0/1003085156 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f99a804d040 con 0x5619a3438390 2024-09-21T01:01:40.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.896+0000 7f99c3bf6740 10 client.26387 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:01:40.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.896+0000 7f99c3bf6740 10 client.26387 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T01:01:40.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.896+0000 7f99c3bf6740 20 client.26387 populate_metadata read hostname 'smithi001' 2024-09-21T01:01:40.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.896+0000 7f99c3bf6740 1 --2- 172.21.15.1:0/1003085156 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5619a33ecda0 0x5619a388b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:40.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.896+0000 7f99c3bf6740 4 client.26387 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:01:40.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.896+0000 7f99c3bf6740 1 -- 172.21.15.1:0/1003085156 --> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5619a37748a0 con 0x5619a33ecda0 2024-09-21T01:01:40.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.897+0000 7f99b67fc640 1 --2- 172.21.15.1:0/1003085156 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5619a33ecda0 0x5619a388b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:40.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.897+0000 7f999e7fc640 10 client.26387 ms_handle_connect on v2:172.21.15.193:6838/1365361177 2024-09-21T01:01:40.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.897+0000 7f99b67fc640 1 --2- 172.21.15.1:0/1003085156 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5619a33ecda0 0x5619a388b430 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3f028ee785decaff server_cookie=562ab06d40a06723 in_seq=0 out_seq=0 2024-09-21T01:01:40.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.897+0000 7f999e7fc640 1 -- 172.21.15.1:0/1003085156 <== mds.1 v2:172.21.15.193:6838/1365361177 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5619a37748a0 con 0x5619a33ecda0 2024-09-21T01:01:40.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.897+0000 7f999e7fc640 10 client.26387 handle_command_reply: tid=0 2024-09-21T01:01:40.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.897+0000 7f99c3bf6740 1 client.26387 shutdown 2024-09-21T01:01:40.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.897+0000 7f99c3bf6740 1 -- 172.21.15.1:0/1003085156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619a3438390 msgr2=0x5619a3812ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:40.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.897+0000 7f99c3bf6740 1 --2- 172.21.15.1:0/1003085156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619a3438390 0x5619a3812ba0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f99a8004050 tx=0x7f99a8031680 comp rx=0 tx=0).stop 2024-09-21T01:01:40.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.897+0000 7f99c3bf6740 1 -- 172.21.15.1:0/1003085156 shutdown_connections 2024-09-21T01:01:40.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.897+0000 7f99c3bf6740 1 --2- 172.21.15.1:0/1003085156 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5619a33ecda0 0x5619a388b430 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:40.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.897+0000 7f99c3bf6740 1 --2- 172.21.15.1:0/1003085156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619a3459070 0x5619a38801d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:40.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.898+0000 7f99c3bf6740 1 --2- 172.21.15.1:0/1003085156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5619a3438390 0x5619a3812ba0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:40.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.898+0000 7f999e7fc640 0 client.26387 ms_handle_reset on v2:172.21.15.193:6838/1365361177 2024-09-21T01:01:40.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.898+0000 7f99c3bf6740 1 --2- 172.21.15.1:0/1003085156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619a34301b0 0x5619a3812600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:40.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.898+0000 7f99c3bf6740 1 -- 172.21.15.1:0/1003085156 >> 172.21.15.1:0/1003085156 conn(0x5619a344d460 msgr2=0x5619a3801a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:40.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.898+0000 7f99c3bf6740 1 -- 172.21.15.1:0/1003085156 shutdown_connections 2024-09-21T01:01:40.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.898+0000 7f99c3bf6740 1 -- 172.21.15.1:0/1003085156 wait complete. 2024-09-21T01:01:40.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.898+0000 7f99c3bf6740 20 client.26387 trim_cache size 0 max 16384 2024-09-21T01:01:40.902 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T01:01:40.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.898+0000 7f99bd682640 1 -- 172.21.15.1:0/542675086 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f99a40b6510 msgr2=0x7f99a40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:40.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.898+0000 7f99bd682640 1 --2- 172.21.15.1:0/542675086 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f99a40b6510 0x7f99a40b8a20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f99b0004ff0 tx=0x7f99b007abd0 comp rx=0 tx=0).stop 2024-09-21T01:01:40.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.898+0000 7f99bd682640 1 -- 172.21.15.1:0/542675086 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99b810de60 msgr2=0x7f99b81031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:40.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.898+0000 7f99bd682640 1 --2- 172.21.15.1:0/542675086 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99b810de60 0x7f99b81031f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f99b000e970 tx=0x7f99b000ed70 comp rx=0 tx=0).stop 2024-09-21T01:01:40.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.898+0000 7f99bd682640 1 -- 172.21.15.1:0/542675086 shutdown_connections 2024-09-21T01:01:40.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.898+0000 7f99bd682640 1 --2- 172.21.15.1:0/542675086 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99b810de60 0x7f99b81031f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:40.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.898+0000 7f99bd682640 1 --2- 172.21.15.1:0/542675086 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f99a40b6510 0x7f99a40b8a20 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:40.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.898+0000 7f99bd682640 1 --2- 172.21.15.1:0/542675086 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99b8105380 0x7f99b8102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:40.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.898+0000 7f99bd682640 1 --2- 172.21.15.1:0/542675086 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f99b8104a30 0x7f99b8102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:40.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.898+0000 7f99bd682640 1 -- 172.21.15.1:0/542675086 >> 172.21.15.1:0/542675086 conn(0x7f99b80797b0 msgr2=0x7f99b8100890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:40.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.899+0000 7f99bd682640 1 -- 172.21.15.1:0/542675086 shutdown_connections 2024-09-21T01:01:40.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:40.899+0000 7f99bd682640 1 -- 172.21.15.1:0/542675086 wait complete. 2024-09-21T01:01:41.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:41 smithi042 ceph-mon[34481]: pgmap v492: 97 pgs: 97 active+clean; 552 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 328 op/s 2024-09-21T01:01:41.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:41 smithi001 ceph-mon[31211]: pgmap v492: 97 pgs: 97 active+clean; 552 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 328 op/s 2024-09-21T01:01:41.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:41 smithi193 ceph-mon[34660]: pgmap v492: 97 pgs: 97 active+clean; 552 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 328 op/s 2024-09-21T01:01:42.001 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T01:01:42.275 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:01:42.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.787+0000 7fc8b1b80640 1 -- 172.21.15.1:0/3123647765 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8ac108d20 msgr2=0x7fc8ac10f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:42.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.787+0000 7fc8b1b80640 1 --2- 172.21.15.1:0/3123647765 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8ac108d20 0x7fc8ac10f550 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4009ca0 tx=0x7fc8a402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.787+0000 7fc8b1b80640 1 -- 172.21.15.1:0/3123647765 shutdown_connections 2024-09-21T01:01:42.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.787+0000 7fc8b1b80640 1 --2- 172.21.15.1:0/3123647765 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8ac108d20 0x7fc8ac10f550 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.787+0000 7fc8b1b80640 1 --2- 172.21.15.1:0/3123647765 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8ac1083d0 0x7fc8ac1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.787+0000 7fc8b1b80640 1 --2- 172.21.15.1:0/3123647765 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8ac102ae0 0x7fc8ac102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.787+0000 7fc8b1b80640 1 -- 172.21.15.1:0/3123647765 >> 172.21.15.1:0/3123647765 conn(0x7fc8ac079790 msgr2=0x7fc8ac079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:42.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.787+0000 7fc8b1b80640 1 -- 172.21.15.1:0/3123647765 shutdown_connections 2024-09-21T01:01:42.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.787+0000 7fc8b1b80640 1 -- 172.21.15.1:0/3123647765 wait complete. 2024-09-21T01:01:42.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.788+0000 7fc8b1b80640 1 Processor -- start 2024-09-21T01:01:42.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.789+0000 7fc8b1b80640 1 -- start start 2024-09-21T01:01:42.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.789+0000 7fc8b1b80640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8ac102ae0 0x7fc8ac19a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:42.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.789+0000 7fc8b1b80640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8ac1083d0 0x7fc8ac19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:42.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.789+0000 7fc8b1b80640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8ac108d20 0x7fc8ac19fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:42.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.789+0000 7fc8b1b80640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ac113b00 con 0x7fc8ac1083d0 2024-09-21T01:01:42.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.789+0000 7fc8b1b80640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ac113980 con 0x7fc8ac102ae0 2024-09-21T01:01:42.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.789+0000 7fc8b1b80640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ac113c80 con 0x7fc8ac108d20 2024-09-21T01:01:42.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.789+0000 7fc8aaffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8ac1083d0 0x7fc8ac19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:42.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.789+0000 7fc8ab7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8ac102ae0 0x7fc8ac19a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:42.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.789+0000 7fc8aaffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8ac1083d0 0x7fc8ac19a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37828/0 (socket says 172.21.15.1:37828) 2024-09-21T01:01:42.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.789+0000 7fc8ab7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8ac102ae0 0x7fc8ac19a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:59600/0 (socket says 172.21.15.1:59600) 2024-09-21T01:01:42.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.789+0000 7fc8aaffd640 1 -- 172.21.15.1:0/1352494805 learned_addr learned my addr 172.21.15.1:0/1352494805 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:42.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.789+0000 7fc8abfff640 1 --2- 172.21.15.1:0/1352494805 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8ac108d20 0x7fc8ac19fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:42.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.789+0000 7fc8ab7fe640 1 -- 172.21.15.1:0/1352494805 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8ac108d20 msgr2=0x7fc8ac19fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:42.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.789+0000 7fc8ab7fe640 1 --2- 172.21.15.1:0/1352494805 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8ac108d20 0x7fc8ac19fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.789+0000 7fc8ab7fe640 1 -- 172.21.15.1:0/1352494805 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8ac1083d0 msgr2=0x7fc8ac19a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:42.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.789+0000 7fc8ab7fe640 1 --2- 172.21.15.1:0/1352494805 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8ac1083d0 0x7fc8ac19a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.789+0000 7fc8ab7fe640 1 -- 172.21.15.1:0/1352494805 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8ac1a03a0 con 0x7fc8ac102ae0 2024-09-21T01:01:42.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.789+0000 7fc8abfff640 1 --2- 172.21.15.1:0/1352494805 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8ac108d20 0x7fc8ac19fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:01:42.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.789+0000 7fc8aaffd640 1 --2- 172.21.15.1:0/1352494805 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8ac1083d0 0x7fc8ac19a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:01:42.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.790+0000 7fc8ab7fe640 1 --2- 172.21.15.1:0/1352494805 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8ac102ae0 0x7fc8ac19a430 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc89c00e9f0 tx=0x7fc89c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:42.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.790+0000 7fc8a8ff9640 1 -- 172.21.15.1:0/1352494805 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc89c00cd80 con 0x7fc8ac102ae0 2024-09-21T01:01:42.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.790+0000 7fc8a8ff9640 1 -- 172.21.15.1:0/1352494805 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc89c0035f0 con 0x7fc8ac102ae0 2024-09-21T01:01:42.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.790+0000 7fc8b1b80640 1 -- 172.21.15.1:0/1352494805 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8ac1a0690 con 0x7fc8ac102ae0 2024-09-21T01:01:42.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.790+0000 7fc8a8ff9640 1 -- 172.21.15.1:0/1352494805 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc89c010670 con 0x7fc8ac102ae0 2024-09-21T01:01:42.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.790+0000 7fc8b1b80640 1 -- 172.21.15.1:0/1352494805 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8ac1a6df0 con 0x7fc8ac102ae0 2024-09-21T01:01:42.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.793+0000 7fc8a8ff9640 1 -- 172.21.15.1:0/1352494805 <== mon.2 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7fc89c0037a0 con 0x7fc8ac102ae0 2024-09-21T01:01:42.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.793+0000 7fc8b80f4740 1 Processor -- start 2024-09-21T01:01:42.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.793+0000 7fc8b80f4740 1 -- start start 2024-09-21T01:01:42.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.793+0000 7fc8b80f4740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d7abc6070 0x563d7af6d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:42.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.793+0000 7fc8b80f4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d7ab9d1b0 0x563d7af6dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:42.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.793+0000 7fc8b80f4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d7aba5390 0x563d7af6e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:42.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.793+0000 7fc8b80f4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563d7aee3ea0 con 0x563d7aba5390 2024-09-21T01:01:42.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.793+0000 7fc8b80f4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563d7aed32d0 con 0x563d7ab9d1b0 2024-09-21T01:01:42.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.793+0000 7fc8b80f4740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563d7aed70e0 con 0x563d7abc6070 2024-09-21T01:01:42.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.793+0000 7fc8ab7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d7ab9d1b0 0x563d7af6dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:42.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.793+0000 7fc8aaffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d7aba5390 0x563d7af6e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:42.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.793+0000 7fc8aaffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d7aba5390 0x563d7af6e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37836/0 (socket says 172.21.15.1:37836) 2024-09-21T01:01:42.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.793+0000 7fc8aaffd640 1 -- 172.21.15.1:0/4264596078 learned_addr learned my addr 172.21.15.1:0/4264596078 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:42.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.794+0000 7fc8abfff640 1 --2- 172.21.15.1:0/4264596078 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d7abc6070 0x563d7af6d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:42.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.794+0000 7fc8ab7fe640 1 -- 172.21.15.1:0/4264596078 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d7abc6070 msgr2=0x563d7af6d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:42.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.794+0000 7fc8ab7fe640 1 --2- 172.21.15.1:0/4264596078 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d7abc6070 0x563d7af6d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.794+0000 7fc8ab7fe640 1 -- 172.21.15.1:0/4264596078 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d7aba5390 msgr2=0x563d7af6e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:42.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.794+0000 7fc8ab7fe640 1 --2- 172.21.15.1:0/4264596078 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d7aba5390 0x563d7af6e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.794+0000 7fc8a8ff9640 1 --2- 172.21.15.1:0/1352494805 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc8940b6510 0x7fc8940b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:42.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.794+0000 7fc8ab7fe640 1 -- 172.21.15.1:0/4264596078 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d7ac31650 con 0x563d7ab9d1b0 2024-09-21T01:01:42.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.794+0000 7fc8abfff640 1 --2- 172.21.15.1:0/4264596078 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d7abc6070 0x563d7af6d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:01:42.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.794+0000 7fc8abfff640 1 --2- 172.21.15.1:0/1352494805 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc8940b6510 0x7fc8940b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:42.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.794+0000 7fc8a8ff9640 1 -- 172.21.15.1:0/1352494805 <== mon.2 v2:172.21.15.42:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fc89c0e76a0 con 0x7fc8ac102ae0 2024-09-21T01:01:42.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.794+0000 7fc8ab7fe640 1 --2- 172.21.15.1:0/4264596078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d7ab9d1b0 0x563d7af6dbe0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0e5150 tx=0x7fc89c0ada00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69ce5b04ae3b5193 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:42.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.794+0000 7fc891ffb640 1 -- 172.21.15.1:0/4264596078 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc89c0a96b0 con 0x563d7ab9d1b0 2024-09-21T01:01:42.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.794+0000 7fc891ffb640 1 -- 172.21.15.1:0/4264596078 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc89c0ad320 con 0x563d7ab9d1b0 2024-09-21T01:01:42.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.794+0000 7fc891ffb640 1 -- 172.21.15.1:0/4264596078 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc89c0acf80 con 0x563d7ab9d1b0 2024-09-21T01:01:42.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.795+0000 7fc8b80f4740 1 -- 172.21.15.1:0/4264596078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d7ab9d1b0 msgr2=0x563d7af6dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:42.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.795+0000 7fc8b80f4740 1 --2- 172.21.15.1:0/4264596078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d7ab9d1b0 0x563d7af6dbe0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0e5150 tx=0x7fc89c0ada00 comp rx=0 tx=0).stop 2024-09-21T01:01:42.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.795+0000 7fc8abfff640 1 --2- 172.21.15.1:0/1352494805 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc8940b6510 0x7fc8940b8a20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4006010 tx=0x7fc8a4009410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:42.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.795+0000 7fc8b80f4740 1 -- 172.21.15.1:0/4264596078 shutdown_connections 2024-09-21T01:01:42.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.795+0000 7fc8b80f4740 1 --2- 172.21.15.1:0/4264596078 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d7aba5390 0x563d7af6e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.795+0000 7fc8b80f4740 1 --2- 172.21.15.1:0/4264596078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d7ab9d1b0 0x563d7af6dbe0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.795+0000 7fc8b80f4740 1 --2- 172.21.15.1:0/4264596078 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d7abc6070 0x563d7af6d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.795+0000 7fc8b80f4740 1 -- 172.21.15.1:0/4264596078 >> 172.21.15.1:0/4264596078 conn(0x563d7abba460 msgr2=0x563d7af6b590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:42.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.796+0000 7fc8b80f4740 1 -- 172.21.15.1:0/4264596078 shutdown_connections 2024-09-21T01:01:42.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.796+0000 7fc8b80f4740 1 -- 172.21.15.1:0/4264596078 wait complete. 2024-09-21T01:01:42.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.796+0000 7fc8b80f4740 1 -- start start 2024-09-21T01:01:42.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.796+0000 7fc8b80f4740 1 Processor -- start 2024-09-21T01:01:42.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.797+0000 7fc8b80f4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d7ab9d1b0 0x563d7af78d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:42.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.797+0000 7fc8b80f4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d7aba5390 0x563d7af79280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:42.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.797+0000 7fc8b80f4740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d7abc6070 0x563d7af85140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:42.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.797+0000 7fc8b80f4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563d7ad34700 con 0x563d7aba5390 2024-09-21T01:01:42.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.797+0000 7fc8b80f4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563d7ae6e160 con 0x563d7ab9d1b0 2024-09-21T01:01:42.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.797+0000 7fc8b80f4740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563d7af7be20 con 0x563d7abc6070 2024-09-21T01:01:42.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.797+0000 7fc8ab7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d7ab9d1b0 0x563d7af78d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:42.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.797+0000 7fc8b80f4740 10 client.0 _ll_register_callbacks cb 0x563d7ae879e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:01:42.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.797+0000 7fc8ab7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d7ab9d1b0 0x563d7af78d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:59618/0 (socket says 172.21.15.1:59618) 2024-09-21T01:01:42.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.797+0000 7fc8ab7fe640 1 -- 172.21.15.1:0/557546457 learned_addr learned my addr 172.21.15.1:0/557546457 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:42.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.797+0000 7fc8aaffd640 1 --2- 172.21.15.1:0/557546457 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d7aba5390 0x563d7af79280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:42.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.797+0000 7fc8ab7fe640 1 -- 172.21.15.1:0/557546457 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d7abc6070 msgr2=0x563d7af85140 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:01:42.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.797+0000 7fc8ab7fe640 1 --2- 172.21.15.1:0/557546457 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d7abc6070 0x563d7af85140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.797+0000 7fc8ab7fe640 1 -- 172.21.15.1:0/557546457 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d7aba5390 msgr2=0x563d7af79280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:42.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.797+0000 7fc8ab7fe640 1 --2- 172.21.15.1:0/557546457 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d7aba5390 0x563d7af79280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.797+0000 7fc8ab7fe640 1 -- 172.21.15.1:0/557546457 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d7ae9bc90 con 0x563d7ab9d1b0 2024-09-21T01:01:42.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.797+0000 7fc8aaffd640 1 --2- 172.21.15.1:0/557546457 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d7aba5390 0x563d7af79280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:01:42.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.797+0000 7fc8ab7fe640 1 --2- 172.21.15.1:0/557546457 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d7ab9d1b0 0x563d7af78d40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0e54f0 tx=0x7fc89c003cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb0888860e57697c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:42.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.797+0000 7fc88affd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:01:42.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.797+0000 7fc88affd640 1 -- 172.21.15.1:0/557546457 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc89c0ad160 con 0x563d7ab9d1b0 2024-09-21T01:01:42.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.798+0000 7fc88affd640 1 -- 172.21.15.1:0/557546457 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fc89c0a9a80 con 0x563d7ab9d1b0 2024-09-21T01:01:42.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.798+0000 7fc8b80f4740 1 -- 172.21.15.1:0/557546457 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc89c0ad320 con 0x563d7ab9d1b0 2024-09-21T01:01:42.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.798+0000 7fc88affd640 1 -- 172.21.15.1:0/557546457 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc89c0ad5e0 con 0x563d7ab9d1b0 2024-09-21T01:01:42.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.798+0000 7fc8b80f4740 10 client.26399 fetch_fsmap learned FSMap version 33 2024-09-21T01:01:42.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.798+0000 7fc8b80f4740 1 -- 172.21.15.1:0/557546457 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x563d7af87b40 con 0x563d7ab9d1b0 2024-09-21T01:01:42.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.798+0000 7fc88affd640 1 -- 172.21.15.1:0/557546457 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc89c0ad320 con 0x563d7ab9d1b0 2024-09-21T01:01:42.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.798+0000 7fc88affd640 1 -- 172.21.15.1:0/557546457 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fc89c0c34d0 con 0x563d7ab9d1b0 2024-09-21T01:01:42.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.798+0000 7fc8b80f4740 10 client.26399 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:01:42.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.798+0000 7fc8b80f4740 10 client.26399 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:01:42.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.798+0000 7fc8b80f4740 20 client.26399 populate_metadata read hostname 'smithi001' 2024-09-21T01:01:42.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.798+0000 7fc8b80f4740 1 --2- 172.21.15.1:0/557546457 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x563d7ab849f0 0x563d7af8aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:42.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.798+0000 7fc8b80f4740 4 client.26399 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:01:42.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.798+0000 7fc8b80f4740 1 -- 172.21.15.1:0/557546457 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d7aee5df0 con 0x563d7ab849f0 2024-09-21T01:01:42.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.798+0000 7fc8aaffd640 1 --2- 172.21.15.1:0/557546457 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x563d7ab849f0 0x563d7af8aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:42.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.799+0000 7fc88affd640 10 client.26399 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:01:42.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.799+0000 7fc8aaffd640 1 --2- 172.21.15.1:0/557546457 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x563d7ab849f0 0x563d7af8aea0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cbad6aa09dbbc52 server_cookie=e589dded666e2b17 in_seq=0 out_seq=0 2024-09-21T01:01:42.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.800+0000 7fc88affd640 1 -- 172.21.15.1:0/557546457 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563d7aee5df0 con 0x563d7ab849f0 2024-09-21T01:01:42.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.800+0000 7fc88affd640 10 client.26399 handle_command_reply: tid=0 2024-09-21T01:01:42.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.800+0000 7fc8b80f4740 1 client.26399 shutdown 2024-09-21T01:01:42.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.800+0000 7fc8b80f4740 1 -- 172.21.15.1:0/557546457 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d7ab9d1b0 msgr2=0x563d7af78d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:42.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.800+0000 7fc8b80f4740 1 --2- 172.21.15.1:0/557546457 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d7ab9d1b0 0x563d7af78d40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0e54f0 tx=0x7fc89c003cd0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.800+0000 7fc8b80f4740 1 -- 172.21.15.1:0/557546457 shutdown_connections 2024-09-21T01:01:42.807 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.800+0000 7fc8b80f4740 1 --2- 172.21.15.1:0/557546457 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x563d7ab849f0 0x563d7af8aea0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.807 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.800+0000 7fc8b80f4740 1 --2- 172.21.15.1:0/557546457 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d7abc6070 0x563d7af85140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.807 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.800+0000 7fc8b80f4740 1 --2- 172.21.15.1:0/557546457 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d7aba5390 0x563d7af79280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.807 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.800+0000 7fc88affd640 0 client.26399 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:01:42.807 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.800+0000 7fc8b80f4740 1 --2- 172.21.15.1:0/557546457 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d7ab9d1b0 0x563d7af78d40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.807 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.800+0000 7fc8b80f4740 1 -- 172.21.15.1:0/557546457 >> 172.21.15.1:0/557546457 conn(0x563d7abba460 msgr2=0x563d7af70830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:42.807 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.800+0000 7fc8b80f4740 1 -- 172.21.15.1:0/557546457 shutdown_connections 2024-09-21T01:01:42.807 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.800+0000 7fc8b80f4740 1 -- 172.21.15.1:0/557546457 wait complete. 2024-09-21T01:01:42.807 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.800+0000 7fc8b80f4740 20 client.26399 trim_cache size 0 max 16384 2024-09-21T01:01:42.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.814+0000 7fc8b80f4740 1 Processor -- start 2024-09-21T01:01:42.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.814+0000 7fc8b80f4740 1 -- start start 2024-09-21T01:01:42.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.814+0000 7fc8b80f4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d7ab9d1b0 0x563d7af6ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:42.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.814+0000 7fc8b80f4740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d7aba5390 0x563d7af6abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:42.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.814+0000 7fc8b80f4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d7abc6070 0x563d7af6b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:42.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.814+0000 7fc8b80f4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ac1af4e0 con 0x563d7abc6070 2024-09-21T01:01:42.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.814+0000 7fc8b80f4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ac1b10e0 con 0x563d7ab9d1b0 2024-09-21T01:01:42.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.814+0000 7fc8b80f4740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ac1afbb0 con 0x563d7aba5390 2024-09-21T01:01:42.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.814+0000 7fc8ab7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d7ab9d1b0 0x563d7af6ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:42.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.814+0000 7fc8abfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d7abc6070 0x563d7af6b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:42.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.814+0000 7fc8ab7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d7ab9d1b0 0x563d7af6ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:59620/0 (socket says 172.21.15.1:59620) 2024-09-21T01:01:42.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.814+0000 7fc8ab7fe640 1 -- 172.21.15.1:0/3480781800 learned_addr learned my addr 172.21.15.1:0/3480781800 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:42.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.814+0000 7fc8aaffd640 1 --2- 172.21.15.1:0/3480781800 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d7aba5390 0x563d7af6abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:42.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.814+0000 7fc8abfff640 1 -- 172.21.15.1:0/3480781800 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d7aba5390 msgr2=0x563d7af6abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:42.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.814+0000 7fc8abfff640 1 --2- 172.21.15.1:0/3480781800 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d7aba5390 0x563d7af6abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.814+0000 7fc8abfff640 1 -- 172.21.15.1:0/3480781800 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d7ab9d1b0 msgr2=0x563d7af6ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:42.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.814+0000 7fc8abfff640 1 --2- 172.21.15.1:0/3480781800 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d7ab9d1b0 0x563d7af6ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.815+0000 7fc8abfff640 1 -- 172.21.15.1:0/3480781800 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d7af7a000 con 0x563d7abc6070 2024-09-21T01:01:42.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.815+0000 7fc8ab7fe640 1 --2- 172.21.15.1:0/3480781800 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d7ab9d1b0 0x563d7af6ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:01:42.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.815+0000 7fc8abfff640 1 --2- 172.21.15.1:0/3480781800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d7abc6070 0x563d7af6b100 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4009ca0 tx=0x7fc8a4040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1d1fbebda9f59cf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:42.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.815+0000 7fc8917fa640 1 -- 172.21.15.1:0/3480781800 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4050070 con 0x563d7abc6070 2024-09-21T01:01:42.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.815+0000 7fc8917fa640 1 -- 172.21.15.1:0/3480781800 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8a4036040 con 0x563d7abc6070 2024-09-21T01:01:42.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.815+0000 7fc8917fa640 1 -- 172.21.15.1:0/3480781800 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a40047d0 con 0x563d7abc6070 2024-09-21T01:01:42.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.816+0000 7fc8b80f4740 1 -- 172.21.15.1:0/3480781800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d7abc6070 msgr2=0x563d7af6b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:42.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.816+0000 7fc8b80f4740 1 --2- 172.21.15.1:0/3480781800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d7abc6070 0x563d7af6b100 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4009ca0 tx=0x7fc8a4040000 comp rx=0 tx=0).stop 2024-09-21T01:01:42.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.816+0000 7fc8b80f4740 1 -- 172.21.15.1:0/3480781800 shutdown_connections 2024-09-21T01:01:42.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.816+0000 7fc8b80f4740 1 --2- 172.21.15.1:0/3480781800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d7abc6070 0x563d7af6b100 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.816+0000 7fc8b80f4740 1 --2- 172.21.15.1:0/3480781800 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d7aba5390 0x563d7af6abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.816+0000 7fc8b80f4740 1 --2- 172.21.15.1:0/3480781800 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d7ab9d1b0 0x563d7af6ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.816+0000 7fc8b80f4740 1 -- 172.21.15.1:0/3480781800 >> 172.21.15.1:0/3480781800 conn(0x563d7abba460 msgr2=0x563d7af6e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:42.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.816+0000 7fc8b80f4740 1 -- 172.21.15.1:0/3480781800 shutdown_connections 2024-09-21T01:01:42.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.816+0000 7fc8b80f4740 1 -- 172.21.15.1:0/3480781800 wait complete. 2024-09-21T01:01:42.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.816+0000 7fc8b80f4740 1 -- start start 2024-09-21T01:01:42.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.817+0000 7fc8b80f4740 1 Processor -- start 2024-09-21T01:01:42.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.817+0000 7fc8b80f4740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d7ab9d1b0 0x563d7af8bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:42.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.817+0000 7fc8b80f4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d7aba5390 0x563d7af8c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:42.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.817+0000 7fc8b80f4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d7abc6070 0x563d7af8ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:42.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.817+0000 7fc8b80f4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ac1b0a10 con 0x563d7abc6070 2024-09-21T01:01:42.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.817+0000 7fc8b80f4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ac1b0340 con 0x563d7aba5390 2024-09-21T01:01:42.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.817+0000 7fc8b80f4740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ac1ad4c0 con 0x563d7ab9d1b0 2024-09-21T01:01:42.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.817+0000 7fc8b80f4740 10 client.0 _ll_register_callbacks cb 0x7fc89c0ed900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:01:42.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.817+0000 7fc8abfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d7abc6070 0x563d7af8ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:42.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.817+0000 7fc8aaffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d7aba5390 0x563d7af8c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:42.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.817+0000 7fc8abfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d7abc6070 0x563d7af8ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37876/0 (socket says 172.21.15.1:37876) 2024-09-21T01:01:42.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.817+0000 7fc8abfff640 1 -- 172.21.15.1:0/2508151740 learned_addr learned my addr 172.21.15.1:0/2508151740 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:42.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.817+0000 7fc8ab7fe640 1 --2- 172.21.15.1:0/2508151740 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d7ab9d1b0 0x563d7af8bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:42.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.817+0000 7fc8abfff640 1 -- 172.21.15.1:0/2508151740 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d7ab9d1b0 msgr2=0x563d7af8bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:42.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.817+0000 7fc8abfff640 1 --2- 172.21.15.1:0/2508151740 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d7ab9d1b0 0x563d7af8bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.817+0000 7fc8abfff640 1 -- 172.21.15.1:0/2508151740 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d7aba5390 msgr2=0x563d7af8c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:42.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.817+0000 7fc8abfff640 1 --2- 172.21.15.1:0/2508151740 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d7aba5390 0x563d7af8c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.817+0000 7fc8abfff640 1 -- 172.21.15.1:0/2508151740 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d7aff4720 con 0x563d7abc6070 2024-09-21T01:01:42.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.817+0000 7fc8aaffd640 1 --2- 172.21.15.1:0/2508151740 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d7aba5390 0x563d7af8c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:01:42.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.818+0000 7fc8abfff640 1 --2- 172.21.15.1:0/2508151740 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d7abc6070 0x563d7af8ca30 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4003d50 tx=0x7fc8a4003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469aacf20f3722f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:42.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.818+0000 7fc88affd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:01:42.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.818+0000 7fc88affd640 1 -- 172.21.15.1:0/2508151740 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4050050 con 0x563d7abc6070 2024-09-21T01:01:42.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.818+0000 7fc88affd640 1 -- 172.21.15.1:0/2508151740 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fc8a402fa70 con 0x563d7abc6070 2024-09-21T01:01:42.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.818+0000 7fc8b80f4740 1 -- 172.21.15.1:0/2508151740 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8a4036040 con 0x563d7abc6070 2024-09-21T01:01:42.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.818+0000 7fc88affd640 1 -- 172.21.15.1:0/2508151740 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc8a402fc70 con 0x563d7abc6070 2024-09-21T01:01:42.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.818+0000 7fc8b80f4740 10 client.16752 fetch_fsmap learned FSMap version 33 2024-09-21T01:01:42.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.818+0000 7fc8b80f4740 1 -- 172.21.15.1:0/2508151740 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x563d7aff5980 con 0x563d7abc6070 2024-09-21T01:01:42.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.818+0000 7fc88affd640 1 -- 172.21.15.1:0/2508151740 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8a4036040 con 0x563d7abc6070 2024-09-21T01:01:42.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.819+0000 7fc88affd640 1 -- 172.21.15.1:0/2508151740 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fc8a4044040 con 0x563d7abc6070 2024-09-21T01:01:42.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.819+0000 7fc8b80f4740 10 client.16752 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:01:42.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.819+0000 7fc8b80f4740 10 client.16752 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:01:42.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.819+0000 7fc8b80f4740 20 client.16752 populate_metadata read hostname 'smithi001' 2024-09-21T01:01:42.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.819+0000 7fc8b80f4740 1 --2- 172.21.15.1:0/2508151740 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x563d7ab59da0 0x563d7aff8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:42.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.819+0000 7fc8b80f4740 4 client.16752 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:01:42.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.819+0000 7fc8b80f4740 1 -- 172.21.15.1:0/2508151740 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563d7aee18a0 con 0x563d7ab59da0 2024-09-21T01:01:42.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.819+0000 7fc8ab7fe640 1 --2- 172.21.15.1:0/2508151740 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x563d7ab59da0 0x563d7aff8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:42.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.819+0000 7fc88affd640 10 client.16752 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:01:42.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.819+0000 7fc8ab7fe640 1 --2- 172.21.15.1:0/2508151740 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x563d7ab59da0 0x563d7aff8170 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c29ba455e63c3e8 server_cookie=b8c65811e86975ed in_seq=0 out_seq=0 2024-09-21T01:01:42.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.820+0000 7fc88affd640 1 -- 172.21.15.1:0/2508151740 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563d7aee18a0 con 0x563d7ab59da0 2024-09-21T01:01:42.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.820+0000 7fc88affd640 10 client.16752 handle_command_reply: tid=0 2024-09-21T01:01:42.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.820+0000 7fc8b80f4740 1 client.16752 shutdown 2024-09-21T01:01:42.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.820+0000 7fc8b80f4740 1 -- 172.21.15.1:0/2508151740 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d7abc6070 msgr2=0x563d7af8ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:42.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.820+0000 7fc8b80f4740 1 --2- 172.21.15.1:0/2508151740 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d7abc6070 0x563d7af8ca30 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4003d50 tx=0x7fc8a4003d80 comp rx=0 tx=0).stop 2024-09-21T01:01:42.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.820+0000 7fc8b80f4740 1 -- 172.21.15.1:0/2508151740 shutdown_connections 2024-09-21T01:01:42.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.820+0000 7fc8b80f4740 1 --2- 172.21.15.1:0/2508151740 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x563d7ab59da0 0x563d7aff8170 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.820+0000 7fc8b80f4740 1 --2- 172.21.15.1:0/2508151740 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d7abc6070 0x563d7af8ca30 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.820+0000 7fc8b80f4740 1 --2- 172.21.15.1:0/2508151740 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d7aba5390 0x563d7af8c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.820+0000 7fc8b80f4740 1 --2- 172.21.15.1:0/2508151740 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d7ab9d1b0 0x563d7af8bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.820+0000 7fc8b80f4740 1 -- 172.21.15.1:0/2508151740 >> 172.21.15.1:0/2508151740 conn(0x563d7abba460 msgr2=0x563d7af6e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:42.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.820+0000 7fc88affd640 0 client.16752 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:01:42.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.820+0000 7fc8b80f4740 1 -- 172.21.15.1:0/2508151740 shutdown_connections 2024-09-21T01:01:42.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.820+0000 7fc8b80f4740 1 -- 172.21.15.1:0/2508151740 wait complete. 2024-09-21T01:01:42.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.820+0000 7fc8b80f4740 20 client.16752 trim_cache size 0 max 16384 2024-09-21T01:01:42.825 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T01:01:42.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.821+0000 7fc8b1b80640 1 -- 172.21.15.1:0/1352494805 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc8940b6510 msgr2=0x7fc8940b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:42.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.821+0000 7fc8b1b80640 1 --2- 172.21.15.1:0/1352494805 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc8940b6510 0x7fc8940b8a20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4006010 tx=0x7fc8a4009410 comp rx=0 tx=0).stop 2024-09-21T01:01:42.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.821+0000 7fc8b1b80640 1 -- 172.21.15.1:0/1352494805 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8ac102ae0 msgr2=0x7fc8ac19a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:42.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.821+0000 7fc8b1b80640 1 --2- 172.21.15.1:0/1352494805 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8ac102ae0 0x7fc8ac19a430 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc89c00e9f0 tx=0x7fc89c00eeb0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.821+0000 7fc8b1b80640 1 -- 172.21.15.1:0/1352494805 shutdown_connections 2024-09-21T01:01:42.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.821+0000 7fc8b1b80640 1 --2- 172.21.15.1:0/1352494805 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8ac108d20 0x7fc8ac19fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.821+0000 7fc8b1b80640 1 --2- 172.21.15.1:0/1352494805 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc8940b6510 0x7fc8940b8a20 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.821+0000 7fc8b1b80640 1 --2- 172.21.15.1:0/1352494805 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8ac1083d0 0x7fc8ac19a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.821+0000 7fc8b1b80640 1 --2- 172.21.15.1:0/1352494805 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8ac102ae0 0x7fc8ac19a430 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.821+0000 7fc8b1b80640 1 -- 172.21.15.1:0/1352494805 >> 172.21.15.1:0/1352494805 conn(0x7fc8ac079790 msgr2=0x7fc8ac106420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:42.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.821+0000 7fc8b1b80640 1 -- 172.21.15.1:0/1352494805 shutdown_connections 2024-09-21T01:01:42.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:42.821+0000 7fc8b1b80640 1 -- 172.21.15.1:0/1352494805 wait complete. 2024-09-21T01:01:42.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.979+0000 7f967224d640 1 -- 172.21.15.1:0/1273344623 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f966c109480 msgr2=0x7f966c10b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:42.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.979+0000 7f967224d640 1 --2- 172.21.15.1:0/1273344623 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f966c109480 0x7f966c10b920 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f9664009ca0 tx=0x7f966402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.981 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.979+0000 7f967224d640 1 -- 172.21.15.1:0/1273344623 shutdown_connections 2024-09-21T01:01:42.981 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.979+0000 7f967224d640 1 --2- 172.21.15.1:0/1273344623 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f966c109480 0x7f966c10b920 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.981 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.979+0000 7f967224d640 1 --2- 172.21.15.1:0/1273344623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f966c106b20 0x7f966c108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.981 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.979+0000 7f967224d640 1 --2- 172.21.15.1:0/1273344623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f966c101a90 0x7f966c101ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.981 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.979+0000 7f967224d640 1 -- 172.21.15.1:0/1273344623 >> 172.21.15.1:0/1273344623 conn(0x7f966c0fd690 msgr2=0x7f966c0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:42.981 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.979+0000 7f967224d640 1 -- 172.21.15.1:0/1273344623 shutdown_connections 2024-09-21T01:01:42.981 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.979+0000 7f967224d640 1 -- 172.21.15.1:0/1273344623 wait complete. 2024-09-21T01:01:42.981 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.980+0000 7f967224d640 1 Processor -- start 2024-09-21T01:01:42.983 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.980+0000 7f967224d640 1 -- start start 2024-09-21T01:01:42.983 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.980+0000 7f967224d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f966c101a90 0x7f966c199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:42.983 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.980+0000 7f967224d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f966c106b20 0x7f966c19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:42.983 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.980+0000 7f967224d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f966c109480 0x7f966c19b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:42.983 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.980+0000 7f967224d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f966c10f300 con 0x7f966c101a90 2024-09-21T01:01:42.983 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.980+0000 7f967224d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f966c10f180 con 0x7f966c109480 2024-09-21T01:01:42.983 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.980+0000 7f967224d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f966c10f480 con 0x7f966c106b20 2024-09-21T01:01:42.983 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.980+0000 7f966b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f966c101a90 0x7f966c199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:42.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.981+0000 7f966b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f966c101a90 0x7f966c199f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37898/0 (socket says 172.21.15.1:37898) 2024-09-21T01:01:42.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.981+0000 7f966b7fe640 1 -- 172.21.15.1:0/1847721034 learned_addr learned my addr 172.21.15.1:0/1847721034 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:42.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.981+0000 7f966bfff640 1 --2- 172.21.15.1:0/1847721034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f966c109480 0x7f966c19b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:42.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.981+0000 7f966affd640 1 --2- 172.21.15.1:0/1847721034 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f966c106b20 0x7f966c19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:42.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.981+0000 7f966b7fe640 1 -- 172.21.15.1:0/1847721034 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f966c106b20 msgr2=0x7f966c19a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:42.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.981+0000 7f966b7fe640 1 --2- 172.21.15.1:0/1847721034 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f966c106b20 0x7f966c19a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.981+0000 7f966b7fe640 1 -- 172.21.15.1:0/1847721034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f966c109480 msgr2=0x7f966c19b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:42.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.981+0000 7f966b7fe640 1 --2- 172.21.15.1:0/1847721034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f966c109480 0x7f966c19b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.981+0000 7f966b7fe640 1 -- 172.21.15.1:0/1847721034 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f966c19b960 con 0x7f966c101a90 2024-09-21T01:01:42.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.981+0000 7f966b7fe640 1 --2- 172.21.15.1:0/1847721034 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f966c101a90 0x7f966c199f20 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f965c00ea60 tx=0x7f965c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:42.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.981+0000 7f9668ff9640 1 -- 172.21.15.1:0/1847721034 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965c00cde0 con 0x7f966c101a90 2024-09-21T01:01:42.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.981+0000 7f9668ff9640 1 -- 172.21.15.1:0/1847721034 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f965c0035f0 con 0x7f966c101a90 2024-09-21T01:01:42.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.981+0000 7f967224d640 1 -- 172.21.15.1:0/1847721034 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f966c19bc50 con 0x7f966c101a90 2024-09-21T01:01:42.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.981+0000 7f9668ff9640 1 -- 172.21.15.1:0/1847721034 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965c010690 con 0x7f966c101a90 2024-09-21T01:01:42.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.981+0000 7f967224d640 1 -- 172.21.15.1:0/1847721034 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f966c1a2340 con 0x7f966c101a90 2024-09-21T01:01:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.984+0000 7f96791bb740 1 Processor -- start 2024-09-21T01:01:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.984+0000 7f96791bb740 1 -- start start 2024-09-21T01:01:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.984+0000 7f9668ff9640 1 -- 172.21.15.1:0/1847721034 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f965c0037a0 con 0x7f966c101a90 2024-09-21T01:01:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.984+0000 7f96791bb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564db1b7b1b0 0x564db1f27260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.984+0000 7f96791bb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564db1b522f0 0x564db1f278d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.984+0000 7f96791bb740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564db1b5a4d0 0x564db1f28420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.984+0000 7f96791bb740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564db1e956f0 con 0x564db1b5a4d0 2024-09-21T01:01:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.984+0000 7f96791bb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564db1e84b20 con 0x564db1b7b1b0 2024-09-21T01:01:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.984+0000 7f96791bb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564db1e88930 con 0x564db1b522f0 2024-09-21T01:01:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.984+0000 7f966affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564db1b5a4d0 0x564db1f28420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.985+0000 7f966bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564db1b7b1b0 0x564db1f27260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.985+0000 7f966affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564db1b5a4d0 0x564db1f28420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37904/0 (socket says 172.21.15.1:37904) 2024-09-21T01:01:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.985+0000 7f966affd640 1 -- 172.21.15.1:0/797623942 learned_addr learned my addr 172.21.15.1:0/797623942 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.985+0000 7f966b7fe640 1 --2- 172.21.15.1:0/797623942 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564db1b522f0 0x564db1f278d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.985+0000 7f966bfff640 1 -- 172.21.15.1:0/797623942 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564db1b522f0 msgr2=0x564db1f278d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.985+0000 7f966bfff640 1 --2- 172.21.15.1:0/797623942 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564db1b522f0 0x564db1f278d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.985+0000 7f966bfff640 1 -- 172.21.15.1:0/797623942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564db1b5a4d0 msgr2=0x564db1f28420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.985+0000 7f966bfff640 1 --2- 172.21.15.1:0/797623942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564db1b5a4d0 0x564db1f28420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.985+0000 7f966bfff640 1 -- 172.21.15.1:0/797623942 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564db1e4a530 con 0x564db1b7b1b0 2024-09-21T01:01:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.985+0000 7f966affd640 1 --2- 172.21.15.1:0/797623942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564db1b5a4d0 0x564db1f28420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:01:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.985+0000 7f966bfff640 1 --2- 172.21.15.1:0/797623942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564db1b7b1b0 0x564db1f27260 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9664031b50 tx=0x7f966402f4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8403c2629590eaee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.985+0000 7f9668ff9640 1 --2- 172.21.15.1:0/1847721034 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f96540b6510 0x7f96540b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.985+0000 7f966b7fe640 1 --2- 172.21.15.1:0/1847721034 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f96540b6510 0x7f96540b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.985+0000 7f9651ffb640 1 -- 172.21.15.1:0/797623942 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9664031650 con 0x564db1b7b1b0 2024-09-21T01:01:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.985+0000 7f9651ffb640 1 -- 172.21.15.1:0/797623942 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9664036030 con 0x564db1b7b1b0 2024-09-21T01:01:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.986+0000 7f9651ffb640 1 -- 172.21.15.1:0/797623942 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9664004770 con 0x564db1b7b1b0 2024-09-21T01:01:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.986+0000 7f9668ff9640 1 -- 172.21.15.1:0/1847721034 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f965c0e7610 con 0x7f966c101a90 2024-09-21T01:01:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.986+0000 7f96791bb740 1 -- 172.21.15.1:0/797623942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564db1b7b1b0 msgr2=0x564db1f27260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.986+0000 7f966b7fe640 1 --2- 172.21.15.1:0/1847721034 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f96540b6510 0x7f96540b8a20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f965c0a9d50 tx=0x7f965c0ed550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.986+0000 7f96791bb740 1 --2- 172.21.15.1:0/797623942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564db1b7b1b0 0x564db1f27260 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9664031b50 tx=0x7f966402f4c0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.986+0000 7f96791bb740 1 -- 172.21.15.1:0/797623942 shutdown_connections 2024-09-21T01:01:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.986+0000 7f96791bb740 1 --2- 172.21.15.1:0/797623942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564db1b5a4d0 0x564db1f28420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.986+0000 7f96791bb740 1 --2- 172.21.15.1:0/797623942 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564db1b522f0 0x564db1f278d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.986+0000 7f96791bb740 1 --2- 172.21.15.1:0/797623942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564db1b7b1b0 0x564db1f27260 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.986+0000 7f96791bb740 1 -- 172.21.15.1:0/797623942 >> 172.21.15.1:0/797623942 conn(0x564db1b6f300 msgr2=0x564db1f1e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:42.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.987+0000 7f96791bb740 1 -- 172.21.15.1:0/797623942 shutdown_connections 2024-09-21T01:01:42.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.987+0000 7f96791bb740 1 -- 172.21.15.1:0/797623942 wait complete. 2024-09-21T01:01:42.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.987+0000 7f96791bb740 1 -- start start 2024-09-21T01:01:42.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.987+0000 7f96791bb740 1 Processor -- start 2024-09-21T01:01:42.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.987+0000 7f96791bb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564db1b522f0 0x564db1f30850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:42.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.987+0000 7f96791bb740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564db1b5a4d0 0x564db1f30f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:42.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.987+0000 7f96791bb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564db1b7b1b0 0x564db1f31a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:42.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.987+0000 7f96791bb740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564db1dbcab0 con 0x564db1b5a4d0 2024-09-21T01:01:42.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.987+0000 7f96791bb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564db1e2a730 con 0x564db1b7b1b0 2024-09-21T01:01:42.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.987+0000 7f96791bb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564db1f28d60 con 0x564db1b522f0 2024-09-21T01:01:42.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.987+0000 7f96791bb740 10 client.0 _ll_register_callbacks cb 0x564db1e7e6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:01:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.988+0000 7f966affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564db1b5a4d0 0x564db1f30f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.988+0000 7f966affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564db1b5a4d0 0x564db1f30f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37912/0 (socket says 172.21.15.1:37912) 2024-09-21T01:01:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.988+0000 7f966affd640 1 -- 172.21.15.1:0/4047866227 learned_addr learned my addr 172.21.15.1:0/4047866227 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.988+0000 7f966bfff640 1 --2- 172.21.15.1:0/4047866227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564db1b7b1b0 0x564db1f31a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.988+0000 7f966bfff640 1 --2- 172.21.15.1:0/4047866227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564db1b522f0 0x564db1f30850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.988+0000 7f966affd640 1 -- 172.21.15.1:0/4047866227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564db1b522f0 msgr2=0x564db1f30850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.988+0000 7f966affd640 1 --2- 172.21.15.1:0/4047866227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564db1b522f0 0x564db1f30850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.988+0000 7f966affd640 1 -- 172.21.15.1:0/4047866227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564db1b7b1b0 msgr2=0x564db1f31a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:42.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.988+0000 7f966affd640 1 --2- 172.21.15.1:0/4047866227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564db1b7b1b0 0x564db1f31a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:42.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.988+0000 7f966affd640 1 -- 172.21.15.1:0/4047866227 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564db1be6790 con 0x564db1b5a4d0 2024-09-21T01:01:42.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.988+0000 7f966affd640 1 --2- 172.21.15.1:0/4047866227 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564db1b5a4d0 0x564db1f30f10 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f9660011490 tx=0x7f9660011950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36992167245c1813 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:42.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.988+0000 7f964affd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:01:42.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.988+0000 7f964affd640 1 -- 172.21.15.1:0/4047866227 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f966001f060 con 0x564db1b5a4d0 2024-09-21T01:01:42.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.988+0000 7f964affd640 1 -- 172.21.15.1:0/4047866227 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f9660010760 con 0x564db1b5a4d0 2024-09-21T01:01:42.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.988+0000 7f96791bb740 1 -- 172.21.15.1:0/4047866227 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9664036030 con 0x564db1b5a4d0 2024-09-21T01:01:42.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.988+0000 7f964affd640 1 -- 172.21.15.1:0/4047866227 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f9660010960 con 0x564db1b5a4d0 2024-09-21T01:01:42.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.988+0000 7f96791bb740 10 client.16764 fetch_fsmap learned FSMap version 33 2024-09-21T01:01:42.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.988+0000 7f96791bb740 1 -- 172.21.15.1:0/4047866227 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564db1c5f620 con 0x564db1b5a4d0 2024-09-21T01:01:42.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.989+0000 7f964affd640 1 -- 172.21.15.1:0/4047866227 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9664036030 con 0x564db1b5a4d0 2024-09-21T01:01:42.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.989+0000 7f964affd640 1 -- 172.21.15.1:0/4047866227 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f9660025c30 con 0x564db1b5a4d0 2024-09-21T01:01:42.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.989+0000 7f96791bb740 10 client.16764 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:01:42.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.989+0000 7f96791bb740 10 client.16764 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:01:42.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.989+0000 7f96791bb740 20 client.16764 populate_metadata read hostname 'smithi001' 2024-09-21T01:01:42.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.989+0000 7f96791bb740 1 --2- 172.21.15.1:0/4047866227 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x564db1b39d80 0x564db1f3e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:42.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.989+0000 7f96791bb740 4 client.16764 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:01:42.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.989+0000 7f96791bb740 1 -- 172.21.15.1:0/4047866227 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564db1e97640 con 0x564db1b39d80 2024-09-21T01:01:42.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.989+0000 7f966bfff640 1 --2- 172.21.15.1:0/4047866227 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x564db1b39d80 0x564db1f3e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:42.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.990+0000 7f966bfff640 1 --2- 172.21.15.1:0/4047866227 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x564db1b39d80 0x564db1f3e000 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a22bf12bdd1fac9c server_cookie=b155d89f30acbe0d in_seq=0 out_seq=0 2024-09-21T01:01:42.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.990+0000 7f964affd640 10 client.16764 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:01:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.990+0000 7f964affd640 1 -- 172.21.15.1:0/4047866227 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564db1e97640 con 0x564db1b39d80 2024-09-21T01:01:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.990+0000 7f964affd640 10 client.16764 handle_command_reply: tid=0 2024-09-21T01:01:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.990+0000 7f96791bb740 1 client.16764 shutdown 2024-09-21T01:01:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.990+0000 7f96791bb740 1 -- 172.21.15.1:0/4047866227 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564db1b5a4d0 msgr2=0x564db1f30f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.990+0000 7f96791bb740 1 --2- 172.21.15.1:0/4047866227 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564db1b5a4d0 0x564db1f30f10 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f9660011490 tx=0x7f9660011950 comp rx=0 tx=0).stop 2024-09-21T01:01:43.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.991+0000 7f96791bb740 1 -- 172.21.15.1:0/4047866227 shutdown_connections 2024-09-21T01:01:43.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.991+0000 7f96791bb740 1 --2- 172.21.15.1:0/4047866227 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x564db1b39d80 0x564db1f3e000 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:43.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.991+0000 7f96791bb740 1 --2- 172.21.15.1:0/4047866227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564db1b7b1b0 0x564db1f31a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:43.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.991+0000 7f96791bb740 1 --2- 172.21.15.1:0/4047866227 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564db1b5a4d0 0x564db1f30f10 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:43.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.991+0000 7f964affd640 0 client.16764 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:01:43.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.991+0000 7f96791bb740 1 --2- 172.21.15.1:0/4047866227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564db1b522f0 0x564db1f30850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:43.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.991+0000 7f96791bb740 1 -- 172.21.15.1:0/4047866227 >> 172.21.15.1:0/4047866227 conn(0x564db1b6f300 msgr2=0x564db1f1cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:43.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.991+0000 7f96791bb740 1 -- 172.21.15.1:0/4047866227 shutdown_connections 2024-09-21T01:01:43.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.991+0000 7f96791bb740 1 -- 172.21.15.1:0/4047866227 wait complete. 2024-09-21T01:01:43.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:42.991+0000 7f96791bb740 20 client.16764 trim_cache size 0 max 16384 2024-09-21T01:01:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.007+0000 7f96791bb740 1 Processor -- start 2024-09-21T01:01:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.007+0000 7f96791bb740 1 -- start start 2024-09-21T01:01:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.007+0000 7f96791bb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564db1b522f0 0x564db1f1e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.007+0000 7f96791bb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564db1b5a4d0 0x564db1f2ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.007+0000 7f96791bb740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564db1b7b1b0 0x564db1f2ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.007+0000 7f96791bb740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f966c1a8e30 con 0x564db1b7b1b0 2024-09-21T01:01:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.007+0000 7f96791bb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f966c1aaa30 con 0x564db1b5a4d0 2024-09-21T01:01:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.007+0000 7f96791bb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f966c1a9500 con 0x564db1b522f0 2024-09-21T01:01:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.007+0000 7f966bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564db1b7b1b0 0x564db1f2ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.007+0000 7f966bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564db1b7b1b0 0x564db1f2ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37924/0 (socket says 172.21.15.1:37924) 2024-09-21T01:01:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.007+0000 7f966bfff640 1 -- 172.21.15.1:0/784886497 learned_addr learned my addr 172.21.15.1:0/784886497 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.007+0000 7f966affd640 1 --2- 172.21.15.1:0/784886497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564db1b5a4d0 0x564db1f2ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.007+0000 7f966bfff640 1 --2- 172.21.15.1:0/784886497 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564db1b522f0 0x564db1f1e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.007+0000 7f966bfff640 1 -- 172.21.15.1:0/784886497 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564db1b522f0 msgr2=0x564db1f1e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.007+0000 7f966bfff640 1 --2- 172.21.15.1:0/784886497 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564db1b522f0 0x564db1f1e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.007+0000 7f966bfff640 1 -- 172.21.15.1:0/784886497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564db1b5a4d0 msgr2=0x564db1f2ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.007+0000 7f966bfff640 1 --2- 172.21.15.1:0/784886497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564db1b5a4d0 0x564db1f2ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.007+0000 7f966bfff640 1 -- 172.21.15.1:0/784886497 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564db1f3a910 con 0x564db1b7b1b0 2024-09-21T01:01:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.008+0000 7f966bfff640 1 --2- 172.21.15.1:0/784886497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564db1b7b1b0 0x564db1f2ede0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f9664009bf0 tx=0x7f966402f4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a562c19357c35ba server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.008+0000 7f96517fa640 1 -- 172.21.15.1:0/784886497 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9664004730 con 0x564db1b7b1b0 2024-09-21T01:01:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.008+0000 7f96517fa640 1 -- 172.21.15.1:0/784886497 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9664059070 con 0x564db1b7b1b0 2024-09-21T01:01:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.008+0000 7f96517fa640 1 -- 172.21.15.1:0/784886497 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9664003e40 con 0x564db1b7b1b0 2024-09-21T01:01:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.009+0000 7f96791bb740 1 -- 172.21.15.1:0/784886497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564db1b7b1b0 msgr2=0x564db1f2ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.009+0000 7f96791bb740 1 --2- 172.21.15.1:0/784886497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564db1b7b1b0 0x564db1f2ede0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f9664009bf0 tx=0x7f966402f4c0 comp rx=0 tx=0).stop 2024-09-21T01:01:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.009+0000 7f96791bb740 1 -- 172.21.15.1:0/784886497 shutdown_connections 2024-09-21T01:01:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.009+0000 7f96791bb740 1 --2- 172.21.15.1:0/784886497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564db1b7b1b0 0x564db1f2ede0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.009+0000 7f96791bb740 1 --2- 172.21.15.1:0/784886497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564db1b5a4d0 0x564db1f2ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.009+0000 7f96791bb740 1 --2- 172.21.15.1:0/784886497 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564db1b522f0 0x564db1f1e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:43.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.009+0000 7f96791bb740 1 -- 172.21.15.1:0/784886497 >> 172.21.15.1:0/784886497 conn(0x564db1b6f300 msgr2=0x564db1f2b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:43.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.009+0000 7f96791bb740 1 -- 172.21.15.1:0/784886497 shutdown_connections 2024-09-21T01:01:43.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.009+0000 7f96791bb740 1 -- 172.21.15.1:0/784886497 wait complete. 2024-09-21T01:01:43.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.009+0000 7f96791bb740 1 -- start start 2024-09-21T01:01:43.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.009+0000 7f96791bb740 1 Processor -- start 2024-09-21T01:01:43.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.010+0000 7f96791bb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564db1b522f0 0x564db1f381f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:43.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.010+0000 7f96791bb740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564db1b5a4d0 0x564db1f36eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:43.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.010+0000 7f96791bb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564db1b7b1b0 0x564db1f373f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:43.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.010+0000 7f96791bb740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f966c1aa360 con 0x564db1b5a4d0 2024-09-21T01:01:43.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.010+0000 7f96791bb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f966c1a9c90 con 0x564db1b7b1b0 2024-09-21T01:01:43.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.010+0000 7f96791bb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f966c1a6e10 con 0x564db1b522f0 2024-09-21T01:01:43.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.010+0000 7f96791bb740 10 client.0 _ll_register_callbacks cb 0x7f966000bc50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:01:43.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.010+0000 7f966affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564db1b5a4d0 0x564db1f36eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:43.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.010+0000 7f966affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564db1b5a4d0 0x564db1f36eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37932/0 (socket says 172.21.15.1:37932) 2024-09-21T01:01:43.016 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.010+0000 7f966affd640 1 -- 172.21.15.1:0/2923009736 learned_addr learned my addr 172.21.15.1:0/2923009736 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:43.016 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.010+0000 7f966bfff640 1 --2- 172.21.15.1:0/2923009736 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564db1b7b1b0 0x564db1f373f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:43.016 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.010+0000 7f966bfff640 1 --2- 172.21.15.1:0/2923009736 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564db1b522f0 0x564db1f381f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:43.016 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.010+0000 7f966affd640 1 -- 172.21.15.1:0/2923009736 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564db1b522f0 msgr2=0x564db1f381f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:43.016 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.010+0000 7f966affd640 1 --2- 172.21.15.1:0/2923009736 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564db1b522f0 0x564db1f381f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:43.016 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.010+0000 7f966affd640 1 -- 172.21.15.1:0/2923009736 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564db1b7b1b0 msgr2=0x564db1f373f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:43.016 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.010+0000 7f966affd640 1 --2- 172.21.15.1:0/2923009736 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564db1b7b1b0 0x564db1f373f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:43.016 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.010+0000 7f966affd640 1 -- 172.21.15.1:0/2923009736 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564db1f37930 con 0x564db1b5a4d0 2024-09-21T01:01:43.016 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.010+0000 7f966bfff640 1 --2- 172.21.15.1:0/2923009736 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564db1b522f0 0x564db1f381f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:01:43.016 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.010+0000 7f966affd640 1 --2- 172.21.15.1:0/2923009736 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564db1b5a4d0 0x564db1f36eb0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f966000f580 tx=0x7f9660005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32047386bc6830a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:43.016 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.010+0000 7f964affd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:01:43.016 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.010+0000 7f964affd640 1 -- 172.21.15.1:0/2923009736 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9660010760 con 0x564db1b5a4d0 2024-09-21T01:01:43.016 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.010+0000 7f964affd640 1 -- 172.21.15.1:0/2923009736 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f96600055f0 con 0x564db1b5a4d0 2024-09-21T01:01:43.016 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.010+0000 7f96791bb740 1 -- 172.21.15.1:0/2923009736 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9664059070 con 0x564db1b5a4d0 2024-09-21T01:01:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.010+0000 7f964affd640 1 -- 172.21.15.1:0/2923009736 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f9660004660 con 0x564db1b5a4d0 2024-09-21T01:01:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.011+0000 7f96791bb740 10 client.16770 fetch_fsmap learned FSMap version 33 2024-09-21T01:01:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.011+0000 7f96791bb740 1 -- 172.21.15.1:0/2923009736 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564db1f367d0 con 0x564db1b5a4d0 2024-09-21T01:01:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.011+0000 7f964affd640 1 -- 172.21.15.1:0/2923009736 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9664059070 con 0x564db1b5a4d0 2024-09-21T01:01:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.011+0000 7f964affd640 1 -- 172.21.15.1:0/2923009736 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f966000f8e0 con 0x564db1b5a4d0 2024-09-21T01:01:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.011+0000 7f96791bb740 10 client.16770 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:01:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.011+0000 7f96791bb740 10 client.16770 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:01:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.011+0000 7f96791bb740 20 client.16770 populate_metadata read hostname 'smithi001' 2024-09-21T01:01:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.011+0000 7f96791bb740 1 --2- 172.21.15.1:0/2923009736 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x564db1b0f1c0 0x564db1fab080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.011+0000 7f96791bb740 4 client.16770 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:01:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.011+0000 7f96791bb740 1 -- 172.21.15.1:0/2923009736 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564db1e930f0 con 0x564db1b0f1c0 2024-09-21T01:01:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.011+0000 7f966bfff640 1 --2- 172.21.15.1:0/2923009736 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x564db1b0f1c0 0x564db1fab080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.012+0000 7f964affd640 10 client.16770 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:01:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.012+0000 7f966bfff640 1 --2- 172.21.15.1:0/2923009736 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x564db1b0f1c0 0x564db1fab080 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb5c461e0090ffc2 server_cookie=1d600d98a4bcee8 in_seq=0 out_seq=0 2024-09-21T01:01:43.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.220+0000 7f964affd640 1 -- 172.21.15.1:0/2923009736 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564db1e930f0 con 0x564db1b0f1c0 2024-09-21T01:01:43.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.220+0000 7f964affd640 10 client.16770 handle_command_reply: tid=0 2024-09-21T01:01:43.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.220+0000 7f96791bb740 1 client.16770 shutdown 2024-09-21T01:01:43.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.221+0000 7f96791bb740 1 -- 172.21.15.1:0/2923009736 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564db1b5a4d0 msgr2=0x564db1f36eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:43.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.221+0000 7f96791bb740 1 --2- 172.21.15.1:0/2923009736 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564db1b5a4d0 0x564db1f36eb0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f966000f580 tx=0x7f9660005270 comp rx=0 tx=0).stop 2024-09-21T01:01:43.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.221+0000 7f96791bb740 1 -- 172.21.15.1:0/2923009736 shutdown_connections 2024-09-21T01:01:43.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.221+0000 7f96791bb740 1 --2- 172.21.15.1:0/2923009736 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x564db1b0f1c0 0x564db1fab080 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:43.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.221+0000 7f96791bb740 1 --2- 172.21.15.1:0/2923009736 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564db1b7b1b0 0x564db1f373f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:43.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.221+0000 7f96791bb740 1 --2- 172.21.15.1:0/2923009736 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564db1b5a4d0 0x564db1f36eb0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:43.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.221+0000 7f964affd640 0 client.16770 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:01:43.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.221+0000 7f96791bb740 1 --2- 172.21.15.1:0/2923009736 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564db1b522f0 0x564db1f381f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:43.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.221+0000 7f96791bb740 1 -- 172.21.15.1:0/2923009736 >> 172.21.15.1:0/2923009736 conn(0x564db1b6f300 msgr2=0x564db1f1fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:43.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.221+0000 7f96791bb740 1 -- 172.21.15.1:0/2923009736 shutdown_connections 2024-09-21T01:01:43.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.221+0000 7f96791bb740 1 -- 172.21.15.1:0/2923009736 wait complete. 2024-09-21T01:01:43.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.221+0000 7f96791bb740 20 client.16770 trim_cache size 0 max 16384 2024-09-21T01:01:43.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T01:01:43.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T01:01:43.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T01:01:43.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T01:01:43.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.222+0000 7f967224d640 1 -- 172.21.15.1:0/1847721034 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f96540b6510 msgr2=0x7f96540b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:43.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.222+0000 7f967224d640 1 --2- 172.21.15.1:0/1847721034 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f96540b6510 0x7f96540b8a20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f965c0a9d50 tx=0x7f965c0ed550 comp rx=0 tx=0).stop 2024-09-21T01:01:43.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.222+0000 7f967224d640 1 -- 172.21.15.1:0/1847721034 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f966c101a90 msgr2=0x7f966c199f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:43.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.222+0000 7f967224d640 1 --2- 172.21.15.1:0/1847721034 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f966c101a90 0x7f966c199f20 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f965c00ea60 tx=0x7f965c00ef20 comp rx=0 tx=0).stop 2024-09-21T01:01:43.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.222+0000 7f967224d640 1 -- 172.21.15.1:0/1847721034 shutdown_connections 2024-09-21T01:01:43.225 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.222+0000 7f967224d640 1 --2- 172.21.15.1:0/1847721034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f966c109480 0x7f966c19b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:43.225 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.222+0000 7f967224d640 1 --2- 172.21.15.1:0/1847721034 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f966c106b20 0x7f966c19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:43.225 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.222+0000 7f967224d640 1 --2- 172.21.15.1:0/1847721034 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f96540b6510 0x7f96540b8a20 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:43.225 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.222+0000 7f967224d640 1 --2- 172.21.15.1:0/1847721034 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f966c101a90 0x7f966c199f20 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:43.225 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.222+0000 7f967224d640 1 -- 172.21.15.1:0/1847721034 >> 172.21.15.1:0/1847721034 conn(0x7f966c0fd690 msgr2=0x7f966c107990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:43.225 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.222+0000 7f967224d640 1 -- 172.21.15.1:0/1847721034 shutdown_connections 2024-09-21T01:01:43.225 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:43.222+0000 7f967224d640 1 -- 172.21.15.1:0/1847721034 wait complete. 2024-09-21T01:01:43.560 INFO:tasks.workunit.client.0.smithi001.stdout: 107 1175401 303 753002 326 663815 704 2024-09-21T01:01:43.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:43 smithi001 ceph-mon[31211]: pgmap v493: 97 pgs: 97 active+clean; 567 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 510 op/s 2024-09-21T01:01:43.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:43 smithi042 ceph-mon[34481]: pgmap v493: 97 pgs: 97 active+clean; 567 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 510 op/s 2024-09-21T01:01:43.780 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:43 smithi193 ceph-mon[34660]: pgmap v493: 97 pgs: 97 active+clean; 567 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 510 op/s 2024-09-21T01:01:44.776 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T01:01:44.776 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T01:01:45.391 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:01:45.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:45 smithi042 ceph-mon[34481]: pgmap v494: 97 pgs: 97 active+clean; 573 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.8 MiB/s wr, 633 op/s 2024-09-21T01:01:45.778 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:45 smithi001 ceph-mon[31211]: pgmap v494: 97 pgs: 97 active+clean; 573 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.8 MiB/s wr, 633 op/s 2024-09-21T01:01:45.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.875+0000 7f88dc995640 1 -- 172.21.15.1:0/1864326460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88d81083b0 msgr2=0x7f88d81087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:45.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.875+0000 7f88dc995640 1 --2- 172.21.15.1:0/1864326460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88d81083b0 0x7f88d81087c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f88cc009900 tx=0x7f88cc02a410 comp rx=0 tx=0).stop 2024-09-21T01:01:45.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.875+0000 7f88dc995640 1 -- 172.21.15.1:0/1864326460 shutdown_connections 2024-09-21T01:01:45.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.875+0000 7f88dc995640 1 --2- 172.21.15.1:0/1864326460 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f88d8108d00 0x7f88d810f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.875+0000 7f88dc995640 1 --2- 172.21.15.1:0/1864326460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88d81083b0 0x7f88d81087c0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.875+0000 7f88dc995640 1 --2- 172.21.15.1:0/1864326460 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88d8102a70 0x7f88d8102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.875+0000 7f88dc995640 1 -- 172.21.15.1:0/1864326460 >> 172.21.15.1:0/1864326460 conn(0x7f88d8079730 msgr2=0x7f88d8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:45.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.875+0000 7f88dc995640 1 -- 172.21.15.1:0/1864326460 shutdown_connections 2024-09-21T01:01:45.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.876+0000 7f88dc995640 1 -- 172.21.15.1:0/1864326460 wait complete. 2024-09-21T01:01:45.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.876+0000 7f88dc995640 1 Processor -- start 2024-09-21T01:01:45.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.876+0000 7f88dc995640 1 -- start start 2024-09-21T01:01:45.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.877+0000 7f88dc995640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88d8102a70 0x7f88d819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:45.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.877+0000 7f88dc995640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88d81083b0 0x7f88d819abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:45.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.877+0000 7f88dc995640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f88d8108d00 0x7f88d819fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:45.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.877+0000 7f88dc995640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f88d8112970 con 0x7f88d81083b0 2024-09-21T01:01:45.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.877+0000 7f88dc995640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f88d81127f0 con 0x7f88d8102a70 2024-09-21T01:01:45.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.877+0000 7f88dc995640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f88d8112af0 con 0x7f88d8108d00 2024-09-21T01:01:45.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.877+0000 7f88d5d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88d81083b0 0x7f88d819abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:45.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.877+0000 7f88d5d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88d81083b0 0x7f88d819abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37946/0 (socket says 172.21.15.1:37946) 2024-09-21T01:01:45.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.877+0000 7f88d5d9b640 1 -- 172.21.15.1:0/1946803920 learned_addr learned my addr 172.21.15.1:0/1946803920 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:45.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.877+0000 7f88d659c640 1 --2- 172.21.15.1:0/1946803920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88d8102a70 0x7f88d819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:45.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.877+0000 7f88d6d9d640 1 --2- 172.21.15.1:0/1946803920 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f88d8108d00 0x7f88d819fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:45.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.877+0000 7f88d5d9b640 1 -- 172.21.15.1:0/1946803920 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f88d8108d00 msgr2=0x7f88d819fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:45.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.877+0000 7f88d5d9b640 1 --2- 172.21.15.1:0/1946803920 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f88d8108d00 0x7f88d819fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.877+0000 7f88d5d9b640 1 -- 172.21.15.1:0/1946803920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88d8102a70 msgr2=0x7f88d819a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:45.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.877+0000 7f88d5d9b640 1 --2- 172.21.15.1:0/1946803920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88d8102a70 0x7f88d819a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.877+0000 7f88d5d9b640 1 -- 172.21.15.1:0/1946803920 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d81a05c0 con 0x7f88d81083b0 2024-09-21T01:01:45.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.878+0000 7f88d5d9b640 1 --2- 172.21.15.1:0/1946803920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88d81083b0 0x7f88d819abf0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f88cc032fd0 tx=0x7f88cc031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:45.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.878+0000 7f88c77fe640 1 -- 172.21.15.1:0/1946803920 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88cc03f030 con 0x7f88d81083b0 2024-09-21T01:01:45.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.878+0000 7f88dc995640 1 -- 172.21.15.1:0/1946803920 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88d81a0850 con 0x7f88d81083b0 2024-09-21T01:01:45.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.878+0000 7f88c77fe640 1 -- 172.21.15.1:0/1946803920 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88cc004490 con 0x7f88d81083b0 2024-09-21T01:01:45.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.878+0000 7f88c77fe640 1 -- 172.21.15.1:0/1946803920 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88cc035070 con 0x7f88d81083b0 2024-09-21T01:01:45.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.878+0000 7f88dc995640 1 -- 172.21.15.1:0/1946803920 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88d81a7010 con 0x7f88d81083b0 2024-09-21T01:01:45.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.881+0000 7f88c77fe640 1 -- 172.21.15.1:0/1946803920 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f88cc042030 con 0x7f88d81083b0 2024-09-21T01:01:45.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.881+0000 7f88e2f09740 1 Processor -- start 2024-09-21T01:01:45.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.882+0000 7f88e2f09740 1 -- start start 2024-09-21T01:01:45.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.882+0000 7f88e2f09740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dcfb0eb350 0x55dcfb492430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:45.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.882+0000 7f88e2f09740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dcfb0c2490 0x55dcfb492970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:45.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.882+0000 7f88e2f09740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dcfb0ca670 0x55dcfb492eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:45.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.882+0000 7f88e2f09740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55dcfb408e60 con 0x55dcfb0c2490 2024-09-21T01:01:45.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.882+0000 7f88e2f09740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55dcfb3f8290 con 0x55dcfb0ca670 2024-09-21T01:01:45.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.882+0000 7f88e2f09740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55dcfb3fc0a0 con 0x55dcfb0eb350 2024-09-21T01:01:45.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.882+0000 7f88d659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dcfb0c2490 0x55dcfb492970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:45.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.882+0000 7f88d6d9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dcfb0eb350 0x55dcfb492430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:45.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.882+0000 7f88d659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dcfb0c2490 0x55dcfb492970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37954/0 (socket says 172.21.15.1:37954) 2024-09-21T01:01:45.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.882+0000 7f88d659c640 1 -- 172.21.15.1:0/3246741587 learned_addr learned my addr 172.21.15.1:0/3246741587 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:45.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.882+0000 7f88d5d9b640 1 --2- 172.21.15.1:0/3246741587 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dcfb0ca670 0x55dcfb492eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:45.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.882+0000 7f88c77fe640 1 --2- 172.21.15.1:0/1946803920 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f88c00b6510 0x7f88c00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:45.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.883+0000 7f88d6d9d640 1 -- 172.21.15.1:0/3246741587 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dcfb0ca670 msgr2=0x55dcfb492eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:45.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.883+0000 7f88d6d9d640 1 --2- 172.21.15.1:0/3246741587 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dcfb0ca670 0x55dcfb492eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.883+0000 7f88d6d9d640 1 -- 172.21.15.1:0/3246741587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dcfb0c2490 msgr2=0x55dcfb492970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:45.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.883+0000 7f88d6d9d640 1 --2- 172.21.15.1:0/3246741587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dcfb0c2490 0x55dcfb492970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.883+0000 7f88d6d9d640 1 -- 172.21.15.1:0/3246741587 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcfb156930 con 0x55dcfb0eb350 2024-09-21T01:01:45.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.883+0000 7f88c77fe640 1 -- 172.21.15.1:0/1946803920 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f88cc107660 con 0x7f88d81083b0 2024-09-21T01:01:45.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.883+0000 7f88d6d9d640 1 --2- 172.21.15.1:0/1946803920 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f88c00b6510 0x7f88c00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:45.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.883+0000 7f88d6d9d640 1 --2- 172.21.15.1:0/3246741587 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dcfb0eb350 0x55dcfb492430 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f88d0009fa0 tx=0x7f88d00118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cefdbfed2e932651 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:45.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.883+0000 7f88c4ff9640 1 -- 172.21.15.1:0/3246741587 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d0017050 con 0x55dcfb0eb350 2024-09-21T01:01:45.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.883+0000 7f88d6d9d640 1 --2- 172.21.15.1:0/1946803920 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f88c00b6510 0x7f88c00b8a20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f88d0022000 tx=0x7f88d0023000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:45.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.883+0000 7f88c4ff9640 1 -- 172.21.15.1:0/3246741587 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88d0003b90 con 0x55dcfb0eb350 2024-09-21T01:01:45.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.883+0000 7f88c4ff9640 1 -- 172.21.15.1:0/3246741587 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d001b930 con 0x55dcfb0eb350 2024-09-21T01:01:45.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.884+0000 7f88e2f09740 1 -- 172.21.15.1:0/3246741587 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dcfb0eb350 msgr2=0x55dcfb492430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:45.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.884+0000 7f88e2f09740 1 --2- 172.21.15.1:0/3246741587 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dcfb0eb350 0x55dcfb492430 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f88d0009fa0 tx=0x7f88d00118d0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.884+0000 7f88e2f09740 1 -- 172.21.15.1:0/3246741587 shutdown_connections 2024-09-21T01:01:45.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.884+0000 7f88e2f09740 1 --2- 172.21.15.1:0/3246741587 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dcfb0ca670 0x55dcfb492eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.884+0000 7f88e2f09740 1 --2- 172.21.15.1:0/3246741587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dcfb0c2490 0x55dcfb492970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.884+0000 7f88e2f09740 1 --2- 172.21.15.1:0/3246741587 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dcfb0eb350 0x55dcfb492430 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.884+0000 7f88e2f09740 1 -- 172.21.15.1:0/3246741587 >> 172.21.15.1:0/3246741587 conn(0x55dcfb0df740 msgr2=0x55dcfb490320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:45.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.884+0000 7f88e2f09740 1 -- 172.21.15.1:0/3246741587 shutdown_connections 2024-09-21T01:01:45.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.884+0000 7f88e2f09740 1 -- 172.21.15.1:0/3246741587 wait complete. 2024-09-21T01:01:45.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.885+0000 7f88e2f09740 1 -- start start 2024-09-21T01:01:45.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.885+0000 7f88e2f09740 1 Processor -- start 2024-09-21T01:01:45.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.885+0000 7f88e2f09740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dcfb0c2490 0x55dcfb49e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:45.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.885+0000 7f88e2f09740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dcfb0ca670 0x55dcfb49e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:45.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.885+0000 7f88e2f09740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dcfb0eb350 0x55dcfb4a9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:45.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.885+0000 7f88e2f09740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55dcfb259890 con 0x55dcfb0eb350 2024-09-21T01:01:45.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.885+0000 7f88e2f09740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55dcfb392d40 con 0x55dcfb0ca670 2024-09-21T01:01:45.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.885+0000 7f88e2f09740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55dcfb4a0c10 con 0x55dcfb0c2490 2024-09-21T01:01:45.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.885+0000 7f88e2f09740 10 client.0 _ll_register_callbacks cb 0x55dcfb3f6c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:01:45.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.885+0000 7f88d659c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dcfb0c2490 0x55dcfb49e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:45.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.885+0000 7f88d6d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dcfb0eb350 0x55dcfb4a9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:45.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.885+0000 7f88d659c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dcfb0c2490 0x55dcfb49e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:33042/0 (socket says 172.21.15.1:33042) 2024-09-21T01:01:45.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.885+0000 7f88d6d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dcfb0eb350 0x55dcfb4a9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37956/0 (socket says 172.21.15.1:37956) 2024-09-21T01:01:45.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.885+0000 7f88d659c640 1 -- 172.21.15.1:0/1802733819 learned_addr learned my addr 172.21.15.1:0/1802733819 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:45.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.885+0000 7f88d5d9b640 1 --2- 172.21.15.1:0/1802733819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dcfb0ca670 0x55dcfb49e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:45.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.886+0000 7f88d659c640 1 -- 172.21.15.1:0/1802733819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dcfb0ca670 msgr2=0x55dcfb49e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:45.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.886+0000 7f88d659c640 1 --2- 172.21.15.1:0/1802733819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dcfb0ca670 0x55dcfb49e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.886+0000 7f88d659c640 1 -- 172.21.15.1:0/1802733819 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dcfb0eb350 msgr2=0x55dcfb4a9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:45.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.886+0000 7f88d659c640 1 --2- 172.21.15.1:0/1802733819 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dcfb0eb350 0x55dcfb4a9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.886+0000 7f88d659c640 1 -- 172.21.15.1:0/1802733819 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcfb4aa550 con 0x55dcfb0c2490 2024-09-21T01:01:45.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.886+0000 7f88d5d9b640 1 --2- 172.21.15.1:0/1802733819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dcfb0ca670 0x55dcfb49e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:01:45.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.886+0000 7f88d6d9d640 1 --2- 172.21.15.1:0/1802733819 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dcfb0eb350 0x55dcfb4a9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:01:45.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.886+0000 7f88d659c640 1 --2- 172.21.15.1:0/1802733819 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dcfb0c2490 0x55dcfb49e070 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f88c8012720 tx=0x7f88c8012be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2075ef89bbab3ed7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:45.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.886+0000 7f88bdffb640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T01:01:45.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.886+0000 7f88bdffb640 1 -- 172.21.15.1:0/1802733819 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c8004050 con 0x55dcfb0c2490 2024-09-21T01:01:45.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.886+0000 7f88bdffb640 1 -- 172.21.15.1:0/1802733819 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f88c80041f0 con 0x55dcfb0c2490 2024-09-21T01:01:45.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.886+0000 7f88e2f09740 1 -- 172.21.15.1:0/1802733819 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88d0003b90 con 0x55dcfb0c2490 2024-09-21T01:01:45.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.886+0000 7f88bdffb640 1 -- 172.21.15.1:0/1802733819 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f88c8022070 con 0x55dcfb0c2490 2024-09-21T01:01:45.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.886+0000 7f88e2f09740 10 client.26311 fetch_fsmap learned FSMap version 33 2024-09-21T01:01:45.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.886+0000 7f88e2f09740 1 -- 172.21.15.1:0/1802733819 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55dcfb4acee0 con 0x55dcfb0c2490 2024-09-21T01:01:45.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.887+0000 7f88bdffb640 1 -- 172.21.15.1:0/1802733819 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88d0003b90 con 0x55dcfb0c2490 2024-09-21T01:01:45.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.887+0000 7f88bdffb640 1 -- 172.21.15.1:0/1802733819 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f88c8003a30 con 0x55dcfb0c2490 2024-09-21T01:01:45.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.887+0000 7f88e2f09740 10 client.26311 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:01:45.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.887+0000 7f88e2f09740 10 client.26311 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:01:45.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.887+0000 7f88e2f09740 20 client.26311 populate_metadata read hostname 'smithi001' 2024-09-21T01:01:45.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.887+0000 7f88e2f09740 1 --2- 172.21.15.1:0/1802733819 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55dcfb0a9cd0 0x55dcfb4b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:45.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.887+0000 7f88e2f09740 4 client.26311 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:01:45.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.887+0000 7f88e2f09740 1 -- 172.21.15.1:0/1802733819 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dcfb40adb0 con 0x55dcfb0a9cd0 2024-09-21T01:01:45.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.888+0000 7f88d5d9b640 1 --2- 172.21.15.1:0/1802733819 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55dcfb0a9cd0 0x55dcfb4b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:45.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.888+0000 7f88d5d9b640 1 --2- 172.21.15.1:0/1802733819 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55dcfb0a9cd0 0x55dcfb4b03d0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef03f0f41b7449d6 server_cookie=743253d9d7768a73 in_seq=0 out_seq=0 2024-09-21T01:01:45.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.888+0000 7f88bdffb640 10 client.26311 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:01:45.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.889+0000 7f88bdffb640 1 -- 172.21.15.1:0/1802733819 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dcfb40adb0 con 0x55dcfb0a9cd0 2024-09-21T01:01:45.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.889+0000 7f88bdffb640 10 client.26311 handle_command_reply: tid=0 2024-09-21T01:01:45.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.889+0000 7f88e2f09740 1 client.26311 shutdown 2024-09-21T01:01:45.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.889+0000 7f88e2f09740 1 -- 172.21.15.1:0/1802733819 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dcfb0c2490 msgr2=0x55dcfb49e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:45.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.889+0000 7f88e2f09740 1 --2- 172.21.15.1:0/1802733819 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dcfb0c2490 0x55dcfb49e070 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f88c8012720 tx=0x7f88c8012be0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.889+0000 7f88e2f09740 1 -- 172.21.15.1:0/1802733819 shutdown_connections 2024-09-21T01:01:45.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.889+0000 7f88e2f09740 1 --2- 172.21.15.1:0/1802733819 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55dcfb0a9cd0 0x55dcfb4b03d0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.889+0000 7f88e2f09740 1 --2- 172.21.15.1:0/1802733819 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dcfb0eb350 0x55dcfb4a9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.889+0000 7f88e2f09740 1 --2- 172.21.15.1:0/1802733819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dcfb0ca670 0x55dcfb49e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.889+0000 7f88e2f09740 1 --2- 172.21.15.1:0/1802733819 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dcfb0c2490 0x55dcfb49e070 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.889+0000 7f88bdffb640 0 client.26311 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:01:45.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.889+0000 7f88e2f09740 1 -- 172.21.15.1:0/1802733819 >> 172.21.15.1:0/1802733819 conn(0x55dcfb0df740 msgr2=0x55dcfb4955c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:45.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.889+0000 7f88e2f09740 1 -- 172.21.15.1:0/1802733819 shutdown_connections 2024-09-21T01:01:45.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.889+0000 7f88e2f09740 1 -- 172.21.15.1:0/1802733819 wait complete. 2024-09-21T01:01:45.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.889+0000 7f88e2f09740 20 client.26311 trim_cache size 0 max 16384 2024-09-21T01:01:45.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.909+0000 7f88e2f09740 1 Processor -- start 2024-09-21T01:01:45.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.909+0000 7f88e2f09740 1 -- start start 2024-09-21T01:01:45.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.909+0000 7f88e2f09740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dcfb0c2490 0x55dcfb4a9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:45.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.909+0000 7f88e2f09740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dcfb0ca670 0x55dcfb4976b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:45.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.909+0000 7f88e2f09740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dcfb0eb350 0x55dcfb497bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:45.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.909+0000 7f88e2f09740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f88d81af4e0 con 0x55dcfb0ca670 2024-09-21T01:01:45.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.909+0000 7f88e2f09740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f88d81b10e0 con 0x55dcfb0eb350 2024-09-21T01:01:45.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.909+0000 7f88e2f09740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f88d81afbb0 con 0x55dcfb0c2490 2024-09-21T01:01:45.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.909+0000 7f88d5d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dcfb0ca670 0x55dcfb4976b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:45.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.909+0000 7f88d6d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dcfb0eb350 0x55dcfb497bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:45.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.909+0000 7f88d5d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dcfb0ca670 0x55dcfb4976b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37960/0 (socket says 172.21.15.1:37960) 2024-09-21T01:01:45.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.909+0000 7f88d5d9b640 1 -- 172.21.15.1:0/1296534202 learned_addr learned my addr 172.21.15.1:0/1296534202 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:45.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.909+0000 7f88d659c640 1 --2- 172.21.15.1:0/1296534202 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dcfb0c2490 0x55dcfb4a9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:45.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.909+0000 7f88d5d9b640 1 -- 172.21.15.1:0/1296534202 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dcfb0c2490 msgr2=0x55dcfb4a9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:45.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.909+0000 7f88d5d9b640 1 --2- 172.21.15.1:0/1296534202 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dcfb0c2490 0x55dcfb4a9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.909+0000 7f88d5d9b640 1 -- 172.21.15.1:0/1296534202 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dcfb0eb350 msgr2=0x55dcfb497bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:45.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.909+0000 7f88d5d9b640 1 --2- 172.21.15.1:0/1296534202 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dcfb0eb350 0x55dcfb497bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.909+0000 7f88d5d9b640 1 -- 172.21.15.1:0/1296534202 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcfb494720 con 0x55dcfb0ca670 2024-09-21T01:01:45.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.909+0000 7f88d6d9d640 1 --2- 172.21.15.1:0/1296534202 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dcfb0eb350 0x55dcfb497bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:01:45.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.910+0000 7f88d5d9b640 1 --2- 172.21.15.1:0/1296534202 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dcfb0ca670 0x55dcfb4976b0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f88cc0c9e50 tx=0x7f88cc0c9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a776356fe5a0203 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:45.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.910+0000 7f88bffff640 1 -- 172.21.15.1:0/1296534202 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88cc049040 con 0x55dcfb0ca670 2024-09-21T01:01:45.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.910+0000 7f88bffff640 1 -- 172.21.15.1:0/1296534202 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88cc0cd390 con 0x55dcfb0ca670 2024-09-21T01:01:45.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.910+0000 7f88bffff640 1 -- 172.21.15.1:0/1296534202 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88cc0d6fc0 con 0x55dcfb0ca670 2024-09-21T01:01:45.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.911+0000 7f88e2f09740 1 -- 172.21.15.1:0/1296534202 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dcfb0ca670 msgr2=0x55dcfb4976b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:45.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.911+0000 7f88e2f09740 1 --2- 172.21.15.1:0/1296534202 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dcfb0ca670 0x55dcfb4976b0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f88cc0c9e50 tx=0x7f88cc0c9040 comp rx=0 tx=0).stop 2024-09-21T01:01:45.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.911+0000 7f88e2f09740 1 -- 172.21.15.1:0/1296534202 shutdown_connections 2024-09-21T01:01:45.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.911+0000 7f88e2f09740 1 --2- 172.21.15.1:0/1296534202 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dcfb0eb350 0x55dcfb497bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.911+0000 7f88e2f09740 1 --2- 172.21.15.1:0/1296534202 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dcfb0ca670 0x55dcfb4976b0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.911+0000 7f88e2f09740 1 --2- 172.21.15.1:0/1296534202 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dcfb0c2490 0x55dcfb4a9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.911+0000 7f88e2f09740 1 -- 172.21.15.1:0/1296534202 >> 172.21.15.1:0/1296534202 conn(0x55dcfb0df740 msgr2=0x55dcfb49c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:45.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.911+0000 7f88e2f09740 1 -- 172.21.15.1:0/1296534202 shutdown_connections 2024-09-21T01:01:45.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.911+0000 7f88e2f09740 1 -- 172.21.15.1:0/1296534202 wait complete. 2024-09-21T01:01:45.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.911+0000 7f88e2f09740 1 -- start start 2024-09-21T01:01:45.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.911+0000 7f88e2f09740 1 Processor -- start 2024-09-21T01:01:45.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.912+0000 7f88e2f09740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dcfb0c2490 0x55dcfb4a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:45.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.912+0000 7f88e2f09740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dcfb0ca670 0x55dcfb4a6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:45.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.912+0000 7f88e2f09740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dcfb0eb350 0x55dcfb4a0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:45.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.912+0000 7f88e2f09740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f88d81b0a10 con 0x55dcfb0ca670 2024-09-21T01:01:45.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.912+0000 7f88e2f09740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f88d81b0340 con 0x55dcfb0c2490 2024-09-21T01:01:45.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.912+0000 7f88e2f09740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f88d81ad4c0 con 0x55dcfb0eb350 2024-09-21T01:01:45.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.912+0000 7f88e2f09740 10 client.0 _ll_register_callbacks cb 0x7f88c8009870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:01:45.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.912+0000 7f88d5d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dcfb0ca670 0x55dcfb4a6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:45.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.912+0000 7f88d659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dcfb0c2490 0x55dcfb4a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:45.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.912+0000 7f88d659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dcfb0c2490 0x55dcfb4a5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:59744/0 (socket says 172.21.15.1:59744) 2024-09-21T01:01:45.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.912+0000 7f88d5d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dcfb0ca670 0x55dcfb4a6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37976/0 (socket says 172.21.15.1:37976) 2024-09-21T01:01:45.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.912+0000 7f88d659c640 1 -- 172.21.15.1:0/1848158323 learned_addr learned my addr 172.21.15.1:0/1848158323 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:45.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.912+0000 7f88d6d9d640 1 --2- 172.21.15.1:0/1848158323 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dcfb0eb350 0x55dcfb4a0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:45.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.912+0000 7f88d659c640 1 -- 172.21.15.1:0/1848158323 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dcfb0eb350 msgr2=0x55dcfb4a0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:45.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.912+0000 7f88d659c640 1 --2- 172.21.15.1:0/1848158323 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dcfb0eb350 0x55dcfb4a0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.912+0000 7f88d659c640 1 -- 172.21.15.1:0/1848158323 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dcfb0ca670 msgr2=0x55dcfb4a6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:45.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.912+0000 7f88d659c640 1 --2- 172.21.15.1:0/1848158323 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dcfb0ca670 0x55dcfb4a6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.912+0000 7f88d659c640 1 -- 172.21.15.1:0/1848158323 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcfb4a13c0 con 0x55dcfb0c2490 2024-09-21T01:01:45.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.912+0000 7f88d5d9b640 1 --2- 172.21.15.1:0/1848158323 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dcfb0ca670 0x55dcfb4a6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:01:45.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.912+0000 7f88d659c640 1 --2- 172.21.15.1:0/1848158323 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dcfb0c2490 0x55dcfb4a5ed0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f88c80126f0 tx=0x7f88c80042b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae2f31ac80121fa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:45.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.912+0000 7f88bdffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:01:45.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.913+0000 7f88bdffb640 1 -- 172.21.15.1:0/1848158323 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c800fb30 con 0x55dcfb0c2490 2024-09-21T01:01:45.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.913+0000 7f88bdffb640 1 -- 172.21.15.1:0/1848158323 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f88c800fcd0 con 0x55dcfb0c2490 2024-09-21T01:01:45.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.913+0000 7f88e2f09740 1 -- 172.21.15.1:0/1848158323 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88cc0cd390 con 0x55dcfb0c2490 2024-09-21T01:01:45.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.913+0000 7f88bdffb640 1 -- 172.21.15.1:0/1848158323 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f88c8038050 con 0x55dcfb0c2490 2024-09-21T01:01:45.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.913+0000 7f88e2f09740 10 client.26441 fetch_fsmap learned FSMap version 33 2024-09-21T01:01:45.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.913+0000 7f88e2f09740 1 -- 172.21.15.1:0/1848158323 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55dcfb51f980 con 0x55dcfb0c2490 2024-09-21T01:01:45.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.913+0000 7f88bdffb640 1 -- 172.21.15.1:0/1848158323 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88cc0cd390 con 0x55dcfb0c2490 2024-09-21T01:01:45.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.913+0000 7f88bdffb640 1 -- 172.21.15.1:0/1848158323 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f88c8003960 con 0x55dcfb0c2490 2024-09-21T01:01:45.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.913+0000 7f88e2f09740 10 client.26441 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:01:45.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.913+0000 7f88e2f09740 10 client.26441 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:01:45.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.913+0000 7f88e2f09740 20 client.26441 populate_metadata read hostname 'smithi001' 2024-09-21T01:01:45.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.913+0000 7f88e2f09740 1 --2- 172.21.15.1:0/1848158323 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55dcfb07f080 0x55dcfb522110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:45.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.913+0000 7f88e2f09740 4 client.26441 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T01:01:45.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.913+0000 7f88e2f09740 1 -- 172.21.15.1:0/1848158323 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55dcfb406860 con 0x55dcfb07f080 2024-09-21T01:01:45.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.914+0000 7f88d5d9b640 1 --2- 172.21.15.1:0/1848158323 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55dcfb07f080 0x55dcfb522110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:45.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.914+0000 7f88d5d9b640 1 --2- 172.21.15.1:0/1848158323 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55dcfb07f080 0x55dcfb522110 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50c98190778dbebc server_cookie=989d93dbc038b9af in_seq=0 out_seq=0 2024-09-21T01:01:45.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.914+0000 7f88bdffb640 10 client.26441 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:01:45.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.915+0000 7f88bdffb640 1 -- 172.21.15.1:0/1848158323 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55dcfb406860 con 0x55dcfb07f080 2024-09-21T01:01:45.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.915+0000 7f88bdffb640 10 client.26441 handle_command_reply: tid=0 2024-09-21T01:01:45.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.915+0000 7f88e2f09740 1 client.26441 shutdown 2024-09-21T01:01:45.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.916+0000 7f88e2f09740 1 -- 172.21.15.1:0/1848158323 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dcfb0c2490 msgr2=0x55dcfb4a5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:45.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.916+0000 7f88e2f09740 1 --2- 172.21.15.1:0/1848158323 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dcfb0c2490 0x55dcfb4a5ed0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f88c80126f0 tx=0x7f88c80042b0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.916+0000 7f88e2f09740 1 -- 172.21.15.1:0/1848158323 shutdown_connections 2024-09-21T01:01:45.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.916+0000 7f88e2f09740 1 --2- 172.21.15.1:0/1848158323 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55dcfb07f080 0x55dcfb522110 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.916+0000 7f88e2f09740 1 --2- 172.21.15.1:0/1848158323 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dcfb0eb350 0x55dcfb4a0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.916+0000 7f88e2f09740 1 --2- 172.21.15.1:0/1848158323 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dcfb0ca670 0x55dcfb4a6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.916+0000 7f88bdffb640 0 client.26441 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:01:45.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.916+0000 7f88e2f09740 1 --2- 172.21.15.1:0/1848158323 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dcfb0c2490 0x55dcfb4a5ed0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.916+0000 7f88e2f09740 1 -- 172.21.15.1:0/1848158323 >> 172.21.15.1:0/1848158323 conn(0x55dcfb0df740 msgr2=0x55dcfb493460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:45.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.916+0000 7f88e2f09740 1 -- 172.21.15.1:0/1848158323 shutdown_connections 2024-09-21T01:01:45.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.916+0000 7f88e2f09740 1 -- 172.21.15.1:0/1848158323 wait complete. 2024-09-21T01:01:45.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.916+0000 7f88e2f09740 20 client.26441 trim_cache size 0 max 16384 2024-09-21T01:01:45.920 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T01:01:45.920 INFO:teuthology.orchestra.run.smithi001.stdout: "return_code": 0, 2024-09-21T01:01:45.920 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_tag": "d9a37a97-ce14-4763-8c19-9bd32df63cf3", 2024-09-21T01:01:45.921 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": "asynchronous" 2024-09-21T01:01:45.921 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T01:01:45.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.917+0000 7f88dc995640 1 -- 172.21.15.1:0/1946803920 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f88c00b6510 msgr2=0x7f88c00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:45.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.917+0000 7f88dc995640 1 --2- 172.21.15.1:0/1946803920 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f88c00b6510 0x7f88c00b8a20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f88d0022000 tx=0x7f88d0023000 comp rx=0 tx=0).stop 2024-09-21T01:01:45.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.917+0000 7f88dc995640 1 -- 172.21.15.1:0/1946803920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88d81083b0 msgr2=0x7f88d819abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:45.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.917+0000 7f88dc995640 1 --2- 172.21.15.1:0/1946803920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88d81083b0 0x7f88d819abf0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f88cc032fd0 tx=0x7f88cc031a20 comp rx=0 tx=0).stop 2024-09-21T01:01:45.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.917+0000 7f88dc995640 1 -- 172.21.15.1:0/1946803920 shutdown_connections 2024-09-21T01:01:45.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.917+0000 7f88dc995640 1 --2- 172.21.15.1:0/1946803920 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f88d8108d00 0x7f88d819fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.917+0000 7f88dc995640 1 --2- 172.21.15.1:0/1946803920 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f88c00b6510 0x7f88c00b8a20 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.917+0000 7f88dc995640 1 --2- 172.21.15.1:0/1946803920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88d81083b0 0x7f88d819abf0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.917+0000 7f88dc995640 1 --2- 172.21.15.1:0/1946803920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88d8102a70 0x7f88d819a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.917+0000 7f88dc995640 1 -- 172.21.15.1:0/1946803920 >> 172.21.15.1:0/1946803920 conn(0x7f88d8079730 msgr2=0x7f88d806c060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:45.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.917+0000 7f88dc995640 1 -- 172.21.15.1:0/1946803920 shutdown_connections 2024-09-21T01:01:45.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:45.917+0000 7f88dc995640 1 -- 172.21.15.1:0/1946803920 wait complete. 2024-09-21T01:01:45.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:45 smithi193 ceph-mon[34660]: pgmap v494: 97 pgs: 97 active+clean; 573 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.8 MiB/s wr, 633 op/s 2024-09-21T01:01:46.805 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:46 smithi001 ceph-mon[31211]: scrub queued for path: / 2024-09-21T01:01:46.806 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:46 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:46.806 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:46 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:01:46.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:46 smithi193 ceph-mon[34660]: scrub queued for path: / 2024-09-21T01:01:46.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:46 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:46.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:46 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:01:46.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:46 smithi042 ceph-mon[34481]: scrub queued for path: / 2024-09-21T01:01:46.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:46 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:46.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:46 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:01:47.181 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:01:47.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:47 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:01:47.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:47 smithi001 ceph-mon[31211]: pgmap v495: 97 pgs: 97 active+clean; 580 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.4 MiB/s wr, 691 op/s 2024-09-21T01:01:47.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:47 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:47.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:47 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:01:47.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:47 smithi193 ceph-mon[34660]: pgmap v495: 97 pgs: 97 active+clean; 580 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.4 MiB/s wr, 691 op/s 2024-09-21T01:01:47.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:47 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:47.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:47 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:01:47.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:47 smithi042 ceph-mon[34481]: pgmap v495: 97 pgs: 97 active+clean; 580 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.4 MiB/s wr, 691 op/s 2024-09-21T01:01:47.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:47 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:48.788 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:01:49.666 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:49 smithi001 ceph-mon[31211]: pgmap v496: 97 pgs: 97 active+clean; 581 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.5 MiB/s wr, 661 op/s 2024-09-21T01:01:49.666 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:49 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:01:49.666 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:49 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:01:49.666 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:49 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:49.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.718+0000 7f480ad6f640 1 -- 172.21.15.1:0/2057577659 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f480411cc30 msgr2=0x7f480411f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:49.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.718+0000 7f480ad6f640 1 --2- 172.21.15.1:0/2057577659 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f480411cc30 0x7f480411f140 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f47f8009900 tx=0x7f47f802a440 comp rx=0 tx=0).stop 2024-09-21T01:01:49.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.719+0000 7f480ad6f640 1 -- 172.21.15.1:0/2057577659 shutdown_connections 2024-09-21T01:01:49.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.719+0000 7f480ad6f640 1 --2- 172.21.15.1:0/2057577659 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f480411cc30 0x7f480411f140 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.719+0000 7f480ad6f640 1 --2- 172.21.15.1:0/2057577659 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f480410a9e0 0x7f480410adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.719+0000 7f480ad6f640 1 --2- 172.21.15.1:0/2057577659 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4804111f40 0x7f480410a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.719+0000 7f480ad6f640 1 -- 172.21.15.1:0/2057577659 >> 172.21.15.1:0/2057577659 conn(0x7f4804070ec0 msgr2=0x7f48040712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:49.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.719+0000 7f480ad6f640 1 -- 172.21.15.1:0/2057577659 shutdown_connections 2024-09-21T01:01:49.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.719+0000 7f480ad6f640 1 -- 172.21.15.1:0/2057577659 wait complete. 2024-09-21T01:01:49.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.720+0000 7f480ad6f640 1 Processor -- start 2024-09-21T01:01:49.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.720+0000 7f480ad6f640 1 -- start start 2024-09-21T01:01:49.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.721+0000 7f480ad6f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f480410a9e0 0x7f48041a93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:49.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.721+0000 7f480ad6f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4804111f40 0x7f48041a9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:49.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.721+0000 7f480ad6f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f480411cc30 0x7f48041aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:49.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.721+0000 7f480ad6f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4804122960 con 0x7f480410a9e0 2024-09-21T01:01:49.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.721+0000 7f480ad6f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f48041227e0 con 0x7f480411cc30 2024-09-21T01:01:49.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.721+0000 7f480ad6f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4804122ae0 con 0x7f4804111f40 2024-09-21T01:01:49.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.721+0000 7f4803fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4804111f40 0x7f48041a9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:49.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.721+0000 7f4803fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4804111f40 0x7f48041a9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:54488/0 (socket says 172.21.15.1:54488) 2024-09-21T01:01:49.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.721+0000 7f4803fff640 1 -- 172.21.15.1:0/3084570956 learned_addr learned my addr 172.21.15.1:0/3084570956 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:49.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.725+0000 7f4808b0b640 1 --2- 172.21.15.1:0/3084570956 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f480410a9e0 0x7f48041a93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:49.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.725+0000 7f480930c640 1 --2- 172.21.15.1:0/3084570956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f480411cc30 0x7f48041aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:49.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.725+0000 7f4808b0b640 1 -- 172.21.15.1:0/3084570956 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4804111f40 msgr2=0x7f48041a9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:49.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.725+0000 7f4808b0b640 1 --2- 172.21.15.1:0/3084570956 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4804111f40 0x7f48041a9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.725+0000 7f4808b0b640 1 -- 172.21.15.1:0/3084570956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f480411cc30 msgr2=0x7f48041aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:49.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.725+0000 7f4808b0b640 1 --2- 172.21.15.1:0/3084570956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f480411cc30 0x7f48041aebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.726+0000 7f4808b0b640 1 -- 172.21.15.1:0/3084570956 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48041af320 con 0x7f480410a9e0 2024-09-21T01:01:49.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.726+0000 7f4808b0b640 1 --2- 172.21.15.1:0/3084570956 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f480410a9e0 0x7f48041a93b0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f47f400e9f0 tx=0x7f47f400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:49.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.727+0000 7f4801ffb640 1 -- 172.21.15.1:0/3084570956 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f400ccc0 con 0x7f480410a9e0 2024-09-21T01:01:49.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.727+0000 7f4801ffb640 1 -- 172.21.15.1:0/3084570956 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47f40108e0 con 0x7f480410a9e0 2024-09-21T01:01:49.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.727+0000 7f4801ffb640 1 -- 172.21.15.1:0/3084570956 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f40188e0 con 0x7f480410a9e0 2024-09-21T01:01:49.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.727+0000 7f480ad6f640 1 -- 172.21.15.1:0/3084570956 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48041af610 con 0x7f480410a9e0 2024-09-21T01:01:49.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.727+0000 7f480ad6f640 1 -- 172.21.15.1:0/3084570956 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48041b5d70 con 0x7f480410a9e0 2024-09-21T01:01:49.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.738+0000 7f48112e3740 1 Processor -- start 2024-09-21T01:01:49.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.744+0000 7f48112e3740 1 -- start start 2024-09-21T01:01:49.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.744+0000 7f4801ffb640 1 -- 172.21.15.1:0/3084570956 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f47f4018a80 con 0x7f480410a9e0 2024-09-21T01:01:49.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.750+0000 7f4801ffb640 1 --2- 172.21.15.1:0/3084570956 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f47ec0b6710 0x7f47ec0b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:49.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.750+0000 7f4801ffb640 1 -- 172.21.15.1:0/3084570956 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f47f40e8620 con 0x7f480410a9e0 2024-09-21T01:01:49.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.756+0000 7f480930c640 1 --2- 172.21.15.1:0/3084570956 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f47ec0b6710 0x7f47ec0b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:49.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.760+0000 7f48112e3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f0b36a070 0x558f0b714350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:49.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.761+0000 7f48112e3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f0b3411b0 0x558f0b711960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:49.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.761+0000 7f48112e3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f0b349390 0x558f0b711f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:49.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.761+0000 7f48112e3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558f0b687e50 con 0x558f0b36a070 2024-09-21T01:01:49.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.761+0000 7f48112e3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558f0b677280 con 0x558f0b349390 2024-09-21T01:01:49.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.761+0000 7f48112e3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558f0b67b090 con 0x558f0b3411b0 2024-09-21T01:01:49.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.762+0000 7f480930c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f0b349390 0x558f0b711f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:49.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.763+0000 7f480930c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f0b349390 0x558f0b711f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:54800/0 (socket says 172.21.15.1:54800) 2024-09-21T01:01:49.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.763+0000 7f480930c640 1 -- 172.21.15.1:0/693307615 learned_addr learned my addr 172.21.15.1:0/693307615 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:49.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.770+0000 7f480930c640 1 -- 172.21.15.1:0/693307615 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f0b3411b0 msgr2=0x558f0b711960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:01:49.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.770+0000 7f480930c640 1 --2- 172.21.15.1:0/693307615 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f0b3411b0 0x558f0b711960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.770+0000 7f480930c640 1 -- 172.21.15.1:0/693307615 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f0b36a070 msgr2=0x558f0b714350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:49.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.770+0000 7f4808b0b640 1 --2- 172.21.15.1:0/693307615 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f0b36a070 0x558f0b714350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:49.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.770+0000 7f480930c640 1 --2- 172.21.15.1:0/693307615 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f0b36a070 0x558f0b714350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.771+0000 7f480930c640 1 -- 172.21.15.1:0/693307615 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f0b3d5650 con 0x558f0b349390 2024-09-21T01:01:49.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.771+0000 7f480930c640 1 --2- 172.21.15.1:0/3084570956 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f47ec0b6710 0x7f47ec0b8c20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f47f802aa30 tx=0x7f47f80049d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:49.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.771+0000 7f4808b0b640 1 --2- 172.21.15.1:0/693307615 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f0b36a070 0x558f0b714350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:01:49.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.771+0000 7f480930c640 1 --2- 172.21.15.1:0/693307615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f0b349390 0x558f0b711f00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f47f8009900 tx=0x7f47f8049000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f002abde3ebc107f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:49.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.773+0000 7f47ea7fc640 1 -- 172.21.15.1:0/693307615 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f8042ac0 con 0x558f0b349390 2024-09-21T01:01:49.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.773+0000 7f47ea7fc640 1 -- 172.21.15.1:0/693307615 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47f8042c60 con 0x558f0b349390 2024-09-21T01:01:49.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.778+0000 7f48112e3740 1 -- 172.21.15.1:0/693307615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f0b349390 msgr2=0x558f0b711f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:49.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.778+0000 7f48112e3740 1 --2- 172.21.15.1:0/693307615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f0b349390 0x558f0b711f00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f47f8009900 tx=0x7f47f8049000 comp rx=0 tx=0).stop 2024-09-21T01:01:49.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.783+0000 7f48112e3740 1 -- 172.21.15.1:0/693307615 shutdown_connections 2024-09-21T01:01:49.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.783+0000 7f48112e3740 1 --2- 172.21.15.1:0/693307615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f0b349390 0x558f0b711f00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.783+0000 7f48112e3740 1 --2- 172.21.15.1:0/693307615 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f0b3411b0 0x558f0b711960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.783+0000 7f48112e3740 1 --2- 172.21.15.1:0/693307615 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f0b36a070 0x558f0b714350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.783+0000 7f48112e3740 1 -- 172.21.15.1:0/693307615 >> 172.21.15.1:0/693307615 conn(0x558f0b35e460 msgr2=0x558f0b70f850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:49.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.788+0000 7f48112e3740 1 -- 172.21.15.1:0/693307615 shutdown_connections 2024-09-21T01:01:49.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.788+0000 7f48112e3740 1 -- 172.21.15.1:0/693307615 wait complete. 2024-09-21T01:01:49.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.788+0000 7f48112e3740 1 -- start start 2024-09-21T01:01:49.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.789+0000 7f48112e3740 1 Processor -- start 2024-09-21T01:01:49.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.789+0000 7f48112e3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f0b3411b0 0x558f0b71cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:49.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.789+0000 7f48112e3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f0b349390 0x558f0b71d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:49.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.789+0000 7f48112e3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f0b36a070 0x558f0b71da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:49.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.789+0000 7f48112e3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558f0b4d8700 con 0x558f0b349390 2024-09-21T01:01:49.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.789+0000 7f48112e3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558f0b612110 con 0x558f0b3411b0 2024-09-21T01:01:49.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.789+0000 7f48112e3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558f0b71fda0 con 0x558f0b36a070 2024-09-21T01:01:49.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.789+0000 7f48112e3740 10 client.0 _ll_register_callbacks cb 0x558f0b62b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:01:49.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.790+0000 7f480930c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f0b36a070 0x558f0b71da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:49.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.790+0000 7f480930c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f0b36a070 0x558f0b71da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:54500/0 (socket says 172.21.15.1:54500) 2024-09-21T01:01:49.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.790+0000 7f480930c640 1 -- 172.21.15.1:0/521525348 learned_addr learned my addr 172.21.15.1:0/521525348 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:49.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.790+0000 7f4808b0b640 1 --2- 172.21.15.1:0/521525348 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f0b3411b0 0x558f0b71cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:49.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.796+0000 7f480930c640 1 -- 172.21.15.1:0/521525348 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f0b3411b0 msgr2=0x558f0b71cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:49.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.796+0000 7f480930c640 1 --2- 172.21.15.1:0/521525348 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f0b3411b0 0x558f0b71cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.796+0000 7f480930c640 1 -- 172.21.15.1:0/521525348 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f0b349390 msgr2=0x558f0b71d4c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:01:49.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.796+0000 7f4803fff640 1 --2- 172.21.15.1:0/521525348 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f0b349390 0x558f0b71d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:49.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.797+0000 7f480930c640 1 --2- 172.21.15.1:0/521525348 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f0b349390 0x558f0b71d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.797+0000 7f480930c640 1 -- 172.21.15.1:0/521525348 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f0b63fc40 con 0x558f0b36a070 2024-09-21T01:01:49.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.798+0000 7f480930c640 1 --2- 172.21.15.1:0/521525348 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f0b36a070 0x558f0b71da20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f47f80096c0 tx=0x7f47f8005850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a65874acd948b72e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:49.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.798+0000 7f47e3fff640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T01:01:49.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.800+0000 7f47e3fff640 1 -- 172.21.15.1:0/521525348 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f8040ae0 con 0x558f0b36a070 2024-09-21T01:01:49.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.800+0000 7f48112e3740 1 -- 172.21.15.1:0/521525348 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47f8042c60 con 0x558f0b36a070 2024-09-21T01:01:49.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.800+0000 7f47e3fff640 1 -- 172.21.15.1:0/521525348 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f47f8040c80 con 0x558f0b36a070 2024-09-21T01:01:49.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.801+0000 7f47e3fff640 1 -- 172.21.15.1:0/521525348 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f47f803d920 con 0x558f0b36a070 2024-09-21T01:01:49.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.801+0000 7f48112e3740 10 client.26326 fetch_fsmap learned FSMap version 33 2024-09-21T01:01:49.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.801+0000 7f48112e3740 1 -- 172.21.15.1:0/521525348 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558f0b72bab0 con 0x558f0b36a070 2024-09-21T01:01:49.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.801+0000 7f47e3fff640 1 -- 172.21.15.1:0/521525348 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47f8042c60 con 0x558f0b36a070 2024-09-21T01:01:49.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.801+0000 7f47e3fff640 1 -- 172.21.15.1:0/521525348 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f47f8031440 con 0x558f0b36a070 2024-09-21T01:01:49.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.803+0000 7f48112e3740 10 client.26326 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:01:49.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.803+0000 7f48112e3740 10 client.26326 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:01:49.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.803+0000 7f48112e3740 20 client.26326 populate_metadata read hostname 'smithi001' 2024-09-21T01:01:49.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.803+0000 7f48112e3740 1 --2- 172.21.15.1:0/521525348 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558f0b3289f0 0x558f0b72ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:49.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.803+0000 7f48112e3740 4 client.26326 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:01:49.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.803+0000 7f48112e3740 1 -- 172.21.15.1:0/521525348 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f0b689da0 con 0x558f0b3289f0 2024-09-21T01:01:49.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.804+0000 7f4808b0b640 1 --2- 172.21.15.1:0/521525348 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558f0b3289f0 0x558f0b72ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:49.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.808+0000 7f4808b0b640 1 --2- 172.21.15.1:0/521525348 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558f0b3289f0 0x558f0b72ef60 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a0e28f88710c6c6 server_cookie=350230ba71923f15 in_seq=0 out_seq=0 2024-09-21T01:01:49.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.808+0000 7f47e3fff640 10 client.26326 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:01:49.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.809+0000 7f47e3fff640 1 -- 172.21.15.1:0/521525348 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558f0b689da0 con 0x558f0b3289f0 2024-09-21T01:01:49.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.809+0000 7f47e3fff640 10 client.26326 handle_command_reply: tid=0 2024-09-21T01:01:49.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.809+0000 7f48112e3740 1 client.26326 shutdown 2024-09-21T01:01:49.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.810+0000 7f48112e3740 1 -- 172.21.15.1:0/521525348 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f0b36a070 msgr2=0x558f0b71da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:49.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.810+0000 7f48112e3740 1 --2- 172.21.15.1:0/521525348 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f0b36a070 0x558f0b71da20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f47f80096c0 tx=0x7f47f8005850 comp rx=0 tx=0).stop 2024-09-21T01:01:49.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.813+0000 7f48112e3740 1 -- 172.21.15.1:0/521525348 shutdown_connections 2024-09-21T01:01:49.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.813+0000 7f48112e3740 1 --2- 172.21.15.1:0/521525348 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558f0b3289f0 0x558f0b72ef60 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.813+0000 7f48112e3740 1 --2- 172.21.15.1:0/521525348 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f0b36a070 0x558f0b71da20 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.813+0000 7f48112e3740 1 --2- 172.21.15.1:0/521525348 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f0b349390 0x558f0b71d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.813+0000 7f48112e3740 1 --2- 172.21.15.1:0/521525348 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f0b3411b0 0x558f0b71cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.813+0000 7f48112e3740 1 -- 172.21.15.1:0/521525348 >> 172.21.15.1:0/521525348 conn(0x558f0b35e460 msgr2=0x558f0b713350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:49.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.813+0000 7f47e3fff640 0 client.26326 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:01:49.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.813+0000 7f48112e3740 1 -- 172.21.15.1:0/521525348 shutdown_connections 2024-09-21T01:01:49.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.813+0000 7f48112e3740 1 -- 172.21.15.1:0/521525348 wait complete. 2024-09-21T01:01:49.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.813+0000 7f48112e3740 20 client.26326 trim_cache size 0 max 16384 2024-09-21T01:01:49.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.853+0000 7f48112e3740 1 Processor -- start 2024-09-21T01:01:49.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.854+0000 7f48112e3740 1 -- start start 2024-09-21T01:01:49.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.854+0000 7f48112e3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f0b3411b0 0x558f0b70eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:49.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.854+0000 7f48112e3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f0b349390 0x558f0b71b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:49.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.854+0000 7f4808b0b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f0b3411b0 0x558f0b70eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:49.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.854+0000 7f4808b0b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f0b3411b0 0x558f0b70eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:54502/0 (socket says 172.21.15.1:54502) 2024-09-21T01:01:49.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.855+0000 7f4808b0b640 1 -- 172.21.15.1:0/2211784294 learned_addr learned my addr 172.21.15.1:0/2211784294 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:49.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.855+0000 7f4803fff640 1 --2- 172.21.15.1:0/2211784294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f0b349390 0x558f0b71b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:49.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.855+0000 7f48112e3740 1 --2- 172.21.15.1:0/2211784294 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f0b36a070 0x558f0b71bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:49.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.855+0000 7f48112e3740 1 -- 172.21.15.1:0/2211784294 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f47f000e630 con 0x558f0b36a070 2024-09-21T01:01:49.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.855+0000 7f48112e3740 1 -- 172.21.15.1:0/2211784294 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f47f0010230 con 0x558f0b349390 2024-09-21T01:01:49.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.855+0000 7f48112e3740 1 -- 172.21.15.1:0/2211784294 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f47f000ed00 con 0x558f0b3411b0 2024-09-21T01:01:49.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.856+0000 7f4808b0b640 1 -- 172.21.15.1:0/2211784294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f0b349390 msgr2=0x558f0b71b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:49.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.856+0000 7f4808b0b640 1 --2- 172.21.15.1:0/2211784294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f0b349390 0x558f0b71b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.856+0000 7f4808b0b640 1 -- 172.21.15.1:0/2211784294 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f0b36a070 msgr2=0x558f0b71bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:49.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.856+0000 7f4808b0b640 1 --2- 172.21.15.1:0/2211784294 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f0b36a070 0x558f0b71bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.856+0000 7f4808b0b640 1 -- 172.21.15.1:0/2211784294 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f0b717c20 con 0x558f0b3411b0 2024-09-21T01:01:49.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.857+0000 7f4808b0b640 1 --2- 172.21.15.1:0/2211784294 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f0b3411b0 0x558f0b70eb70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f47f40aa740 tx=0x7f47f40ae1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae9164525c5ff79a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:49.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.861+0000 7f480ad6f640 1 -- 172.21.15.1:0/2211784294 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f40b3210 con 0x558f0b3411b0 2024-09-21T01:01:49.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.861+0000 7f480ad6f640 1 -- 172.21.15.1:0/2211784294 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47f40b8150 con 0x558f0b3411b0 2024-09-21T01:01:49.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.861+0000 7f480ad6f640 1 -- 172.21.15.1:0/2211784294 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f40e8310 con 0x558f0b3411b0 2024-09-21T01:01:49.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.865+0000 7f48112e3740 1 -- 172.21.15.1:0/2211784294 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f0b3411b0 msgr2=0x558f0b70eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:49.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.865+0000 7f48112e3740 1 --2- 172.21.15.1:0/2211784294 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f0b3411b0 0x558f0b70eb70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f47f40aa740 tx=0x7f47f40ae1a0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.865+0000 7f48112e3740 1 -- 172.21.15.1:0/2211784294 shutdown_connections 2024-09-21T01:01:49.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.865+0000 7f48112e3740 1 --2- 172.21.15.1:0/2211784294 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f0b36a070 0x558f0b71bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.866+0000 7f48112e3740 1 --2- 172.21.15.1:0/2211784294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f0b349390 0x558f0b71b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.866+0000 7f48112e3740 1 --2- 172.21.15.1:0/2211784294 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f0b3411b0 0x558f0b70eb70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.866+0000 7f48112e3740 1 -- 172.21.15.1:0/2211784294 >> 172.21.15.1:0/2211784294 conn(0x558f0b35e460 msgr2=0x558f0b70a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:49.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.867+0000 7f48112e3740 1 -- 172.21.15.1:0/2211784294 shutdown_connections 2024-09-21T01:01:49.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.867+0000 7f48112e3740 1 -- 172.21.15.1:0/2211784294 wait complete. 2024-09-21T01:01:49.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.867+0000 7f48112e3740 1 -- start start 2024-09-21T01:01:49.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.868+0000 7f48112e3740 1 Processor -- start 2024-09-21T01:01:49.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.869+0000 7f48112e3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f0b3411b0 0x558f0b7255d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:49.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.869+0000 7f48112e3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f0b349390 0x558f0b70db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:49.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.869+0000 7f4808b0b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f0b3411b0 0x558f0b7255d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:49.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.869+0000 7f4808b0b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f0b3411b0 0x558f0b7255d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:54506/0 (socket says 172.21.15.1:54506) 2024-09-21T01:01:49.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.869+0000 7f4808b0b640 1 -- 172.21.15.1:0/2588932150 learned_addr learned my addr 172.21.15.1:0/2588932150 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:49.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.869+0000 7f48112e3740 1 --2- 172.21.15.1:0/2588932150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f0b36a070 0x558f0b70e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:49.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.870+0000 7f48112e3740 1 -- 172.21.15.1:0/2588932150 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f47f000fb60 con 0x558f0b349390 2024-09-21T01:01:49.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.870+0000 7f480930c640 1 --2- 172.21.15.1:0/2588932150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f0b36a070 0x558f0b70e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:49.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.870+0000 7f48112e3740 1 -- 172.21.15.1:0/2588932150 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f47f000f490 con 0x558f0b36a070 2024-09-21T01:01:49.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.870+0000 7f48112e3740 1 -- 172.21.15.1:0/2588932150 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f47f000c610 con 0x558f0b3411b0 2024-09-21T01:01:49.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.871+0000 7f4808b0b640 1 -- 172.21.15.1:0/2588932150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f0b36a070 msgr2=0x558f0b70e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:49.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.871+0000 7f4808b0b640 1 --2- 172.21.15.1:0/2588932150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f0b36a070 0x558f0b70e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.871+0000 7f4808b0b640 1 -- 172.21.15.1:0/2588932150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f0b349390 msgr2=0x558f0b70db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:49.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.871+0000 7f4808b0b640 1 --2- 172.21.15.1:0/2588932150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f0b349390 0x558f0b70db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.871+0000 7f4808b0b640 1 -- 172.21.15.1:0/2588932150 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f0b70e5e0 con 0x558f0b3411b0 2024-09-21T01:01:49.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.871+0000 7f4808b0b640 1 --2- 172.21.15.1:0/2588932150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f0b3411b0 0x558f0b7255d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f47f40aad00 tx=0x7f47f40aabd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a74833b34d564385 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:49.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.872+0000 7f48112e3740 10 client.0 _ll_register_callbacks cb 0x7f47f8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:01:49.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.872+0000 7f48112e3740 1 -- 172.21.15.1:0/2588932150 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47f40b8150 con 0x558f0b3411b0 2024-09-21T01:01:49.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.872+0000 7f47e3fff640 10 client.26332 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T01:01:49.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.872+0000 7f47e3fff640 1 -- 172.21.15.1:0/2588932150 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f40b3210 con 0x558f0b3411b0 2024-09-21T01:01:49.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.872+0000 7f47e3fff640 1 -- 172.21.15.1:0/2588932150 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f47f40ad990 con 0x558f0b3411b0 2024-09-21T01:01:49.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.873+0000 7f47e3fff640 1 -- 172.21.15.1:0/2588932150 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f47f40adb90 con 0x558f0b3411b0 2024-09-21T01:01:49.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.874+0000 7f48112e3740 10 client.26332 fetch_fsmap learned FSMap version 33 2024-09-21T01:01:49.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.874+0000 7f48112e3740 1 -- 172.21.15.1:0/2588932150 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({fsmap=33}) -- 0x558f0b723c80 con 0x558f0b3411b0 2024-09-21T01:01:49.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.878+0000 7f47e3fff640 1 -- 172.21.15.1:0/2588932150 <== mon.1 v2:172.21.15.193:3300/0 4 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f47f40e80d0 con 0x558f0b3411b0 2024-09-21T01:01:49.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.878+0000 7f48112e3740 10 client.26332 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:01:49.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.878+0000 7f48112e3740 10 client.26332 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:01:49.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.878+0000 7f48112e3740 20 client.26332 populate_metadata read hostname 'smithi001' 2024-09-21T01:01:49.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.878+0000 7f48112e3740 1 --2- 172.21.15.1:0/2588932150 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558f0b2fdda0 0x558f0b79bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:49.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.878+0000 7f48112e3740 4 client.26332 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:01:49.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.878+0000 7f48112e3740 1 -- 172.21.15.1:0/2588932150 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f47f40b8150 con 0x558f0b2fdda0 2024-09-21T01:01:49.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.878+0000 7f4803fff640 1 --2- 172.21.15.1:0/2588932150 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558f0b2fdda0 0x558f0b79bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:49.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.889+0000 7f4803fff640 1 --2- 172.21.15.1:0/2588932150 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558f0b2fdda0 0x558f0b79bb10 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7163f056eae1bab4 server_cookie=b5af7e2d524e8935 in_seq=0 out_seq=0 2024-09-21T01:01:49.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.889+0000 7f47e3fff640 10 client.26332 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:01:49.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.889+0000 7f47e3fff640 1 -- 172.21.15.1:0/2588932150 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2566 (crc 0 0 0) 0x7f47f40b8150 con 0x558f0b2fdda0 2024-09-21T01:01:49.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.889+0000 7f47e3fff640 10 client.26332 handle_command_reply: tid=0 2024-09-21T01:01:49.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.889+0000 7f48112e3740 1 client.26332 shutdown 2024-09-21T01:01:49.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.890+0000 7f48112e3740 1 -- 172.21.15.1:0/2588932150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f0b3411b0 msgr2=0x558f0b7255d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:49.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.890+0000 7f48112e3740 1 --2- 172.21.15.1:0/2588932150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f0b3411b0 0x558f0b7255d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f47f40aad00 tx=0x7f47f40aabd0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.890+0000 7f48112e3740 1 -- 172.21.15.1:0/2588932150 shutdown_connections 2024-09-21T01:01:49.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.890+0000 7f48112e3740 1 --2- 172.21.15.1:0/2588932150 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558f0b2fdda0 0x558f0b79bb10 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.890+0000 7f48112e3740 1 --2- 172.21.15.1:0/2588932150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f0b36a070 0x558f0b70e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.890+0000 7f48112e3740 1 --2- 172.21.15.1:0/2588932150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f0b349390 0x558f0b70db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.890+0000 7f48112e3740 1 --2- 172.21.15.1:0/2588932150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f0b3411b0 0x558f0b7255d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.890+0000 7f48112e3740 1 -- 172.21.15.1:0/2588932150 >> 172.21.15.1:0/2588932150 conn(0x558f0b35e460 msgr2=0x558f0b71b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:49.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.893+0000 7f47e3fff640 0 client.26332 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:01:49.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.893+0000 7f48112e3740 1 -- 172.21.15.1:0/2588932150 shutdown_connections 2024-09-21T01:01:49.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.893+0000 7f48112e3740 1 -- 172.21.15.1:0/2588932150 wait complete. 2024-09-21T01:01:49.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.894+0000 7f48112e3740 20 client.26332 trim_cache size 0 max 16384 2024-09-21T01:01:49.899 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T01:01:49.899 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "scrub active (105 inodes in the stack)", 2024-09-21T01:01:49.899 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": { 2024-09-21T01:01:49.899 INFO:teuthology.orchestra.run.smithi001.stdout: "d9a37a97-ce14-4763-8c19-9bd32df63cf3": { 2024-09-21T01:01:49.899 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:01:49.899 INFO:teuthology.orchestra.run.smithi001.stdout: "tag": "d9a37a97-ce14-4763-8c19-9bd32df63cf3", 2024-09-21T01:01:49.899 INFO:teuthology.orchestra.run.smithi001.stdout: "options": "recursive,force" 2024-09-21T01:01:49.899 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:01:49.899 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:01:49.899 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_stats": { 2024-09-21T01:01:49.899 INFO:teuthology.orchestra.run.smithi001.stdout: "c2addc95-c922-4a70-b746-0b5fd2af59bf": { 2024-09-21T01:01:49.899 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:00:52.374848+0000", 2024-09-21T01:01:49.899 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:01:49.900 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:01:49.900 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:01:49.900 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:01:49.900 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:01:49.900 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:01:49.900 INFO:teuthology.orchestra.run.smithi001.stdout: "d9a37a97-ce14-4763-8c19-9bd32df63cf3": { 2024-09-21T01:01:49.900 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:01:45.914443+0000", 2024-09-21T01:01:49.900 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:01:49.900 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:01:49.900 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:01:49.900 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:01:49.900 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:01:49.900 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:01:49.900 INFO:teuthology.orchestra.run.smithi001.stdout: "f826f2c1-768a-47bb-b868-785b351ac6b4": { 2024-09-21T01:01:49.900 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:59:06.554657+0000", 2024-09-21T01:01:49.901 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:01:49.901 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:01:49.901 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:01:49.901 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:01:49.901 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:01:49.901 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:01:49.901 INFO:teuthology.orchestra.run.smithi001.stdout: "1bffed0d-34b1-4e8b-9cab-7501131ef79d": { 2024-09-21T01:01:49.901 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:00:02.564228+0000", 2024-09-21T01:01:49.901 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:01:49.901 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:01:49.901 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:01:49.901 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:01:49.901 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:01:49.901 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:01:49.902 INFO:teuthology.orchestra.run.smithi001.stdout: "bee49cce-b407-4617-a959-331ffd8dc5b0": { 2024-09-21T01:01:49.902 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:58:17.883027+0000", 2024-09-21T01:01:49.902 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:01:49.902 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:01:49.902 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:01:49.902 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:01:49.902 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:01:49.902 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:01:49.902 INFO:teuthology.orchestra.run.smithi001.stdout: "7cb1bc3f-e2d2-4bf7-b13e-8f3371d7aac1": { 2024-09-21T01:01:49.902 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:58:02.751142+0000", 2024-09-21T01:01:49.902 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:01:49.902 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:01:49.902 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:01:49.902 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:01:49.903 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:01:49.903 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:01:49.903 INFO:teuthology.orchestra.run.smithi001.stdout: "2383a19c-993d-4440-99f7-93b43dcf33b4": { 2024-09-21T01:01:49.903 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:47.609257+0000", 2024-09-21T01:01:49.903 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:01:49.903 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:01:49.903 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:01:49.903 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:01:49.904 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:01:49.904 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:01:49.904 INFO:teuthology.orchestra.run.smithi001.stdout: "53fa74e4-5aa8-408b-9724-7c93618f7636": { 2024-09-21T01:01:49.904 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:01.730608+0000", 2024-09-21T01:01:49.904 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:01:49.904 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:01:49.904 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:01:49.904 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:01:49.904 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:01:49.904 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:01:49.904 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:01:49.904 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T01:01:49.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.900+0000 7f47eb7fe640 1 -- 172.21.15.1:0/3084570956 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f47ec0b6710 msgr2=0x7f47ec0b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:49.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.900+0000 7f47eb7fe640 1 --2- 172.21.15.1:0/3084570956 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f47ec0b6710 0x7f47ec0b8c20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f47f802aa30 tx=0x7f47f80049d0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.900+0000 7f47eb7fe640 1 -- 172.21.15.1:0/3084570956 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f480410a9e0 msgr2=0x7f48041a93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:49.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.900+0000 7f47eb7fe640 1 --2- 172.21.15.1:0/3084570956 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f480410a9e0 0x7f48041a93b0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f47f400e9f0 tx=0x7f47f400eeb0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.900+0000 7f47eb7fe640 1 -- 172.21.15.1:0/3084570956 shutdown_connections 2024-09-21T01:01:49.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.900+0000 7f47eb7fe640 1 --2- 172.21.15.1:0/3084570956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f480411cc30 0x7f48041aebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.900+0000 7f47eb7fe640 1 --2- 172.21.15.1:0/3084570956 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4804111f40 0x7f48041a9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.900+0000 7f47eb7fe640 1 --2- 172.21.15.1:0/3084570956 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f47ec0b6710 0x7f47ec0b8c20 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.900+0000 7f47eb7fe640 1 --2- 172.21.15.1:0/3084570956 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f480410a9e0 0x7f48041a93b0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.900+0000 7f47eb7fe640 1 -- 172.21.15.1:0/3084570956 >> 172.21.15.1:0/3084570956 conn(0x7f4804070ec0 msgr2=0x7f4804071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:49.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.901+0000 7f47eb7fe640 1 -- 172.21.15.1:0/3084570956 shutdown_connections 2024-09-21T01:01:49.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:01:49.901+0000 7f47eb7fe640 1 -- 172.21.15.1:0/3084570956 wait complete. 2024-09-21T01:01:49.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:49 smithi193 ceph-mon[34660]: pgmap v496: 97 pgs: 97 active+clean; 581 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.5 MiB/s wr, 661 op/s 2024-09-21T01:01:49.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:49 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:01:49.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:49 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:01:49.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:49 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:49.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:49 smithi042 ceph-mon[34481]: pgmap v496: 97 pgs: 97 active+clean; 581 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.5 MiB/s wr, 661 op/s 2024-09-21T01:01:49.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:49 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:01:49.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:49 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:01:49.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:49 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:50.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:50 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:50.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:50 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:01:50.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:50 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:50.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:50 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:01:50.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:50 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:50.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:50 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:01:51.404 INFO:tasks.cephfs.filesystem:scrub status for tag:d9a37a97-ce14-4763-8c19-9bd32df63cf3 - {'path': '/', 'tag': 'd9a37a97-ce14-4763-8c19-9bd32df63cf3', 'options': 'recursive,force'} 2024-09-21T01:01:51.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:51 smithi001 ceph-mon[31211]: pgmap v497: 97 pgs: 97 active+clean; 579 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 6.0 MiB/s wr, 674 op/s 2024-09-21T01:01:51.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:51 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:51.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:51 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:01:51.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:51 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:51.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:51 smithi193 ceph-mon[34660]: pgmap v497: 97 pgs: 97 active+clean; 579 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 6.0 MiB/s wr, 674 op/s 2024-09-21T01:01:51.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:51 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:51.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:51 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:01:51.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:51 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:51.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:51 smithi042 ceph-mon[34481]: pgmap v497: 97 pgs: 97 active+clean; 579 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 6.0 MiB/s wr, 674 op/s 2024-09-21T01:01:51.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:51 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:51.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:51 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:01:51.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:51 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:52.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:52 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:01:52.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:52 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:52.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:52 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:01:52.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:52 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:52.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:52 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:01:52.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:52 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:53.560 INFO:tasks.workunit.client.0.smithi001.stdout: 113 1430458 411 921252 431 804784 1308 2024-09-21T01:01:53.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:53 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:01:53.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:53 smithi001 ceph-mon[31211]: pgmap v498: 97 pgs: 97 active+clean; 583 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.0 MiB/s wr, 690 op/s 2024-09-21T01:01:53.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:53 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:53.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:53 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:01:53.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:53 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:01:53.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:53 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:53.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:53 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:01:53.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:53 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:01:53.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:53 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:01:53.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:53 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:53.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:53 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:53.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:53 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:01:53.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:53 smithi193 ceph-mon[34660]: pgmap v498: 97 pgs: 97 active+clean; 583 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.0 MiB/s wr, 690 op/s 2024-09-21T01:01:53.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:53 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:53.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:53 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:01:53.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:53 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:01:53.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:53 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:53.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:53 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:01:53.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:53 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:01:53.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:53 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:01:53.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:53 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:53.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:53 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:53.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:53 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:01:53.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:53 smithi042 ceph-mon[34481]: pgmap v498: 97 pgs: 97 active+clean; 583 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.0 MiB/s wr, 690 op/s 2024-09-21T01:01:53.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:53 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:53.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:53 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:01:53.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:53 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:01:53.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:53 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:53.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:53 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:01:53.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:53 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:01:53.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:53 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:01:53.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:53 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:53.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:53 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:54.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:54 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:54.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:54 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:01:54.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:54 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:54.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:54 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:54.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:54 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:54.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:54 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:01:54.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:54 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:54.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:54 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:54.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:54 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:54.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:54 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:01:54.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:54 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:54.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:54 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:55.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:55 smithi001 ceph-mon[31211]: pgmap v499: 97 pgs: 97 active+clean; 585 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.8 MiB/s wr, 619 op/s 2024-09-21T01:01:55.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:55 smithi193 ceph-mon[34660]: pgmap v499: 97 pgs: 97 active+clean; 585 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.8 MiB/s wr, 619 op/s 2024-09-21T01:01:55.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:55 smithi042 ceph-mon[34481]: pgmap v499: 97 pgs: 97 active+clean; 585 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.8 MiB/s wr, 619 op/s 2024-09-21T01:01:56.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.326+0000 7f259538e640 1 -- 172.21.15.1:0/1958708128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25901036e0 msgr2=0x7f2590103b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:56.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.326+0000 7f259538e640 1 --2- 172.21.15.1:0/1958708128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25901036e0 0x7f2590103b50 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f2580009900 tx=0x7f258002a410 comp rx=0 tx=0).stop 2024-09-21T01:01:56.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.326+0000 7f259538e640 1 -- 172.21.15.1:0/1958708128 shutdown_connections 2024-09-21T01:01:56.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.326+0000 7f259538e640 1 --2- 172.21.15.1:0/1958708128 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2590105100 0x7f259010baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:56.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.326+0000 7f259538e640 1 --2- 172.21.15.1:0/1958708128 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2590104760 0x7f2590104b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:56.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.326+0000 7f259538e640 1 --2- 172.21.15.1:0/1958708128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25901036e0 0x7f2590103b50 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:56.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.326+0000 7f259538e640 1 -- 172.21.15.1:0/1958708128 >> 172.21.15.1:0/1958708128 conn(0x7f25900ff020 msgr2=0x7f25901014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:56.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.326+0000 7f259538e640 1 -- 172.21.15.1:0/1958708128 shutdown_connections 2024-09-21T01:01:56.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.326+0000 7f259538e640 1 -- 172.21.15.1:0/1958708128 wait complete. 2024-09-21T01:01:56.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.326+0000 7f259538e640 1 Processor -- start 2024-09-21T01:01:56.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.327+0000 7f259538e640 1 -- start start 2024-09-21T01:01:56.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.327+0000 7f259538e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25901036e0 0x7f2590199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:56.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.327+0000 7f259538e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2590104760 0x7f259019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:56.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.327+0000 7f259538e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2590105100 0x7f259019b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:56.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.327+0000 7f259538e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f259010f320 con 0x7f25901036e0 2024-09-21T01:01:56.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.327+0000 7f259538e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f259010f1a0 con 0x7f2590105100 2024-09-21T01:01:56.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.327+0000 7f259538e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f259010f4a0 con 0x7f2590104760 2024-09-21T01:01:56.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.327+0000 7f258effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25901036e0 0x7f2590199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:56.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.327+0000 7f258effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25901036e0 0x7f2590199f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37324/0 (socket says 172.21.15.1:37324) 2024-09-21T01:01:56.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.327+0000 7f258effd640 1 -- 172.21.15.1:0/1786302337 learned_addr learned my addr 172.21.15.1:0/1786302337 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:56.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.327+0000 7f258f7fe640 1 --2- 172.21.15.1:0/1786302337 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2590105100 0x7f259019b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:56.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.327+0000 7f258e7fc640 1 --2- 172.21.15.1:0/1786302337 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2590104760 0x7f259019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:56.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.327+0000 7f258effd640 1 -- 172.21.15.1:0/1786302337 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2590104760 msgr2=0x7f259019a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:56.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.327+0000 7f258effd640 1 --2- 172.21.15.1:0/1786302337 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2590104760 0x7f259019a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:56.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.327+0000 7f258effd640 1 -- 172.21.15.1:0/1786302337 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2590105100 msgr2=0x7f259019b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:56.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.327+0000 7f258effd640 1 --2- 172.21.15.1:0/1786302337 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2590105100 0x7f259019b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:56.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.327+0000 7f258effd640 1 -- 172.21.15.1:0/1786302337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f259019b9b0 con 0x7f25901036e0 2024-09-21T01:01:56.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.327+0000 7f258f7fe640 1 --2- 172.21.15.1:0/1786302337 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2590105100 0x7f259019b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:01:56.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.328+0000 7f258effd640 1 --2- 172.21.15.1:0/1786302337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25901036e0 0x7f2590199f70 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f2580006010 tx=0x7f25800042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:56.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.328+0000 7f2577fff640 1 -- 172.21.15.1:0/1786302337 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258003f030 con 0x7f25901036e0 2024-09-21T01:01:56.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.328+0000 7f259538e640 1 -- 172.21.15.1:0/1786302337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f259019bc40 con 0x7f25901036e0 2024-09-21T01:01:56.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.328+0000 7f2577fff640 1 -- 172.21.15.1:0/1786302337 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2580032e50 con 0x7f25901036e0 2024-09-21T01:01:56.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.328+0000 7f2577fff640 1 -- 172.21.15.1:0/1786302337 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2580035070 con 0x7f25901036e0 2024-09-21T01:01:56.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.328+0000 7f259538e640 1 -- 172.21.15.1:0/1786302337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f259019bf50 con 0x7f25901036e0 2024-09-21T01:01:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.331+0000 7f2577fff640 1 -- 172.21.15.1:0/1786302337 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f2580042030 con 0x7f25901036e0 2024-09-21T01:01:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.331+0000 7f259c3db740 1 Processor -- start 2024-09-21T01:01:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.331+0000 7f259c3db740 1 -- start start 2024-09-21T01:01:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.331+0000 7f259c3db740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560a1e68c1b0 0x560a1ea33e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.331+0000 7f259c3db740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560a1e6632f0 0x560a1ea344c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.331+0000 7f259c3db740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a1e66b4d0 0x560a1ea35010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.331+0000 7f259c3db740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560a1e9a66f0 con 0x560a1e66b4d0 2024-09-21T01:01:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.331+0000 7f259c3db740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560a1e995b20 con 0x560a1e6632f0 2024-09-21T01:01:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.331+0000 7f259c3db740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560a1e999930 con 0x560a1e68c1b0 2024-09-21T01:01:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.331+0000 7f258e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a1e66b4d0 0x560a1ea35010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.331+0000 7f258effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560a1e6632f0 0x560a1ea344c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.331+0000 7f258e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a1e66b4d0 0x560a1ea35010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37336/0 (socket says 172.21.15.1:37336) 2024-09-21T01:01:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.331+0000 7f258e7fc640 1 -- 172.21.15.1:0/4198736126 learned_addr learned my addr 172.21.15.1:0/4198736126 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.331+0000 7f258f7fe640 1 --2- 172.21.15.1:0/4198736126 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560a1e68c1b0 0x560a1ea33e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.331+0000 7f2577fff640 1 --2- 172.21.15.1:0/1786302337 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f25780b6510 0x7f25780b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.331+0000 7f258e7fc640 1 -- 172.21.15.1:0/4198736126 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560a1e68c1b0 msgr2=0x560a1ea33e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.331+0000 7f258e7fc640 1 --2- 172.21.15.1:0/4198736126 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560a1e68c1b0 0x560a1ea33e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.331+0000 7f258e7fc640 1 -- 172.21.15.1:0/4198736126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560a1e6632f0 msgr2=0x560a1ea344c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.332+0000 7f258e7fc640 1 --2- 172.21.15.1:0/4198736126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560a1e6632f0 0x560a1ea344c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.332+0000 7f258e7fc640 1 -- 172.21.15.1:0/4198736126 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a1e95b530 con 0x560a1e66b4d0 2024-09-21T01:01:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.332+0000 7f258effd640 1 --2- 172.21.15.1:0/4198736126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560a1e6632f0 0x560a1ea344c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:01:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.332+0000 7f258f7fe640 1 --2- 172.21.15.1:0/1786302337 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f25780b6510 0x7f25780b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.332+0000 7f2577fff640 1 -- 172.21.15.1:0/1786302337 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f2580107830 con 0x7f25901036e0 2024-09-21T01:01:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.332+0000 7f258e7fc640 1 --2- 172.21.15.1:0/4198736126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a1e66b4d0 0x560a1ea35010 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f2584009d20 tx=0x7f2584011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60a864ef1c55257a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.332+0000 7f25757fa640 1 -- 172.21.15.1:0/4198736126 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258401e070 con 0x560a1e66b4d0 2024-09-21T01:01:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.332+0000 7f25757fa640 1 -- 172.21.15.1:0/4198736126 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2584019ae0 con 0x560a1e66b4d0 2024-09-21T01:01:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.332+0000 7f25757fa640 1 -- 172.21.15.1:0/4198736126 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258400ea80 con 0x560a1e66b4d0 2024-09-21T01:01:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.333+0000 7f259c3db740 1 -- 172.21.15.1:0/4198736126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a1e66b4d0 msgr2=0x560a1ea35010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.333+0000 7f258f7fe640 1 --2- 172.21.15.1:0/1786302337 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f25780b6510 0x7f25780b8a20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f25880049d0 tx=0x7f2588004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.333+0000 7f259c3db740 1 --2- 172.21.15.1:0/4198736126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a1e66b4d0 0x560a1ea35010 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f2584009d20 tx=0x7f2584011810 comp rx=0 tx=0).stop 2024-09-21T01:01:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.333+0000 7f259c3db740 1 -- 172.21.15.1:0/4198736126 shutdown_connections 2024-09-21T01:01:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.333+0000 7f259c3db740 1 --2- 172.21.15.1:0/4198736126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a1e66b4d0 0x560a1ea35010 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.333+0000 7f259c3db740 1 --2- 172.21.15.1:0/4198736126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560a1e6632f0 0x560a1ea344c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.333+0000 7f259c3db740 1 --2- 172.21.15.1:0/4198736126 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560a1e68c1b0 0x560a1ea33e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.333+0000 7f259c3db740 1 -- 172.21.15.1:0/4198736126 >> 172.21.15.1:0/4198736126 conn(0x560a1e680300 msgr2=0x560a1ea2f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.333+0000 7f259c3db740 1 -- 172.21.15.1:0/4198736126 shutdown_connections 2024-09-21T01:01:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.333+0000 7f259c3db740 1 -- 172.21.15.1:0/4198736126 wait complete. 2024-09-21T01:01:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.333+0000 7f259c3db740 1 -- start start 2024-09-21T01:01:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.333+0000 7f259c3db740 1 Processor -- start 2024-09-21T01:01:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.334+0000 7f259c3db740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560a1e6632f0 0x560a1ea3d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.334+0000 7f259c3db740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a1e66b4d0 0x560a1ea3dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.334+0000 7f259c3db740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560a1e68c1b0 0x560a1ea3e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.334+0000 7f259c3db740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560a1e8cdab0 con 0x560a1e66b4d0 2024-09-21T01:01:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.334+0000 7f259c3db740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560a1e93b730 con 0x560a1e6632f0 2024-09-21T01:01:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.334+0000 7f259c3db740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560a1ea35b30 con 0x560a1e68c1b0 2024-09-21T01:01:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.334+0000 7f259c3db740 10 client.0 _ll_register_callbacks cb 0x560a1e98f6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:01:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.334+0000 7f258e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a1e66b4d0 0x560a1ea3dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.334+0000 7f258effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560a1e6632f0 0x560a1ea3d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:56.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.334+0000 7f258e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a1e66b4d0 0x560a1ea3dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37346/0 (socket says 172.21.15.1:37346) 2024-09-21T01:01:56.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.334+0000 7f258e7fc640 1 -- 172.21.15.1:0/543985644 learned_addr learned my addr 172.21.15.1:0/543985644 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:56.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.334+0000 7f258f7fe640 1 --2- 172.21.15.1:0/543985644 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560a1e68c1b0 0x560a1ea3e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:56.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.334+0000 7f258e7fc640 1 -- 172.21.15.1:0/543985644 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560a1e68c1b0 msgr2=0x560a1ea3e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.334+0000 7f258e7fc640 1 --2- 172.21.15.1:0/543985644 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560a1e68c1b0 0x560a1ea3e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.334+0000 7f258e7fc640 1 -- 172.21.15.1:0/543985644 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560a1e6632f0 msgr2=0x560a1ea3d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.334+0000 7f258e7fc640 1 --2- 172.21.15.1:0/543985644 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560a1e6632f0 0x560a1ea3d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.334+0000 7f258e7fc640 1 -- 172.21.15.1:0/543985644 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a1e6f7790 con 0x560a1e66b4d0 2024-09-21T01:01:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.334+0000 7f258f7fe640 1 --2- 172.21.15.1:0/543985644 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560a1e68c1b0 0x560a1ea3e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:01:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.334+0000 7f258e7fc640 1 --2- 172.21.15.1:0/543985644 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a1e66b4d0 0x560a1ea3dc70 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f2584009cf0 tx=0x7f2584004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=865786d71f4f547e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.334+0000 7f2572ff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:01:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.335+0000 7f2572ff5640 1 -- 172.21.15.1:0/543985644 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258401e050 con 0x560a1e66b4d0 2024-09-21T01:01:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.335+0000 7f2572ff5640 1 -- 172.21.15.1:0/543985644 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f2584019430 con 0x560a1e66b4d0 2024-09-21T01:01:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.335+0000 7f259c3db740 1 -- 172.21.15.1:0/543985644 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2584019ae0 con 0x560a1e66b4d0 2024-09-21T01:01:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.335+0000 7f2572ff5640 1 -- 172.21.15.1:0/543985644 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f25840098f0 con 0x560a1e66b4d0 2024-09-21T01:01:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.335+0000 7f259c3db740 10 client.16803 fetch_fsmap learned FSMap version 33 2024-09-21T01:01:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.335+0000 7f259c3db740 1 -- 172.21.15.1:0/543985644 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560a1e770620 con 0x560a1e66b4d0 2024-09-21T01:01:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.335+0000 7f2572ff5640 1 -- 172.21.15.1:0/543985644 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2584019ae0 con 0x560a1e66b4d0 2024-09-21T01:01:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.335+0000 7f2572ff5640 1 -- 172.21.15.1:0/543985644 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f2584003830 con 0x560a1e66b4d0 2024-09-21T01:01:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.335+0000 7f259c3db740 10 client.16803 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:01:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.335+0000 7f259c3db740 10 client.16803 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:01:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.335+0000 7f259c3db740 20 client.16803 populate_metadata read hostname 'smithi001' 2024-09-21T01:01:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.335+0000 7f259c3db740 1 --2- 172.21.15.1:0/543985644 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560a1e64ad80 0x560a1ea4aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.335+0000 7f259c3db740 4 client.16803 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:01:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.335+0000 7f259c3db740 1 -- 172.21.15.1:0/543985644 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a1e9a8640 con 0x560a1e64ad80 2024-09-21T01:01:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.335+0000 7f258effd640 1 --2- 172.21.15.1:0/543985644 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560a1e64ad80 0x560a1ea4aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.336+0000 7f2572ff5640 10 client.16803 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:01:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.336+0000 7f258effd640 1 --2- 172.21.15.1:0/543985644 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560a1e64ad80 0x560a1ea4aab0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c82adbeb4af030bd server_cookie=2498c454c0a0a6c3 in_seq=0 out_seq=0 2024-09-21T01:01:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.337+0000 7f2572ff5640 1 -- 172.21.15.1:0/543985644 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560a1e9a8640 con 0x560a1e64ad80 2024-09-21T01:01:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.337+0000 7f2572ff5640 10 client.16803 handle_command_reply: tid=0 2024-09-21T01:01:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.337+0000 7f259c3db740 1 client.16803 shutdown 2024-09-21T01:01:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.337+0000 7f259c3db740 1 -- 172.21.15.1:0/543985644 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a1e66b4d0 msgr2=0x560a1ea3dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.337+0000 7f259c3db740 1 --2- 172.21.15.1:0/543985644 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a1e66b4d0 0x560a1ea3dc70 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f2584009cf0 tx=0x7f2584004270 comp rx=0 tx=0).stop 2024-09-21T01:01:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.337+0000 7f259c3db740 1 -- 172.21.15.1:0/543985644 shutdown_connections 2024-09-21T01:01:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.337+0000 7f259c3db740 1 --2- 172.21.15.1:0/543985644 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560a1e64ad80 0x560a1ea4aab0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.337+0000 7f259c3db740 1 --2- 172.21.15.1:0/543985644 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560a1e68c1b0 0x560a1ea3e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.337+0000 7f2572ff5640 0 client.16803 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:01:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.337+0000 7f259c3db740 1 --2- 172.21.15.1:0/543985644 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a1e66b4d0 0x560a1ea3dc70 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.337+0000 7f259c3db740 1 --2- 172.21.15.1:0/543985644 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560a1e6632f0 0x560a1ea3d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.337+0000 7f259c3db740 1 -- 172.21.15.1:0/543985644 >> 172.21.15.1:0/543985644 conn(0x560a1e680300 msgr2=0x560a1ea2dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.337+0000 7f259c3db740 1 -- 172.21.15.1:0/543985644 shutdown_connections 2024-09-21T01:01:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.337+0000 7f259c3db740 1 -- 172.21.15.1:0/543985644 wait complete. 2024-09-21T01:01:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.337+0000 7f259c3db740 20 client.16803 trim_cache size 0 max 16384 2024-09-21T01:01:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.352+0000 7f259c3db740 1 Processor -- start 2024-09-21T01:01:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.352+0000 7f259c3db740 1 -- start start 2024-09-21T01:01:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.352+0000 7f259c3db740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560a1e6632f0 0x560a1ea34500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:56.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.352+0000 7f259c3db740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560a1e66b4d0 0x560a1ea3bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:56.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.352+0000 7f259c3db740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a1e68c1b0 0x560a1ea3c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:56.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.352+0000 7f259c3db740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f25901aafb0 con 0x560a1e68c1b0 2024-09-21T01:01:56.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.352+0000 7f259c3db740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f25901acbb0 con 0x560a1e6632f0 2024-09-21T01:01:56.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.352+0000 7f259c3db740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f25901ab680 con 0x560a1e66b4d0 2024-09-21T01:01:56.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.353+0000 7f258f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a1e68c1b0 0x560a1ea3c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:56.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.353+0000 7f258f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a1e68c1b0 0x560a1ea3c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37354/0 (socket says 172.21.15.1:37354) 2024-09-21T01:01:56.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.353+0000 7f258effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560a1e6632f0 0x560a1ea34500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:56.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.353+0000 7f258f7fe640 1 -- 172.21.15.1:0/7827034 learned_addr learned my addr 172.21.15.1:0/7827034 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:56.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.353+0000 7f258e7fc640 1 --2- 172.21.15.1:0/7827034 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560a1e66b4d0 0x560a1ea3bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.353+0000 7f258f7fe640 1 -- 172.21.15.1:0/7827034 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560a1e66b4d0 msgr2=0x560a1ea3bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.353+0000 7f258f7fe640 1 --2- 172.21.15.1:0/7827034 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560a1e66b4d0 0x560a1ea3bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.353+0000 7f258f7fe640 1 -- 172.21.15.1:0/7827034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560a1e6632f0 msgr2=0x560a1ea34500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.353+0000 7f258f7fe640 1 --2- 172.21.15.1:0/7827034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560a1e6632f0 0x560a1ea34500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.353+0000 7f258f7fe640 1 -- 172.21.15.1:0/7827034 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a1ea3d340 con 0x560a1e68c1b0 2024-09-21T01:01:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.353+0000 7f258e7fc640 1 --2- 172.21.15.1:0/7827034 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560a1e66b4d0 0x560a1ea3bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:01:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.353+0000 7f258effd640 1 --2- 172.21.15.1:0/7827034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560a1e6632f0 0x560a1ea34500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:01:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.353+0000 7f258f7fe640 1 --2- 172.21.15.1:0/7827034 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a1e68c1b0 0x560a1ea3c000 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f258800f910 tx=0x7f2588017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f46f8c1fbcf6ae1e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.353+0000 7f2574ff9640 1 -- 172.21.15.1:0/7827034 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25880104f0 con 0x560a1e68c1b0 2024-09-21T01:01:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.353+0000 7f2574ff9640 1 -- 172.21.15.1:0/7827034 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2588010b40 con 0x560a1e68c1b0 2024-09-21T01:01:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.353+0000 7f2574ff9640 1 -- 172.21.15.1:0/7827034 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258801bb90 con 0x560a1e68c1b0 2024-09-21T01:01:56.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.354+0000 7f259c3db740 1 -- 172.21.15.1:0/7827034 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a1e68c1b0 msgr2=0x560a1ea3c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:56.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.354+0000 7f259c3db740 1 --2- 172.21.15.1:0/7827034 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a1e68c1b0 0x560a1ea3c000 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f258800f910 tx=0x7f2588017000 comp rx=0 tx=0).stop 2024-09-21T01:01:56.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.354+0000 7f259c3db740 1 -- 172.21.15.1:0/7827034 shutdown_connections 2024-09-21T01:01:56.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.354+0000 7f259c3db740 1 --2- 172.21.15.1:0/7827034 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a1e68c1b0 0x560a1ea3c000 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:56.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.354+0000 7f259c3db740 1 --2- 172.21.15.1:0/7827034 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560a1e66b4d0 0x560a1ea3bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:56.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.354+0000 7f259c3db740 1 --2- 172.21.15.1:0/7827034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560a1e6632f0 0x560a1ea34500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:56.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.354+0000 7f259c3db740 1 -- 172.21.15.1:0/7827034 >> 172.21.15.1:0/7827034 conn(0x560a1e680300 msgr2=0x560a1ea33df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:56.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.354+0000 7f259c3db740 1 -- 172.21.15.1:0/7827034 shutdown_connections 2024-09-21T01:01:56.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.354+0000 7f259c3db740 1 -- 172.21.15.1:0/7827034 wait complete. 2024-09-21T01:01:56.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.355+0000 7f259c3db740 1 -- start start 2024-09-21T01:01:56.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.355+0000 7f259c3db740 1 Processor -- start 2024-09-21T01:01:56.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.355+0000 7f259c3db740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560a1e6632f0 0x560a1ea45310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:56.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.355+0000 7f259c3db740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560a1e66b4d0 0x560a1ea43fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:56.361 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.355+0000 7f259c3db740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a1e68c1b0 0x560a1ea44510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:56.361 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.355+0000 7f259c3db740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f25901ac4e0 con 0x560a1e68c1b0 2024-09-21T01:01:56.361 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.355+0000 7f259c3db740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f25901abe10 con 0x560a1e66b4d0 2024-09-21T01:01:56.361 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.355+0000 7f259c3db740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f25901a8f90 con 0x560a1e6632f0 2024-09-21T01:01:56.361 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.355+0000 7f259c3db740 10 client.0 _ll_register_callbacks cb 0x7f258401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:01:56.361 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.355+0000 7f258f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a1e68c1b0 0x560a1ea44510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:56.361 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.355+0000 7f258f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a1e68c1b0 0x560a1ea44510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37368/0 (socket says 172.21.15.1:37368) 2024-09-21T01:01:56.361 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.355+0000 7f258e7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560a1e66b4d0 0x560a1ea43fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:56.361 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.355+0000 7f258f7fe640 1 -- 172.21.15.1:0/2329392055 learned_addr learned my addr 172.21.15.1:0/2329392055 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:01:56.361 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.355+0000 7f258effd640 1 --2- 172.21.15.1:0/2329392055 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560a1e6632f0 0x560a1ea45310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:56.361 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.355+0000 7f258f7fe640 1 -- 172.21.15.1:0/2329392055 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560a1e6632f0 msgr2=0x560a1ea45310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:56.361 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.355+0000 7f258f7fe640 1 --2- 172.21.15.1:0/2329392055 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560a1e6632f0 0x560a1ea45310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:56.361 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.355+0000 7f258f7fe640 1 -- 172.21.15.1:0/2329392055 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560a1e66b4d0 msgr2=0x560a1ea43fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:56.361 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.355+0000 7f258f7fe640 1 --2- 172.21.15.1:0/2329392055 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560a1e66b4d0 0x560a1ea43fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:56.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.355+0000 7f258f7fe640 1 -- 172.21.15.1:0/2329392055 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a1ea44c00 con 0x560a1e68c1b0 2024-09-21T01:01:56.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.356+0000 7f258f7fe640 1 --2- 172.21.15.1:0/2329392055 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a1e68c1b0 0x560a1ea44510 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f2588006010 tx=0x7f2588010720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cce3e9f45a9d20d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:56.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.356+0000 7f2572ff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:01:56.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.356+0000 7f2572ff5640 1 -- 172.21.15.1:0/2329392055 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25880120d0 con 0x560a1e68c1b0 2024-09-21T01:01:56.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.356+0000 7f2572ff5640 1 -- 172.21.15.1:0/2329392055 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f2588004ab0 con 0x560a1e68c1b0 2024-09-21T01:01:56.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.356+0000 7f259c3db740 1 -- 172.21.15.1:0/2329392055 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2588010b40 con 0x560a1e68c1b0 2024-09-21T01:01:56.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.356+0000 7f2572ff5640 1 -- 172.21.15.1:0/2329392055 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f2588004cb0 con 0x560a1e68c1b0 2024-09-21T01:01:56.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.356+0000 7f259c3db740 10 client.16809 fetch_fsmap learned FSMap version 33 2024-09-21T01:01:56.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.356+0000 7f259c3db740 1 -- 172.21.15.1:0/2329392055 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560a1eab54b0 con 0x560a1e68c1b0 2024-09-21T01:01:56.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.356+0000 7f2572ff5640 1 -- 172.21.15.1:0/2329392055 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2588010b40 con 0x560a1e68c1b0 2024-09-21T01:01:56.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.356+0000 7f2572ff5640 1 -- 172.21.15.1:0/2329392055 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f2588027070 con 0x560a1e68c1b0 2024-09-21T01:01:56.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.356+0000 7f259c3db740 10 client.16809 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:01:56.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.356+0000 7f259c3db740 10 client.16809 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:01:56.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.356+0000 7f259c3db740 20 client.16809 populate_metadata read hostname 'smithi001' 2024-09-21T01:01:56.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.357+0000 7f259c3db740 1 --2- 172.21.15.1:0/2329392055 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560a1e6201c0 0x560a1eab7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:56.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.357+0000 7f259c3db740 4 client.16809 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:01:56.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.357+0000 7f259c3db740 1 -- 172.21.15.1:0/2329392055 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560a1ea2f9f0 con 0x560a1e6201c0 2024-09-21T01:01:56.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.357+0000 7f258effd640 1 --2- 172.21.15.1:0/2329392055 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560a1e6201c0 0x560a1eab7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:56.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.357+0000 7f2572ff5640 10 client.16809 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:01:56.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.357+0000 7f258effd640 1 --2- 172.21.15.1:0/2329392055 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560a1e6201c0 0x560a1eab7d10 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e61b6dae8d19f2e server_cookie=2e2d758c9c4b92c7 in_seq=0 out_seq=0 2024-09-21T01:01:56.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.446+0000 7f2572ff5640 1 -- 172.21.15.1:0/2329392055 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560a1ea2f9f0 con 0x560a1e6201c0 2024-09-21T01:01:56.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.446+0000 7f2572ff5640 10 client.16809 handle_command_reply: tid=0 2024-09-21T01:01:56.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.446+0000 7f259c3db740 1 client.16809 shutdown 2024-09-21T01:01:56.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.446+0000 7f259c3db740 1 -- 172.21.15.1:0/2329392055 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a1e68c1b0 msgr2=0x560a1ea44510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:56.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.446+0000 7f259c3db740 1 --2- 172.21.15.1:0/2329392055 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a1e68c1b0 0x560a1ea44510 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f2588006010 tx=0x7f2588010720 comp rx=0 tx=0).stop 2024-09-21T01:01:56.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.446+0000 7f259c3db740 1 -- 172.21.15.1:0/2329392055 shutdown_connections 2024-09-21T01:01:56.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.446+0000 7f259c3db740 1 --2- 172.21.15.1:0/2329392055 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560a1e6201c0 0x560a1eab7d10 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:56.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.446+0000 7f259c3db740 1 --2- 172.21.15.1:0/2329392055 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a1e68c1b0 0x560a1ea44510 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:56.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.446+0000 7f259c3db740 1 --2- 172.21.15.1:0/2329392055 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560a1e66b4d0 0x560a1ea43fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:56.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.446+0000 7f259c3db740 1 --2- 172.21.15.1:0/2329392055 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560a1e6632f0 0x560a1ea45310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:56.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.446+0000 7f259c3db740 1 -- 172.21.15.1:0/2329392055 >> 172.21.15.1:0/2329392055 conn(0x560a1e680300 msgr2=0x560a1ea3d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:56.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.446+0000 7f2572ff5640 0 client.16809 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:01:56.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.446+0000 7f259c3db740 1 -- 172.21.15.1:0/2329392055 shutdown_connections 2024-09-21T01:01:56.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.446+0000 7f259c3db740 1 -- 172.21.15.1:0/2329392055 wait complete. 2024-09-21T01:01:56.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.446+0000 7f259c3db740 20 client.16809 trim_cache size 0 max 16384 2024-09-21T01:01:56.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T01:01:56.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T01:01:56.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T01:01:56.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T01:01:56.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.447+0000 7f259538e640 1 -- 172.21.15.1:0/1786302337 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f25780b6510 msgr2=0x7f25780b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:56.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.447+0000 7f259538e640 1 --2- 172.21.15.1:0/1786302337 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f25780b6510 0x7f25780b8a20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f25880049d0 tx=0x7f2588004a40 comp rx=0 tx=0).stop 2024-09-21T01:01:56.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.447+0000 7f259538e640 1 -- 172.21.15.1:0/1786302337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25901036e0 msgr2=0x7f2590199f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:56.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.447+0000 7f259538e640 1 --2- 172.21.15.1:0/1786302337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25901036e0 0x7f2590199f70 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f2580006010 tx=0x7f25800042f0 comp rx=0 tx=0).stop 2024-09-21T01:01:56.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.447+0000 7f259538e640 1 -- 172.21.15.1:0/1786302337 shutdown_connections 2024-09-21T01:01:56.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.447+0000 7f259538e640 1 --2- 172.21.15.1:0/1786302337 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2590105100 0x7f259019b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:56.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.447+0000 7f259538e640 1 --2- 172.21.15.1:0/1786302337 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2590104760 0x7f259019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:56.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.447+0000 7f259538e640 1 --2- 172.21.15.1:0/1786302337 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f25780b6510 0x7f25780b8a20 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:56.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.447+0000 7f259538e640 1 --2- 172.21.15.1:0/1786302337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25901036e0 0x7f2590199f70 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:56.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.447+0000 7f259538e640 1 -- 172.21.15.1:0/1786302337 >> 172.21.15.1:0/1786302337 conn(0x7f25900ff020 msgr2=0x7f2590107a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:56.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.447+0000 7f259538e640 1 -- 172.21.15.1:0/1786302337 shutdown_connections 2024-09-21T01:01:56.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:01:56.447+0000 7f259538e640 1 -- 172.21.15.1:0/1786302337 wait complete. 2024-09-21T01:01:57.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:57 smithi001 ceph-mon[31211]: pgmap v500: 97 pgs: 97 active+clean; 589 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 527 op/s 2024-09-21T01:01:57.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:57 smithi193 ceph-mon[34660]: pgmap v500: 97 pgs: 97 active+clean; 589 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 527 op/s 2024-09-21T01:01:57.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:57 smithi042 ceph-mon[34481]: pgmap v500: 97 pgs: 97 active+clean; 589 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 527 op/s 2024-09-21T01:01:59.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:01:59 smithi001 ceph-mon[31211]: pgmap v501: 97 pgs: 97 active+clean; 590 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 497 op/s 2024-09-21T01:01:59.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:01:59 smithi193 ceph-mon[34660]: pgmap v501: 97 pgs: 97 active+clean; 590 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 497 op/s 2024-09-21T01:01:59.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:01:59 smithi042 ceph-mon[34481]: pgmap v501: 97 pgs: 97 active+clean; 590 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 497 op/s 2024-09-21T01:02:01.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:01 smithi001 ceph-mon[31211]: pgmap v502: 97 pgs: 97 active+clean; 592 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 588 op/s 2024-09-21T01:02:01.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:01 smithi193 ceph-mon[34660]: pgmap v502: 97 pgs: 97 active+clean; 592 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 588 op/s 2024-09-21T01:02:01.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:01 smithi042 ceph-mon[34481]: pgmap v502: 97 pgs: 97 active+clean; 592 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 588 op/s 2024-09-21T01:02:03.560 INFO:tasks.workunit.client.0.smithi001.stdout: 113 36333 3 24385 1 21582 7 2024-09-21T01:02:03.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:03 smithi001 ceph-mon[31211]: pgmap v503: 97 pgs: 97 active+clean; 609 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.7 MiB/s wr, 706 op/s 2024-09-21T01:02:03.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:03 smithi193 ceph-mon[34660]: pgmap v503: 97 pgs: 97 active+clean; 609 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.7 MiB/s wr, 706 op/s 2024-09-21T01:02:03.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:03 smithi042 ceph-mon[34481]: pgmap v503: 97 pgs: 97 active+clean; 609 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.7 MiB/s wr, 706 op/s 2024-09-21T01:02:05.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:05 smithi001 ceph-mon[31211]: pgmap v504: 97 pgs: 97 active+clean; 624 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.5 MiB/s wr, 798 op/s 2024-09-21T01:02:05.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:05 smithi193 ceph-mon[34660]: pgmap v504: 97 pgs: 97 active+clean; 624 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.5 MiB/s wr, 798 op/s 2024-09-21T01:02:05.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:05 smithi042 ceph-mon[34481]: pgmap v504: 97 pgs: 97 active+clean; 624 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.5 MiB/s wr, 798 op/s 2024-09-21T01:02:07.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:07 smithi001 ceph-mon[31211]: pgmap v505: 97 pgs: 97 active+clean; 617 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.2 MiB/s wr, 719 op/s 2024-09-21T01:02:07.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:07 smithi193 ceph-mon[34660]: pgmap v505: 97 pgs: 97 active+clean; 617 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.2 MiB/s wr, 719 op/s 2024-09-21T01:02:07.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:07 smithi042 ceph-mon[34481]: pgmap v505: 97 pgs: 97 active+clean; 617 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.2 MiB/s wr, 719 op/s 2024-09-21T01:02:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.551+0000 7fadd6321640 1 -- 172.21.15.1:0/2901530731 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fadd01036c0 msgr2=0x7fadd0103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.551+0000 7fadd6321640 1 --2- 172.21.15.1:0/2901530731 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fadd01036c0 0x7fadd0103b30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009900 tx=0x7fadc002a410 comp rx=0 tx=0).stop 2024-09-21T01:02:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.551+0000 7fadd6321640 1 -- 172.21.15.1:0/2901530731 shutdown_connections 2024-09-21T01:02:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.551+0000 7fadd6321640 1 --2- 172.21.15.1:0/2901530731 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadd01050e0 0x7fadd010ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.551+0000 7fadd6321640 1 --2- 172.21.15.1:0/2901530731 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fadd0104740 0x7fadd0104b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.551+0000 7fadd6321640 1 --2- 172.21.15.1:0/2901530731 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fadd01036c0 0x7fadd0103b30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.551+0000 7fadd6321640 1 -- 172.21.15.1:0/2901530731 >> 172.21.15.1:0/2901530731 conn(0x7fadd00ff000 msgr2=0x7fadd01014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.551+0000 7fadd6321640 1 -- 172.21.15.1:0/2901530731 shutdown_connections 2024-09-21T01:02:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.551+0000 7fadd6321640 1 -- 172.21.15.1:0/2901530731 wait complete. 2024-09-21T01:02:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.552+0000 7fadd6321640 1 Processor -- start 2024-09-21T01:02:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.552+0000 7fadd6321640 1 -- start start 2024-09-21T01:02:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.552+0000 7fadd6321640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fadd01036c0 0x7fadd0076e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.552+0000 7fadd6321640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fadd0104740 0x7fadd0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.552+0000 7fadd6321640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadd01050e0 0x7fadd0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.552+0000 7fadd6321640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fadd010f300 con 0x7fadd01050e0 2024-09-21T01:02:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.552+0000 7fadd6321640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fadd010f180 con 0x7fadd01036c0 2024-09-21T01:02:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.552+0000 7fadd6321640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fadd010f480 con 0x7fadd0104740 2024-09-21T01:02:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.552+0000 7fadd48be640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadd01050e0 0x7fadd0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.552+0000 7fadcffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fadd01036c0 0x7fadd0076e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:09.559 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.552+0000 7fadc7fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fadd0104740 0x7fadd0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:09.559 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.552+0000 7fadd48be640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadd01050e0 0x7fadd0075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42562/0 (socket says 172.21.15.1:42562) 2024-09-21T01:02:09.559 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.552+0000 7fadd48be640 1 -- 172.21.15.1:0/3364694632 learned_addr learned my addr 172.21.15.1:0/3364694632 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:02:09.559 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.552+0000 7fadcffff640 1 --2- 172.21.15.1:0/3364694632 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fadd01036c0 0x7fadd0076e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:50248/0 (socket says 172.21.15.1:50248) 2024-09-21T01:02:09.559 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.553+0000 7fadc7fff640 1 -- 172.21.15.1:0/3364694632 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fadd01036c0 msgr2=0x7fadd0076e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:09.559 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.553+0000 7fadc7fff640 1 --2- 172.21.15.1:0/3364694632 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fadd01036c0 0x7fadd0076e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:09.559 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.553+0000 7fadc7fff640 1 -- 172.21.15.1:0/3364694632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadd01050e0 msgr2=0x7fadd0075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:09.559 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.553+0000 7fadc7fff640 1 --2- 172.21.15.1:0/3364694632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadd01050e0 0x7fadd0075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:09.559 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.553+0000 7fadc7fff640 1 -- 172.21.15.1:0/3364694632 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd0076380 con 0x7fadd0104740 2024-09-21T01:02:09.559 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.553+0000 7fadd48be640 1 --2- 172.21.15.1:0/3364694632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadd01050e0 0x7fadd0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:02:09.559 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.553+0000 7fadc7fff640 1 --2- 172.21.15.1:0/3364694632 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fadd0104740 0x7fadd0075710 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fadb800e9f0 tx=0x7fadb800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:09.560 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.553+0000 7fadcdffb640 1 -- 172.21.15.1:0/3364694632 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb800ccc0 con 0x7fadd0104740 2024-09-21T01:02:09.560 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.553+0000 7fadcdffb640 1 -- 172.21.15.1:0/3364694632 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadb8005020 con 0x7fadd0104740 2024-09-21T01:02:09.560 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.553+0000 7fadd6321640 1 -- 172.21.15.1:0/3364694632 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadd01a3fd0 con 0x7fadd0104740 2024-09-21T01:02:09.560 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.553+0000 7fadcdffb640 1 -- 172.21.15.1:0/3364694632 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb8004a00 con 0x7fadd0104740 2024-09-21T01:02:09.560 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.553+0000 7fadd6321640 1 -- 172.21.15.1:0/3364694632 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadd01a43e0 con 0x7fadd0104740 2024-09-21T01:02:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.556+0000 7faddd288740 1 Processor -- start 2024-09-21T01:02:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.556+0000 7faddd288740 1 -- start start 2024-09-21T01:02:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.556+0000 7fadcdffb640 1 -- 172.21.15.1:0/3364694632 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7fadb8004ba0 con 0x7fadd0104740 2024-09-21T01:02:09.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.556+0000 7faddd288740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de6829c1b0 0x55de68643e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:09.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.556+0000 7faddd288740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de682732f0 0x55de686444c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:09.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.556+0000 7faddd288740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de6827b4d0 0x55de68645010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:09.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.556+0000 7faddd288740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55de685b66f0 con 0x55de6829c1b0 2024-09-21T01:02:09.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.556+0000 7faddd288740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55de685a5b20 con 0x55de682732f0 2024-09-21T01:02:09.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.556+0000 7faddd288740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55de685a9930 con 0x55de6827b4d0 2024-09-21T01:02:09.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.557+0000 7fadd48be640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de6829c1b0 0x55de68643e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:09.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.557+0000 7fadcffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de682732f0 0x55de686444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:09.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.557+0000 7fadd48be640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de6829c1b0 0x55de68643e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42576/0 (socket says 172.21.15.1:42576) 2024-09-21T01:02:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.557+0000 7fadd48be640 1 -- 172.21.15.1:0/720174373 learned_addr learned my addr 172.21.15.1:0/720174373 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:02:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.557+0000 7fadc7fff640 1 --2- 172.21.15.1:0/720174373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de6827b4d0 0x55de68645010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.557+0000 7fadd48be640 1 -- 172.21.15.1:0/720174373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de6827b4d0 msgr2=0x55de68645010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.557+0000 7fadd48be640 1 --2- 172.21.15.1:0/720174373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de6827b4d0 0x55de68645010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.557+0000 7fadd48be640 1 -- 172.21.15.1:0/720174373 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de682732f0 msgr2=0x55de686444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.557+0000 7fadd48be640 1 --2- 172.21.15.1:0/720174373 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de682732f0 0x55de686444c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.557+0000 7fadd48be640 1 -- 172.21.15.1:0/720174373 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de6856b530 con 0x55de6829c1b0 2024-09-21T01:02:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.557+0000 7fadcffff640 1 --2- 172.21.15.1:0/720174373 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de682732f0 0x55de686444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:02:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.557+0000 7fadd48be640 1 --2- 172.21.15.1:0/720174373 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de6829c1b0 0x55de68643e50 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fadc800e830 tx=0x7fadc800ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c484dd3ccf8baf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.557+0000 7fadc67fc640 1 -- 172.21.15.1:0/720174373 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc8004d20 con 0x55de6829c1b0 2024-09-21T01:02:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.557+0000 7fadcdffb640 1 --2- 172.21.15.1:0/3364694632 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fadbc0b6510 0x7fadbc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.557+0000 7fadc67fc640 1 -- 172.21.15.1:0/720174373 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadc8005020 con 0x55de6829c1b0 2024-09-21T01:02:09.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.558+0000 7fadc67fc640 1 -- 172.21.15.1:0/720174373 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc801a600 con 0x55de6829c1b0 2024-09-21T01:02:09.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.558+0000 7fadcffff640 1 --2- 172.21.15.1:0/3364694632 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fadbc0b6510 0x7fadbc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:09.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.558+0000 7fadcdffb640 1 -- 172.21.15.1:0/3364694632 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fadb80e72c0 con 0x7fadd0104740 2024-09-21T01:02:09.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.559+0000 7faddd288740 1 -- 172.21.15.1:0/720174373 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de6829c1b0 msgr2=0x55de68643e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:09.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.559+0000 7fadcffff640 1 --2- 172.21.15.1:0/3364694632 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fadbc0b6510 0x7fadbc0b8a20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fadc0000c00 tx=0x7fadc0031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:09.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.559+0000 7faddd288740 1 --2- 172.21.15.1:0/720174373 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de6829c1b0 0x55de68643e50 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fadc800e830 tx=0x7fadc800ecf0 comp rx=0 tx=0).stop 2024-09-21T01:02:09.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.559+0000 7faddd288740 1 -- 172.21.15.1:0/720174373 shutdown_connections 2024-09-21T01:02:09.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.559+0000 7faddd288740 1 --2- 172.21.15.1:0/720174373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de6827b4d0 0x55de68645010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:09.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.559+0000 7faddd288740 1 --2- 172.21.15.1:0/720174373 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de682732f0 0x55de686444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:09.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.559+0000 7faddd288740 1 --2- 172.21.15.1:0/720174373 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de6829c1b0 0x55de68643e50 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:09.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.559+0000 7faddd288740 1 -- 172.21.15.1:0/720174373 >> 172.21.15.1:0/720174373 conn(0x55de68290300 msgr2=0x55de6863f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:09.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.559+0000 7faddd288740 1 -- 172.21.15.1:0/720174373 shutdown_connections 2024-09-21T01:02:09.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.559+0000 7faddd288740 1 -- 172.21.15.1:0/720174373 wait complete. 2024-09-21T01:02:09.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.559+0000 7faddd288740 1 -- start start 2024-09-21T01:02:09.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.560+0000 7faddd288740 1 Processor -- start 2024-09-21T01:02:09.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.560+0000 7faddd288740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de682732f0 0x55de6864d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:09.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.560+0000 7faddd288740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de6827b4d0 0x55de6864dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:09.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.560+0000 7faddd288740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de6829c1b0 0x55de6864e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:09.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.560+0000 7faddd288740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55de684ddab0 con 0x55de6827b4d0 2024-09-21T01:02:09.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.560+0000 7faddd288740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55de6854b730 con 0x55de682732f0 2024-09-21T01:02:09.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.560+0000 7faddd288740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55de68645b30 con 0x55de6829c1b0 2024-09-21T01:02:09.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.560+0000 7faddd288740 10 client.0 _ll_register_callbacks cb 0x55de6859f6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:02:09.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.560+0000 7fadcffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de682732f0 0x55de6864d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:09.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.560+0000 7fadc7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de6827b4d0 0x55de6864dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:09.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.560+0000 7fadcffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de682732f0 0x55de6864d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:50264/0 (socket says 172.21.15.1:50264) 2024-09-21T01:02:09.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.560+0000 7fadcffff640 1 -- 172.21.15.1:0/1317779945 learned_addr learned my addr 172.21.15.1:0/1317779945 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:02:09.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.560+0000 7fadd48be640 1 --2- 172.21.15.1:0/1317779945 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de6829c1b0 0x55de6864e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:09.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.561+0000 7fadcffff640 1 -- 172.21.15.1:0/1317779945 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de6829c1b0 msgr2=0x55de6864e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:09.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.561+0000 7fadcffff640 1 --2- 172.21.15.1:0/1317779945 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de6829c1b0 0x55de6864e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:09.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.561+0000 7fadcffff640 1 -- 172.21.15.1:0/1317779945 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de6827b4d0 msgr2=0x55de6864dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:09.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.561+0000 7fadcffff640 1 --2- 172.21.15.1:0/1317779945 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de6827b4d0 0x55de6864dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:09.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.561+0000 7fadcffff640 1 -- 172.21.15.1:0/1317779945 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de68307790 con 0x55de682732f0 2024-09-21T01:02:09.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.561+0000 7fadd48be640 1 --2- 172.21.15.1:0/1317779945 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de6829c1b0 0x55de6864e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:02:09.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.561+0000 7fadcffff640 1 --2- 172.21.15.1:0/1317779945 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de682732f0 0x55de6864d630 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fadc0031a50 tx=0x7fadc0009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd346e84a5b922c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:09.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.561+0000 7fadaf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:02:09.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.565+0000 7fadaf7fe640 1 -- 172.21.15.1:0/1317779945 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0035040 con 0x55de682732f0 2024-09-21T01:02:09.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.566+0000 7fadaf7fe640 1 -- 172.21.15.1:0/1317779945 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fadc0004300 con 0x55de682732f0 2024-09-21T01:02:09.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.566+0000 7faddd288740 1 -- 172.21.15.1:0/1317779945 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadc8005020 con 0x55de682732f0 2024-09-21T01:02:09.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.566+0000 7fadaf7fe640 1 -- 172.21.15.1:0/1317779945 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fadc00035f0 con 0x55de682732f0 2024-09-21T01:02:09.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.566+0000 7faddd288740 10 client.26489 fetch_fsmap learned FSMap version 33 2024-09-21T01:02:09.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.566+0000 7faddd288740 1 -- 172.21.15.1:0/1317779945 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55de68380620 con 0x55de682732f0 2024-09-21T01:02:09.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.566+0000 7fadaf7fe640 1 -- 172.21.15.1:0/1317779945 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadc8005020 con 0x55de682732f0 2024-09-21T01:02:09.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.566+0000 7fadaf7fe640 1 -- 172.21.15.1:0/1317779945 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fadc0044070 con 0x55de682732f0 2024-09-21T01:02:09.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.566+0000 7faddd288740 10 client.26489 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:02:09.574 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.566+0000 7faddd288740 10 client.26489 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:02:09.574 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.566+0000 7faddd288740 20 client.26489 populate_metadata read hostname 'smithi001' 2024-09-21T01:02:09.574 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.566+0000 7faddd288740 1 --2- 172.21.15.1:0/1317779945 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55de6825ad80 0x55de6865ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:09.574 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.566+0000 7faddd288740 4 client.26489 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:02:09.574 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.566+0000 7faddd288740 1 -- 172.21.15.1:0/1317779945 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de685b8640 con 0x55de6825ad80 2024-09-21T01:02:09.574 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.567+0000 7fadc7fff640 1 --2- 172.21.15.1:0/1317779945 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55de6825ad80 0x55de6865ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:09.574 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.567+0000 7fadc7fff640 1 --2- 172.21.15.1:0/1317779945 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55de6825ad80 0x55de6865ae70 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=285ef88ac4a3643e server_cookie=ea8e926e42286087 in_seq=0 out_seq=0 2024-09-21T01:02:09.574 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.567+0000 7fadaf7fe640 10 client.26489 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:02:09.574 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.568+0000 7fadaf7fe640 1 -- 172.21.15.1:0/1317779945 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55de685b8640 con 0x55de6825ad80 2024-09-21T01:02:09.574 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.568+0000 7fadaf7fe640 10 client.26489 handle_command_reply: tid=0 2024-09-21T01:02:09.574 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.568+0000 7faddd288740 1 client.26489 shutdown 2024-09-21T01:02:09.574 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.568+0000 7faddd288740 1 -- 172.21.15.1:0/1317779945 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de682732f0 msgr2=0x55de6864d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:09.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.569+0000 7faddd288740 1 --2- 172.21.15.1:0/1317779945 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de682732f0 0x55de6864d630 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fadc0031a50 tx=0x7fadc0009260 comp rx=0 tx=0).stop 2024-09-21T01:02:09.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.569+0000 7faddd288740 1 -- 172.21.15.1:0/1317779945 shutdown_connections 2024-09-21T01:02:09.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.569+0000 7faddd288740 1 --2- 172.21.15.1:0/1317779945 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55de6825ad80 0x55de6865ae70 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:09.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.569+0000 7faddd288740 1 --2- 172.21.15.1:0/1317779945 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de6829c1b0 0x55de6864e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:09.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.569+0000 7faddd288740 1 --2- 172.21.15.1:0/1317779945 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de6827b4d0 0x55de6864dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:09.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.569+0000 7faddd288740 1 --2- 172.21.15.1:0/1317779945 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de682732f0 0x55de6864d630 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:09.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.569+0000 7fadaf7fe640 0 client.26489 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:02:09.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.569+0000 7faddd288740 1 -- 172.21.15.1:0/1317779945 >> 172.21.15.1:0/1317779945 conn(0x55de68290300 msgr2=0x55de6863dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:09.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.569+0000 7faddd288740 1 -- 172.21.15.1:0/1317779945 shutdown_connections 2024-09-21T01:02:09.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.569+0000 7faddd288740 1 -- 172.21.15.1:0/1317779945 wait complete. 2024-09-21T01:02:09.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.569+0000 7faddd288740 20 client.26489 trim_cache size 0 max 16384 2024-09-21T01:02:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.588+0000 7faddd288740 1 Processor -- start 2024-09-21T01:02:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.588+0000 7faddd288740 1 -- start start 2024-09-21T01:02:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.588+0000 7faddd288740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de682732f0 0x55de6863e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.588+0000 7faddd288740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de6827b4d0 0x55de6863eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.588+0000 7faddd288740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de6829c1b0 0x55de6864bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.588+0000 7faddd288740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fadd01ad1e0 con 0x55de6829c1b0 2024-09-21T01:02:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.588+0000 7faddd288740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fadd01aede0 con 0x55de6827b4d0 2024-09-21T01:02:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.588+0000 7faddd288740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fadd01ad8b0 con 0x55de682732f0 2024-09-21T01:02:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.588+0000 7fadd48be640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de6829c1b0 0x55de6864bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.588+0000 7fadcffff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de682732f0 0x55de6863e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.588+0000 7fadc7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de6827b4d0 0x55de6863eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.588+0000 7fadcffff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de682732f0 0x55de6863e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:57618/0 (socket says 172.21.15.1:57618) 2024-09-21T01:02:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.588+0000 7fadd48be640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de6829c1b0 0x55de6864bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42586/0 (socket says 172.21.15.1:42586) 2024-09-21T01:02:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.588+0000 7fadcffff640 1 -- 172.21.15.1:0/886196755 learned_addr learned my addr 172.21.15.1:0/886196755 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:02:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.589+0000 7fadcffff640 1 -- 172.21.15.1:0/886196755 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de6827b4d0 msgr2=0x55de6863eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.589+0000 7fadcffff640 1 --2- 172.21.15.1:0/886196755 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de6827b4d0 0x55de6863eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.589+0000 7fadcffff640 1 -- 172.21.15.1:0/886196755 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de6829c1b0 msgr2=0x55de6864bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.589+0000 7fadcffff640 1 --2- 172.21.15.1:0/886196755 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de6829c1b0 0x55de6864bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.589+0000 7fadcffff640 1 -- 172.21.15.1:0/886196755 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de68655b00 con 0x55de682732f0 2024-09-21T01:02:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.589+0000 7fadcffff640 1 --2- 172.21.15.1:0/886196755 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de682732f0 0x55de6863e610 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009230 tx=0x7fadc0032fc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53ee7cd34cd2f4a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.589+0000 7fadc5ffb640 1 -- 172.21.15.1:0/886196755 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0035040 con 0x55de682732f0 2024-09-21T01:02:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.589+0000 7fadc5ffb640 1 -- 172.21.15.1:0/886196755 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadc003d650 con 0x55de682732f0 2024-09-21T01:02:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.589+0000 7fadc5ffb640 1 -- 172.21.15.1:0/886196755 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0003e40 con 0x55de682732f0 2024-09-21T01:02:09.598 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.590+0000 7faddd288740 1 -- 172.21.15.1:0/886196755 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de682732f0 msgr2=0x55de6863e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:09.598 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.590+0000 7faddd288740 1 --2- 172.21.15.1:0/886196755 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de682732f0 0x55de6863e610 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009230 tx=0x7fadc0032fc0 comp rx=0 tx=0).stop 2024-09-21T01:02:09.598 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.590+0000 7faddd288740 1 -- 172.21.15.1:0/886196755 shutdown_connections 2024-09-21T01:02:09.598 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.590+0000 7faddd288740 1 --2- 172.21.15.1:0/886196755 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de6829c1b0 0x55de6864bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:09.598 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.590+0000 7faddd288740 1 --2- 172.21.15.1:0/886196755 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de6827b4d0 0x55de6863eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.590+0000 7faddd288740 1 --2- 172.21.15.1:0/886196755 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de682732f0 0x55de6863e610 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.590+0000 7faddd288740 1 -- 172.21.15.1:0/886196755 >> 172.21.15.1:0/886196755 conn(0x55de68290300 msgr2=0x55de6864c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.590+0000 7faddd288740 1 -- 172.21.15.1:0/886196755 shutdown_connections 2024-09-21T01:02:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.590+0000 7faddd288740 1 -- 172.21.15.1:0/886196755 wait complete. 2024-09-21T01:02:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.591+0000 7faddd288740 1 -- start start 2024-09-21T01:02:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.591+0000 7faddd288740 1 Processor -- start 2024-09-21T01:02:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.591+0000 7faddd288740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de682732f0 0x55de686543b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.591+0000 7faddd288740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de6827b4d0 0x55de686548f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.591+0000 7faddd288740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de6829c1b0 0x55de68654e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.591+0000 7faddd288740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fadd01ae710 con 0x55de6827b4d0 2024-09-21T01:02:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.591+0000 7faddd288740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fadd01ae040 con 0x55de682732f0 2024-09-21T01:02:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.591+0000 7faddd288740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fadd01ab1c0 con 0x55de6829c1b0 2024-09-21T01:02:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.591+0000 7faddd288740 10 client.0 _ll_register_callbacks cb 0x7fadc0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:02:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.591+0000 7fadc7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de6827b4d0 0x55de686548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.591+0000 7fadc7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de6827b4d0 0x55de686548f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42590/0 (socket says 172.21.15.1:42590) 2024-09-21T01:02:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.592+0000 7fadc7fff640 1 -- 172.21.15.1:0/169129981 learned_addr learned my addr 172.21.15.1:0/169129981 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:02:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.591+0000 7fadcffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de682732f0 0x55de686543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.592+0000 7fadd48be640 1 --2- 172.21.15.1:0/169129981 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de6829c1b0 0x55de68654e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.592+0000 7fadc7fff640 1 -- 172.21.15.1:0/169129981 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de6829c1b0 msgr2=0x55de68654e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.592+0000 7fadc7fff640 1 --2- 172.21.15.1:0/169129981 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de6829c1b0 0x55de68654e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.592+0000 7fadc7fff640 1 -- 172.21.15.1:0/169129981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de682732f0 msgr2=0x55de686543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.592+0000 7fadc7fff640 1 --2- 172.21.15.1:0/169129981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de682732f0 0x55de686543b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.592+0000 7fadc7fff640 1 -- 172.21.15.1:0/169129981 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de6864ebd0 con 0x55de6827b4d0 2024-09-21T01:02:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.592+0000 7fadcffff640 1 --2- 172.21.15.1:0/169129981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de682732f0 0x55de686543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:02:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.592+0000 7fadc7fff640 1 --2- 172.21.15.1:0/169129981 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de6827b4d0 0x55de686548f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fadb80aa6a0 tx=0x7fadb80096e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e553ab2d1acb3f60 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.592+0000 7fadaf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:02:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.592+0000 7fadaf7fe640 1 -- 172.21.15.1:0/169129981 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb801c040 con 0x55de6827b4d0 2024-09-21T01:02:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.592+0000 7faddd288740 1 -- 172.21.15.1:0/169129981 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadc003d650 con 0x55de6827b4d0 2024-09-21T01:02:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.592+0000 7fadaf7fe640 1 -- 172.21.15.1:0/169129981 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fadb80a96a0 con 0x55de6827b4d0 2024-09-21T01:02:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.592+0000 7fadaf7fe640 1 -- 172.21.15.1:0/169129981 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fadb80acd80 con 0x55de6827b4d0 2024-09-21T01:02:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.592+0000 7faddd288740 10 client.16827 fetch_fsmap learned FSMap version 33 2024-09-21T01:02:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.592+0000 7faddd288740 1 -- 172.21.15.1:0/169129981 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55de686c5b80 con 0x55de6827b4d0 2024-09-21T01:02:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.593+0000 7fadaf7fe640 1 -- 172.21.15.1:0/169129981 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadc003d650 con 0x55de6827b4d0 2024-09-21T01:02:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.593+0000 7fadaf7fe640 1 -- 172.21.15.1:0/169129981 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fadb8094bc0 con 0x55de6827b4d0 2024-09-21T01:02:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.593+0000 7faddd288740 10 client.16827 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:02:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.593+0000 7faddd288740 10 client.16827 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:02:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.593+0000 7faddd288740 20 client.16827 populate_metadata read hostname 'smithi001' 2024-09-21T01:02:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.593+0000 7faddd288740 1 --2- 172.21.15.1:0/169129981 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55de682301c0 0x55de686c8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.593+0000 7faddd288740 4 client.16827 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:02:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.593+0000 7faddd288740 1 -- 172.21.15.1:0/169129981 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55de685b40f0 con 0x55de682301c0 2024-09-21T01:02:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.593+0000 7fadcffff640 1 --2- 172.21.15.1:0/169129981 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55de682301c0 0x55de686c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.594+0000 7fadcffff640 1 --2- 172.21.15.1:0/169129981 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55de682301c0 0x55de686c8520 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5481222881cff67c server_cookie=8f0bc04d5ccf9d2d in_seq=0 out_seq=0 2024-09-21T01:02:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.594+0000 7fadaf7fe640 10 client.16827 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:02:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.619+0000 7fadaf7fe640 1 -- 172.21.15.1:0/169129981 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55de685b40f0 con 0x55de682301c0 2024-09-21T01:02:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.619+0000 7fadaf7fe640 10 client.16827 handle_command_reply: tid=0 2024-09-21T01:02:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.620+0000 7faddd288740 1 client.16827 shutdown 2024-09-21T01:02:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.620+0000 7faddd288740 1 -- 172.21.15.1:0/169129981 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de6827b4d0 msgr2=0x55de686548f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.620+0000 7faddd288740 1 --2- 172.21.15.1:0/169129981 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de6827b4d0 0x55de686548f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fadb80aa6a0 tx=0x7fadb80096e0 comp rx=0 tx=0).stop 2024-09-21T01:02:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.620+0000 7faddd288740 1 -- 172.21.15.1:0/169129981 shutdown_connections 2024-09-21T01:02:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.620+0000 7faddd288740 1 --2- 172.21.15.1:0/169129981 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55de682301c0 0x55de686c8520 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.620+0000 7faddd288740 1 --2- 172.21.15.1:0/169129981 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de6829c1b0 0x55de68654e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.620+0000 7faddd288740 1 --2- 172.21.15.1:0/169129981 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de6827b4d0 0x55de686548f0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.620+0000 7fadaf7fe640 0 client.16827 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:02:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.620+0000 7faddd288740 1 --2- 172.21.15.1:0/169129981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de682732f0 0x55de686543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.620+0000 7faddd288740 1 -- 172.21.15.1:0/169129981 >> 172.21.15.1:0/169129981 conn(0x55de68290300 msgr2=0x55de6863e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.620+0000 7faddd288740 1 -- 172.21.15.1:0/169129981 shutdown_connections 2024-09-21T01:02:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.620+0000 7faddd288740 1 -- 172.21.15.1:0/169129981 wait complete. 2024-09-21T01:02:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.620+0000 7faddd288740 20 client.16827 trim_cache size 0 max 16384 2024-09-21T01:02:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T01:02:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T01:02:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T01:02:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T01:02:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.621+0000 7fadd6321640 1 -- 172.21.15.1:0/3364694632 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fadbc0b6510 msgr2=0x7fadbc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.621+0000 7fadd6321640 1 --2- 172.21.15.1:0/3364694632 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fadbc0b6510 0x7fadbc0b8a20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fadc0000c00 tx=0x7fadc0031400 comp rx=0 tx=0).stop 2024-09-21T01:02:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.621+0000 7fadd6321640 1 -- 172.21.15.1:0/3364694632 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fadd0104740 msgr2=0x7fadd0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.621+0000 7fadd6321640 1 --2- 172.21.15.1:0/3364694632 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fadd0104740 0x7fadd0075710 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fadb800e9f0 tx=0x7fadb800eeb0 comp rx=0 tx=0).stop 2024-09-21T01:02:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.621+0000 7fadd6321640 1 -- 172.21.15.1:0/3364694632 shutdown_connections 2024-09-21T01:02:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.621+0000 7fadd6321640 1 --2- 172.21.15.1:0/3364694632 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fadbc0b6510 0x7fadbc0b8a20 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.621+0000 7fadd6321640 1 --2- 172.21.15.1:0/3364694632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadd01050e0 0x7fadd0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.621+0000 7fadd6321640 1 --2- 172.21.15.1:0/3364694632 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fadd0104740 0x7fadd0075710 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.621+0000 7fadd6321640 1 --2- 172.21.15.1:0/3364694632 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fadd01036c0 0x7fadd0076e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.621+0000 7fadd6321640 1 -- 172.21.15.1:0/3364694632 >> 172.21.15.1:0/3364694632 conn(0x7fadd00ff000 msgr2=0x7fadd0107a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.621+0000 7fadd6321640 1 -- 172.21.15.1:0/3364694632 shutdown_connections 2024-09-21T01:02:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:09.621+0000 7fadd6321640 1 -- 172.21.15.1:0/3364694632 wait complete. 2024-09-21T01:02:09.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:09 smithi001 ceph-mon[31211]: pgmap v506: 97 pgs: 97 active+clean; 597 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.8 MiB/s wr, 656 op/s 2024-09-21T01:02:09.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:09 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:02:09.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:09 smithi193 ceph-mon[34660]: pgmap v506: 97 pgs: 97 active+clean; 597 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.8 MiB/s wr, 656 op/s 2024-09-21T01:02:09.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:09 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:02:09.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:09 smithi042 ceph-mon[34481]: pgmap v506: 97 pgs: 97 active+clean; 597 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.8 MiB/s wr, 656 op/s 2024-09-21T01:02:09.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:09 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:02:11.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:11 smithi001 ceph-mon[31211]: pgmap v507: 97 pgs: 97 active+clean; 601 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.0 MiB/s wr, 688 op/s 2024-09-21T01:02:11.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:11 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:02:11.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:11 smithi193 ceph-mon[34660]: pgmap v507: 97 pgs: 97 active+clean; 601 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.0 MiB/s wr, 688 op/s 2024-09-21T01:02:11.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:11 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:02:11.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:11 smithi042 ceph-mon[34481]: pgmap v507: 97 pgs: 97 active+clean; 601 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.0 MiB/s wr, 688 op/s 2024-09-21T01:02:11.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:11 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:02:12.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:12 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:02:12.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:12 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:02:12.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:12 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T01:02:12.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:12 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:02:12.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:12 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:02:12.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:12 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T01:02:12.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:12 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:02:12.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:12 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:02:12.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:12 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T01:02:13.560 INFO:tasks.workunit.client.0.smithi001.stdout: 113 2237 3 1389 0 1222 1 2024-09-21T01:02:14.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:13 smithi001 ceph-mon[31211]: pgmap v508: 97 pgs: 97 active+clean; 601 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.5 MiB/s wr, 626 op/s 2024-09-21T01:02:14.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:13 smithi193 ceph-mon[34660]: pgmap v508: 97 pgs: 97 active+clean; 601 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.5 MiB/s wr, 626 op/s 2024-09-21T01:02:14.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:13 smithi042 ceph-mon[34481]: pgmap v508: 97 pgs: 97 active+clean; 601 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.5 MiB/s wr, 626 op/s 2024-09-21T01:02:16.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:15 smithi001 ceph-mon[31211]: pgmap v509: 97 pgs: 97 active+clean; 607 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 623 op/s 2024-09-21T01:02:16.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:15 smithi193 ceph-mon[34660]: pgmap v509: 97 pgs: 97 active+clean; 607 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 623 op/s 2024-09-21T01:02:16.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:15 smithi042 ceph-mon[34481]: pgmap v509: 97 pgs: 97 active+clean; 607 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 623 op/s 2024-09-21T01:02:18.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:17 smithi001 ceph-mon[31211]: pgmap v510: 97 pgs: 97 active+clean; 609 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 556 op/s 2024-09-21T01:02:18.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:17 smithi193 ceph-mon[34660]: pgmap v510: 97 pgs: 97 active+clean; 609 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 556 op/s 2024-09-21T01:02:18.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:17 smithi042 ceph-mon[34481]: pgmap v510: 97 pgs: 97 active+clean; 609 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 556 op/s 2024-09-21T01:02:20.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:19 smithi001 ceph-mon[31211]: pgmap v511: 97 pgs: 97 active+clean; 609 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 510 op/s 2024-09-21T01:02:20.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:19 smithi193 ceph-mon[34660]: pgmap v511: 97 pgs: 97 active+clean; 609 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 510 op/s 2024-09-21T01:02:20.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:19 smithi042 ceph-mon[34481]: pgmap v511: 97 pgs: 97 active+clean; 609 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 510 op/s 2024-09-21T01:02:21.404 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:02:21.677 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:02:22.095 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:21 smithi001 ceph-mon[31211]: pgmap v512: 97 pgs: 97 active+clean; 609 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 536 op/s 2024-09-21T01:02:22.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.191+0000 7f5ae0d64640 1 -- 172.21.15.1:0/2809137223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5adc108d10 msgr2=0x7f5adc10f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:22.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.191+0000 7f5ae0d64640 1 --2- 172.21.15.1:0/2809137223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5adc108d10 0x7f5adc10f540 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4009ca0 tx=0x7f5ad402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.191+0000 7f5ae0d64640 1 -- 172.21.15.1:0/2809137223 shutdown_connections 2024-09-21T01:02:22.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.191+0000 7f5ae0d64640 1 --2- 172.21.15.1:0/2809137223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5adc108d10 0x7f5adc10f540 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.191+0000 7f5ae0d64640 1 --2- 172.21.15.1:0/2809137223 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5adc1083c0 0x7f5adc1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.191+0000 7f5ae0d64640 1 --2- 172.21.15.1:0/2809137223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5adc102a80 0x7f5adc102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.191+0000 7f5ae0d64640 1 -- 172.21.15.1:0/2809137223 >> 172.21.15.1:0/2809137223 conn(0x7f5adc079740 msgr2=0x7f5adc079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:22.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.191+0000 7f5ae0d64640 1 -- 172.21.15.1:0/2809137223 shutdown_connections 2024-09-21T01:02:22.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.191+0000 7f5ae0d64640 1 -- 172.21.15.1:0/2809137223 wait complete. 2024-09-21T01:02:22.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.192+0000 7f5ae0d64640 1 Processor -- start 2024-09-21T01:02:22.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.192+0000 7f5ae0d64640 1 -- start start 2024-09-21T01:02:22.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.192+0000 7f5ae0d64640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5adc102a80 0x7f5adc10fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.192+0000 7f5ae0d64640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5adc1083c0 0x7f5adc110310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.192+0000 7f5ae0d64640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5adc108d10 0x7f5adc110850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.192+0000 7f5ae0d64640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5adc113af0 con 0x7f5adc1083c0 2024-09-21T01:02:22.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.192+0000 7f5ae0d64640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5adc113970 con 0x7f5adc108d10 2024-09-21T01:02:22.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.192+0000 7f5ae0d64640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5adc113c70 con 0x7f5adc102a80 2024-09-21T01:02:22.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.192+0000 7f5ad3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5adc1083c0 0x7f5adc110310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.192+0000 7f5ad3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5adc1083c0 0x7f5adc110310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56196/0 (socket says 172.21.15.1:56196) 2024-09-21T01:02:22.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.192+0000 7f5ad3fff640 1 -- 172.21.15.1:0/2450055666 learned_addr learned my addr 172.21.15.1:0/2450055666 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:02:22.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.192+0000 7f5adad9d640 1 --2- 172.21.15.1:0/2450055666 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5adc108d10 0x7f5adc110850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.192+0000 7f5ada59c640 1 --2- 172.21.15.1:0/2450055666 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5adc102a80 0x7f5adc10fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.193+0000 7f5ad3fff640 1 -- 172.21.15.1:0/2450055666 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5adc102a80 msgr2=0x7f5adc10fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:22.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.193+0000 7f5ad3fff640 1 --2- 172.21.15.1:0/2450055666 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5adc102a80 0x7f5adc10fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.193+0000 7f5ad3fff640 1 -- 172.21.15.1:0/2450055666 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5adc108d10 msgr2=0x7f5adc110850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:22.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.193+0000 7f5ad3fff640 1 --2- 172.21.15.1:0/2450055666 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5adc108d10 0x7f5adc110850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.193+0000 7f5ad3fff640 1 -- 172.21.15.1:0/2450055666 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5adc1a87e0 con 0x7f5adc1083c0 2024-09-21T01:02:22.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.193+0000 7f5ad3fff640 1 --2- 172.21.15.1:0/2450055666 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5adc1083c0 0x7f5adc110310 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f5ac400d770 tx=0x7f5ac400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:22.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.193+0000 7f5ad37fe640 1 -- 172.21.15.1:0/2450055666 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4017070 con 0x7f5adc1083c0 2024-09-21T01:02:22.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.193+0000 7f5ad37fe640 1 -- 172.21.15.1:0/2450055666 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ac4009c30 con 0x7f5adc1083c0 2024-09-21T01:02:22.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.193+0000 7f5ae0d64640 1 -- 172.21.15.1:0/2450055666 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5adc1a8ad0 con 0x7f5adc1083c0 2024-09-21T01:02:22.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.193+0000 7f5ad37fe640 1 -- 172.21.15.1:0/2450055666 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac400f620 con 0x7f5adc1083c0 2024-09-21T01:02:22.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.193+0000 7f5ae0d64640 1 -- 172.21.15.1:0/2450055666 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5adc1a9010 con 0x7f5adc1083c0 2024-09-21T01:02:22.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.196+0000 7f5ae72d8740 1 Processor -- start 2024-09-21T01:02:22.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.196+0000 7f5ae72d8740 1 -- start start 2024-09-21T01:02:22.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.196+0000 7f5ad37fe640 1 -- 172.21.15.1:0/2450055666 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f5ac401a070 con 0x7f5adc1083c0 2024-09-21T01:02:22.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.196+0000 7f5ae72d8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649148ac070 0x564914c53650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.196+0000 7f5ae72d8740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5649148831b0 0x564914c53b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.196+0000 7f5ae72d8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56491488b390 0x564914c540d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.196+0000 7f5ae72d8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564914bc9e50 con 0x5649148ac070 2024-09-21T01:02:22.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.196+0000 7f5ae72d8740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564914bb9280 con 0x5649148831b0 2024-09-21T01:02:22.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.196+0000 7f5ae72d8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564914bbd090 con 0x56491488b390 2024-09-21T01:02:22.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.196+0000 7f5adad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649148ac070 0x564914c53650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.197+0000 7f5adad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649148ac070 0x564914c53650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56208/0 (socket says 172.21.15.1:56208) 2024-09-21T01:02:22.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.197+0000 7f5ada59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5649148831b0 0x564914c53b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.197+0000 7f5adad9d640 1 -- 172.21.15.1:0/1425613953 learned_addr learned my addr 172.21.15.1:0/1425613953 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:02:22.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.197+0000 7f5ad3fff640 1 --2- 172.21.15.1:0/1425613953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56491488b390 0x564914c540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.197+0000 7f5ada59c640 1 -- 172.21.15.1:0/1425613953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56491488b390 msgr2=0x564914c540d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:22.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.197+0000 7f5ada59c640 1 --2- 172.21.15.1:0/1425613953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56491488b390 0x564914c540d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.197+0000 7f5ada59c640 1 -- 172.21.15.1:0/1425613953 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649148ac070 msgr2=0x564914c53650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:22.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.197+0000 7f5ada59c640 1 --2- 172.21.15.1:0/1425613953 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649148ac070 0x564914c53650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.197+0000 7f5ada59c640 1 -- 172.21.15.1:0/1425613953 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564914917650 con 0x5649148831b0 2024-09-21T01:02:22.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.197+0000 7f5adad9d640 1 --2- 172.21.15.1:0/1425613953 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649148ac070 0x564914c53650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:02:22.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.197+0000 7f5ad37fe640 1 --2- 172.21.15.1:0/2450055666 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5ac80b6510 0x7f5ac80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.197+0000 7f5ada59c640 1 --2- 172.21.15.1:0/1425613953 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5649148831b0 0x564914c53b90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5acc009bf0 tx=0x7f5acc011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a933fcfe8382ea0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:22.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.197+0000 7f5adad9d640 1 --2- 172.21.15.1:0/2450055666 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5ac80b6510 0x7f5ac80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.197+0000 7f5ad37fe640 1 -- 172.21.15.1:0/2450055666 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f5ac40e6d70 con 0x7f5adc1083c0 2024-09-21T01:02:22.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.197+0000 7f5ad0ff9640 1 -- 172.21.15.1:0/1425613953 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc004050 con 0x5649148831b0 2024-09-21T01:02:22.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.198+0000 7f5ad0ff9640 1 -- 172.21.15.1:0/1425613953 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5acc0054d0 con 0x5649148831b0 2024-09-21T01:02:22.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.198+0000 7f5ad0ff9640 1 -- 172.21.15.1:0/1425613953 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc004d00 con 0x5649148831b0 2024-09-21T01:02:22.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.198+0000 7f5ae72d8740 1 -- 172.21.15.1:0/1425613953 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5649148831b0 msgr2=0x564914c53b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:22.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.198+0000 7f5ae72d8740 1 --2- 172.21.15.1:0/1425613953 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5649148831b0 0x564914c53b90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5acc009bf0 tx=0x7f5acc011810 comp rx=0 tx=0).stop 2024-09-21T01:02:22.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.198+0000 7f5adad9d640 1 --2- 172.21.15.1:0/2450055666 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5ac80b6510 0x7f5ac80b8a20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5ad402aeb0 tx=0x7f5ad4005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:22.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.198+0000 7f5ae72d8740 1 -- 172.21.15.1:0/1425613953 shutdown_connections 2024-09-21T01:02:22.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.198+0000 7f5ae72d8740 1 --2- 172.21.15.1:0/1425613953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56491488b390 0x564914c540d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.198+0000 7f5ae72d8740 1 --2- 172.21.15.1:0/1425613953 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5649148831b0 0x564914c53b90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.198+0000 7f5ae72d8740 1 --2- 172.21.15.1:0/1425613953 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649148ac070 0x564914c53650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.198+0000 7f5ae72d8740 1 -- 172.21.15.1:0/1425613953 >> 172.21.15.1:0/1425613953 conn(0x5649148a0460 msgr2=0x564914c51540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:22.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.199+0000 7f5ae72d8740 1 -- 172.21.15.1:0/1425613953 shutdown_connections 2024-09-21T01:02:22.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.199+0000 7f5ae72d8740 1 -- 172.21.15.1:0/1425613953 wait complete. 2024-09-21T01:02:22.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.199+0000 7f5ae72d8740 1 -- start start 2024-09-21T01:02:22.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.199+0000 7f5ae72d8740 1 Processor -- start 2024-09-21T01:02:22.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.199+0000 7f5ae72d8740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5649148831b0 0x564914c5ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.199+0000 7f5ae72d8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56491488b390 0x564914c5f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.199+0000 7f5ae72d8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649148ac070 0x564914c5f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.199+0000 7f5ae72d8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564914a1a700 con 0x5649148ac070 2024-09-21T01:02:22.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.199+0000 7f5ae72d8740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564914b54110 con 0x5649148831b0 2024-09-21T01:02:22.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.199+0000 7f5ae72d8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564914c61e30 con 0x56491488b390 2024-09-21T01:02:22.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.199+0000 7f5ae72d8740 10 client.0 _ll_register_callbacks cb 0x564914b6d990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:02:22.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.200+0000 7f5adad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649148ac070 0x564914c5f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.200+0000 7f5ada59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5649148831b0 0x564914c5ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.200+0000 7f5adad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649148ac070 0x564914c5f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56212/0 (socket says 172.21.15.1:56212) 2024-09-21T01:02:22.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.200+0000 7f5ada59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5649148831b0 0x564914c5ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:44290/0 (socket says 172.21.15.1:44290) 2024-09-21T01:02:22.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.200+0000 7f5adad9d640 1 -- 172.21.15.1:0/3634005915 learned_addr learned my addr 172.21.15.1:0/3634005915 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:02:22.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.200+0000 7f5ad3fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56491488b390 0x564914c5f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.200+0000 7f5adad9d640 1 -- 172.21.15.1:0/3634005915 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56491488b390 msgr2=0x564914c5f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:22.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.200+0000 7f5adad9d640 1 --2- 172.21.15.1:0/3634005915 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56491488b390 0x564914c5f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.200+0000 7f5adad9d640 1 -- 172.21.15.1:0/3634005915 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5649148831b0 msgr2=0x564914c5ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:22.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.200+0000 7f5adad9d640 1 --2- 172.21.15.1:0/3634005915 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5649148831b0 0x564914c5ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.200+0000 7f5adad9d640 1 -- 172.21.15.1:0/3634005915 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564914b81c40 con 0x5649148ac070 2024-09-21T01:02:22.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.200+0000 7f5ada59c640 1 --2- 172.21.15.1:0/3634005915 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5649148831b0 0x564914c5ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:02:22.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.200+0000 7f5adad9d640 1 --2- 172.21.15.1:0/3634005915 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649148ac070 0x564914c5f790 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4005e30 tx=0x7f5ad402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=334cd76c26734123 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:22.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.200+0000 7f5ac1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:02:22.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.200+0000 7f5ac1ffb640 1 -- 172.21.15.1:0/3634005915 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad402f610 con 0x5649148ac070 2024-09-21T01:02:22.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.200+0000 7f5ac1ffb640 1 -- 172.21.15.1:0/3634005915 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f5ad402f7b0 con 0x5649148ac070 2024-09-21T01:02:22.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.200+0000 7f5ae72d8740 1 -- 172.21.15.1:0/3634005915 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5acc0054d0 con 0x5649148ac070 2024-09-21T01:02:22.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.201+0000 7f5ac1ffb640 1 -- 172.21.15.1:0/3634005915 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f5ad402f9b0 con 0x5649148ac070 2024-09-21T01:02:22.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.201+0000 7f5ae72d8740 10 client.16839 fetch_fsmap learned FSMap version 33 2024-09-21T01:02:22.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.201+0000 7f5ae72d8740 1 -- 172.21.15.1:0/3634005915 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564914c6da90 con 0x5649148ac070 2024-09-21T01:02:22.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.201+0000 7f5ac1ffb640 1 -- 172.21.15.1:0/3634005915 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5acc0054d0 con 0x5649148ac070 2024-09-21T01:02:22.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.201+0000 7f5ac1ffb640 1 -- 172.21.15.1:0/3634005915 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f5ad4051070 con 0x5649148ac070 2024-09-21T01:02:22.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.201+0000 7f5ae72d8740 10 client.16839 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:02:22.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.201+0000 7f5ae72d8740 10 client.16839 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:02:22.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.201+0000 7f5ae72d8740 20 client.16839 populate_metadata read hostname 'smithi001' 2024-09-21T01:02:22.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.201+0000 7f5ae72d8740 1 --2- 172.21.15.1:0/3634005915 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x56491486a9f0 0x564914c70fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.201+0000 7f5ae72d8740 4 client.16839 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:02:22.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.201+0000 7f5ae72d8740 1 -- 172.21.15.1:0/3634005915 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564914bcbda0 con 0x56491486a9f0 2024-09-21T01:02:22.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.202+0000 7f5ada59c640 1 --2- 172.21.15.1:0/3634005915 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x56491486a9f0 0x564914c70fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.202+0000 7f5ac1ffb640 10 client.16839 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:02:22.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.202+0000 7f5ada59c640 1 --2- 172.21.15.1:0/3634005915 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x56491486a9f0 0x564914c70fb0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d23de608729e401a server_cookie=aa285ddbd7b57153 in_seq=0 out_seq=0 2024-09-21T01:02:22.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.203+0000 7f5ac1ffb640 1 -- 172.21.15.1:0/3634005915 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564914bcbda0 con 0x56491486a9f0 2024-09-21T01:02:22.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.203+0000 7f5ac1ffb640 10 client.16839 handle_command_reply: tid=0 2024-09-21T01:02:22.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.203+0000 7f5ae72d8740 1 client.16839 shutdown 2024-09-21T01:02:22.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.203+0000 7f5ae72d8740 1 -- 172.21.15.1:0/3634005915 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649148ac070 msgr2=0x564914c5f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:22.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.203+0000 7f5ae72d8740 1 --2- 172.21.15.1:0/3634005915 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649148ac070 0x564914c5f790 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4005e30 tx=0x7f5ad402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.203+0000 7f5ae72d8740 1 -- 172.21.15.1:0/3634005915 shutdown_connections 2024-09-21T01:02:22.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.203+0000 7f5ae72d8740 1 --2- 172.21.15.1:0/3634005915 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x56491486a9f0 0x564914c70fb0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.203+0000 7f5ae72d8740 1 --2- 172.21.15.1:0/3634005915 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649148ac070 0x564914c5f790 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.203+0000 7f5ae72d8740 1 --2- 172.21.15.1:0/3634005915 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56491488b390 0x564914c5f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.203+0000 7f5ae72d8740 1 --2- 172.21.15.1:0/3634005915 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5649148831b0 0x564914c5ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.203+0000 7f5ae72d8740 1 -- 172.21.15.1:0/3634005915 >> 172.21.15.1:0/3634005915 conn(0x5649148a0460 msgr2=0x564914c56830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:22.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.203+0000 7f5ac1ffb640 0 client.16839 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:02:22.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.204+0000 7f5ae72d8740 1 -- 172.21.15.1:0/3634005915 shutdown_connections 2024-09-21T01:02:22.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.204+0000 7f5ae72d8740 1 -- 172.21.15.1:0/3634005915 wait complete. 2024-09-21T01:02:22.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.204+0000 7f5ae72d8740 20 client.16839 trim_cache size 0 max 16384 2024-09-21T01:02:22.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.222+0000 7f5ae72d8740 1 Processor -- start 2024-09-21T01:02:22.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.222+0000 7f5ae72d8740 1 -- start start 2024-09-21T01:02:22.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.223+0000 7f5ae72d8740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5649148a0460 0x564914c60940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.223+0000 7f5ae72d8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649148831b0 0x564914c50b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.223+0000 7f5ae72d8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56491488b390 0x564914c510b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.223+0000 7f5ae72d8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5adc1b16c0 con 0x5649148831b0 2024-09-21T01:02:22.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.223+0000 7f5ae72d8740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5adc1b32c0 con 0x5649148a0460 2024-09-21T01:02:22.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.223+0000 7f5ae72d8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5adc1b1d90 con 0x56491488b390 2024-09-21T01:02:22.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.223+0000 7f5ad3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649148831b0 0x564914c50b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.223+0000 7f5ada59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5649148a0460 0x564914c60940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.223+0000 7f5ada59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5649148a0460 0x564914c60940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:44298/0 (socket says 172.21.15.1:44298) 2024-09-21T01:02:22.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.223+0000 7f5ad3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649148831b0 0x564914c50b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56218/0 (socket says 172.21.15.1:56218) 2024-09-21T01:02:22.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.223+0000 7f5ada59c640 1 -- 172.21.15.1:0/2518024182 learned_addr learned my addr 172.21.15.1:0/2518024182 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:02:22.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.223+0000 7f5adad9d640 1 --2- 172.21.15.1:0/2518024182 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56491488b390 0x564914c510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.223+0000 7f5ada59c640 1 -- 172.21.15.1:0/2518024182 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56491488b390 msgr2=0x564914c510b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:22.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.223+0000 7f5ada59c640 1 --2- 172.21.15.1:0/2518024182 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56491488b390 0x564914c510b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.223+0000 7f5ada59c640 1 -- 172.21.15.1:0/2518024182 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649148831b0 msgr2=0x564914c50b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:22.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.223+0000 7f5ada59c640 1 --2- 172.21.15.1:0/2518024182 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649148831b0 0x564914c50b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.223+0000 7f5ada59c640 1 -- 172.21.15.1:0/2518024182 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564914c5ffd0 con 0x5649148a0460 2024-09-21T01:02:22.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.223+0000 7f5adad9d640 1 --2- 172.21.15.1:0/2518024182 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56491488b390 0x564914c510b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:02:22.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.223+0000 7f5ada59c640 1 --2- 172.21.15.1:0/2518024182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5649148a0460 0x564914c60940 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5acc01a000 tx=0x7f5acc005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fdf5a4b81c76d81 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:22.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.224+0000 7f5ac3fff640 1 -- 172.21.15.1:0/2518024182 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc032030 con 0x5649148a0460 2024-09-21T01:02:22.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.224+0000 7f5ac3fff640 1 -- 172.21.15.1:0/2518024182 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5acc009da0 con 0x5649148a0460 2024-09-21T01:02:22.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.224+0000 7f5ac3fff640 1 -- 172.21.15.1:0/2518024182 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc019690 con 0x5649148a0460 2024-09-21T01:02:22.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.224+0000 7f5ae72d8740 1 -- 172.21.15.1:0/2518024182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5649148a0460 msgr2=0x564914c60940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:22.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.224+0000 7f5ae72d8740 1 --2- 172.21.15.1:0/2518024182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5649148a0460 0x564914c60940 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5acc01a000 tx=0x7f5acc005f90 comp rx=0 tx=0).stop 2024-09-21T01:02:22.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.225+0000 7f5ae72d8740 1 -- 172.21.15.1:0/2518024182 shutdown_connections 2024-09-21T01:02:22.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.225+0000 7f5ae72d8740 1 --2- 172.21.15.1:0/2518024182 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56491488b390 0x564914c510b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.225+0000 7f5ae72d8740 1 --2- 172.21.15.1:0/2518024182 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649148831b0 0x564914c50b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.225+0000 7f5ae72d8740 1 --2- 172.21.15.1:0/2518024182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5649148a0460 0x564914c60940 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.225+0000 7f5ae72d8740 1 -- 172.21.15.1:0/2518024182 >> 172.21.15.1:0/2518024182 conn(0x564914c6b590 msgr2=0x564914c60230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:22.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.225+0000 7f5ae72d8740 1 -- 172.21.15.1:0/2518024182 shutdown_connections 2024-09-21T01:02:22.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.225+0000 7f5ae72d8740 1 -- 172.21.15.1:0/2518024182 wait complete. 2024-09-21T01:02:22.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.225+0000 7f5ae72d8740 1 -- start start 2024-09-21T01:02:22.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.225+0000 7f5ae72d8740 1 Processor -- start 2024-09-21T01:02:22.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.225+0000 7f5ae72d8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5649148831b0 0x564914c67920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.225+0000 7f5ae72d8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56491488b390 0x564914c62dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.225+0000 7f5ae72d8740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5649148a0460 0x564914c63390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.226+0000 7f5ae72d8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5adc1b2bf0 con 0x56491488b390 2024-09-21T01:02:22.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.226+0000 7f5ae72d8740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5adc1b2520 con 0x5649148a0460 2024-09-21T01:02:22.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.226+0000 7f5ae72d8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5adc1af6a0 con 0x5649148831b0 2024-09-21T01:02:22.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.226+0000 7f5ae72d8740 10 client.0 _ll_register_callbacks cb 0x7f5ad4009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:02:22.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.226+0000 7f5ad3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56491488b390 0x564914c62dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.226+0000 7f5ad3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56491488b390 0x564914c62dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56220/0 (socket says 172.21.15.1:56220) 2024-09-21T01:02:22.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.226+0000 7f5ad3fff640 1 -- 172.21.15.1:0/3698902881 learned_addr learned my addr 172.21.15.1:0/3698902881 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:02:22.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.226+0000 7f5ada59c640 1 --2- 172.21.15.1:0/3698902881 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5649148831b0 0x564914c67920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.226+0000 7f5adad9d640 1 --2- 172.21.15.1:0/3698902881 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5649148a0460 0x564914c63390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.226+0000 7f5ad3fff640 1 -- 172.21.15.1:0/3698902881 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5649148831b0 msgr2=0x564914c67920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:22.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.226+0000 7f5ad3fff640 1 --2- 172.21.15.1:0/3698902881 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5649148831b0 0x564914c67920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.226+0000 7f5ad3fff640 1 -- 172.21.15.1:0/3698902881 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5649148a0460 msgr2=0x564914c63390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:22.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.226+0000 7f5ad3fff640 1 --2- 172.21.15.1:0/3698902881 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5649148a0460 0x564914c63390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.226+0000 7f5ad3fff640 1 -- 172.21.15.1:0/3698902881 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564914c63b20 con 0x56491488b390 2024-09-21T01:02:22.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.226+0000 7f5ad3fff640 1 --2- 172.21.15.1:0/3698902881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56491488b390 0x564914c62dd0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f5ac40aa200 tx=0x7f5ac400de80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c5979dabb390b82 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:22.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.226+0000 7f5ac1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:02:22.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.227+0000 7f5ac1ffb640 1 -- 172.21.15.1:0/3698902881 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4021070 con 0x56491488b390 2024-09-21T01:02:22.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.227+0000 7f5ac1ffb640 1 -- 172.21.15.1:0/3698902881 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f5ac40940b0 con 0x56491488b390 2024-09-21T01:02:22.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.227+0000 7f5ae72d8740 1 -- 172.21.15.1:0/3698902881 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5acc009da0 con 0x56491488b390 2024-09-21T01:02:22.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.227+0000 7f5ac1ffb640 1 -- 172.21.15.1:0/3698902881 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f5ac40acd60 con 0x56491488b390 2024-09-21T01:02:22.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.227+0000 7f5ae72d8740 10 client.16845 fetch_fsmap learned FSMap version 33 2024-09-21T01:02:22.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.227+0000 7f5ae72d8740 1 -- 172.21.15.1:0/3698902881 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564914cdb940 con 0x56491488b390 2024-09-21T01:02:22.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.227+0000 7f5ac1ffb640 1 -- 172.21.15.1:0/3698902881 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5acc009da0 con 0x56491488b390 2024-09-21T01:02:22.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.227+0000 7f5ac1ffb640 1 -- 172.21.15.1:0/3698902881 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f5ac40ea020 con 0x56491488b390 2024-09-21T01:02:22.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.227+0000 7f5ae72d8740 10 client.16845 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:02:22.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.227+0000 7f5ae72d8740 10 client.16845 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:02:22.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.227+0000 7f5ae72d8740 20 client.16845 populate_metadata read hostname 'smithi001' 2024-09-21T01:02:22.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.227+0000 7f5ae72d8740 1 --2- 172.21.15.1:0/3698902881 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5649148ac070 0x564914cde080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.227+0000 7f5ae72d8740 4 client.16845 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:02:22.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.227+0000 7f5ae72d8740 1 -- 172.21.15.1:0/3698902881 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564914bc7850 con 0x5649148ac070 2024-09-21T01:02:22.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.228+0000 7f5ada59c640 1 --2- 172.21.15.1:0/3698902881 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5649148ac070 0x564914cde080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.228+0000 7f5ada59c640 1 --2- 172.21.15.1:0/3698902881 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5649148ac070 0x564914cde080 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c44ac95b02bb88b server_cookie=b6fc84c09cefaa08 in_seq=0 out_seq=0 2024-09-21T01:02:22.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.228+0000 7f5ac1ffb640 10 client.16845 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:02:22.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.228+0000 7f5ac1ffb640 1 -- 172.21.15.1:0/3698902881 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2558 (crc 0 0 0) 0x564914bc7850 con 0x5649148ac070 2024-09-21T01:02:22.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.228+0000 7f5ac1ffb640 10 client.16845 handle_command_reply: tid=0 2024-09-21T01:02:22.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.228+0000 7f5ae72d8740 1 client.16845 shutdown 2024-09-21T01:02:22.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.228+0000 7f5ae72d8740 1 -- 172.21.15.1:0/3698902881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56491488b390 msgr2=0x564914c62dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:22.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.228+0000 7f5ae72d8740 1 --2- 172.21.15.1:0/3698902881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56491488b390 0x564914c62dd0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f5ac40aa200 tx=0x7f5ac400de80 comp rx=0 tx=0).stop 2024-09-21T01:02:22.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.229+0000 7f5ae72d8740 1 -- 172.21.15.1:0/3698902881 shutdown_connections 2024-09-21T01:02:22.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.229+0000 7f5ae72d8740 1 --2- 172.21.15.1:0/3698902881 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5649148ac070 0x564914cde080 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.229+0000 7f5ae72d8740 1 --2- 172.21.15.1:0/3698902881 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5649148a0460 0x564914c63390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.229+0000 7f5ae72d8740 1 --2- 172.21.15.1:0/3698902881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56491488b390 0x564914c62dd0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.229+0000 7f5ae72d8740 1 --2- 172.21.15.1:0/3698902881 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5649148831b0 0x564914c67920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.229+0000 7f5ae72d8740 1 -- 172.21.15.1:0/3698902881 >> 172.21.15.1:0/3698902881 conn(0x564914c6b590 msgr2=0x564914c56750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:22.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.229+0000 7f5ac1ffb640 0 client.16845 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:02:22.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.229+0000 7f5ae72d8740 1 -- 172.21.15.1:0/3698902881 shutdown_connections 2024-09-21T01:02:22.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.229+0000 7f5ae72d8740 1 -- 172.21.15.1:0/3698902881 wait complete. 2024-09-21T01:02:22.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.229+0000 7f5ae72d8740 20 client.16845 trim_cache size 0 max 16384 2024-09-21T01:02:22.238 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T01:02:22.239 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T01:02:22.239 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": { 2024-09-21T01:02:22.239 INFO:teuthology.orchestra.run.smithi001.stdout: "d9a37a97-ce14-4763-8c19-9bd32df63cf3": { 2024-09-21T01:02:22.239 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:02:22.239 INFO:teuthology.orchestra.run.smithi001.stdout: "tag": "d9a37a97-ce14-4763-8c19-9bd32df63cf3", 2024-09-21T01:02:22.239 INFO:teuthology.orchestra.run.smithi001.stdout: "options": "recursive,force" 2024-09-21T01:02:22.239 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:02:22.239 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:02:22.239 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_stats": { 2024-09-21T01:02:22.239 INFO:teuthology.orchestra.run.smithi001.stdout: "c2addc95-c922-4a70-b746-0b5fd2af59bf": { 2024-09-21T01:02:22.239 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:00:52.374848+0000", 2024-09-21T01:02:22.239 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:02:22.239 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:02:22.239 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:02:22.239 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:02:22.240 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:02:22.240 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:02:22.240 INFO:teuthology.orchestra.run.smithi001.stdout: "d9a37a97-ce14-4763-8c19-9bd32df63cf3": { 2024-09-21T01:02:22.240 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:01:45.914443+0000", 2024-09-21T01:02:22.240 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:02:22.240 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:02:22.240 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:02:22.240 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:02:22.240 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:02:22.240 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:02:22.240 INFO:teuthology.orchestra.run.smithi001.stdout: "f826f2c1-768a-47bb-b868-785b351ac6b4": { 2024-09-21T01:02:22.240 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:59:06.554657+0000", 2024-09-21T01:02:22.240 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:02:22.240 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:02:22.241 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:02:22.241 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:02:22.241 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:02:22.241 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:02:22.241 INFO:teuthology.orchestra.run.smithi001.stdout: "1bffed0d-34b1-4e8b-9cab-7501131ef79d": { 2024-09-21T01:02:22.241 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:00:02.564228+0000", 2024-09-21T01:02:22.241 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:02:22.241 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:02:22.241 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:02:22.241 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:02:22.241 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:02:22.241 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:02:22.241 INFO:teuthology.orchestra.run.smithi001.stdout: "bee49cce-b407-4617-a959-331ffd8dc5b0": { 2024-09-21T01:02:22.241 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:58:17.883027+0000", 2024-09-21T01:02:22.241 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:02:22.242 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:02:22.242 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:02:22.242 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:02:22.242 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:02:22.242 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:02:22.242 INFO:teuthology.orchestra.run.smithi001.stdout: "7cb1bc3f-e2d2-4bf7-b13e-8f3371d7aac1": { 2024-09-21T01:02:22.242 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:58:02.751142+0000", 2024-09-21T01:02:22.242 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:02:22.242 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:02:22.242 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:02:22.242 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:02:22.242 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:02:22.242 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:02:22.242 INFO:teuthology.orchestra.run.smithi001.stdout: "2383a19c-993d-4440-99f7-93b43dcf33b4": { 2024-09-21T01:02:22.243 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:47.609257+0000", 2024-09-21T01:02:22.243 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:02:22.243 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:02:22.243 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:02:22.243 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:02:22.243 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:02:22.243 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:02:22.243 INFO:teuthology.orchestra.run.smithi001.stdout: "53fa74e4-5aa8-408b-9724-7c93618f7636": { 2024-09-21T01:02:22.243 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:01.730608+0000", 2024-09-21T01:02:22.243 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:02:22.243 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:02:22.243 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:02:22.243 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:02:22.243 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:02:22.243 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:02:22.244 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:02:22.244 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T01:02:22.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.229+0000 7f5ae0d64640 1 -- 172.21.15.1:0/2450055666 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5ac80b6510 msgr2=0x7f5ac80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:22.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.229+0000 7f5ae0d64640 1 --2- 172.21.15.1:0/2450055666 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5ac80b6510 0x7f5ac80b8a20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5ad402aeb0 tx=0x7f5ad4005d80 comp rx=0 tx=0).stop 2024-09-21T01:02:22.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.229+0000 7f5ae0d64640 1 -- 172.21.15.1:0/2450055666 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5adc1083c0 msgr2=0x7f5adc110310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:22.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.229+0000 7f5ae0d64640 1 --2- 172.21.15.1:0/2450055666 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5adc1083c0 0x7f5adc110310 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f5ac400d770 tx=0x7f5ac400dc30 comp rx=0 tx=0).stop 2024-09-21T01:02:22.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.229+0000 7f5ae0d64640 1 -- 172.21.15.1:0/2450055666 shutdown_connections 2024-09-21T01:02:22.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.229+0000 7f5ae0d64640 1 --2- 172.21.15.1:0/2450055666 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5adc108d10 0x7f5adc110850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.229+0000 7f5ae0d64640 1 --2- 172.21.15.1:0/2450055666 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5ac80b6510 0x7f5ac80b8a20 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.229+0000 7f5ae0d64640 1 --2- 172.21.15.1:0/2450055666 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5adc1083c0 0x7f5adc110310 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.229+0000 7f5ae0d64640 1 --2- 172.21.15.1:0/2450055666 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5adc102a80 0x7f5adc10fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.230+0000 7f5ae0d64640 1 -- 172.21.15.1:0/2450055666 >> 172.21.15.1:0/2450055666 conn(0x7f5adc079740 msgr2=0x7f5adc105310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:22.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.230+0000 7f5ae0d64640 1 -- 172.21.15.1:0/2450055666 shutdown_connections 2024-09-21T01:02:22.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:22.230+0000 7f5ae0d64640 1 -- 172.21.15.1:0/2450055666 wait complete. 2024-09-21T01:02:22.245 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:21 smithi042 ceph-mon[34481]: pgmap v512: 97 pgs: 97 active+clean; 609 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 536 op/s 2024-09-21T01:02:22.246 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:21 smithi193 ceph-mon[34660]: pgmap v512: 97 pgs: 97 active+clean; 609 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 536 op/s 2024-09-21T01:02:22.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.727+0000 7f811eff1640 1 -- 172.21.15.1:0/2530731777 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8118103fe0 msgr2=0x7f811810a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:22.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.727+0000 7f811eff1640 1 --2- 172.21.15.1:0/2530731777 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8118103fe0 0x7f811810a980 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f8110009ca0 tx=0x7f811002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.727+0000 7f811eff1640 1 -- 172.21.15.1:0/2530731777 shutdown_connections 2024-09-21T01:02:22.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.727+0000 7f811eff1640 1 --2- 172.21.15.1:0/2530731777 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8118103fe0 0x7f811810a980 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.727+0000 7f811eff1640 1 --2- 172.21.15.1:0/2530731777 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8118103640 0x7f8118103a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.727+0000 7f811eff1640 1 --2- 172.21.15.1:0/2530731777 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81181025c0 0x7f8118102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.727+0000 7f811eff1640 1 -- 172.21.15.1:0/2530731777 >> 172.21.15.1:0/2530731777 conn(0x7f81180fdf00 msgr2=0x7f81181003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:22.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.727+0000 7f811eff1640 1 -- 172.21.15.1:0/2530731777 shutdown_connections 2024-09-21T01:02:22.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.727+0000 7f811eff1640 1 -- 172.21.15.1:0/2530731777 wait complete. 2024-09-21T01:02:22.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.728+0000 7f811eff1640 1 Processor -- start 2024-09-21T01:02:22.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.728+0000 7f811eff1640 1 -- start start 2024-09-21T01:02:22.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.728+0000 7f811eff1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81181025c0 0x7f8118199f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.728+0000 7f811eff1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8118103640 0x7f811819a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.728+0000 7f811eff1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8118103fe0 0x7f811819b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.728+0000 7f811eff1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f811810e210 con 0x7f8118103640 2024-09-21T01:02:22.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.728+0000 7f811eff1640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f811810e090 con 0x7f81181025c0 2024-09-21T01:02:22.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.728+0000 7f811eff1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f811810e390 con 0x7f8118103fe0 2024-09-21T01:02:22.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.728+0000 7f8117fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8118103640 0x7f811819a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.728+0000 7f8117fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8118103640 0x7f811819a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56236/0 (socket says 172.21.15.1:56236) 2024-09-21T01:02:22.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.728+0000 7f8117fff640 1 -- 172.21.15.1:0/1036113649 learned_addr learned my addr 172.21.15.1:0/1036113649 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:02:22.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.728+0000 7f811cd8d640 1 --2- 172.21.15.1:0/1036113649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81181025c0 0x7f8118199f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.728+0000 7f811d58e640 1 --2- 172.21.15.1:0/1036113649 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8118103fe0 0x7f811819b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.728+0000 7f8117fff640 1 -- 172.21.15.1:0/1036113649 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8118103fe0 msgr2=0x7f811819b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:22.733 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.729+0000 7f8117fff640 1 --2- 172.21.15.1:0/1036113649 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8118103fe0 0x7f811819b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.733 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.729+0000 7f8117fff640 1 -- 172.21.15.1:0/1036113649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81181025c0 msgr2=0x7f8118199f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:22.733 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.729+0000 7f8117fff640 1 --2- 172.21.15.1:0/1036113649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81181025c0 0x7f8118199f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.733 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.729+0000 7f8117fff640 1 -- 172.21.15.1:0/1036113649 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f811819b940 con 0x7f8118103640 2024-09-21T01:02:22.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.729+0000 7f8117fff640 1 --2- 172.21.15.1:0/1036113649 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8118103640 0x7f811819a570 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f810400d770 tx=0x7f810400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:22.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.729+0000 7f8115ffb640 1 -- 172.21.15.1:0/1036113649 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8104017070 con 0x7f8118103640 2024-09-21T01:02:22.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.729+0000 7f8115ffb640 1 -- 172.21.15.1:0/1036113649 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81040054d0 con 0x7f8118103640 2024-09-21T01:02:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.729+0000 7f8115ffb640 1 -- 172.21.15.1:0/1036113649 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8104004c30 con 0x7f8118103640 2024-09-21T01:02:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.729+0000 7f811eff1640 1 -- 172.21.15.1:0/1036113649 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f811819bc30 con 0x7f8118103640 2024-09-21T01:02:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.729+0000 7f811eff1640 1 -- 172.21.15.1:0/1036113649 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81181a2320 con 0x7f8118103640 2024-09-21T01:02:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.732+0000 7f8115ffb640 1 -- 172.21.15.1:0/1036113649 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f8104004e10 con 0x7f8118103640 2024-09-21T01:02:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.732+0000 7f812603d740 1 Processor -- start 2024-09-21T01:02:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.732+0000 7f812603d740 1 -- start start 2024-09-21T01:02:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.732+0000 7f812603d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55687df411b0 0x55687e2e8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.732+0000 7f812603d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55687df182f0 0x55687e2e94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.732+0000 7f812603d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55687df204d0 0x55687e2ea010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.732+0000 7f812603d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55687e25b6f0 con 0x55687df204d0 2024-09-21T01:02:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.732+0000 7f812603d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55687e24ab20 con 0x55687df411b0 2024-09-21T01:02:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.732+0000 7f812603d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55687e24e930 con 0x55687df182f0 2024-09-21T01:02:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.732+0000 7f8117fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55687df204d0 0x55687e2ea010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.732+0000 7f811d58e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55687df411b0 0x55687e2e8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.732+0000 7f811d58e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55687df411b0 0x55687e2e8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:44338/0 (socket says 172.21.15.1:44338) 2024-09-21T01:02:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.732+0000 7f811d58e640 1 -- 172.21.15.1:0/2504987210 learned_addr learned my addr 172.21.15.1:0/2504987210 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:02:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.732+0000 7f811cd8d640 1 --2- 172.21.15.1:0/2504987210 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55687df182f0 0x55687e2e94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.733+0000 7f811d58e640 1 -- 172.21.15.1:0/2504987210 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55687df182f0 msgr2=0x55687e2e94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:22.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.733+0000 7f811d58e640 1 --2- 172.21.15.1:0/2504987210 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55687df182f0 0x55687e2e94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.733+0000 7f811d58e640 1 -- 172.21.15.1:0/2504987210 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55687df204d0 msgr2=0x55687e2ea010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:22.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.733+0000 7f811d58e640 1 --2- 172.21.15.1:0/2504987210 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55687df204d0 0x55687e2ea010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.733+0000 7f811d58e640 1 -- 172.21.15.1:0/2504987210 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55687e210530 con 0x55687df411b0 2024-09-21T01:02:22.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.733+0000 7f811d58e640 1 --2- 172.21.15.1:0/2504987210 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55687df411b0 0x55687e2e8e50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8110006010 tx=0x7f811002f3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9458dd605afac31b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:22.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.733+0000 7f8115ffb640 1 --2- 172.21.15.1:0/1036113649 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f81080b6590 0x7f81080b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.733+0000 7f8102ffd640 1 -- 172.21.15.1:0/2504987210 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8110031650 con 0x55687df411b0 2024-09-21T01:02:22.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.733+0000 7f8102ffd640 1 -- 172.21.15.1:0/2504987210 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8110036070 con 0x55687df411b0 2024-09-21T01:02:22.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.733+0000 7f8102ffd640 1 -- 172.21.15.1:0/2504987210 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8110004700 con 0x55687df411b0 2024-09-21T01:02:22.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.733+0000 7f811cd8d640 1 --2- 172.21.15.1:0/1036113649 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f81080b6590 0x7f81080b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.733+0000 7f8115ffb640 1 -- 172.21.15.1:0/1036113649 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f81040e6dc0 con 0x7f8118103640 2024-09-21T01:02:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.734+0000 7f812603d740 1 -- 172.21.15.1:0/2504987210 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55687df411b0 msgr2=0x55687e2e8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.734+0000 7f811cd8d640 1 --2- 172.21.15.1:0/1036113649 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f81080b6590 0x7f81080b8aa0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f810c009d00 tx=0x7f810c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.734+0000 7f812603d740 1 --2- 172.21.15.1:0/2504987210 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55687df411b0 0x55687e2e8e50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8110006010 tx=0x7f811002f3a0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.734+0000 7f812603d740 1 -- 172.21.15.1:0/2504987210 shutdown_connections 2024-09-21T01:02:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.734+0000 7f812603d740 1 --2- 172.21.15.1:0/2504987210 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55687df204d0 0x55687e2ea010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.734+0000 7f812603d740 1 --2- 172.21.15.1:0/2504987210 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55687df182f0 0x55687e2e94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.734+0000 7f812603d740 1 --2- 172.21.15.1:0/2504987210 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55687df411b0 0x55687e2e8e50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.734+0000 7f812603d740 1 -- 172.21.15.1:0/2504987210 >> 172.21.15.1:0/2504987210 conn(0x55687df35300 msgr2=0x55687e2e48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.734+0000 7f812603d740 1 -- 172.21.15.1:0/2504987210 shutdown_connections 2024-09-21T01:02:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.734+0000 7f812603d740 1 -- 172.21.15.1:0/2504987210 wait complete. 2024-09-21T01:02:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.734+0000 7f812603d740 1 -- start start 2024-09-21T01:02:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.735+0000 7f812603d740 1 Processor -- start 2024-09-21T01:02:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.735+0000 7f812603d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55687df182f0 0x55687e2f25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.735+0000 7f812603d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55687df204d0 0x55687e2f2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.735+0000 7f812603d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55687df411b0 0x55687e2f37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.735+0000 7f812603d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55687e182ab0 con 0x55687df182f0 2024-09-21T01:02:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.735+0000 7f812603d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55687e1f0730 con 0x55687df411b0 2024-09-21T01:02:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.735+0000 7f812603d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55687e2eaad0 con 0x55687df204d0 2024-09-21T01:02:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.735+0000 7f812603d740 10 client.0 _ll_register_callbacks cb 0x55687e2446b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:02:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.735+0000 7f811cd8d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55687df182f0 0x55687e2f25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.735+0000 7f811cd8d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55687df182f0 0x55687e2f25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56254/0 (socket says 172.21.15.1:56254) 2024-09-21T01:02:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.735+0000 7f811cd8d640 1 -- 172.21.15.1:0/3376719465 learned_addr learned my addr 172.21.15.1:0/3376719465 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:02:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.735+0000 7f811d58e640 1 --2- 172.21.15.1:0/3376719465 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55687df411b0 0x55687e2f37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.735+0000 7f8117fff640 1 --2- 172.21.15.1:0/3376719465 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55687df204d0 0x55687e2f2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.735+0000 7f811cd8d640 1 -- 172.21.15.1:0/3376719465 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55687df204d0 msgr2=0x55687e2f2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.735+0000 7f811cd8d640 1 --2- 172.21.15.1:0/3376719465 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55687df204d0 0x55687e2f2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.735+0000 7f811cd8d640 1 -- 172.21.15.1:0/3376719465 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55687df411b0 msgr2=0x55687e2f37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.735+0000 7f811cd8d640 1 --2- 172.21.15.1:0/3376719465 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55687df411b0 0x55687e2f37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.735+0000 7f811cd8d640 1 -- 172.21.15.1:0/3376719465 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55687dfac790 con 0x55687df182f0 2024-09-21T01:02:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.736+0000 7f811cd8d640 1 --2- 172.21.15.1:0/3376719465 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55687df182f0 0x55687e2f25a0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f810c01e9f0 tx=0x7f810c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45810c4220949ef8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.736+0000 7f80f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:02:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.736+0000 7f80f7fff640 1 -- 172.21.15.1:0/3376719465 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810c02e060 con 0x55687df182f0 2024-09-21T01:02:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.736+0000 7f80f7fff640 1 -- 172.21.15.1:0/3376719465 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f810c018030 con 0x55687df182f0 2024-09-21T01:02:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.736+0000 7f812603d740 1 -- 172.21.15.1:0/3376719465 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8110036070 con 0x55687df182f0 2024-09-21T01:02:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.736+0000 7f80f7fff640 1 -- 172.21.15.1:0/3376719465 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f810c029420 con 0x55687df182f0 2024-09-21T01:02:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.736+0000 7f812603d740 10 client.16857 fetch_fsmap learned FSMap version 33 2024-09-21T01:02:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.736+0000 7f812603d740 1 -- 172.21.15.1:0/3376719465 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55687e025620 con 0x55687df182f0 2024-09-21T01:02:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.736+0000 7f80f7fff640 1 -- 172.21.15.1:0/3376719465 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8110036070 con 0x55687df182f0 2024-09-21T01:02:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.736+0000 7f80f7fff640 1 -- 172.21.15.1:0/3376719465 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f810c00f550 con 0x55687df182f0 2024-09-21T01:02:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.737+0000 7f812603d740 10 client.16857 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:02:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.737+0000 7f812603d740 10 client.16857 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:02:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.737+0000 7f812603d740 20 client.16857 populate_metadata read hostname 'smithi001' 2024-09-21T01:02:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.737+0000 7f812603d740 1 --2- 172.21.15.1:0/3376719465 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55687deffd80 0x55687e2ffd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.737+0000 7f812603d740 4 client.16857 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:02:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.737+0000 7f812603d740 1 -- 172.21.15.1:0/3376719465 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55687e25d640 con 0x55687deffd80 2024-09-21T01:02:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.737+0000 7f8117fff640 1 --2- 172.21.15.1:0/3376719465 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55687deffd80 0x55687e2ffd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.737+0000 7f8117fff640 1 --2- 172.21.15.1:0/3376719465 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55687deffd80 0x55687e2ffd90 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=279ad8ec2fc42424 server_cookie=67fc0841071558b2 in_seq=0 out_seq=0 2024-09-21T01:02:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.737+0000 7f80f7fff640 10 client.16857 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:02:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.738+0000 7f80f7fff640 1 -- 172.21.15.1:0/3376719465 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55687e25d640 con 0x55687deffd80 2024-09-21T01:02:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.738+0000 7f80f7fff640 10 client.16857 handle_command_reply: tid=0 2024-09-21T01:02:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.738+0000 7f812603d740 1 client.16857 shutdown 2024-09-21T01:02:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.738+0000 7f812603d740 1 -- 172.21.15.1:0/3376719465 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55687df182f0 msgr2=0x55687e2f25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.738+0000 7f812603d740 1 --2- 172.21.15.1:0/3376719465 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55687df182f0 0x55687e2f25a0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f810c01e9f0 tx=0x7f810c004730 comp rx=0 tx=0).stop 2024-09-21T01:02:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.738+0000 7f812603d740 1 -- 172.21.15.1:0/3376719465 shutdown_connections 2024-09-21T01:02:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.738+0000 7f812603d740 1 --2- 172.21.15.1:0/3376719465 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55687deffd80 0x55687e2ffd90 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.746 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.738+0000 7f812603d740 1 --2- 172.21.15.1:0/3376719465 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55687df411b0 0x55687e2f37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.746 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.738+0000 7f812603d740 1 --2- 172.21.15.1:0/3376719465 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55687df204d0 0x55687e2f2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.746 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.738+0000 7f80f7fff640 0 client.16857 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:02:22.746 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.738+0000 7f812603d740 1 --2- 172.21.15.1:0/3376719465 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55687df182f0 0x55687e2f25a0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.746 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.738+0000 7f812603d740 1 -- 172.21.15.1:0/3376719465 >> 172.21.15.1:0/3376719465 conn(0x55687df35300 msgr2=0x55687e2e2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:22.746 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.739+0000 7f812603d740 1 -- 172.21.15.1:0/3376719465 shutdown_connections 2024-09-21T01:02:22.746 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.739+0000 7f812603d740 1 -- 172.21.15.1:0/3376719465 wait complete. 2024-09-21T01:02:22.746 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.739+0000 7f812603d740 20 client.16857 trim_cache size 0 max 16384 2024-09-21T01:02:22.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.755+0000 7f812603d740 1 Processor -- start 2024-09-21T01:02:22.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.755+0000 7f812603d740 1 -- start start 2024-09-21T01:02:22.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.756+0000 7f812603d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55687df182f0 0x55687e2ed6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.756+0000 7f812603d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55687df204d0 0x55687e2f0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.756+0000 7f812603d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55687df411b0 0x55687e2f0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.756+0000 7f812603d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f81181aaff0 con 0x55687df411b0 2024-09-21T01:02:22.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.756+0000 7f812603d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f81181acbf0 con 0x55687df182f0 2024-09-21T01:02:22.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.756+0000 7f812603d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f81181ab6c0 con 0x55687df204d0 2024-09-21T01:02:22.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.756+0000 7f811d58e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55687df411b0 0x55687e2f0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.756+0000 7f811d58e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55687df411b0 0x55687e2f0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56268/0 (socket says 172.21.15.1:56268) 2024-09-21T01:02:22.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.756+0000 7f811d58e640 1 -- 172.21.15.1:0/4250912523 learned_addr learned my addr 172.21.15.1:0/4250912523 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:02:22.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.756+0000 7f811cd8d640 1 --2- 172.21.15.1:0/4250912523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55687df182f0 0x55687e2ed6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.756+0000 7f8117fff640 1 --2- 172.21.15.1:0/4250912523 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55687df204d0 0x55687e2f0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.756+0000 7f811d58e640 1 -- 172.21.15.1:0/4250912523 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55687df204d0 msgr2=0x55687e2f0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:22.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.756+0000 7f811d58e640 1 --2- 172.21.15.1:0/4250912523 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55687df204d0 0x55687e2f0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.756+0000 7f811d58e640 1 -- 172.21.15.1:0/4250912523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55687df182f0 msgr2=0x55687e2ed6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:22.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.756+0000 7f811d58e640 1 --2- 172.21.15.1:0/4250912523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55687df182f0 0x55687e2ed6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.756+0000 7f811d58e640 1 -- 172.21.15.1:0/4250912523 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55687e2f0720 con 0x55687df411b0 2024-09-21T01:02:22.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.756+0000 7f811d58e640 1 --2- 172.21.15.1:0/4250912523 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55687df411b0 0x55687e2f0fe0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f8110009dc0 tx=0x7f8110004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4698d9641f6e51eb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:22.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.756+0000 7f81027fc640 1 -- 172.21.15.1:0/4250912523 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8110049040 con 0x55687df411b0 2024-09-21T01:02:22.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.757+0000 7f81027fc640 1 -- 172.21.15.1:0/4250912523 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8110036040 con 0x55687df411b0 2024-09-21T01:02:22.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.757+0000 7f81027fc640 1 -- 172.21.15.1:0/4250912523 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8110004630 con 0x55687df411b0 2024-09-21T01:02:22.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.757+0000 7f812603d740 1 -- 172.21.15.1:0/4250912523 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55687df411b0 msgr2=0x55687e2f0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:22.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.757+0000 7f812603d740 1 --2- 172.21.15.1:0/4250912523 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55687df411b0 0x55687e2f0fe0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f8110009dc0 tx=0x7f8110004a40 comp rx=0 tx=0).stop 2024-09-21T01:02:22.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.757+0000 7f812603d740 1 -- 172.21.15.1:0/4250912523 shutdown_connections 2024-09-21T01:02:22.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.757+0000 7f812603d740 1 --2- 172.21.15.1:0/4250912523 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55687df411b0 0x55687e2f0fe0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.757+0000 7f812603d740 1 --2- 172.21.15.1:0/4250912523 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55687df204d0 0x55687e2f0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.757+0000 7f812603d740 1 --2- 172.21.15.1:0/4250912523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55687df182f0 0x55687e2ed6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.757+0000 7f812603d740 1 -- 172.21.15.1:0/4250912523 >> 172.21.15.1:0/4250912523 conn(0x55687df35300 msgr2=0x55687e2ecfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:22.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.757+0000 7f812603d740 1 -- 172.21.15.1:0/4250912523 shutdown_connections 2024-09-21T01:02:22.762 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.757+0000 7f812603d740 1 -- 172.21.15.1:0/4250912523 wait complete. 2024-09-21T01:02:22.762 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.758+0000 7f812603d740 1 -- start start 2024-09-21T01:02:22.762 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.758+0000 7f812603d740 1 Processor -- start 2024-09-21T01:02:22.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.758+0000 7f812603d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55687df182f0 0x55687e2f95d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.758+0000 7f812603d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55687df204d0 0x55687e2f9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.758+0000 7f812603d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55687df411b0 0x55687e2fa070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.758+0000 7f812603d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f81181ac520 con 0x55687df182f0 2024-09-21T01:02:22.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.758+0000 7f812603d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f81181abe50 con 0x55687df411b0 2024-09-21T01:02:22.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.758+0000 7f812603d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f81181a8fd0 con 0x55687df204d0 2024-09-21T01:02:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.758+0000 7f812603d740 10 client.0 _ll_register_callbacks cb 0x7f810c009a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:02:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.758+0000 7f811cd8d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55687df182f0 0x55687e2f95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.758+0000 7f811cd8d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55687df182f0 0x55687e2f95d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56278/0 (socket says 172.21.15.1:56278) 2024-09-21T01:02:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.758+0000 7f811cd8d640 1 -- 172.21.15.1:0/2641913337 learned_addr learned my addr 172.21.15.1:0/2641913337 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:02:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.759+0000 7f811d58e640 1 --2- 172.21.15.1:0/2641913337 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55687df411b0 0x55687e2fa070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.759+0000 7f811cd8d640 1 -- 172.21.15.1:0/2641913337 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55687df204d0 msgr2=0x55687e2f9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.759+0000 7f811cd8d640 1 --2- 172.21.15.1:0/2641913337 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55687df204d0 0x55687e2f9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.759+0000 7f811cd8d640 1 -- 172.21.15.1:0/2641913337 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55687df411b0 msgr2=0x55687e2fa070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.759+0000 7f811cd8d640 1 --2- 172.21.15.1:0/2641913337 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55687df411b0 0x55687e2fa070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.759+0000 7f811cd8d640 1 -- 172.21.15.1:0/2641913337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55687e2f83c0 con 0x55687df182f0 2024-09-21T01:02:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.759+0000 7f811cd8d640 1 --2- 172.21.15.1:0/2641913337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55687df182f0 0x55687e2f95d0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f810c012cb0 tx=0x7f810c005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=906754179de8b4f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.759+0000 7f80f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:02:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.759+0000 7f80f7fff640 1 -- 172.21.15.1:0/2641913337 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810c038030 con 0x55687df182f0 2024-09-21T01:02:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.759+0000 7f80f7fff640 1 -- 172.21.15.1:0/2641913337 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f810c024040 con 0x55687df182f0 2024-09-21T01:02:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.759+0000 7f812603d740 1 -- 172.21.15.1:0/2641913337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8110036040 con 0x55687df182f0 2024-09-21T01:02:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.759+0000 7f80f7fff640 1 -- 172.21.15.1:0/2641913337 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f810c00f770 con 0x55687df182f0 2024-09-21T01:02:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.759+0000 7f812603d740 10 client.16863 fetch_fsmap learned FSMap version 33 2024-09-21T01:02:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.759+0000 7f812603d740 1 -- 172.21.15.1:0/2641913337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55687e36ac70 con 0x55687df182f0 2024-09-21T01:02:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.760+0000 7f80f7fff640 1 -- 172.21.15.1:0/2641913337 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8110036040 con 0x55687df182f0 2024-09-21T01:02:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.760+0000 7f80f7fff640 1 -- 172.21.15.1:0/2641913337 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f810c004c60 con 0x55687df182f0 2024-09-21T01:02:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.760+0000 7f812603d740 10 client.16863 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:02:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.760+0000 7f812603d740 10 client.16863 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:02:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.760+0000 7f812603d740 20 client.16863 populate_metadata read hostname 'smithi001' 2024-09-21T01:02:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.760+0000 7f812603d740 1 --2- 172.21.15.1:0/2641913337 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55687ded51c0 0x55687e36d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.760+0000 7f812603d740 4 client.16863 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:02:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.760+0000 7f812603d740 1 -- 172.21.15.1:0/2641913337 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55687e2590f0 con 0x55687ded51c0 2024-09-21T01:02:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.760+0000 7f8117fff640 1 --2- 172.21.15.1:0/2641913337 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55687ded51c0 0x55687e36d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.760+0000 7f80f7fff640 10 client.16863 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:02:22.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.760+0000 7f8117fff640 1 --2- 172.21.15.1:0/2641913337 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55687ded51c0 0x55687e36d600 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b5914731d377201 server_cookie=c103182360423996 in_seq=0 out_seq=0 2024-09-21T01:02:22.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.771+0000 7f80f7fff640 1 -- 172.21.15.1:0/2641913337 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55687e2590f0 con 0x55687ded51c0 2024-09-21T01:02:22.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.771+0000 7f80f7fff640 10 client.16863 handle_command_reply: tid=0 2024-09-21T01:02:22.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.771+0000 7f812603d740 1 client.16863 shutdown 2024-09-21T01:02:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.771+0000 7f812603d740 1 -- 172.21.15.1:0/2641913337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55687df182f0 msgr2=0x55687e2f95d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.771+0000 7f812603d740 1 --2- 172.21.15.1:0/2641913337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55687df182f0 0x55687e2f95d0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f810c012cb0 tx=0x7f810c005e70 comp rx=0 tx=0).stop 2024-09-21T01:02:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.771+0000 7f812603d740 1 -- 172.21.15.1:0/2641913337 shutdown_connections 2024-09-21T01:02:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.771+0000 7f812603d740 1 --2- 172.21.15.1:0/2641913337 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55687ded51c0 0x55687e36d600 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.771+0000 7f812603d740 1 --2- 172.21.15.1:0/2641913337 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55687df411b0 0x55687e2fa070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.771+0000 7f80f7fff640 0 client.16863 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:02:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.771+0000 7f812603d740 1 --2- 172.21.15.1:0/2641913337 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55687df204d0 0x55687e2f9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.771+0000 7f812603d740 1 --2- 172.21.15.1:0/2641913337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55687df182f0 0x55687e2f95d0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.771+0000 7f812603d740 1 -- 172.21.15.1:0/2641913337 >> 172.21.15.1:0/2641913337 conn(0x55687df35300 msgr2=0x55687e2e5e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.771+0000 7f812603d740 1 -- 172.21.15.1:0/2641913337 shutdown_connections 2024-09-21T01:02:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.771+0000 7f812603d740 1 -- 172.21.15.1:0/2641913337 wait complete. 2024-09-21T01:02:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.772+0000 7f812603d740 20 client.16863 trim_cache size 0 max 16384 2024-09-21T01:02:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T01:02:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T01:02:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T01:02:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T01:02:22.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.772+0000 7f811eff1640 1 -- 172.21.15.1:0/1036113649 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f81080b6590 msgr2=0x7f81080b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:22.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.772+0000 7f811eff1640 1 --2- 172.21.15.1:0/1036113649 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f81080b6590 0x7f81080b8aa0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f810c009d00 tx=0x7f810c005f90 comp rx=0 tx=0).stop 2024-09-21T01:02:22.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.772+0000 7f811eff1640 1 -- 172.21.15.1:0/1036113649 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8118103640 msgr2=0x7f811819a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:22.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.772+0000 7f811eff1640 1 --2- 172.21.15.1:0/1036113649 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8118103640 0x7f811819a570 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f810400d770 tx=0x7f810400dc30 comp rx=0 tx=0).stop 2024-09-21T01:02:22.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.772+0000 7f811eff1640 1 -- 172.21.15.1:0/1036113649 shutdown_connections 2024-09-21T01:02:22.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.772+0000 7f811eff1640 1 --2- 172.21.15.1:0/1036113649 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8118103fe0 0x7f811819b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.772+0000 7f811eff1640 1 --2- 172.21.15.1:0/1036113649 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f81080b6590 0x7f81080b8aa0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.772+0000 7f811eff1640 1 --2- 172.21.15.1:0/1036113649 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8118103640 0x7f811819a570 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.772+0000 7f811eff1640 1 --2- 172.21.15.1:0/1036113649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81181025c0 0x7f8118199f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.772+0000 7f811eff1640 1 -- 172.21.15.1:0/1036113649 >> 172.21.15.1:0/1036113649 conn(0x7f81180fdf00 msgr2=0x7f81180ff810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:22.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.772+0000 7f811eff1640 1 -- 172.21.15.1:0/1036113649 shutdown_connections 2024-09-21T01:02:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:22.772+0000 7f811eff1640 1 -- 172.21.15.1:0/1036113649 wait complete. 2024-09-21T01:02:23.037 INFO:tasks.cephfs.filesystem:scrub status for tag:d9a37a97-ce14-4763-8c19-9bd32df63cf3 - {'path': '/', 'tag': 'd9a37a97-ce14-4763-8c19-9bd32df63cf3', 'options': 'recursive,force'} 2024-09-21T01:02:23.561 INFO:tasks.workunit.client.0.smithi001.stdout: 114 13396 132 8282 64 8372 214 2024-09-21T01:02:24.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:23 smithi001 ceph-mon[31211]: pgmap v513: 97 pgs: 97 active+clean; 613 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 467 op/s 2024-09-21T01:02:24.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:23 smithi193 ceph-mon[34660]: pgmap v513: 97 pgs: 97 active+clean; 613 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 467 op/s 2024-09-21T01:02:24.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:23 smithi042 ceph-mon[34481]: pgmap v513: 97 pgs: 97 active+clean; 613 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 467 op/s 2024-09-21T01:02:26.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:25 smithi001 ceph-mon[31211]: pgmap v514: 97 pgs: 97 active+clean; 613 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 421 op/s 2024-09-21T01:02:26.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:25 smithi193 ceph-mon[34660]: pgmap v514: 97 pgs: 97 active+clean; 613 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 421 op/s 2024-09-21T01:02:26.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:25 smithi042 ceph-mon[34481]: pgmap v514: 97 pgs: 97 active+clean; 613 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 421 op/s 2024-09-21T01:02:28.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:27 smithi001 ceph-mon[31211]: pgmap v515: 97 pgs: 97 active+clean; 612 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 781 KiB/s rd, 882 KiB/s wr, 275 op/s 2024-09-21T01:02:28.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:27 smithi193 ceph-mon[34660]: pgmap v515: 97 pgs: 97 active+clean; 612 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 781 KiB/s rd, 882 KiB/s wr, 275 op/s 2024-09-21T01:02:28.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:27 smithi042 ceph-mon[34481]: pgmap v515: 97 pgs: 97 active+clean; 612 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 781 KiB/s rd, 882 KiB/s wr, 275 op/s 2024-09-21T01:02:29.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:28 smithi001 ceph-mon[31211]: scrub summary: idle 2024-09-21T01:02:29.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:28 smithi001 ceph-mon[31211]: scrub summary: idle 2024-09-21T01:02:29.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:28 smithi001 ceph-mon[31211]: scrub summary: idle 2024-09-21T01:02:29.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:28 smithi001 ceph-mon[31211]: scrub summary: idle 2024-09-21T01:02:29.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:28 smithi193 ceph-mon[34660]: scrub summary: idle 2024-09-21T01:02:29.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:28 smithi193 ceph-mon[34660]: scrub summary: idle 2024-09-21T01:02:29.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:28 smithi193 ceph-mon[34660]: scrub summary: idle 2024-09-21T01:02:29.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:28 smithi193 ceph-mon[34660]: scrub summary: idle 2024-09-21T01:02:29.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:28 smithi042 ceph-mon[34481]: scrub summary: idle 2024-09-21T01:02:29.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:28 smithi042 ceph-mon[34481]: scrub summary: idle 2024-09-21T01:02:29.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:28 smithi042 ceph-mon[34481]: scrub summary: idle 2024-09-21T01:02:29.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:28 smithi042 ceph-mon[34481]: scrub summary: idle 2024-09-21T01:02:30.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:29 smithi001 ceph-mon[31211]: scrub summary: idle 2024-09-21T01:02:30.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:29 smithi001 ceph-mon[31211]: pgmap v516: 97 pgs: 97 active+clean; 605 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 870 KiB/s wr, 178 op/s 2024-09-21T01:02:30.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:29 smithi193 ceph-mon[34660]: scrub summary: idle 2024-09-21T01:02:30.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:29 smithi193 ceph-mon[34660]: pgmap v516: 97 pgs: 97 active+clean; 605 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 870 KiB/s wr, 178 op/s 2024-09-21T01:02:30.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:29 smithi042 ceph-mon[34481]: scrub summary: idle 2024-09-21T01:02:30.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:29 smithi042 ceph-mon[34481]: pgmap v516: 97 pgs: 97 active+clean; 605 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 870 KiB/s wr, 178 op/s 2024-09-21T01:02:32.173 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:31 smithi001 ceph-mon[31211]: pgmap v517: 97 pgs: 97 active+clean; 603 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 1.3 MiB/s wr, 182 op/s 2024-09-21T01:02:32.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:31 smithi193 ceph-mon[34660]: pgmap v517: 97 pgs: 97 active+clean; 603 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 1.3 MiB/s wr, 182 op/s 2024-09-21T01:02:32.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:31 smithi042 ceph-mon[34481]: pgmap v517: 97 pgs: 97 active+clean; 603 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 1.3 MiB/s wr, 182 op/s 2024-09-21T01:02:33.561 INFO:tasks.workunit.client.0.smithi001.stdout: 116 465586 252 302957 204 261209 724 2024-09-21T01:02:34.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:33 smithi001 ceph-mon[31211]: pgmap v518: 97 pgs: 97 active+clean; 596 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 1.5 MiB/s wr, 157 op/s 2024-09-21T01:02:34.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:33 smithi193 ceph-mon[34660]: pgmap v518: 97 pgs: 97 active+clean; 596 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 1.5 MiB/s wr, 157 op/s 2024-09-21T01:02:34.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:33 smithi042 ceph-mon[34481]: pgmap v518: 97 pgs: 97 active+clean; 596 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 1.5 MiB/s wr, 157 op/s 2024-09-21T01:02:36.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:35 smithi001 ceph-mon[31211]: pgmap v519: 97 pgs: 97 active+clean; 597 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 1.3 MiB/s wr, 130 op/s 2024-09-21T01:02:36.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:35 smithi193 ceph-mon[34660]: pgmap v519: 97 pgs: 97 active+clean; 597 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 1.3 MiB/s wr, 130 op/s 2024-09-21T01:02:36.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:35 smithi042 ceph-mon[34481]: pgmap v519: 97 pgs: 97 active+clean; 597 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 1.3 MiB/s wr, 130 op/s 2024-09-21T01:02:36.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.583+0000 7f2393fff640 1 -- 172.21.15.1:0/3840492976 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f239410cd20 msgr2=0x7f239410f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:36.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.583+0000 7f2393fff640 1 --2- 172.21.15.1:0/3840492976 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f239410cd20 0x7f239410f140 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2384009900 tx=0x7f238402a410 comp rx=0 tx=0).stop 2024-09-21T01:02:36.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.584+0000 7f2393fff640 1 -- 172.21.15.1:0/3840492976 shutdown_connections 2024-09-21T01:02:36.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.584+0000 7f2393fff640 1 --2- 172.21.15.1:0/3840492976 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f239410f830 0x7f239410fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:36.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.584+0000 7f2393fff640 1 --2- 172.21.15.1:0/3840492976 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f239410cd20 0x7f239410f140 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:36.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.584+0000 7f2393fff640 1 --2- 172.21.15.1:0/3840492976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f239410a3c0 0x7f239410c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:36.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.584+0000 7f2393fff640 1 -- 172.21.15.1:0/3840492976 >> 172.21.15.1:0/3840492976 conn(0x7f23940706a0 msgr2=0x7f2394072ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:36.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.584+0000 7f2393fff640 1 -- 172.21.15.1:0/3840492976 shutdown_connections 2024-09-21T01:02:36.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.584+0000 7f2393fff640 1 -- 172.21.15.1:0/3840492976 wait complete. 2024-09-21T01:02:36.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.585+0000 7f2393fff640 1 Processor -- start 2024-09-21T01:02:36.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.586+0000 7f2393fff640 1 -- start start 2024-09-21T01:02:36.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.586+0000 7f2393fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f239410a3c0 0x7f23941a8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:36.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.586+0000 7f2393fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f239410f830 0x7f23941a9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:36.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.586+0000 7f2393fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23941a9dc0 0x7f23941aa2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:36.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.586+0000 7f2393fff640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f239411df80 con 0x7f23941a9dc0 2024-09-21T01:02:36.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.586+0000 7f2393fff640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f239411de00 con 0x7f239410a3c0 2024-09-21T01:02:36.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.586+0000 7f2393fff640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f239411e100 con 0x7f239410f830 2024-09-21T01:02:36.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.586+0000 7f23937fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23941a9dc0 0x7f23941aa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:36.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.586+0000 7f23937fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23941a9dc0 0x7f23941aa2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43270/0 (socket says 172.21.15.1:43270) 2024-09-21T01:02:36.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.586+0000 7f23937fe640 1 -- 172.21.15.1:0/3212250550 learned_addr learned my addr 172.21.15.1:0/3212250550 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:02:36.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.586+0000 7f2392ffd640 1 --2- 172.21.15.1:0/3212250550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f239410a3c0 0x7f23941a8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:36.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.587+0000 7f23927fc640 1 --2- 172.21.15.1:0/3212250550 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f239410f830 0x7f23941a9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:36.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.587+0000 7f23937fe640 1 -- 172.21.15.1:0/3212250550 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f239410f830 msgr2=0x7f23941a9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:36.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.587+0000 7f23937fe640 1 --2- 172.21.15.1:0/3212250550 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f239410f830 0x7f23941a9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:36.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.587+0000 7f23937fe640 1 -- 172.21.15.1:0/3212250550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f239410a3c0 msgr2=0x7f23941a8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:36.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.587+0000 7f23937fe640 1 --2- 172.21.15.1:0/3212250550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f239410a3c0 0x7f23941a8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:36.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.587+0000 7f23937fe640 1 -- 172.21.15.1:0/3212250550 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23941aaae0 con 0x7f23941a9dc0 2024-09-21T01:02:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.587+0000 7f2392ffd640 1 --2- 172.21.15.1:0/3212250550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f239410a3c0 0x7f23941a8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:02:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.587+0000 7f23937fe640 1 --2- 172.21.15.1:0/3212250550 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23941a9dc0 0x7f23941aa2c0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f238800e970 tx=0x7f238800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.588+0000 7f237bfff640 1 -- 172.21.15.1:0/3212250550 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238800ccc0 con 0x7f23941a9dc0 2024-09-21T01:02:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.588+0000 7f237bfff640 1 -- 172.21.15.1:0/3212250550 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f238800ce60 con 0x7f23941a9dc0 2024-09-21T01:02:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.588+0000 7f237bfff640 1 -- 172.21.15.1:0/3212250550 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2388010430 con 0x7f23941a9dc0 2024-09-21T01:02:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.588+0000 7f2393fff640 1 -- 172.21.15.1:0/3212250550 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2394111b50 con 0x7f23941a9dc0 2024-09-21T01:02:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.588+0000 7f2393fff640 1 -- 172.21.15.1:0/3212250550 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2394112050 con 0x7f23941a9dc0 2024-09-21T01:02:36.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.592+0000 7f23a045d740 1 Processor -- start 2024-09-21T01:02:36.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.594+0000 7f237bfff640 1 -- 172.21.15.1:0/3212250550 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f2388004f90 con 0x7f23941a9dc0 2024-09-21T01:02:36.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.595+0000 7f23a045d740 1 -- start start 2024-09-21T01:02:36.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.595+0000 7f23a045d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d131b81b0 0x558d13560040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:36.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.595+0000 7f23a045d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d1318f2f0 0x558d135606b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:36.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.595+0000 7f23a045d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d131974d0 0x558d13561200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:36.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.595+0000 7f23a045d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558d134d26f0 con 0x558d1318f2f0 2024-09-21T01:02:36.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.595+0000 7f23a045d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558d134c1b20 con 0x558d131b81b0 2024-09-21T01:02:36.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.595+0000 7f23a045d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558d134c5930 con 0x558d131974d0 2024-09-21T01:02:36.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.596+0000 7f23927fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d131b81b0 0x558d13560040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:36.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.596+0000 7f23927fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d131b81b0 0x558d13560040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:45000/0 (socket says 172.21.15.1:45000) 2024-09-21T01:02:36.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.596+0000 7f23927fc640 1 -- 172.21.15.1:0/586963333 learned_addr learned my addr 172.21.15.1:0/586963333 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:02:36.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.596+0000 7f2392ffd640 1 --2- 172.21.15.1:0/586963333 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d1318f2f0 0x558d135606b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:36.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.596+0000 7f23927fc640 1 --2- 172.21.15.1:0/586963333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d131974d0 0x558d13561200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:36.598 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.596+0000 7f2392ffd640 1 -- 172.21.15.1:0/586963333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d131974d0 msgr2=0x558d13561200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:36.598 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.596+0000 7f2392ffd640 1 --2- 172.21.15.1:0/586963333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d131974d0 0x558d13561200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:36.598 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.596+0000 7f2392ffd640 1 -- 172.21.15.1:0/586963333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d131b81b0 msgr2=0x558d13560040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:36.598 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.596+0000 7f2392ffd640 1 --2- 172.21.15.1:0/586963333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d131b81b0 0x558d13560040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:36.598 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.596+0000 7f2392ffd640 1 -- 172.21.15.1:0/586963333 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d13487530 con 0x558d1318f2f0 2024-09-21T01:02:36.598 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.596+0000 7f23927fc640 1 --2- 172.21.15.1:0/586963333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d131974d0 0x558d13561200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:02:36.598 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.597+0000 7f2392ffd640 1 --2- 172.21.15.1:0/586963333 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d1318f2f0 0x558d135606b0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f238c005fd0 tx=0x7f238c011c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a67421cd8ae0a5d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:36.598 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.597+0000 7f237bfff640 1 --2- 172.21.15.1:0/3212250550 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f237c0b65b0 0x7f237c0b8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:36.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.597+0000 7f23927fc640 1 --2- 172.21.15.1:0/3212250550 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f237c0b65b0 0x7f237c0b8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:36.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.597+0000 7f237bfff640 1 -- 172.21.15.1:0/3212250550 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f23880e76f0 con 0x7f23941a9dc0 2024-09-21T01:02:36.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.597+0000 7f23797fa640 1 -- 172.21.15.1:0/586963333 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c003c30 con 0x558d1318f2f0 2024-09-21T01:02:36.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.598+0000 7f23797fa640 1 -- 172.21.15.1:0/586963333 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f238c00fe50 con 0x558d1318f2f0 2024-09-21T01:02:36.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.598+0000 7f23797fa640 1 -- 172.21.15.1:0/586963333 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c0193e0 con 0x558d1318f2f0 2024-09-21T01:02:36.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.599+0000 7f23a045d740 1 -- 172.21.15.1:0/586963333 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d1318f2f0 msgr2=0x558d135606b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:36.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.599+0000 7f23927fc640 1 --2- 172.21.15.1:0/3212250550 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f237c0b65b0 0x7f237c0b8ac0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f23840096c0 tx=0x7f2384043040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:36.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.599+0000 7f23a045d740 1 --2- 172.21.15.1:0/586963333 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d1318f2f0 0x558d135606b0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f238c005fd0 tx=0x7f238c011c70 comp rx=0 tx=0).stop 2024-09-21T01:02:36.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.599+0000 7f23a045d740 1 -- 172.21.15.1:0/586963333 shutdown_connections 2024-09-21T01:02:36.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.599+0000 7f23a045d740 1 --2- 172.21.15.1:0/586963333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d131974d0 0x558d13561200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:36.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.599+0000 7f23a045d740 1 --2- 172.21.15.1:0/586963333 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d1318f2f0 0x558d135606b0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:36.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.599+0000 7f23a045d740 1 --2- 172.21.15.1:0/586963333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d131b81b0 0x558d13560040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:36.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.599+0000 7f23a045d740 1 -- 172.21.15.1:0/586963333 >> 172.21.15.1:0/586963333 conn(0x558d131ac300 msgr2=0x558d1355bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:36.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.599+0000 7f23a045d740 1 -- 172.21.15.1:0/586963333 shutdown_connections 2024-09-21T01:02:36.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.600+0000 7f23a045d740 1 -- 172.21.15.1:0/586963333 wait complete. 2024-09-21T01:02:36.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.600+0000 7f23a045d740 1 -- start start 2024-09-21T01:02:36.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.601+0000 7f23a045d740 1 Processor -- start 2024-09-21T01:02:36.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.601+0000 7f23a045d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d1318f2f0 0x558d135697f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:36.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.601+0000 7f23a045d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d131974d0 0x558d13569eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:36.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.601+0000 7f23a045d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d131b81b0 0x558d1356aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:36.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.601+0000 7f23a045d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558d133f9ab0 con 0x558d1318f2f0 2024-09-21T01:02:36.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.601+0000 7f23a045d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558d13467730 con 0x558d131b81b0 2024-09-21T01:02:36.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.601+0000 7f23a045d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558d13561d20 con 0x558d131974d0 2024-09-21T01:02:36.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.601+0000 7f23a045d740 10 client.0 _ll_register_callbacks cb 0x558d134bb6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:02:36.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.601+0000 7f2392ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d1318f2f0 0x558d135697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:36.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.601+0000 7f2392ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d1318f2f0 0x558d135697f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43292/0 (socket says 172.21.15.1:43292) 2024-09-21T01:02:36.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.601+0000 7f2392ffd640 1 -- 172.21.15.1:0/1652834571 learned_addr learned my addr 172.21.15.1:0/1652834571 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:02:36.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.601+0000 7f23937fe640 1 --2- 172.21.15.1:0/1652834571 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d131b81b0 0x558d1356aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:36.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.602+0000 7f23927fc640 1 --2- 172.21.15.1:0/1652834571 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d131974d0 0x558d13569eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:36.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.602+0000 7f2392ffd640 1 -- 172.21.15.1:0/1652834571 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d131974d0 msgr2=0x558d13569eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:36.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.602+0000 7f2392ffd640 1 --2- 172.21.15.1:0/1652834571 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d131974d0 0x558d13569eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:36.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.602+0000 7f2392ffd640 1 -- 172.21.15.1:0/1652834571 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d131b81b0 msgr2=0x558d1356aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:36.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.602+0000 7f2392ffd640 1 --2- 172.21.15.1:0/1652834571 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d131b81b0 0x558d1356aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:36.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.602+0000 7f2392ffd640 1 -- 172.21.15.1:0/1652834571 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d13223790 con 0x558d1318f2f0 2024-09-21T01:02:36.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.602+0000 7f2392ffd640 1 --2- 172.21.15.1:0/1652834571 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d1318f2f0 0x558d135697f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f238c009a00 tx=0x7f238c00f9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49c0b3d5edbbd01c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:36.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.602+0000 7f2376ff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:02:36.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.603+0000 7f2376ff5640 1 -- 172.21.15.1:0/1652834571 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c01f040 con 0x558d1318f2f0 2024-09-21T01:02:36.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.603+0000 7f2376ff5640 1 -- 172.21.15.1:0/1652834571 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f238c011040 con 0x558d1318f2f0 2024-09-21T01:02:36.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.603+0000 7f23a045d740 1 -- 172.21.15.1:0/1652834571 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f238c00fe50 con 0x558d1318f2f0 2024-09-21T01:02:36.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.603+0000 7f2376ff5640 1 -- 172.21.15.1:0/1652834571 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f238c011240 con 0x558d1318f2f0 2024-09-21T01:02:36.605 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.603+0000 7f23a045d740 10 client.16875 fetch_fsmap learned FSMap version 33 2024-09-21T01:02:36.605 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.603+0000 7f23a045d740 1 -- 172.21.15.1:0/1652834571 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558d1329c620 con 0x558d1318f2f0 2024-09-21T01:02:36.605 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.604+0000 7f2376ff5640 1 -- 172.21.15.1:0/1652834571 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f238c00fe50 con 0x558d1318f2f0 2024-09-21T01:02:36.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.604+0000 7f2376ff5640 1 -- 172.21.15.1:0/1652834571 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f238c018070 con 0x558d1318f2f0 2024-09-21T01:02:36.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.604+0000 7f23a045d740 10 client.16875 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:02:36.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.604+0000 7f23a045d740 10 client.16875 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:02:36.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.604+0000 7f23a045d740 20 client.16875 populate_metadata read hostname 'smithi001' 2024-09-21T01:02:36.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.604+0000 7f23a045d740 1 --2- 172.21.15.1:0/1652834571 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558d13176d80 0x558d13576cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:36.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.604+0000 7f23a045d740 4 client.16875 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:02:36.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.604+0000 7f23a045d740 1 -- 172.21.15.1:0/1652834571 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d134d4640 con 0x558d13176d80 2024-09-21T01:02:36.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.604+0000 7f23927fc640 1 --2- 172.21.15.1:0/1652834571 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558d13176d80 0x558d13576cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:36.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.605+0000 7f2376ff5640 10 client.16875 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:02:36.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.605+0000 7f23927fc640 1 --2- 172.21.15.1:0/1652834571 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558d13176d80 0x558d13576cd0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d92428a84545696e server_cookie=c649a3107fbdf027 in_seq=0 out_seq=0 2024-09-21T01:02:36.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.606+0000 7f2376ff5640 1 -- 172.21.15.1:0/1652834571 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558d134d4640 con 0x558d13176d80 2024-09-21T01:02:36.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.606+0000 7f2376ff5640 10 client.16875 handle_command_reply: tid=0 2024-09-21T01:02:36.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.607+0000 7f23a045d740 1 client.16875 shutdown 2024-09-21T01:02:36.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.607+0000 7f23a045d740 1 -- 172.21.15.1:0/1652834571 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d1318f2f0 msgr2=0x558d135697f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:36.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.607+0000 7f23a045d740 1 --2- 172.21.15.1:0/1652834571 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d1318f2f0 0x558d135697f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f238c009a00 tx=0x7f238c00f9a0 comp rx=0 tx=0).stop 2024-09-21T01:02:36.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.607+0000 7f23a045d740 1 -- 172.21.15.1:0/1652834571 shutdown_connections 2024-09-21T01:02:36.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.607+0000 7f23a045d740 1 --2- 172.21.15.1:0/1652834571 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558d13176d80 0x558d13576cd0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:36.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.607+0000 7f23a045d740 1 --2- 172.21.15.1:0/1652834571 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d131b81b0 0x558d1356aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:36.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.607+0000 7f2376ff5640 0 client.16875 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:02:36.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.607+0000 7f23a045d740 1 --2- 172.21.15.1:0/1652834571 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d131974d0 0x558d13569eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:36.609 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.607+0000 7f23a045d740 1 --2- 172.21.15.1:0/1652834571 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d1318f2f0 0x558d135697f0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:36.609 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.607+0000 7f23a045d740 1 -- 172.21.15.1:0/1652834571 >> 172.21.15.1:0/1652834571 conn(0x558d131ac300 msgr2=0x558d1355a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:36.609 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.607+0000 7f23a045d740 1 -- 172.21.15.1:0/1652834571 shutdown_connections 2024-09-21T01:02:36.609 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.607+0000 7f23a045d740 1 -- 172.21.15.1:0/1652834571 wait complete. 2024-09-21T01:02:36.609 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.607+0000 7f23a045d740 20 client.16875 trim_cache size 0 max 16384 2024-09-21T01:02:36.633 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.631+0000 7f23a045d740 1 Processor -- start 2024-09-21T01:02:36.633 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.631+0000 7f23a045d740 1 -- start start 2024-09-21T01:02:36.633 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.632+0000 7f23a045d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d13176d80 0x558d13564810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:36.633 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.632+0000 7f23a045d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d1318f2f0 0x558d1355bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.632+0000 7f23a045d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d131974d0 0x558d1355c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.632+0000 7f23a045d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f23941c29a0 con 0x558d13176d80 2024-09-21T01:02:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.632+0000 7f23a045d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f23941c45a0 con 0x558d1318f2f0 2024-09-21T01:02:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.632+0000 7f23a045d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f23941c3070 con 0x558d131974d0 2024-09-21T01:02:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.632+0000 7f2392ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d13176d80 0x558d13564810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.632+0000 7f2392ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d13176d80 0x558d13564810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43304/0 (socket says 172.21.15.1:43304) 2024-09-21T01:02:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.632+0000 7f2392ffd640 1 -- 172.21.15.1:0/1573408304 learned_addr learned my addr 172.21.15.1:0/1573408304 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:02:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.632+0000 7f23927fc640 1 --2- 172.21.15.1:0/1573408304 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d1318f2f0 0x558d1355bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.632+0000 7f23937fe640 1 --2- 172.21.15.1:0/1573408304 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d131974d0 0x558d1355c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.632+0000 7f2392ffd640 1 -- 172.21.15.1:0/1573408304 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d131974d0 msgr2=0x558d1355c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.632+0000 7f2392ffd640 1 --2- 172.21.15.1:0/1573408304 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d131974d0 0x558d1355c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.632+0000 7f2392ffd640 1 -- 172.21.15.1:0/1573408304 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d1318f2f0 msgr2=0x558d1355bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.632+0000 7f2392ffd640 1 --2- 172.21.15.1:0/1573408304 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d1318f2f0 0x558d1355bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.632+0000 7f2392ffd640 1 -- 172.21.15.1:0/1573408304 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d13577230 con 0x558d13176d80 2024-09-21T01:02:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.632+0000 7f23937fe640 1 --2- 172.21.15.1:0/1573408304 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d131974d0 0x558d1355c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:02:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.632+0000 7f23927fc640 1 --2- 172.21.15.1:0/1573408304 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d1318f2f0 0x558d1355bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:02:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.632+0000 7f2392ffd640 1 --2- 172.21.15.1:0/1573408304 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d13176d80 0x558d13564810 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f238c000f80 tx=0x7f238c00f7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d515208567c32226 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.633+0000 7f2378ff9640 1 -- 172.21.15.1:0/1573408304 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c0113e0 con 0x558d13176d80 2024-09-21T01:02:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.633+0000 7f2378ff9640 1 -- 172.21.15.1:0/1573408304 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f238c03c070 con 0x558d13176d80 2024-09-21T01:02:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.633+0000 7f2378ff9640 1 -- 172.21.15.1:0/1573408304 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c003c90 con 0x558d13176d80 2024-09-21T01:02:36.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.633+0000 7f23a045d740 1 -- 172.21.15.1:0/1573408304 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d13176d80 msgr2=0x558d13564810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:36.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.633+0000 7f23a045d740 1 --2- 172.21.15.1:0/1573408304 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d13176d80 0x558d13564810 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f238c000f80 tx=0x7f238c00f7d0 comp rx=0 tx=0).stop 2024-09-21T01:02:36.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.634+0000 7f23a045d740 1 -- 172.21.15.1:0/1573408304 shutdown_connections 2024-09-21T01:02:36.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.634+0000 7f23a045d740 1 --2- 172.21.15.1:0/1573408304 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d131974d0 0x558d1355c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:36.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.634+0000 7f23a045d740 1 --2- 172.21.15.1:0/1573408304 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d1318f2f0 0x558d1355bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.634+0000 7f23a045d740 1 --2- 172.21.15.1:0/1573408304 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d13176d80 0x558d13564810 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.634+0000 7f23a045d740 1 -- 172.21.15.1:0/1573408304 >> 172.21.15.1:0/1573408304 conn(0x558d131ac300 msgr2=0x558d13564100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.634+0000 7f23a045d740 1 -- 172.21.15.1:0/1573408304 shutdown_connections 2024-09-21T01:02:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.634+0000 7f23a045d740 1 -- 172.21.15.1:0/1573408304 wait complete. 2024-09-21T01:02:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.634+0000 7f23a045d740 1 -- start start 2024-09-21T01:02:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.634+0000 7f23a045d740 1 Processor -- start 2024-09-21T01:02:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.634+0000 7f23a045d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d13176d80 0x558d1356e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.634+0000 7f23a045d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d1318f2f0 0x558d1356ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.634+0000 7f23a045d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d131974d0 0x558d1356f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.634+0000 7f23a045d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f23941c3ed0 con 0x558d131974d0 2024-09-21T01:02:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.634+0000 7f23a045d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f23941c3800 con 0x558d13176d80 2024-09-21T01:02:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.634+0000 7f23a045d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2394118e60 con 0x558d1318f2f0 2024-09-21T01:02:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.634+0000 7f23a045d740 10 client.0 _ll_register_callbacks cb 0x7f2388005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:02:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.634+0000 7f23937fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d131974d0 0x558d1356f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.635+0000 7f2392ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d13176d80 0x558d1356e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.635+0000 7f23937fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d131974d0 0x558d1356f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43310/0 (socket says 172.21.15.1:43310) 2024-09-21T01:02:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.635+0000 7f23937fe640 1 -- 172.21.15.1:0/530091526 learned_addr learned my addr 172.21.15.1:0/530091526 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:02:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.635+0000 7f23927fc640 1 --2- 172.21.15.1:0/530091526 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d1318f2f0 0x558d1356ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.635+0000 7f23937fe640 1 -- 172.21.15.1:0/530091526 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d1318f2f0 msgr2=0x558d1356ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.635+0000 7f23937fe640 1 --2- 172.21.15.1:0/530091526 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d1318f2f0 0x558d1356ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.635+0000 7f23937fe640 1 -- 172.21.15.1:0/530091526 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d13176d80 msgr2=0x558d1356e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.635+0000 7f23937fe640 1 --2- 172.21.15.1:0/530091526 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d13176d80 0x558d1356e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.635+0000 7f23937fe640 1 -- 172.21.15.1:0/530091526 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d13570140 con 0x558d131974d0 2024-09-21T01:02:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.635+0000 7f23937fe640 1 --2- 172.21.15.1:0/530091526 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d131974d0 0x558d1356f9e0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f238800e940 tx=0x7f2388005340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ddba85908ae955 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.635+0000 7f2376ff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:02:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.635+0000 7f2376ff5640 1 -- 172.21.15.1:0/530091526 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23880adf60 con 0x558d131974d0 2024-09-21T01:02:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.635+0000 7f2376ff5640 1 -- 172.21.15.1:0/530091526 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f23880acac0 con 0x558d131974d0 2024-09-21T01:02:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.635+0000 7f23a045d740 1 -- 172.21.15.1:0/530091526 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f238c03c070 con 0x558d131974d0 2024-09-21T01:02:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.635+0000 7f2376ff5640 1 -- 172.21.15.1:0/530091526 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f23880b2340 con 0x558d131974d0 2024-09-21T01:02:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.635+0000 7f23a045d740 10 client.16881 fetch_fsmap learned FSMap version 33 2024-09-21T01:02:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.635+0000 7f23a045d740 1 -- 172.21.15.1:0/530091526 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558d13571500 con 0x558d131974d0 2024-09-21T01:02:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.636+0000 7f2376ff5640 1 -- 172.21.15.1:0/530091526 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f238c03c070 con 0x558d131974d0 2024-09-21T01:02:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.636+0000 7f2376ff5640 1 -- 172.21.15.1:0/530091526 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f23880ac730 con 0x558d131974d0 2024-09-21T01:02:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.636+0000 7f23a045d740 10 client.16881 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:02:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.636+0000 7f23a045d740 10 client.16881 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:02:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.636+0000 7f23a045d740 20 client.16881 populate_metadata read hostname 'smithi001' 2024-09-21T01:02:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.636+0000 7f23a045d740 1 --2- 172.21.15.1:0/530091526 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558d131b81b0 0x558d135e3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.636+0000 7f23a045d740 4 client.16881 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:02:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.636+0000 7f23a045d740 1 -- 172.21.15.1:0/530091526 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558d134d00f0 con 0x558d131b81b0 2024-09-21T01:02:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.636+0000 7f2392ffd640 1 --2- 172.21.15.1:0/530091526 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558d131b81b0 0x558d135e3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.636+0000 7f2392ffd640 1 --2- 172.21.15.1:0/530091526 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558d131b81b0 0x558d135e3780 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1e6584a2bc75ef server_cookie=882ff29066fe6682 in_seq=0 out_seq=0 2024-09-21T01:02:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:36.636+0000 7f2376ff5640 10 client.16881 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:02:37.611 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:37.610+0000 7f2376ff5640 1 -- 172.21.15.1:0/530091526 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558d134d00f0 con 0x558d131b81b0 2024-09-21T01:02:37.611 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:37.610+0000 7f2376ff5640 10 client.16881 handle_command_reply: tid=0 2024-09-21T01:02:37.611 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:37.610+0000 7f23a045d740 1 client.16881 shutdown 2024-09-21T01:02:37.611 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:37.610+0000 7f23a045d740 1 -- 172.21.15.1:0/530091526 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d131974d0 msgr2=0x558d1356f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:37.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:37.610+0000 7f23a045d740 1 --2- 172.21.15.1:0/530091526 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d131974d0 0x558d1356f9e0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f238800e940 tx=0x7f2388005340 comp rx=0 tx=0).stop 2024-09-21T01:02:37.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:37.610+0000 7f23a045d740 1 -- 172.21.15.1:0/530091526 shutdown_connections 2024-09-21T01:02:37.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:37.610+0000 7f23a045d740 1 --2- 172.21.15.1:0/530091526 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x558d131b81b0 0x558d135e3780 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:37.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:37.610+0000 7f23a045d740 1 --2- 172.21.15.1:0/530091526 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d131974d0 0x558d1356f9e0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:37.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:37.610+0000 7f23a045d740 1 --2- 172.21.15.1:0/530091526 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d1318f2f0 0x558d1356ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:37.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:37.610+0000 7f23a045d740 1 --2- 172.21.15.1:0/530091526 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d13176d80 0x558d1356e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:37.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:37.610+0000 7f23a045d740 1 -- 172.21.15.1:0/530091526 >> 172.21.15.1:0/530091526 conn(0x558d131ac300 msgr2=0x558d13564100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:37.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:37.610+0000 7f2376ff5640 0 client.16881 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:02:37.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:37.611+0000 7f23a045d740 1 -- 172.21.15.1:0/530091526 shutdown_connections 2024-09-21T01:02:37.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:37.611+0000 7f23a045d740 1 -- 172.21.15.1:0/530091526 wait complete. 2024-09-21T01:02:37.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:37.611+0000 7f23a045d740 20 client.16881 trim_cache size 0 max 16384 2024-09-21T01:02:37.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T01:02:37.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T01:02:37.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T01:02:37.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T01:02:37.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:37.636+0000 7f2393fff640 1 -- 172.21.15.1:0/3212250550 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f237c0b65b0 msgr2=0x7f237c0b8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:37.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:37.636+0000 7f2393fff640 1 --2- 172.21.15.1:0/3212250550 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f237c0b65b0 0x7f237c0b8ac0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f23840096c0 tx=0x7f2384043040 comp rx=0 tx=0).stop 2024-09-21T01:02:37.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:37.636+0000 7f2393fff640 1 -- 172.21.15.1:0/3212250550 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23941a9dc0 msgr2=0x7f23941aa2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:37.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:37.636+0000 7f2393fff640 1 --2- 172.21.15.1:0/3212250550 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23941a9dc0 0x7f23941aa2c0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f238800e970 tx=0x7f238800ed70 comp rx=0 tx=0).stop 2024-09-21T01:02:37.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:37.638+0000 7f2393fff640 1 -- 172.21.15.1:0/3212250550 shutdown_connections 2024-09-21T01:02:37.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:37.638+0000 7f2393fff640 1 --2- 172.21.15.1:0/3212250550 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f237c0b65b0 0x7f237c0b8ac0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:37.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:37.638+0000 7f2393fff640 1 --2- 172.21.15.1:0/3212250550 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23941a9dc0 0x7f23941aa2c0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:37.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:37.638+0000 7f2393fff640 1 --2- 172.21.15.1:0/3212250550 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f239410f830 0x7f23941a9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:37.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:37.638+0000 7f2393fff640 1 --2- 172.21.15.1:0/3212250550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f239410a3c0 0x7f23941a8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:37.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:37.638+0000 7f2393fff640 1 -- 172.21.15.1:0/3212250550 >> 172.21.15.1:0/3212250550 conn(0x7f23940706a0 msgr2=0x7f239410daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:37.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:37.639+0000 7f2393fff640 1 -- 172.21.15.1:0/3212250550 shutdown_connections 2024-09-21T01:02:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:37.644+0000 7f2393fff640 1 -- 172.21.15.1:0/3212250550 wait complete. 2024-09-21T01:02:38.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:37 smithi001 ceph-mon[31211]: pgmap v520: 97 pgs: 97 active+clean; 600 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 1.6 MiB/s wr, 131 op/s 2024-09-21T01:02:38.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:37 smithi193 ceph-mon[34660]: pgmap v520: 97 pgs: 97 active+clean; 600 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 1.6 MiB/s wr, 131 op/s 2024-09-21T01:02:38.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:37 smithi042 ceph-mon[34481]: pgmap v520: 97 pgs: 97 active+clean; 600 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 1.6 MiB/s wr, 131 op/s 2024-09-21T01:02:40.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:39 smithi001 ceph-mon[31211]: pgmap v521: 97 pgs: 97 active+clean; 605 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 141 op/s 2024-09-21T01:02:40.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:39 smithi193 ceph-mon[34660]: pgmap v521: 97 pgs: 97 active+clean; 605 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 141 op/s 2024-09-21T01:02:40.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:39 smithi042 ceph-mon[34481]: pgmap v521: 97 pgs: 97 active+clean; 605 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 141 op/s 2024-09-21T01:02:42.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:41 smithi001 ceph-mon[31211]: pgmap v522: 97 pgs: 97 active+clean; 604 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 158 op/s 2024-09-21T01:02:42.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:41 smithi193 ceph-mon[34660]: pgmap v522: 97 pgs: 97 active+clean; 604 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 158 op/s 2024-09-21T01:02:42.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:41 smithi042 ceph-mon[34481]: pgmap v522: 97 pgs: 97 active+clean; 604 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 158 op/s 2024-09-21T01:02:43.560 INFO:tasks.workunit.client.0.smithi001.stdout: 123 1811590 285 1183325 296 1064077 1202 2024-09-21T01:02:44.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:43 smithi001 ceph-mon[31211]: pgmap v523: 97 pgs: 97 active+clean; 609 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 204 op/s 2024-09-21T01:02:44.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:43 smithi193 ceph-mon[34660]: pgmap v523: 97 pgs: 97 active+clean; 609 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 204 op/s 2024-09-21T01:02:44.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:43 smithi042 ceph-mon[34481]: pgmap v523: 97 pgs: 97 active+clean; 609 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 204 op/s 2024-09-21T01:02:46.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:45 smithi001 ceph-mon[31211]: pgmap v524: 97 pgs: 97 active+clean; 625 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.1 MiB/s wr, 308 op/s 2024-09-21T01:02:46.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:45 smithi193 ceph-mon[34660]: pgmap v524: 97 pgs: 97 active+clean; 625 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.1 MiB/s wr, 308 op/s 2024-09-21T01:02:46.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:45 smithi042 ceph-mon[34481]: pgmap v524: 97 pgs: 97 active+clean; 625 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.1 MiB/s wr, 308 op/s 2024-09-21T01:02:48.212 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:47 smithi001 ceph-mon[31211]: pgmap v525: 97 pgs: 97 active+clean; 645 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.0 MiB/s wr, 485 op/s 2024-09-21T01:02:48.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:47 smithi193 ceph-mon[34660]: pgmap v525: 97 pgs: 97 active+clean; 645 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.0 MiB/s wr, 485 op/s 2024-09-21T01:02:48.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:47 smithi042 ceph-mon[34481]: pgmap v525: 97 pgs: 97 active+clean; 645 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.0 MiB/s wr, 485 op/s 2024-09-21T01:02:50.212 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:49 smithi001 ceph-mon[31211]: pgmap v526: 97 pgs: 97 active+clean; 641 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.0 MiB/s wr, 510 op/s 2024-09-21T01:02:50.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:49 smithi193 ceph-mon[34660]: pgmap v526: 97 pgs: 97 active+clean; 641 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.0 MiB/s wr, 510 op/s 2024-09-21T01:02:50.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:49 smithi042 ceph-mon[34481]: pgmap v526: 97 pgs: 97 active+clean; 641 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.0 MiB/s wr, 510 op/s 2024-09-21T01:02:52.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:51 smithi001 ceph-mon[31211]: pgmap v527: 97 pgs: 97 active+clean; 640 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.9 MiB/s wr, 553 op/s 2024-09-21T01:02:52.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:51 smithi193 ceph-mon[34660]: pgmap v527: 97 pgs: 97 active+clean; 640 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.9 MiB/s wr, 553 op/s 2024-09-21T01:02:52.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:51 smithi042 ceph-mon[34481]: pgmap v527: 97 pgs: 97 active+clean; 640 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.9 MiB/s wr, 553 op/s 2024-09-21T01:02:52.523 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.521+0000 7fd61a920640 1 -- 172.21.15.1:0/3357103885 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd61410cd20 msgr2=0x7fd61410f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:52.523 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.521+0000 7fd61a920640 1 --2- 172.21.15.1:0/3357103885 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd61410cd20 0x7fd61410f140 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fd6080098b0 tx=0x7fd60802a3b0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.527+0000 7fd61a920640 1 -- 172.21.15.1:0/3357103885 shutdown_connections 2024-09-21T01:02:52.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.527+0000 7fd61a920640 1 --2- 172.21.15.1:0/3357103885 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd61410f830 0x7fd61410fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.527+0000 7fd61a920640 1 --2- 172.21.15.1:0/3357103885 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd61410cd20 0x7fd61410f140 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.527+0000 7fd61a920640 1 --2- 172.21.15.1:0/3357103885 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd61410a3c0 0x7fd61410c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.527+0000 7fd61a920640 1 -- 172.21.15.1:0/3357103885 >> 172.21.15.1:0/3357103885 conn(0x7fd6140706d0 msgr2=0x7fd614072b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:52.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.527+0000 7fd61a920640 1 -- 172.21.15.1:0/3357103885 shutdown_connections 2024-09-21T01:02:52.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.527+0000 7fd61a920640 1 -- 172.21.15.1:0/3357103885 wait complete. 2024-09-21T01:02:52.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.528+0000 7fd61a920640 1 Processor -- start 2024-09-21T01:02:52.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.528+0000 7fd61a920640 1 -- start start 2024-09-21T01:02:52.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.529+0000 7fd61a920640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd61410a3c0 0x7fd614112350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:52.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.529+0000 7fd61a920640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd61410cd20 0x7fd6141129c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:52.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.529+0000 7fd61a920640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd61410f830 0x7fd614113570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:52.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.529+0000 7fd618ebd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd61410f830 0x7fd614113570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:52.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.529+0000 7fd613fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd61410a3c0 0x7fd614112350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:52.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.529+0000 7fd618ebd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd61410f830 0x7fd614113570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54648/0 (socket says 172.21.15.1:54648) 2024-09-21T01:02:52.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.529+0000 7fd618ebd640 1 -- 172.21.15.1:0/716278023 learned_addr learned my addr 172.21.15.1:0/716278023 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:02:52.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.529+0000 7fd61a920640 1 -- 172.21.15.1:0/716278023 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd61411e010 con 0x7fd61410f830 2024-09-21T01:02:52.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.529+0000 7fd61a920640 1 -- 172.21.15.1:0/716278023 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd61411de90 con 0x7fd61410a3c0 2024-09-21T01:02:52.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.529+0000 7fd61a920640 1 -- 172.21.15.1:0/716278023 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd61411e190 con 0x7fd61410cd20 2024-09-21T01:02:52.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.530+0000 7fd618ebd640 1 -- 172.21.15.1:0/716278023 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd61410cd20 msgr2=0x7fd6141129c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T01:02:52.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.530+0000 7fd618ebd640 1 --2- 172.21.15.1:0/716278023 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd61410cd20 0x7fd6141129c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.530+0000 7fd618ebd640 1 -- 172.21.15.1:0/716278023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd61410a3c0 msgr2=0x7fd614112350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:52.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.530+0000 7fd618ebd640 1 --2- 172.21.15.1:0/716278023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd61410a3c0 0x7fd614112350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.530+0000 7fd618ebd640 1 -- 172.21.15.1:0/716278023 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd614113d90 con 0x7fd61410f830 2024-09-21T01:02:52.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.531+0000 7fd618ebd640 1 --2- 172.21.15.1:0/716278023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd61410f830 0x7fd614113570 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd60c00bd60 tx=0x7fd60c009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:52.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.571+0000 7fd6117fa640 1 -- 172.21.15.1:0/716278023 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60c019070 con 0x7fd61410f830 2024-09-21T01:02:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.571+0000 7fd6117fa640 1 -- 172.21.15.1:0/716278023 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd60c00cbe0 con 0x7fd61410f830 2024-09-21T01:02:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.571+0000 7fd61a920640 1 -- 172.21.15.1:0/716278023 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd614114080 con 0x7fd61410f830 2024-09-21T01:02:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.571+0000 7fd61a920640 1 -- 172.21.15.1:0/716278023 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd614118760 con 0x7fd61410f830 2024-09-21T01:02:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.571+0000 7fd6117fa640 1 -- 172.21.15.1:0/716278023 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60c0075d0 con 0x7fd61410f830 2024-09-21T01:02:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.581+0000 7fd621891740 1 Processor -- start 2024-09-21T01:02:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.581+0000 7fd621891740 1 -- start start 2024-09-21T01:02:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.582+0000 7fd6117fa640 1 -- 172.21.15.1:0/716278023 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7fd60c01c070 con 0x7fd61410f830 2024-09-21T01:02:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.582+0000 7fd621891740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cef50de1b0 0x55cef5486050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.582+0000 7fd621891740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cef50b52f0 0x55cef54866c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.582+0000 7fd621891740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cef50bd4d0 0x55cef54871e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.582+0000 7fd621891740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55cef53f86f0 con 0x55cef50bd4d0 2024-09-21T01:02:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.582+0000 7fd621891740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55cef53e7b20 con 0x55cef50b52f0 2024-09-21T01:02:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.582+0000 7fd621891740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55cef53eb930 con 0x55cef50de1b0 2024-09-21T01:02:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.582+0000 7fd613fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cef50b52f0 0x55cef54866c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.582+0000 7fd613fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cef50b52f0 0x55cef54866c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:54896/0 (socket says 172.21.15.1:54896) 2024-09-21T01:02:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.582+0000 7fd613fff640 1 -- 172.21.15.1:0/4163820071 learned_addr learned my addr 172.21.15.1:0/4163820071 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:02:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.583+0000 7fd613fff640 1 -- 172.21.15.1:0/4163820071 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cef50de1b0 msgr2=0x55cef5486050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:02:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.583+0000 7fd613fff640 1 --2- 172.21.15.1:0/4163820071 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cef50de1b0 0x55cef5486050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.583+0000 7fd613fff640 1 -- 172.21.15.1:0/4163820071 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cef50bd4d0 msgr2=0x55cef54871e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:02:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.583+0000 7fd6137fe640 1 --2- 172.21.15.1:0/4163820071 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cef50bd4d0 0x55cef54871e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.583+0000 7fd613fff640 1 --2- 172.21.15.1:0/4163820071 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cef50bd4d0 0x55cef54871e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.583+0000 7fd613fff640 1 -- 172.21.15.1:0/4163820071 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cef53ad530 con 0x55cef50b52f0 2024-09-21T01:02:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.584+0000 7fd613fff640 1 --2- 172.21.15.1:0/4163820071 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cef50b52f0 0x55cef54866c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd60400b740 tx=0x7fd60400bc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3ddea04ece9aeab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.585+0000 7fd6117fa640 1 --2- 172.21.15.1:0/716278023 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd5fc0b6720 0x7fd5fc0b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.586+0000 7fd6137fe640 1 --2- 172.21.15.1:0/716278023 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd5fc0b6720 0x7fd5fc0b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.587+0000 7fd6137fe640 1 --2- 172.21.15.1:0/716278023 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd5fc0b6720 0x7fd5fc0b8c30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd608035040 tx=0x7fd608000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:52.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.590+0000 7fd61a920640 1 -- 172.21.15.1:0/4163820071 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd604003dd0 con 0x55cef50b52f0 2024-09-21T01:02:52.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.590+0000 7fd61a920640 1 -- 172.21.15.1:0/4163820071 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd604015070 con 0x55cef50b52f0 2024-09-21T01:02:52.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.591+0000 7fd621891740 1 -- 172.21.15.1:0/4163820071 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cef50b52f0 msgr2=0x55cef54866c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:52.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.591+0000 7fd621891740 1 --2- 172.21.15.1:0/4163820071 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cef50b52f0 0x55cef54866c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd60400b740 tx=0x7fd60400bc00 comp rx=0 tx=0).stop 2024-09-21T01:02:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.597+0000 7fd621891740 1 -- 172.21.15.1:0/4163820071 shutdown_connections 2024-09-21T01:02:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.597+0000 7fd621891740 1 --2- 172.21.15.1:0/4163820071 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cef50bd4d0 0x55cef54871e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.597+0000 7fd621891740 1 --2- 172.21.15.1:0/4163820071 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cef50b52f0 0x55cef54866c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.598 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.597+0000 7fd621891740 1 --2- 172.21.15.1:0/4163820071 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cef50de1b0 0x55cef5486050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.598 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.597+0000 7fd621891740 1 -- 172.21.15.1:0/4163820071 >> 172.21.15.1:0/4163820071 conn(0x55cef50d2300 msgr2=0x55cef5481de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:52.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.601+0000 7fd6117fa640 1 -- 172.21.15.1:0/716278023 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fd60c0e6790 con 0x7fd61410f830 2024-09-21T01:02:52.611 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.611+0000 7fd621891740 1 -- 172.21.15.1:0/4163820071 shutdown_connections 2024-09-21T01:02:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.611+0000 7fd621891740 1 -- 172.21.15.1:0/4163820071 wait complete. 2024-09-21T01:02:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.611+0000 7fd621891740 1 -- start start 2024-09-21T01:02:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.612+0000 7fd621891740 1 Processor -- start 2024-09-21T01:02:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.613+0000 7fd621891740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cef50b52f0 0x55cef548f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.613+0000 7fd621891740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cef50bd4d0 0x55cef548feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.613+0000 7fd621891740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cef50de1b0 0x55cef5490a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.613+0000 7fd621891740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55cef531fab0 con 0x55cef50b52f0 2024-09-21T01:02:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.613+0000 7fd621891740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55cef538d730 con 0x55cef50de1b0 2024-09-21T01:02:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.613+0000 7fd621891740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55cef5487d50 con 0x55cef50bd4d0 2024-09-21T01:02:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.613+0000 7fd621891740 10 client.0 _ll_register_callbacks cb 0x55cef53e16b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:02:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.613+0000 7fd613fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cef50b52f0 0x55cef548f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.613+0000 7fd613fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cef50b52f0 0x55cef548f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54666/0 (socket says 172.21.15.1:54666) 2024-09-21T01:02:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.613+0000 7fd613fff640 1 -- 172.21.15.1:0/2192288475 learned_addr learned my addr 172.21.15.1:0/2192288475 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:02:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.613+0000 7fd6137fe640 1 --2- 172.21.15.1:0/2192288475 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cef50bd4d0 0x55cef548feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.613+0000 7fd618ebd640 1 --2- 172.21.15.1:0/2192288475 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cef50de1b0 0x55cef5490a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.613+0000 7fd618ebd640 1 -- 172.21.15.1:0/2192288475 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cef50bd4d0 msgr2=0x55cef548feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.613+0000 7fd618ebd640 1 --2- 172.21.15.1:0/2192288475 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cef50bd4d0 0x55cef548feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.613+0000 7fd618ebd640 1 -- 172.21.15.1:0/2192288475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cef50b52f0 msgr2=0x55cef548f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.613+0000 7fd618ebd640 1 --2- 172.21.15.1:0/2192288475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cef50b52f0 0x55cef548f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.613+0000 7fd618ebd640 1 -- 172.21.15.1:0/2192288475 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cef5149790 con 0x55cef50de1b0 2024-09-21T01:02:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.614+0000 7fd613fff640 1 --2- 172.21.15.1:0/2192288475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cef50b52f0 0x55cef548f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:02:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.614+0000 7fd618ebd640 1 --2- 172.21.15.1:0/2192288475 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cef50de1b0 0x55cef5490a20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0ac650 tx=0x7fd60c0ac2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a2d11c74121adad server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:52.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.638+0000 7fd5f77fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:02:52.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.638+0000 7fd5f77fe640 1 -- 172.21.15.1:0/2192288475 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60c0addd0 con 0x55cef50de1b0 2024-09-21T01:02:52.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.638+0000 7fd621891740 1 -- 172.21.15.1:0/2192288475 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd604015070 con 0x55cef50de1b0 2024-09-21T01:02:52.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.638+0000 7fd5f77fe640 1 -- 172.21.15.1:0/2192288475 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fd60c014440 con 0x55cef50de1b0 2024-09-21T01:02:52.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.638+0000 7fd5f77fe640 1 -- 172.21.15.1:0/2192288475 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fd60c0ac460 con 0x55cef50de1b0 2024-09-21T01:02:52.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.638+0000 7fd621891740 10 client.26558 fetch_fsmap learned FSMap version 33 2024-09-21T01:02:52.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.638+0000 7fd621891740 1 -- 172.21.15.1:0/2192288475 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55cef51c2620 con 0x55cef50de1b0 2024-09-21T01:02:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.639+0000 7fd5f77fe640 1 -- 172.21.15.1:0/2192288475 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd604015070 con 0x55cef50de1b0 2024-09-21T01:02:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.639+0000 7fd5f77fe640 1 -- 172.21.15.1:0/2192288475 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fd60c0a82a0 con 0x55cef50de1b0 2024-09-21T01:02:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.639+0000 7fd621891740 10 client.26558 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:02:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.639+0000 7fd621891740 10 client.26558 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:02:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.639+0000 7fd621891740 20 client.26558 populate_metadata read hostname 'smithi001' 2024-09-21T01:02:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.639+0000 7fd621891740 1 --2- 172.21.15.1:0/2192288475 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55cef509cd80 0x55cef549d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.639+0000 7fd621891740 4 client.26558 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:02:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.639+0000 7fd621891740 1 -- 172.21.15.1:0/2192288475 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cef53fa640 con 0x55cef509cd80 2024-09-21T01:02:52.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.640+0000 7fd613fff640 1 --2- 172.21.15.1:0/2192288475 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55cef509cd80 0x55cef549d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:52.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.640+0000 7fd5f77fe640 10 client.26558 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:02:52.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.640+0000 7fd613fff640 1 --2- 172.21.15.1:0/2192288475 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55cef509cd80 0x55cef549d470 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cc1ae354c23530 server_cookie=f65371d067606693 in_seq=0 out_seq=0 2024-09-21T01:02:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.641+0000 7fd5f77fe640 1 -- 172.21.15.1:0/2192288475 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cef53fa640 con 0x55cef509cd80 2024-09-21T01:02:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.641+0000 7fd5f77fe640 10 client.26558 handle_command_reply: tid=0 2024-09-21T01:02:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.641+0000 7fd621891740 1 client.26558 shutdown 2024-09-21T01:02:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.642+0000 7fd621891740 1 -- 172.21.15.1:0/2192288475 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cef50de1b0 msgr2=0x55cef5490a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:52.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.642+0000 7fd621891740 1 --2- 172.21.15.1:0/2192288475 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cef50de1b0 0x55cef5490a20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0ac650 tx=0x7fd60c0ac2a0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.646 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.646+0000 7fd621891740 1 -- 172.21.15.1:0/2192288475 shutdown_connections 2024-09-21T01:02:52.646 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.646+0000 7fd621891740 1 --2- 172.21.15.1:0/2192288475 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55cef509cd80 0x55cef549d470 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.646 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.646+0000 7fd621891740 1 --2- 172.21.15.1:0/2192288475 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cef50de1b0 0x55cef5490a20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.647 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.646+0000 7fd621891740 1 --2- 172.21.15.1:0/2192288475 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cef50bd4d0 0x55cef548feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.647 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.646+0000 7fd621891740 1 --2- 172.21.15.1:0/2192288475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cef50b52f0 0x55cef548f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.647 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.646+0000 7fd621891740 1 -- 172.21.15.1:0/2192288475 >> 172.21.15.1:0/2192288475 conn(0x55cef50d2300 msgr2=0x55cef54803a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.649+0000 7fd5f77fe640 0 client.26558 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:02:52.650 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.649+0000 7fd621891740 1 -- 172.21.15.1:0/2192288475 shutdown_connections 2024-09-21T01:02:52.650 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.649+0000 7fd621891740 1 -- 172.21.15.1:0/2192288475 wait complete. 2024-09-21T01:02:52.650 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.649+0000 7fd621891740 20 client.26558 trim_cache size 0 max 16384 2024-09-21T01:02:52.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.820+0000 7fd621891740 1 Processor -- start 2024-09-21T01:02:52.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.820+0000 7fd621891740 1 -- start start 2024-09-21T01:02:52.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.821+0000 7fd621891740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cef50d2300 0x55cef549d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:52.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.821+0000 7fd621891740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cef50b52f0 0x55cef54a1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:52.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.821+0000 7fd621891740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cef50bd4d0 0x55cef54a21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:52.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.821+0000 7fd621891740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd6141c2610 con 0x55cef50d2300 2024-09-21T01:02:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.821+0000 7fd621891740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd6141c4210 con 0x55cef50b52f0 2024-09-21T01:02:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.821+0000 7fd621891740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd6141c2ce0 con 0x55cef50bd4d0 2024-09-21T01:02:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.821+0000 7fd6137fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cef50b52f0 0x55cef54a1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.821+0000 7fd618ebd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cef50bd4d0 0x55cef54a21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.821+0000 7fd6137fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cef50b52f0 0x55cef54a1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:54916/0 (socket says 172.21.15.1:54916) 2024-09-21T01:02:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.821+0000 7fd6137fe640 1 -- 172.21.15.1:0/3858345684 learned_addr learned my addr 172.21.15.1:0/3858345684 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:02:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.821+0000 7fd613fff640 1 --2- 172.21.15.1:0/3858345684 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cef50d2300 0x55cef549d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.822+0000 7fd6137fe640 1 -- 172.21.15.1:0/3858345684 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cef50bd4d0 msgr2=0x55cef54a21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.822+0000 7fd6137fe640 1 --2- 172.21.15.1:0/3858345684 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cef50bd4d0 0x55cef54a21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.822+0000 7fd6137fe640 1 -- 172.21.15.1:0/3858345684 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cef50d2300 msgr2=0x55cef549d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.822+0000 7fd6137fe640 1 --2- 172.21.15.1:0/3858345684 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cef50d2300 0x55cef549d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.822+0000 7fd6137fe640 1 -- 172.21.15.1:0/3858345684 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cef509cfb0 con 0x55cef50b52f0 2024-09-21T01:02:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.822+0000 7fd613fff640 1 --2- 172.21.15.1:0/3858345684 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cef50d2300 0x55cef549d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:02:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.822+0000 7fd6137fe640 1 --2- 172.21.15.1:0/3858345684 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cef50b52f0 0x55cef54a1c60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd6080098b0 tx=0x7fd60802c050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b31b39c1346f7b58 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.824+0000 7fd601ffb640 1 -- 172.21.15.1:0/3858345684 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60804f070 con 0x55cef50b52f0 2024-09-21T01:02:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.824+0000 7fd601ffb640 1 -- 172.21.15.1:0/3858345684 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6080035f0 con 0x55cef50b52f0 2024-09-21T01:02:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.824+0000 7fd601ffb640 1 -- 172.21.15.1:0/3858345684 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd608037040 con 0x55cef50b52f0 2024-09-21T01:02:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.855+0000 7fd621891740 1 -- 172.21.15.1:0/3858345684 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cef50b52f0 msgr2=0x55cef54a1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.855+0000 7fd621891740 1 --2- 172.21.15.1:0/3858345684 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cef50b52f0 0x55cef54a1c60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd6080098b0 tx=0x7fd60802c050 comp rx=0 tx=0).stop 2024-09-21T01:02:52.857 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.856+0000 7fd621891740 1 -- 172.21.15.1:0/3858345684 shutdown_connections 2024-09-21T01:02:52.857 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.856+0000 7fd621891740 1 --2- 172.21.15.1:0/3858345684 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cef50bd4d0 0x55cef54a21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.857 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.856+0000 7fd621891740 1 --2- 172.21.15.1:0/3858345684 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cef50b52f0 0x55cef54a1c60 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.857 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.856+0000 7fd621891740 1 --2- 172.21.15.1:0/3858345684 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cef50d2300 0x55cef549d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.857 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.856+0000 7fd621891740 1 -- 172.21.15.1:0/3858345684 >> 172.21.15.1:0/3858345684 conn(0x55cef54868b0 msgr2=0x55cef547cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:52.857 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.857+0000 7fd621891740 1 -- 172.21.15.1:0/3858345684 shutdown_connections 2024-09-21T01:02:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.857+0000 7fd621891740 1 -- 172.21.15.1:0/3858345684 wait complete. 2024-09-21T01:02:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.857+0000 7fd621891740 1 -- start start 2024-09-21T01:02:52.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.862+0000 7fd621891740 1 Processor -- start 2024-09-21T01:02:52.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.862+0000 7fd621891740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cef50b52f0 0x55cef5494450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:52.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.863+0000 7fd621891740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cef50bd4d0 0x55cef5494b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:52.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.863+0000 7fd621891740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cef50d2300 0x55cef5495680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:52.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.863+0000 7fd621891740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd6141c3b40 con 0x55cef50d2300 2024-09-21T01:02:52.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.863+0000 7fd621891740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd6141c3470 con 0x55cef50b52f0 2024-09-21T01:02:52.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.863+0000 7fd621891740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd6141c05f0 con 0x55cef50bd4d0 2024-09-21T01:02:52.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.863+0000 7fd621891740 10 client.0 _ll_register_callbacks cb 0x7fd60c0a87f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:02:52.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.863+0000 7fd6137fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cef50bd4d0 0x55cef5494b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:52.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.863+0000 7fd618ebd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cef50d2300 0x55cef5495680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:52.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.863+0000 7fd6137fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cef50bd4d0 0x55cef5494b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:46632/0 (socket says 172.21.15.1:46632) 2024-09-21T01:02:52.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.863+0000 7fd6137fe640 1 -- 172.21.15.1:0/3503344681 learned_addr learned my addr 172.21.15.1:0/3503344681 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:02:52.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.863+0000 7fd613fff640 1 --2- 172.21.15.1:0/3503344681 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cef50b52f0 0x55cef5494450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:52.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.864+0000 7fd613fff640 1 -- 172.21.15.1:0/3503344681 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cef50bd4d0 msgr2=0x55cef5494b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:52.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.864+0000 7fd613fff640 1 --2- 172.21.15.1:0/3503344681 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cef50bd4d0 0x55cef5494b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.864+0000 7fd613fff640 1 -- 172.21.15.1:0/3503344681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cef50d2300 msgr2=0x55cef5495680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:52.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.864+0000 7fd613fff640 1 --2- 172.21.15.1:0/3503344681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cef50d2300 0x55cef5495680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.864+0000 7fd613fff640 1 -- 172.21.15.1:0/3503344681 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cef5495de0 con 0x55cef50b52f0 2024-09-21T01:02:52.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.864+0000 7fd618ebd640 1 --2- 172.21.15.1:0/3503344681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cef50d2300 0x55cef5495680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:02:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.865+0000 7fd613fff640 1 --2- 172.21.15.1:0/3503344681 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cef50b52f0 0x55cef5494450 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd604000c00 tx=0x7fd604005c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad37e4ccac3f877b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:52.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.888+0000 7fd5f77fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:02:52.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.888+0000 7fd5f77fe640 1 -- 172.21.15.1:0/3503344681 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd604005020 con 0x55cef50b52f0 2024-09-21T01:02:52.891 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.888+0000 7fd621891740 1 -- 172.21.15.1:0/3503344681 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6080035f0 con 0x55cef50b52f0 2024-09-21T01:02:52.891 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.888+0000 7fd5f77fe640 1 -- 172.21.15.1:0/3503344681 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fd6040051c0 con 0x55cef50b52f0 2024-09-21T01:02:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.891+0000 7fd5f77fe640 1 -- 172.21.15.1:0/3503344681 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fd6040053c0 con 0x55cef50b52f0 2024-09-21T01:02:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.891+0000 7fd621891740 10 client.26564 fetch_fsmap learned FSMap version 33 2024-09-21T01:02:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.891+0000 7fd621891740 1 -- 172.21.15.1:0/3503344681 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55cef54970d0 con 0x55cef50b52f0 2024-09-21T01:02:52.895 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.895+0000 7fd5f77fe640 1 -- 172.21.15.1:0/3503344681 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd604015040 con 0x55cef50b52f0 2024-09-21T01:02:52.895 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.895+0000 7fd5f77fe640 1 -- 172.21.15.1:0/3503344681 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fd604011840 con 0x55cef50b52f0 2024-09-21T01:02:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.896+0000 7fd621891740 10 client.26564 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:02:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.896+0000 7fd621891740 10 client.26564 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:02:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.896+0000 7fd621891740 20 client.26564 populate_metadata read hostname 'smithi001' 2024-09-21T01:02:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.896+0000 7fd621891740 1 --2- 172.21.15.1:0/3503344681 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55cef50de1b0 0x55cef54976b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.897+0000 7fd621891740 4 client.26564 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:02:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.897+0000 7fd621891740 1 -- 172.21.15.1:0/3503344681 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fd6080035f0 con 0x55cef50de1b0 2024-09-21T01:02:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.897+0000 7fd6137fe640 1 --2- 172.21.15.1:0/3503344681 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55cef50de1b0 0x55cef54976b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.898+0000 7fd6137fe640 1 --2- 172.21.15.1:0/3503344681 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55cef50de1b0 0x55cef54976b0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=784fdd54a55a3d3a server_cookie=28515c0bc99f2a7a in_seq=0 out_seq=0 2024-09-21T01:02:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:52.898+0000 7fd5f77fe640 10 client.26564 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:02:53.038 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:02:53.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:52 smithi042 ceph-mon[34481]: pgmap v528: 97 pgs: 97 active+clean; 622 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.9 MiB/s wr, 616 op/s 2024-09-21T01:02:53.338 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:52 smithi001 ceph-mon[31211]: pgmap v528: 97 pgs: 97 active+clean; 622 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.9 MiB/s wr, 616 op/s 2024-09-21T01:02:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:53.448+0000 7fd5f77fe640 1 -- 172.21.15.1:0/3503344681 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fd6080035f0 con 0x55cef50de1b0 2024-09-21T01:02:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:53.448+0000 7fd5f77fe640 10 client.26564 handle_command_reply: tid=0 2024-09-21T01:02:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:53.448+0000 7fd621891740 1 client.26564 shutdown 2024-09-21T01:02:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:53.448+0000 7fd621891740 1 -- 172.21.15.1:0/3503344681 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cef50b52f0 msgr2=0x55cef5494450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:53.448+0000 7fd621891740 1 --2- 172.21.15.1:0/3503344681 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cef50b52f0 0x55cef5494450 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd604000c00 tx=0x7fd604005c70 comp rx=0 tx=0).stop 2024-09-21T01:02:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:53.448+0000 7fd621891740 1 -- 172.21.15.1:0/3503344681 shutdown_connections 2024-09-21T01:02:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:53.448+0000 7fd621891740 1 --2- 172.21.15.1:0/3503344681 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55cef50de1b0 0x55cef54976b0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:53.448+0000 7fd621891740 1 --2- 172.21.15.1:0/3503344681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cef50d2300 0x55cef5495680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:53.448+0000 7fd5f77fe640 0 client.26564 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:02:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:53.448+0000 7fd621891740 1 --2- 172.21.15.1:0/3503344681 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cef50bd4d0 0x55cef5494b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:53.448+0000 7fd621891740 1 --2- 172.21.15.1:0/3503344681 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cef50b52f0 0x55cef5494450 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:53.448+0000 7fd621891740 1 -- 172.21.15.1:0/3503344681 >> 172.21.15.1:0/3503344681 conn(0x55cef54868b0 msgr2=0x55cef549d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:53.448+0000 7fd621891740 1 -- 172.21.15.1:0/3503344681 shutdown_connections 2024-09-21T01:02:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:53.449+0000 7fd621891740 1 -- 172.21.15.1:0/3503344681 wait complete. 2024-09-21T01:02:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:53.449+0000 7fd621891740 20 client.26564 trim_cache size 0 max 16384 2024-09-21T01:02:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T01:02:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T01:02:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T01:02:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T01:02:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:53.449+0000 7fd602ffd640 1 -- 172.21.15.1:0/716278023 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd5fc0b6720 msgr2=0x7fd5fc0b8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:53.449+0000 7fd602ffd640 1 --2- 172.21.15.1:0/716278023 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd5fc0b6720 0x7fd5fc0b8c30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd608035040 tx=0x7fd608000bc0 comp rx=0 tx=0).stop 2024-09-21T01:02:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:53.449+0000 7fd602ffd640 1 -- 172.21.15.1:0/716278023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd61410f830 msgr2=0x7fd614113570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:53.449+0000 7fd602ffd640 1 --2- 172.21.15.1:0/716278023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd61410f830 0x7fd614113570 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd60c00bd60 tx=0x7fd60c009e90 comp rx=0 tx=0).stop 2024-09-21T01:02:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:53.450+0000 7fd602ffd640 1 -- 172.21.15.1:0/716278023 shutdown_connections 2024-09-21T01:02:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:53.450+0000 7fd602ffd640 1 --2- 172.21.15.1:0/716278023 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd5fc0b6720 0x7fd5fc0b8c30 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:53.450+0000 7fd602ffd640 1 --2- 172.21.15.1:0/716278023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd61410f830 0x7fd614113570 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:53.450+0000 7fd602ffd640 1 --2- 172.21.15.1:0/716278023 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd61410cd20 0x7fd6141129c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:53.450+0000 7fd602ffd640 1 --2- 172.21.15.1:0/716278023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd61410a3c0 0x7fd614112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:53.450+0000 7fd602ffd640 1 -- 172.21.15.1:0/716278023 >> 172.21.15.1:0/716278023 conn(0x7fd6140706d0 msgr2=0x7fd61410b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:53.450+0000 7fd602ffd640 1 -- 172.21.15.1:0/716278023 shutdown_connections 2024-09-21T01:02:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:02:53.450+0000 7fd602ffd640 1 -- 172.21.15.1:0/716278023 wait complete. 2024-09-21T01:02:53.479 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:52 smithi193 ceph-mon[34660]: pgmap v528: 97 pgs: 97 active+clean; 622 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.9 MiB/s wr, 616 op/s 2024-09-21T01:02:53.561 INFO:tasks.workunit.client.0.smithi001.stdout: 135 1948494 564 1284817 600 1144073 1619 2024-09-21T01:02:54.338 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:02:55.473 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:55 smithi001 ceph-mon[31211]: pgmap v529: 97 pgs: 97 active+clean; 630 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.1 MiB/s wr, 625 op/s 2024-09-21T01:02:55.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.477+0000 7f9c7d03f640 1 -- 172.21.15.1:0/321833348 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c7810d620 msgr2=0x7f9c78117090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:55.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.477+0000 7f9c7d03f640 1 --2- 172.21.15.1:0/321833348 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c7810d620 0x7f9c78117090 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c009900 tx=0x7f9c6c02a400 comp rx=0 tx=0).stop 2024-09-21T01:02:55.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.483+0000 7f9c7d03f640 1 -- 172.21.15.1:0/321833348 shutdown_connections 2024-09-21T01:02:55.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.483+0000 7f9c7d03f640 1 --2- 172.21.15.1:0/321833348 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c7810d620 0x7f9c78117090 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:55.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.483+0000 7f9c7d03f640 1 --2- 172.21.15.1:0/321833348 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c7810ccd0 0x7f9c7810d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:55.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.483+0000 7f9c7d03f640 1 --2- 172.21.15.1:0/321833348 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9c7810a650 0x7f9c7810aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:55.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.483+0000 7f9c7d03f640 1 -- 172.21.15.1:0/321833348 >> 172.21.15.1:0/321833348 conn(0x7f9c78070ec0 msgr2=0x7f9c780712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:55.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.488+0000 7f9c7d03f640 1 -- 172.21.15.1:0/321833348 shutdown_connections 2024-09-21T01:02:55.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.488+0000 7f9c7d03f640 1 -- 172.21.15.1:0/321833348 wait complete. 2024-09-21T01:02:55.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.489+0000 7f9c7d03f640 1 Processor -- start 2024-09-21T01:02:55.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.490+0000 7f9c7d03f640 1 -- start start 2024-09-21T01:02:55.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.491+0000 7f9c7d03f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c7810a650 0x7f9c781160e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:55.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.491+0000 7f9c7d03f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c7810ccd0 0x7f9c78116680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:55.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.491+0000 7f9c7d03f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9c7810d620 0x7f9c781aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:55.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.491+0000 7f9c7d03f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9c78119730 con 0x7f9c7810a650 2024-09-21T01:02:55.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.492+0000 7f9c7d03f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9c781195b0 con 0x7f9c7810ccd0 2024-09-21T01:02:55.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.492+0000 7f9c7d03f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9c781198b0 con 0x7f9c7810d620 2024-09-21T01:02:55.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.492+0000 7f9c76d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c7810a650 0x7f9c781160e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:55.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.492+0000 7f9c76d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c7810a650 0x7f9c781160e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54714/0 (socket says 172.21.15.1:54714) 2024-09-21T01:02:55.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.492+0000 7f9c76d9d640 1 -- 172.21.15.1:0/2308575674 learned_addr learned my addr 172.21.15.1:0/2308575674 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:02:55.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.492+0000 7f9c7759e640 1 --2- 172.21.15.1:0/2308575674 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9c7810d620 0x7f9c781aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:55.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.493+0000 7f9c7659c640 1 --2- 172.21.15.1:0/2308575674 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c7810ccd0 0x7f9c78116680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:55.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.493+0000 7f9c76d9d640 1 -- 172.21.15.1:0/2308575674 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9c7810d620 msgr2=0x7f9c781aeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:55.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.493+0000 7f9c76d9d640 1 --2- 172.21.15.1:0/2308575674 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9c7810d620 0x7f9c781aeb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:55.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.493+0000 7f9c76d9d640 1 -- 172.21.15.1:0/2308575674 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c7810ccd0 msgr2=0x7f9c78116680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:55.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.493+0000 7f9c76d9d640 1 --2- 172.21.15.1:0/2308575674 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c7810ccd0 0x7f9c78116680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:55.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.493+0000 7f9c76d9d640 1 -- 172.21.15.1:0/2308575674 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c781af270 con 0x7f9c7810a650 2024-09-21T01:02:55.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.493+0000 7f9c76d9d640 1 --2- 172.21.15.1:0/2308575674 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c7810a650 0x7f9c781160e0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f9c7000db40 tx=0x7f9c7000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:55.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.494+0000 7f9c5ffff640 1 -- 172.21.15.1:0/2308575674 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7000bca0 con 0x7f9c7810a650 2024-09-21T01:02:55.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.494+0000 7f9c7d03f640 1 -- 172.21.15.1:0/2308575674 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c781af560 con 0x7f9c7810a650 2024-09-21T01:02:55.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.494+0000 7f9c7d03f640 1 -- 172.21.15.1:0/2308575674 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c781b5cc0 con 0x7f9c7810a650 2024-09-21T01:02:55.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.494+0000 7f9c5ffff640 1 -- 172.21.15.1:0/2308575674 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c7000be40 con 0x7f9c7810a650 2024-09-21T01:02:55.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.494+0000 7f9c5ffff640 1 -- 172.21.15.1:0/2308575674 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c700167b0 con 0x7f9c7810a650 2024-09-21T01:02:55.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.508+0000 7f9c835b3740 1 Processor -- start 2024-09-21T01:02:55.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.510+0000 7f9c5ffff640 1 -- 172.21.15.1:0/2308575674 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f9c70016950 con 0x7f9c7810a650 2024-09-21T01:02:55.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.510+0000 7f9c835b3740 1 -- start start 2024-09-21T01:02:55.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.512+0000 7f9c5ffff640 1 --2- 172.21.15.1:0/2308575674 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f9c600b65d0 0x7f9c600b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:55.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.512+0000 7f9c5ffff640 1 -- 172.21.15.1:0/2308575674 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f9c700e7200 con 0x7f9c7810a650 2024-09-21T01:02:55.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.514+0000 7f9c835b3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc8eff8070 0x55dc8f39f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:55.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.515+0000 7f9c835b3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dc8efcf1b0 0x55dc8f39fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:55.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.515+0000 7f9c76d9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc8eff8070 0x55dc8f39f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:55.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.515+0000 7f9c76d9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc8eff8070 0x55dc8f39f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:46652/0 (socket says 172.21.15.1:46652) 2024-09-21T01:02:55.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.515+0000 7f9c76d9d640 1 -- 172.21.15.1:0/2032588737 learned_addr learned my addr 172.21.15.1:0/2032588737 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:02:55.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.515+0000 7f9c835b3740 1 --2- 172.21.15.1:0/2032588737 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc8efd7390 0x55dc8f3a00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:55.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.515+0000 7f9c835b3740 1 -- 172.21.15.1:0/2032588737 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55dc8f315e50 con 0x55dc8efd7390 2024-09-21T01:02:55.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.515+0000 7f9c7759e640 1 --2- 172.21.15.1:0/2308575674 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f9c600b65d0 0x7f9c600b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:55.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.515+0000 7f9c835b3740 1 -- 172.21.15.1:0/2032588737 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55dc8f305280 con 0x55dc8efcf1b0 2024-09-21T01:02:55.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.515+0000 7f9c835b3740 1 -- 172.21.15.1:0/2032588737 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55dc8f309090 con 0x55dc8eff8070 2024-09-21T01:02:55.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.516+0000 7f9c7759e640 1 --2- 172.21.15.1:0/2032588737 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc8efd7390 0x55dc8f3a00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:55.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.521+0000 7f9c7759e640 1 -- 172.21.15.1:0/2032588737 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc8eff8070 msgr2=0x55dc8f39f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:55.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.521+0000 7f9c7759e640 1 --2- 172.21.15.1:0/2032588737 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc8eff8070 0x55dc8f39f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:55.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.521+0000 7f9c7759e640 1 -- 172.21.15.1:0/2032588737 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dc8efcf1b0 msgr2=0x55dc8f39fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:55.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.521+0000 7f9c7759e640 1 --2- 172.21.15.1:0/2032588737 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dc8efcf1b0 0x55dc8f39fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:55.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.521+0000 7f9c7759e640 1 -- 172.21.15.1:0/2032588737 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc8f063650 con 0x55dc8efd7390 2024-09-21T01:02:55.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.521+0000 7f9c7759e640 1 --2- 172.21.15.1:0/2308575674 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f9c600b65d0 0x7f9c600b8ae0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c031440 tx=0x7f9c6c0044a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:55.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.522+0000 7f9c7759e640 1 --2- 172.21.15.1:0/2032588737 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc8efd7390 0x55dc8f3a00d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c009850 tx=0x7f9c6c043000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1d4b762a1571d29 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:55.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.524+0000 7f9c5d7fa640 1 -- 172.21.15.1:0/2032588737 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c035050 con 0x55dc8efd7390 2024-09-21T01:02:55.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.524+0000 7f9c5d7fa640 1 -- 172.21.15.1:0/2032588737 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c6c004b70 con 0x55dc8efd7390 2024-09-21T01:02:55.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.524+0000 7f9c5d7fa640 1 -- 172.21.15.1:0/2032588737 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c003d20 con 0x55dc8efd7390 2024-09-21T01:02:55.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.526+0000 7f9c835b3740 1 -- 172.21.15.1:0/2032588737 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc8efd7390 msgr2=0x55dc8f3a00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:55.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.526+0000 7f9c835b3740 1 --2- 172.21.15.1:0/2032588737 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc8efd7390 0x55dc8f3a00d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c009850 tx=0x7f9c6c043000 comp rx=0 tx=0).stop 2024-09-21T01:02:55.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.529+0000 7f9c835b3740 1 -- 172.21.15.1:0/2032588737 shutdown_connections 2024-09-21T01:02:55.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.529+0000 7f9c835b3740 1 --2- 172.21.15.1:0/2032588737 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc8efd7390 0x55dc8f3a00d0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:55.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.529+0000 7f9c835b3740 1 --2- 172.21.15.1:0/2032588737 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dc8efcf1b0 0x55dc8f39fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:55.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.529+0000 7f9c835b3740 1 --2- 172.21.15.1:0/2032588737 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc8eff8070 0x55dc8f39f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:55.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.529+0000 7f9c835b3740 1 -- 172.21.15.1:0/2032588737 >> 172.21.15.1:0/2032588737 conn(0x55dc8efec460 msgr2=0x55dc8f39d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:55.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.534+0000 7f9c835b3740 1 -- 172.21.15.1:0/2032588737 shutdown_connections 2024-09-21T01:02:55.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.534+0000 7f9c835b3740 1 -- 172.21.15.1:0/2032588737 wait complete. 2024-09-21T01:02:55.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.535+0000 7f9c835b3740 1 -- start start 2024-09-21T01:02:55.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.535+0000 7f9c835b3740 1 Processor -- start 2024-09-21T01:02:55.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.539+0000 7f9c835b3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc8efcf1b0 0x55dc8f3aada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:55.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.539+0000 7f9c835b3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc8efd7390 0x55dc8f3ab2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:55.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.539+0000 7f9c835b3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dc8eff8070 0x55dc8f3b7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:55.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.539+0000 7f9c835b3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55dc8f166700 con 0x55dc8efd7390 2024-09-21T01:02:55.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.539+0000 7f9c835b3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55dc8f2a0110 con 0x55dc8eff8070 2024-09-21T01:02:55.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.539+0000 7f9c835b3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55dc8f3addd0 con 0x55dc8efcf1b0 2024-09-21T01:02:55.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.539+0000 7f9c835b3740 10 client.0 _ll_register_callbacks cb 0x55dc8f2b9990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:02:55.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.540+0000 7f9c7659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc8efd7390 0x55dc8f3ab2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:55.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.540+0000 7f9c7659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc8efd7390 0x55dc8f3ab2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54742/0 (socket says 172.21.15.1:54742) 2024-09-21T01:02:55.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.540+0000 7f9c7659c640 1 -- 172.21.15.1:0/2098625659 learned_addr learned my addr 172.21.15.1:0/2098625659 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:02:55.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.541+0000 7f9c76d9d640 1 --2- 172.21.15.1:0/2098625659 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc8efcf1b0 0x55dc8f3aada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:55.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.541+0000 7f9c7759e640 1 --2- 172.21.15.1:0/2098625659 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dc8eff8070 0x55dc8f3b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:55.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.542+0000 7f9c7659c640 1 -- 172.21.15.1:0/2098625659 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc8efcf1b0 msgr2=0x55dc8f3aada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:55.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.542+0000 7f9c7659c640 1 --2- 172.21.15.1:0/2098625659 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc8efcf1b0 0x55dc8f3aada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:55.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.542+0000 7f9c7659c640 1 -- 172.21.15.1:0/2098625659 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dc8eff8070 msgr2=0x55dc8f3b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:55.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.542+0000 7f9c7659c640 1 --2- 172.21.15.1:0/2098625659 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dc8eff8070 0x55dc8f3b7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:55.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.542+0000 7f9c7659c640 1 -- 172.21.15.1:0/2098625659 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc8f2cdc40 con 0x55dc8efd7390 2024-09-21T01:02:55.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.542+0000 7f9c7759e640 1 --2- 172.21.15.1:0/2098625659 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dc8eff8070 0x55dc8f3b7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:02:55.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.543+0000 7f9c7659c640 1 --2- 172.21.15.1:0/2098625659 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc8efd7390 0x55dc8f3ab2e0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f9c6800afd0 tx=0x7f9c68008790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7632da563072b92 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:55.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.544+0000 7f9c5aff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:02:55.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.547+0000 7f9c5aff5640 1 -- 172.21.15.1:0/2098625659 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c68013760 con 0x55dc8efd7390 2024-09-21T01:02:55.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.547+0000 7f9c5aff5640 1 -- 172.21.15.1:0/2098625659 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f9c68013900 con 0x55dc8efd7390 2024-09-21T01:02:55.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.548+0000 7f9c835b3740 1 -- 172.21.15.1:0/2098625659 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c6c004b70 con 0x55dc8efd7390 2024-09-21T01:02:55.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.549+0000 7f9c5aff5640 1 -- 172.21.15.1:0/2098625659 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f9c68013b00 con 0x55dc8efd7390 2024-09-21T01:02:55.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.558+0000 7f9c835b3740 10 client.16908 fetch_fsmap learned FSMap version 33 2024-09-21T01:02:55.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.558+0000 7f9c835b3740 1 -- 172.21.15.1:0/2098625659 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55dc8f3b9c30 con 0x55dc8efd7390 2024-09-21T01:02:55.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.560+0000 7f9c5aff5640 1 -- 172.21.15.1:0/2098625659 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c6c004b70 con 0x55dc8efd7390 2024-09-21T01:02:55.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.560+0000 7f9c5aff5640 1 -- 172.21.15.1:0/2098625659 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f9c680143f0 con 0x55dc8efd7390 2024-09-21T01:02:55.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.561+0000 7f9c835b3740 10 client.16908 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:02:55.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.561+0000 7f9c835b3740 10 client.16908 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:02:55.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.561+0000 7f9c835b3740 20 client.16908 populate_metadata read hostname 'smithi001' 2024-09-21T01:02:55.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.561+0000 7f9c835b3740 1 --2- 172.21.15.1:0/2098625659 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55dc8efb69f0 0x55dc8f3bd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:55.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.561+0000 7f9c835b3740 4 client.16908 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:02:55.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.561+0000 7f9c835b3740 1 -- 172.21.15.1:0/2098625659 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc8f317da0 con 0x55dc8efb69f0 2024-09-21T01:02:55.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.563+0000 7f9c76d9d640 1 --2- 172.21.15.1:0/2098625659 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55dc8efb69f0 0x55dc8f3bd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:55.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.573+0000 7f9c76d9d640 1 --2- 172.21.15.1:0/2098625659 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55dc8efb69f0 0x55dc8f3bd160 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=601b5cbe485fb3bf server_cookie=b235cc600b24f7bd in_seq=0 out_seq=0 2024-09-21T01:02:55.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.573+0000 7f9c5aff5640 10 client.16908 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:02:55.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.574+0000 7f9c5aff5640 1 -- 172.21.15.1:0/2098625659 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dc8f317da0 con 0x55dc8efb69f0 2024-09-21T01:02:55.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.574+0000 7f9c5aff5640 10 client.16908 handle_command_reply: tid=0 2024-09-21T01:02:55.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.574+0000 7f9c835b3740 1 client.16908 shutdown 2024-09-21T01:02:55.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.581+0000 7f9c835b3740 1 -- 172.21.15.1:0/2098625659 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc8efd7390 msgr2=0x55dc8f3ab2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:55.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.581+0000 7f9c835b3740 1 --2- 172.21.15.1:0/2098625659 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc8efd7390 0x55dc8f3ab2e0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f9c6800afd0 tx=0x7f9c68008790 comp rx=0 tx=0).stop 2024-09-21T01:02:55.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.585+0000 7f9c835b3740 1 -- 172.21.15.1:0/2098625659 shutdown_connections 2024-09-21T01:02:55.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.585+0000 7f9c835b3740 1 --2- 172.21.15.1:0/2098625659 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55dc8efb69f0 0x55dc8f3bd160 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:55.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.585+0000 7f9c835b3740 1 --2- 172.21.15.1:0/2098625659 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dc8eff8070 0x55dc8f3b7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:55.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.585+0000 7f9c835b3740 1 --2- 172.21.15.1:0/2098625659 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc8efd7390 0x55dc8f3ab2e0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:55.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.585+0000 7f9c835b3740 1 --2- 172.21.15.1:0/2098625659 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc8efcf1b0 0x55dc8f3aada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:55.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.585+0000 7f9c835b3740 1 -- 172.21.15.1:0/2098625659 >> 172.21.15.1:0/2098625659 conn(0x55dc8efec460 msgr2=0x55dc8f3a0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:55.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.586+0000 7f9c5aff5640 0 client.16908 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:02:55.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.587+0000 7f9c835b3740 1 -- 172.21.15.1:0/2098625659 shutdown_connections 2024-09-21T01:02:55.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.587+0000 7f9c835b3740 1 -- 172.21.15.1:0/2098625659 wait complete. 2024-09-21T01:02:55.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.587+0000 7f9c835b3740 20 client.16908 trim_cache size 0 max 16384 2024-09-21T01:02:55.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.628+0000 7f9c835b3740 1 Processor -- start 2024-09-21T01:02:55.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.629+0000 7f9c835b3740 1 -- start start 2024-09-21T01:02:55.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.629+0000 7f9c835b3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dc8efcf1b0 0x55dc8f3a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:55.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.629+0000 7f9c835b3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc8efd7390 0x55dc8f3a7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:55.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.629+0000 7f9c7659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc8efd7390 0x55dc8f3a7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:55.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.629+0000 7f9c7659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc8efd7390 0x55dc8f3a7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54744/0 (socket says 172.21.15.1:54744) 2024-09-21T01:02:55.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.629+0000 7f9c7659c640 1 -- 172.21.15.1:0/2963636338 learned_addr learned my addr 172.21.15.1:0/2963636338 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:02:55.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.630+0000 7f9c835b3740 1 --2- 172.21.15.1:0/2963636338 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc8eff8070 0x55dc8f3a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:55.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.630+0000 7f9c835b3740 1 -- 172.21.15.1:0/2963636338 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9c6400e5b0 con 0x55dc8efd7390 2024-09-21T01:02:55.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.630+0000 7f9c7759e640 1 --2- 172.21.15.1:0/2963636338 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc8eff8070 0x55dc8f3a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:55.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.630+0000 7f9c835b3740 1 -- 172.21.15.1:0/2963636338 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9c640101b0 con 0x55dc8efcf1b0 2024-09-21T01:02:55.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.630+0000 7f9c76d9d640 1 --2- 172.21.15.1:0/2963636338 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dc8efcf1b0 0x55dc8f3a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:55.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.630+0000 7f9c835b3740 1 -- 172.21.15.1:0/2963636338 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9c6400ec80 con 0x55dc8eff8070 2024-09-21T01:02:55.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.631+0000 7f9c7659c640 1 -- 172.21.15.1:0/2963636338 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc8eff8070 msgr2=0x55dc8f3a84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:55.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.631+0000 7f9c7659c640 1 --2- 172.21.15.1:0/2963636338 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc8eff8070 0x55dc8f3a84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:55.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.631+0000 7f9c7659c640 1 -- 172.21.15.1:0/2963636338 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dc8efcf1b0 msgr2=0x55dc8f3a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:55.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.631+0000 7f9c7659c640 1 --2- 172.21.15.1:0/2963636338 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dc8efcf1b0 0x55dc8f3a0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:55.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.631+0000 7f9c7659c640 1 -- 172.21.15.1:0/2963636338 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc8f3a1940 con 0x55dc8efd7390 2024-09-21T01:02:55.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.632+0000 7f9c7659c640 1 --2- 172.21.15.1:0/2963636338 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc8efd7390 0x55dc8f3a7f90 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f9c68008c90 tx=0x7f9c6800ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f83fb6145ca42b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:55.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.633+0000 7f9c5cff9640 1 -- 172.21.15.1:0/2963636338 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c68013ea0 con 0x55dc8efd7390 2024-09-21T01:02:55.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.633+0000 7f9c5cff9640 1 -- 172.21.15.1:0/2963636338 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c68019070 con 0x55dc8efd7390 2024-09-21T01:02:55.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.635+0000 7f9c835b3740 1 -- 172.21.15.1:0/2963636338 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc8efd7390 msgr2=0x55dc8f3a7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:55.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.635+0000 7f9c835b3740 1 --2- 172.21.15.1:0/2963636338 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc8efd7390 0x55dc8f3a7f90 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f9c68008c90 tx=0x7f9c6800ac40 comp rx=0 tx=0).stop 2024-09-21T01:02:55.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.637+0000 7f9c835b3740 1 -- 172.21.15.1:0/2963636338 shutdown_connections 2024-09-21T01:02:55.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.637+0000 7f9c835b3740 1 --2- 172.21.15.1:0/2963636338 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc8eff8070 0x55dc8f3a84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:55.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.637+0000 7f9c835b3740 1 --2- 172.21.15.1:0/2963636338 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc8efd7390 0x55dc8f3a7f90 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:55.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.637+0000 7f9c835b3740 1 --2- 172.21.15.1:0/2963636338 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dc8efcf1b0 0x55dc8f3a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:55.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.637+0000 7f9c835b3740 1 -- 172.21.15.1:0/2963636338 >> 172.21.15.1:0/2963636338 conn(0x55dc8efec460 msgr2=0x55dc8f3a0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:55.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.642+0000 7f9c835b3740 1 -- 172.21.15.1:0/2963636338 shutdown_connections 2024-09-21T01:02:55.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.642+0000 7f9c835b3740 1 -- 172.21.15.1:0/2963636338 wait complete. 2024-09-21T01:02:55.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.642+0000 7f9c835b3740 1 -- start start 2024-09-21T01:02:55.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.642+0000 7f9c835b3740 1 Processor -- start 2024-09-21T01:02:55.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.648+0000 7f9c835b3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dc8efcf1b0 0x55dc8f3af400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:55.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.648+0000 7f9c835b3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc8efd7390 0x55dc8f3af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:55.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.648+0000 7f9c835b3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc8eff8070 0x55dc8f426b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:55.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.648+0000 7f9c835b3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9c6400fae0 con 0x55dc8efd7390 2024-09-21T01:02:55.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.648+0000 7f9c835b3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9c6400f410 con 0x55dc8efcf1b0 2024-09-21T01:02:55.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.648+0000 7f9c835b3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9c6400c590 con 0x55dc8eff8070 2024-09-21T01:02:55.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.649+0000 7f9c835b3740 10 client.0 _ll_register_callbacks cb 0x7f9c68005f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:02:55.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.649+0000 7f9c7759e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc8eff8070 0x55dc8f426b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:55.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.649+0000 7f9c7759e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc8eff8070 0x55dc8f426b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:46674/0 (socket says 172.21.15.1:46674) 2024-09-21T01:02:55.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.649+0000 7f9c7759e640 1 -- 172.21.15.1:0/2192531642 learned_addr learned my addr 172.21.15.1:0/2192531642 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:02:55.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.650+0000 7f9c76d9d640 1 --2- 172.21.15.1:0/2192531642 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dc8efcf1b0 0x55dc8f3af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:55.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.651+0000 7f9c7659c640 1 --2- 172.21.15.1:0/2192531642 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc8efd7390 0x55dc8f3af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:55.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.651+0000 7f9c7759e640 1 -- 172.21.15.1:0/2192531642 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dc8efcf1b0 msgr2=0x55dc8f3af400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:55.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.651+0000 7f9c7759e640 1 --2- 172.21.15.1:0/2192531642 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dc8efcf1b0 0x55dc8f3af400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:55.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.651+0000 7f9c7759e640 1 -- 172.21.15.1:0/2192531642 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc8efd7390 msgr2=0x55dc8f3af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:55.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.651+0000 7f9c7759e640 1 --2- 172.21.15.1:0/2192531642 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc8efd7390 0x55dc8f3af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:55.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.651+0000 7f9c7759e640 1 -- 172.21.15.1:0/2192531642 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc8f4270a0 con 0x55dc8eff8070 2024-09-21T01:02:55.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.653+0000 7f9c7759e640 1 --2- 172.21.15.1:0/2192531642 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc8eff8070 0x55dc8f426b60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c005d00 tx=0x7f9c6c0037d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccefd4e9774a6ab3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:55.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.653+0000 7f9c5aff5640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T01:02:55.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.653+0000 7f9c5aff5640 1 -- 172.21.15.1:0/2192531642 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c059070 con 0x55dc8eff8070 2024-09-21T01:02:55.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.653+0000 7f9c5aff5640 1 -- 172.21.15.1:0/2192531642 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f9c6c0039f0 con 0x55dc8eff8070 2024-09-21T01:02:55.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.653+0000 7f9c835b3740 1 -- 172.21.15.1:0/2192531642 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c68019070 con 0x55dc8eff8070 2024-09-21T01:02:55.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.656+0000 7f9c5aff5640 1 -- 172.21.15.1:0/2192531642 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f9c6c063050 con 0x55dc8eff8070 2024-09-21T01:02:55.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.658+0000 7f9c835b3740 10 client.26446 fetch_fsmap learned FSMap version 33 2024-09-21T01:02:55.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.658+0000 7f9c835b3740 1 -- 172.21.15.1:0/2192531642 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55dc8f428170 con 0x55dc8eff8070 2024-09-21T01:02:55.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.660+0000 7f9c5aff5640 1 -- 172.21.15.1:0/2192531642 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c68019070 con 0x55dc8eff8070 2024-09-21T01:02:55.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.660+0000 7f9c5aff5640 1 -- 172.21.15.1:0/2192531642 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f9c6c03d460 con 0x55dc8eff8070 2024-09-21T01:02:55.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.662+0000 7f9c835b3740 10 client.26446 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:02:55.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.662+0000 7f9c835b3740 10 client.26446 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:02:55.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.662+0000 7f9c835b3740 20 client.26446 populate_metadata read hostname 'smithi001' 2024-09-21T01:02:55.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.662+0000 7f9c835b3740 1 --2- 172.21.15.1:0/2192531642 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55dc8ef8bda0 0x55dc8f42a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:55.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.662+0000 7f9c835b3740 4 client.26446 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:02:55.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.662+0000 7f9c835b3740 1 -- 172.21.15.1:0/2192531642 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dc8f313850 con 0x55dc8ef8bda0 2024-09-21T01:02:55.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.665+0000 7f9c76d9d640 1 --2- 172.21.15.1:0/2192531642 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55dc8ef8bda0 0x55dc8f42a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:55.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.678+0000 7f9c76d9d640 1 --2- 172.21.15.1:0/2192531642 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55dc8ef8bda0 0x55dc8f42a4b0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fbce3a2d5169853 server_cookie=d711839a216b459c in_seq=0 out_seq=0 2024-09-21T01:02:55.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.679+0000 7f9c5aff5640 10 client.26446 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:02:55.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.683+0000 7f9c5aff5640 1 -- 172.21.15.1:0/2192531642 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2362 (crc 0 0 0) 0x55dc8f313850 con 0x55dc8ef8bda0 2024-09-21T01:02:55.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.683+0000 7f9c5aff5640 10 client.26446 handle_command_reply: tid=0 2024-09-21T01:02:55.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.683+0000 7f9c835b3740 1 client.26446 shutdown 2024-09-21T01:02:55.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.690+0000 7f9c835b3740 1 -- 172.21.15.1:0/2192531642 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc8eff8070 msgr2=0x55dc8f426b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:55.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.690+0000 7f9c835b3740 1 --2- 172.21.15.1:0/2192531642 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc8eff8070 0x55dc8f426b60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c005d00 tx=0x7f9c6c0037d0 comp rx=0 tx=0).stop 2024-09-21T01:02:55.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.691+0000 7f9c835b3740 1 -- 172.21.15.1:0/2192531642 shutdown_connections 2024-09-21T01:02:55.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.691+0000 7f9c835b3740 1 --2- 172.21.15.1:0/2192531642 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55dc8ef8bda0 0x55dc8f42a4b0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:55.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.691+0000 7f9c835b3740 1 --2- 172.21.15.1:0/2192531642 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc8eff8070 0x55dc8f426b60 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:55.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.691+0000 7f9c835b3740 1 --2- 172.21.15.1:0/2192531642 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc8efd7390 0x55dc8f3af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:55.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.691+0000 7f9c835b3740 1 --2- 172.21.15.1:0/2192531642 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dc8efcf1b0 0x55dc8f3af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:55.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.691+0000 7f9c5aff5640 0 client.26446 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:02:55.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.691+0000 7f9c835b3740 1 -- 172.21.15.1:0/2192531642 >> 172.21.15.1:0/2192531642 conn(0x55dc8efec460 msgr2=0x55dc8f3ac250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:55.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.694+0000 7f9c835b3740 1 -- 172.21.15.1:0/2192531642 shutdown_connections 2024-09-21T01:02:55.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.694+0000 7f9c835b3740 1 -- 172.21.15.1:0/2192531642 wait complete. 2024-09-21T01:02:55.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.694+0000 7f9c835b3740 20 client.26446 trim_cache size 0 max 16384 2024-09-21T01:02:55.696 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T01:02:55.696 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "no active scrubs running", 2024-09-21T01:02:55.696 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": {}, 2024-09-21T01:02:55.696 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_stats": { 2024-09-21T01:02:55.696 INFO:teuthology.orchestra.run.smithi001.stdout: "c2addc95-c922-4a70-b746-0b5fd2af59bf": { 2024-09-21T01:02:55.696 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:00:52.374848+0000", 2024-09-21T01:02:55.696 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:02:55.696 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:02:55.696 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:02:55.696 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:02:55.697 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:02:55.697 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:02:55.697 INFO:teuthology.orchestra.run.smithi001.stdout: "d9a37a97-ce14-4763-8c19-9bd32df63cf3": { 2024-09-21T01:02:55.697 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:01:45.914443+0000", 2024-09-21T01:02:55.697 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:02:55.697 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:02:55.697 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:02:55.697 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:02:55.697 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:02:55.697 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:02:55.697 INFO:teuthology.orchestra.run.smithi001.stdout: "f826f2c1-768a-47bb-b868-785b351ac6b4": { 2024-09-21T01:02:55.697 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:59:06.554657+0000", 2024-09-21T01:02:55.697 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:02:55.697 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:02:55.698 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:02:55.698 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:02:55.698 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:02:55.698 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:02:55.698 INFO:teuthology.orchestra.run.smithi001.stdout: "1bffed0d-34b1-4e8b-9cab-7501131ef79d": { 2024-09-21T01:02:55.698 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:00:02.564228+0000", 2024-09-21T01:02:55.698 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:02:55.698 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:02:55.698 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:02:55.698 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:02:55.698 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:02:55.698 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:02:55.699 INFO:teuthology.orchestra.run.smithi001.stdout: "bee49cce-b407-4617-a959-331ffd8dc5b0": { 2024-09-21T01:02:55.699 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:58:17.883027+0000", 2024-09-21T01:02:55.699 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:02:55.699 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:02:55.699 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:02:55.699 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:02:55.699 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:02:55.699 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:02:55.699 INFO:teuthology.orchestra.run.smithi001.stdout: "7cb1bc3f-e2d2-4bf7-b13e-8f3371d7aac1": { 2024-09-21T01:02:55.699 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:58:02.751142+0000", 2024-09-21T01:02:55.699 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:02:55.699 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:02:55.699 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:02:55.699 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:02:55.700 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:02:55.700 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:02:55.700 INFO:teuthology.orchestra.run.smithi001.stdout: "2383a19c-993d-4440-99f7-93b43dcf33b4": { 2024-09-21T01:02:55.700 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:47.609257+0000", 2024-09-21T01:02:55.700 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:02:55.700 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:02:55.700 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:02:55.700 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:02:55.700 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:02:55.700 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:02:55.700 INFO:teuthology.orchestra.run.smithi001.stdout: "53fa74e4-5aa8-408b-9724-7c93618f7636": { 2024-09-21T01:02:55.700 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:01.730608+0000", 2024-09-21T01:02:55.700 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:02:55.700 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:02:55.700 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:02:55.701 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:02:55.701 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:02:55.701 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:02:55.701 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:02:55.701 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T01:02:55.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.696+0000 7f9c7d03f640 1 -- 172.21.15.1:0/2308575674 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f9c600b65d0 msgr2=0x7f9c600b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:55.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.696+0000 7f9c7d03f640 1 --2- 172.21.15.1:0/2308575674 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f9c600b65d0 0x7f9c600b8ae0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c031440 tx=0x7f9c6c0044a0 comp rx=0 tx=0).stop 2024-09-21T01:02:55.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.696+0000 7f9c7d03f640 1 -- 172.21.15.1:0/2308575674 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c7810a650 msgr2=0x7f9c781160e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:55.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.696+0000 7f9c7d03f640 1 --2- 172.21.15.1:0/2308575674 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c7810a650 0x7f9c781160e0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f9c7000db40 tx=0x7f9c7000b260 comp rx=0 tx=0).stop 2024-09-21T01:02:55.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.699+0000 7f9c7d03f640 1 -- 172.21.15.1:0/2308575674 shutdown_connections 2024-09-21T01:02:55.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.699+0000 7f9c7d03f640 1 --2- 172.21.15.1:0/2308575674 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9c7810d620 0x7f9c781aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:55.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.699+0000 7f9c7d03f640 1 --2- 172.21.15.1:0/2308575674 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c7810ccd0 0x7f9c78116680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:55.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.699+0000 7f9c7d03f640 1 --2- 172.21.15.1:0/2308575674 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f9c600b65d0 0x7f9c600b8ae0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:55.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.699+0000 7f9c7d03f640 1 --2- 172.21.15.1:0/2308575674 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c7810a650 0x7f9c781160e0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:55.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.699+0000 7f9c7d03f640 1 -- 172.21.15.1:0/2308575674 >> 172.21.15.1:0/2308575674 conn(0x7f9c78070ec0 msgr2=0x7f9c7811c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:55.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.700+0000 7f9c7d03f640 1 -- 172.21.15.1:0/2308575674 shutdown_connections 2024-09-21T01:02:55.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:55.700+0000 7f9c7d03f640 1 -- 172.21.15.1:0/2308575674 wait complete. 2024-09-21T01:02:55.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:55 smithi193 ceph-mon[34660]: pgmap v529: 97 pgs: 97 active+clean; 630 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.1 MiB/s wr, 625 op/s 2024-09-21T01:02:55.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:55 smithi042 ceph-mon[34481]: pgmap v529: 97 pgs: 97 active+clean; 630 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.1 MiB/s wr, 625 op/s 2024-09-21T01:02:57.470 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T01:02:57.470 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:02:57.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:57 smithi001 ceph-mon[31211]: pgmap v530: 97 pgs: 97 active+clean; 632 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 589 op/s 2024-09-21T01:02:57.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:57 smithi193 ceph-mon[34660]: pgmap v530: 97 pgs: 97 active+clean; 632 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 589 op/s 2024-09-21T01:02:57.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:57 smithi042 ceph-mon[34481]: pgmap v530: 97 pgs: 97 active+clean; 632 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 589 op/s 2024-09-21T01:02:58.829 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:02:59.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.375+0000 7f2fee09b640 1 -- 172.21.15.1:0/1445550256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2fe810de10 msgr2=0x7f2fe8110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:59.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.375+0000 7f2fee09b640 1 --2- 172.21.15.1:0/1445550256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2fe810de10 0x7f2fe8110300 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0009ca0 tx=0x7f2fe002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:02:59.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.375+0000 7f2fee09b640 1 -- 172.21.15.1:0/1445550256 shutdown_connections 2024-09-21T01:02:59.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.375+0000 7f2fee09b640 1 --2- 172.21.15.1:0/1445550256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2fe810de10 0x7f2fe8110300 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:59.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.375+0000 7f2fee09b640 1 --2- 172.21.15.1:0/1445550256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2fe8105300 0x7f2fe810d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:59.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.375+0000 7f2fee09b640 1 --2- 172.21.15.1:0/1445550256 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fe81049b0 0x7f2fe8104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:59.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.375+0000 7f2fee09b640 1 -- 172.21.15.1:0/1445550256 >> 172.21.15.1:0/1445550256 conn(0x7f2fe8079730 msgr2=0x7f2fe8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:59.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.375+0000 7f2fee09b640 1 -- 172.21.15.1:0/1445550256 shutdown_connections 2024-09-21T01:02:59.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.375+0000 7f2fee09b640 1 -- 172.21.15.1:0/1445550256 wait complete. 2024-09-21T01:02:59.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.375+0000 7f2fee09b640 1 Processor -- start 2024-09-21T01:02:59.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.375+0000 7f2fee09b640 1 -- start start 2024-09-21T01:02:59.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.376+0000 7f2fee09b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fe81049b0 0x7f2fe819a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:59.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.376+0000 7f2fee09b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2fe8105300 0x7f2fe819a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:59.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.376+0000 7f2fee09b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2fe810de10 0x7f2fe819fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:59.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.376+0000 7f2fee09b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe8113a70 con 0x7f2fe8105300 2024-09-21T01:02:59.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.376+0000 7f2fee09b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe81138f0 con 0x7f2fe810de10 2024-09-21T01:02:59.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.376+0000 7f2fee09b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe8113bf0 con 0x7f2fe81049b0 2024-09-21T01:02:59.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.376+0000 7f2fdeffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2fe8105300 0x7f2fe819a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:59.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.376+0000 7f2fdeffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2fe8105300 0x7f2fe819a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58572/0 (socket says 172.21.15.1:58572) 2024-09-21T01:02:59.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.376+0000 7f2fdeffd640 1 -- 172.21.15.1:0/3435786866 learned_addr learned my addr 172.21.15.1:0/3435786866 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:02:59.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.376+0000 7f2fe77fe640 1 --2- 172.21.15.1:0/3435786866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fe81049b0 0x7f2fe819a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:59.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.376+0000 7f2fe7fff640 1 --2- 172.21.15.1:0/3435786866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2fe810de10 0x7f2fe819fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:59.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.376+0000 7f2fdeffd640 1 -- 172.21.15.1:0/3435786866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fe81049b0 msgr2=0x7f2fe819a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:59.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.376+0000 7f2fdeffd640 1 --2- 172.21.15.1:0/3435786866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fe81049b0 0x7f2fe819a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:59.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.376+0000 7f2fdeffd640 1 -- 172.21.15.1:0/3435786866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2fe810de10 msgr2=0x7f2fe819fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:59.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.376+0000 7f2fdeffd640 1 --2- 172.21.15.1:0/3435786866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2fe810de10 0x7f2fe819fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:59.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.377+0000 7f2fdeffd640 1 -- 172.21.15.1:0/3435786866 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe81a02d0 con 0x7f2fe8105300 2024-09-21T01:02:59.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.377+0000 7f2fdeffd640 1 --2- 172.21.15.1:0/3435786866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2fe8105300 0x7f2fe819a9c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f2fd000e9f0 tx=0x7f2fd000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:59.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.377+0000 7f2fe57fa640 1 -- 172.21.15.1:0/3435786866 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd000ccc0 con 0x7f2fe8105300 2024-09-21T01:02:59.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.377+0000 7f2fe57fa640 1 -- 172.21.15.1:0/3435786866 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fd00108e0 con 0x7f2fe8105300 2024-09-21T01:02:59.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.377+0000 7f2fee09b640 1 -- 172.21.15.1:0/3435786866 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fe81a05c0 con 0x7f2fe8105300 2024-09-21T01:02:59.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.377+0000 7f2fe57fa640 1 -- 172.21.15.1:0/3435786866 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd0018860 con 0x7f2fe8105300 2024-09-21T01:02:59.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.377+0000 7f2fee09b640 1 -- 172.21.15.1:0/3435786866 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fe81a6de0 con 0x7f2fe8105300 2024-09-21T01:02:59.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.379+0000 7f2fee09b640 1 -- 172.21.15.1:0/3435786866 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fe8104dc0 con 0x7f2fe8105300 2024-09-21T01:02:59.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.380+0000 7f2fe57fa640 1 -- 172.21.15.1:0/3435786866 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f2fd0018a00 con 0x7f2fe8105300 2024-09-21T01:02:59.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.381+0000 7f2fe57fa640 1 --2- 172.21.15.1:0/3435786866 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f2fd40b6540 0x7f2fd40b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:59.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.382+0000 7f2fe77fe640 1 --2- 172.21.15.1:0/3435786866 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f2fd40b6540 0x7f2fd40b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:59.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.382+0000 7f2fe57fa640 1 -- 172.21.15.1:0/3435786866 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f2fd00e7600 con 0x7f2fe8105300 2024-09-21T01:02:59.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.383+0000 7f2fe77fe640 1 --2- 172.21.15.1:0/3435786866 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f2fd40b6540 0x7f2fd40b8a50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2fe806bc60 tx=0x7f2fd8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:59.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.387+0000 7f2fe57fa640 1 -- 172.21.15.1:0/3435786866 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2fd00b2250 con 0x7f2fe8105300 2024-09-21T01:02:59.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:02:59 smithi001 ceph-mon[31211]: pgmap v531: 97 pgs: 97 active+clean; 631 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 433 op/s 2024-09-21T01:02:59.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.711+0000 7f2fee09b640 1 -- 172.21.15.1:0/3435786866 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2fe81a6fb0 con 0x7f2fe8105300 2024-09-21T01:02:59.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.712+0000 7f2fe57fa640 1 -- 172.21.15.1:0/3435786866 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11962 (secure 0 0 0) 0x7f2fd00b7190 con 0x7f2fe8105300 2024-09-21T01:02:59.713 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T01:02:59.714 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":33,"btime":"2024-09-21T01:00:33:343470+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2810186677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2810186677},{"type":"v1","addr":"172.21.15.1:6835","nonce":2810186677}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14736,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3935320478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3935320478},{"type":"v1","addr":"172.21.15.1:6837","nonce":3935320478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:54:58.592853+0000","modified":"2024-09-21T01:00:33.134699+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24653,"mds_1":24637,"mds_2":24626,"mds_3":24622,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/2125703572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2125703572},{"type":"v1","addr":"172.21.15.1:6839","nonce":2125703572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/3860445313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860445313},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860445313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6833/712170939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":712170939},{"type":"v1","addr":"172.21.15.193:6833","nonce":712170939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6833/1653911656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1653911656},{"type":"v1","addr":"172.21.15.42:6833","nonce":1653911656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6835/793085918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":793085918},{"type":"v1","addr":"172.21.15.42:6835","nonce":793085918}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6835/3631682268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":3631682268},{"type":"v1","addr":"172.21.15.193:6835","nonce":3631682268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.193:6837/909252228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":909252228},{"type":"v1","addr":"172.21.15.193:6837","nonce":909252228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.42:6837/2395608508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2395608508},{"type":"v1","addr":"172.21.15.42:6837","nonce":2395608508}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.193:6839/1365361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1365361177},{"type":"v1","addr":"172.21.15.193:6839","nonce":1365361177}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6839/2526476666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2526476666},{"type":"v1","addr":"172.21.15.42:6839","nonce":2526476666}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24610,24622,24626,24637,24653]},"id":1}]} 2024-09-21T01:02:59.714 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 33 2024-09-21T01:02:59.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.717+0000 7f2fee09b640 1 -- 172.21.15.1:0/3435786866 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f2fd40b6540 msgr2=0x7f2fd40b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:59.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.717+0000 7f2fee09b640 1 --2- 172.21.15.1:0/3435786866 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f2fd40b6540 0x7f2fd40b8a50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2fe806bc60 tx=0x7f2fd8005f90 comp rx=0 tx=0).stop 2024-09-21T01:02:59.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.717+0000 7f2fee09b640 1 -- 172.21.15.1:0/3435786866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2fe8105300 msgr2=0x7f2fe819a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:59.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.717+0000 7f2fee09b640 1 --2- 172.21.15.1:0/3435786866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2fe8105300 0x7f2fe819a9c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f2fd000e9f0 tx=0x7f2fd000eeb0 comp rx=0 tx=0).stop 2024-09-21T01:02:59.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.717+0000 7f2fee09b640 1 -- 172.21.15.1:0/3435786866 shutdown_connections 2024-09-21T01:02:59.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.717+0000 7f2fee09b640 1 --2- 172.21.15.1:0/3435786866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2fe810de10 0x7f2fe819fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:59.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.717+0000 7f2fee09b640 1 --2- 172.21.15.1:0/3435786866 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f2fd40b6540 0x7f2fd40b8a50 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:59.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.717+0000 7f2fee09b640 1 --2- 172.21.15.1:0/3435786866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2fe8105300 0x7f2fe819a9c0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:59.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.717+0000 7f2fee09b640 1 --2- 172.21.15.1:0/3435786866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fe81049b0 0x7f2fe819a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:59.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.717+0000 7f2fee09b640 1 -- 172.21.15.1:0/3435786866 >> 172.21.15.1:0/3435786866 conn(0x7f2fe8079730 msgr2=0x7f2fe80ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:59.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.717+0000 7f2fee09b640 1 -- 172.21.15.1:0/3435786866 shutdown_connections 2024-09-21T01:02:59.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:02:59.717+0000 7f2fee09b640 1 -- 172.21.15.1:0/3435786866 wait complete. 2024-09-21T01:02:59.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:02:59 smithi193 ceph-mon[34660]: pgmap v531: 97 pgs: 97 active+clean; 631 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 433 op/s 2024-09-21T01:02:59.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:02:59 smithi042 ceph-mon[34481]: pgmap v531: 97 pgs: 97 active+clean; 631 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 433 op/s 2024-09-21T01:03:00.693 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:00 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/3435786866' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:03:00.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:00 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/3435786866' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:03:00.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:00 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/3435786866' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:03:00.940 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T01:03:01.712 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:01 smithi001 ceph-mon[31211]: pgmap v532: 97 pgs: 97 active+clean; 633 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 460 op/s 2024-09-21T01:03:01.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:01 smithi193 ceph-mon[34660]: pgmap v532: 97 pgs: 97 active+clean; 633 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 460 op/s 2024-09-21T01:03:01.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:01 smithi042 ceph-mon[34481]: pgmap v532: 97 pgs: 97 active+clean; 633 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 460 op/s 2024-09-21T01:03:03.572 INFO:tasks.workunit.client.0.smithi001.stdout: 140 1600413 342 1057423 418 947177 1166 2024-09-21T01:03:03.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:03 smithi001 ceph-mon[31211]: pgmap v533: 97 pgs: 97 active+clean; 633 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 464 op/s 2024-09-21T01:03:03.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:03 smithi193 ceph-mon[34660]: pgmap v533: 97 pgs: 97 active+clean; 633 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 464 op/s 2024-09-21T01:03:03.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:03 smithi042 ceph-mon[34481]: pgmap v533: 97 pgs: 97 active+clean; 633 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 464 op/s 2024-09-21T01:03:04.126 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:03:04.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.851+0000 7f25e943b640 1 -- 172.21.15.1:0/2575638681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25e4110140 msgr2=0x7f25e4112560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:04.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.851+0000 7f25e943b640 1 --2- 172.21.15.1:0/2575638681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25e4110140 0x7f25e4112560 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f25dc009ca0 tx=0x7f25dc02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:03:04.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.851+0000 7f25e943b640 1 -- 172.21.15.1:0/2575638681 shutdown_connections 2024-09-21T01:03:04.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.851+0000 7f25e943b640 1 --2- 172.21.15.1:0/2575638681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25e4110140 0x7f25e4112560 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:04.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.851+0000 7f25e943b640 1 --2- 172.21.15.1:0/2575638681 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25e4076080 0x7f25e410fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:04.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.851+0000 7f25e943b640 1 --2- 172.21.15.1:0/2575638681 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f25e4075730 0x7f25e4075b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:04.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.851+0000 7f25e943b640 1 -- 172.21.15.1:0/2575638681 >> 172.21.15.1:0/2575638681 conn(0x7f25e407b850 msgr2=0x7f25e407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:04.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.851+0000 7f25e943b640 1 -- 172.21.15.1:0/2575638681 shutdown_connections 2024-09-21T01:03:04.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.851+0000 7f25e943b640 1 -- 172.21.15.1:0/2575638681 wait complete. 2024-09-21T01:03:04.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.852+0000 7f25e943b640 1 Processor -- start 2024-09-21T01:03:04.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.852+0000 7f25e943b640 1 -- start start 2024-09-21T01:03:04.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.852+0000 7f25e943b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f25e4075730 0x7f25e419c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:04.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.852+0000 7f25e943b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25e4076080 0x7f25e419cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:04.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.852+0000 7f25e943b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25e4110140 0x7f25e41a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:04.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.852+0000 7f25e943b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f25e4115c80 con 0x7f25e4076080 2024-09-21T01:03:04.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.852+0000 7f25e943b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f25e4115b00 con 0x7f25e4110140 2024-09-21T01:03:04.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.852+0000 7f25e943b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f25e4115e00 con 0x7f25e4075730 2024-09-21T01:03:04.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.852+0000 7f25e27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25e4076080 0x7f25e419cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:04.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.852+0000 7f25e27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25e4076080 0x7f25e419cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58594/0 (socket says 172.21.15.1:58594) 2024-09-21T01:03:04.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.852+0000 7f25e27fc640 1 -- 172.21.15.1:0/2554543613 learned_addr learned my addr 172.21.15.1:0/2554543613 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:04.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.852+0000 7f25e37fe640 1 --2- 172.21.15.1:0/2554543613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25e4110140 0x7f25e41a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:04.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.852+0000 7f25e2ffd640 1 --2- 172.21.15.1:0/2554543613 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f25e4075730 0x7f25e419c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:04.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.853+0000 7f25e27fc640 1 -- 172.21.15.1:0/2554543613 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f25e4075730 msgr2=0x7f25e419c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:04.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.853+0000 7f25e27fc640 1 --2- 172.21.15.1:0/2554543613 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f25e4075730 0x7f25e419c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:04.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.853+0000 7f25e27fc640 1 -- 172.21.15.1:0/2554543613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25e4110140 msgr2=0x7f25e41a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:04.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.853+0000 7f25e27fc640 1 --2- 172.21.15.1:0/2554543613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25e4110140 0x7f25e41a1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:04.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.853+0000 7f25e27fc640 1 -- 172.21.15.1:0/2554543613 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e41a2540 con 0x7f25e4076080 2024-09-21T01:03:04.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.853+0000 7f25e37fe640 1 --2- 172.21.15.1:0/2554543613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25e4110140 0x7f25e41a1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:03:04.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.853+0000 7f25e27fc640 1 --2- 172.21.15.1:0/2554543613 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25e4076080 0x7f25e419cb70 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f25d800e9f0 tx=0x7f25d800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:04.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.853+0000 7f25cbfff640 1 -- 172.21.15.1:0/2554543613 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d800ccc0 con 0x7f25e4076080 2024-09-21T01:03:04.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.853+0000 7f25cbfff640 1 -- 172.21.15.1:0/2554543613 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25d80108e0 con 0x7f25e4076080 2024-09-21T01:03:04.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.853+0000 7f25cbfff640 1 -- 172.21.15.1:0/2554543613 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d8018860 con 0x7f25e4076080 2024-09-21T01:03:04.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.853+0000 7f25e943b640 1 -- 172.21.15.1:0/2554543613 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25e41a2830 con 0x7f25e4076080 2024-09-21T01:03:04.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.853+0000 7f25e943b640 1 -- 172.21.15.1:0/2554543613 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25e41a8f90 con 0x7f25e4076080 2024-09-21T01:03:04.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.856+0000 7f25cbfff640 1 -- 172.21.15.1:0/2554543613 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f25d8010430 con 0x7f25e4076080 2024-09-21T01:03:04.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.856+0000 7f25ef9af740 1 Processor -- start 2024-09-21T01:03:04.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.856+0000 7f25ef9af740 1 -- start start 2024-09-21T01:03:04.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.856+0000 7f25ef9af740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638646b4070 0x563864a5b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:04.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.856+0000 7f25ef9af740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56386468b1b0 0x563864a5bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:04.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.856+0000 7f25ef9af740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563864693390 0x563864a5c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:04.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.856+0000 7f25ef9af740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5638649d1ea0 con 0x563864693390 2024-09-21T01:03:04.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.856+0000 7f25ef9af740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5638649c12d0 con 0x56386468b1b0 2024-09-21T01:03:04.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.856+0000 7f25ef9af740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5638649c50e0 con 0x5638646b4070 2024-09-21T01:03:04.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.857+0000 7f25e27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563864693390 0x563864a5c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:04.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.857+0000 7f25e2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56386468b1b0 0x563864a5bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:04.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.857+0000 7f25e2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56386468b1b0 0x563864a5bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:46418/0 (socket says 172.21.15.1:46418) 2024-09-21T01:03:04.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.857+0000 7f25e27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563864693390 0x563864a5c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58600/0 (socket says 172.21.15.1:58600) 2024-09-21T01:03:04.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.857+0000 7f25e2ffd640 1 -- 172.21.15.1:0/251946593 learned_addr learned my addr 172.21.15.1:0/251946593 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:04.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.857+0000 7f25cbfff640 1 --2- 172.21.15.1:0/2554543613 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f25cc0b6510 0x7f25cc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:04.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.857+0000 7f25e37fe640 1 --2- 172.21.15.1:0/251946593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638646b4070 0x563864a5b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:04.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.857+0000 7f25e2ffd640 1 -- 172.21.15.1:0/251946593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638646b4070 msgr2=0x563864a5b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:04.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.857+0000 7f25e37fe640 1 --2- 172.21.15.1:0/2554543613 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f25cc0b6510 0x7f25cc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:04.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.857+0000 7f25e2ffd640 1 --2- 172.21.15.1:0/251946593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638646b4070 0x563864a5b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:04.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.857+0000 7f25e2ffd640 1 -- 172.21.15.1:0/251946593 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563864693390 msgr2=0x563864a5c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:04.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.857+0000 7f25e2ffd640 1 --2- 172.21.15.1:0/251946593 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563864693390 0x563864a5c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:04.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.857+0000 7f25e2ffd640 1 -- 172.21.15.1:0/251946593 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56386471f650 con 0x56386468b1b0 2024-09-21T01:03:04.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.857+0000 7f25cbfff640 1 -- 172.21.15.1:0/2554543613 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f25d80e75a0 con 0x7f25e4076080 2024-09-21T01:03:04.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.857+0000 7f25e2ffd640 1 --2- 172.21.15.1:0/251946593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56386468b1b0 0x563864a5bbe0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f25d400bd10 tx=0x7f25d40107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f65a783501adad27 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:04.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.857+0000 7f25e37fe640 1 --2- 172.21.15.1:0/2554543613 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f25cc0b6510 0x7f25cc0b8a20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f25dc006010 tx=0x7f25dc0095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:04.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.857+0000 7f25c97fa640 1 -- 172.21.15.1:0/251946593 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d4004030 con 0x56386468b1b0 2024-09-21T01:03:04.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.858+0000 7f25c97fa640 1 -- 172.21.15.1:0/251946593 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25d40035f0 con 0x56386468b1b0 2024-09-21T01:03:04.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.858+0000 7f25c97fa640 1 -- 172.21.15.1:0/251946593 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d4011770 con 0x56386468b1b0 2024-09-21T01:03:04.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.858+0000 7f25ef9af740 1 -- 172.21.15.1:0/251946593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56386468b1b0 msgr2=0x563864a5bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:04.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.858+0000 7f25ef9af740 1 --2- 172.21.15.1:0/251946593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56386468b1b0 0x563864a5bbe0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f25d400bd10 tx=0x7f25d40107a0 comp rx=0 tx=0).stop 2024-09-21T01:03:04.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.858+0000 7f25ef9af740 1 -- 172.21.15.1:0/251946593 shutdown_connections 2024-09-21T01:03:04.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.858+0000 7f25ef9af740 1 --2- 172.21.15.1:0/251946593 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563864693390 0x563864a5c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:04.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.858+0000 7f25ef9af740 1 --2- 172.21.15.1:0/251946593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56386468b1b0 0x563864a5bbe0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:04.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.858+0000 7f25ef9af740 1 --2- 172.21.15.1:0/251946593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638646b4070 0x563864a5b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:04.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.859+0000 7f25ef9af740 1 -- 172.21.15.1:0/251946593 >> 172.21.15.1:0/251946593 conn(0x5638646a8460 msgr2=0x563864a59590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:04.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.859+0000 7f25ef9af740 1 -- 172.21.15.1:0/251946593 shutdown_connections 2024-09-21T01:03:04.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.859+0000 7f25ef9af740 1 -- 172.21.15.1:0/251946593 wait complete. 2024-09-21T01:03:04.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.859+0000 7f25ef9af740 1 -- start start 2024-09-21T01:03:04.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.859+0000 7f25ef9af740 1 Processor -- start 2024-09-21T01:03:04.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.860+0000 7f25ef9af740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56386468b1b0 0x563864a66d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:04.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.860+0000 7f25ef9af740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563864693390 0x563864a672a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:04.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.860+0000 7f25ef9af740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638646b4070 0x563864a73170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:04.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.860+0000 7f25ef9af740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563864822700 con 0x563864693390 2024-09-21T01:03:04.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.860+0000 7f25ef9af740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56386495c160 con 0x56386468b1b0 2024-09-21T01:03:04.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.860+0000 7f25ef9af740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563864a69e80 con 0x5638646b4070 2024-09-21T01:03:04.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.860+0000 7f25ef9af740 10 client.0 _ll_register_callbacks cb 0x5638649759e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:03:04.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.860+0000 7f25e27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563864693390 0x563864a672a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:04.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.860+0000 7f25e2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56386468b1b0 0x563864a66d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:04.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.860+0000 7f25e27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563864693390 0x563864a672a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58612/0 (socket says 172.21.15.1:58612) 2024-09-21T01:03:04.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.860+0000 7f25e27fc640 1 -- 172.21.15.1:0/3772778117 learned_addr learned my addr 172.21.15.1:0/3772778117 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:04.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.860+0000 7f25e37fe640 1 --2- 172.21.15.1:0/3772778117 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638646b4070 0x563864a73170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:04.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.860+0000 7f25e27fc640 1 -- 172.21.15.1:0/3772778117 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638646b4070 msgr2=0x563864a73170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:04.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.860+0000 7f25e27fc640 1 --2- 172.21.15.1:0/3772778117 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638646b4070 0x563864a73170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:04.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.860+0000 7f25e27fc640 1 -- 172.21.15.1:0/3772778117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56386468b1b0 msgr2=0x563864a66d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:04.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.860+0000 7f25e27fc640 1 --2- 172.21.15.1:0/3772778117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56386468b1b0 0x563864a66d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:04.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.860+0000 7f25e27fc640 1 -- 172.21.15.1:0/3772778117 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563864989c90 con 0x563864693390 2024-09-21T01:03:04.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.860+0000 7f25e37fe640 1 --2- 172.21.15.1:0/3772778117 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638646b4070 0x563864a73170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:03:04.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.860+0000 7f25e2ffd640 1 --2- 172.21.15.1:0/3772778117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56386468b1b0 0x563864a66d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:03:04.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.860+0000 7f25e27fc640 1 --2- 172.21.15.1:0/3772778117 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563864693390 0x563864a672a0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f25d80a9f80 tx=0x7f25d8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=318616b66e62aa5a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:04.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.860+0000 7f25c6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:03:04.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.860+0000 7f25c6ff5640 1 -- 172.21.15.1:0/3772778117 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d80e7310 con 0x563864693390 2024-09-21T01:03:04.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.860+0000 7f25c6ff5640 1 -- 172.21.15.1:0/3772778117 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f25d80a9110 con 0x563864693390 2024-09-21T01:03:04.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.860+0000 7f25ef9af740 1 -- 172.21.15.1:0/3772778117 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25d40035f0 con 0x563864693390 2024-09-21T01:03:04.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.861+0000 7f25c6ff5640 1 -- 172.21.15.1:0/3772778117 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f25d80ad2d0 con 0x563864693390 2024-09-21T01:03:04.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.861+0000 7f25ef9af740 10 client.16932 fetch_fsmap learned FSMap version 33 2024-09-21T01:03:04.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.861+0000 7f25ef9af740 1 -- 172.21.15.1:0/3772778117 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x563864a75b90 con 0x563864693390 2024-09-21T01:03:04.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.861+0000 7f25c6ff5640 1 -- 172.21.15.1:0/3772778117 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25d40035f0 con 0x563864693390 2024-09-21T01:03:04.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.861+0000 7f25c6ff5640 1 -- 172.21.15.1:0/3772778117 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f25d80930f0 con 0x563864693390 2024-09-21T01:03:04.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.861+0000 7f25ef9af740 10 client.16932 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:03:04.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.861+0000 7f25ef9af740 10 client.16932 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T01:03:04.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.861+0000 7f25ef9af740 20 client.16932 populate_metadata read hostname 'smithi001' 2024-09-21T01:03:04.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.861+0000 7f25ef9af740 1 --2- 172.21.15.1:0/3772778117 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x5638646729f0 0x563864a790c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:04.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.861+0000 7f25ef9af740 4 client.16932 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:03:04.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.861+0000 7f25ef9af740 1 -- 172.21.15.1:0/3772778117 --> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638649d3df0 con 0x5638646729f0 2024-09-21T01:03:04.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.861+0000 7f25e2ffd640 1 --2- 172.21.15.1:0/3772778117 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x5638646729f0 0x563864a790c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:04.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.862+0000 7f25e2ffd640 1 --2- 172.21.15.1:0/3772778117 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x5638646729f0 0x563864a790c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=768f72662d0346fd server_cookie=dc95fa22825d683a in_seq=0 out_seq=0 2024-09-21T01:03:04.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.862+0000 7f25c6ff5640 10 client.16932 ms_handle_connect on v2:172.21.15.193:6834/3631682268 2024-09-21T01:03:04.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.863+0000 7f25c6ff5640 1 -- 172.21.15.1:0/3772778117 <== mds.4 v2:172.21.15.193:6834/3631682268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5638649d3df0 con 0x5638646729f0 2024-09-21T01:03:04.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.863+0000 7f25c6ff5640 10 client.16932 handle_command_reply: tid=0 2024-09-21T01:03:04.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.863+0000 7f25ef9af740 1 client.16932 shutdown 2024-09-21T01:03:04.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.863+0000 7f25ef9af740 1 -- 172.21.15.1:0/3772778117 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563864693390 msgr2=0x563864a672a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:04.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.863+0000 7f25ef9af740 1 --2- 172.21.15.1:0/3772778117 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563864693390 0x563864a672a0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f25d80a9f80 tx=0x7f25d8000bc0 comp rx=0 tx=0).stop 2024-09-21T01:03:04.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.863+0000 7f25ef9af740 1 -- 172.21.15.1:0/3772778117 shutdown_connections 2024-09-21T01:03:04.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.863+0000 7f25ef9af740 1 --2- 172.21.15.1:0/3772778117 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x5638646729f0 0x563864a790c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:04.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.863+0000 7f25ef9af740 1 --2- 172.21.15.1:0/3772778117 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638646b4070 0x563864a73170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:04.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.863+0000 7f25ef9af740 1 --2- 172.21.15.1:0/3772778117 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563864693390 0x563864a672a0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:04.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.863+0000 7f25c6ff5640 0 client.16932 ms_handle_reset on v2:172.21.15.193:6834/3631682268 2024-09-21T01:03:04.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.863+0000 7f25ef9af740 1 --2- 172.21.15.1:0/3772778117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56386468b1b0 0x563864a66d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:04.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.863+0000 7f25ef9af740 1 -- 172.21.15.1:0/3772778117 >> 172.21.15.1:0/3772778117 conn(0x5638646a8460 msgr2=0x563864a5e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:04.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.863+0000 7f25ef9af740 1 -- 172.21.15.1:0/3772778117 shutdown_connections 2024-09-21T01:03:04.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.863+0000 7f25ef9af740 1 -- 172.21.15.1:0/3772778117 wait complete. 2024-09-21T01:03:04.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.863+0000 7f25ef9af740 20 client.16932 trim_cache size 0 max 16384 2024-09-21T01:03:04.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.876+0000 7f25ef9af740 1 Processor -- start 2024-09-21T01:03:04.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.876+0000 7f25ef9af740 1 -- start start 2024-09-21T01:03:04.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.877+0000 7f25ef9af740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638646729f0 0x563864a67220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:04.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.877+0000 7f25ef9af740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56386468b1b0 0x563864a73070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:04.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.877+0000 7f25ef9af740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563864693390 0x563864a63f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:04.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.877+0000 7f25ef9af740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f25e41b15f0 con 0x56386468b1b0 2024-09-21T01:03:04.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.877+0000 7f25ef9af740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f25e41b31f0 con 0x563864693390 2024-09-21T01:03:04.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.877+0000 7f25ef9af740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f25e41b1cc0 con 0x5638646729f0 2024-09-21T01:03:04.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.877+0000 7f25e27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56386468b1b0 0x563864a73070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:04.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.877+0000 7f25e27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56386468b1b0 0x563864a73070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58620/0 (socket says 172.21.15.1:58620) 2024-09-21T01:03:04.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.877+0000 7f25e27fc640 1 -- 172.21.15.1:0/332742128 learned_addr learned my addr 172.21.15.1:0/332742128 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:04.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.877+0000 7f25e37fe640 1 --2- 172.21.15.1:0/332742128 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563864693390 0x563864a63f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:04.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.877+0000 7f25e2ffd640 1 --2- 172.21.15.1:0/332742128 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638646729f0 0x563864a67220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:04.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.877+0000 7f25e27fc640 1 -- 172.21.15.1:0/332742128 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638646729f0 msgr2=0x563864a67220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:04.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.877+0000 7f25e27fc640 1 --2- 172.21.15.1:0/332742128 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638646729f0 0x563864a67220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:04.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.877+0000 7f25e27fc640 1 -- 172.21.15.1:0/332742128 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563864693390 msgr2=0x563864a63f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:04.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.877+0000 7f25e27fc640 1 --2- 172.21.15.1:0/332742128 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563864693390 0x563864a63f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:04.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.877+0000 7f25e27fc640 1 -- 172.21.15.1:0/332742128 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563864a68020 con 0x56386468b1b0 2024-09-21T01:03:04.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.877+0000 7f25e27fc640 1 --2- 172.21.15.1:0/332742128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56386468b1b0 0x563864a73070 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f25d80ad750 tx=0x7f25d80a9790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f29b328f8bbfd6f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:04.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.878+0000 7f25c8ff9640 1 -- 172.21.15.1:0/332742128 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d80b21f0 con 0x56386468b1b0 2024-09-21T01:03:04.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.878+0000 7f25c8ff9640 1 -- 172.21.15.1:0/332742128 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25d80b7130 con 0x56386468b1b0 2024-09-21T01:03:04.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.878+0000 7f25c8ff9640 1 -- 172.21.15.1:0/332742128 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d80e7370 con 0x56386468b1b0 2024-09-21T01:03:04.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.878+0000 7f25ef9af740 1 -- 172.21.15.1:0/332742128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56386468b1b0 msgr2=0x563864a73070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:04.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.878+0000 7f25ef9af740 1 --2- 172.21.15.1:0/332742128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56386468b1b0 0x563864a73070 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f25d80ad750 tx=0x7f25d80a9790 comp rx=0 tx=0).stop 2024-09-21T01:03:04.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.878+0000 7f25ef9af740 1 -- 172.21.15.1:0/332742128 shutdown_connections 2024-09-21T01:03:04.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.878+0000 7f25ef9af740 1 --2- 172.21.15.1:0/332742128 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563864693390 0x563864a63f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:04.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.878+0000 7f25ef9af740 1 --2- 172.21.15.1:0/332742128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56386468b1b0 0x563864a73070 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:04.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.878+0000 7f25ef9af740 1 --2- 172.21.15.1:0/332742128 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638646729f0 0x563864a67220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:04.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.878+0000 7f25ef9af740 1 -- 172.21.15.1:0/332742128 >> 172.21.15.1:0/332742128 conn(0x5638646a8460 msgr2=0x563864a66b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:04.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.879+0000 7f25ef9af740 1 -- 172.21.15.1:0/332742128 shutdown_connections 2024-09-21T01:03:04.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.879+0000 7f25ef9af740 1 -- 172.21.15.1:0/332742128 wait complete. 2024-09-21T01:03:04.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.879+0000 7f25ef9af740 1 -- start start 2024-09-21T01:03:04.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.879+0000 7f25ef9af740 1 Processor -- start 2024-09-21T01:03:04.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.879+0000 7f25ef9af740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638646729f0 0x563864a6b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:04.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.879+0000 7f25ef9af740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56386468b1b0 0x563864a6b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:04.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.879+0000 7f25ef9af740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563864693390 0x563864a6bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:04.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.879+0000 7f25ef9af740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f25e41b2b20 con 0x563864693390 2024-09-21T01:03:04.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.879+0000 7f25ef9af740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f25e41b2450 con 0x5638646729f0 2024-09-21T01:03:04.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.879+0000 7f25ef9af740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f25e41af5d0 con 0x56386468b1b0 2024-09-21T01:03:04.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.879+0000 7f25ef9af740 10 client.0 _ll_register_callbacks cb 0x7f25d80ad110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:03:04.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.880+0000 7f25e37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563864693390 0x563864a6bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:04.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.880+0000 7f25e2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638646729f0 0x563864a6b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:04.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.880+0000 7f25e2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638646729f0 0x563864a6b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:46442/0 (socket says 172.21.15.1:46442) 2024-09-21T01:03:04.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.880+0000 7f25e2ffd640 1 -- 172.21.15.1:0/1817769910 learned_addr learned my addr 172.21.15.1:0/1817769910 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:04.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.880+0000 7f25e27fc640 1 --2- 172.21.15.1:0/1817769910 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56386468b1b0 0x563864a6b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:04.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.880+0000 7f25e2ffd640 1 -- 172.21.15.1:0/1817769910 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56386468b1b0 msgr2=0x563864a6b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:04.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.880+0000 7f25e2ffd640 1 --2- 172.21.15.1:0/1817769910 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56386468b1b0 0x563864a6b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:04.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.880+0000 7f25e2ffd640 1 -- 172.21.15.1:0/1817769910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563864693390 msgr2=0x563864a6bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:04.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.880+0000 7f25e2ffd640 1 --2- 172.21.15.1:0/1817769910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563864693390 0x563864a6bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:04.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.880+0000 7f25e2ffd640 1 -- 172.21.15.1:0/1817769910 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563864ae2a80 con 0x5638646729f0 2024-09-21T01:03:04.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.880+0000 7f25e27fc640 1 --2- 172.21.15.1:0/1817769910 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56386468b1b0 0x563864a6b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:03:04.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.880+0000 7f25e37fe640 1 --2- 172.21.15.1:0/1817769910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563864693390 0x563864a6bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:03:04.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.880+0000 7f25e2ffd640 1 --2- 172.21.15.1:0/1817769910 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638646729f0 0x563864a6b050 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x563864a5a320 tx=0x7f25d400bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bea866d74953207 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:04.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.880+0000 7f25c6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:03:04.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.880+0000 7f25c6ff5640 1 -- 172.21.15.1:0/1817769910 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d4032060 con 0x5638646729f0 2024-09-21T01:03:04.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.880+0000 7f25ef9af740 1 -- 172.21.15.1:0/1817769910 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25d80b7130 con 0x5638646729f0 2024-09-21T01:03:04.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.880+0000 7f25c6ff5640 1 -- 172.21.15.1:0/1817769910 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f25d4005450 con 0x5638646729f0 2024-09-21T01:03:04.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.881+0000 7f25c6ff5640 1 -- 172.21.15.1:0/1817769910 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f25d4005650 con 0x5638646729f0 2024-09-21T01:03:04.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.881+0000 7f25ef9af740 10 client.26594 fetch_fsmap learned FSMap version 33 2024-09-21T01:03:04.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.881+0000 7f25ef9af740 1 -- 172.21.15.1:0/1817769910 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x563864ae3ca0 con 0x5638646729f0 2024-09-21T01:03:04.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.881+0000 7f25c6ff5640 1 -- 172.21.15.1:0/1817769910 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25d80b7130 con 0x5638646729f0 2024-09-21T01:03:04.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.881+0000 7f25c6ff5640 1 -- 172.21.15.1:0/1817769910 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f25d4011740 con 0x5638646729f0 2024-09-21T01:03:04.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.881+0000 7f25ef9af740 10 client.26594 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:03:04.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.881+0000 7f25ef9af740 10 client.26594 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T01:03:04.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.881+0000 7f25ef9af740 20 client.26594 populate_metadata read hostname 'smithi001' 2024-09-21T01:03:04.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.881+0000 7f25ef9af740 1 --2- 172.21.15.1:0/1817769910 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x5638646b4070 0x563864ae61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:04.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.881+0000 7f25ef9af740 4 client.26594 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:03:04.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.881+0000 7f25ef9af740 1 -- 172.21.15.1:0/1817769910 --> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5638649cf8a0 con 0x5638646b4070 2024-09-21T01:03:04.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.881+0000 7f25e27fc640 1 --2- 172.21.15.1:0/1817769910 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x5638646b4070 0x563864ae61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:04.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.882+0000 7f25e27fc640 1 --2- 172.21.15.1:0/1817769910 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x5638646b4070 0x563864ae61b0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2b5d83bae37174d6 server_cookie=481d19633c68502f in_seq=0 out_seq=0 2024-09-21T01:03:04.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.882+0000 7f25c6ff5640 10 client.26594 ms_handle_connect on v2:172.21.15.193:6834/3631682268 2024-09-21T01:03:04.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.882+0000 7f25c6ff5640 1 -- 172.21.15.1:0/1817769910 <== mds.4 v2:172.21.15.193:6834/3631682268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5638649cf8a0 con 0x5638646b4070 2024-09-21T01:03:04.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.882+0000 7f25c6ff5640 10 client.26594 handle_command_reply: tid=0 2024-09-21T01:03:04.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.882+0000 7f25ef9af740 1 client.26594 shutdown 2024-09-21T01:03:04.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.882+0000 7f25ef9af740 1 -- 172.21.15.1:0/1817769910 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638646729f0 msgr2=0x563864a6b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:04.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.882+0000 7f25ef9af740 1 --2- 172.21.15.1:0/1817769910 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638646729f0 0x563864a6b050 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x563864a5a320 tx=0x7f25d400bf00 comp rx=0 tx=0).stop 2024-09-21T01:03:04.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.882+0000 7f25ef9af740 1 -- 172.21.15.1:0/1817769910 shutdown_connections 2024-09-21T01:03:04.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.882+0000 7f25ef9af740 1 --2- 172.21.15.1:0/1817769910 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x5638646b4070 0x563864ae61b0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:04.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.882+0000 7f25ef9af740 1 --2- 172.21.15.1:0/1817769910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563864693390 0x563864a6bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:04.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.882+0000 7f25ef9af740 1 --2- 172.21.15.1:0/1817769910 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56386468b1b0 0x563864a6b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:04.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.882+0000 7f25ef9af740 1 --2- 172.21.15.1:0/1817769910 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638646729f0 0x563864a6b050 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:04.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.882+0000 7f25c6ff5640 0 client.26594 ms_handle_reset on v2:172.21.15.193:6834/3631682268 2024-09-21T01:03:04.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.882+0000 7f25ef9af740 1 -- 172.21.15.1:0/1817769910 >> 172.21.15.1:0/1817769910 conn(0x5638646a8460 msgr2=0x563864a5c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:04.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.882+0000 7f25ef9af740 1 -- 172.21.15.1:0/1817769910 shutdown_connections 2024-09-21T01:03:04.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.883+0000 7f25ef9af740 1 -- 172.21.15.1:0/1817769910 wait complete. 2024-09-21T01:03:04.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.883+0000 7f25ef9af740 20 client.26594 trim_cache size 0 max 16384 2024-09-21T01:03:04.894 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T01:03:04.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.883+0000 7f25e943b640 1 -- 172.21.15.1:0/2554543613 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f25cc0b6510 msgr2=0x7f25cc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:04.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.883+0000 7f25e943b640 1 --2- 172.21.15.1:0/2554543613 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f25cc0b6510 0x7f25cc0b8a20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f25dc006010 tx=0x7f25dc0095c0 comp rx=0 tx=0).stop 2024-09-21T01:03:04.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.883+0000 7f25e943b640 1 -- 172.21.15.1:0/2554543613 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25e4076080 msgr2=0x7f25e419cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:04.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.883+0000 7f25e943b640 1 --2- 172.21.15.1:0/2554543613 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25e4076080 0x7f25e419cb70 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f25d800e9f0 tx=0x7f25d800eeb0 comp rx=0 tx=0).stop 2024-09-21T01:03:04.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.883+0000 7f25e943b640 1 -- 172.21.15.1:0/2554543613 shutdown_connections 2024-09-21T01:03:04.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.883+0000 7f25e943b640 1 --2- 172.21.15.1:0/2554543613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25e4110140 0x7f25e41a1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:04.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.883+0000 7f25e943b640 1 --2- 172.21.15.1:0/2554543613 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f25cc0b6510 0x7f25cc0b8a20 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:04.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.883+0000 7f25e943b640 1 --2- 172.21.15.1:0/2554543613 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25e4076080 0x7f25e419cb70 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:04.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.883+0000 7f25e943b640 1 --2- 172.21.15.1:0/2554543613 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f25e4075730 0x7f25e419c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:04.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.883+0000 7f25e943b640 1 -- 172.21.15.1:0/2554543613 >> 172.21.15.1:0/2554543613 conn(0x7f25e407b850 msgr2=0x7f25e4101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:04.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.883+0000 7f25e943b640 1 -- 172.21.15.1:0/2554543613 shutdown_connections 2024-09-21T01:03:04.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:04.883+0000 7f25e943b640 1 -- 172.21.15.1:0/2554543613 wait complete. 2024-09-21T01:03:05.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:05 smithi001 ceph-mon[31211]: pgmap v534: 97 pgs: 97 active+clean; 664 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.5 MiB/s wr, 582 op/s 2024-09-21T01:03:05.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:05 smithi193 ceph-mon[34660]: pgmap v534: 97 pgs: 97 active+clean; 664 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.5 MiB/s wr, 582 op/s 2024-09-21T01:03:05.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:05 smithi042 ceph-mon[34481]: pgmap v534: 97 pgs: 97 active+clean; 664 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.5 MiB/s wr, 582 op/s 2024-09-21T01:03:05.747 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T01:03:06.501 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:03:07.397 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:07 smithi001 ceph-mon[31211]: pgmap v535: 97 pgs: 97 active+clean; 702 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 6.9 MiB/s wr, 769 op/s 2024-09-21T01:03:07.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.611+0000 7f101e2a3640 1 -- 172.21.15.1:0/4016003230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f101810dbf0 msgr2=0x7f101810e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:07.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.611+0000 7f101e2a3640 1 --2- 172.21.15.1:0/4016003230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f101810dbf0 0x7f101810e000 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f101001a910 tx=0x7f101003b470 comp rx=0 tx=0).stop 2024-09-21T01:03:07.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.614+0000 7f101e2a3640 1 -- 172.21.15.1:0/4016003230 shutdown_connections 2024-09-21T01:03:07.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.614+0000 7f101e2a3640 1 --2- 172.21.15.1:0/4016003230 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f101811cba0 0x7f101811efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:07.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.614+0000 7f101e2a3640 1 --2- 172.21.15.1:0/4016003230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f101810dbf0 0x7f101810e000 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:07.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.614+0000 7f101e2a3640 1 --2- 172.21.15.1:0/4016003230 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1018111cd0 0x7f101810d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:07.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.614+0000 7f101e2a3640 1 -- 172.21.15.1:0/4016003230 >> 172.21.15.1:0/4016003230 conn(0x7f101806e9f0 msgr2=0x7f101806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:07.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.618+0000 7f101e2a3640 1 -- 172.21.15.1:0/4016003230 shutdown_connections 2024-09-21T01:03:07.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.619+0000 7f101e2a3640 1 -- 172.21.15.1:0/4016003230 wait complete. 2024-09-21T01:03:07.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.620+0000 7f101e2a3640 1 Processor -- start 2024-09-21T01:03:07.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.620+0000 7f101e2a3640 1 -- start start 2024-09-21T01:03:07.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.621+0000 7f101e2a3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f101810dbf0 0x7f101811c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:07.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.621+0000 7f101e2a3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1018111cd0 0x7f10181187e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:07.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.621+0000 7f101e2a3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f101811cba0 0x7f1018118e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:07.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.621+0000 7f101e2a3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1018114c50 con 0x7f1018111cd0 2024-09-21T01:03:07.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.621+0000 7f101e2a3640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1018114ad0 con 0x7f101811cba0 2024-09-21T01:03:07.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.621+0000 7f101e2a3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1018114dd0 con 0x7f101810dbf0 2024-09-21T01:03:07.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.621+0000 7f101daa2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f101811cba0 0x7f1018118e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:07.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.621+0000 7f101daa2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f101811cba0 0x7f1018118e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:46460/0 (socket says 172.21.15.1:46460) 2024-09-21T01:03:07.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.621+0000 7f101daa2640 1 -- 172.21.15.1:0/587612012 learned_addr learned my addr 172.21.15.1:0/587612012 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:07.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.622+0000 7f101d2a1640 1 --2- 172.21.15.1:0/587612012 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f101810dbf0 0x7f101811c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:07.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.622+0000 7f101caa0640 1 --2- 172.21.15.1:0/587612012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1018111cd0 0x7f10181187e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:07.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.622+0000 7f101d2a1640 1 -- 172.21.15.1:0/587612012 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f101811cba0 msgr2=0x7f1018118e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:07.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.622+0000 7f101d2a1640 1 --2- 172.21.15.1:0/587612012 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f101811cba0 0x7f1018118e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:07.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.622+0000 7f101d2a1640 1 -- 172.21.15.1:0/587612012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1018111cd0 msgr2=0x7f10181187e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:07.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.622+0000 7f101d2a1640 1 --2- 172.21.15.1:0/587612012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1018111cd0 0x7f10181187e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:07.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.622+0000 7f101d2a1640 1 -- 172.21.15.1:0/587612012 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10181acc00 con 0x7f101810dbf0 2024-09-21T01:03:07.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.623+0000 7f101d2a1640 1 --2- 172.21.15.1:0/587612012 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f101810dbf0 0x7f101811c500 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f100400e9c0 tx=0x7f100400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:07.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.628+0000 7f10167fc640 1 -- 172.21.15.1:0/587612012 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100400ccc0 con 0x7f101810dbf0 2024-09-21T01:03:07.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.628+0000 7f101e2a3640 1 -- 172.21.15.1:0/587612012 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10181acdd0 con 0x7f101810dbf0 2024-09-21T01:03:07.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.628+0000 7f101e2a3640 1 -- 172.21.15.1:0/587612012 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10181ad2a0 con 0x7f101810dbf0 2024-09-21T01:03:07.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.633+0000 7f1025a79740 1 Processor -- start 2024-09-21T01:03:07.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.633+0000 7f10167fc640 1 -- 172.21.15.1:0/587612012 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10040035f0 con 0x7f101810dbf0 2024-09-21T01:03:07.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.634+0000 7f10167fc640 1 -- 172.21.15.1:0/587612012 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100400ce60 con 0x7f101810dbf0 2024-09-21T01:03:07.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.634+0000 7f1025a79740 1 -- start start 2024-09-21T01:03:07.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.636+0000 7f1025a79740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6ceae2070 0x55b6cee89860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:07.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.636+0000 7f1025a79740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b6ceab91b0 0x55b6cee89da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:07.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.636+0000 7f1025a79740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6ceac1390 0x55b6cee8a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:07.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.636+0000 7f1025a79740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b6cedffea0 con 0x55b6ceae2070 2024-09-21T01:03:07.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.636+0000 7f1025a79740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b6cedef2d0 con 0x55b6ceab91b0 2024-09-21T01:03:07.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.636+0000 7f1025a79740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b6cedf30e0 con 0x55b6ceac1390 2024-09-21T01:03:07.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.637+0000 7f101daa2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6ceae2070 0x55b6cee89860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:07.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.637+0000 7f101daa2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6ceae2070 0x55b6cee89860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58640/0 (socket says 172.21.15.1:58640) 2024-09-21T01:03:07.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.637+0000 7f101daa2640 1 -- 172.21.15.1:0/4089402886 learned_addr learned my addr 172.21.15.1:0/4089402886 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:07.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.640+0000 7f101d2a1640 1 --2- 172.21.15.1:0/4089402886 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b6ceab91b0 0x55b6cee89da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:07.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.640+0000 7f10167fc640 1 -- 172.21.15.1:0/587612012 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f1004004020 con 0x7f101810dbf0 2024-09-21T01:03:07.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.641+0000 7f101caa0640 1 --2- 172.21.15.1:0/4089402886 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6ceac1390 0x55b6cee8a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:07.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.641+0000 7f101daa2640 1 -- 172.21.15.1:0/4089402886 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6ceac1390 msgr2=0x55b6cee8a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:07.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.641+0000 7f101daa2640 1 --2- 172.21.15.1:0/4089402886 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6ceac1390 0x55b6cee8a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:07.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.641+0000 7f101daa2640 1 -- 172.21.15.1:0/4089402886 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b6ceab91b0 msgr2=0x55b6cee89da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:07.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.641+0000 7f101daa2640 1 --2- 172.21.15.1:0/4089402886 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b6ceab91b0 0x55b6cee89da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:07.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.641+0000 7f101daa2640 1 -- 172.21.15.1:0/4089402886 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6ceb4d650 con 0x55b6ceae2070 2024-09-21T01:03:07.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.642+0000 7f10167fc640 1 --2- 172.21.15.1:0/587612012 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f10080b6720 0x7f10080b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:07.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.643+0000 7f10167fc640 1 -- 172.21.15.1:0/587612012 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f10040e74b0 con 0x7f101810dbf0 2024-09-21T01:03:07.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.643+0000 7f101daa2640 1 --2- 172.21.15.1:0/4089402886 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6ceae2070 0x55b6cee89860 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f100c00e270 tx=0x7f100c0096f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7271e5835d97c44 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:07.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.644+0000 7f10037fe640 1 -- 172.21.15.1:0/4089402886 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100c018020 con 0x55b6ceae2070 2024-09-21T01:03:07.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.644+0000 7f10037fe640 1 -- 172.21.15.1:0/4089402886 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f100c014d40 con 0x55b6ceae2070 2024-09-21T01:03:07.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.645+0000 7f101d2a1640 1 --2- 172.21.15.1:0/587612012 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f10080b6720 0x7f10080b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:07.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.646+0000 7f1025a79740 1 -- 172.21.15.1:0/4089402886 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6ceae2070 msgr2=0x55b6cee89860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:07.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.646+0000 7f1025a79740 1 --2- 172.21.15.1:0/4089402886 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6ceae2070 0x55b6cee89860 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f100c00e270 tx=0x7f100c0096f0 comp rx=0 tx=0).stop 2024-09-21T01:03:07.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.646+0000 7f101d2a1640 1 --2- 172.21.15.1:0/587612012 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f10080b6720 0x7f10080b8c30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f10040aa830 tx=0x7f1004000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:07.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.648+0000 7f1025a79740 1 -- 172.21.15.1:0/4089402886 shutdown_connections 2024-09-21T01:03:07.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.648+0000 7f1025a79740 1 --2- 172.21.15.1:0/4089402886 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6ceac1390 0x55b6cee8a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:07.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.648+0000 7f1025a79740 1 --2- 172.21.15.1:0/4089402886 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b6ceab91b0 0x55b6cee89da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:07.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.648+0000 7f1025a79740 1 --2- 172.21.15.1:0/4089402886 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6ceae2070 0x55b6cee89860 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:07.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.648+0000 7f1025a79740 1 -- 172.21.15.1:0/4089402886 >> 172.21.15.1:0/4089402886 conn(0x55b6cead6460 msgr2=0x55b6cee87750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:07.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.653+0000 7f1025a79740 1 -- 172.21.15.1:0/4089402886 shutdown_connections 2024-09-21T01:03:07.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.653+0000 7f1025a79740 1 -- 172.21.15.1:0/4089402886 wait complete. 2024-09-21T01:03:07.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.654+0000 7f1025a79740 1 -- start start 2024-09-21T01:03:07.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.654+0000 7f1025a79740 1 Processor -- start 2024-09-21T01:03:07.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.659+0000 7f1025a79740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6ceab91b0 0x55b6cee94e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:07.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.659+0000 7f1025a79740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b6ceac1390 0x55b6cee953b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:07.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.659+0000 7f1025a79740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6ceae2070 0x55b6cee958f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:07.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.659+0000 7f101daa2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6ceab91b0 0x55b6cee94e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:07.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.659+0000 7f101daa2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6ceab91b0 0x55b6cee94e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:53318/0 (socket says 172.21.15.1:53318) 2024-09-21T01:03:07.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.659+0000 7f101daa2640 1 -- 172.21.15.1:0/2564234791 learned_addr learned my addr 172.21.15.1:0/2564234791 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:07.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.660+0000 7f1025a79740 1 -- 172.21.15.1:0/2564234791 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b6cec50700 con 0x55b6ceae2070 2024-09-21T01:03:07.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.660+0000 7f1025a79740 1 -- 172.21.15.1:0/2564234791 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b6ced8a160 con 0x55b6ceac1390 2024-09-21T01:03:07.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.661+0000 7f1025a79740 1 -- 172.21.15.1:0/2564234791 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b6cee98090 con 0x55b6ceab91b0 2024-09-21T01:03:07.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.661+0000 7f1025a79740 10 client.0 _ll_register_callbacks cb 0x55b6ceda39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:03:07.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.661+0000 7f101daa2640 1 --2- 172.21.15.1:0/2564234791 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6ceae2070 0x55b6cee958f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:07.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.662+0000 7f101daa2640 1 -- 172.21.15.1:0/2564234791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b6ceac1390 msgr2=0x55b6cee953b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:03:07.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.662+0000 7f101daa2640 1 --2- 172.21.15.1:0/2564234791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b6ceac1390 0x55b6cee953b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:07.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.662+0000 7f101daa2640 1 -- 172.21.15.1:0/2564234791 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6ceae2070 msgr2=0x55b6cee958f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:07.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.662+0000 7f101daa2640 1 --2- 172.21.15.1:0/2564234791 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6ceae2070 0x55b6cee958f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:07.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.662+0000 7f101daa2640 1 -- 172.21.15.1:0/2564234791 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6cedb7c90 con 0x55b6ceab91b0 2024-09-21T01:03:07.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.663+0000 7f101daa2640 1 --2- 172.21.15.1:0/2564234791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6ceab91b0 0x55b6cee94e70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f100c009b60 tx=0x7f100c013890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4d805b0115fa9a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:07.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.663+0000 7f1000ff9640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T01:03:07.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.668+0000 7f1000ff9640 1 -- 172.21.15.1:0/2564234791 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100c018070 con 0x55b6ceab91b0 2024-09-21T01:03:07.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.669+0000 7f1025a79740 1 -- 172.21.15.1:0/2564234791 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f100c014d40 con 0x55b6ceab91b0 2024-09-21T01:03:07.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.669+0000 7f1000ff9640 1 -- 172.21.15.1:0/2564234791 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f100c01e430 con 0x55b6ceab91b0 2024-09-21T01:03:07.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.676+0000 7f1000ff9640 1 -- 172.21.15.1:0/2564234791 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f100c01e630 con 0x55b6ceab91b0 2024-09-21T01:03:07.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.678+0000 7f1025a79740 10 client.26473 fetch_fsmap learned FSMap version 33 2024-09-21T01:03:07.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.678+0000 7f1025a79740 1 -- 172.21.15.1:0/2564234791 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55b6ceea3d80 con 0x55b6ceab91b0 2024-09-21T01:03:07.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.682+0000 7f1000ff9640 1 -- 172.21.15.1:0/2564234791 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f100c014d40 con 0x55b6ceab91b0 2024-09-21T01:03:07.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.682+0000 7f1000ff9640 1 -- 172.21.15.1:0/2564234791 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f100c01d750 con 0x55b6ceab91b0 2024-09-21T01:03:07.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.685+0000 7f1025a79740 10 client.26473 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:03:07.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.685+0000 7f1025a79740 10 client.26473 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-21T01:03:07.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.685+0000 7f1025a79740 20 client.26473 populate_metadata read hostname 'smithi001' 2024-09-21T01:03:07.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.685+0000 7f1025a79740 1 --2- 172.21.15.1:0/2564234791 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x55b6ceaa09f0 0x55b6ceea71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:07.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.685+0000 7f1025a79740 4 client.26473 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:03:07.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.685+0000 7f1025a79740 1 -- 172.21.15.1:0/2564234791 --> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b6cee01df0 con 0x55b6ceaa09f0 2024-09-21T01:03:07.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.687+0000 7f101caa0640 1 --2- 172.21.15.1:0/2564234791 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x55b6ceaa09f0 0x55b6ceea71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:07.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.701+0000 7f101caa0640 1 --2- 172.21.15.1:0/2564234791 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x55b6ceaa09f0 0x55b6ceea71a0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4bc10ce62f68c0c9 server_cookie=e7c183f104783686 in_seq=0 out_seq=0 2024-09-21T01:03:07.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.701+0000 7f1000ff9640 10 client.26473 ms_handle_connect on v2:172.21.15.193:6836/909252228 2024-09-21T01:03:07.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.705+0000 7f1000ff9640 1 -- 172.21.15.1:0/2564234791 <== mds.3 v2:172.21.15.193:6836/909252228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b6cee01df0 con 0x55b6ceaa09f0 2024-09-21T01:03:07.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.705+0000 7f1000ff9640 10 client.26473 handle_command_reply: tid=0 2024-09-21T01:03:07.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.705+0000 7f1025a79740 1 client.26473 shutdown 2024-09-21T01:03:07.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.708+0000 7f1025a79740 1 -- 172.21.15.1:0/2564234791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6ceab91b0 msgr2=0x55b6cee94e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:07.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.708+0000 7f1025a79740 1 --2- 172.21.15.1:0/2564234791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6ceab91b0 0x55b6cee94e70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f100c009b60 tx=0x7f100c013890 comp rx=0 tx=0).stop 2024-09-21T01:03:07.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.708+0000 7f1025a79740 1 -- 172.21.15.1:0/2564234791 shutdown_connections 2024-09-21T01:03:07.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.708+0000 7f1025a79740 1 --2- 172.21.15.1:0/2564234791 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x55b6ceaa09f0 0x55b6ceea71a0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:07.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.708+0000 7f1025a79740 1 --2- 172.21.15.1:0/2564234791 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6ceae2070 0x55b6cee958f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:07.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.708+0000 7f1025a79740 1 --2- 172.21.15.1:0/2564234791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b6ceac1390 0x55b6cee953b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:07.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.708+0000 7f1025a79740 1 --2- 172.21.15.1:0/2564234791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6ceab91b0 0x55b6cee94e70 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:07.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.708+0000 7f1025a79740 1 -- 172.21.15.1:0/2564234791 >> 172.21.15.1:0/2564234791 conn(0x55b6cead6460 msgr2=0x55b6cee8ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:07.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.708+0000 7f1000ff9640 0 client.26473 ms_handle_reset on v2:172.21.15.193:6836/909252228 2024-09-21T01:03:07.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.708+0000 7f1025a79740 1 -- 172.21.15.1:0/2564234791 shutdown_connections 2024-09-21T01:03:07.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.708+0000 7f1025a79740 1 -- 172.21.15.1:0/2564234791 wait complete. 2024-09-21T01:03:07.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.708+0000 7f1025a79740 20 client.26473 trim_cache size 0 max 16384 2024-09-21T01:03:07.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:07 smithi193 ceph-mon[34660]: pgmap v535: 97 pgs: 97 active+clean; 702 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 6.9 MiB/s wr, 769 op/s 2024-09-21T01:03:07.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:07 smithi042 ceph-mon[34481]: pgmap v535: 97 pgs: 97 active+clean; 702 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 6.9 MiB/s wr, 769 op/s 2024-09-21T01:03:07.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.745+0000 7f1025a79740 1 Processor -- start 2024-09-21T01:03:07.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.747+0000 7f1025a79740 1 -- start start 2024-09-21T01:03:07.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.747+0000 7f1025a79740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6ceab91b0 0x55b6cee96aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:07.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.747+0000 7f1025a79740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6ceac1390 0x55b6cee86d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:07.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.748+0000 7f1025a79740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b6ceae2070 0x55b6cee87260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:07.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.748+0000 7f101daa2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6ceab91b0 0x55b6cee96aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:07.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.748+0000 7f101daa2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6ceab91b0 0x55b6cee96aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:53324/0 (socket says 172.21.15.1:53324) 2024-09-21T01:03:07.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.748+0000 7f101daa2640 1 -- 172.21.15.1:0/1844246466 learned_addr learned my addr 172.21.15.1:0/1844246466 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:07.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.748+0000 7f1025a79740 1 -- 172.21.15.1:0/1844246466 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0ffc00e680 con 0x55b6ceac1390 2024-09-21T01:03:07.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.748+0000 7f1025a79740 1 -- 172.21.15.1:0/1844246466 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0ffc010280 con 0x55b6ceae2070 2024-09-21T01:03:07.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.748+0000 7f1025a79740 1 -- 172.21.15.1:0/1844246466 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0ffc00ed50 con 0x55b6ceab91b0 2024-09-21T01:03:07.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.748+0000 7f101daa2640 1 --2- 172.21.15.1:0/1844246466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b6ceae2070 0x55b6cee87260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:07.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.752+0000 7f101daa2640 1 -- 172.21.15.1:0/1844246466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b6ceae2070 msgr2=0x55b6cee87260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:07.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.752+0000 7f101daa2640 1 --2- 172.21.15.1:0/1844246466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b6ceae2070 0x55b6cee87260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:07.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.752+0000 7f101daa2640 1 -- 172.21.15.1:0/1844246466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6ceac1390 msgr2=0x55b6cee86d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:07.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.752+0000 7f101daa2640 1 --2- 172.21.15.1:0/1844246466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6ceac1390 0x55b6cee86d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:07.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.752+0000 7f101daa2640 1 -- 172.21.15.1:0/1844246466 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6cee8c6c0 con 0x55b6ceab91b0 2024-09-21T01:03:07.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.757+0000 7f101daa2640 1 --2- 172.21.15.1:0/1844246466 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6ceab91b0 0x55b6cee96aa0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f100c00ec40 tx=0x7f100c021040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12bd3cba40c75249 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:07.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.759+0000 7f1002ffd640 1 -- 172.21.15.1:0/1844246466 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100c018070 con 0x55b6ceab91b0 2024-09-21T01:03:07.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.759+0000 7f1002ffd640 1 -- 172.21.15.1:0/1844246466 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f100c023040 con 0x55b6ceab91b0 2024-09-21T01:03:07.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.759+0000 7f1002ffd640 1 -- 172.21.15.1:0/1844246466 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100c014ca0 con 0x55b6ceab91b0 2024-09-21T01:03:07.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.762+0000 7f1025a79740 1 -- 172.21.15.1:0/1844246466 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6ceab91b0 msgr2=0x55b6cee96aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:07.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.762+0000 7f1025a79740 1 --2- 172.21.15.1:0/1844246466 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6ceab91b0 0x55b6cee96aa0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f100c00ec40 tx=0x7f100c021040 comp rx=0 tx=0).stop 2024-09-21T01:03:07.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.764+0000 7f1025a79740 1 -- 172.21.15.1:0/1844246466 shutdown_connections 2024-09-21T01:03:07.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.764+0000 7f1025a79740 1 --2- 172.21.15.1:0/1844246466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b6ceae2070 0x55b6cee87260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:07.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.764+0000 7f1025a79740 1 --2- 172.21.15.1:0/1844246466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6ceac1390 0x55b6cee86d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:07.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.764+0000 7f1025a79740 1 --2- 172.21.15.1:0/1844246466 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6ceab91b0 0x55b6cee96aa0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:07.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.764+0000 7f1025a79740 1 -- 172.21.15.1:0/1844246466 >> 172.21.15.1:0/1844246466 conn(0x55b6cead6460 msgr2=0x55b6cee96390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:07.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.773+0000 7f1025a79740 1 -- 172.21.15.1:0/1844246466 shutdown_connections 2024-09-21T01:03:07.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.774+0000 7f1025a79740 1 -- 172.21.15.1:0/1844246466 wait complete. 2024-09-21T01:03:07.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.774+0000 7f1025a79740 1 -- start start 2024-09-21T01:03:07.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.774+0000 7f1025a79740 1 Processor -- start 2024-09-21T01:03:07.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.775+0000 7f1025a79740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6ceab91b0 0x55b6cee9a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:07.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.775+0000 7f1025a79740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b6ceac1390 0x55b6cee9a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:07.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.775+0000 7f1025a79740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6ceae2070 0x55b6cef09a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:07.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.775+0000 7f101daa2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6ceab91b0 0x55b6cee9a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:07.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.776+0000 7f101daa2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6ceab91b0 0x55b6cee9a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:53326/0 (socket says 172.21.15.1:53326) 2024-09-21T01:03:07.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.776+0000 7f101daa2640 1 -- 172.21.15.1:0/2847804286 learned_addr learned my addr 172.21.15.1:0/2847804286 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:07.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.776+0000 7f1025a79740 1 -- 172.21.15.1:0/2847804286 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0ffc00fbb0 con 0x55b6ceae2070 2024-09-21T01:03:07.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.776+0000 7f1025a79740 1 -- 172.21.15.1:0/2847804286 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0ffc00f4e0 con 0x55b6ceac1390 2024-09-21T01:03:07.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.776+0000 7f1025a79740 1 -- 172.21.15.1:0/2847804286 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0ffc00c660 con 0x55b6ceab91b0 2024-09-21T01:03:07.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.776+0000 7f101daa2640 1 --2- 172.21.15.1:0/2847804286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6ceae2070 0x55b6cef09a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:07.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.776+0000 7f1025a79740 10 client.0 _ll_register_callbacks cb 0x7f100c00e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:03:07.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.776+0000 7f101daa2640 1 -- 172.21.15.1:0/2847804286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b6ceac1390 msgr2=0x55b6cee9a8b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:03:07.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.776+0000 7f101daa2640 1 --2- 172.21.15.1:0/2847804286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b6ceac1390 0x55b6cee9a8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:07.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.776+0000 7f101daa2640 1 -- 172.21.15.1:0/2847804286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6ceae2070 msgr2=0x55b6cef09a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:07.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.776+0000 7f101daa2640 1 --2- 172.21.15.1:0/2847804286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6ceae2070 0x55b6cef09a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:07.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.776+0000 7f101daa2640 1 -- 172.21.15.1:0/2847804286 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6cef0a0e0 con 0x55b6ceab91b0 2024-09-21T01:03:07.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.779+0000 7f101daa2640 1 --2- 172.21.15.1:0/2847804286 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6ceab91b0 0x55b6cee9a310 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f100c00e270 tx=0x7f100c00efd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0e48157903fec6e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:07.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.779+0000 7f1000ff9640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T01:03:07.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.783+0000 7f1000ff9640 1 -- 172.21.15.1:0/2847804286 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100c03c030 con 0x55b6ceab91b0 2024-09-21T01:03:07.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.783+0000 7f1025a79740 1 -- 172.21.15.1:0/2847804286 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f100c023040 con 0x55b6ceab91b0 2024-09-21T01:03:07.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.783+0000 7f1000ff9640 1 -- 172.21.15.1:0/2847804286 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f100c028040 con 0x55b6ceab91b0 2024-09-21T01:03:07.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.783+0000 7f1000ff9640 1 -- 172.21.15.1:0/2847804286 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f100c047070 con 0x55b6ceab91b0 2024-09-21T01:03:07.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.784+0000 7f1025a79740 10 client.26479 fetch_fsmap learned FSMap version 33 2024-09-21T01:03:07.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.784+0000 7f1025a79740 1 -- 172.21.15.1:0/2847804286 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55b6cef11400 con 0x55b6ceab91b0 2024-09-21T01:03:07.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.785+0000 7f1000ff9640 1 -- 172.21.15.1:0/2847804286 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f100c014690 con 0x55b6ceab91b0 2024-09-21T01:03:07.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.789+0000 7f1000ff9640 1 -- 172.21.15.1:0/2847804286 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f100c0434e0 con 0x55b6ceab91b0 2024-09-21T01:03:07.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.789+0000 7f1025a79740 10 client.26479 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:03:07.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.789+0000 7f1025a79740 10 client.26479 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-21T01:03:07.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.789+0000 7f1025a79740 20 client.26479 populate_metadata read hostname 'smithi001' 2024-09-21T01:03:07.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.789+0000 7f1025a79740 1 --2- 172.21.15.1:0/2847804286 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x55b6cea75da0 0x55b6cef139f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:07.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.789+0000 7f1025a79740 4 client.26479 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:03:07.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.789+0000 7f1025a79740 1 -- 172.21.15.1:0/2847804286 --> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f100c023040 con 0x55b6cea75da0 2024-09-21T01:03:07.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.792+0000 7f101caa0640 1 --2- 172.21.15.1:0/2847804286 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x55b6cea75da0 0x55b6cef139f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:07.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.803+0000 7f101caa0640 1 --2- 172.21.15.1:0/2847804286 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x55b6cea75da0 0x55b6cef139f0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9e654e9da08601b1 server_cookie=ac05ac8720efb1aa in_seq=0 out_seq=0 2024-09-21T01:03:07.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.804+0000 7f1000ff9640 10 client.26479 ms_handle_connect on v2:172.21.15.193:6836/909252228 2024-09-21T01:03:07.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.808+0000 7f1000ff9640 1 -- 172.21.15.1:0/2847804286 <== mds.3 v2:172.21.15.193:6836/909252228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f100c023040 con 0x55b6cea75da0 2024-09-21T01:03:07.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.808+0000 7f1000ff9640 10 client.26479 handle_command_reply: tid=0 2024-09-21T01:03:07.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.809+0000 7f1025a79740 1 client.26479 shutdown 2024-09-21T01:03:07.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.810+0000 7f1025a79740 1 -- 172.21.15.1:0/2847804286 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6ceab91b0 msgr2=0x55b6cee9a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:07.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.810+0000 7f1025a79740 1 --2- 172.21.15.1:0/2847804286 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6ceab91b0 0x55b6cee9a310 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f100c00e270 tx=0x7f100c00efd0 comp rx=0 tx=0).stop 2024-09-21T01:03:07.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.814+0000 7f1025a79740 1 -- 172.21.15.1:0/2847804286 shutdown_connections 2024-09-21T01:03:07.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.814+0000 7f1025a79740 1 --2- 172.21.15.1:0/2847804286 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x55b6cea75da0 0x55b6cef139f0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:07.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.814+0000 7f1025a79740 1 --2- 172.21.15.1:0/2847804286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6ceae2070 0x55b6cef09a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:07.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.814+0000 7f1025a79740 1 --2- 172.21.15.1:0/2847804286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b6ceac1390 0x55b6cee9a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:07.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.814+0000 7f1025a79740 1 --2- 172.21.15.1:0/2847804286 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6ceab91b0 0x55b6cee9a310 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:07.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.814+0000 7f1000ff9640 0 client.26479 ms_handle_reset on v2:172.21.15.193:6836/909252228 2024-09-21T01:03:07.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.814+0000 7f1025a79740 1 -- 172.21.15.1:0/2847804286 >> 172.21.15.1:0/2847804286 conn(0x55b6cead6460 msgr2=0x55b6cee8a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:07.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.814+0000 7f1025a79740 1 -- 172.21.15.1:0/2847804286 shutdown_connections 2024-09-21T01:03:07.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.814+0000 7f1025a79740 1 -- 172.21.15.1:0/2847804286 wait complete. 2024-09-21T01:03:07.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.814+0000 7f1025a79740 20 client.26479 trim_cache size 0 max 16384 2024-09-21T01:03:07.817 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T01:03:07.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.816+0000 7f101e2a3640 1 -- 172.21.15.1:0/587612012 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f10080b6720 msgr2=0x7f10080b8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:07.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.816+0000 7f101e2a3640 1 --2- 172.21.15.1:0/587612012 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f10080b6720 0x7f10080b8c30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f10040aa830 tx=0x7f1004000bc0 comp rx=0 tx=0).stop 2024-09-21T01:03:07.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.816+0000 7f101e2a3640 1 -- 172.21.15.1:0/587612012 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f101810dbf0 msgr2=0x7f101811c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:07.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.816+0000 7f101e2a3640 1 --2- 172.21.15.1:0/587612012 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f101810dbf0 0x7f101811c500 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f100400e9c0 tx=0x7f100400ee80 comp rx=0 tx=0).stop 2024-09-21T01:03:07.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.816+0000 7f101e2a3640 1 -- 172.21.15.1:0/587612012 shutdown_connections 2024-09-21T01:03:07.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.816+0000 7f101e2a3640 1 --2- 172.21.15.1:0/587612012 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f101811cba0 0x7f1018118e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:07.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.816+0000 7f101e2a3640 1 --2- 172.21.15.1:0/587612012 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f10080b6720 0x7f10080b8c30 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:07.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.816+0000 7f101e2a3640 1 --2- 172.21.15.1:0/587612012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1018111cd0 0x7f10181187e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:07.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.816+0000 7f101e2a3640 1 --2- 172.21.15.1:0/587612012 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f101810dbf0 0x7f101811c500 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:07.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.817+0000 7f101e2a3640 1 -- 172.21.15.1:0/587612012 >> 172.21.15.1:0/587612012 conn(0x7f101806e9f0 msgr2=0x7f1018110980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:07.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.817+0000 7f101e2a3640 1 -- 172.21.15.1:0/587612012 shutdown_connections 2024-09-21T01:03:07.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:07.817+0000 7f101e2a3640 1 -- 172.21.15.1:0/587612012 wait complete. 2024-09-21T01:03:08.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.169+0000 7f835af2b640 1 -- 172.21.15.1:0/4192310341 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f835410ada0 msgr2=0x7f835410b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:08.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.169+0000 7f835af2b640 1 --2- 172.21.15.1:0/4192310341 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f835410ada0 0x7f835410b270 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f834c009ca0 tx=0x7f834c02a8d0 comp rx=0 tx=0).stop 2024-09-21T01:03:08.177 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.177+0000 7f835af2b640 1 -- 172.21.15.1:0/4192310341 shutdown_connections 2024-09-21T01:03:08.177 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.177+0000 7f835af2b640 1 --2- 172.21.15.1:0/4192310341 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8354111f90 0x7f83541143b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:08.177 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.177+0000 7f835af2b640 1 --2- 172.21.15.1:0/4192310341 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f835410ada0 0x7f835410b270 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:08.178 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.177+0000 7f835af2b640 1 --2- 172.21.15.1:0/4192310341 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f835410a3c0 0x7f835410a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:08.178 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.177+0000 7f835af2b640 1 -- 172.21.15.1:0/4192310341 >> 172.21.15.1:0/4192310341 conn(0x7f8354070810 msgr2=0x7f8354072cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:08.182 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.182+0000 7f835af2b640 1 -- 172.21.15.1:0/4192310341 shutdown_connections 2024-09-21T01:03:08.182 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.182+0000 7f835af2b640 1 -- 172.21.15.1:0/4192310341 wait complete. 2024-09-21T01:03:08.183 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.183+0000 7f835af2b640 1 Processor -- start 2024-09-21T01:03:08.183 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.183+0000 7f835af2b640 1 -- start start 2024-09-21T01:03:08.184 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.183+0000 7f835af2b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f835410a3c0 0x7f835410d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:08.184 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.183+0000 7f835af2b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f835410ada0 0x7f835410be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:08.184 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.183+0000 7f835af2b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8354111f90 0x7f835410c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:08.184 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.183+0000 7f835af2b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8354117b80 con 0x7f835410a3c0 2024-09-21T01:03:08.184 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.183+0000 7f835af2b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8354117a00 con 0x7f8354111f90 2024-09-21T01:03:08.185 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.183+0000 7f835af2b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8354117d00 con 0x7f835410ada0 2024-09-21T01:03:08.185 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.184+0000 7f8353fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f835410ada0 0x7f835410be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:08.185 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.184+0000 7f8353fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f835410ada0 0x7f835410be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:53340/0 (socket says 172.21.15.1:53340) 2024-09-21T01:03:08.185 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.184+0000 7f8353fff640 1 -- 172.21.15.1:0/3095949817 learned_addr learned my addr 172.21.15.1:0/3095949817 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:08.185 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.184+0000 7f8353fff640 1 -- 172.21.15.1:0/3095949817 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8354111f90 msgr2=0x7f835410c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:08.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.184+0000 7f83594c8640 1 --2- 172.21.15.1:0/3095949817 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8354111f90 0x7f835410c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:08.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.184+0000 7f8353fff640 1 --2- 172.21.15.1:0/3095949817 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8354111f90 0x7f835410c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:08.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.184+0000 7f8353fff640 1 -- 172.21.15.1:0/3095949817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f835410a3c0 msgr2=0x7f835410d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:08.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.185+0000 7f8358cc7640 1 --2- 172.21.15.1:0/3095949817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f835410a3c0 0x7f835410d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:08.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.185+0000 7f8353fff640 1 --2- 172.21.15.1:0/3095949817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f835410a3c0 0x7f835410d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:08.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.185+0000 7f8353fff640 1 -- 172.21.15.1:0/3095949817 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f835410caf0 con 0x7f835410ada0 2024-09-21T01:03:08.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.185+0000 7f83594c8640 1 --2- 172.21.15.1:0/3095949817 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8354111f90 0x7f835410c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:03:08.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.185+0000 7f8358cc7640 1 --2- 172.21.15.1:0/3095949817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f835410a3c0 0x7f835410d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:03:08.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.185+0000 7f8353fff640 1 --2- 172.21.15.1:0/3095949817 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f835410ada0 0x7f835410be80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f834c0098d0 tx=0x7f834c003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.208+0000 7f8351ffb640 1 -- 172.21.15.1:0/3095949817 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c004380 con 0x7f835410ada0 2024-09-21T01:03:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.208+0000 7f835af2b640 1 -- 172.21.15.1:0/3095949817 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83541ac820 con 0x7f835410ada0 2024-09-21T01:03:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.208+0000 7f835af2b640 1 -- 172.21.15.1:0/3095949817 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83541acd00 con 0x7f835410ada0 2024-09-21T01:03:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.208+0000 7f8351ffb640 1 -- 172.21.15.1:0/3095949817 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f834c02f620 con 0x7f835410ada0 2024-09-21T01:03:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.208+0000 7f8351ffb640 1 -- 172.21.15.1:0/3095949817 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c030810 con 0x7f835410ada0 2024-09-21T01:03:08.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.214+0000 7f8361e98740 1 Processor -- start 2024-09-21T01:03:08.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.214+0000 7f8361e98740 1 -- start start 2024-09-21T01:03:08.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.214+0000 7f8361e98740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4f9a01b0 0x559c4fd47e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:08.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.214+0000 7f8361e98740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c4f9772f0 0x559c4fd484c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:08.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.214+0000 7f8361e98740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c4f97f4d0 0x559c4fd49010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:08.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.214+0000 7f8361e98740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559c4fcba6f0 con 0x559c4f9a01b0 2024-09-21T01:03:08.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.214+0000 7f8361e98740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559c4fca9b20 con 0x559c4f97f4d0 2024-09-21T01:03:08.216 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.214+0000 7f8361e98740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559c4fcad930 con 0x559c4f9772f0 2024-09-21T01:03:08.216 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.215+0000 7f83594c8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4f9a01b0 0x559c4fd47e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:08.216 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.215+0000 7f83594c8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4f9a01b0 0x559c4fd47e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58694/0 (socket says 172.21.15.1:58694) 2024-09-21T01:03:08.216 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.215+0000 7f83594c8640 1 -- 172.21.15.1:0/3195505372 learned_addr learned my addr 172.21.15.1:0/3195505372 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:08.216 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.215+0000 7f8353fff640 1 --2- 172.21.15.1:0/3195505372 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c4f97f4d0 0x559c4fd49010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:08.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.216+0000 7f83594c8640 1 -- 172.21.15.1:0/3195505372 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c4f9772f0 msgr2=0x559c4fd484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:08.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.216+0000 7f83594c8640 1 --2- 172.21.15.1:0/3195505372 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c4f9772f0 0x559c4fd484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:08.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.216+0000 7f83594c8640 1 -- 172.21.15.1:0/3195505372 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c4f97f4d0 msgr2=0x559c4fd49010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:08.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.216+0000 7f83594c8640 1 --2- 172.21.15.1:0/3195505372 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c4f97f4d0 0x559c4fd49010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:08.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.216+0000 7f83594c8640 1 -- 172.21.15.1:0/3195505372 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c4fc6f530 con 0x559c4f9a01b0 2024-09-21T01:03:08.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.216+0000 7f83594c8640 1 --2- 172.21.15.1:0/3195505372 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4f9a01b0 0x559c4fd47e50 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f834400a920 tx=0x7f834400ade0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f787a71b77bd307d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:08.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.228+0000 7f8351ffb640 1 -- 172.21.15.1:0/3095949817 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f834c0309b0 con 0x7f835410ada0 2024-09-21T01:03:08.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.230+0000 7f8342ffd640 1 -- 172.21.15.1:0/3195505372 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8344015070 con 0x559c4f9a01b0 2024-09-21T01:03:08.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.230+0000 7f8342ffd640 1 -- 172.21.15.1:0/3195505372 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f834400cc00 con 0x559c4f9a01b0 2024-09-21T01:03:08.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.230+0000 7f8342ffd640 1 -- 172.21.15.1:0/3195505372 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83440185c0 con 0x559c4f9a01b0 2024-09-21T01:03:08.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.232+0000 7f8361e98740 1 -- 172.21.15.1:0/3195505372 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4f9a01b0 msgr2=0x559c4fd47e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:08.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.232+0000 7f8361e98740 1 --2- 172.21.15.1:0/3195505372 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4f9a01b0 0x559c4fd47e50 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f834400a920 tx=0x7f834400ade0 comp rx=0 tx=0).stop 2024-09-21T01:03:08.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.233+0000 7f8361e98740 1 -- 172.21.15.1:0/3195505372 shutdown_connections 2024-09-21T01:03:08.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.233+0000 7f8361e98740 1 --2- 172.21.15.1:0/3195505372 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c4f97f4d0 0x559c4fd49010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:08.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.233+0000 7f8361e98740 1 --2- 172.21.15.1:0/3195505372 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c4f9772f0 0x559c4fd484c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:08.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.233+0000 7f8361e98740 1 --2- 172.21.15.1:0/3195505372 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4f9a01b0 0x559c4fd47e50 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:08.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.233+0000 7f8361e98740 1 -- 172.21.15.1:0/3195505372 >> 172.21.15.1:0/3195505372 conn(0x559c4f994300 msgr2=0x559c4fd438e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:08.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.236+0000 7f8361e98740 1 -- 172.21.15.1:0/3195505372 shutdown_connections 2024-09-21T01:03:08.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.236+0000 7f8361e98740 1 -- 172.21.15.1:0/3195505372 wait complete. 2024-09-21T01:03:08.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.237+0000 7f8361e98740 1 -- start start 2024-09-21T01:03:08.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.237+0000 7f8361e98740 1 Processor -- start 2024-09-21T01:03:08.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.237+0000 7f8351ffb640 1 --2- 172.21.15.1:0/3095949817 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f833c0b6620 0x7f833c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:08.239 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.238+0000 7f8351ffb640 1 -- 172.21.15.1:0/3095949817 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f834c109a10 con 0x7f835410ada0 2024-09-21T01:03:08.239 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.238+0000 7f83594c8640 1 --2- 172.21.15.1:0/3095949817 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f833c0b6620 0x7f833c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:08.240 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.239+0000 7f8361e98740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c4f9772f0 0x559c4fd59ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:08.240 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.239+0000 7f8361e98740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4f97f4d0 0x559c4fd5a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:08.240 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.239+0000 7f8361e98740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c4f9a01b0 0x559c4fd5b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:08.240 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.239+0000 7f8361e98740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559c4fbe1ab0 con 0x559c4f97f4d0 2024-09-21T01:03:08.241 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.239+0000 7f8361e98740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559c4fc4f730 con 0x559c4f9772f0 2024-09-21T01:03:08.241 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.239+0000 7f8361e98740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559c4fd49b30 con 0x559c4f9a01b0 2024-09-21T01:03:08.241 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.239+0000 7f8361e98740 10 client.0 _ll_register_callbacks cb 0x559c4fca36b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:03:08.241 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.240+0000 7f8358cc7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c4f9772f0 0x559c4fd59ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:08.241 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.240+0000 7f8353fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4f97f4d0 0x559c4fd5a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:08.241 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.240+0000 7f83594c8640 1 --2- 172.21.15.1:0/3095949817 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f833c0b6620 0x7f833c0b8b30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f834400a6b0 tx=0x7f834400a200 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:08.241 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.240+0000 7f8358cc7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c4f9772f0 0x559c4fd59ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:46500/0 (socket says 172.21.15.1:46500) 2024-09-21T01:03:08.241 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.240+0000 7f8358cc7640 1 -- 172.21.15.1:0/4025159529 learned_addr learned my addr 172.21.15.1:0/4025159529 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:08.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.240+0000 7f83594c8640 1 --2- 172.21.15.1:0/4025159529 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c4f9a01b0 0x559c4fd5b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:08.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.240+0000 7f8358cc7640 1 -- 172.21.15.1:0/4025159529 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c4f9a01b0 msgr2=0x559c4fd5b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:08.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.240+0000 7f8358cc7640 1 --2- 172.21.15.1:0/4025159529 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c4f9a01b0 0x559c4fd5b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:08.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.240+0000 7f8358cc7640 1 -- 172.21.15.1:0/4025159529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4f97f4d0 msgr2=0x559c4fd5a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:08.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.240+0000 7f8358cc7640 1 --2- 172.21.15.1:0/4025159529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4f97f4d0 0x559c4fd5a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:08.243 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.240+0000 7f8358cc7640 1 -- 172.21.15.1:0/4025159529 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c4fa0b790 con 0x559c4f9772f0 2024-09-21T01:03:08.243 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.241+0000 7f8353fff640 1 --2- 172.21.15.1:0/4025159529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4f97f4d0 0x559c4fd5a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:03:08.243 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.241+0000 7f8358cc7640 1 --2- 172.21.15.1:0/4025159529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c4f9772f0 0x559c4fd59ea0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f834800c200 tx=0x7f834800c6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6437266730cf166 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.262+0000 7f8337fff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:03:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.262+0000 7f8337fff640 1 -- 172.21.15.1:0/4025159529 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8348015070 con 0x559c4f9772f0 2024-09-21T01:03:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.263+0000 7f8361e98740 1 -- 172.21.15.1:0/4025159529 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f834400cc00 con 0x559c4f9772f0 2024-09-21T01:03:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.263+0000 7f8337fff640 1 -- 172.21.15.1:0/4025159529 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f8348011800 con 0x559c4f9772f0 2024-09-21T01:03:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.263+0000 7f8337fff640 1 -- 172.21.15.1:0/4025159529 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f8348021050 con 0x559c4f9772f0 2024-09-21T01:03:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.263+0000 7f8361e98740 10 client.26612 fetch_fsmap learned FSMap version 33 2024-09-21T01:03:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.263+0000 7f8361e98740 1 -- 172.21.15.1:0/4025159529 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x559c4fa84620 con 0x559c4f9772f0 2024-09-21T01:03:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.263+0000 7f8337fff640 1 -- 172.21.15.1:0/4025159529 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f834400cc00 con 0x559c4f9772f0 2024-09-21T01:03:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.264+0000 7f8337fff640 1 -- 172.21.15.1:0/4025159529 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f8348019ae0 con 0x559c4f9772f0 2024-09-21T01:03:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.264+0000 7f8361e98740 10 client.26612 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:03:08.266 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.264+0000 7f8361e98740 10 client.26612 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:03:08.266 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.264+0000 7f8361e98740 20 client.26612 populate_metadata read hostname 'smithi001' 2024-09-21T01:03:08.266 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.264+0000 7f8361e98740 1 --2- 172.21.15.1:0/4025159529 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x559c4f95ed80 0x559c4fd67b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:08.266 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.264+0000 7f8361e98740 4 client.26612 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:03:08.266 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.264+0000 7f8361e98740 1 -- 172.21.15.1:0/4025159529 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c4fcbc640 con 0x559c4f95ed80 2024-09-21T01:03:08.266 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.264+0000 7f8353fff640 1 --2- 172.21.15.1:0/4025159529 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x559c4f95ed80 0x559c4fd67b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:08.266 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.265+0000 7f8337fff640 10 client.26612 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:03:08.266 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.265+0000 7f8353fff640 1 --2- 172.21.15.1:0/4025159529 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x559c4f95ed80 0x559c4fd67b30 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a14ada47ed5ab0b server_cookie=2b7225f4786bc60a in_seq=0 out_seq=0 2024-09-21T01:03:08.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.268+0000 7f8337fff640 1 -- 172.21.15.1:0/4025159529 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559c4fcbc640 con 0x559c4f95ed80 2024-09-21T01:03:08.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.268+0000 7f8337fff640 10 client.26612 handle_command_reply: tid=0 2024-09-21T01:03:08.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.268+0000 7f8361e98740 1 client.26612 shutdown 2024-09-21T01:03:08.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.269+0000 7f8361e98740 1 -- 172.21.15.1:0/4025159529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c4f9772f0 msgr2=0x559c4fd59ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:08.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.269+0000 7f8361e98740 1 --2- 172.21.15.1:0/4025159529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c4f9772f0 0x559c4fd59ea0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f834800c200 tx=0x7f834800c6c0 comp rx=0 tx=0).stop 2024-09-21T01:03:08.270 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.269+0000 7f8361e98740 1 -- 172.21.15.1:0/4025159529 shutdown_connections 2024-09-21T01:03:08.270 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.269+0000 7f8361e98740 1 --2- 172.21.15.1:0/4025159529 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x559c4f95ed80 0x559c4fd67b30 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:08.270 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.269+0000 7f8361e98740 1 --2- 172.21.15.1:0/4025159529 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c4f9a01b0 0x559c4fd5b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:08.270 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.269+0000 7f8361e98740 1 --2- 172.21.15.1:0/4025159529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4f97f4d0 0x559c4fd5a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:08.270 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.269+0000 7f8361e98740 1 --2- 172.21.15.1:0/4025159529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c4f9772f0 0x559c4fd59ea0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:08.270 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.269+0000 7f8361e98740 1 -- 172.21.15.1:0/4025159529 >> 172.21.15.1:0/4025159529 conn(0x559c4f994300 msgr2=0x559c4fd41ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:08.278 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.277+0000 7f8337fff640 0 client.26612 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:03:08.278 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.277+0000 7f8361e98740 1 -- 172.21.15.1:0/4025159529 shutdown_connections 2024-09-21T01:03:08.278 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.277+0000 7f8361e98740 1 -- 172.21.15.1:0/4025159529 wait complete. 2024-09-21T01:03:08.279 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.278+0000 7f8361e98740 20 client.26612 trim_cache size 0 max 16384 2024-09-21T01:03:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.312+0000 7f8361e98740 1 Processor -- start 2024-09-21T01:03:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.312+0000 7f8361e98740 1 -- start start 2024-09-21T01:03:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.312+0000 7f8361e98740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c4f9772f0 0x559c4fd5b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.313+0000 7f8361e98740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4f97f4d0 0x559c4fd67aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:08.315 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.313+0000 7f8358cc7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c4f9772f0 0x559c4fd5b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:08.315 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.313+0000 7f8358cc7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c4f9772f0 0x559c4fd5b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:53368/0 (socket says 172.21.15.1:53368) 2024-09-21T01:03:08.315 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.313+0000 7f8353fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4f97f4d0 0x559c4fd67aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:08.315 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.314+0000 7f8353fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4f97f4d0 0x559c4fd67aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58718/0 (socket says 172.21.15.1:58718) 2024-09-21T01:03:08.315 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.314+0000 7f8358cc7640 1 -- 172.21.15.1:0/3761555151 learned_addr learned my addr 172.21.15.1:0/3761555151 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:08.315 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.314+0000 7f8361e98740 1 --2- 172.21.15.1:0/3761555151 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c4f9a01b0 0x559c4fd43220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:08.315 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.314+0000 7f8361e98740 1 -- 172.21.15.1:0/3761555151 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f833800e5c0 con 0x559c4f97f4d0 2024-09-21T01:03:08.316 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.314+0000 7f83594c8640 1 --2- 172.21.15.1:0/3761555151 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c4f9a01b0 0x559c4fd43220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:08.316 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.314+0000 7f8361e98740 1 -- 172.21.15.1:0/3761555151 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f83380101c0 con 0x559c4f9a01b0 2024-09-21T01:03:08.316 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.314+0000 7f8361e98740 1 -- 172.21.15.1:0/3761555151 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f833800ec90 con 0x559c4f9772f0 2024-09-21T01:03:08.316 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.315+0000 7f8353fff640 1 -- 172.21.15.1:0/3761555151 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c4f9772f0 msgr2=0x559c4fd5b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:08.316 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.315+0000 7f8353fff640 1 --2- 172.21.15.1:0/3761555151 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c4f9772f0 0x559c4fd5b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:08.316 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.315+0000 7f8353fff640 1 -- 172.21.15.1:0/3761555151 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c4f9a01b0 msgr2=0x559c4fd43220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:08.316 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.315+0000 7f8353fff640 1 --2- 172.21.15.1:0/3761555151 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c4f9a01b0 0x559c4fd43220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:08.316 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.315+0000 7f8353fff640 1 -- 172.21.15.1:0/3761555151 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c4fd5bb70 con 0x559c4f97f4d0 2024-09-21T01:03:08.317 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.316+0000 7f8353fff640 1 --2- 172.21.15.1:0/3761555151 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4f97f4d0 0x559c4fd67aa0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f834c031b60 tx=0x7f834c02a8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cb8c619dac8f0a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:08.318 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.317+0000 7f83427fc640 1 -- 172.21.15.1:0/3761555151 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c0cb290 con 0x559c4f97f4d0 2024-09-21T01:03:08.318 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.317+0000 7f83427fc640 1 -- 172.21.15.1:0/3761555151 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f834c0d0e50 con 0x559c4f97f4d0 2024-09-21T01:03:08.318 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.317+0000 7f83427fc640 1 -- 172.21.15.1:0/3761555151 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c0cbd90 con 0x559c4f97f4d0 2024-09-21T01:03:08.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.319+0000 7f8361e98740 1 -- 172.21.15.1:0/3761555151 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4f97f4d0 msgr2=0x559c4fd67aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:08.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.319+0000 7f8361e98740 1 --2- 172.21.15.1:0/3761555151 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4f97f4d0 0x559c4fd67aa0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f834c031b60 tx=0x7f834c02a8d0 comp rx=0 tx=0).stop 2024-09-21T01:03:08.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.341+0000 7f8361e98740 1 -- 172.21.15.1:0/3761555151 shutdown_connections 2024-09-21T01:03:08.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.341+0000 7f8361e98740 1 --2- 172.21.15.1:0/3761555151 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c4f9a01b0 0x559c4fd43220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:08.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.341+0000 7f8361e98740 1 --2- 172.21.15.1:0/3761555151 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4f97f4d0 0x559c4fd67aa0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:08.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.341+0000 7f8361e98740 1 --2- 172.21.15.1:0/3761555151 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c4f9772f0 0x559c4fd5b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:08.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.341+0000 7f8361e98740 1 -- 172.21.15.1:0/3761555151 >> 172.21.15.1:0/3761555151 conn(0x559c4f994300 msgr2=0x559c4fd588a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:08.381 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.381+0000 7f8361e98740 1 -- 172.21.15.1:0/3761555151 shutdown_connections 2024-09-21T01:03:08.382 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.381+0000 7f8361e98740 1 -- 172.21.15.1:0/3761555151 wait complete. 2024-09-21T01:03:08.382 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.382+0000 7f8361e98740 1 -- start start 2024-09-21T01:03:08.382 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.382+0000 7f8361e98740 1 Processor -- start 2024-09-21T01:03:08.383 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.383+0000 7f8361e98740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c4f9772f0 0x559c4fd5c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.383+0000 7f8361e98740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4f97f4d0 0x559c4fd5ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.383+0000 7f8361e98740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c4f9a01b0 0x559c4fd5d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.383+0000 7f8361e98740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f833800faf0 con 0x559c4f97f4d0 2024-09-21T01:03:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.383+0000 7f8361e98740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f833800f420 con 0x559c4f9a01b0 2024-09-21T01:03:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.383+0000 7f8361e98740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f833800c5a0 con 0x559c4f9772f0 2024-09-21T01:03:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.384+0000 7f83594c8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c4f9a01b0 0x559c4fd5d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.384+0000 7f83594c8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c4f9a01b0 0x559c4fd5d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:46520/0 (socket says 172.21.15.1:46520) 2024-09-21T01:03:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.384+0000 7f83594c8640 1 -- 172.21.15.1:0/1200284223 learned_addr learned my addr 172.21.15.1:0/1200284223 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.384+0000 7f8358cc7640 1 --2- 172.21.15.1:0/1200284223 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c4f9772f0 0x559c4fd5c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.384+0000 7f8353fff640 1 --2- 172.21.15.1:0/1200284223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4f97f4d0 0x559c4fd5ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.385+0000 7f8358cc7640 1 -- 172.21.15.1:0/1200284223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c4f9a01b0 msgr2=0x559c4fd5d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.385+0000 7f8358cc7640 1 --2- 172.21.15.1:0/1200284223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c4f9a01b0 0x559c4fd5d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.385+0000 7f8358cc7640 1 -- 172.21.15.1:0/1200284223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4f97f4d0 msgr2=0x559c4fd5ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.385+0000 7f8358cc7640 1 --2- 172.21.15.1:0/1200284223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4f97f4d0 0x559c4fd5ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.385+0000 7f8358cc7640 1 -- 172.21.15.1:0/1200284223 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c4fd5e100 con 0x559c4f9772f0 2024-09-21T01:03:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.385+0000 7f8353fff640 1 --2- 172.21.15.1:0/1200284223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4f97f4d0 0x559c4fd5ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:03:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.385+0000 7f8361e98740 10 client.0 _ll_register_callbacks cb 0x7f834800a0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:03:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.385+0000 7f8361e98740 1 -- 172.21.15.1:0/1200284223 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f834c0d0e50 con 0x559c4f9772f0 2024-09-21T01:03:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.386+0000 7f8358cc7640 1 --2- 172.21.15.1:0/1200284223 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c4f9772f0 0x559c4fd5c7c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8348004700 tx=0x7f83480185c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b742baef9ef560e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:08.495 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.488+0000 7f8337fff640 10 client.26494 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T01:03:08.495 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.495+0000 7f8337fff640 1 -- 172.21.15.1:0/1200284223 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834802c030 con 0x559c4f9772f0 2024-09-21T01:03:08.496 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.495+0000 7f8337fff640 1 -- 172.21.15.1:0/1200284223 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f834800a2c0 con 0x559c4f9772f0 2024-09-21T01:03:08.497 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.495+0000 7f8337fff640 1 -- 172.21.15.1:0/1200284223 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f8348015040 con 0x559c4f9772f0 2024-09-21T01:03:08.497 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.497+0000 7f8361e98740 10 client.26494 fetch_fsmap learned FSMap version 33 2024-09-21T01:03:08.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.498+0000 7f8361e98740 1 -- 172.21.15.1:0/1200284223 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({fsmap=33}) -- 0x559c4fd61350 con 0x559c4f9772f0 2024-09-21T01:03:08.502 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.501+0000 7f8337fff640 1 -- 172.21.15.1:0/1200284223 <== mon.1 v2:172.21.15.193:3300/0 4 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f8348018a60 con 0x559c4f9772f0 2024-09-21T01:03:08.503 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.501+0000 7f8361e98740 10 client.26494 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T01:03:08.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.501+0000 7f8361e98740 10 client.26494 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:03:08.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.501+0000 7f8361e98740 20 client.26494 populate_metadata read hostname 'smithi001' 2024-09-21T01:03:08.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.502+0000 7f8361e98740 1 --2- 172.21.15.1:0/1200284223 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x559c4f9341c0 0x559c4fdd4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:08.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.502+0000 7f8361e98740 4 client.26494 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:03:08.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.502+0000 7f8361e98740 1 -- 172.21.15.1:0/1200284223 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559c4fcb80f0 con 0x559c4f9341c0 2024-09-21T01:03:08.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.502+0000 7f8353fff640 1 --2- 172.21.15.1:0/1200284223 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x559c4f9341c0 0x559c4fdd4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:08.505 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.504+0000 7f8353fff640 1 --2- 172.21.15.1:0/1200284223 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x559c4f9341c0 0x559c4fdd4540 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9f64ac4097758b8 server_cookie=9895936a25ae8458 in_seq=0 out_seq=0 2024-09-21T01:03:08.505 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:08.504+0000 7f8337fff640 10 client.26494 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:03:09.347 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T01:03:09.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:09.653+0000 7f8337fff640 1 -- 172.21.15.1:0/1200284223 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559c4fcb80f0 con 0x559c4f9341c0 2024-09-21T01:03:09.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:09.653+0000 7f8337fff640 10 client.26494 handle_command_reply: tid=0 2024-09-21T01:03:09.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:09.653+0000 7f8361e98740 1 client.26494 shutdown 2024-09-21T01:03:09.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:09.653+0000 7f8361e98740 1 -- 172.21.15.1:0/1200284223 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c4f9772f0 msgr2=0x559c4fd5c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:09.655 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:09.653+0000 7f8361e98740 1 --2- 172.21.15.1:0/1200284223 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c4f9772f0 0x559c4fd5c7c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8348004700 tx=0x7f83480185c0 comp rx=0 tx=0).stop 2024-09-21T01:03:09.655 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:09.654+0000 7f8361e98740 1 -- 172.21.15.1:0/1200284223 shutdown_connections 2024-09-21T01:03:09.655 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:09.654+0000 7f8361e98740 1 --2- 172.21.15.1:0/1200284223 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x559c4f9341c0 0x559c4fdd4540 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:09.655 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:09.654+0000 7f8361e98740 1 --2- 172.21.15.1:0/1200284223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559c4f9a01b0 0x559c4fd5d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:09.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:09.654+0000 7f8361e98740 1 --2- 172.21.15.1:0/1200284223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4f97f4d0 0x559c4fd5ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:09.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:09.654+0000 7f8361e98740 1 --2- 172.21.15.1:0/1200284223 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c4f9772f0 0x559c4fd5c7c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:09.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:09.654+0000 7f8361e98740 1 -- 172.21.15.1:0/1200284223 >> 172.21.15.1:0/1200284223 conn(0x559c4f994300 msgr2=0x559c4fd43220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:09.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:09.654+0000 7f8337fff640 0 client.26494 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:03:09.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:09.655+0000 7f8361e98740 1 -- 172.21.15.1:0/1200284223 shutdown_connections 2024-09-21T01:03:09.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:09.655+0000 7f8361e98740 1 -- 172.21.15.1:0/1200284223 wait complete. 2024-09-21T01:03:09.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:09.655+0000 7f8361e98740 20 client.26494 trim_cache size 0 max 16384 2024-09-21T01:03:09.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T01:03:09.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T01:03:09.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T01:03:09.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T01:03:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:09.689+0000 7f835af2b640 1 -- 172.21.15.1:0/3095949817 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f833c0b6620 msgr2=0x7f833c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:09.689+0000 7f835af2b640 1 --2- 172.21.15.1:0/3095949817 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f833c0b6620 0x7f833c0b8b30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f834400a6b0 tx=0x7f834400a200 comp rx=0 tx=0).stop 2024-09-21T01:03:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:09.689+0000 7f835af2b640 1 -- 172.21.15.1:0/3095949817 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f835410ada0 msgr2=0x7f835410be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:09.689+0000 7f835af2b640 1 --2- 172.21.15.1:0/3095949817 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f835410ada0 0x7f835410be80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f834c0098d0 tx=0x7f834c003f10 comp rx=0 tx=0).stop 2024-09-21T01:03:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:09.690+0000 7f835af2b640 1 -- 172.21.15.1:0/3095949817 shutdown_connections 2024-09-21T01:03:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:09.690+0000 7f835af2b640 1 --2- 172.21.15.1:0/3095949817 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8354111f90 0x7f835410c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:09.690+0000 7f835af2b640 1 --2- 172.21.15.1:0/3095949817 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f835410ada0 0x7f835410be80 secure :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f834c0098d0 tx=0x7f834c003f10 comp rx=0 tx=0).stop 2024-09-21T01:03:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:09.690+0000 7f835af2b640 1 --2- 172.21.15.1:0/3095949817 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f833c0b6620 0x7f833c0b8b30 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:09.690+0000 7f835af2b640 1 --2- 172.21.15.1:0/3095949817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f835410a3c0 0x7f835410d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:09.690+0000 7f835af2b640 1 -- 172.21.15.1:0/3095949817 >> 172.21.15.1:0/3095949817 conn(0x7f8354070810 msgr2=0x7f8354072ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:09.699 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:09.699+0000 7f835af2b640 1 -- 172.21.15.1:0/3095949817 shutdown_connections 2024-09-21T01:03:09.700 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:09.699+0000 7f835af2b640 1 -- 172.21.15.1:0/3095949817 wait complete. 2024-09-21T01:03:09.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:09 smithi001 ceph-mon[31211]: pgmap v536: 97 pgs: 97 active+clean; 698 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 7.4 MiB/s wr, 753 op/s 2024-09-21T01:03:09.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:09 smithi193 ceph-mon[34660]: pgmap v536: 97 pgs: 97 active+clean; 698 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 7.4 MiB/s wr, 753 op/s 2024-09-21T01:03:09.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:09 smithi042 ceph-mon[34481]: pgmap v536: 97 pgs: 97 active+clean; 698 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 7.4 MiB/s wr, 753 op/s 2024-09-21T01:03:11.634 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:03:11.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:11 smithi001 ceph-mon[31211]: pgmap v537: 97 pgs: 97 active+clean; 696 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.7 MiB/s wr, 783 op/s 2024-09-21T01:03:11.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:11 smithi193 ceph-mon[34660]: pgmap v537: 97 pgs: 97 active+clean; 696 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.7 MiB/s wr, 783 op/s 2024-09-21T01:03:11.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:11 smithi042 ceph-mon[34481]: pgmap v537: 97 pgs: 97 active+clean; 696 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.7 MiB/s wr, 783 op/s 2024-09-21T01:03:12.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:12 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:03:12.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.637+0000 7f90a17ca640 1 -- 172.21.15.1:0/69444260 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f909c1053f0 msgr2=0x7f909c105800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:12.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.637+0000 7f90a17ca640 1 --2- 172.21.15.1:0/69444260 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f909c1053f0 0x7f909c105800 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f908c009900 tx=0x7f908c02a440 comp rx=0 tx=0).stop 2024-09-21T01:03:12.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.638+0000 7f90a17ca640 1 -- 172.21.15.1:0/69444260 shutdown_connections 2024-09-21T01:03:12.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.638+0000 7f90a17ca640 1 --2- 172.21.15.1:0/69444260 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f909c102630 0x7f909c106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:12.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.638+0000 7f90a17ca640 1 --2- 172.21.15.1:0/69444260 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f909c101ce0 0x7f909c1020f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:12.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.638+0000 7f90a17ca640 1 --2- 172.21.15.1:0/69444260 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f909c1053f0 0x7f909c105800 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:12.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.638+0000 7f90a17ca640 1 -- 172.21.15.1:0/69444260 >> 172.21.15.1:0/69444260 conn(0x7f909c077c60 msgr2=0x7f909c0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:12.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.641+0000 7f90a17ca640 1 -- 172.21.15.1:0/69444260 shutdown_connections 2024-09-21T01:03:12.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.642+0000 7f90a17ca640 1 -- 172.21.15.1:0/69444260 wait complete. 2024-09-21T01:03:12.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.643+0000 7f90a17ca640 1 Processor -- start 2024-09-21T01:03:12.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.643+0000 7f90a17ca640 1 -- start start 2024-09-21T01:03:12.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.644+0000 7f90a17ca640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f909c101ce0 0x7f909c117470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:12.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.644+0000 7f90a17ca640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f909c102630 0x7f909c110740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:12.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.644+0000 7f90a17ca640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f909c1053f0 0x7f909c110c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:12.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.644+0000 7f90a17ca640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f909c11a140 con 0x7f909c101ce0 2024-09-21T01:03:12.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.644+0000 7f90a17ca640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f909c119fc0 con 0x7f909c102630 2024-09-21T01:03:12.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.644+0000 7f90a17ca640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f909c11a2c0 con 0x7f909c1053f0 2024-09-21T01:03:12.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.644+0000 7f909b7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f909c1053f0 0x7f909c110c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:12.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.644+0000 7f909b7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f909c1053f0 0x7f909c110c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:57248/0 (socket says 172.21.15.1:57248) 2024-09-21T01:03:12.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.644+0000 7f909b7fe640 1 -- 172.21.15.1:0/2020105690 learned_addr learned my addr 172.21.15.1:0/2020105690 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:12.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.646+0000 7f909affd640 1 --2- 172.21.15.1:0/2020105690 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f909c101ce0 0x7f909c117470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:12.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.647+0000 7f909b7fe640 1 -- 172.21.15.1:0/2020105690 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f909c102630 msgr2=0x7f909c110740 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:03:12.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.647+0000 7f909b7fe640 1 --2- 172.21.15.1:0/2020105690 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f909c102630 0x7f909c110740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:12.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.647+0000 7f909b7fe640 1 -- 172.21.15.1:0/2020105690 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f909c101ce0 msgr2=0x7f909c117470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:12.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.647+0000 7f909b7fe640 1 --2- 172.21.15.1:0/2020105690 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f909c101ce0 0x7f909c117470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:12.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.647+0000 7f909b7fe640 1 -- 172.21.15.1:0/2020105690 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f909c1114a0 con 0x7f909c1053f0 2024-09-21T01:03:12.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.652+0000 7f909b7fe640 1 --2- 172.21.15.1:0/2020105690 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f909c1053f0 0x7f909c110c80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f909000e970 tx=0x7f909000ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:12.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.656+0000 7f9083fff640 1 -- 172.21.15.1:0/2020105690 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909000ccc0 con 0x7f909c1053f0 2024-09-21T01:03:12.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.656+0000 7f90a17ca640 1 -- 172.21.15.1:0/2020105690 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f909c116140 con 0x7f909c1053f0 2024-09-21T01:03:12.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.656+0000 7f90a17ca640 1 -- 172.21.15.1:0/2020105690 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f909c116680 con 0x7f909c1053f0 2024-09-21T01:03:12.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.656+0000 7f9083fff640 1 -- 172.21.15.1:0/2020105690 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f909000ce60 con 0x7f909c1053f0 2024-09-21T01:03:12.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.656+0000 7f9083fff640 1 -- 172.21.15.1:0/2020105690 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9090010430 con 0x7f909c1053f0 2024-09-21T01:03:12.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.660+0000 7f90a7d3e740 1 Processor -- start 2024-09-21T01:03:12.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.675+0000 7f90a7d3e740 1 -- start start 2024-09-21T01:03:12.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.675+0000 7f90a7d3e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564685f8e070 0x5646863356a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:12.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.675+0000 7f90a7d3e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564685f651b0 0x564686335be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:12.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.675+0000 7f90a7d3e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564685f6d390 0x564686336120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:12.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.675+0000 7f90a7d3e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5646862abea0 con 0x564685f6d390 2024-09-21T01:03:12.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.675+0000 7f90a7d3e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56468629b2d0 con 0x564685f8e070 2024-09-21T01:03:12.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.675+0000 7f90a7d3e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56468629f0e0 con 0x564685f651b0 2024-09-21T01:03:12.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.675+0000 7f909affd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564685f651b0 0x564686335be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:12.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.675+0000 7f909affd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564685f651b0 0x564686335be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:57260/0 (socket says 172.21.15.1:57260) 2024-09-21T01:03:12.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.675+0000 7f909affd640 1 -- 172.21.15.1:0/3522973274 learned_addr learned my addr 172.21.15.1:0/3522973274 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:12.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.676+0000 7f9083fff640 1 -- 172.21.15.1:0/2020105690 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f9090010630 con 0x7f909c1053f0 2024-09-21T01:03:12.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.676+0000 7f909affd640 1 -- 172.21.15.1:0/3522973274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564685f8e070 msgr2=0x5646863356a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:03:12.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.676+0000 7f909affd640 1 --2- 172.21.15.1:0/3522973274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564685f8e070 0x5646863356a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:12.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.676+0000 7f909affd640 1 -- 172.21.15.1:0/3522973274 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564685f6d390 msgr2=0x564686336120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:03:12.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.676+0000 7f909affd640 1 --2- 172.21.15.1:0/3522973274 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564685f6d390 0x564686336120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:12.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.676+0000 7f909affd640 1 -- 172.21.15.1:0/3522973274 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564685ff9650 con 0x564685f651b0 2024-09-21T01:03:12.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.678+0000 7f909affd640 1 --2- 172.21.15.1:0/3522973274 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564685f651b0 0x564686335be0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f908c02a9b0 tx=0x7f908c005f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1439b12b5e7fd74 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:12.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.679+0000 7f90817fa640 1 -- 172.21.15.1:0/3522973274 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908c040030 con 0x564685f651b0 2024-09-21T01:03:12.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.679+0000 7f9083fff640 1 --2- 172.21.15.1:0/2020105690 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f90840b6710 0x7f90840b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:12.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.679+0000 7f90817fa640 1 -- 172.21.15.1:0/3522973274 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f908c031520 con 0x564685f651b0 2024-09-21T01:03:12.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.681+0000 7f90a7d3e740 1 -- 172.21.15.1:0/3522973274 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564685f651b0 msgr2=0x564686335be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:12.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.681+0000 7f90a7d3e740 1 --2- 172.21.15.1:0/3522973274 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564685f651b0 0x564686335be0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f908c02a9b0 tx=0x7f908c005f30 comp rx=0 tx=0).stop 2024-09-21T01:03:12.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.681+0000 7f9083fff640 1 -- 172.21.15.1:0/2020105690 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f90900e7690 con 0x7f909c1053f0 2024-09-21T01:03:12.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.682+0000 7f909a7fc640 1 --2- 172.21.15.1:0/2020105690 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f90840b6710 0x7f90840b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:12.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.683+0000 7f909a7fc640 1 --2- 172.21.15.1:0/2020105690 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f90840b6710 0x7f90840b8c20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f909c102500 tx=0x7f9094009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:12.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.684+0000 7f90a7d3e740 1 -- 172.21.15.1:0/3522973274 shutdown_connections 2024-09-21T01:03:12.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.684+0000 7f90a7d3e740 1 --2- 172.21.15.1:0/3522973274 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564685f6d390 0x564686336120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:12.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.684+0000 7f90a7d3e740 1 --2- 172.21.15.1:0/3522973274 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564685f651b0 0x564686335be0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:12.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.684+0000 7f90a7d3e740 1 --2- 172.21.15.1:0/3522973274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564685f8e070 0x5646863356a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:12.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.684+0000 7f90a7d3e740 1 -- 172.21.15.1:0/3522973274 >> 172.21.15.1:0/3522973274 conn(0x564685f82460 msgr2=0x564686333590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:12.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.687+0000 7f90a7d3e740 1 -- 172.21.15.1:0/3522973274 shutdown_connections 2024-09-21T01:03:12.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.687+0000 7f90a7d3e740 1 -- 172.21.15.1:0/3522973274 wait complete. 2024-09-21T01:03:12.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.688+0000 7f90a7d3e740 1 -- start start 2024-09-21T01:03:12.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.688+0000 7f90a7d3e740 1 Processor -- start 2024-09-21T01:03:12.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.690+0000 7f90a7d3e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564685f651b0 0x564686340c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:12.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.690+0000 7f90a7d3e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564685f6d390 0x564686341140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:12.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.690+0000 7f90a7d3e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564685f8e070 0x564686341680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:12.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.690+0000 7f90a7d3e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5646860fc700 con 0x564685f8e070 2024-09-21T01:03:12.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.690+0000 7f90a7d3e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564686236160 con 0x564685f651b0 2024-09-21T01:03:12.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.690+0000 7f90a7d3e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564686343e70 con 0x564685f6d390 2024-09-21T01:03:12.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.690+0000 7f90a7d3e740 10 client.0 _ll_register_callbacks cb 0x56468624f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:03:12.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.691+0000 7f909affd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564685f651b0 0x564686340c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:12.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.691+0000 7f909affd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564685f651b0 0x564686340c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:39564/0 (socket says 172.21.15.1:39564) 2024-09-21T01:03:12.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.691+0000 7f909affd640 1 -- 172.21.15.1:0/3689370918 learned_addr learned my addr 172.21.15.1:0/3689370918 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:12.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.691+0000 7f909affd640 1 -- 172.21.15.1:0/3689370918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564685f6d390 msgr2=0x564686341140 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:03:12.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.691+0000 7f909affd640 1 --2- 172.21.15.1:0/3689370918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564685f6d390 0x564686341140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:12.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.691+0000 7f909affd640 1 -- 172.21.15.1:0/3689370918 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564685f8e070 msgr2=0x564686341680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:03:12.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.691+0000 7f909affd640 1 --2- 172.21.15.1:0/3689370918 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564685f8e070 0x564686341680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:12.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.691+0000 7f909affd640 1 -- 172.21.15.1:0/3689370918 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564686263c90 con 0x564685f651b0 2024-09-21T01:03:12.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.692+0000 7f909affd640 1 --2- 172.21.15.1:0/3689370918 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564685f651b0 0x564686340c00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f908c009850 tx=0x7f908c031cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d922268a3d9b72c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:12.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.692+0000 7f907eff5640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:03:12.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.692+0000 7f907eff5640 1 -- 172.21.15.1:0/3689370918 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908c040040 con 0x564685f651b0 2024-09-21T01:03:12.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.692+0000 7f90a7d3e740 1 -- 172.21.15.1:0/3689370918 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f908c031520 con 0x564685f651b0 2024-09-21T01:03:12.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.693+0000 7f907eff5640 1 -- 172.21.15.1:0/3689370918 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f908c03c880 con 0x564685f651b0 2024-09-21T01:03:12.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.693+0000 7f907eff5640 1 -- 172.21.15.1:0/3689370918 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f908c055050 con 0x564685f651b0 2024-09-21T01:03:12.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.693+0000 7f90a7d3e740 10 client.26624 fetch_fsmap learned FSMap version 34 2024-09-21T01:03:12.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.693+0000 7f90a7d3e740 1 -- 172.21.15.1:0/3689370918 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56468634fb00 con 0x564685f651b0 2024-09-21T01:03:12.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.694+0000 7f907eff5640 1 -- 172.21.15.1:0/3689370918 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f908c031520 con 0x564685f651b0 2024-09-21T01:03:12.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.696+0000 7f907eff5640 1 -- 172.21.15.1:0/3689370918 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 34) ==== 8374+0+0 (secure 0 0 0) 0x7f908c03a040 con 0x564685f651b0 2024-09-21T01:03:12.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.696+0000 7f90a7d3e740 10 client.26624 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T01:03:12.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.696+0000 7f90a7d3e740 10 client.26624 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T01:03:12.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.696+0000 7f90a7d3e740 20 client.26624 populate_metadata read hostname 'smithi001' 2024-09-21T01:03:12.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.696+0000 7f90a7d3e740 1 --2- 172.21.15.1:0/3689370918 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x564685f4c9f0 0x5646863532e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:12.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.696+0000 7f90a7d3e740 4 client.26624 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:03:12.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.696+0000 7f90a7d3e740 1 -- 172.21.15.1:0/3689370918 --> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5646862addf0 con 0x564685f4c9f0 2024-09-21T01:03:12.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.704+0000 7f909a7fc640 1 --2- 172.21.15.1:0/3689370918 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x564685f4c9f0 0x5646863532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:12.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.720+0000 7f909a7fc640 1 --2- 172.21.15.1:0/3689370918 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x564685f4c9f0 0x5646863532e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3d3de12b5e1d1b31 server_cookie=189e309a90997710 in_seq=0 out_seq=0 2024-09-21T01:03:12.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.721+0000 7f907eff5640 10 client.26624 ms_handle_connect on v2:172.21.15.42:6836/2395608508 2024-09-21T01:03:12.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.723+0000 7f907eff5640 1 -- 172.21.15.1:0/3689370918 <== mds.2 v2:172.21.15.42:6836/2395608508 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5646862addf0 con 0x564685f4c9f0 2024-09-21T01:03:12.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.723+0000 7f907eff5640 10 client.26624 handle_command_reply: tid=0 2024-09-21T01:03:12.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.725+0000 7f90a7d3e740 1 client.26624 shutdown 2024-09-21T01:03:12.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:12 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:03:12.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.727+0000 7f90a7d3e740 1 -- 172.21.15.1:0/3689370918 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564685f651b0 msgr2=0x564686340c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:12.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.727+0000 7f90a7d3e740 1 --2- 172.21.15.1:0/3689370918 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564685f651b0 0x564686340c00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f908c009850 tx=0x7f908c031cf0 comp rx=0 tx=0).stop 2024-09-21T01:03:12.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.728+0000 7f90a7d3e740 1 -- 172.21.15.1:0/3689370918 shutdown_connections 2024-09-21T01:03:12.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.728+0000 7f90a7d3e740 1 --2- 172.21.15.1:0/3689370918 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x564685f4c9f0 0x5646863532e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:12.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.728+0000 7f90a7d3e740 1 --2- 172.21.15.1:0/3689370918 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564685f8e070 0x564686341680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:12.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.728+0000 7f90a7d3e740 1 --2- 172.21.15.1:0/3689370918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564685f6d390 0x564686341140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:12.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.728+0000 7f90a7d3e740 1 --2- 172.21.15.1:0/3689370918 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564685f651b0 0x564686340c00 secure :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f908c009850 tx=0x7f908c031cf0 comp rx=0 tx=0).stop 2024-09-21T01:03:12.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.728+0000 7f90a7d3e740 1 -- 172.21.15.1:0/3689370918 >> 172.21.15.1:0/3689370918 conn(0x564685f82460 msgr2=0x564686338830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:12.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.730+0000 7f907eff5640 0 client.26624 ms_handle_reset on v2:172.21.15.42:6836/2395608508 2024-09-21T01:03:12.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.732+0000 7f90a7d3e740 1 -- 172.21.15.1:0/3689370918 shutdown_connections 2024-09-21T01:03:12.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.732+0000 7f90a7d3e740 1 -- 172.21.15.1:0/3689370918 wait complete. 2024-09-21T01:03:12.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.733+0000 7f90a7d3e740 20 client.26624 trim_cache size 0 max 16384 2024-09-21T01:03:12.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:12 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:03:12.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.780+0000 7f90a7d3e740 1 Processor -- start 2024-09-21T01:03:12.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.783+0000 7f90a7d3e740 1 -- start start 2024-09-21T01:03:12.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.783+0000 7f90a7d3e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564685f6d390 0x564686337090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:12.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.783+0000 7f90a7d3e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564685f8e070 0x56468633ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:12.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.783+0000 7f90a7d3e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564685f21da0 0x56468633e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:12.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.783+0000 7f90a7d3e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f908800e4f0 con 0x564685f6d390 2024-09-21T01:03:12.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.783+0000 7f90a7d3e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f90880100c0 con 0x564685f8e070 2024-09-21T01:03:12.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.783+0000 7f90a7d3e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f908800ebc0 con 0x564685f21da0 2024-09-21T01:03:12.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.784+0000 7f909a7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564685f8e070 0x56468633ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:12.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.784+0000 7f909a7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564685f8e070 0x56468633ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:39568/0 (socket says 172.21.15.1:39568) 2024-09-21T01:03:12.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.784+0000 7f909a7fc640 1 -- 172.21.15.1:0/1939474640 learned_addr learned my addr 172.21.15.1:0/1939474640 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:12.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.784+0000 7f909affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564685f6d390 0x564686337090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:12.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.784+0000 7f909b7fe640 1 --2- 172.21.15.1:0/1939474640 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564685f21da0 0x56468633e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:12.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.785+0000 7f909b7fe640 1 -- 172.21.15.1:0/1939474640 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564685f8e070 msgr2=0x56468633ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:12.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.785+0000 7f909b7fe640 1 --2- 172.21.15.1:0/1939474640 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564685f8e070 0x56468633ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:12.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.785+0000 7f909b7fe640 1 -- 172.21.15.1:0/1939474640 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564685f6d390 msgr2=0x564686337090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:12.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.785+0000 7f909b7fe640 1 --2- 172.21.15.1:0/1939474640 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564685f6d390 0x564686337090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:12.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.785+0000 7f909b7fe640 1 -- 172.21.15.1:0/1939474640 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564686338500 con 0x564685f21da0 2024-09-21T01:03:12.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.785+0000 7f909b7fe640 1 --2- 172.21.15.1:0/1939474640 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564685f21da0 0x56468633e330 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f909000e940 tx=0x7f90900adf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f2cb36442b95eb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:12.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.789+0000 7f9080ff9640 1 -- 172.21.15.1:0/1939474640 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90900d3030 con 0x564685f21da0 2024-09-21T01:03:12.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.789+0000 7f9080ff9640 1 -- 172.21.15.1:0/1939474640 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90900b2070 con 0x564685f21da0 2024-09-21T01:03:12.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.789+0000 7f9080ff9640 1 -- 172.21.15.1:0/1939474640 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90900046c0 con 0x564685f21da0 2024-09-21T01:03:12.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.791+0000 7f90a7d3e740 1 -- 172.21.15.1:0/1939474640 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564685f21da0 msgr2=0x56468633e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:12.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.791+0000 7f90a7d3e740 1 --2- 172.21.15.1:0/1939474640 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564685f21da0 0x56468633e330 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f909000e940 tx=0x7f90900adf60 comp rx=0 tx=0).stop 2024-09-21T01:03:12.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.795+0000 7f90a7d3e740 1 -- 172.21.15.1:0/1939474640 shutdown_connections 2024-09-21T01:03:12.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.795+0000 7f90a7d3e740 1 --2- 172.21.15.1:0/1939474640 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564685f21da0 0x56468633e330 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:12.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.795+0000 7f90a7d3e740 1 --2- 172.21.15.1:0/1939474640 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564685f8e070 0x56468633ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:12.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.795+0000 7f90a7d3e740 1 --2- 172.21.15.1:0/1939474640 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564685f6d390 0x564686337090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:12.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.795+0000 7f90a7d3e740 1 -- 172.21.15.1:0/1939474640 >> 172.21.15.1:0/1939474640 conn(0x564685f82460 msgr2=0x56468633faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:12.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.797+0000 7f90a7d3e740 1 -- 172.21.15.1:0/1939474640 shutdown_connections 2024-09-21T01:03:12.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.797+0000 7f90a7d3e740 1 -- 172.21.15.1:0/1939474640 wait complete. 2024-09-21T01:03:12.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.797+0000 7f90a7d3e740 1 -- start start 2024-09-21T01:03:12.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.798+0000 7f90a7d3e740 1 Processor -- start 2024-09-21T01:03:12.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.802+0000 7f90a7d3e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564685f21da0 0x564686349980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:12.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.802+0000 7f90a7d3e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564685f6d390 0x564686344e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:12.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.802+0000 7f90a7d3e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564685f8e070 0x564686345370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:12.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.802+0000 7f90a7d3e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f908800f9f0 con 0x564685f8e070 2024-09-21T01:03:12.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.802+0000 7f90a7d3e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f908800f320 con 0x564685f6d390 2024-09-21T01:03:12.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.802+0000 7f90a7d3e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f908800c580 con 0x564685f21da0 2024-09-21T01:03:12.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.802+0000 7f90a7d3e740 10 client.0 _ll_register_callbacks cb 0x7f908c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:03:12.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.803+0000 7f909a7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564685f6d390 0x564686344e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:12.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.803+0000 7f909affd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564685f21da0 0x564686349980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:12.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.804+0000 7f909a7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564685f6d390 0x564686344e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:39574/0 (socket says 172.21.15.1:39574) 2024-09-21T01:03:12.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.804+0000 7f909a7fc640 1 -- 172.21.15.1:0/1971877383 learned_addr learned my addr 172.21.15.1:0/1971877383 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:12.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.804+0000 7f909b7fe640 1 --2- 172.21.15.1:0/1971877383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564685f8e070 0x564686345370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:12.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.805+0000 7f909a7fc640 1 -- 172.21.15.1:0/1971877383 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564685f21da0 msgr2=0x564686349980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:12.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.805+0000 7f909a7fc640 1 --2- 172.21.15.1:0/1971877383 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564685f21da0 0x564686349980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:12.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.805+0000 7f909a7fc640 1 -- 172.21.15.1:0/1971877383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564685f8e070 msgr2=0x564686345370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:12.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.805+0000 7f909a7fc640 1 --2- 172.21.15.1:0/1971877383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564685f8e070 0x564686345370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:12.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.805+0000 7f909a7fc640 1 -- 172.21.15.1:0/1971877383 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564686345b00 con 0x564685f6d390 2024-09-21T01:03:12.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.805+0000 7f909b7fe640 1 --2- 172.21.15.1:0/1971877383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564685f8e070 0x564686345370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:03:12.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.807+0000 7f909a7fc640 1 --2- 172.21.15.1:0/1971877383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564685f6d390 0x564686344e30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f909401a770 tx=0x7f9094004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=103f9e4340609c55 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:12.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.807+0000 7f907eff5640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:03:12.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.807+0000 7f907eff5640 1 -- 172.21.15.1:0/1971877383 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909400db20 con 0x564685f6d390 2024-09-21T01:03:12.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.807+0000 7f90a7d3e740 1 -- 172.21.15.1:0/1971877383 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90900b2070 con 0x564685f6d390 2024-09-21T01:03:12.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.807+0000 7f907eff5640 1 -- 172.21.15.1:0/1971877383 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f909400dcc0 con 0x564685f6d390 2024-09-21T01:03:12.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.808+0000 7f907eff5640 1 -- 172.21.15.1:0/1971877383 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f909402b470 con 0x564685f6d390 2024-09-21T01:03:12.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.808+0000 7f90a7d3e740 10 client.26630 fetch_fsmap learned FSMap version 34 2024-09-21T01:03:12.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.808+0000 7f90a7d3e740 1 -- 172.21.15.1:0/1971877383 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5646863bdc50 con 0x564685f6d390 2024-09-21T01:03:12.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.812+0000 7f907eff5640 1 -- 172.21.15.1:0/1971877383 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90900b2070 con 0x564685f6d390 2024-09-21T01:03:12.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.812+0000 7f907eff5640 1 -- 172.21.15.1:0/1971877383 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 34) ==== 8374+0+0 (secure 0 0 0) 0x7f9094036730 con 0x564685f6d390 2024-09-21T01:03:12.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.812+0000 7f90a7d3e740 10 client.26630 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T01:03:12.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.812+0000 7f90a7d3e740 10 client.26630 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T01:03:12.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.812+0000 7f90a7d3e740 20 client.26630 populate_metadata read hostname 'smithi001' 2024-09-21T01:03:12.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.812+0000 7f90a7d3e740 1 --2- 172.21.15.1:0/1971877383 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x5646863be440 0x5646863c0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:12.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.812+0000 7f90a7d3e740 4 client.26630 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:03:12.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.812+0000 7f90a7d3e740 1 -- 172.21.15.1:0/1971877383 --> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5646862a98a0 con 0x5646863be440 2024-09-21T01:03:12.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.813+0000 7f909affd640 1 --2- 172.21.15.1:0/1971877383 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x5646863be440 0x5646863c0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:12.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.813+0000 7f907eff5640 10 client.26630 ms_handle_connect on v2:172.21.15.42:6836/2395608508 2024-09-21T01:03:12.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.814+0000 7f909affd640 1 --2- 172.21.15.1:0/1971877383 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x5646863be440 0x5646863c0860 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e4680b0343b932b server_cookie=58264f3c95a03e01 in_seq=0 out_seq=0 2024-09-21T01:03:12.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.822+0000 7f907eff5640 1 -- 172.21.15.1:0/1971877383 <== mds.2 v2:172.21.15.42:6836/2395608508 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5646862a98a0 con 0x5646863be440 2024-09-21T01:03:12.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.822+0000 7f907eff5640 10 client.26630 handle_command_reply: tid=0 2024-09-21T01:03:12.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.822+0000 7f90a7d3e740 1 client.26630 shutdown 2024-09-21T01:03:12.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.834+0000 7f90a7d3e740 1 -- 172.21.15.1:0/1971877383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564685f6d390 msgr2=0x564686344e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:12.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.834+0000 7f90a7d3e740 1 --2- 172.21.15.1:0/1971877383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564685f6d390 0x564686344e30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f909401a770 tx=0x7f9094004ad0 comp rx=0 tx=0).stop 2024-09-21T01:03:12.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.834+0000 7f90a7d3e740 1 -- 172.21.15.1:0/1971877383 shutdown_connections 2024-09-21T01:03:12.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.834+0000 7f90a7d3e740 1 --2- 172.21.15.1:0/1971877383 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x5646863be440 0x5646863c0860 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:12.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.834+0000 7f90a7d3e740 1 --2- 172.21.15.1:0/1971877383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564685f8e070 0x564686345370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:12.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.834+0000 7f90a7d3e740 1 --2- 172.21.15.1:0/1971877383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564685f6d390 0x564686344e30 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:12.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.834+0000 7f90a7d3e740 1 --2- 172.21.15.1:0/1971877383 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564685f21da0 0x564686349980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:12.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.834+0000 7f90a7d3e740 1 -- 172.21.15.1:0/1971877383 >> 172.21.15.1:0/1971877383 conn(0x564685f82460 msgr2=0x5646863365f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:12.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.838+0000 7f907eff5640 0 client.26630 ms_handle_reset on v2:172.21.15.42:6836/2395608508 2024-09-21T01:03:12.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.838+0000 7f90a7d3e740 1 -- 172.21.15.1:0/1971877383 shutdown_connections 2024-09-21T01:03:12.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.838+0000 7f90a7d3e740 1 -- 172.21.15.1:0/1971877383 wait complete. 2024-09-21T01:03:12.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.843+0000 7f90a7d3e740 20 client.26630 trim_cache size 0 max 16384 2024-09-21T01:03:12.849 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T01:03:12.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.853+0000 7f90a17ca640 1 -- 172.21.15.1:0/2020105690 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f90840b6710 msgr2=0x7f90840b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:12.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.853+0000 7f90a17ca640 1 --2- 172.21.15.1:0/2020105690 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f90840b6710 0x7f90840b8c20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f909c102500 tx=0x7f9094009250 comp rx=0 tx=0).stop 2024-09-21T01:03:12.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.853+0000 7f90a17ca640 1 -- 172.21.15.1:0/2020105690 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f909c1053f0 msgr2=0x7f909c110c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:12.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.853+0000 7f90a17ca640 1 --2- 172.21.15.1:0/2020105690 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f909c1053f0 0x7f909c110c80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f909000e970 tx=0x7f909000ed70 comp rx=0 tx=0).stop 2024-09-21T01:03:12.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.856+0000 7f90a17ca640 1 -- 172.21.15.1:0/2020105690 shutdown_connections 2024-09-21T01:03:12.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.856+0000 7f90a17ca640 1 --2- 172.21.15.1:0/2020105690 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f909c1053f0 0x7f909c110c80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:12.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.856+0000 7f90a17ca640 1 --2- 172.21.15.1:0/2020105690 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f909c102630 0x7f909c110740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:12.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.856+0000 7f90a17ca640 1 --2- 172.21.15.1:0/2020105690 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f90840b6710 0x7f90840b8c20 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:12.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.856+0000 7f90a17ca640 1 --2- 172.21.15.1:0/2020105690 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f909c101ce0 0x7f909c117470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:12.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.856+0000 7f90a17ca640 1 -- 172.21.15.1:0/2020105690 >> 172.21.15.1:0/2020105690 conn(0x7f909c077c60 msgr2=0x7f909c100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:12.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.858+0000 7f90a17ca640 1 -- 172.21.15.1:0/2020105690 shutdown_connections 2024-09-21T01:03:12.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:12.858+0000 7f90a17ca640 1 -- 172.21.15.1:0/2020105690 wait complete. 2024-09-21T01:03:13.564 INFO:tasks.workunit.client.0.smithi001.stdout: 145 1712902 483 1155524 359 1043393 1376 2024-09-21T01:03:13.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:13 smithi001 ceph-mon[31211]: pgmap v538: 97 pgs: 97 active+clean; 679 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 7.5 MiB/s wr, 778 op/s 2024-09-21T01:03:13.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:13 smithi001 ceph-mon[31211]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:03:13.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:13 smithi193 ceph-mon[34660]: pgmap v538: 97 pgs: 97 active+clean; 679 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 7.5 MiB/s wr, 778 op/s 2024-09-21T01:03:13.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:13 smithi193 ceph-mon[34660]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:03:13.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:13 smithi042 ceph-mon[34481]: pgmap v538: 97 pgs: 97 active+clean; 679 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 7.5 MiB/s wr, 778 op/s 2024-09-21T01:03:13.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:13 smithi042 ceph-mon[34481]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:03:14.322 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T01:03:15.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:15 smithi001 ceph-mon[31211]: pgmap v539: 97 pgs: 97 active+clean; 683 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.2 MiB/s wr, 757 op/s 2024-09-21T01:03:15.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:15 smithi193 ceph-mon[34660]: pgmap v539: 97 pgs: 97 active+clean; 683 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.2 MiB/s wr, 757 op/s 2024-09-21T01:03:15.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:15 smithi042 ceph-mon[34481]: pgmap v539: 97 pgs: 97 active+clean; 683 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.2 MiB/s wr, 757 op/s 2024-09-21T01:03:16.538 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:03:17.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:17 smithi001 ceph-mon[31211]: pgmap v540: 97 pgs: 97 active+clean; 681 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.4 MiB/s wr, 574 op/s 2024-09-21T01:03:17.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:03:17.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:03:17.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T01:03:17.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T01:03:17.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:17 smithi001 ceph-mon[31211]: Adjusting osd_memory_target on smithi001 to 177.0M 2024-09-21T01:03:17.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:17 smithi001 ceph-mon[31211]: Unable to set osd_memory_target on smithi001 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-21T01:03:17.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:03:17.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:03:17.461 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T01:03:17.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.584+0000 7f10f634b640 1 -- 172.21.15.1:0/308681987 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10e8094d60 msgr2=0x7f10e8095170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:17.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.584+0000 7f10f634b640 1 --2- 172.21.15.1:0/308681987 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10e8094d60 0x7f10e8095170 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f10e401a940 tx=0x7f10e403b470 comp rx=0 tx=0).stop 2024-09-21T01:03:17.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.585+0000 7f10f634b640 1 -- 172.21.15.1:0/308681987 shutdown_connections 2024-09-21T01:03:17.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.585+0000 7f10f634b640 1 --2- 172.21.15.1:0/308681987 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10e809a1a0 0x7f10e809a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:17.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.585+0000 7f10f634b640 1 --2- 172.21.15.1:0/308681987 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10e80956b0 0x7f10e8099be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:17.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.585+0000 7f10f634b640 1 --2- 172.21.15.1:0/308681987 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10e8094d60 0x7f10e8095170 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:17.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.585+0000 7f10f634b640 1 -- 172.21.15.1:0/308681987 >> 172.21.15.1:0/308681987 conn(0x7f10e800cd70 msgr2=0x7f10e800d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:17.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.586+0000 7f10f634b640 1 -- 172.21.15.1:0/308681987 shutdown_connections 2024-09-21T01:03:17.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.588+0000 7f10f634b640 1 -- 172.21.15.1:0/308681987 wait complete. 2024-09-21T01:03:17.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.589+0000 7f10f634b640 1 Processor -- start 2024-09-21T01:03:17.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.589+0000 7f10f634b640 1 -- start start 2024-09-21T01:03:17.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.590+0000 7f10f634b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10e8094d60 0x7f10e80a9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:17.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.590+0000 7f10f634b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10e80956b0 0x7f10e80a5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:17.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.590+0000 7f10f634b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10e809a1a0 0x7f10e80a5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:17.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.590+0000 7f10f634b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f10e809db00 con 0x7f10e809a1a0 2024-09-21T01:03:17.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.590+0000 7f10f634b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f10e809d980 con 0x7f10e80956b0 2024-09-21T01:03:17.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.590+0000 7f10f634b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f10e809dc80 con 0x7f10e8094d60 2024-09-21T01:03:17.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.591+0000 7f10f48e8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10e809a1a0 0x7f10e80a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:17.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.591+0000 7f10f48e8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10e809a1a0 0x7f10e80a5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39918/0 (socket says 172.21.15.1:39918) 2024-09-21T01:03:17.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.591+0000 7f10f48e8640 1 -- 172.21.15.1:0/1046539084 learned_addr learned my addr 172.21.15.1:0/1046539084 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:17.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.591+0000 7f10effff640 1 --2- 172.21.15.1:0/1046539084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10e8094d60 0x7f10e80a9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:17.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.592+0000 7f10f48e8640 1 -- 172.21.15.1:0/1046539084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10e8094d60 msgr2=0x7f10e80a9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:17.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.592+0000 7f10f48e8640 1 --2- 172.21.15.1:0/1046539084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10e8094d60 0x7f10e80a9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:17.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.592+0000 7f10f48e8640 1 -- 172.21.15.1:0/1046539084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10e80956b0 msgr2=0x7f10e80a5670 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:03:17.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.592+0000 7f10f48e8640 1 --2- 172.21.15.1:0/1046539084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10e80956b0 0x7f10e80a5670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:17.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.592+0000 7f10f48e8640 1 -- 172.21.15.1:0/1046539084 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e8136b60 con 0x7f10e809a1a0 2024-09-21T01:03:17.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.592+0000 7f10f48e8640 1 --2- 172.21.15.1:0/1046539084 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10e809a1a0 0x7f10e80a5d00 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f10f002ebd0 tx=0x7f10f00769d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:17.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.593+0000 7f10ed7fa640 1 -- 172.21.15.1:0/1046539084 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f0086070 con 0x7f10e809a1a0 2024-09-21T01:03:17.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.593+0000 7f10f634b640 1 -- 172.21.15.1:0/1046539084 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10e8136d30 con 0x7f10e809a1a0 2024-09-21T01:03:17.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.593+0000 7f10f634b640 1 -- 172.21.15.1:0/1046539084 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10e8137210 con 0x7f10e809a1a0 2024-09-21T01:03:17.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.594+0000 7f10ed7fa640 1 -- 172.21.15.1:0/1046539084 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10f007fbc0 con 0x7f10e809a1a0 2024-09-21T01:03:17.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.594+0000 7f10ed7fa640 1 -- 172.21.15.1:0/1046539084 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f0081c00 con 0x7f10e809a1a0 2024-09-21T01:03:17.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.601+0000 7f10ed7fa640 1 -- 172.21.15.1:0/1046539084 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f10f0089070 con 0x7f10e809a1a0 2024-09-21T01:03:17.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.602+0000 7f10fc8bf740 1 Processor -- start 2024-09-21T01:03:17.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.604+0000 7f10fc8bf740 1 -- start start 2024-09-21T01:03:17.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.610+0000 7f10ed7fa640 1 --2- 172.21.15.1:0/1046539084 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f10e00b66a0 0x7f10e00b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:17.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.611+0000 7f10ed7fa640 1 -- 172.21.15.1:0/1046539084 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f10f0154bd0 con 0x7f10e809a1a0 2024-09-21T01:03:17.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.612+0000 7f10fc8bf740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5592b9576070 0x5592b991d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:17.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.612+0000 7f10fc8bf740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5592b954d1b0 0x5592b991dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:17.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.612+0000 7f10fc8bf740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5592b9555390 0x5592b991e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:17.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.612+0000 7f10fc8bf740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5592b9893ea0 con 0x5592b9576070 2024-09-21T01:03:17.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.612+0000 7f10fc8bf740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5592b98832d0 con 0x5592b954d1b0 2024-09-21T01:03:17.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.612+0000 7f10fc8bf740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5592b98870e0 con 0x5592b9555390 2024-09-21T01:03:17.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.612+0000 7f10f48e8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5592b9555390 0x5592b991e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:17.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.613+0000 7f10effff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5592b9576070 0x5592b991d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:17.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.613+0000 7f10effff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5592b9576070 0x5592b991d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39928/0 (socket says 172.21.15.1:39928) 2024-09-21T01:03:17.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.613+0000 7f10effff640 1 -- 172.21.15.1:0/4123371201 learned_addr learned my addr 172.21.15.1:0/4123371201 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:17.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.614+0000 7f10ef7fe640 1 --2- 172.21.15.1:0/1046539084 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f10e00b66a0 0x7f10e00b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:17.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.614+0000 7f10ef7fe640 1 --2- 172.21.15.1:0/4123371201 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5592b954d1b0 0x5592b991dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:17.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.615+0000 7f10ef7fe640 1 --2- 172.21.15.1:0/1046539084 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f10e00b66a0 0x7f10e00b8bb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f10e8092b30 tx=0x7f10dc009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:17.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.615+0000 7f10ef7fe640 1 -- 172.21.15.1:0/4123371201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5592b9555390 msgr2=0x5592b991e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:17.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.615+0000 7f10ef7fe640 1 --2- 172.21.15.1:0/4123371201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5592b9555390 0x5592b991e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:17.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.615+0000 7f10ef7fe640 1 -- 172.21.15.1:0/4123371201 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5592b9576070 msgr2=0x5592b991d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:17.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.617+0000 7f10ef7fe640 1 --2- 172.21.15.1:0/4123371201 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5592b9576070 0x5592b991d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:17.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.617+0000 7f10ef7fe640 1 -- 172.21.15.1:0/4123371201 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592b95e1650 con 0x5592b954d1b0 2024-09-21T01:03:17.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.617+0000 7f10effff640 1 --2- 172.21.15.1:0/4123371201 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5592b9576070 0x5592b991d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:03:17.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.617+0000 7f10ef7fe640 1 --2- 172.21.15.1:0/4123371201 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5592b954d1b0 0x5592b991dda0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f10e8008570 tx=0x7f10dc019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1efa74f11e68d8b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:17.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.618+0000 7f10da7fc640 1 -- 172.21.15.1:0/4123371201 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10dc00f070 con 0x5592b954d1b0 2024-09-21T01:03:17.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.618+0000 7f10da7fc640 1 -- 172.21.15.1:0/4123371201 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10dc01d070 con 0x5592b954d1b0 2024-09-21T01:03:17.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.618+0000 7f10da7fc640 1 -- 172.21.15.1:0/4123371201 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10dc0226d0 con 0x5592b954d1b0 2024-09-21T01:03:17.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.620+0000 7f10fc8bf740 1 -- 172.21.15.1:0/4123371201 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5592b954d1b0 msgr2=0x5592b991dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:17.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.620+0000 7f10fc8bf740 1 --2- 172.21.15.1:0/4123371201 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5592b954d1b0 0x5592b991dda0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f10e8008570 tx=0x7f10dc019000 comp rx=0 tx=0).stop 2024-09-21T01:03:17.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.620+0000 7f10fc8bf740 1 -- 172.21.15.1:0/4123371201 shutdown_connections 2024-09-21T01:03:17.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.620+0000 7f10fc8bf740 1 --2- 172.21.15.1:0/4123371201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5592b9555390 0x5592b991e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:17.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.620+0000 7f10fc8bf740 1 --2- 172.21.15.1:0/4123371201 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5592b954d1b0 0x5592b991dda0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:17.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.621+0000 7f10fc8bf740 1 --2- 172.21.15.1:0/4123371201 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5592b9576070 0x5592b991d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:17.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.621+0000 7f10fc8bf740 1 -- 172.21.15.1:0/4123371201 >> 172.21.15.1:0/4123371201 conn(0x5592b956a460 msgr2=0x5592b991b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:17.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.621+0000 7f10fc8bf740 1 -- 172.21.15.1:0/4123371201 shutdown_connections 2024-09-21T01:03:17.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.621+0000 7f10fc8bf740 1 -- 172.21.15.1:0/4123371201 wait complete. 2024-09-21T01:03:17.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.622+0000 7f10fc8bf740 1 -- start start 2024-09-21T01:03:17.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.622+0000 7f10fc8bf740 1 Processor -- start 2024-09-21T01:03:17.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.623+0000 7f10fc8bf740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5592b954d1b0 0x5592b9928f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:17.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.623+0000 7f10fc8bf740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5592b9555390 0x5592b9929460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:17.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.623+0000 7f10fc8bf740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5592b9576070 0x5592b9935360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:17.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.624+0000 7f10effff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5592b954d1b0 0x5592b9928f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:17.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.624+0000 7f10effff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5592b954d1b0 0x5592b9928f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39934/0 (socket says 172.21.15.1:39934) 2024-09-21T01:03:17.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.624+0000 7f10ef7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5592b9555390 0x5592b9929460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:17.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.624+0000 7f10ef7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5592b9555390 0x5592b9929460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:57314/0 (socket says 172.21.15.1:57314) 2024-09-21T01:03:17.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.624+0000 7f10fc8bf740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5592b96e4700 con 0x5592b954d1b0 2024-09-21T01:03:17.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.624+0000 7f10fc8bf740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5592b981e160 con 0x5592b9576070 2024-09-21T01:03:17.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.624+0000 7f10fc8bf740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5592b992bfe0 con 0x5592b9555390 2024-09-21T01:03:17.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.624+0000 7f10fc8bf740 10 client.0 _ll_register_callbacks cb 0x5592b98379e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:03:17.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.624+0000 7f10effff640 1 -- 172.21.15.1:0/1180402120 learned_addr learned my addr 172.21.15.1:0/1180402120 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:17.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.625+0000 7f10f48e8640 1 --2- 172.21.15.1:0/1180402120 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5592b9576070 0x5592b9935360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:17.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.625+0000 7f10effff640 1 -- 172.21.15.1:0/1180402120 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5592b9555390 msgr2=0x5592b9929460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:17.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.625+0000 7f10effff640 1 --2- 172.21.15.1:0/1180402120 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5592b9555390 0x5592b9929460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:17.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.625+0000 7f10effff640 1 -- 172.21.15.1:0/1180402120 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5592b9576070 msgr2=0x5592b9935360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:17.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.625+0000 7f10effff640 1 --2- 172.21.15.1:0/1180402120 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5592b9576070 0x5592b9935360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:17.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.625+0000 7f10effff640 1 -- 172.21.15.1:0/1180402120 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592b984bc90 con 0x5592b954d1b0 2024-09-21T01:03:17.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.625+0000 7f10effff640 1 --2- 172.21.15.1:0/1180402120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5592b954d1b0 0x5592b9928f20 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f10e401a910 tx=0x7f10e4004940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f47dc365076f396 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:17.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.625+0000 7f10cf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:03:17.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.626+0000 7f10cf7fe640 1 -- 172.21.15.1:0/1180402120 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e4046030 con 0x5592b954d1b0 2024-09-21T01:03:17.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.626+0000 7f10cf7fe640 1 -- 172.21.15.1:0/1180402120 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f10e4004e20 con 0x5592b954d1b0 2024-09-21T01:03:17.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.626+0000 7f10fc8bf740 1 -- 172.21.15.1:0/1180402120 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10dc01d070 con 0x5592b954d1b0 2024-09-21T01:03:17.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.627+0000 7f10cf7fe640 1 -- 172.21.15.1:0/1180402120 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f10e4005020 con 0x5592b954d1b0 2024-09-21T01:03:17.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.630+0000 7f10fc8bf740 10 client.16986 fetch_fsmap learned FSMap version 34 2024-09-21T01:03:17.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.630+0000 7f10fc8bf740 1 -- 172.21.15.1:0/1180402120 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5592b9937d50 con 0x5592b954d1b0 2024-09-21T01:03:17.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.631+0000 7f10cf7fe640 1 -- 172.21.15.1:0/1180402120 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10e4040510 con 0x5592b954d1b0 2024-09-21T01:03:17.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.631+0000 7f10cf7fe640 1 -- 172.21.15.1:0/1180402120 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 34) ==== 8374+0+0 (secure 0 0 0) 0x7f10e404d440 con 0x5592b954d1b0 2024-09-21T01:03:17.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.632+0000 7f10fc8bf740 10 client.16986 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T01:03:17.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.632+0000 7f10fc8bf740 10 client.16986 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T01:03:17.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.632+0000 7f10fc8bf740 20 client.16986 populate_metadata read hostname 'smithi001' 2024-09-21T01:03:17.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.632+0000 7f10fc8bf740 1 --2- 172.21.15.1:0/1180402120 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5592b95349f0 0x5592b993b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:17.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.632+0000 7f10fc8bf740 4 client.16986 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:03:17.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.632+0000 7f10fc8bf740 1 -- 172.21.15.1:0/1180402120 --> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f10dc01d070 con 0x5592b95349f0 2024-09-21T01:03:17.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.632+0000 7f10ef7fe640 1 --2- 172.21.15.1:0/1180402120 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5592b95349f0 0x5592b993b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:17.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.639+0000 7f10ef7fe640 1 --2- 172.21.15.1:0/1180402120 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5592b95349f0 0x5592b993b2a0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9dfebadd8543ca22 server_cookie=298aa239f31740ad in_seq=0 out_seq=0 2024-09-21T01:03:17.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.639+0000 7f10cf7fe640 10 client.16986 ms_handle_connect on v2:172.21.15.193:6838/1365361177 2024-09-21T01:03:17.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.643+0000 7f10cf7fe640 1 -- 172.21.15.1:0/1180402120 <== mds.1 v2:172.21.15.193:6838/1365361177 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f10dc01d070 con 0x5592b95349f0 2024-09-21T01:03:17.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.643+0000 7f10cf7fe640 10 client.16986 handle_command_reply: tid=0 2024-09-21T01:03:17.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.643+0000 7f10fc8bf740 1 client.16986 shutdown 2024-09-21T01:03:17.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.643+0000 7f10fc8bf740 1 -- 172.21.15.1:0/1180402120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5592b954d1b0 msgr2=0x5592b9928f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:17.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.643+0000 7f10fc8bf740 1 --2- 172.21.15.1:0/1180402120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5592b954d1b0 0x5592b9928f20 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f10e401a910 tx=0x7f10e4004940 comp rx=0 tx=0).stop 2024-09-21T01:03:17.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.643+0000 7f10fc8bf740 1 -- 172.21.15.1:0/1180402120 shutdown_connections 2024-09-21T01:03:17.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.643+0000 7f10fc8bf740 1 --2- 172.21.15.1:0/1180402120 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5592b95349f0 0x5592b993b2a0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:17.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.643+0000 7f10fc8bf740 1 --2- 172.21.15.1:0/1180402120 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5592b9576070 0x5592b9935360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:17.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.643+0000 7f10fc8bf740 1 --2- 172.21.15.1:0/1180402120 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5592b9555390 0x5592b9929460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:17.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.643+0000 7f10cf7fe640 0 client.16986 ms_handle_reset on v2:172.21.15.193:6838/1365361177 2024-09-21T01:03:17.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.643+0000 7f10fc8bf740 1 --2- 172.21.15.1:0/1180402120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5592b954d1b0 0x5592b9928f20 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:17.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.644+0000 7f10fc8bf740 1 -- 172.21.15.1:0/1180402120 >> 172.21.15.1:0/1180402120 conn(0x5592b956a460 msgr2=0x5592b99209f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:17.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.645+0000 7f10fc8bf740 1 -- 172.21.15.1:0/1180402120 shutdown_connections 2024-09-21T01:03:17.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.646+0000 7f10fc8bf740 1 -- 172.21.15.1:0/1180402120 wait complete. 2024-09-21T01:03:17.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.646+0000 7f10fc8bf740 20 client.16986 trim_cache size 0 max 16384 2024-09-21T01:03:17.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.676+0000 7f10fc8bf740 1 Processor -- start 2024-09-21T01:03:17.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.677+0000 7f10fc8bf740 1 -- start start 2024-09-21T01:03:17.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.677+0000 7f10fc8bf740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5592b95349f0 0x5592b99293e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:17.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.677+0000 7f10fc8bf740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5592b954d1b0 0x5592b9920960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:17.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.677+0000 7f10fc8bf740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5592b9555390 0x5592b9920ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:17.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.677+0000 7f10fc8bf740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f10d400e630 con 0x5592b954d1b0 2024-09-21T01:03:17.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.677+0000 7f10fc8bf740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f10d4010200 con 0x5592b95349f0 2024-09-21T01:03:17.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.677+0000 7f10fc8bf740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f10d400ed00 con 0x5592b9555390 2024-09-21T01:03:17.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.677+0000 7f10effff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5592b95349f0 0x5592b99293e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:17.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.677+0000 7f10effff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5592b95349f0 0x5592b99293e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:39618/0 (socket says 172.21.15.1:39618) 2024-09-21T01:03:17.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.677+0000 7f10effff640 1 -- 172.21.15.1:0/3631587343 learned_addr learned my addr 172.21.15.1:0/3631587343 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:17.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.677+0000 7f10ef7fe640 1 --2- 172.21.15.1:0/3631587343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5592b954d1b0 0x5592b9920960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:17.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.677+0000 7f10f48e8640 1 --2- 172.21.15.1:0/3631587343 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5592b9555390 0x5592b9920ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:17.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.678+0000 7f10effff640 1 -- 172.21.15.1:0/3631587343 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5592b9555390 msgr2=0x5592b9920ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:17.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.678+0000 7f10effff640 1 --2- 172.21.15.1:0/3631587343 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5592b9555390 0x5592b9920ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:17.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.678+0000 7f10effff640 1 -- 172.21.15.1:0/3631587343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5592b954d1b0 msgr2=0x5592b9920960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:17.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.678+0000 7f10effff640 1 --2- 172.21.15.1:0/3631587343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5592b954d1b0 0x5592b9920960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:17.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.678+0000 7f10effff640 1 -- 172.21.15.1:0/3631587343 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592b992a1e0 con 0x5592b95349f0 2024-09-21T01:03:17.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.678+0000 7f10effff640 1 --2- 172.21.15.1:0/3631587343 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5592b95349f0 0x5592b99293e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f10e401a860 tx=0x7f10e4001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ddbfb85934e6225 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:17.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.678+0000 7f10d9ffb640 1 -- 172.21.15.1:0/3631587343 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e4046070 con 0x5592b95349f0 2024-09-21T01:03:17.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.679+0000 7f10d9ffb640 1 -- 172.21.15.1:0/3631587343 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10e404d440 con 0x5592b95349f0 2024-09-21T01:03:17.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.679+0000 7f10d9ffb640 1 -- 172.21.15.1:0/3631587343 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e4040770 con 0x5592b95349f0 2024-09-21T01:03:17.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.680+0000 7f10fc8bf740 1 -- 172.21.15.1:0/3631587343 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5592b95349f0 msgr2=0x5592b99293e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:17.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.680+0000 7f10fc8bf740 1 --2- 172.21.15.1:0/3631587343 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5592b95349f0 0x5592b99293e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f10e401a860 tx=0x7f10e4001e70 comp rx=0 tx=0).stop 2024-09-21T01:03:17.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.681+0000 7f10fc8bf740 1 -- 172.21.15.1:0/3631587343 shutdown_connections 2024-09-21T01:03:17.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.681+0000 7f10fc8bf740 1 --2- 172.21.15.1:0/3631587343 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5592b9555390 0x5592b9920ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:17.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.681+0000 7f10fc8bf740 1 --2- 172.21.15.1:0/3631587343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5592b954d1b0 0x5592b9920960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:17.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.681+0000 7f10fc8bf740 1 --2- 172.21.15.1:0/3631587343 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5592b95349f0 0x5592b99293e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:17.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.681+0000 7f10fc8bf740 1 -- 172.21.15.1:0/3631587343 >> 172.21.15.1:0/3631587343 conn(0x5592b956a460 msgr2=0x5592b9928cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:17.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.681+0000 7f10fc8bf740 1 -- 172.21.15.1:0/3631587343 shutdown_connections 2024-09-21T01:03:17.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.681+0000 7f10fc8bf740 1 -- 172.21.15.1:0/3631587343 wait complete. 2024-09-21T01:03:17.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.682+0000 7f10fc8bf740 1 -- start start 2024-09-21T01:03:17.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.682+0000 7f10fc8bf740 1 Processor -- start 2024-09-21T01:03:17.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.683+0000 7f10fc8bf740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5592b95349f0 0x5592b992d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:17.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.683+0000 7f10fc8bf740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5592b954d1b0 0x5592b992da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:17.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.683+0000 7f10fc8bf740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5592b9555390 0x5592b99a4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:17.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.683+0000 7f10effff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5592b95349f0 0x5592b992d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:17.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.683+0000 7f10fc8bf740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f10d400fb30 con 0x5592b954d1b0 2024-09-21T01:03:17.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.683+0000 7f10fc8bf740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f10d400f460 con 0x5592b95349f0 2024-09-21T01:03:17.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.683+0000 7f10effff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5592b95349f0 0x5592b992d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:39632/0 (socket says 172.21.15.1:39632) 2024-09-21T01:03:17.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.683+0000 7f10effff640 1 -- 172.21.15.1:0/2785789864 learned_addr learned my addr 172.21.15.1:0/2785789864 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:17.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.683+0000 7f10fc8bf740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f10d400c610 con 0x5592b9555390 2024-09-21T01:03:17.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.683+0000 7f10ef7fe640 1 --2- 172.21.15.1:0/2785789864 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5592b954d1b0 0x5592b992da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:17.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.683+0000 7f10f48e8640 1 --2- 172.21.15.1:0/2785789864 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5592b9555390 0x5592b99a4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:17.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.683+0000 7f10fc8bf740 10 client.0 _ll_register_callbacks cb 0x7f10e401a790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:03:17.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.683+0000 7f10f48e8640 1 -- 172.21.15.1:0/2785789864 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5592b95349f0 msgr2=0x5592b992d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:17.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.683+0000 7f10f48e8640 1 --2- 172.21.15.1:0/2785789864 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5592b95349f0 0x5592b992d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:17.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.683+0000 7f10f48e8640 1 -- 172.21.15.1:0/2785789864 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5592b954d1b0 msgr2=0x5592b992da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:17.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.683+0000 7f10f48e8640 1 --2- 172.21.15.1:0/2785789864 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5592b954d1b0 0x5592b992da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:17.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.683+0000 7f10f48e8640 1 -- 172.21.15.1:0/2785789864 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592b992e230 con 0x5592b9555390 2024-09-21T01:03:17.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.684+0000 7f10ef7fe640 1 --2- 172.21.15.1:0/2785789864 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5592b954d1b0 0x5592b992da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:03:17.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.684+0000 7f10f48e8640 1 --2- 172.21.15.1:0/2785789864 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5592b9555390 0x5592b99a4ca0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f10f00694d0 tx=0x7f10f0078040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bccfd2eb6d044970 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:17.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.684+0000 7f10cf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T01:03:17.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.684+0000 7f10cf7fe640 1 -- 172.21.15.1:0/2785789864 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f0081e60 con 0x5592b9555390 2024-09-21T01:03:17.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.684+0000 7f10cf7fe640 1 -- 172.21.15.1:0/2785789864 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f10f0122ba0 con 0x5592b9555390 2024-09-21T01:03:17.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.684+0000 7f10fc8bf740 1 -- 172.21.15.1:0/2785789864 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10e404d440 con 0x5592b9555390 2024-09-21T01:03:17.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.684+0000 7f10cf7fe640 1 -- 172.21.15.1:0/2785789864 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f10f011f820 con 0x5592b9555390 2024-09-21T01:03:17.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.684+0000 7f10fc8bf740 10 client.26521 fetch_fsmap learned FSMap version 34 2024-09-21T01:03:17.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.684+0000 7f10fc8bf740 1 -- 172.21.15.1:0/2785789864 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5592b99a61d0 con 0x5592b9555390 2024-09-21T01:03:17.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.685+0000 7f10cf7fe640 1 -- 172.21.15.1:0/2785789864 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10e404d440 con 0x5592b9555390 2024-09-21T01:03:17.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.685+0000 7f10cf7fe640 1 -- 172.21.15.1:0/2785789864 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 34) ==== 8374+0+0 (secure 0 0 0) 0x7f10f0152b70 con 0x5592b9555390 2024-09-21T01:03:17.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.685+0000 7f10fc8bf740 10 client.26521 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T01:03:17.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.685+0000 7f10fc8bf740 10 client.26521 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T01:03:17.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.685+0000 7f10fc8bf740 20 client.26521 populate_metadata read hostname 'smithi001' 2024-09-21T01:03:17.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.685+0000 7f10fc8bf740 1 --2- 172.21.15.1:0/2785789864 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5592b9576070 0x5592b99a8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:17.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.685+0000 7f10fc8bf740 4 client.26521 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:03:17.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.685+0000 7f10fc8bf740 1 -- 172.21.15.1:0/2785789864 --> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5592b9895df0 con 0x5592b9576070 2024-09-21T01:03:17.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.686+0000 7f10effff640 1 --2- 172.21.15.1:0/2785789864 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5592b9576070 0x5592b99a8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:17.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.687+0000 7f10cf7fe640 10 client.26521 ms_handle_connect on v2:172.21.15.193:6838/1365361177 2024-09-21T01:03:17.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.689+0000 7f10effff640 1 --2- 172.21.15.1:0/2785789864 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5592b9576070 0x5592b99a8990 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a854e4d119a3d145 server_cookie=5313bdf99decf26f in_seq=0 out_seq=0 2024-09-21T01:03:17.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.689+0000 7f10cf7fe640 1 -- 172.21.15.1:0/2785789864 <== mds.1 v2:172.21.15.193:6838/1365361177 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5592b9895df0 con 0x5592b9576070 2024-09-21T01:03:17.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.689+0000 7f10cf7fe640 10 client.26521 handle_command_reply: tid=0 2024-09-21T01:03:17.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.690+0000 7f10fc8bf740 1 client.26521 shutdown 2024-09-21T01:03:17.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.690+0000 7f10fc8bf740 1 -- 172.21.15.1:0/2785789864 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5592b9555390 msgr2=0x5592b99a4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:17.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.690+0000 7f10fc8bf740 1 --2- 172.21.15.1:0/2785789864 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5592b9555390 0x5592b99a4ca0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f10f00694d0 tx=0x7f10f0078040 comp rx=0 tx=0).stop 2024-09-21T01:03:17.721 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T01:03:17.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.691+0000 7f10fc8bf740 1 -- 172.21.15.1:0/2785789864 shutdown_connections 2024-09-21T01:03:17.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.691+0000 7f10fc8bf740 1 --2- 172.21.15.1:0/2785789864 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5592b9576070 0x5592b99a8990 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:17.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.691+0000 7f10cf7fe640 0 client.26521 ms_handle_reset on v2:172.21.15.193:6838/1365361177 2024-09-21T01:03:17.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.691+0000 7f10fc8bf740 1 --2- 172.21.15.1:0/2785789864 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5592b9555390 0x5592b99a4ca0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:17.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.691+0000 7f10fc8bf740 1 --2- 172.21.15.1:0/2785789864 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5592b954d1b0 0x5592b992da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:17.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.692+0000 7f10fc8bf740 1 --2- 172.21.15.1:0/2785789864 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5592b95349f0 0x5592b992d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:17.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.692+0000 7f10fc8bf740 1 -- 172.21.15.1:0/2785789864 >> 172.21.15.1:0/2785789864 conn(0x5592b956a460 msgr2=0x5592b9920960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:17.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.692+0000 7f10fc8bf740 1 -- 172.21.15.1:0/2785789864 shutdown_connections 2024-09-21T01:03:17.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.692+0000 7f10fc8bf740 1 -- 172.21.15.1:0/2785789864 wait complete. 2024-09-21T01:03:17.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.693+0000 7f10fc8bf740 20 client.26521 trim_cache size 0 max 16384 2024-09-21T01:03:17.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.694+0000 7f10f634b640 1 -- 172.21.15.1:0/1046539084 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f10e00b66a0 msgr2=0x7f10e00b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:17.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.694+0000 7f10f634b640 1 --2- 172.21.15.1:0/1046539084 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f10e00b66a0 0x7f10e00b8bb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f10e8092b30 tx=0x7f10dc009680 comp rx=0 tx=0).stop 2024-09-21T01:03:17.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.694+0000 7f10f634b640 1 -- 172.21.15.1:0/1046539084 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10e809a1a0 msgr2=0x7f10e80a5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:17.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.694+0000 7f10f634b640 1 --2- 172.21.15.1:0/1046539084 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10e809a1a0 0x7f10e80a5d00 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f10f002ebd0 tx=0x7f10f00769d0 comp rx=0 tx=0).stop 2024-09-21T01:03:17.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.694+0000 7f10f634b640 1 -- 172.21.15.1:0/1046539084 shutdown_connections 2024-09-21T01:03:17.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.695+0000 7f10f634b640 1 --2- 172.21.15.1:0/1046539084 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f10e00b66a0 0x7f10e00b8bb0 secure :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f10e8092b30 tx=0x7f10dc009680 comp rx=0 tx=0).stop 2024-09-21T01:03:17.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.695+0000 7f10f634b640 1 --2- 172.21.15.1:0/1046539084 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10e809a1a0 0x7f10e80a5d00 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:17.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.695+0000 7f10f634b640 1 --2- 172.21.15.1:0/1046539084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10e80956b0 0x7f10e80a5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:17.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.695+0000 7f10f634b640 1 --2- 172.21.15.1:0/1046539084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10e8094d60 0x7f10e80a9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:17.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.695+0000 7f10f634b640 1 -- 172.21.15.1:0/1046539084 >> 172.21.15.1:0/1046539084 conn(0x7f10e800cd70 msgr2=0x7f10e8097bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:17.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.695+0000 7f10f634b640 1 -- 172.21.15.1:0/1046539084 shutdown_connections 2024-09-21T01:03:17.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:17.695+0000 7f10f634b640 1 -- 172.21.15.1:0/1046539084 wait complete. 2024-09-21T01:03:17.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:17 smithi193 ceph-mon[34660]: pgmap v540: 97 pgs: 97 active+clean; 681 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.4 MiB/s wr, 574 op/s 2024-09-21T01:03:17.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:03:17.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:03:17.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T01:03:17.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T01:03:17.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:17 smithi193 ceph-mon[34660]: Adjusting osd_memory_target on smithi001 to 177.0M 2024-09-21T01:03:17.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:17 smithi193 ceph-mon[34660]: Unable to set osd_memory_target on smithi001 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-21T01:03:17.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:03:17.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:03:17.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T01:03:17.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:17 smithi042 ceph-mon[34481]: pgmap v540: 97 pgs: 97 active+clean; 681 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.4 MiB/s wr, 574 op/s 2024-09-21T01:03:17.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:03:17.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:03:17.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T01:03:17.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T01:03:17.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:17 smithi042 ceph-mon[34481]: Adjusting osd_memory_target on smithi001 to 177.0M 2024-09-21T01:03:17.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:17 smithi042 ceph-mon[34481]: Unable to set osd_memory_target on smithi001 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-21T01:03:17.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:03:17.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:03:17.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T01:03:19.389 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:19 smithi001 ceph-mon[31211]: pgmap v541: 97 pgs: 97 active+clean; 681 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 324 op/s 2024-09-21T01:03:19.488 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T01:03:19.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:19 smithi193 ceph-mon[34660]: pgmap v541: 97 pgs: 97 active+clean; 681 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 324 op/s 2024-09-21T01:03:19.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:19 smithi042 ceph-mon[34481]: pgmap v541: 97 pgs: 97 active+clean; 681 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 324 op/s 2024-09-21T01:03:21.270 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:03:21.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:21 smithi001 ceph-mon[31211]: pgmap v542: 97 pgs: 97 active+clean; 683 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 279 op/s 2024-09-21T01:03:21.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:21 smithi193 ceph-mon[34660]: pgmap v542: 97 pgs: 97 active+clean; 683 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 279 op/s 2024-09-21T01:03:21.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:21 smithi042 ceph-mon[34481]: pgmap v542: 97 pgs: 97 active+clean; 683 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 279 op/s 2024-09-21T01:03:22.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.687+0000 7fe591b0b640 1 -- 172.21.15.1:0/3126307598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe58c107be0 msgr2=0x7fe58c1080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:22.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.687+0000 7fe591b0b640 1 --2- 172.21.15.1:0/3126307598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe58c107be0 0x7fe58c1080c0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fe580009890 tx=0x7fe58002a390 comp rx=0 tx=0).stop 2024-09-21T01:03:22.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.687+0000 7fe591b0b640 1 -- 172.21.15.1:0/3126307598 shutdown_connections 2024-09-21T01:03:22.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.687+0000 7fe591b0b640 1 --2- 172.21.15.1:0/3126307598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe58c107be0 0x7fe58c1080c0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:22.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.687+0000 7fe591b0b640 1 --2- 172.21.15.1:0/3126307598 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe58c1030f0 0x7fe58c107620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:22.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.687+0000 7fe591b0b640 1 --2- 172.21.15.1:0/3126307598 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe58c1027a0 0x7fe58c102bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:22.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.687+0000 7fe591b0b640 1 -- 172.21.15.1:0/3126307598 >> 172.21.15.1:0/3126307598 conn(0x7fe58c079730 msgr2=0x7fe58c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:22.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.688+0000 7fe591b0b640 1 -- 172.21.15.1:0/3126307598 shutdown_connections 2024-09-21T01:03:22.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.688+0000 7fe591b0b640 1 -- 172.21.15.1:0/3126307598 wait complete. 2024-09-21T01:03:22.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.689+0000 7fe591b0b640 1 Processor -- start 2024-09-21T01:03:22.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.689+0000 7fe591b0b640 1 -- start start 2024-09-21T01:03:22.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.690+0000 7fe591b0b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe58c1027a0 0x7fe58c073f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:22.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.690+0000 7fe591b0b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe58c1030f0 0x7fe58c074500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:22.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.690+0000 7fe591b0b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe58c10bc20 0x7fe58c10c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:22.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.690+0000 7fe591b0b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe58c11a0d0 con 0x7fe58c1030f0 2024-09-21T01:03:22.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.690+0000 7fe591b0b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe58c119f50 con 0x7fe58c1027a0 2024-09-21T01:03:22.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.690+0000 7fe591b0b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe58c11a250 con 0x7fe58c10bc20 2024-09-21T01:03:22.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.692+0000 7fe58b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe58c1027a0 0x7fe58c073f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:22.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.692+0000 7fe58bfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe58c10bc20 0x7fe58c10c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:22.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.692+0000 7fe58b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe58c1027a0 0x7fe58c073f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:41198/0 (socket says 172.21.15.1:41198) 2024-09-21T01:03:22.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.692+0000 7fe58b7fe640 1 -- 172.21.15.1:0/3341295316 learned_addr learned my addr 172.21.15.1:0/3341295316 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:22.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.694+0000 7fe58affd640 1 --2- 172.21.15.1:0/3341295316 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe58c1030f0 0x7fe58c074500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:22.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.696+0000 7fe58b7fe640 1 -- 172.21.15.1:0/3341295316 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe58c10bc20 msgr2=0x7fe58c10c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:22.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.696+0000 7fe58b7fe640 1 --2- 172.21.15.1:0/3341295316 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe58c10bc20 0x7fe58c10c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:22.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.696+0000 7fe58b7fe640 1 -- 172.21.15.1:0/3341295316 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe58c1030f0 msgr2=0x7fe58c074500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:22.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.696+0000 7fe58b7fe640 1 --2- 172.21.15.1:0/3341295316 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe58c1030f0 0x7fe58c074500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:22.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.696+0000 7fe58b7fe640 1 -- 172.21.15.1:0/3341295316 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe58c10c830 con 0x7fe58c1027a0 2024-09-21T01:03:22.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.700+0000 7fe58b7fe640 1 --2- 172.21.15.1:0/3341295316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe58c1027a0 0x7fe58c073f80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe57c00e9f0 tx=0x7fe57c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:22.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.701+0000 7fe588ff9640 1 -- 172.21.15.1:0/3341295316 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c00ccc0 con 0x7fe58c1027a0 2024-09-21T01:03:22.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.701+0000 7fe591b0b640 1 -- 172.21.15.1:0/3341295316 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe58c113ed0 con 0x7fe58c1027a0 2024-09-21T01:03:22.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.701+0000 7fe591b0b640 1 -- 172.21.15.1:0/3341295316 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe58c114410 con 0x7fe58c1027a0 2024-09-21T01:03:22.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.701+0000 7fe588ff9640 1 -- 172.21.15.1:0/3341295316 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe57c0035f0 con 0x7fe58c1027a0 2024-09-21T01:03:22.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.701+0000 7fe588ff9640 1 -- 172.21.15.1:0/3341295316 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c00ce60 con 0x7fe58c1027a0 2024-09-21T01:03:22.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.707+0000 7fe59807f740 1 Processor -- start 2024-09-21T01:03:22.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.710+0000 7fe59807f740 1 -- start start 2024-09-21T01:03:22.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.711+0000 7fe59807f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f00fdb5070 0x55f01015c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:22.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.711+0000 7fe59807f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f00fd8c1b0 0x55f01015cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:22.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.711+0000 7fe59807f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f00fd94390 0x55f01015d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:22.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.711+0000 7fe59807f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f0100d2ea0 con 0x55f00fdb5070 2024-09-21T01:03:22.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.711+0000 7fe59807f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f0100c22d0 con 0x55f00fd8c1b0 2024-09-21T01:03:22.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.711+0000 7fe59807f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f0100c60e0 con 0x55f00fd94390 2024-09-21T01:03:22.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.711+0000 7fe588ff9640 1 -- 172.21.15.1:0/3341295316 <== mon.2 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7fe57c004020 con 0x7fe58c1027a0 2024-09-21T01:03:22.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.711+0000 7fe58b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f00fd8c1b0 0x55f01015cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:22.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.711+0000 7fe58b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f00fd8c1b0 0x55f01015cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:41208/0 (socket says 172.21.15.1:41208) 2024-09-21T01:03:22.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.711+0000 7fe58b7fe640 1 -- 172.21.15.1:0/2924280736 learned_addr learned my addr 172.21.15.1:0/2924280736 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:22.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.712+0000 7fe58affd640 1 --2- 172.21.15.1:0/2924280736 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f00fd94390 0x55f01015d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:22.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.712+0000 7fe58b7fe640 1 -- 172.21.15.1:0/2924280736 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f00fd94390 msgr2=0x55f01015d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:22.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.712+0000 7fe58b7fe640 1 --2- 172.21.15.1:0/2924280736 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f00fd94390 0x55f01015d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:22.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.712+0000 7fe58b7fe640 1 -- 172.21.15.1:0/2924280736 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f00fdb5070 msgr2=0x55f01015c6a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:03:22.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.712+0000 7fe58b7fe640 1 --2- 172.21.15.1:0/2924280736 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f00fdb5070 0x55f01015c6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:22.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.712+0000 7fe58b7fe640 1 -- 172.21.15.1:0/2924280736 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f00fe20650 con 0x55f00fd8c1b0 2024-09-21T01:03:22.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.712+0000 7fe58b7fe640 1 --2- 172.21.15.1:0/2924280736 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f00fd8c1b0 0x55f01015cbe0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe57c0ef290 tx=0x7fe57c0ef380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6eaa80e1bd3e5f71 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:22.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.713+0000 7fe588ff9640 1 --2- 172.21.15.1:0/3341295316 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe5740b6710 0x7fe5740b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:22.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.714+0000 7fe588ff9640 1 -- 172.21.15.1:0/3341295316 <== mon.2 v2:172.21.15.42:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fe57c0e7300 con 0x7fe58c1027a0 2024-09-21T01:03:22.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.714+0000 7fe571ffb640 1 -- 172.21.15.1:0/2924280736 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c0fa070 con 0x55f00fd8c1b0 2024-09-21T01:03:22.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.714+0000 7fe571ffb640 1 -- 172.21.15.1:0/2924280736 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe57c0e9580 con 0x55f00fd8c1b0 2024-09-21T01:03:22.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.716+0000 7fe59807f740 1 -- 172.21.15.1:0/2924280736 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f00fd8c1b0 msgr2=0x55f01015cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:22.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.716+0000 7fe59807f740 1 --2- 172.21.15.1:0/2924280736 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f00fd8c1b0 0x55f01015cbe0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe57c0ef290 tx=0x7fe57c0ef380 comp rx=0 tx=0).stop 2024-09-21T01:03:22.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.720+0000 7fe58bfff640 1 --2- 172.21.15.1:0/3341295316 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe5740b6710 0x7fe5740b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:22.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.720+0000 7fe59807f740 1 -- 172.21.15.1:0/2924280736 shutdown_connections 2024-09-21T01:03:22.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.720+0000 7fe59807f740 1 --2- 172.21.15.1:0/2924280736 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f00fd94390 0x55f01015d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:22.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.720+0000 7fe59807f740 1 --2- 172.21.15.1:0/2924280736 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f00fd8c1b0 0x55f01015cbe0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:22.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.720+0000 7fe59807f740 1 --2- 172.21.15.1:0/2924280736 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f00fdb5070 0x55f01015c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:22.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.720+0000 7fe59807f740 1 -- 172.21.15.1:0/2924280736 >> 172.21.15.1:0/2924280736 conn(0x55f00fda9460 msgr2=0x55f01015a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:22.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.720+0000 7fe59807f740 1 -- 172.21.15.1:0/2924280736 shutdown_connections 2024-09-21T01:03:22.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.721+0000 7fe59807f740 1 -- 172.21.15.1:0/2924280736 wait complete. 2024-09-21T01:03:22.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.721+0000 7fe59807f740 1 -- start start 2024-09-21T01:03:22.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.722+0000 7fe59807f740 1 Processor -- start 2024-09-21T01:03:22.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.722+0000 7fe59807f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f00fd8c1b0 0x55f010167cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:22.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.722+0000 7fe59807f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f00fd94390 0x55f010168210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:22.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.722+0000 7fe59807f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f00fdb5070 0x55f010168750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:22.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.722+0000 7fe59807f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f00ff23700 con 0x55f00fd8c1b0 2024-09-21T01:03:22.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.722+0000 7fe59807f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f01005d160 con 0x55f00fd94390 2024-09-21T01:03:22.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.722+0000 7fe59807f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f01016aed0 con 0x55f00fdb5070 2024-09-21T01:03:22.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.723+0000 7fe59807f740 10 client.0 _ll_register_callbacks cb 0x55f0100769e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:03:22.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.726+0000 7fe58affd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f00fd94390 0x55f010168210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:22.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.729+0000 7fe58affd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f00fd94390 0x55f010168210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:41224/0 (socket says 172.21.15.1:41224) 2024-09-21T01:03:22.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.729+0000 7fe58affd640 1 -- 172.21.15.1:0/960339529 learned_addr learned my addr 172.21.15.1:0/960339529 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:22.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.729+0000 7fe58affd640 1 -- 172.21.15.1:0/960339529 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f00fdb5070 msgr2=0x55f010168750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:03:22.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.729+0000 7fe58affd640 1 --2- 172.21.15.1:0/960339529 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f00fdb5070 0x55f010168750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:22.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.729+0000 7fe58affd640 1 -- 172.21.15.1:0/960339529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f00fd8c1b0 msgr2=0x55f010167cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:22.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.729+0000 7fe58affd640 1 --2- 172.21.15.1:0/960339529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f00fd8c1b0 0x55f010167cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:22.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.729+0000 7fe58affd640 1 -- 172.21.15.1:0/960339529 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f01008ac90 con 0x55f00fd94390 2024-09-21T01:03:22.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.732+0000 7fe58affd640 1 --2- 172.21.15.1:0/960339529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f00fd94390 0x55f010168210 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe584011890 tx=0x7fe584011d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=154e25bc25e673d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:22.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.732+0000 7fe56affd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:03:22.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.733+0000 7fe56affd640 1 -- 172.21.15.1:0/960339529 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe58400fb40 con 0x55f00fd94390 2024-09-21T01:03:22.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.733+0000 7fe59807f740 1 -- 172.21.15.1:0/960339529 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe57c0e9580 con 0x55f00fd94390 2024-09-21T01:03:22.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.733+0000 7fe56affd640 1 -- 172.21.15.1:0/960339529 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fe58400fce0 con 0x55f00fd94390 2024-09-21T01:03:22.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.733+0000 7fe56affd640 1 -- 172.21.15.1:0/960339529 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe584012450 con 0x55f00fd94390 2024-09-21T01:03:22.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.734+0000 7fe59807f740 10 client.26654 fetch_fsmap learned FSMap version 34 2024-09-21T01:03:22.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.734+0000 7fe59807f740 1 -- 172.21.15.1:0/960339529 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f010198c80 con 0x55f00fd94390 2024-09-21T01:03:22.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.737+0000 7fe56affd640 1 -- 172.21.15.1:0/960339529 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe57c0e9580 con 0x55f00fd94390 2024-09-21T01:03:22.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.737+0000 7fe56affd640 1 -- 172.21.15.1:0/960339529 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 34) ==== 8374+0+0 (secure 0 0 0) 0x7fe58400f040 con 0x55f00fd94390 2024-09-21T01:03:22.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.739+0000 7fe59807f740 10 client.26654 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T01:03:22.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.739+0000 7fe59807f740 10 client.26654 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:03:22.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.739+0000 7fe59807f740 20 client.26654 populate_metadata read hostname 'smithi001' 2024-09-21T01:03:22.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.739+0000 7fe58bfff640 1 --2- 172.21.15.1:0/3341295316 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe5740b6710 0x7fe5740b8c20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe58002a980 tx=0x7fe580009280 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:22.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.739+0000 7fe59807f740 1 --2- 172.21.15.1:0/960339529 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55f00fd739f0 0x55f01019c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:22.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.739+0000 7fe59807f740 4 client.26654 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:03:22.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.739+0000 7fe59807f740 1 -- 172.21.15.1:0/960339529 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0100d4df0 con 0x55f00fd739f0 2024-09-21T01:03:22.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.740+0000 7fe58b7fe640 1 --2- 172.21.15.1:0/960339529 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55f00fd739f0 0x55f01019c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:22.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.747+0000 7fe58b7fe640 1 --2- 172.21.15.1:0/960339529 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55f00fd739f0 0x55f01019c5f0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93bb1f1ff506c254 server_cookie=f24f0bd0fde92819 in_seq=0 out_seq=0 2024-09-21T01:03:22.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.748+0000 7fe56affd640 10 client.26654 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:03:22.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.752+0000 7fe56affd640 1 -- 172.21.15.1:0/960339529 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f0100d4df0 con 0x55f00fd739f0 2024-09-21T01:03:22.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.752+0000 7fe56affd640 10 client.26654 handle_command_reply: tid=0 2024-09-21T01:03:22.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.752+0000 7fe59807f740 1 client.26654 shutdown 2024-09-21T01:03:22.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.753+0000 7fe59807f740 1 -- 172.21.15.1:0/960339529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f00fd94390 msgr2=0x55f010168210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:22.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.753+0000 7fe59807f740 1 --2- 172.21.15.1:0/960339529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f00fd94390 0x55f010168210 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe584011890 tx=0x7fe584011d50 comp rx=0 tx=0).stop 2024-09-21T01:03:22.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.765+0000 7fe59807f740 1 -- 172.21.15.1:0/960339529 shutdown_connections 2024-09-21T01:03:22.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.765+0000 7fe59807f740 1 --2- 172.21.15.1:0/960339529 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55f00fd739f0 0x55f01019c5f0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:22.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.765+0000 7fe59807f740 1 --2- 172.21.15.1:0/960339529 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f00fdb5070 0x55f010168750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:22.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.765+0000 7fe59807f740 1 --2- 172.21.15.1:0/960339529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f00fd94390 0x55f010168210 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:22.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.765+0000 7fe59807f740 1 --2- 172.21.15.1:0/960339529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f00fd8c1b0 0x55f010167cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:22.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.765+0000 7fe59807f740 1 -- 172.21.15.1:0/960339529 >> 172.21.15.1:0/960339529 conn(0x55f00fda9460 msgr2=0x55f01015f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:22.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.765+0000 7fe56affd640 0 client.26654 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:03:22.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.770+0000 7fe59807f740 1 -- 172.21.15.1:0/960339529 shutdown_connections 2024-09-21T01:03:22.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.770+0000 7fe59807f740 1 -- 172.21.15.1:0/960339529 wait complete. 2024-09-21T01:03:22.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.770+0000 7fe59807f740 20 client.26654 trim_cache size 0 max 16384 2024-09-21T01:03:22.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.804+0000 7fe59807f740 1 Processor -- start 2024-09-21T01:03:22.807 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.807+0000 7fe59807f740 1 -- start start 2024-09-21T01:03:22.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.807+0000 7fe59807f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f00fd8c1b0 0x55f01015e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:22.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.808+0000 7fe59807f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f00fd94390 0x55f010169900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:22.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.808+0000 7fe58b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f00fd8c1b0 0x55f01015e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:22.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.808+0000 7fe58b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f00fd8c1b0 0x55f01015e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:41236/0 (socket says 172.21.15.1:41236) 2024-09-21T01:03:22.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.808+0000 7fe59807f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f00fdb5070 0x55f010159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:22.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.808+0000 7fe58b7fe640 1 -- 172.21.15.1:0/3976120111 learned_addr learned my addr 172.21.15.1:0/3976120111 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:22.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.808+0000 7fe59807f740 1 -- 172.21.15.1:0/3976120111 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe57800e680 con 0x55f00fd94390 2024-09-21T01:03:22.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.809+0000 7fe59807f740 1 -- 172.21.15.1:0/3976120111 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe578010250 con 0x55f00fd8c1b0 2024-09-21T01:03:22.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.809+0000 7fe59807f740 1 -- 172.21.15.1:0/3976120111 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe57800ed50 con 0x55f00fdb5070 2024-09-21T01:03:22.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.812+0000 7fe58affd640 1 --2- 172.21.15.1:0/3976120111 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f00fd94390 0x55f010169900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:22.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.812+0000 7fe58bfff640 1 --2- 172.21.15.1:0/3976120111 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f00fdb5070 0x55f010159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:22.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.812+0000 7fe58b7fe640 1 -- 172.21.15.1:0/3976120111 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f00fdb5070 msgr2=0x55f010159bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:22.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.812+0000 7fe58b7fe640 1 --2- 172.21.15.1:0/3976120111 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f00fdb5070 0x55f010159bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:22.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.812+0000 7fe58b7fe640 1 -- 172.21.15.1:0/3976120111 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f00fd94390 msgr2=0x55f010169900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:22.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.812+0000 7fe58b7fe640 1 --2- 172.21.15.1:0/3976120111 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f00fd94390 0x55f010169900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:22.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.812+0000 7fe58b7fe640 1 -- 172.21.15.1:0/3976120111 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f010168d70 con 0x55f00fd8c1b0 2024-09-21T01:03:22.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.812+0000 7fe58affd640 1 --2- 172.21.15.1:0/3976120111 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f00fd94390 0x55f010169900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:03:22.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.813+0000 7fe58b7fe640 1 --2- 172.21.15.1:0/3976120111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f00fd8c1b0 0x55f01015e090 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe57c0ad110 tx=0x7fe57c0e7ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3ccb5ecfa484740 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:22.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.816+0000 7fe5717fa640 1 -- 172.21.15.1:0/3976120111 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c0a92b0 con 0x55f00fd8c1b0 2024-09-21T01:03:22.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.816+0000 7fe5717fa640 1 -- 172.21.15.1:0/3976120111 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe57c0ea960 con 0x55f00fd8c1b0 2024-09-21T01:03:22.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.816+0000 7fe5717fa640 1 -- 172.21.15.1:0/3976120111 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c0acb80 con 0x55f00fd8c1b0 2024-09-21T01:03:22.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.817+0000 7fe59807f740 1 -- 172.21.15.1:0/3976120111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f00fd8c1b0 msgr2=0x55f01015e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:22.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.817+0000 7fe59807f740 1 --2- 172.21.15.1:0/3976120111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f00fd8c1b0 0x55f01015e090 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe57c0ad110 tx=0x7fe57c0e7ce0 comp rx=0 tx=0).stop 2024-09-21T01:03:22.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.820+0000 7fe59807f740 1 -- 172.21.15.1:0/3976120111 shutdown_connections 2024-09-21T01:03:22.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.820+0000 7fe59807f740 1 --2- 172.21.15.1:0/3976120111 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f00fdb5070 0x55f010159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:22.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.820+0000 7fe59807f740 1 --2- 172.21.15.1:0/3976120111 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f00fd94390 0x55f010169900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:22.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.820+0000 7fe59807f740 1 --2- 172.21.15.1:0/3976120111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f00fd8c1b0 0x55f01015e090 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:22.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.820+0000 7fe59807f740 1 -- 172.21.15.1:0/3976120111 >> 172.21.15.1:0/3976120111 conn(0x55f00fda9460 msgr2=0x55f0101691f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:22.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.823+0000 7fe59807f740 1 -- 172.21.15.1:0/3976120111 shutdown_connections 2024-09-21T01:03:22.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.824+0000 7fe59807f740 1 -- 172.21.15.1:0/3976120111 wait complete. 2024-09-21T01:03:22.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.825+0000 7fe59807f740 1 -- start start 2024-09-21T01:03:22.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.825+0000 7fe59807f740 1 Processor -- start 2024-09-21T01:03:22.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.826+0000 7fe59807f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f00fd8c1b0 0x55f010170900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:22.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.826+0000 7fe59807f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f00fd94390 0x55f01016be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:22.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.826+0000 7fe59807f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f00fdb5070 0x55f01016c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:22.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.826+0000 7fe59807f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe57800fb80 con 0x55f00fd94390 2024-09-21T01:03:22.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.826+0000 7fe59807f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe57800f4b0 con 0x55f00fdb5070 2024-09-21T01:03:22.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.826+0000 7fe59807f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe57800c660 con 0x55f00fd8c1b0 2024-09-21T01:03:22.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.827+0000 7fe59807f740 10 client.0 _ll_register_callbacks cb 0x7fe5840096c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:03:22.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.827+0000 7fe58affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f00fd94390 0x55f01016be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:22.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.827+0000 7fe58affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f00fd94390 0x55f01016be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32780/0 (socket says 172.21.15.1:32780) 2024-09-21T01:03:22.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.827+0000 7fe58affd640 1 -- 172.21.15.1:0/577821338 learned_addr learned my addr 172.21.15.1:0/577821338 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:22.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.827+0000 7fe58b7fe640 1 --2- 172.21.15.1:0/577821338 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f00fd8c1b0 0x55f010170900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:22.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.828+0000 7fe58affd640 1 -- 172.21.15.1:0/577821338 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f00fd8c1b0 msgr2=0x55f010170900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:22.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.828+0000 7fe58affd640 1 --2- 172.21.15.1:0/577821338 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f00fd8c1b0 0x55f010170900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:22.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.828+0000 7fe58affd640 1 -- 172.21.15.1:0/577821338 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f00fdb5070 msgr2=0x55f01016c340 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:03:22.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.828+0000 7fe58affd640 1 --2- 172.21.15.1:0/577821338 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f00fdb5070 0x55f01016c340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:22.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.829+0000 7fe58affd640 1 -- 172.21.15.1:0/577821338 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f01016c9e0 con 0x55f00fd94390 2024-09-21T01:03:22.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.830+0000 7fe58affd640 1 --2- 172.21.15.1:0/577821338 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f00fd94390 0x55f01016be00 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fe584006010 tx=0x7fe58401b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36453c981e0606e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:22.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.830+0000 7fe56affd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:03:22.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.830+0000 7fe56affd640 1 -- 172.21.15.1:0/577821338 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe58402b070 con 0x55f00fd94390 2024-09-21T01:03:22.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.831+0000 7fe59807f740 1 -- 172.21.15.1:0/577821338 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f0100d08a0 con 0x55f00fd94390 2024-09-21T01:03:22.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.831+0000 7fe56affd640 1 -- 172.21.15.1:0/577821338 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fe58401b9c0 con 0x55f00fd94390 2024-09-21T01:03:22.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.831+0000 7fe56affd640 1 -- 172.21.15.1:0/577821338 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe584038050 con 0x55f00fd94390 2024-09-21T01:03:22.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.833+0000 7fe59807f740 10 client.17001 fetch_fsmap learned FSMap version 34 2024-09-21T01:03:22.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.833+0000 7fe59807f740 1 -- 172.21.15.1:0/577821338 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f010206db0 con 0x55f00fd94390 2024-09-21T01:03:22.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.834+0000 7fe56affd640 1 -- 172.21.15.1:0/577821338 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55f0100d08a0 con 0x55f00fd94390 2024-09-21T01:03:22.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.834+0000 7fe56affd640 1 -- 172.21.15.1:0/577821338 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 34) ==== 8374+0+0 (secure 0 0 0) 0x7fe584012700 con 0x55f00fd94390 2024-09-21T01:03:22.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.835+0000 7fe59807f740 10 client.17001 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T01:03:22.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.835+0000 7fe59807f740 10 client.17001 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:03:22.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.835+0000 7fe59807f740 20 client.17001 populate_metadata read hostname 'smithi001' 2024-09-21T01:03:22.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.835+0000 7fe59807f740 1 --2- 172.21.15.1:0/577821338 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55f00fd48da0 0x55f010209570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:22.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.835+0000 7fe59807f740 4 client.17001 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:03:22.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.835+0000 7fe59807f740 1 -- 172.21.15.1:0/577821338 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f0100cdcd0 con 0x55f00fd48da0 2024-09-21T01:03:22.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.835+0000 7fe58b7fe640 1 --2- 172.21.15.1:0/577821338 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55f00fd48da0 0x55f010209570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:22.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.840+0000 7fe58b7fe640 1 --2- 172.21.15.1:0/577821338 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55f00fd48da0 0x55f010209570 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4ea5871b703b450 server_cookie=de61a3e5bf1b8715 in_seq=0 out_seq=0 2024-09-21T01:03:22.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.840+0000 7fe56affd640 10 client.17001 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:03:22.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.841+0000 7fe56affd640 1 -- 172.21.15.1:0/577821338 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f0100cdcd0 con 0x55f00fd48da0 2024-09-21T01:03:22.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.841+0000 7fe56affd640 10 client.17001 handle_command_reply: tid=0 2024-09-21T01:03:22.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.841+0000 7fe59807f740 1 client.17001 shutdown 2024-09-21T01:03:22.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.848+0000 7fe59807f740 1 -- 172.21.15.1:0/577821338 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f00fd94390 msgr2=0x55f01016be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:22.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.848+0000 7fe59807f740 1 --2- 172.21.15.1:0/577821338 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f00fd94390 0x55f01016be00 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fe584006010 tx=0x7fe58401b660 comp rx=0 tx=0).stop 2024-09-21T01:03:22.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.850+0000 7fe59807f740 1 -- 172.21.15.1:0/577821338 shutdown_connections 2024-09-21T01:03:22.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.850+0000 7fe59807f740 1 --2- 172.21.15.1:0/577821338 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55f00fd48da0 0x55f010209570 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:22.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.850+0000 7fe59807f740 1 --2- 172.21.15.1:0/577821338 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f00fdb5070 0x55f01016c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:22.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.850+0000 7fe59807f740 1 --2- 172.21.15.1:0/577821338 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f00fd94390 0x55f01016be00 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:22.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.850+0000 7fe59807f740 1 --2- 172.21.15.1:0/577821338 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f00fd8c1b0 0x55f010170900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:22.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.850+0000 7fe59807f740 1 -- 172.21.15.1:0/577821338 >> 172.21.15.1:0/577821338 conn(0x55f00fda9460 msgr2=0x55f010169150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:22.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.850+0000 7fe56affd640 0 client.17001 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:03:22.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.850+0000 7fe59807f740 1 -- 172.21.15.1:0/577821338 shutdown_connections 2024-09-21T01:03:22.852 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T01:03:22.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.850+0000 7fe59807f740 1 -- 172.21.15.1:0/577821338 wait complete. 2024-09-21T01:03:22.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.851+0000 7fe59807f740 20 client.17001 trim_cache size 0 max 16384 2024-09-21T01:03:22.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.851+0000 7fe591b0b640 1 -- 172.21.15.1:0/3341295316 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe5740b6710 msgr2=0x7fe5740b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:22.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.851+0000 7fe591b0b640 1 --2- 172.21.15.1:0/3341295316 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe5740b6710 0x7fe5740b8c20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe58002a980 tx=0x7fe580009280 comp rx=0 tx=0).stop 2024-09-21T01:03:22.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.851+0000 7fe591b0b640 1 -- 172.21.15.1:0/3341295316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe58c1027a0 msgr2=0x7fe58c073f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:22.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.851+0000 7fe591b0b640 1 --2- 172.21.15.1:0/3341295316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe58c1027a0 0x7fe58c073f80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe57c00e9f0 tx=0x7fe57c00eeb0 comp rx=0 tx=0).stop 2024-09-21T01:03:22.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.852+0000 7fe591b0b640 1 -- 172.21.15.1:0/3341295316 shutdown_connections 2024-09-21T01:03:22.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.852+0000 7fe591b0b640 1 --2- 172.21.15.1:0/3341295316 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe58c10bc20 0x7fe58c10c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:22.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.852+0000 7fe591b0b640 1 --2- 172.21.15.1:0/3341295316 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fe5740b6710 0x7fe5740b8c20 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:22.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.852+0000 7fe591b0b640 1 --2- 172.21.15.1:0/3341295316 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe58c1030f0 0x7fe58c074500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:22.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.852+0000 7fe591b0b640 1 --2- 172.21.15.1:0/3341295316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe58c1027a0 0x7fe58c073f80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:22.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.852+0000 7fe591b0b640 1 -- 172.21.15.1:0/3341295316 >> 172.21.15.1:0/3341295316 conn(0x7fe58c079730 msgr2=0x7fe58c1055f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:22.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.852+0000 7fe591b0b640 1 -- 172.21.15.1:0/3341295316 shutdown_connections 2024-09-21T01:03:22.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:22.852+0000 7fe591b0b640 1 -- 172.21.15.1:0/3341295316 wait complete. 2024-09-21T01:03:23.565 INFO:tasks.workunit.client.0.smithi001.stdout: 150 1844992 474 1244222 320 1109245 1253 2024-09-21T01:03:23.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.588+0000 7f3008007640 1 -- 172.21.15.1:0/3466262294 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f300010f830 msgr2=0x7f300010fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:23.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.588+0000 7f3008007640 1 --2- 172.21.15.1:0/3466262294 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f300010f830 0x7f300010fd30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8009ca0 tx=0x7f2ff802a8d0 comp rx=0 tx=0).stop 2024-09-21T01:03:23.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.588+0000 7f3008007640 1 -- 172.21.15.1:0/3466262294 shutdown_connections 2024-09-21T01:03:23.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.588+0000 7f3008007640 1 --2- 172.21.15.1:0/3466262294 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f300010f830 0x7f300010fd30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.588+0000 7f3008007640 1 --2- 172.21.15.1:0/3466262294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f300010cd20 0x7f300010f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.589+0000 7f3008007640 1 --2- 172.21.15.1:0/3466262294 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f300010a3c0 0x7f300010c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.589+0000 7f3008007640 1 -- 172.21.15.1:0/3466262294 >> 172.21.15.1:0/3466262294 conn(0x7f30000706d0 msgr2=0x7f3000072b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:23.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.592+0000 7f3008007640 1 -- 172.21.15.1:0/3466262294 shutdown_connections 2024-09-21T01:03:23.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.596+0000 7f3008007640 1 -- 172.21.15.1:0/3466262294 wait complete. 2024-09-21T01:03:23.598 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.597+0000 7f3008007640 1 Processor -- start 2024-09-21T01:03:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.599+0000 7f3008007640 1 -- start start 2024-09-21T01:03:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.600+0000 7f3008007640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f300010a3c0 0x7f30001a8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.600+0000 7f3008007640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f300010cd20 0x7f30001a9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.600+0000 7f3008007640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f300010f830 0x7f30001a9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.600+0000 7f3008007640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f300011dfc0 con 0x7f300010a3c0 2024-09-21T01:03:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.600+0000 7f3008007640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f300011de40 con 0x7f300010f830 2024-09-21T01:03:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.600+0000 7f3008007640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f300011e140 con 0x7f300010cd20 2024-09-21T01:03:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.601+0000 7f30055a2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f300010cd20 0x7f30001a9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.601+0000 7f30055a2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f300010cd20 0x7f30001a9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:48414/0 (socket says 172.21.15.1:48414) 2024-09-21T01:03:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.601+0000 7f30055a2640 1 -- 172.21.15.1:0/4159102578 learned_addr learned my addr 172.21.15.1:0/4159102578 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.601+0000 7f30065a4640 1 --2- 172.21.15.1:0/4159102578 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f300010f830 0x7f30001a9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.602+0000 7f30065a4640 1 -- 172.21.15.1:0/4159102578 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f300010cd20 msgr2=0x7f30001a9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.602+0000 7f30065a4640 1 --2- 172.21.15.1:0/4159102578 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f300010cd20 0x7f30001a9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.602+0000 7f30065a4640 1 -- 172.21.15.1:0/4159102578 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f300010a3c0 msgr2=0x7f30001a8b90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T01:03:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.602+0000 7f30065a4640 1 --2- 172.21.15.1:0/4159102578 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f300010a3c0 0x7f30001a8b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.602+0000 7f30065a4640 1 -- 172.21.15.1:0/4159102578 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30001aa5d0 con 0x7f300010f830 2024-09-21T01:03:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.602+0000 7f30065a4640 1 --2- 172.21.15.1:0/4159102578 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f300010f830 0x7f30001a9db0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2ff802aec0 tx=0x7f2ff80317d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.608+0000 7f2ff6ffd640 1 -- 172.21.15.1:0/4159102578 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff8003b70 con 0x7f300010f830 2024-09-21T01:03:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.608+0000 7f2ff6ffd640 1 -- 172.21.15.1:0/4159102578 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ff8003d10 con 0x7f300010f830 2024-09-21T01:03:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.608+0000 7f2ff6ffd640 1 -- 172.21.15.1:0/4159102578 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff802fa40 con 0x7f300010f830 2024-09-21T01:03:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.608+0000 7f3008007640 1 -- 172.21.15.1:0/4159102578 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30001aa860 con 0x7f300010f830 2024-09-21T01:03:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.608+0000 7f3008007640 1 -- 172.21.15.1:0/4159102578 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30001b0fb0 con 0x7f300010f830 2024-09-21T01:03:23.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.614+0000 7f300f04d740 1 Processor -- start 2024-09-21T01:03:23.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.617+0000 7f2ff6ffd640 1 -- 172.21.15.1:0/4159102578 <== mon.2 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f2ff8004580 con 0x7f300010f830 2024-09-21T01:03:23.625 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.623+0000 7f300f04d740 1 -- start start 2024-09-21T01:03:23.625 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.624+0000 7f300f04d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632c871b1b0 0x5632c8ac3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:23.625 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.624+0000 7f300f04d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632c86f22f0 0x5632c8ac36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:23.625 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.624+0000 7f300f04d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5632c86fa4d0 0x5632c8ac4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:23.625 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.624+0000 7f300f04d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5632c8a356f0 con 0x5632c871b1b0 2024-09-21T01:03:23.626 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.624+0000 7f300f04d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5632c8a24b20 con 0x5632c86fa4d0 2024-09-21T01:03:23.626 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.624+0000 7f300f04d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5632c8a28930 con 0x5632c86f22f0 2024-09-21T01:03:23.627 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.627+0000 7f3005da3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632c86f22f0 0x5632c8ac36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:23.627 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.627+0000 7f3005da3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632c86f22f0 0x5632c8ac36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:48424/0 (socket says 172.21.15.1:48424) 2024-09-21T01:03:23.627 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.627+0000 7f3005da3640 1 -- 172.21.15.1:0/2825996708 learned_addr learned my addr 172.21.15.1:0/2825996708 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:23.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.628+0000 7f30055a2640 1 --2- 172.21.15.1:0/2825996708 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632c871b1b0 0x5632c8ac3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:23.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.628+0000 7f3005da3640 1 -- 172.21.15.1:0/2825996708 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5632c86fa4d0 msgr2=0x5632c8ac4200 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:03:23.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.628+0000 7f3005da3640 1 --2- 172.21.15.1:0/2825996708 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5632c86fa4d0 0x5632c8ac4200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:23.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.628+0000 7f3005da3640 1 -- 172.21.15.1:0/2825996708 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632c871b1b0 msgr2=0x5632c8ac3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:23.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.628+0000 7f3005da3640 1 --2- 172.21.15.1:0/2825996708 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632c871b1b0 0x5632c8ac3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:23.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.628+0000 7f3005da3640 1 -- 172.21.15.1:0/2825996708 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632c89ea530 con 0x5632c86f22f0 2024-09-21T01:03:23.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.628+0000 7f30055a2640 1 --2- 172.21.15.1:0/2825996708 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632c871b1b0 0x5632c8ac3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:03:23.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.630+0000 7f2ff6ffd640 1 --2- 172.21.15.1:0/4159102578 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f2fec0b66a0 0x7f2fec0b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:23.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.631+0000 7f2ff6ffd640 1 -- 172.21.15.1:0/4159102578 <== mon.2 v2:172.21.15.42:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f2ff81086c0 con 0x7f300010f830 2024-09-21T01:03:23.633 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.633+0000 7f30055a2640 1 --2- 172.21.15.1:0/4159102578 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f2fec0b66a0 0x7f2fec0b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.634+0000 7f30055a2640 1 --2- 172.21.15.1:0/4159102578 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f2fec0b66a0 0x7f2fec0b8bb0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc0097f0 tx=0x7f2ffc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:23.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.635+0000 7f3005da3640 1 --2- 172.21.15.1:0/2825996708 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632c86f22f0 0x5632c8ac36b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0009770 tx=0x7f2ff0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c3aa3294a71d584 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:23.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.641+0000 7f2febfff640 1 -- 172.21.15.1:0/2825996708 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0015020 con 0x5632c86f22f0 2024-09-21T01:03:23.642 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.641+0000 7f2febfff640 1 -- 172.21.15.1:0/2825996708 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ff0011420 con 0x5632c86f22f0 2024-09-21T01:03:23.642 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.641+0000 7f2febfff640 1 -- 172.21.15.1:0/2825996708 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff00105c0 con 0x5632c86f22f0 2024-09-21T01:03:23.650 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.650+0000 7f300f04d740 1 -- 172.21.15.1:0/2825996708 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632c86f22f0 msgr2=0x5632c8ac36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:23.650 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.650+0000 7f300f04d740 1 --2- 172.21.15.1:0/2825996708 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632c86f22f0 0x5632c8ac36b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0009770 tx=0x7f2ff0009c30 comp rx=0 tx=0).stop 2024-09-21T01:03:23.655 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.655+0000 7f300f04d740 1 -- 172.21.15.1:0/2825996708 shutdown_connections 2024-09-21T01:03:23.655 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.655+0000 7f300f04d740 1 --2- 172.21.15.1:0/2825996708 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5632c86fa4d0 0x5632c8ac4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:23.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.655+0000 7f300f04d740 1 --2- 172.21.15.1:0/2825996708 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632c86f22f0 0x5632c8ac36b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:23.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.655+0000 7f300f04d740 1 --2- 172.21.15.1:0/2825996708 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632c871b1b0 0x5632c8ac3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:23.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.655+0000 7f300f04d740 1 -- 172.21.15.1:0/2825996708 >> 172.21.15.1:0/2825996708 conn(0x5632c870f300 msgr2=0x5632c8abead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:23.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.658+0000 7f300f04d740 1 -- 172.21.15.1:0/2825996708 shutdown_connections 2024-09-21T01:03:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.660+0000 7f300f04d740 1 -- 172.21.15.1:0/2825996708 wait complete. 2024-09-21T01:03:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.660+0000 7f300f04d740 1 -- start start 2024-09-21T01:03:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.660+0000 7f300f04d740 1 Processor -- start 2024-09-21T01:03:23.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.662+0000 7f300f04d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5632c86f22f0 0x5632c8add7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:23.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.663+0000 7f300f04d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632c86fa4d0 0x5632c8adde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:23.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.663+0000 7f300f04d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632c871b1b0 0x5632c8adea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:23.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.663+0000 7f300f04d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5632c895cab0 con 0x5632c86fa4d0 2024-09-21T01:03:23.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.663+0000 7f300f04d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5632c89ca730 con 0x5632c86f22f0 2024-09-21T01:03:23.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.663+0000 7f300f04d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5632c8ac4d20 con 0x5632c871b1b0 2024-09-21T01:03:23.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.663+0000 7f300f04d740 10 client.0 _ll_register_callbacks cb 0x5632c8a1e6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:03:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.664+0000 7f30055a2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632c86fa4d0 0x5632c8adde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.664+0000 7f30055a2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632c86fa4d0 0x5632c8adde90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32796/0 (socket says 172.21.15.1:32796) 2024-09-21T01:03:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.664+0000 7f30055a2640 1 -- 172.21.15.1:0/3203978443 learned_addr learned my addr 172.21.15.1:0/3203978443 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.665+0000 7f3005da3640 1 --2- 172.21.15.1:0/3203978443 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5632c86f22f0 0x5632c8add7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.665+0000 7f30055a2640 1 -- 172.21.15.1:0/3203978443 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632c871b1b0 msgr2=0x5632c8adea00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:03:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.665+0000 7f30055a2640 1 --2- 172.21.15.1:0/3203978443 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632c871b1b0 0x5632c8adea00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.665+0000 7f30055a2640 1 -- 172.21.15.1:0/3203978443 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5632c86f22f0 msgr2=0x5632c8add7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.665+0000 7f30055a2640 1 --2- 172.21.15.1:0/3203978443 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5632c86f22f0 0x5632c8add7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.665+0000 7f30055a2640 1 -- 172.21.15.1:0/3203978443 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632c8786790 con 0x5632c86fa4d0 2024-09-21T01:03:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.665+0000 7f30055a2640 1 --2- 172.21.15.1:0/3203978443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632c86fa4d0 0x5632c8adde90 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc011c60 tx=0x7f2ffc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e6b7d93ac5d8e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.666+0000 7f2fe97fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:03:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.666+0000 7f2fe97fa640 1 -- 172.21.15.1:0/3203978443 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc011c90 con 0x5632c86fa4d0 2024-09-21T01:03:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.666+0000 7f300f04d740 1 -- 172.21.15.1:0/3203978443 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ff0011420 con 0x5632c86fa4d0 2024-09-21T01:03:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.666+0000 7f2fe97fa640 1 -- 172.21.15.1:0/3203978443 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f2ffc011e30 con 0x5632c86fa4d0 2024-09-21T01:03:23.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.667+0000 7f2fe97fa640 1 -- 172.21.15.1:0/3203978443 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2ffc004030 con 0x5632c86fa4d0 2024-09-21T01:03:23.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.668+0000 7f300f04d740 10 client.17004 fetch_fsmap learned FSMap version 34 2024-09-21T01:03:23.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.669+0000 7f300f04d740 1 -- 172.21.15.1:0/3203978443 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5632c87ff620 con 0x5632c86fa4d0 2024-09-21T01:03:23.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.671+0000 7f2fe97fa640 1 -- 172.21.15.1:0/3203978443 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ff0011420 con 0x5632c86fa4d0 2024-09-21T01:03:23.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.671+0000 7f2fe97fa640 1 -- 172.21.15.1:0/3203978443 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 34) ==== 8374+0+0 (secure 0 0 0) 0x7f2ffc01a040 con 0x5632c86fa4d0 2024-09-21T01:03:23.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.672+0000 7f300f04d740 10 client.17004 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T01:03:23.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.672+0000 7f300f04d740 10 client.17004 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:03:23.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.672+0000 7f300f04d740 20 client.17004 populate_metadata read hostname 'smithi001' 2024-09-21T01:03:23.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.672+0000 7f300f04d740 1 --2- 172.21.15.1:0/3203978443 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5632c86d9d80 0x5632c8aeaf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:23.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.672+0000 7f300f04d740 4 client.17004 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:03:23.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.672+0000 7f300f04d740 1 -- 172.21.15.1:0/3203978443 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5632c8a37640 con 0x5632c86d9d80 2024-09-21T01:03:23.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.673+0000 7f3005da3640 1 --2- 172.21.15.1:0/3203978443 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5632c86d9d80 0x5632c8aeaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:23.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.676+0000 7f3005da3640 1 --2- 172.21.15.1:0/3203978443 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5632c86d9d80 0x5632c8aeaf80 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5e1a2b5a97f446e server_cookie=feb2d087206aff0 in_seq=0 out_seq=0 2024-09-21T01:03:23.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.677+0000 7f2fe97fa640 10 client.17004 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:03:23.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.677+0000 7f2fe97fa640 1 -- 172.21.15.1:0/3203978443 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5632c8a37640 con 0x5632c86d9d80 2024-09-21T01:03:23.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.678+0000 7f2fe97fa640 10 client.17004 handle_command_reply: tid=0 2024-09-21T01:03:23.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.678+0000 7f300f04d740 1 client.17004 shutdown 2024-09-21T01:03:23.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.679+0000 7f300f04d740 1 -- 172.21.15.1:0/3203978443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632c86fa4d0 msgr2=0x5632c8adde90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:23.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.679+0000 7f300f04d740 1 --2- 172.21.15.1:0/3203978443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632c86fa4d0 0x5632c8adde90 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc011c60 tx=0x7f2ffc0046c0 comp rx=0 tx=0).stop 2024-09-21T01:03:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.680+0000 7f300f04d740 1 -- 172.21.15.1:0/3203978443 shutdown_connections 2024-09-21T01:03:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.680+0000 7f300f04d740 1 --2- 172.21.15.1:0/3203978443 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5632c86d9d80 0x5632c8aeaf80 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.680+0000 7f300f04d740 1 --2- 172.21.15.1:0/3203978443 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632c871b1b0 0x5632c8adea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.680+0000 7f300f04d740 1 --2- 172.21.15.1:0/3203978443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632c86fa4d0 0x5632c8adde90 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.680+0000 7f300f04d740 1 --2- 172.21.15.1:0/3203978443 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5632c86f22f0 0x5632c8add7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.680+0000 7f300f04d740 1 -- 172.21.15.1:0/3203978443 >> 172.21.15.1:0/3203978443 conn(0x5632c870f300 msgr2=0x5632c8abd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.680+0000 7f2fe97fa640 0 client.17004 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:03:23.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.682+0000 7f300f04d740 1 -- 172.21.15.1:0/3203978443 shutdown_connections 2024-09-21T01:03:23.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.683+0000 7f300f04d740 1 -- 172.21.15.1:0/3203978443 wait complete. 2024-09-21T01:03:23.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.687+0000 7f300f04d740 20 client.17004 trim_cache size 0 max 16384 2024-09-21T01:03:23.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:23 smithi001 ceph-mon[31211]: pgmap v543: 97 pgs: 97 active+clean; 685 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 242 op/s 2024-09-21T01:03:23.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.725+0000 7f300f04d740 1 Processor -- start 2024-09-21T01:03:23.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.726+0000 7f300f04d740 1 -- start start 2024-09-21T01:03:23.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.726+0000 7f300f04d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5632c86f22f0 0x5632c8ac3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:23.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.726+0000 7f300f04d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632c86fa4d0 0x5632c8abf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:23.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.726+0000 7f300f04d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632c871b1b0 0x5632c8abf960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:23.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.726+0000 7f300f04d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f30001b15f0 con 0x5632c871b1b0 2024-09-21T01:03:23.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.726+0000 7f300f04d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f30001b31c0 con 0x5632c86f22f0 2024-09-21T01:03:23.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.726+0000 7f300f04d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f30001b1cc0 con 0x5632c86fa4d0 2024-09-21T01:03:23.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.727+0000 7f3005da3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5632c86f22f0 0x5632c8ac3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:23.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.727+0000 7f3005da3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5632c86f22f0 0x5632c8ac3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:41298/0 (socket says 172.21.15.1:41298) 2024-09-21T01:03:23.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.727+0000 7f3005da3640 1 -- 172.21.15.1:0/1469122186 learned_addr learned my addr 172.21.15.1:0/1469122186 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:23.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.727+0000 7f30055a2640 1 --2- 172.21.15.1:0/1469122186 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632c86fa4d0 0x5632c8abf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:23.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:23 smithi193 ceph-mon[34660]: pgmap v543: 97 pgs: 97 active+clean; 685 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 242 op/s 2024-09-21T01:03:23.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.729+0000 7f30065a4640 1 --2- 172.21.15.1:0/1469122186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632c871b1b0 0x5632c8abf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:23.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.730+0000 7f3005da3640 1 -- 172.21.15.1:0/1469122186 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632c86fa4d0 msgr2=0x5632c8abf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:23.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.730+0000 7f3005da3640 1 --2- 172.21.15.1:0/1469122186 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632c86fa4d0 0x5632c8abf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:23.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.730+0000 7f3005da3640 1 -- 172.21.15.1:0/1469122186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632c871b1b0 msgr2=0x5632c8abf960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:23.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.730+0000 7f3005da3640 1 --2- 172.21.15.1:0/1469122186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632c871b1b0 0x5632c8abf960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:23.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.730+0000 7f3005da3640 1 -- 172.21.15.1:0/1469122186 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632c8abeaf0 con 0x5632c86f22f0 2024-09-21T01:03:23.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.734+0000 7f3005da3640 1 --2- 172.21.15.1:0/1469122186 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5632c86f22f0 0x5632c8ac3e80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2ff000b4b0 tx=0x7f2ff0009280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e8ce7156efd3ae4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:23.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.736+0000 7f2feb7fe640 1 -- 172.21.15.1:0/1469122186 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0015050 con 0x5632c86f22f0 2024-09-21T01:03:23.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.736+0000 7f2feb7fe640 1 -- 172.21.15.1:0/1469122186 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ff0009e80 con 0x5632c86f22f0 2024-09-21T01:03:23.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.736+0000 7f2feb7fe640 1 -- 172.21.15.1:0/1469122186 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0015050 con 0x5632c86f22f0 2024-09-21T01:03:23.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.737+0000 7f300f04d740 1 -- 172.21.15.1:0/1469122186 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5632c86f22f0 msgr2=0x5632c8ac3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:23.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.737+0000 7f300f04d740 1 --2- 172.21.15.1:0/1469122186 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5632c86f22f0 0x5632c8ac3e80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2ff000b4b0 tx=0x7f2ff0009280 comp rx=0 tx=0).stop 2024-09-21T01:03:23.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.738+0000 7f300f04d740 1 -- 172.21.15.1:0/1469122186 shutdown_connections 2024-09-21T01:03:23.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.739+0000 7f300f04d740 1 --2- 172.21.15.1:0/1469122186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632c871b1b0 0x5632c8abf960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:23.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.739+0000 7f300f04d740 1 --2- 172.21.15.1:0/1469122186 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632c86fa4d0 0x5632c8abf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:23.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.739+0000 7f300f04d740 1 --2- 172.21.15.1:0/1469122186 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5632c86f22f0 0x5632c8ac3e80 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:23.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.739+0000 7f300f04d740 1 -- 172.21.15.1:0/1469122186 >> 172.21.15.1:0/1469122186 conn(0x5632c870f300 msgr2=0x5632c8ab9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:23.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:23 smithi042 ceph-mon[34481]: pgmap v543: 97 pgs: 97 active+clean; 685 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 242 op/s 2024-09-21T01:03:23.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.744+0000 7f300f04d740 1 -- 172.21.15.1:0/1469122186 shutdown_connections 2024-09-21T01:03:23.746 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.745+0000 7f300f04d740 1 -- 172.21.15.1:0/1469122186 wait complete. 2024-09-21T01:03:23.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.746+0000 7f300f04d740 1 -- start start 2024-09-21T01:03:23.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.746+0000 7f300f04d740 1 Processor -- start 2024-09-21T01:03:23.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.748+0000 7f300f04d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5632c86f22f0 0x5632c8ae51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:23.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.748+0000 7f300f04d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632c86fa4d0 0x5632c8ae3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.748+0000 7f300f04d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632c871b1b0 0x5632c8ae43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.748+0000 7f300f04d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f30001b2af0 con 0x5632c86fa4d0 2024-09-21T01:03:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.748+0000 7f300f04d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f30001b2420 con 0x5632c86f22f0 2024-09-21T01:03:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.748+0000 7f300f04d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f30001186f0 con 0x5632c871b1b0 2024-09-21T01:03:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.748+0000 7f300f04d740 10 client.0 _ll_register_callbacks cb 0x7f2ffc013f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:03:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.750+0000 7f30065a4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632c871b1b0 0x5632c8ae43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.750+0000 7f30065a4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632c871b1b0 0x5632c8ae43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:48440/0 (socket says 172.21.15.1:48440) 2024-09-21T01:03:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.750+0000 7f30065a4640 1 -- 172.21.15.1:0/301395717 learned_addr learned my addr 172.21.15.1:0/301395717 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.751+0000 7f30055a2640 1 --2- 172.21.15.1:0/301395717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632c86fa4d0 0x5632c8ae3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.751+0000 7f30065a4640 1 -- 172.21.15.1:0/301395717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5632c86f22f0 msgr2=0x5632c8ae51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.751+0000 7f30065a4640 1 --2- 172.21.15.1:0/301395717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5632c86f22f0 0x5632c8ae51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.751+0000 7f30065a4640 1 -- 172.21.15.1:0/301395717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632c86fa4d0 msgr2=0x5632c8ae3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.751+0000 7f30065a4640 1 --2- 172.21.15.1:0/301395717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632c86fa4d0 0x5632c8ae3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.751+0000 7f30065a4640 1 -- 172.21.15.1:0/301395717 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632c8ae4900 con 0x5632c871b1b0 2024-09-21T01:03:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.751+0000 7f30065a4640 1 --2- 172.21.15.1:0/301395717 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632c871b1b0 0x5632c8ae43c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80cbaa0 tx=0x7f2ff80cdfa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eabf3889b538772c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.751+0000 7f2fe97fa640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T01:03:23.753 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.753+0000 7f2fe97fa640 1 -- 172.21.15.1:0/301395717 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff802fde0 con 0x5632c871b1b0 2024-09-21T01:03:23.754 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.753+0000 7f2fe97fa640 1 -- 172.21.15.1:0/301395717 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f2ff80cfb60 con 0x5632c871b1b0 2024-09-21T01:03:23.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.754+0000 7f300f04d740 1 -- 172.21.15.1:0/301395717 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5632c8a330f0 con 0x5632c871b1b0 2024-09-21T01:03:23.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.757+0000 7f2fe97fa640 1 -- 172.21.15.1:0/301395717 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2ff80d3310 con 0x5632c871b1b0 2024-09-21T01:03:23.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.759+0000 7f300f04d740 10 client.26548 fetch_fsmap learned FSMap version 34 2024-09-21T01:03:23.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.759+0000 7f300f04d740 1 -- 172.21.15.1:0/301395717 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5632c8ae3840 con 0x5632c871b1b0 2024-09-21T01:03:23.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.762+0000 7f2fe97fa640 1 -- 172.21.15.1:0/301395717 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5632c8a330f0 con 0x5632c871b1b0 2024-09-21T01:03:23.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.762+0000 7f2fe97fa640 1 -- 172.21.15.1:0/301395717 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 34) ==== 8374+0+0 (secure 0 0 0) 0x7f2ff80cda90 con 0x5632c871b1b0 2024-09-21T01:03:23.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.766+0000 7f300f04d740 10 client.26548 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T01:03:23.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.766+0000 7f300f04d740 10 client.26548 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:03:23.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.766+0000 7f300f04d740 20 client.26548 populate_metadata read hostname 'smithi001' 2024-09-21T01:03:23.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.766+0000 7f300f04d740 1 --2- 172.21.15.1:0/301395717 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5632c86af1c0 0x5632c8b58050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:23.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.766+0000 7f300f04d740 4 client.26548 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:03:23.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.766+0000 7f300f04d740 1 -- 172.21.15.1:0/301395717 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5632c8a30520 con 0x5632c86af1c0 2024-09-21T01:03:23.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.767+0000 7f3005da3640 1 --2- 172.21.15.1:0/301395717 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5632c86af1c0 0x5632c8b58050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:23.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.770+0000 7f3005da3640 1 --2- 172.21.15.1:0/301395717 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5632c86af1c0 0x5632c8b58050 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b60e1107d2cde01 server_cookie=3dd26c568c4498dd in_seq=0 out_seq=0 2024-09-21T01:03:23.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:23.771+0000 7f2fe97fa640 10 client.26548 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:03:24.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:24.535+0000 7f2fe97fa640 1 -- 172.21.15.1:0/301395717 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5632c8a30520 con 0x5632c86af1c0 2024-09-21T01:03:24.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:24.535+0000 7f2fe97fa640 10 client.26548 handle_command_reply: tid=0 2024-09-21T01:03:24.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:24.535+0000 7f300f04d740 1 client.26548 shutdown 2024-09-21T01:03:24.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:24.535+0000 7f300f04d740 1 -- 172.21.15.1:0/301395717 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632c871b1b0 msgr2=0x5632c8ae43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:24.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:24.535+0000 7f300f04d740 1 --2- 172.21.15.1:0/301395717 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632c871b1b0 0x5632c8ae43c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80cbaa0 tx=0x7f2ff80cdfa0 comp rx=0 tx=0).stop 2024-09-21T01:03:24.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:24.535+0000 7f300f04d740 1 -- 172.21.15.1:0/301395717 shutdown_connections 2024-09-21T01:03:24.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:24.535+0000 7f300f04d740 1 --2- 172.21.15.1:0/301395717 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5632c86af1c0 0x5632c8b58050 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:24.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:24.535+0000 7f300f04d740 1 --2- 172.21.15.1:0/301395717 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632c871b1b0 0x5632c8ae43c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:24.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:24.535+0000 7f300f04d740 1 --2- 172.21.15.1:0/301395717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632c86fa4d0 0x5632c8ae3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:24.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:24.535+0000 7f2fe97fa640 0 client.26548 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:03:24.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:24.535+0000 7f300f04d740 1 --2- 172.21.15.1:0/301395717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5632c86f22f0 0x5632c8ae51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:24.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:24.535+0000 7f300f04d740 1 -- 172.21.15.1:0/301395717 >> 172.21.15.1:0/301395717 conn(0x5632c870f300 msgr2=0x5632c8ac3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:24.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:24.535+0000 7f300f04d740 1 -- 172.21.15.1:0/301395717 shutdown_connections 2024-09-21T01:03:24.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:24.535+0000 7f300f04d740 1 -- 172.21.15.1:0/301395717 wait complete. 2024-09-21T01:03:24.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:24.535+0000 7f300f04d740 20 client.26548 trim_cache size 0 max 16384 2024-09-21T01:03:24.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T01:03:24.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T01:03:24.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T01:03:24.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T01:03:24.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:24.535+0000 7f3008007640 1 -- 172.21.15.1:0/4159102578 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f2fec0b66a0 msgr2=0x7f2fec0b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:24.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:24.535+0000 7f3008007640 1 --2- 172.21.15.1:0/4159102578 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f2fec0b66a0 0x7f2fec0b8bb0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc0097f0 tx=0x7f2ffc005f90 comp rx=0 tx=0).stop 2024-09-21T01:03:24.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:24.535+0000 7f3008007640 1 -- 172.21.15.1:0/4159102578 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f300010f830 msgr2=0x7f30001a9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:24.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:24.535+0000 7f3008007640 1 --2- 172.21.15.1:0/4159102578 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f300010f830 0x7f30001a9db0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2ff802aec0 tx=0x7f2ff80317d0 comp rx=0 tx=0).stop 2024-09-21T01:03:24.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:24.536+0000 7f3008007640 1 -- 172.21.15.1:0/4159102578 shutdown_connections 2024-09-21T01:03:24.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:24.536+0000 7f3008007640 1 --2- 172.21.15.1:0/4159102578 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f300010f830 0x7f30001a9db0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:24.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:24.536+0000 7f3008007640 1 --2- 172.21.15.1:0/4159102578 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f300010cd20 0x7f30001a9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:24.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:24.536+0000 7f3008007640 1 --2- 172.21.15.1:0/4159102578 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f2fec0b66a0 0x7f2fec0b8bb0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:24.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:24.536+0000 7f3008007640 1 --2- 172.21.15.1:0/4159102578 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f300010a3c0 0x7f30001a8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:24.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:24.536+0000 7f3008007640 1 -- 172.21.15.1:0/4159102578 >> 172.21.15.1:0/4159102578 conn(0x7f30000706d0 msgr2=0x7f300010b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:24.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:24.536+0000 7f3008007640 1 -- 172.21.15.1:0/4159102578 shutdown_connections 2024-09-21T01:03:24.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:24.536+0000 7f3008007640 1 -- 172.21.15.1:0/4159102578 wait complete. 2024-09-21T01:03:24.804 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T01:03:24.804 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T01:03:25.077 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:03:25.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:25 smithi001 ceph-mon[31211]: pgmap v544: 97 pgs: 97 active+clean; 702 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 349 op/s 2024-09-21T01:03:25.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.565+0000 7f40dc19c640 1 -- 172.21.15.1:0/4022180261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40d4110180 msgr2=0x7f40d41125a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:25.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.565+0000 7f40dc19c640 1 --2- 172.21.15.1:0/4022180261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40d4110180 0x7f40d41125a0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f40cc009ca0 tx=0x7f40cc02a950 comp rx=0 tx=0).stop 2024-09-21T01:03:25.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.565+0000 7f40dc19c640 1 -- 172.21.15.1:0/4022180261 shutdown_connections 2024-09-21T01:03:25.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.565+0000 7f40dc19c640 1 --2- 172.21.15.1:0/4022180261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40d4110180 0x7f40d41125a0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.565+0000 7f40dc19c640 1 --2- 172.21.15.1:0/4022180261 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40d4102f20 0x7f40d410fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.565+0000 7f40dc19c640 1 --2- 172.21.15.1:0/4022180261 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f40d41025d0 0x7f40d41029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.565+0000 7f40dc19c640 1 -- 172.21.15.1:0/4022180261 >> 172.21.15.1:0/4022180261 conn(0x7f40d4079730 msgr2=0x7f40d4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:25.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.565+0000 7f40dc19c640 1 -- 172.21.15.1:0/4022180261 shutdown_connections 2024-09-21T01:03:25.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.565+0000 7f40dc19c640 1 -- 172.21.15.1:0/4022180261 wait complete. 2024-09-21T01:03:25.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.566+0000 7f40dc19c640 1 Processor -- start 2024-09-21T01:03:25.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.566+0000 7f40dc19c640 1 -- start start 2024-09-21T01:03:25.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.566+0000 7f40dc19c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40d41025d0 0x7f40d419c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:25.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.566+0000 7f40dc19c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40d4102f20 0x7f40d419cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:25.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.566+0000 7f40dc19c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f40d4110180 0x7f40d41a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:25.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.566+0000 7f40dc19c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f40d4115c70 con 0x7f40d41025d0 2024-09-21T01:03:25.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.566+0000 7f40dc19c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f40d4115af0 con 0x7f40d4102f20 2024-09-21T01:03:25.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.566+0000 7f40dc19c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f40d4115df0 con 0x7f40d4110180 2024-09-21T01:03:25.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.566+0000 7f40d9f38640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40d41025d0 0x7f40d419c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:25.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.566+0000 7f40d9f38640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40d41025d0 0x7f40d419c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32826/0 (socket says 172.21.15.1:32826) 2024-09-21T01:03:25.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.566+0000 7f40d9f38640 1 -- 172.21.15.1:0/2064146877 learned_addr learned my addr 172.21.15.1:0/2064146877 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:25.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.566+0000 7f40d9737640 1 --2- 172.21.15.1:0/2064146877 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40d4102f20 0x7f40d419cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:25.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.566+0000 7f40da739640 1 --2- 172.21.15.1:0/2064146877 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f40d4110180 0x7f40d41a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:25.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.567+0000 7f40d9f38640 1 -- 172.21.15.1:0/2064146877 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f40d4110180 msgr2=0x7f40d41a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:25.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.567+0000 7f40d9f38640 1 --2- 172.21.15.1:0/2064146877 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f40d4110180 0x7f40d41a1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.567+0000 7f40d9f38640 1 -- 172.21.15.1:0/2064146877 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40d4102f20 msgr2=0x7f40d419cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:25.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.567+0000 7f40d9f38640 1 --2- 172.21.15.1:0/2064146877 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40d4102f20 0x7f40d419cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.567+0000 7f40d9f38640 1 -- 172.21.15.1:0/2064146877 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40d41a2550 con 0x7f40d41025d0 2024-09-21T01:03:25.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.567+0000 7f40d9f38640 1 --2- 172.21.15.1:0/2064146877 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40d41025d0 0x7f40d419c5e0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f40d000e9f0 tx=0x7f40d000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:25.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.567+0000 7f40caffd640 1 -- 172.21.15.1:0/2064146877 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d000cd80 con 0x7f40d41025d0 2024-09-21T01:03:25.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.567+0000 7f40dc19c640 1 -- 172.21.15.1:0/2064146877 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40d41a2840 con 0x7f40d41025d0 2024-09-21T01:03:25.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.567+0000 7f40caffd640 1 -- 172.21.15.1:0/2064146877 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40d00054d0 con 0x7f40d41025d0 2024-09-21T01:03:25.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.567+0000 7f40caffd640 1 -- 172.21.15.1:0/2064146877 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d0010690 con 0x7f40d41025d0 2024-09-21T01:03:25.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.567+0000 7f40dc19c640 1 -- 172.21.15.1:0/2064146877 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40d41a8fa0 con 0x7f40d41025d0 2024-09-21T01:03:25.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.570+0000 7f40e2710740 1 Processor -- start 2024-09-21T01:03:25.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.570+0000 7f40e2710740 1 -- start start 2024-09-21T01:03:25.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.570+0000 7f40caffd640 1 -- 172.21.15.1:0/2064146877 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f40d0004e90 con 0x7f40d41025d0 2024-09-21T01:03:25.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.570+0000 7f40e2710740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85d093350 0x55a85d43a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:25.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.570+0000 7f40e2710740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a85d06a490 0x55a85d43a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:25.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.570+0000 7f40e2710740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a85d072670 0x55a85d43aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:25.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.570+0000 7f40e2710740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a85d3b0e60 con 0x55a85d093350 2024-09-21T01:03:25.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.570+0000 7f40e2710740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a85d3a0290 con 0x55a85d06a490 2024-09-21T01:03:25.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.570+0000 7f40e2710740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a85d3a40a0 con 0x55a85d072670 2024-09-21T01:03:25.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.570+0000 7f40da739640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85d093350 0x55a85d43a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:25.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.570+0000 7f40da739640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85d093350 0x55a85d43a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32834/0 (socket says 172.21.15.1:32834) 2024-09-21T01:03:25.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.571+0000 7f40da739640 1 -- 172.21.15.1:0/3864495404 learned_addr learned my addr 172.21.15.1:0/3864495404 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:25.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.571+0000 7f40d9f38640 1 --2- 172.21.15.1:0/3864495404 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a85d06a490 0x55a85d43a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:25.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.571+0000 7f40d9737640 1 --2- 172.21.15.1:0/3864495404 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a85d072670 0x55a85d43aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:25.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.571+0000 7f40da739640 1 -- 172.21.15.1:0/3864495404 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a85d072670 msgr2=0x55a85d43aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:25.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.571+0000 7f40da739640 1 --2- 172.21.15.1:0/3864495404 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a85d072670 0x55a85d43aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.571+0000 7f40da739640 1 -- 172.21.15.1:0/3864495404 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a85d06a490 msgr2=0x55a85d43a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:25.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.571+0000 7f40da739640 1 --2- 172.21.15.1:0/3864495404 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a85d06a490 0x55a85d43a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.571+0000 7f40da739640 1 -- 172.21.15.1:0/3864495404 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a85d0fe930 con 0x55a85d093350 2024-09-21T01:03:25.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.571+0000 7f40da739640 1 --2- 172.21.15.1:0/3864495404 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85d093350 0x55a85d43a430 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f40cc009440 tx=0x7f40cc009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de3e0c7bfe5b220 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:25.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.571+0000 7f40caffd640 1 --2- 172.21.15.1:0/2064146877 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f40c00b6510 0x7f40c00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:25.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.571+0000 7f40d9f38640 1 --2- 172.21.15.1:0/2064146877 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f40c00b6510 0x7f40c00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:25.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.571+0000 7f40bffff640 1 -- 172.21.15.1:0/3864495404 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40cc034040 con 0x55a85d093350 2024-09-21T01:03:25.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.572+0000 7f40bffff640 1 -- 172.21.15.1:0/3864495404 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40cc02fec0 con 0x55a85d093350 2024-09-21T01:03:25.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.572+0000 7f40bffff640 1 -- 172.21.15.1:0/3864495404 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40cc004330 con 0x55a85d093350 2024-09-21T01:03:25.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.572+0000 7f40caffd640 1 -- 172.21.15.1:0/2064146877 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f40d00e77a0 con 0x7f40d41025d0 2024-09-21T01:03:25.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.572+0000 7f40e2710740 1 -- 172.21.15.1:0/3864495404 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85d093350 msgr2=0x55a85d43a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:25.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.572+0000 7f40d9f38640 1 --2- 172.21.15.1:0/2064146877 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f40c00b6510 0x7f40c00b8a20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x55a85d4390b0 tx=0x7f40d00ed550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:25.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.572+0000 7f40e2710740 1 --2- 172.21.15.1:0/3864495404 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85d093350 0x55a85d43a430 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f40cc009440 tx=0x7f40cc009a20 comp rx=0 tx=0).stop 2024-09-21T01:03:25.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.573+0000 7f40e2710740 1 -- 172.21.15.1:0/3864495404 shutdown_connections 2024-09-21T01:03:25.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.573+0000 7f40e2710740 1 --2- 172.21.15.1:0/3864495404 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a85d072670 0x55a85d43aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.573+0000 7f40e2710740 1 --2- 172.21.15.1:0/3864495404 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a85d06a490 0x55a85d43a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.573+0000 7f40e2710740 1 --2- 172.21.15.1:0/3864495404 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85d093350 0x55a85d43a430 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.573+0000 7f40e2710740 1 -- 172.21.15.1:0/3864495404 >> 172.21.15.1:0/3864495404 conn(0x55a85d087740 msgr2=0x55a85d438320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:25.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.573+0000 7f40e2710740 1 -- 172.21.15.1:0/3864495404 shutdown_connections 2024-09-21T01:03:25.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.573+0000 7f40e2710740 1 -- 172.21.15.1:0/3864495404 wait complete. 2024-09-21T01:03:25.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.573+0000 7f40e2710740 1 -- start start 2024-09-21T01:03:25.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.573+0000 7f40e2710740 1 Processor -- start 2024-09-21T01:03:25.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.574+0000 7f40e2710740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a85d06a490 0x55a85d446050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:25.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.574+0000 7f40e2710740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a85d072670 0x55a85d446590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:25.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.574+0000 7f40e2710740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85d093350 0x55a85d451f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:25.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.574+0000 7f40e2710740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a85d201890 con 0x55a85d093350 2024-09-21T01:03:25.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.574+0000 7f40e2710740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a85d33ad40 con 0x55a85d072670 2024-09-21T01:03:25.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.574+0000 7f40e2710740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a85d448bb0 con 0x55a85d06a490 2024-09-21T01:03:25.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.574+0000 7f40e2710740 10 client.0 _ll_register_callbacks cb 0x55a85d39ec80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:03:25.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.574+0000 7f40da739640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85d093350 0x55a85d451f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:25.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.574+0000 7f40d9737640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a85d072670 0x55a85d446590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:25.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.574+0000 7f40da739640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a85d06a490 0x55a85d446050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:25.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.574+0000 7f40da739640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a85d06a490 0x55a85d446050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:48468/0 (socket says 172.21.15.1:48468) 2024-09-21T01:03:25.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.574+0000 7f40da739640 1 -- 172.21.15.1:0/1751922583 learned_addr learned my addr 172.21.15.1:0/1751922583 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:25.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.574+0000 7f40da739640 1 -- 172.21.15.1:0/1751922583 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a85d072670 msgr2=0x55a85d446590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:25.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.574+0000 7f40da739640 1 --2- 172.21.15.1:0/1751922583 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a85d072670 0x55a85d446590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.574+0000 7f40da739640 1 -- 172.21.15.1:0/1751922583 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85d093350 msgr2=0x55a85d451f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:25.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.574+0000 7f40da739640 1 --2- 172.21.15.1:0/1751922583 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85d093350 0x55a85d451f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.574+0000 7f40da739640 1 -- 172.21.15.1:0/1751922583 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a85d4524f0 con 0x55a85d06a490 2024-09-21T01:03:25.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.575+0000 7f40da739640 1 --2- 172.21.15.1:0/1751922583 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a85d06a490 0x55a85d446050 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f40cc009ca0 tx=0x7f40cc005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1978cb28ace110a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:25.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.575+0000 7f40bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T01:03:25.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.575+0000 7f40bd7fa640 1 -- 172.21.15.1:0/1751922583 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40cc0046d0 con 0x55a85d06a490 2024-09-21T01:03:25.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.575+0000 7f40e2710740 1 -- 172.21.15.1:0/1751922583 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40cc02fec0 con 0x55a85d06a490 2024-09-21T01:03:25.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.575+0000 7f40bd7fa640 1 -- 172.21.15.1:0/1751922583 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f40cc003970 con 0x55a85d06a490 2024-09-21T01:03:25.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.575+0000 7f40bd7fa640 1 -- 172.21.15.1:0/1751922583 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f40cc003b70 con 0x55a85d06a490 2024-09-21T01:03:25.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.575+0000 7f40e2710740 10 client.26560 fetch_fsmap learned FSMap version 34 2024-09-21T01:03:25.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.575+0000 7f40e2710740 1 -- 172.21.15.1:0/1751922583 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a85d454e00 con 0x55a85d06a490 2024-09-21T01:03:25.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.575+0000 7f40bd7fa640 1 -- 172.21.15.1:0/1751922583 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40cc02fec0 con 0x55a85d06a490 2024-09-21T01:03:25.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.575+0000 7f40bd7fa640 1 -- 172.21.15.1:0/1751922583 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 34) ==== 8374+0+0 (secure 0 0 0) 0x7f40cc042070 con 0x55a85d06a490 2024-09-21T01:03:25.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.575+0000 7f40e2710740 10 client.26560 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T01:03:25.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.575+0000 7f40e2710740 10 client.26560 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:03:25.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.575+0000 7f40e2710740 20 client.26560 populate_metadata read hostname 'smithi001' 2024-09-21T01:03:25.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.575+0000 7f40e2710740 1 --2- 172.21.15.1:0/1751922583 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a85d051cd0 0x55a85d458160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:25.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.575+0000 7f40e2710740 4 client.26560 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:03:25.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.576+0000 7f40e2710740 1 -- 172.21.15.1:0/1751922583 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a85d3b2db0 con 0x55a85d051cd0 2024-09-21T01:03:25.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.576+0000 7f40d9737640 1 --2- 172.21.15.1:0/1751922583 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a85d051cd0 0x55a85d458160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:25.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.576+0000 7f40d9737640 1 --2- 172.21.15.1:0/1751922583 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a85d051cd0 0x55a85d458160 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0f85cee1f5b591a server_cookie=ce15b967b02af24c in_seq=0 out_seq=0 2024-09-21T01:03:25.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.576+0000 7f40bd7fa640 10 client.26560 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:03:25.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.577+0000 7f40bd7fa640 1 -- 172.21.15.1:0/1751922583 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a85d3b2db0 con 0x55a85d051cd0 2024-09-21T01:03:25.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.577+0000 7f40bd7fa640 10 client.26560 handle_command_reply: tid=0 2024-09-21T01:03:25.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.577+0000 7f40e2710740 1 client.26560 shutdown 2024-09-21T01:03:25.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.577+0000 7f40e2710740 1 -- 172.21.15.1:0/1751922583 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a85d06a490 msgr2=0x55a85d446050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:25.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.577+0000 7f40e2710740 1 --2- 172.21.15.1:0/1751922583 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a85d06a490 0x55a85d446050 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f40cc009ca0 tx=0x7f40cc005fd0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.577+0000 7f40e2710740 1 -- 172.21.15.1:0/1751922583 shutdown_connections 2024-09-21T01:03:25.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.577+0000 7f40e2710740 1 --2- 172.21.15.1:0/1751922583 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a85d051cd0 0x55a85d458160 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.577+0000 7f40e2710740 1 --2- 172.21.15.1:0/1751922583 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85d093350 0x55a85d451f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.577+0000 7f40e2710740 1 --2- 172.21.15.1:0/1751922583 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a85d072670 0x55a85d446590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.577+0000 7f40e2710740 1 --2- 172.21.15.1:0/1751922583 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a85d06a490 0x55a85d446050 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.577+0000 7f40e2710740 1 -- 172.21.15.1:0/1751922583 >> 172.21.15.1:0/1751922583 conn(0x55a85d087740 msgr2=0x55a85d43d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:25.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.577+0000 7f40bd7fa640 0 client.26560 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:03:25.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.577+0000 7f40e2710740 1 -- 172.21.15.1:0/1751922583 shutdown_connections 2024-09-21T01:03:25.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.577+0000 7f40e2710740 1 -- 172.21.15.1:0/1751922583 wait complete. 2024-09-21T01:03:25.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.577+0000 7f40e2710740 20 client.26560 trim_cache size 0 max 16384 2024-09-21T01:03:25.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.595+0000 7f40e2710740 1 Processor -- start 2024-09-21T01:03:25.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.595+0000 7f40e2710740 1 -- start start 2024-09-21T01:03:25.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.595+0000 7f40e2710740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a85d06a490 0x55a85d451e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:25.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.595+0000 7f40e2710740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a85d072670 0x55a85d43f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:25.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.595+0000 7f40e2710740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85d093350 0x55a85d43fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:25.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.595+0000 7f40e2710740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f40d41b15e0 con 0x55a85d093350 2024-09-21T01:03:25.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.595+0000 7f40e2710740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f40d41b31b0 con 0x55a85d06a490 2024-09-21T01:03:25.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.595+0000 7f40e2710740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f40d41b1cb0 con 0x55a85d072670 2024-09-21T01:03:25.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.595+0000 7f40da739640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85d093350 0x55a85d43fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:25.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.595+0000 7f40da739640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a85d06a490 0x55a85d451e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:25.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.595+0000 7f40da739640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a85d06a490 0x55a85d451e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:41352/0 (socket says 172.21.15.1:41352) 2024-09-21T01:03:25.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.596+0000 7f40da739640 1 -- 172.21.15.1:0/1023944469 learned_addr learned my addr 172.21.15.1:0/1023944469 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:25.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.595+0000 7f40d9737640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a85d072670 0x55a85d43f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:25.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.596+0000 7f40d9737640 1 -- 172.21.15.1:0/1023944469 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a85d06a490 msgr2=0x55a85d451e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:25.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.596+0000 7f40d9737640 1 --2- 172.21.15.1:0/1023944469 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a85d06a490 0x55a85d451e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.596+0000 7f40d9737640 1 -- 172.21.15.1:0/1023944469 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85d093350 msgr2=0x55a85d43fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:25.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.596+0000 7f40d9737640 1 --2- 172.21.15.1:0/1023944469 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85d093350 0x55a85d43fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.596+0000 7f40d9737640 1 -- 172.21.15.1:0/1023944469 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a85d43c9f0 con 0x55a85d072670 2024-09-21T01:03:25.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.596+0000 7f40da739640 1 --2- 172.21.15.1:0/1023944469 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85d093350 0x55a85d43fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:03:25.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.596+0000 7f40d9737640 1 --2- 172.21.15.1:0/1023944469 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a85d072670 0x55a85d43f6b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55a85d3a03e0 tx=0x7f40c4005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f71a1741c785f9e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:25.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.596+0000 7f40bf7fe640 1 -- 172.21.15.1:0/1023944469 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c4003d20 con 0x55a85d072670 2024-09-21T01:03:25.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.596+0000 7f40bf7fe640 1 -- 172.21.15.1:0/1023944469 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40c40108e0 con 0x55a85d072670 2024-09-21T01:03:25.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.596+0000 7f40bf7fe640 1 -- 172.21.15.1:0/1023944469 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c401f8d0 con 0x55a85d072670 2024-09-21T01:03:25.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.597+0000 7f40e2710740 1 -- 172.21.15.1:0/1023944469 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a85d072670 msgr2=0x55a85d43f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:25.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.597+0000 7f40e2710740 1 --2- 172.21.15.1:0/1023944469 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a85d072670 0x55a85d43f6b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55a85d3a03e0 tx=0x7f40c4005f90 comp rx=0 tx=0).stop 2024-09-21T01:03:25.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.597+0000 7f40e2710740 1 -- 172.21.15.1:0/1023944469 shutdown_connections 2024-09-21T01:03:25.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.597+0000 7f40e2710740 1 --2- 172.21.15.1:0/1023944469 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85d093350 0x55a85d43fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.597+0000 7f40e2710740 1 --2- 172.21.15.1:0/1023944469 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a85d072670 0x55a85d43f6b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.597+0000 7f40e2710740 1 --2- 172.21.15.1:0/1023944469 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a85d06a490 0x55a85d451e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.597+0000 7f40e2710740 1 -- 172.21.15.1:0/1023944469 >> 172.21.15.1:0/1023944469 conn(0x55a85d087740 msgr2=0x55a85d4446d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:25.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.597+0000 7f40e2710740 1 -- 172.21.15.1:0/1023944469 shutdown_connections 2024-09-21T01:03:25.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.597+0000 7f40e2710740 1 -- 172.21.15.1:0/1023944469 wait complete. 2024-09-21T01:03:25.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.598+0000 7f40e2710740 1 -- start start 2024-09-21T01:03:25.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.598+0000 7f40e2710740 1 Processor -- start 2024-09-21T01:03:25.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.598+0000 7f40e2710740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a85d06a490 0x55a85d457950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:25.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.598+0000 7f40e2710740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85d072670 0x55a85d457eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:25.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.598+0000 7f40e2710740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a85d093350 0x55a85d4c18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:25.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.598+0000 7f40e2710740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f40d41b2ae0 con 0x55a85d072670 2024-09-21T01:03:25.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.598+0000 7f40e2710740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f40d41b2410 con 0x55a85d06a490 2024-09-21T01:03:25.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.598+0000 7f40e2710740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f40d41af5c0 con 0x55a85d093350 2024-09-21T01:03:25.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.598+0000 7f40e2710740 10 client.0 _ll_register_callbacks cb 0x7f40d00ed420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:03:25.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.599+0000 7f40d9737640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85d072670 0x55a85d457eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:25.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.599+0000 7f40da739640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a85d06a490 0x55a85d457950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:25.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.599+0000 7f40d9737640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85d072670 0x55a85d457eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32874/0 (socket says 172.21.15.1:32874) 2024-09-21T01:03:25.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.599+0000 7f40d9737640 1 -- 172.21.15.1:0/2763345649 learned_addr learned my addr 172.21.15.1:0/2763345649 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:25.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.599+0000 7f40da739640 1 --2- 172.21.15.1:0/2763345649 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a85d093350 0x55a85d4c18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:25.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.599+0000 7f40da739640 1 -- 172.21.15.1:0/2763345649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a85d06a490 msgr2=0x55a85d457950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:25.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.599+0000 7f40da739640 1 --2- 172.21.15.1:0/2763345649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a85d06a490 0x55a85d457950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.599+0000 7f40da739640 1 -- 172.21.15.1:0/2763345649 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85d072670 msgr2=0x55a85d457eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:25.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.599+0000 7f40da739640 1 --2- 172.21.15.1:0/2763345649 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85d072670 0x55a85d457eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.599+0000 7f40da739640 1 -- 172.21.15.1:0/2763345649 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a85d4c1ec0 con 0x55a85d093350 2024-09-21T01:03:25.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.599+0000 7f40da739640 1 --2- 172.21.15.1:0/2763345649 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a85d093350 0x55a85d4c18d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f40cc030f40 tx=0x7f40cc003d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1d1e9bed14d11cd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:25.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.599+0000 7f40bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T01:03:25.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.599+0000 7f40bd7fa640 1 -- 172.21.15.1:0/2763345649 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40cc034070 con 0x55a85d093350 2024-09-21T01:03:25.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.599+0000 7f40e2710740 1 -- 172.21.15.1:0/2763345649 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40c40108e0 con 0x55a85d093350 2024-09-21T01:03:25.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.599+0000 7f40bd7fa640 1 -- 172.21.15.1:0/2763345649 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f40cc004400 con 0x55a85d093350 2024-09-21T01:03:25.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.599+0000 7f40bd7fa640 1 -- 172.21.15.1:0/2763345649 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f40cc071050 con 0x55a85d093350 2024-09-21T01:03:25.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.599+0000 7f40e2710740 10 client.26566 fetch_fsmap learned FSMap version 34 2024-09-21T01:03:25.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.599+0000 7f40e2710740 1 -- 172.21.15.1:0/2763345649 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a85d4c3180 con 0x55a85d093350 2024-09-21T01:03:25.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.600+0000 7f40bd7fa640 1 -- 172.21.15.1:0/2763345649 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40c40108e0 con 0x55a85d093350 2024-09-21T01:03:25.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.600+0000 7f40bd7fa640 1 -- 172.21.15.1:0/2763345649 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 34) ==== 8374+0+0 (secure 0 0 0) 0x7f40cc069020 con 0x55a85d093350 2024-09-21T01:03:25.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.600+0000 7f40e2710740 10 client.26566 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T01:03:25.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.600+0000 7f40e2710740 10 client.26566 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:03:25.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.600+0000 7f40e2710740 20 client.26566 populate_metadata read hostname 'smithi001' 2024-09-21T01:03:25.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.600+0000 7f40e2710740 1 --2- 172.21.15.1:0/2763345649 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a85d027080 0x55a85d4c57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:25.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.600+0000 7f40e2710740 4 client.26566 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T01:03:25.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.600+0000 7f40e2710740 1 -- 172.21.15.1:0/2763345649 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a85d3ae860 con 0x55a85d027080 2024-09-21T01:03:25.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.600+0000 7f40d9737640 1 --2- 172.21.15.1:0/2763345649 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a85d027080 0x55a85d4c57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:25.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.600+0000 7f40bd7fa640 10 client.26566 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:03:25.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.601+0000 7f40d9737640 1 --2- 172.21.15.1:0/2763345649 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a85d027080 0x55a85d4c57f0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f8cd8daf1af84ca server_cookie=61469761bde052b5 in_seq=0 out_seq=0 2024-09-21T01:03:25.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.602+0000 7f40bd7fa640 1 -- 172.21.15.1:0/2763345649 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a85d3ae860 con 0x55a85d027080 2024-09-21T01:03:25.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.602+0000 7f40bd7fa640 10 client.26566 handle_command_reply: tid=0 2024-09-21T01:03:25.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.602+0000 7f40e2710740 1 client.26566 shutdown 2024-09-21T01:03:25.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.602+0000 7f40e2710740 1 -- 172.21.15.1:0/2763345649 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a85d093350 msgr2=0x55a85d4c18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:25.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.602+0000 7f40e2710740 1 --2- 172.21.15.1:0/2763345649 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a85d093350 0x55a85d4c18d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f40cc030f40 tx=0x7f40cc003d10 comp rx=0 tx=0).stop 2024-09-21T01:03:25.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.602+0000 7f40e2710740 1 -- 172.21.15.1:0/2763345649 shutdown_connections 2024-09-21T01:03:25.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.602+0000 7f40e2710740 1 --2- 172.21.15.1:0/2763345649 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a85d027080 0x55a85d4c57f0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.602+0000 7f40e2710740 1 --2- 172.21.15.1:0/2763345649 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a85d093350 0x55a85d4c18d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.602+0000 7f40e2710740 1 --2- 172.21.15.1:0/2763345649 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85d072670 0x55a85d457eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.602+0000 7f40bd7fa640 0 client.26566 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:03:25.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.602+0000 7f40e2710740 1 --2- 172.21.15.1:0/2763345649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a85d06a490 0x55a85d457950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.603+0000 7f40e2710740 1 -- 172.21.15.1:0/2763345649 >> 172.21.15.1:0/2763345649 conn(0x55a85d087740 msgr2=0x55a85d43b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:25.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.603+0000 7f40e2710740 1 -- 172.21.15.1:0/2763345649 shutdown_connections 2024-09-21T01:03:25.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.603+0000 7f40e2710740 1 -- 172.21.15.1:0/2763345649 wait complete. 2024-09-21T01:03:25.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.603+0000 7f40e2710740 20 client.26566 trim_cache size 0 max 16384 2024-09-21T01:03:25.608 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T01:03:25.608 INFO:teuthology.orchestra.run.smithi001.stdout: "return_code": 0, 2024-09-21T01:03:25.608 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_tag": "3d019354-f00e-4e9b-b42c-f519d1f68cd2", 2024-09-21T01:03:25.609 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": "asynchronous" 2024-09-21T01:03:25.609 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T01:03:25.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.603+0000 7f40dc19c640 1 -- 172.21.15.1:0/2064146877 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f40c00b6510 msgr2=0x7f40c00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:25.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.603+0000 7f40dc19c640 1 --2- 172.21.15.1:0/2064146877 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f40c00b6510 0x7f40c00b8a20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x55a85d4390b0 tx=0x7f40d00ed550 comp rx=0 tx=0).stop 2024-09-21T01:03:25.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.603+0000 7f40dc19c640 1 -- 172.21.15.1:0/2064146877 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40d41025d0 msgr2=0x7f40d419c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:25.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.603+0000 7f40dc19c640 1 --2- 172.21.15.1:0/2064146877 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40d41025d0 0x7f40d419c5e0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f40d000e9f0 tx=0x7f40d000edf0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.603+0000 7f40dc19c640 1 -- 172.21.15.1:0/2064146877 shutdown_connections 2024-09-21T01:03:25.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.603+0000 7f40dc19c640 1 --2- 172.21.15.1:0/2064146877 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f40d4110180 0x7f40d41a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.603+0000 7f40dc19c640 1 --2- 172.21.15.1:0/2064146877 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40d4102f20 0x7f40d419cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.603+0000 7f40dc19c640 1 --2- 172.21.15.1:0/2064146877 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f40c00b6510 0x7f40c00b8a20 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.603+0000 7f40dc19c640 1 --2- 172.21.15.1:0/2064146877 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40d41025d0 0x7f40d419c5e0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.603+0000 7f40dc19c640 1 -- 172.21.15.1:0/2064146877 >> 172.21.15.1:0/2064146877 conn(0x7f40d4079730 msgr2=0x7f40d4109d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:25.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.603+0000 7f40dc19c640 1 -- 172.21.15.1:0/2064146877 shutdown_connections 2024-09-21T01:03:25.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:25.603+0000 7f40dc19c640 1 -- 172.21.15.1:0/2064146877 wait complete. 2024-09-21T01:03:25.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:25 smithi193 ceph-mon[34660]: pgmap v544: 97 pgs: 97 active+clean; 702 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 349 op/s 2024-09-21T01:03:25.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:25 smithi042 ceph-mon[34481]: pgmap v544: 97 pgs: 97 active+clean; 702 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 349 op/s 2024-09-21T01:03:26.418 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:03:26.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:26 smithi001 ceph-mon[31211]: scrub queued for path: / 2024-09-21T01:03:26.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:26 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:03:26.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:26 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:03:26.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:26 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:03:26.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:26 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:03:26.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:26 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:03:26.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:26 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:03:26.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:26 smithi193 ceph-mon[34660]: scrub queued for path: / 2024-09-21T01:03:26.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:26 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:03:26.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:26 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:03:26.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:26 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:03:26.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:26 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:03:26.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:26 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:03:26.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:26 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:03:26.732 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:03:26.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:26 smithi042 ceph-mon[34481]: scrub queued for path: / 2024-09-21T01:03:26.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:26 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:03:26.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:26 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:03:26.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:26 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:03:26.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:26 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:03:26.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:26 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:03:26.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:26 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:03:27.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.249+0000 7f0df08b4640 1 -- 172.21.15.1:0/1120612084 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0dec108cf0 msgr2=0x7f0dec10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:27.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.249+0000 7f0df08b4640 1 --2- 172.21.15.1:0/1120612084 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0dec108cf0 0x7f0dec10f520 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f0de4009ca0 tx=0x7f0de402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:03:27.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.249+0000 7f0df08b4640 1 -- 172.21.15.1:0/1120612084 shutdown_connections 2024-09-21T01:03:27.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.249+0000 7f0df08b4640 1 --2- 172.21.15.1:0/1120612084 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0dec108cf0 0x7f0dec10f520 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:27.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.249+0000 7f0df08b4640 1 --2- 172.21.15.1:0/1120612084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0dec1083a0 0x7f0dec1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:27.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.249+0000 7f0df08b4640 1 --2- 172.21.15.1:0/1120612084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0dec102a60 0x7f0dec102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:27.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.249+0000 7f0df08b4640 1 -- 172.21.15.1:0/1120612084 >> 172.21.15.1:0/1120612084 conn(0x7f0dec079730 msgr2=0x7f0dec079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:27.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.249+0000 7f0df08b4640 1 -- 172.21.15.1:0/1120612084 shutdown_connections 2024-09-21T01:03:27.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.249+0000 7f0df08b4640 1 -- 172.21.15.1:0/1120612084 wait complete. 2024-09-21T01:03:27.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.250+0000 7f0df08b4640 1 Processor -- start 2024-09-21T01:03:27.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.250+0000 7f0df08b4640 1 -- start start 2024-09-21T01:03:27.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.250+0000 7f0df08b4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0dec102a60 0x7f0dec19a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:27.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.250+0000 7f0df08b4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0dec1083a0 0x7f0dec19a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:27.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.250+0000 7f0df08b4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0dec108cf0 0x7f0dec19fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:27.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.250+0000 7f0df08b4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec112960 con 0x7f0dec102a60 2024-09-21T01:03:27.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.250+0000 7f0df08b4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec1127e0 con 0x7f0dec1083a0 2024-09-21T01:03:27.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.250+0000 7f0df08b4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec112ae0 con 0x7f0dec108cf0 2024-09-21T01:03:27.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.251+0000 7f0dea59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0dec102a60 0x7f0dec19a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:27.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.251+0000 7f0de9d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0dec1083a0 0x7f0dec19a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:27.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.251+0000 7f0de9d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0dec1083a0 0x7f0dec19a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:41378/0 (socket says 172.21.15.1:41378) 2024-09-21T01:03:27.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.251+0000 7f0dea59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0dec102a60 0x7f0dec19a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32900/0 (socket says 172.21.15.1:32900) 2024-09-21T01:03:27.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.251+0000 7f0de9d9b640 1 -- 172.21.15.1:0/1067794132 learned_addr learned my addr 172.21.15.1:0/1067794132 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:27.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.251+0000 7f0dead9d640 1 --2- 172.21.15.1:0/1067794132 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0dec108cf0 0x7f0dec19fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:27.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.251+0000 7f0de9d9b640 1 -- 172.21.15.1:0/1067794132 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0dec108cf0 msgr2=0x7f0dec19fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:27.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.251+0000 7f0de9d9b640 1 --2- 172.21.15.1:0/1067794132 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0dec108cf0 0x7f0dec19fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:27.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.251+0000 7f0de9d9b640 1 -- 172.21.15.1:0/1067794132 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0dec102a60 msgr2=0x7f0dec19a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:27.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.251+0000 7f0de9d9b640 1 --2- 172.21.15.1:0/1067794132 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0dec102a60 0x7f0dec19a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:27.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.251+0000 7f0de9d9b640 1 -- 172.21.15.1:0/1067794132 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dec1a0350 con 0x7f0dec1083a0 2024-09-21T01:03:27.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.251+0000 7f0de9d9b640 1 --2- 172.21.15.1:0/1067794132 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0dec1083a0 0x7f0dec19a980 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0de000e9c0 tx=0x7f0de000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:27.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.252+0000 7f0ddb7fe640 1 -- 172.21.15.1:0/1067794132 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de000cd80 con 0x7f0dec1083a0 2024-09-21T01:03:27.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.252+0000 7f0df08b4640 1 -- 172.21.15.1:0/1067794132 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dec1a0640 con 0x7f0dec1083a0 2024-09-21T01:03:27.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.252+0000 7f0ddb7fe640 1 -- 172.21.15.1:0/1067794132 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0de00054d0 con 0x7f0dec1083a0 2024-09-21T01:03:27.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.252+0000 7f0ddb7fe640 1 -- 172.21.15.1:0/1067794132 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de0010430 con 0x7f0dec1083a0 2024-09-21T01:03:27.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.252+0000 7f0df08b4640 1 -- 172.21.15.1:0/1067794132 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dec1a6da0 con 0x7f0dec1083a0 2024-09-21T01:03:27.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.255+0000 7f0df6e28740 1 Processor -- start 2024-09-21T01:03:27.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.255+0000 7f0df6e28740 1 -- start start 2024-09-21T01:03:27.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.255+0000 7f0ddb7fe640 1 -- 172.21.15.1:0/1067794132 <== mon.2 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f0de0004fd0 con 0x7f0dec1083a0 2024-09-21T01:03:27.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.255+0000 7f0df6e28740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56362f471070 0x56362f818650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:27.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.255+0000 7f0df6e28740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56362f4481b0 0x56362f818b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:27.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.255+0000 7f0df6e28740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56362f450390 0x56362f8190d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:27.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.255+0000 7f0df6e28740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56362f78ee50 con 0x56362f450390 2024-09-21T01:03:27.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.255+0000 7f0df6e28740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56362f77e280 con 0x56362f471070 2024-09-21T01:03:27.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.255+0000 7f0df6e28740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56362f782090 con 0x56362f4481b0 2024-09-21T01:03:27.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.256+0000 7f0dead9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56362f471070 0x56362f818650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:27.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.256+0000 7f0dea59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56362f4481b0 0x56362f818b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:27.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.256+0000 7f0dea59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56362f4481b0 0x56362f818b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:48516/0 (socket says 172.21.15.1:48516) 2024-09-21T01:03:27.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.256+0000 7f0dea59c640 1 -- 172.21.15.1:0/2645916353 learned_addr learned my addr 172.21.15.1:0/2645916353 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:27.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.256+0000 7f0de9d9b640 1 --2- 172.21.15.1:0/2645916353 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56362f450390 0x56362f8190d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:27.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.256+0000 7f0dead9d640 1 -- 172.21.15.1:0/2645916353 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56362f4481b0 msgr2=0x56362f818b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:27.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.256+0000 7f0dead9d640 1 --2- 172.21.15.1:0/2645916353 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56362f4481b0 0x56362f818b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:27.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.256+0000 7f0dead9d640 1 -- 172.21.15.1:0/2645916353 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56362f450390 msgr2=0x56362f8190d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:27.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.256+0000 7f0dead9d640 1 --2- 172.21.15.1:0/2645916353 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56362f450390 0x56362f8190d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:27.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.256+0000 7f0dead9d640 1 -- 172.21.15.1:0/2645916353 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56362f4dc650 con 0x56362f471070 2024-09-21T01:03:27.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.256+0000 7f0dead9d640 1 --2- 172.21.15.1:0/2645916353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56362f471070 0x56362f818650 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0de4005e30 tx=0x7f0de402f410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fd72f94918dc4db server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:27.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.257+0000 7f0ddb7fe640 1 --2- 172.21.15.1:0/1067794132 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f0dd40b6510 0x7f0dd40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:27.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.257+0000 7f0dd8ff9640 1 -- 172.21.15.1:0/2645916353 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de4031cf0 con 0x56362f471070 2024-09-21T01:03:27.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.257+0000 7f0dea59c640 1 --2- 172.21.15.1:0/1067794132 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f0dd40b6510 0x7f0dd40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:27.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.257+0000 7f0dd8ff9640 1 -- 172.21.15.1:0/2645916353 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0de4036030 con 0x56362f471070 2024-09-21T01:03:27.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.257+0000 7f0dd8ff9640 1 -- 172.21.15.1:0/2645916353 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de4004040 con 0x56362f471070 2024-09-21T01:03:27.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.257+0000 7f0ddb7fe640 1 -- 172.21.15.1:0/1067794132 <== mon.2 v2:172.21.15.42:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f0de00e7730 con 0x7f0dec1083a0 2024-09-21T01:03:27.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.258+0000 7f0df6e28740 1 -- 172.21.15.1:0/2645916353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56362f471070 msgr2=0x56362f818650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:27.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.258+0000 7f0dea59c640 1 --2- 172.21.15.1:0/1067794132 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f0dd40b6510 0x7f0dd40b8a20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x56362f8172d0 tx=0x7f0ddc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:27.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.258+0000 7f0df6e28740 1 --2- 172.21.15.1:0/2645916353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56362f471070 0x56362f818650 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0de4005e30 tx=0x7f0de402f410 comp rx=0 tx=0).stop 2024-09-21T01:03:27.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.258+0000 7f0df6e28740 1 -- 172.21.15.1:0/2645916353 shutdown_connections 2024-09-21T01:03:27.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.258+0000 7f0df6e28740 1 --2- 172.21.15.1:0/2645916353 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56362f450390 0x56362f8190d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:27.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.258+0000 7f0df6e28740 1 --2- 172.21.15.1:0/2645916353 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56362f4481b0 0x56362f818b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:27.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.258+0000 7f0df6e28740 1 --2- 172.21.15.1:0/2645916353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56362f471070 0x56362f818650 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:27.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.258+0000 7f0df6e28740 1 -- 172.21.15.1:0/2645916353 >> 172.21.15.1:0/2645916353 conn(0x56362f465460 msgr2=0x56362f816540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:27.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.258+0000 7f0df6e28740 1 -- 172.21.15.1:0/2645916353 shutdown_connections 2024-09-21T01:03:27.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.258+0000 7f0df6e28740 1 -- 172.21.15.1:0/2645916353 wait complete. 2024-09-21T01:03:27.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.259+0000 7f0df6e28740 1 -- start start 2024-09-21T01:03:27.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.259+0000 7f0df6e28740 1 Processor -- start 2024-09-21T01:03:27.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.259+0000 7f0df6e28740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56362f4481b0 0x56362f82a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:27.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.259+0000 7f0df6e28740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56362f450390 0x56362f828170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:27.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.259+0000 7f0df6e28740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56362f471070 0x56362f828880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:27.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.259+0000 7f0df6e28740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56362f5df700 con 0x56362f4481b0 2024-09-21T01:03:27.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.259+0000 7f0df6e28740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56362f719110 con 0x56362f471070 2024-09-21T01:03:27.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.259+0000 7f0df6e28740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56362f82af50 con 0x56362f450390 2024-09-21T01:03:27.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.259+0000 7f0df6e28740 10 client.0 _ll_register_callbacks cb 0x56362f732990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:03:27.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.259+0000 7f0de9d9b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56362f450390 0x56362f828170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:27.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.259+0000 7f0dead9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56362f471070 0x56362f828880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:27.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.259+0000 7f0dea59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56362f4481b0 0x56362f82a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:27.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.259+0000 7f0de9d9b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56362f450390 0x56362f828170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:48524/0 (socket says 172.21.15.1:48524) 2024-09-21T01:03:27.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.259+0000 7f0dead9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56362f471070 0x56362f828880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:41400/0 (socket says 172.21.15.1:41400) 2024-09-21T01:03:27.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.259+0000 7f0de9d9b640 1 -- 172.21.15.1:0/3980616607 learned_addr learned my addr 172.21.15.1:0/3980616607 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:27.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.259+0000 7f0dea59c640 1 --2- 172.21.15.1:0/3980616607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56362f4481b0 0x56362f82a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32918/0 (socket says 172.21.15.1:32918) 2024-09-21T01:03:27.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.260+0000 7f0dea59c640 1 -- 172.21.15.1:0/3980616607 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56362f450390 msgr2=0x56362f828170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:27.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.260+0000 7f0dea59c640 1 --2- 172.21.15.1:0/3980616607 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56362f450390 0x56362f828170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:27.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.260+0000 7f0dea59c640 1 -- 172.21.15.1:0/3980616607 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56362f471070 msgr2=0x56362f828880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:27.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.260+0000 7f0dea59c640 1 --2- 172.21.15.1:0/3980616607 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56362f471070 0x56362f828880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:27.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.260+0000 7f0dea59c640 1 -- 172.21.15.1:0/3980616607 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56362f746c40 con 0x56362f4481b0 2024-09-21T01:03:27.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.260+0000 7f0dea59c640 1 --2- 172.21.15.1:0/3980616607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56362f4481b0 0x56362f82a890 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc01e9d0 tx=0x7f0ddc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354aefac404f4754 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:27.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.260+0000 7f0dd1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:03:27.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.260+0000 7f0dd1ffb640 1 -- 172.21.15.1:0/3980616607 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc009b30 con 0x56362f4481b0 2024-09-21T01:03:27.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.260+0000 7f0df6e28740 1 -- 172.21.15.1:0/3980616607 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0de4036030 con 0x56362f4481b0 2024-09-21T01:03:27.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.260+0000 7f0dd1ffb640 1 -- 172.21.15.1:0/3980616607 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f0ddc018030 con 0x56362f4481b0 2024-09-21T01:03:27.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.260+0000 7f0dd1ffb640 1 -- 172.21.15.1:0/3980616607 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0ddc005020 con 0x56362f4481b0 2024-09-21T01:03:27.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.260+0000 7f0df6e28740 10 client.17040 fetch_fsmap learned FSMap version 34 2024-09-21T01:03:27.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.260+0000 7f0df6e28740 1 -- 172.21.15.1:0/3980616607 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56362f83b190 con 0x56362f4481b0 2024-09-21T01:03:27.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.261+0000 7f0dd1ffb640 1 -- 172.21.15.1:0/3980616607 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0de4036030 con 0x56362f4481b0 2024-09-21T01:03:27.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.261+0000 7f0dd1ffb640 1 -- 172.21.15.1:0/3980616607 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 34) ==== 8374+0+0 (secure 0 0 0) 0x7f0ddc029420 con 0x56362f4481b0 2024-09-21T01:03:27.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.261+0000 7f0df6e28740 10 client.17040 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T01:03:27.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.261+0000 7f0df6e28740 10 client.17040 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:03:27.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.261+0000 7f0df6e28740 20 client.17040 populate_metadata read hostname 'smithi001' 2024-09-21T01:03:27.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.261+0000 7f0df6e28740 1 --2- 172.21.15.1:0/3980616607 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x56362f42f9f0 0x56362f83e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:27.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.261+0000 7f0df6e28740 4 client.17040 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:03:27.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.261+0000 7f0df6e28740 1 -- 172.21.15.1:0/3980616607 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56362f790da0 con 0x56362f42f9f0 2024-09-21T01:03:27.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.261+0000 7f0de9d9b640 1 --2- 172.21.15.1:0/3980616607 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x56362f42f9f0 0x56362f83e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:27.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.262+0000 7f0dd1ffb640 10 client.17040 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:03:27.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.262+0000 7f0de9d9b640 1 --2- 172.21.15.1:0/3980616607 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x56362f42f9f0 0x56362f83e670 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5e01fdde31ae9fc server_cookie=e48a0b90b3d605d4 in_seq=0 out_seq=0 2024-09-21T01:03:27.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.264+0000 7f0dd1ffb640 1 -- 172.21.15.1:0/3980616607 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56362f790da0 con 0x56362f42f9f0 2024-09-21T01:03:27.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.265+0000 7f0dd1ffb640 10 client.17040 handle_command_reply: tid=0 2024-09-21T01:03:27.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.265+0000 7f0df6e28740 1 client.17040 shutdown 2024-09-21T01:03:27.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.265+0000 7f0df6e28740 1 -- 172.21.15.1:0/3980616607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56362f4481b0 msgr2=0x56362f82a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:27.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.265+0000 7f0df6e28740 1 --2- 172.21.15.1:0/3980616607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56362f4481b0 0x56362f82a890 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc01e9d0 tx=0x7f0ddc004730 comp rx=0 tx=0).stop 2024-09-21T01:03:27.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.265+0000 7f0df6e28740 1 -- 172.21.15.1:0/3980616607 shutdown_connections 2024-09-21T01:03:27.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.265+0000 7f0df6e28740 1 --2- 172.21.15.1:0/3980616607 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x56362f42f9f0 0x56362f83e670 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:27.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.265+0000 7f0df6e28740 1 --2- 172.21.15.1:0/3980616607 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56362f471070 0x56362f828880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:27.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.265+0000 7f0dd1ffb640 0 client.17040 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:03:27.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.265+0000 7f0df6e28740 1 --2- 172.21.15.1:0/3980616607 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56362f450390 0x56362f828170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:27.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.265+0000 7f0df6e28740 1 --2- 172.21.15.1:0/3980616607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56362f4481b0 0x56362f82a890 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:27.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.265+0000 7f0df6e28740 1 -- 172.21.15.1:0/3980616607 >> 172.21.15.1:0/3980616607 conn(0x56362f465460 msgr2=0x56362f814b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:27.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.265+0000 7f0df6e28740 1 -- 172.21.15.1:0/3980616607 shutdown_connections 2024-09-21T01:03:27.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.265+0000 7f0df6e28740 1 -- 172.21.15.1:0/3980616607 wait complete. 2024-09-21T01:03:27.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.265+0000 7f0df6e28740 20 client.17040 trim_cache size 0 max 16384 2024-09-21T01:03:27.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.285+0000 7f0df6e28740 1 Processor -- start 2024-09-21T01:03:27.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.285+0000 7f0df6e28740 1 -- start start 2024-09-21T01:03:27.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.285+0000 7f0df6e28740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56362f42f9f0 0x56362f821930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:27.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.285+0000 7f0df6e28740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56362f4481b0 0x56362f816570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:27.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.285+0000 7f0df6e28740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56362f450390 0x56362f825320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:27.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.285+0000 7f0df6e28740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec1ad110 con 0x56362f4481b0 2024-09-21T01:03:27.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.285+0000 7f0df6e28740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec1aece0 con 0x56362f450390 2024-09-21T01:03:27.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.285+0000 7f0df6e28740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec1ad7e0 con 0x56362f42f9f0 2024-09-21T01:03:27.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.285+0000 7f0de9d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56362f4481b0 0x56362f816570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:27.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.285+0000 7f0de9d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56362f4481b0 0x56362f816570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32924/0 (socket says 172.21.15.1:32924) 2024-09-21T01:03:27.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.285+0000 7f0de9d9b640 1 -- 172.21.15.1:0/3340360164 learned_addr learned my addr 172.21.15.1:0/3340360164 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:27.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.285+0000 7f0dead9d640 1 --2- 172.21.15.1:0/3340360164 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56362f450390 0x56362f825320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:27.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.285+0000 7f0dea59c640 1 --2- 172.21.15.1:0/3340360164 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56362f42f9f0 0x56362f821930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:27.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.286+0000 7f0de9d9b640 1 -- 172.21.15.1:0/3340360164 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56362f42f9f0 msgr2=0x56362f821930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:27.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.286+0000 7f0de9d9b640 1 --2- 172.21.15.1:0/3340360164 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56362f42f9f0 0x56362f821930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:27.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.286+0000 7f0de9d9b640 1 -- 172.21.15.1:0/3340360164 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56362f450390 msgr2=0x56362f825320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:27.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.286+0000 7f0de9d9b640 1 --2- 172.21.15.1:0/3340360164 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56362f450390 0x56362f825320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:27.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.286+0000 7f0de9d9b640 1 -- 172.21.15.1:0/3340360164 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56362f827090 con 0x56362f4481b0 2024-09-21T01:03:27.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.286+0000 7f0de9d9b640 1 --2- 172.21.15.1:0/3340360164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56362f4481b0 0x56362f816570 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f0de00e5260 tx=0x7f0de00d1040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74770c9215da17e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:27.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.286+0000 7f0dd3fff640 1 -- 172.21.15.1:0/3340360164 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de00a9740 con 0x56362f4481b0 2024-09-21T01:03:27.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.286+0000 7f0dd3fff640 1 -- 172.21.15.1:0/3340360164 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0de00046c0 con 0x56362f4481b0 2024-09-21T01:03:27.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.286+0000 7f0dd3fff640 1 -- 172.21.15.1:0/3340360164 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de00ad010 con 0x56362f4481b0 2024-09-21T01:03:27.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.287+0000 7f0df6e28740 1 -- 172.21.15.1:0/3340360164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56362f4481b0 msgr2=0x56362f816570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:27.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.287+0000 7f0df6e28740 1 --2- 172.21.15.1:0/3340360164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56362f4481b0 0x56362f816570 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f0de00e5260 tx=0x7f0de00d1040 comp rx=0 tx=0).stop 2024-09-21T01:03:27.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.287+0000 7f0df6e28740 1 -- 172.21.15.1:0/3340360164 shutdown_connections 2024-09-21T01:03:27.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.287+0000 7f0df6e28740 1 --2- 172.21.15.1:0/3340360164 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56362f450390 0x56362f825320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:27.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.287+0000 7f0df6e28740 1 --2- 172.21.15.1:0/3340360164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56362f4481b0 0x56362f816570 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:27.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.287+0000 7f0df6e28740 1 --2- 172.21.15.1:0/3340360164 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56362f42f9f0 0x56362f821930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:27.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.287+0000 7f0df6e28740 1 -- 172.21.15.1:0/3340360164 >> 172.21.15.1:0/3340360164 conn(0x56362f465460 msgr2=0x56362f815e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:27.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.287+0000 7f0df6e28740 1 -- 172.21.15.1:0/3340360164 shutdown_connections 2024-09-21T01:03:27.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.287+0000 7f0df6e28740 1 -- 172.21.15.1:0/3340360164 wait complete. 2024-09-21T01:03:27.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.287+0000 7f0df6e28740 1 -- start start 2024-09-21T01:03:27.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.288+0000 7f0df6e28740 1 Processor -- start 2024-09-21T01:03:27.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.288+0000 7f0df6e28740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56362f42f9f0 0x56362f8352a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:27.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.288+0000 7f0df6e28740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56362f4481b0 0x56362f8357e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:27.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.288+0000 7f0df6e28740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56362f450390 0x56362f8a7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:27.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.288+0000 7f0df6e28740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec1ae610 con 0x56362f450390 2024-09-21T01:03:27.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.288+0000 7f0df6e28740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec1adf40 con 0x56362f42f9f0 2024-09-21T01:03:27.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.288+0000 7f0df6e28740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec1ab0f0 con 0x56362f4481b0 2024-09-21T01:03:27.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.288+0000 7f0df6e28740 10 client.0 _ll_register_callbacks cb 0x7f0ddc01e890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:03:27.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.288+0000 7f0dead9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56362f450390 0x56362f8a7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:27.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.288+0000 7f0de9d9b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56362f4481b0 0x56362f8357e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:27.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.288+0000 7f0dead9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56362f450390 0x56362f8a7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32930/0 (socket says 172.21.15.1:32930) 2024-09-21T01:03:27.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.288+0000 7f0dead9d640 1 -- 172.21.15.1:0/2027767329 learned_addr learned my addr 172.21.15.1:0/2027767329 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:27.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.288+0000 7f0dea59c640 1 --2- 172.21.15.1:0/2027767329 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56362f42f9f0 0x56362f8352a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:27.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.288+0000 7f0de9d9b640 1 -- 172.21.15.1:0/2027767329 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56362f42f9f0 msgr2=0x56362f8352a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:27.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.288+0000 7f0de9d9b640 1 --2- 172.21.15.1:0/2027767329 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56362f42f9f0 0x56362f8352a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:27.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.288+0000 7f0de9d9b640 1 -- 172.21.15.1:0/2027767329 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56362f450390 msgr2=0x56362f8a7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:27.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.288+0000 7f0de9d9b640 1 --2- 172.21.15.1:0/2027767329 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56362f450390 0x56362f8a7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:27.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.288+0000 7f0de9d9b640 1 -- 172.21.15.1:0/2027767329 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56362f8a8570 con 0x56362f4481b0 2024-09-21T01:03:27.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.288+0000 7f0dead9d640 1 --2- 172.21.15.1:0/2027767329 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56362f450390 0x56362f8a7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:03:27.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.289+0000 7f0de9d9b640 1 --2- 172.21.15.1:0/2027767329 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56362f4481b0 0x56362f8357e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0de00e5260 tx=0x7f0de00048b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7076965c313a4632 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:27.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.289+0000 7f0dd1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T01:03:27.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.289+0000 7f0dd1ffb640 1 -- 172.21.15.1:0/2027767329 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de00ad1f0 con 0x56362f4481b0 2024-09-21T01:03:27.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.289+0000 7f0dd1ffb640 1 -- 172.21.15.1:0/2027767329 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f0de00aebd0 con 0x56362f4481b0 2024-09-21T01:03:27.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.289+0000 7f0df6e28740 1 -- 172.21.15.1:0/2027767329 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56362f78c850 con 0x56362f4481b0 2024-09-21T01:03:27.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.289+0000 7f0dd1ffb640 1 -- 172.21.15.1:0/2027767329 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0de00ad670 con 0x56362f4481b0 2024-09-21T01:03:27.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.289+0000 7f0df6e28740 10 client.26584 fetch_fsmap learned FSMap version 34 2024-09-21T01:03:27.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.289+0000 7f0df6e28740 1 -- 172.21.15.1:0/2027767329 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56362f8a9800 con 0x56362f4481b0 2024-09-21T01:03:27.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.289+0000 7f0dd1ffb640 1 -- 172.21.15.1:0/2027767329 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56362f78c850 con 0x56362f4481b0 2024-09-21T01:03:27.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.290+0000 7f0dd1ffb640 1 -- 172.21.15.1:0/2027767329 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 34) ==== 8374+0+0 (secure 0 0 0) 0x7f0de00b6e30 con 0x56362f4481b0 2024-09-21T01:03:27.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.290+0000 7f0df6e28740 10 client.26584 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T01:03:27.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.290+0000 7f0df6e28740 10 client.26584 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:03:27.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.290+0000 7f0df6e28740 20 client.26584 populate_metadata read hostname 'smithi001' 2024-09-21T01:03:27.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.290+0000 7f0df6e28740 1 --2- 172.21.15.1:0/2027767329 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x56362f471070 0x56362f8abeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:27.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.290+0000 7f0df6e28740 4 client.26584 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:03:27.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.290+0000 7f0df6e28740 1 -- 172.21.15.1:0/2027767329 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56362f789c80 con 0x56362f471070 2024-09-21T01:03:27.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.290+0000 7f0dea59c640 1 --2- 172.21.15.1:0/2027767329 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x56362f471070 0x56362f8abeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:27.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.290+0000 7f0dea59c640 1 --2- 172.21.15.1:0/2027767329 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x56362f471070 0x56362f8abeb0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45a66b2bcaf38b1d server_cookie=adb614cbe3492658 in_seq=0 out_seq=0 2024-09-21T01:03:27.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.290+0000 7f0dd1ffb640 10 client.26584 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:03:27.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.294+0000 7f0dd1ffb640 1 -- 172.21.15.1:0/2027767329 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2850 (crc 0 0 0) 0x56362f789c80 con 0x56362f471070 2024-09-21T01:03:27.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.294+0000 7f0dd1ffb640 10 client.26584 handle_command_reply: tid=0 2024-09-21T01:03:27.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.294+0000 7f0df6e28740 1 client.26584 shutdown 2024-09-21T01:03:27.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.294+0000 7f0df6e28740 1 -- 172.21.15.1:0/2027767329 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56362f4481b0 msgr2=0x56362f8357e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:27.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.294+0000 7f0df6e28740 1 --2- 172.21.15.1:0/2027767329 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56362f4481b0 0x56362f8357e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0de00e5260 tx=0x7f0de00048b0 comp rx=0 tx=0).stop 2024-09-21T01:03:27.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.294+0000 7f0df6e28740 1 -- 172.21.15.1:0/2027767329 shutdown_connections 2024-09-21T01:03:27.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.294+0000 7f0df6e28740 1 --2- 172.21.15.1:0/2027767329 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x56362f471070 0x56362f8abeb0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:27.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.294+0000 7f0df6e28740 1 --2- 172.21.15.1:0/2027767329 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56362f450390 0x56362f8a7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:27.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.294+0000 7f0df6e28740 1 --2- 172.21.15.1:0/2027767329 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56362f4481b0 0x56362f8357e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:27.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.294+0000 7f0df6e28740 1 --2- 172.21.15.1:0/2027767329 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56362f42f9f0 0x56362f8352a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:27.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.294+0000 7f0dd1ffb640 0 client.26584 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:03:27.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.294+0000 7f0df6e28740 1 -- 172.21.15.1:0/2027767329 >> 172.21.15.1:0/2027767329 conn(0x56362f465460 msgr2=0x56362f81d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:27.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.294+0000 7f0df6e28740 1 -- 172.21.15.1:0/2027767329 shutdown_connections 2024-09-21T01:03:27.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.294+0000 7f0df6e28740 1 -- 172.21.15.1:0/2027767329 wait complete. 2024-09-21T01:03:27.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.294+0000 7f0df6e28740 20 client.26584 trim_cache size 0 max 16384 2024-09-21T01:03:27.297 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T01:03:27.297 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "scrub active (165 inodes in the stack)", 2024-09-21T01:03:27.297 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": { 2024-09-21T01:03:27.297 INFO:teuthology.orchestra.run.smithi001.stdout: "3d019354-f00e-4e9b-b42c-f519d1f68cd2": { 2024-09-21T01:03:27.297 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:03:27.297 INFO:teuthology.orchestra.run.smithi001.stdout: "tag": "3d019354-f00e-4e9b-b42c-f519d1f68cd2", 2024-09-21T01:03:27.298 INFO:teuthology.orchestra.run.smithi001.stdout: "options": "recursive,force" 2024-09-21T01:03:27.298 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:03:27.298 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:03:27.298 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_stats": { 2024-09-21T01:03:27.298 INFO:teuthology.orchestra.run.smithi001.stdout: "c2addc95-c922-4a70-b746-0b5fd2af59bf": { 2024-09-21T01:03:27.298 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:00:52.374848+0000", 2024-09-21T01:03:27.298 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:03:27.298 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:03:27.298 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:03:27.298 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:03:27.298 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:03:27.298 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:03:27.298 INFO:teuthology.orchestra.run.smithi001.stdout: "d9a37a97-ce14-4763-8c19-9bd32df63cf3": { 2024-09-21T01:03:27.299 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:01:45.914443+0000", 2024-09-21T01:03:27.299 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:03:27.299 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:03:27.299 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:03:27.299 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:03:27.299 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:03:27.299 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:03:27.299 INFO:teuthology.orchestra.run.smithi001.stdout: "f826f2c1-768a-47bb-b868-785b351ac6b4": { 2024-09-21T01:03:27.299 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:59:06.554657+0000", 2024-09-21T01:03:27.299 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:03:27.299 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:03:27.299 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:03:27.299 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:03:27.299 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:03:27.299 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:03:27.299 INFO:teuthology.orchestra.run.smithi001.stdout: "1bffed0d-34b1-4e8b-9cab-7501131ef79d": { 2024-09-21T01:03:27.300 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:00:02.564228+0000", 2024-09-21T01:03:27.300 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:03:27.300 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:03:27.300 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:03:27.300 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:03:27.300 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:03:27.300 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:03:27.300 INFO:teuthology.orchestra.run.smithi001.stdout: "bee49cce-b407-4617-a959-331ffd8dc5b0": { 2024-09-21T01:03:27.300 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:58:17.883027+0000", 2024-09-21T01:03:27.300 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:03:27.300 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:03:27.300 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:03:27.300 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:03:27.300 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:03:27.300 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:03:27.301 INFO:teuthology.orchestra.run.smithi001.stdout: "3d019354-f00e-4e9b-b42c-f519d1f68cd2": { 2024-09-21T01:03:27.301 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:03:25.601697+0000", 2024-09-21T01:03:27.301 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:03:27.301 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:03:27.301 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:03:27.301 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:03:27.301 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:03:27.301 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:03:27.301 INFO:teuthology.orchestra.run.smithi001.stdout: "7cb1bc3f-e2d2-4bf7-b13e-8f3371d7aac1": { 2024-09-21T01:03:27.301 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:58:02.751142+0000", 2024-09-21T01:03:27.301 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:03:27.301 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:03:27.301 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:03:27.301 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:03:27.302 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:03:27.302 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:03:27.302 INFO:teuthology.orchestra.run.smithi001.stdout: "2383a19c-993d-4440-99f7-93b43dcf33b4": { 2024-09-21T01:03:27.302 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:47.609257+0000", 2024-09-21T01:03:27.302 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:03:27.302 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:03:27.302 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:03:27.302 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:03:27.302 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:03:27.302 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:03:27.302 INFO:teuthology.orchestra.run.smithi001.stdout: "53fa74e4-5aa8-408b-9724-7c93618f7636": { 2024-09-21T01:03:27.302 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:01.730608+0000", 2024-09-21T01:03:27.302 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:03:27.302 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:03:27.303 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:03:27.303 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:03:27.303 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:03:27.303 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:03:27.303 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:03:27.303 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T01:03:27.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.295+0000 7f0df08b4640 1 -- 172.21.15.1:0/1067794132 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f0dd40b6510 msgr2=0x7f0dd40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:27.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.295+0000 7f0df08b4640 1 --2- 172.21.15.1:0/1067794132 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f0dd40b6510 0x7f0dd40b8a20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x56362f8172d0 tx=0x7f0ddc005f90 comp rx=0 tx=0).stop 2024-09-21T01:03:27.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.295+0000 7f0df08b4640 1 -- 172.21.15.1:0/1067794132 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0dec1083a0 msgr2=0x7f0dec19a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:27.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.295+0000 7f0df08b4640 1 --2- 172.21.15.1:0/1067794132 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0dec1083a0 0x7f0dec19a980 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0de000e9c0 tx=0x7f0de000ee80 comp rx=0 tx=0).stop 2024-09-21T01:03:27.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.295+0000 7f0df08b4640 1 -- 172.21.15.1:0/1067794132 shutdown_connections 2024-09-21T01:03:27.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.295+0000 7f0df08b4640 1 --2- 172.21.15.1:0/1067794132 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0dec108cf0 0x7f0dec19fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:27.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.295+0000 7f0df08b4640 1 --2- 172.21.15.1:0/1067794132 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0dec1083a0 0x7f0dec19a980 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:27.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.295+0000 7f0df08b4640 1 --2- 172.21.15.1:0/1067794132 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f0dd40b6510 0x7f0dd40b8a20 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:27.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.295+0000 7f0df08b4640 1 --2- 172.21.15.1:0/1067794132 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0dec102a60 0x7f0dec19a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:27.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.295+0000 7f0df08b4640 1 -- 172.21.15.1:0/1067794132 >> 172.21.15.1:0/1067794132 conn(0x7f0dec079730 msgr2=0x7f0dec06b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:27.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.295+0000 7f0df08b4640 1 -- 172.21.15.1:0/1067794132 shutdown_connections 2024-09-21T01:03:27.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:27.295+0000 7f0df08b4640 1 -- 172.21.15.1:0/1067794132 wait complete. 2024-09-21T01:03:27.671 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:27 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:03:27.672 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:27 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:03:27.672 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:27 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:03:27.672 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:27 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:03:27.672 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:27 smithi001 ceph-mon[31211]: pgmap v545: 97 pgs: 97 active+clean; 729 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.6 MiB/s wr, 518 op/s 2024-09-21T01:03:27.672 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:27 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:03:27.672 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:27 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:03:27.672 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:27 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:03:27.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:27 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:03:27.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:27 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:03:27.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:27 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:03:27.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:27 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:03:27.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:27 smithi193 ceph-mon[34660]: pgmap v545: 97 pgs: 97 active+clean; 729 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.6 MiB/s wr, 518 op/s 2024-09-21T01:03:27.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:27 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:03:27.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:27 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:03:27.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:27 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:03:27.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:27 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:03:27.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:27 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:03:27.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:27 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:03:27.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:27 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:03:27.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:27 smithi042 ceph-mon[34481]: pgmap v545: 97 pgs: 97 active+clean; 729 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.6 MiB/s wr, 518 op/s 2024-09-21T01:03:27.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:27 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:03:27.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:27 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:03:27.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:27 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:03:28.009 INFO:tasks.cephfs.filesystem:scrub status for tag:3d019354-f00e-4e9b-b42c-f519d1f68cd2 - {'path': '/', 'tag': '3d019354-f00e-4e9b-b42c-f519d1f68cd2', 'options': 'recursive,force'} 2024-09-21T01:03:28.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:28 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:03:28.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:28 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:03:28.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:28 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:03:28.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:28 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:03:28.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:28 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:03:28.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:28 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:03:28.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:28 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:03:28.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:28 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:03:28.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:28 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:03:29.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:29 smithi001 ceph-mon[31211]: pgmap v546: 97 pgs: 97 active+clean; 729 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.7 MiB/s wr, 590 op/s 2024-09-21T01:03:29.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:29 smithi193 ceph-mon[34660]: pgmap v546: 97 pgs: 97 active+clean; 729 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.7 MiB/s wr, 590 op/s 2024-09-21T01:03:29.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:29 smithi042 ceph-mon[34481]: pgmap v546: 97 pgs: 97 active+clean; 729 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.7 MiB/s wr, 590 op/s 2024-09-21T01:03:31.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:31 smithi001 ceph-mon[31211]: pgmap v547: 97 pgs: 97 active+clean; 731 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.9 MiB/s wr, 691 op/s 2024-09-21T01:03:31.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:31 smithi193 ceph-mon[34660]: pgmap v547: 97 pgs: 97 active+clean; 731 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.9 MiB/s wr, 691 op/s 2024-09-21T01:03:31.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:31 smithi042 ceph-mon[34481]: pgmap v547: 97 pgs: 97 active+clean; 731 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.9 MiB/s wr, 691 op/s 2024-09-21T01:03:33.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:33 smithi001 ceph-mon[31211]: pgmap v548: 97 pgs: 97 active+clean; 732 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.7 MiB/s wr, 795 op/s 2024-09-21T01:03:33.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:33 smithi193 ceph-mon[34660]: pgmap v548: 97 pgs: 97 active+clean; 732 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.7 MiB/s wr, 795 op/s 2024-09-21T01:03:33.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:33 smithi042 ceph-mon[34481]: pgmap v548: 97 pgs: 97 active+clean; 732 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.7 MiB/s wr, 795 op/s 2024-09-21T01:03:35.702 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:35 smithi001 ceph-mon[31211]: pgmap v549: 97 pgs: 97 active+clean; 735 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.6 MiB/s wr, 853 op/s 2024-09-21T01:03:35.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:35 smithi193 ceph-mon[34660]: pgmap v549: 97 pgs: 97 active+clean; 735 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.6 MiB/s wr, 853 op/s 2024-09-21T01:03:35.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:35 smithi042 ceph-mon[34481]: pgmap v549: 97 pgs: 97 active+clean; 735 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.6 MiB/s wr, 853 op/s 2024-09-21T01:03:37.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.639+0000 7fd646bf9640 1 -- 172.21.15.1:0/3524958535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd640103fe0 msgr2=0x7fd64010a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:37.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.639+0000 7fd646bf9640 1 --2- 172.21.15.1:0/3524958535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd640103fe0 0x7fd64010a980 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fd638009ca0 tx=0x7fd63802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:03:37.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.639+0000 7fd646bf9640 1 -- 172.21.15.1:0/3524958535 shutdown_connections 2024-09-21T01:03:37.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.639+0000 7fd646bf9640 1 --2- 172.21.15.1:0/3524958535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd640103fe0 0x7fd64010a980 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:37.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.639+0000 7fd646bf9640 1 --2- 172.21.15.1:0/3524958535 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd640103640 0x7fd640103a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:37.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.639+0000 7fd646bf9640 1 --2- 172.21.15.1:0/3524958535 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6401025c0 0x7fd640102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:37.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.639+0000 7fd646bf9640 1 -- 172.21.15.1:0/3524958535 >> 172.21.15.1:0/3524958535 conn(0x7fd6400fdf00 msgr2=0x7fd6401003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:37.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.639+0000 7fd646bf9640 1 -- 172.21.15.1:0/3524958535 shutdown_connections 2024-09-21T01:03:37.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.639+0000 7fd646bf9640 1 -- 172.21.15.1:0/3524958535 wait complete. 2024-09-21T01:03:37.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.640+0000 7fd646bf9640 1 Processor -- start 2024-09-21T01:03:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.640+0000 7fd646bf9640 1 -- start start 2024-09-21T01:03:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.640+0000 7fd646bf9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6401025c0 0x7fd640198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.640+0000 7fd646bf9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd640103640 0x7fd640199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.640+0000 7fd646bf9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd640103fe0 0x7fd640199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.640+0000 7fd646bf9640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd64010e210 con 0x7fd6401025c0 2024-09-21T01:03:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.640+0000 7fd646bf9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd64010e090 con 0x7fd640103fe0 2024-09-21T01:03:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.640+0000 7fd646bf9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd64010e390 con 0x7fd640103640 2024-09-21T01:03:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.640+0000 7fd644995640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6401025c0 0x7fd640198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.640+0000 7fd644995640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6401025c0 0x7fd640198dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33604/0 (socket says 172.21.15.1:33604) 2024-09-21T01:03:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.640+0000 7fd644995640 1 -- 172.21.15.1:0/1064171454 learned_addr learned my addr 172.21.15.1:0/1064171454 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.640+0000 7fd63ffff640 1 --2- 172.21.15.1:0/1064171454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd640103640 0x7fd640199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.640+0000 7fd645196640 1 --2- 172.21.15.1:0/1064171454 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd640103fe0 0x7fd640199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.641+0000 7fd644995640 1 -- 172.21.15.1:0/1064171454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd640103640 msgr2=0x7fd640199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.641+0000 7fd644995640 1 --2- 172.21.15.1:0/1064171454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd640103640 0x7fd640199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:37.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.641+0000 7fd644995640 1 -- 172.21.15.1:0/1064171454 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd640103fe0 msgr2=0x7fd640199ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:37.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.641+0000 7fd644995640 1 --2- 172.21.15.1:0/1064171454 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd640103fe0 0x7fd640199ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:37.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.641+0000 7fd644995640 1 -- 172.21.15.1:0/1064171454 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd64019a810 con 0x7fd6401025c0 2024-09-21T01:03:37.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.641+0000 7fd644995640 1 --2- 172.21.15.1:0/1064171454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6401025c0 0x7fd640198dd0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fd63400d770 tx=0x7fd63400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:37.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.641+0000 7fd63dffb640 1 -- 172.21.15.1:0/1064171454 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd634017070 con 0x7fd6401025c0 2024-09-21T01:03:37.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.641+0000 7fd63dffb640 1 -- 172.21.15.1:0/1064171454 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6340054d0 con 0x7fd6401025c0 2024-09-21T01:03:37.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.641+0000 7fd646bf9640 1 -- 172.21.15.1:0/1064171454 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd64019ab00 con 0x7fd6401025c0 2024-09-21T01:03:37.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.641+0000 7fd63dffb640 1 -- 172.21.15.1:0/1064171454 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd634004c30 con 0x7fd6401025c0 2024-09-21T01:03:37.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.641+0000 7fd646bf9640 1 -- 172.21.15.1:0/1064171454 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6401a11f0 con 0x7fd6401025c0 2024-09-21T01:03:37.647 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.644+0000 7fd63dffb640 1 -- 172.21.15.1:0/1064171454 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7fd634004e10 con 0x7fd6401025c0 2024-09-21T01:03:37.647 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.644+0000 7fd64dc42740 1 Processor -- start 2024-09-21T01:03:37.647 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.644+0000 7fd64dc42740 1 -- start start 2024-09-21T01:03:37.647 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.644+0000 7fd64dc42740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4842c61b0 0x55b484670060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:37.647 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.644+0000 7fd64dc42740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b48429d2f0 0x55b4846706d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:37.647 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.644+0000 7fd64dc42740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4842a54d0 0x55b484671220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:37.647 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.644+0000 7fd64dc42740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b4845e06f0 con 0x55b4842a54d0 2024-09-21T01:03:37.647 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.644+0000 7fd64dc42740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b4845cfb20 con 0x55b48429d2f0 2024-09-21T01:03:37.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.644+0000 7fd64dc42740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b4845d3930 con 0x55b4842c61b0 2024-09-21T01:03:37.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.644+0000 7fd645196640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4842c61b0 0x55b484670060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:37.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.645+0000 7fd63ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4842a54d0 0x55b484671220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:37.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.645+0000 7fd644995640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b48429d2f0 0x55b4846706d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:37.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.645+0000 7fd645196640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4842c61b0 0x55b484670060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:51130/0 (socket says 172.21.15.1:51130) 2024-09-21T01:03:37.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.645+0000 7fd645196640 1 -- 172.21.15.1:0/2685854014 learned_addr learned my addr 172.21.15.1:0/2685854014 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:37.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.645+0000 7fd645196640 1 -- 172.21.15.1:0/2685854014 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b48429d2f0 msgr2=0x55b4846706d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:37.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.645+0000 7fd645196640 1 --2- 172.21.15.1:0/2685854014 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b48429d2f0 0x55b4846706d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:37.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.645+0000 7fd645196640 1 -- 172.21.15.1:0/2685854014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4842a54d0 msgr2=0x55b484671220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:37.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.645+0000 7fd645196640 1 --2- 172.21.15.1:0/2685854014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4842a54d0 0x55b484671220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:37.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.645+0000 7fd645196640 1 -- 172.21.15.1:0/2685854014 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b484595530 con 0x55b4842c61b0 2024-09-21T01:03:37.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.645+0000 7fd63dffb640 1 --2- 172.21.15.1:0/1064171454 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd6300b6510 0x7fd6300b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:37.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.645+0000 7fd644995640 1 --2- 172.21.15.1:0/1064171454 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd6300b6510 0x7fd6300b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:37.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.645+0000 7fd645196640 1 --2- 172.21.15.1:0/2685854014 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4842c61b0 0x55b484670060 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd638035000 tx=0x7fd638009800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e35b4d6bf1061eeb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:37.649 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.645+0000 7fd63dffb640 1 -- 172.21.15.1:0/1064171454 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fd6340e6d60 con 0x7fd6401025c0 2024-09-21T01:03:37.649 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.645+0000 7fd62affd640 1 -- 172.21.15.1:0/2685854014 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd638031650 con 0x55b4842c61b0 2024-09-21T01:03:37.649 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.645+0000 7fd62affd640 1 -- 172.21.15.1:0/2685854014 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd638036030 con 0x55b4842c61b0 2024-09-21T01:03:37.649 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.645+0000 7fd62affd640 1 -- 172.21.15.1:0/2685854014 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd63802f620 con 0x55b4842c61b0 2024-09-21T01:03:37.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.646+0000 7fd64dc42740 1 -- 172.21.15.1:0/2685854014 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4842c61b0 msgr2=0x55b484670060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:37.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.646+0000 7fd644995640 1 --2- 172.21.15.1:0/1064171454 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd6300b6510 0x7fd6300b8a20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd6340a9550 tx=0x7fd634094040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:37.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.646+0000 7fd64dc42740 1 --2- 172.21.15.1:0/2685854014 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4842c61b0 0x55b484670060 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd638035000 tx=0x7fd638009800 comp rx=0 tx=0).stop 2024-09-21T01:03:37.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.646+0000 7fd64dc42740 1 -- 172.21.15.1:0/2685854014 shutdown_connections 2024-09-21T01:03:37.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.646+0000 7fd64dc42740 1 --2- 172.21.15.1:0/2685854014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4842a54d0 0x55b484671220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:37.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.646+0000 7fd64dc42740 1 --2- 172.21.15.1:0/2685854014 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b48429d2f0 0x55b4846706d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:37.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.646+0000 7fd64dc42740 1 --2- 172.21.15.1:0/2685854014 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4842c61b0 0x55b484670060 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:37.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.646+0000 7fd64dc42740 1 -- 172.21.15.1:0/2685854014 >> 172.21.15.1:0/2685854014 conn(0x55b4842ba300 msgr2=0x55b4846698e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:37.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.646+0000 7fd64dc42740 1 -- 172.21.15.1:0/2685854014 shutdown_connections 2024-09-21T01:03:37.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.646+0000 7fd64dc42740 1 -- 172.21.15.1:0/2685854014 wait complete. 2024-09-21T01:03:37.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.647+0000 7fd64dc42740 1 -- start start 2024-09-21T01:03:37.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.647+0000 7fd64dc42740 1 Processor -- start 2024-09-21T01:03:37.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.647+0000 7fd64dc42740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b48429d2f0 0x55b4846795b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:37.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.647+0000 7fd64dc42740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b4842a54d0 0x55b484679c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:37.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.647+0000 7fd64dc42740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4842c61b0 0x55b48467a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:37.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.647+0000 7fd64dc42740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b484507ab0 con 0x55b48429d2f0 2024-09-21T01:03:37.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.647+0000 7fd64dc42740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b484575730 con 0x55b4842a54d0 2024-09-21T01:03:37.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.647+0000 7fd64dc42740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b484671b60 con 0x55b4842c61b0 2024-09-21T01:03:37.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.647+0000 7fd645196640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b48429d2f0 0x55b4846795b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:37.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.647+0000 7fd64dc42740 10 client.0 _ll_register_callbacks cb 0x55b4845c96b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:03:37.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.647+0000 7fd645196640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b48429d2f0 0x55b4846795b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33616/0 (socket says 172.21.15.1:33616) 2024-09-21T01:03:37.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.647+0000 7fd645196640 1 -- 172.21.15.1:0/83362687 learned_addr learned my addr 172.21.15.1:0/83362687 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:37.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.647+0000 7fd63ffff640 1 --2- 172.21.15.1:0/83362687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b4842a54d0 0x55b484679c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:37.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.648+0000 7fd645196640 1 --2- 172.21.15.1:0/83362687 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4842c61b0 0x55b48467a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:37.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.648+0000 7fd63ffff640 1 -- 172.21.15.1:0/83362687 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4842c61b0 msgr2=0x55b48467a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:37.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.648+0000 7fd63ffff640 1 --2- 172.21.15.1:0/83362687 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4842c61b0 0x55b48467a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:37.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.648+0000 7fd63ffff640 1 -- 172.21.15.1:0/83362687 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b48429d2f0 msgr2=0x55b4846795b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:37.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.648+0000 7fd63ffff640 1 --2- 172.21.15.1:0/83362687 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b48429d2f0 0x55b4846795b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:37.655 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.648+0000 7fd63ffff640 1 -- 172.21.15.1:0/83362687 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b484331790 con 0x55b4842a54d0 2024-09-21T01:03:37.655 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.648+0000 7fd645196640 1 --2- 172.21.15.1:0/83362687 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b48429d2f0 0x55b4846795b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:03:37.655 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.648+0000 7fd63ffff640 1 --2- 172.21.15.1:0/83362687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b4842a54d0 0x55b484679c70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd62c012700 tx=0x7fd62c012bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3a46bc730b155b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:37.655 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.648+0000 7fd61ffff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:03:37.655 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.648+0000 7fd61ffff640 1 -- 172.21.15.1:0/83362687 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c00f8c0 con 0x55b4842a54d0 2024-09-21T01:03:37.655 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.648+0000 7fd64dc42740 1 -- 172.21.15.1:0/83362687 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd638036030 con 0x55b4842a54d0 2024-09-21T01:03:37.655 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.648+0000 7fd61ffff640 1 -- 172.21.15.1:0/83362687 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fd62c00fa60 con 0x55b4842a54d0 2024-09-21T01:03:37.655 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.649+0000 7fd61ffff640 1 -- 172.21.15.1:0/83362687 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd62c00fc60 con 0x55b4842a54d0 2024-09-21T01:03:37.655 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.649+0000 7fd64dc42740 10 client.26717 fetch_fsmap learned FSMap version 34 2024-09-21T01:03:37.655 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.649+0000 7fd64dc42740 1 -- 172.21.15.1:0/83362687 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b4843aa620 con 0x55b4842a54d0 2024-09-21T01:03:37.655 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.649+0000 7fd61ffff640 1 -- 172.21.15.1:0/83362687 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd638036030 con 0x55b4842a54d0 2024-09-21T01:03:37.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.649+0000 7fd61ffff640 1 -- 172.21.15.1:0/83362687 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 34) ==== 8374+0+0 (secure 0 0 0) 0x7fd62c026420 con 0x55b4842a54d0 2024-09-21T01:03:37.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.649+0000 7fd64dc42740 10 client.26717 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T01:03:37.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.649+0000 7fd64dc42740 10 client.26717 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:03:37.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.649+0000 7fd64dc42740 20 client.26717 populate_metadata read hostname 'smithi001' 2024-09-21T01:03:37.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.649+0000 7fd64dc42740 1 --2- 172.21.15.1:0/83362687 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55b484284d80 0x55b484686df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:37.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.649+0000 7fd64dc42740 4 client.26717 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:03:37.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.649+0000 7fd64dc42740 1 -- 172.21.15.1:0/83362687 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b4845e2640 con 0x55b484284d80 2024-09-21T01:03:37.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.649+0000 7fd645196640 1 --2- 172.21.15.1:0/83362687 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55b484284d80 0x55b484686df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:37.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.650+0000 7fd61ffff640 10 client.26717 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:03:37.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.650+0000 7fd645196640 1 --2- 172.21.15.1:0/83362687 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55b484284d80 0x55b484686df0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96d14edeb3df4fb5 server_cookie=394538d07a15dbd0 in_seq=0 out_seq=0 2024-09-21T01:03:37.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.651+0000 7fd61ffff640 1 -- 172.21.15.1:0/83362687 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b4845e2640 con 0x55b484284d80 2024-09-21T01:03:37.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.651+0000 7fd61ffff640 10 client.26717 handle_command_reply: tid=0 2024-09-21T01:03:37.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.651+0000 7fd64dc42740 1 client.26717 shutdown 2024-09-21T01:03:37.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.651+0000 7fd64dc42740 1 -- 172.21.15.1:0/83362687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b4842a54d0 msgr2=0x55b484679c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:37.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.651+0000 7fd64dc42740 1 --2- 172.21.15.1:0/83362687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b4842a54d0 0x55b484679c70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd62c012700 tx=0x7fd62c012bc0 comp rx=0 tx=0).stop 2024-09-21T01:03:37.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.651+0000 7fd64dc42740 1 -- 172.21.15.1:0/83362687 shutdown_connections 2024-09-21T01:03:37.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.651+0000 7fd64dc42740 1 --2- 172.21.15.1:0/83362687 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55b484284d80 0x55b484686df0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:37.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.651+0000 7fd64dc42740 1 --2- 172.21.15.1:0/83362687 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4842c61b0 0x55b48467a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:37.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.651+0000 7fd64dc42740 1 --2- 172.21.15.1:0/83362687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b4842a54d0 0x55b484679c70 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:37.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.651+0000 7fd61ffff640 0 client.26717 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:03:37.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.651+0000 7fd64dc42740 1 --2- 172.21.15.1:0/83362687 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b48429d2f0 0x55b4846795b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:37.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.651+0000 7fd64dc42740 1 -- 172.21.15.1:0/83362687 >> 172.21.15.1:0/83362687 conn(0x55b4842ba300 msgr2=0x55b4846710d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:37.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.651+0000 7fd64dc42740 1 -- 172.21.15.1:0/83362687 shutdown_connections 2024-09-21T01:03:37.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.651+0000 7fd64dc42740 1 -- 172.21.15.1:0/83362687 wait complete. 2024-09-21T01:03:37.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.651+0000 7fd64dc42740 20 client.26717 trim_cache size 0 max 16384 2024-09-21T01:03:37.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.667+0000 7fd64dc42740 1 Processor -- start 2024-09-21T01:03:37.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.667+0000 7fd64dc42740 1 -- start start 2024-09-21T01:03:37.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.667+0000 7fd64dc42740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b48429d2f0 0x55b484679cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.667+0000 7fd64dc42740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4842a54d0 0x55b48467a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.667+0000 7fd64dc42740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4842c61b0 0x55b48467ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.667+0000 7fd64dc42740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd6401a8c80 con 0x55b4842c61b0 2024-09-21T01:03:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.667+0000 7fd64dc42740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd6401aa850 con 0x55b48429d2f0 2024-09-21T01:03:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.667+0000 7fd64dc42740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd6401a9350 con 0x55b4842a54d0 2024-09-21T01:03:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.667+0000 7fd645196640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4842c61b0 0x55b48467ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.667+0000 7fd645196640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4842c61b0 0x55b48467ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33626/0 (socket says 172.21.15.1:33626) 2024-09-21T01:03:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.667+0000 7fd645196640 1 -- 172.21.15.1:0/3083886968 learned_addr learned my addr 172.21.15.1:0/3083886968 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.667+0000 7fd63ffff640 1 --2- 172.21.15.1:0/3083886968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4842a54d0 0x55b48467a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.667+0000 7fd645196640 1 --2- 172.21.15.1:0/3083886968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b48429d2f0 0x55b484679cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.667+0000 7fd63ffff640 1 -- 172.21.15.1:0/3083886968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b48429d2f0 msgr2=0x55b484679cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.667+0000 7fd63ffff640 1 --2- 172.21.15.1:0/3083886968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b48429d2f0 0x55b484679cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.667+0000 7fd63ffff640 1 -- 172.21.15.1:0/3083886968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4842c61b0 msgr2=0x55b48467ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.667+0000 7fd63ffff640 1 --2- 172.21.15.1:0/3083886968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4842c61b0 0x55b48467ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:37.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.667+0000 7fd63ffff640 1 -- 172.21.15.1:0/3083886968 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4846777c0 con 0x55b4842a54d0 2024-09-21T01:03:37.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.667+0000 7fd645196640 1 --2- 172.21.15.1:0/3083886968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4842c61b0 0x55b48467ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:03:37.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.668+0000 7fd63ffff640 1 --2- 172.21.15.1:0/3083886968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4842a54d0 0x55b48467a7c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd62c009e00 tx=0x7fd62c00ff90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dde610aedf31ba8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:37.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.668+0000 7fd62a7fc640 1 -- 172.21.15.1:0/3083886968 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c026420 con 0x55b4842a54d0 2024-09-21T01:03:37.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.668+0000 7fd62a7fc640 1 -- 172.21.15.1:0/3083886968 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd62c02b020 con 0x55b4842a54d0 2024-09-21T01:03:37.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.668+0000 7fd62a7fc640 1 -- 172.21.15.1:0/3083886968 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c005270 con 0x55b4842a54d0 2024-09-21T01:03:37.674 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.669+0000 7fd64dc42740 1 -- 172.21.15.1:0/3083886968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4842a54d0 msgr2=0x55b48467a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:37.674 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.669+0000 7fd64dc42740 1 --2- 172.21.15.1:0/3083886968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4842a54d0 0x55b48467a7c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd62c009e00 tx=0x7fd62c00ff90 comp rx=0 tx=0).stop 2024-09-21T01:03:37.674 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.669+0000 7fd64dc42740 1 -- 172.21.15.1:0/3083886968 shutdown_connections 2024-09-21T01:03:37.674 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.669+0000 7fd64dc42740 1 --2- 172.21.15.1:0/3083886968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4842c61b0 0x55b48467ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:37.675 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.669+0000 7fd64dc42740 1 --2- 172.21.15.1:0/3083886968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4842a54d0 0x55b48467a7c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:37.675 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.669+0000 7fd64dc42740 1 --2- 172.21.15.1:0/3083886968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b48429d2f0 0x55b484679cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:37.675 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.669+0000 7fd64dc42740 1 -- 172.21.15.1:0/3083886968 >> 172.21.15.1:0/3083886968 conn(0x55b4842ba300 msgr2=0x55b4846795b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:37.675 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.669+0000 7fd64dc42740 1 -- 172.21.15.1:0/3083886968 shutdown_connections 2024-09-21T01:03:37.675 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.669+0000 7fd64dc42740 1 -- 172.21.15.1:0/3083886968 wait complete. 2024-09-21T01:03:37.675 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.669+0000 7fd64dc42740 1 -- start start 2024-09-21T01:03:37.675 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.669+0000 7fd64dc42740 1 Processor -- start 2024-09-21T01:03:37.675 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.670+0000 7fd64dc42740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b48429d2f0 0x55b48467c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:37.675 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.670+0000 7fd64dc42740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4842a54d0 0x55b48467cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:37.675 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.670+0000 7fd64dc42740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b4842c61b0 0x55b484680b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:37.675 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.670+0000 7fd64dc42740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd6401aa180 con 0x55b4842a54d0 2024-09-21T01:03:37.675 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.670+0000 7fd64dc42740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd6401a9ab0 con 0x55b4842c61b0 2024-09-21T01:03:37.675 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.670+0000 7fd64dc42740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd6401a6c60 con 0x55b48429d2f0 2024-09-21T01:03:37.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.670+0000 7fd64dc42740 10 client.0 _ll_register_callbacks cb 0x7fd62c009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:03:37.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.670+0000 7fd63ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4842a54d0 0x55b48467cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:37.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.670+0000 7fd63ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4842a54d0 0x55b48467cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33634/0 (socket says 172.21.15.1:33634) 2024-09-21T01:03:37.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.670+0000 7fd63ffff640 1 -- 172.21.15.1:0/1722041714 learned_addr learned my addr 172.21.15.1:0/1722041714 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:37.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.670+0000 7fd645196640 1 --2- 172.21.15.1:0/1722041714 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b48429d2f0 0x55b48467c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:37.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.670+0000 7fd645196640 1 --2- 172.21.15.1:0/1722041714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b4842c61b0 0x55b484680b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:37.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.670+0000 7fd63ffff640 1 -- 172.21.15.1:0/1722041714 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b48429d2f0 msgr2=0x55b48467c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:37.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.670+0000 7fd63ffff640 1 --2- 172.21.15.1:0/1722041714 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b48429d2f0 0x55b48467c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:37.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.670+0000 7fd63ffff640 1 -- 172.21.15.1:0/1722041714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b4842c61b0 msgr2=0x55b484680b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:37.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.670+0000 7fd63ffff640 1 --2- 172.21.15.1:0/1722041714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b4842c61b0 0x55b484680b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:37.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.670+0000 7fd63ffff640 1 -- 172.21.15.1:0/1722041714 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4846812e0 con 0x55b4842a54d0 2024-09-21T01:03:37.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.670+0000 7fd63ffff640 1 --2- 172.21.15.1:0/1722041714 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4842a54d0 0x55b48467cf90 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fd62c0268c0 tx=0x7fd62c026ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b34a45cbd5325611 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:37.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.670+0000 7fd61ffff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:03:37.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.670+0000 7fd61ffff640 1 -- 172.21.15.1:0/1722041714 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c00f9a0 con 0x55b4842a54d0 2024-09-21T01:03:37.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.671+0000 7fd64dc42740 1 -- 172.21.15.1:0/1722041714 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd62c02b020 con 0x55b4842a54d0 2024-09-21T01:03:37.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.671+0000 7fd61ffff640 1 -- 172.21.15.1:0/1722041714 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fd62c02c040 con 0x55b4842a54d0 2024-09-21T01:03:37.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.671+0000 7fd61ffff640 1 -- 172.21.15.1:0/1722041714 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd62c005170 con 0x55b4842a54d0 2024-09-21T01:03:37.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.671+0000 7fd64dc42740 10 client.17064 fetch_fsmap learned FSMap version 34 2024-09-21T01:03:37.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.671+0000 7fd64dc42740 1 -- 172.21.15.1:0/1722041714 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b48467e4f0 con 0x55b4842a54d0 2024-09-21T01:03:37.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.671+0000 7fd61ffff640 1 -- 172.21.15.1:0/1722041714 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd62c02b020 con 0x55b4842a54d0 2024-09-21T01:03:37.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.671+0000 7fd61ffff640 1 -- 172.21.15.1:0/1722041714 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 34) ==== 8374+0+0 (secure 0 0 0) 0x7fd62c039030 con 0x55b4842a54d0 2024-09-21T01:03:37.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.671+0000 7fd64dc42740 10 client.17064 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T01:03:37.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.671+0000 7fd64dc42740 10 client.17064 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:03:37.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.671+0000 7fd64dc42740 20 client.17064 populate_metadata read hostname 'smithi001' 2024-09-21T01:03:37.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.671+0000 7fd64dc42740 1 --2- 172.21.15.1:0/1722041714 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55b48425a1c0 0x55b4846f3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:37.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.671+0000 7fd64dc42740 4 client.17064 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:03:37.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.671+0000 7fd64dc42740 1 -- 172.21.15.1:0/1722041714 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b4845de0f0 con 0x55b48425a1c0 2024-09-21T01:03:37.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.671+0000 7fd645196640 1 --2- 172.21.15.1:0/1722041714 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55b48425a1c0 0x55b4846f3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:37.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.672+0000 7fd61ffff640 10 client.17064 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:03:37.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.672+0000 7fd645196640 1 --2- 172.21.15.1:0/1722041714 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55b48425a1c0 0x55b4846f3d90 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20f7584119a96ae7 server_cookie=b56121a8224f79cd in_seq=0 out_seq=0 2024-09-21T01:03:37.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:37 smithi001 ceph-mon[31211]: pgmap v550: 97 pgs: 97 active+clean; 740 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.7 MiB/s wr, 853 op/s 2024-09-21T01:03:37.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:37 smithi193 ceph-mon[34660]: pgmap v550: 97 pgs: 97 active+clean; 740 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.7 MiB/s wr, 853 op/s 2024-09-21T01:03:37.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:37 smithi042 ceph-mon[34481]: pgmap v550: 97 pgs: 97 active+clean; 740 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.7 MiB/s wr, 853 op/s 2024-09-21T01:03:37.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.779+0000 7fd61ffff640 1 -- 172.21.15.1:0/1722041714 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b4845de0f0 con 0x55b48425a1c0 2024-09-21T01:03:37.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.779+0000 7fd61ffff640 10 client.17064 handle_command_reply: tid=0 2024-09-21T01:03:37.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.779+0000 7fd64dc42740 1 client.17064 shutdown 2024-09-21T01:03:37.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.779+0000 7fd64dc42740 1 -- 172.21.15.1:0/1722041714 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4842a54d0 msgr2=0x55b48467cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:37.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.779+0000 7fd64dc42740 1 --2- 172.21.15.1:0/1722041714 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4842a54d0 0x55b48467cf90 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fd62c0268c0 tx=0x7fd62c026ce0 comp rx=0 tx=0).stop 2024-09-21T01:03:37.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.779+0000 7fd64dc42740 1 -- 172.21.15.1:0/1722041714 shutdown_connections 2024-09-21T01:03:37.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.779+0000 7fd64dc42740 1 --2- 172.21.15.1:0/1722041714 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55b48425a1c0 0x55b4846f3d90 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:37.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.779+0000 7fd64dc42740 1 --2- 172.21.15.1:0/1722041714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b4842c61b0 0x55b484680b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:37.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.779+0000 7fd64dc42740 1 --2- 172.21.15.1:0/1722041714 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4842a54d0 0x55b48467cf90 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:37.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.779+0000 7fd64dc42740 1 --2- 172.21.15.1:0/1722041714 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b48429d2f0 0x55b48467c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:37.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.779+0000 7fd61ffff640 0 client.17064 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:03:37.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.779+0000 7fd64dc42740 1 -- 172.21.15.1:0/1722041714 >> 172.21.15.1:0/1722041714 conn(0x55b4842ba300 msgr2=0x55b48467a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:37.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.779+0000 7fd64dc42740 1 -- 172.21.15.1:0/1722041714 shutdown_connections 2024-09-21T01:03:37.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.779+0000 7fd64dc42740 1 -- 172.21.15.1:0/1722041714 wait complete. 2024-09-21T01:03:37.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.779+0000 7fd64dc42740 20 client.17064 trim_cache size 0 max 16384 2024-09-21T01:03:37.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T01:03:37.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T01:03:37.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T01:03:37.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T01:03:37.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.780+0000 7fd646bf9640 1 -- 172.21.15.1:0/1064171454 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd6300b6510 msgr2=0x7fd6300b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:37.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.780+0000 7fd646bf9640 1 --2- 172.21.15.1:0/1064171454 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd6300b6510 0x7fd6300b8a20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd6340a9550 tx=0x7fd634094040 comp rx=0 tx=0).stop 2024-09-21T01:03:37.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.780+0000 7fd646bf9640 1 -- 172.21.15.1:0/1064171454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6401025c0 msgr2=0x7fd640198dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:37.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.780+0000 7fd646bf9640 1 --2- 172.21.15.1:0/1064171454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6401025c0 0x7fd640198dd0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fd63400d770 tx=0x7fd63400dc30 comp rx=0 tx=0).stop 2024-09-21T01:03:37.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.780+0000 7fd646bf9640 1 -- 172.21.15.1:0/1064171454 shutdown_connections 2024-09-21T01:03:37.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.780+0000 7fd646bf9640 1 --2- 172.21.15.1:0/1064171454 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd640103fe0 0x7fd640199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:37.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.780+0000 7fd646bf9640 1 --2- 172.21.15.1:0/1064171454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd640103640 0x7fd640199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:37.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.780+0000 7fd646bf9640 1 --2- 172.21.15.1:0/1064171454 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd6300b6510 0x7fd6300b8a20 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:37.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.780+0000 7fd646bf9640 1 --2- 172.21.15.1:0/1064171454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6401025c0 0x7fd640198dd0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:37.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.780+0000 7fd646bf9640 1 -- 172.21.15.1:0/1064171454 >> 172.21.15.1:0/1064171454 conn(0x7fd6400fdf00 msgr2=0x7fd640106960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:37.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.780+0000 7fd646bf9640 1 -- 172.21.15.1:0/1064171454 shutdown_connections 2024-09-21T01:03:37.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:37.780+0000 7fd646bf9640 1 -- 172.21.15.1:0/1064171454 wait complete. 2024-09-21T01:03:39.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:39 smithi001 ceph-mon[31211]: pgmap v551: 97 pgs: 97 active+clean; 741 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 674 op/s 2024-09-21T01:03:39.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:39 smithi193 ceph-mon[34660]: pgmap v551: 97 pgs: 97 active+clean; 741 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 674 op/s 2024-09-21T01:03:39.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:39 smithi042 ceph-mon[34481]: pgmap v551: 97 pgs: 97 active+clean; 741 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 674 op/s 2024-09-21T01:03:41.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:41 smithi001 ceph-mon[31211]: pgmap v552: 97 pgs: 97 active+clean; 741 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 657 op/s 2024-09-21T01:03:41.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:41 smithi193 ceph-mon[34660]: pgmap v552: 97 pgs: 97 active+clean; 741 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 657 op/s 2024-09-21T01:03:41.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:41 smithi042 ceph-mon[34481]: pgmap v552: 97 pgs: 97 active+clean; 741 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 657 op/s 2024-09-21T01:03:43.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:43 smithi001 ceph-mon[31211]: pgmap v553: 97 pgs: 97 active+clean; 740 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 726 op/s 2024-09-21T01:03:43.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:43 smithi193 ceph-mon[34660]: pgmap v553: 97 pgs: 97 active+clean; 740 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 726 op/s 2024-09-21T01:03:43.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:43 smithi042 ceph-mon[34481]: pgmap v553: 97 pgs: 97 active+clean; 740 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 726 op/s 2024-09-21T01:03:45.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:45 smithi001 ceph-mon[31211]: pgmap v554: 97 pgs: 97 active+clean; 742 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 748 op/s 2024-09-21T01:03:45.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:45 smithi193 ceph-mon[34660]: pgmap v554: 97 pgs: 97 active+clean; 742 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 748 op/s 2024-09-21T01:03:45.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:45 smithi042 ceph-mon[34481]: pgmap v554: 97 pgs: 97 active+clean; 742 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 748 op/s 2024-09-21T01:03:47.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:47 smithi001 ceph-mon[31211]: pgmap v555: 97 pgs: 97 active+clean; 742 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1003 KiB/s wr, 750 op/s 2024-09-21T01:03:47.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:47 smithi193 ceph-mon[34660]: pgmap v555: 97 pgs: 97 active+clean; 742 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1003 KiB/s wr, 750 op/s 2024-09-21T01:03:47.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:47 smithi042 ceph-mon[34481]: pgmap v555: 97 pgs: 97 active+clean; 742 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1003 KiB/s wr, 750 op/s 2024-09-21T01:03:49.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:49 smithi001 ceph-mon[31211]: pgmap v556: 97 pgs: 97 active+clean; 744 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 716 KiB/s wr, 701 op/s 2024-09-21T01:03:49.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:49 smithi193 ceph-mon[34660]: pgmap v556: 97 pgs: 97 active+clean; 744 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 716 KiB/s wr, 701 op/s 2024-09-21T01:03:49.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:49 smithi042 ceph-mon[34481]: pgmap v556: 97 pgs: 97 active+clean; 744 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 716 KiB/s wr, 701 op/s 2024-09-21T01:03:50.887 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.883+0000 7f5caea27640 1 -- 172.21.15.1:0/3597476518 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ca8103fe0 msgr2=0x7f5ca810a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:50.887 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.883+0000 7f5caea27640 1 --2- 172.21.15.1:0/3597476518 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ca8103fe0 0x7f5ca810a980 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0009be0 tx=0x7f5ca002a6c0 comp rx=0 tx=0).stop 2024-09-21T01:03:50.887 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.883+0000 7f5caea27640 1 -- 172.21.15.1:0/3597476518 shutdown_connections 2024-09-21T01:03:50.887 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.883+0000 7f5caea27640 1 --2- 172.21.15.1:0/3597476518 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ca8103fe0 0x7f5ca810a980 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:50.887 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.883+0000 7f5caea27640 1 --2- 172.21.15.1:0/3597476518 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ca8103640 0x7f5ca8103a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:50.888 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.883+0000 7f5caea27640 1 --2- 172.21.15.1:0/3597476518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ca81025c0 0x7f5ca8102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:50.888 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.883+0000 7f5caea27640 1 -- 172.21.15.1:0/3597476518 >> 172.21.15.1:0/3597476518 conn(0x7f5ca80fdf00 msgr2=0x7f5ca81003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:50.888 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.883+0000 7f5caea27640 1 -- 172.21.15.1:0/3597476518 shutdown_connections 2024-09-21T01:03:50.888 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.883+0000 7f5caea27640 1 -- 172.21.15.1:0/3597476518 wait complete. 2024-09-21T01:03:50.888 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.884+0000 7f5caea27640 1 Processor -- start 2024-09-21T01:03:50.888 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.884+0000 7f5caea27640 1 -- start start 2024-09-21T01:03:50.888 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.884+0000 7f5caea27640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ca81025c0 0x7f5ca8198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:50.888 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.884+0000 7f5caea27640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ca8103640 0x7f5ca8199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:50.888 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.884+0000 7f5caea27640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ca8103fe0 0x7f5ca8199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:50.888 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.884+0000 7f5caea27640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca810e1f0 con 0x7f5ca8103fe0 2024-09-21T01:03:50.888 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.884+0000 7f5caea27640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca810e070 con 0x7f5ca8103640 2024-09-21T01:03:50.888 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.884+0000 7f5caea27640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca810e370 con 0x7f5ca81025c0 2024-09-21T01:03:50.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.884+0000 7f5cacfc4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ca8103fe0 0x7f5ca8199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:50.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.884+0000 7f5ca77fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ca8103640 0x7f5ca8199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:50.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.884+0000 7f5cacfc4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ca8103fe0 0x7f5ca8199fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54450/0 (socket says 172.21.15.1:54450) 2024-09-21T01:03:50.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.884+0000 7f5cacfc4640 1 -- 172.21.15.1:0/2589092806 learned_addr learned my addr 172.21.15.1:0/2589092806 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:50.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.885+0000 7f5ca7fff640 1 --2- 172.21.15.1:0/2589092806 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ca81025c0 0x7f5ca8198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:50.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.885+0000 7f5cacfc4640 1 -- 172.21.15.1:0/2589092806 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ca81025c0 msgr2=0x7f5ca8198d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:50.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.885+0000 7f5cacfc4640 1 --2- 172.21.15.1:0/2589092806 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ca81025c0 0x7f5ca8198d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:50.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.885+0000 7f5cacfc4640 1 -- 172.21.15.1:0/2589092806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ca8103640 msgr2=0x7f5ca8199400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:50.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.885+0000 7f5cacfc4640 1 --2- 172.21.15.1:0/2589092806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ca8103640 0x7f5ca8199400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:50.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.885+0000 7f5cacfc4640 1 -- 172.21.15.1:0/2589092806 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca819a7d0 con 0x7f5ca8103fe0 2024-09-21T01:03:50.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.885+0000 7f5ca77fe640 1 --2- 172.21.15.1:0/2589092806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ca8103640 0x7f5ca8199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:03:50.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.885+0000 7f5cacfc4640 1 --2- 172.21.15.1:0/2589092806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ca8103fe0 0x7f5ca8199fb0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0034040 tx=0x7f5ca0030d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:50.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.885+0000 7f5ca57fa640 1 -- 172.21.15.1:0/2589092806 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca0041020 con 0x7f5ca8103fe0 2024-09-21T01:03:50.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.885+0000 7f5caea27640 1 -- 172.21.15.1:0/2589092806 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ca819aa60 con 0x7f5ca8103fe0 2024-09-21T01:03:50.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.885+0000 7f5ca57fa640 1 -- 172.21.15.1:0/2589092806 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ca00318f0 con 0x7f5ca8103fe0 2024-09-21T01:03:50.890 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.885+0000 7f5ca57fa640 1 -- 172.21.15.1:0/2589092806 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca0036040 con 0x7f5ca8103fe0 2024-09-21T01:03:50.890 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.885+0000 7f5caea27640 1 -- 172.21.15.1:0/2589092806 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ca819ad70 con 0x7f5ca8103fe0 2024-09-21T01:03:50.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.888+0000 7f5cb5a6e740 1 Processor -- start 2024-09-21T01:03:50.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.889+0000 7f5ca57fa640 1 -- 172.21.15.1:0/2589092806 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f5ca0044020 con 0x7f5ca8103fe0 2024-09-21T01:03:50.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.889+0000 7f5cb5a6e740 1 -- start start 2024-09-21T01:03:50.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.889+0000 7f5cb5a6e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f902f11b0 0x559f90698e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:50.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.889+0000 7f5cb5a6e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f902c82f0 0x559f906994c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:50.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.889+0000 7f5cb5a6e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f902d04d0 0x559f9069a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:50.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.889+0000 7f5cb5a6e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559f9060b6f0 con 0x559f902c82f0 2024-09-21T01:03:50.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.889+0000 7f5cb5a6e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559f905fab20 con 0x559f902f11b0 2024-09-21T01:03:50.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.889+0000 7f5cb5a6e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559f905fe930 con 0x559f902d04d0 2024-09-21T01:03:50.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.889+0000 7f5ca7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f902c82f0 0x559f906994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:50.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.889+0000 7f5ca7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f902c82f0 0x559f906994c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54452/0 (socket says 172.21.15.1:54452) 2024-09-21T01:03:50.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.889+0000 7f5ca7fff640 1 -- 172.21.15.1:0/36811973 learned_addr learned my addr 172.21.15.1:0/36811973 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:50.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.889+0000 7f5ca77fe640 1 --2- 172.21.15.1:0/36811973 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f902f11b0 0x559f90698e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:50.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.889+0000 7f5ca77fe640 1 --2- 172.21.15.1:0/36811973 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f902d04d0 0x559f9069a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:50.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.889+0000 7f5ca7fff640 1 -- 172.21.15.1:0/36811973 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f902d04d0 msgr2=0x559f9069a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:50.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.889+0000 7f5ca7fff640 1 --2- 172.21.15.1:0/36811973 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f902d04d0 0x559f9069a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:50.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.889+0000 7f5ca7fff640 1 -- 172.21.15.1:0/36811973 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f902f11b0 msgr2=0x559f90698e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:50.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.889+0000 7f5ca7fff640 1 --2- 172.21.15.1:0/36811973 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f902f11b0 0x559f90698e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:50.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.889+0000 7f5ca7fff640 1 -- 172.21.15.1:0/36811973 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f905c0530 con 0x559f902c82f0 2024-09-21T01:03:50.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.889+0000 7f5ca77fe640 1 --2- 172.21.15.1:0/36811973 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f902f11b0 0x559f90698e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:03:50.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.889+0000 7f5ca57fa640 1 --2- 172.21.15.1:0/2589092806 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5c900b6510 0x7f5c900b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:50.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.890+0000 7f5ca7fff640 1 --2- 172.21.15.1:0/36811973 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f902c82f0 0x559f906994c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f5c98009d20 tx=0x7f5c980117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79ada8bb098c3c1c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:50.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.890+0000 7f5ca77fe640 1 --2- 172.21.15.1:0/2589092806 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5c900b6510 0x7f5c900b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:50.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.890+0000 7f5ca57fa640 1 -- 172.21.15.1:0/2589092806 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f5ca01080f0 con 0x7f5ca8103fe0 2024-09-21T01:03:50.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.890+0000 7f5c8e7fc640 1 -- 172.21.15.1:0/36811973 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c98012650 con 0x559f902c82f0 2024-09-21T01:03:50.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.890+0000 7f5c8e7fc640 1 -- 172.21.15.1:0/36811973 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c98009e10 con 0x559f902c82f0 2024-09-21T01:03:50.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.890+0000 7f5c8e7fc640 1 -- 172.21.15.1:0/36811973 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9800fb90 con 0x559f902c82f0 2024-09-21T01:03:50.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.891+0000 7f5cb5a6e740 1 -- 172.21.15.1:0/36811973 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f902c82f0 msgr2=0x559f906994c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:50.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.891+0000 7f5cb5a6e740 1 --2- 172.21.15.1:0/36811973 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f902c82f0 0x559f906994c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f5c98009d20 tx=0x7f5c980117b0 comp rx=0 tx=0).stop 2024-09-21T01:03:50.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.891+0000 7f5ca77fe640 1 --2- 172.21.15.1:0/2589092806 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5c900b6510 0x7f5c900b8a20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c0058c0 tx=0x7f5c9c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:50.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.891+0000 7f5cb5a6e740 1 -- 172.21.15.1:0/36811973 shutdown_connections 2024-09-21T01:03:50.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.891+0000 7f5cb5a6e740 1 --2- 172.21.15.1:0/36811973 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f902d04d0 0x559f9069a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:50.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.891+0000 7f5cb5a6e740 1 --2- 172.21.15.1:0/36811973 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f902c82f0 0x559f906994c0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:50.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.891+0000 7f5cb5a6e740 1 --2- 172.21.15.1:0/36811973 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f902f11b0 0x559f90698e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:50.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.891+0000 7f5cb5a6e740 1 -- 172.21.15.1:0/36811973 >> 172.21.15.1:0/36811973 conn(0x559f902e5300 msgr2=0x559f906948e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:50.899 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.891+0000 7f5cb5a6e740 1 -- 172.21.15.1:0/36811973 shutdown_connections 2024-09-21T01:03:50.899 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.891+0000 7f5cb5a6e740 1 -- 172.21.15.1:0/36811973 wait complete. 2024-09-21T01:03:50.899 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.891+0000 7f5cb5a6e740 1 -- start start 2024-09-21T01:03:50.899 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.892+0000 7f5cb5a6e740 1 Processor -- start 2024-09-21T01:03:50.899 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.892+0000 7f5cb5a6e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f902c82f0 0x559f906a2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:50.899 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.892+0000 7f5cb5a6e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f902d04d0 0x559f906a2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:50.899 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.892+0000 7f5cb5a6e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f902f11b0 0x559f906a37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:50.899 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.892+0000 7f5cb5a6e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559f90532ab0 con 0x559f902c82f0 2024-09-21T01:03:50.899 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.892+0000 7f5cb5a6e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559f905a0730 con 0x559f902f11b0 2024-09-21T01:03:50.899 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.892+0000 7f5cb5a6e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559f9069ab30 con 0x559f902d04d0 2024-09-21T01:03:50.899 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.892+0000 7f5cb5a6e740 10 client.0 _ll_register_callbacks cb 0x559f905f46b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:03:50.899 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.892+0000 7f5ca7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f902c82f0 0x559f906a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:50.899 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.892+0000 7f5ca7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f902c82f0 0x559f906a2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54462/0 (socket says 172.21.15.1:54462) 2024-09-21T01:03:50.899 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.892+0000 7f5ca7fff640 1 -- 172.21.15.1:0/2069518276 learned_addr learned my addr 172.21.15.1:0/2069518276 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:50.900 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.892+0000 7f5ca77fe640 1 --2- 172.21.15.1:0/2069518276 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f902d04d0 0x559f906a2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:50.900 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.892+0000 7f5cacfc4640 1 --2- 172.21.15.1:0/2069518276 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f902f11b0 0x559f906a37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:50.900 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.892+0000 7f5ca7fff640 1 -- 172.21.15.1:0/2069518276 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f902d04d0 msgr2=0x559f906a2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:50.900 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.892+0000 7f5ca7fff640 1 --2- 172.21.15.1:0/2069518276 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f902d04d0 0x559f906a2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:50.900 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.892+0000 7f5ca7fff640 1 -- 172.21.15.1:0/2069518276 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f902f11b0 msgr2=0x559f906a37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:50.900 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.892+0000 7f5ca7fff640 1 --2- 172.21.15.1:0/2069518276 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f902f11b0 0x559f906a37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:50.900 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.892+0000 7f5ca7fff640 1 -- 172.21.15.1:0/2069518276 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f9035c790 con 0x559f902c82f0 2024-09-21T01:03:50.900 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.892+0000 7f5ca77fe640 1 --2- 172.21.15.1:0/2069518276 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f902d04d0 0x559f906a2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:03:50.900 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.893+0000 7f5ca7fff640 1 --2- 172.21.15.1:0/2069518276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f902c82f0 0x559f906a2580 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f5c98009cf0 tx=0x7f5c9800fb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a72b40f974e0279 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:50.900 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.893+0000 7f5c877fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:03:50.900 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.893+0000 7f5c877fe640 1 -- 172.21.15.1:0/2069518276 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c98028020 con 0x559f902c82f0 2024-09-21T01:03:50.900 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.893+0000 7f5c877fe640 1 -- 172.21.15.1:0/2069518276 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f5c98005250 con 0x559f902c82f0 2024-09-21T01:03:50.900 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.893+0000 7f5cb5a6e740 1 -- 172.21.15.1:0/2069518276 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c98009e10 con 0x559f902c82f0 2024-09-21T01:03:50.900 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.893+0000 7f5c877fe640 1 -- 172.21.15.1:0/2069518276 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5c98033050 con 0x559f902c82f0 2024-09-21T01:03:50.900 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.893+0000 7f5cb5a6e740 10 client.17076 fetch_fsmap learned FSMap version 34 2024-09-21T01:03:50.901 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.893+0000 7f5cb5a6e740 1 -- 172.21.15.1:0/2069518276 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x559f903d5620 con 0x559f902c82f0 2024-09-21T01:03:50.901 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.893+0000 7f5c877fe640 1 -- 172.21.15.1:0/2069518276 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c98009e10 con 0x559f902c82f0 2024-09-21T01:03:50.901 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.893+0000 7f5c877fe640 1 -- 172.21.15.1:0/2069518276 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 34) ==== 8374+0+0 (secure 0 0 0) 0x7f5c98004c20 con 0x559f902c82f0 2024-09-21T01:03:50.901 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.893+0000 7f5cb5a6e740 10 client.17076 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T01:03:50.901 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.893+0000 7f5cb5a6e740 10 client.17076 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:03:50.901 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.893+0000 7f5cb5a6e740 20 client.17076 populate_metadata read hostname 'smithi001' 2024-09-21T01:03:50.901 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.893+0000 7f5cb5a6e740 1 --2- 172.21.15.1:0/2069518276 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x559f902afd80 0x559f906afa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:50.901 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.893+0000 7f5cb5a6e740 4 client.17076 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:03:50.901 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.894+0000 7f5cb5a6e740 1 -- 172.21.15.1:0/2069518276 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f9060d640 con 0x559f902afd80 2024-09-21T01:03:50.901 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.894+0000 7f5ca77fe640 1 --2- 172.21.15.1:0/2069518276 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x559f902afd80 0x559f906afa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:50.901 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.894+0000 7f5c877fe640 10 client.17076 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:03:50.902 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.894+0000 7f5ca77fe640 1 --2- 172.21.15.1:0/2069518276 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x559f902afd80 0x559f906afa20 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74ee0f7e1ebfb49b server_cookie=ccf31a6da4cf0ede in_seq=0 out_seq=0 2024-09-21T01:03:50.902 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.895+0000 7f5c877fe640 1 -- 172.21.15.1:0/2069518276 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559f9060d640 con 0x559f902afd80 2024-09-21T01:03:50.902 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.895+0000 7f5c877fe640 10 client.17076 handle_command_reply: tid=0 2024-09-21T01:03:50.902 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.895+0000 7f5cb5a6e740 1 client.17076 shutdown 2024-09-21T01:03:50.902 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.895+0000 7f5cb5a6e740 1 -- 172.21.15.1:0/2069518276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f902c82f0 msgr2=0x559f906a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:50.902 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.895+0000 7f5cb5a6e740 1 --2- 172.21.15.1:0/2069518276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f902c82f0 0x559f906a2580 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f5c98009cf0 tx=0x7f5c9800fb40 comp rx=0 tx=0).stop 2024-09-21T01:03:50.902 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.895+0000 7f5cb5a6e740 1 -- 172.21.15.1:0/2069518276 shutdown_connections 2024-09-21T01:03:50.902 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.895+0000 7f5cb5a6e740 1 --2- 172.21.15.1:0/2069518276 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x559f902afd80 0x559f906afa20 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:50.902 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.895+0000 7f5cb5a6e740 1 --2- 172.21.15.1:0/2069518276 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f902f11b0 0x559f906a37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:50.902 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.895+0000 7f5cb5a6e740 1 --2- 172.21.15.1:0/2069518276 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f902d04d0 0x559f906a2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:50.902 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.895+0000 7f5cb5a6e740 1 --2- 172.21.15.1:0/2069518276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f902c82f0 0x559f906a2580 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:50.902 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.895+0000 7f5c877fe640 0 client.17076 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:03:50.902 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.895+0000 7f5cb5a6e740 1 -- 172.21.15.1:0/2069518276 >> 172.21.15.1:0/2069518276 conn(0x559f902e5300 msgr2=0x559f90692ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:50.902 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.895+0000 7f5cb5a6e740 1 -- 172.21.15.1:0/2069518276 shutdown_connections 2024-09-21T01:03:50.902 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.895+0000 7f5cb5a6e740 1 -- 172.21.15.1:0/2069518276 wait complete. 2024-09-21T01:03:50.903 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.895+0000 7f5cb5a6e740 20 client.17076 trim_cache size 0 max 16384 2024-09-21T01:03:50.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.910+0000 7f5cb5a6e740 1 Processor -- start 2024-09-21T01:03:50.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.910+0000 7f5cb5a6e740 1 -- start start 2024-09-21T01:03:50.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.911+0000 7f5cb5a6e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f902c82f0 0x559f906a11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:50.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.911+0000 7f5cb5a6e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f902d04d0 0x559f906aa690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:50.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.911+0000 7f5cb5a6e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f902f11b0 0x559f90694d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:50.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.911+0000 7f5cb5a6e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca81aaf90 con 0x559f902f11b0 2024-09-21T01:03:50.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.911+0000 7f5cb5a6e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca81acb60 con 0x559f902c82f0 2024-09-21T01:03:50.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.911+0000 7f5cb5a6e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca81ab660 con 0x559f902d04d0 2024-09-21T01:03:50.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.911+0000 7f5cacfc4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f902f11b0 0x559f90694d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:50.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.911+0000 7f5ca7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f902c82f0 0x559f906a11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:50.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.911+0000 7f5ca7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f902c82f0 0x559f906a11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:40704/0 (socket says 172.21.15.1:40704) 2024-09-21T01:03:50.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.911+0000 7f5ca7fff640 1 -- 172.21.15.1:0/2038272267 learned_addr learned my addr 172.21.15.1:0/2038272267 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:50.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.911+0000 7f5cacfc4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f902f11b0 0x559f90694d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54474/0 (socket says 172.21.15.1:54474) 2024-09-21T01:03:50.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.911+0000 7f5ca77fe640 1 --2- 172.21.15.1:0/2038272267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f902d04d0 0x559f906aa690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:50.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.911+0000 7f5cacfc4640 1 -- 172.21.15.1:0/2038272267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f902d04d0 msgr2=0x559f906aa690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:50.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.911+0000 7f5cacfc4640 1 --2- 172.21.15.1:0/2038272267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f902d04d0 0x559f906aa690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:50.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.911+0000 7f5cacfc4640 1 -- 172.21.15.1:0/2038272267 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f902c82f0 msgr2=0x559f906a11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:50.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.911+0000 7f5cacfc4640 1 --2- 172.21.15.1:0/2038272267 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f902c82f0 0x559f906a11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:50.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.911+0000 7f5cacfc4640 1 -- 172.21.15.1:0/2038272267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f906a3b20 con 0x559f902f11b0 2024-09-21T01:03:50.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.911+0000 7f5cacfc4640 1 --2- 172.21.15.1:0/2038272267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f902f11b0 0x559f90694d90 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0105f40 tx=0x7f5ca00308a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c58ae916af713f1f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:50.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.912+0000 7f5c8dffb640 1 -- 172.21.15.1:0/2038272267 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca00ce960 con 0x559f902f11b0 2024-09-21T01:03:50.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.912+0000 7f5c8dffb640 1 -- 172.21.15.1:0/2038272267 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ca00d2d40 con 0x559f902f11b0 2024-09-21T01:03:50.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.912+0000 7f5c8dffb640 1 -- 172.21.15.1:0/2038272267 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca00d77f0 con 0x559f902f11b0 2024-09-21T01:03:50.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.912+0000 7f5cb5a6e740 1 -- 172.21.15.1:0/2038272267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f902f11b0 msgr2=0x559f90694d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:50.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.912+0000 7f5cb5a6e740 1 --2- 172.21.15.1:0/2038272267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f902f11b0 0x559f90694d90 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0105f40 tx=0x7f5ca00308a0 comp rx=0 tx=0).stop 2024-09-21T01:03:50.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.913+0000 7f5cb5a6e740 1 -- 172.21.15.1:0/2038272267 shutdown_connections 2024-09-21T01:03:50.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.913+0000 7f5cb5a6e740 1 --2- 172.21.15.1:0/2038272267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f902f11b0 0x559f90694d90 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:50.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.913+0000 7f5cb5a6e740 1 --2- 172.21.15.1:0/2038272267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f902d04d0 0x559f906aa690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:50.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.913+0000 7f5cb5a6e740 1 --2- 172.21.15.1:0/2038272267 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f902c82f0 0x559f906a11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:50.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.913+0000 7f5cb5a6e740 1 -- 172.21.15.1:0/2038272267 >> 172.21.15.1:0/2038272267 conn(0x559f902e5300 msgr2=0x559f906a0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:50.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.913+0000 7f5cb5a6e740 1 -- 172.21.15.1:0/2038272267 shutdown_connections 2024-09-21T01:03:50.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.913+0000 7f5cb5a6e740 1 -- 172.21.15.1:0/2038272267 wait complete. 2024-09-21T01:03:50.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.913+0000 7f5cb5a6e740 1 -- start start 2024-09-21T01:03:50.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.913+0000 7f5cb5a6e740 1 Processor -- start 2024-09-21T01:03:50.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.914+0000 7f5cb5a6e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f902c82f0 0x559f906aa190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.914+0000 7f5cb5a6e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f902d04d0 0x559f906a8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.914+0000 7f5cb5a6e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f902f11b0 0x559f906a9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.914+0000 7f5cb5a6e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca81ac490 con 0x559f902c82f0 2024-09-21T01:03:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.914+0000 7f5cb5a6e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca81abdc0 con 0x559f902d04d0 2024-09-21T01:03:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.914+0000 7f5cb5a6e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca81a8f70 con 0x559f902f11b0 2024-09-21T01:03:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.914+0000 7f5cb5a6e740 10 client.0 _ll_register_callbacks cb 0x7f5c98009b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:03:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.914+0000 7f5ca7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f902c82f0 0x559f906aa190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.914+0000 7f5ca7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f902c82f0 0x559f906aa190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54490/0 (socket says 172.21.15.1:54490) 2024-09-21T01:03:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.914+0000 7f5ca7fff640 1 -- 172.21.15.1:0/3733397192 learned_addr learned my addr 172.21.15.1:0/3733397192 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.914+0000 7f5ca77fe640 1 --2- 172.21.15.1:0/3733397192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f902d04d0 0x559f906a8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.914+0000 7f5cacfc4640 1 --2- 172.21.15.1:0/3733397192 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f902f11b0 0x559f906a9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.914+0000 7f5ca7fff640 1 -- 172.21.15.1:0/3733397192 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f902f11b0 msgr2=0x559f906a9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.914+0000 7f5ca7fff640 1 --2- 172.21.15.1:0/3733397192 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f902f11b0 0x559f906a9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.914+0000 7f5ca7fff640 1 -- 172.21.15.1:0/3733397192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f902d04d0 msgr2=0x559f906a8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.914+0000 7f5ca7fff640 1 --2- 172.21.15.1:0/3733397192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f902d04d0 0x559f906a8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:50.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.914+0000 7f5ca7fff640 1 -- 172.21.15.1:0/3733397192 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f906a9980 con 0x559f902c82f0 2024-09-21T01:03:50.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.914+0000 7f5cacfc4640 1 --2- 172.21.15.1:0/3733397192 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f902f11b0 0x559f906a9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:03:50.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.914+0000 7f5ca7fff640 1 --2- 172.21.15.1:0/3733397192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f902c82f0 0x559f906aa190 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f5c98009c40 tx=0x7f5c9800ff40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d1ba47c2f512f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:50.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.914+0000 7f5c877fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:03:50.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.914+0000 7f5c877fe640 1 -- 172.21.15.1:0/3733397192 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c98028040 con 0x559f902c82f0 2024-09-21T01:03:50.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.914+0000 7f5c877fe640 1 -- 172.21.15.1:0/3733397192 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f5c98003d50 con 0x559f902c82f0 2024-09-21T01:03:50.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.914+0000 7f5cb5a6e740 1 -- 172.21.15.1:0/3733397192 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ca00d2d40 con 0x559f902c82f0 2024-09-21T01:03:50.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.915+0000 7f5c877fe640 1 -- 172.21.15.1:0/3733397192 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5c98046050 con 0x559f902c82f0 2024-09-21T01:03:50.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.915+0000 7f5cb5a6e740 10 client.17082 fetch_fsmap learned FSMap version 34 2024-09-21T01:03:50.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.915+0000 7f5cb5a6e740 1 -- 172.21.15.1:0/3733397192 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x559f906a8860 con 0x559f902c82f0 2024-09-21T01:03:50.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.915+0000 7f5c877fe640 1 -- 172.21.15.1:0/3733397192 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ca00d2d40 con 0x559f902c82f0 2024-09-21T01:03:50.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.915+0000 7f5c877fe640 1 -- 172.21.15.1:0/3733397192 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 34) ==== 8374+0+0 (secure 0 0 0) 0x7f5c9800f440 con 0x559f902c82f0 2024-09-21T01:03:50.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.915+0000 7f5cb5a6e740 10 client.17082 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T01:03:50.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.915+0000 7f5cb5a6e740 10 client.17082 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:03:50.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.915+0000 7f5cb5a6e740 20 client.17082 populate_metadata read hostname 'smithi001' 2024-09-21T01:03:50.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.915+0000 7f5cb5a6e740 1 --2- 172.21.15.1:0/3733397192 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x559f902851c0 0x559f9071cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:50.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.915+0000 7f5cb5a6e740 4 client.17082 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:03:50.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.915+0000 7f5cb5a6e740 1 -- 172.21.15.1:0/3733397192 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559f906090f0 con 0x559f902851c0 2024-09-21T01:03:50.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.915+0000 7f5ca77fe640 1 --2- 172.21.15.1:0/3733397192 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x559f902851c0 0x559f9071cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:50.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.916+0000 7f5ca77fe640 1 --2- 172.21.15.1:0/3733397192 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x559f902851c0 0x559f9071cb90 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f57713b7e386a91c server_cookie=828c453303f76b32 in_seq=0 out_seq=0 2024-09-21T01:03:50.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.916+0000 7f5c877fe640 10 client.17082 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:03:50.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.936+0000 7f5c877fe640 1 -- 172.21.15.1:0/3733397192 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559f906090f0 con 0x559f902851c0 2024-09-21T01:03:50.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.936+0000 7f5c877fe640 10 client.17082 handle_command_reply: tid=0 2024-09-21T01:03:50.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.936+0000 7f5cb5a6e740 1 client.17082 shutdown 2024-09-21T01:03:50.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.936+0000 7f5cb5a6e740 1 -- 172.21.15.1:0/3733397192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f902c82f0 msgr2=0x559f906aa190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:50.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.936+0000 7f5cb5a6e740 1 --2- 172.21.15.1:0/3733397192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f902c82f0 0x559f906aa190 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f5c98009c40 tx=0x7f5c9800ff40 comp rx=0 tx=0).stop 2024-09-21T01:03:50.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.936+0000 7f5cb5a6e740 1 -- 172.21.15.1:0/3733397192 shutdown_connections 2024-09-21T01:03:50.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.936+0000 7f5cb5a6e740 1 --2- 172.21.15.1:0/3733397192 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x559f902851c0 0x559f9071cb90 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:50.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.936+0000 7f5cb5a6e740 1 --2- 172.21.15.1:0/3733397192 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f902f11b0 0x559f906a9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:50.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.936+0000 7f5c877fe640 0 client.17082 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:03:50.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.936+0000 7f5cb5a6e740 1 --2- 172.21.15.1:0/3733397192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f902d04d0 0x559f906a8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:50.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.936+0000 7f5cb5a6e740 1 --2- 172.21.15.1:0/3733397192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f902c82f0 0x559f906aa190 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:50.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.936+0000 7f5cb5a6e740 1 -- 172.21.15.1:0/3733397192 >> 172.21.15.1:0/3733397192 conn(0x559f902e5300 msgr2=0x559f906a0660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:50.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.936+0000 7f5cb5a6e740 1 -- 172.21.15.1:0/3733397192 shutdown_connections 2024-09-21T01:03:50.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.936+0000 7f5cb5a6e740 1 -- 172.21.15.1:0/3733397192 wait complete. 2024-09-21T01:03:50.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.936+0000 7f5cb5a6e740 20 client.17082 trim_cache size 0 max 16384 2024-09-21T01:03:50.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T01:03:50.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T01:03:50.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T01:03:50.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T01:03:50.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.936+0000 7f5caea27640 1 -- 172.21.15.1:0/2589092806 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5c900b6510 msgr2=0x7f5c900b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:50.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.936+0000 7f5caea27640 1 --2- 172.21.15.1:0/2589092806 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5c900b6510 0x7f5c900b8a20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c0058c0 tx=0x7f5c9c005850 comp rx=0 tx=0).stop 2024-09-21T01:03:50.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.936+0000 7f5caea27640 1 -- 172.21.15.1:0/2589092806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ca8103fe0 msgr2=0x7f5ca8199fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:50.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.936+0000 7f5caea27640 1 --2- 172.21.15.1:0/2589092806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ca8103fe0 0x7f5ca8199fb0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0034040 tx=0x7f5ca0030d20 comp rx=0 tx=0).stop 2024-09-21T01:03:50.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.936+0000 7f5caea27640 1 -- 172.21.15.1:0/2589092806 shutdown_connections 2024-09-21T01:03:50.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.936+0000 7f5caea27640 1 --2- 172.21.15.1:0/2589092806 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f5c900b6510 0x7f5c900b8a20 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:50.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.936+0000 7f5caea27640 1 --2- 172.21.15.1:0/2589092806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ca8103fe0 0x7f5ca8199fb0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:50.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.936+0000 7f5caea27640 1 --2- 172.21.15.1:0/2589092806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ca8103640 0x7f5ca8199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:50.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.936+0000 7f5caea27640 1 --2- 172.21.15.1:0/2589092806 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ca81025c0 0x7f5ca8198d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:50.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.936+0000 7f5caea27640 1 -- 172.21.15.1:0/2589092806 >> 172.21.15.1:0/2589092806 conn(0x7f5ca80fdf00 msgr2=0x7f5ca8106940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:50.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.936+0000 7f5caea27640 1 -- 172.21.15.1:0/2589092806 shutdown_connections 2024-09-21T01:03:50.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:03:50.936+0000 7f5caea27640 1 -- 172.21.15.1:0/2589092806 wait complete. 2024-09-21T01:03:51.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:51 smithi001 ceph-mon[31211]: pgmap v557: 97 pgs: 97 active+clean; 744 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 940 KiB/s rd, 663 KiB/s wr, 743 op/s 2024-09-21T01:03:51.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:51 smithi193 ceph-mon[34660]: pgmap v557: 97 pgs: 97 active+clean; 744 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 940 KiB/s rd, 663 KiB/s wr, 743 op/s 2024-09-21T01:03:51.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:51 smithi042 ceph-mon[34481]: pgmap v557: 97 pgs: 97 active+clean; 744 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 940 KiB/s rd, 663 KiB/s wr, 743 op/s 2024-09-21T01:03:52.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:52 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:03:52.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:52 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:03:52.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:52 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:03:53.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:53 smithi001 ceph-mon[31211]: pgmap v558: 97 pgs: 97 active+clean; 746 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 838 KiB/s wr, 836 op/s 2024-09-21T01:03:53.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:53 smithi193 ceph-mon[34660]: pgmap v558: 97 pgs: 97 active+clean; 746 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 838 KiB/s wr, 836 op/s 2024-09-21T01:03:53.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:53 smithi042 ceph-mon[34481]: pgmap v558: 97 pgs: 97 active+clean; 746 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 838 KiB/s wr, 836 op/s 2024-09-21T01:03:55.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:55 smithi001 ceph-mon[31211]: pgmap v559: 97 pgs: 97 active+clean; 734 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 834 KiB/s rd, 577 KiB/s wr, 694 op/s 2024-09-21T01:03:55.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:55 smithi193 ceph-mon[34660]: pgmap v559: 97 pgs: 97 active+clean; 734 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 834 KiB/s rd, 577 KiB/s wr, 694 op/s 2024-09-21T01:03:55.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:55 smithi042 ceph-mon[34481]: pgmap v559: 97 pgs: 97 active+clean; 734 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 834 KiB/s rd, 577 KiB/s wr, 694 op/s 2024-09-21T01:03:57.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:57 smithi001 ceph-mon[31211]: pgmap v560: 97 pgs: 97 active+clean; 722 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 421 KiB/s wr, 561 op/s 2024-09-21T01:03:57.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:57 smithi193 ceph-mon[34660]: pgmap v560: 97 pgs: 97 active+clean; 722 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 421 KiB/s wr, 561 op/s 2024-09-21T01:03:57.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:57 smithi042 ceph-mon[34481]: pgmap v560: 97 pgs: 97 active+clean; 722 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 421 KiB/s wr, 561 op/s 2024-09-21T01:03:58.010 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:03:58.290 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:03:58.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.832+0000 7f642dd4b640 1 -- 172.21.15.1:0/1278994915 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6428109e00 msgr2=0x7f6428110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:58.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.832+0000 7f642dd4b640 1 --2- 172.21.15.1:0/1278994915 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6428109e00 0x7f6428110630 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f6420009ca0 tx=0x7f642002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.832+0000 7f642dd4b640 1 -- 172.21.15.1:0/1278994915 shutdown_connections 2024-09-21T01:03:58.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.832+0000 7f642dd4b640 1 --2- 172.21.15.1:0/1278994915 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6428109e00 0x7f6428110630 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.832+0000 7f642dd4b640 1 --2- 172.21.15.1:0/1278994915 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64281094b0 0x7f64281098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.832+0000 7f642dd4b640 1 --2- 172.21.15.1:0/1278994915 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6428103bc0 0x7f6428103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.832+0000 7f642dd4b640 1 -- 172.21.15.1:0/1278994915 >> 172.21.15.1:0/1278994915 conn(0x7f642807b910 msgr2=0x7f642807bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:58.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.832+0000 7f642dd4b640 1 -- 172.21.15.1:0/1278994915 shutdown_connections 2024-09-21T01:03:58.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.833+0000 7f642dd4b640 1 -- 172.21.15.1:0/1278994915 wait complete. 2024-09-21T01:03:58.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.833+0000 7f642dd4b640 1 Processor -- start 2024-09-21T01:03:58.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.833+0000 7f642dd4b640 1 -- start start 2024-09-21T01:03:58.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.834+0000 7f642dd4b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6428103bc0 0x7f642819a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:58.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.834+0000 7f642dd4b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64281094b0 0x7f642819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:58.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.834+0000 7f642dd4b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6428109e00 0x7f642819fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:58.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.834+0000 7f642dd4b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6428113ac0 con 0x7f64281094b0 2024-09-21T01:03:58.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.834+0000 7f642dd4b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6428113940 con 0x7f6428103bc0 2024-09-21T01:03:58.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.834+0000 7f642dd4b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6428113c40 con 0x7f6428109e00 2024-09-21T01:03:58.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.834+0000 7f641effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64281094b0 0x7f642819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:58.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.834+0000 7f64277fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6428103bc0 0x7f642819a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:58.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.834+0000 7f64277fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6428103bc0 0x7f642819a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:40730/0 (socket says 172.21.15.1:40730) 2024-09-21T01:03:58.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.834+0000 7f641effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64281094b0 0x7f642819a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54496/0 (socket says 172.21.15.1:54496) 2024-09-21T01:03:58.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.834+0000 7f64277fe640 1 -- 172.21.15.1:0/121026876 learned_addr learned my addr 172.21.15.1:0/121026876 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:58.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.834+0000 7f6427fff640 1 --2- 172.21.15.1:0/121026876 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6428109e00 0x7f642819fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:58.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.834+0000 7f64277fe640 1 -- 172.21.15.1:0/121026876 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6428109e00 msgr2=0x7f642819fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:58.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.834+0000 7f64277fe640 1 --2- 172.21.15.1:0/121026876 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6428109e00 0x7f642819fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.834+0000 7f64277fe640 1 -- 172.21.15.1:0/121026876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64281094b0 msgr2=0x7f642819a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:58.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.834+0000 7f64277fe640 1 --2- 172.21.15.1:0/121026876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64281094b0 0x7f642819a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.834+0000 7f64277fe640 1 -- 172.21.15.1:0/121026876 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64281a03a0 con 0x7f6428103bc0 2024-09-21T01:03:58.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.834+0000 7f641effd640 1 --2- 172.21.15.1:0/121026876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64281094b0 0x7f642819a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:03:58.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.834+0000 7f64277fe640 1 --2- 172.21.15.1:0/121026876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6428103bc0 0x7f642819a430 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f641800d770 tx=0x7f641800dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:58.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.835+0000 7f64257fa640 1 -- 172.21.15.1:0/121026876 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6418017070 con 0x7f6428103bc0 2024-09-21T01:03:58.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.835+0000 7f642dd4b640 1 -- 172.21.15.1:0/121026876 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64281a0690 con 0x7f6428103bc0 2024-09-21T01:03:58.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.835+0000 7f64257fa640 1 -- 172.21.15.1:0/121026876 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64180054d0 con 0x7f6428103bc0 2024-09-21T01:03:58.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.835+0000 7f64257fa640 1 -- 172.21.15.1:0/121026876 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6418004c30 con 0x7f6428103bc0 2024-09-21T01:03:58.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.835+0000 7f642dd4b640 1 -- 172.21.15.1:0/121026876 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64281a6df0 con 0x7f6428103bc0 2024-09-21T01:03:58.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.837+0000 7f64257fa640 1 -- 172.21.15.1:0/121026876 <== mon.2 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f6418004e10 con 0x7f6428103bc0 2024-09-21T01:03:58.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.838+0000 7f64342bf740 1 Processor -- start 2024-09-21T01:03:58.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.838+0000 7f64342bf740 1 -- start start 2024-09-21T01:03:58.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.838+0000 7f64342bf740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eac5250070 0x55eac55f7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:58.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.838+0000 7f64342bf740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eac52271b0 0x55eac55f7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:58.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.838+0000 7f64342bf740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eac522f390 0x55eac55f80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:58.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.838+0000 7f64342bf740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55eac556de50 con 0x55eac5250070 2024-09-21T01:03:58.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.838+0000 7f64342bf740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55eac555d280 con 0x55eac522f390 2024-09-21T01:03:58.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.838+0000 7f64342bf740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55eac5561090 con 0x55eac52271b0 2024-09-21T01:03:58.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.838+0000 7f6427fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eac5250070 0x55eac55f7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:58.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.838+0000 7f64257fa640 1 --2- 172.21.15.1:0/121026876 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f64140b6510 0x7f64140b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:58.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.838+0000 7f6427fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eac5250070 0x55eac55f7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54508/0 (socket says 172.21.15.1:54508) 2024-09-21T01:03:58.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.838+0000 7f6427fff640 1 -- 172.21.15.1:0/4268990757 learned_addr learned my addr 172.21.15.1:0/4268990757 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:58.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.838+0000 7f641effd640 1 --2- 172.21.15.1:0/4268990757 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eac522f390 0x55eac55f80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:58.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.839+0000 7f64277fe640 1 --2- 172.21.15.1:0/4268990757 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eac52271b0 0x55eac55f7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:58.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.839+0000 7f6427fff640 1 --2- 172.21.15.1:0/121026876 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f64140b6510 0x7f64140b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:58.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.839+0000 7f64257fa640 1 -- 172.21.15.1:0/121026876 <== mon.2 v2:172.21.15.42:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f64180e6d60 con 0x7f6428103bc0 2024-09-21T01:03:58.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.839+0000 7f641effd640 1 -- 172.21.15.1:0/4268990757 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eac52271b0 msgr2=0x55eac55f7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:58.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.839+0000 7f641effd640 1 --2- 172.21.15.1:0/4268990757 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eac52271b0 0x55eac55f7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.839+0000 7f641effd640 1 -- 172.21.15.1:0/4268990757 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eac5250070 msgr2=0x55eac55f7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:58.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.839+0000 7f641effd640 1 --2- 172.21.15.1:0/4268990757 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eac5250070 0x55eac55f7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.839+0000 7f641effd640 1 -- 172.21.15.1:0/4268990757 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eac52bb650 con 0x55eac522f390 2024-09-21T01:03:58.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.839+0000 7f641effd640 1 --2- 172.21.15.1:0/4268990757 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eac522f390 0x55eac55f80d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f642806b8a0 tx=0x7f64100118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bca80f0f084bd60a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:58.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.839+0000 7f6427fff640 1 --2- 172.21.15.1:0/121026876 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f64140b6510 0x7f64140b8a20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6420035000 tx=0x7f642002a8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:58.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.839+0000 7f641dffb640 1 -- 172.21.15.1:0/4268990757 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6410004030 con 0x55eac522f390 2024-09-21T01:03:58.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.839+0000 7f641dffb640 1 -- 172.21.15.1:0/4268990757 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64100035f0 con 0x55eac522f390 2024-09-21T01:03:58.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.839+0000 7f641dffb640 1 -- 172.21.15.1:0/4268990757 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641000f740 con 0x55eac522f390 2024-09-21T01:03:58.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.840+0000 7f64342bf740 1 -- 172.21.15.1:0/4268990757 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eac522f390 msgr2=0x55eac55f80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:58.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.840+0000 7f64342bf740 1 --2- 172.21.15.1:0/4268990757 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eac522f390 0x55eac55f80d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f642806b8a0 tx=0x7f64100118d0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.840+0000 7f64342bf740 1 -- 172.21.15.1:0/4268990757 shutdown_connections 2024-09-21T01:03:58.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.840+0000 7f64342bf740 1 --2- 172.21.15.1:0/4268990757 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eac522f390 0x55eac55f80d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.840+0000 7f64342bf740 1 --2- 172.21.15.1:0/4268990757 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eac52271b0 0x55eac55f7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.840+0000 7f64342bf740 1 --2- 172.21.15.1:0/4268990757 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eac5250070 0x55eac55f7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.840+0000 7f64342bf740 1 -- 172.21.15.1:0/4268990757 >> 172.21.15.1:0/4268990757 conn(0x55eac5244460 msgr2=0x55eac55f5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:58.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.840+0000 7f64342bf740 1 -- 172.21.15.1:0/4268990757 shutdown_connections 2024-09-21T01:03:58.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.840+0000 7f64342bf740 1 -- 172.21.15.1:0/4268990757 wait complete. 2024-09-21T01:03:58.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.841+0000 7f64342bf740 1 -- start start 2024-09-21T01:03:58.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.841+0000 7f64342bf740 1 Processor -- start 2024-09-21T01:03:58.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.841+0000 7f64342bf740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eac52271b0 0x55eac5602c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:58.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.841+0000 7f64342bf740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eac522f390 0x55eac56031b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:58.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.841+0000 7f64342bf740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eac5250070 0x55eac5603710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:58.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.841+0000 7f64342bf740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55eac53be700 con 0x55eac5250070 2024-09-21T01:03:58.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.841+0000 7f64342bf740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55eac54f8110 con 0x55eac522f390 2024-09-21T01:03:58.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.841+0000 7f64342bf740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55eac5605e30 con 0x55eac52271b0 2024-09-21T01:03:58.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.841+0000 7f64342bf740 10 client.0 _ll_register_callbacks cb 0x55eac5511990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:03:58.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.842+0000 7f6427fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eac5250070 0x55eac5603710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:58.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.842+0000 7f641effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eac522f390 0x55eac56031b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:58.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.842+0000 7f64277fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eac52271b0 0x55eac5602c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:58.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.842+0000 7f641effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eac522f390 0x55eac56031b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:40760/0 (socket says 172.21.15.1:40760) 2024-09-21T01:03:58.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.842+0000 7f6427fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eac5250070 0x55eac5603710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54516/0 (socket says 172.21.15.1:54516) 2024-09-21T01:03:58.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.842+0000 7f641effd640 1 -- 172.21.15.1:0/2793701523 learned_addr learned my addr 172.21.15.1:0/2793701523 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:58.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.842+0000 7f64277fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eac52271b0 0x55eac5602c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:51306/0 (socket says 172.21.15.1:51306) 2024-09-21T01:03:58.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.842+0000 7f641effd640 1 -- 172.21.15.1:0/2793701523 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eac52271b0 msgr2=0x55eac5602c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:58.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.842+0000 7f641effd640 1 --2- 172.21.15.1:0/2793701523 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eac52271b0 0x55eac5602c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.842+0000 7f641effd640 1 -- 172.21.15.1:0/2793701523 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eac5250070 msgr2=0x55eac5603710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:58.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.842+0000 7f641effd640 1 --2- 172.21.15.1:0/2793701523 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eac5250070 0x55eac5603710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.842+0000 7f641effd640 1 -- 172.21.15.1:0/2793701523 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eac5525c40 con 0x55eac522f390 2024-09-21T01:03:58.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.842+0000 7f64277fe640 1 --2- 172.21.15.1:0/2793701523 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eac52271b0 0x55eac5602c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:03:58.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.842+0000 7f6427fff640 1 --2- 172.21.15.1:0/2793701523 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eac5250070 0x55eac5603710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:03:58.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.842+0000 7f641effd640 1 --2- 172.21.15.1:0/2793701523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eac522f390 0x55eac56031b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f641001b040 tx=0x7f6410003a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17e2d27979455dc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:58.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.842+0000 7f6406ffd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:03:58.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.842+0000 7f6406ffd640 1 -- 172.21.15.1:0/2793701523 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6410028030 con 0x55eac522f390 2024-09-21T01:03:58.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.842+0000 7f6406ffd640 1 -- 172.21.15.1:0/2793701523 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f641001f040 con 0x55eac522f390 2024-09-21T01:03:58.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.842+0000 7f64342bf740 1 -- 172.21.15.1:0/2793701523 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64100035f0 con 0x55eac522f390 2024-09-21T01:03:58.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.843+0000 7f6406ffd640 1 -- 172.21.15.1:0/2793701523 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6410004490 con 0x55eac522f390 2024-09-21T01:03:58.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.843+0000 7f64342bf740 10 client.26753 fetch_fsmap learned FSMap version 34 2024-09-21T01:03:58.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.843+0000 7f64342bf740 1 -- 172.21.15.1:0/2793701523 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55eac5611ab0 con 0x55eac522f390 2024-09-21T01:03:58.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.843+0000 7f6406ffd640 1 -- 172.21.15.1:0/2793701523 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64100035f0 con 0x55eac522f390 2024-09-21T01:03:58.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.843+0000 7f6406ffd640 1 -- 172.21.15.1:0/2793701523 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 34) ==== 8374+0+0 (secure 0 0 0) 0x7f6410004c00 con 0x55eac522f390 2024-09-21T01:03:58.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.843+0000 7f64342bf740 10 client.26753 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T01:03:58.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.843+0000 7f64342bf740 10 client.26753 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:03:58.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.843+0000 7f64342bf740 20 client.26753 populate_metadata read hostname 'smithi001' 2024-09-21T01:03:58.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.843+0000 7f64342bf740 1 --2- 172.21.15.1:0/2793701523 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55eac520e9f0 0x55eac5614e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:58.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.843+0000 7f64342bf740 4 client.26753 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:03:58.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.843+0000 7f64342bf740 1 -- 172.21.15.1:0/2793701523 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eac556fda0 con 0x55eac520e9f0 2024-09-21T01:03:58.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.843+0000 7f64277fe640 1 --2- 172.21.15.1:0/2793701523 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55eac520e9f0 0x55eac5614e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:58.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.844+0000 7f6406ffd640 10 client.26753 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:03:58.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.844+0000 7f64277fe640 1 --2- 172.21.15.1:0/2793701523 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55eac520e9f0 0x55eac5614e70 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e1d393288b8b6d2 server_cookie=340151ef354ff660 in_seq=0 out_seq=0 2024-09-21T01:03:58.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.845+0000 7f6406ffd640 1 -- 172.21.15.1:0/2793701523 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55eac556fda0 con 0x55eac520e9f0 2024-09-21T01:03:58.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.845+0000 7f6406ffd640 10 client.26753 handle_command_reply: tid=0 2024-09-21T01:03:58.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.845+0000 7f64342bf740 1 client.26753 shutdown 2024-09-21T01:03:58.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.845+0000 7f64342bf740 1 -- 172.21.15.1:0/2793701523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eac522f390 msgr2=0x55eac56031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:58.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.845+0000 7f64342bf740 1 --2- 172.21.15.1:0/2793701523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eac522f390 0x55eac56031b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f641001b040 tx=0x7f6410003a50 comp rx=0 tx=0).stop 2024-09-21T01:03:58.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.845+0000 7f64342bf740 1 -- 172.21.15.1:0/2793701523 shutdown_connections 2024-09-21T01:03:58.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.845+0000 7f64342bf740 1 --2- 172.21.15.1:0/2793701523 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55eac520e9f0 0x55eac5614e70 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.845+0000 7f64342bf740 1 --2- 172.21.15.1:0/2793701523 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eac5250070 0x55eac5603710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.845+0000 7f64342bf740 1 --2- 172.21.15.1:0/2793701523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eac522f390 0x55eac56031b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.845+0000 7f64342bf740 1 --2- 172.21.15.1:0/2793701523 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eac52271b0 0x55eac5602c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.845+0000 7f6406ffd640 0 client.26753 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:03:58.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.845+0000 7f64342bf740 1 -- 172.21.15.1:0/2793701523 >> 172.21.15.1:0/2793701523 conn(0x55eac5244460 msgr2=0x55eac55fa830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:58.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.845+0000 7f64342bf740 1 -- 172.21.15.1:0/2793701523 shutdown_connections 2024-09-21T01:03:58.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.845+0000 7f64342bf740 1 -- 172.21.15.1:0/2793701523 wait complete. 2024-09-21T01:03:58.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.845+0000 7f64342bf740 20 client.26753 trim_cache size 0 max 16384 2024-09-21T01:03:58.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.863+0000 7f64342bf740 1 Processor -- start 2024-09-21T01:03:58.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.863+0000 7f64342bf740 1 -- start start 2024-09-21T01:03:58.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.863+0000 7f64342bf740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eac52271b0 0x55eac55fe420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:58.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.863+0000 7f64342bf740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eac522f390 0x55eac56048a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:58.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.863+0000 7f64342bf740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eac5250070 0x55eac55ffe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:58.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.863+0000 7f64342bf740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f64281af430 con 0x55eac5250070 2024-09-21T01:03:58.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.863+0000 7f64342bf740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f64281b1000 con 0x55eac522f390 2024-09-21T01:03:58.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.863+0000 7f64342bf740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f64281afb00 con 0x55eac52271b0 2024-09-21T01:03:58.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.863+0000 7f641effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eac522f390 0x55eac56048a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:58.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.863+0000 7f6427fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eac5250070 0x55eac55ffe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:58.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.863+0000 7f641effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eac522f390 0x55eac56048a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:40774/0 (socket says 172.21.15.1:40774) 2024-09-21T01:03:58.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.863+0000 7f641effd640 1 -- 172.21.15.1:0/196519432 learned_addr learned my addr 172.21.15.1:0/196519432 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:58.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.863+0000 7f64277fe640 1 --2- 172.21.15.1:0/196519432 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eac52271b0 0x55eac55fe420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:58.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.863+0000 7f641effd640 1 -- 172.21.15.1:0/196519432 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eac52271b0 msgr2=0x55eac55fe420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:58.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.863+0000 7f641effd640 1 --2- 172.21.15.1:0/196519432 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eac52271b0 0x55eac55fe420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.863+0000 7f641effd640 1 -- 172.21.15.1:0/196519432 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eac5250070 msgr2=0x55eac55ffe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:58.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.863+0000 7f641effd640 1 --2- 172.21.15.1:0/196519432 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eac5250070 0x55eac55ffe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.864+0000 7f641effd640 1 -- 172.21.15.1:0/196519432 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eac56053b0 con 0x55eac522f390 2024-09-21T01:03:58.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.864+0000 7f6427fff640 1 --2- 172.21.15.1:0/196519432 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eac5250070 0x55eac55ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:03:58.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.864+0000 7f641effd640 1 --2- 172.21.15.1:0/196519432 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eac522f390 0x55eac56048a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6410006000 tx=0x7f6410003ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffcc421876e17d1a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:58.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.864+0000 7f641d7fa640 1 -- 172.21.15.1:0/196519432 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6410028040 con 0x55eac522f390 2024-09-21T01:03:58.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.864+0000 7f641d7fa640 1 -- 172.21.15.1:0/196519432 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6410003ac0 con 0x55eac522f390 2024-09-21T01:03:58.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.864+0000 7f641d7fa640 1 -- 172.21.15.1:0/196519432 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641000fe00 con 0x55eac522f390 2024-09-21T01:03:58.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.865+0000 7f64342bf740 1 -- 172.21.15.1:0/196519432 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eac522f390 msgr2=0x55eac56048a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:58.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.865+0000 7f64342bf740 1 --2- 172.21.15.1:0/196519432 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eac522f390 0x55eac56048a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6410006000 tx=0x7f6410003ee0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.865+0000 7f64342bf740 1 -- 172.21.15.1:0/196519432 shutdown_connections 2024-09-21T01:03:58.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.865+0000 7f64342bf740 1 --2- 172.21.15.1:0/196519432 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eac5250070 0x55eac55ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.865+0000 7f64342bf740 1 --2- 172.21.15.1:0/196519432 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eac522f390 0x55eac56048a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.865+0000 7f64342bf740 1 --2- 172.21.15.1:0/196519432 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eac52271b0 0x55eac55fe420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.865+0000 7f64342bf740 1 -- 172.21.15.1:0/196519432 >> 172.21.15.1:0/196519432 conn(0x55eac5244460 msgr2=0x55eac5604190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:58.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.865+0000 7f64342bf740 1 -- 172.21.15.1:0/196519432 shutdown_connections 2024-09-21T01:03:58.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.865+0000 7f64342bf740 1 -- 172.21.15.1:0/196519432 wait complete. 2024-09-21T01:03:58.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.865+0000 7f64342bf740 1 -- start start 2024-09-21T01:03:58.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.866+0000 7f64342bf740 1 Processor -- start 2024-09-21T01:03:58.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.866+0000 7f64342bf740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eac52271b0 0x55eac5618160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:58.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.866+0000 7f64342bf740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eac522f390 0x55eac5618720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:58.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.866+0000 7f64342bf740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eac5250070 0x55eac5677d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:58.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.866+0000 7f64342bf740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f64281b0930 con 0x55eac52271b0 2024-09-21T01:03:58.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.866+0000 7f64342bf740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f64281b0260 con 0x55eac5250070 2024-09-21T01:03:58.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.866+0000 7f64342bf740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f64281ad410 con 0x55eac522f390 2024-09-21T01:03:58.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.866+0000 7f64342bf740 10 client.0 _ll_register_callbacks cb 0x7f6420009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:03:58.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.866+0000 7f64277fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eac52271b0 0x55eac5618160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:58.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.866+0000 7f64277fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eac52271b0 0x55eac5618160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54536/0 (socket says 172.21.15.1:54536) 2024-09-21T01:03:58.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.866+0000 7f64277fe640 1 -- 172.21.15.1:0/1956520255 learned_addr learned my addr 172.21.15.1:0/1956520255 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:03:58.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.866+0000 7f6427fff640 1 --2- 172.21.15.1:0/1956520255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eac5250070 0x55eac5677d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:58.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.866+0000 7f641effd640 1 --2- 172.21.15.1:0/1956520255 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eac522f390 0x55eac5618720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:58.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.866+0000 7f64277fe640 1 -- 172.21.15.1:0/1956520255 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eac522f390 msgr2=0x55eac5618720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:58.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.866+0000 7f64277fe640 1 --2- 172.21.15.1:0/1956520255 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eac522f390 0x55eac5618720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.866+0000 7f64277fe640 1 -- 172.21.15.1:0/1956520255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eac5250070 msgr2=0x55eac5677d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:58.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.866+0000 7f64277fe640 1 --2- 172.21.15.1:0/1956520255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eac5250070 0x55eac5677d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.866+0000 7f64277fe640 1 -- 172.21.15.1:0/1956520255 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eac56784f0 con 0x55eac52271b0 2024-09-21T01:03:58.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.866+0000 7f6427fff640 1 --2- 172.21.15.1:0/1956520255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eac5250070 0x55eac5677d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:03:58.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.867+0000 7f64277fe640 1 --2- 172.21.15.1:0/1956520255 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eac52271b0 0x55eac5618160 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f64180e4840 tx=0x7f641801e310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe0f965b6a966f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:58.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.867+0000 7f6406ffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:03:58.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.867+0000 7f6406ffd640 1 -- 172.21.15.1:0/1956520255 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6418020040 con 0x55eac52271b0 2024-09-21T01:03:58.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.867+0000 7f6406ffd640 1 -- 172.21.15.1:0/1956520255 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f64180a91f0 con 0x55eac52271b0 2024-09-21T01:03:58.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.867+0000 7f64342bf740 1 -- 172.21.15.1:0/1956520255 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6410003ac0 con 0x55eac52271b0 2024-09-21T01:03:58.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.867+0000 7f6406ffd640 1 -- 172.21.15.1:0/1956520255 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f641801e120 con 0x55eac52271b0 2024-09-21T01:03:58.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.867+0000 7f64342bf740 10 client.17100 fetch_fsmap learned FSMap version 34 2024-09-21T01:03:58.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.867+0000 7f64342bf740 1 -- 172.21.15.1:0/1956520255 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55eac5617930 con 0x55eac52271b0 2024-09-21T01:03:58.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.867+0000 7f6406ffd640 1 -- 172.21.15.1:0/1956520255 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6410003ac0 con 0x55eac52271b0 2024-09-21T01:03:58.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.867+0000 7f6406ffd640 1 -- 172.21.15.1:0/1956520255 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 34) ==== 8374+0+0 (secure 0 0 0) 0x7f6418098110 con 0x55eac52271b0 2024-09-21T01:03:58.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.868+0000 7f64342bf740 10 client.17100 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T01:03:58.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.868+0000 7f64342bf740 10 client.17100 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:03:58.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.868+0000 7f64342bf740 20 client.17100 populate_metadata read hostname 'smithi001' 2024-09-21T01:03:58.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.868+0000 7f64342bf740 1 --2- 172.21.15.1:0/1956520255 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55eac51e3da0 0x55eac5685c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:58.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.868+0000 7f64342bf740 4 client.17100 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:03:58.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.868+0000 7f64342bf740 1 -- 172.21.15.1:0/1956520255 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55eac556b850 con 0x55eac51e3da0 2024-09-21T01:03:58.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.868+0000 7f641effd640 1 --2- 172.21.15.1:0/1956520255 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55eac51e3da0 0x55eac5685c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:58.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.868+0000 7f641effd640 1 --2- 172.21.15.1:0/1956520255 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55eac51e3da0 0x55eac5685c90 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=954a7473c11f6a36 server_cookie=6263286b2e5a1d18 in_seq=0 out_seq=0 2024-09-21T01:03:58.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.868+0000 7f6406ffd640 10 client.17100 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:03:58.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.868+0000 7f6406ffd640 1 -- 172.21.15.1:0/1956520255 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2842 (crc 0 0 0) 0x55eac556b850 con 0x55eac51e3da0 2024-09-21T01:03:58.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.868+0000 7f6406ffd640 10 client.17100 handle_command_reply: tid=0 2024-09-21T01:03:58.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.868+0000 7f64342bf740 1 client.17100 shutdown 2024-09-21T01:03:58.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.869+0000 7f64342bf740 1 -- 172.21.15.1:0/1956520255 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eac52271b0 msgr2=0x55eac5618160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:58.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.869+0000 7f64342bf740 1 --2- 172.21.15.1:0/1956520255 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eac52271b0 0x55eac5618160 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f64180e4840 tx=0x7f641801e310 comp rx=0 tx=0).stop 2024-09-21T01:03:58.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.869+0000 7f64342bf740 1 -- 172.21.15.1:0/1956520255 shutdown_connections 2024-09-21T01:03:58.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.869+0000 7f64342bf740 1 --2- 172.21.15.1:0/1956520255 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55eac51e3da0 0x55eac5685c90 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.869+0000 7f64342bf740 1 --2- 172.21.15.1:0/1956520255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eac5250070 0x55eac5677d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.869+0000 7f64342bf740 1 --2- 172.21.15.1:0/1956520255 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eac522f390 0x55eac5618720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.869+0000 7f64342bf740 1 --2- 172.21.15.1:0/1956520255 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eac52271b0 0x55eac5618160 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.869+0000 7f64342bf740 1 -- 172.21.15.1:0/1956520255 >> 172.21.15.1:0/1956520255 conn(0x55eac5244460 msgr2=0x55eac5604120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:58.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.869+0000 7f6406ffd640 0 client.17100 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:03:58.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.869+0000 7f64342bf740 1 -- 172.21.15.1:0/1956520255 shutdown_connections 2024-09-21T01:03:58.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.869+0000 7f64342bf740 1 -- 172.21.15.1:0/1956520255 wait complete. 2024-09-21T01:03:58.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.869+0000 7f64342bf740 20 client.17100 trim_cache size 0 max 16384 2024-09-21T01:03:58.874 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T01:03:58.875 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T01:03:58.875 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": { 2024-09-21T01:03:58.875 INFO:teuthology.orchestra.run.smithi001.stdout: "3d019354-f00e-4e9b-b42c-f519d1f68cd2": { 2024-09-21T01:03:58.875 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:03:58.875 INFO:teuthology.orchestra.run.smithi001.stdout: "tag": "3d019354-f00e-4e9b-b42c-f519d1f68cd2", 2024-09-21T01:03:58.875 INFO:teuthology.orchestra.run.smithi001.stdout: "options": "recursive,force" 2024-09-21T01:03:58.875 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:03:58.875 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:03:58.875 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_stats": { 2024-09-21T01:03:58.875 INFO:teuthology.orchestra.run.smithi001.stdout: "c2addc95-c922-4a70-b746-0b5fd2af59bf": { 2024-09-21T01:03:58.875 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:00:52.374848+0000", 2024-09-21T01:03:58.875 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:03:58.875 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:03:58.876 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:03:58.876 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:03:58.876 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:03:58.876 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:03:58.876 INFO:teuthology.orchestra.run.smithi001.stdout: "d9a37a97-ce14-4763-8c19-9bd32df63cf3": { 2024-09-21T01:03:58.876 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:01:45.914443+0000", 2024-09-21T01:03:58.876 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:03:58.876 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:03:58.876 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:03:58.876 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:03:58.876 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:03:58.876 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:03:58.876 INFO:teuthology.orchestra.run.smithi001.stdout: "f826f2c1-768a-47bb-b868-785b351ac6b4": { 2024-09-21T01:03:58.876 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:59:06.554657+0000", 2024-09-21T01:03:58.877 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:03:58.877 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:03:58.877 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:03:58.877 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:03:58.877 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:03:58.877 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:03:58.877 INFO:teuthology.orchestra.run.smithi001.stdout: "1bffed0d-34b1-4e8b-9cab-7501131ef79d": { 2024-09-21T01:03:58.877 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:00:02.564228+0000", 2024-09-21T01:03:58.877 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:03:58.877 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:03:58.877 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:03:58.877 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:03:58.877 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:03:58.878 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:03:58.878 INFO:teuthology.orchestra.run.smithi001.stdout: "bee49cce-b407-4617-a959-331ffd8dc5b0": { 2024-09-21T01:03:58.878 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:58:17.883027+0000", 2024-09-21T01:03:58.878 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:03:58.878 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:03:58.878 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:03:58.878 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:03:58.878 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:03:58.878 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:03:58.878 INFO:teuthology.orchestra.run.smithi001.stdout: "3d019354-f00e-4e9b-b42c-f519d1f68cd2": { 2024-09-21T01:03:58.878 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:03:25.601697+0000", 2024-09-21T01:03:58.879 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:03:58.879 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:03:58.879 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:03:58.879 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:03:58.879 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:03:58.879 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:03:58.879 INFO:teuthology.orchestra.run.smithi001.stdout: "7cb1bc3f-e2d2-4bf7-b13e-8f3371d7aac1": { 2024-09-21T01:03:58.879 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:58:02.751142+0000", 2024-09-21T01:03:58.879 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:03:58.879 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:03:58.879 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:03:58.879 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:03:58.879 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:03:58.879 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:03:58.879 INFO:teuthology.orchestra.run.smithi001.stdout: "2383a19c-993d-4440-99f7-93b43dcf33b4": { 2024-09-21T01:03:58.880 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:47.609257+0000", 2024-09-21T01:03:58.880 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:03:58.880 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:03:58.880 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:03:58.880 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:03:58.880 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:03:58.880 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:03:58.880 INFO:teuthology.orchestra.run.smithi001.stdout: "53fa74e4-5aa8-408b-9724-7c93618f7636": { 2024-09-21T01:03:58.880 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:01.730608+0000", 2024-09-21T01:03:58.880 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:03:58.880 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:03:58.880 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:03:58.880 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:03:58.880 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:03:58.880 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:03:58.881 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:03:58.881 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T01:03:58.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.869+0000 7f642dd4b640 1 -- 172.21.15.1:0/121026876 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f64140b6510 msgr2=0x7f64140b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:58.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.869+0000 7f642dd4b640 1 --2- 172.21.15.1:0/121026876 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f64140b6510 0x7f64140b8a20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6420035000 tx=0x7f642002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.869+0000 7f642dd4b640 1 -- 172.21.15.1:0/121026876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6428103bc0 msgr2=0x7f642819a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:58.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.869+0000 7f642dd4b640 1 --2- 172.21.15.1:0/121026876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6428103bc0 0x7f642819a430 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f641800d770 tx=0x7f641800dc30 comp rx=0 tx=0).stop 2024-09-21T01:03:58.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.870+0000 7f642dd4b640 1 -- 172.21.15.1:0/121026876 shutdown_connections 2024-09-21T01:03:58.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.870+0000 7f642dd4b640 1 --2- 172.21.15.1:0/121026876 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6428109e00 0x7f642819fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.870+0000 7f642dd4b640 1 --2- 172.21.15.1:0/121026876 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f64140b6510 0x7f64140b8a20 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.870+0000 7f642dd4b640 1 --2- 172.21.15.1:0/121026876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64281094b0 0x7f642819a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.870+0000 7f642dd4b640 1 --2- 172.21.15.1:0/121026876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6428103bc0 0x7f642819a430 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.870+0000 7f642dd4b640 1 -- 172.21.15.1:0/121026876 >> 172.21.15.1:0/121026876 conn(0x7f642807b910 msgr2=0x7f6428107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:58.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.870+0000 7f642dd4b640 1 -- 172.21.15.1:0/121026876 shutdown_connections 2024-09-21T01:03:58.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:03:58.870+0000 7f642dd4b640 1 -- 172.21.15.1:0/121026876 wait complete. 2024-09-21T01:03:59.152 INFO:tasks.workunit.client.0.smithi001.stdout: 2024-09-21T01:03:59.152 INFO:tasks.workunit.client.0.smithi001.stdout:Final score for writes: 150 2024-09-21T01:03:59.152 INFO:tasks.workunit.client.0.smithi001.stdout:Final score for reads : 441222 2024-09-21T01:03:59.152 INFO:tasks.workunit.client.0.smithi001.stdout: 2024-09-21T01:03:59.152 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T01:03:59.153 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T01:03:59.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:03:59 smithi001 ceph-mon[31211]: pgmap v561: 97 pgs: 97 active+clean; 723 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 984 KiB/s rd, 793 KiB/s wr, 662 op/s 2024-09-21T01:03:59.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:03:59 smithi193 ceph-mon[34660]: pgmap v561: 97 pgs: 97 active+clean; 723 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 984 KiB/s rd, 793 KiB/s wr, 662 op/s 2024-09-21T01:03:59.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:03:59 smithi042 ceph-mon[34481]: pgmap v561: 97 pgs: 97 active+clean; 723 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 984 KiB/s rd, 793 KiB/s wr, 662 op/s 2024-09-21T01:03:59.747 INFO:tasks.cephfs.filesystem:scrub status for tag:3d019354-f00e-4e9b-b42c-f519d1f68cd2 - {'path': '/', 'tag': '3d019354-f00e-4e9b-b42c-f519d1f68cd2', 'options': 'recursive,force'} 2024-09-21T01:04:01.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:01 smithi193 ceph-mon[34660]: pgmap v562: 97 pgs: 97 active+clean; 723 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 667 KiB/s wr, 561 op/s 2024-09-21T01:04:01.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:01 smithi042 ceph-mon[34481]: pgmap v562: 97 pgs: 97 active+clean; 723 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 667 KiB/s wr, 561 op/s 2024-09-21T01:04:01.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:01 smithi001 ceph-mon[31211]: pgmap v562: 97 pgs: 97 active+clean; 723 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 667 KiB/s wr, 561 op/s 2024-09-21T01:04:03.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:03 smithi193 ceph-mon[34660]: pgmap v563: 97 pgs: 97 active+clean; 724 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 891 KiB/s wr, 549 op/s 2024-09-21T01:04:03.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:03 smithi042 ceph-mon[34481]: pgmap v563: 97 pgs: 97 active+clean; 724 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 891 KiB/s wr, 549 op/s 2024-09-21T01:04:03.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:03 smithi001 ceph-mon[31211]: pgmap v563: 97 pgs: 97 active+clean; 724 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 891 KiB/s wr, 549 op/s 2024-09-21T01:04:04.038 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.037+0000 7f1ee1c8b640 1 -- 172.21.15.1:0/2562135907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1edc109400 msgr2=0x7f1edc10b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:04.038 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.037+0000 7f1ee1c8b640 1 --2- 172.21.15.1:0/2562135907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1edc109400 0x7f1edc10b910 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4009ca0 tx=0x7f1ed402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:04:04.038 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.037+0000 7f1ee1c8b640 1 -- 172.21.15.1:0/2562135907 shutdown_connections 2024-09-21T01:04:04.038 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.037+0000 7f1ee1c8b640 1 --2- 172.21.15.1:0/2562135907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1edc109400 0x7f1edc10b910 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:04.038 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.037+0000 7f1ee1c8b640 1 --2- 172.21.15.1:0/2562135907 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1edc106840 0x7f1edc108cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:04.038 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.037+0000 7f1ee1c8b640 1 --2- 172.21.15.1:0/2562135907 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1edc06b880 0x7f1edc106300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:04.038 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.037+0000 7f1ee1c8b640 1 -- 172.21.15.1:0/2562135907 >> 172.21.15.1:0/2562135907 conn(0x7f1edc0fdf00 msgr2=0x7f1edc1003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:04.039 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.037+0000 7f1ee1c8b640 1 -- 172.21.15.1:0/2562135907 shutdown_connections 2024-09-21T01:04:04.039 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.037+0000 7f1ee1c8b640 1 -- 172.21.15.1:0/2562135907 wait complete. 2024-09-21T01:04:04.040 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.038+0000 7f1ee1c8b640 1 Processor -- start 2024-09-21T01:04:04.040 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.038+0000 7f1ee1c8b640 1 -- start start 2024-09-21T01:04:04.040 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.038+0000 7f1ee1c8b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1edc06b880 0x7f1edc199f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:04.040 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.038+0000 7f1ee1c8b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1edc106840 0x7f1edc19a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:04.041 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.038+0000 7f1ee1c8b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1edc109400 0x7f1edc19b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:04.041 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.038+0000 7f1ee1c8b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1edc10f390 con 0x7f1edc06b880 2024-09-21T01:04:04.041 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.038+0000 7f1ee1c8b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1edc10f210 con 0x7f1edc106840 2024-09-21T01:04:04.041 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.038+0000 7f1ee1c8b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1edc10f510 con 0x7f1edc109400 2024-09-21T01:04:04.041 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.038+0000 7f1edb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1edc06b880 0x7f1edc199f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:04.041 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.038+0000 7f1edb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1edc06b880 0x7f1edc199f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44802/0 (socket says 172.21.15.1:44802) 2024-09-21T01:04:04.041 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.038+0000 7f1edb7fe640 1 -- 172.21.15.1:0/3063414492 learned_addr learned my addr 172.21.15.1:0/3063414492 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:04.042 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.038+0000 7f1edaffd640 1 --2- 172.21.15.1:0/3063414492 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1edc106840 0x7f1edc19a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:04.042 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.038+0000 7f1edbfff640 1 --2- 172.21.15.1:0/3063414492 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1edc109400 0x7f1edc19b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:04.042 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.039+0000 7f1edb7fe640 1 -- 172.21.15.1:0/3063414492 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1edc109400 msgr2=0x7f1edc19b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:04.042 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.039+0000 7f1edb7fe640 1 --2- 172.21.15.1:0/3063414492 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1edc109400 0x7f1edc19b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:04.042 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.039+0000 7f1edb7fe640 1 -- 172.21.15.1:0/3063414492 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1edc106840 msgr2=0x7f1edc19a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:04.042 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.039+0000 7f1edb7fe640 1 --2- 172.21.15.1:0/3063414492 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1edc106840 0x7f1edc19a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:04.042 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.039+0000 7f1edb7fe640 1 -- 172.21.15.1:0/3063414492 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1edc19b9a0 con 0x7f1edc06b880 2024-09-21T01:04:04.042 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.039+0000 7f1edb7fe640 1 --2- 172.21.15.1:0/3063414492 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1edc06b880 0x7f1edc199f60 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc00e9f0 tx=0x7f1ecc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:04.043 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.039+0000 7f1ed8ff9640 1 -- 172.21.15.1:0/3063414492 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc00cd80 con 0x7f1edc06b880 2024-09-21T01:04:04.043 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.039+0000 7f1ee1c8b640 1 -- 172.21.15.1:0/3063414492 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1edc19bc90 con 0x7f1edc06b880 2024-09-21T01:04:04.043 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.039+0000 7f1ed8ff9640 1 -- 172.21.15.1:0/3063414492 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ecc0054d0 con 0x7f1edc06b880 2024-09-21T01:04:04.043 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.039+0000 7f1ed8ff9640 1 -- 172.21.15.1:0/3063414492 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc010690 con 0x7f1edc06b880 2024-09-21T01:04:04.043 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.039+0000 7f1ee1c8b640 1 -- 172.21.15.1:0/3063414492 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1edc1a2380 con 0x7f1edc06b880 2024-09-21T01:04:04.048 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.041+0000 7f1ee8bfc740 1 Processor -- start 2024-09-21T01:04:04.048 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.042+0000 7f1ee8bfc740 1 -- start start 2024-09-21T01:04:04.048 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.042+0000 7f1ee8bfc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5ecbc71b0 0x55a5ecf73260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:04.048 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.042+0000 7f1ee8bfc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a5ecb9e2f0 0x55a5ecf738d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:04.048 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.042+0000 7f1ee8bfc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5ecba64d0 0x55a5ecf74420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:04.048 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.042+0000 7f1ee8bfc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a5ecee16f0 con 0x55a5ecba64d0 2024-09-21T01:04:04.048 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.042+0000 7f1ee8bfc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a5eced0b20 con 0x55a5ecbc71b0 2024-09-21T01:04:04.048 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.042+0000 7f1ee8bfc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a5eced4930 con 0x55a5ecb9e2f0 2024-09-21T01:04:04.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.042+0000 7f1edaffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5ecba64d0 0x55a5ecf74420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:04.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.042+0000 7f1edbfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5ecbc71b0 0x55a5ecf73260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:04.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.042+0000 7f1edaffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5ecba64d0 0x55a5ecf74420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44806/0 (socket says 172.21.15.1:44806) 2024-09-21T01:04:04.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.042+0000 7f1edbfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5ecbc71b0 0x55a5ecf73260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:48238/0 (socket says 172.21.15.1:48238) 2024-09-21T01:04:04.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.042+0000 7f1edaffd640 1 -- 172.21.15.1:0/2942409993 learned_addr learned my addr 172.21.15.1:0/2942409993 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:04.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.042+0000 7f1ed8ff9640 1 -- 172.21.15.1:0/3063414492 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f1ecc010830 con 0x7f1edc06b880 2024-09-21T01:04:04.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.042+0000 7f1edbfff640 1 -- 172.21.15.1:0/2942409993 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a5ecb9e2f0 msgr2=0x55a5ecf738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:04.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.042+0000 7f1edbfff640 1 --2- 172.21.15.1:0/2942409993 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a5ecb9e2f0 0x55a5ecf738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:04.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.042+0000 7f1edbfff640 1 -- 172.21.15.1:0/2942409993 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5ecba64d0 msgr2=0x55a5ecf74420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:04.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.042+0000 7f1edbfff640 1 --2- 172.21.15.1:0/2942409993 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5ecba64d0 0x55a5ecf74420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:04.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.042+0000 7f1edbfff640 1 -- 172.21.15.1:0/2942409993 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5ece96530 con 0x55a5ecbc71b0 2024-09-21T01:04:04.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.042+0000 7f1edaffd640 1 --2- 172.21.15.1:0/2942409993 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5ecba64d0 0x55a5ecf74420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:04.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.043+0000 7f1edbfff640 1 --2- 172.21.15.1:0/2942409993 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5ecbc71b0 0x55a5ecf73260 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4006010 tx=0x7f1ed402f3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc7d26bc87027685 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:04.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.043+0000 7f1ec1ffb640 1 -- 172.21.15.1:0/2942409993 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed4031450 con 0x55a5ecbc71b0 2024-09-21T01:04:04.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.043+0000 7f1ed8ff9640 1 --2- 172.21.15.1:0/3063414492 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f1ec40b6510 0x7f1ec40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:04.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.043+0000 7f1ec1ffb640 1 -- 172.21.15.1:0/2942409993 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ed4036040 con 0x55a5ecbc71b0 2024-09-21T01:04:04.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.043+0000 7f1ec1ffb640 1 -- 172.21.15.1:0/2942409993 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed4004560 con 0x55a5ecbc71b0 2024-09-21T01:04:04.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.043+0000 7f1edb7fe640 1 --2- 172.21.15.1:0/3063414492 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f1ec40b6510 0x7f1ec40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:04.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.043+0000 7f1ed8ff9640 1 -- 172.21.15.1:0/3063414492 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f1ecc0e7850 con 0x7f1edc06b880 2024-09-21T01:04:04.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.044+0000 7f1ee8bfc740 1 -- 172.21.15.1:0/2942409993 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5ecbc71b0 msgr2=0x55a5ecf73260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:04.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.044+0000 7f1edb7fe640 1 --2- 172.21.15.1:0/3063414492 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f1ec40b6510 0x7f1ec40b8a20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc0ad6c0 tx=0x7f1ecc07adb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:04.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.044+0000 7f1ee8bfc740 1 --2- 172.21.15.1:0/2942409993 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5ecbc71b0 0x55a5ecf73260 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4006010 tx=0x7f1ed402f3a0 comp rx=0 tx=0).stop 2024-09-21T01:04:04.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.044+0000 7f1ee8bfc740 1 -- 172.21.15.1:0/2942409993 shutdown_connections 2024-09-21T01:04:04.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.044+0000 7f1ee8bfc740 1 --2- 172.21.15.1:0/2942409993 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5ecba64d0 0x55a5ecf74420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:04.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.044+0000 7f1ee8bfc740 1 --2- 172.21.15.1:0/2942409993 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a5ecb9e2f0 0x55a5ecf738d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:04.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.044+0000 7f1ee8bfc740 1 --2- 172.21.15.1:0/2942409993 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5ecbc71b0 0x55a5ecf73260 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:04.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.044+0000 7f1ee8bfc740 1 -- 172.21.15.1:0/2942409993 >> 172.21.15.1:0/2942409993 conn(0x55a5ecbbb300 msgr2=0x55a5ecf6a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:04.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.044+0000 7f1ee8bfc740 1 -- 172.21.15.1:0/2942409993 shutdown_connections 2024-09-21T01:04:04.051 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.044+0000 7f1ee8bfc740 1 -- 172.21.15.1:0/2942409993 wait complete. 2024-09-21T01:04:04.051 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.044+0000 7f1ee8bfc740 1 -- start start 2024-09-21T01:04:04.051 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.045+0000 7f1ee8bfc740 1 Processor -- start 2024-09-21T01:04:04.051 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.045+0000 7f1ee8bfc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5ecb9e2f0 0x55a5ecf7c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:04.051 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.045+0000 7f1ee8bfc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5ecba64d0 0x55a5ecf7d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:04.051 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.045+0000 7f1ee8bfc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a5ecbc71b0 0x55a5ecf7dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:04.051 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.045+0000 7f1ee8bfc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a5ece08ab0 con 0x55a5ecb9e2f0 2024-09-21T01:04:04.051 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.045+0000 7f1ee8bfc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a5ece76730 con 0x55a5ecba64d0 2024-09-21T01:04:04.051 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.045+0000 7f1ee8bfc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a5ecf74ee0 con 0x55a5ecbc71b0 2024-09-21T01:04:04.051 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.045+0000 7f1edbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5ecb9e2f0 0x55a5ecf7c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:04.051 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.045+0000 7f1ee8bfc740 10 client.0 _ll_register_callbacks cb 0x55a5ececa6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:04.051 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.045+0000 7f1edbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5ecb9e2f0 0x55a5ecf7c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44808/0 (socket says 172.21.15.1:44808) 2024-09-21T01:04:04.051 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.045+0000 7f1edbfff640 1 -- 172.21.15.1:0/3127961623 learned_addr learned my addr 172.21.15.1:0/3127961623 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:04.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.045+0000 7f1edaffd640 1 --2- 172.21.15.1:0/3127961623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5ecba64d0 0x55a5ecf7d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:04.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.045+0000 7f1edbfff640 1 --2- 172.21.15.1:0/3127961623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a5ecbc71b0 0x55a5ecf7dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:04.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.045+0000 7f1edbfff640 1 -- 172.21.15.1:0/3127961623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a5ecbc71b0 msgr2=0x55a5ecf7dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:04.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.045+0000 7f1edbfff640 1 --2- 172.21.15.1:0/3127961623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a5ecbc71b0 0x55a5ecf7dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:04.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.045+0000 7f1edbfff640 1 -- 172.21.15.1:0/3127961623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5ecba64d0 msgr2=0x55a5ecf7d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:04.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.045+0000 7f1edbfff640 1 --2- 172.21.15.1:0/3127961623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5ecba64d0 0x55a5ecf7d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:04.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.045+0000 7f1edbfff640 1 -- 172.21.15.1:0/3127961623 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5ecc32790 con 0x55a5ecb9e2f0 2024-09-21T01:04:04.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.045+0000 7f1edaffd640 1 --2- 172.21.15.1:0/3127961623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5ecba64d0 0x55a5ecf7d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:04.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.046+0000 7f1edbfff640 1 --2- 172.21.15.1:0/3127961623 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5ecb9e2f0 0x55a5ecf7c970 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f1ed402a900 tx=0x7f1ed4005c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b48eabe233355d5f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:04.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.046+0000 7f1ebaffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:04:04.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.046+0000 7f1ebaffd640 1 -- 172.21.15.1:0/3127961623 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed4058060 con 0x55a5ecb9e2f0 2024-09-21T01:04:04.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.046+0000 7f1ebaffd640 1 -- 172.21.15.1:0/3127961623 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f1ed4003b80 con 0x55a5ecb9e2f0 2024-09-21T01:04:04.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.046+0000 7f1ee8bfc740 1 -- 172.21.15.1:0/3127961623 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ed4036040 con 0x55a5ecb9e2f0 2024-09-21T01:04:04.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.046+0000 7f1ebaffd640 1 -- 172.21.15.1:0/3127961623 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1ed4003d80 con 0x55a5ecb9e2f0 2024-09-21T01:04:04.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.046+0000 7f1ee8bfc740 10 client.17112 fetch_fsmap learned FSMap version 34 2024-09-21T01:04:04.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.046+0000 7f1ee8bfc740 1 -- 172.21.15.1:0/3127961623 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a5eccab620 con 0x55a5ecb9e2f0 2024-09-21T01:04:04.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.046+0000 7f1ebaffd640 1 -- 172.21.15.1:0/3127961623 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ed4036040 con 0x55a5ecb9e2f0 2024-09-21T01:04:04.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.046+0000 7f1ebaffd640 1 -- 172.21.15.1:0/3127961623 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 34) ==== 8374+0+0 (secure 0 0 0) 0x7f1ed4050070 con 0x55a5ecb9e2f0 2024-09-21T01:04:04.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.046+0000 7f1ee8bfc740 10 client.17112 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T01:04:04.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.046+0000 7f1ee8bfc740 10 client.17112 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:04:04.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.046+0000 7f1ee8bfc740 20 client.17112 populate_metadata read hostname 'smithi001' 2024-09-21T01:04:04.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.046+0000 7f1ee8bfc740 1 --2- 172.21.15.1:0/3127961623 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a5ecb85d80 0x55a5ecf89c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:04.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.046+0000 7f1ee8bfc740 4 client.17112 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:04:04.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.046+0000 7f1ee8bfc740 1 -- 172.21.15.1:0/3127961623 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5ecee3640 con 0x55a5ecb85d80 2024-09-21T01:04:04.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.047+0000 7f1edaffd640 1 --2- 172.21.15.1:0/3127961623 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a5ecb85d80 0x55a5ecf89c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:04.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.047+0000 7f1edaffd640 1 --2- 172.21.15.1:0/3127961623 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a5ecb85d80 0x55a5ecf89c80 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f631b6a79ada5196 server_cookie=5d4e3c3a01728a5 in_seq=0 out_seq=0 2024-09-21T01:04:04.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.047+0000 7f1ebaffd640 10 client.17112 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:04:04.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.048+0000 7f1ebaffd640 1 -- 172.21.15.1:0/3127961623 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a5ecee3640 con 0x55a5ecb85d80 2024-09-21T01:04:04.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.048+0000 7f1ebaffd640 10 client.17112 handle_command_reply: tid=0 2024-09-21T01:04:04.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.048+0000 7f1ee8bfc740 1 client.17112 shutdown 2024-09-21T01:04:04.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.048+0000 7f1ee8bfc740 1 -- 172.21.15.1:0/3127961623 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5ecb9e2f0 msgr2=0x55a5ecf7c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:04.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.048+0000 7f1ee8bfc740 1 --2- 172.21.15.1:0/3127961623 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5ecb9e2f0 0x55a5ecf7c970 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f1ed402a900 tx=0x7f1ed4005c10 comp rx=0 tx=0).stop 2024-09-21T01:04:04.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.048+0000 7f1ee8bfc740 1 -- 172.21.15.1:0/3127961623 shutdown_connections 2024-09-21T01:04:04.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.048+0000 7f1ee8bfc740 1 --2- 172.21.15.1:0/3127961623 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a5ecb85d80 0x55a5ecf89c80 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:04.057 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.048+0000 7f1ee8bfc740 1 --2- 172.21.15.1:0/3127961623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a5ecbc71b0 0x55a5ecf7dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:04.057 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.048+0000 7f1ee8bfc740 1 --2- 172.21.15.1:0/3127961623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5ecba64d0 0x55a5ecf7d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:04.057 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.048+0000 7f1ebaffd640 0 client.17112 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:04:04.057 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.048+0000 7f1ee8bfc740 1 --2- 172.21.15.1:0/3127961623 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5ecb9e2f0 0x55a5ecf7c970 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:04.057 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.048+0000 7f1ee8bfc740 1 -- 172.21.15.1:0/3127961623 >> 172.21.15.1:0/3127961623 conn(0x55a5ecbbb300 msgr2=0x55a5ecf68ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:04.057 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.048+0000 7f1ee8bfc740 1 -- 172.21.15.1:0/3127961623 shutdown_connections 2024-09-21T01:04:04.057 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.049+0000 7f1ee8bfc740 1 -- 172.21.15.1:0/3127961623 wait complete. 2024-09-21T01:04:04.057 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.049+0000 7f1ee8bfc740 20 client.17112 trim_cache size 0 max 16384 2024-09-21T01:04:04.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.063+0000 7f1ee8bfc740 1 Processor -- start 2024-09-21T01:04:04.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.063+0000 7f1ee8bfc740 1 -- start start 2024-09-21T01:04:04.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.063+0000 7f1ee8bfc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5ecb9e2f0 0x55a5ecf740f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:04.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.063+0000 7f1ee8bfc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5ecba64d0 0x55a5ecf7af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:04.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.063+0000 7f1ee8bfc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a5ecbc71b0 0x55a5ecf7b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:04.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.063+0000 7f1ee8bfc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1edc1a8e50 con 0x55a5ecb9e2f0 2024-09-21T01:04:04.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.063+0000 7f1ee8bfc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1edc1aaa20 con 0x55a5ecba64d0 2024-09-21T01:04:04.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.063+0000 7f1ee8bfc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1edc1a9520 con 0x55a5ecbc71b0 2024-09-21T01:04:04.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.064+0000 7f1edbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5ecb9e2f0 0x55a5ecf740f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:04.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.064+0000 7f1edbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5ecb9e2f0 0x55a5ecf740f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44822/0 (socket says 172.21.15.1:44822) 2024-09-21T01:04:04.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.064+0000 7f1edbfff640 1 -- 172.21.15.1:0/1345472008 learned_addr learned my addr 172.21.15.1:0/1345472008 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:04.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.064+0000 7f1edaffd640 1 --2- 172.21.15.1:0/1345472008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5ecba64d0 0x55a5ecf7af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:04.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.064+0000 7f1edbfff640 1 -- 172.21.15.1:0/1345472008 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a5ecbc71b0 msgr2=0x55a5ecf7b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:04.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.064+0000 7f1edbfff640 1 --2- 172.21.15.1:0/1345472008 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a5ecbc71b0 0x55a5ecf7b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:04.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.064+0000 7f1edbfff640 1 -- 172.21.15.1:0/1345472008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5ecba64d0 msgr2=0x55a5ecf7af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:04.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.064+0000 7f1edbfff640 1 --2- 172.21.15.1:0/1345472008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5ecba64d0 0x55a5ecf7af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:04.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.064+0000 7f1edbfff640 1 -- 172.21.15.1:0/1345472008 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5ecf65cd0 con 0x55a5ecb9e2f0 2024-09-21T01:04:04.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.064+0000 7f1edbfff640 1 --2- 172.21.15.1:0/1345472008 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5ecb9e2f0 0x55a5ecf740f0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4005e30 tx=0x7f1ed4000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=185d1a09af3cff89 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:04.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.064+0000 7f1ec17fa640 1 -- 172.21.15.1:0/1345472008 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed4058040 con 0x55a5ecb9e2f0 2024-09-21T01:04:04.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.064+0000 7f1ec17fa640 1 -- 172.21.15.1:0/1345472008 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ed4036040 con 0x55a5ecb9e2f0 2024-09-21T01:04:04.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.064+0000 7f1ec17fa640 1 -- 172.21.15.1:0/1345472008 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed4030a70 con 0x55a5ecb9e2f0 2024-09-21T01:04:04.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.065+0000 7f1ee8bfc740 1 -- 172.21.15.1:0/1345472008 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5ecb9e2f0 msgr2=0x55a5ecf740f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:04.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.065+0000 7f1ee8bfc740 1 --2- 172.21.15.1:0/1345472008 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5ecb9e2f0 0x55a5ecf740f0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4005e30 tx=0x7f1ed4000f40 comp rx=0 tx=0).stop 2024-09-21T01:04:04.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.065+0000 7f1ee8bfc740 1 -- 172.21.15.1:0/1345472008 shutdown_connections 2024-09-21T01:04:04.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.065+0000 7f1ee8bfc740 1 --2- 172.21.15.1:0/1345472008 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a5ecbc71b0 0x55a5ecf7b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:04.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.065+0000 7f1ee8bfc740 1 --2- 172.21.15.1:0/1345472008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5ecba64d0 0x55a5ecf7af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:04.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.065+0000 7f1ee8bfc740 1 --2- 172.21.15.1:0/1345472008 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5ecb9e2f0 0x55a5ecf740f0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:04.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.065+0000 7f1ee8bfc740 1 -- 172.21.15.1:0/1345472008 >> 172.21.15.1:0/1345472008 conn(0x55a5ecbbb300 msgr2=0x55a5ecf655c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:04.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.065+0000 7f1ee8bfc740 1 -- 172.21.15.1:0/1345472008 shutdown_connections 2024-09-21T01:04:04.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.065+0000 7f1ee8bfc740 1 -- 172.21.15.1:0/1345472008 wait complete. 2024-09-21T01:04:04.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.065+0000 7f1ee8bfc740 1 -- start start 2024-09-21T01:04:04.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.066+0000 7f1ee8bfc740 1 Processor -- start 2024-09-21T01:04:04.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.066+0000 7f1ee8bfc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5ecb9e2f0 0x55a5ecf84820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:04.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.066+0000 7f1ee8bfc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5ecba64d0 0x55a5ecf834e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:04.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.066+0000 7f1ee8bfc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a5ecbc71b0 0x55a5ecf83ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:04.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.066+0000 7f1ee8bfc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1edc1aa350 con 0x55a5ecba64d0 2024-09-21T01:04:04.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.066+0000 7f1ee8bfc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1edc1a9c80 con 0x55a5ecb9e2f0 2024-09-21T01:04:04.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.066+0000 7f1ee8bfc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1edc1a6e30 con 0x55a5ecbc71b0 2024-09-21T01:04:04.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.066+0000 7f1ee8bfc740 10 client.0 _ll_register_callbacks cb 0x7f1ed00097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:04.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.066+0000 7f1edaffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5ecba64d0 0x55a5ecf834e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:04.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.066+0000 7f1edaffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5ecba64d0 0x55a5ecf834e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44836/0 (socket says 172.21.15.1:44836) 2024-09-21T01:04:04.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.066+0000 7f1edaffd640 1 -- 172.21.15.1:0/1187955971 learned_addr learned my addr 172.21.15.1:0/1187955971 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:04.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.066+0000 7f1edbfff640 1 --2- 172.21.15.1:0/1187955971 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5ecb9e2f0 0x55a5ecf84820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:04.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.066+0000 7f1edbfff640 1 --2- 172.21.15.1:0/1187955971 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a5ecbc71b0 0x55a5ecf83ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:04.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.066+0000 7f1edaffd640 1 -- 172.21.15.1:0/1187955971 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a5ecbc71b0 msgr2=0x55a5ecf83ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:04.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.066+0000 7f1edaffd640 1 --2- 172.21.15.1:0/1187955971 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a5ecbc71b0 0x55a5ecf83ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:04.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.066+0000 7f1edaffd640 1 -- 172.21.15.1:0/1187955971 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5ecb9e2f0 msgr2=0x55a5ecf84820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:04.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.066+0000 7f1edaffd640 1 --2- 172.21.15.1:0/1187955971 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5ecb9e2f0 0x55a5ecf84820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:04.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.066+0000 7f1edaffd640 1 -- 172.21.15.1:0/1187955971 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5ecf84250 con 0x55a5ecba64d0 2024-09-21T01:04:04.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.067+0000 7f1edaffd640 1 --2- 172.21.15.1:0/1187955971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5ecba64d0 0x55a5ecf834e0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0004700 tx=0x7f1ed0012b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d67e741bb5fb509a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:04.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.067+0000 7f1ebaffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:04:04.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.067+0000 7f1ebaffd640 1 -- 172.21.15.1:0/1187955971 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed0004250 con 0x55a5ecba64d0 2024-09-21T01:04:04.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.067+0000 7f1ee8bfc740 1 -- 172.21.15.1:0/1187955971 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ed4036040 con 0x55a5ecba64d0 2024-09-21T01:04:04.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.067+0000 7f1ebaffd640 1 -- 172.21.15.1:0/1187955971 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f1ed00043f0 con 0x55a5ecba64d0 2024-09-21T01:04:04.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.067+0000 7f1ebaffd640 1 -- 172.21.15.1:0/1187955971 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1ed0010960 con 0x55a5ecba64d0 2024-09-21T01:04:04.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.067+0000 7f1ee8bfc740 10 client.17118 fetch_fsmap learned FSMap version 34 2024-09-21T01:04:04.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.067+0000 7f1ee8bfc740 1 -- 172.21.15.1:0/1187955971 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a5ecff4630 con 0x55a5ecba64d0 2024-09-21T01:04:04.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.067+0000 7f1ebaffd640 1 -- 172.21.15.1:0/1187955971 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ed4036040 con 0x55a5ecba64d0 2024-09-21T01:04:04.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.067+0000 7f1ebaffd640 1 -- 172.21.15.1:0/1187955971 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 34) ==== 8374+0+0 (secure 0 0 0) 0x7f1ed0024400 con 0x55a5ecba64d0 2024-09-21T01:04:04.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.068+0000 7f1ee8bfc740 10 client.17118 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T01:04:04.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.068+0000 7f1ee8bfc740 10 client.17118 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:04:04.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.068+0000 7f1ee8bfc740 20 client.17118 populate_metadata read hostname 'smithi001' 2024-09-21T01:04:04.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.068+0000 7f1ee8bfc740 1 --2- 172.21.15.1:0/1187955971 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a5ecb5b1c0 0x55a5ecff7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:04.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.068+0000 7f1ee8bfc740 4 client.17118 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:04:04.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.068+0000 7f1ee8bfc740 1 -- 172.21.15.1:0/1187955971 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a5ecedf0f0 con 0x55a5ecb5b1c0 2024-09-21T01:04:04.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.068+0000 7f1edbfff640 1 --2- 172.21.15.1:0/1187955971 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a5ecb5b1c0 0x55a5ecff7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:04.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.068+0000 7f1edbfff640 1 --2- 172.21.15.1:0/1187955971 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a5ecb5b1c0 0x55a5ecff7050 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f68c577d156309e server_cookie=9000ca3007b36121 in_seq=0 out_seq=0 2024-09-21T01:04:04.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.068+0000 7f1ebaffd640 10 client.17118 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:04:04.079 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.078+0000 7f1ebaffd640 1 -- 172.21.15.1:0/1187955971 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a5ecedf0f0 con 0x55a5ecb5b1c0 2024-09-21T01:04:04.079 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.078+0000 7f1ebaffd640 10 client.17118 handle_command_reply: tid=0 2024-09-21T01:04:04.079 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.078+0000 7f1ee8bfc740 1 client.17118 shutdown 2024-09-21T01:04:04.079 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.078+0000 7f1ee8bfc740 1 -- 172.21.15.1:0/1187955971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5ecba64d0 msgr2=0x55a5ecf834e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:04.079 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.078+0000 7f1ee8bfc740 1 --2- 172.21.15.1:0/1187955971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5ecba64d0 0x55a5ecf834e0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0004700 tx=0x7f1ed0012b40 comp rx=0 tx=0).stop 2024-09-21T01:04:04.079 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.078+0000 7f1ee8bfc740 1 -- 172.21.15.1:0/1187955971 shutdown_connections 2024-09-21T01:04:04.079 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.078+0000 7f1ee8bfc740 1 --2- 172.21.15.1:0/1187955971 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a5ecb5b1c0 0x55a5ecff7050 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:04.080 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.078+0000 7f1ee8bfc740 1 --2- 172.21.15.1:0/1187955971 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a5ecbc71b0 0x55a5ecf83ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:04.080 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.078+0000 7f1ee8bfc740 1 --2- 172.21.15.1:0/1187955971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5ecba64d0 0x55a5ecf834e0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:04.080 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.078+0000 7f1ee8bfc740 1 --2- 172.21.15.1:0/1187955971 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a5ecb9e2f0 0x55a5ecf84820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:04.080 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.078+0000 7f1ebaffd640 0 client.17118 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:04:04.080 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.078+0000 7f1ee8bfc740 1 -- 172.21.15.1:0/1187955971 >> 172.21.15.1:0/1187955971 conn(0x55a5ecbbb300 msgr2=0x55a5ecf655c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:04.080 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.078+0000 7f1ee8bfc740 1 -- 172.21.15.1:0/1187955971 shutdown_connections 2024-09-21T01:04:04.080 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.078+0000 7f1ee8bfc740 1 -- 172.21.15.1:0/1187955971 wait complete. 2024-09-21T01:04:04.080 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.078+0000 7f1ee8bfc740 20 client.17118 trim_cache size 0 max 16384 2024-09-21T01:04:04.080 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T01:04:04.080 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T01:04:04.080 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T01:04:04.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T01:04:04.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.079+0000 7f1ee1c8b640 1 -- 172.21.15.1:0/3063414492 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f1ec40b6510 msgr2=0x7f1ec40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:04.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.079+0000 7f1ee1c8b640 1 --2- 172.21.15.1:0/3063414492 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f1ec40b6510 0x7f1ec40b8a20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc0ad6c0 tx=0x7f1ecc07adb0 comp rx=0 tx=0).stop 2024-09-21T01:04:04.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.079+0000 7f1ee1c8b640 1 -- 172.21.15.1:0/3063414492 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1edc06b880 msgr2=0x7f1edc199f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:04.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.079+0000 7f1ee1c8b640 1 --2- 172.21.15.1:0/3063414492 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1edc06b880 0x7f1edc199f60 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc00e9f0 tx=0x7f1ecc00edf0 comp rx=0 tx=0).stop 2024-09-21T01:04:04.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.079+0000 7f1ee1c8b640 1 -- 172.21.15.1:0/3063414492 shutdown_connections 2024-09-21T01:04:04.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.079+0000 7f1ee1c8b640 1 --2- 172.21.15.1:0/3063414492 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1edc109400 0x7f1edc19b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:04.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.079+0000 7f1ee1c8b640 1 --2- 172.21.15.1:0/3063414492 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1edc106840 0x7f1edc19a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:04.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.079+0000 7f1ee1c8b640 1 --2- 172.21.15.1:0/3063414492 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f1ec40b6510 0x7f1ec40b8a20 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:04.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.079+0000 7f1ee1c8b640 1 --2- 172.21.15.1:0/3063414492 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1edc06b880 0x7f1edc199f60 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:04.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.079+0000 7f1ee1c8b640 1 -- 172.21.15.1:0/3063414492 >> 172.21.15.1:0/3063414492 conn(0x7f1edc0fdf00 msgr2=0x7f1edc104cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:04.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.079+0000 7f1ee1c8b640 1 -- 172.21.15.1:0/3063414492 shutdown_connections 2024-09-21T01:04:04.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:04.079+0000 7f1ee1c8b640 1 -- 172.21.15.1:0/3063414492 wait complete. 2024-09-21T01:04:05.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:05 smithi193 ceph-mon[34660]: pgmap v564: 97 pgs: 97 active+clean; 725 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 1.3 MiB/s wr, 461 op/s 2024-09-21T01:04:05.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:05 smithi042 ceph-mon[34481]: pgmap v564: 97 pgs: 97 active+clean; 725 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 1.3 MiB/s wr, 461 op/s 2024-09-21T01:04:05.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:05 smithi001 ceph-mon[31211]: pgmap v564: 97 pgs: 97 active+clean; 725 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 1.3 MiB/s wr, 461 op/s 2024-09-21T01:04:07.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:07 smithi193 ceph-mon[34660]: pgmap v565: 97 pgs: 97 active+clean; 716 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 515 op/s 2024-09-21T01:04:07.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:07 smithi042 ceph-mon[34481]: pgmap v565: 97 pgs: 97 active+clean; 716 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 515 op/s 2024-09-21T01:04:07.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:07 smithi001 ceph-mon[31211]: pgmap v565: 97 pgs: 97 active+clean; 716 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 515 op/s 2024-09-21T01:04:08.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:08 smithi193 ceph-mon[34660]: scrub summary: idle 2024-09-21T01:04:08.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:08 smithi193 ceph-mon[34660]: scrub summary: idle 2024-09-21T01:04:08.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:08 smithi193 ceph-mon[34660]: scrub summary: idle 2024-09-21T01:04:08.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:08 smithi042 ceph-mon[34481]: scrub summary: idle 2024-09-21T01:04:08.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:08 smithi042 ceph-mon[34481]: scrub summary: idle 2024-09-21T01:04:08.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:08 smithi042 ceph-mon[34481]: scrub summary: idle 2024-09-21T01:04:08.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:08 smithi001 ceph-mon[31211]: scrub summary: idle 2024-09-21T01:04:08.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:08 smithi001 ceph-mon[31211]: scrub summary: idle 2024-09-21T01:04:08.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:08 smithi001 ceph-mon[31211]: scrub summary: idle 2024-09-21T01:04:09.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:09 smithi193 ceph-mon[34660]: scrub summary: idle 2024-09-21T01:04:09.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:09 smithi193 ceph-mon[34660]: scrub summary: idle 2024-09-21T01:04:09.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:09 smithi193 ceph-mon[34660]: pgmap v566: 97 pgs: 97 active+clean; 716 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 541 op/s 2024-09-21T01:04:09.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:09 smithi042 ceph-mon[34481]: scrub summary: idle 2024-09-21T01:04:09.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:09 smithi042 ceph-mon[34481]: scrub summary: idle 2024-09-21T01:04:09.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:09 smithi042 ceph-mon[34481]: pgmap v566: 97 pgs: 97 active+clean; 716 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 541 op/s 2024-09-21T01:04:09.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:09 smithi001 ceph-mon[31211]: scrub summary: idle 2024-09-21T01:04:09.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:09 smithi001 ceph-mon[31211]: scrub summary: idle 2024-09-21T01:04:09.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:09 smithi001 ceph-mon[31211]: pgmap v566: 97 pgs: 97 active+clean; 716 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 541 op/s 2024-09-21T01:04:11.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:11 smithi193 ceph-mon[34660]: pgmap v567: 97 pgs: 97 active+clean; 705 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 439 op/s 2024-09-21T01:04:11.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:11 smithi042 ceph-mon[34481]: pgmap v567: 97 pgs: 97 active+clean; 705 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 439 op/s 2024-09-21T01:04:11.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:11 smithi001 ceph-mon[31211]: pgmap v567: 97 pgs: 97 active+clean; 705 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 439 op/s 2024-09-21T01:04:13.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:13 smithi042 ceph-mon[34481]: pgmap v568: 97 pgs: 97 active+clean; 675 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 490 op/s 2024-09-21T01:04:13.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:13 smithi001 ceph-mon[31211]: pgmap v568: 97 pgs: 97 active+clean; 675 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 490 op/s 2024-09-21T01:04:13.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:13 smithi193 ceph-mon[34660]: pgmap v568: 97 pgs: 97 active+clean; 675 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 490 op/s 2024-09-21T01:04:14.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:14 smithi001 ceph-mon[31211]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:04:14.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:14 smithi193 ceph-mon[34660]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:04:14.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:14 smithi042 ceph-mon[34481]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:04:15.880 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:15 smithi193 ceph-mon[34660]: pgmap v569: 97 pgs: 97 active+clean; 654 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 491 op/s 2024-09-21T01:04:15.893 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:15 smithi042 ceph-mon[34481]: pgmap v569: 97 pgs: 97 active+clean; 654 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 491 op/s 2024-09-21T01:04:15.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:15 smithi001 ceph-mon[31211]: pgmap v569: 97 pgs: 97 active+clean; 654 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 491 op/s 2024-09-21T01:04:17.183 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.182+0000 7f3af67cc640 1 -- 172.21.15.1:0/2040024982 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3af0109540 msgr2=0x7f3af010b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:17.183 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.182+0000 7f3af67cc640 1 --2- 172.21.15.1:0/2040024982 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3af0109540 0x7f3af010b960 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f3ae8009ca0 tx=0x7f3ae802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:04:17.183 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.182+0000 7f3af67cc640 1 -- 172.21.15.1:0/2040024982 shutdown_connections 2024-09-21T01:04:17.183 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.182+0000 7f3af67cc640 1 --2- 172.21.15.1:0/2040024982 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3af0109540 0x7f3af010b960 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:17.184 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.182+0000 7f3af67cc640 1 --2- 172.21.15.1:0/2040024982 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3af0106be0 0x7f3af0109000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:17.184 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.182+0000 7f3af67cc640 1 --2- 172.21.15.1:0/2040024982 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3af0101a90 0x7f3af0101ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:17.184 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.182+0000 7f3af67cc640 1 -- 172.21.15.1:0/2040024982 >> 172.21.15.1:0/2040024982 conn(0x7f3af00fd690 msgr2=0x7f3af00ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:17.184 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.182+0000 7f3af67cc640 1 -- 172.21.15.1:0/2040024982 shutdown_connections 2024-09-21T01:04:17.184 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.182+0000 7f3af67cc640 1 -- 172.21.15.1:0/2040024982 wait complete. 2024-09-21T01:04:17.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.183+0000 7f3af67cc640 1 Processor -- start 2024-09-21T01:04:17.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.183+0000 7f3af67cc640 1 -- start start 2024-09-21T01:04:17.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.183+0000 7f3af67cc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3af0101a90 0x7f3af0199ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:17.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.183+0000 7f3af67cc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3af0106be0 0x7f3af019a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:17.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.183+0000 7f3af67cc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3af0109540 0x7f3af019b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:17.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.183+0000 7f3af67cc640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3af010f310 con 0x7f3af0109540 2024-09-21T01:04:17.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.183+0000 7f3af67cc640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3af010f190 con 0x7f3af0101a90 2024-09-21T01:04:17.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.183+0000 7f3af67cc640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3af010f490 con 0x7f3af0106be0 2024-09-21T01:04:17.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.183+0000 7f3af4d69640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3af0109540 0x7f3af019b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:17.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.184+0000 7f3af4d69640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3af0109540 0x7f3af019b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53790/0 (socket says 172.21.15.1:53790) 2024-09-21T01:04:17.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.184+0000 7f3af4d69640 1 -- 172.21.15.1:0/593553599 learned_addr learned my addr 172.21.15.1:0/593553599 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:17.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.184+0000 7f3aef7fe640 1 --2- 172.21.15.1:0/593553599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3af0106be0 0x7f3af019a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:17.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.184+0000 7f3aeffff640 1 --2- 172.21.15.1:0/593553599 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3af0101a90 0x7f3af0199ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:17.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.184+0000 7f3af4d69640 1 -- 172.21.15.1:0/593553599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3af0106be0 msgr2=0x7f3af019a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:17.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.184+0000 7f3af4d69640 1 --2- 172.21.15.1:0/593553599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3af0106be0 0x7f3af019a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:17.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.184+0000 7f3af4d69640 1 -- 172.21.15.1:0/593553599 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3af0101a90 msgr2=0x7f3af0199ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:17.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.184+0000 7f3af4d69640 1 --2- 172.21.15.1:0/593553599 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3af0101a90 0x7f3af0199ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:17.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.184+0000 7f3af4d69640 1 -- 172.21.15.1:0/593553599 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3af019b910 con 0x7f3af0109540 2024-09-21T01:04:17.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.184+0000 7f3af4d69640 1 --2- 172.21.15.1:0/593553599 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3af0109540 0x7f3af019b0f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f3ae8004af0 tx=0x7f3ae8031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:17.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.184+0000 7f3aed7fa640 1 -- 172.21.15.1:0/593553599 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae8003b70 con 0x7f3af0109540 2024-09-21T01:04:17.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.184+0000 7f3af67cc640 1 -- 172.21.15.1:0/593553599 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3af019bba0 con 0x7f3af0109540 2024-09-21T01:04:17.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.184+0000 7f3aed7fa640 1 -- 172.21.15.1:0/593553599 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ae8003d10 con 0x7f3af0109540 2024-09-21T01:04:17.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.184+0000 7f3aed7fa640 1 -- 172.21.15.1:0/593553599 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae802fb20 con 0x7f3af0109540 2024-09-21T01:04:17.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.184+0000 7f3af67cc640 1 -- 172.21.15.1:0/593553599 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3af01a22f0 con 0x7f3af0109540 2024-09-21T01:04:17.188 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.187+0000 7f3afd80e740 1 Processor -- start 2024-09-21T01:04:17.190 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.188+0000 7f3aed7fa640 1 -- 172.21.15.1:0/593553599 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f3ae802fcc0 con 0x7f3af0109540 2024-09-21T01:04:17.190 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.188+0000 7f3afd80e740 1 -- start start 2024-09-21T01:04:17.190 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.188+0000 7f3afd80e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d858ee1b0 0x560d85c95e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:17.190 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.188+0000 7f3afd80e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d858c52f0 0x560d85c964c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:17.190 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.188+0000 7f3afd80e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d858cd4d0 0x560d85c97010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:17.190 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.188+0000 7f3afd80e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560d85c086f0 con 0x560d858c52f0 2024-09-21T01:04:17.190 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.188+0000 7f3afd80e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560d85bf7b20 con 0x560d858ee1b0 2024-09-21T01:04:17.190 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.188+0000 7f3afd80e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560d85bfb930 con 0x560d858cd4d0 2024-09-21T01:04:17.190 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.188+0000 7f3aeffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d858c52f0 0x560d85c964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:17.190 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.188+0000 7f3aeffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d858c52f0 0x560d85c964c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53796/0 (socket says 172.21.15.1:53796) 2024-09-21T01:04:17.190 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.188+0000 7f3aeffff640 1 -- 172.21.15.1:0/2574763616 learned_addr learned my addr 172.21.15.1:0/2574763616 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:17.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.188+0000 7f3aef7fe640 1 --2- 172.21.15.1:0/2574763616 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d858ee1b0 0x560d85c95e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:17.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.188+0000 7f3aef7fe640 1 --2- 172.21.15.1:0/2574763616 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d858cd4d0 0x560d85c97010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:17.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.188+0000 7f3aeffff640 1 -- 172.21.15.1:0/2574763616 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d858cd4d0 msgr2=0x560d85c97010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:17.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.188+0000 7f3aeffff640 1 --2- 172.21.15.1:0/2574763616 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d858cd4d0 0x560d85c97010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:17.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.188+0000 7f3aeffff640 1 -- 172.21.15.1:0/2574763616 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d858ee1b0 msgr2=0x560d85c95e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:17.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.188+0000 7f3aeffff640 1 --2- 172.21.15.1:0/2574763616 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d858ee1b0 0x560d85c95e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:17.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.188+0000 7f3aeffff640 1 -- 172.21.15.1:0/2574763616 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d85bbd530 con 0x560d858c52f0 2024-09-21T01:04:17.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.189+0000 7f3aed7fa640 1 --2- 172.21.15.1:0/593553599 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f3ad80b6510 0x7f3ad80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:17.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.189+0000 7f3aeffff640 1 --2- 172.21.15.1:0/2574763616 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d858c52f0 0x560d85c964c0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0009cf0 tx=0x7f3ae0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cefa7b728196ab65 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:17.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.189+0000 7f3aef7fe640 1 --2- 172.21.15.1:0/593553599 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f3ad80b6510 0x7f3ad80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:17.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.189+0000 7f3ad67fc640 1 -- 172.21.15.1:0/2574763616 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae001e070 con 0x560d858c52f0 2024-09-21T01:04:17.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.189+0000 7f3aed7fa640 1 -- 172.21.15.1:0/593553599 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f3ae81086c0 con 0x7f3af0109540 2024-09-21T01:04:17.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.189+0000 7f3ad67fc640 1 -- 172.21.15.1:0/2574763616 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ae0009de0 con 0x560d858c52f0 2024-09-21T01:04:17.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.189+0000 7f3ad67fc640 1 -- 172.21.15.1:0/2574763616 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae0019450 con 0x560d858c52f0 2024-09-21T01:04:17.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.190+0000 7f3afd80e740 1 -- 172.21.15.1:0/2574763616 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d858c52f0 msgr2=0x560d85c964c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:17.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.190+0000 7f3afd80e740 1 --2- 172.21.15.1:0/2574763616 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d858c52f0 0x560d85c964c0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0009cf0 tx=0x7f3ae0011810 comp rx=0 tx=0).stop 2024-09-21T01:04:17.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.190+0000 7f3aef7fe640 1 --2- 172.21.15.1:0/593553599 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f3ad80b6510 0x7f3ad80b8a20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3ae400f560 tx=0x7f3ae4004730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:17.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.190+0000 7f3afd80e740 1 -- 172.21.15.1:0/2574763616 shutdown_connections 2024-09-21T01:04:17.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.190+0000 7f3afd80e740 1 --2- 172.21.15.1:0/2574763616 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d858cd4d0 0x560d85c97010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:17.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.190+0000 7f3afd80e740 1 --2- 172.21.15.1:0/2574763616 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d858c52f0 0x560d85c964c0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:17.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.190+0000 7f3afd80e740 1 --2- 172.21.15.1:0/2574763616 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d858ee1b0 0x560d85c95e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:17.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.190+0000 7f3afd80e740 1 -- 172.21.15.1:0/2574763616 >> 172.21.15.1:0/2574763616 conn(0x560d858e2300 msgr2=0x560d85c918e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:17.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.190+0000 7f3afd80e740 1 -- 172.21.15.1:0/2574763616 shutdown_connections 2024-09-21T01:04:17.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.190+0000 7f3afd80e740 1 -- 172.21.15.1:0/2574763616 wait complete. 2024-09-21T01:04:17.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.190+0000 7f3afd80e740 1 -- start start 2024-09-21T01:04:17.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.191+0000 7f3afd80e740 1 Processor -- start 2024-09-21T01:04:17.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.191+0000 7f3afd80e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d858c52f0 0x560d85c9f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:17.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.191+0000 7f3afd80e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d858cd4d0 0x560d85c9fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:17.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.191+0000 7f3afd80e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d858ee1b0 0x560d85ca07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:17.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.191+0000 7f3afd80e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560d85b2fab0 con 0x560d858cd4d0 2024-09-21T01:04:17.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.191+0000 7f3afd80e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560d85b9d730 con 0x560d858ee1b0 2024-09-21T01:04:17.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.191+0000 7f3afd80e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560d85c97b30 con 0x560d858c52f0 2024-09-21T01:04:17.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.191+0000 7f3afd80e740 10 client.0 _ll_register_callbacks cb 0x560d85bf16b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:17.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.191+0000 7f3aeffff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d858c52f0 0x560d85c9f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:17.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.191+0000 7f3af4d69640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d858ee1b0 0x560d85ca07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:17.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.191+0000 7f3aef7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d858cd4d0 0x560d85c9fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:17.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.191+0000 7f3af4d69640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d858ee1b0 0x560d85ca07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:50856/0 (socket says 172.21.15.1:50856) 2024-09-21T01:04:17.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.191+0000 7f3af4d69640 1 -- 172.21.15.1:0/970819990 learned_addr learned my addr 172.21.15.1:0/970819990 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:17.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.191+0000 7f3aeffff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d858c52f0 0x560d85c9f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:49246/0 (socket says 172.21.15.1:49246) 2024-09-21T01:04:17.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.191+0000 7f3aef7fe640 1 -- 172.21.15.1:0/970819990 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d858c52f0 msgr2=0x560d85c9f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:17.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.191+0000 7f3aef7fe640 1 --2- 172.21.15.1:0/970819990 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d858c52f0 0x560d85c9f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:17.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.191+0000 7f3aef7fe640 1 -- 172.21.15.1:0/970819990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d858ee1b0 msgr2=0x560d85ca07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:17.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.191+0000 7f3aef7fe640 1 --2- 172.21.15.1:0/970819990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d858ee1b0 0x560d85ca07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:17.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.191+0000 7f3aef7fe640 1 -- 172.21.15.1:0/970819990 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d85959790 con 0x560d858cd4d0 2024-09-21T01:04:17.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.191+0000 7f3aeffff640 1 --2- 172.21.15.1:0/970819990 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d858c52f0 0x560d85c9f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:17.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.191+0000 7f3af4d69640 1 --2- 172.21.15.1:0/970819990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d858ee1b0 0x560d85ca07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:17.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.192+0000 7f3aef7fe640 1 --2- 172.21.15.1:0/970819990 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d858cd4d0 0x560d85c9fc60 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f3ae400fdf0 tx=0x7f3ae4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57fbd5764d08b89a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:17.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.192+0000 7f3acf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:04:17.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.192+0000 7f3acf7fe640 1 -- 172.21.15.1:0/970819990 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4003e50 con 0x560d858cd4d0 2024-09-21T01:04:17.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.192+0000 7f3acf7fe640 1 -- 172.21.15.1:0/970819990 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f3ae401a030 con 0x560d858cd4d0 2024-09-21T01:04:17.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.192+0000 7f3afd80e740 1 -- 172.21.15.1:0/970819990 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ae0009de0 con 0x560d858cd4d0 2024-09-21T01:04:17.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.192+0000 7f3acf7fe640 1 -- 172.21.15.1:0/970819990 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f3ae4010930 con 0x560d858cd4d0 2024-09-21T01:04:17.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.192+0000 7f3afd80e740 10 client.17130 fetch_fsmap learned FSMap version 35 2024-09-21T01:04:17.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.192+0000 7f3afd80e740 1 -- 172.21.15.1:0/970819990 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x560d859d2620 con 0x560d858cd4d0 2024-09-21T01:04:17.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.192+0000 7f3acf7fe640 1 -- 172.21.15.1:0/970819990 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ae0009de0 con 0x560d858cd4d0 2024-09-21T01:04:17.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.193+0000 7f3acf7fe640 1 -- 172.21.15.1:0/970819990 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 35) ==== 8378+0+0 (secure 0 0 0) 0x7f3ae40047a0 con 0x560d858cd4d0 2024-09-21T01:04:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.193+0000 7f3afd80e740 10 client.17130 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T01:04:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.193+0000 7f3afd80e740 10 client.17130 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:04:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.193+0000 7f3afd80e740 20 client.17130 populate_metadata read hostname 'smithi001' 2024-09-21T01:04:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.193+0000 7f3afd80e740 1 --2- 172.21.15.1:0/970819990 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560d858acd80 0x560d85cacf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.193+0000 7f3afd80e740 4 client.17130 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:04:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.193+0000 7f3afd80e740 1 -- 172.21.15.1:0/970819990 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d85c0a640 con 0x560d858acd80 2024-09-21T01:04:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.193+0000 7f3aeffff640 1 --2- 172.21.15.1:0/970819990 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560d858acd80 0x560d85cacf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.193+0000 7f3acf7fe640 10 client.17130 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:04:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.193+0000 7f3aeffff640 1 --2- 172.21.15.1:0/970819990 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560d858acd80 0x560d85cacf10 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e45db4cdf6b2225 server_cookie=6025bae2198b5632 in_seq=0 out_seq=0 2024-09-21T01:04:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.194+0000 7f3acf7fe640 1 -- 172.21.15.1:0/970819990 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560d85c0a640 con 0x560d858acd80 2024-09-21T01:04:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.194+0000 7f3acf7fe640 10 client.17130 handle_command_reply: tid=0 2024-09-21T01:04:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.194+0000 7f3afd80e740 1 client.17130 shutdown 2024-09-21T01:04:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.195+0000 7f3afd80e740 1 -- 172.21.15.1:0/970819990 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d858cd4d0 msgr2=0x560d85c9fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.195+0000 7f3afd80e740 1 --2- 172.21.15.1:0/970819990 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d858cd4d0 0x560d85c9fc60 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f3ae400fdf0 tx=0x7f3ae4005f90 comp rx=0 tx=0).stop 2024-09-21T01:04:17.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.195+0000 7f3afd80e740 1 -- 172.21.15.1:0/970819990 shutdown_connections 2024-09-21T01:04:17.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.195+0000 7f3afd80e740 1 --2- 172.21.15.1:0/970819990 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560d858acd80 0x560d85cacf10 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:17.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.195+0000 7f3afd80e740 1 --2- 172.21.15.1:0/970819990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d858ee1b0 0x560d85ca07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:17.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.195+0000 7f3afd80e740 1 --2- 172.21.15.1:0/970819990 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d858cd4d0 0x560d85c9fc60 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:17.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.195+0000 7f3acf7fe640 0 client.17130 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:04:17.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.195+0000 7f3afd80e740 1 --2- 172.21.15.1:0/970819990 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d858c52f0 0x560d85c9f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:17.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.195+0000 7f3afd80e740 1 -- 172.21.15.1:0/970819990 >> 172.21.15.1:0/970819990 conn(0x560d858e2300 msgr2=0x560d85c96ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:17.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.195+0000 7f3afd80e740 1 -- 172.21.15.1:0/970819990 shutdown_connections 2024-09-21T01:04:17.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.195+0000 7f3afd80e740 1 -- 172.21.15.1:0/970819990 wait complete. 2024-09-21T01:04:17.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.195+0000 7f3afd80e740 20 client.17130 trim_cache size 0 max 16384 2024-09-21T01:04:17.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.210+0000 7f3afd80e740 1 Processor -- start 2024-09-21T01:04:17.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.210+0000 7f3afd80e740 1 -- start start 2024-09-21T01:04:17.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.211+0000 7f3afd80e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d858c52f0 0x560d85c91930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:17.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.211+0000 7f3afd80e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d858cd4d0 0x560d85c9dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:17.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.211+0000 7f3afd80e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d858ee1b0 0x560d85c9dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:17.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.211+0000 7f3afd80e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3af01aaf90 con 0x560d858ee1b0 2024-09-21T01:04:17.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.211+0000 7f3afd80e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3af01acb90 con 0x560d858c52f0 2024-09-21T01:04:17.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.211+0000 7f3afd80e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3af01ab660 con 0x560d858cd4d0 2024-09-21T01:04:17.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.211+0000 7f3af4d69640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d858ee1b0 0x560d85c9dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:17.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.211+0000 7f3af4d69640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d858ee1b0 0x560d85c9dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53814/0 (socket says 172.21.15.1:53814) 2024-09-21T01:04:17.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.211+0000 7f3af4d69640 1 -- 172.21.15.1:0/3396725604 learned_addr learned my addr 172.21.15.1:0/3396725604 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:17.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.211+0000 7f3aef7fe640 1 --2- 172.21.15.1:0/3396725604 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d858cd4d0 0x560d85c9dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:17.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.211+0000 7f3aeffff640 1 --2- 172.21.15.1:0/3396725604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d858c52f0 0x560d85c91930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:17.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.211+0000 7f3af4d69640 1 -- 172.21.15.1:0/3396725604 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d858cd4d0 msgr2=0x560d85c9dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:17.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.211+0000 7f3af4d69640 1 --2- 172.21.15.1:0/3396725604 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d858cd4d0 0x560d85c9dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:17.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.211+0000 7f3af4d69640 1 -- 172.21.15.1:0/3396725604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d858c52f0 msgr2=0x560d85c91930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:17.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.211+0000 7f3af4d69640 1 --2- 172.21.15.1:0/3396725604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d858c52f0 0x560d85c91930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:17.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.211+0000 7f3af4d69640 1 -- 172.21.15.1:0/3396725604 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d85c9d730 con 0x560d858ee1b0 2024-09-21T01:04:17.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.211+0000 7f3aeffff640 1 --2- 172.21.15.1:0/3396725604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d858c52f0 0x560d85c91930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:04:17.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.211+0000 7f3af4d69640 1 --2- 172.21.15.1:0/3396725604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d858ee1b0 0x560d85c9dff0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f3ae8106510 tx=0x7f3ae802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a23ad0e77de98d04 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:17.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.211+0000 7f3ad5ffb640 1 -- 172.21.15.1:0/3396725604 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae80cdfa0 con 0x560d858ee1b0 2024-09-21T01:04:17.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.212+0000 7f3ad5ffb640 1 -- 172.21.15.1:0/3396725604 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ae8036070 con 0x560d858ee1b0 2024-09-21T01:04:17.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.212+0000 7f3ad5ffb640 1 -- 172.21.15.1:0/3396725604 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae80d8250 con 0x560d858ee1b0 2024-09-21T01:04:17.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.212+0000 7f3afd80e740 1 -- 172.21.15.1:0/3396725604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d858ee1b0 msgr2=0x560d85c9dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:17.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.212+0000 7f3afd80e740 1 --2- 172.21.15.1:0/3396725604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d858ee1b0 0x560d85c9dff0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f3ae8106510 tx=0x7f3ae802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:04:17.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.212+0000 7f3afd80e740 1 -- 172.21.15.1:0/3396725604 shutdown_connections 2024-09-21T01:04:17.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.212+0000 7f3afd80e740 1 --2- 172.21.15.1:0/3396725604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d858ee1b0 0x560d85c9dff0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:17.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.212+0000 7f3afd80e740 1 --2- 172.21.15.1:0/3396725604 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d858cd4d0 0x560d85c9dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:17.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.212+0000 7f3afd80e740 1 --2- 172.21.15.1:0/3396725604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d858c52f0 0x560d85c91930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:17.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.212+0000 7f3afd80e740 1 -- 172.21.15.1:0/3396725604 >> 172.21.15.1:0/3396725604 conn(0x560d858e2300 msgr2=0x560d85c91220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:17.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.212+0000 7f3afd80e740 1 -- 172.21.15.1:0/3396725604 shutdown_connections 2024-09-21T01:04:17.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.212+0000 7f3afd80e740 1 -- 172.21.15.1:0/3396725604 wait complete. 2024-09-21T01:04:17.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.213+0000 7f3afd80e740 1 -- start start 2024-09-21T01:04:17.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.213+0000 7f3afd80e740 1 Processor -- start 2024-09-21T01:04:17.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.213+0000 7f3afd80e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d858c52f0 0x560d85ca2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:17.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.213+0000 7f3afd80e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d858cd4d0 0x560d85ca3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:17.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.213+0000 7f3afd80e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d858ee1b0 0x560d85ca6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:17.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.213+0000 7f3afd80e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3af01ac490 con 0x560d858cd4d0 2024-09-21T01:04:17.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.213+0000 7f3afd80e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3af01abdc0 con 0x560d858ee1b0 2024-09-21T01:04:17.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.213+0000 7f3afd80e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3af01a8f70 con 0x560d858c52f0 2024-09-21T01:04:17.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.213+0000 7f3afd80e740 10 client.0 _ll_register_callbacks cb 0x7f3ae4009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:17.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.213+0000 7f3aef7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d858cd4d0 0x560d85ca3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:17.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.213+0000 7f3aeffff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d858c52f0 0x560d85ca2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.213+0000 7f3aef7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d858cd4d0 0x560d85ca3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53822/0 (socket says 172.21.15.1:53822) 2024-09-21T01:04:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.213+0000 7f3aef7fe640 1 -- 172.21.15.1:0/1852173780 learned_addr learned my addr 172.21.15.1:0/1852173780 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.214+0000 7f3af4d69640 1 --2- 172.21.15.1:0/1852173780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d858ee1b0 0x560d85ca6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.214+0000 7f3aef7fe640 1 -- 172.21.15.1:0/1852173780 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d858c52f0 msgr2=0x560d85ca2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.214+0000 7f3aef7fe640 1 --2- 172.21.15.1:0/1852173780 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d858c52f0 0x560d85ca2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.214+0000 7f3aef7fe640 1 -- 172.21.15.1:0/1852173780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d858ee1b0 msgr2=0x560d85ca6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.214+0000 7f3aef7fe640 1 --2- 172.21.15.1:0/1852173780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d858ee1b0 0x560d85ca6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.214+0000 7f3aef7fe640 1 -- 172.21.15.1:0/1852173780 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d85ca75e0 con 0x560d858cd4d0 2024-09-21T01:04:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.214+0000 7f3aeffff640 1 --2- 172.21.15.1:0/1852173780 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d858c52f0 0x560d85ca2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.214+0000 7f3aef7fe640 1 --2- 172.21.15.1:0/1852173780 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d858cd4d0 0x560d85ca3290 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f3ae40099e0 tx=0x7f3ae4010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b3fda080d088282 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.214+0000 7f3acf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:04:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.214+0000 7f3acf7fe640 1 -- 172.21.15.1:0/1852173780 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4037030 con 0x560d858cd4d0 2024-09-21T01:04:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.214+0000 7f3acf7fe640 1 -- 172.21.15.1:0/1852173780 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f3ae4003e50 con 0x560d858cd4d0 2024-09-21T01:04:17.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.214+0000 7f3afd80e740 1 -- 172.21.15.1:0/1852173780 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ae8036070 con 0x560d858cd4d0 2024-09-21T01:04:17.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.214+0000 7f3acf7fe640 1 -- 172.21.15.1:0/1852173780 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f3ae4005090 con 0x560d858cd4d0 2024-09-21T01:04:17.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.214+0000 7f3afd80e740 10 client.17136 fetch_fsmap learned FSMap version 35 2024-09-21T01:04:17.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.214+0000 7f3afd80e740 1 -- 172.21.15.1:0/1852173780 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x560d85ca4a10 con 0x560d858cd4d0 2024-09-21T01:04:17.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.215+0000 7f3acf7fe640 1 -- 172.21.15.1:0/1852173780 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ae8036070 con 0x560d858cd4d0 2024-09-21T01:04:17.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.215+0000 7f3acf7fe640 1 -- 172.21.15.1:0/1852173780 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 35) ==== 8378+0+0 (secure 0 0 0) 0x7f3ae403c810 con 0x560d858cd4d0 2024-09-21T01:04:17.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.215+0000 7f3afd80e740 10 client.17136 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T01:04:17.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.215+0000 7f3afd80e740 10 client.17136 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:04:17.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.215+0000 7f3afd80e740 20 client.17136 populate_metadata read hostname 'smithi001' 2024-09-21T01:04:17.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.215+0000 7f3afd80e740 1 --2- 172.21.15.1:0/1852173780 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560d858821c0 0x560d85d1a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:17.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.215+0000 7f3afd80e740 4 client.17136 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:04:17.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.215+0000 7f3afd80e740 1 -- 172.21.15.1:0/1852173780 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560d85c060f0 con 0x560d858821c0 2024-09-21T01:04:17.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.215+0000 7f3aeffff640 1 --2- 172.21.15.1:0/1852173780 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560d858821c0 0x560d85d1a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:17.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.216+0000 7f3aeffff640 1 --2- 172.21.15.1:0/1852173780 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560d858821c0 0x560d85d1a030 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c5214bd7058bf0b server_cookie=ab8ab59e110b16d2 in_seq=0 out_seq=0 2024-09-21T01:04:17.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.216+0000 7f3acf7fe640 10 client.17136 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:04:17.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.231+0000 7f3acf7fe640 1 -- 172.21.15.1:0/1852173780 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560d85c060f0 con 0x560d858821c0 2024-09-21T01:04:17.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.231+0000 7f3acf7fe640 10 client.17136 handle_command_reply: tid=0 2024-09-21T01:04:17.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.231+0000 7f3afd80e740 1 client.17136 shutdown 2024-09-21T01:04:17.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.231+0000 7f3afd80e740 1 -- 172.21.15.1:0/1852173780 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d858cd4d0 msgr2=0x560d85ca3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:17.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.231+0000 7f3afd80e740 1 --2- 172.21.15.1:0/1852173780 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d858cd4d0 0x560d85ca3290 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f3ae40099e0 tx=0x7f3ae4010d80 comp rx=0 tx=0).stop 2024-09-21T01:04:17.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.231+0000 7f3afd80e740 1 -- 172.21.15.1:0/1852173780 shutdown_connections 2024-09-21T01:04:17.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.231+0000 7f3afd80e740 1 --2- 172.21.15.1:0/1852173780 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x560d858821c0 0x560d85d1a030 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:17.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.231+0000 7f3afd80e740 1 --2- 172.21.15.1:0/1852173780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d858ee1b0 0x560d85ca6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:17.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.231+0000 7f3afd80e740 1 --2- 172.21.15.1:0/1852173780 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560d858cd4d0 0x560d85ca3290 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:17.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.231+0000 7f3afd80e740 1 --2- 172.21.15.1:0/1852173780 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d858c52f0 0x560d85ca2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:17.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.231+0000 7f3acf7fe640 0 client.17136 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:04:17.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.231+0000 7f3afd80e740 1 -- 172.21.15.1:0/1852173780 >> 172.21.15.1:0/1852173780 conn(0x560d858e2300 msgr2=0x560d85c8fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:17.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.231+0000 7f3afd80e740 1 -- 172.21.15.1:0/1852173780 shutdown_connections 2024-09-21T01:04:17.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.231+0000 7f3afd80e740 1 -- 172.21.15.1:0/1852173780 wait complete. 2024-09-21T01:04:17.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.231+0000 7f3afd80e740 20 client.17136 trim_cache size 0 max 16384 2024-09-21T01:04:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T01:04:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T01:04:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T01:04:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T01:04:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.232+0000 7f3af67cc640 1 -- 172.21.15.1:0/593553599 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f3ad80b6510 msgr2=0x7f3ad80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.232+0000 7f3af67cc640 1 --2- 172.21.15.1:0/593553599 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f3ad80b6510 0x7f3ad80b8a20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3ae400f560 tx=0x7f3ae4004730 comp rx=0 tx=0).stop 2024-09-21T01:04:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.232+0000 7f3af67cc640 1 -- 172.21.15.1:0/593553599 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3af0109540 msgr2=0x7f3af019b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.232+0000 7f3af67cc640 1 --2- 172.21.15.1:0/593553599 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3af0109540 0x7f3af019b0f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f3ae8004af0 tx=0x7f3ae8031700 comp rx=0 tx=0).stop 2024-09-21T01:04:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.232+0000 7f3af67cc640 1 -- 172.21.15.1:0/593553599 shutdown_connections 2024-09-21T01:04:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.232+0000 7f3af67cc640 1 --2- 172.21.15.1:0/593553599 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f3ad80b6510 0x7f3ad80b8a20 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.232+0000 7f3af67cc640 1 --2- 172.21.15.1:0/593553599 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3af0109540 0x7f3af019b0f0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.232+0000 7f3af67cc640 1 --2- 172.21.15.1:0/593553599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3af0106be0 0x7f3af019a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.232+0000 7f3af67cc640 1 --2- 172.21.15.1:0/593553599 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3af0101a90 0x7f3af0199ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.232+0000 7f3af67cc640 1 -- 172.21.15.1:0/593553599 >> 172.21.15.1:0/593553599 conn(0x7f3af00fd690 msgr2=0x7f3af01079b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.232+0000 7f3af67cc640 1 -- 172.21.15.1:0/593553599 shutdown_connections 2024-09-21T01:04:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:17.232+0000 7f3af67cc640 1 -- 172.21.15.1:0/593553599 wait complete. 2024-09-21T01:04:17.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:17 smithi001 ceph-mon[31211]: pgmap v570: 97 pgs: 97 active+clean; 639 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 472 op/s 2024-09-21T01:04:17.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:04:17.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:04:17.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:04:17.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T01:04:17.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T01:04:17.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:04:17.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:04:17.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T01:04:17.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T01:04:17.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:04:17.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:04:17.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T01:04:17.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:17 smithi193 ceph-mon[34660]: pgmap v570: 97 pgs: 97 active+clean; 639 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 472 op/s 2024-09-21T01:04:17.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:04:17.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:04:17.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:04:17.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T01:04:17.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T01:04:17.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:04:17.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:04:17.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T01:04:17.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T01:04:17.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:04:17.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:04:17.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T01:04:17.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:17 smithi042 ceph-mon[34481]: pgmap v570: 97 pgs: 97 active+clean; 639 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 472 op/s 2024-09-21T01:04:17.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:04:17.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:04:17.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:04:17.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T01:04:17.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T01:04:17.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:04:17.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:04:17.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T01:04:17.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T01:04:17.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:04:17.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:04:17.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T01:04:18.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:18 smithi001 ceph-mon[31211]: Adjusting osd_memory_target on smithi193 to 176.0M 2024-09-21T01:04:18.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:18 smithi001 ceph-mon[31211]: Unable to set osd_memory_target on smithi193 to 184596787: error parsing value: Value '184596787' is below minimum 939524096 2024-09-21T01:04:18.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:18 smithi001 ceph-mon[31211]: Adjusting osd_memory_target on smithi042 to 177.0M 2024-09-21T01:04:18.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:18 smithi001 ceph-mon[31211]: Unable to set osd_memory_target on smithi042 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-09-21T01:04:18.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:18 smithi001 ceph-mon[31211]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:04:18.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:18 smithi193 ceph-mon[34660]: Adjusting osd_memory_target on smithi193 to 176.0M 2024-09-21T01:04:18.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:18 smithi193 ceph-mon[34660]: Unable to set osd_memory_target on smithi193 to 184596787: error parsing value: Value '184596787' is below minimum 939524096 2024-09-21T01:04:18.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:18 smithi193 ceph-mon[34660]: Adjusting osd_memory_target on smithi042 to 177.0M 2024-09-21T01:04:18.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:18 smithi193 ceph-mon[34660]: Unable to set osd_memory_target on smithi042 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-09-21T01:04:18.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:18 smithi193 ceph-mon[34660]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:04:18.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:18 smithi042 ceph-mon[34481]: Adjusting osd_memory_target on smithi193 to 176.0M 2024-09-21T01:04:18.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:18 smithi042 ceph-mon[34481]: Unable to set osd_memory_target on smithi193 to 184596787: error parsing value: Value '184596787' is below minimum 939524096 2024-09-21T01:04:18.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:18 smithi042 ceph-mon[34481]: Adjusting osd_memory_target on smithi042 to 177.0M 2024-09-21T01:04:18.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:18 smithi042 ceph-mon[34481]: Unable to set osd_memory_target on smithi042 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-09-21T01:04:18.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:18 smithi042 ceph-mon[34481]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:04:19.861 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:19 smithi001 ceph-mon[31211]: pgmap v571: 97 pgs: 97 active+clean; 638 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 414 op/s 2024-09-21T01:04:19.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:19 smithi193 ceph-mon[34660]: pgmap v571: 97 pgs: 97 active+clean; 638 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 414 op/s 2024-09-21T01:04:19.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:19 smithi042 ceph-mon[34481]: pgmap v571: 97 pgs: 97 active+clean; 638 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 414 op/s 2024-09-21T01:04:21.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:21 smithi001 ceph-mon[31211]: pgmap v572: 97 pgs: 97 active+clean; 628 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 443 op/s 2024-09-21T01:04:21.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:21 smithi193 ceph-mon[34660]: pgmap v572: 97 pgs: 97 active+clean; 628 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 443 op/s 2024-09-21T01:04:21.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:21 smithi042 ceph-mon[34481]: pgmap v572: 97 pgs: 97 active+clean; 628 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 443 op/s 2024-09-21T01:04:23.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:23 smithi001 ceph-mon[31211]: pgmap v573: 97 pgs: 97 active+clean; 614 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 449 op/s 2024-09-21T01:04:23.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:23 smithi193 ceph-mon[34660]: pgmap v573: 97 pgs: 97 active+clean; 614 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 449 op/s 2024-09-21T01:04:23.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:23 smithi042 ceph-mon[34481]: pgmap v573: 97 pgs: 97 active+clean; 614 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 449 op/s 2024-09-21T01:04:24.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:24 smithi001 ceph-mon[31211]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:04:24.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:24 smithi193 ceph-mon[34660]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:04:24.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:24 smithi042 ceph-mon[34481]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:04:25.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:25 smithi001 ceph-mon[31211]: pgmap v574: 97 pgs: 97 active+clean; 604 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 497 op/s 2024-09-21T01:04:25.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:25 smithi193 ceph-mon[34660]: pgmap v574: 97 pgs: 97 active+clean; 604 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 497 op/s 2024-09-21T01:04:25.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:25 smithi042 ceph-mon[34481]: pgmap v574: 97 pgs: 97 active+clean; 604 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 497 op/s 2024-09-21T01:04:27.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:27 smithi001 ceph-mon[31211]: pgmap v575: 97 pgs: 97 active+clean; 588 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 547 op/s 2024-09-21T01:04:27.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:27 smithi193 ceph-mon[34660]: pgmap v575: 97 pgs: 97 active+clean; 588 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 547 op/s 2024-09-21T01:04:27.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:27 smithi042 ceph-mon[34481]: pgmap v575: 97 pgs: 97 active+clean; 588 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 547 op/s 2024-09-21T01:04:28.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:28 smithi001 ceph-mon[31211]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:04:28.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:28 smithi193 ceph-mon[34660]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:04:28.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:28 smithi042 ceph-mon[34481]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:04:29.747 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:04:29.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:29 smithi001 ceph-mon[31211]: pgmap v576: 97 pgs: 97 active+clean; 572 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 530 op/s 2024-09-21T01:04:29.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:29 smithi193 ceph-mon[34660]: pgmap v576: 97 pgs: 97 active+clean; 572 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 530 op/s 2024-09-21T01:04:29.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:29 smithi042 ceph-mon[34481]: pgmap v576: 97 pgs: 97 active+clean; 572 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 530 op/s 2024-09-21T01:04:30.058 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:04:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.338+0000 7f2c22625640 1 -- 172.21.15.1:0/2151274196 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c1c102c30 msgr2=0x7f2c1c1050b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.338+0000 7f2c22625640 1 --2- 172.21.15.1:0/2151274196 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c1c102c30 0x7f2c1c1050b0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c009900 tx=0x7f2c0c02a410 comp rx=0 tx=0).stop 2024-09-21T01:04:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.338+0000 7f2c22625640 1 -- 172.21.15.1:0/2151274196 shutdown_connections 2024-09-21T01:04:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.338+0000 7f2c22625640 1 --2- 172.21.15.1:0/2151274196 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c1c108310 0x7f2c1c10a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.338+0000 7f2c22625640 1 --2- 172.21.15.1:0/2151274196 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2c1c1056f0 0x7f2c1c107bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.338+0000 7f2c22625640 1 --2- 172.21.15.1:0/2151274196 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c1c102c30 0x7f2c1c1050b0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.338+0000 7f2c22625640 1 -- 172.21.15.1:0/2151274196 >> 172.21.15.1:0/2151274196 conn(0x7f2c1c0fd6a0 msgr2=0x7f2c1c0ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:30.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.338+0000 7f2c22625640 1 -- 172.21.15.1:0/2151274196 shutdown_connections 2024-09-21T01:04:30.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.338+0000 7f2c22625640 1 -- 172.21.15.1:0/2151274196 wait complete. 2024-09-21T01:04:30.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.338+0000 7f2c22625640 1 Processor -- start 2024-09-21T01:04:30.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.338+0000 7f2c22625640 1 -- start start 2024-09-21T01:04:30.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.339+0000 7f2c22625640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c1c102c30 0x7f2c1c1021b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.339+0000 7f2c22625640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c1c1056f0 0x7f2c1c19ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.339+0000 7f2c22625640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2c1c108310 0x7f2c1c1a11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.339+0000 7f2c22625640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1c10e260 con 0x7f2c1c102c30 2024-09-21T01:04:30.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.339+0000 7f2c22625640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1c10e0e0 con 0x7f2c1c1056f0 2024-09-21T01:04:30.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.339+0000 7f2c22625640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1c10e3e0 con 0x7f2c1c108310 2024-09-21T01:04:30.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.339+0000 7f2c1bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c1c102c30 0x7f2c1c1021b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.339+0000 7f2c1bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c1c102c30 0x7f2c1c1021b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56602/0 (socket says 172.21.15.1:56602) 2024-09-21T01:04:30.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.339+0000 7f2c1bfff640 1 -- 172.21.15.1:0/3193803006 learned_addr learned my addr 172.21.15.1:0/3193803006 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:30.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.339+0000 7f2c20bc2640 1 --2- 172.21.15.1:0/3193803006 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2c1c108310 0x7f2c1c1a11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.339+0000 7f2c13fff640 1 --2- 172.21.15.1:0/3193803006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c1c1056f0 0x7f2c1c19ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.339+0000 7f2c1bfff640 1 -- 172.21.15.1:0/3193803006 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2c1c108310 msgr2=0x7f2c1c1a11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:30.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.339+0000 7f2c1bfff640 1 --2- 172.21.15.1:0/3193803006 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2c1c108310 0x7f2c1c1a11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.339+0000 7f2c1bfff640 1 -- 172.21.15.1:0/3193803006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c1c1056f0 msgr2=0x7f2c1c19ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:30.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.339+0000 7f2c1bfff640 1 --2- 172.21.15.1:0/3193803006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c1c1056f0 0x7f2c1c19ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.339+0000 7f2c1bfff640 1 -- 172.21.15.1:0/3193803006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c1c1a19c0 con 0x7f2c1c102c30 2024-09-21T01:04:30.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.339+0000 7f2c1bfff640 1 --2- 172.21.15.1:0/3193803006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c1c102c30 0x7f2c1c1021b0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c031440 tx=0x7f2c0c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:30.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.339+0000 7f2c19ffb640 1 -- 172.21.15.1:0/3193803006 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c03f070 con 0x7f2c1c102c30 2024-09-21T01:04:30.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.340+0000 7f2c19ffb640 1 -- 172.21.15.1:0/3193803006 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c0c031c50 con 0x7f2c1c102c30 2024-09-21T01:04:30.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.340+0000 7f2c22625640 1 -- 172.21.15.1:0/3193803006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c1c1a1c50 con 0x7f2c1c102c30 2024-09-21T01:04:30.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.340+0000 7f2c19ffb640 1 -- 172.21.15.1:0/3193803006 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c035030 con 0x7f2c1c102c30 2024-09-21T01:04:30.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.340+0000 7f2c22625640 1 -- 172.21.15.1:0/3193803006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c1c1a2190 con 0x7f2c1c102c30 2024-09-21T01:04:30.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.343+0000 7f2c19ffb640 1 -- 172.21.15.1:0/3193803006 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f2c0c042070 con 0x7f2c1c102c30 2024-09-21T01:04:30.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.343+0000 7f2c29673740 1 Processor -- start 2024-09-21T01:04:30.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.343+0000 7f2c29673740 1 -- start start 2024-09-21T01:04:30.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.343+0000 7f2c29673740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f5929b1b0 0x563f59647260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.343+0000 7f2c29673740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f592722f0 0x563f596478d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.343+0000 7f2c29673740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f5927a4d0 0x563f59648420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.343+0000 7f2c29673740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563f595b56f0 con 0x563f5927a4d0 2024-09-21T01:04:30.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.343+0000 7f2c29673740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563f595a4b20 con 0x563f592722f0 2024-09-21T01:04:30.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.343+0000 7f2c29673740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563f595a8930 con 0x563f5929b1b0 2024-09-21T01:04:30.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.343+0000 7f2c13fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f5927a4d0 0x563f59648420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.343+0000 7f2c1bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f592722f0 0x563f596478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.343+0000 7f2c13fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f5927a4d0 0x563f59648420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56614/0 (socket says 172.21.15.1:56614) 2024-09-21T01:04:30.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.344+0000 7f2c13fff640 1 -- 172.21.15.1:0/1023993442 learned_addr learned my addr 172.21.15.1:0/1023993442 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:30.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.343+0000 7f2c20bc2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f5929b1b0 0x563f59647260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.344+0000 7f2c19ffb640 1 --2- 172.21.15.1:0/3193803006 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f2c080b6590 0x7f2c080b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.344+0000 7f2c20bc2640 1 --2- 172.21.15.1:0/3193803006 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f2c080b6590 0x7f2c080b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.344+0000 7f2c13fff640 1 -- 172.21.15.1:0/1023993442 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f5929b1b0 msgr2=0x563f59647260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:30.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.344+0000 7f2c13fff640 1 --2- 172.21.15.1:0/1023993442 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f5929b1b0 0x563f59647260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.344+0000 7f2c19ffb640 1 -- 172.21.15.1:0/3193803006 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f2c0c107a00 con 0x7f2c1c102c30 2024-09-21T01:04:30.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.344+0000 7f2c13fff640 1 -- 172.21.15.1:0/1023993442 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f592722f0 msgr2=0x563f596478d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:30.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.344+0000 7f2c13fff640 1 --2- 172.21.15.1:0/1023993442 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f592722f0 0x563f596478d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.344+0000 7f2c13fff640 1 -- 172.21.15.1:0/1023993442 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f5956a530 con 0x563f5927a4d0 2024-09-21T01:04:30.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.344+0000 7f2c13fff640 1 --2- 172.21.15.1:0/1023993442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f5927a4d0 0x563f59648420 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f2c04009d20 tx=0x7f2c04011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d33356aa5249821 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:30.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.345+0000 7f2c127fc640 1 -- 172.21.15.1:0/1023993442 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0401e070 con 0x563f5927a4d0 2024-09-21T01:04:30.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.345+0000 7f2c20bc2640 1 --2- 172.21.15.1:0/3193803006 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f2c080b6590 0x7f2c080b8aa0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2c14005fd0 tx=0x7f2c14015040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:30.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.345+0000 7f2c127fc640 1 -- 172.21.15.1:0/1023993442 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c04019ae0 con 0x563f5927a4d0 2024-09-21T01:04:30.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.345+0000 7f2c127fc640 1 -- 172.21.15.1:0/1023993442 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0400eac0 con 0x563f5927a4d0 2024-09-21T01:04:30.351 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.346+0000 7f2c29673740 1 -- 172.21.15.1:0/1023993442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f5927a4d0 msgr2=0x563f59648420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:30.351 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.346+0000 7f2c29673740 1 --2- 172.21.15.1:0/1023993442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f5927a4d0 0x563f59648420 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f2c04009d20 tx=0x7f2c04011810 comp rx=0 tx=0).stop 2024-09-21T01:04:30.351 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.346+0000 7f2c29673740 1 -- 172.21.15.1:0/1023993442 shutdown_connections 2024-09-21T01:04:30.351 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.346+0000 7f2c29673740 1 --2- 172.21.15.1:0/1023993442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f5927a4d0 0x563f59648420 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.351 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.346+0000 7f2c29673740 1 --2- 172.21.15.1:0/1023993442 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f592722f0 0x563f596478d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.346+0000 7f2c29673740 1 --2- 172.21.15.1:0/1023993442 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f5929b1b0 0x563f59647260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.346+0000 7f2c29673740 1 -- 172.21.15.1:0/1023993442 >> 172.21.15.1:0/1023993442 conn(0x563f5928f300 msgr2=0x563f5963e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:30.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.346+0000 7f2c29673740 1 -- 172.21.15.1:0/1023993442 shutdown_connections 2024-09-21T01:04:30.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.346+0000 7f2c29673740 1 -- 172.21.15.1:0/1023993442 wait complete. 2024-09-21T01:04:30.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.346+0000 7f2c29673740 1 -- start start 2024-09-21T01:04:30.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.346+0000 7f2c29673740 1 Processor -- start 2024-09-21T01:04:30.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.347+0000 7f2c29673740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f592722f0 0x563f59650a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.347+0000 7f2c29673740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f5927a4d0 0x563f596510c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.347+0000 7f2c29673740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f5929b1b0 0x563f59651c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.347+0000 7f2c29673740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563f594dcab0 con 0x563f5927a4d0 2024-09-21T01:04:30.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.347+0000 7f2c29673740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563f5954a730 con 0x563f5929b1b0 2024-09-21T01:04:30.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.347+0000 7f2c29673740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563f59648f40 con 0x563f592722f0 2024-09-21T01:04:30.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.347+0000 7f2c29673740 10 client.0 _ll_register_callbacks cb 0x563f5959e6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.347+0000 7f2c1bfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f592722f0 0x563f59650a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.347+0000 7f2c13fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f5927a4d0 0x563f596510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.347+0000 7f2c1bfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f592722f0 0x563f59650a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:54726/0 (socket says 172.21.15.1:54726) 2024-09-21T01:04:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.347+0000 7f2c1bfff640 1 -- 172.21.15.1:0/2387911304 learned_addr learned my addr 172.21.15.1:0/2387911304 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.347+0000 7f2c20bc2640 1 --2- 172.21.15.1:0/2387911304 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f5929b1b0 0x563f59651c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.347+0000 7f2c1bfff640 1 -- 172.21.15.1:0/2387911304 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f5929b1b0 msgr2=0x563f59651c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.347+0000 7f2c1bfff640 1 --2- 172.21.15.1:0/2387911304 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f5929b1b0 0x563f59651c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.347+0000 7f2c1bfff640 1 -- 172.21.15.1:0/2387911304 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f5927a4d0 msgr2=0x563f596510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.347+0000 7f2c1bfff640 1 --2- 172.21.15.1:0/2387911304 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f5927a4d0 0x563f596510c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.347+0000 7f2c1bfff640 1 -- 172.21.15.1:0/2387911304 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f59306790 con 0x563f592722f0 2024-09-21T01:04:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.347+0000 7f2c13fff640 1 --2- 172.21.15.1:0/2387911304 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f5927a4d0 0x563f596510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.348+0000 7f2c1bfff640 1 --2- 172.21.15.1:0/2387911304 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f592722f0 0x563f59650a00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c1054e0 tx=0x7f2c0c03b6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c38270fec38a3e19 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.348+0000 7f2bfb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T01:04:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.348+0000 7f2bfb7fe640 1 -- 172.21.15.1:0/2387911304 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c049070 con 0x563f592722f0 2024-09-21T01:04:30.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.348+0000 7f2bfb7fe640 1 -- 172.21.15.1:0/2387911304 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f2c0c0d7100 con 0x563f592722f0 2024-09-21T01:04:30.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.348+0000 7f2c29673740 1 -- 172.21.15.1:0/2387911304 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c04019ae0 con 0x563f592722f0 2024-09-21T01:04:30.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.348+0000 7f2bfb7fe640 1 -- 172.21.15.1:0/2387911304 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f2c0c0cd570 con 0x563f592722f0 2024-09-21T01:04:30.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.348+0000 7f2c29673740 10 client.26680 fetch_fsmap learned FSMap version 38 2024-09-21T01:04:30.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.348+0000 7f2c29673740 1 -- 172.21.15.1:0/2387911304 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x563f5937f620 con 0x563f592722f0 2024-09-21T01:04:30.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.348+0000 7f2bfb7fe640 1 -- 172.21.15.1:0/2387911304 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c04019ae0 con 0x563f592722f0 2024-09-21T01:04:30.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.348+0000 7f2bfb7fe640 1 -- 172.21.15.1:0/2387911304 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 38) ==== 8390+0+0 (secure 0 0 0) 0x7f2c0c0efb80 con 0x563f592722f0 2024-09-21T01:04:30.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.348+0000 7f2c29673740 10 client.26680 fetch_fsmap finished waiting for FSMap version 38 2024-09-21T01:04:30.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.348+0000 7f2c29673740 10 client.26680 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:04:30.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.348+0000 7f2c29673740 20 client.26680 populate_metadata read hostname 'smithi001' 2024-09-21T01:04:30.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.348+0000 7f2c29673740 1 --2- 172.21.15.1:0/2387911304 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x563f59259d80 0x563f5965e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.348+0000 7f2c29673740 4 client.26680 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:04:30.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.348+0000 7f2c29673740 1 -- 172.21.15.1:0/2387911304 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f595b7640 con 0x563f59259d80 2024-09-21T01:04:30.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.349+0000 7f2c13fff640 1 --2- 172.21.15.1:0/2387911304 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x563f59259d80 0x563f5965e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.349+0000 7f2bfb7fe640 10 client.26680 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:04:30.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.349+0000 7f2c13fff640 1 --2- 172.21.15.1:0/2387911304 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x563f59259d80 0x563f5965e320 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c76c0881edaf6d0 server_cookie=6bad5bc7561554dd in_seq=0 out_seq=0 2024-09-21T01:04:30.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.350+0000 7f2bfb7fe640 1 -- 172.21.15.1:0/2387911304 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563f595b7640 con 0x563f59259d80 2024-09-21T01:04:30.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.350+0000 7f2bfb7fe640 10 client.26680 handle_command_reply: tid=0 2024-09-21T01:04:30.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.350+0000 7f2c29673740 1 client.26680 shutdown 2024-09-21T01:04:30.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.350+0000 7f2c29673740 1 -- 172.21.15.1:0/2387911304 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f592722f0 msgr2=0x563f59650a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:30.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.350+0000 7f2c29673740 1 --2- 172.21.15.1:0/2387911304 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f592722f0 0x563f59650a00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c1054e0 tx=0x7f2c0c03b6e0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.350+0000 7f2c29673740 1 -- 172.21.15.1:0/2387911304 shutdown_connections 2024-09-21T01:04:30.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.350+0000 7f2c29673740 1 --2- 172.21.15.1:0/2387911304 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x563f59259d80 0x563f5965e320 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.350+0000 7f2c29673740 1 --2- 172.21.15.1:0/2387911304 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f5929b1b0 0x563f59651c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.350+0000 7f2c29673740 1 --2- 172.21.15.1:0/2387911304 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f5927a4d0 0x563f596510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.350+0000 7f2bfb7fe640 0 client.26680 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:04:30.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.350+0000 7f2c29673740 1 --2- 172.21.15.1:0/2387911304 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f592722f0 0x563f59650a00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.350+0000 7f2c29673740 1 -- 172.21.15.1:0/2387911304 >> 172.21.15.1:0/2387911304 conn(0x563f5928f300 msgr2=0x563f5963cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:30.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.351+0000 7f2c29673740 1 -- 172.21.15.1:0/2387911304 shutdown_connections 2024-09-21T01:04:30.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.351+0000 7f2c29673740 1 -- 172.21.15.1:0/2387911304 wait complete. 2024-09-21T01:04:30.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.351+0000 7f2c29673740 20 client.26680 trim_cache size 0 max 16384 2024-09-21T01:04:30.379 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.377+0000 7f2c29673740 1 Processor -- start 2024-09-21T01:04:30.379 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.377+0000 7f2c29673740 1 -- start start 2024-09-21T01:04:30.379 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.378+0000 7f2c29673740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f592722f0 0x563f5963cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.378+0000 7f2c29673740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f5927a4d0 0x563f5963d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.378+0000 7f2c29673740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f5929b1b0 0x563f5963d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.378+0000 7f2c29673740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1c1a8d00 con 0x563f5929b1b0 2024-09-21T01:04:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.378+0000 7f2c29673740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1c1aa990 con 0x563f5927a4d0 2024-09-21T01:04:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.378+0000 7f2c29673740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1c1a9400 con 0x563f592722f0 2024-09-21T01:04:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.378+0000 7f2c20bc2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f5929b1b0 0x563f5963d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.378+0000 7f2c20bc2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f5929b1b0 0x563f5963d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56622/0 (socket says 172.21.15.1:56622) 2024-09-21T01:04:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.378+0000 7f2c20bc2640 1 -- 172.21.15.1:0/1451760611 learned_addr learned my addr 172.21.15.1:0/1451760611 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.378+0000 7f2c13fff640 1 --2- 172.21.15.1:0/1451760611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f5927a4d0 0x563f5963d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.378+0000 7f2c1bfff640 1 --2- 172.21.15.1:0/1451760611 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f592722f0 0x563f5963cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.378+0000 7f2c20bc2640 1 -- 172.21.15.1:0/1451760611 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f592722f0 msgr2=0x563f5963cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.378+0000 7f2c20bc2640 1 --2- 172.21.15.1:0/1451760611 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f592722f0 0x563f5963cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.378+0000 7f2c20bc2640 1 -- 172.21.15.1:0/1451760611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f5927a4d0 msgr2=0x563f5963d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.378+0000 7f2c20bc2640 1 --2- 172.21.15.1:0/1451760611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f5927a4d0 0x563f5963d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.378+0000 7f2c20bc2640 1 -- 172.21.15.1:0/1451760611 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f5964eb30 con 0x563f5929b1b0 2024-09-21T01:04:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.378+0000 7f2c1bfff640 1 --2- 172.21.15.1:0/1451760611 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f592722f0 0x563f5963cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.378+0000 7f2c20bc2640 1 --2- 172.21.15.1:0/1451760611 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f5929b1b0 0x563f5963d920 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f2c1400f860 tx=0x7f2c14017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcd3ec7e074aabe5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.379+0000 7f2c11ffb640 1 -- 172.21.15.1:0/1451760611 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c1400fde0 con 0x563f5929b1b0 2024-09-21T01:04:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.379+0000 7f2c11ffb640 1 -- 172.21.15.1:0/1451760611 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c14010de0 con 0x563f5929b1b0 2024-09-21T01:04:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.379+0000 7f2c11ffb640 1 -- 172.21.15.1:0/1451760611 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c14020e20 con 0x563f5929b1b0 2024-09-21T01:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.379+0000 7f2c29673740 1 -- 172.21.15.1:0/1451760611 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f5929b1b0 msgr2=0x563f5963d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.379+0000 7f2c29673740 1 --2- 172.21.15.1:0/1451760611 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f5929b1b0 0x563f5963d920 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f2c1400f860 tx=0x7f2c14017000 comp rx=0 tx=0).stop 2024-09-21T01:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.380+0000 7f2c29673740 1 -- 172.21.15.1:0/1451760611 shutdown_connections 2024-09-21T01:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.380+0000 7f2c29673740 1 --2- 172.21.15.1:0/1451760611 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f5929b1b0 0x563f5963d920 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.380+0000 7f2c29673740 1 --2- 172.21.15.1:0/1451760611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f5927a4d0 0x563f5963d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.380+0000 7f2c29673740 1 --2- 172.21.15.1:0/1451760611 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f592722f0 0x563f5963cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.380+0000 7f2c29673740 1 -- 172.21.15.1:0/1451760611 >> 172.21.15.1:0/1451760611 conn(0x563f5928f300 msgr2=0x563f59647200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.380+0000 7f2c29673740 1 -- 172.21.15.1:0/1451760611 shutdown_connections 2024-09-21T01:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.380+0000 7f2c29673740 1 -- 172.21.15.1:0/1451760611 wait complete. 2024-09-21T01:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.380+0000 7f2c29673740 1 -- start start 2024-09-21T01:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.380+0000 7f2c29673740 1 Processor -- start 2024-09-21T01:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.380+0000 7f2c29673740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f592722f0 0x563f59658460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.380+0000 7f2c29673740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f5927a4d0 0x563f59658b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.380+0000 7f2c29673740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f5929b1b0 0x563f596572b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.380+0000 7f2c29673740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1c1aa200 con 0x563f5927a4d0 2024-09-21T01:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.380+0000 7f2c29673740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1c1a9b30 con 0x563f592722f0 2024-09-21T01:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.380+0000 7f2c29673740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1c1a6ce0 con 0x563f5929b1b0 2024-09-21T01:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.380+0000 7f2c29673740 10 client.0 _ll_register_callbacks cb 0x7f2c0c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.381+0000 7f2c13fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f5927a4d0 0x563f59658b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.381+0000 7f2c13fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f5927a4d0 0x563f59658b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56624/0 (socket says 172.21.15.1:56624) 2024-09-21T01:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.381+0000 7f2c13fff640 1 -- 172.21.15.1:0/2057068864 learned_addr learned my addr 172.21.15.1:0/2057068864 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.381+0000 7f2c20bc2640 1 --2- 172.21.15.1:0/2057068864 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f5929b1b0 0x563f596572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.381+0000 7f2c1bfff640 1 --2- 172.21.15.1:0/2057068864 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f592722f0 0x563f59658460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.381+0000 7f2c13fff640 1 -- 172.21.15.1:0/2057068864 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f5929b1b0 msgr2=0x563f596572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.381+0000 7f2c13fff640 1 --2- 172.21.15.1:0/2057068864 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f5929b1b0 0x563f596572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.381+0000 7f2c13fff640 1 -- 172.21.15.1:0/2057068864 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f592722f0 msgr2=0x563f59658460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.381+0000 7f2c13fff640 1 --2- 172.21.15.1:0/2057068864 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f592722f0 0x563f59658460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.381+0000 7f2c13fff640 1 -- 172.21.15.1:0/2057068864 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f59657a40 con 0x563f5927a4d0 2024-09-21T01:04:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.381+0000 7f2c13fff640 1 --2- 172.21.15.1:0/2057068864 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f5927a4d0 0x563f59658b20 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f2c040058c0 tx=0x7f2c04009c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44932c98a25e3a85 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.381+0000 7f2bfb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:04:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.381+0000 7f2bfb7fe640 1 -- 172.21.15.1:0/2057068864 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0401e040 con 0x563f5927a4d0 2024-09-21T01:04:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.381+0000 7f2bfb7fe640 1 -- 172.21.15.1:0/2057068864 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f2c040035f0 con 0x563f5927a4d0 2024-09-21T01:04:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.381+0000 7f2c29673740 1 -- 172.21.15.1:0/2057068864 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c14010de0 con 0x563f5927a4d0 2024-09-21T01:04:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.382+0000 7f2bfb7fe640 1 -- 172.21.15.1:0/2057068864 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f2c040037f0 con 0x563f5927a4d0 2024-09-21T01:04:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.382+0000 7f2c29673740 10 client.17154 fetch_fsmap learned FSMap version 38 2024-09-21T01:04:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.382+0000 7f2c29673740 1 -- 172.21.15.1:0/2057068864 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x563f59656920 con 0x563f5927a4d0 2024-09-21T01:04:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.382+0000 7f2bfb7fe640 1 -- 172.21.15.1:0/2057068864 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c14010de0 con 0x563f5927a4d0 2024-09-21T01:04:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.382+0000 7f2bfb7fe640 1 -- 172.21.15.1:0/2057068864 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 38) ==== 8390+0+0 (secure 0 0 0) 0x7f2c0400e7f0 con 0x563f5927a4d0 2024-09-21T01:04:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.382+0000 7f2c29673740 10 client.17154 fetch_fsmap finished waiting for FSMap version 38 2024-09-21T01:04:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.382+0000 7f2c29673740 10 client.17154 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:04:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.382+0000 7f2c29673740 20 client.17154 populate_metadata read hostname 'smithi001' 2024-09-21T01:04:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.382+0000 7f2c29673740 1 --2- 172.21.15.1:0/2057068864 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x563f5922f1c0 0x563f596cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.382+0000 7f2c29673740 4 client.17154 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:04:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.382+0000 7f2c29673740 1 -- 172.21.15.1:0/2057068864 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563f595b30f0 con 0x563f5922f1c0 2024-09-21T01:04:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.382+0000 7f2c1bfff640 1 --2- 172.21.15.1:0/2057068864 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x563f5922f1c0 0x563f596cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.383+0000 7f2bfb7fe640 10 client.17154 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:04:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.383+0000 7f2c1bfff640 1 --2- 172.21.15.1:0/2057068864 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x563f5922f1c0 0x563f596cb290 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7554a0d2b8c43697 server_cookie=6e610e4f92628af2 in_seq=0 out_seq=0 2024-09-21T01:04:30.407 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.405+0000 7f2bfb7fe640 1 -- 172.21.15.1:0/2057068864 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563f595b30f0 con 0x563f5922f1c0 2024-09-21T01:04:30.407 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.405+0000 7f2bfb7fe640 10 client.17154 handle_command_reply: tid=0 2024-09-21T01:04:30.407 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.405+0000 7f2c29673740 1 client.17154 shutdown 2024-09-21T01:04:30.407 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.406+0000 7f2c29673740 1 -- 172.21.15.1:0/2057068864 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f5927a4d0 msgr2=0x563f59658b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:30.407 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.406+0000 7f2c29673740 1 --2- 172.21.15.1:0/2057068864 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f5927a4d0 0x563f59658b20 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f2c040058c0 tx=0x7f2c04009c40 comp rx=0 tx=0).stop 2024-09-21T01:04:30.407 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.406+0000 7f2c29673740 1 -- 172.21.15.1:0/2057068864 shutdown_connections 2024-09-21T01:04:30.407 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.406+0000 7f2c29673740 1 --2- 172.21.15.1:0/2057068864 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x563f5922f1c0 0x563f596cb290 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.407 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.406+0000 7f2c29673740 1 --2- 172.21.15.1:0/2057068864 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f5929b1b0 0x563f596572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.407 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.406+0000 7f2bfb7fe640 0 client.17154 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:04:30.407 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.406+0000 7f2c29673740 1 --2- 172.21.15.1:0/2057068864 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f5927a4d0 0x563f59658b20 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.408 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.406+0000 7f2c29673740 1 --2- 172.21.15.1:0/2057068864 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563f592722f0 0x563f59658460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.408 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.406+0000 7f2c29673740 1 -- 172.21.15.1:0/2057068864 >> 172.21.15.1:0/2057068864 conn(0x563f5928f300 msgr2=0x563f5964f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:30.408 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.406+0000 7f2c29673740 1 -- 172.21.15.1:0/2057068864 shutdown_connections 2024-09-21T01:04:30.408 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.406+0000 7f2c29673740 1 -- 172.21.15.1:0/2057068864 wait complete. 2024-09-21T01:04:30.408 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.406+0000 7f2c29673740 20 client.17154 trim_cache size 0 max 16384 2024-09-21T01:04:30.408 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T01:04:30.408 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T01:04:30.408 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T01:04:30.408 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T01:04:30.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.406+0000 7f2c22625640 1 -- 172.21.15.1:0/3193803006 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f2c080b6590 msgr2=0x7f2c080b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:30.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.406+0000 7f2c22625640 1 --2- 172.21.15.1:0/3193803006 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f2c080b6590 0x7f2c080b8aa0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2c14005fd0 tx=0x7f2c14015040 comp rx=0 tx=0).stop 2024-09-21T01:04:30.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.406+0000 7f2c22625640 1 -- 172.21.15.1:0/3193803006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c1c102c30 msgr2=0x7f2c1c1021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:30.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.406+0000 7f2c22625640 1 --2- 172.21.15.1:0/3193803006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c1c102c30 0x7f2c1c1021b0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c031440 tx=0x7f2c0c003c10 comp rx=0 tx=0).stop 2024-09-21T01:04:30.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.407+0000 7f2c22625640 1 -- 172.21.15.1:0/3193803006 shutdown_connections 2024-09-21T01:04:30.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.407+0000 7f2c22625640 1 --2- 172.21.15.1:0/3193803006 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2c1c108310 0x7f2c1c1a11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.410 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.407+0000 7f2c22625640 1 --2- 172.21.15.1:0/3193803006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c1c1056f0 0x7f2c1c19ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.410 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.407+0000 7f2c22625640 1 --2- 172.21.15.1:0/3193803006 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f2c080b6590 0x7f2c080b8aa0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.410 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.407+0000 7f2c22625640 1 --2- 172.21.15.1:0/3193803006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c1c102c30 0x7f2c1c1021b0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.410 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.407+0000 7f2c22625640 1 -- 172.21.15.1:0/3193803006 >> 172.21.15.1:0/3193803006 conn(0x7f2c1c0fd6a0 msgr2=0x7f2c1c103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:30.410 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.407+0000 7f2c22625640 1 -- 172.21.15.1:0/3193803006 shutdown_connections 2024-09-21T01:04:30.410 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:30.407+0000 7f2c22625640 1 -- 172.21.15.1:0/3193803006 wait complete. 2024-09-21T01:04:30.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.603+0000 7f4575b0a640 1 -- 172.21.15.1:0/3275169640 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45701083d0 msgr2=0x7f45701087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:30.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.603+0000 7f4575b0a640 1 --2- 172.21.15.1:0/3275169640 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45701083d0 0x7f45701087e0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f4564009900 tx=0x7f456402a410 comp rx=0 tx=0).stop 2024-09-21T01:04:30.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.603+0000 7f4575b0a640 1 -- 172.21.15.1:0/3275169640 shutdown_connections 2024-09-21T01:04:30.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.603+0000 7f4575b0a640 1 --2- 172.21.15.1:0/3275169640 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4570108d20 0x7f457010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.603+0000 7f4575b0a640 1 --2- 172.21.15.1:0/3275169640 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45701083d0 0x7f45701087e0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.603+0000 7f4575b0a640 1 --2- 172.21.15.1:0/3275169640 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4570102ae0 0x7f4570102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.603+0000 7f4575b0a640 1 -- 172.21.15.1:0/3275169640 >> 172.21.15.1:0/3275169640 conn(0x7f4570079760 msgr2=0x7f4570079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:30.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.604+0000 7f4575b0a640 1 -- 172.21.15.1:0/3275169640 shutdown_connections 2024-09-21T01:04:30.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.604+0000 7f4575b0a640 1 -- 172.21.15.1:0/3275169640 wait complete. 2024-09-21T01:04:30.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.604+0000 7f4575b0a640 1 Processor -- start 2024-09-21T01:04:30.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.604+0000 7f4575b0a640 1 -- start start 2024-09-21T01:04:30.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.605+0000 7f4575b0a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4570102ae0 0x7f45700ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.605+0000 7f4575b0a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f45701083d0 0x7f45700ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.605+0000 7f4575b0a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4570108d20 0x7f45701000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.605+0000 7f4575b0a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4570112990 con 0x7f4570108d20 2024-09-21T01:04:30.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.605+0000 7f4575b0a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4570112810 con 0x7f4570102ae0 2024-09-21T01:04:30.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.605+0000 7f4575b0a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4570112b10 con 0x7f45701083d0 2024-09-21T01:04:30.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.605+0000 7f456f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4570102ae0 0x7f45700ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.605+0000 7f456ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4570108d20 0x7f45701000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.605+0000 7f456f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4570102ae0 0x7f45700ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:50680/0 (socket says 172.21.15.1:50680) 2024-09-21T01:04:30.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.605+0000 7f456f7fe640 1 -- 172.21.15.1:0/3215033156 learned_addr learned my addr 172.21.15.1:0/3215033156 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:30.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.605+0000 7f456effd640 1 --2- 172.21.15.1:0/3215033156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f45701083d0 0x7f45700ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.605+0000 7f456f7fe640 1 -- 172.21.15.1:0/3215033156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f45701083d0 msgr2=0x7f45700ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:30.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.605+0000 7f456f7fe640 1 --2- 172.21.15.1:0/3215033156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f45701083d0 0x7f45700ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.605+0000 7f456f7fe640 1 -- 172.21.15.1:0/3215033156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4570108d20 msgr2=0x7f45701000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:30.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.605+0000 7f456f7fe640 1 --2- 172.21.15.1:0/3215033156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4570108d20 0x7f45701000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.605+0000 7f456f7fe640 1 -- 172.21.15.1:0/3215033156 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45701a8710 con 0x7f4570102ae0 2024-09-21T01:04:30.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.606+0000 7f456f7fe640 1 --2- 172.21.15.1:0/3215033156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4570102ae0 0x7f45700ff670 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f456000e9f0 tx=0x7f456000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:30.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.606+0000 7f456cff9640 1 -- 172.21.15.1:0/3215033156 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f456000cd80 con 0x7f4570102ae0 2024-09-21T01:04:30.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.606+0000 7f456cff9640 1 -- 172.21.15.1:0/3215033156 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45600054d0 con 0x7f4570102ae0 2024-09-21T01:04:30.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.606+0000 7f456cff9640 1 -- 172.21.15.1:0/3215033156 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4560010690 con 0x7f4570102ae0 2024-09-21T01:04:30.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.606+0000 7f4575b0a640 1 -- 172.21.15.1:0/3215033156 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45701a8a00 con 0x7f4570102ae0 2024-09-21T01:04:30.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.606+0000 7f4575b0a640 1 -- 172.21.15.1:0/3215033156 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45701a8ec0 con 0x7f4570102ae0 2024-09-21T01:04:30.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.609+0000 7f457c07e740 1 Processor -- start 2024-09-21T01:04:30.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.609+0000 7f457c07e740 1 -- start start 2024-09-21T01:04:30.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.609+0000 7f456cff9640 1 -- 172.21.15.1:0/3215033156 <== mon.2 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f4560004e90 con 0x7f4570102ae0 2024-09-21T01:04:30.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.609+0000 7f457c07e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556bc88c2070 0x556bc8c69650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.609+0000 7f457c07e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bc88991b0 0x556bc8c69b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.609+0000 7f457c07e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556bc88a1390 0x556bc8c6a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.609+0000 7f457c07e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556bc8bdfe50 con 0x556bc88c2070 2024-09-21T01:04:30.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.609+0000 7f457c07e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556bc8bcf280 con 0x556bc88991b0 2024-09-21T01:04:30.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.609+0000 7f457c07e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556bc8bd3090 con 0x556bc88a1390 2024-09-21T01:04:30.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.609+0000 7f456ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556bc88c2070 0x556bc8c69650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.609+0000 7f456effd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556bc88a1390 0x556bc8c6a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.609+0000 7f456f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bc88991b0 0x556bc8c69b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.609+0000 7f456effd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556bc88a1390 0x556bc8c6a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:54768/0 (socket says 172.21.15.1:54768) 2024-09-21T01:04:30.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.609+0000 7f456ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556bc88c2070 0x556bc8c69650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56660/0 (socket says 172.21.15.1:56660) 2024-09-21T01:04:30.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.609+0000 7f456effd640 1 -- 172.21.15.1:0/938138962 learned_addr learned my addr 172.21.15.1:0/938138962 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:30.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.610+0000 7f456effd640 1 -- 172.21.15.1:0/938138962 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bc88991b0 msgr2=0x556bc8c69b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:30.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.610+0000 7f456effd640 1 --2- 172.21.15.1:0/938138962 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bc88991b0 0x556bc8c69b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.610+0000 7f456effd640 1 -- 172.21.15.1:0/938138962 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556bc88c2070 msgr2=0x556bc8c69650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:30.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.610+0000 7f456effd640 1 --2- 172.21.15.1:0/938138962 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556bc88c2070 0x556bc8c69650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.610+0000 7f456effd640 1 -- 172.21.15.1:0/938138962 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bc892d650 con 0x556bc88a1390 2024-09-21T01:04:30.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.610+0000 7f456effd640 1 --2- 172.21.15.1:0/938138962 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556bc88a1390 0x556bc8c6a0d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4564009900 tx=0x7f4564032b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa211e51a01933c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:30.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.610+0000 7f456cff9640 1 --2- 172.21.15.1:0/3215033156 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f45580b6510 0x7f45580b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.610+0000 7f4555ffb640 1 -- 172.21.15.1:0/938138962 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4564040070 con 0x556bc88a1390 2024-09-21T01:04:30.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.610+0000 7f456ffff640 1 --2- 172.21.15.1:0/3215033156 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f45580b6510 0x7f45580b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.610+0000 7f4555ffb640 1 -- 172.21.15.1:0/938138962 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4564004030 con 0x556bc88a1390 2024-09-21T01:04:30.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.611+0000 7f456cff9640 1 -- 172.21.15.1:0/3215033156 <== mon.2 v2:172.21.15.42:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f45600e76f0 con 0x7f4570102ae0 2024-09-21T01:04:30.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.611+0000 7f4555ffb640 1 -- 172.21.15.1:0/938138962 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4564035040 con 0x556bc88a1390 2024-09-21T01:04:30.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.611+0000 7f457c07e740 1 -- 172.21.15.1:0/938138962 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556bc88a1390 msgr2=0x556bc8c6a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:30.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.611+0000 7f456ffff640 1 --2- 172.21.15.1:0/3215033156 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f45580b6510 0x7f45580b8a20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4568005fd0 tx=0x7f4568009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:30.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.611+0000 7f457c07e740 1 --2- 172.21.15.1:0/938138962 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556bc88a1390 0x556bc8c6a0d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4564009900 tx=0x7f4564032b20 comp rx=0 tx=0).stop 2024-09-21T01:04:30.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.611+0000 7f457c07e740 1 -- 172.21.15.1:0/938138962 shutdown_connections 2024-09-21T01:04:30.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.611+0000 7f457c07e740 1 --2- 172.21.15.1:0/938138962 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556bc88a1390 0x556bc8c6a0d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.611+0000 7f457c07e740 1 --2- 172.21.15.1:0/938138962 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bc88991b0 0x556bc8c69b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.611+0000 7f457c07e740 1 --2- 172.21.15.1:0/938138962 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556bc88c2070 0x556bc8c69650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.611+0000 7f457c07e740 1 -- 172.21.15.1:0/938138962 >> 172.21.15.1:0/938138962 conn(0x556bc88b6460 msgr2=0x556bc8c67540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:30.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.612+0000 7f457c07e740 1 -- 172.21.15.1:0/938138962 shutdown_connections 2024-09-21T01:04:30.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.612+0000 7f457c07e740 1 -- 172.21.15.1:0/938138962 wait complete. 2024-09-21T01:04:30.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.612+0000 7f457c07e740 1 -- start start 2024-09-21T01:04:30.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.612+0000 7f457c07e740 1 Processor -- start 2024-09-21T01:04:30.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.613+0000 7f457c07e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556bc88991b0 0x556bc8c74d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.613+0000 7f457c07e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bc88a1390 0x556bc8c75240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.613+0000 7f457c07e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556bc88c2070 0x556bc8c81140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.613+0000 7f457c07e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556bc8a30700 con 0x556bc88c2070 2024-09-21T01:04:30.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.613+0000 7f457c07e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556bc8b6a110 con 0x556bc88a1390 2024-09-21T01:04:30.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.613+0000 7f457c07e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556bc8c77e20 con 0x556bc88991b0 2024-09-21T01:04:30.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.613+0000 7f457c07e740 10 client.0 _ll_register_callbacks cb 0x556bc8b83990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:30.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.613+0000 7f456f7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556bc88991b0 0x556bc8c74d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.613+0000 7f456ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556bc88c2070 0x556bc8c81140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.613+0000 7f456f7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556bc88991b0 0x556bc8c74d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:54772/0 (socket says 172.21.15.1:54772) 2024-09-21T01:04:30.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.613+0000 7f456f7fe640 1 -- 172.21.15.1:0/813698892 learned_addr learned my addr 172.21.15.1:0/813698892 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:30.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.613+0000 7f456effd640 1 --2- 172.21.15.1:0/813698892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bc88a1390 0x556bc8c75240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.613+0000 7f456f7fe640 1 -- 172.21.15.1:0/813698892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bc88a1390 msgr2=0x556bc8c75240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:30.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.613+0000 7f456f7fe640 1 --2- 172.21.15.1:0/813698892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bc88a1390 0x556bc8c75240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.613+0000 7f456f7fe640 1 -- 172.21.15.1:0/813698892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556bc88c2070 msgr2=0x556bc8c81140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:30.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.613+0000 7f456f7fe640 1 --2- 172.21.15.1:0/813698892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556bc88c2070 0x556bc8c81140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.613+0000 7f456f7fe640 1 -- 172.21.15.1:0/813698892 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bc8b97c40 con 0x556bc88991b0 2024-09-21T01:04:30.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.613+0000 7f456ffff640 1 --2- 172.21.15.1:0/813698892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556bc88c2070 0x556bc8c81140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:30.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.613+0000 7f456effd640 1 --2- 172.21.15.1:0/813698892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bc88a1390 0x556bc8c75240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:30.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.613+0000 7f456f7fe640 1 --2- 172.21.15.1:0/813698892 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556bc88991b0 0x556bc8c74d00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f45600e51d0 tx=0x7f4560009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b96e666d185bd23 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:30.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.613+0000 7f454effd640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T01:04:30.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.614+0000 7f454effd640 1 -- 172.21.15.1:0/813698892 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45600ad630 con 0x556bc88991b0 2024-09-21T01:04:30.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.614+0000 7f457c07e740 1 -- 172.21.15.1:0/813698892 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4564004030 con 0x556bc88991b0 2024-09-21T01:04:30.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.614+0000 7f454effd640 1 -- 172.21.15.1:0/813698892 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f45600e7ba0 con 0x556bc88991b0 2024-09-21T01:04:30.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.614+0000 7f454effd640 1 -- 172.21.15.1:0/813698892 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f4560005180 con 0x556bc88991b0 2024-09-21T01:04:30.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.614+0000 7f457c07e740 10 client.26698 fetch_fsmap learned FSMap version 38 2024-09-21T01:04:30.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.614+0000 7f457c07e740 1 -- 172.21.15.1:0/813698892 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x556bc8c83b50 con 0x556bc88991b0 2024-09-21T01:04:30.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.614+0000 7f454effd640 1 -- 172.21.15.1:0/813698892 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4564004030 con 0x556bc88991b0 2024-09-21T01:04:30.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.614+0000 7f454effd640 1 -- 172.21.15.1:0/813698892 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 38) ==== 8390+0+0 (secure 0 0 0) 0x7f45600eace0 con 0x556bc88991b0 2024-09-21T01:04:30.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.614+0000 7f457c07e740 10 client.26698 fetch_fsmap finished waiting for FSMap version 38 2024-09-21T01:04:30.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.614+0000 7f457c07e740 10 client.26698 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:04:30.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.614+0000 7f457c07e740 20 client.26698 populate_metadata read hostname 'smithi001' 2024-09-21T01:04:30.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.614+0000 7f457c07e740 1 --2- 172.21.15.1:0/813698892 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x556bc88809f0 0x556bc8c870c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.614+0000 7f457c07e740 4 client.26698 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:04:30.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.614+0000 7f457c07e740 1 -- 172.21.15.1:0/813698892 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556bc8be1da0 con 0x556bc88809f0 2024-09-21T01:04:30.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.615+0000 7f456effd640 1 --2- 172.21.15.1:0/813698892 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x556bc88809f0 0x556bc8c870c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.615+0000 7f454effd640 10 client.26698 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:04:30.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.615+0000 7f456effd640 1 --2- 172.21.15.1:0/813698892 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x556bc88809f0 0x556bc8c870c0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e7473f0e501ceb server_cookie=55e96a0d46beef20 in_seq=0 out_seq=0 2024-09-21T01:04:30.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.616+0000 7f454effd640 1 -- 172.21.15.1:0/813698892 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556bc8be1da0 con 0x556bc88809f0 2024-09-21T01:04:30.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.616+0000 7f454effd640 10 client.26698 handle_command_reply: tid=0 2024-09-21T01:04:30.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.616+0000 7f457c07e740 1 client.26698 shutdown 2024-09-21T01:04:30.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.616+0000 7f457c07e740 1 -- 172.21.15.1:0/813698892 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556bc88991b0 msgr2=0x556bc8c74d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:30.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.616+0000 7f457c07e740 1 --2- 172.21.15.1:0/813698892 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556bc88991b0 0x556bc8c74d00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f45600e51d0 tx=0x7f4560009310 comp rx=0 tx=0).stop 2024-09-21T01:04:30.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.616+0000 7f457c07e740 1 -- 172.21.15.1:0/813698892 shutdown_connections 2024-09-21T01:04:30.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.616+0000 7f457c07e740 1 --2- 172.21.15.1:0/813698892 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x556bc88809f0 0x556bc8c870c0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.616+0000 7f457c07e740 1 --2- 172.21.15.1:0/813698892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556bc88c2070 0x556bc8c81140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.617+0000 7f454effd640 0 client.26698 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:04:30.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.617+0000 7f457c07e740 1 --2- 172.21.15.1:0/813698892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bc88a1390 0x556bc8c75240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.617+0000 7f457c07e740 1 --2- 172.21.15.1:0/813698892 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556bc88991b0 0x556bc8c74d00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.617+0000 7f457c07e740 1 -- 172.21.15.1:0/813698892 >> 172.21.15.1:0/813698892 conn(0x556bc88b6460 msgr2=0x556bc8c6a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:30.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.617+0000 7f457c07e740 1 -- 172.21.15.1:0/813698892 shutdown_connections 2024-09-21T01:04:30.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.617+0000 7f457c07e740 1 -- 172.21.15.1:0/813698892 wait complete. 2024-09-21T01:04:30.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.617+0000 7f457c07e740 20 client.26698 trim_cache size 0 max 16384 2024-09-21T01:04:30.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.635+0000 7f457c07e740 1 Processor -- start 2024-09-21T01:04:30.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.635+0000 7f457c07e740 1 -- start start 2024-09-21T01:04:30.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.635+0000 7f457c07e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556bc88991b0 0x556bc8c76be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.636+0000 7f457c07e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556bc88a1390 0x556bc8c81040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.636+0000 7f457c07e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bc88c2070 0x556bc8c6ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.636+0000 7f457c07e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f45701b15a0 con 0x556bc88991b0 2024-09-21T01:04:30.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.636+0000 7f457c07e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f45701b3230 con 0x556bc88c2070 2024-09-21T01:04:30.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.636+0000 7f457c07e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f45701b1ca0 con 0x556bc88a1390 2024-09-21T01:04:30.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.636+0000 7f456ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bc88c2070 0x556bc8c6ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.636+0000 7f456ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bc88c2070 0x556bc8c6ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:50710/0 (socket says 172.21.15.1:50710) 2024-09-21T01:04:30.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.636+0000 7f456ffff640 1 -- 172.21.15.1:0/269126337 learned_addr learned my addr 172.21.15.1:0/269126337 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:30.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.636+0000 7f456effd640 1 --2- 172.21.15.1:0/269126337 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556bc88a1390 0x556bc8c81040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.636+0000 7f456f7fe640 1 --2- 172.21.15.1:0/269126337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556bc88991b0 0x556bc8c76be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.636+0000 7f456ffff640 1 -- 172.21.15.1:0/269126337 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556bc88a1390 msgr2=0x556bc8c81040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:30.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.636+0000 7f456ffff640 1 --2- 172.21.15.1:0/269126337 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556bc88a1390 0x556bc8c81040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.636+0000 7f456ffff640 1 -- 172.21.15.1:0/269126337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556bc88991b0 msgr2=0x556bc8c76be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:30.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.636+0000 7f456ffff640 1 --2- 172.21.15.1:0/269126337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556bc88991b0 0x556bc8c76be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.636+0000 7f456ffff640 1 -- 172.21.15.1:0/269126337 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bc8c77d10 con 0x556bc88c2070 2024-09-21T01:04:30.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.636+0000 7f456f7fe640 1 --2- 172.21.15.1:0/269126337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556bc88991b0 0x556bc8c76be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:04:30.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.637+0000 7f456ffff640 1 --2- 172.21.15.1:0/269126337 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bc88c2070 0x556bc8c6ee70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4568004380 tx=0x7f456801a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec8b27f215ae26b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:30.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.637+0000 7f45557fa640 1 -- 172.21.15.1:0/269126337 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f456802d070 con 0x556bc88c2070 2024-09-21T01:04:30.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.637+0000 7f45557fa640 1 -- 172.21.15.1:0/269126337 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f456801d470 con 0x556bc88c2070 2024-09-21T01:04:30.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.637+0000 7f45557fa640 1 -- 172.21.15.1:0/269126337 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4568028660 con 0x556bc88c2070 2024-09-21T01:04:30.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.638+0000 7f457c07e740 1 -- 172.21.15.1:0/269126337 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bc88c2070 msgr2=0x556bc8c6ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:30.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.638+0000 7f457c07e740 1 --2- 172.21.15.1:0/269126337 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bc88c2070 0x556bc8c6ee70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4568004380 tx=0x7f456801a000 comp rx=0 tx=0).stop 2024-09-21T01:04:30.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.638+0000 7f457c07e740 1 -- 172.21.15.1:0/269126337 shutdown_connections 2024-09-21T01:04:30.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.638+0000 7f457c07e740 1 --2- 172.21.15.1:0/269126337 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bc88c2070 0x556bc8c6ee70 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.638+0000 7f457c07e740 1 --2- 172.21.15.1:0/269126337 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556bc88a1390 0x556bc8c81040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.638+0000 7f457c07e740 1 --2- 172.21.15.1:0/269126337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556bc88991b0 0x556bc8c76be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.638+0000 7f457c07e740 1 -- 172.21.15.1:0/269126337 >> 172.21.15.1:0/269126337 conn(0x556bc88b6460 msgr2=0x556bc8c6e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:30.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.638+0000 7f457c07e740 1 -- 172.21.15.1:0/269126337 shutdown_connections 2024-09-21T01:04:30.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.638+0000 7f457c07e740 1 -- 172.21.15.1:0/269126337 wait complete. 2024-09-21T01:04:30.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.638+0000 7f457c07e740 1 -- start start 2024-09-21T01:04:30.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.638+0000 7f457c07e740 1 Processor -- start 2024-09-21T01:04:30.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.639+0000 7f457c07e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556bc88991b0 0x556bc8c7b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.639+0000 7f457c07e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556bc88a1390 0x556bc8c7b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.639+0000 7f457c07e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bc88c2070 0x556bc8c7bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.639+0000 7f457c07e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f45701b2aa0 con 0x556bc88a1390 2024-09-21T01:04:30.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.639+0000 7f457c07e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f45701b23d0 con 0x556bc88c2070 2024-09-21T01:04:30.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.639+0000 7f457c07e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f45701af580 con 0x556bc88991b0 2024-09-21T01:04:30.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.639+0000 7f457c07e740 10 client.0 _ll_register_callbacks cb 0x7f45600ed240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:30.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.639+0000 7f456effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556bc88a1390 0x556bc8c7b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.639+0000 7f456effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556bc88a1390 0x556bc8c7b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56684/0 (socket says 172.21.15.1:56684) 2024-09-21T01:04:30.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.639+0000 7f456effd640 1 -- 172.21.15.1:0/1646968130 learned_addr learned my addr 172.21.15.1:0/1646968130 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:30.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.639+0000 7f456f7fe640 1 --2- 172.21.15.1:0/1646968130 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556bc88991b0 0x556bc8c7b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.639+0000 7f456ffff640 1 --2- 172.21.15.1:0/1646968130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bc88c2070 0x556bc8c7bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.639+0000 7f456effd640 1 -- 172.21.15.1:0/1646968130 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556bc88991b0 msgr2=0x556bc8c7b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:30.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.639+0000 7f456effd640 1 --2- 172.21.15.1:0/1646968130 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556bc88991b0 0x556bc8c7b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.639+0000 7f456effd640 1 -- 172.21.15.1:0/1646968130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bc88c2070 msgr2=0x556bc8c7bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:30.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.639+0000 7f456effd640 1 --2- 172.21.15.1:0/1646968130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bc88c2070 0x556bc8c7bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.639+0000 7f456effd640 1 -- 172.21.15.1:0/1646968130 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bc8cf0c40 con 0x556bc88a1390 2024-09-21T01:04:30.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.639+0000 7f456f7fe640 1 --2- 172.21.15.1:0/1646968130 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556bc88991b0 0x556bc8c7b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:30.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.639+0000 7f456ffff640 1 --2- 172.21.15.1:0/1646968130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bc88c2070 0x556bc8c7bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:30.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.640+0000 7f456effd640 1 --2- 172.21.15.1:0/1646968130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556bc88a1390 0x556bc8c7b780 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f4564005150 tx=0x7f456402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cd895c12b3eb445 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:30.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.640+0000 7f454effd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:04:30.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.640+0000 7f454effd640 1 -- 172.21.15.1:0/1646968130 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4564040040 con 0x556bc88a1390 2024-09-21T01:04:30.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.640+0000 7f454effd640 1 -- 172.21.15.1:0/1646968130 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f4564004470 con 0x556bc88a1390 2024-09-21T01:04:30.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.640+0000 7f457c07e740 1 -- 172.21.15.1:0/1646968130 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f456801d470 con 0x556bc88a1390 2024-09-21T01:04:30.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.640+0000 7f454effd640 1 -- 172.21.15.1:0/1646968130 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f4564035040 con 0x556bc88a1390 2024-09-21T01:04:30.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.640+0000 7f457c07e740 10 client.17172 fetch_fsmap learned FSMap version 38 2024-09-21T01:04:30.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.640+0000 7f457c07e740 1 -- 172.21.15.1:0/1646968130 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x556bc8cf1f30 con 0x556bc88a1390 2024-09-21T01:04:30.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.640+0000 7f454effd640 1 -- 172.21.15.1:0/1646968130 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f456801d470 con 0x556bc88a1390 2024-09-21T01:04:30.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.641+0000 7f454effd640 1 -- 172.21.15.1:0/1646968130 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 38) ==== 8390+0+0 (secure 0 0 0) 0x7f45640047c0 con 0x556bc88a1390 2024-09-21T01:04:30.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.641+0000 7f457c07e740 10 client.17172 fetch_fsmap finished waiting for FSMap version 38 2024-09-21T01:04:30.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.641+0000 7f457c07e740 10 client.17172 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:04:30.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.641+0000 7f457c07e740 20 client.17172 populate_metadata read hostname 'smithi001' 2024-09-21T01:04:30.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.641+0000 7f457c07e740 1 --2- 172.21.15.1:0/1646968130 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x556bc8855da0 0x556bc8cf4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.641+0000 7f457c07e740 4 client.17172 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:04:30.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.641+0000 7f457c07e740 1 -- 172.21.15.1:0/1646968130 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556bc8bdd850 con 0x556bc8855da0 2024-09-21T01:04:30.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.641+0000 7f456f7fe640 1 --2- 172.21.15.1:0/1646968130 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x556bc8855da0 0x556bc8cf4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.641+0000 7f456f7fe640 1 --2- 172.21.15.1:0/1646968130 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x556bc8855da0 0x556bc8cf4420 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0107bd01422a009 server_cookie=c81c286240d13014 in_seq=0 out_seq=0 2024-09-21T01:04:30.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.641+0000 7f454effd640 10 client.17172 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:04:30.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.642+0000 7f454effd640 1 -- 172.21.15.1:0/1646968130 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2646 (crc 0 0 0) 0x556bc8bdd850 con 0x556bc8855da0 2024-09-21T01:04:30.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.642+0000 7f454effd640 10 client.17172 handle_command_reply: tid=0 2024-09-21T01:04:30.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.642+0000 7f457c07e740 1 client.17172 shutdown 2024-09-21T01:04:30.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.642+0000 7f457c07e740 1 -- 172.21.15.1:0/1646968130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556bc88a1390 msgr2=0x556bc8c7b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:30.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.642+0000 7f457c07e740 1 --2- 172.21.15.1:0/1646968130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556bc88a1390 0x556bc8c7b780 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f4564005150 tx=0x7f456402a410 comp rx=0 tx=0).stop 2024-09-21T01:04:30.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.642+0000 7f457c07e740 1 -- 172.21.15.1:0/1646968130 shutdown_connections 2024-09-21T01:04:30.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.642+0000 7f457c07e740 1 --2- 172.21.15.1:0/1646968130 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x556bc8855da0 0x556bc8cf4420 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.642+0000 7f457c07e740 1 --2- 172.21.15.1:0/1646968130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bc88c2070 0x556bc8c7bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.642+0000 7f454effd640 0 client.17172 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:04:30.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.642+0000 7f457c07e740 1 --2- 172.21.15.1:0/1646968130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556bc88a1390 0x556bc8c7b780 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.642+0000 7f457c07e740 1 --2- 172.21.15.1:0/1646968130 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556bc88991b0 0x556bc8c7b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.642+0000 7f457c07e740 1 -- 172.21.15.1:0/1646968130 >> 172.21.15.1:0/1646968130 conn(0x556bc88b6460 msgr2=0x556bc8c6e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:30.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.642+0000 7f457c07e740 1 -- 172.21.15.1:0/1646968130 shutdown_connections 2024-09-21T01:04:30.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.642+0000 7f457c07e740 1 -- 172.21.15.1:0/1646968130 wait complete. 2024-09-21T01:04:30.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.642+0000 7f457c07e740 20 client.17172 trim_cache size 0 max 16384 2024-09-21T01:04:30.647 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T01:04:30.648 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "no active scrubs running", 2024-09-21T01:04:30.648 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": {}, 2024-09-21T01:04:30.648 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_stats": { 2024-09-21T01:04:30.648 INFO:teuthology.orchestra.run.smithi001.stdout: "c2addc95-c922-4a70-b746-0b5fd2af59bf": { 2024-09-21T01:04:30.648 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:00:52.374848+0000", 2024-09-21T01:04:30.648 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:04:30.648 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:04:30.648 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:04:30.648 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:04:30.648 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:04:30.648 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:04:30.648 INFO:teuthology.orchestra.run.smithi001.stdout: "d9a37a97-ce14-4763-8c19-9bd32df63cf3": { 2024-09-21T01:04:30.648 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:01:45.914443+0000", 2024-09-21T01:04:30.648 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:04:30.649 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:04:30.649 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:04:30.649 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:04:30.649 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:04:30.649 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:04:30.649 INFO:teuthology.orchestra.run.smithi001.stdout: "f826f2c1-768a-47bb-b868-785b351ac6b4": { 2024-09-21T01:04:30.649 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:59:06.554657+0000", 2024-09-21T01:04:30.649 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:04:30.649 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:04:30.649 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:04:30.649 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:04:30.649 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:04:30.649 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:04:30.649 INFO:teuthology.orchestra.run.smithi001.stdout: "1bffed0d-34b1-4e8b-9cab-7501131ef79d": { 2024-09-21T01:04:30.650 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:00:02.564228+0000", 2024-09-21T01:04:30.650 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:04:30.650 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:04:30.650 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:04:30.650 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:04:30.650 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:04:30.650 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:04:30.650 INFO:teuthology.orchestra.run.smithi001.stdout: "bee49cce-b407-4617-a959-331ffd8dc5b0": { 2024-09-21T01:04:30.650 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:58:17.883027+0000", 2024-09-21T01:04:30.650 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:04:30.650 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:04:30.650 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:04:30.650 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:04:30.650 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:04:30.651 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:04:30.651 INFO:teuthology.orchestra.run.smithi001.stdout: "3d019354-f00e-4e9b-b42c-f519d1f68cd2": { 2024-09-21T01:04:30.651 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:03:25.601697+0000", 2024-09-21T01:04:30.651 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:04:30.651 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:04:30.651 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:04:30.651 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:04:30.651 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:04:30.651 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:04:30.651 INFO:teuthology.orchestra.run.smithi001.stdout: "7cb1bc3f-e2d2-4bf7-b13e-8f3371d7aac1": { 2024-09-21T01:04:30.651 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:58:02.751142+0000", 2024-09-21T01:04:30.651 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:04:30.651 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:04:30.651 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:04:30.651 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:04:30.652 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:04:30.652 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:04:30.652 INFO:teuthology.orchestra.run.smithi001.stdout: "2383a19c-993d-4440-99f7-93b43dcf33b4": { 2024-09-21T01:04:30.652 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:47.609257+0000", 2024-09-21T01:04:30.652 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:04:30.652 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:04:30.652 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:04:30.652 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:04:30.652 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:04:30.652 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:04:30.652 INFO:teuthology.orchestra.run.smithi001.stdout: "53fa74e4-5aa8-408b-9724-7c93618f7636": { 2024-09-21T01:04:30.652 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:01.730608+0000", 2024-09-21T01:04:30.652 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:04:30.652 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:04:30.653 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:04:30.653 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:04:30.653 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:04:30.653 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:04:30.653 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:04:30.653 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T01:04:30.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.643+0000 7f4575b0a640 1 -- 172.21.15.1:0/3215033156 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f45580b6510 msgr2=0x7f45580b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:30.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.643+0000 7f4575b0a640 1 --2- 172.21.15.1:0/3215033156 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f45580b6510 0x7f45580b8a20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4568005fd0 tx=0x7f4568009500 comp rx=0 tx=0).stop 2024-09-21T01:04:30.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.643+0000 7f4575b0a640 1 -- 172.21.15.1:0/3215033156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4570102ae0 msgr2=0x7f45700ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:30.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.643+0000 7f4575b0a640 1 --2- 172.21.15.1:0/3215033156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4570102ae0 0x7f45700ff670 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f456000e9f0 tx=0x7f456000edf0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.643+0000 7f4575b0a640 1 -- 172.21.15.1:0/3215033156 shutdown_connections 2024-09-21T01:04:30.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.643+0000 7f4575b0a640 1 --2- 172.21.15.1:0/3215033156 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f45580b6510 0x7f45580b8a20 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.643+0000 7f4575b0a640 1 --2- 172.21.15.1:0/3215033156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4570108d20 0x7f45701000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.643+0000 7f4575b0a640 1 --2- 172.21.15.1:0/3215033156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f45701083d0 0x7f45700ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.643+0000 7f4575b0a640 1 --2- 172.21.15.1:0/3215033156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4570102ae0 0x7f45700ff670 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.643+0000 7f4575b0a640 1 -- 172.21.15.1:0/3215033156 >> 172.21.15.1:0/3215033156 conn(0x7f4570079760 msgr2=0x7f45701019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:30.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.643+0000 7f4575b0a640 1 -- 172.21.15.1:0/3215033156 shutdown_connections 2024-09-21T01:04:30.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:30.643+0000 7f4575b0a640 1 -- 172.21.15.1:0/3215033156 wait complete. 2024-09-21T01:04:31.533 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T01:04:31.533 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:04:31.792 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:04:31.914 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:31 smithi001 ceph-mon[31211]: pgmap v577: 97 pgs: 97 active+clean; 560 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 588 op/s 2024-09-21T01:04:31.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:31 smithi193 ceph-mon[34660]: pgmap v577: 97 pgs: 97 active+clean; 560 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 588 op/s 2024-09-21T01:04:31.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:31 smithi042 ceph-mon[34481]: pgmap v577: 97 pgs: 97 active+clean; 560 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 588 op/s 2024-09-21T01:04:32.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.304+0000 7fcfc3d89640 1 -- 172.21.15.1:0/3058038122 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfbc108cf0 msgr2=0x7fcfbc10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:32.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.304+0000 7fcfc3d89640 1 --2- 172.21.15.1:0/3058038122 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfbc108cf0 0x7fcfbc10f520 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fcfac009ca0 tx=0x7fcfac02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:04:32.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.304+0000 7fcfc3d89640 1 -- 172.21.15.1:0/3058038122 shutdown_connections 2024-09-21T01:04:32.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.304+0000 7fcfc3d89640 1 --2- 172.21.15.1:0/3058038122 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfbc108cf0 0x7fcfbc10f520 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:32.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.304+0000 7fcfc3d89640 1 --2- 172.21.15.1:0/3058038122 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcfbc1083a0 0x7fcfbc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:32.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.304+0000 7fcfc3d89640 1 --2- 172.21.15.1:0/3058038122 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfbc102a60 0x7fcfbc102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:32.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.304+0000 7fcfc3d89640 1 -- 172.21.15.1:0/3058038122 >> 172.21.15.1:0/3058038122 conn(0x7fcfbc079730 msgr2=0x7fcfbc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:32.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.304+0000 7fcfc3d89640 1 -- 172.21.15.1:0/3058038122 shutdown_connections 2024-09-21T01:04:32.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.304+0000 7fcfc3d89640 1 -- 172.21.15.1:0/3058038122 wait complete. 2024-09-21T01:04:32.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.305+0000 7fcfc3d89640 1 Processor -- start 2024-09-21T01:04:32.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.305+0000 7fcfc3d89640 1 -- start start 2024-09-21T01:04:32.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.306+0000 7fcfc3d89640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfbc102a60 0x7fcfbc19b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:32.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.306+0000 7fcfc3d89640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcfbc1083a0 0x7fcfbc19b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:32.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.306+0000 7fcfc3d89640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfbc108cf0 0x7fcfbc19bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:32.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.306+0000 7fcfc3d89640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcfbc112960 con 0x7fcfbc102a60 2024-09-21T01:04:32.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.306+0000 7fcfc3d89640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcfbc1127e0 con 0x7fcfbc108cf0 2024-09-21T01:04:32.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.306+0000 7fcfc3d89640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcfbc112ae0 con 0x7fcfbc1083a0 2024-09-21T01:04:32.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.306+0000 7fcfc1b25640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfbc102a60 0x7fcfbc19b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:32.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.306+0000 7fcfc1b25640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfbc102a60 0x7fcfbc19b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56714/0 (socket says 172.21.15.1:56714) 2024-09-21T01:04:32.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.306+0000 7fcfc1b25640 1 -- 172.21.15.1:0/2559131271 learned_addr learned my addr 172.21.15.1:0/2559131271 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:32.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.306+0000 7fcfc2326640 1 --2- 172.21.15.1:0/2559131271 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfbc108cf0 0x7fcfbc19bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:32.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.306+0000 7fcfc1324640 1 --2- 172.21.15.1:0/2559131271 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcfbc1083a0 0x7fcfbc19b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:32.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.306+0000 7fcfc1b25640 1 -- 172.21.15.1:0/2559131271 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcfbc1083a0 msgr2=0x7fcfbc19b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:32.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.306+0000 7fcfc1b25640 1 --2- 172.21.15.1:0/2559131271 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcfbc1083a0 0x7fcfbc19b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:32.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.306+0000 7fcfc1b25640 1 -- 172.21.15.1:0/2559131271 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfbc108cf0 msgr2=0x7fcfbc19bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:32.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.306+0000 7fcfc1b25640 1 --2- 172.21.15.1:0/2559131271 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfbc108cf0 0x7fcfbc19bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:32.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.306+0000 7fcfc1b25640 1 -- 172.21.15.1:0/2559131271 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfbc1a6570 con 0x7fcfbc102a60 2024-09-21T01:04:32.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.306+0000 7fcfc1b25640 1 --2- 172.21.15.1:0/2559131271 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfbc102a60 0x7fcfbc19b2b0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fcfb400e9f0 tx=0x7fcfb400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:32.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.307+0000 7fcfbaffd640 1 -- 172.21.15.1:0/2559131271 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb400cd80 con 0x7fcfbc102a60 2024-09-21T01:04:32.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.307+0000 7fcfbaffd640 1 -- 172.21.15.1:0/2559131271 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfb40108e0 con 0x7fcfbc102a60 2024-09-21T01:04:32.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.307+0000 7fcfc3d89640 1 -- 172.21.15.1:0/2559131271 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfbc1a6860 con 0x7fcfbc102a60 2024-09-21T01:04:32.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.307+0000 7fcfbaffd640 1 -- 172.21.15.1:0/2559131271 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4018980 con 0x7fcfbc102a60 2024-09-21T01:04:32.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.307+0000 7fcfc3d89640 1 -- 172.21.15.1:0/2559131271 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfbc1a6df0 con 0x7fcfbc102a60 2024-09-21T01:04:32.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.308+0000 7fcfc3d89640 1 -- 172.21.15.1:0/2559131271 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfbc102e70 con 0x7fcfbc102a60 2024-09-21T01:04:32.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.309+0000 7fcfbaffd640 1 -- 172.21.15.1:0/2559131271 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7fcfb4010430 con 0x7fcfbc102a60 2024-09-21T01:04:32.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.310+0000 7fcfbaffd640 1 --2- 172.21.15.1:0/2559131271 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fcfa40b6590 0x7fcfa40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:32.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.310+0000 7fcfc1324640 1 --2- 172.21.15.1:0/2559131271 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fcfa40b6590 0x7fcfa40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:32.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.310+0000 7fcfbaffd640 1 -- 172.21.15.1:0/2559131271 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fcfb40e7a70 con 0x7fcfbc102a60 2024-09-21T01:04:32.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.311+0000 7fcfc1324640 1 --2- 172.21.15.1:0/2559131271 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fcfa40b6590 0x7fcfa40b8aa0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc06a3f0 tx=0x7fcfb000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:32.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.313+0000 7fcfbaffd640 1 -- 172.21.15.1:0/2559131271 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcfb40b26c0 con 0x7fcfbc102a60 2024-09-21T01:04:32.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.575+0000 7fcfc3d89640 1 -- 172.21.15.1:0/2559131271 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcfbc06b290 con 0x7fcfbc102a60 2024-09-21T01:04:32.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.576+0000 7fcfbaffd640 1 -- 172.21.15.1:0/2559131271 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+11966 (secure 0 0 0) 0x7fcfb40b7600 con 0x7fcfbc102a60 2024-09-21T01:04:32.577 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T01:04:32.577 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":38,"btime":"2024-09-21T01:04:27:524696+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2810186677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2810186677},{"type":"v1","addr":"172.21.15.1:6835","nonce":2810186677}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14736,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3935320478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3935320478},{"type":"v1","addr":"172.21.15.1:6837","nonce":3935320478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:54:58.592853+0000","modified":"2024-09-21T01:04:26.917997+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24653,"mds_1":24637,"mds_2":24626,"mds_3":24622,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/2125703572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2125703572},{"type":"v1","addr":"172.21.15.1:6839","nonce":2125703572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/3860445313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860445313},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860445313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6833/712170939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":712170939},{"type":"v1","addr":"172.21.15.193:6833","nonce":712170939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6833/1653911656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1653911656},{"type":"v1","addr":"172.21.15.42:6833","nonce":1653911656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6835/793085918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":793085918},{"type":"v1","addr":"172.21.15.42:6835","nonce":793085918}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6835/3631682268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":3631682268},{"type":"v1","addr":"172.21.15.193:6835","nonce":3631682268}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.193:6837/909252228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":909252228},{"type":"v1","addr":"172.21.15.193:6837","nonce":909252228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.42:6837/2395608508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2395608508},{"type":"v1","addr":"172.21.15.42:6837","nonce":2395608508}]},"join_fscid":-1,"export_targets":[0,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.193:6839/1365361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1365361177},{"type":"v1","addr":"172.21.15.193:6839","nonce":1365361177}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6839/2526476666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2526476666},{"type":"v1","addr":"172.21.15.42:6839","nonce":2526476666}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653,24637,24626,24622,24610]},"id":1}]} 2024-09-21T01:04:32.577 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 38 2024-09-21T01:04:32.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.578+0000 7fcfc3d89640 1 -- 172.21.15.1:0/2559131271 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fcfa40b6590 msgr2=0x7fcfa40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:32.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.578+0000 7fcfc3d89640 1 --2- 172.21.15.1:0/2559131271 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fcfa40b6590 0x7fcfa40b8aa0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc06a3f0 tx=0x7fcfb000b390 comp rx=0 tx=0).stop 2024-09-21T01:04:32.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.578+0000 7fcfc3d89640 1 -- 172.21.15.1:0/2559131271 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfbc102a60 msgr2=0x7fcfbc19b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:32.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.578+0000 7fcfc3d89640 1 --2- 172.21.15.1:0/2559131271 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfbc102a60 0x7fcfbc19b2b0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fcfb400e9f0 tx=0x7fcfb400eeb0 comp rx=0 tx=0).stop 2024-09-21T01:04:32.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.578+0000 7fcfc3d89640 1 -- 172.21.15.1:0/2559131271 shutdown_connections 2024-09-21T01:04:32.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.578+0000 7fcfc3d89640 1 --2- 172.21.15.1:0/2559131271 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfbc108cf0 0x7fcfbc19bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:32.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.578+0000 7fcfc3d89640 1 --2- 172.21.15.1:0/2559131271 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcfbc1083a0 0x7fcfbc19b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:32.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.578+0000 7fcfc3d89640 1 --2- 172.21.15.1:0/2559131271 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fcfa40b6590 0x7fcfa40b8aa0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:32.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.578+0000 7fcfc3d89640 1 --2- 172.21.15.1:0/2559131271 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfbc102a60 0x7fcfbc19b2b0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:32.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.578+0000 7fcfc3d89640 1 -- 172.21.15.1:0/2559131271 >> 172.21.15.1:0/2559131271 conn(0x7fcfbc079730 msgr2=0x7fcfbc104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:32.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.578+0000 7fcfc3d89640 1 -- 172.21.15.1:0/2559131271 shutdown_connections 2024-09-21T01:04:32.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:32.578+0000 7fcfc3d89640 1 -- 172.21.15.1:0/2559131271 wait complete. 2024-09-21T01:04:33.352 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T01:04:33.612 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:04:33.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:33 smithi001 ceph-mon[31211]: pgmap v578: 97 pgs: 97 active+clean; 553 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 613 op/s 2024-09-21T01:04:33.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:33 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/2559131271' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:04:33.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:33 smithi193 ceph-mon[34660]: pgmap v578: 97 pgs: 97 active+clean; 553 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 613 op/s 2024-09-21T01:04:33.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:33 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/2559131271' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:04:33.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:33 smithi042 ceph-mon[34481]: pgmap v578: 97 pgs: 97 active+clean; 553 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 613 op/s 2024-09-21T01:04:33.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:33 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/2559131271' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:04:34.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.136+0000 7f560198d640 1 -- 172.21.15.1:0/4163101366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55fc103b70 msgr2=0x7f55fc103f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:34.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.136+0000 7f560198d640 1 --2- 172.21.15.1:0/4163101366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55fc103b70 0x7f55fc103f80 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f55ec009ca0 tx=0x7f55ec02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:04:34.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.136+0000 7f560198d640 1 -- 172.21.15.1:0/4163101366 shutdown_connections 2024-09-21T01:04:34.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.136+0000 7f560198d640 1 --2- 172.21.15.1:0/4163101366 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55fc109e00 0x7f55fc110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:34.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.136+0000 7f560198d640 1 --2- 172.21.15.1:0/4163101366 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f55fc1094b0 0x7f55fc1098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:34.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.136+0000 7f560198d640 1 --2- 172.21.15.1:0/4163101366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55fc103b70 0x7f55fc103f80 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:34.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.136+0000 7f560198d640 1 -- 172.21.15.1:0/4163101366 >> 172.21.15.1:0/4163101366 conn(0x7f55fc0ff5e0 msgr2=0x7f55fc101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:34.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.136+0000 7f560198d640 1 -- 172.21.15.1:0/4163101366 shutdown_connections 2024-09-21T01:04:34.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.136+0000 7f560198d640 1 -- 172.21.15.1:0/4163101366 wait complete. 2024-09-21T01:04:34.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.136+0000 7f560198d640 1 Processor -- start 2024-09-21T01:04:34.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.137+0000 7f560198d640 1 -- start start 2024-09-21T01:04:34.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.137+0000 7f560198d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f55fc103b70 0x7f55fc19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:34.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.137+0000 7f560198d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55fc1094b0 0x7f55fc19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:34.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.137+0000 7f560198d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55fc109e00 0x7f55fc19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:34.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.137+0000 7f560198d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f55fc113b10 con 0x7f55fc1094b0 2024-09-21T01:04:34.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.137+0000 7f560198d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f55fc113990 con 0x7f55fc109e00 2024-09-21T01:04:34.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.137+0000 7f560198d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f55fc113c90 con 0x7f55fc103b70 2024-09-21T01:04:34.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.137+0000 7f55fa7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55fc1094b0 0x7f55fc19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:34.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.137+0000 7f55fb7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55fc109e00 0x7f55fc19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:34.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.137+0000 7f55fb7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55fc109e00 0x7f55fc19fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:50742/0 (socket says 172.21.15.1:50742) 2024-09-21T01:04:34.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.137+0000 7f55fa7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55fc1094b0 0x7f55fc19aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56728/0 (socket says 172.21.15.1:56728) 2024-09-21T01:04:34.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.137+0000 7f55fb7fe640 1 -- 172.21.15.1:0/2805412915 learned_addr learned my addr 172.21.15.1:0/2805412915 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:34.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.137+0000 7f55faffd640 1 --2- 172.21.15.1:0/2805412915 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f55fc103b70 0x7f55fc19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:34.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.138+0000 7f55fa7fc640 1 -- 172.21.15.1:0/2805412915 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f55fc103b70 msgr2=0x7f55fc19a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:34.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.138+0000 7f55fa7fc640 1 --2- 172.21.15.1:0/2805412915 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f55fc103b70 0x7f55fc19a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:34.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.138+0000 7f55fa7fc640 1 -- 172.21.15.1:0/2805412915 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55fc109e00 msgr2=0x7f55fc19fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:34.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.138+0000 7f55fa7fc640 1 --2- 172.21.15.1:0/2805412915 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55fc109e00 0x7f55fc19fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:34.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.138+0000 7f55fa7fc640 1 -- 172.21.15.1:0/2805412915 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55fc1a03f0 con 0x7f55fc1094b0 2024-09-21T01:04:34.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.138+0000 7f55fb7fe640 1 --2- 172.21.15.1:0/2805412915 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55fc109e00 0x7f55fc19fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:34.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.138+0000 7f55fa7fc640 1 --2- 172.21.15.1:0/2805412915 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55fc1094b0 0x7f55fc19aa20 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f55fc06bd40 tx=0x7f55e400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:34.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.138+0000 7f560098b640 1 -- 172.21.15.1:0/2805412915 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e400cc40 con 0x7f55fc1094b0 2024-09-21T01:04:34.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.138+0000 7f560098b640 1 -- 172.21.15.1:0/2805412915 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55e400cde0 con 0x7f55fc1094b0 2024-09-21T01:04:34.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.138+0000 7f560098b640 1 -- 172.21.15.1:0/2805412915 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e4018780 con 0x7f55fc1094b0 2024-09-21T01:04:34.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.138+0000 7f560198d640 1 -- 172.21.15.1:0/2805412915 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55fc1a06e0 con 0x7f55fc1094b0 2024-09-21T01:04:34.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.138+0000 7f560198d640 1 -- 172.21.15.1:0/2805412915 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55fc0755f0 con 0x7f55fc1094b0 2024-09-21T01:04:34.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.141+0000 7f5607f01740 1 Processor -- start 2024-09-21T01:04:34.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.141+0000 7f5607f01740 1 -- start start 2024-09-21T01:04:34.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.141+0000 7f560098b640 1 -- 172.21.15.1:0/2805412915 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f55e4010a90 con 0x7f55fc1094b0 2024-09-21T01:04:34.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.141+0000 7f5607f01740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5556ba426070 0x5556ba7cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:34.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.141+0000 7f5607f01740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556ba3fd1b0 0x5556ba7cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:34.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.141+0000 7f5607f01740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556ba405390 0x5556ba7cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:34.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.141+0000 7f5607f01740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5556ba743ea0 con 0x5556ba426070 2024-09-21T01:04:34.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.141+0000 7f5607f01740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5556ba7332d0 con 0x5556ba405390 2024-09-21T01:04:34.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.141+0000 7f5607f01740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5556ba7370e0 con 0x5556ba3fd1b0 2024-09-21T01:04:34.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.141+0000 7f55fb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5556ba426070 0x5556ba7cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:34.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.141+0000 7f55fb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5556ba426070 0x5556ba7cd2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56730/0 (socket says 172.21.15.1:56730) 2024-09-21T01:04:34.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.141+0000 7f55fb7fe640 1 -- 172.21.15.1:0/4018148092 learned_addr learned my addr 172.21.15.1:0/4018148092 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:34.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.141+0000 7f55faffd640 1 --2- 172.21.15.1:0/4018148092 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556ba3fd1b0 0x5556ba7cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:34.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.142+0000 7f55fa7fc640 1 --2- 172.21.15.1:0/4018148092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556ba405390 0x5556ba7cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:34.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.142+0000 7f55faffd640 1 -- 172.21.15.1:0/4018148092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556ba405390 msgr2=0x5556ba7cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:34.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.142+0000 7f55faffd640 1 --2- 172.21.15.1:0/4018148092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556ba405390 0x5556ba7cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:34.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.142+0000 7f55faffd640 1 -- 172.21.15.1:0/4018148092 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5556ba426070 msgr2=0x5556ba7cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:34.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.142+0000 7f55faffd640 1 --2- 172.21.15.1:0/4018148092 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5556ba426070 0x5556ba7cd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:34.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.142+0000 7f55faffd640 1 -- 172.21.15.1:0/4018148092 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556ba491650 con 0x5556ba3fd1b0 2024-09-21T01:04:34.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.142+0000 7f560098b640 1 --2- 172.21.15.1:0/2805412915 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f55e80b6590 0x7f55e80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:34.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.142+0000 7f55faffd640 1 --2- 172.21.15.1:0/4018148092 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556ba3fd1b0 0x5556ba7cd800 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f55ec000f80 tx=0x7f55ec02f310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc07c4c4f3f311b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:34.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.142+0000 7f560098b640 1 -- 172.21.15.1:0/2805412915 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f55e40e7550 con 0x7f55fc1094b0 2024-09-21T01:04:34.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.142+0000 7f55fb7fe640 1 --2- 172.21.15.1:0/2805412915 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f55e80b6590 0x7f55e80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:34.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.142+0000 7f55f1ffb640 1 -- 172.21.15.1:0/4018148092 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ec031cf0 con 0x5556ba3fd1b0 2024-09-21T01:04:34.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.142+0000 7f55f1ffb640 1 -- 172.21.15.1:0/4018148092 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55ec036030 con 0x5556ba3fd1b0 2024-09-21T01:04:34.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.142+0000 7f55f1ffb640 1 -- 172.21.15.1:0/4018148092 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ec0042a0 con 0x5556ba3fd1b0 2024-09-21T01:04:34.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.143+0000 7f5607f01740 1 -- 172.21.15.1:0/4018148092 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556ba3fd1b0 msgr2=0x5556ba7cd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:34.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.143+0000 7f5607f01740 1 --2- 172.21.15.1:0/4018148092 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556ba3fd1b0 0x5556ba7cd800 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f55ec000f80 tx=0x7f55ec02f310 comp rx=0 tx=0).stop 2024-09-21T01:04:34.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.143+0000 7f55fb7fe640 1 --2- 172.21.15.1:0/2805412915 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f55e80b6590 0x7f55e80b8aa0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f55f4012800 tx=0x7f55f4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:34.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.144+0000 7f5607f01740 1 -- 172.21.15.1:0/4018148092 shutdown_connections 2024-09-21T01:04:34.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.144+0000 7f5607f01740 1 --2- 172.21.15.1:0/4018148092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556ba405390 0x5556ba7cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:34.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.144+0000 7f5607f01740 1 --2- 172.21.15.1:0/4018148092 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556ba3fd1b0 0x5556ba7cd800 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:34.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.144+0000 7f5607f01740 1 --2- 172.21.15.1:0/4018148092 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5556ba426070 0x5556ba7cd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:34.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.144+0000 7f5607f01740 1 -- 172.21.15.1:0/4018148092 >> 172.21.15.1:0/4018148092 conn(0x5556ba41a460 msgr2=0x5556ba7cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:34.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.144+0000 7f5607f01740 1 -- 172.21.15.1:0/4018148092 shutdown_connections 2024-09-21T01:04:34.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.144+0000 7f5607f01740 1 -- 172.21.15.1:0/4018148092 wait complete. 2024-09-21T01:04:34.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.144+0000 7f5607f01740 1 -- start start 2024-09-21T01:04:34.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.144+0000 7f5607f01740 1 Processor -- start 2024-09-21T01:04:34.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.145+0000 7f5607f01740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556ba3fd1b0 0x5556ba7e1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:34.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.145+0000 7f5607f01740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5556ba405390 0x5556ba7e1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:34.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.145+0000 7f5607f01740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556ba426070 0x5556ba7e6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:34.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.145+0000 7f5607f01740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5556ba594700 con 0x5556ba405390 2024-09-21T01:04:34.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.145+0000 7f5607f01740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5556ba6ce160 con 0x5556ba426070 2024-09-21T01:04:34.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.145+0000 7f5607f01740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5556ba7db8c0 con 0x5556ba3fd1b0 2024-09-21T01:04:34.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.145+0000 7f5607f01740 10 client.0 _ll_register_callbacks cb 0x5556ba6e79e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:34.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.145+0000 7f55fb7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556ba426070 0x5556ba7e6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:34.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.145+0000 7f55fa7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5556ba405390 0x5556ba7e1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:34.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.145+0000 7f55fb7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556ba426070 0x5556ba7e6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:50762/0 (socket says 172.21.15.1:50762) 2024-09-21T01:04:34.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.145+0000 7f55fb7fe640 1 -- 172.21.15.1:0/749339047 learned_addr learned my addr 172.21.15.1:0/749339047 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:34.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.145+0000 7f55faffd640 1 --2- 172.21.15.1:0/749339047 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556ba3fd1b0 0x5556ba7e1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:34.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.145+0000 7f55fb7fe640 1 -- 172.21.15.1:0/749339047 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556ba3fd1b0 msgr2=0x5556ba7e1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:34.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.145+0000 7f55fb7fe640 1 --2- 172.21.15.1:0/749339047 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556ba3fd1b0 0x5556ba7e1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:34.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.145+0000 7f55fb7fe640 1 -- 172.21.15.1:0/749339047 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5556ba405390 msgr2=0x5556ba7e1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:34.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.145+0000 7f55fb7fe640 1 --2- 172.21.15.1:0/749339047 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5556ba405390 0x5556ba7e1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:34.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.145+0000 7f55fb7fe640 1 -- 172.21.15.1:0/749339047 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556ba6fbc90 con 0x5556ba426070 2024-09-21T01:04:34.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.145+0000 7f55fa7fc640 1 --2- 172.21.15.1:0/749339047 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5556ba405390 0x5556ba7e1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:34.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.146+0000 7f55fb7fe640 1 --2- 172.21.15.1:0/749339047 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556ba426070 0x5556ba7e6f00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f55f4009810 tx=0x7f55f4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ca394c03c6842a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:34.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.146+0000 7f55daffd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:04:34.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.146+0000 7f55daffd640 1 -- 172.21.15.1:0/749339047 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f402e060 con 0x5556ba426070 2024-09-21T01:04:34.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.146+0000 7f55daffd640 1 -- 172.21.15.1:0/749339047 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f55f4018030 con 0x5556ba426070 2024-09-21T01:04:34.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.146+0000 7f5607f01740 1 -- 172.21.15.1:0/749339047 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55ec036030 con 0x5556ba426070 2024-09-21T01:04:34.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.146+0000 7f55daffd640 1 -- 172.21.15.1:0/749339047 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f55f4012e40 con 0x5556ba426070 2024-09-21T01:04:34.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.146+0000 7f5607f01740 10 client.26846 fetch_fsmap learned FSMap version 38 2024-09-21T01:04:34.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.146+0000 7f5607f01740 1 -- 172.21.15.1:0/749339047 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5556ba7efeb0 con 0x5556ba426070 2024-09-21T01:04:34.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.146+0000 7f55daffd640 1 -- 172.21.15.1:0/749339047 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55ec036030 con 0x5556ba426070 2024-09-21T01:04:34.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.146+0000 7f55daffd640 1 -- 172.21.15.1:0/749339047 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 38) ==== 8390+0+0 (secure 0 0 0) 0x7f55f4029ae0 con 0x5556ba426070 2024-09-21T01:04:34.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.146+0000 7f5607f01740 10 client.26846 fetch_fsmap finished waiting for FSMap version 38 2024-09-21T01:04:34.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.146+0000 7f5607f01740 10 client.26846 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T01:04:34.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.146+0000 7f5607f01740 20 client.26846 populate_metadata read hostname 'smithi001' 2024-09-21T01:04:34.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.146+0000 7f5607f01740 1 --2- 172.21.15.1:0/749339047 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x5556ba3e49f0 0x5556ba7f3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:34.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.146+0000 7f5607f01740 4 client.26846 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:04:34.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.146+0000 7f5607f01740 1 -- 172.21.15.1:0/749339047 --> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556ba745df0 con 0x5556ba3e49f0 2024-09-21T01:04:34.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.147+0000 7f55faffd640 1 --2- 172.21.15.1:0/749339047 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x5556ba3e49f0 0x5556ba7f3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:34.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.147+0000 7f55daffd640 10 client.26846 ms_handle_connect on v2:172.21.15.193:6834/3631682268 2024-09-21T01:04:34.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.147+0000 7f55faffd640 1 --2- 172.21.15.1:0/749339047 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x5556ba3e49f0 0x5556ba7f3470 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e50e61ee92491788 server_cookie=6b6ab0a1a53b699c in_seq=0 out_seq=0 2024-09-21T01:04:34.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.148+0000 7f55daffd640 1 -- 172.21.15.1:0/749339047 <== mds.4 v2:172.21.15.193:6834/3631682268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5556ba745df0 con 0x5556ba3e49f0 2024-09-21T01:04:34.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.148+0000 7f55daffd640 10 client.26846 handle_command_reply: tid=0 2024-09-21T01:04:34.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.148+0000 7f5607f01740 1 client.26846 shutdown 2024-09-21T01:04:34.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.148+0000 7f5607f01740 1 -- 172.21.15.1:0/749339047 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556ba426070 msgr2=0x5556ba7e6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:34.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.148+0000 7f5607f01740 1 --2- 172.21.15.1:0/749339047 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556ba426070 0x5556ba7e6f00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f55f4009810 tx=0x7f55f4004730 comp rx=0 tx=0).stop 2024-09-21T01:04:34.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.148+0000 7f5607f01740 1 -- 172.21.15.1:0/749339047 shutdown_connections 2024-09-21T01:04:34.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.148+0000 7f5607f01740 1 --2- 172.21.15.1:0/749339047 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x5556ba3e49f0 0x5556ba7f3470 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:34.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.148+0000 7f55daffd640 0 client.26846 ms_handle_reset on v2:172.21.15.193:6834/3631682268 2024-09-21T01:04:34.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.148+0000 7f5607f01740 1 --2- 172.21.15.1:0/749339047 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556ba426070 0x5556ba7e6f00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:34.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.148+0000 7f5607f01740 1 --2- 172.21.15.1:0/749339047 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5556ba405390 0x5556ba7e1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:34.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.148+0000 7f5607f01740 1 --2- 172.21.15.1:0/749339047 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556ba3fd1b0 0x5556ba7e1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:34.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.148+0000 7f5607f01740 1 -- 172.21.15.1:0/749339047 >> 172.21.15.1:0/749339047 conn(0x5556ba41a460 msgr2=0x5556ba7d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:34.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.148+0000 7f5607f01740 1 -- 172.21.15.1:0/749339047 shutdown_connections 2024-09-21T01:04:34.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.148+0000 7f5607f01740 1 -- 172.21.15.1:0/749339047 wait complete. 2024-09-21T01:04:34.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.149+0000 7f5607f01740 20 client.26846 trim_cache size 0 max 16384 2024-09-21T01:04:34.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.162+0000 7f5607f01740 1 Processor -- start 2024-09-21T01:04:34.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.162+0000 7f5607f01740 1 -- start start 2024-09-21T01:04:34.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.162+0000 7f5607f01740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556ba3fd1b0 0x5556ba7dadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:34.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.162+0000 7f5607f01740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556ba405390 0x5556ba7e6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:34.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.162+0000 7f5607f01740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5556ba426070 0x5556ba7e73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:34.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.162+0000 7f5607f01740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f55fc1ad270 con 0x5556ba426070 2024-09-21T01:04:34.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.162+0000 7f5607f01740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f55fc1aef00 con 0x5556ba3fd1b0 2024-09-21T01:04:34.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.162+0000 7f5607f01740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f55fc1ad970 con 0x5556ba405390 2024-09-21T01:04:34.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.162+0000 7f55fb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5556ba426070 0x5556ba7e73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:34.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.162+0000 7f55faffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556ba3fd1b0 0x5556ba7dadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:34.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.162+0000 7f55fb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5556ba426070 0x5556ba7e73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56746/0 (socket says 172.21.15.1:56746) 2024-09-21T01:04:34.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.162+0000 7f55faffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556ba3fd1b0 0x5556ba7dadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:50772/0 (socket says 172.21.15.1:50772) 2024-09-21T01:04:34.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.162+0000 7f55fb7fe640 1 -- 172.21.15.1:0/1347729080 learned_addr learned my addr 172.21.15.1:0/1347729080 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:34.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.162+0000 7f55fa7fc640 1 --2- 172.21.15.1:0/1347729080 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556ba405390 0x5556ba7e6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:34.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.163+0000 7f55fb7fe640 1 -- 172.21.15.1:0/1347729080 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556ba405390 msgr2=0x5556ba7e6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:34.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.163+0000 7f55fb7fe640 1 --2- 172.21.15.1:0/1347729080 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556ba405390 0x5556ba7e6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:34.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.163+0000 7f55fb7fe640 1 -- 172.21.15.1:0/1347729080 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556ba3fd1b0 msgr2=0x5556ba7dadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:34.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.163+0000 7f55fb7fe640 1 --2- 172.21.15.1:0/1347729080 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556ba3fd1b0 0x5556ba7dadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:34.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.163+0000 7f55fb7fe640 1 -- 172.21.15.1:0/1347729080 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556ba7d0120 con 0x5556ba426070 2024-09-21T01:04:34.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.163+0000 7f55fa7fc640 1 --2- 172.21.15.1:0/1347729080 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556ba405390 0x5556ba7e6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:34.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.163+0000 7f55fb7fe640 1 --2- 172.21.15.1:0/1347729080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5556ba426070 0x5556ba7e73b0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f55f4009640 tx=0x7f55f40097a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5ca4ecdf2d0e8cc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:34.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.163+0000 7f55f17fa640 1 -- 172.21.15.1:0/1347729080 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f401e8b0 con 0x5556ba426070 2024-09-21T01:04:34.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.163+0000 7f55f17fa640 1 -- 172.21.15.1:0/1347729080 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55f4005020 con 0x5556ba426070 2024-09-21T01:04:34.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.163+0000 7f55f17fa640 1 -- 172.21.15.1:0/1347729080 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f4004a00 con 0x5556ba426070 2024-09-21T01:04:34.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.164+0000 7f5607f01740 1 -- 172.21.15.1:0/1347729080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5556ba426070 msgr2=0x5556ba7e73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:34.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.164+0000 7f5607f01740 1 --2- 172.21.15.1:0/1347729080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5556ba426070 0x5556ba7e73b0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f55f4009640 tx=0x7f55f40097a0 comp rx=0 tx=0).stop 2024-09-21T01:04:34.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.164+0000 7f5607f01740 1 -- 172.21.15.1:0/1347729080 shutdown_connections 2024-09-21T01:04:34.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.164+0000 7f5607f01740 1 --2- 172.21.15.1:0/1347729080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5556ba426070 0x5556ba7e73b0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:34.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.164+0000 7f5607f01740 1 --2- 172.21.15.1:0/1347729080 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556ba405390 0x5556ba7e6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:34.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.164+0000 7f5607f01740 1 --2- 172.21.15.1:0/1347729080 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556ba3fd1b0 0x5556ba7dadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:34.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.164+0000 7f5607f01740 1 -- 172.21.15.1:0/1347729080 >> 172.21.15.1:0/1347729080 conn(0x5556ba41a460 msgr2=0x5556ba7dff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:34.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.164+0000 7f5607f01740 1 -- 172.21.15.1:0/1347729080 shutdown_connections 2024-09-21T01:04:34.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.164+0000 7f5607f01740 1 -- 172.21.15.1:0/1347729080 wait complete. 2024-09-21T01:04:34.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.164+0000 7f5607f01740 1 -- start start 2024-09-21T01:04:34.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.164+0000 7f5607f01740 1 Processor -- start 2024-09-21T01:04:34.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.165+0000 7f5607f01740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556ba3fd1b0 0x5556ba7e96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:34.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.165+0000 7f5607f01740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5556ba405390 0x5556ba7e9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:34.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.165+0000 7f5607f01740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556ba426070 0x5556ba85ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:34.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.165+0000 7f5607f01740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f55fc1ae770 con 0x5556ba405390 2024-09-21T01:04:34.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.165+0000 7f5607f01740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f55fc1ae0a0 con 0x5556ba426070 2024-09-21T01:04:34.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.165+0000 7f5607f01740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f55fc1ab250 con 0x5556ba3fd1b0 2024-09-21T01:04:34.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.165+0000 7f5607f01740 10 client.0 _ll_register_callbacks cb 0x7f55f4009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:34.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.165+0000 7f55fa7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5556ba405390 0x5556ba7e9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:34.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.165+0000 7f55fb7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556ba426070 0x5556ba85ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:34.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.165+0000 7f55faffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556ba3fd1b0 0x5556ba7e96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:34.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.165+0000 7f55fb7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556ba426070 0x5556ba85ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:50782/0 (socket says 172.21.15.1:50782) 2024-09-21T01:04:34.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.165+0000 7f55fa7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5556ba405390 0x5556ba7e9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56752/0 (socket says 172.21.15.1:56752) 2024-09-21T01:04:34.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.165+0000 7f55fb7fe640 1 -- 172.21.15.1:0/410993549 learned_addr learned my addr 172.21.15.1:0/410993549 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:34.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.165+0000 7f55fb7fe640 1 -- 172.21.15.1:0/410993549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556ba3fd1b0 msgr2=0x5556ba7e96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:34.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.165+0000 7f55fb7fe640 1 --2- 172.21.15.1:0/410993549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556ba3fd1b0 0x5556ba7e96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:34.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.165+0000 7f55fb7fe640 1 -- 172.21.15.1:0/410993549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5556ba405390 msgr2=0x5556ba7e9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:34.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.165+0000 7f55fb7fe640 1 --2- 172.21.15.1:0/410993549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5556ba405390 0x5556ba7e9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:34.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.165+0000 7f55fb7fe640 1 -- 172.21.15.1:0/410993549 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556ba7ea3f0 con 0x5556ba426070 2024-09-21T01:04:34.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.165+0000 7f55fa7fc640 1 --2- 172.21.15.1:0/410993549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5556ba405390 0x5556ba7e9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:34.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.165+0000 7f55faffd640 1 --2- 172.21.15.1:0/410993549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556ba3fd1b0 0x5556ba7e96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:34.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.166+0000 7f55fb7fe640 1 --2- 172.21.15.1:0/410993549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556ba426070 0x5556ba85ce70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f55f402b010 tx=0x7f55f401eb60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2658a29270d2ef6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:34.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.166+0000 7f55daffd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:04:34.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.166+0000 7f55daffd640 1 -- 172.21.15.1:0/410993549 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f404a020 con 0x5556ba426070 2024-09-21T01:04:34.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.166+0000 7f55daffd640 1 -- 172.21.15.1:0/410993549 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f55f4004730 con 0x5556ba426070 2024-09-21T01:04:34.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.166+0000 7f5607f01740 1 -- 172.21.15.1:0/410993549 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55f4005020 con 0x5556ba426070 2024-09-21T01:04:34.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.166+0000 7f55daffd640 1 -- 172.21.15.1:0/410993549 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f55f4005560 con 0x5556ba426070 2024-09-21T01:04:34.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.166+0000 7f5607f01740 10 client.26852 fetch_fsmap learned FSMap version 38 2024-09-21T01:04:34.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.166+0000 7f5607f01740 1 -- 172.21.15.1:0/410993549 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5556ba85e360 con 0x5556ba426070 2024-09-21T01:04:34.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.166+0000 7f55daffd640 1 -- 172.21.15.1:0/410993549 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55f4005020 con 0x5556ba426070 2024-09-21T01:04:34.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.166+0000 7f55daffd640 1 -- 172.21.15.1:0/410993549 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 38) ==== 8390+0+0 (secure 0 0 0) 0x7f55f4034bd0 con 0x5556ba426070 2024-09-21T01:04:34.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.167+0000 7f5607f01740 10 client.26852 fetch_fsmap finished waiting for FSMap version 38 2024-09-21T01:04:34.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.167+0000 7f5607f01740 10 client.26852 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T01:04:34.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.167+0000 7f5607f01740 20 client.26852 populate_metadata read hostname 'smithi001' 2024-09-21T01:04:34.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.167+0000 7f5607f01740 1 --2- 172.21.15.1:0/410993549 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x5556ba3b9da0 0x5556ba860a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:34.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.167+0000 7f5607f01740 4 client.26852 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:04:34.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.167+0000 7f5607f01740 1 -- 172.21.15.1:0/410993549 --> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5556ba7418a0 con 0x5556ba3b9da0 2024-09-21T01:04:34.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.167+0000 7f55faffd640 1 --2- 172.21.15.1:0/410993549 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x5556ba3b9da0 0x5556ba860a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:34.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.167+0000 7f55daffd640 10 client.26852 ms_handle_connect on v2:172.21.15.193:6834/3631682268 2024-09-21T01:04:34.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.167+0000 7f55faffd640 1 --2- 172.21.15.1:0/410993549 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x5556ba3b9da0 0x5556ba860a30 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8182f9e5f5befd3a server_cookie=12841314eff197b7 in_seq=0 out_seq=0 2024-09-21T01:04:34.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.167+0000 7f55daffd640 1 -- 172.21.15.1:0/410993549 <== mds.4 v2:172.21.15.193:6834/3631682268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5556ba7418a0 con 0x5556ba3b9da0 2024-09-21T01:04:34.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.167+0000 7f55daffd640 10 client.26852 handle_command_reply: tid=0 2024-09-21T01:04:34.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.167+0000 7f5607f01740 1 client.26852 shutdown 2024-09-21T01:04:34.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.168+0000 7f5607f01740 1 -- 172.21.15.1:0/410993549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556ba426070 msgr2=0x5556ba85ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:34.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.168+0000 7f5607f01740 1 --2- 172.21.15.1:0/410993549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556ba426070 0x5556ba85ce70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f55f402b010 tx=0x7f55f401eb60 comp rx=0 tx=0).stop 2024-09-21T01:04:34.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.168+0000 7f5607f01740 1 -- 172.21.15.1:0/410993549 shutdown_connections 2024-09-21T01:04:34.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.168+0000 7f5607f01740 1 --2- 172.21.15.1:0/410993549 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x5556ba3b9da0 0x5556ba860a30 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:34.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.168+0000 7f5607f01740 1 --2- 172.21.15.1:0/410993549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556ba426070 0x5556ba85ce70 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:34.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.168+0000 7f5607f01740 1 --2- 172.21.15.1:0/410993549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5556ba405390 0x5556ba7e9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:34.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.168+0000 7f5607f01740 1 --2- 172.21.15.1:0/410993549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556ba3fd1b0 0x5556ba7e96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:34.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.168+0000 7f5607f01740 1 -- 172.21.15.1:0/410993549 >> 172.21.15.1:0/410993549 conn(0x5556ba41a460 msgr2=0x5556ba7ce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:34.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.168+0000 7f55daffd640 0 client.26852 ms_handle_reset on v2:172.21.15.193:6834/3631682268 2024-09-21T01:04:34.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.168+0000 7f5607f01740 1 -- 172.21.15.1:0/410993549 shutdown_connections 2024-09-21T01:04:34.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.168+0000 7f5607f01740 1 -- 172.21.15.1:0/410993549 wait complete. 2024-09-21T01:04:34.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.168+0000 7f5607f01740 20 client.26852 trim_cache size 0 max 16384 2024-09-21T01:04:34.174 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T01:04:34.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.168+0000 7f560198d640 1 -- 172.21.15.1:0/2805412915 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f55e80b6590 msgr2=0x7f55e80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:34.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.168+0000 7f560198d640 1 --2- 172.21.15.1:0/2805412915 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f55e80b6590 0x7f55e80b8aa0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f55f4012800 tx=0x7f55f4005f90 comp rx=0 tx=0).stop 2024-09-21T01:04:34.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.168+0000 7f560198d640 1 -- 172.21.15.1:0/2805412915 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55fc1094b0 msgr2=0x7f55fc19aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:34.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.168+0000 7f560198d640 1 --2- 172.21.15.1:0/2805412915 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55fc1094b0 0x7f55fc19aa20 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f55fc06bd40 tx=0x7f55e400ee50 comp rx=0 tx=0).stop 2024-09-21T01:04:34.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.169+0000 7f560198d640 1 -- 172.21.15.1:0/2805412915 shutdown_connections 2024-09-21T01:04:34.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.169+0000 7f560198d640 1 --2- 172.21.15.1:0/2805412915 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55fc109e00 0x7f55fc19fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:34.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.169+0000 7f560198d640 1 --2- 172.21.15.1:0/2805412915 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f55e80b6590 0x7f55e80b8aa0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:34.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.169+0000 7f560198d640 1 --2- 172.21.15.1:0/2805412915 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55fc1094b0 0x7f55fc19aa20 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:34.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.169+0000 7f560198d640 1 --2- 172.21.15.1:0/2805412915 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f55fc103b70 0x7f55fc19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:34.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.169+0000 7f560198d640 1 -- 172.21.15.1:0/2805412915 >> 172.21.15.1:0/2805412915 conn(0x7f55fc0ff5e0 msgr2=0x7f55fc101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:34.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.169+0000 7f560198d640 1 -- 172.21.15.1:0/2805412915 shutdown_connections 2024-09-21T01:04:34.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:34.169+0000 7f560198d640 1 -- 172.21.15.1:0/2805412915 wait complete. 2024-09-21T01:04:35.171 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T01:04:35.451 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:04:35.840 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:35 smithi001 ceph-mon[31211]: pgmap v579: 97 pgs: 97 active+clean; 544 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 596 op/s 2024-09-21T01:04:35.840 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:35 smithi001 ceph-mon[31211]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:04:35.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.937+0000 7f71b3307640 1 -- 172.21.15.1:0/3544742938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71ac103b60 msgr2=0x7f71ac103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:35.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.937+0000 7f71b3307640 1 --2- 172.21.15.1:0/3544742938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71ac103b60 0x7f71ac103f70 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009900 tx=0x7f71a802a410 comp rx=0 tx=0).stop 2024-09-21T01:04:35.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.937+0000 7f71b3307640 1 -- 172.21.15.1:0/3544742938 shutdown_connections 2024-09-21T01:04:35.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.937+0000 7f71b3307640 1 --2- 172.21.15.1:0/3544742938 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f71ac109df0 0x7f71ac110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:35.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.937+0000 7f71b3307640 1 --2- 172.21.15.1:0/3544742938 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f71ac1094a0 0x7f71ac1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:35.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.937+0000 7f71b3307640 1 --2- 172.21.15.1:0/3544742938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71ac103b60 0x7f71ac103f70 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:35.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.937+0000 7f71b3307640 1 -- 172.21.15.1:0/3544742938 >> 172.21.15.1:0/3544742938 conn(0x7f71ac07b850 msgr2=0x7f71ac07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:35.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.937+0000 7f71b3307640 1 -- 172.21.15.1:0/3544742938 shutdown_connections 2024-09-21T01:04:35.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.937+0000 7f71b3307640 1 -- 172.21.15.1:0/3544742938 wait complete. 2024-09-21T01:04:35.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.938+0000 7f71b3307640 1 Processor -- start 2024-09-21T01:04:35.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.938+0000 7f71b3307640 1 -- start start 2024-09-21T01:04:35.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.939+0000 7f71b3307640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f71ac103b60 0x7f71ac19a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:35.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.939+0000 7f71b3307640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f71ac1094a0 0x7f71ac19ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:35.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.939+0000 7f71b3307640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71ac109df0 0x7f71ac19fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:35.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.939+0000 7f71b3307640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac113b00 con 0x7f71ac109df0 2024-09-21T01:04:35.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.939+0000 7f71b3307640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac113980 con 0x7f71ac103b60 2024-09-21T01:04:35.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.939+0000 7f71b3307640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac113c80 con 0x7f71ac1094a0 2024-09-21T01:04:35.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.939+0000 7f71b18a4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71ac109df0 0x7f71ac19fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:35.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.939+0000 7f71b10a3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f71ac103b60 0x7f71ac19a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:35.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.939+0000 7f71b18a4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71ac109df0 0x7f71ac19fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56774/0 (socket says 172.21.15.1:56774) 2024-09-21T01:04:35.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.939+0000 7f71b08a2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f71ac1094a0 0x7f71ac19ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:35.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.939+0000 7f71b18a4640 1 -- 172.21.15.1:0/327315896 learned_addr learned my addr 172.21.15.1:0/327315896 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:35.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.939+0000 7f71b18a4640 1 -- 172.21.15.1:0/327315896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f71ac1094a0 msgr2=0x7f71ac19ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:35.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.939+0000 7f71b18a4640 1 --2- 172.21.15.1:0/327315896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f71ac1094a0 0x7f71ac19ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:35.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.939+0000 7f71b18a4640 1 -- 172.21.15.1:0/327315896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f71ac103b60 msgr2=0x7f71ac19a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:35.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.939+0000 7f71b18a4640 1 --2- 172.21.15.1:0/327315896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f71ac103b60 0x7f71ac19a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:35.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.939+0000 7f71b18a4640 1 -- 172.21.15.1:0/327315896 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71ac1a04e0 con 0x7f71ac109df0 2024-09-21T01:04:35.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.939+0000 7f71b18a4640 1 --2- 172.21.15.1:0/327315896 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71ac109df0 0x7f71ac19fdb0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f71a400eb10 tx=0x7f71a400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:35.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.939+0000 7f71a27fc640 1 -- 172.21.15.1:0/327315896 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a4004b20 con 0x7f71ac109df0 2024-09-21T01:04:35.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.939+0000 7f71b3307640 1 -- 172.21.15.1:0/327315896 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71ac1a07d0 con 0x7f71ac109df0 2024-09-21T01:04:35.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.940+0000 7f71a27fc640 1 -- 172.21.15.1:0/327315896 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71a4004cc0 con 0x7f71ac109df0 2024-09-21T01:04:35.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.940+0000 7f71a27fc640 1 -- 172.21.15.1:0/327315896 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a4010670 con 0x7f71ac109df0 2024-09-21T01:04:35.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.940+0000 7f71b3307640 1 -- 172.21.15.1:0/327315896 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71ac1a6f30 con 0x7f71ac109df0 2024-09-21T01:04:35.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.942+0000 7f71b987b740 1 Processor -- start 2024-09-21T01:04:35.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.943+0000 7f71a27fc640 1 -- 172.21.15.1:0/327315896 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f71a4005020 con 0x7f71ac109df0 2024-09-21T01:04:35.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.943+0000 7f71b987b740 1 -- start start 2024-09-21T01:04:35.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.943+0000 7f71b987b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56201cde8070 0x56201d18f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:35.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.943+0000 7f71b987b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56201cdbf1b0 0x56201d18fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:35.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.943+0000 7f71b987b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201cdc7390 0x56201d190120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:35.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.943+0000 7f71b987b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56201d105ea0 con 0x56201cdbf1b0 2024-09-21T01:04:35.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.943+0000 7f71b987b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56201d0f52d0 con 0x56201cde8070 2024-09-21T01:04:35.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.943+0000 7f71b987b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56201d0f90e0 con 0x56201cdc7390 2024-09-21T01:04:35.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.944+0000 7f71b10a3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56201cdbf1b0 0x56201d18fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:35.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.944+0000 7f71b08a2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56201cde8070 0x56201d18f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:35.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.944+0000 7f71b10a3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56201cdbf1b0 0x56201d18fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56790/0 (socket says 172.21.15.1:56790) 2024-09-21T01:04:35.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.944+0000 7f71b10a3640 1 -- 172.21.15.1:0/2101435027 learned_addr learned my addr 172.21.15.1:0/2101435027 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:35.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.944+0000 7f71b08a2640 1 --2- 172.21.15.1:0/2101435027 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201cdc7390 0x56201d190120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:35.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.944+0000 7f71b10a3640 1 -- 172.21.15.1:0/2101435027 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201cdc7390 msgr2=0x56201d190120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:35.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.944+0000 7f71b10a3640 1 --2- 172.21.15.1:0/2101435027 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201cdc7390 0x56201d190120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:35.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.944+0000 7f71b10a3640 1 -- 172.21.15.1:0/2101435027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56201cde8070 msgr2=0x56201d18f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:35.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.944+0000 7f71b10a3640 1 --2- 172.21.15.1:0/2101435027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56201cde8070 0x56201d18f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:35.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.944+0000 7f71b10a3640 1 -- 172.21.15.1:0/2101435027 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56201ce53650 con 0x56201cdbf1b0 2024-09-21T01:04:35.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.944+0000 7f71a27fc640 1 --2- 172.21.15.1:0/327315896 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f71980b6510 0x7f71980b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:35.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.944+0000 7f71b08a2640 1 --2- 172.21.15.1:0/327315896 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f71980b6510 0x7f71980b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:35.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.944+0000 7f71a27fc640 1 -- 172.21.15.1:0/327315896 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f71a40e7900 con 0x7f71ac109df0 2024-09-21T01:04:35.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.944+0000 7f71b10a3640 1 --2- 172.21.15.1:0/2101435027 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56201cdbf1b0 0x56201d18fbe0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009900 tx=0x7f71a8004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5dc08fbca36a6a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:35.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.944+0000 7f71977fe640 1 -- 172.21.15.1:0/2101435027 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a8040070 con 0x56201cdbf1b0 2024-09-21T01:04:35.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.945+0000 7f71977fe640 1 -- 172.21.15.1:0/2101435027 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71a8005500 con 0x56201cdbf1b0 2024-09-21T01:04:35.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.945+0000 7f71977fe640 1 -- 172.21.15.1:0/2101435027 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a8035040 con 0x56201cdbf1b0 2024-09-21T01:04:35.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.945+0000 7f71b08a2640 1 --2- 172.21.15.1:0/327315896 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f71980b6510 0x7f71980b8a20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f719c009710 tx=0x7f719c015040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:35.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.945+0000 7f71b987b740 1 -- 172.21.15.1:0/2101435027 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56201cdbf1b0 msgr2=0x56201d18fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:35.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.945+0000 7f71b987b740 1 --2- 172.21.15.1:0/2101435027 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56201cdbf1b0 0x56201d18fbe0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009900 tx=0x7f71a8004040 comp rx=0 tx=0).stop 2024-09-21T01:04:35.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.946+0000 7f71b987b740 1 -- 172.21.15.1:0/2101435027 shutdown_connections 2024-09-21T01:04:35.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.946+0000 7f71b987b740 1 --2- 172.21.15.1:0/2101435027 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201cdc7390 0x56201d190120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:35.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.946+0000 7f71b987b740 1 --2- 172.21.15.1:0/2101435027 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56201cdbf1b0 0x56201d18fbe0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:35.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.946+0000 7f71b987b740 1 --2- 172.21.15.1:0/2101435027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56201cde8070 0x56201d18f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:35.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.946+0000 7f71b987b740 1 -- 172.21.15.1:0/2101435027 >> 172.21.15.1:0/2101435027 conn(0x56201cddc460 msgr2=0x56201d18d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:35.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.946+0000 7f71b987b740 1 -- 172.21.15.1:0/2101435027 shutdown_connections 2024-09-21T01:04:35.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.946+0000 7f71b987b740 1 -- 172.21.15.1:0/2101435027 wait complete. 2024-09-21T01:04:35.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.946+0000 7f71b987b740 1 -- start start 2024-09-21T01:04:35.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.946+0000 7f71b987b740 1 Processor -- start 2024-09-21T01:04:35.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.947+0000 7f71b987b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201cdbf1b0 0x56201d19f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:35.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.947+0000 7f71b987b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56201cdc7390 0x56201d19f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:35.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.947+0000 7f71b987b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56201cde8070 0x56201d19fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:35.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.947+0000 7f71b987b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56201cf56700 con 0x56201cdc7390 2024-09-21T01:04:35.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.947+0000 7f71b987b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56201d090160 con 0x56201cde8070 2024-09-21T01:04:35.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.947+0000 7f71b987b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56201d1a2150 con 0x56201cdbf1b0 2024-09-21T01:04:35.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.947+0000 7f71b987b740 10 client.0 _ll_register_callbacks cb 0x56201d0a99e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:35.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.947+0000 7f71b08a2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56201cdc7390 0x56201d19f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:35.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.947+0000 7f71b08a2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56201cdc7390 0x56201d19f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56792/0 (socket says 172.21.15.1:56792) 2024-09-21T01:04:35.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.947+0000 7f71b08a2640 1 -- 172.21.15.1:0/2309656521 learned_addr learned my addr 172.21.15.1:0/2309656521 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:35.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.947+0000 7f71b10a3640 1 --2- 172.21.15.1:0/2309656521 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201cdbf1b0 0x56201d19f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:35.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.947+0000 7f71b18a4640 1 --2- 172.21.15.1:0/2309656521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56201cde8070 0x56201d19fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:35.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.947+0000 7f71b08a2640 1 -- 172.21.15.1:0/2309656521 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201cdbf1b0 msgr2=0x56201d19f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:35.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.947+0000 7f71b08a2640 1 --2- 172.21.15.1:0/2309656521 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201cdbf1b0 0x56201d19f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:35.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.947+0000 7f71b08a2640 1 -- 172.21.15.1:0/2309656521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56201cde8070 msgr2=0x56201d19fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:35.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.947+0000 7f71b08a2640 1 --2- 172.21.15.1:0/2309656521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56201cde8070 0x56201d19fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:35.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.947+0000 7f71b08a2640 1 -- 172.21.15.1:0/2309656521 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56201d0bdc90 con 0x56201cdc7390 2024-09-21T01:04:35.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.947+0000 7f71b10a3640 1 --2- 172.21.15.1:0/2309656521 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201cdbf1b0 0x56201d19f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:35.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.947+0000 7f71b18a4640 1 --2- 172.21.15.1:0/2309656521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56201cde8070 0x56201d19fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:35.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.948+0000 7f71b08a2640 1 --2- 172.21.15.1:0/2309656521 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56201cdc7390 0x56201d19f590 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f719c0038a0 tx=0x7f719c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc4e9c5b68bf776b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:35.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.948+0000 7f7194ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:04:35.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.948+0000 7f7194ff9640 1 -- 172.21.15.1:0/2309656521 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719c00fb80 con 0x56201cdc7390 2024-09-21T01:04:35.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.948+0000 7f7194ff9640 1 -- 172.21.15.1:0/2309656521 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f719c00fd20 con 0x56201cdc7390 2024-09-21T01:04:35.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.948+0000 7f71b987b740 1 -- 172.21.15.1:0/2309656521 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71a8005500 con 0x56201cdc7390 2024-09-21T01:04:35.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.948+0000 7f7194ff9640 1 -- 172.21.15.1:0/2309656521 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f719c030070 con 0x56201cdc7390 2024-09-21T01:04:35.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.948+0000 7f71b987b740 10 client.17208 fetch_fsmap learned FSMap version 39 2024-09-21T01:04:35.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.948+0000 7f71b987b740 1 -- 172.21.15.1:0/2309656521 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x56201d1ade20 con 0x56201cdc7390 2024-09-21T01:04:35.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.948+0000 7f7194ff9640 1 -- 172.21.15.1:0/2309656521 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71a8005500 con 0x56201cdc7390 2024-09-21T01:04:35.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.948+0000 7f7194ff9640 1 -- 172.21.15.1:0/2309656521 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 39) ==== 8398+0+0 (secure 0 0 0) 0x7f719c01d040 con 0x56201cdc7390 2024-09-21T01:04:35.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.948+0000 7f71b987b740 10 client.17208 fetch_fsmap finished waiting for FSMap version 39 2024-09-21T01:04:35.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.948+0000 7f71b987b740 10 client.17208 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-21T01:04:35.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.948+0000 7f71b987b740 20 client.17208 populate_metadata read hostname 'smithi001' 2024-09-21T01:04:35.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.948+0000 7f71b987b740 1 --2- 172.21.15.1:0/2309656521 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x56201cda69f0 0x56201d1b1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:35.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.949+0000 7f71b987b740 4 client.17208 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:04:35.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.949+0000 7f71b987b740 1 -- 172.21.15.1:0/2309656521 --> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56201d107df0 con 0x56201cda69f0 2024-09-21T01:04:35.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.949+0000 7f71b10a3640 1 --2- 172.21.15.1:0/2309656521 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x56201cda69f0 0x56201d1b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:35.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.949+0000 7f7194ff9640 10 client.17208 ms_handle_connect on v2:172.21.15.193:6836/909252228 2024-09-21T01:04:35.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.949+0000 7f71b10a3640 1 --2- 172.21.15.1:0/2309656521 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x56201cda69f0 0x56201d1b1410 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=22e72fdbe451cf0c server_cookie=3779d009deabfd18 in_seq=0 out_seq=0 2024-09-21T01:04:35.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.950+0000 7f7194ff9640 1 -- 172.21.15.1:0/2309656521 <== mds.3 v2:172.21.15.193:6836/909252228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56201d107df0 con 0x56201cda69f0 2024-09-21T01:04:35.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.950+0000 7f7194ff9640 10 client.17208 handle_command_reply: tid=0 2024-09-21T01:04:35.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.950+0000 7f71b987b740 1 client.17208 shutdown 2024-09-21T01:04:35.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.950+0000 7f71b987b740 1 -- 172.21.15.1:0/2309656521 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56201cdc7390 msgr2=0x56201d19f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:35.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.950+0000 7f71b987b740 1 --2- 172.21.15.1:0/2309656521 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56201cdc7390 0x56201d19f590 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f719c0038a0 tx=0x7f719c005f90 comp rx=0 tx=0).stop 2024-09-21T01:04:35.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.950+0000 7f71b987b740 1 -- 172.21.15.1:0/2309656521 shutdown_connections 2024-09-21T01:04:35.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.950+0000 7f71b987b740 1 --2- 172.21.15.1:0/2309656521 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x56201cda69f0 0x56201d1b1410 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:35.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.950+0000 7f71b987b740 1 --2- 172.21.15.1:0/2309656521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56201cde8070 0x56201d19fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:35.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.950+0000 7f71b987b740 1 --2- 172.21.15.1:0/2309656521 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56201cdc7390 0x56201d19f590 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:35.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.950+0000 7f71b987b740 1 --2- 172.21.15.1:0/2309656521 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201cdbf1b0 0x56201d19f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:35.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.950+0000 7f71b987b740 1 -- 172.21.15.1:0/2309656521 >> 172.21.15.1:0/2309656521 conn(0x56201cddc460 msgr2=0x56201d192830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:35.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.950+0000 7f7194ff9640 0 client.17208 ms_handle_reset on v2:172.21.15.193:6836/909252228 2024-09-21T01:04:35.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.950+0000 7f71b987b740 1 -- 172.21.15.1:0/2309656521 shutdown_connections 2024-09-21T01:04:35.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.950+0000 7f71b987b740 1 -- 172.21.15.1:0/2309656521 wait complete. 2024-09-21T01:04:35.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.951+0000 7f71b987b740 20 client.17208 trim_cache size 0 max 16384 2024-09-21T01:04:35.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.969+0000 7f71b987b740 1 Processor -- start 2024-09-21T01:04:35.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.969+0000 7f71b987b740 1 -- start start 2024-09-21T01:04:35.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.969+0000 7f71b987b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56201cdbf1b0 0x56201d19d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:35.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.969+0000 7f71b987b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201cdc7390 0x56201d19de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:35.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.969+0000 7f71b987b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56201cde8070 0x56201d19c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:35.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.969+0000 7f71b987b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac1ad330 con 0x56201cdbf1b0 2024-09-21T01:04:35.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.969+0000 7f71b987b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac1aeff0 con 0x56201cde8070 2024-09-21T01:04:35.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.969+0000 7f71b987b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac1ada30 con 0x56201cdc7390 2024-09-21T01:04:35.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.969+0000 7f71b10a3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56201cdbf1b0 0x56201d19d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:35.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.969+0000 7f71b10a3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56201cdbf1b0 0x56201d19d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56800/0 (socket says 172.21.15.1:56800) 2024-09-21T01:04:35.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.969+0000 7f71b10a3640 1 -- 172.21.15.1:0/330736769 learned_addr learned my addr 172.21.15.1:0/330736769 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:35.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.969+0000 7f71b18a4640 1 --2- 172.21.15.1:0/330736769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56201cde8070 0x56201d19c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:35.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.969+0000 7f71b08a2640 1 --2- 172.21.15.1:0/330736769 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201cdc7390 0x56201d19de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:35.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.970+0000 7f71b10a3640 1 -- 172.21.15.1:0/330736769 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201cdc7390 msgr2=0x56201d19de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:35.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.970+0000 7f71b10a3640 1 --2- 172.21.15.1:0/330736769 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201cdc7390 0x56201d19de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:35.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.970+0000 7f71b10a3640 1 -- 172.21.15.1:0/330736769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56201cde8070 msgr2=0x56201d19c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:35.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.970+0000 7f71b10a3640 1 --2- 172.21.15.1:0/330736769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56201cde8070 0x56201d19c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:35.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.970+0000 7f71b10a3640 1 -- 172.21.15.1:0/330736769 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56201d19fe10 con 0x56201cdbf1b0 2024-09-21T01:04:35.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.970+0000 7f71b08a2640 1 --2- 172.21.15.1:0/330736769 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201cdc7390 0x56201d19de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:04:35.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.970+0000 7f71b10a3640 1 --2- 172.21.15.1:0/330736769 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56201cdbf1b0 0x56201d19d8d0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f71a802a930 tx=0x7f71a8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=282e9a397664ada3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:35.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.970+0000 7f7196ffd640 1 -- 172.21.15.1:0/330736769 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a8040040 con 0x56201cdbf1b0 2024-09-21T01:04:35.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.970+0000 7f7196ffd640 1 -- 172.21.15.1:0/330736769 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71a80048c0 con 0x56201cdbf1b0 2024-09-21T01:04:35.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.970+0000 7f7196ffd640 1 -- 172.21.15.1:0/330736769 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a8035040 con 0x56201cdbf1b0 2024-09-21T01:04:35.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.972+0000 7f71b987b740 1 -- 172.21.15.1:0/330736769 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56201cdbf1b0 msgr2=0x56201d19d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:35.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.972+0000 7f71b987b740 1 --2- 172.21.15.1:0/330736769 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56201cdbf1b0 0x56201d19d8d0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f71a802a930 tx=0x7f71a8000bc0 comp rx=0 tx=0).stop 2024-09-21T01:04:35.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.972+0000 7f71b987b740 1 -- 172.21.15.1:0/330736769 shutdown_connections 2024-09-21T01:04:35.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.972+0000 7f71b987b740 1 --2- 172.21.15.1:0/330736769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56201cde8070 0x56201d19c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:35.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.972+0000 7f71b987b740 1 --2- 172.21.15.1:0/330736769 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201cdc7390 0x56201d19de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:35.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.972+0000 7f71b987b740 1 --2- 172.21.15.1:0/330736769 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56201cdbf1b0 0x56201d19d8d0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:35.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.972+0000 7f71b987b740 1 -- 172.21.15.1:0/330736769 >> 172.21.15.1:0/330736769 conn(0x56201cddc460 msgr2=0x56201d19a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:35.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.973+0000 7f71b987b740 1 -- 172.21.15.1:0/330736769 shutdown_connections 2024-09-21T01:04:35.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.973+0000 7f71b987b740 1 -- 172.21.15.1:0/330736769 wait complete. 2024-09-21T01:04:35.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.974+0000 7f71b987b740 1 -- start start 2024-09-21T01:04:35.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.974+0000 7f71b987b740 1 Processor -- start 2024-09-21T01:04:35.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.974+0000 7f71b987b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201cdbf1b0 0x56201d1962c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:35.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.975+0000 7f71b987b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56201cdc7390 0x56201d1968a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:35.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.975+0000 7f71b987b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56201cde8070 0x56201d1a6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:35.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.975+0000 7f71b987b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac1ae860 con 0x56201cde8070 2024-09-21T01:04:35.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.975+0000 7f71b987b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac1ae160 con 0x56201cdc7390 2024-09-21T01:04:35.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.975+0000 7f71b987b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac1ab310 con 0x56201cdbf1b0 2024-09-21T01:04:35.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.975+0000 7f71b987b740 10 client.0 _ll_register_callbacks cb 0x7f719c010f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:35.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.975+0000 7f71b08a2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56201cdc7390 0x56201d1968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:35.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.975+0000 7f71b18a4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56201cde8070 0x56201d1a6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:35.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.975+0000 7f71b18a4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56201cde8070 0x56201d1a6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56806/0 (socket says 172.21.15.1:56806) 2024-09-21T01:04:35.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.975+0000 7f71b18a4640 1 -- 172.21.15.1:0/2890375676 learned_addr learned my addr 172.21.15.1:0/2890375676 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:35.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.975+0000 7f71b10a3640 1 --2- 172.21.15.1:0/2890375676 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201cdbf1b0 0x56201d1962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:35.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.976+0000 7f71b18a4640 1 -- 172.21.15.1:0/2890375676 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201cdbf1b0 msgr2=0x56201d1962c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:35.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.976+0000 7f71b18a4640 1 --2- 172.21.15.1:0/2890375676 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201cdbf1b0 0x56201d1962c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:35.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.976+0000 7f71b18a4640 1 -- 172.21.15.1:0/2890375676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56201cdc7390 msgr2=0x56201d1968a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:35.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.976+0000 7f71b18a4640 1 --2- 172.21.15.1:0/2890375676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56201cdc7390 0x56201d1968a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:35.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.976+0000 7f71b18a4640 1 -- 172.21.15.1:0/2890375676 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56201d1a6940 con 0x56201cde8070 2024-09-21T01:04:35.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.976+0000 7f71b18a4640 1 --2- 172.21.15.1:0/2890375676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56201cde8070 0x56201d1a6400 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f71a40049d0 tx=0x7f71a40b7360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ef6c3af19ad48d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:35.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.976+0000 7f7194ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:04:35.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.976+0000 7f7194ff9640 1 -- 172.21.15.1:0/2890375676 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a40ad180 con 0x56201cde8070 2024-09-21T01:04:35.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.976+0000 7f71b987b740 1 -- 172.21.15.1:0/2890375676 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71a80048c0 con 0x56201cde8070 2024-09-21T01:04:35.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.976+0000 7f7194ff9640 1 -- 172.21.15.1:0/2890375676 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f71a40a9560 con 0x56201cde8070 2024-09-21T01:04:35.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.977+0000 7f7194ff9640 1 -- 172.21.15.1:0/2890375676 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f71a40a9180 con 0x56201cde8070 2024-09-21T01:04:35.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.977+0000 7f71b987b740 10 client.17214 fetch_fsmap learned FSMap version 39 2024-09-21T01:04:35.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.977+0000 7f71b987b740 1 -- 172.21.15.1:0/2890375676 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x56201d1a7be0 con 0x56201cde8070 2024-09-21T01:04:35.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.977+0000 7f7194ff9640 1 -- 172.21.15.1:0/2890375676 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71a80048c0 con 0x56201cde8070 2024-09-21T01:04:35.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.977+0000 7f7194ff9640 1 -- 172.21.15.1:0/2890375676 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 39) ==== 8398+0+0 (secure 0 0 0) 0x7f71a40b3680 con 0x56201cde8070 2024-09-21T01:04:35.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.977+0000 7f71b987b740 10 client.17214 fetch_fsmap finished waiting for FSMap version 39 2024-09-21T01:04:35.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.977+0000 7f71b987b740 10 client.17214 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-21T01:04:35.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.977+0000 7f71b987b740 20 client.17214 populate_metadata read hostname 'smithi001' 2024-09-21T01:04:35.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.977+0000 7f71b987b740 1 --2- 172.21.15.1:0/2890375676 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x56201cd7bda0 0x56201d222610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:35.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.977+0000 7f71b987b740 4 client.17214 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:04:35.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.977+0000 7f71b987b740 1 -- 172.21.15.1:0/2890375676 --> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56201d1038a0 con 0x56201cd7bda0 2024-09-21T01:04:35.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.978+0000 7f71b10a3640 1 --2- 172.21.15.1:0/2890375676 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x56201cd7bda0 0x56201d222610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:35.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:35 smithi193 ceph-mon[34660]: pgmap v579: 97 pgs: 97 active+clean; 544 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 596 op/s 2024-09-21T01:04:35.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:35 smithi193 ceph-mon[34660]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:04:35.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.978+0000 7f7194ff9640 10 client.17214 ms_handle_connect on v2:172.21.15.193:6836/909252228 2024-09-21T01:04:35.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.978+0000 7f71b10a3640 1 --2- 172.21.15.1:0/2890375676 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x56201cd7bda0 0x56201d222610 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ba44caa80b9958d1 server_cookie=f500c1abb556cd2b in_seq=0 out_seq=0 2024-09-21T01:04:35.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.979+0000 7f7194ff9640 1 -- 172.21.15.1:0/2890375676 <== mds.3 v2:172.21.15.193:6836/909252228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56201d1038a0 con 0x56201cd7bda0 2024-09-21T01:04:35.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.979+0000 7f7194ff9640 10 client.17214 handle_command_reply: tid=0 2024-09-21T01:04:35.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.979+0000 7f71b987b740 1 client.17214 shutdown 2024-09-21T01:04:35.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.979+0000 7f71b987b740 1 -- 172.21.15.1:0/2890375676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56201cde8070 msgr2=0x56201d1a6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:35.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.979+0000 7f71b987b740 1 --2- 172.21.15.1:0/2890375676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56201cde8070 0x56201d1a6400 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f71a40049d0 tx=0x7f71a40b7360 comp rx=0 tx=0).stop 2024-09-21T01:04:35.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.979+0000 7f71b987b740 1 -- 172.21.15.1:0/2890375676 shutdown_connections 2024-09-21T01:04:35.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.979+0000 7f71b987b740 1 --2- 172.21.15.1:0/2890375676 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x56201cd7bda0 0x56201d222610 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:35.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.979+0000 7f71b987b740 1 --2- 172.21.15.1:0/2890375676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56201cde8070 0x56201d1a6400 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:35.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.979+0000 7f71b987b740 1 --2- 172.21.15.1:0/2890375676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56201cdc7390 0x56201d1968a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:35.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.979+0000 7f71b987b740 1 --2- 172.21.15.1:0/2890375676 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201cdbf1b0 0x56201d1962c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:35.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.979+0000 7f7194ff9640 0 client.17214 ms_handle_reset on v2:172.21.15.193:6836/909252228 2024-09-21T01:04:35.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.979+0000 7f71b987b740 1 -- 172.21.15.1:0/2890375676 >> 172.21.15.1:0/2890375676 conn(0x56201cddc460 msgr2=0x56201d1906d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:35.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.979+0000 7f71b987b740 1 -- 172.21.15.1:0/2890375676 shutdown_connections 2024-09-21T01:04:35.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.980+0000 7f71b987b740 1 -- 172.21.15.1:0/2890375676 wait complete. 2024-09-21T01:04:35.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.980+0000 7f71b987b740 20 client.17214 trim_cache size 0 max 16384 2024-09-21T01:04:35.983 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T01:04:35.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.980+0000 7f71b3307640 1 -- 172.21.15.1:0/327315896 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f71980b6510 msgr2=0x7f71980b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:35.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.980+0000 7f71b3307640 1 --2- 172.21.15.1:0/327315896 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f71980b6510 0x7f71980b8a20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f719c009710 tx=0x7f719c015040 comp rx=0 tx=0).stop 2024-09-21T01:04:35.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.980+0000 7f71b3307640 1 -- 172.21.15.1:0/327315896 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71ac109df0 msgr2=0x7f71ac19fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:35.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.980+0000 7f71b3307640 1 --2- 172.21.15.1:0/327315896 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71ac109df0 0x7f71ac19fdb0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f71a400eb10 tx=0x7f71a400c2d0 comp rx=0 tx=0).stop 2024-09-21T01:04:35.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.980+0000 7f71b3307640 1 -- 172.21.15.1:0/327315896 shutdown_connections 2024-09-21T01:04:35.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.980+0000 7f71b3307640 1 --2- 172.21.15.1:0/327315896 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f71980b6510 0x7f71980b8a20 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:35.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.980+0000 7f71b3307640 1 --2- 172.21.15.1:0/327315896 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71ac109df0 0x7f71ac19fdb0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:35.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.980+0000 7f71b3307640 1 --2- 172.21.15.1:0/327315896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f71ac1094a0 0x7f71ac19ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:35.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.980+0000 7f71b3307640 1 --2- 172.21.15.1:0/327315896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f71ac103b60 0x7f71ac19a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:35.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.980+0000 7f71b3307640 1 -- 172.21.15.1:0/327315896 >> 172.21.15.1:0/327315896 conn(0x7f71ac07b850 msgr2=0x7f71ac1075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:35.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.981+0000 7f71b3307640 1 -- 172.21.15.1:0/327315896 shutdown_connections 2024-09-21T01:04:35.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:35.981+0000 7f71b3307640 1 -- 172.21.15.1:0/327315896 wait complete. 2024-09-21T01:04:35.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:35 smithi042 ceph-mon[34481]: pgmap v579: 97 pgs: 97 active+clean; 544 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 596 op/s 2024-09-21T01:04:35.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:35 smithi042 ceph-mon[34481]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:04:36.709 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T01:04:36.970 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:04:37.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.497+0000 7f853793c640 1 -- 172.21.15.1:0/1767558396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85301094c0 msgr2=0x7f85301098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:37.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.497+0000 7f853793c640 1 --2- 172.21.15.1:0/1767558396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85301094c0 0x7f85301098d0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f8520009900 tx=0x7f852002a410 comp rx=0 tx=0).stop 2024-09-21T01:04:37.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.497+0000 7f853793c640 1 -- 172.21.15.1:0/1767558396 shutdown_connections 2024-09-21T01:04:37.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.497+0000 7f853793c640 1 --2- 172.21.15.1:0/1767558396 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8530109e10 0x7f8530110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:37.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.497+0000 7f853793c640 1 --2- 172.21.15.1:0/1767558396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85301094c0 0x7f85301098d0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:37.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.497+0000 7f853793c640 1 --2- 172.21.15.1:0/1767558396 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8530103b80 0x7f8530103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:37.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.497+0000 7f853793c640 1 -- 172.21.15.1:0/1767558396 >> 172.21.15.1:0/1767558396 conn(0x7f85300ff610 msgr2=0x7f8530101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:37.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.498+0000 7f853793c640 1 -- 172.21.15.1:0/1767558396 shutdown_connections 2024-09-21T01:04:37.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.498+0000 7f853793c640 1 -- 172.21.15.1:0/1767558396 wait complete. 2024-09-21T01:04:37.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.499+0000 7f853793c640 1 Processor -- start 2024-09-21T01:04:37.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.499+0000 7f853793c640 1 -- start start 2024-09-21T01:04:37.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.499+0000 7f853793c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8530103b80 0x7f853019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:37.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.499+0000 7f853793c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85301094c0 0x7f853019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:37.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.499+0000 7f853793c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8530109e10 0x7f853019fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:37.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.499+0000 7f853793c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8530113ad0 con 0x7f85301094c0 2024-09-21T01:04:37.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.499+0000 7f853793c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8530113950 con 0x7f8530109e10 2024-09-21T01:04:37.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.499+0000 7f853793c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8530113c50 con 0x7f8530103b80 2024-09-21T01:04:37.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.499+0000 7f8534ed7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85301094c0 0x7f853019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:37.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.499+0000 7f8534ed7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85301094c0 0x7f853019aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56826/0 (socket says 172.21.15.1:56826) 2024-09-21T01:04:37.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.499+0000 7f8534ed7640 1 -- 172.21.15.1:0/1663192158 learned_addr learned my addr 172.21.15.1:0/1663192158 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:37.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.499+0000 7f8535ed9640 1 --2- 172.21.15.1:0/1663192158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8530109e10 0x7f853019fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:37.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.499+0000 7f85356d8640 1 --2- 172.21.15.1:0/1663192158 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8530103b80 0x7f853019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:37.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.499+0000 7f8534ed7640 1 -- 172.21.15.1:0/1663192158 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8530103b80 msgr2=0x7f853019a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:37.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.499+0000 7f8534ed7640 1 --2- 172.21.15.1:0/1663192158 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8530103b80 0x7f853019a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:37.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.500+0000 7f8534ed7640 1 -- 172.21.15.1:0/1663192158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8530109e10 msgr2=0x7f853019fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:37.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.500+0000 7f8534ed7640 1 --2- 172.21.15.1:0/1663192158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8530109e10 0x7f853019fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:37.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.500+0000 7f8534ed7640 1 -- 172.21.15.1:0/1663192158 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85301a0430 con 0x7f85301094c0 2024-09-21T01:04:37.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.500+0000 7f8535ed9640 1 --2- 172.21.15.1:0/1663192158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8530109e10 0x7f853019fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:37.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.500+0000 7f85356d8640 1 --2- 172.21.15.1:0/1663192158 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8530103b80 0x7f853019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:37.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.500+0000 7f8534ed7640 1 --2- 172.21.15.1:0/1663192158 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85301094c0 0x7f853019aa60 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f852002a930 tx=0x7f8520031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:37.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.500+0000 7f85267fc640 1 -- 172.21.15.1:0/1663192158 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852003f030 con 0x7f85301094c0 2024-09-21T01:04:37.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.500+0000 7f85267fc640 1 -- 172.21.15.1:0/1663192158 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8520004490 con 0x7f85301094c0 2024-09-21T01:04:37.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.500+0000 7f853793c640 1 -- 172.21.15.1:0/1663192158 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85301a06c0 con 0x7f85301094c0 2024-09-21T01:04:37.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.500+0000 7f85267fc640 1 -- 172.21.15.1:0/1663192158 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8520035070 con 0x7f85301094c0 2024-09-21T01:04:37.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.500+0000 7f853793c640 1 -- 172.21.15.1:0/1663192158 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85301a6e80 con 0x7f85301094c0 2024-09-21T01:04:37.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.503+0000 7f853deb0740 1 Processor -- start 2024-09-21T01:04:37.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.503+0000 7f853deb0740 1 -- start start 2024-09-21T01:04:37.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.504+0000 7f853deb0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cbdc224070 0x55cbdc5cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:37.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.504+0000 7f853deb0740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cbdc1fb1b0 0x55cbdc5cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:37.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.504+0000 7f853deb0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cbdc203390 0x55cbdc5cc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:37.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.504+0000 7f853deb0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55cbdc541ea0 con 0x55cbdc203390 2024-09-21T01:04:37.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.504+0000 7f853deb0740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55cbdc5312d0 con 0x55cbdc1fb1b0 2024-09-21T01:04:37.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.504+0000 7f853deb0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55cbdc5350e0 con 0x55cbdc224070 2024-09-21T01:04:37.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.504+0000 7f85356d8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cbdc1fb1b0 0x55cbdc5cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:37.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.504+0000 7f8535ed9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cbdc224070 0x55cbdc5cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:37.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.504+0000 7f85356d8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cbdc1fb1b0 0x55cbdc5cbbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:50864/0 (socket says 172.21.15.1:50864) 2024-09-21T01:04:37.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.504+0000 7f8535ed9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cbdc224070 0x55cbdc5cb6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:54944/0 (socket says 172.21.15.1:54944) 2024-09-21T01:04:37.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.504+0000 7f85356d8640 1 -- 172.21.15.1:0/642305997 learned_addr learned my addr 172.21.15.1:0/642305997 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:37.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.504+0000 7f85267fc640 1 -- 172.21.15.1:0/1663192158 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f8520042030 con 0x7f85301094c0 2024-09-21T01:04:37.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.504+0000 7f8534ed7640 1 --2- 172.21.15.1:0/642305997 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cbdc203390 0x55cbdc5cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:37.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.504+0000 7f85356d8640 1 -- 172.21.15.1:0/642305997 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cbdc224070 msgr2=0x55cbdc5cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:37.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.504+0000 7f85356d8640 1 --2- 172.21.15.1:0/642305997 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cbdc224070 0x55cbdc5cb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:37.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.504+0000 7f85356d8640 1 -- 172.21.15.1:0/642305997 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cbdc203390 msgr2=0x55cbdc5cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:37.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.504+0000 7f85356d8640 1 --2- 172.21.15.1:0/642305997 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cbdc203390 0x55cbdc5cc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:37.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.504+0000 7f85356d8640 1 -- 172.21.15.1:0/642305997 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbdc28f650 con 0x55cbdc1fb1b0 2024-09-21T01:04:37.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.504+0000 7f8535ed9640 1 --2- 172.21.15.1:0/642305997 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cbdc224070 0x55cbdc5cb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:37.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.504+0000 7f8534ed7640 1 --2- 172.21.15.1:0/642305997 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cbdc203390 0x55cbdc5cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:04:37.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.505+0000 7f85356d8640 1 --2- 172.21.15.1:0/642305997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cbdc1fb1b0 0x55cbdc5cbbe0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f852c011540 tx=0x7f852c011a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2172d23b6ceea37 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:37.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.505+0000 7f851b7fe640 1 -- 172.21.15.1:0/642305997 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852c00f640 con 0x55cbdc1fb1b0 2024-09-21T01:04:37.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.505+0000 7f851b7fe640 1 -- 172.21.15.1:0/642305997 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f852c00fc90 con 0x55cbdc1fb1b0 2024-09-21T01:04:37.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.505+0000 7f851b7fe640 1 -- 172.21.15.1:0/642305997 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852c019c60 con 0x55cbdc1fb1b0 2024-09-21T01:04:37.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.505+0000 7f85267fc640 1 --2- 172.21.15.1:0/1663192158 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f851c0b6510 0x7f851c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:37.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.505+0000 7f8535ed9640 1 --2- 172.21.15.1:0/1663192158 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f851c0b6510 0x7f851c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:37.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.505+0000 7f85267fc640 1 -- 172.21.15.1:0/1663192158 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f8520107600 con 0x7f85301094c0 2024-09-21T01:04:37.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.506+0000 7f853deb0740 1 -- 172.21.15.1:0/642305997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cbdc1fb1b0 msgr2=0x55cbdc5cbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:37.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.506+0000 7f8535ed9640 1 --2- 172.21.15.1:0/1663192158 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f851c0b6510 0x7f851c0b8a20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8528009fd0 tx=0x7f8528009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:37.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.506+0000 7f853deb0740 1 --2- 172.21.15.1:0/642305997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cbdc1fb1b0 0x55cbdc5cbbe0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f852c011540 tx=0x7f852c011a00 comp rx=0 tx=0).stop 2024-09-21T01:04:37.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.506+0000 7f853deb0740 1 -- 172.21.15.1:0/642305997 shutdown_connections 2024-09-21T01:04:37.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.506+0000 7f853deb0740 1 --2- 172.21.15.1:0/642305997 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cbdc203390 0x55cbdc5cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:37.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.506+0000 7f853deb0740 1 --2- 172.21.15.1:0/642305997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cbdc1fb1b0 0x55cbdc5cbbe0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:37.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.506+0000 7f853deb0740 1 --2- 172.21.15.1:0/642305997 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cbdc224070 0x55cbdc5cb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:37.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.506+0000 7f853deb0740 1 -- 172.21.15.1:0/642305997 >> 172.21.15.1:0/642305997 conn(0x55cbdc218460 msgr2=0x55cbdc5c9590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:37.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.506+0000 7f853deb0740 1 -- 172.21.15.1:0/642305997 shutdown_connections 2024-09-21T01:04:37.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.506+0000 7f853deb0740 1 -- 172.21.15.1:0/642305997 wait complete. 2024-09-21T01:04:37.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.506+0000 7f853deb0740 1 -- start start 2024-09-21T01:04:37.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.506+0000 7f853deb0740 1 Processor -- start 2024-09-21T01:04:37.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.507+0000 7f853deb0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cbdc1fb1b0 0x55cbdc5d6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:37.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.507+0000 7f853deb0740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cbdc203390 0x55cbdc5d7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:37.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.507+0000 7f853deb0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cbdc224070 0x55cbdc5e31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:37.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.507+0000 7f853deb0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55cbdc392700 con 0x55cbdc1fb1b0 2024-09-21T01:04:37.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.507+0000 7f853deb0740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55cbdc4cc160 con 0x55cbdc203390 2024-09-21T01:04:37.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.507+0000 7f853deb0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55cbdc5d9e80 con 0x55cbdc224070 2024-09-21T01:04:37.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.507+0000 7f853deb0740 10 client.0 _ll_register_callbacks cb 0x55cbdc4e59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:37.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.507+0000 7f8534ed7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cbdc203390 0x55cbdc5d7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:37.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.507+0000 7f85356d8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cbdc1fb1b0 0x55cbdc5d6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:37.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.507+0000 7f8534ed7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cbdc203390 0x55cbdc5d7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:50870/0 (socket says 172.21.15.1:50870) 2024-09-21T01:04:37.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.507+0000 7f8534ed7640 1 -- 172.21.15.1:0/2646800520 learned_addr learned my addr 172.21.15.1:0/2646800520 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:37.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.507+0000 7f85356d8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cbdc1fb1b0 0x55cbdc5d6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56844/0 (socket says 172.21.15.1:56844) 2024-09-21T01:04:37.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.507+0000 7f8535ed9640 1 --2- 172.21.15.1:0/2646800520 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cbdc224070 0x55cbdc5e31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:37.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.507+0000 7f8534ed7640 1 -- 172.21.15.1:0/2646800520 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cbdc224070 msgr2=0x55cbdc5e31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:37.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.507+0000 7f8534ed7640 1 --2- 172.21.15.1:0/2646800520 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cbdc224070 0x55cbdc5e31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:37.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.507+0000 7f8534ed7640 1 -- 172.21.15.1:0/2646800520 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cbdc1fb1b0 msgr2=0x55cbdc5d6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:37.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.507+0000 7f8534ed7640 1 --2- 172.21.15.1:0/2646800520 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cbdc1fb1b0 0x55cbdc5d6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:37.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.507+0000 7f8534ed7640 1 -- 172.21.15.1:0/2646800520 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbdc4f9c90 con 0x55cbdc203390 2024-09-21T01:04:37.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.508+0000 7f8534ed7640 1 --2- 172.21.15.1:0/2646800520 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cbdc203390 0x55cbdc5d7280 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8520031440 tx=0x7f8520003f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db5563ee18d55fea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:37.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.508+0000 7f8518ff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:04:37.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.508+0000 7f8518ff9640 1 -- 172.21.15.1:0/2646800520 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8520049070 con 0x55cbdc203390 2024-09-21T01:04:37.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.508+0000 7f8518ff9640 1 -- 172.21.15.1:0/2646800520 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f85200d6f00 con 0x55cbdc203390 2024-09-21T01:04:37.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.508+0000 7f853deb0740 1 -- 172.21.15.1:0/2646800520 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f852c00fc90 con 0x55cbdc203390 2024-09-21T01:04:37.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.508+0000 7f8518ff9640 1 -- 172.21.15.1:0/2646800520 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f85200ccf90 con 0x55cbdc203390 2024-09-21T01:04:37.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.508+0000 7f853deb0740 10 client.26882 fetch_fsmap learned FSMap version 39 2024-09-21T01:04:37.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.508+0000 7f853deb0740 1 -- 172.21.15.1:0/2646800520 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55cbdc5e5b10 con 0x55cbdc203390 2024-09-21T01:04:37.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.508+0000 7f8518ff9640 1 -- 172.21.15.1:0/2646800520 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f852c00fc90 con 0x55cbdc203390 2024-09-21T01:04:37.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.508+0000 7f8518ff9640 1 -- 172.21.15.1:0/2646800520 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 39) ==== 8398+0+0 (secure 0 0 0) 0x7f85200c9170 con 0x55cbdc203390 2024-09-21T01:04:37.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.508+0000 7f853deb0740 10 client.26882 fetch_fsmap finished waiting for FSMap version 39 2024-09-21T01:04:37.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.508+0000 7f853deb0740 10 client.26882 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T01:04:37.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.508+0000 7f853deb0740 20 client.26882 populate_metadata read hostname 'smithi001' 2024-09-21T01:04:37.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.508+0000 7f853deb0740 1 --2- 172.21.15.1:0/2646800520 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x55cbdc1e29f0 0x55cbdc5e8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:37.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.508+0000 7f853deb0740 4 client.26882 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:04:37.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.508+0000 7f853deb0740 1 -- 172.21.15.1:0/2646800520 --> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cbdc543df0 con 0x55cbdc1e29f0 2024-09-21T01:04:37.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.509+0000 7f85356d8640 1 --2- 172.21.15.1:0/2646800520 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x55cbdc1e29f0 0x55cbdc5e8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:37.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.509+0000 7f8518ff9640 10 client.26882 ms_handle_connect on v2:172.21.15.42:6836/2395608508 2024-09-21T01:04:37.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.509+0000 7f85356d8640 1 --2- 172.21.15.1:0/2646800520 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x55cbdc1e29f0 0x55cbdc5e8fc0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a2f9a9dade189d05 server_cookie=8dffe3337d3d6496 in_seq=0 out_seq=0 2024-09-21T01:04:37.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.511+0000 7f8518ff9640 1 -- 172.21.15.1:0/2646800520 <== mds.2 v2:172.21.15.42:6836/2395608508 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cbdc543df0 con 0x55cbdc1e29f0 2024-09-21T01:04:37.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.511+0000 7f8518ff9640 10 client.26882 handle_command_reply: tid=0 2024-09-21T01:04:37.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.511+0000 7f853deb0740 1 client.26882 shutdown 2024-09-21T01:04:37.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.511+0000 7f853deb0740 1 -- 172.21.15.1:0/2646800520 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cbdc203390 msgr2=0x55cbdc5d7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:37.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.511+0000 7f853deb0740 1 --2- 172.21.15.1:0/2646800520 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cbdc203390 0x55cbdc5d7280 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8520031440 tx=0x7f8520003f60 comp rx=0 tx=0).stop 2024-09-21T01:04:37.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.511+0000 7f853deb0740 1 -- 172.21.15.1:0/2646800520 shutdown_connections 2024-09-21T01:04:37.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.511+0000 7f853deb0740 1 --2- 172.21.15.1:0/2646800520 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x55cbdc1e29f0 0x55cbdc5e8fc0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:37.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.511+0000 7f853deb0740 1 --2- 172.21.15.1:0/2646800520 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cbdc224070 0x55cbdc5e31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:37.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.511+0000 7f853deb0740 1 --2- 172.21.15.1:0/2646800520 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cbdc203390 0x55cbdc5d7280 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:37.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.511+0000 7f8518ff9640 0 client.26882 ms_handle_reset on v2:172.21.15.42:6836/2395608508 2024-09-21T01:04:37.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.511+0000 7f853deb0740 1 --2- 172.21.15.1:0/2646800520 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cbdc1fb1b0 0x55cbdc5d6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:37.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.511+0000 7f853deb0740 1 -- 172.21.15.1:0/2646800520 >> 172.21.15.1:0/2646800520 conn(0x55cbdc218460 msgr2=0x55cbdc5ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:37.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.512+0000 7f853deb0740 1 -- 172.21.15.1:0/2646800520 shutdown_connections 2024-09-21T01:04:37.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.512+0000 7f853deb0740 1 -- 172.21.15.1:0/2646800520 wait complete. 2024-09-21T01:04:37.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.512+0000 7f853deb0740 20 client.26882 trim_cache size 0 max 16384 2024-09-21T01:04:37.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.525+0000 7f853deb0740 1 Processor -- start 2024-09-21T01:04:37.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.525+0000 7f853deb0740 1 -- start start 2024-09-21T01:04:37.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.525+0000 7f853deb0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cbdc1e29f0 0x55cbdc5d5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:37.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.525+0000 7f853deb0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cbdc1fb1b0 0x55cbdc5d8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:37.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.525+0000 7f853deb0740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cbdc203390 0x55cbdc5e30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:37.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.525+0000 7f853deb0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f85301af4a0 con 0x55cbdc1e29f0 2024-09-21T01:04:37.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.525+0000 7f853deb0740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f85301b1160 con 0x55cbdc203390 2024-09-21T01:04:37.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.525+0000 7f853deb0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f85301afba0 con 0x55cbdc1fb1b0 2024-09-21T01:04:37.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.525+0000 7f85356d8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cbdc1e29f0 0x55cbdc5d5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:37.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.525+0000 7f85356d8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cbdc1e29f0 0x55cbdc5d5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56852/0 (socket says 172.21.15.1:56852) 2024-09-21T01:04:37.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.525+0000 7f85356d8640 1 -- 172.21.15.1:0/3030838673 learned_addr learned my addr 172.21.15.1:0/3030838673 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:37.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.525+0000 7f8535ed9640 1 --2- 172.21.15.1:0/3030838673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cbdc203390 0x55cbdc5e30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:37.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.525+0000 7f8534ed7640 1 --2- 172.21.15.1:0/3030838673 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cbdc1fb1b0 0x55cbdc5d8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:37.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.526+0000 7f85356d8640 1 -- 172.21.15.1:0/3030838673 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cbdc1fb1b0 msgr2=0x55cbdc5d8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:37.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.526+0000 7f85356d8640 1 --2- 172.21.15.1:0/3030838673 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cbdc1fb1b0 0x55cbdc5d8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:37.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.526+0000 7f85356d8640 1 -- 172.21.15.1:0/3030838673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cbdc203390 msgr2=0x55cbdc5e30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:37.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.526+0000 7f85356d8640 1 --2- 172.21.15.1:0/3030838673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cbdc203390 0x55cbdc5e30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:37.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.526+0000 7f85356d8640 1 -- 172.21.15.1:0/3030838673 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbdc5ce500 con 0x55cbdc1e29f0 2024-09-21T01:04:37.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.526+0000 7f8535ed9640 1 --2- 172.21.15.1:0/3030838673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cbdc203390 0x55cbdc5e30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:37.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.526+0000 7f85356d8640 1 --2- 172.21.15.1:0/3030838673 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cbdc1e29f0 0x55cbdc5d5c30 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f852c000c00 tx=0x7f852c0198a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c41e832fcdf693e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:37.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.526+0000 7f851affd640 1 -- 172.21.15.1:0/3030838673 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852c019910 con 0x55cbdc1e29f0 2024-09-21T01:04:37.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.526+0000 7f851affd640 1 -- 172.21.15.1:0/3030838673 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f852c005040 con 0x55cbdc1e29f0 2024-09-21T01:04:37.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.526+0000 7f851affd640 1 -- 172.21.15.1:0/3030838673 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852c00f8a0 con 0x55cbdc1e29f0 2024-09-21T01:04:37.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.527+0000 7f853deb0740 1 -- 172.21.15.1:0/3030838673 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cbdc1e29f0 msgr2=0x55cbdc5d5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:37.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.527+0000 7f853deb0740 1 --2- 172.21.15.1:0/3030838673 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cbdc1e29f0 0x55cbdc5d5c30 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f852c000c00 tx=0x7f852c0198a0 comp rx=0 tx=0).stop 2024-09-21T01:04:37.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.527+0000 7f853deb0740 1 -- 172.21.15.1:0/3030838673 shutdown_connections 2024-09-21T01:04:37.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.527+0000 7f853deb0740 1 --2- 172.21.15.1:0/3030838673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cbdc203390 0x55cbdc5e30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:37.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.527+0000 7f853deb0740 1 --2- 172.21.15.1:0/3030838673 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cbdc1fb1b0 0x55cbdc5d8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:37.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.527+0000 7f853deb0740 1 --2- 172.21.15.1:0/3030838673 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cbdc1e29f0 0x55cbdc5d5c30 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:37.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.527+0000 7f853deb0740 1 -- 172.21.15.1:0/3030838673 >> 172.21.15.1:0/3030838673 conn(0x55cbdc218460 msgr2=0x55cbdc5d8260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:37.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.527+0000 7f853deb0740 1 -- 172.21.15.1:0/3030838673 shutdown_connections 2024-09-21T01:04:37.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.527+0000 7f853deb0740 1 -- 172.21.15.1:0/3030838673 wait complete. 2024-09-21T01:04:37.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.527+0000 7f853deb0740 1 -- start start 2024-09-21T01:04:37.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.528+0000 7f853deb0740 1 Processor -- start 2024-09-21T01:04:37.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.528+0000 7f853deb0740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cbdc1e29f0 0x55cbdc5db8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:37.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.528+0000 7f853deb0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cbdc1fb1b0 0x55cbdc5dbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:37.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.528+0000 7f853deb0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cbdc203390 0x55cbdc652930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:37.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.528+0000 7f853deb0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f85301b09d0 con 0x55cbdc1fb1b0 2024-09-21T01:04:37.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.528+0000 7f853deb0740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f85301b02d0 con 0x55cbdc1e29f0 2024-09-21T01:04:37.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.528+0000 7f853deb0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f85301ad480 con 0x55cbdc203390 2024-09-21T01:04:37.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.528+0000 7f853deb0740 10 client.0 _ll_register_callbacks cb 0x7f8520005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:37.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.528+0000 7f8534ed7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cbdc1fb1b0 0x55cbdc5dbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:37.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.528+0000 7f85356d8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cbdc1e29f0 0x55cbdc5db8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:37.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.528+0000 7f85356d8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cbdc1e29f0 0x55cbdc5db8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:50880/0 (socket says 172.21.15.1:50880) 2024-09-21T01:04:37.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.528+0000 7f85356d8640 1 -- 172.21.15.1:0/1501632508 learned_addr learned my addr 172.21.15.1:0/1501632508 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:37.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.528+0000 7f8535ed9640 1 --2- 172.21.15.1:0/1501632508 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cbdc203390 0x55cbdc652930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:37.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.529+0000 7f85356d8640 1 -- 172.21.15.1:0/1501632508 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cbdc203390 msgr2=0x55cbdc652930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:37.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.529+0000 7f85356d8640 1 --2- 172.21.15.1:0/1501632508 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cbdc203390 0x55cbdc652930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:37.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.529+0000 7f85356d8640 1 -- 172.21.15.1:0/1501632508 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cbdc1fb1b0 msgr2=0x55cbdc5dbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:37.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.529+0000 7f85356d8640 1 --2- 172.21.15.1:0/1501632508 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cbdc1fb1b0 0x55cbdc5dbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:37.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.529+0000 7f85356d8640 1 -- 172.21.15.1:0/1501632508 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbdc652f20 con 0x55cbdc1e29f0 2024-09-21T01:04:37.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.529+0000 7f85356d8640 1 --2- 172.21.15.1:0/1501632508 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cbdc1e29f0 0x55cbdc5db8c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f852c011a40 tx=0x7f852c005db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afbd63573696fd9a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:37.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.529+0000 7f8518ff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:04:37.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.529+0000 7f8518ff9640 1 -- 172.21.15.1:0/1501632508 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852c0051f0 con 0x55cbdc1e29f0 2024-09-21T01:04:37.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.529+0000 7f853deb0740 1 -- 172.21.15.1:0/1501632508 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f852c005040 con 0x55cbdc1e29f0 2024-09-21T01:04:37.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.529+0000 7f8518ff9640 1 -- 172.21.15.1:0/1501632508 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f852c005390 con 0x55cbdc1e29f0 2024-09-21T01:04:37.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.529+0000 7f8518ff9640 1 -- 172.21.15.1:0/1501632508 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f852c0055b0 con 0x55cbdc1e29f0 2024-09-21T01:04:37.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.529+0000 7f853deb0740 10 client.26888 fetch_fsmap learned FSMap version 39 2024-09-21T01:04:37.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.529+0000 7f853deb0740 1 -- 172.21.15.1:0/1501632508 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55cbdc6541a0 con 0x55cbdc1e29f0 2024-09-21T01:04:37.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.530+0000 7f8518ff9640 1 -- 172.21.15.1:0/1501632508 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f852c005040 con 0x55cbdc1e29f0 2024-09-21T01:04:37.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.530+0000 7f8518ff9640 1 -- 172.21.15.1:0/1501632508 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 39) ==== 8398+0+0 (secure 0 0 0) 0x7f852c02b020 con 0x55cbdc1e29f0 2024-09-21T01:04:37.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.530+0000 7f853deb0740 10 client.26888 fetch_fsmap finished waiting for FSMap version 39 2024-09-21T01:04:37.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.530+0000 7f853deb0740 10 client.26888 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T01:04:37.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.530+0000 7f853deb0740 20 client.26888 populate_metadata read hostname 'smithi001' 2024-09-21T01:04:37.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.530+0000 7f853deb0740 1 --2- 172.21.15.1:0/1501632508 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x55cbdc224070 0x55cbdc656720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:37.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.530+0000 7f853deb0740 4 client.26888 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:04:37.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.530+0000 7f853deb0740 1 -- 172.21.15.1:0/1501632508 --> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cbdc53f8a0 con 0x55cbdc224070 2024-09-21T01:04:37.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.530+0000 7f8534ed7640 1 --2- 172.21.15.1:0/1501632508 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x55cbdc224070 0x55cbdc656720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:37.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.531+0000 7f8518ff9640 10 client.26888 ms_handle_connect on v2:172.21.15.42:6836/2395608508 2024-09-21T01:04:37.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.530+0000 7f8534ed7640 1 --2- 172.21.15.1:0/1501632508 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x55cbdc224070 0x55cbdc656720 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b94dd35463a61f31 server_cookie=822d3b9c4696602a in_seq=0 out_seq=0 2024-09-21T01:04:37.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.531+0000 7f8518ff9640 1 -- 172.21.15.1:0/1501632508 <== mds.2 v2:172.21.15.42:6836/2395608508 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cbdc53f8a0 con 0x55cbdc224070 2024-09-21T01:04:37.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.531+0000 7f8518ff9640 10 client.26888 handle_command_reply: tid=0 2024-09-21T01:04:37.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.531+0000 7f853deb0740 1 client.26888 shutdown 2024-09-21T01:04:37.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.531+0000 7f853deb0740 1 -- 172.21.15.1:0/1501632508 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cbdc1e29f0 msgr2=0x55cbdc5db8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:37.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.531+0000 7f853deb0740 1 --2- 172.21.15.1:0/1501632508 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cbdc1e29f0 0x55cbdc5db8c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f852c011a40 tx=0x7f852c005db0 comp rx=0 tx=0).stop 2024-09-21T01:04:37.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.531+0000 7f853deb0740 1 -- 172.21.15.1:0/1501632508 shutdown_connections 2024-09-21T01:04:37.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.531+0000 7f853deb0740 1 --2- 172.21.15.1:0/1501632508 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x55cbdc224070 0x55cbdc656720 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:37.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.531+0000 7f853deb0740 1 --2- 172.21.15.1:0/1501632508 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cbdc203390 0x55cbdc652930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:37.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.531+0000 7f853deb0740 1 --2- 172.21.15.1:0/1501632508 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cbdc1fb1b0 0x55cbdc5dbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:37.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.531+0000 7f853deb0740 1 --2- 172.21.15.1:0/1501632508 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cbdc1e29f0 0x55cbdc5db8c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:37.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.531+0000 7f8518ff9640 0 client.26888 ms_handle_reset on v2:172.21.15.42:6836/2395608508 2024-09-21T01:04:37.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.531+0000 7f853deb0740 1 -- 172.21.15.1:0/1501632508 >> 172.21.15.1:0/1501632508 conn(0x55cbdc218460 msgr2=0x55cbdc5d81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:37.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.531+0000 7f853deb0740 1 -- 172.21.15.1:0/1501632508 shutdown_connections 2024-09-21T01:04:37.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.531+0000 7f853deb0740 1 -- 172.21.15.1:0/1501632508 wait complete. 2024-09-21T01:04:37.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.531+0000 7f853deb0740 20 client.26888 trim_cache size 0 max 16384 2024-09-21T01:04:37.545 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T01:04:37.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.532+0000 7f853793c640 1 -- 172.21.15.1:0/1663192158 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f851c0b6510 msgr2=0x7f851c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:37.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.532+0000 7f853793c640 1 --2- 172.21.15.1:0/1663192158 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f851c0b6510 0x7f851c0b8a20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8528009fd0 tx=0x7f8528009500 comp rx=0 tx=0).stop 2024-09-21T01:04:37.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.532+0000 7f853793c640 1 -- 172.21.15.1:0/1663192158 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85301094c0 msgr2=0x7f853019aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:37.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.532+0000 7f853793c640 1 --2- 172.21.15.1:0/1663192158 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85301094c0 0x7f853019aa60 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f852002a930 tx=0x7f8520031a20 comp rx=0 tx=0).stop 2024-09-21T01:04:37.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.532+0000 7f853793c640 1 -- 172.21.15.1:0/1663192158 shutdown_connections 2024-09-21T01:04:37.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.532+0000 7f853793c640 1 --2- 172.21.15.1:0/1663192158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8530109e10 0x7f853019fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:37.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.532+0000 7f853793c640 1 --2- 172.21.15.1:0/1663192158 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f851c0b6510 0x7f851c0b8a20 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:37.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.532+0000 7f853793c640 1 --2- 172.21.15.1:0/1663192158 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85301094c0 0x7f853019aa60 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:37.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.532+0000 7f853793c640 1 --2- 172.21.15.1:0/1663192158 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8530103b80 0x7f853019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:37.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.532+0000 7f853793c640 1 -- 172.21.15.1:0/1663192158 >> 172.21.15.1:0/1663192158 conn(0x7f85300ff610 msgr2=0x7f8530101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:37.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.532+0000 7f853793c640 1 -- 172.21.15.1:0/1663192158 shutdown_connections 2024-09-21T01:04:37.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:37.532+0000 7f853793c640 1 -- 172.21.15.1:0/1663192158 wait complete. 2024-09-21T01:04:37.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:37 smithi001 ceph-mon[31211]: pgmap v580: 97 pgs: 97 active+clean; 531 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 569 op/s 2024-09-21T01:04:37.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:37 smithi193 ceph-mon[34660]: pgmap v580: 97 pgs: 97 active+clean; 531 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 569 op/s 2024-09-21T01:04:37.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:37 smithi042 ceph-mon[34481]: pgmap v580: 97 pgs: 97 active+clean; 531 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 569 op/s 2024-09-21T01:04:38.527 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T01:04:38.789 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:04:39.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.325+0000 7f45025e5640 1 -- 172.21.15.1:0/3235653470 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44fc102fa0 msgr2=0x7f44fc10fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:39.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.325+0000 7f45025e5640 1 --2- 172.21.15.1:0/3235653470 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44fc102fa0 0x7f44fc10fcc0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f44f0009900 tx=0x7f44f002a480 comp rx=0 tx=0).stop 2024-09-21T01:04:39.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.325+0000 7f45025e5640 1 -- 172.21.15.1:0/3235653470 shutdown_connections 2024-09-21T01:04:39.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.325+0000 7f45025e5640 1 --2- 172.21.15.1:0/3235653470 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f44fc110200 0x7f44fc112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:39.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.325+0000 7f45025e5640 1 --2- 172.21.15.1:0/3235653470 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44fc102fa0 0x7f44fc10fcc0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:39.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.325+0000 7f45025e5640 1 --2- 172.21.15.1:0/3235653470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44fc102650 0x7f44fc102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:39.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.325+0000 7f45025e5640 1 -- 172.21.15.1:0/3235653470 >> 172.21.15.1:0/3235653470 conn(0x7f44fc079760 msgr2=0x7f44fc079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:39.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.325+0000 7f45025e5640 1 -- 172.21.15.1:0/3235653470 shutdown_connections 2024-09-21T01:04:39.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.325+0000 7f45025e5640 1 -- 172.21.15.1:0/3235653470 wait complete. 2024-09-21T01:04:39.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.325+0000 7f45025e5640 1 Processor -- start 2024-09-21T01:04:39.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.326+0000 7f45025e5640 1 -- start start 2024-09-21T01:04:39.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.326+0000 7f45025e5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44fc102650 0x7f44fc19c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:39.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.326+0000 7f45025e5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f44fc102fa0 0x7f44fc19cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:39.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.326+0000 7f45025e5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44fc110200 0x7f44fc1a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:39.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.326+0000 7f45025e5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc115ca0 con 0x7f44fc110200 2024-09-21T01:04:39.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.326+0000 7f45025e5640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc115b20 con 0x7f44fc102650 2024-09-21T01:04:39.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.326+0000 7f45025e5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc115e20 con 0x7f44fc102fa0 2024-09-21T01:04:39.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.326+0000 7f44fbfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44fc102650 0x7f44fc19c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:39.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.326+0000 7f44fbfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44fc102650 0x7f44fc19c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:50332/0 (socket says 172.21.15.1:50332) 2024-09-21T01:04:39.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.326+0000 7f44fbfff640 1 -- 172.21.15.1:0/1515325668 learned_addr learned my addr 172.21.15.1:0/1515325668 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:39.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.326+0000 7f44fb7fe640 1 --2- 172.21.15.1:0/1515325668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f44fc102fa0 0x7f44fc19cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:39.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.326+0000 7f4500b82640 1 --2- 172.21.15.1:0/1515325668 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44fc110200 0x7f44fc1a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:39.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.327+0000 7f44fbfff640 1 -- 172.21.15.1:0/1515325668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f44fc102fa0 msgr2=0x7f44fc19cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:39.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.327+0000 7f44fbfff640 1 --2- 172.21.15.1:0/1515325668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f44fc102fa0 0x7f44fc19cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:39.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.327+0000 7f44fbfff640 1 -- 172.21.15.1:0/1515325668 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44fc110200 msgr2=0x7f44fc1a1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:39.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.327+0000 7f44fbfff640 1 --2- 172.21.15.1:0/1515325668 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44fc110200 0x7f44fc1a1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:39.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.327+0000 7f44fbfff640 1 -- 172.21.15.1:0/1515325668 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44fc1a25a0 con 0x7f44fc102650 2024-09-21T01:04:39.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.327+0000 7f44fbfff640 1 --2- 172.21.15.1:0/1515325668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44fc102650 0x7f44fc19c630 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f44ec00e9f0 tx=0x7f44ec00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:39.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.327+0000 7f44f97fa640 1 -- 172.21.15.1:0/1515325668 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ec00cd80 con 0x7f44fc102650 2024-09-21T01:04:39.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.327+0000 7f44f97fa640 1 -- 172.21.15.1:0/1515325668 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44ec0108e0 con 0x7f44fc102650 2024-09-21T01:04:39.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.327+0000 7f45025e5640 1 -- 172.21.15.1:0/1515325668 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44fc1a2890 con 0x7f44fc102650 2024-09-21T01:04:39.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.327+0000 7f44f97fa640 1 -- 172.21.15.1:0/1515325668 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ec018980 con 0x7f44fc102650 2024-09-21T01:04:39.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.327+0000 7f45025e5640 1 -- 172.21.15.1:0/1515325668 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44fc1a8ff0 con 0x7f44fc102650 2024-09-21T01:04:39.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.330+0000 7f4508b59740 1 Processor -- start 2024-09-21T01:04:39.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.330+0000 7f4508b59740 1 -- start start 2024-09-21T01:04:39.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.330+0000 7f4508b59740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55871f9c7070 0x55871fd6e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:39.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.330+0000 7f4508b59740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f99e1b0 0x55871fd6e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:39.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.330+0000 7f4508b59740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55871f9a6390 0x55871fd6ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:39.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.330+0000 7f4508b59740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55871fce4ea0 con 0x55871f9a6390 2024-09-21T01:04:39.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.330+0000 7f4508b59740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55871fcd42d0 con 0x55871f99e1b0 2024-09-21T01:04:39.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.330+0000 7f4508b59740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55871fcd80e0 con 0x55871f9c7070 2024-09-21T01:04:39.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.330+0000 7f44fb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55871f9a6390 0x55871fd6ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:39.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.330+0000 7f44fb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55871f9a6390 0x55871fd6ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47108/0 (socket says 172.21.15.1:47108) 2024-09-21T01:04:39.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.330+0000 7f44fb7fe640 1 -- 172.21.15.1:0/4258854669 learned_addr learned my addr 172.21.15.1:0/4258854669 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:39.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.330+0000 7f44f97fa640 1 -- 172.21.15.1:0/1515325668 <== mon.2 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f44ec010430 con 0x7f44fc102650 2024-09-21T01:04:39.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.330+0000 7f4500b82640 1 --2- 172.21.15.1:0/4258854669 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55871f9c7070 0x55871fd6e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:39.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.331+0000 7f44fbfff640 1 --2- 172.21.15.1:0/4258854669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f99e1b0 0x55871fd6e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:39.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.331+0000 7f44fb7fe640 1 -- 172.21.15.1:0/4258854669 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55871f9c7070 msgr2=0x55871fd6e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:39.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.331+0000 7f44fb7fe640 1 --2- 172.21.15.1:0/4258854669 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55871f9c7070 0x55871fd6e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:39.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.331+0000 7f44fb7fe640 1 -- 172.21.15.1:0/4258854669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f99e1b0 msgr2=0x55871fd6e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:39.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.331+0000 7f44fb7fe640 1 --2- 172.21.15.1:0/4258854669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f99e1b0 0x55871fd6e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:39.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.331+0000 7f44fb7fe640 1 -- 172.21.15.1:0/4258854669 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55871fa32650 con 0x55871f9a6390 2024-09-21T01:04:39.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.331+0000 7f44fbfff640 1 --2- 172.21.15.1:0/4258854669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f99e1b0 0x55871fd6e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:04:39.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.331+0000 7f44fb7fe640 1 --2- 172.21.15.1:0/4258854669 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55871f9a6390 0x55871fd6ed40 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f44f0009900 tx=0x7f44f0032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0efbaed31f7085f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:39.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.331+0000 7f44e27fc640 1 -- 172.21.15.1:0/4258854669 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f0040070 con 0x55871f9a6390 2024-09-21T01:04:39.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.332+0000 7f44f97fa640 1 --2- 172.21.15.1:0/1515325668 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f44e40b6510 0x7f44e40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:39.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.332+0000 7f44e27fc640 1 -- 172.21.15.1:0/4258854669 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44f0004030 con 0x55871f9a6390 2024-09-21T01:04:39.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.332+0000 7f44e27fc640 1 -- 172.21.15.1:0/4258854669 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f0040070 con 0x55871f9a6390 2024-09-21T01:04:39.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.332+0000 7f44f97fa640 1 -- 172.21.15.1:0/1515325668 <== mon.2 v2:172.21.15.42:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f44ec0e7650 con 0x7f44fc102650 2024-09-21T01:04:39.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.333+0000 7f4500b82640 1 --2- 172.21.15.1:0/1515325668 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f44e40b6510 0x7f44e40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:39.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.333+0000 7f4508b59740 1 -- 172.21.15.1:0/4258854669 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55871f9a6390 msgr2=0x55871fd6ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:39.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.333+0000 7f4508b59740 1 --2- 172.21.15.1:0/4258854669 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55871f9a6390 0x55871fd6ed40 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f44f0009900 tx=0x7f44f0032c40 comp rx=0 tx=0).stop 2024-09-21T01:04:39.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.333+0000 7f4508b59740 1 -- 172.21.15.1:0/4258854669 shutdown_connections 2024-09-21T01:04:39.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.333+0000 7f4508b59740 1 --2- 172.21.15.1:0/4258854669 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55871f9a6390 0x55871fd6ed40 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:39.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.333+0000 7f4508b59740 1 --2- 172.21.15.1:0/4258854669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f99e1b0 0x55871fd6e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:39.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.333+0000 7f4508b59740 1 --2- 172.21.15.1:0/4258854669 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55871f9c7070 0x55871fd6e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:39.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.333+0000 7f4508b59740 1 -- 172.21.15.1:0/4258854669 >> 172.21.15.1:0/4258854669 conn(0x55871f9bb460 msgr2=0x55871fd6c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:39.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.333+0000 7f4508b59740 1 -- 172.21.15.1:0/4258854669 shutdown_connections 2024-09-21T01:04:39.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.333+0000 7f4508b59740 1 -- 172.21.15.1:0/4258854669 wait complete. 2024-09-21T01:04:39.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.334+0000 7f4508b59740 1 -- start start 2024-09-21T01:04:39.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.334+0000 7f4500b82640 1 --2- 172.21.15.1:0/1515325668 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f44e40b6510 0x7f44e40b8a20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f44f4005fd0 tx=0x7f44f4009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:39.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.334+0000 7f4508b59740 1 Processor -- start 2024-09-21T01:04:39.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.335+0000 7f4508b59740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f99e1b0 0x55871fd79980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:39.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.335+0000 7f4508b59740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55871f9a6390 0x55871fd79ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:39.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.335+0000 7f4508b59740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55871f9c7070 0x55871fd8e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:39.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.335+0000 7f4508b59740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55871fb35700 con 0x55871f9a6390 2024-09-21T01:04:39.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.335+0000 7f4508b59740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55871fc6f160 con 0x55871f99e1b0 2024-09-21T01:04:39.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.335+0000 7f4508b59740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55871fd7ca40 con 0x55871f9c7070 2024-09-21T01:04:39.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.335+0000 7f4508b59740 10 client.0 _ll_register_callbacks cb 0x55871fc889e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:39.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.335+0000 7f44fbfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f99e1b0 0x55871fd79980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:39.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.336+0000 7f4500b82640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55871f9c7070 0x55871fd8e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:39.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.336+0000 7f4500b82640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55871f9c7070 0x55871fd8e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:42682/0 (socket says 172.21.15.1:42682) 2024-09-21T01:04:39.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.336+0000 7f4500b82640 1 -- 172.21.15.1:0/2185036178 learned_addr learned my addr 172.21.15.1:0/2185036178 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:39.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.336+0000 7f44fb7fe640 1 --2- 172.21.15.1:0/2185036178 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55871f9a6390 0x55871fd79ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:39.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.336+0000 7f44fbfff640 1 -- 172.21.15.1:0/2185036178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55871f9c7070 msgr2=0x55871fd8e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:39.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.336+0000 7f44fbfff640 1 --2- 172.21.15.1:0/2185036178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55871f9c7070 0x55871fd8e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:39.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.336+0000 7f44fbfff640 1 -- 172.21.15.1:0/2185036178 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55871f9a6390 msgr2=0x55871fd79ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:39.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.336+0000 7f44fbfff640 1 --2- 172.21.15.1:0/2185036178 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55871f9a6390 0x55871fd79ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:39.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.336+0000 7f44fbfff640 1 -- 172.21.15.1:0/2185036178 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55871fc9cc90 con 0x55871f99e1b0 2024-09-21T01:04:39.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.337+0000 7f44fbfff640 1 --2- 172.21.15.1:0/2185036178 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f99e1b0 0x55871fd79980 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f44ec0e5180 tx=0x7f44ec0ad1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8552113d88b960d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:39.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.337+0000 7f44db7fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:04:39.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.338+0000 7f44db7fe640 1 -- 172.21.15.1:0/2185036178 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ec018d20 con 0x55871f99e1b0 2024-09-21T01:04:39.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.338+0000 7f44db7fe640 1 -- 172.21.15.1:0/2185036178 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f44ec0a91c0 con 0x55871f99e1b0 2024-09-21T01:04:39.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.340+0000 7f4508b59740 1 -- 172.21.15.1:0/2185036178 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44f0004030 con 0x55871f99e1b0 2024-09-21T01:04:39.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.343+0000 7f44db7fe640 1 -- 172.21.15.1:0/2185036178 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f44ec010720 con 0x55871f99e1b0 2024-09-21T01:04:39.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.343+0000 7f4508b59740 10 client.26900 fetch_fsmap learned FSMap version 39 2024-09-21T01:04:39.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.343+0000 7f4508b59740 1 -- 172.21.15.1:0/2185036178 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55871fd90fe0 con 0x55871f99e1b0 2024-09-21T01:04:39.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.345+0000 7f44db7fe640 1 -- 172.21.15.1:0/2185036178 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44f0004030 con 0x55871f99e1b0 2024-09-21T01:04:39.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.345+0000 7f44db7fe640 1 -- 172.21.15.1:0/2185036178 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 39) ==== 8398+0+0 (secure 0 0 0) 0x7f44ec0ac540 con 0x55871f99e1b0 2024-09-21T01:04:39.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.345+0000 7f4508b59740 10 client.26900 fetch_fsmap finished waiting for FSMap version 39 2024-09-21T01:04:39.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.345+0000 7f4508b59740 10 client.26900 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T01:04:39.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.345+0000 7f4508b59740 20 client.26900 populate_metadata read hostname 'smithi001' 2024-09-21T01:04:39.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.345+0000 7f4508b59740 1 --2- 172.21.15.1:0/2185036178 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x55871f9859f0 0x55871fd94630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:39.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.345+0000 7f4508b59740 4 client.26900 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:04:39.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.345+0000 7f4508b59740 1 -- 172.21.15.1:0/2185036178 --> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55871fce6df0 con 0x55871f9859f0 2024-09-21T01:04:39.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.351+0000 7f44fb7fe640 1 --2- 172.21.15.1:0/2185036178 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x55871f9859f0 0x55871fd94630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:39.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.352+0000 7f44fb7fe640 1 --2- 172.21.15.1:0/2185036178 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x55871f9859f0 0x55871fd94630 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=396c0b0c62e35550 server_cookie=cef8914d063adfe in_seq=0 out_seq=0 2024-09-21T01:04:39.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.352+0000 7f44db7fe640 10 client.26900 ms_handle_connect on v2:172.21.15.193:6838/1365361177 2024-09-21T01:04:39.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.353+0000 7f44db7fe640 1 -- 172.21.15.1:0/2185036178 <== mds.1 v2:172.21.15.193:6838/1365361177 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55871fce6df0 con 0x55871f9859f0 2024-09-21T01:04:39.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.353+0000 7f44db7fe640 10 client.26900 handle_command_reply: tid=0 2024-09-21T01:04:39.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.353+0000 7f4508b59740 1 client.26900 shutdown 2024-09-21T01:04:39.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.354+0000 7f4508b59740 1 -- 172.21.15.1:0/2185036178 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f99e1b0 msgr2=0x55871fd79980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:39.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.354+0000 7f4508b59740 1 --2- 172.21.15.1:0/2185036178 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f99e1b0 0x55871fd79980 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f44ec0e5180 tx=0x7f44ec0ad1c0 comp rx=0 tx=0).stop 2024-09-21T01:04:39.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.356+0000 7f4508b59740 1 -- 172.21.15.1:0/2185036178 shutdown_connections 2024-09-21T01:04:39.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.356+0000 7f4508b59740 1 --2- 172.21.15.1:0/2185036178 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x55871f9859f0 0x55871fd94630 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:39.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.356+0000 7f4508b59740 1 --2- 172.21.15.1:0/2185036178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55871f9c7070 0x55871fd8e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:39.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.356+0000 7f4508b59740 1 --2- 172.21.15.1:0/2185036178 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55871f9a6390 0x55871fd79ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:39.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.356+0000 7f4508b59740 1 --2- 172.21.15.1:0/2185036178 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f99e1b0 0x55871fd79980 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:39.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.356+0000 7f4508b59740 1 -- 172.21.15.1:0/2185036178 >> 172.21.15.1:0/2185036178 conn(0x55871f9bb460 msgr2=0x55871fd71450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:39.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.356+0000 7f44db7fe640 0 client.26900 ms_handle_reset on v2:172.21.15.193:6838/1365361177 2024-09-21T01:04:39.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.356+0000 7f4508b59740 1 -- 172.21.15.1:0/2185036178 shutdown_connections 2024-09-21T01:04:39.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.356+0000 7f4508b59740 1 -- 172.21.15.1:0/2185036178 wait complete. 2024-09-21T01:04:39.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.357+0000 7f4508b59740 20 client.26900 trim_cache size 0 max 16384 2024-09-21T01:04:39.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.373+0000 7f4508b59740 1 Processor -- start 2024-09-21T01:04:39.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.373+0000 7f4508b59740 1 -- start start 2024-09-21T01:04:39.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.373+0000 7f4508b59740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55871f99e1b0 0x55871fd6fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:39.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.373+0000 7f4508b59740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55871f9a6390 0x55871fd7b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:39.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.373+0000 7f4508b59740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f9c7070 0x55871fd6b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:39.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.373+0000 7f4508b59740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc1ad200 con 0x55871f99e1b0 2024-09-21T01:04:39.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.373+0000 7f4508b59740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc1aeec0 con 0x55871f9c7070 2024-09-21T01:04:39.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.373+0000 7f4508b59740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc1ad900 con 0x55871f9a6390 2024-09-21T01:04:39.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.373+0000 7f44fbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55871f99e1b0 0x55871fd6fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:39.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.373+0000 7f4500b82640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f9c7070 0x55871fd6b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:39.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.373+0000 7f4500b82640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f9c7070 0x55871fd6b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:50368/0 (socket says 172.21.15.1:50368) 2024-09-21T01:04:39.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.373+0000 7f44fbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55871f99e1b0 0x55871fd6fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47128/0 (socket says 172.21.15.1:47128) 2024-09-21T01:04:39.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.373+0000 7f4500b82640 1 -- 172.21.15.1:0/3713945739 learned_addr learned my addr 172.21.15.1:0/3713945739 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:39.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.373+0000 7f44fb7fe640 1 --2- 172.21.15.1:0/3713945739 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55871f9a6390 0x55871fd7b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:39.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.374+0000 7f4500b82640 1 -- 172.21.15.1:0/3713945739 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55871f9a6390 msgr2=0x55871fd7b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:39.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.374+0000 7f4500b82640 1 --2- 172.21.15.1:0/3713945739 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55871f9a6390 0x55871fd7b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:39.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.374+0000 7f4500b82640 1 -- 172.21.15.1:0/3713945739 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55871f99e1b0 msgr2=0x55871fd6fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:39.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.374+0000 7f4500b82640 1 --2- 172.21.15.1:0/3713945739 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55871f99e1b0 0x55871fd6fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:39.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.374+0000 7f4500b82640 1 -- 172.21.15.1:0/3713945739 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55871fd7ac40 con 0x55871f9c7070 2024-09-21T01:04:39.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.374+0000 7f4500b82640 1 --2- 172.21.15.1:0/3713945739 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f9c7070 0x55871fd6b760 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f44f4003d20 tx=0x7f44f4015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b656f6c7356e3465 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:39.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.374+0000 7f44e1ffb640 1 -- 172.21.15.1:0/3713945739 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f4004b20 con 0x55871f9c7070 2024-09-21T01:04:39.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.374+0000 7f44e1ffb640 1 -- 172.21.15.1:0/3713945739 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44f4004cc0 con 0x55871f9c7070 2024-09-21T01:04:39.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.374+0000 7f44e1ffb640 1 -- 172.21.15.1:0/3713945739 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f4005910 con 0x55871f9c7070 2024-09-21T01:04:39.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.375+0000 7f4508b59740 1 -- 172.21.15.1:0/3713945739 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f9c7070 msgr2=0x55871fd6b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:39.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.375+0000 7f4508b59740 1 --2- 172.21.15.1:0/3713945739 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f9c7070 0x55871fd6b760 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f44f4003d20 tx=0x7f44f4015000 comp rx=0 tx=0).stop 2024-09-21T01:04:39.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.375+0000 7f4508b59740 1 -- 172.21.15.1:0/3713945739 shutdown_connections 2024-09-21T01:04:39.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.375+0000 7f4508b59740 1 --2- 172.21.15.1:0/3713945739 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f9c7070 0x55871fd6b760 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:39.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.375+0000 7f4508b59740 1 --2- 172.21.15.1:0/3713945739 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55871f9a6390 0x55871fd7b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:39.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.375+0000 7f4508b59740 1 --2- 172.21.15.1:0/3713945739 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55871f99e1b0 0x55871fd6fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:39.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.375+0000 7f4508b59740 1 -- 172.21.15.1:0/3713945739 >> 172.21.15.1:0/3713945739 conn(0x55871f9bb460 msgr2=0x55871fd7aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:39.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.375+0000 7f4508b59740 1 -- 172.21.15.1:0/3713945739 shutdown_connections 2024-09-21T01:04:39.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.375+0000 7f4508b59740 1 -- 172.21.15.1:0/3713945739 wait complete. 2024-09-21T01:04:39.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.375+0000 7f4508b59740 1 -- start start 2024-09-21T01:04:39.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.376+0000 7f4508b59740 1 Processor -- start 2024-09-21T01:04:39.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.376+0000 7f4508b59740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55871f99e1b0 0x55871fd8aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:39.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.376+0000 7f4508b59740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55871f9a6390 0x55871fd85f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:39.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.376+0000 7f4508b59740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f9c7070 0x55871fd864c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:39.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.376+0000 7f4508b59740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc1ae730 con 0x55871f9a6390 2024-09-21T01:04:39.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.376+0000 7f4508b59740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc1ae030 con 0x55871f9c7070 2024-09-21T01:04:39.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.376+0000 7f4508b59740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc1ab260 con 0x55871f99e1b0 2024-09-21T01:04:39.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.376+0000 7f4508b59740 10 client.0 _ll_register_callbacks cb 0x7f44ec009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:39.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.376+0000 7f44fb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55871f9a6390 0x55871fd85f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:39.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.376+0000 7f4500b82640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f9c7070 0x55871fd864c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:39.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.376+0000 7f44fb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55871f9a6390 0x55871fd85f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47142/0 (socket says 172.21.15.1:47142) 2024-09-21T01:04:39.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.376+0000 7f44fb7fe640 1 -- 172.21.15.1:0/1295724524 learned_addr learned my addr 172.21.15.1:0/1295724524 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:39.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.376+0000 7f44fbfff640 1 --2- 172.21.15.1:0/1295724524 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55871f99e1b0 0x55871fd8aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:39.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.377+0000 7f44fb7fe640 1 -- 172.21.15.1:0/1295724524 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55871f99e1b0 msgr2=0x55871fd8aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:39.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.377+0000 7f44fb7fe640 1 --2- 172.21.15.1:0/1295724524 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55871f99e1b0 0x55871fd8aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:39.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.377+0000 7f44fb7fe640 1 -- 172.21.15.1:0/1295724524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f9c7070 msgr2=0x55871fd864c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:39.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.377+0000 7f44fb7fe640 1 --2- 172.21.15.1:0/1295724524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f9c7070 0x55871fd864c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:39.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.377+0000 7f44fb7fe640 1 -- 172.21.15.1:0/1295724524 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55871fd86a00 con 0x55871f9a6390 2024-09-21T01:04:39.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.377+0000 7f4500b82640 1 --2- 172.21.15.1:0/1295724524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f9c7070 0x55871fd864c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:39.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.377+0000 7f44fb7fe640 1 --2- 172.21.15.1:0/1295724524 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55871f9a6390 0x55871fd85f80 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f44f0009900 tx=0x7f44f00051c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d651344b81440c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:39.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.377+0000 7f44db7fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:04:39.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.377+0000 7f44db7fe640 1 -- 172.21.15.1:0/1295724524 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f0040070 con 0x55871f9a6390 2024-09-21T01:04:39.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.377+0000 7f44db7fe640 1 -- 172.21.15.1:0/1295724524 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f44f0031b10 con 0x55871f9a6390 2024-09-21T01:04:39.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.377+0000 7f4508b59740 1 -- 172.21.15.1:0/1295724524 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44f4004cc0 con 0x55871f9a6390 2024-09-21T01:04:39.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.377+0000 7f44db7fe640 1 -- 172.21.15.1:0/1295724524 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f44f0035040 con 0x55871f9a6390 2024-09-21T01:04:39.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.377+0000 7f4508b59740 10 client.17247 fetch_fsmap learned FSMap version 39 2024-09-21T01:04:39.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.377+0000 7f4508b59740 1 -- 172.21.15.1:0/1295724524 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55871fdfece0 con 0x55871f9a6390 2024-09-21T01:04:39.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.378+0000 7f44db7fe640 1 -- 172.21.15.1:0/1295724524 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44f4004cc0 con 0x55871f9a6390 2024-09-21T01:04:39.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.378+0000 7f44db7fe640 1 -- 172.21.15.1:0/1295724524 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 39) ==== 8398+0+0 (secure 0 0 0) 0x7f44f0004270 con 0x55871f9a6390 2024-09-21T01:04:39.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.378+0000 7f4508b59740 10 client.17247 fetch_fsmap finished waiting for FSMap version 39 2024-09-21T01:04:39.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.378+0000 7f4508b59740 10 client.17247 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T01:04:39.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.378+0000 7f4508b59740 20 client.17247 populate_metadata read hostname 'smithi001' 2024-09-21T01:04:39.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.378+0000 7f4508b59740 1 --2- 172.21.15.1:0/1295724524 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x55871f95ada0 0x55871fe010b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:39.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.378+0000 7f4508b59740 4 client.17247 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:04:39.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.378+0000 7f4508b59740 1 -- 172.21.15.1:0/1295724524 --> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55871fce28a0 con 0x55871f95ada0 2024-09-21T01:04:39.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.378+0000 7f44fbfff640 1 --2- 172.21.15.1:0/1295724524 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x55871f95ada0 0x55871fe010b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:39.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.378+0000 7f44db7fe640 10 client.17247 ms_handle_connect on v2:172.21.15.193:6838/1365361177 2024-09-21T01:04:39.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.379+0000 7f44fbfff640 1 --2- 172.21.15.1:0/1295724524 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x55871f95ada0 0x55871fe010b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=165a7930c22b73bf server_cookie=bf4a5bf1d88e3b5c in_seq=0 out_seq=0 2024-09-21T01:04:39.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.379+0000 7f44db7fe640 1 -- 172.21.15.1:0/1295724524 <== mds.1 v2:172.21.15.193:6838/1365361177 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55871fce28a0 con 0x55871f95ada0 2024-09-21T01:04:39.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.379+0000 7f44db7fe640 10 client.17247 handle_command_reply: tid=0 2024-09-21T01:04:39.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.379+0000 7f4508b59740 1 client.17247 shutdown 2024-09-21T01:04:39.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.379+0000 7f4508b59740 1 -- 172.21.15.1:0/1295724524 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55871f9a6390 msgr2=0x55871fd85f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:39.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.379+0000 7f4508b59740 1 --2- 172.21.15.1:0/1295724524 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55871f9a6390 0x55871fd85f80 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f44f0009900 tx=0x7f44f00051c0 comp rx=0 tx=0).stop 2024-09-21T01:04:39.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.379+0000 7f4508b59740 1 -- 172.21.15.1:0/1295724524 shutdown_connections 2024-09-21T01:04:39.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.379+0000 7f4508b59740 1 --2- 172.21.15.1:0/1295724524 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x55871f95ada0 0x55871fe010b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:39.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.379+0000 7f4508b59740 1 --2- 172.21.15.1:0/1295724524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f9c7070 0x55871fd864c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:39.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.379+0000 7f4508b59740 1 --2- 172.21.15.1:0/1295724524 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55871f9a6390 0x55871fd85f80 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:39.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.379+0000 7f4508b59740 1 --2- 172.21.15.1:0/1295724524 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55871f99e1b0 0x55871fd8aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:39.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.379+0000 7f4508b59740 1 -- 172.21.15.1:0/1295724524 >> 172.21.15.1:0/1295724524 conn(0x55871f9bb460 msgr2=0x55871fd6fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:39.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.379+0000 7f44db7fe640 0 client.17247 ms_handle_reset on v2:172.21.15.193:6838/1365361177 2024-09-21T01:04:39.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.379+0000 7f4508b59740 1 -- 172.21.15.1:0/1295724524 shutdown_connections 2024-09-21T01:04:39.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.379+0000 7f4508b59740 1 -- 172.21.15.1:0/1295724524 wait complete. 2024-09-21T01:04:39.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.379+0000 7f4508b59740 20 client.17247 trim_cache size 0 max 16384 2024-09-21T01:04:39.386 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T01:04:39.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.380+0000 7f45025e5640 1 -- 172.21.15.1:0/1515325668 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f44e40b6510 msgr2=0x7f44e40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:39.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.380+0000 7f45025e5640 1 --2- 172.21.15.1:0/1515325668 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f44e40b6510 0x7f44e40b8a20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f44f4005fd0 tx=0x7f44f4009600 comp rx=0 tx=0).stop 2024-09-21T01:04:39.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.380+0000 7f45025e5640 1 -- 172.21.15.1:0/1515325668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44fc102650 msgr2=0x7f44fc19c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:39.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.380+0000 7f45025e5640 1 --2- 172.21.15.1:0/1515325668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44fc102650 0x7f44fc19c630 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f44ec00e9f0 tx=0x7f44ec00eeb0 comp rx=0 tx=0).stop 2024-09-21T01:04:39.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.380+0000 7f45025e5640 1 -- 172.21.15.1:0/1515325668 shutdown_connections 2024-09-21T01:04:39.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.380+0000 7f45025e5640 1 --2- 172.21.15.1:0/1515325668 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f44e40b6510 0x7f44e40b8a20 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:39.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.380+0000 7f45025e5640 1 --2- 172.21.15.1:0/1515325668 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44fc110200 0x7f44fc1a1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:39.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.380+0000 7f45025e5640 1 --2- 172.21.15.1:0/1515325668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f44fc102fa0 0x7f44fc19cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:39.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.380+0000 7f45025e5640 1 --2- 172.21.15.1:0/1515325668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44fc102650 0x7f44fc19c630 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:39.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.380+0000 7f45025e5640 1 -- 172.21.15.1:0/1515325668 >> 172.21.15.1:0/1515325668 conn(0x7f44fc079760 msgr2=0x7f44fc109d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:39.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.380+0000 7f45025e5640 1 -- 172.21.15.1:0/1515325668 shutdown_connections 2024-09-21T01:04:39.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:39.380+0000 7f45025e5640 1 -- 172.21.15.1:0/1515325668 wait complete. 2024-09-21T01:04:39.952 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:39 smithi001 ceph-mon[31211]: pgmap v581: 97 pgs: 97 active+clean; 528 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 496 op/s 2024-09-21T01:04:39.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:39 smithi193 ceph-mon[34660]: pgmap v581: 97 pgs: 97 active+clean; 528 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 496 op/s 2024-09-21T01:04:39.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:39 smithi042 ceph-mon[34481]: pgmap v581: 97 pgs: 97 active+clean; 528 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 496 op/s 2024-09-21T01:04:40.281 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T01:04:40.562 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:04:41.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.146+0000 7fc0889df640 1 -- 172.21.15.1:0/3891454842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0841083c0 msgr2=0x7fc0841087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:41.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.146+0000 7fc0889df640 1 --2- 172.21.15.1:0/3891454842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0841083c0 0x7fc0841087d0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fc078009900 tx=0x7fc07802a3f0 comp rx=0 tx=0).stop 2024-09-21T01:04:41.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.147+0000 7fc0889df640 1 -- 172.21.15.1:0/3891454842 shutdown_connections 2024-09-21T01:04:41.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.147+0000 7fc0889df640 1 --2- 172.21.15.1:0/3891454842 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc084108d10 0x7fc08410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:41.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.147+0000 7fc0889df640 1 --2- 172.21.15.1:0/3891454842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0841083c0 0x7fc0841087d0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:41.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.147+0000 7fc0889df640 1 --2- 172.21.15.1:0/3891454842 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc084102a80 0x7fc084102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:41.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.147+0000 7fc0889df640 1 -- 172.21.15.1:0/3891454842 >> 172.21.15.1:0/3891454842 conn(0x7fc084079740 msgr2=0x7fc084079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:41.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.148+0000 7fc0889df640 1 -- 172.21.15.1:0/3891454842 shutdown_connections 2024-09-21T01:04:41.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.148+0000 7fc0889df640 1 -- 172.21.15.1:0/3891454842 wait complete. 2024-09-21T01:04:41.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.149+0000 7fc0889df640 1 Processor -- start 2024-09-21T01:04:41.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.150+0000 7fc0889df640 1 -- start start 2024-09-21T01:04:41.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.150+0000 7fc0889df640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc084102a80 0x7fc08410da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:41.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.150+0000 7fc0889df640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0841083c0 0x7fc08410dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:41.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.150+0000 7fc0889df640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc084108d10 0x7fc08410e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:41.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.150+0000 7fc0889df640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc084110e80 con 0x7fc084108d10 2024-09-21T01:04:41.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.150+0000 7fc08259c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc084102a80 0x7fc08410da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:41.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.150+0000 7fc0889df640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc084110d00 con 0x7fc0841083c0 2024-09-21T01:04:41.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.150+0000 7fc0889df640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc084111000 con 0x7fc084102a80 2024-09-21T01:04:41.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.150+0000 7fc08259c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc084102a80 0x7fc08410da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:42718/0 (socket says 172.21.15.1:42718) 2024-09-21T01:04:41.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.150+0000 7fc08259c640 1 -- 172.21.15.1:0/1351987531 learned_addr learned my addr 172.21.15.1:0/1351987531 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:41.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.151+0000 7fc082d9d640 1 --2- 172.21.15.1:0/1351987531 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc084108d10 0x7fc08410e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:41.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.151+0000 7fc08259c640 1 -- 172.21.15.1:0/1351987531 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0841083c0 msgr2=0x7fc08410dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:41.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.151+0000 7fc08259c640 1 --2- 172.21.15.1:0/1351987531 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0841083c0 0x7fc08410dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:41.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.151+0000 7fc08259c640 1 -- 172.21.15.1:0/1351987531 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc084108d10 msgr2=0x7fc08410e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:41.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.151+0000 7fc08259c640 1 --2- 172.21.15.1:0/1351987531 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc084108d10 0x7fc08410e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:41.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.151+0000 7fc08259c640 1 -- 172.21.15.1:0/1351987531 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0841acb90 con 0x7fc084102a80 2024-09-21T01:04:41.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.151+0000 7fc08259c640 1 --2- 172.21.15.1:0/1351987531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc084102a80 0x7fc08410da80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc07400ea60 tx=0x7fc07400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:41.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.151+0000 7fc0737fe640 1 -- 172.21.15.1:0/1351987531 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07400cde0 con 0x7fc084102a80 2024-09-21T01:04:41.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.152+0000 7fc0737fe640 1 -- 172.21.15.1:0/1351987531 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0740035f0 con 0x7fc084102a80 2024-09-21T01:04:41.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.152+0000 7fc0889df640 1 -- 172.21.15.1:0/1351987531 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0841ace80 con 0x7fc084102a80 2024-09-21T01:04:41.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.152+0000 7fc0737fe640 1 -- 172.21.15.1:0/1351987531 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc074010690 con 0x7fc084102a80 2024-09-21T01:04:41.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.152+0000 7fc0889df640 1 -- 172.21.15.1:0/1351987531 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0841ad380 con 0x7fc084102a80 2024-09-21T01:04:41.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.156+0000 7fc08ef53740 1 Processor -- start 2024-09-21T01:04:41.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.156+0000 7fc08ef53740 1 -- start start 2024-09-21T01:04:41.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.156+0000 7fc08ef53740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c49ea83070 0x55c49ee2a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:41.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.156+0000 7fc08ef53740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c49ea5a1b0 0x55c49ee2a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:41.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.157+0000 7fc08ef53740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c49ea62390 0x55c49ee2ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:41.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.157+0000 7fc08ef53740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c49eda0ea0 con 0x55c49ea62390 2024-09-21T01:04:41.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.157+0000 7fc08ef53740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c49ed902d0 con 0x55c49ea83070 2024-09-21T01:04:41.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.157+0000 7fc08ef53740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55c49ed940e0 con 0x55c49ea5a1b0 2024-09-21T01:04:41.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.157+0000 7fc081d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c49ea62390 0x55c49ee2ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:41.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.157+0000 7fc081d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c49ea62390 0x55c49ee2ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47166/0 (socket says 172.21.15.1:47166) 2024-09-21T01:04:41.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.157+0000 7fc081d9b640 1 -- 172.21.15.1:0/3952433262 learned_addr learned my addr 172.21.15.1:0/3952433262 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:41.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.157+0000 7fc082d9d640 1 --2- 172.21.15.1:0/3952433262 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c49ea83070 0x55c49ee2a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:41.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.157+0000 7fc081d9b640 1 -- 172.21.15.1:0/3952433262 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c49ea5a1b0 msgr2=0x55c49ee2a800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:04:41.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.157+0000 7fc081d9b640 1 --2- 172.21.15.1:0/3952433262 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c49ea5a1b0 0x55c49ee2a800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:41.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.157+0000 7fc081d9b640 1 -- 172.21.15.1:0/3952433262 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c49ea83070 msgr2=0x55c49ee2a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:41.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.157+0000 7fc081d9b640 1 --2- 172.21.15.1:0/3952433262 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c49ea83070 0x55c49ee2a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:41.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.157+0000 7fc081d9b640 1 -- 172.21.15.1:0/3952433262 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c49eaee650 con 0x55c49ea62390 2024-09-21T01:04:41.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.158+0000 7fc0737fe640 1 -- 172.21.15.1:0/1351987531 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7fc074004020 con 0x7fc084102a80 2024-09-21T01:04:41.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.159+0000 7fc0737fe640 1 --2- 172.21.15.1:0/1351987531 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc06c0b6600 0x7fc06c0b8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:41.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.159+0000 7fc081d9b640 1 --2- 172.21.15.1:0/3952433262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c49ea62390 0x55c49ee2ad40 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fc07802a910 tx=0x7fc078000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bcea9834a7caf48 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:41.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.159+0000 7fc082d9d640 1 --2- 172.21.15.1:0/1351987531 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc06c0b6600 0x7fc06c0b8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:41.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.159+0000 7fc0737fe640 1 -- 172.21.15.1:0/1351987531 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fc0740e7750 con 0x7fc084102a80 2024-09-21T01:04:41.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.160+0000 7fc082d9d640 1 --2- 172.21.15.1:0/1351987531 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc06c0b6600 0x7fc06c0b8b10 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc07c0092f0 tx=0x7fc07c009280 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:41.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.160+0000 7fc070ff9640 1 -- 172.21.15.1:0/3952433262 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07803e030 con 0x55c49ea62390 2024-09-21T01:04:41.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.160+0000 7fc070ff9640 1 -- 172.21.15.1:0/3952433262 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc078005020 con 0x55c49ea62390 2024-09-21T01:04:41.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.160+0000 7fc070ff9640 1 -- 172.21.15.1:0/3952433262 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc078035040 con 0x55c49ea62390 2024-09-21T01:04:41.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.161+0000 7fc08ef53740 1 -- 172.21.15.1:0/3952433262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c49ea62390 msgr2=0x55c49ee2ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:41.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.161+0000 7fc08ef53740 1 --2- 172.21.15.1:0/3952433262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c49ea62390 0x55c49ee2ad40 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fc07802a910 tx=0x7fc078000bc0 comp rx=0 tx=0).stop 2024-09-21T01:04:41.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.162+0000 7fc08ef53740 1 -- 172.21.15.1:0/3952433262 shutdown_connections 2024-09-21T01:04:41.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.162+0000 7fc08ef53740 1 --2- 172.21.15.1:0/3952433262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c49ea62390 0x55c49ee2ad40 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:41.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.162+0000 7fc08ef53740 1 --2- 172.21.15.1:0/3952433262 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c49ea5a1b0 0x55c49ee2a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:41.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.162+0000 7fc08ef53740 1 --2- 172.21.15.1:0/3952433262 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c49ea83070 0x55c49ee2a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:41.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.162+0000 7fc08ef53740 1 -- 172.21.15.1:0/3952433262 >> 172.21.15.1:0/3952433262 conn(0x55c49ea77460 msgr2=0x55c49ee281b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:41.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.162+0000 7fc08ef53740 1 -- 172.21.15.1:0/3952433262 shutdown_connections 2024-09-21T01:04:41.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.162+0000 7fc08ef53740 1 -- 172.21.15.1:0/3952433262 wait complete. 2024-09-21T01:04:41.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.163+0000 7fc08ef53740 1 -- start start 2024-09-21T01:04:41.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.163+0000 7fc08ef53740 1 Processor -- start 2024-09-21T01:04:41.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.164+0000 7fc08ef53740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c49ea5a1b0 0x55c49ee35980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:41.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.164+0000 7fc08ef53740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c49ea62390 0x55c49ee35ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:41.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.164+0000 7fc081d9b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c49ea62390 0x55c49ee35ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:41.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.164+0000 7fc08259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c49ea5a1b0 0x55c49ee35980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:41.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.164+0000 7fc08259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c49ea5a1b0 0x55c49ee35980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47176/0 (socket says 172.21.15.1:47176) 2024-09-21T01:04:41.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.164+0000 7fc081d9b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c49ea62390 0x55c49ee35ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:42732/0 (socket says 172.21.15.1:42732) 2024-09-21T01:04:41.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.164+0000 7fc08ef53740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c49ea83070 0x55c49ee41d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:41.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.164+0000 7fc081d9b640 1 -- 172.21.15.1:0/640360360 learned_addr learned my addr 172.21.15.1:0/640360360 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:41.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.164+0000 7fc08ef53740 1 -- 172.21.15.1:0/640360360 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c49ebf1700 con 0x55c49ea5a1b0 2024-09-21T01:04:41.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.164+0000 7fc08ef53740 1 -- 172.21.15.1:0/640360360 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c49ed2b160 con 0x55c49ea83070 2024-09-21T01:04:41.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.164+0000 7fc08ef53740 1 -- 172.21.15.1:0/640360360 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55c49ee38a40 con 0x55c49ea62390 2024-09-21T01:04:41.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.164+0000 7fc08ef53740 10 client.0 _ll_register_callbacks cb 0x55c49ed449e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:41.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.164+0000 7fc082d9d640 1 --2- 172.21.15.1:0/640360360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c49ea83070 0x55c49ee41d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:41.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.165+0000 7fc08259c640 1 -- 172.21.15.1:0/640360360 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c49ea62390 msgr2=0x55c49ee35ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:41.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.165+0000 7fc08259c640 1 --2- 172.21.15.1:0/640360360 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c49ea62390 0x55c49ee35ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:41.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.165+0000 7fc08259c640 1 -- 172.21.15.1:0/640360360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c49ea83070 msgr2=0x55c49ee41d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:41.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.165+0000 7fc08259c640 1 --2- 172.21.15.1:0/640360360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c49ea83070 0x55c49ee41d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:41.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.165+0000 7fc08259c640 1 -- 172.21.15.1:0/640360360 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c49ed58c90 con 0x55c49ea5a1b0 2024-09-21T01:04:41.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.165+0000 7fc08259c640 1 --2- 172.21.15.1:0/640360360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c49ea5a1b0 0x55c49ee35980 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x55c49ee28f40 tx=0x7fc074003cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1533c66d9faeddb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:41.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.165+0000 7fc069ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:04:41.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.165+0000 7fc069ffb640 1 -- 172.21.15.1:0/640360360 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc074004310 con 0x55c49ea5a1b0 2024-09-21T01:04:41.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.166+0000 7fc08ef53740 1 -- 172.21.15.1:0/640360360 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc078005020 con 0x55c49ea5a1b0 2024-09-21T01:04:41.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.166+0000 7fc069ffb640 1 -- 172.21.15.1:0/640360360 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fc0740aeb90 con 0x55c49ea5a1b0 2024-09-21T01:04:41.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.166+0000 7fc069ffb640 1 -- 172.21.15.1:0/640360360 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fc0740ad370 con 0x55c49ea5a1b0 2024-09-21T01:04:41.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.166+0000 7fc08ef53740 10 client.17259 fetch_fsmap learned FSMap version 39 2024-09-21T01:04:41.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.166+0000 7fc08ef53740 1 -- 172.21.15.1:0/640360360 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55c49ee44730 con 0x55c49ea5a1b0 2024-09-21T01:04:41.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.166+0000 7fc069ffb640 1 -- 172.21.15.1:0/640360360 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0740adf60 con 0x55c49ea5a1b0 2024-09-21T01:04:41.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.167+0000 7fc069ffb640 1 -- 172.21.15.1:0/640360360 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 39) ==== 8398+0+0 (secure 0 0 0) 0x7fc0740ac530 con 0x55c49ea5a1b0 2024-09-21T01:04:41.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.167+0000 7fc08ef53740 10 client.17259 fetch_fsmap finished waiting for FSMap version 39 2024-09-21T01:04:41.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.167+0000 7fc08ef53740 10 client.17259 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:04:41.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.167+0000 7fc08ef53740 20 client.17259 populate_metadata read hostname 'smithi001' 2024-09-21T01:04:41.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.167+0000 7fc08ef53740 1 --2- 172.21.15.1:0/640360360 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55c49ea419f0 0x55c49ee480a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:41.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.167+0000 7fc08ef53740 4 client.17259 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:04:41.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.167+0000 7fc08ef53740 1 -- 172.21.15.1:0/640360360 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc078005020 con 0x55c49ea419f0 2024-09-21T01:04:41.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.167+0000 7fc081d9b640 1 --2- 172.21.15.1:0/640360360 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55c49ea419f0 0x55c49ee480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:41.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.168+0000 7fc069ffb640 10 client.17259 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:04:41.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.168+0000 7fc081d9b640 1 --2- 172.21.15.1:0/640360360 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55c49ea419f0 0x55c49ee480a0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56c084be97953a26 server_cookie=63d8b81542d9a3bb in_seq=0 out_seq=0 2024-09-21T01:04:41.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.169+0000 7fc069ffb640 1 -- 172.21.15.1:0/640360360 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fc078005020 con 0x55c49ea419f0 2024-09-21T01:04:41.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.169+0000 7fc069ffb640 10 client.17259 handle_command_reply: tid=0 2024-09-21T01:04:41.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.169+0000 7fc08ef53740 1 client.17259 shutdown 2024-09-21T01:04:41.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.169+0000 7fc08ef53740 1 -- 172.21.15.1:0/640360360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c49ea5a1b0 msgr2=0x55c49ee35980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:41.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.169+0000 7fc08ef53740 1 --2- 172.21.15.1:0/640360360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c49ea5a1b0 0x55c49ee35980 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x55c49ee28f40 tx=0x7fc074003cf0 comp rx=0 tx=0).stop 2024-09-21T01:04:41.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.169+0000 7fc08ef53740 1 -- 172.21.15.1:0/640360360 shutdown_connections 2024-09-21T01:04:41.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.169+0000 7fc08ef53740 1 --2- 172.21.15.1:0/640360360 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55c49ea419f0 0x55c49ee480a0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:41.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.169+0000 7fc08ef53740 1 --2- 172.21.15.1:0/640360360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c49ea83070 0x55c49ee41d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:41.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.169+0000 7fc08ef53740 1 --2- 172.21.15.1:0/640360360 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c49ea62390 0x55c49ee35ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:41.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.169+0000 7fc08ef53740 1 --2- 172.21.15.1:0/640360360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c49ea5a1b0 0x55c49ee35980 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:41.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.169+0000 7fc08ef53740 1 -- 172.21.15.1:0/640360360 >> 172.21.15.1:0/640360360 conn(0x55c49ea77460 msgr2=0x55c49ee2d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:41.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.169+0000 7fc069ffb640 0 client.17259 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:04:41.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.169+0000 7fc08ef53740 1 -- 172.21.15.1:0/640360360 shutdown_connections 2024-09-21T01:04:41.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.169+0000 7fc08ef53740 1 -- 172.21.15.1:0/640360360 wait complete. 2024-09-21T01:04:41.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.169+0000 7fc08ef53740 20 client.17259 trim_cache size 0 max 16384 2024-09-21T01:04:41.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.182+0000 7fc08ef53740 1 Processor -- start 2024-09-21T01:04:41.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.182+0000 7fc08ef53740 1 -- start start 2024-09-21T01:04:41.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.183+0000 7fc08ef53740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c49ea5a1b0 0x55c49ee35da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:41.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.183+0000 7fc08ef53740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c49ea62390 0x55c49ee2ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:41.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.183+0000 7fc08ef53740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c49ea83070 0x55c49ee27760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:41.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.183+0000 7fc08ef53740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc0841b5b90 con 0x55c49ea62390 2024-09-21T01:04:41.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.183+0000 7fc08ef53740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc0841b7850 con 0x55c49ea5a1b0 2024-09-21T01:04:41.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.183+0000 7fc08ef53740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc0841b6290 con 0x55c49ea83070 2024-09-21T01:04:41.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.183+0000 7fc081d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c49ea62390 0x55c49ee2ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:41.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.183+0000 7fc081d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c49ea62390 0x55c49ee2ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47188/0 (socket says 172.21.15.1:47188) 2024-09-21T01:04:41.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.183+0000 7fc081d9b640 1 -- 172.21.15.1:0/1203134076 learned_addr learned my addr 172.21.15.1:0/1203134076 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:41.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.183+0000 7fc08259c640 1 --2- 172.21.15.1:0/1203134076 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c49ea5a1b0 0x55c49ee35da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:41.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.183+0000 7fc082d9d640 1 --2- 172.21.15.1:0/1203134076 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c49ea83070 0x55c49ee27760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:41.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.183+0000 7fc081d9b640 1 -- 172.21.15.1:0/1203134076 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c49ea83070 msgr2=0x55c49ee27760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:41.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.183+0000 7fc081d9b640 1 --2- 172.21.15.1:0/1203134076 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c49ea83070 0x55c49ee27760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:41.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.183+0000 7fc081d9b640 1 -- 172.21.15.1:0/1203134076 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c49ea5a1b0 msgr2=0x55c49ee35da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:41.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.183+0000 7fc081d9b640 1 --2- 172.21.15.1:0/1203134076 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c49ea5a1b0 0x55c49ee35da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:41.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.183+0000 7fc081d9b640 1 -- 172.21.15.1:0/1203134076 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c49ee22460 con 0x55c49ea62390 2024-09-21T01:04:41.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.183+0000 7fc08259c640 1 --2- 172.21.15.1:0/1203134076 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c49ea5a1b0 0x55c49ee35da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:41.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.184+0000 7fc081d9b640 1 --2- 172.21.15.1:0/1203134076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c49ea62390 0x55c49ee2ba00 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fc078009230 tx=0x7fc078004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f565b661fe9110 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:41.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.184+0000 7fc06bfff640 1 -- 172.21.15.1:0/1203134076 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07803e040 con 0x55c49ea62390 2024-09-21T01:04:41.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.184+0000 7fc06bfff640 1 -- 172.21.15.1:0/1203134076 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0780040c0 con 0x55c49ea62390 2024-09-21T01:04:41.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.184+0000 7fc06bfff640 1 -- 172.21.15.1:0/1203134076 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc078035040 con 0x55c49ea62390 2024-09-21T01:04:41.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.185+0000 7fc08ef53740 1 -- 172.21.15.1:0/1203134076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c49ea62390 msgr2=0x55c49ee2ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:41.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.185+0000 7fc08ef53740 1 --2- 172.21.15.1:0/1203134076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c49ea62390 0x55c49ee2ba00 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fc078009230 tx=0x7fc078004840 comp rx=0 tx=0).stop 2024-09-21T01:04:41.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.185+0000 7fc08ef53740 1 -- 172.21.15.1:0/1203134076 shutdown_connections 2024-09-21T01:04:41.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.185+0000 7fc08ef53740 1 --2- 172.21.15.1:0/1203134076 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c49ea83070 0x55c49ee27760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:41.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.185+0000 7fc08ef53740 1 --2- 172.21.15.1:0/1203134076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c49ea62390 0x55c49ee2ba00 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:41.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.185+0000 7fc08ef53740 1 --2- 172.21.15.1:0/1203134076 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c49ea5a1b0 0x55c49ee35da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:41.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.185+0000 7fc08ef53740 1 -- 172.21.15.1:0/1203134076 >> 172.21.15.1:0/1203134076 conn(0x55c49ea77460 msgr2=0x55c49ee2b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:41.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.185+0000 7fc08ef53740 1 -- 172.21.15.1:0/1203134076 shutdown_connections 2024-09-21T01:04:41.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.185+0000 7fc08ef53740 1 -- 172.21.15.1:0/1203134076 wait complete. 2024-09-21T01:04:41.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.185+0000 7fc08ef53740 1 -- start start 2024-09-21T01:04:41.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.185+0000 7fc08ef53740 1 Processor -- start 2024-09-21T01:04:41.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.186+0000 7fc08ef53740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c49ea5a1b0 0x55c49ee3e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:41.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.186+0000 7fc08ef53740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c49ea62390 0x55c49ee3e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:41.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.186+0000 7fc08ef53740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c49ea83070 0x55c49ee39760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:41.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.186+0000 7fc08ef53740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc0841b70c0 con 0x55c49ea5a1b0 2024-09-21T01:04:41.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.186+0000 7fc08ef53740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc0841b69c0 con 0x55c49ea62390 2024-09-21T01:04:41.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.186+0000 7fc08ef53740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc0841b3b70 con 0x55c49ea83070 2024-09-21T01:04:41.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.186+0000 7fc08ef53740 10 client.0 _ll_register_callbacks cb 0x7fc074003d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:41.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.186+0000 7fc08259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c49ea5a1b0 0x55c49ee3e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:41.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.186+0000 7fc081d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c49ea62390 0x55c49ee3e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:41.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.186+0000 7fc08259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c49ea5a1b0 0x55c49ee3e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47196/0 (socket says 172.21.15.1:47196) 2024-09-21T01:04:41.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.186+0000 7fc081d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c49ea62390 0x55c49ee3e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:50422/0 (socket says 172.21.15.1:50422) 2024-09-21T01:04:41.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.186+0000 7fc082d9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c49ea83070 0x55c49ee39760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:41.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.186+0000 7fc081d9b640 1 -- 172.21.15.1:0/2828095114 learned_addr learned my addr 172.21.15.1:0/2828095114 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:41.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.186+0000 7fc081d9b640 1 -- 172.21.15.1:0/2828095114 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c49ea83070 msgr2=0x55c49ee39760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:41.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.186+0000 7fc081d9b640 1 --2- 172.21.15.1:0/2828095114 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c49ea83070 0x55c49ee39760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:41.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.186+0000 7fc081d9b640 1 -- 172.21.15.1:0/2828095114 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c49ea5a1b0 msgr2=0x55c49ee3e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:41.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.186+0000 7fc081d9b640 1 --2- 172.21.15.1:0/2828095114 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c49ea5a1b0 0x55c49ee3e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:41.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.186+0000 7fc081d9b640 1 -- 172.21.15.1:0/2828095114 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c49ee39ed0 con 0x55c49ea62390 2024-09-21T01:04:41.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.186+0000 7fc082d9d640 1 --2- 172.21.15.1:0/2828095114 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c49ea83070 0x55c49ee39760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:41.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.186+0000 7fc081d9b640 1 --2- 172.21.15.1:0/2828095114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c49ea62390 0x55c49ee3e670 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc07802a910 tx=0x7fc078009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdbbab0700c7688b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:41.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.186+0000 7fc069ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:04:41.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.187+0000 7fc069ffb640 1 -- 172.21.15.1:0/2828095114 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc078062060 con 0x55c49ea62390 2024-09-21T01:04:41.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.187+0000 7fc069ffb640 1 -- 172.21.15.1:0/2828095114 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fc0780038c0 con 0x55c49ea62390 2024-09-21T01:04:41.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.187+0000 7fc08ef53740 1 -- 172.21.15.1:0/2828095114 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0780040c0 con 0x55c49ea62390 2024-09-21T01:04:41.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.187+0000 7fc069ffb640 1 -- 172.21.15.1:0/2828095114 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fc078035030 con 0x55c49ea62390 2024-09-21T01:04:41.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.187+0000 7fc08ef53740 10 client.26921 fetch_fsmap learned FSMap version 39 2024-09-21T01:04:41.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.187+0000 7fc08ef53740 1 -- 172.21.15.1:0/2828095114 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55c49eeb2620 con 0x55c49ea62390 2024-09-21T01:04:41.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.187+0000 7fc069ffb640 1 -- 172.21.15.1:0/2828095114 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0780040c0 con 0x55c49ea62390 2024-09-21T01:04:41.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.187+0000 7fc069ffb640 1 -- 172.21.15.1:0/2828095114 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 39) ==== 8398+0+0 (secure 0 0 0) 0x7fc078043460 con 0x55c49ea62390 2024-09-21T01:04:41.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.187+0000 7fc08ef53740 10 client.26921 fetch_fsmap finished waiting for FSMap version 39 2024-09-21T01:04:41.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.187+0000 7fc08ef53740 10 client.26921 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:04:41.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.187+0000 7fc08ef53740 20 client.26921 populate_metadata read hostname 'smithi001' 2024-09-21T01:04:41.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.187+0000 7fc08ef53740 1 --2- 172.21.15.1:0/2828095114 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55c49ea16da0 0x55c49eeb4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:41.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.188+0000 7fc08ef53740 4 client.26921 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:04:41.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.188+0000 7fc08ef53740 1 -- 172.21.15.1:0/2828095114 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c49eda2df0 con 0x55c49ea16da0 2024-09-21T01:04:41.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.188+0000 7fc08259c640 1 --2- 172.21.15.1:0/2828095114 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55c49ea16da0 0x55c49eeb4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:41.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.188+0000 7fc069ffb640 10 client.26921 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:04:41.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.188+0000 7fc08259c640 1 --2- 172.21.15.1:0/2828095114 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55c49ea16da0 0x55c49eeb4930 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74e64714a0f1c994 server_cookie=32a226a81ca7dbcc in_seq=0 out_seq=0 2024-09-21T01:04:41.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.188+0000 7fc069ffb640 1 -- 172.21.15.1:0/2828095114 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c49eda2df0 con 0x55c49ea16da0 2024-09-21T01:04:41.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.188+0000 7fc069ffb640 10 client.26921 handle_command_reply: tid=0 2024-09-21T01:04:41.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.188+0000 7fc08ef53740 1 client.26921 shutdown 2024-09-21T01:04:41.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.188+0000 7fc08ef53740 1 -- 172.21.15.1:0/2828095114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c49ea62390 msgr2=0x55c49ee3e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:41.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.188+0000 7fc08ef53740 1 --2- 172.21.15.1:0/2828095114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c49ea62390 0x55c49ee3e670 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc07802a910 tx=0x7fc078009260 comp rx=0 tx=0).stop 2024-09-21T01:04:41.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.188+0000 7fc08ef53740 1 -- 172.21.15.1:0/2828095114 shutdown_connections 2024-09-21T01:04:41.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.188+0000 7fc08ef53740 1 --2- 172.21.15.1:0/2828095114 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55c49ea16da0 0x55c49eeb4930 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:41.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.188+0000 7fc08ef53740 1 --2- 172.21.15.1:0/2828095114 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c49ea83070 0x55c49ee39760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:41.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.188+0000 7fc08ef53740 1 --2- 172.21.15.1:0/2828095114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c49ea62390 0x55c49ee3e670 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:41.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.188+0000 7fc08ef53740 1 --2- 172.21.15.1:0/2828095114 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c49ea5a1b0 0x55c49ee3e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:41.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.189+0000 7fc069ffb640 0 client.26921 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:04:41.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.189+0000 7fc08ef53740 1 -- 172.21.15.1:0/2828095114 >> 172.21.15.1:0/2828095114 conn(0x55c49ea77460 msgr2=0x55c49ee2bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:41.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.189+0000 7fc08ef53740 1 -- 172.21.15.1:0/2828095114 shutdown_connections 2024-09-21T01:04:41.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.189+0000 7fc08ef53740 1 -- 172.21.15.1:0/2828095114 wait complete. 2024-09-21T01:04:41.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.189+0000 7fc08ef53740 20 client.26921 trim_cache size 0 max 16384 2024-09-21T01:04:41.194 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T01:04:41.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.189+0000 7fc0889df640 1 -- 172.21.15.1:0/1351987531 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc06c0b6600 msgr2=0x7fc06c0b8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:41.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.189+0000 7fc0889df640 1 --2- 172.21.15.1:0/1351987531 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc06c0b6600 0x7fc06c0b8b10 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc07c0092f0 tx=0x7fc07c009280 comp rx=0 tx=0).stop 2024-09-21T01:04:41.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.189+0000 7fc0889df640 1 -- 172.21.15.1:0/1351987531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc084102a80 msgr2=0x7fc08410da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:41.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.189+0000 7fc0889df640 1 --2- 172.21.15.1:0/1351987531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc084102a80 0x7fc08410da80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc07400ea60 tx=0x7fc07400ef20 comp rx=0 tx=0).stop 2024-09-21T01:04:41.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.189+0000 7fc0889df640 1 -- 172.21.15.1:0/1351987531 shutdown_connections 2024-09-21T01:04:41.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.189+0000 7fc0889df640 1 --2- 172.21.15.1:0/1351987531 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc06c0b6600 0x7fc06c0b8b10 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:41.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.189+0000 7fc0889df640 1 --2- 172.21.15.1:0/1351987531 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc084108d10 0x7fc08410e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:41.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.189+0000 7fc0889df640 1 --2- 172.21.15.1:0/1351987531 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0841083c0 0x7fc08410dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:41.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.189+0000 7fc0889df640 1 --2- 172.21.15.1:0/1351987531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc084102a80 0x7fc08410da80 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:41.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.189+0000 7fc0889df640 1 -- 172.21.15.1:0/1351987531 >> 172.21.15.1:0/1351987531 conn(0x7fc084079740 msgr2=0x7fc084104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:41.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.190+0000 7fc0889df640 1 -- 172.21.15.1:0/1351987531 shutdown_connections 2024-09-21T01:04:41.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:41.190+0000 7fc0889df640 1 -- 172.21.15.1:0/1351987531 wait complete. 2024-09-21T01:04:41.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:41 smithi001 ceph-mon[31211]: pgmap v582: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 545 op/s 2024-09-21T01:04:41.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:41 smithi193 ceph-mon[34660]: pgmap v582: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 545 op/s 2024-09-21T01:04:41.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:41 smithi042 ceph-mon[34481]: pgmap v582: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 545 op/s 2024-09-21T01:04:43.083 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T01:04:43.084 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T01:04:43.367 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:04:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.505+0000 7f20efcbd640 1 -- 172.21.15.1:0/3037034468 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20e8106b00 msgr2=0x7f20e8108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.505+0000 7f20efcbd640 1 --2- 172.21.15.1:0/3037034468 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20e8106b00 0x7f20e8108f20 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f20d8009900 tx=0x7f20d802a410 comp rx=0 tx=0).stop 2024-09-21T01:04:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.505+0000 7f20efcbd640 1 -- 172.21.15.1:0/3037034468 shutdown_connections 2024-09-21T01:04:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.505+0000 7f20efcbd640 1 --2- 172.21.15.1:0/3037034468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20e8109460 0x7f20e810b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.505+0000 7f20efcbd640 1 --2- 172.21.15.1:0/3037034468 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20e8106b00 0x7f20e8108f20 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.505+0000 7f20efcbd640 1 --2- 172.21.15.1:0/3037034468 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20e8101a70 0x7f20e8101e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.505+0000 7f20efcbd640 1 -- 172.21.15.1:0/3037034468 >> 172.21.15.1:0/3037034468 conn(0x7f20e80fd690 msgr2=0x7f20e80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.505+0000 7f20efcbd640 1 -- 172.21.15.1:0/3037034468 shutdown_connections 2024-09-21T01:04:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.505+0000 7f20efcbd640 1 -- 172.21.15.1:0/3037034468 wait complete. 2024-09-21T01:04:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.506+0000 7f20efcbd640 1 Processor -- start 2024-09-21T01:04:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.506+0000 7f20efcbd640 1 -- start start 2024-09-21T01:04:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.506+0000 7f20efcbd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20e8101a70 0x7f20e8199f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.506+0000 7f20efcbd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20e8106b00 0x7f20e819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.506+0000 7f20efcbd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20e8109460 0x7f20e819b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.506+0000 7f20efcbd640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f20e810f300 con 0x7f20e8109460 2024-09-21T01:04:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.506+0000 7f20efcbd640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f20e810f180 con 0x7f20e8101a70 2024-09-21T01:04:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.506+0000 7f20efcbd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f20e810f480 con 0x7f20e8106b00 2024-09-21T01:04:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.506+0000 7f20ee25a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20e8109460 0x7f20e819b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.506+0000 7f20eda59640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20e8101a70 0x7f20e8199f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.507+0000 7f20ee25a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20e8109460 0x7f20e819b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47214/0 (socket says 172.21.15.1:47214) 2024-09-21T01:04:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.507+0000 7f20ee25a640 1 -- 172.21.15.1:0/331803635 learned_addr learned my addr 172.21.15.1:0/331803635 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:43.510 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.507+0000 7f20ed258640 1 --2- 172.21.15.1:0/331803635 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20e8106b00 0x7f20e819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:43.510 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.507+0000 7f20ee25a640 1 -- 172.21.15.1:0/331803635 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20e8106b00 msgr2=0x7f20e819a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:43.510 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.507+0000 7f20ee25a640 1 --2- 172.21.15.1:0/331803635 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20e8106b00 0x7f20e819a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:43.510 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.507+0000 7f20ee25a640 1 -- 172.21.15.1:0/331803635 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20e8101a70 msgr2=0x7f20e8199f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:43.510 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.507+0000 7f20ee25a640 1 --2- 172.21.15.1:0/331803635 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20e8101a70 0x7f20e8199f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:43.510 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.507+0000 7f20ee25a640 1 -- 172.21.15.1:0/331803635 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e819b970 con 0x7f20e8109460 2024-09-21T01:04:43.510 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.507+0000 7f20ee25a640 1 --2- 172.21.15.1:0/331803635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20e8109460 0x7f20e819b150 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f20e000eaa0 tx=0x7f20e000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:43.510 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.507+0000 7f20deffd640 1 -- 172.21.15.1:0/331803635 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e000cdb0 con 0x7f20e8109460 2024-09-21T01:04:43.510 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.507+0000 7f20efcbd640 1 -- 172.21.15.1:0/331803635 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20e819bc60 con 0x7f20e8109460 2024-09-21T01:04:43.510 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.507+0000 7f20deffd640 1 -- 172.21.15.1:0/331803635 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20e0005020 con 0x7f20e8109460 2024-09-21T01:04:43.510 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.507+0000 7f20deffd640 1 -- 172.21.15.1:0/331803635 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e00116d0 con 0x7f20e8109460 2024-09-21T01:04:43.510 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.507+0000 7f20efcbd640 1 -- 172.21.15.1:0/331803635 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20e81a2350 con 0x7f20e8109460 2024-09-21T01:04:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.510+0000 7f20f6c2d740 1 Processor -- start 2024-09-21T01:04:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.510+0000 7f20deffd640 1 -- 172.21.15.1:0/331803635 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f20e00051d0 con 0x7f20e8109460 2024-09-21T01:04:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.511+0000 7f20f6c2d740 1 -- start start 2024-09-21T01:04:43.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.511+0000 7f20f6c2d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557ddb031b0 0x5557ddeaae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:43.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.511+0000 7f20f6c2d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557ddada2f0 0x5557ddeab4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:43.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.511+0000 7f20f6c2d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5557ddae24d0 0x5557ddeac010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:43.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.511+0000 7f20f6c2d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5557dde1d6f0 con 0x5557ddada2f0 2024-09-21T01:04:43.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.511+0000 7f20f6c2d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5557dde0cb20 con 0x5557ddb031b0 2024-09-21T01:04:43.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.511+0000 7f20f6c2d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5557dde10930 con 0x5557ddae24d0 2024-09-21T01:04:43.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.511+0000 7f20eda59640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557ddada2f0 0x5557ddeab4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:43.514 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.511+0000 7f20ed258640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557ddb031b0 0x5557ddeaae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:43.514 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.511+0000 7f20eda59640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557ddada2f0 0x5557ddeab4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47220/0 (socket says 172.21.15.1:47220) 2024-09-21T01:04:43.514 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.511+0000 7f20eda59640 1 -- 172.21.15.1:0/2651669421 learned_addr learned my addr 172.21.15.1:0/2651669421 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:43.514 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.511+0000 7f20ed258640 1 --2- 172.21.15.1:0/2651669421 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5557ddae24d0 0x5557ddeac010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:43.514 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.511+0000 7f20eda59640 1 -- 172.21.15.1:0/2651669421 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5557ddae24d0 msgr2=0x5557ddeac010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:43.514 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.511+0000 7f20eda59640 1 --2- 172.21.15.1:0/2651669421 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5557ddae24d0 0x5557ddeac010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:43.514 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.511+0000 7f20eda59640 1 -- 172.21.15.1:0/2651669421 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557ddb031b0 msgr2=0x5557ddeaae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:43.514 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.511+0000 7f20eda59640 1 --2- 172.21.15.1:0/2651669421 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557ddb031b0 0x5557ddeaae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:43.514 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.511+0000 7f20eda59640 1 -- 172.21.15.1:0/2651669421 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557dddd2530 con 0x5557ddada2f0 2024-09-21T01:04:43.514 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.511+0000 7f20ed258640 1 --2- 172.21.15.1:0/2651669421 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5557ddae24d0 0x5557ddeac010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:04:43.514 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.511+0000 7f20deffd640 1 --2- 172.21.15.1:0/331803635 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f20d40b6510 0x7f20d40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:43.514 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.512+0000 7f20eda59640 1 --2- 172.21.15.1:0/2651669421 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557ddada2f0 0x5557ddeab4c0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f20e4009cf0 tx=0x7f20e4011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4958ea26b386b476 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:43.514 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.512+0000 7f20ed258640 1 --2- 172.21.15.1:0/331803635 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f20d40b6510 0x7f20d40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:43.515 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.512+0000 7f20deffd640 1 -- 172.21.15.1:0/331803635 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f20e00e7400 con 0x7f20e8109460 2024-09-21T01:04:43.515 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.512+0000 7f20d3fff640 1 -- 172.21.15.1:0/2651669421 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e4004230 con 0x5557ddada2f0 2024-09-21T01:04:43.515 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.512+0000 7f20d3fff640 1 -- 172.21.15.1:0/2651669421 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20e40043d0 con 0x5557ddada2f0 2024-09-21T01:04:43.515 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.512+0000 7f20d3fff640 1 -- 172.21.15.1:0/2651669421 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e4019880 con 0x5557ddada2f0 2024-09-21T01:04:43.519 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.513+0000 7f20f6c2d740 1 -- 172.21.15.1:0/2651669421 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557ddada2f0 msgr2=0x5557ddeab4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:43.519 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.513+0000 7f20f6c2d740 1 --2- 172.21.15.1:0/2651669421 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557ddada2f0 0x5557ddeab4c0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f20e4009cf0 tx=0x7f20e4011810 comp rx=0 tx=0).stop 2024-09-21T01:04:43.519 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.513+0000 7f20ed258640 1 --2- 172.21.15.1:0/331803635 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f20d40b6510 0x7f20d40b8a20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f20d8000c00 tx=0x7f20d8009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:43.520 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.513+0000 7f20f6c2d740 1 -- 172.21.15.1:0/2651669421 shutdown_connections 2024-09-21T01:04:43.520 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.513+0000 7f20f6c2d740 1 --2- 172.21.15.1:0/2651669421 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5557ddae24d0 0x5557ddeac010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:43.520 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.513+0000 7f20f6c2d740 1 --2- 172.21.15.1:0/2651669421 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557ddada2f0 0x5557ddeab4c0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:43.520 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.513+0000 7f20f6c2d740 1 --2- 172.21.15.1:0/2651669421 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557ddb031b0 0x5557ddeaae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:43.520 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.513+0000 7f20f6c2d740 1 -- 172.21.15.1:0/2651669421 >> 172.21.15.1:0/2651669421 conn(0x5557ddaf7300 msgr2=0x5557ddea68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:43.520 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.513+0000 7f20f6c2d740 1 -- 172.21.15.1:0/2651669421 shutdown_connections 2024-09-21T01:04:43.520 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.513+0000 7f20f6c2d740 1 -- 172.21.15.1:0/2651669421 wait complete. 2024-09-21T01:04:43.520 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.513+0000 7f20f6c2d740 1 -- start start 2024-09-21T01:04:43.520 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.513+0000 7f20f6c2d740 1 Processor -- start 2024-09-21T01:04:43.520 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.514+0000 7f20f6c2d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557ddada2f0 0x5557ddeb45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:43.520 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.514+0000 7f20f6c2d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557ddae24d0 0x5557ddeb4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.514+0000 7f20f6c2d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5557ddb031b0 0x5557ddeb5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.514+0000 7f20f6c2d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5557ddd44ab0 con 0x5557ddada2f0 2024-09-21T01:04:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.514+0000 7f20f6c2d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5557dddb2730 con 0x5557ddae24d0 2024-09-21T01:04:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.514+0000 7f20f6c2d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5557ddeacb30 con 0x5557ddb031b0 2024-09-21T01:04:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.514+0000 7f20f6c2d740 10 client.0 _ll_register_callbacks cb 0x5557dde066b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.514+0000 7f20eda59640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557ddada2f0 0x5557ddeb45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.514+0000 7f20eda59640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557ddada2f0 0x5557ddeb45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47224/0 (socket says 172.21.15.1:47224) 2024-09-21T01:04:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.514+0000 7f20eda59640 1 -- 172.21.15.1:0/3550582872 learned_addr learned my addr 172.21.15.1:0/3550582872 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.514+0000 7f20ed258640 1 --2- 172.21.15.1:0/3550582872 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557ddae24d0 0x5557ddeb4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.514+0000 7f20ee25a640 1 --2- 172.21.15.1:0/3550582872 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5557ddb031b0 0x5557ddeb5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.514+0000 7f20eda59640 1 -- 172.21.15.1:0/3550582872 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5557ddb031b0 msgr2=0x5557ddeb5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.514+0000 7f20eda59640 1 --2- 172.21.15.1:0/3550582872 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5557ddb031b0 0x5557ddeb5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.514+0000 7f20eda59640 1 -- 172.21.15.1:0/3550582872 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557ddae24d0 msgr2=0x5557ddeb4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.514+0000 7f20eda59640 1 --2- 172.21.15.1:0/3550582872 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557ddae24d0 0x5557ddeb4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.514+0000 7f20eda59640 1 -- 172.21.15.1:0/3550582872 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557ddb6e790 con 0x5557ddada2f0 2024-09-21T01:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.515+0000 7f20eda59640 1 --2- 172.21.15.1:0/3550582872 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557ddada2f0 0x5557ddeb45d0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f20e4000c00 tx=0x7f20e4003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fdfcd647ccc915e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.515+0000 7f20d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.515+0000 7f20d17fa640 1 -- 172.21.15.1:0/3550582872 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e4027070 con 0x5557ddada2f0 2024-09-21T01:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.515+0000 7f20d17fa640 1 -- 172.21.15.1:0/3550582872 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f20e4005040 con 0x5557ddada2f0 2024-09-21T01:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.515+0000 7f20f6c2d740 1 -- 172.21.15.1:0/3550582872 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20e40043d0 con 0x5557ddada2f0 2024-09-21T01:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.515+0000 7f20d17fa640 1 -- 172.21.15.1:0/3550582872 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f20e4033050 con 0x5557ddada2f0 2024-09-21T01:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.515+0000 7f20f6c2d740 10 client.17277 fetch_fsmap learned FSMap version 39 2024-09-21T01:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.515+0000 7f20f6c2d740 1 -- 172.21.15.1:0/3550582872 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5557ddbe7620 con 0x5557ddada2f0 2024-09-21T01:04:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.515+0000 7f20d17fa640 1 -- 172.21.15.1:0/3550582872 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20e40043d0 con 0x5557ddada2f0 2024-09-21T01:04:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.515+0000 7f20d17fa640 1 -- 172.21.15.1:0/3550582872 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 39) ==== 8398+0+0 (secure 0 0 0) 0x7f20e4004a80 con 0x5557ddada2f0 2024-09-21T01:04:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.515+0000 7f20f6c2d740 10 client.17277 fetch_fsmap finished waiting for FSMap version 39 2024-09-21T01:04:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.515+0000 7f20f6c2d740 10 client.17277 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:04:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.515+0000 7f20f6c2d740 20 client.17277 populate_metadata read hostname 'smithi001' 2024-09-21T01:04:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.515+0000 7f20f6c2d740 1 --2- 172.21.15.1:0/3550582872 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5557ddac1d80 0x5557ddec1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.516+0000 7f20f6c2d740 4 client.17277 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:04:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.516+0000 7f20f6c2d740 1 -- 172.21.15.1:0/3550582872 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5557dde1f640 con 0x5557ddac1d80 2024-09-21T01:04:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.516+0000 7f20ed258640 1 --2- 172.21.15.1:0/3550582872 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5557ddac1d80 0x5557ddec1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.516+0000 7f20ed258640 1 --2- 172.21.15.1:0/3550582872 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5557ddac1d80 0x5557ddec1c40 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a0fcffc4001c7e1 server_cookie=467d9670a44a5cec in_seq=0 out_seq=0 2024-09-21T01:04:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.516+0000 7f20d17fa640 10 client.17277 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:04:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.517+0000 7f20d17fa640 1 -- 172.21.15.1:0/3550582872 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5557dde1f640 con 0x5557ddac1d80 2024-09-21T01:04:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.517+0000 7f20d17fa640 10 client.17277 handle_command_reply: tid=0 2024-09-21T01:04:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.517+0000 7f20f6c2d740 1 client.17277 shutdown 2024-09-21T01:04:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.517+0000 7f20f6c2d740 1 -- 172.21.15.1:0/3550582872 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557ddada2f0 msgr2=0x5557ddeb45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.517+0000 7f20f6c2d740 1 --2- 172.21.15.1:0/3550582872 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557ddada2f0 0x5557ddeb45d0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f20e4000c00 tx=0x7f20e4003820 comp rx=0 tx=0).stop 2024-09-21T01:04:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.517+0000 7f20f6c2d740 1 -- 172.21.15.1:0/3550582872 shutdown_connections 2024-09-21T01:04:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.517+0000 7f20f6c2d740 1 --2- 172.21.15.1:0/3550582872 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5557ddac1d80 0x5557ddec1c40 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.517+0000 7f20f6c2d740 1 --2- 172.21.15.1:0/3550582872 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5557ddb031b0 0x5557ddeb5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.517+0000 7f20f6c2d740 1 --2- 172.21.15.1:0/3550582872 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557ddae24d0 0x5557ddeb4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.517+0000 7f20f6c2d740 1 --2- 172.21.15.1:0/3550582872 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557ddada2f0 0x5557ddeb45d0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.517+0000 7f20d17fa640 0 client.17277 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:04:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.518+0000 7f20f6c2d740 1 -- 172.21.15.1:0/3550582872 >> 172.21.15.1:0/3550582872 conn(0x5557ddaf7300 msgr2=0x5557ddea4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.518+0000 7f20f6c2d740 1 -- 172.21.15.1:0/3550582872 shutdown_connections 2024-09-21T01:04:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.518+0000 7f20f6c2d740 1 -- 172.21.15.1:0/3550582872 wait complete. 2024-09-21T01:04:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.518+0000 7f20f6c2d740 20 client.17277 trim_cache size 0 max 16384 2024-09-21T01:04:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.532+0000 7f20f6c2d740 1 Processor -- start 2024-09-21T01:04:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.532+0000 7f20f6c2d740 1 -- start start 2024-09-21T01:04:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.533+0000 7f20f6c2d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557ddada2f0 0x5557ddea6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.533+0000 7f20f6c2d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557ddae24d0 0x5557ddebc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.533+0000 7f20f6c2d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5557ddb031b0 0x5557ddea5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.533+0000 7f20f6c2d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f20e81ab040 con 0x5557ddada2f0 2024-09-21T01:04:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.533+0000 7f20f6c2d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f20e81acd00 con 0x5557ddae24d0 2024-09-21T01:04:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.533+0000 7f20f6c2d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f20e81ab740 con 0x5557ddb031b0 2024-09-21T01:04:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.533+0000 7f20eda59640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557ddada2f0 0x5557ddea6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.533+0000 7f20eda59640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557ddada2f0 0x5557ddea6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47226/0 (socket says 172.21.15.1:47226) 2024-09-21T01:04:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.533+0000 7f20eda59640 1 -- 172.21.15.1:0/3529704181 learned_addr learned my addr 172.21.15.1:0/3529704181 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.533+0000 7f20ed258640 1 --2- 172.21.15.1:0/3529704181 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557ddae24d0 0x5557ddebc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.533+0000 7f20ee25a640 1 --2- 172.21.15.1:0/3529704181 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5557ddb031b0 0x5557ddea5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.533+0000 7f20eda59640 1 -- 172.21.15.1:0/3529704181 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5557ddb031b0 msgr2=0x5557ddea5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:43.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.533+0000 7f20eda59640 1 --2- 172.21.15.1:0/3529704181 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5557ddb031b0 0x5557ddea5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:43.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.533+0000 7f20eda59640 1 -- 172.21.15.1:0/3529704181 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557ddae24d0 msgr2=0x5557ddebc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:43.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.533+0000 7f20eda59640 1 --2- 172.21.15.1:0/3529704181 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557ddae24d0 0x5557ddebc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:43.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.533+0000 7f20eda59640 1 -- 172.21.15.1:0/3529704181 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557ddea1cd0 con 0x5557ddada2f0 2024-09-21T01:04:43.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.533+0000 7f20eda59640 1 --2- 172.21.15.1:0/3529704181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557ddada2f0 0x5557ddea6220 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f20e4011850 tx=0x7f20e40197c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=741e46e18f07a109 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:43.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.533+0000 7f20d37fe640 1 -- 172.21.15.1:0/3529704181 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e403c070 con 0x5557ddada2f0 2024-09-21T01:04:43.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.533+0000 7f20d37fe640 1 -- 172.21.15.1:0/3529704181 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20e4009910 con 0x5557ddada2f0 2024-09-21T01:04:43.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.533+0000 7f20d37fe640 1 -- 172.21.15.1:0/3529704181 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e4027040 con 0x5557ddada2f0 2024-09-21T01:04:43.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.534+0000 7f20f6c2d740 1 -- 172.21.15.1:0/3529704181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557ddada2f0 msgr2=0x5557ddea6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:43.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.534+0000 7f20f6c2d740 1 --2- 172.21.15.1:0/3529704181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557ddada2f0 0x5557ddea6220 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f20e4011850 tx=0x7f20e40197c0 comp rx=0 tx=0).stop 2024-09-21T01:04:43.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.534+0000 7f20f6c2d740 1 -- 172.21.15.1:0/3529704181 shutdown_connections 2024-09-21T01:04:43.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.534+0000 7f20f6c2d740 1 --2- 172.21.15.1:0/3529704181 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5557ddb031b0 0x5557ddea5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:43.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.534+0000 7f20f6c2d740 1 --2- 172.21.15.1:0/3529704181 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557ddae24d0 0x5557ddebc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:43.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.534+0000 7f20f6c2d740 1 --2- 172.21.15.1:0/3529704181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557ddada2f0 0x5557ddea6220 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:43.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.534+0000 7f20f6c2d740 1 -- 172.21.15.1:0/3529704181 >> 172.21.15.1:0/3529704181 conn(0x5557ddaf7300 msgr2=0x5557ddea15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:43.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.534+0000 7f20f6c2d740 1 -- 172.21.15.1:0/3529704181 shutdown_connections 2024-09-21T01:04:43.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.534+0000 7f20f6c2d740 1 -- 172.21.15.1:0/3529704181 wait complete. 2024-09-21T01:04:43.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.535+0000 7f20f6c2d740 1 -- start start 2024-09-21T01:04:43.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.535+0000 7f20f6c2d740 1 Processor -- start 2024-09-21T01:04:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.535+0000 7f20f6c2d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557ddada2f0 0x5557ddebc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.535+0000 7f20f6c2d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5557ddae24d0 0x5557ddebb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.535+0000 7f20f6c2d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557ddb031b0 0x5557ddebbb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.535+0000 7f20f6c2d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f20e81ac570 con 0x5557ddada2f0 2024-09-21T01:04:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.535+0000 7f20f6c2d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f20e81abe70 con 0x5557ddb031b0 2024-09-21T01:04:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.535+0000 7f20f6c2d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f20e81a9020 con 0x5557ddae24d0 2024-09-21T01:04:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.535+0000 7f20f6c2d740 10 client.0 _ll_register_callbacks cb 0x7f20d8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.535+0000 7f20eda59640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557ddada2f0 0x5557ddebc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.535+0000 7f20eda59640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557ddada2f0 0x5557ddebc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47232/0 (socket says 172.21.15.1:47232) 2024-09-21T01:04:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.535+0000 7f20eda59640 1 -- 172.21.15.1:0/771346866 learned_addr learned my addr 172.21.15.1:0/771346866 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.535+0000 7f20ee25a640 1 --2- 172.21.15.1:0/771346866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557ddb031b0 0x5557ddebbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.535+0000 7f20ed258640 1 --2- 172.21.15.1:0/771346866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5557ddae24d0 0x5557ddebb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.536+0000 7f20eda59640 1 -- 172.21.15.1:0/771346866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5557ddae24d0 msgr2=0x5557ddebb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.536+0000 7f20eda59640 1 --2- 172.21.15.1:0/771346866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5557ddae24d0 0x5557ddebb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.536+0000 7f20eda59640 1 -- 172.21.15.1:0/771346866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557ddb031b0 msgr2=0x5557ddebbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.536+0000 7f20eda59640 1 --2- 172.21.15.1:0/771346866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557ddb031b0 0x5557ddebbb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.536+0000 7f20eda59640 1 -- 172.21.15.1:0/771346866 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557ddeb9f50 con 0x5557ddada2f0 2024-09-21T01:04:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.536+0000 7f20eda59640 1 --2- 172.21.15.1:0/771346866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557ddada2f0 0x5557ddebc660 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f20e40198d0 tx=0x7f20e4005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8cfd328c523cf9d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.536+0000 7f20d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:04:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.536+0000 7f20d17fa640 1 -- 172.21.15.1:0/771346866 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e403c070 con 0x5557ddada2f0 2024-09-21T01:04:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.536+0000 7f20d17fa640 1 -- 172.21.15.1:0/771346866 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f20e4019cc0 con 0x5557ddada2f0 2024-09-21T01:04:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.536+0000 7f20f6c2d740 1 -- 172.21.15.1:0/771346866 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20e4009910 con 0x5557ddada2f0 2024-09-21T01:04:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.536+0000 7f20d17fa640 1 -- 172.21.15.1:0/771346866 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f20e4027040 con 0x5557ddada2f0 2024-09-21T01:04:43.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.536+0000 7f20f6c2d740 10 client.17283 fetch_fsmap learned FSMap version 39 2024-09-21T01:04:43.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.536+0000 7f20f6c2d740 1 -- 172.21.15.1:0/771346866 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5557ddf2c840 con 0x5557ddada2f0 2024-09-21T01:04:43.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.536+0000 7f20d17fa640 1 -- 172.21.15.1:0/771346866 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20e4009910 con 0x5557ddada2f0 2024-09-21T01:04:43.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.536+0000 7f20d17fa640 1 -- 172.21.15.1:0/771346866 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 39) ==== 8398+0+0 (secure 0 0 0) 0x7f20e40045c0 con 0x5557ddada2f0 2024-09-21T01:04:43.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.537+0000 7f20f6c2d740 10 client.17283 fetch_fsmap finished waiting for FSMap version 39 2024-09-21T01:04:43.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.537+0000 7f20f6c2d740 10 client.17283 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:04:43.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.537+0000 7f20f6c2d740 20 client.17283 populate_metadata read hostname 'smithi001' 2024-09-21T01:04:43.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.537+0000 7f20f6c2d740 1 --2- 172.21.15.1:0/771346866 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5557dda971c0 0x5557ddf2f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:43.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.537+0000 7f20f6c2d740 4 client.17283 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:04:43.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.537+0000 7f20f6c2d740 1 -- 172.21.15.1:0/771346866 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5557dde1b0f0 con 0x5557dda971c0 2024-09-21T01:04:43.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.537+0000 7f20ed258640 1 --2- 172.21.15.1:0/771346866 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5557dda971c0 0x5557ddf2f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:43.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.537+0000 7f20d17fa640 10 client.17283 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:04:43.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.537+0000 7f20ed258640 1 --2- 172.21.15.1:0/771346866 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5557dda971c0 0x5557ddf2f260 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ef2ca042f912163 server_cookie=12a64ca17d491ff7 in_seq=0 out_seq=0 2024-09-21T01:04:43.549 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.547+0000 7f20d17fa640 1 -- 172.21.15.1:0/771346866 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5557dde1b0f0 con 0x5557dda971c0 2024-09-21T01:04:43.549 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.547+0000 7f20d17fa640 10 client.17283 handle_command_reply: tid=0 2024-09-21T01:04:43.549 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.547+0000 7f20f6c2d740 1 client.17283 shutdown 2024-09-21T01:04:43.549 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.548+0000 7f20f6c2d740 1 -- 172.21.15.1:0/771346866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557ddada2f0 msgr2=0x5557ddebc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:43.549 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.548+0000 7f20f6c2d740 1 --2- 172.21.15.1:0/771346866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557ddada2f0 0x5557ddebc660 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f20e40198d0 tx=0x7f20e4005dc0 comp rx=0 tx=0).stop 2024-09-21T01:04:43.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.548+0000 7f20f6c2d740 1 -- 172.21.15.1:0/771346866 shutdown_connections 2024-09-21T01:04:43.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.548+0000 7f20f6c2d740 1 --2- 172.21.15.1:0/771346866 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5557dda971c0 0x5557ddf2f260 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:43.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.548+0000 7f20f6c2d740 1 --2- 172.21.15.1:0/771346866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557ddb031b0 0x5557ddebbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:43.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.548+0000 7f20f6c2d740 1 --2- 172.21.15.1:0/771346866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5557ddae24d0 0x5557ddebb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:43.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.548+0000 7f20f6c2d740 1 --2- 172.21.15.1:0/771346866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5557ddada2f0 0x5557ddebc660 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:43.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.548+0000 7f20d17fa640 0 client.17283 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:04:43.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.548+0000 7f20f6c2d740 1 -- 172.21.15.1:0/771346866 >> 172.21.15.1:0/771346866 conn(0x5557ddaf7300 msgr2=0x5557ddea15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:43.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.548+0000 7f20f6c2d740 1 -- 172.21.15.1:0/771346866 shutdown_connections 2024-09-21T01:04:43.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.548+0000 7f20f6c2d740 1 -- 172.21.15.1:0/771346866 wait complete. 2024-09-21T01:04:43.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.548+0000 7f20f6c2d740 20 client.17283 trim_cache size 0 max 16384 2024-09-21T01:04:43.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T01:04:43.551 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T01:04:43.551 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T01:04:43.551 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T01:04:43.551 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.548+0000 7f20efcbd640 1 -- 172.21.15.1:0/331803635 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f20d40b6510 msgr2=0x7f20d40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.548+0000 7f20efcbd640 1 --2- 172.21.15.1:0/331803635 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f20d40b6510 0x7f20d40b8a20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f20d8000c00 tx=0x7f20d8009560 comp rx=0 tx=0).stop 2024-09-21T01:04:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.549+0000 7f20efcbd640 1 -- 172.21.15.1:0/331803635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20e8109460 msgr2=0x7f20e819b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.549+0000 7f20efcbd640 1 --2- 172.21.15.1:0/331803635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20e8109460 0x7f20e819b150 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f20e000eaa0 tx=0x7f20e000ef60 comp rx=0 tx=0).stop 2024-09-21T01:04:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.549+0000 7f20efcbd640 1 -- 172.21.15.1:0/331803635 shutdown_connections 2024-09-21T01:04:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.549+0000 7f20efcbd640 1 --2- 172.21.15.1:0/331803635 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f20d40b6510 0x7f20d40b8a20 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.549+0000 7f20efcbd640 1 --2- 172.21.15.1:0/331803635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20e8109460 0x7f20e819b150 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.549+0000 7f20efcbd640 1 --2- 172.21.15.1:0/331803635 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20e8106b00 0x7f20e819a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.549+0000 7f20efcbd640 1 --2- 172.21.15.1:0/331803635 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20e8101a70 0x7f20e8199f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.549+0000 7f20efcbd640 1 -- 172.21.15.1:0/331803635 >> 172.21.15.1:0/331803635 conn(0x7f20e80fd690 msgr2=0x7f20e81079d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.549+0000 7f20efcbd640 1 -- 172.21.15.1:0/331803635 shutdown_connections 2024-09-21T01:04:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:43.549+0000 7f20efcbd640 1 -- 172.21.15.1:0/331803635 wait complete. 2024-09-21T01:04:43.832 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:43 smithi001 ceph-mon[31211]: pgmap v583: 97 pgs: 97 active+clean; 494 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 540 op/s 2024-09-21T01:04:43.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:43 smithi193 ceph-mon[34660]: pgmap v583: 97 pgs: 97 active+clean; 494 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 540 op/s 2024-09-21T01:04:43.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:43 smithi042 ceph-mon[34481]: pgmap v583: 97 pgs: 97 active+clean; 494 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 540 op/s 2024-09-21T01:04:44.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.198+0000 7f2182fef640 1 -- 172.21.15.1:0/1535277140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f217c108340 msgr2=0x7f217c108750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:44.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.198+0000 7f2182fef640 1 --2- 172.21.15.1:0/1535277140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f217c108340 0x7f217c108750 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f216c009900 tx=0x7f216c02a410 comp rx=0 tx=0).stop 2024-09-21T01:04:44.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.199+0000 7f2182fef640 1 -- 172.21.15.1:0/1535277140 shutdown_connections 2024-09-21T01:04:44.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.199+0000 7f2182fef640 1 --2- 172.21.15.1:0/1535277140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f217c108c90 0x7f217c10f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:44.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.199+0000 7f2182fef640 1 --2- 172.21.15.1:0/1535277140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f217c108340 0x7f217c108750 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:44.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.199+0000 7f2182fef640 1 --2- 172.21.15.1:0/1535277140 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f217c1076a0 0x7f217c107ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:44.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.199+0000 7f2182fef640 1 -- 172.21.15.1:0/1535277140 >> 172.21.15.1:0/1535277140 conn(0x7f217c077800 msgr2=0x7f217c077c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:44.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.199+0000 7f2182fef640 1 -- 172.21.15.1:0/1535277140 shutdown_connections 2024-09-21T01:04:44.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.199+0000 7f2182fef640 1 -- 172.21.15.1:0/1535277140 wait complete. 2024-09-21T01:04:44.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.199+0000 7f2182fef640 1 Processor -- start 2024-09-21T01:04:44.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.199+0000 7f2182fef640 1 -- start start 2024-09-21T01:04:44.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.200+0000 7f2182fef640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f217c1076a0 0x7f217c1033f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:44.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.200+0000 7f2182fef640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f217c108340 0x7f217c103930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:44.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.200+0000 7f2182fef640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f217c108c90 0x7f217c103e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:44.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.200+0000 7f2182fef640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f217c112a00 con 0x7f217c108c90 2024-09-21T01:04:44.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.200+0000 7f2182fef640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f217c112880 con 0x7f217c1076a0 2024-09-21T01:04:44.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.200+0000 7f2182fef640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f217c112b80 con 0x7f217c108340 2024-09-21T01:04:44.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.200+0000 7f218158c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f217c108c90 0x7f217c103e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:44.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.200+0000 7f218158c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f217c108c90 0x7f217c103e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47248/0 (socket says 172.21.15.1:47248) 2024-09-21T01:04:44.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.200+0000 7f218158c640 1 -- 172.21.15.1:0/3209923709 learned_addr learned my addr 172.21.15.1:0/3209923709 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:44.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.200+0000 7f2173fff640 1 --2- 172.21.15.1:0/3209923709 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f217c108340 0x7f217c103930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:44.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.200+0000 7f2180d8b640 1 --2- 172.21.15.1:0/3209923709 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f217c1076a0 0x7f217c1033f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:44.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.200+0000 7f218158c640 1 -- 172.21.15.1:0/3209923709 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f217c108340 msgr2=0x7f217c103930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:44.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.200+0000 7f218158c640 1 --2- 172.21.15.1:0/3209923709 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f217c108340 0x7f217c103930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:44.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.200+0000 7f218158c640 1 -- 172.21.15.1:0/3209923709 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f217c1076a0 msgr2=0x7f217c1033f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:44.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.200+0000 7f218158c640 1 --2- 172.21.15.1:0/3209923709 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f217c1076a0 0x7f217c1033f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:44.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.200+0000 7f218158c640 1 -- 172.21.15.1:0/3209923709 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f217c1a8840 con 0x7f217c108c90 2024-09-21T01:04:44.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.200+0000 7f2173fff640 1 --2- 172.21.15.1:0/3209923709 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f217c108340 0x7f217c103930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:44.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.201+0000 7f218158c640 1 --2- 172.21.15.1:0/3209923709 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f217c108c90 0x7f217c103e70 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f217400eb10 tx=0x7f217400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:44.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.201+0000 7f2171ffb640 1 -- 172.21.15.1:0/3209923709 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2174004b20 con 0x7f217c108c90 2024-09-21T01:04:44.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.201+0000 7f2182fef640 1 -- 172.21.15.1:0/3209923709 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f217c1a8b30 con 0x7f217c108c90 2024-09-21T01:04:44.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.201+0000 7f2171ffb640 1 -- 172.21.15.1:0/3209923709 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2174004cc0 con 0x7f217c108c90 2024-09-21T01:04:44.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.201+0000 7f2171ffb640 1 -- 172.21.15.1:0/3209923709 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2174010670 con 0x7f217c108c90 2024-09-21T01:04:44.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.201+0000 7f2182fef640 1 -- 172.21.15.1:0/3209923709 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f217c1a9040 con 0x7f217c108c90 2024-09-21T01:04:44.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.204+0000 7f2189563740 1 Processor -- start 2024-09-21T01:04:44.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.204+0000 7f2171ffb640 1 -- 172.21.15.1:0/3209923709 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f2174010830 con 0x7f217c108c90 2024-09-21T01:04:44.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.204+0000 7f2189563740 1 -- start start 2024-09-21T01:04:44.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.205+0000 7f2189563740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e650028350 0x55e6503cf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:44.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.205+0000 7f2189563740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e64ffff490 0x55e6503cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:44.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.205+0000 7f2189563740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e650007670 0x55e6503cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:44.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.205+0000 7f2189563740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e650345e60 con 0x55e650007670 2024-09-21T01:04:44.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.205+0000 7f2189563740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e650335290 con 0x55e650028350 2024-09-21T01:04:44.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.205+0000 7f2189563740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55e6503390a0 con 0x55e64ffff490 2024-09-21T01:04:44.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.205+0000 7f2180d8b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e64ffff490 0x55e6503cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:44.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.205+0000 7f2173fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e650007670 0x55e6503cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:44.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.205+0000 7f2180d8b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e64ffff490 0x55e6503cf970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:42828/0 (socket says 172.21.15.1:42828) 2024-09-21T01:04:44.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.205+0000 7f2180d8b640 1 -- 172.21.15.1:0/3612178221 learned_addr learned my addr 172.21.15.1:0/3612178221 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:44.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.205+0000 7f2173fff640 1 --2- 172.21.15.1:0/3612178221 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e650028350 0x55e6503cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:44.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.205+0000 7f2171ffb640 1 --2- 172.21.15.1:0/3209923709 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f21640b6510 0x7f21640b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:44.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.205+0000 7f2180d8b640 1 -- 172.21.15.1:0/3612178221 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e650028350 msgr2=0x55e6503cf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:44.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.205+0000 7f2180d8b640 1 --2- 172.21.15.1:0/3612178221 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e650028350 0x55e6503cf430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:44.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.205+0000 7f2180d8b640 1 -- 172.21.15.1:0/3612178221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e650007670 msgr2=0x55e6503cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:44.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.205+0000 7f2180d8b640 1 --2- 172.21.15.1:0/3612178221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e650007670 0x55e6503cfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:44.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.205+0000 7f2180d8b640 1 -- 172.21.15.1:0/3612178221 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e650093930 con 0x55e64ffff490 2024-09-21T01:04:44.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.205+0000 7f218158c640 1 --2- 172.21.15.1:0/3209923709 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f21640b6510 0x7f21640b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:44.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.205+0000 7f2171ffb640 1 -- 172.21.15.1:0/3209923709 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f21740e7870 con 0x7f217c108c90 2024-09-21T01:04:44.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.205+0000 7f2180d8b640 1 --2- 172.21.15.1:0/3612178221 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e64ffff490 0x55e6503cf970 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2178004650 tx=0x7f217800bba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=736039a71752dddd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:44.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.206+0000 7f2162ffd640 1 -- 172.21.15.1:0/3612178221 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2178003b50 con 0x55e64ffff490 2024-09-21T01:04:44.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.206+0000 7f2162ffd640 1 -- 172.21.15.1:0/3612178221 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2178015070 con 0x55e64ffff490 2024-09-21T01:04:44.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.206+0000 7f2162ffd640 1 -- 172.21.15.1:0/3612178221 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2178004c50 con 0x55e64ffff490 2024-09-21T01:04:44.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.206+0000 7f2189563740 1 -- 172.21.15.1:0/3612178221 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e64ffff490 msgr2=0x55e6503cf970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:44.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.206+0000 7f218158c640 1 --2- 172.21.15.1:0/3209923709 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f21640b6510 0x7f21640b8a20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f21740a9fb0 tx=0x7f21740a2290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:44.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.206+0000 7f2189563740 1 --2- 172.21.15.1:0/3612178221 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e64ffff490 0x55e6503cf970 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2178004650 tx=0x7f217800bba0 comp rx=0 tx=0).stop 2024-09-21T01:04:44.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.207+0000 7f2189563740 1 -- 172.21.15.1:0/3612178221 shutdown_connections 2024-09-21T01:04:44.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.207+0000 7f2189563740 1 --2- 172.21.15.1:0/3612178221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e650007670 0x55e6503cfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:44.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.207+0000 7f2189563740 1 --2- 172.21.15.1:0/3612178221 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e64ffff490 0x55e6503cf970 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:44.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.207+0000 7f2189563740 1 --2- 172.21.15.1:0/3612178221 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e650028350 0x55e6503cf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:44.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.207+0000 7f2189563740 1 -- 172.21.15.1:0/3612178221 >> 172.21.15.1:0/3612178221 conn(0x55e65001c740 msgr2=0x55e6503cd320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:44.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.207+0000 7f2189563740 1 -- 172.21.15.1:0/3612178221 shutdown_connections 2024-09-21T01:04:44.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.207+0000 7f2189563740 1 -- 172.21.15.1:0/3612178221 wait complete. 2024-09-21T01:04:44.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.207+0000 7f2189563740 1 -- start start 2024-09-21T01:04:44.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.207+0000 7f2189563740 1 Processor -- start 2024-09-21T01:04:44.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.208+0000 7f2189563740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e64ffff490 0x55e6503dafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:44.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.208+0000 7f2189563740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e650007670 0x55e6503db4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:44.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.208+0000 7f2189563740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e650028350 0x55e6503e6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:44.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.208+0000 7f2189563740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e650196890 con 0x55e650028350 2024-09-21T01:04:44.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.208+0000 7f2189563740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e6502cfd40 con 0x55e650007670 2024-09-21T01:04:44.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.208+0000 7f2189563740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55e6503ddc10 con 0x55e64ffff490 2024-09-21T01:04:44.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.208+0000 7f2189563740 10 client.0 _ll_register_callbacks cb 0x55e650333c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:44.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.208+0000 7f2173fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e650028350 0x55e6503e6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:44.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.208+0000 7f2180d8b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e650007670 0x55e6503db4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:44.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.208+0000 7f2173fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e650028350 0x55e6503e6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47274/0 (socket says 172.21.15.1:47274) 2024-09-21T01:04:44.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.208+0000 7f2173fff640 1 -- 172.21.15.1:0/3134777158 learned_addr learned my addr 172.21.15.1:0/3134777158 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:44.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.208+0000 7f2173fff640 1 --2- 172.21.15.1:0/3134777158 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e64ffff490 0x55e6503dafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:44.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.208+0000 7f2180d8b640 1 -- 172.21.15.1:0/3134777158 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e64ffff490 msgr2=0x55e6503dafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:44.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.208+0000 7f2180d8b640 1 --2- 172.21.15.1:0/3134777158 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e64ffff490 0x55e6503dafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:44.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.208+0000 7f2180d8b640 1 -- 172.21.15.1:0/3134777158 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e650028350 msgr2=0x55e6503e6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:44.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.208+0000 7f2180d8b640 1 --2- 172.21.15.1:0/3134777158 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e650028350 0x55e6503e6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:44.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.208+0000 7f2180d8b640 1 -- 172.21.15.1:0/3134777158 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6503e74c0 con 0x55e650007670 2024-09-21T01:04:44.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.208+0000 7f2173fff640 1 --2- 172.21.15.1:0/3134777158 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e650028350 0x55e6503e6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:44.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.208+0000 7f2180d8b640 1 --2- 172.21.15.1:0/3134777158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e650007670 0x55e6503db4e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x55e6503ce0b0 tx=0x7f2178004330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1839db969c4eb85 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:44.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.208+0000 7f215bfff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:04:44.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.209+0000 7f215bfff640 1 -- 172.21.15.1:0/3134777158 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2178028060 con 0x55e650007670 2024-09-21T01:04:44.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.209+0000 7f215bfff640 1 -- 172.21.15.1:0/3134777158 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f2178011440 con 0x55e650007670 2024-09-21T01:04:44.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.209+0000 7f2189563740 1 -- 172.21.15.1:0/3134777158 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2178015070 con 0x55e650007670 2024-09-21T01:04:44.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.209+0000 7f215bfff640 1 -- 172.21.15.1:0/3134777158 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f2178011640 con 0x55e650007670 2024-09-21T01:04:44.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.209+0000 7f2189563740 10 client.26951 fetch_fsmap learned FSMap version 39 2024-09-21T01:04:44.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.209+0000 7f2189563740 1 -- 172.21.15.1:0/3134777158 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55e6503e9dd0 con 0x55e650007670 2024-09-21T01:04:44.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.209+0000 7f215bfff640 1 -- 172.21.15.1:0/3134777158 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2178015070 con 0x55e650007670 2024-09-21T01:04:44.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.209+0000 7f215bfff640 1 -- 172.21.15.1:0/3134777158 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 39) ==== 8398+0+0 (secure 0 0 0) 0x7f2178022070 con 0x55e650007670 2024-09-21T01:04:44.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.209+0000 7f2189563740 10 client.26951 fetch_fsmap finished waiting for FSMap version 39 2024-09-21T01:04:44.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.210+0000 7f2189563740 10 client.26951 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:04:44.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.210+0000 7f2189563740 20 client.26951 populate_metadata read hostname 'smithi001' 2024-09-21T01:04:44.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.210+0000 7f2189563740 1 --2- 172.21.15.1:0/3134777158 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55e64ffe6cd0 0x55e6503ed5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:44.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.210+0000 7f2189563740 4 client.26951 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:04:44.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.210+0000 7f2189563740 1 -- 172.21.15.1:0/3134777158 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e650347db0 con 0x55e64ffe6cd0 2024-09-21T01:04:44.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.210+0000 7f2173fff640 1 --2- 172.21.15.1:0/3134777158 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55e64ffe6cd0 0x55e6503ed5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:44.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.211+0000 7f215bfff640 10 client.26951 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:04:44.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.211+0000 7f2173fff640 1 --2- 172.21.15.1:0/3134777158 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55e64ffe6cd0 0x55e6503ed5e0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82c0ba906b2fef49 server_cookie=e05949b50a8aa595 in_seq=0 out_seq=0 2024-09-21T01:04:44.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.211+0000 7f215bfff640 1 -- 172.21.15.1:0/3134777158 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e650347db0 con 0x55e64ffe6cd0 2024-09-21T01:04:44.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.211+0000 7f215bfff640 10 client.26951 handle_command_reply: tid=0 2024-09-21T01:04:44.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.211+0000 7f2189563740 1 client.26951 shutdown 2024-09-21T01:04:44.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.212+0000 7f2189563740 1 -- 172.21.15.1:0/3134777158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e650007670 msgr2=0x55e6503db4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:44.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.212+0000 7f2189563740 1 --2- 172.21.15.1:0/3134777158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e650007670 0x55e6503db4e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x55e6503ce0b0 tx=0x7f2178004330 comp rx=0 tx=0).stop 2024-09-21T01:04:44.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.212+0000 7f2189563740 1 -- 172.21.15.1:0/3134777158 shutdown_connections 2024-09-21T01:04:44.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.212+0000 7f2189563740 1 --2- 172.21.15.1:0/3134777158 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55e64ffe6cd0 0x55e6503ed5e0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:44.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.212+0000 7f2189563740 1 --2- 172.21.15.1:0/3134777158 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e650028350 0x55e6503e6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:44.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.212+0000 7f2189563740 1 --2- 172.21.15.1:0/3134777158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e650007670 0x55e6503db4e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:44.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.212+0000 7f215bfff640 0 client.26951 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:04:44.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.212+0000 7f2189563740 1 --2- 172.21.15.1:0/3134777158 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e64ffff490 0x55e6503dafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:44.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.212+0000 7f2189563740 1 -- 172.21.15.1:0/3134777158 >> 172.21.15.1:0/3134777158 conn(0x55e65001c740 msgr2=0x55e6503d25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:44.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.212+0000 7f2189563740 1 -- 172.21.15.1:0/3134777158 shutdown_connections 2024-09-21T01:04:44.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.212+0000 7f2189563740 1 -- 172.21.15.1:0/3134777158 wait complete. 2024-09-21T01:04:44.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.212+0000 7f2189563740 20 client.26951 trim_cache size 0 max 16384 2024-09-21T01:04:44.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.230+0000 7f2189563740 1 Processor -- start 2024-09-21T01:04:44.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.230+0000 7f2189563740 1 -- start start 2024-09-21T01:04:44.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.230+0000 7f2189563740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e64ffe6cd0 0x55e6503e6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:44.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.230+0000 7f2189563740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e64ffff490 0x55e6503d5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:44.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.230+0000 7f2189563740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e650007670 0x55e6503d6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:44.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.230+0000 7f2189563740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f217c1b1680 con 0x55e650007670 2024-09-21T01:04:44.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.230+0000 7f2189563740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f217c1b3340 con 0x55e64ffe6cd0 2024-09-21T01:04:44.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.231+0000 7f2189563740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f217c1b1d80 con 0x55e64ffff490 2024-09-21T01:04:44.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.231+0000 7f2173fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e650007670 0x55e6503d6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:44.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.231+0000 7f2173fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e650007670 0x55e6503d6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47280/0 (socket says 172.21.15.1:47280) 2024-09-21T01:04:44.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.231+0000 7f2173fff640 1 -- 172.21.15.1:0/2986152105 learned_addr learned my addr 172.21.15.1:0/2986152105 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:44.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.231+0000 7f2173fff640 1 --2- 172.21.15.1:0/2986152105 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e64ffe6cd0 0x55e6503e6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:44.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.231+0000 7f2180d8b640 1 --2- 172.21.15.1:0/2986152105 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e64ffff490 0x55e6503d5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:44.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.231+0000 7f2173fff640 1 -- 172.21.15.1:0/2986152105 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e64ffff490 msgr2=0x55e6503d5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:44.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.231+0000 7f2173fff640 1 --2- 172.21.15.1:0/2986152105 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e64ffff490 0x55e6503d5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:44.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.231+0000 7f2173fff640 1 -- 172.21.15.1:0/2986152105 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e64ffe6cd0 msgr2=0x55e6503e6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:44.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.231+0000 7f2173fff640 1 --2- 172.21.15.1:0/2986152105 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e64ffe6cd0 0x55e6503e6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:44.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.231+0000 7f2173fff640 1 -- 172.21.15.1:0/2986152105 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6503c7520 con 0x55e650007670 2024-09-21T01:04:44.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.231+0000 7f2173fff640 1 --2- 172.21.15.1:0/2986152105 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e650007670 0x55e6503d6490 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f216c032af0 tx=0x7f216c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a86509ce61507d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:44.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.231+0000 7f21627fc640 1 -- 172.21.15.1:0/2986152105 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c035040 con 0x55e650007670 2024-09-21T01:04:44.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.232+0000 7f21627fc640 1 -- 172.21.15.1:0/2986152105 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f216c0054d0 con 0x55e650007670 2024-09-21T01:04:44.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.232+0000 7f21627fc640 1 -- 172.21.15.1:0/2986152105 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c0035f0 con 0x55e650007670 2024-09-21T01:04:44.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.232+0000 7f2189563740 1 -- 172.21.15.1:0/2986152105 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e650007670 msgr2=0x55e6503d6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:44.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.232+0000 7f2189563740 1 --2- 172.21.15.1:0/2986152105 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e650007670 0x55e6503d6490 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f216c032af0 tx=0x7f216c02a410 comp rx=0 tx=0).stop 2024-09-21T01:04:44.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.232+0000 7f2189563740 1 -- 172.21.15.1:0/2986152105 shutdown_connections 2024-09-21T01:04:44.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.232+0000 7f2189563740 1 --2- 172.21.15.1:0/2986152105 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e650007670 0x55e6503d6490 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:44.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.232+0000 7f2189563740 1 --2- 172.21.15.1:0/2986152105 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e64ffff490 0x55e6503d5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:44.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.232+0000 7f2189563740 1 --2- 172.21.15.1:0/2986152105 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e64ffe6cd0 0x55e6503e6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:44.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.232+0000 7f2189563740 1 -- 172.21.15.1:0/2986152105 >> 172.21.15.1:0/2986152105 conn(0x55e65001c740 msgr2=0x55e6503dafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:44.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.233+0000 7f2189563740 1 -- 172.21.15.1:0/2986152105 shutdown_connections 2024-09-21T01:04:44.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.233+0000 7f2189563740 1 -- 172.21.15.1:0/2986152105 wait complete. 2024-09-21T01:04:44.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.233+0000 7f2189563740 1 -- start start 2024-09-21T01:04:44.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.233+0000 7f2189563740 1 Processor -- start 2024-09-21T01:04:44.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.233+0000 7f2189563740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e64ffe6cd0 0x55e6503e3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:44.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.233+0000 7f2189563740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e64ffff490 0x55e6503dead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:44.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.233+0000 7f2189563740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e650007670 0x55e6503df010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:44.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.233+0000 7f2189563740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f217c1b2bb0 con 0x55e64ffe6cd0 2024-09-21T01:04:44.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.233+0000 7f2189563740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f217c1b24b0 con 0x55e650007670 2024-09-21T01:04:44.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.233+0000 7f2189563740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f217c1af660 con 0x55e64ffff490 2024-09-21T01:04:44.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.234+0000 7f2189563740 10 client.0 _ll_register_callbacks cb 0x7f216c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:44.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.234+0000 7f2173fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e64ffe6cd0 0x55e6503e3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:44.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.234+0000 7f2173fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e64ffe6cd0 0x55e6503e3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47294/0 (socket says 172.21.15.1:47294) 2024-09-21T01:04:44.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.234+0000 7f2173fff640 1 -- 172.21.15.1:0/2860913229 learned_addr learned my addr 172.21.15.1:0/2860913229 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:44.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.234+0000 7f2180d8b640 1 --2- 172.21.15.1:0/2860913229 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e64ffff490 0x55e6503dead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:44.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.234+0000 7f2173fff640 1 --2- 172.21.15.1:0/2860913229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e650007670 0x55e6503df010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:44.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.234+0000 7f2173fff640 1 -- 172.21.15.1:0/2860913229 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e64ffff490 msgr2=0x55e6503dead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:44.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.234+0000 7f2173fff640 1 --2- 172.21.15.1:0/2860913229 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e64ffff490 0x55e6503dead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:44.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.234+0000 7f2173fff640 1 -- 172.21.15.1:0/2860913229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e650007670 msgr2=0x55e6503df010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:44.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.234+0000 7f2173fff640 1 --2- 172.21.15.1:0/2860913229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e650007670 0x55e6503df010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:44.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.234+0000 7f2173fff640 1 -- 172.21.15.1:0/2860913229 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6503d2290 con 0x55e64ffe6cd0 2024-09-21T01:04:44.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.234+0000 7f2173fff640 1 --2- 172.21.15.1:0/2860913229 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e64ffe6cd0 0x55e6503e3620 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f216c001eb0 tx=0x7f216c0092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=485f852fccc51f10 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:44.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.234+0000 7f215bfff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:04:44.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.234+0000 7f215bfff640 1 -- 172.21.15.1:0/2860913229 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c035070 con 0x55e64ffe6cd0 2024-09-21T01:04:44.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.234+0000 7f215bfff640 1 -- 172.21.15.1:0/2860913229 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f216c004f00 con 0x55e64ffe6cd0 2024-09-21T01:04:44.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.234+0000 7f2189563740 1 -- 172.21.15.1:0/2860913229 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f216c0054d0 con 0x55e64ffe6cd0 2024-09-21T01:04:44.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.235+0000 7f215bfff640 1 -- 172.21.15.1:0/2860913229 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f216c005100 con 0x55e64ffe6cd0 2024-09-21T01:04:44.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.235+0000 7f2189563740 10 client.17301 fetch_fsmap learned FSMap version 39 2024-09-21T01:04:44.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.235+0000 7f2189563740 1 -- 172.21.15.1:0/2860913229 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55e650457d40 con 0x55e64ffe6cd0 2024-09-21T01:04:44.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.235+0000 7f215bfff640 1 -- 172.21.15.1:0/2860913229 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f216c0054d0 con 0x55e64ffe6cd0 2024-09-21T01:04:44.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.235+0000 7f215bfff640 1 -- 172.21.15.1:0/2860913229 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 39) ==== 8398+0+0 (secure 0 0 0) 0x7f216c03d450 con 0x55e64ffe6cd0 2024-09-21T01:04:44.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.235+0000 7f2189563740 10 client.17301 fetch_fsmap finished waiting for FSMap version 39 2024-09-21T01:04:44.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.235+0000 7f2189563740 10 client.17301 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:04:44.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.235+0000 7f2189563740 20 client.17301 populate_metadata read hostname 'smithi001' 2024-09-21T01:04:44.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.235+0000 7f2189563740 1 --2- 172.21.15.1:0/2860913229 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55e650028350 0x55e65045a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:44.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.235+0000 7f2189563740 4 client.17301 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T01:04:44.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.235+0000 7f2189563740 1 -- 172.21.15.1:0/2860913229 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e650343860 con 0x55e650028350 2024-09-21T01:04:44.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.235+0000 7f2180d8b640 1 --2- 172.21.15.1:0/2860913229 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55e650028350 0x55e65045a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:44.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.236+0000 7f2180d8b640 1 --2- 172.21.15.1:0/2860913229 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55e650028350 0x55e65045a4e0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e10723dcb36dec32 server_cookie=770f32fbb17d7337 in_seq=0 out_seq=0 2024-09-21T01:04:44.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.236+0000 7f215bfff640 10 client.17301 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:04:44.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.238+0000 7f215bfff640 1 -- 172.21.15.1:0/2860913229 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e650343860 con 0x55e650028350 2024-09-21T01:04:44.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.238+0000 7f215bfff640 10 client.17301 handle_command_reply: tid=0 2024-09-21T01:04:44.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.238+0000 7f2189563740 1 client.17301 shutdown 2024-09-21T01:04:44.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.238+0000 7f2189563740 1 -- 172.21.15.1:0/2860913229 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e64ffe6cd0 msgr2=0x55e6503e3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:44.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.238+0000 7f2189563740 1 --2- 172.21.15.1:0/2860913229 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e64ffe6cd0 0x55e6503e3620 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f216c001eb0 tx=0x7f216c0092d0 comp rx=0 tx=0).stop 2024-09-21T01:04:44.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.238+0000 7f2189563740 1 -- 172.21.15.1:0/2860913229 shutdown_connections 2024-09-21T01:04:44.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.238+0000 7f2189563740 1 --2- 172.21.15.1:0/2860913229 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55e650028350 0x55e65045a4e0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:44.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.238+0000 7f2189563740 1 --2- 172.21.15.1:0/2860913229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e650007670 0x55e6503df010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:44.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.238+0000 7f2189563740 1 --2- 172.21.15.1:0/2860913229 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e64ffff490 0x55e6503dead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:44.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.238+0000 7f2189563740 1 --2- 172.21.15.1:0/2860913229 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e64ffe6cd0 0x55e6503e3620 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:44.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.238+0000 7f2189563740 1 -- 172.21.15.1:0/2860913229 >> 172.21.15.1:0/2860913229 conn(0x55e65001c740 msgr2=0x55e6503daf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:44.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.238+0000 7f215bfff640 0 client.17301 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:04:44.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.238+0000 7f2189563740 1 -- 172.21.15.1:0/2860913229 shutdown_connections 2024-09-21T01:04:44.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.238+0000 7f2189563740 1 -- 172.21.15.1:0/2860913229 wait complete. 2024-09-21T01:04:44.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.238+0000 7f2189563740 20 client.17301 trim_cache size 0 max 16384 2024-09-21T01:04:44.243 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T01:04:44.244 INFO:teuthology.orchestra.run.smithi001.stdout: "return_code": 0, 2024-09-21T01:04:44.244 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_tag": "312f6066-fad3-46b9-9286-e6b009b3a330", 2024-09-21T01:04:44.244 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": "asynchronous" 2024-09-21T01:04:44.244 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T01:04:44.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.239+0000 7f2182fef640 1 -- 172.21.15.1:0/3209923709 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f21640b6510 msgr2=0x7f21640b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:44.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.239+0000 7f2182fef640 1 --2- 172.21.15.1:0/3209923709 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f21640b6510 0x7f21640b8a20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f21740a9fb0 tx=0x7f21740a2290 comp rx=0 tx=0).stop 2024-09-21T01:04:44.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.239+0000 7f2182fef640 1 -- 172.21.15.1:0/3209923709 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f217c108c90 msgr2=0x7f217c103e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:44.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.239+0000 7f2182fef640 1 --2- 172.21.15.1:0/3209923709 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f217c108c90 0x7f217c103e70 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f217400eb10 tx=0x7f217400c2d0 comp rx=0 tx=0).stop 2024-09-21T01:04:44.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.239+0000 7f2182fef640 1 -- 172.21.15.1:0/3209923709 shutdown_connections 2024-09-21T01:04:44.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.239+0000 7f2182fef640 1 --2- 172.21.15.1:0/3209923709 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f21640b6510 0x7f21640b8a20 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:44.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.239+0000 7f2182fef640 1 --2- 172.21.15.1:0/3209923709 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f217c108c90 0x7f217c103e70 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:44.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.239+0000 7f2182fef640 1 --2- 172.21.15.1:0/3209923709 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f217c108340 0x7f217c103930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:44.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.239+0000 7f2182fef640 1 --2- 172.21.15.1:0/3209923709 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f217c1076a0 0x7f217c1033f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:44.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.239+0000 7f2182fef640 1 -- 172.21.15.1:0/3209923709 >> 172.21.15.1:0/3209923709 conn(0x7f217c077800 msgr2=0x7f217c1058a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:44.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.239+0000 7f2182fef640 1 -- 172.21.15.1:0/3209923709 shutdown_connections 2024-09-21T01:04:44.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:44.239+0000 7f2182fef640 1 -- 172.21.15.1:0/3209923709 wait complete. 2024-09-21T01:04:45.038 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:04:45.339 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:04:45.721 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:45 smithi001 ceph-mon[31211]: scrub queued for path: / 2024-09-21T01:04:45.722 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:45 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:04:45.722 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:45 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:04:45.722 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:45 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:04:45.722 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:45 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:04:45.722 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:45 smithi001 ceph-mon[31211]: pgmap v584: 97 pgs: 97 active+clean; 473 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 533 op/s 2024-09-21T01:04:45.722 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:45 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:04:45.722 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:45 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:04:45.722 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:45 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:04:45.722 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:45 smithi001 ceph-mon[31211]: scrub summary: active paths [/] 2024-09-21T01:04:45.722 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:45 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:04:45.722 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:45 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:04:45.722 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:45 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:04:45.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.817+0000 7fc46ec54640 1 -- 172.21.15.1:0/983779489 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc468104880 msgr2=0x7fc468104c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:45.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.817+0000 7fc46ec54640 1 --2- 172.21.15.1:0/983779489 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc468104880 0x7fc468104c90 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fc464009900 tx=0x7fc46402a410 comp rx=0 tx=0).stop 2024-09-21T01:04:45.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.817+0000 7fc46ec54640 1 -- 172.21.15.1:0/983779489 shutdown_connections 2024-09-21T01:04:45.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.817+0000 7fc46ec54640 1 --2- 172.21.15.1:0/983779489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc46810de30 0x7fc468110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:45.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.817+0000 7fc46ec54640 1 --2- 172.21.15.1:0/983779489 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc4681052b0 0x7fc46810d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:45.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.817+0000 7fc46ec54640 1 --2- 172.21.15.1:0/983779489 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc468104880 0x7fc468104c90 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:45.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.817+0000 7fc46ec54640 1 -- 172.21.15.1:0/983779489 >> 172.21.15.1:0/983779489 conn(0x7fc468079720 msgr2=0x7fc468079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:45.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.817+0000 7fc46ec54640 1 -- 172.21.15.1:0/983779489 shutdown_connections 2024-09-21T01:04:45.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.817+0000 7fc46ec54640 1 -- 172.21.15.1:0/983779489 wait complete. 2024-09-21T01:04:45.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.818+0000 7fc46ec54640 1 Processor -- start 2024-09-21T01:04:45.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.818+0000 7fc46ec54640 1 -- start start 2024-09-21T01:04:45.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.818+0000 7fc46ec54640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc468104880 0x7fc468102790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:45.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.818+0000 7fc46ec54640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4681052b0 0x7fc468102cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:45.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.818+0000 7fc46ec54640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc46810de30 0x7fc468103210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:45.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.818+0000 7fc46ec54640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc468113ae0 con 0x7fc4681052b0 2024-09-21T01:04:45.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.818+0000 7fc46ec54640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc468113960 con 0x7fc468104880 2024-09-21T01:04:45.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.818+0000 7fc46ec54640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc468113c60 con 0x7fc46810de30 2024-09-21T01:04:45.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.818+0000 7fc45ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4681052b0 0x7fc468102cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:45.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.818+0000 7fc45ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4681052b0 0x7fc468102cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47320/0 (socket says 172.21.15.1:47320) 2024-09-21T01:04:45.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.818+0000 7fc45ffff640 1 -- 172.21.15.1:0/2574096150 learned_addr learned my addr 172.21.15.1:0/2574096150 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:45.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.818+0000 7fc46c9f0640 1 --2- 172.21.15.1:0/2574096150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc468104880 0x7fc468102790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:45.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.818+0000 7fc46d1f1640 1 --2- 172.21.15.1:0/2574096150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc46810de30 0x7fc468103210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:45.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.819+0000 7fc45ffff640 1 -- 172.21.15.1:0/2574096150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc46810de30 msgr2=0x7fc468103210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:45.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.819+0000 7fc45ffff640 1 --2- 172.21.15.1:0/2574096150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc46810de30 0x7fc468103210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:45.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.819+0000 7fc45ffff640 1 -- 172.21.15.1:0/2574096150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc468104880 msgr2=0x7fc468102790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:45.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.819+0000 7fc45ffff640 1 --2- 172.21.15.1:0/2574096150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc468104880 0x7fc468102790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:45.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.819+0000 7fc45ffff640 1 -- 172.21.15.1:0/2574096150 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4681a8770 con 0x7fc4681052b0 2024-09-21T01:04:45.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.819+0000 7fc46c9f0640 1 --2- 172.21.15.1:0/2574096150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc468104880 0x7fc468102790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:45.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.819+0000 7fc45ffff640 1 --2- 172.21.15.1:0/2574096150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4681052b0 0x7fc468102cd0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc458005d00 tx=0x7fc45800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:45.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.819+0000 7fc45dffb640 1 -- 172.21.15.1:0/2574096150 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc458017070 con 0x7fc4681052b0 2024-09-21T01:04:45.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.819+0000 7fc45dffb640 1 -- 172.21.15.1:0/2574096150 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc458009c30 con 0x7fc4681052b0 2024-09-21T01:04:45.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.819+0000 7fc45dffb640 1 -- 172.21.15.1:0/2574096150 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc45800f620 con 0x7fc4681052b0 2024-09-21T01:04:45.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.819+0000 7fc46ec54640 1 -- 172.21.15.1:0/2574096150 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4681a8a60 con 0x7fc4681052b0 2024-09-21T01:04:45.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.819+0000 7fc46ec54640 1 -- 172.21.15.1:0/2574096150 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4681a8f20 con 0x7fc4681052b0 2024-09-21T01:04:45.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.822+0000 7fc4751c8740 1 Processor -- start 2024-09-21T01:04:45.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.822+0000 7fc4751c8740 1 -- start start 2024-09-21T01:04:45.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.822+0000 7fc45dffb640 1 -- 172.21.15.1:0/2574096150 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7fc45801a070 con 0x7fc4681052b0 2024-09-21T01:04:45.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.822+0000 7fc4751c8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560865663070 0x560865a0a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:45.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.823+0000 7fc4751c8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56086563a1b0 0x560865a0ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:45.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.823+0000 7fc4751c8740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560865642390 0x560865a0b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:45.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.823+0000 7fc4751c8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560865980e50 con 0x560865663070 2024-09-21T01:04:45.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.823+0000 7fc4751c8740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560865970280 con 0x560865642390 2024-09-21T01:04:45.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.823+0000 7fc4751c8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560865974090 con 0x56086563a1b0 2024-09-21T01:04:45.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.823+0000 7fc46d1f1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560865663070 0x560865a0a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:45.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.823+0000 7fc46d1f1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560865663070 0x560865a0a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47336/0 (socket says 172.21.15.1:47336) 2024-09-21T01:04:45.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.823+0000 7fc46d1f1640 1 -- 172.21.15.1:0/2362067010 learned_addr learned my addr 172.21.15.1:0/2362067010 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:45.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.823+0000 7fc45ffff640 1 --2- 172.21.15.1:0/2362067010 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560865642390 0x560865a0b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:45.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.823+0000 7fc46c9f0640 1 --2- 172.21.15.1:0/2362067010 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56086563a1b0 0x560865a0ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:45.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.823+0000 7fc46d1f1640 1 -- 172.21.15.1:0/2362067010 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56086563a1b0 msgr2=0x560865a0ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:45.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.823+0000 7fc46d1f1640 1 --2- 172.21.15.1:0/2362067010 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56086563a1b0 0x560865a0ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:45.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.823+0000 7fc46d1f1640 1 -- 172.21.15.1:0/2362067010 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560865642390 msgr2=0x560865a0b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:45.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.823+0000 7fc46d1f1640 1 --2- 172.21.15.1:0/2362067010 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560865642390 0x560865a0b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:45.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.823+0000 7fc46d1f1640 1 -- 172.21.15.1:0/2362067010 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608656ce650 con 0x560865663070 2024-09-21T01:04:45.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.823+0000 7fc46d1f1640 1 --2- 172.21.15.1:0/2362067010 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560865663070 0x560865a0a650 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fc460009fc0 tx=0x7fc460010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4683144ff54a1e0d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:45.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.824+0000 7fc44effd640 1 -- 172.21.15.1:0/2362067010 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc460003b70 con 0x560865663070 2024-09-21T01:04:45.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.824+0000 7fc45dffb640 1 --2- 172.21.15.1:0/2574096150 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc4500b6510 0x7fc4500b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:45.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.824+0000 7fc44effd640 1 -- 172.21.15.1:0/2362067010 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc460003d10 con 0x560865663070 2024-09-21T01:04:45.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.824+0000 7fc44effd640 1 -- 172.21.15.1:0/2362067010 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc460011a40 con 0x560865663070 2024-09-21T01:04:45.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.824+0000 7fc46c9f0640 1 --2- 172.21.15.1:0/2574096150 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc4500b6510 0x7fc4500b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:45.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.824+0000 7fc45dffb640 1 -- 172.21.15.1:0/2574096150 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fc4580e6d80 con 0x7fc4681052b0 2024-09-21T01:04:45.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.825+0000 7fc4751c8740 1 -- 172.21.15.1:0/2362067010 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560865663070 msgr2=0x560865a0a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:45.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.825+0000 7fc46c9f0640 1 --2- 172.21.15.1:0/2574096150 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc4500b6510 0x7fc4500b8a20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc464005ab0 tx=0x7fc464005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:45.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.825+0000 7fc4751c8740 1 --2- 172.21.15.1:0/2362067010 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560865663070 0x560865a0a650 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fc460009fc0 tx=0x7fc460010860 comp rx=0 tx=0).stop 2024-09-21T01:04:45.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.825+0000 7fc4751c8740 1 -- 172.21.15.1:0/2362067010 shutdown_connections 2024-09-21T01:04:45.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.825+0000 7fc4751c8740 1 --2- 172.21.15.1:0/2362067010 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560865642390 0x560865a0b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:45.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.825+0000 7fc4751c8740 1 --2- 172.21.15.1:0/2362067010 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56086563a1b0 0x560865a0ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:45.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.825+0000 7fc4751c8740 1 --2- 172.21.15.1:0/2362067010 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560865663070 0x560865a0a650 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:45.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.825+0000 7fc4751c8740 1 -- 172.21.15.1:0/2362067010 >> 172.21.15.1:0/2362067010 conn(0x560865657460 msgr2=0x560865a08540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:45.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.825+0000 7fc4751c8740 1 -- 172.21.15.1:0/2362067010 shutdown_connections 2024-09-21T01:04:45.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.825+0000 7fc4751c8740 1 -- 172.21.15.1:0/2362067010 wait complete. 2024-09-21T01:04:45.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.825+0000 7fc4751c8740 1 -- start start 2024-09-21T01:04:45.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.825+0000 7fc4751c8740 1 Processor -- start 2024-09-21T01:04:45.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.826+0000 7fc4751c8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56086563a1b0 0x560865a15cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:45.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.826+0000 7fc4751c8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560865642390 0x560865a16210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:45.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.826+0000 7fc4751c8740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560865663070 0x560865a22120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:45.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.826+0000 7fc4751c8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5608657d1700 con 0x56086563a1b0 2024-09-21T01:04:45.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.826+0000 7fc4751c8740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56086590b110 con 0x560865663070 2024-09-21T01:04:45.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.826+0000 7fc4751c8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560865a18e30 con 0x560865642390 2024-09-21T01:04:45.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.826+0000 7fc4751c8740 10 client.0 _ll_register_callbacks cb 0x560865924990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:45.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.826+0000 7fc46c9f0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56086563a1b0 0x560865a15cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:45.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.826+0000 7fc46c9f0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56086563a1b0 0x560865a15cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47342/0 (socket says 172.21.15.1:47342) 2024-09-21T01:04:45.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.826+0000 7fc46c9f0640 1 -- 172.21.15.1:0/1344535503 learned_addr learned my addr 172.21.15.1:0/1344535503 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:45.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.826+0000 7fc46d1f1640 1 --2- 172.21.15.1:0/1344535503 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560865663070 0x560865a22120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:45.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.826+0000 7fc45ffff640 1 --2- 172.21.15.1:0/1344535503 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560865642390 0x560865a16210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:45.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.826+0000 7fc46d1f1640 1 -- 172.21.15.1:0/1344535503 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560865642390 msgr2=0x560865a16210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:45.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.826+0000 7fc46d1f1640 1 --2- 172.21.15.1:0/1344535503 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560865642390 0x560865a16210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:45.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.826+0000 7fc46d1f1640 1 -- 172.21.15.1:0/1344535503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56086563a1b0 msgr2=0x560865a15cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:45.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.826+0000 7fc46d1f1640 1 --2- 172.21.15.1:0/1344535503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56086563a1b0 0x560865a15cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:45.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.826+0000 7fc46d1f1640 1 -- 172.21.15.1:0/1344535503 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560865938c40 con 0x560865663070 2024-09-21T01:04:45.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.827+0000 7fc46c9f0640 1 --2- 172.21.15.1:0/1344535503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56086563a1b0 0x560865a15cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:45.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.827+0000 7fc46d1f1640 1 --2- 172.21.15.1:0/1344535503 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560865663070 0x560865a22120 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc460009f90 tx=0x7fc460004840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3afd49052995abe6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:45.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.827+0000 7fc447fff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:04:45.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.827+0000 7fc447fff640 1 -- 172.21.15.1:0/1344535503 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc460004cd0 con 0x560865663070 2024-09-21T01:04:45.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.827+0000 7fc4751c8740 1 -- 172.21.15.1:0/1344535503 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc460003d10 con 0x560865663070 2024-09-21T01:04:45.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.827+0000 7fc447fff640 1 -- 172.21.15.1:0/1344535503 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fc460011740 con 0x560865663070 2024-09-21T01:04:45.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.827+0000 7fc447fff640 1 -- 172.21.15.1:0/1344535503 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fc460011940 con 0x560865663070 2024-09-21T01:04:45.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.827+0000 7fc4751c8740 10 client.26969 fetch_fsmap learned FSMap version 39 2024-09-21T01:04:45.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.827+0000 7fc4751c8740 1 -- 172.21.15.1:0/1344535503 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x560865a24b00 con 0x560865663070 2024-09-21T01:04:45.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.827+0000 7fc447fff640 1 -- 172.21.15.1:0/1344535503 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc460003d10 con 0x560865663070 2024-09-21T01:04:45.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.828+0000 7fc447fff640 1 -- 172.21.15.1:0/1344535503 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 39) ==== 8398+0+0 (secure 0 0 0) 0x7fc460005040 con 0x560865663070 2024-09-21T01:04:45.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.828+0000 7fc4751c8740 10 client.26969 fetch_fsmap finished waiting for FSMap version 39 2024-09-21T01:04:45.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.828+0000 7fc4751c8740 10 client.26969 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:04:45.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.828+0000 7fc4751c8740 20 client.26969 populate_metadata read hostname 'smithi001' 2024-09-21T01:04:45.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.828+0000 7fc4751c8740 1 --2- 172.21.15.1:0/1344535503 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5608656219f0 0x560865a27f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:45.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.828+0000 7fc4751c8740 4 client.26969 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:04:45.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.828+0000 7fc4751c8740 1 -- 172.21.15.1:0/1344535503 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560865982da0 con 0x5608656219f0 2024-09-21T01:04:45.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.828+0000 7fc46c9f0640 1 --2- 172.21.15.1:0/1344535503 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5608656219f0 0x560865a27f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:45.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.829+0000 7fc447fff640 10 client.26969 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:04:45.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.829+0000 7fc46c9f0640 1 --2- 172.21.15.1:0/1344535503 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5608656219f0 0x560865a27f70 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=276c58f7d6dce29 server_cookie=a008f67658b85174 in_seq=0 out_seq=0 2024-09-21T01:04:45.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.829+0000 7fc447fff640 1 -- 172.21.15.1:0/1344535503 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560865982da0 con 0x5608656219f0 2024-09-21T01:04:45.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.829+0000 7fc447fff640 10 client.26969 handle_command_reply: tid=0 2024-09-21T01:04:45.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.829+0000 7fc4751c8740 1 client.26969 shutdown 2024-09-21T01:04:45.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.829+0000 7fc4751c8740 1 -- 172.21.15.1:0/1344535503 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560865663070 msgr2=0x560865a22120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:45.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.829+0000 7fc4751c8740 1 --2- 172.21.15.1:0/1344535503 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560865663070 0x560865a22120 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc460009f90 tx=0x7fc460004840 comp rx=0 tx=0).stop 2024-09-21T01:04:45.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.829+0000 7fc4751c8740 1 -- 172.21.15.1:0/1344535503 shutdown_connections 2024-09-21T01:04:45.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.830+0000 7fc4751c8740 1 --2- 172.21.15.1:0/1344535503 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5608656219f0 0x560865a27f70 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:45.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.830+0000 7fc4751c8740 1 --2- 172.21.15.1:0/1344535503 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560865663070 0x560865a22120 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:45.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.830+0000 7fc447fff640 0 client.26969 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:04:45.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.830+0000 7fc4751c8740 1 --2- 172.21.15.1:0/1344535503 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560865642390 0x560865a16210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:45.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.830+0000 7fc4751c8740 1 --2- 172.21.15.1:0/1344535503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56086563a1b0 0x560865a15cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:45.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.830+0000 7fc4751c8740 1 -- 172.21.15.1:0/1344535503 >> 172.21.15.1:0/1344535503 conn(0x560865657460 msgr2=0x560865a0d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:45.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.830+0000 7fc4751c8740 1 -- 172.21.15.1:0/1344535503 shutdown_connections 2024-09-21T01:04:45.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.830+0000 7fc4751c8740 1 -- 172.21.15.1:0/1344535503 wait complete. 2024-09-21T01:04:45.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.830+0000 7fc4751c8740 20 client.26969 trim_cache size 0 max 16384 2024-09-21T01:04:45.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.848+0000 7fc4751c8740 1 Processor -- start 2024-09-21T01:04:45.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.848+0000 7fc4751c8740 1 -- start start 2024-09-21T01:04:45.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.848+0000 7fc4751c8740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56086563a1b0 0x560865a16190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:45.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.848+0000 7fc4751c8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560865642390 0x560865a22020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:45.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.848+0000 7fc4751c8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560865663070 0x560865a12ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:45.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.848+0000 7fc4751c8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc4681b1680 con 0x560865642390 2024-09-21T01:04:45.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.848+0000 7fc4751c8740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc4681b3340 con 0x56086563a1b0 2024-09-21T01:04:45.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.848+0000 7fc4751c8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc4681b1d80 con 0x560865663070 2024-09-21T01:04:45.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.848+0000 7fc45ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560865642390 0x560865a22020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:45.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.848+0000 7fc45ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560865642390 0x560865a22020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47344/0 (socket says 172.21.15.1:47344) 2024-09-21T01:04:45.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.848+0000 7fc46c9f0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56086563a1b0 0x560865a16190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:45.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.848+0000 7fc45ffff640 1 -- 172.21.15.1:0/266517488 learned_addr learned my addr 172.21.15.1:0/266517488 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:45.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.848+0000 7fc46d1f1640 1 --2- 172.21.15.1:0/266517488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560865663070 0x560865a12ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:45.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.848+0000 7fc45ffff640 1 -- 172.21.15.1:0/266517488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560865663070 msgr2=0x560865a12ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:45.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.848+0000 7fc45ffff640 1 --2- 172.21.15.1:0/266517488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560865663070 0x560865a12ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:45.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.848+0000 7fc45ffff640 1 -- 172.21.15.1:0/266517488 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56086563a1b0 msgr2=0x560865a16190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:45.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.848+0000 7fc45ffff640 1 --2- 172.21.15.1:0/266517488 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56086563a1b0 0x560865a16190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:45.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.848+0000 7fc45ffff640 1 -- 172.21.15.1:0/266517488 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560865a14c30 con 0x560865642390 2024-09-21T01:04:45.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.849+0000 7fc46c9f0640 1 --2- 172.21.15.1:0/266517488 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56086563a1b0 0x560865a16190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:45.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.849+0000 7fc45ffff640 1 --2- 172.21.15.1:0/266517488 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560865642390 0x560865a22020 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fc4580acbf0 tx=0x7fc4580ea860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30514b1b10ef3baa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:45.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.849+0000 7fc44e7fc640 1 -- 172.21.15.1:0/266517488 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc458021070 con 0x560865642390 2024-09-21T01:04:45.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.849+0000 7fc44e7fc640 1 -- 172.21.15.1:0/266517488 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4580aca00 con 0x560865642390 2024-09-21T01:04:45.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.849+0000 7fc44e7fc640 1 -- 172.21.15.1:0/266517488 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4580a8aa0 con 0x560865642390 2024-09-21T01:04:45.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.850+0000 7fc4751c8740 1 -- 172.21.15.1:0/266517488 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560865642390 msgr2=0x560865a22020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:45.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.850+0000 7fc4751c8740 1 --2- 172.21.15.1:0/266517488 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560865642390 0x560865a22020 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fc4580acbf0 tx=0x7fc4580ea860 comp rx=0 tx=0).stop 2024-09-21T01:04:45.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.850+0000 7fc4751c8740 1 -- 172.21.15.1:0/266517488 shutdown_connections 2024-09-21T01:04:45.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.850+0000 7fc4751c8740 1 --2- 172.21.15.1:0/266517488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560865663070 0x560865a12ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:45.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.850+0000 7fc4751c8740 1 --2- 172.21.15.1:0/266517488 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560865642390 0x560865a22020 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:45.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.850+0000 7fc4751c8740 1 --2- 172.21.15.1:0/266517488 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56086563a1b0 0x560865a16190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:45.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.850+0000 7fc4751c8740 1 -- 172.21.15.1:0/266517488 >> 172.21.15.1:0/266517488 conn(0x560865657460 msgr2=0x560865a15a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:45.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.850+0000 7fc4751c8740 1 -- 172.21.15.1:0/266517488 shutdown_connections 2024-09-21T01:04:45.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.850+0000 7fc4751c8740 1 -- 172.21.15.1:0/266517488 wait complete. 2024-09-21T01:04:45.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.850+0000 7fc4751c8740 1 -- start start 2024-09-21T01:04:45.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.850+0000 7fc4751c8740 1 Processor -- start 2024-09-21T01:04:45.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.851+0000 7fc4751c8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56086563a1b0 0x560865a1e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:45.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.851+0000 7fc4751c8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560865642390 0x560865a19e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:45.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.851+0000 7fc4751c8740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560865663070 0x560865a1a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:45.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.851+0000 7fc4751c8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc4681b2bb0 con 0x56086563a1b0 2024-09-21T01:04:45.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.851+0000 7fc4751c8740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc4681b24b0 con 0x560865663070 2024-09-21T01:04:45.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.851+0000 7fc4751c8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc4681af660 con 0x560865642390 2024-09-21T01:04:45.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.851+0000 7fc4751c8740 10 client.0 _ll_register_callbacks cb 0x7fc4580ea730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:45.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.851+0000 7fc46c9f0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56086563a1b0 0x560865a1e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:45.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.851+0000 7fc46c9f0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56086563a1b0 0x560865a1e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47358/0 (socket says 172.21.15.1:47358) 2024-09-21T01:04:45.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.851+0000 7fc46c9f0640 1 -- 172.21.15.1:0/3732877394 learned_addr learned my addr 172.21.15.1:0/3732877394 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:45.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.851+0000 7fc46d1f1640 1 --2- 172.21.15.1:0/3732877394 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560865663070 0x560865a1a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:45.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.851+0000 7fc45ffff640 1 --2- 172.21.15.1:0/3732877394 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560865642390 0x560865a19e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:45.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.851+0000 7fc46c9f0640 1 -- 172.21.15.1:0/3732877394 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560865642390 msgr2=0x560865a19e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:45.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.851+0000 7fc46c9f0640 1 --2- 172.21.15.1:0/3732877394 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560865642390 0x560865a19e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:45.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.851+0000 7fc46c9f0640 1 -- 172.21.15.1:0/3732877394 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560865663070 msgr2=0x560865a1a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:45.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.851+0000 7fc46c9f0640 1 --2- 172.21.15.1:0/3732877394 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560865663070 0x560865a1a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:45.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.851+0000 7fc46c9f0640 1 -- 172.21.15.1:0/3732877394 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560865a1ac20 con 0x56086563a1b0 2024-09-21T01:04:45.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.852+0000 7fc46c9f0640 1 --2- 172.21.15.1:0/3732877394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56086563a1b0 0x560865a1e960 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fc46402aa00 tx=0x7fc464009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8724b476d8f723eb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:45.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.852+0000 7fc447fff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:04:45.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.852+0000 7fc447fff640 1 -- 172.21.15.1:0/3732877394 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46405e060 con 0x56086563a1b0 2024-09-21T01:04:45.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.852+0000 7fc447fff640 1 -- 172.21.15.1:0/3732877394 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fc464004bc0 con 0x56086563a1b0 2024-09-21T01:04:45.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.852+0000 7fc4751c8740 1 -- 172.21.15.1:0/3732877394 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4580aca00 con 0x56086563a1b0 2024-09-21T01:04:45.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.852+0000 7fc447fff640 1 -- 172.21.15.1:0/3732877394 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fc464035040 con 0x56086563a1b0 2024-09-21T01:04:45.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.852+0000 7fc4751c8740 10 client.17319 fetch_fsmap learned FSMap version 39 2024-09-21T01:04:45.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.852+0000 7fc4751c8740 1 -- 172.21.15.1:0/3732877394 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x560865a927c0 con 0x56086563a1b0 2024-09-21T01:04:45.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.852+0000 7fc447fff640 1 -- 172.21.15.1:0/3732877394 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4580aca00 con 0x56086563a1b0 2024-09-21T01:04:45.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.853+0000 7fc447fff640 1 -- 172.21.15.1:0/3732877394 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 39) ==== 8398+0+0 (secure 0 0 0) 0x7fc464044070 con 0x56086563a1b0 2024-09-21T01:04:45.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.853+0000 7fc4751c8740 10 client.17319 fetch_fsmap finished waiting for FSMap version 39 2024-09-21T01:04:45.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.853+0000 7fc4751c8740 10 client.17319 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:04:45.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.853+0000 7fc4751c8740 20 client.17319 populate_metadata read hostname 'smithi001' 2024-09-21T01:04:45.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.853+0000 7fc4751c8740 1 --2- 172.21.15.1:0/3732877394 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5608655f6da0 0x560865a95020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:45.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.853+0000 7fc4751c8740 4 client.17319 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:04:45.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.853+0000 7fc4751c8740 1 -- 172.21.15.1:0/3732877394 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56086597e850 con 0x5608655f6da0 2024-09-21T01:04:45.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.853+0000 7fc45ffff640 1 --2- 172.21.15.1:0/3732877394 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5608655f6da0 0x560865a95020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:45.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.853+0000 7fc45ffff640 1 --2- 172.21.15.1:0/3732877394 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5608655f6da0 0x560865a95020 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcb985013cb3a9d5 server_cookie=d755432b60081a71 in_seq=0 out_seq=0 2024-09-21T01:04:45.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.853+0000 7fc447fff640 10 client.17319 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:04:45.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.854+0000 7fc447fff640 1 -- 172.21.15.1:0/3732877394 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3126 (crc 0 0 0) 0x56086597e850 con 0x5608655f6da0 2024-09-21T01:04:45.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.854+0000 7fc447fff640 10 client.17319 handle_command_reply: tid=0 2024-09-21T01:04:45.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.854+0000 7fc4751c8740 1 client.17319 shutdown 2024-09-21T01:04:45.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.854+0000 7fc4751c8740 1 -- 172.21.15.1:0/3732877394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56086563a1b0 msgr2=0x560865a1e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:45.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.854+0000 7fc4751c8740 1 --2- 172.21.15.1:0/3732877394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56086563a1b0 0x560865a1e960 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fc46402aa00 tx=0x7fc464009260 comp rx=0 tx=0).stop 2024-09-21T01:04:45.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.854+0000 7fc4751c8740 1 -- 172.21.15.1:0/3732877394 shutdown_connections 2024-09-21T01:04:45.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.854+0000 7fc4751c8740 1 --2- 172.21.15.1:0/3732877394 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5608655f6da0 0x560865a95020 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:45.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.854+0000 7fc4751c8740 1 --2- 172.21.15.1:0/3732877394 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560865663070 0x560865a1a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:45.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.854+0000 7fc4751c8740 1 --2- 172.21.15.1:0/3732877394 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560865642390 0x560865a19e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:45.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.854+0000 7fc4751c8740 1 --2- 172.21.15.1:0/3732877394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56086563a1b0 0x560865a1e960 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:45.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.854+0000 7fc4751c8740 1 -- 172.21.15.1:0/3732877394 >> 172.21.15.1:0/3732877394 conn(0x560865657460 msgr2=0x560865a0b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:45.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.854+0000 7fc447fff640 0 client.17319 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:04:45.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.854+0000 7fc4751c8740 1 -- 172.21.15.1:0/3732877394 shutdown_connections 2024-09-21T01:04:45.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.854+0000 7fc4751c8740 1 -- 172.21.15.1:0/3732877394 wait complete. 2024-09-21T01:04:45.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.854+0000 7fc4751c8740 20 client.17319 trim_cache size 0 max 16384 2024-09-21T01:04:45.859 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T01:04:45.859 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T01:04:45.860 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": { 2024-09-21T01:04:45.860 INFO:teuthology.orchestra.run.smithi001.stdout: "312f6066-fad3-46b9-9286-e6b009b3a330": { 2024-09-21T01:04:45.860 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:04:45.860 INFO:teuthology.orchestra.run.smithi001.stdout: "tag": "312f6066-fad3-46b9-9286-e6b009b3a330", 2024-09-21T01:04:45.860 INFO:teuthology.orchestra.run.smithi001.stdout: "options": "recursive,force" 2024-09-21T01:04:45.860 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:04:45.860 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:04:45.860 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_stats": { 2024-09-21T01:04:45.860 INFO:teuthology.orchestra.run.smithi001.stdout: "312f6066-fad3-46b9-9286-e6b009b3a330": { 2024-09-21T01:04:45.861 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:04:44.236119+0000", 2024-09-21T01:04:45.861 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:04:45.861 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:04:45.861 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:04:45.861 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:04:45.861 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:04:45.861 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:04:45.861 INFO:teuthology.orchestra.run.smithi001.stdout: "c2addc95-c922-4a70-b746-0b5fd2af59bf": { 2024-09-21T01:04:45.861 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:00:52.374848+0000", 2024-09-21T01:04:45.862 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:04:45.862 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:04:45.862 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:04:45.862 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:04:45.862 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:04:45.862 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:04:45.862 INFO:teuthology.orchestra.run.smithi001.stdout: "d9a37a97-ce14-4763-8c19-9bd32df63cf3": { 2024-09-21T01:04:45.862 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:01:45.914443+0000", 2024-09-21T01:04:45.862 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:04:45.862 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:04:45.862 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:04:45.862 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:04:45.862 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:04:45.862 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:04:45.862 INFO:teuthology.orchestra.run.smithi001.stdout: "f826f2c1-768a-47bb-b868-785b351ac6b4": { 2024-09-21T01:04:45.863 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:59:06.554657+0000", 2024-09-21T01:04:45.863 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:04:45.863 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:04:45.863 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:04:45.863 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:04:45.863 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:04:45.863 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:04:45.863 INFO:teuthology.orchestra.run.smithi001.stdout: "1bffed0d-34b1-4e8b-9cab-7501131ef79d": { 2024-09-21T01:04:45.863 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:00:02.564228+0000", 2024-09-21T01:04:45.863 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:04:45.863 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:04:45.863 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:04:45.863 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:04:45.863 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:04:45.864 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:04:45.864 INFO:teuthology.orchestra.run.smithi001.stdout: "bee49cce-b407-4617-a959-331ffd8dc5b0": { 2024-09-21T01:04:45.864 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:58:17.883027+0000", 2024-09-21T01:04:45.864 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:04:45.864 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:04:45.864 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:04:45.864 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:04:45.864 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:04:45.864 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:04:45.864 INFO:teuthology.orchestra.run.smithi001.stdout: "3d019354-f00e-4e9b-b42c-f519d1f68cd2": { 2024-09-21T01:04:45.864 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:03:25.601697+0000", 2024-09-21T01:04:45.864 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:04:45.864 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:04:45.864 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:04:45.865 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:04:45.865 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:04:45.865 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:04:45.865 INFO:teuthology.orchestra.run.smithi001.stdout: "7cb1bc3f-e2d2-4bf7-b13e-8f3371d7aac1": { 2024-09-21T01:04:45.865 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:58:02.751142+0000", 2024-09-21T01:04:45.865 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:04:45.865 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:04:45.865 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:04:45.865 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:04:45.865 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:04:45.865 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:04:45.865 INFO:teuthology.orchestra.run.smithi001.stdout: "2383a19c-993d-4440-99f7-93b43dcf33b4": { 2024-09-21T01:04:45.865 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:47.609257+0000", 2024-09-21T01:04:45.865 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:04:45.865 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:04:45.866 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:04:45.866 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:04:45.866 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:04:45.866 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:04:45.866 INFO:teuthology.orchestra.run.smithi001.stdout: "53fa74e4-5aa8-408b-9724-7c93618f7636": { 2024-09-21T01:04:45.866 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:01.730608+0000", 2024-09-21T01:04:45.866 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:04:45.866 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:04:45.866 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:04:45.866 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:04:45.866 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:04:45.866 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:04:45.866 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:04:45.866 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T01:04:45.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.855+0000 7fc46ec54640 1 -- 172.21.15.1:0/2574096150 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc4500b6510 msgr2=0x7fc4500b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:45.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.855+0000 7fc46ec54640 1 --2- 172.21.15.1:0/2574096150 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc4500b6510 0x7fc4500b8a20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc464005ab0 tx=0x7fc464005a20 comp rx=0 tx=0).stop 2024-09-21T01:04:45.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.855+0000 7fc46ec54640 1 -- 172.21.15.1:0/2574096150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4681052b0 msgr2=0x7fc468102cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:45.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.855+0000 7fc46ec54640 1 --2- 172.21.15.1:0/2574096150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4681052b0 0x7fc468102cd0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc458005d00 tx=0x7fc45800dde0 comp rx=0 tx=0).stop 2024-09-21T01:04:45.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.855+0000 7fc46ec54640 1 -- 172.21.15.1:0/2574096150 shutdown_connections 2024-09-21T01:04:45.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.855+0000 7fc46ec54640 1 --2- 172.21.15.1:0/2574096150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc46810de30 0x7fc468103210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:45.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.855+0000 7fc46ec54640 1 --2- 172.21.15.1:0/2574096150 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc4500b6510 0x7fc4500b8a20 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:45.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.855+0000 7fc46ec54640 1 --2- 172.21.15.1:0/2574096150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4681052b0 0x7fc468102cd0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:45.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.855+0000 7fc46ec54640 1 --2- 172.21.15.1:0/2574096150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc468104880 0x7fc468102790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:45.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.855+0000 7fc46ec54640 1 -- 172.21.15.1:0/2574096150 >> 172.21.15.1:0/2574096150 conn(0x7fc468079720 msgr2=0x7fc468107940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:45.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.855+0000 7fc46ec54640 1 -- 172.21.15.1:0/2574096150 shutdown_connections 2024-09-21T01:04:45.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:04:45.855+0000 7fc46ec54640 1 -- 172.21.15.1:0/2574096150 wait complete. 2024-09-21T01:04:45.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:45 smithi193 ceph-mon[34660]: scrub queued for path: / 2024-09-21T01:04:45.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:45 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:04:45.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:45 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:04:45.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:45 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:04:45.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:45 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:04:45.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:45 smithi193 ceph-mon[34660]: pgmap v584: 97 pgs: 97 active+clean; 473 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 533 op/s 2024-09-21T01:04:45.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:45 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:04:45.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:45 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:04:45.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:45 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:04:45.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:45 smithi193 ceph-mon[34660]: scrub summary: active paths [/] 2024-09-21T01:04:45.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:45 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:04:45.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:45 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:04:45.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:45 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:04:45.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:45 smithi042 ceph-mon[34481]: scrub queued for path: / 2024-09-21T01:04:45.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:45 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:04:45.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:45 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:04:45.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:45 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:04:45.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:45 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:04:45.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:45 smithi042 ceph-mon[34481]: pgmap v584: 97 pgs: 97 active+clean; 473 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 533 op/s 2024-09-21T01:04:45.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:45 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:04:45.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:45 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:04:45.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:45 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:04:45.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:45 smithi042 ceph-mon[34481]: scrub summary: active paths [/] 2024-09-21T01:04:45.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:45 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:04:45.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:45 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:04:45.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:45 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:04:46.806 INFO:tasks.cephfs.filesystem:scrub status for tag:312f6066-fad3-46b9-9286-e6b009b3a330 - {'path': '/', 'tag': '312f6066-fad3-46b9-9286-e6b009b3a330', 'options': 'recursive,force'} 2024-09-21T01:04:46.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:46 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:04:46.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:46 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:04:46.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:46 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:04:47.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:47 smithi001 ceph-mon[31211]: pgmap v585: 97 pgs: 97 active+clean; 456 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 576 op/s 2024-09-21T01:04:47.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:47 smithi193 ceph-mon[34660]: pgmap v585: 97 pgs: 97 active+clean; 456 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 576 op/s 2024-09-21T01:04:47.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:47 smithi042 ceph-mon[34481]: pgmap v585: 97 pgs: 97 active+clean; 456 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 576 op/s 2024-09-21T01:04:49.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:49 smithi001 ceph-mon[31211]: pgmap v586: 97 pgs: 97 active+clean; 457 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 539 op/s 2024-09-21T01:04:49.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:49 smithi193 ceph-mon[34660]: pgmap v586: 97 pgs: 97 active+clean; 457 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 539 op/s 2024-09-21T01:04:49.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:49 smithi042 ceph-mon[34481]: pgmap v586: 97 pgs: 97 active+clean; 457 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 539 op/s 2024-09-21T01:04:51.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:51 smithi001 ceph-mon[31211]: pgmap v587: 97 pgs: 97 active+clean; 452 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 639 op/s 2024-09-21T01:04:51.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:51 smithi193 ceph-mon[34660]: pgmap v587: 97 pgs: 97 active+clean; 452 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 639 op/s 2024-09-21T01:04:51.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:51 smithi042 ceph-mon[34481]: pgmap v587: 97 pgs: 97 active+clean; 452 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 639 op/s 2024-09-21T01:04:53.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:53 smithi001 ceph-mon[31211]: pgmap v588: 97 pgs: 97 active+clean; 443 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 668 op/s 2024-09-21T01:04:53.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:53 smithi193 ceph-mon[34660]: pgmap v588: 97 pgs: 97 active+clean; 443 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 668 op/s 2024-09-21T01:04:53.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:53 smithi042 ceph-mon[34481]: pgmap v588: 97 pgs: 97 active+clean; 443 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 668 op/s 2024-09-21T01:04:55.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:55 smithi001 ceph-mon[31211]: pgmap v589: 97 pgs: 97 active+clean; 439 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 688 op/s 2024-09-21T01:04:55.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:55 smithi193 ceph-mon[34660]: pgmap v589: 97 pgs: 97 active+clean; 439 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 688 op/s 2024-09-21T01:04:55.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:55 smithi042 ceph-mon[34481]: pgmap v589: 97 pgs: 97 active+clean; 439 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 688 op/s 2024-09-21T01:04:56.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.661+0000 7fcae9769640 1 -- 172.21.15.1:0/1021227742 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcae41025b0 msgr2=0x7fcae4102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:56.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.661+0000 7fcae9769640 1 --2- 172.21.15.1:0/1021227742 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcae41025b0 0x7fcae4102a20 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fcad4009900 tx=0x7fcad402a410 comp rx=0 tx=0).stop 2024-09-21T01:04:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.661+0000 7fcae9769640 1 -- 172.21.15.1:0/1021227742 shutdown_connections 2024-09-21T01:04:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.661+0000 7fcae9769640 1 --2- 172.21.15.1:0/1021227742 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcae4103fd0 0x7fcae410a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.661+0000 7fcae9769640 1 --2- 172.21.15.1:0/1021227742 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcae4103630 0x7fcae4103a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.661+0000 7fcae9769640 1 --2- 172.21.15.1:0/1021227742 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcae41025b0 0x7fcae4102a20 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.661+0000 7fcae9769640 1 -- 172.21.15.1:0/1021227742 >> 172.21.15.1:0/1021227742 conn(0x7fcae40fdf30 msgr2=0x7fcae41003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.661+0000 7fcae9769640 1 -- 172.21.15.1:0/1021227742 shutdown_connections 2024-09-21T01:04:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.661+0000 7fcae9769640 1 -- 172.21.15.1:0/1021227742 wait complete. 2024-09-21T01:04:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.662+0000 7fcae9769640 1 Processor -- start 2024-09-21T01:04:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.662+0000 7fcae9769640 1 -- start start 2024-09-21T01:04:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.662+0000 7fcae9769640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcae41025b0 0x7fcae419c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.662+0000 7fcae9769640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcae4103630 0x7fcae419c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.662+0000 7fcae9769640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcae4103fd0 0x7fcae419d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.662+0000 7fcae9769640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcae410e1e0 con 0x7fcae4103630 2024-09-21T01:04:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.662+0000 7fcae9769640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcae410e060 con 0x7fcae4103fd0 2024-09-21T01:04:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.662+0000 7fcae9769640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcae410e360 con 0x7fcae41025b0 2024-09-21T01:04:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.662+0000 7fcae27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcae4103630 0x7fcae419c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.662+0000 7fcae27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcae4103630 0x7fcae419c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43700/0 (socket says 172.21.15.1:43700) 2024-09-21T01:04:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.663+0000 7fcae27fc640 1 -- 172.21.15.1:0/1062541270 learned_addr learned my addr 172.21.15.1:0/1062541270 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.663+0000 7fcae37fe640 1 --2- 172.21.15.1:0/1062541270 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcae4103fd0 0x7fcae419d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.663+0000 7fcae2ffd640 1 --2- 172.21.15.1:0/1062541270 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcae41025b0 0x7fcae419c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.663+0000 7fcae27fc640 1 -- 172.21.15.1:0/1062541270 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcae41025b0 msgr2=0x7fcae419c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.663+0000 7fcae27fc640 1 --2- 172.21.15.1:0/1062541270 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcae41025b0 0x7fcae419c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.663+0000 7fcae27fc640 1 -- 172.21.15.1:0/1062541270 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcae4103fd0 msgr2=0x7fcae419d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.663+0000 7fcae27fc640 1 --2- 172.21.15.1:0/1062541270 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcae4103fd0 0x7fcae419d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.663+0000 7fcae27fc640 1 -- 172.21.15.1:0/1062541270 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcae419db70 con 0x7fcae4103630 2024-09-21T01:04:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.663+0000 7fcae27fc640 1 --2- 172.21.15.1:0/1062541270 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcae4103630 0x7fcae419c7a0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fcacc00ebc0 tx=0x7fcacc00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.663+0000 7fcadbfff640 1 -- 172.21.15.1:0/1062541270 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcacc010630 con 0x7fcae4103630 2024-09-21T01:04:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.663+0000 7fcae9769640 1 -- 172.21.15.1:0/1062541270 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcae419de60 con 0x7fcae4103630 2024-09-21T01:04:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.663+0000 7fcadbfff640 1 -- 172.21.15.1:0/1062541270 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcacc010c80 con 0x7fcae4103630 2024-09-21T01:04:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.663+0000 7fcadbfff640 1 -- 172.21.15.1:0/1062541270 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcacc018b60 con 0x7fcae4103630 2024-09-21T01:04:56.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.663+0000 7fcae9769640 1 -- 172.21.15.1:0/1062541270 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcae41a4550 con 0x7fcae4103630 2024-09-21T01:04:56.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.666+0000 7fcaf06d8740 1 Processor -- start 2024-09-21T01:04:56.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.666+0000 7fcaf06d8740 1 -- start start 2024-09-21T01:04:56.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.666+0000 7fcaf06d8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5610258411b0 0x561025be8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:56.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.666+0000 7fcaf06d8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610258182f0 0x561025be94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.666+0000 7fcaf06d8740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5610258204d0 0x561025bea010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.666+0000 7fcaf06d8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561025b5b6f0 con 0x5610258182f0 2024-09-21T01:04:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.666+0000 7fcaf06d8740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561025b4ab20 con 0x5610258204d0 2024-09-21T01:04:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.666+0000 7fcaf06d8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x561025b4e930 con 0x5610258411b0 2024-09-21T01:04:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.666+0000 7fcae2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610258182f0 0x561025be94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.666+0000 7fcae2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610258182f0 0x561025be94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43714/0 (socket says 172.21.15.1:43714) 2024-09-21T01:04:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.666+0000 7fcae2ffd640 1 -- 172.21.15.1:0/725247576 learned_addr learned my addr 172.21.15.1:0/725247576 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.666+0000 7fcadbfff640 1 -- 172.21.15.1:0/1062541270 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7fcacc018d00 con 0x7fcae4103630 2024-09-21T01:04:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.667+0000 7fcae37fe640 1 --2- 172.21.15.1:0/725247576 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5610258411b0 0x561025be8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.667+0000 7fcae27fc640 1 --2- 172.21.15.1:0/725247576 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5610258204d0 0x561025bea010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.667+0000 7fcae2ffd640 1 -- 172.21.15.1:0/725247576 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5610258411b0 msgr2=0x561025be8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.667+0000 7fcae2ffd640 1 --2- 172.21.15.1:0/725247576 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5610258411b0 0x561025be8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.667+0000 7fcae2ffd640 1 -- 172.21.15.1:0/725247576 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5610258204d0 msgr2=0x561025bea010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.667+0000 7fcae2ffd640 1 --2- 172.21.15.1:0/725247576 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5610258204d0 0x561025bea010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.667+0000 7fcae2ffd640 1 -- 172.21.15.1:0/725247576 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561025b10530 con 0x5610258182f0 2024-09-21T01:04:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.667+0000 7fcae27fc640 1 --2- 172.21.15.1:0/725247576 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5610258204d0 0x561025bea010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:04:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.667+0000 7fcae2ffd640 1 --2- 172.21.15.1:0/725247576 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610258182f0 0x561025be94c0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fcad402a930 tx=0x7fcad4009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c0e96a8b36ba57 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.667+0000 7fcad97fa640 1 -- 172.21.15.1:0/725247576 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad4035030 con 0x5610258182f0 2024-09-21T01:04:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.667+0000 7fcad97fa640 1 -- 172.21.15.1:0/725247576 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcad4040070 con 0x5610258182f0 2024-09-21T01:04:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.667+0000 7fcad97fa640 1 -- 172.21.15.1:0/725247576 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad4003970 con 0x5610258182f0 2024-09-21T01:04:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.667+0000 7fcadbfff640 1 --2- 172.21.15.1:0/1062541270 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fcad00b6510 0x7fcad00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.668+0000 7fcae37fe640 1 --2- 172.21.15.1:0/1062541270 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fcad00b6510 0x7fcad00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.668+0000 7fcadbfff640 1 -- 172.21.15.1:0/1062541270 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fcacc0e7910 con 0x7fcae4103630 2024-09-21T01:04:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.668+0000 7fcaf06d8740 1 -- 172.21.15.1:0/725247576 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610258182f0 msgr2=0x561025be94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.668+0000 7fcae37fe640 1 --2- 172.21.15.1:0/1062541270 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fcad00b6510 0x7fcad00b8a20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fcadc009cd0 tx=0x7fcadc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.668+0000 7fcaf06d8740 1 --2- 172.21.15.1:0/725247576 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610258182f0 0x561025be94c0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fcad402a930 tx=0x7fcad4009620 comp rx=0 tx=0).stop 2024-09-21T01:04:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.668+0000 7fcaf06d8740 1 -- 172.21.15.1:0/725247576 shutdown_connections 2024-09-21T01:04:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.668+0000 7fcaf06d8740 1 --2- 172.21.15.1:0/725247576 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5610258204d0 0x561025bea010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.668+0000 7fcaf06d8740 1 --2- 172.21.15.1:0/725247576 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610258182f0 0x561025be94c0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.668+0000 7fcaf06d8740 1 --2- 172.21.15.1:0/725247576 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5610258411b0 0x561025be8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.668+0000 7fcaf06d8740 1 -- 172.21.15.1:0/725247576 >> 172.21.15.1:0/725247576 conn(0x561025835300 msgr2=0x561025be48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.668+0000 7fcaf06d8740 1 -- 172.21.15.1:0/725247576 shutdown_connections 2024-09-21T01:04:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.668+0000 7fcaf06d8740 1 -- 172.21.15.1:0/725247576 wait complete. 2024-09-21T01:04:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.669+0000 7fcaf06d8740 1 -- start start 2024-09-21T01:04:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.669+0000 7fcaf06d8740 1 Processor -- start 2024-09-21T01:04:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.669+0000 7fcaf06d8740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5610258182f0 0x561025bf2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.669+0000 7fcaf06d8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5610258204d0 0x561025bf2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.669+0000 7fcaf06d8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610258411b0 0x561025bf37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.669+0000 7fcaf06d8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561025a82ab0 con 0x5610258411b0 2024-09-21T01:04:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.669+0000 7fcaf06d8740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561025af0730 con 0x5610258182f0 2024-09-21T01:04:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.669+0000 7fcaf06d8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x561025beaad0 con 0x5610258204d0 2024-09-21T01:04:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.669+0000 7fcaf06d8740 10 client.0 _ll_register_callbacks cb 0x561025b446b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.669+0000 7fcae37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610258411b0 0x561025bf37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.669+0000 7fcae2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5610258182f0 0x561025bf2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.669+0000 7fcae2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5610258182f0 0x561025bf2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:50030/0 (socket says 172.21.15.1:50030) 2024-09-21T01:04:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.669+0000 7fcae2ffd640 1 -- 172.21.15.1:0/1525759438 learned_addr learned my addr 172.21.15.1:0/1525759438 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.669+0000 7fcae37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610258411b0 0x561025bf37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43722/0 (socket says 172.21.15.1:43722) 2024-09-21T01:04:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.669+0000 7fcae27fc640 1 --2- 172.21.15.1:0/1525759438 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5610258204d0 0x561025bf2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.670+0000 7fcae2ffd640 1 -- 172.21.15.1:0/1525759438 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5610258204d0 msgr2=0x561025bf2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.670+0000 7fcae2ffd640 1 --2- 172.21.15.1:0/1525759438 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5610258204d0 0x561025bf2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.670+0000 7fcae2ffd640 1 -- 172.21.15.1:0/1525759438 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610258411b0 msgr2=0x561025bf37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.670+0000 7fcae2ffd640 1 --2- 172.21.15.1:0/1525759438 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610258411b0 0x561025bf37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.670+0000 7fcae2ffd640 1 -- 172.21.15.1:0/1525759438 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610258ac790 con 0x5610258182f0 2024-09-21T01:04:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.670+0000 7fcae27fc640 1 --2- 172.21.15.1:0/1525759438 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5610258204d0 0x561025bf2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:04:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.670+0000 7fcae37fe640 1 --2- 172.21.15.1:0/1525759438 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610258411b0 0x561025bf37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.670+0000 7fcae2ffd640 1 --2- 172.21.15.1:0/1525759438 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5610258182f0 0x561025bf2620 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcad4031950 tx=0x7fcad4031980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c0bbe3a7dbe4103 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.670+0000 7fcaca7fc640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:04:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.670+0000 7fcaca7fc640 1 -- 172.21.15.1:0/1525759438 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad4035040 con 0x5610258182f0 2024-09-21T01:04:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.670+0000 7fcaf06d8740 1 -- 172.21.15.1:0/1525759438 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcad4040070 con 0x5610258182f0 2024-09-21T01:04:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.670+0000 7fcaca7fc640 1 -- 172.21.15.1:0/1525759438 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fcad4031ad0 con 0x5610258182f0 2024-09-21T01:04:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.670+0000 7fcaca7fc640 1 -- 172.21.15.1:0/1525759438 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fcad4031cd0 con 0x5610258182f0 2024-09-21T01:04:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.670+0000 7fcaf06d8740 10 client.26984 fetch_fsmap learned FSMap version 39 2024-09-21T01:04:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.670+0000 7fcaf06d8740 1 -- 172.21.15.1:0/1525759438 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x561025925620 con 0x5610258182f0 2024-09-21T01:04:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.671+0000 7fcaca7fc640 1 -- 172.21.15.1:0/1525759438 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcad4040070 con 0x5610258182f0 2024-09-21T01:04:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.671+0000 7fcaca7fc640 1 -- 172.21.15.1:0/1525759438 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 39) ==== 8398+0+0 (secure 0 0 0) 0x7fcad40457f0 con 0x5610258182f0 2024-09-21T01:04:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.671+0000 7fcaf06d8740 10 client.26984 fetch_fsmap finished waiting for FSMap version 39 2024-09-21T01:04:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.671+0000 7fcaf06d8740 10 client.26984 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:04:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.671+0000 7fcaf06d8740 20 client.26984 populate_metadata read hostname 'smithi001' 2024-09-21T01:04:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.671+0000 7fcaf06d8740 1 --2- 172.21.15.1:0/1525759438 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5610257ffd80 0x561025bff870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.671+0000 7fcaf06d8740 4 client.26984 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:04:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.671+0000 7fcaf06d8740 1 -- 172.21.15.1:0/1525759438 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561025b5d640 con 0x5610257ffd80 2024-09-21T01:04:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.671+0000 7fcae27fc640 1 --2- 172.21.15.1:0/1525759438 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5610257ffd80 0x561025bff870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.671+0000 7fcaca7fc640 10 client.26984 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:04:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.671+0000 7fcae27fc640 1 --2- 172.21.15.1:0/1525759438 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5610257ffd80 0x561025bff870 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61c0321f9b36481e server_cookie=6acafb2cbd361626 in_seq=0 out_seq=0 2024-09-21T01:04:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.672+0000 7fcaca7fc640 1 -- 172.21.15.1:0/1525759438 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561025b5d640 con 0x5610257ffd80 2024-09-21T01:04:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.672+0000 7fcaca7fc640 10 client.26984 handle_command_reply: tid=0 2024-09-21T01:04:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.673+0000 7fcaf06d8740 1 client.26984 shutdown 2024-09-21T01:04:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.673+0000 7fcaf06d8740 1 -- 172.21.15.1:0/1525759438 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5610258182f0 msgr2=0x561025bf2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.673+0000 7fcaf06d8740 1 --2- 172.21.15.1:0/1525759438 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5610258182f0 0x561025bf2620 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcad4031950 tx=0x7fcad4031980 comp rx=0 tx=0).stop 2024-09-21T01:04:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.673+0000 7fcaf06d8740 1 -- 172.21.15.1:0/1525759438 shutdown_connections 2024-09-21T01:04:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.673+0000 7fcaf06d8740 1 --2- 172.21.15.1:0/1525759438 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5610257ffd80 0x561025bff870 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.673+0000 7fcaf06d8740 1 --2- 172.21.15.1:0/1525759438 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610258411b0 0x561025bf37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.673+0000 7fcaca7fc640 0 client.26984 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:04:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.673+0000 7fcaf06d8740 1 --2- 172.21.15.1:0/1525759438 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5610258204d0 0x561025bf2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.673+0000 7fcaf06d8740 1 --2- 172.21.15.1:0/1525759438 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5610258182f0 0x561025bf2620 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.673+0000 7fcaf06d8740 1 -- 172.21.15.1:0/1525759438 >> 172.21.15.1:0/1525759438 conn(0x561025835300 msgr2=0x561025be54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.673+0000 7fcaf06d8740 1 -- 172.21.15.1:0/1525759438 shutdown_connections 2024-09-21T01:04:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.673+0000 7fcaf06d8740 1 -- 172.21.15.1:0/1525759438 wait complete. 2024-09-21T01:04:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.673+0000 7fcaf06d8740 20 client.26984 trim_cache size 0 max 16384 2024-09-21T01:04:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.688+0000 7fcaf06d8740 1 Processor -- start 2024-09-21T01:04:56.689 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.688+0000 7fcaf06d8740 1 -- start start 2024-09-21T01:04:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.688+0000 7fcaf06d8740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5610257ffd80 0x561025be9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.688+0000 7fcaf06d8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610258182f0 0x561025bfa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.688+0000 7fcaf06d8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5610258204d0 0x561025be8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.688+0000 7fcaf06d8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcae41ad230 con 0x5610258182f0 2024-09-21T01:04:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.688+0000 7fcaf06d8740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcae41aeef0 con 0x5610257ffd80 2024-09-21T01:04:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.688+0000 7fcaf06d8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcae41ad930 con 0x5610258204d0 2024-09-21T01:04:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.688+0000 7fcae27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610258182f0 0x561025bfa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.689+0000 7fcae27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610258182f0 0x561025bfa6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43736/0 (socket says 172.21.15.1:43736) 2024-09-21T01:04:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.689+0000 7fcae2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5610257ffd80 0x561025be9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.689+0000 7fcae27fc640 1 -- 172.21.15.1:0/2643320831 learned_addr learned my addr 172.21.15.1:0/2643320831 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.689+0000 7fcae37fe640 1 --2- 172.21.15.1:0/2643320831 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5610258204d0 0x561025be8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.689+0000 7fcae27fc640 1 -- 172.21.15.1:0/2643320831 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5610258204d0 msgr2=0x561025be8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.689+0000 7fcae27fc640 1 --2- 172.21.15.1:0/2643320831 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5610258204d0 0x561025be8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.689+0000 7fcae27fc640 1 -- 172.21.15.1:0/2643320831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5610257ffd80 msgr2=0x561025be9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.689+0000 7fcae27fc640 1 --2- 172.21.15.1:0/2643320831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5610257ffd80 0x561025be9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.689+0000 7fcae27fc640 1 -- 172.21.15.1:0/2643320831 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561025bf3140 con 0x5610258182f0 2024-09-21T01:04:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.689+0000 7fcae37fe640 1 --2- 172.21.15.1:0/2643320831 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5610258204d0 0x561025be8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:04:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.689+0000 7fcae27fc640 1 --2- 172.21.15.1:0/2643320831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610258182f0 0x561025bfa6c0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fcacc0aa100 tx=0x7fcacc0e9e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=830b6599b64b3cd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.689+0000 7fcad8ff9640 1 -- 172.21.15.1:0/2643320831 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcacc0a92a0 con 0x5610258182f0 2024-09-21T01:04:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.689+0000 7fcad8ff9640 1 -- 172.21.15.1:0/2643320831 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcacc018420 con 0x5610258182f0 2024-09-21T01:04:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.689+0000 7fcad8ff9640 1 -- 172.21.15.1:0/2643320831 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcacc0a9480 con 0x5610258182f0 2024-09-21T01:04:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.690+0000 7fcaf06d8740 1 -- 172.21.15.1:0/2643320831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610258182f0 msgr2=0x561025bfa6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.690+0000 7fcaf06d8740 1 --2- 172.21.15.1:0/2643320831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610258182f0 0x561025bfa6c0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fcacc0aa100 tx=0x7fcacc0e9e20 comp rx=0 tx=0).stop 2024-09-21T01:04:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.690+0000 7fcaf06d8740 1 -- 172.21.15.1:0/2643320831 shutdown_connections 2024-09-21T01:04:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.690+0000 7fcaf06d8740 1 --2- 172.21.15.1:0/2643320831 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5610258204d0 0x561025be8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.690+0000 7fcaf06d8740 1 --2- 172.21.15.1:0/2643320831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610258182f0 0x561025bfa6c0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.690+0000 7fcaf06d8740 1 --2- 172.21.15.1:0/2643320831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5610257ffd80 0x561025be9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.690+0000 7fcaf06d8740 1 -- 172.21.15.1:0/2643320831 >> 172.21.15.1:0/2643320831 conn(0x561025835300 msgr2=0x561025bdf5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.690+0000 7fcaf06d8740 1 -- 172.21.15.1:0/2643320831 shutdown_connections 2024-09-21T01:04:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.690+0000 7fcaf06d8740 1 -- 172.21.15.1:0/2643320831 wait complete. 2024-09-21T01:04:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.690+0000 7fcaf06d8740 1 -- start start 2024-09-21T01:04:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.691+0000 7fcaf06d8740 1 Processor -- start 2024-09-21T01:04:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.691+0000 7fcaf06d8740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5610257ffd80 0x561025bf7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.691+0000 7fcaf06d8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5610258182f0 0x561025bf7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.691+0000 7fcaf06d8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610258204d0 0x561025bf8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.691+0000 7fcaf06d8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcae41ae760 con 0x5610258204d0 2024-09-21T01:04:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.691+0000 7fcaf06d8740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcae41ae060 con 0x5610257ffd80 2024-09-21T01:04:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.691+0000 7fcaf06d8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcae41ab210 con 0x5610258182f0 2024-09-21T01:04:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.691+0000 7fcaf06d8740 10 client.0 _ll_register_callbacks cb 0x7fcad4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.691+0000 7fcae37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610258204d0 0x561025bf8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.691+0000 7fcae2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5610257ffd80 0x561025bf7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.691+0000 7fcae37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610258204d0 0x561025bf8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43740/0 (socket says 172.21.15.1:43740) 2024-09-21T01:04:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.691+0000 7fcae37fe640 1 -- 172.21.15.1:0/3519652783 learned_addr learned my addr 172.21.15.1:0/3519652783 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:04:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.691+0000 7fcae27fc640 1 --2- 172.21.15.1:0/3519652783 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5610258182f0 0x561025bf7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.691+0000 7fcae37fe640 1 -- 172.21.15.1:0/3519652783 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5610258182f0 msgr2=0x561025bf7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.691+0000 7fcae37fe640 1 --2- 172.21.15.1:0/3519652783 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5610258182f0 0x561025bf7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.691+0000 7fcae37fe640 1 -- 172.21.15.1:0/3519652783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5610257ffd80 msgr2=0x561025bf7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.691+0000 7fcae37fe640 1 --2- 172.21.15.1:0/3519652783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5610257ffd80 0x561025bf7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.691+0000 7fcae37fe640 1 -- 172.21.15.1:0/3519652783 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561025bf8db0 con 0x5610258204d0 2024-09-21T01:04:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.691+0000 7fcae2ffd640 1 --2- 172.21.15.1:0/3519652783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5610257ffd80 0x561025bf7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.692+0000 7fcae37fe640 1 --2- 172.21.15.1:0/3519652783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610258204d0 0x561025bf8650 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fcadc01eda0 tx=0x7fcadc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8902877be611f5ed server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.692+0000 7fcaca7fc640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:04:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.692+0000 7fcaca7fc640 1 -- 172.21.15.1:0/3519652783 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcadc00fad0 con 0x5610258204d0 2024-09-21T01:04:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.692+0000 7fcaf06d8740 1 -- 172.21.15.1:0/3519652783 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561025b590f0 con 0x5610258204d0 2024-09-21T01:04:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.692+0000 7fcaca7fc640 1 -- 172.21.15.1:0/3519652783 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fcadc00fc70 con 0x5610258204d0 2024-09-21T01:04:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.692+0000 7fcaca7fc640 1 -- 172.21.15.1:0/3519652783 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fcadc02b480 con 0x5610258204d0 2024-09-21T01:04:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.692+0000 7fcaf06d8740 10 client.17337 fetch_fsmap learned FSMap version 39 2024-09-21T01:04:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.692+0000 7fcaf06d8740 1 -- 172.21.15.1:0/3519652783 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x561025bfa1f0 con 0x5610258204d0 2024-09-21T01:04:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.692+0000 7fcaca7fc640 1 -- 172.21.15.1:0/3519652783 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x561025b590f0 con 0x5610258204d0 2024-09-21T01:04:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.692+0000 7fcaca7fc640 1 -- 172.21.15.1:0/3519652783 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 39) ==== 8398+0+0 (secure 0 0 0) 0x7fcadc029430 con 0x5610258204d0 2024-09-21T01:04:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.692+0000 7fcaf06d8740 10 client.17337 fetch_fsmap finished waiting for FSMap version 39 2024-09-21T01:04:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.692+0000 7fcaf06d8740 10 client.17337 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:04:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.692+0000 7fcaf06d8740 20 client.17337 populate_metadata read hostname 'smithi001' 2024-09-21T01:04:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.692+0000 7fcaf06d8740 1 --2- 172.21.15.1:0/3519652783 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5610258411b0 0x561025c6c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.692+0000 7fcaf06d8740 4 client.17337 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:04:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.692+0000 7fcaf06d8740 1 -- 172.21.15.1:0/3519652783 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561025b56520 con 0x5610258411b0 2024-09-21T01:04:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.693+0000 7fcae2ffd640 1 --2- 172.21.15.1:0/3519652783 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5610258411b0 0x561025c6c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.693+0000 7fcae2ffd640 1 --2- 172.21.15.1:0/3519652783 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5610258411b0 0x561025c6c380 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6915c3828357ff42 server_cookie=f9892881d1640dad in_seq=0 out_seq=0 2024-09-21T01:04:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.693+0000 7fcaca7fc640 10 client.17337 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:04:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.702+0000 7fcaca7fc640 1 -- 172.21.15.1:0/3519652783 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561025b56520 con 0x5610258411b0 2024-09-21T01:04:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.702+0000 7fcaca7fc640 10 client.17337 handle_command_reply: tid=0 2024-09-21T01:04:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.702+0000 7fcaf06d8740 1 client.17337 shutdown 2024-09-21T01:04:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.703+0000 7fcaf06d8740 1 -- 172.21.15.1:0/3519652783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610258204d0 msgr2=0x561025bf8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.703+0000 7fcaf06d8740 1 --2- 172.21.15.1:0/3519652783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610258204d0 0x561025bf8650 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fcadc01eda0 tx=0x7fcadc0046c0 comp rx=0 tx=0).stop 2024-09-21T01:04:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.703+0000 7fcaf06d8740 1 -- 172.21.15.1:0/3519652783 shutdown_connections 2024-09-21T01:04:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.703+0000 7fcaf06d8740 1 --2- 172.21.15.1:0/3519652783 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5610258411b0 0x561025c6c380 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.703+0000 7fcaf06d8740 1 --2- 172.21.15.1:0/3519652783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610258204d0 0x561025bf8650 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.703+0000 7fcaf06d8740 1 --2- 172.21.15.1:0/3519652783 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5610258182f0 0x561025bf7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.703+0000 7fcaca7fc640 0 client.17337 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:04:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.703+0000 7fcaf06d8740 1 --2- 172.21.15.1:0/3519652783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5610257ffd80 0x561025bf7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.703+0000 7fcaf06d8740 1 -- 172.21.15.1:0/3519652783 >> 172.21.15.1:0/3519652783 conn(0x561025835300 msgr2=0x561025be8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.703+0000 7fcaf06d8740 1 -- 172.21.15.1:0/3519652783 shutdown_connections 2024-09-21T01:04:56.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.703+0000 7fcaf06d8740 1 -- 172.21.15.1:0/3519652783 wait complete. 2024-09-21T01:04:56.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.703+0000 7fcaf06d8740 20 client.17337 trim_cache size 0 max 16384 2024-09-21T01:04:56.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T01:04:56.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T01:04:56.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T01:04:56.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T01:04:56.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.703+0000 7fcae9769640 1 -- 172.21.15.1:0/1062541270 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fcad00b6510 msgr2=0x7fcad00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:56.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.703+0000 7fcae9769640 1 --2- 172.21.15.1:0/1062541270 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fcad00b6510 0x7fcad00b8a20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fcadc009cd0 tx=0x7fcadc005f90 comp rx=0 tx=0).stop 2024-09-21T01:04:56.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.703+0000 7fcae9769640 1 -- 172.21.15.1:0/1062541270 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcae4103630 msgr2=0x7fcae419c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:56.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.703+0000 7fcae9769640 1 --2- 172.21.15.1:0/1062541270 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcae4103630 0x7fcae419c7a0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fcacc00ebc0 tx=0x7fcacc00c6a0 comp rx=0 tx=0).stop 2024-09-21T01:04:56.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.703+0000 7fcae9769640 1 -- 172.21.15.1:0/1062541270 shutdown_connections 2024-09-21T01:04:56.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.703+0000 7fcae9769640 1 --2- 172.21.15.1:0/1062541270 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcae4103fd0 0x7fcae419d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:56.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.703+0000 7fcae9769640 1 --2- 172.21.15.1:0/1062541270 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fcad00b6510 0x7fcad00b8a20 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:56.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.703+0000 7fcae9769640 1 --2- 172.21.15.1:0/1062541270 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcae4103630 0x7fcae419c7a0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:56.707 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.704+0000 7fcae9769640 1 --2- 172.21.15.1:0/1062541270 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcae41025b0 0x7fcae419c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:56.707 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.704+0000 7fcae9769640 1 -- 172.21.15.1:0/1062541270 >> 172.21.15.1:0/1062541270 conn(0x7fcae40fdf30 msgr2=0x7fcae40ff7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:56.707 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.704+0000 7fcae9769640 1 -- 172.21.15.1:0/1062541270 shutdown_connections 2024-09-21T01:04:56.707 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:04:56.704+0000 7fcae9769640 1 -- 172.21.15.1:0/1062541270 wait complete. 2024-09-21T01:04:57.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:57 smithi001 ceph-mon[31211]: pgmap v590: 97 pgs: 97 active+clean; 431 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 704 op/s 2024-09-21T01:04:57.982 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:57 smithi193 ceph-mon[34660]: pgmap v590: 97 pgs: 97 active+clean; 431 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 704 op/s 2024-09-21T01:04:57.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:57 smithi042 ceph-mon[34481]: pgmap v590: 97 pgs: 97 active+clean; 431 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 704 op/s 2024-09-21T01:04:58.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:58 smithi001 ceph-mon[31211]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:04:58.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:58 smithi193 ceph-mon[34660]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:04:58.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:58 smithi042 ceph-mon[34481]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:04:59.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:04:59 smithi001 ceph-mon[31211]: pgmap v591: 97 pgs: 97 active+clean; 428 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 631 op/s 2024-09-21T01:04:59.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:04:59 smithi193 ceph-mon[34660]: pgmap v591: 97 pgs: 97 active+clean; 428 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 631 op/s 2024-09-21T01:04:59.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:04:59 smithi042 ceph-mon[34481]: pgmap v591: 97 pgs: 97 active+clean; 428 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 631 op/s 2024-09-21T01:05:01.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:01 smithi001 ceph-mon[31211]: scrub summary: idle+waiting paths [/] 2024-09-21T01:05:01.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:01 smithi001 ceph-mon[31211]: pgmap v592: 97 pgs: 97 active+clean; 406 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 686 op/s 2024-09-21T01:05:01.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:01 smithi193 ceph-mon[34660]: scrub summary: idle+waiting paths [/] 2024-09-21T01:05:01.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:01 smithi193 ceph-mon[34660]: pgmap v592: 97 pgs: 97 active+clean; 406 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 686 op/s 2024-09-21T01:05:01.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:01 smithi042 ceph-mon[34481]: scrub summary: idle+waiting paths [/] 2024-09-21T01:05:01.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:01 smithi042 ceph-mon[34481]: pgmap v592: 97 pgs: 97 active+clean; 406 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 686 op/s 2024-09-21T01:05:03.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:03 smithi001 ceph-mon[31211]: pgmap v593: 97 pgs: 97 active+clean; 390 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 647 op/s 2024-09-21T01:05:03.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:03 smithi193 ceph-mon[34660]: pgmap v593: 97 pgs: 97 active+clean; 390 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 647 op/s 2024-09-21T01:05:03.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:03 smithi042 ceph-mon[34481]: pgmap v593: 97 pgs: 97 active+clean; 390 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 647 op/s 2024-09-21T01:05:05.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:05 smithi001 ceph-mon[31211]: pgmap v594: 97 pgs: 97 active+clean; 382 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 595 op/s 2024-09-21T01:05:05.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:05 smithi193 ceph-mon[34660]: pgmap v594: 97 pgs: 97 active+clean; 382 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 595 op/s 2024-09-21T01:05:05.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:05 smithi042 ceph-mon[34481]: pgmap v594: 97 pgs: 97 active+clean; 382 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 595 op/s 2024-09-21T01:05:07.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:07 smithi001 ceph-mon[31211]: pgmap v595: 97 pgs: 97 active+clean; 365 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1014 KiB/s wr, 577 op/s 2024-09-21T01:05:07.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:07 smithi193 ceph-mon[34660]: pgmap v595: 97 pgs: 97 active+clean; 365 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1014 KiB/s wr, 577 op/s 2024-09-21T01:05:07.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:07 smithi042 ceph-mon[34481]: pgmap v595: 97 pgs: 97 active+clean; 365 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1014 KiB/s wr, 577 op/s 2024-09-21T01:05:08.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:08 smithi001 ceph-mon[31211]: scrub summary: idle 2024-09-21T01:05:08.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:08 smithi001 ceph-mon[31211]: scrub summary: idle 2024-09-21T01:05:08.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:08 smithi001 ceph-mon[31211]: scrub summary: idle 2024-09-21T01:05:08.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:08 smithi193 ceph-mon[34660]: scrub summary: idle 2024-09-21T01:05:08.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:08 smithi193 ceph-mon[34660]: scrub summary: idle 2024-09-21T01:05:08.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:08 smithi193 ceph-mon[34660]: scrub summary: idle 2024-09-21T01:05:08.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:08 smithi042 ceph-mon[34481]: scrub summary: idle 2024-09-21T01:05:08.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:08 smithi042 ceph-mon[34481]: scrub summary: idle 2024-09-21T01:05:08.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:08 smithi042 ceph-mon[34481]: scrub summary: idle 2024-09-21T01:05:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.804+0000 7efccab77640 1 -- 172.21.15.1:0/3407481 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efcc406b820 msgr2=0x7efcc4106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.804+0000 7efccab77640 1 --2- 172.21.15.1:0/3407481 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efcc406b820 0x7efcc4106360 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7efcb4009900 tx=0x7efcb402a410 comp rx=0 tx=0).stop 2024-09-21T01:05:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.804+0000 7efccab77640 1 -- 172.21.15.1:0/3407481 shutdown_connections 2024-09-21T01:05:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.804+0000 7efccab77640 1 --2- 172.21.15.1:0/3407481 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efcc4109400 0x7efcc410b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.804+0000 7efccab77640 1 --2- 172.21.15.1:0/3407481 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efcc41068a0 0x7efcc4108cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.804+0000 7efccab77640 1 --2- 172.21.15.1:0/3407481 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efcc406b820 0x7efcc4106360 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.804+0000 7efccab77640 1 -- 172.21.15.1:0/3407481 >> 172.21.15.1:0/3407481 conn(0x7efcc40fdf00 msgr2=0x7efcc41003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.804+0000 7efccab77640 1 -- 172.21.15.1:0/3407481 shutdown_connections 2024-09-21T01:05:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.804+0000 7efccab77640 1 -- 172.21.15.1:0/3407481 wait complete. 2024-09-21T01:05:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.805+0000 7efccab77640 1 Processor -- start 2024-09-21T01:05:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.805+0000 7efccab77640 1 -- start start 2024-09-21T01:05:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.805+0000 7efccab77640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efcc406b820 0x7efcc4199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.805+0000 7efccab77640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efcc41068a0 0x7efcc419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.805+0000 7efccab77640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efcc4109400 0x7efcc419b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.805+0000 7efccab77640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efcc410f330 con 0x7efcc41068a0 2024-09-21T01:05:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.805+0000 7efccab77640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efcc410f1b0 con 0x7efcc4109400 2024-09-21T01:05:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.805+0000 7efccab77640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efcc410f4b0 con 0x7efcc406b820 2024-09-21T01:05:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.805+0000 7efcc3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efcc41068a0 0x7efcc419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.805+0000 7efcc3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efcc41068a0 0x7efcc419a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52608/0 (socket says 172.21.15.1:52608) 2024-09-21T01:05:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.805+0000 7efcc3fff640 1 -- 172.21.15.1:0/2101163618 learned_addr learned my addr 172.21.15.1:0/2101163618 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.805+0000 7efcc8913640 1 --2- 172.21.15.1:0/2101163618 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efcc406b820 0x7efcc4199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.806+0000 7efcc9114640 1 --2- 172.21.15.1:0/2101163618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efcc4109400 0x7efcc419b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.806+0000 7efcc3fff640 1 -- 172.21.15.1:0/2101163618 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efcc406b820 msgr2=0x7efcc4199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.806+0000 7efcc3fff640 1 --2- 172.21.15.1:0/2101163618 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efcc406b820 0x7efcc4199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.806+0000 7efcc3fff640 1 -- 172.21.15.1:0/2101163618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efcc4109400 msgr2=0x7efcc419b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.806+0000 7efcc3fff640 1 --2- 172.21.15.1:0/2101163618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efcc4109400 0x7efcc419b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.806+0000 7efcc3fff640 1 -- 172.21.15.1:0/2101163618 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc419b9f0 con 0x7efcc41068a0 2024-09-21T01:05:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.806+0000 7efcc3fff640 1 --2- 172.21.15.1:0/2101163618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efcc41068a0 0x7efcc419a620 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7efcac00e9c0 tx=0x7efcac00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.806+0000 7efcc1ffb640 1 -- 172.21.15.1:0/2101163618 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcac00cd80 con 0x7efcc41068a0 2024-09-21T01:05:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.806+0000 7efcc1ffb640 1 -- 172.21.15.1:0/2101163618 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcac0054d0 con 0x7efcc41068a0 2024-09-21T01:05:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.806+0000 7efccab77640 1 -- 172.21.15.1:0/2101163618 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcc419bce0 con 0x7efcc41068a0 2024-09-21T01:05:09.811 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.806+0000 7efcc1ffb640 1 -- 172.21.15.1:0/2101163618 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcac010430 con 0x7efcc41068a0 2024-09-21T01:05:09.811 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.806+0000 7efccab77640 1 -- 172.21.15.1:0/2101163618 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcc41a23d0 con 0x7efcc41068a0 2024-09-21T01:05:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.809+0000 7efcc1ffb640 1 -- 172.21.15.1:0/2101163618 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7efcac004fd0 con 0x7efcc41068a0 2024-09-21T01:05:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.809+0000 7efcd1bbf740 1 Processor -- start 2024-09-21T01:05:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.809+0000 7efcd1bbf740 1 -- start start 2024-09-21T01:05:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.809+0000 7efcd1bbf740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b6d50d1b0 0x561b6d8b9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.810+0000 7efcd1bbf740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b6d4e42f0 0x561b6d8b98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.810+0000 7efcd1bbf740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b6d4ec4d0 0x561b6d8ba420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.810+0000 7efcd1bbf740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561b6d8276f0 con 0x561b6d50d1b0 2024-09-21T01:05:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.810+0000 7efcd1bbf740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561b6d816b20 con 0x561b6d4e42f0 2024-09-21T01:05:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.810+0000 7efcd1bbf740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x561b6d81a930 con 0x561b6d4ec4d0 2024-09-21T01:05:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.810+0000 7efcc9114640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b6d50d1b0 0x561b6d8b9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.810+0000 7efcc9114640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b6d50d1b0 0x561b6d8b9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52620/0 (socket says 172.21.15.1:52620) 2024-09-21T01:05:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.810+0000 7efcc9114640 1 -- 172.21.15.1:0/2176822945 learned_addr learned my addr 172.21.15.1:0/2176822945 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.810+0000 7efcc3fff640 1 --2- 172.21.15.1:0/2176822945 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b6d4ec4d0 0x561b6d8ba420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.810+0000 7efcc8913640 1 --2- 172.21.15.1:0/2176822945 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b6d4e42f0 0x561b6d8b98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.810+0000 7efcc9114640 1 -- 172.21.15.1:0/2176822945 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b6d4ec4d0 msgr2=0x561b6d8ba420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.810+0000 7efcc9114640 1 --2- 172.21.15.1:0/2176822945 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b6d4ec4d0 0x561b6d8ba420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.810+0000 7efcc9114640 1 -- 172.21.15.1:0/2176822945 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b6d4e42f0 msgr2=0x561b6d8b98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.810+0000 7efcc9114640 1 --2- 172.21.15.1:0/2176822945 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b6d4e42f0 0x561b6d8b98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.810+0000 7efcc9114640 1 -- 172.21.15.1:0/2176822945 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b6d7dc530 con 0x561b6d50d1b0 2024-09-21T01:05:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.810+0000 7efcc1ffb640 1 --2- 172.21.15.1:0/2101163618 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7efcb00b6510 0x7efcb00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.810+0000 7efcc8913640 1 --2- 172.21.15.1:0/2101163618 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7efcb00b6510 0x7efcb00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.810+0000 7efcc9114640 1 --2- 172.21.15.1:0/2176822945 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b6d50d1b0 0x561b6d8b9260 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7efcbc009fd0 tx=0x7efcbc0118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56409559fb199916 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.810+0000 7efcc1ffb640 1 -- 172.21.15.1:0/2101163618 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7efcac0e7740 con 0x7efcc41068a0 2024-09-21T01:05:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.811+0000 7efcbaffd640 1 -- 172.21.15.1:0/2176822945 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcbc004d20 con 0x561b6d50d1b0 2024-09-21T01:05:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.811+0000 7efcbaffd640 1 -- 172.21.15.1:0/2176822945 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcbc004050 con 0x561b6d50d1b0 2024-09-21T01:05:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.811+0000 7efcbaffd640 1 -- 172.21.15.1:0/2176822945 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcbc005280 con 0x561b6d50d1b0 2024-09-21T01:05:09.818 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.811+0000 7efcd1bbf740 1 -- 172.21.15.1:0/2176822945 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b6d50d1b0 msgr2=0x561b6d8b9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:09.818 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.811+0000 7efcc8913640 1 --2- 172.21.15.1:0/2101163618 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7efcb00b6510 0x7efcb00b8a20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7efcb4000c00 tx=0x7efcb4031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:09.818 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.811+0000 7efcd1bbf740 1 --2- 172.21.15.1:0/2176822945 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b6d50d1b0 0x561b6d8b9260 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7efcbc009fd0 tx=0x7efcbc0118d0 comp rx=0 tx=0).stop 2024-09-21T01:05:09.819 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.812+0000 7efcd1bbf740 1 -- 172.21.15.1:0/2176822945 shutdown_connections 2024-09-21T01:05:09.819 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.812+0000 7efcd1bbf740 1 --2- 172.21.15.1:0/2176822945 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b6d4ec4d0 0x561b6d8ba420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:09.819 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.812+0000 7efcd1bbf740 1 --2- 172.21.15.1:0/2176822945 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b6d4e42f0 0x561b6d8b98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:09.819 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.812+0000 7efcd1bbf740 1 --2- 172.21.15.1:0/2176822945 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b6d50d1b0 0x561b6d8b9260 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:09.819 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.812+0000 7efcd1bbf740 1 -- 172.21.15.1:0/2176822945 >> 172.21.15.1:0/2176822945 conn(0x561b6d501300 msgr2=0x561b6d8b08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:09.819 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.812+0000 7efcd1bbf740 1 -- 172.21.15.1:0/2176822945 shutdown_connections 2024-09-21T01:05:09.819 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.812+0000 7efcd1bbf740 1 -- 172.21.15.1:0/2176822945 wait complete. 2024-09-21T01:05:09.819 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.812+0000 7efcd1bbf740 1 -- start start 2024-09-21T01:05:09.819 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.812+0000 7efcd1bbf740 1 Processor -- start 2024-09-21T01:05:09.819 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.813+0000 7efcd1bbf740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b6d4e42f0 0x561b6d8c2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:09.819 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.813+0000 7efcd1bbf740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b6d4ec4d0 0x561b6d8c3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:09.819 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.813+0000 7efcd1bbf740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b6d50d1b0 0x561b6d8c3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:09.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.813+0000 7efcd1bbf740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561b6d74eab0 con 0x561b6d4ec4d0 2024-09-21T01:05:09.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.813+0000 7efcd1bbf740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561b6d7bc730 con 0x561b6d4e42f0 2024-09-21T01:05:09.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.813+0000 7efcd1bbf740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x561b6d8baf40 con 0x561b6d50d1b0 2024-09-21T01:05:09.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.813+0000 7efcd1bbf740 10 client.0 _ll_register_callbacks cb 0x561b6d8106b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:05:09.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.813+0000 7efcc3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b6d4ec4d0 0x561b6d8c3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:09.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.813+0000 7efcc9114640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b6d50d1b0 0x561b6d8c3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:09.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.813+0000 7efcc3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b6d4ec4d0 0x561b6d8c3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52630/0 (socket says 172.21.15.1:52630) 2024-09-21T01:05:09.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.813+0000 7efcc9114640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b6d50d1b0 0x561b6d8c3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:44340/0 (socket says 172.21.15.1:44340) 2024-09-21T01:05:09.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.813+0000 7efcc3fff640 1 -- 172.21.15.1:0/2911532160 learned_addr learned my addr 172.21.15.1:0/2911532160 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:09.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.813+0000 7efcc8913640 1 --2- 172.21.15.1:0/2911532160 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b6d4e42f0 0x561b6d8c2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:09.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.813+0000 7efcc3fff640 1 -- 172.21.15.1:0/2911532160 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b6d50d1b0 msgr2=0x561b6d8c3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:09.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.813+0000 7efcc3fff640 1 --2- 172.21.15.1:0/2911532160 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b6d50d1b0 0x561b6d8c3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:09.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.813+0000 7efcc3fff640 1 -- 172.21.15.1:0/2911532160 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b6d4e42f0 msgr2=0x561b6d8c2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:09.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.813+0000 7efcc3fff640 1 --2- 172.21.15.1:0/2911532160 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b6d4e42f0 0x561b6d8c2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:09.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.813+0000 7efcc3fff640 1 -- 172.21.15.1:0/2911532160 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b6d578790 con 0x561b6d4ec4d0 2024-09-21T01:05:09.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.813+0000 7efcc9114640 1 --2- 172.21.15.1:0/2911532160 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b6d50d1b0 0x561b6d8c3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:05:09.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.813+0000 7efcc3fff640 1 --2- 172.21.15.1:0/2911532160 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b6d4ec4d0 0x561b6d8c3100 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7efcac0ad5b0 tx=0x7efcac0048b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=508761888e0c6428 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:09.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.813+0000 7efca3fff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:05:09.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.813+0000 7efca3fff640 1 -- 172.21.15.1:0/2911532160 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcac0a9750 con 0x561b6d4ec4d0 2024-09-21T01:05:09.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.813+0000 7efca3fff640 1 -- 172.21.15.1:0/2911532160 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7efcac0b2110 con 0x561b6d4ec4d0 2024-09-21T01:05:09.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.813+0000 7efcd1bbf740 1 -- 172.21.15.1:0/2911532160 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efcbc004050 con 0x561b6d4ec4d0 2024-09-21T01:05:09.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.814+0000 7efca3fff640 1 -- 172.21.15.1:0/2911532160 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7efcac0ad020 con 0x561b6d4ec4d0 2024-09-21T01:05:09.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.814+0000 7efcd1bbf740 10 client.17349 fetch_fsmap learned FSMap version 40 2024-09-21T01:05:09.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.814+0000 7efcd1bbf740 1 -- 172.21.15.1:0/2911532160 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x561b6d5f1620 con 0x561b6d4ec4d0 2024-09-21T01:05:09.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.814+0000 7efca3fff640 1 -- 172.21.15.1:0/2911532160 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcbc004050 con 0x561b6d4ec4d0 2024-09-21T01:05:09.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.814+0000 7efca3fff640 1 -- 172.21.15.1:0/2911532160 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 40) ==== 8394+0+0 (secure 0 0 0) 0x7efcac0ac580 con 0x561b6d4ec4d0 2024-09-21T01:05:09.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.814+0000 7efcd1bbf740 10 client.17349 fetch_fsmap finished waiting for FSMap version 40 2024-09-21T01:05:09.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.814+0000 7efcd1bbf740 10 client.17349 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:05:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.814+0000 7efcd1bbf740 20 client.17349 populate_metadata read hostname 'smithi001' 2024-09-21T01:05:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.814+0000 7efcd1bbf740 1 --2- 172.21.15.1:0/2911532160 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x561b6d4cbd80 0x561b6d8d01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.814+0000 7efcd1bbf740 4 client.17349 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:05:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.814+0000 7efcd1bbf740 1 -- 172.21.15.1:0/2911532160 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b6d829640 con 0x561b6d4cbd80 2024-09-21T01:05:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.814+0000 7efcc8913640 1 --2- 172.21.15.1:0/2911532160 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x561b6d4cbd80 0x561b6d8d01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.815+0000 7efca3fff640 10 client.17349 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:05:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.815+0000 7efcc8913640 1 --2- 172.21.15.1:0/2911532160 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x561b6d4cbd80 0x561b6d8d01f0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5be064ee62849d48 server_cookie=c880bb12d4f3e900 in_seq=0 out_seq=0 2024-09-21T01:05:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.816+0000 7efca3fff640 1 -- 172.21.15.1:0/2911532160 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561b6d829640 con 0x561b6d4cbd80 2024-09-21T01:05:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.816+0000 7efca3fff640 10 client.17349 handle_command_reply: tid=0 2024-09-21T01:05:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.816+0000 7efcd1bbf740 1 client.17349 shutdown 2024-09-21T01:05:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.816+0000 7efcd1bbf740 1 -- 172.21.15.1:0/2911532160 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b6d4ec4d0 msgr2=0x561b6d8c3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.816+0000 7efcd1bbf740 1 --2- 172.21.15.1:0/2911532160 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b6d4ec4d0 0x561b6d8c3100 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7efcac0ad5b0 tx=0x7efcac0048b0 comp rx=0 tx=0).stop 2024-09-21T01:05:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.816+0000 7efcd1bbf740 1 -- 172.21.15.1:0/2911532160 shutdown_connections 2024-09-21T01:05:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.816+0000 7efcd1bbf740 1 --2- 172.21.15.1:0/2911532160 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x561b6d4cbd80 0x561b6d8d01f0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:09.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.816+0000 7efcd1bbf740 1 --2- 172.21.15.1:0/2911532160 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b6d50d1b0 0x561b6d8c3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:09.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.816+0000 7efcd1bbf740 1 --2- 172.21.15.1:0/2911532160 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b6d4ec4d0 0x561b6d8c3100 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:09.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.816+0000 7efcd1bbf740 1 --2- 172.21.15.1:0/2911532160 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b6d4e42f0 0x561b6d8c2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:09.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.816+0000 7efca3fff640 0 client.17349 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:05:09.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.816+0000 7efcd1bbf740 1 -- 172.21.15.1:0/2911532160 >> 172.21.15.1:0/2911532160 conn(0x561b6d501300 msgr2=0x561b6d8aeea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:09.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.816+0000 7efcd1bbf740 1 -- 172.21.15.1:0/2911532160 shutdown_connections 2024-09-21T01:05:09.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.816+0000 7efcd1bbf740 1 -- 172.21.15.1:0/2911532160 wait complete. 2024-09-21T01:05:09.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.816+0000 7efcd1bbf740 20 client.17349 trim_cache size 0 max 16384 2024-09-21T01:05:09.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.832+0000 7efcd1bbf740 1 Processor -- start 2024-09-21T01:05:09.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.832+0000 7efcd1bbf740 1 -- start start 2024-09-21T01:05:09.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.832+0000 7efcd1bbf740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b6d4e42f0 0x561b6d8ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:09.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.832+0000 7efcd1bbf740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b6d4ec4d0 0x561b6d8c0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:09.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.832+0000 7efcd1bbf740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b6d50d1b0 0x561b6d8c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:09.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.832+0000 7efcd1bbf740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efcc41a8ee0 con 0x561b6d4ec4d0 2024-09-21T01:05:09.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.832+0000 7efcd1bbf740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efcc41aab70 con 0x561b6d50d1b0 2024-09-21T01:05:09.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.832+0000 7efcd1bbf740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efcc41a95e0 con 0x561b6d4e42f0 2024-09-21T01:05:09.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.832+0000 7efcc3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b6d4ec4d0 0x561b6d8c0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:09.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.833+0000 7efcc3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b6d4ec4d0 0x561b6d8c0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52640/0 (socket says 172.21.15.1:52640) 2024-09-21T01:05:09.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.833+0000 7efcc3fff640 1 -- 172.21.15.1:0/701777025 learned_addr learned my addr 172.21.15.1:0/701777025 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:09.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.833+0000 7efcc8913640 1 --2- 172.21.15.1:0/701777025 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b6d4e42f0 0x561b6d8ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:09.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.833+0000 7efcc9114640 1 --2- 172.21.15.1:0/701777025 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b6d50d1b0 0x561b6d8c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:09.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.833+0000 7efcc3fff640 1 -- 172.21.15.1:0/701777025 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b6d4e42f0 msgr2=0x561b6d8ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:09.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.833+0000 7efcc3fff640 1 --2- 172.21.15.1:0/701777025 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b6d4e42f0 0x561b6d8ab5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:09.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.833+0000 7efcc3fff640 1 -- 172.21.15.1:0/701777025 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b6d50d1b0 msgr2=0x561b6d8c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:09.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.833+0000 7efcc3fff640 1 --2- 172.21.15.1:0/701777025 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b6d50d1b0 0x561b6d8c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:09.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.833+0000 7efcc3fff640 1 -- 172.21.15.1:0/701777025 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b6d8c3fe0 con 0x561b6d4ec4d0 2024-09-21T01:05:09.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.833+0000 7efcc9114640 1 --2- 172.21.15.1:0/701777025 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b6d50d1b0 0x561b6d8c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:05:09.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.833+0000 7efcc3fff640 1 --2- 172.21.15.1:0/701777025 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b6d4ec4d0 0x561b6d8c0f50 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7efcac0acaa0 tx=0x7efcac009700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fbd8d7fec342bae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:09.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.833+0000 7efcba7fc640 1 -- 172.21.15.1:0/701777025 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcac0ad200 con 0x561b6d4ec4d0 2024-09-21T01:05:09.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.833+0000 7efcba7fc640 1 -- 172.21.15.1:0/701777025 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcac0046c0 con 0x561b6d4ec4d0 2024-09-21T01:05:09.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.833+0000 7efcba7fc640 1 -- 172.21.15.1:0/701777025 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcac0ad680 con 0x561b6d4ec4d0 2024-09-21T01:05:09.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.834+0000 7efcd1bbf740 1 -- 172.21.15.1:0/701777025 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b6d4ec4d0 msgr2=0x561b6d8c0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:09.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.834+0000 7efcd1bbf740 1 --2- 172.21.15.1:0/701777025 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b6d4ec4d0 0x561b6d8c0f50 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7efcac0acaa0 tx=0x7efcac009700 comp rx=0 tx=0).stop 2024-09-21T01:05:09.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.834+0000 7efcd1bbf740 1 -- 172.21.15.1:0/701777025 shutdown_connections 2024-09-21T01:05:09.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.834+0000 7efcd1bbf740 1 --2- 172.21.15.1:0/701777025 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b6d50d1b0 0x561b6d8c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:09.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.834+0000 7efcd1bbf740 1 --2- 172.21.15.1:0/701777025 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b6d4ec4d0 0x561b6d8c0f50 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:09.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.834+0000 7efcd1bbf740 1 --2- 172.21.15.1:0/701777025 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b6d4e42f0 0x561b6d8ab5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:09.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.834+0000 7efcd1bbf740 1 -- 172.21.15.1:0/701777025 >> 172.21.15.1:0/701777025 conn(0x561b6d501300 msgr2=0x561b6d8c1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:09.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.834+0000 7efcd1bbf740 1 -- 172.21.15.1:0/701777025 shutdown_connections 2024-09-21T01:05:09.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.834+0000 7efcd1bbf740 1 -- 172.21.15.1:0/701777025 wait complete. 2024-09-21T01:05:09.841 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.834+0000 7efcd1bbf740 1 -- start start 2024-09-21T01:05:09.841 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.834+0000 7efcd1bbf740 1 Processor -- start 2024-09-21T01:05:09.841 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.835+0000 7efcd1bbf740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b6d4e42f0 0x561b6d8c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:09.841 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.835+0000 7efcd1bbf740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b6d4ec4d0 0x561b6d8c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:09.841 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.835+0000 7efcd1bbf740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b6d50d1b0 0x561b6d8ca420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:09.841 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.835+0000 7efcd1bbf740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efcc41aa3e0 con 0x561b6d4e42f0 2024-09-21T01:05:09.841 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.835+0000 7efcd1bbf740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efcc41a9ce0 con 0x561b6d50d1b0 2024-09-21T01:05:09.841 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.835+0000 7efcd1bbf740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efcc41a6ec0 con 0x561b6d4ec4d0 2024-09-21T01:05:09.841 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.835+0000 7efcd1bbf740 10 client.0 _ll_register_callbacks cb 0x7efcac0ed240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:05:09.841 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.835+0000 7efcc8913640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b6d4e42f0 0x561b6d8c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:09.841 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.835+0000 7efcc8913640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b6d4e42f0 0x561b6d8c99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52642/0 (socket says 172.21.15.1:52642) 2024-09-21T01:05:09.841 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.835+0000 7efcc8913640 1 -- 172.21.15.1:0/2756829974 learned_addr learned my addr 172.21.15.1:0/2756829974 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:09.841 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.835+0000 7efcc3fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b6d4ec4d0 0x561b6d8c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:09.841 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.835+0000 7efcc9114640 1 --2- 172.21.15.1:0/2756829974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b6d50d1b0 0x561b6d8ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:09.842 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.835+0000 7efcc8913640 1 -- 172.21.15.1:0/2756829974 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b6d4ec4d0 msgr2=0x561b6d8c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:09.842 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.835+0000 7efcc8913640 1 --2- 172.21.15.1:0/2756829974 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b6d4ec4d0 0x561b6d8c9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:09.842 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.835+0000 7efcc8913640 1 -- 172.21.15.1:0/2756829974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b6d50d1b0 msgr2=0x561b6d8ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:09.842 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.835+0000 7efcc8913640 1 --2- 172.21.15.1:0/2756829974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b6d50d1b0 0x561b6d8ca420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:09.842 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.835+0000 7efcc8913640 1 -- 172.21.15.1:0/2756829974 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b6d8c86c0 con 0x561b6d4e42f0 2024-09-21T01:05:09.842 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.835+0000 7efcc3fff640 1 --2- 172.21.15.1:0/2756829974 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b6d4ec4d0 0x561b6d8c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:05:09.842 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.836+0000 7efcc8913640 1 --2- 172.21.15.1:0/2756829974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b6d4e42f0 0x561b6d8c99a0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7efcb4031500 tx=0x7efcb402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e191d982567a1f17 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:09.842 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.836+0000 7efca3fff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:05:09.842 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.836+0000 7efca3fff640 1 -- 172.21.15.1:0/2756829974 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb4035040 con 0x561b6d4e42f0 2024-09-21T01:05:09.842 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.836+0000 7efca3fff640 1 -- 172.21.15.1:0/2756829974 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7efcb40035f0 con 0x561b6d4e42f0 2024-09-21T01:05:09.842 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.836+0000 7efcd1bbf740 1 -- 172.21.15.1:0/2756829974 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561b6d8250f0 con 0x561b6d4e42f0 2024-09-21T01:05:09.842 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.836+0000 7efca3fff640 1 -- 172.21.15.1:0/2756829974 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7efcb40037f0 con 0x561b6d4e42f0 2024-09-21T01:05:09.842 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.836+0000 7efcd1bbf740 10 client.17355 fetch_fsmap learned FSMap version 40 2024-09-21T01:05:09.842 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.836+0000 7efcd1bbf740 1 -- 172.21.15.1:0/2756829974 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x561b6d93b090 con 0x561b6d4e42f0 2024-09-21T01:05:09.843 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.836+0000 7efca3fff640 1 -- 172.21.15.1:0/2756829974 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x561b6d8250f0 con 0x561b6d4e42f0 2024-09-21T01:05:09.843 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.836+0000 7efca3fff640 1 -- 172.21.15.1:0/2756829974 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 40) ==== 8394+0+0 (secure 0 0 0) 0x7efcb4044040 con 0x561b6d4e42f0 2024-09-21T01:05:09.843 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.836+0000 7efcd1bbf740 10 client.17355 fetch_fsmap finished waiting for FSMap version 40 2024-09-21T01:05:09.843 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.836+0000 7efcd1bbf740 10 client.17355 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:05:09.843 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.836+0000 7efcd1bbf740 20 client.17355 populate_metadata read hostname 'smithi001' 2024-09-21T01:05:09.843 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.836+0000 7efcd1bbf740 1 --2- 172.21.15.1:0/2756829974 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x561b6d4a11c0 0x561b6d93db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:09.843 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.836+0000 7efcd1bbf740 4 client.17355 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:05:09.843 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.836+0000 7efcd1bbf740 1 -- 172.21.15.1:0/2756829974 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561b6d822520 con 0x561b6d4a11c0 2024-09-21T01:05:09.843 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.837+0000 7efcc3fff640 1 --2- 172.21.15.1:0/2756829974 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x561b6d4a11c0 0x561b6d93db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:09.843 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.837+0000 7efca3fff640 10 client.17355 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:05:09.843 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.837+0000 7efcc3fff640 1 --2- 172.21.15.1:0/2756829974 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x561b6d4a11c0 0x561b6d93db20 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b191478c2b9e15cc server_cookie=981f2405e871e351 in_seq=0 out_seq=0 2024-09-21T01:05:09.851 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.847+0000 7efca3fff640 1 -- 172.21.15.1:0/2756829974 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561b6d822520 con 0x561b6d4a11c0 2024-09-21T01:05:09.851 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.847+0000 7efca3fff640 10 client.17355 handle_command_reply: tid=0 2024-09-21T01:05:09.852 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.847+0000 7efcd1bbf740 1 client.17355 shutdown 2024-09-21T01:05:09.852 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.848+0000 7efcd1bbf740 1 -- 172.21.15.1:0/2756829974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b6d4e42f0 msgr2=0x561b6d8c99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:09.852 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.848+0000 7efcd1bbf740 1 --2- 172.21.15.1:0/2756829974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b6d4e42f0 0x561b6d8c99a0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7efcb4031500 tx=0x7efcb402a410 comp rx=0 tx=0).stop 2024-09-21T01:05:09.852 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.848+0000 7efcd1bbf740 1 -- 172.21.15.1:0/2756829974 shutdown_connections 2024-09-21T01:05:09.852 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.848+0000 7efcd1bbf740 1 --2- 172.21.15.1:0/2756829974 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x561b6d4a11c0 0x561b6d93db20 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:09.852 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.848+0000 7efcd1bbf740 1 --2- 172.21.15.1:0/2756829974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b6d50d1b0 0x561b6d8ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:09.852 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.848+0000 7efcd1bbf740 1 --2- 172.21.15.1:0/2756829974 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b6d4ec4d0 0x561b6d8c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:09.852 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.848+0000 7efcd1bbf740 1 --2- 172.21.15.1:0/2756829974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b6d4e42f0 0x561b6d8c99a0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:09.852 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.848+0000 7efca3fff640 0 client.17355 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:05:09.852 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.848+0000 7efcd1bbf740 1 -- 172.21.15.1:0/2756829974 >> 172.21.15.1:0/2756829974 conn(0x561b6d501300 msgr2=0x561b6d8ab5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:09.852 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.848+0000 7efcd1bbf740 1 -- 172.21.15.1:0/2756829974 shutdown_connections 2024-09-21T01:05:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.848+0000 7efcd1bbf740 1 -- 172.21.15.1:0/2756829974 wait complete. 2024-09-21T01:05:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.848+0000 7efcd1bbf740 20 client.17355 trim_cache size 0 max 16384 2024-09-21T01:05:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T01:05:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T01:05:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T01:05:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T01:05:09.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.848+0000 7efccab77640 1 -- 172.21.15.1:0/2101163618 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7efcb00b6510 msgr2=0x7efcb00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:09.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.848+0000 7efccab77640 1 --2- 172.21.15.1:0/2101163618 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7efcb00b6510 0x7efcb00b8a20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7efcb4000c00 tx=0x7efcb4031400 comp rx=0 tx=0).stop 2024-09-21T01:05:09.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.849+0000 7efccab77640 1 -- 172.21.15.1:0/2101163618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efcc41068a0 msgr2=0x7efcc419a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:09.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.849+0000 7efccab77640 1 --2- 172.21.15.1:0/2101163618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efcc41068a0 0x7efcc419a620 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7efcac00e9c0 tx=0x7efcac00ee80 comp rx=0 tx=0).stop 2024-09-21T01:05:09.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.849+0000 7efccab77640 1 -- 172.21.15.1:0/2101163618 shutdown_connections 2024-09-21T01:05:09.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.849+0000 7efccab77640 1 --2- 172.21.15.1:0/2101163618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efcc4109400 0x7efcc419b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:09.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.849+0000 7efccab77640 1 --2- 172.21.15.1:0/2101163618 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7efcb00b6510 0x7efcb00b8a20 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:09.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.849+0000 7efccab77640 1 --2- 172.21.15.1:0/2101163618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efcc41068a0 0x7efcc419a620 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:09.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.849+0000 7efccab77640 1 --2- 172.21.15.1:0/2101163618 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efcc406b820 0x7efcc4199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:09.855 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.849+0000 7efccab77640 1 -- 172.21.15.1:0/2101163618 >> 172.21.15.1:0/2101163618 conn(0x7efcc40fdf00 msgr2=0x7efcc4104e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:09.855 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.849+0000 7efccab77640 1 -- 172.21.15.1:0/2101163618 shutdown_connections 2024-09-21T01:05:09.855 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:09.849+0000 7efccab77640 1 -- 172.21.15.1:0/2101163618 wait complete. 2024-09-21T01:05:09.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:09 smithi001 ceph-mon[31211]: scrub summary: idle 2024-09-21T01:05:09.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:09 smithi001 ceph-mon[31211]: scrub summary: idle 2024-09-21T01:05:09.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:09 smithi001 ceph-mon[31211]: pgmap v596: 97 pgs: 97 active+clean; 362 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 508 op/s 2024-09-21T01:05:09.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:09 smithi193 ceph-mon[34660]: scrub summary: idle 2024-09-21T01:05:09.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:09 smithi193 ceph-mon[34660]: scrub summary: idle 2024-09-21T01:05:09.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:09 smithi193 ceph-mon[34660]: pgmap v596: 97 pgs: 97 active+clean; 362 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 508 op/s 2024-09-21T01:05:09.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:09 smithi042 ceph-mon[34481]: scrub summary: idle 2024-09-21T01:05:09.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:09 smithi042 ceph-mon[34481]: scrub summary: idle 2024-09-21T01:05:09.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:09 smithi042 ceph-mon[34481]: pgmap v596: 97 pgs: 97 active+clean; 362 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 508 op/s 2024-09-21T01:05:11.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:11 smithi001 ceph-mon[31211]: pgmap v597: 97 pgs: 97 active+clean; 355 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 556 op/s 2024-09-21T01:05:11.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:11 smithi193 ceph-mon[34660]: pgmap v597: 97 pgs: 97 active+clean; 355 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 556 op/s 2024-09-21T01:05:11.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:11 smithi042 ceph-mon[34481]: pgmap v597: 97 pgs: 97 active+clean; 355 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 556 op/s 2024-09-21T01:05:13.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:13 smithi001 ceph-mon[31211]: pgmap v598: 97 pgs: 97 active+clean; 339 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 530 op/s 2024-09-21T01:05:13.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:13 smithi193 ceph-mon[34660]: pgmap v598: 97 pgs: 97 active+clean; 339 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 530 op/s 2024-09-21T01:05:13.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:13 smithi042 ceph-mon[34481]: pgmap v598: 97 pgs: 97 active+clean; 339 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 530 op/s 2024-09-21T01:05:15.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:15 smithi001 ceph-mon[31211]: pgmap v599: 97 pgs: 97 active+clean; 330 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 502 op/s 2024-09-21T01:05:15.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:15 smithi193 ceph-mon[34660]: pgmap v599: 97 pgs: 97 active+clean; 330 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 502 op/s 2024-09-21T01:05:15.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:15 smithi042 ceph-mon[34481]: pgmap v599: 97 pgs: 97 active+clean; 330 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 502 op/s 2024-09-21T01:05:16.808 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:05:17.072 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:17.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.619+0000 7f92c6d13640 1 -- 172.21.15.1:0/244423947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92c0102a70 msgr2=0x7f92c0102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:17.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.619+0000 7f92c6d13640 1 --2- 172.21.15.1:0/244423947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92c0102a70 0x7f92c0102e80 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f92b4009900 tx=0x7f92b402a410 comp rx=0 tx=0).stop 2024-09-21T01:05:17.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.619+0000 7f92c6d13640 1 -- 172.21.15.1:0/244423947 shutdown_connections 2024-09-21T01:05:17.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.619+0000 7f92c6d13640 1 --2- 172.21.15.1:0/244423947 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92c0108d00 0x7f92c010f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:17.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.619+0000 7f92c6d13640 1 --2- 172.21.15.1:0/244423947 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92c01083b0 0x7f92c01087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:17.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.619+0000 7f92c6d13640 1 --2- 172.21.15.1:0/244423947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92c0102a70 0x7f92c0102e80 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:17.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.619+0000 7f92c6d13640 1 -- 172.21.15.1:0/244423947 >> 172.21.15.1:0/244423947 conn(0x7f92c0079730 msgr2=0x7f92c0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:17.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.619+0000 7f92c6d13640 1 -- 172.21.15.1:0/244423947 shutdown_connections 2024-09-21T01:05:17.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.620+0000 7f92c6d13640 1 -- 172.21.15.1:0/244423947 wait complete. 2024-09-21T01:05:17.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.620+0000 7f92c6d13640 1 Processor -- start 2024-09-21T01:05:17.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.620+0000 7f92c6d13640 1 -- start start 2024-09-21T01:05:17.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.621+0000 7f92c6d13640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92c0102a70 0x7f92c019c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:17.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.621+0000 7f92c6d13640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92c01083b0 0x7f92c019cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:17.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.621+0000 7f92c6d13640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92c0108d00 0x7f92c01a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:17.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.621+0000 7f92c6d13640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f92c0113a70 con 0x7f92c0108d00 2024-09-21T01:05:17.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.621+0000 7f92c6d13640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f92c01138f0 con 0x7f92c01083b0 2024-09-21T01:05:17.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.621+0000 7f92c6d13640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f92c0113bf0 con 0x7f92c0102a70 2024-09-21T01:05:17.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.621+0000 7f92bffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92c01083b0 0x7f92c019cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:17.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.621+0000 7f92c4aaf640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92c0102a70 0x7f92c019c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:17.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.621+0000 7f92bffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92c01083b0 0x7f92c019cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:54868/0 (socket says 172.21.15.1:54868) 2024-09-21T01:05:17.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.621+0000 7f92c4aaf640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92c0102a70 0x7f92c019c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:44372/0 (socket says 172.21.15.1:44372) 2024-09-21T01:05:17.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.621+0000 7f92bffff640 1 -- 172.21.15.1:0/2307673862 learned_addr learned my addr 172.21.15.1:0/2307673862 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:17.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.621+0000 7f92c52b0640 1 --2- 172.21.15.1:0/2307673862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92c0108d00 0x7f92c01a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:17.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.622+0000 7f92c4aaf640 1 -- 172.21.15.1:0/2307673862 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92c01083b0 msgr2=0x7f92c019cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:17.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.622+0000 7f92c4aaf640 1 --2- 172.21.15.1:0/2307673862 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92c01083b0 0x7f92c019cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:17.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.622+0000 7f92c4aaf640 1 -- 172.21.15.1:0/2307673862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92c0108d00 msgr2=0x7f92c01a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:17.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.622+0000 7f92c4aaf640 1 --2- 172.21.15.1:0/2307673862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92c0108d00 0x7f92c01a1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:17.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.622+0000 7f92c4aaf640 1 -- 172.21.15.1:0/2307673862 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92c01a2630 con 0x7f92c0102a70 2024-09-21T01:05:17.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.622+0000 7f92c4aaf640 1 --2- 172.21.15.1:0/2307673862 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92c0102a70 0x7f92c019c6c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f92b402a930 tx=0x7f92b4031a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:17.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.622+0000 7f92bdffb640 1 -- 172.21.15.1:0/2307673862 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b403f030 con 0x7f92c0102a70 2024-09-21T01:05:17.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.622+0000 7f92bdffb640 1 -- 172.21.15.1:0/2307673862 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92b4004490 con 0x7f92c0102a70 2024-09-21T01:05:17.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.622+0000 7f92bdffb640 1 -- 172.21.15.1:0/2307673862 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b4035070 con 0x7f92c0102a70 2024-09-21T01:05:17.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.622+0000 7f92c6d13640 1 -- 172.21.15.1:0/2307673862 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92c01a28c0 con 0x7f92c0102a70 2024-09-21T01:05:17.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.622+0000 7f92c6d13640 1 -- 172.21.15.1:0/2307673862 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92c01a9080 con 0x7f92c0102a70 2024-09-21T01:05:17.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.625+0000 7f92bdffb640 1 -- 172.21.15.1:0/2307673862 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f92b4042030 con 0x7f92c0102a70 2024-09-21T01:05:17.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.625+0000 7f92cd287740 1 Processor -- start 2024-09-21T01:05:17.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.625+0000 7f92cd287740 1 -- start start 2024-09-21T01:05:17.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.626+0000 7f92cd287740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6c0261070 0x55a6c0608270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:17.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.626+0000 7f92cd287740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6c02381b0 0x55a6c06087b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:17.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.626+0000 7f92cd287740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6c0240390 0x55a6c0608cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:17.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.626+0000 7f92cd287740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a6c057ee50 con 0x55a6c0240390 2024-09-21T01:05:17.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.626+0000 7f92cd287740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a6c056e280 con 0x55a6c02381b0 2024-09-21T01:05:17.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.626+0000 7f92cd287740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a6c0572090 con 0x55a6c0261070 2024-09-21T01:05:17.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.626+0000 7f92c4aaf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6c02381b0 0x55a6c06087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:17.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.626+0000 7f92c52b0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6c0261070 0x55a6c0608270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:17.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.626+0000 7f92bffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6c0240390 0x55a6c0608cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:17.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.626+0000 7f92bffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6c0240390 0x55a6c0608cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52660/0 (socket says 172.21.15.1:52660) 2024-09-21T01:05:17.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.626+0000 7f92bffff640 1 -- 172.21.15.1:0/3712946784 learned_addr learned my addr 172.21.15.1:0/3712946784 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:17.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.626+0000 7f92bdffb640 1 --2- 172.21.15.1:0/2307673862 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f92b00b6590 0x7f92b00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:17.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.626+0000 7f92c52b0640 1 -- 172.21.15.1:0/3712946784 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6c02381b0 msgr2=0x55a6c06087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:17.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.626+0000 7f92c52b0640 1 --2- 172.21.15.1:0/3712946784 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6c02381b0 0x55a6c06087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:17.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.626+0000 7f92c52b0640 1 -- 172.21.15.1:0/3712946784 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6c0240390 msgr2=0x55a6c0608cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:17.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.626+0000 7f92c52b0640 1 --2- 172.21.15.1:0/3712946784 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6c0240390 0x55a6c0608cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:17.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.626+0000 7f92c52b0640 1 -- 172.21.15.1:0/3712946784 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6c02cc650 con 0x55a6c0261070 2024-09-21T01:05:17.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.627+0000 7f92bdffb640 1 -- 172.21.15.1:0/2307673862 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f92b4107540 con 0x7f92c0102a70 2024-09-21T01:05:17.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.627+0000 7f92c52b0640 1 --2- 172.21.15.1:0/2307673862 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f92b00b6590 0x7f92b00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:17.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.627+0000 7f92c52b0640 1 --2- 172.21.15.1:0/3712946784 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6c0261070 0x55a6c0608270 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f92b8009f00 tx=0x7f92b8011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e67cef2e8e88c15 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:17.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.627+0000 7f92aaffd640 1 -- 172.21.15.1:0/3712946784 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b80045c0 con 0x55a6c0261070 2024-09-21T01:05:17.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.627+0000 7f92c52b0640 1 --2- 172.21.15.1:0/2307673862 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f92b00b6590 0x7f92b00b8aa0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f92b8020000 tx=0x7f92b8021000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:17.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.627+0000 7f92aaffd640 1 -- 172.21.15.1:0/3712946784 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92b8004760 con 0x55a6c0261070 2024-09-21T01:05:17.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.627+0000 7f92aaffd640 1 -- 172.21.15.1:0/3712946784 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b801c400 con 0x55a6c0261070 2024-09-21T01:05:17.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.628+0000 7f92cd287740 1 -- 172.21.15.1:0/3712946784 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6c0261070 msgr2=0x55a6c0608270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:17.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.628+0000 7f92cd287740 1 --2- 172.21.15.1:0/3712946784 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6c0261070 0x55a6c0608270 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f92b8009f00 tx=0x7f92b8011810 comp rx=0 tx=0).stop 2024-09-21T01:05:17.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.629+0000 7f92cd287740 1 -- 172.21.15.1:0/3712946784 shutdown_connections 2024-09-21T01:05:17.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.629+0000 7f92cd287740 1 --2- 172.21.15.1:0/3712946784 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6c0240390 0x55a6c0608cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:17.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.629+0000 7f92cd287740 1 --2- 172.21.15.1:0/3712946784 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6c02381b0 0x55a6c06087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:17.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.629+0000 7f92cd287740 1 --2- 172.21.15.1:0/3712946784 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6c0261070 0x55a6c0608270 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:17.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.629+0000 7f92cd287740 1 -- 172.21.15.1:0/3712946784 >> 172.21.15.1:0/3712946784 conn(0x55a6c0255460 msgr2=0x55a6c0606160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:17.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.629+0000 7f92cd287740 1 -- 172.21.15.1:0/3712946784 shutdown_connections 2024-09-21T01:05:17.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.629+0000 7f92cd287740 1 -- 172.21.15.1:0/3712946784 wait complete. 2024-09-21T01:05:17.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.629+0000 7f92cd287740 1 -- start start 2024-09-21T01:05:17.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.629+0000 7f92cd287740 1 Processor -- start 2024-09-21T01:05:17.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.630+0000 7f92cd287740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6c02381b0 0x55a6c061ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:17.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.630+0000 7f92cd287740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6c0240390 0x55a6c061d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:17.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.630+0000 7f92cd287740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6c0261070 0x55a6c0622060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:17.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.630+0000 7f92c4aaf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6c02381b0 0x55a6c061ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:17.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.630+0000 7f92cd287740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a6c03cf700 con 0x55a6c0261070 2024-09-21T01:05:17.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.630+0000 7f92cd287740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a6c0509110 con 0x55a6c02381b0 2024-09-21T01:05:17.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.630+0000 7f92cd287740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a6c0616a50 con 0x55a6c0240390 2024-09-21T01:05:17.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.630+0000 7f92c4aaf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6c02381b0 0x55a6c061ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:54888/0 (socket says 172.21.15.1:54888) 2024-09-21T01:05:17.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.630+0000 7f92c4aaf640 1 -- 172.21.15.1:0/1953433982 learned_addr learned my addr 172.21.15.1:0/1953433982 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:17.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.631+0000 7f92bffff640 1 --2- 172.21.15.1:0/1953433982 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6c0240390 0x55a6c061d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:17.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.631+0000 7f92cd287740 10 client.0 _ll_register_callbacks cb 0x55a6c0522990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:05:17.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.631+0000 7f92c52b0640 1 --2- 172.21.15.1:0/1953433982 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6c0261070 0x55a6c0622060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:17.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.631+0000 7f92c4aaf640 1 -- 172.21.15.1:0/1953433982 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6c0240390 msgr2=0x55a6c061d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:17.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.631+0000 7f92c4aaf640 1 --2- 172.21.15.1:0/1953433982 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6c0240390 0x55a6c061d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:17.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.631+0000 7f92c4aaf640 1 -- 172.21.15.1:0/1953433982 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6c0261070 msgr2=0x55a6c0622060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:17.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.631+0000 7f92c4aaf640 1 --2- 172.21.15.1:0/1953433982 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6c0261070 0x55a6c0622060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:17.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.631+0000 7f92c4aaf640 1 -- 172.21.15.1:0/1953433982 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6c0536c40 con 0x55a6c02381b0 2024-09-21T01:05:17.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.631+0000 7f92c4aaf640 1 --2- 172.21.15.1:0/1953433982 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6c02381b0 0x55a6c061ca60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f92b404a000 tx=0x7f92b410ac00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3818bc7edf9c368d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:17.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.631+0000 7f929ffff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:05:17.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.631+0000 7f929ffff640 1 -- 172.21.15.1:0/1953433982 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b4049070 con 0x55a6c02381b0 2024-09-21T01:05:17.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.631+0000 7f92cd287740 1 -- 172.21.15.1:0/1953433982 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92b8004760 con 0x55a6c02381b0 2024-09-21T01:05:17.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.631+0000 7f929ffff640 1 -- 172.21.15.1:0/1953433982 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f92b403bc30 con 0x55a6c02381b0 2024-09-21T01:05:17.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.632+0000 7f929ffff640 1 -- 172.21.15.1:0/1953433982 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f92b40c7e60 con 0x55a6c02381b0 2024-09-21T01:05:17.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.632+0000 7f92cd287740 10 client.27020 fetch_fsmap learned FSMap version 40 2024-09-21T01:05:17.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.632+0000 7f92cd287740 1 -- 172.21.15.1:0/1953433982 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55a6c062af90 con 0x55a6c02381b0 2024-09-21T01:05:17.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.632+0000 7f929ffff640 1 -- 172.21.15.1:0/1953433982 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92b8004760 con 0x55a6c02381b0 2024-09-21T01:05:17.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.632+0000 7f929ffff640 1 -- 172.21.15.1:0/1953433982 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 40) ==== 8394+0+0 (secure 0 0 0) 0x7f92b40d6c40 con 0x55a6c02381b0 2024-09-21T01:05:17.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.632+0000 7f92cd287740 10 client.27020 fetch_fsmap finished waiting for FSMap version 40 2024-09-21T01:05:17.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.632+0000 7f92cd287740 10 client.27020 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:05:17.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.632+0000 7f92cd287740 20 client.27020 populate_metadata read hostname 'smithi001' 2024-09-21T01:05:17.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.632+0000 7f92cd287740 1 --2- 172.21.15.1:0/1953433982 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a6c021f9f0 0x55a6c062e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:17.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.632+0000 7f92cd287740 4 client.27020 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:05:17.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.632+0000 7f92cd287740 1 -- 172.21.15.1:0/1953433982 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a6c0580da0 con 0x55a6c021f9f0 2024-09-21T01:05:17.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.632+0000 7f92bffff640 1 --2- 172.21.15.1:0/1953433982 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a6c021f9f0 0x55a6c062e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:17.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.633+0000 7f92bffff640 1 --2- 172.21.15.1:0/1953433982 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a6c021f9f0 0x55a6c062e510 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38a42234dcf3bfb8 server_cookie=645813039331f8af in_seq=0 out_seq=0 2024-09-21T01:05:17.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.633+0000 7f929ffff640 10 client.27020 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:05:17.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.634+0000 7f929ffff640 1 -- 172.21.15.1:0/1953433982 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a6c0580da0 con 0x55a6c021f9f0 2024-09-21T01:05:17.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.634+0000 7f929ffff640 10 client.27020 handle_command_reply: tid=0 2024-09-21T01:05:17.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.634+0000 7f92cd287740 1 client.27020 shutdown 2024-09-21T01:05:17.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.634+0000 7f92cd287740 1 -- 172.21.15.1:0/1953433982 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6c02381b0 msgr2=0x55a6c061ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:17.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.634+0000 7f92cd287740 1 --2- 172.21.15.1:0/1953433982 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6c02381b0 0x55a6c061ca60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f92b404a000 tx=0x7f92b410ac00 comp rx=0 tx=0).stop 2024-09-21T01:05:17.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.634+0000 7f92cd287740 1 -- 172.21.15.1:0/1953433982 shutdown_connections 2024-09-21T01:05:17.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.634+0000 7f92cd287740 1 --2- 172.21.15.1:0/1953433982 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a6c021f9f0 0x55a6c062e510 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:17.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.634+0000 7f929ffff640 0 client.27020 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:05:17.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.634+0000 7f92cd287740 1 --2- 172.21.15.1:0/1953433982 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6c0261070 0x55a6c0622060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:17.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.634+0000 7f92cd287740 1 --2- 172.21.15.1:0/1953433982 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6c0240390 0x55a6c061d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:17.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.634+0000 7f92cd287740 1 --2- 172.21.15.1:0/1953433982 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6c02381b0 0x55a6c061ca60 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:17.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.634+0000 7f92cd287740 1 -- 172.21.15.1:0/1953433982 >> 172.21.15.1:0/1953433982 conn(0x55a6c0255460 msgr2=0x55a6c060b400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:17.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.635+0000 7f92cd287740 1 -- 172.21.15.1:0/1953433982 shutdown_connections 2024-09-21T01:05:17.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.635+0000 7f92cd287740 1 -- 172.21.15.1:0/1953433982 wait complete. 2024-09-21T01:05:17.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.635+0000 7f92cd287740 20 client.27020 trim_cache size 0 max 16384 2024-09-21T01:05:17.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.654+0000 7f92cd287740 1 Processor -- start 2024-09-21T01:05:17.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.654+0000 7f92cd287740 1 -- start start 2024-09-21T01:05:17.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.654+0000 7f92cd287740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6c021f9f0 0x55a6c0606190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:17.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.654+0000 7f92cd287740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6c02381b0 0x55a6c0616c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:17.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.654+0000 7f92cd287740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6c0240390 0x55a6c0615d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:17.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.654+0000 7f92cd287740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f92c0070e60 con 0x55a6c0240390 2024-09-21T01:05:17.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.654+0000 7f92cd287740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f92c0072af0 con 0x55a6c02381b0 2024-09-21T01:05:17.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.654+0000 7f92cd287740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f92c0071560 con 0x55a6c021f9f0 2024-09-21T01:05:17.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.654+0000 7f92c52b0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6c0240390 0x55a6c0615d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:17.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.654+0000 7f92c52b0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6c0240390 0x55a6c0615d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52672/0 (socket says 172.21.15.1:52672) 2024-09-21T01:05:17.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.654+0000 7f92c52b0640 1 -- 172.21.15.1:0/3865005680 learned_addr learned my addr 172.21.15.1:0/3865005680 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:17.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.654+0000 7f92bffff640 1 --2- 172.21.15.1:0/3865005680 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6c02381b0 0x55a6c0616c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:17.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.654+0000 7f92c4aaf640 1 --2- 172.21.15.1:0/3865005680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6c021f9f0 0x55a6c0606190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:17.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.655+0000 7f92c52b0640 1 -- 172.21.15.1:0/3865005680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6c021f9f0 msgr2=0x55a6c0606190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:17.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.655+0000 7f92c52b0640 1 --2- 172.21.15.1:0/3865005680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6c021f9f0 0x55a6c0606190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:17.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.655+0000 7f92c52b0640 1 -- 172.21.15.1:0/3865005680 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6c02381b0 msgr2=0x55a6c0616c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:17.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.655+0000 7f92c52b0640 1 --2- 172.21.15.1:0/3865005680 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6c02381b0 0x55a6c0616c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:17.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.655+0000 7f92c52b0640 1 -- 172.21.15.1:0/3865005680 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6c061b7c0 con 0x55a6c0240390 2024-09-21T01:05:17.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.655+0000 7f92c52b0640 1 --2- 172.21.15.1:0/3865005680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6c0240390 0x55a6c0615d70 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f92b8026000 tx=0x7f92b8027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f3e1906eed850f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:17.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.655+0000 7f92aa7fc640 1 -- 172.21.15.1:0/3865005680 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b8036020 con 0x55a6c0240390 2024-09-21T01:05:17.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.655+0000 7f92aa7fc640 1 -- 172.21.15.1:0/3865005680 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92b8009b30 con 0x55a6c0240390 2024-09-21T01:05:17.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.655+0000 7f92aa7fc640 1 -- 172.21.15.1:0/3865005680 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b800fc60 con 0x55a6c0240390 2024-09-21T01:05:17.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.656+0000 7f92cd287740 1 -- 172.21.15.1:0/3865005680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6c0240390 msgr2=0x55a6c0615d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:17.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.656+0000 7f92cd287740 1 --2- 172.21.15.1:0/3865005680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6c0240390 0x55a6c0615d70 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f92b8026000 tx=0x7f92b8027000 comp rx=0 tx=0).stop 2024-09-21T01:05:17.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.656+0000 7f92cd287740 1 -- 172.21.15.1:0/3865005680 shutdown_connections 2024-09-21T01:05:17.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.656+0000 7f92cd287740 1 --2- 172.21.15.1:0/3865005680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6c0240390 0x55a6c0615d70 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:17.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.656+0000 7f92cd287740 1 --2- 172.21.15.1:0/3865005680 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6c02381b0 0x55a6c0616c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:17.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.656+0000 7f92cd287740 1 --2- 172.21.15.1:0/3865005680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6c021f9f0 0x55a6c0606190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:17.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.656+0000 7f92cd287740 1 -- 172.21.15.1:0/3865005680 >> 172.21.15.1:0/3865005680 conn(0x55a6c0255460 msgr2=0x55a6c0605a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:17.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.656+0000 7f92cd287740 1 -- 172.21.15.1:0/3865005680 shutdown_connections 2024-09-21T01:05:17.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.656+0000 7f92cd287740 1 -- 172.21.15.1:0/3865005680 wait complete. 2024-09-21T01:05:17.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.657+0000 7f92cd287740 1 -- start start 2024-09-21T01:05:17.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.657+0000 7f92cd287740 1 Processor -- start 2024-09-21T01:05:17.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.657+0000 7f92cd287740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6c021f9f0 0x55a6c0623240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:17.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.657+0000 7f92cd287740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6c02381b0 0x55a6c0623780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:17.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.657+0000 7f92cd287740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6c0240390 0x55a6c0628090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:17.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.657+0000 7f92cd287740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f92c0072360 con 0x55a6c0240390 2024-09-21T01:05:17.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.657+0000 7f92cd287740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f92c0071c60 con 0x55a6c021f9f0 2024-09-21T01:05:17.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.657+0000 7f92cd287740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f92c006ee80 con 0x55a6c02381b0 2024-09-21T01:05:17.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.657+0000 7f92cd287740 10 client.0 _ll_register_callbacks cb 0x7f92b4005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:05:17.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.658+0000 7f92c4aaf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6c021f9f0 0x55a6c0623240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:17.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.658+0000 7f92bffff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6c02381b0 0x55a6c0623780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:17.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.658+0000 7f92c52b0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6c0240390 0x55a6c0628090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:17.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.658+0000 7f92bffff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6c02381b0 0x55a6c0623780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:44408/0 (socket says 172.21.15.1:44408) 2024-09-21T01:05:17.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.658+0000 7f92c4aaf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6c021f9f0 0x55a6c0623240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:54908/0 (socket says 172.21.15.1:54908) 2024-09-21T01:05:17.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.658+0000 7f92bffff640 1 -- 172.21.15.1:0/117616878 learned_addr learned my addr 172.21.15.1:0/117616878 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:17.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.658+0000 7f92c4aaf640 1 -- 172.21.15.1:0/117616878 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6c02381b0 msgr2=0x55a6c0623780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:17.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.658+0000 7f92c4aaf640 1 --2- 172.21.15.1:0/117616878 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6c02381b0 0x55a6c0623780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:17.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.658+0000 7f92c4aaf640 1 -- 172.21.15.1:0/117616878 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6c0240390 msgr2=0x55a6c0628090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:17.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.658+0000 7f92c4aaf640 1 --2- 172.21.15.1:0/117616878 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6c0240390 0x55a6c0628090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:17.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.658+0000 7f92c4aaf640 1 -- 172.21.15.1:0/117616878 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6c06285d0 con 0x55a6c021f9f0 2024-09-21T01:05:17.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.658+0000 7f92c52b0640 1 --2- 172.21.15.1:0/117616878 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6c0240390 0x55a6c0628090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:05:17.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.658+0000 7f92c4aaf640 1 --2- 172.21.15.1:0/117616878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6c021f9f0 0x55a6c0623240 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f92b40ca9d0 tx=0x7f92b41072f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb007d23ee3075e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:17.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.658+0000 7f929ffff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:05:17.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.658+0000 7f929ffff640 1 -- 172.21.15.1:0/117616878 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b4049070 con 0x55a6c021f9f0 2024-09-21T01:05:17.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.658+0000 7f929ffff640 1 -- 172.21.15.1:0/117616878 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f92b40c90b0 con 0x55a6c021f9f0 2024-09-21T01:05:17.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.658+0000 7f92cd287740 1 -- 172.21.15.1:0/117616878 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92b8009b30 con 0x55a6c021f9f0 2024-09-21T01:05:17.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.659+0000 7f929ffff640 1 -- 172.21.15.1:0/117616878 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f92b40c9600 con 0x55a6c021f9f0 2024-09-21T01:05:17.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.659+0000 7f92cd287740 10 client.27026 fetch_fsmap learned FSMap version 40 2024-09-21T01:05:17.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.659+0000 7f92cd287740 1 -- 172.21.15.1:0/117616878 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55a6c06995e0 con 0x55a6c021f9f0 2024-09-21T01:05:17.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.659+0000 7f929ffff640 1 -- 172.21.15.1:0/117616878 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92b8009b30 con 0x55a6c021f9f0 2024-09-21T01:05:17.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.659+0000 7f929ffff640 1 -- 172.21.15.1:0/117616878 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 40) ==== 8394+0+0 (secure 0 0 0) 0x7f92b40d6040 con 0x55a6c021f9f0 2024-09-21T01:05:17.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.659+0000 7f92cd287740 10 client.27026 fetch_fsmap finished waiting for FSMap version 40 2024-09-21T01:05:17.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.659+0000 7f92cd287740 10 client.27026 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:05:17.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.659+0000 7f92cd287740 20 client.27026 populate_metadata read hostname 'smithi001' 2024-09-21T01:05:17.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.659+0000 7f92cd287740 1 --2- 172.21.15.1:0/117616878 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a6c0261070 0x55a6c069bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:17.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.659+0000 7f92cd287740 4 client.27026 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:05:17.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.659+0000 7f92cd287740 1 -- 172.21.15.1:0/117616878 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a6c057c850 con 0x55a6c0261070 2024-09-21T01:05:17.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.659+0000 7f92bffff640 1 --2- 172.21.15.1:0/117616878 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a6c0261070 0x55a6c069bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:17.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.660+0000 7f929ffff640 10 client.27026 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:05:17.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.660+0000 7f92bffff640 1 --2- 172.21.15.1:0/117616878 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a6c0261070 0x55a6c069bcb0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8f8c19bc2fd9605 server_cookie=5beeb6b7ba825e16 in_seq=0 out_seq=0 2024-09-21T01:05:17.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.660+0000 7f929ffff640 1 -- 172.21.15.1:0/117616878 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2930 (crc 0 0 0) 0x55a6c057c850 con 0x55a6c0261070 2024-09-21T01:05:17.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.660+0000 7f929ffff640 10 client.27026 handle_command_reply: tid=0 2024-09-21T01:05:17.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.660+0000 7f92cd287740 1 client.27026 shutdown 2024-09-21T01:05:17.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.661+0000 7f92cd287740 1 -- 172.21.15.1:0/117616878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6c021f9f0 msgr2=0x55a6c0623240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:17.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.661+0000 7f92cd287740 1 --2- 172.21.15.1:0/117616878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6c021f9f0 0x55a6c0623240 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f92b40ca9d0 tx=0x7f92b41072f0 comp rx=0 tx=0).stop 2024-09-21T01:05:17.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.661+0000 7f92cd287740 1 -- 172.21.15.1:0/117616878 shutdown_connections 2024-09-21T01:05:17.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.661+0000 7f92cd287740 1 --2- 172.21.15.1:0/117616878 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x55a6c0261070 0x55a6c069bcb0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:17.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.661+0000 7f929ffff640 0 client.27026 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:05:17.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.661+0000 7f92cd287740 1 --2- 172.21.15.1:0/117616878 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6c0240390 0x55a6c0628090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:17.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.661+0000 7f92cd287740 1 --2- 172.21.15.1:0/117616878 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6c02381b0 0x55a6c0623780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:17.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.661+0000 7f92cd287740 1 --2- 172.21.15.1:0/117616878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a6c021f9f0 0x55a6c0623240 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:17.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.661+0000 7f92cd287740 1 -- 172.21.15.1:0/117616878 >> 172.21.15.1:0/117616878 conn(0x55a6c0255460 msgr2=0x55a6c060b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:17.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.661+0000 7f92cd287740 1 -- 172.21.15.1:0/117616878 shutdown_connections 2024-09-21T01:05:17.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.661+0000 7f92cd287740 1 -- 172.21.15.1:0/117616878 wait complete. 2024-09-21T01:05:17.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.661+0000 7f92cd287740 20 client.27026 trim_cache size 0 max 16384 2024-09-21T01:05:17.666 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T01:05:17.667 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "no active scrubs running", 2024-09-21T01:05:17.667 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": {}, 2024-09-21T01:05:17.667 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_stats": { 2024-09-21T01:05:17.667 INFO:teuthology.orchestra.run.smithi001.stdout: "312f6066-fad3-46b9-9286-e6b009b3a330": { 2024-09-21T01:05:17.667 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:04:44.236119+0000", 2024-09-21T01:05:17.667 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:05:17.667 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:05:17.667 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:05:17.667 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:05:17.667 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:05:17.667 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:17.667 INFO:teuthology.orchestra.run.smithi001.stdout: "c2addc95-c922-4a70-b746-0b5fd2af59bf": { 2024-09-21T01:05:17.667 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:00:52.374848+0000", 2024-09-21T01:05:17.667 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:05:17.667 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:05:17.668 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:05:17.668 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:05:17.668 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:05:17.668 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:17.668 INFO:teuthology.orchestra.run.smithi001.stdout: "d9a37a97-ce14-4763-8c19-9bd32df63cf3": { 2024-09-21T01:05:17.668 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:01:45.914443+0000", 2024-09-21T01:05:17.668 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:05:17.668 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:05:17.668 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:05:17.668 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:05:17.668 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:05:17.668 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:17.668 INFO:teuthology.orchestra.run.smithi001.stdout: "f826f2c1-768a-47bb-b868-785b351ac6b4": { 2024-09-21T01:05:17.668 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:59:06.554657+0000", 2024-09-21T01:05:17.669 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:05:17.669 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:05:17.669 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:05:17.669 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:05:17.669 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:05:17.669 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:17.669 INFO:teuthology.orchestra.run.smithi001.stdout: "1bffed0d-34b1-4e8b-9cab-7501131ef79d": { 2024-09-21T01:05:17.669 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:00:02.564228+0000", 2024-09-21T01:05:17.669 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:05:17.669 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:05:17.669 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:05:17.669 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:05:17.669 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:05:17.669 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:17.669 INFO:teuthology.orchestra.run.smithi001.stdout: "bee49cce-b407-4617-a959-331ffd8dc5b0": { 2024-09-21T01:05:17.670 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:58:17.883027+0000", 2024-09-21T01:05:17.670 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:05:17.670 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:05:17.670 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:05:17.670 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:05:17.670 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:05:17.670 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:17.670 INFO:teuthology.orchestra.run.smithi001.stdout: "3d019354-f00e-4e9b-b42c-f519d1f68cd2": { 2024-09-21T01:05:17.670 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T01:03:25.601697+0000", 2024-09-21T01:05:17.670 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:05:17.670 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:05:17.670 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:05:17.670 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:05:17.670 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:05:17.671 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:17.671 INFO:teuthology.orchestra.run.smithi001.stdout: "7cb1bc3f-e2d2-4bf7-b13e-8f3371d7aac1": { 2024-09-21T01:05:17.671 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:58:02.751142+0000", 2024-09-21T01:05:17.671 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:05:17.671 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:05:17.671 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:05:17.671 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:05:17.671 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:05:17.671 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:17.671 INFO:teuthology.orchestra.run.smithi001.stdout: "2383a19c-993d-4440-99f7-93b43dcf33b4": { 2024-09-21T01:05:17.671 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:47.609257+0000", 2024-09-21T01:05:17.671 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:05:17.671 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:05:17.671 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:05:17.671 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:05:17.672 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:05:17.672 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:17.672 INFO:teuthology.orchestra.run.smithi001.stdout: "53fa74e4-5aa8-408b-9724-7c93618f7636": { 2024-09-21T01:05:17.672 INFO:teuthology.orchestra.run.smithi001.stdout: "start_time": "2024-09-21T00:57:01.730608+0000", 2024-09-21T01:05:17.672 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-21T01:05:17.672 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:05:17.672 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_passed": 0, 2024-09-21T01:05:17.672 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_failed": 0, 2024-09-21T01:05:17.672 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_skipped": 0 2024-09-21T01:05:17.672 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:17.672 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:17.672 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T01:05:17.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.662+0000 7f92c6d13640 1 -- 172.21.15.1:0/2307673862 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f92b00b6590 msgr2=0x7f92b00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:17.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.662+0000 7f92c6d13640 1 --2- 172.21.15.1:0/2307673862 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f92b00b6590 0x7f92b00b8aa0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f92b8020000 tx=0x7f92b8021000 comp rx=0 tx=0).stop 2024-09-21T01:05:17.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.662+0000 7f92c6d13640 1 -- 172.21.15.1:0/2307673862 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92c0102a70 msgr2=0x7f92c019c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:17.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.662+0000 7f92c6d13640 1 --2- 172.21.15.1:0/2307673862 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92c0102a70 0x7f92c019c6c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f92b402a930 tx=0x7f92b4031a20 comp rx=0 tx=0).stop 2024-09-21T01:05:17.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.662+0000 7f92c6d13640 1 -- 172.21.15.1:0/2307673862 shutdown_connections 2024-09-21T01:05:17.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.662+0000 7f92c6d13640 1 --2- 172.21.15.1:0/2307673862 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f92b00b6590 0x7f92b00b8aa0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:17.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.662+0000 7f92c6d13640 1 --2- 172.21.15.1:0/2307673862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92c0108d00 0x7f92c01a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:17.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.662+0000 7f92c6d13640 1 --2- 172.21.15.1:0/2307673862 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92c01083b0 0x7f92c019cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:17.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.662+0000 7f92c6d13640 1 --2- 172.21.15.1:0/2307673862 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92c0102a70 0x7f92c019c6c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:17.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.662+0000 7f92c6d13640 1 -- 172.21.15.1:0/2307673862 >> 172.21.15.1:0/2307673862 conn(0x7f92c0079730 msgr2=0x7f92c010d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:17.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.662+0000 7f92c6d13640 1 -- 172.21.15.1:0/2307673862 shutdown_connections 2024-09-21T01:05:17.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:17.662+0000 7f92c6d13640 1 -- 172.21.15.1:0/2307673862 wait complete. 2024-09-21T01:05:17.674 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:17 smithi001 ceph-mon[31211]: pgmap v600: 97 pgs: 97 active+clean; 311 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 505 op/s 2024-09-21T01:05:17.674 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:17 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:05:17.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:17 smithi193 ceph-mon[34660]: pgmap v600: 97 pgs: 97 active+clean; 311 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 505 op/s 2024-09-21T01:05:17.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:17 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:05:17.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:17 smithi042 ceph-mon[34481]: pgmap v600: 97 pgs: 97 active+clean; 311 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 505 op/s 2024-09-21T01:05:17.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:17 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:05:18.746 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T01:05:18.746 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:05:18.952 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:18 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:18.952 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:18 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:05:18.953 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:18 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T01:05:18.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:18 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:18.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:18 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:05:18.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:18 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T01:05:18.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:18 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:18.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:18 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:05:18.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:18 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' 2024-09-21T01:05:19.012 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:19.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.547+0000 7f04a605a640 1 -- 172.21.15.1:0/1577813115 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04a0101de0 msgr2=0x7f04a01021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:19.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.547+0000 7f04a605a640 1 --2- 172.21.15.1:0/1577813115 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04a0101de0 0x7f04a01021f0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f0494009900 tx=0x7f049402a3f0 comp rx=0 tx=0).stop 2024-09-21T01:05:19.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.547+0000 7f04a605a640 1 -- 172.21.15.1:0/1577813115 shutdown_connections 2024-09-21T01:05:19.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.547+0000 7f04a605a640 1 --2- 172.21.15.1:0/1577813115 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04a0102730 0x7f04a0110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:19.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.547+0000 7f04a605a640 1 --2- 172.21.15.1:0/1577813115 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04a0101de0 0x7f04a01021f0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:19.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.547+0000 7f04a605a640 1 --2- 172.21.15.1:0/1577813115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04a01086f0 0x7f04a0108b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:19.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.548+0000 7f04a605a640 1 -- 172.21.15.1:0/1577813115 >> 172.21.15.1:0/1577813115 conn(0x7f04a0077c60 msgr2=0x7f04a00780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:19.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.548+0000 7f04a605a640 1 -- 172.21.15.1:0/1577813115 shutdown_connections 2024-09-21T01:05:19.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.548+0000 7f04a605a640 1 -- 172.21.15.1:0/1577813115 wait complete. 2024-09-21T01:05:19.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.549+0000 7f04a605a640 1 Processor -- start 2024-09-21T01:05:19.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.549+0000 7f04a605a640 1 -- start start 2024-09-21T01:05:19.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.549+0000 7f04a605a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04a0101de0 0x7f04a0103010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:19.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.549+0000 7f04a605a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04a0102730 0x7f04a0103550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:19.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.549+0000 7f04a605a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04a01086f0 0x7f04a0103a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:19.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.549+0000 7f04a605a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f04a0113ae0 con 0x7f04a01086f0 2024-09-21T01:05:19.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.549+0000 7f04a605a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f04a0113960 con 0x7f04a0102730 2024-09-21T01:05:19.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.549+0000 7f04a605a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f04a0113c60 con 0x7f04a0101de0 2024-09-21T01:05:19.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.550+0000 7f049ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04a01086f0 0x7f04a0103a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:19.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.550+0000 7f049f7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04a0101de0 0x7f04a0103010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:19.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.550+0000 7f049ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04a01086f0 0x7f04a0103a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39776/0 (socket says 172.21.15.1:39776) 2024-09-21T01:05:19.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.550+0000 7f049ffff640 1 -- 172.21.15.1:0/3091798140 learned_addr learned my addr 172.21.15.1:0/3091798140 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:19.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.550+0000 7f049f7fe640 1 -- 172.21.15.1:0/3091798140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04a0102730 msgr2=0x7f04a0103550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:19.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.550+0000 7f049effd640 1 --2- 172.21.15.1:0/3091798140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04a0102730 0x7f04a0103550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:19.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.550+0000 7f049f7fe640 1 --2- 172.21.15.1:0/3091798140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04a0102730 0x7f04a0103550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:19.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.550+0000 7f049f7fe640 1 -- 172.21.15.1:0/3091798140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04a01086f0 msgr2=0x7f04a0103a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:19.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.550+0000 7f049f7fe640 1 --2- 172.21.15.1:0/3091798140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04a01086f0 0x7f04a0103a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:19.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.550+0000 7f049f7fe640 1 -- 172.21.15.1:0/3091798140 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a01a87f0 con 0x7f04a0101de0 2024-09-21T01:05:19.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.550+0000 7f049ffff640 1 --2- 172.21.15.1:0/3091798140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04a01086f0 0x7f04a0103a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:05:19.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.550+0000 7f049effd640 1 --2- 172.21.15.1:0/3091798140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04a0102730 0x7f04a0103550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:05:19.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.551+0000 7f049f7fe640 1 --2- 172.21.15.1:0/3091798140 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04a0101de0 0x7f04a0103010 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0490005fd0 tx=0x7f049000dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:19.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.551+0000 7f049cff9640 1 -- 172.21.15.1:0/3091798140 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0490009c30 con 0x7f04a0101de0 2024-09-21T01:05:19.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.551+0000 7f049cff9640 1 -- 172.21.15.1:0/3091798140 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0490009dd0 con 0x7f04a0101de0 2024-09-21T01:05:19.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.551+0000 7f04a605a640 1 -- 172.21.15.1:0/3091798140 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04a01a8ae0 con 0x7f04a0101de0 2024-09-21T01:05:19.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.551+0000 7f04a605a640 1 -- 172.21.15.1:0/3091798140 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04a01a9070 con 0x7f04a0101de0 2024-09-21T01:05:19.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.551+0000 7f049cff9640 1 -- 172.21.15.1:0/3091798140 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0490010460 con 0x7f04a0101de0 2024-09-21T01:05:19.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.553+0000 7f04a605a640 1 -- 172.21.15.1:0/3091798140 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04a01021f0 con 0x7f04a0101de0 2024-09-21T01:05:19.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.555+0000 7f049cff9640 1 -- 172.21.15.1:0/3091798140 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f0490005030 con 0x7f04a0101de0 2024-09-21T01:05:19.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.556+0000 7f049cff9640 1 --2- 172.21.15.1:0/3091798140 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f04880b6610 0x7f04880b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:19.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.557+0000 7f049cff9640 1 -- 172.21.15.1:0/3091798140 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f04900e7260 con 0x7f04a0101de0 2024-09-21T01:05:19.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.557+0000 7f049effd640 1 --2- 172.21.15.1:0/3091798140 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f04880b6610 0x7f04880b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:19.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.557+0000 7f049effd640 1 --2- 172.21.15.1:0/3091798140 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f04880b6610 0x7f04880b8b20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0494000c00 tx=0x7f0494031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:19.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.560+0000 7f049cff9640 1 -- 172.21.15.1:0/3091798140 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0490017020 con 0x7f04a0101de0 2024-09-21T01:05:19.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.816+0000 7f04a605a640 1 -- 172.21.15.1:0/3091798140 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f04a002e640 con 0x7f04a0101de0 2024-09-21T01:05:19.817 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:19 smithi001 ceph-mon[31211]: pgmap v601: 97 pgs: 97 active+clean; 299 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 440 op/s 2024-09-21T01:05:19.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.817+0000 7f049cff9640 1 -- 172.21.15.1:0/3091798140 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11966 (secure 0 0 0) 0x7f04900adaf0 con 0x7f04a0101de0 2024-09-21T01:05:19.818 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T01:05:19.818 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":40,"btime":"2024-09-21T01:04:57:576228+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2810186677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2810186677},{"type":"v1","addr":"172.21.15.1:6835","nonce":2810186677}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14736,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3935320478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3935320478},{"type":"v1","addr":"172.21.15.1:6837","nonce":3935320478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":40,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:54:58.592853+0000","modified":"2024-09-21T01:04:56.921124+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24653,"mds_1":24637,"mds_2":24626,"mds_3":24622,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/2125703572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2125703572},{"type":"v1","addr":"172.21.15.1:6839","nonce":2125703572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/3860445313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860445313},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860445313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6833/712170939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":712170939},{"type":"v1","addr":"172.21.15.193:6833","nonce":712170939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6833/1653911656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1653911656},{"type":"v1","addr":"172.21.15.42:6833","nonce":1653911656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6835/793085918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":793085918},{"type":"v1","addr":"172.21.15.42:6835","nonce":793085918}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6835/3631682268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":3631682268},{"type":"v1","addr":"172.21.15.193:6835","nonce":3631682268}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.193:6837/909252228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":909252228},{"type":"v1","addr":"172.21.15.193:6837","nonce":909252228}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.42:6837/2395608508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2395608508},{"type":"v1","addr":"172.21.15.42:6837","nonce":2395608508}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.193:6839/1365361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1365361177},{"type":"v1","addr":"172.21.15.193:6839","nonce":1365361177}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6839/2526476666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2526476666},{"type":"v1","addr":"172.21.15.42:6839","nonce":2526476666}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653,24637,24626,24622,24610]},"id":1}]} 2024-09-21T01:05:19.818 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 40 2024-09-21T01:05:19.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.819+0000 7f04a605a640 1 -- 172.21.15.1:0/3091798140 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f04880b6610 msgr2=0x7f04880b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:19.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.819+0000 7f04a605a640 1 --2- 172.21.15.1:0/3091798140 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f04880b6610 0x7f04880b8b20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0494000c00 tx=0x7f0494031400 comp rx=0 tx=0).stop 2024-09-21T01:05:19.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.819+0000 7f04a605a640 1 -- 172.21.15.1:0/3091798140 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04a0101de0 msgr2=0x7f04a0103010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:19.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.819+0000 7f04a605a640 1 --2- 172.21.15.1:0/3091798140 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04a0101de0 0x7f04a0103010 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0490005fd0 tx=0x7f049000dde0 comp rx=0 tx=0).stop 2024-09-21T01:05:19.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.819+0000 7f04a605a640 1 -- 172.21.15.1:0/3091798140 shutdown_connections 2024-09-21T01:05:19.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.819+0000 7f04a605a640 1 --2- 172.21.15.1:0/3091798140 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f04880b6610 0x7f04880b8b20 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:19.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.819+0000 7f04a605a640 1 --2- 172.21.15.1:0/3091798140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04a01086f0 0x7f04a0103a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:19.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.819+0000 7f04a605a640 1 --2- 172.21.15.1:0/3091798140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04a0102730 0x7f04a0103550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:19.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.819+0000 7f04a605a640 1 --2- 172.21.15.1:0/3091798140 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04a0101de0 0x7f04a0103010 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:19.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.819+0000 7f04a605a640 1 -- 172.21.15.1:0/3091798140 >> 172.21.15.1:0/3091798140 conn(0x7f04a0077c60 msgr2=0x7f04a01064c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:19.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.819+0000 7f04a605a640 1 -- 172.21.15.1:0/3091798140 shutdown_connections 2024-09-21T01:05:19.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:19.819+0000 7f04a605a640 1 -- 172.21.15.1:0/3091798140 wait complete. 2024-09-21T01:05:19.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:19 smithi193 ceph-mon[34660]: pgmap v601: 97 pgs: 97 active+clean; 299 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 440 op/s 2024-09-21T01:05:19.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:19 smithi042 ceph-mon[34481]: pgmap v601: 97 pgs: 97 active+clean; 299 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 440 op/s 2024-09-21T01:05:20.640 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T01:05:20.901 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:20.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:20 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/3091798140' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:05:20.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:20 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/3091798140' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:05:20.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:20 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/3091798140' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:05:21.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.434+0000 7f0e4dc58640 1 -- 172.21.15.1:0/3476748803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e48105d70 msgr2=0x7f0e48106180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:21.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.434+0000 7f0e4dc58640 1 --2- 172.21.15.1:0/3476748803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e48105d70 0x7f0e48106180 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f0e38009900 tx=0x7f0e3802a3f0 comp rx=0 tx=0).stop 2024-09-21T01:05:21.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.434+0000 7f0e4dc58640 1 -- 172.21.15.1:0/3476748803 shutdown_connections 2024-09-21T01:05:21.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.435+0000 7f0e4dc58640 1 --2- 172.21.15.1:0/3476748803 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e4810c000 0x7f0e48112830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:21.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.435+0000 7f0e4dc58640 1 --2- 172.21.15.1:0/3476748803 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e4810b6b0 0x7f0e4810bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:21.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.435+0000 7f0e4dc58640 1 --2- 172.21.15.1:0/3476748803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e48105d70 0x7f0e48106180 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:21.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.435+0000 7f0e4dc58640 1 -- 172.21.15.1:0/3476748803 >> 172.21.15.1:0/3476748803 conn(0x7f0e48101780 msgr2=0x7f0e48103bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:21.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.436+0000 7f0e4dc58640 1 -- 172.21.15.1:0/3476748803 shutdown_connections 2024-09-21T01:05:21.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.436+0000 7f0e4dc58640 1 -- 172.21.15.1:0/3476748803 wait complete. 2024-09-21T01:05:21.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.437+0000 7f0e4dc58640 1 Processor -- start 2024-09-21T01:05:21.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.437+0000 7f0e4dc58640 1 -- start start 2024-09-21T01:05:21.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.438+0000 7f0e4dc58640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e48105d70 0x7f0e4819c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:21.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.438+0000 7f0e4dc58640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e4810b6b0 0x7f0e4819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:21.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.438+0000 7f0e4dc58640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e4810c000 0x7f0e481a1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:21.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.438+0000 7f0e4dc58640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0e48115d70 con 0x7f0e4810b6b0 2024-09-21T01:05:21.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.438+0000 7f0e4dc58640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0e48115bf0 con 0x7f0e4810c000 2024-09-21T01:05:21.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.438+0000 7f0e4dc58640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0e48115ef0 con 0x7f0e48105d70 2024-09-21T01:05:21.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.438+0000 7f0e477fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e48105d70 0x7f0e4819c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:21.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.438+0000 7f0e46ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e4810b6b0 0x7f0e4819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:21.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.438+0000 7f0e477fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e48105d70 0x7f0e4819c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:42050/0 (socket says 172.21.15.1:42050) 2024-09-21T01:05:21.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.438+0000 7f0e477fe640 1 -- 172.21.15.1:0/413978699 learned_addr learned my addr 172.21.15.1:0/413978699 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:21.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.438+0000 7f0e47fff640 1 --2- 172.21.15.1:0/413978699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e4810c000 0x7f0e481a1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:21.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.439+0000 7f0e46ffd640 1 -- 172.21.15.1:0/413978699 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e48105d70 msgr2=0x7f0e4819c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:21.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.439+0000 7f0e46ffd640 1 --2- 172.21.15.1:0/413978699 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e48105d70 0x7f0e4819c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:21.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.439+0000 7f0e46ffd640 1 -- 172.21.15.1:0/413978699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e4810c000 msgr2=0x7f0e481a1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:21.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.439+0000 7f0e46ffd640 1 --2- 172.21.15.1:0/413978699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e4810c000 0x7f0e481a1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:21.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.439+0000 7f0e46ffd640 1 -- 172.21.15.1:0/413978699 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e481a26d0 con 0x7f0e4810b6b0 2024-09-21T01:05:21.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.439+0000 7f0e477fe640 1 --2- 172.21.15.1:0/413978699 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e48105d70 0x7f0e4819c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:05:21.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.441+0000 7f0e46ffd640 1 --2- 172.21.15.1:0/413978699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e4810b6b0 0x7f0e4819cd00 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f0e4806aa90 tx=0x7f0e3c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:21.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.446+0000 7f0e44ff9640 1 -- 172.21.15.1:0/413978699 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c00cc40 con 0x7f0e4810b6b0 2024-09-21T01:05:21.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.447+0000 7f0e44ff9640 1 -- 172.21.15.1:0/413978699 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e3c00cde0 con 0x7f0e4810b6b0 2024-09-21T01:05:21.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.447+0000 7f0e44ff9640 1 -- 172.21.15.1:0/413978699 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c018780 con 0x7f0e4810b6b0 2024-09-21T01:05:21.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.447+0000 7f0e4dc58640 1 -- 172.21.15.1:0/413978699 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e481a29c0 con 0x7f0e4810b6b0 2024-09-21T01:05:21.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.447+0000 7f0e4dc58640 1 -- 172.21.15.1:0/413978699 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e48077800 con 0x7f0e4810b6b0 2024-09-21T01:05:21.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.451+0000 7f0e541cc740 1 Processor -- start 2024-09-21T01:05:21.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.451+0000 7f0e541cc740 1 -- start start 2024-09-21T01:05:21.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.452+0000 7f0e541cc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f56e70070 0x558f572176a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:21.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.452+0000 7f0e541cc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f56e471b0 0x558f57217be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:21.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.452+0000 7f0e541cc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f56e4f390 0x558f57218120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:21.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.452+0000 7f0e541cc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558f5718dea0 con 0x558f56e471b0 2024-09-21T01:05:21.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.452+0000 7f0e541cc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558f5717d2d0 con 0x558f56e70070 2024-09-21T01:05:21.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.452+0000 7f0e541cc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558f571810e0 con 0x558f56e4f390 2024-09-21T01:05:21.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.452+0000 7f0e47fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f56e70070 0x558f572176a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:21.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.453+0000 7f0e477fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f56e471b0 0x558f57217be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:21.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.453+0000 7f0e477fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f56e471b0 0x558f57217be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39800/0 (socket says 172.21.15.1:39800) 2024-09-21T01:05:21.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.453+0000 7f0e477fe640 1 -- 172.21.15.1:0/3102664989 learned_addr learned my addr 172.21.15.1:0/3102664989 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:21.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.453+0000 7f0e477fe640 1 -- 172.21.15.1:0/3102664989 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f56e4f390 msgr2=0x558f57218120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:05:21.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.453+0000 7f0e477fe640 1 --2- 172.21.15.1:0/3102664989 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f56e4f390 0x558f57218120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:21.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.453+0000 7f0e477fe640 1 -- 172.21.15.1:0/3102664989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f56e70070 msgr2=0x558f572176a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:21.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.453+0000 7f0e477fe640 1 --2- 172.21.15.1:0/3102664989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f56e70070 0x558f572176a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:21.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.453+0000 7f0e477fe640 1 -- 172.21.15.1:0/3102664989 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f56edb650 con 0x558f56e471b0 2024-09-21T01:05:21.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.453+0000 7f0e47fff640 1 --2- 172.21.15.1:0/3102664989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f56e70070 0x558f572176a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:05:21.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.454+0000 7f0e44ff9640 1 -- 172.21.15.1:0/413978699 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f0e3c010a90 con 0x7f0e4810b6b0 2024-09-21T01:05:21.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.454+0000 7f0e477fe640 1 --2- 172.21.15.1:0/3102664989 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f56e471b0 0x558f57217be0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f0e38006010 tx=0x7f0e38004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9734e27dc567f1a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:21.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.454+0000 7f0e2dffb640 1 -- 172.21.15.1:0/3102664989 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e38035040 con 0x558f56e471b0 2024-09-21T01:05:21.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.454+0000 7f0e2dffb640 1 -- 172.21.15.1:0/3102664989 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e380054b0 con 0x558f56e471b0 2024-09-21T01:05:21.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.454+0000 7f0e2dffb640 1 -- 172.21.15.1:0/3102664989 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e38003bc0 con 0x558f56e471b0 2024-09-21T01:05:21.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.455+0000 7f0e44ff9640 1 --2- 172.21.15.1:0/413978699 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f0e300b6720 0x7f0e300b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:21.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.455+0000 7f0e44ff9640 1 -- 172.21.15.1:0/413978699 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f0e3c0e7580 con 0x7f0e4810b6b0 2024-09-21T01:05:21.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.456+0000 7f0e47fff640 1 --2- 172.21.15.1:0/413978699 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f0e300b6720 0x7f0e300b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:21.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.456+0000 7f0e541cc740 1 -- 172.21.15.1:0/3102664989 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f56e471b0 msgr2=0x558f57217be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:21.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.456+0000 7f0e541cc740 1 --2- 172.21.15.1:0/3102664989 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f56e471b0 0x558f57217be0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f0e38006010 tx=0x7f0e38004610 comp rx=0 tx=0).stop 2024-09-21T01:05:21.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.456+0000 7f0e541cc740 1 -- 172.21.15.1:0/3102664989 shutdown_connections 2024-09-21T01:05:21.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.456+0000 7f0e541cc740 1 --2- 172.21.15.1:0/3102664989 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f56e4f390 0x558f57218120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:21.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.456+0000 7f0e541cc740 1 --2- 172.21.15.1:0/3102664989 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f56e471b0 0x558f57217be0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:21.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.456+0000 7f0e541cc740 1 --2- 172.21.15.1:0/3102664989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f56e70070 0x558f572176a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:21.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.456+0000 7f0e541cc740 1 -- 172.21.15.1:0/3102664989 >> 172.21.15.1:0/3102664989 conn(0x558f56e64460 msgr2=0x558f57215590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:21.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.457+0000 7f0e47fff640 1 --2- 172.21.15.1:0/413978699 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f0e300b6720 0x7f0e300b8c30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0e4000ffd0 tx=0x7f0e40011040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:21.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.457+0000 7f0e541cc740 1 -- 172.21.15.1:0/3102664989 shutdown_connections 2024-09-21T01:05:21.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.457+0000 7f0e541cc740 1 -- 172.21.15.1:0/3102664989 wait complete. 2024-09-21T01:05:21.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.458+0000 7f0e541cc740 1 -- start start 2024-09-21T01:05:21.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.458+0000 7f0e541cc740 1 Processor -- start 2024-09-21T01:05:21.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.458+0000 7f0e541cc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f56e471b0 0x558f57222e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:21.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.458+0000 7f0e541cc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f56e4f390 0x558f572233c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:21.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.458+0000 7f0e541cc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f56e70070 0x558f5722f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:21.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.458+0000 7f0e541cc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558f56fde700 con 0x558f56e471b0 2024-09-21T01:05:21.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.458+0000 7f0e541cc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558f57118160 con 0x558f56e4f390 2024-09-21T01:05:21.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.458+0000 7f0e541cc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558f57225e70 con 0x558f56e70070 2024-09-21T01:05:21.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.458+0000 7f0e541cc740 10 client.0 _ll_register_callbacks cb 0x558f571319e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:05:21.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.459+0000 7f0e477fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f56e471b0 0x558f57222e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:21.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.459+0000 7f0e477fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f56e471b0 0x558f57222e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39806/0 (socket says 172.21.15.1:39806) 2024-09-21T01:05:21.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.459+0000 7f0e477fe640 1 -- 172.21.15.1:0/1404825685 learned_addr learned my addr 172.21.15.1:0/1404825685 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:21.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.459+0000 7f0e47fff640 1 --2- 172.21.15.1:0/1404825685 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f56e70070 0x558f5722f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:21.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.459+0000 7f0e46ffd640 1 --2- 172.21.15.1:0/1404825685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f56e4f390 0x558f572233c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:21.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.459+0000 7f0e477fe640 1 -- 172.21.15.1:0/1404825685 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f56e70070 msgr2=0x558f5722f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:21.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.459+0000 7f0e477fe640 1 --2- 172.21.15.1:0/1404825685 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f56e70070 0x558f5722f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:21.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.459+0000 7f0e477fe640 1 -- 172.21.15.1:0/1404825685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f56e4f390 msgr2=0x558f572233c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:21.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.459+0000 7f0e477fe640 1 --2- 172.21.15.1:0/1404825685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f56e4f390 0x558f572233c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:21.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.459+0000 7f0e477fe640 1 -- 172.21.15.1:0/1404825685 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f57145c90 con 0x558f56e471b0 2024-09-21T01:05:21.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.459+0000 7f0e477fe640 1 --2- 172.21.15.1:0/1404825685 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f56e471b0 0x558f57222e80 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f0e38004730 tx=0x7f0e3802a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e06b76dbdcfc741 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:21.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.459+0000 7f0e26ffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:05:21.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.460+0000 7f0e26ffd640 1 -- 172.21.15.1:0/1404825685 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e38035070 con 0x558f56e471b0 2024-09-21T01:05:21.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.460+0000 7f0e541cc740 1 -- 172.21.15.1:0/1404825685 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e380054b0 con 0x558f56e471b0 2024-09-21T01:05:21.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.460+0000 7f0e26ffd640 1 -- 172.21.15.1:0/1404825685 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f0e380052b0 con 0x558f56e471b0 2024-09-21T01:05:21.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.460+0000 7f0e26ffd640 1 -- 172.21.15.1:0/1404825685 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f0e38003ea0 con 0x558f56e471b0 2024-09-21T01:05:21.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.460+0000 7f0e541cc740 10 client.17391 fetch_fsmap learned FSMap version 40 2024-09-21T01:05:21.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.460+0000 7f0e541cc740 1 -- 172.21.15.1:0/1404825685 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x558f57231bc0 con 0x558f56e471b0 2024-09-21T01:05:21.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.460+0000 7f0e26ffd640 1 -- 172.21.15.1:0/1404825685 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e380054b0 con 0x558f56e471b0 2024-09-21T01:05:21.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.460+0000 7f0e26ffd640 1 -- 172.21.15.1:0/1404825685 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 40) ==== 8394+0+0 (secure 0 0 0) 0x7f0e38031a70 con 0x558f56e471b0 2024-09-21T01:05:21.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.460+0000 7f0e541cc740 10 client.17391 fetch_fsmap finished waiting for FSMap version 40 2024-09-21T01:05:21.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.460+0000 7f0e541cc740 10 client.17391 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T01:05:21.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.460+0000 7f0e541cc740 20 client.17391 populate_metadata read hostname 'smithi001' 2024-09-21T01:05:21.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.460+0000 7f0e541cc740 1 --2- 172.21.15.1:0/1404825685 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x558f56e2e9f0 0x558f57234f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:21.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.460+0000 7f0e541cc740 4 client.17391 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:05:21.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.460+0000 7f0e541cc740 1 -- 172.21.15.1:0/1404825685 --> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f5718fdf0 con 0x558f56e2e9f0 2024-09-21T01:05:21.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.461+0000 7f0e46ffd640 1 --2- 172.21.15.1:0/1404825685 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x558f56e2e9f0 0x558f57234f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:21.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.461+0000 7f0e46ffd640 1 --2- 172.21.15.1:0/1404825685 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x558f56e2e9f0 0x558f57234f20 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8e6e8da23e713478 server_cookie=f122bf567bf85bfc in_seq=0 out_seq=0 2024-09-21T01:05:21.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.461+0000 7f0e26ffd640 10 client.17391 ms_handle_connect on v2:172.21.15.193:6834/3631682268 2024-09-21T01:05:21.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.462+0000 7f0e26ffd640 1 -- 172.21.15.1:0/1404825685 <== mds.4 v2:172.21.15.193:6834/3631682268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558f5718fdf0 con 0x558f56e2e9f0 2024-09-21T01:05:21.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.462+0000 7f0e26ffd640 10 client.17391 handle_command_reply: tid=0 2024-09-21T01:05:21.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.462+0000 7f0e541cc740 1 client.17391 shutdown 2024-09-21T01:05:21.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.463+0000 7f0e541cc740 1 -- 172.21.15.1:0/1404825685 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f56e471b0 msgr2=0x558f57222e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:21.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.463+0000 7f0e541cc740 1 --2- 172.21.15.1:0/1404825685 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f56e471b0 0x558f57222e80 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f0e38004730 tx=0x7f0e3802a3f0 comp rx=0 tx=0).stop 2024-09-21T01:05:21.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.463+0000 7f0e541cc740 1 -- 172.21.15.1:0/1404825685 shutdown_connections 2024-09-21T01:05:21.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.463+0000 7f0e541cc740 1 --2- 172.21.15.1:0/1404825685 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x558f56e2e9f0 0x558f57234f20 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:21.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.463+0000 7f0e541cc740 1 --2- 172.21.15.1:0/1404825685 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f56e70070 0x558f5722f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:21.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.463+0000 7f0e541cc740 1 --2- 172.21.15.1:0/1404825685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f56e4f390 0x558f572233c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:21.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.463+0000 7f0e541cc740 1 --2- 172.21.15.1:0/1404825685 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f56e471b0 0x558f57222e80 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:21.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.463+0000 7f0e541cc740 1 -- 172.21.15.1:0/1404825685 >> 172.21.15.1:0/1404825685 conn(0x558f56e64460 msgr2=0x558f5721a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:21.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.463+0000 7f0e26ffd640 0 client.17391 ms_handle_reset on v2:172.21.15.193:6834/3631682268 2024-09-21T01:05:21.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.463+0000 7f0e541cc740 1 -- 172.21.15.1:0/1404825685 shutdown_connections 2024-09-21T01:05:21.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.463+0000 7f0e541cc740 1 -- 172.21.15.1:0/1404825685 wait complete. 2024-09-21T01:05:21.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.463+0000 7f0e541cc740 20 client.17391 trim_cache size 0 max 16384 2024-09-21T01:05:21.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.481+0000 7f0e541cc740 1 Processor -- start 2024-09-21T01:05:21.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.482+0000 7f0e541cc740 1 -- start start 2024-09-21T01:05:21.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.482+0000 7f0e541cc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f56e471b0 0x558f57223340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:21.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.482+0000 7f0e541cc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f56e4f390 0x558f5722f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:21.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.482+0000 7f0e541cc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f56e70070 0x558f5721a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:21.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.482+0000 7f0e541cc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0e481ad350 con 0x558f56e471b0 2024-09-21T01:05:21.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.482+0000 7f0e541cc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0e481aefe0 con 0x558f56e4f390 2024-09-21T01:05:21.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.482+0000 7f0e541cc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0e481ada50 con 0x558f56e70070 2024-09-21T01:05:21.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.482+0000 7f0e477fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f56e471b0 0x558f57223340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:21.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.482+0000 7f0e47fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f56e70070 0x558f5721a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:21.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.482+0000 7f0e477fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f56e471b0 0x558f57223340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39808/0 (socket says 172.21.15.1:39808) 2024-09-21T01:05:21.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.482+0000 7f0e477fe640 1 -- 172.21.15.1:0/3359215574 learned_addr learned my addr 172.21.15.1:0/3359215574 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:21.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.482+0000 7f0e47fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f56e70070 0x558f5721a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:42076/0 (socket says 172.21.15.1:42076) 2024-09-21T01:05:21.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.482+0000 7f0e46ffd640 1 --2- 172.21.15.1:0/3359215574 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f56e4f390 0x558f5722f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:21.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.483+0000 7f0e47fff640 1 -- 172.21.15.1:0/3359215574 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f56e4f390 msgr2=0x558f5722f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:21.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.483+0000 7f0e47fff640 1 --2- 172.21.15.1:0/3359215574 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f56e4f390 0x558f5722f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:21.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.483+0000 7f0e47fff640 1 -- 172.21.15.1:0/3359215574 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f56e471b0 msgr2=0x558f57223340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:21.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.483+0000 7f0e47fff640 1 --2- 172.21.15.1:0/3359215574 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f56e471b0 0x558f57223340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:21.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.483+0000 7f0e47fff640 1 -- 172.21.15.1:0/3359215574 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f57224140 con 0x558f56e70070 2024-09-21T01:05:21.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.483+0000 7f0e477fe640 1 --2- 172.21.15.1:0/3359215574 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f56e471b0 0x558f57223340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:05:21.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.483+0000 7f0e47fff640 1 --2- 172.21.15.1:0/3359215574 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f56e70070 0x558f5721a7a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0e40011b10 tx=0x7f0e4001a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca46b72d283059fb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:21.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.484+0000 7f0e2d7fa640 1 -- 172.21.15.1:0/3359215574 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4001ebe0 con 0x558f56e70070 2024-09-21T01:05:21.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.484+0000 7f0e2d7fa640 1 -- 172.21.15.1:0/3359215574 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e4002f070 con 0x558f56e70070 2024-09-21T01:05:21.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.484+0000 7f0e2d7fa640 1 -- 172.21.15.1:0/3359215574 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4002a650 con 0x558f56e70070 2024-09-21T01:05:21.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.485+0000 7f0e541cc740 1 -- 172.21.15.1:0/3359215574 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f56e70070 msgr2=0x558f5721a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:21.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.485+0000 7f0e541cc740 1 --2- 172.21.15.1:0/3359215574 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f56e70070 0x558f5721a7a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0e40011b10 tx=0x7f0e4001a000 comp rx=0 tx=0).stop 2024-09-21T01:05:21.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.485+0000 7f0e541cc740 1 -- 172.21.15.1:0/3359215574 shutdown_connections 2024-09-21T01:05:21.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.485+0000 7f0e541cc740 1 --2- 172.21.15.1:0/3359215574 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f56e70070 0x558f5721a7a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:21.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.485+0000 7f0e541cc740 1 --2- 172.21.15.1:0/3359215574 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f56e4f390 0x558f5722f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:21.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.485+0000 7f0e541cc740 1 --2- 172.21.15.1:0/3359215574 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f56e471b0 0x558f57223340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:21.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.485+0000 7f0e541cc740 1 -- 172.21.15.1:0/3359215574 >> 172.21.15.1:0/3359215574 conn(0x558f56e64460 msgr2=0x558f57222c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:21.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.485+0000 7f0e541cc740 1 -- 172.21.15.1:0/3359215574 shutdown_connections 2024-09-21T01:05:21.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.485+0000 7f0e541cc740 1 -- 172.21.15.1:0/3359215574 wait complete. 2024-09-21T01:05:21.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.486+0000 7f0e541cc740 1 -- start start 2024-09-21T01:05:21.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.487+0000 7f0e541cc740 1 Processor -- start 2024-09-21T01:05:21.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.487+0000 7f0e541cc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f56e471b0 0x558f57238710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:21.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.487+0000 7f0e541cc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f56e4f390 0x558f57235be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:21.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.487+0000 7f0e541cc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f56e70070 0x558f57236120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:21.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.488+0000 7f0e541cc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0e481ae850 con 0x558f56e471b0 2024-09-21T01:05:21.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.488+0000 7f0e541cc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0e481ae150 con 0x558f56e4f390 2024-09-21T01:05:21.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.488+0000 7f0e541cc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0e481ab330 con 0x558f56e70070 2024-09-21T01:05:21.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.488+0000 7f0e541cc740 10 client.0 _ll_register_callbacks cb 0x7f0e38005040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:05:21.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.488+0000 7f0e477fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f56e471b0 0x558f57238710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:21.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.488+0000 7f0e477fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f56e471b0 0x558f57238710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39814/0 (socket says 172.21.15.1:39814) 2024-09-21T01:05:21.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.488+0000 7f0e477fe640 1 -- 172.21.15.1:0/3226687912 learned_addr learned my addr 172.21.15.1:0/3226687912 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:21.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.488+0000 7f0e47fff640 1 --2- 172.21.15.1:0/3226687912 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f56e70070 0x558f57236120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:21.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.488+0000 7f0e46ffd640 1 --2- 172.21.15.1:0/3226687912 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f56e4f390 0x558f57235be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:21.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.488+0000 7f0e477fe640 1 -- 172.21.15.1:0/3226687912 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f56e70070 msgr2=0x558f57236120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:21.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.488+0000 7f0e477fe640 1 --2- 172.21.15.1:0/3226687912 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f56e70070 0x558f57236120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:21.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.488+0000 7f0e477fe640 1 -- 172.21.15.1:0/3226687912 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f56e4f390 msgr2=0x558f57235be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:21.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.488+0000 7f0e477fe640 1 --2- 172.21.15.1:0/3226687912 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f56e4f390 0x558f57235be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:21.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.488+0000 7f0e477fe640 1 -- 172.21.15.1:0/3226687912 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f57236890 con 0x558f56e471b0 2024-09-21T01:05:21.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.489+0000 7f0e477fe640 1 --2- 172.21.15.1:0/3226687912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f56e471b0 0x558f57238710 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f0e38031e90 tx=0x7f0e3803c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeb96903e2592e2a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:21.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.489+0000 7f0e26ffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:05:21.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.489+0000 7f0e26ffd640 1 -- 172.21.15.1:0/3226687912 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e38035040 con 0x558f56e471b0 2024-09-21T01:05:21.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.489+0000 7f0e26ffd640 1 -- 172.21.15.1:0/3226687912 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f0e38004ba0 con 0x558f56e471b0 2024-09-21T01:05:21.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.489+0000 7f0e541cc740 1 -- 172.21.15.1:0/3226687912 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e4002f070 con 0x558f56e471b0 2024-09-21T01:05:21.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.490+0000 7f0e26ffd640 1 -- 172.21.15.1:0/3226687912 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f0e3802aa70 con 0x558f56e471b0 2024-09-21T01:05:21.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.490+0000 7f0e541cc740 10 client.17397 fetch_fsmap learned FSMap version 40 2024-09-21T01:05:21.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.490+0000 7f0e541cc740 1 -- 172.21.15.1:0/3226687912 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x558f5729f5f0 con 0x558f56e471b0 2024-09-21T01:05:21.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.490+0000 7f0e26ffd640 1 -- 172.21.15.1:0/3226687912 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e4002f070 con 0x558f56e471b0 2024-09-21T01:05:21.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.490+0000 7f0e26ffd640 1 -- 172.21.15.1:0/3226687912 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 40) ==== 8394+0+0 (secure 0 0 0) 0x7f0e38031530 con 0x558f56e471b0 2024-09-21T01:05:21.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.490+0000 7f0e541cc740 10 client.17397 fetch_fsmap finished waiting for FSMap version 40 2024-09-21T01:05:21.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.490+0000 7f0e541cc740 10 client.17397 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T01:05:21.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.490+0000 7f0e541cc740 20 client.17397 populate_metadata read hostname 'smithi001' 2024-09-21T01:05:21.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.490+0000 7f0e541cc740 1 --2- 172.21.15.1:0/3226687912 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x558f56e03da0 0x558f572a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:21.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.490+0000 7f0e541cc740 4 client.17397 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:05:21.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.490+0000 7f0e541cc740 1 -- 172.21.15.1:0/3226687912 --> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558f5718b8a0 con 0x558f56e03da0 2024-09-21T01:05:21.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.491+0000 7f0e46ffd640 1 --2- 172.21.15.1:0/3226687912 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x558f56e03da0 0x558f572a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:21.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.491+0000 7f0e26ffd640 10 client.17397 ms_handle_connect on v2:172.21.15.193:6834/3631682268 2024-09-21T01:05:21.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.491+0000 7f0e46ffd640 1 --2- 172.21.15.1:0/3226687912 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x558f56e03da0 0x558f572a1e10 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=616d549f1becd4a server_cookie=1b840f63080c797e in_seq=0 out_seq=0 2024-09-21T01:05:21.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.491+0000 7f0e26ffd640 1 -- 172.21.15.1:0/3226687912 <== mds.4 v2:172.21.15.193:6834/3631682268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558f5718b8a0 con 0x558f56e03da0 2024-09-21T01:05:21.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.491+0000 7f0e26ffd640 10 client.17397 handle_command_reply: tid=0 2024-09-21T01:05:21.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.491+0000 7f0e541cc740 1 client.17397 shutdown 2024-09-21T01:05:21.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.492+0000 7f0e541cc740 1 -- 172.21.15.1:0/3226687912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f56e471b0 msgr2=0x558f57238710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:21.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.492+0000 7f0e541cc740 1 --2- 172.21.15.1:0/3226687912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f56e471b0 0x558f57238710 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f0e38031e90 tx=0x7f0e3803c7a0 comp rx=0 tx=0).stop 2024-09-21T01:05:21.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.492+0000 7f0e541cc740 1 -- 172.21.15.1:0/3226687912 shutdown_connections 2024-09-21T01:05:21.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.492+0000 7f0e541cc740 1 --2- 172.21.15.1:0/3226687912 >> [v2:172.21.15.193:6834/3631682268,v1:172.21.15.193:6835/3631682268] conn(0x558f56e03da0 0x558f572a1e10 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:21.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.492+0000 7f0e541cc740 1 --2- 172.21.15.1:0/3226687912 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558f56e70070 0x558f57236120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:21.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.492+0000 7f0e541cc740 1 --2- 172.21.15.1:0/3226687912 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f56e4f390 0x558f57235be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:21.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.492+0000 7f0e26ffd640 0 client.17397 ms_handle_reset on v2:172.21.15.193:6834/3631682268 2024-09-21T01:05:21.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.492+0000 7f0e541cc740 1 --2- 172.21.15.1:0/3226687912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f56e471b0 0x558f57238710 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:21.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.492+0000 7f0e541cc740 1 -- 172.21.15.1:0/3226687912 >> 172.21.15.1:0/3226687912 conn(0x558f56e64460 msgr2=0x558f57214dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:21.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.492+0000 7f0e541cc740 1 -- 172.21.15.1:0/3226687912 shutdown_connections 2024-09-21T01:05:21.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.492+0000 7f0e541cc740 1 -- 172.21.15.1:0/3226687912 wait complete. 2024-09-21T01:05:21.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.492+0000 7f0e541cc740 20 client.17397 trim_cache size 0 max 16384 2024-09-21T01:05:21.495 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T01:05:21.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.493+0000 7f0e4dc58640 1 -- 172.21.15.1:0/413978699 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f0e300b6720 msgr2=0x7f0e300b8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:21.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.493+0000 7f0e4dc58640 1 --2- 172.21.15.1:0/413978699 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f0e300b6720 0x7f0e300b8c30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0e4000ffd0 tx=0x7f0e40011040 comp rx=0 tx=0).stop 2024-09-21T01:05:21.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.493+0000 7f0e4dc58640 1 -- 172.21.15.1:0/413978699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e4810b6b0 msgr2=0x7f0e4819cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:21.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.493+0000 7f0e4dc58640 1 --2- 172.21.15.1:0/413978699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e4810b6b0 0x7f0e4819cd00 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f0e4806aa90 tx=0x7f0e3c00ee50 comp rx=0 tx=0).stop 2024-09-21T01:05:21.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.493+0000 7f0e4dc58640 1 -- 172.21.15.1:0/413978699 shutdown_connections 2024-09-21T01:05:21.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.494+0000 7f0e4dc58640 1 --2- 172.21.15.1:0/413978699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e4810c000 0x7f0e481a1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:21.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.494+0000 7f0e4dc58640 1 --2- 172.21.15.1:0/413978699 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f0e300b6720 0x7f0e300b8c30 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:21.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.494+0000 7f0e4dc58640 1 --2- 172.21.15.1:0/413978699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e4810b6b0 0x7f0e4819cd00 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:21.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.494+0000 7f0e4dc58640 1 --2- 172.21.15.1:0/413978699 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e48105d70 0x7f0e4819c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:21.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.494+0000 7f0e4dc58640 1 -- 172.21.15.1:0/413978699 >> 172.21.15.1:0/413978699 conn(0x7f0e48101780 msgr2=0x7f0e48104bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:21.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.494+0000 7f0e4dc58640 1 -- 172.21.15.1:0/413978699 shutdown_connections 2024-09-21T01:05:21.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:21.494+0000 7f0e4dc58640 1 -- 172.21.15.1:0/413978699 wait complete. 2024-09-21T01:05:21.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:21 smithi001 ceph-mon[31211]: pgmap v602: 97 pgs: 97 active+clean; 282 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 459 op/s 2024-09-21T01:05:21.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:21 smithi193 ceph-mon[34660]: pgmap v602: 97 pgs: 97 active+clean; 282 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 459 op/s 2024-09-21T01:05:21.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:21 smithi042 ceph-mon[34481]: pgmap v602: 97 pgs: 97 active+clean; 282 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 459 op/s 2024-09-21T01:05:22.298 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T01:05:22.597 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:22.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.952+0000 7f42819cf640 1 -- 172.21.15.1:0/1166474871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f427c104740 msgr2=0x7f427c104b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:22.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.952+0000 7f42819cf640 1 --2- 172.21.15.1:0/1166474871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f427c104740 0x7f427c104b50 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f4264009900 tx=0x7f426402a410 comp rx=0 tx=0).stop 2024-09-21T01:05:22.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.952+0000 7f42819cf640 1 -- 172.21.15.1:0/1166474871 shutdown_connections 2024-09-21T01:05:22.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.952+0000 7f42819cf640 1 --2- 172.21.15.1:0/1166474871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f427c1050e0 0x7f427c10ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:22.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.952+0000 7f42819cf640 1 --2- 172.21.15.1:0/1166474871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f427c104740 0x7f427c104b50 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:22.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.952+0000 7f42819cf640 1 --2- 172.21.15.1:0/1166474871 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f427c1036c0 0x7f427c103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:22.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.952+0000 7f42819cf640 1 -- 172.21.15.1:0/1166474871 >> 172.21.15.1:0/1166474871 conn(0x7f427c0ff000 msgr2=0x7f427c1014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:22.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.952+0000 7f42819cf640 1 -- 172.21.15.1:0/1166474871 shutdown_connections 2024-09-21T01:05:22.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.952+0000 7f42819cf640 1 -- 172.21.15.1:0/1166474871 wait complete. 2024-09-21T01:05:22.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.952+0000 7f42819cf640 1 Processor -- start 2024-09-21T01:05:22.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.952+0000 7f42819cf640 1 -- start start 2024-09-21T01:05:22.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.952+0000 7f42819cf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f427c1036c0 0x7f427c199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:22.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.952+0000 7f42819cf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f427c104740 0x7f427c19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:22.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.952+0000 7f42819cf640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f427c1050e0 0x7f427c19b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:22.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.953+0000 7f42819cf640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f427c10f360 con 0x7f427c1036c0 2024-09-21T01:05:22.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.953+0000 7f42819cf640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f427c10f1e0 con 0x7f427c104740 2024-09-21T01:05:22.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.953+0000 7f42819cf640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f427c10f4e0 con 0x7f427c1050e0 2024-09-21T01:05:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.953+0000 7f427affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f427c1036c0 0x7f427c199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.953+0000 7f427affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f427c1036c0 0x7f427c199f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39836/0 (socket says 172.21.15.1:39836) 2024-09-21T01:05:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.953+0000 7f427affd640 1 -- 172.21.15.1:0/4153054978 learned_addr learned my addr 172.21.15.1:0/4153054978 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.953+0000 7f4273fff640 1 --2- 172.21.15.1:0/4153054978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f427c104740 0x7f427c19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.953+0000 7f427b7fe640 1 --2- 172.21.15.1:0/4153054978 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f427c1050e0 0x7f427c19b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.953+0000 7f427affd640 1 -- 172.21.15.1:0/4153054978 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f427c1050e0 msgr2=0x7f427c19b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.953+0000 7f427affd640 1 --2- 172.21.15.1:0/4153054978 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f427c1050e0 0x7f427c19b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.953+0000 7f427affd640 1 -- 172.21.15.1:0/4153054978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f427c104740 msgr2=0x7f427c19a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.953+0000 7f427affd640 1 --2- 172.21.15.1:0/4153054978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f427c104740 0x7f427c19a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.953+0000 7f427affd640 1 -- 172.21.15.1:0/4153054978 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f427c19b960 con 0x7f427c1036c0 2024-09-21T01:05:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.953+0000 7f4273fff640 1 --2- 172.21.15.1:0/4153054978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f427c104740 0x7f427c19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:05:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.953+0000 7f427affd640 1 --2- 172.21.15.1:0/4153054978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f427c1036c0 0x7f427c199f20 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f426c00d770 tx=0x7f426c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.953+0000 7f42809cd640 1 -- 172.21.15.1:0/4153054978 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426c017070 con 0x7f427c1036c0 2024-09-21T01:05:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.953+0000 7f42809cd640 1 -- 172.21.15.1:0/4153054978 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f426c0054d0 con 0x7f427c1036c0 2024-09-21T01:05:22.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.953+0000 7f42819cf640 1 -- 172.21.15.1:0/4153054978 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f427c19bc50 con 0x7f427c1036c0 2024-09-21T01:05:22.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.953+0000 7f42809cd640 1 -- 172.21.15.1:0/4153054978 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426c004c30 con 0x7f427c1036c0 2024-09-21T01:05:22.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.954+0000 7f42819cf640 1 -- 172.21.15.1:0/4153054978 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f427c1a2340 con 0x7f427c1036c0 2024-09-21T01:05:22.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.956+0000 7f4288a1d740 1 Processor -- start 2024-09-21T01:05:22.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.956+0000 7f4288a1d740 1 -- start start 2024-09-21T01:05:22.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.956+0000 7f42809cd640 1 -- 172.21.15.1:0/4153054978 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f426c004e10 con 0x7f427c1036c0 2024-09-21T01:05:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.956+0000 7f4288a1d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602036241b0 0x5602039cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.956+0000 7f4288a1d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602035fb2f0 0x5602039cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.956+0000 7f4288a1d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602036034d0 0x5602039cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.956+0000 7f4288a1d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56020393e6f0 con 0x5602035fb2f0 2024-09-21T01:05:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.956+0000 7f4288a1d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56020392db20 con 0x5602036034d0 2024-09-21T01:05:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.956+0000 7f4288a1d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560203931930 con 0x5602036241b0 2024-09-21T01:05:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.957+0000 7f427affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602035fb2f0 0x5602039cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.957+0000 7f4273fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602036034d0 0x5602039cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.957+0000 7f4273fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602036034d0 0x5602039cd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:36476/0 (socket says 172.21.15.1:36476) 2024-09-21T01:05:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.957+0000 7f427affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602035fb2f0 0x5602039cc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39848/0 (socket says 172.21.15.1:39848) 2024-09-21T01:05:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.957+0000 7f4273fff640 1 -- 172.21.15.1:0/1005647127 learned_addr learned my addr 172.21.15.1:0/1005647127 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.957+0000 7f427b7fe640 1 --2- 172.21.15.1:0/1005647127 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602036241b0 0x5602039cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.957+0000 7f4273fff640 1 -- 172.21.15.1:0/1005647127 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602036241b0 msgr2=0x5602039cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:22.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.957+0000 7f4273fff640 1 --2- 172.21.15.1:0/1005647127 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602036241b0 0x5602039cbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:22.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.957+0000 7f4273fff640 1 -- 172.21.15.1:0/1005647127 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602035fb2f0 msgr2=0x5602039cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:22.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.957+0000 7f4273fff640 1 --2- 172.21.15.1:0/1005647127 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602035fb2f0 0x5602039cc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:22.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.957+0000 7f4273fff640 1 -- 172.21.15.1:0/1005647127 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602038f3530 con 0x5602036034d0 2024-09-21T01:05:22.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.957+0000 7f4273fff640 1 --2- 172.21.15.1:0/1005647127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602036034d0 0x5602039cd010 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4264009230 tx=0x7f4264004520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8fb86b8aea8676a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:22.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.957+0000 7f4271ffb640 1 -- 172.21.15.1:0/1005647127 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4264035030 con 0x5602036034d0 2024-09-21T01:05:22.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.957+0000 7f42809cd640 1 --2- 172.21.15.1:0/4153054978 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f42680b6510 0x7f42680b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:22.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.957+0000 7f4271ffb640 1 -- 172.21.15.1:0/1005647127 <== mon.2 v2:172.21.15.42:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4264040070 con 0x5602036034d0 2024-09-21T01:05:22.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.957+0000 7f4271ffb640 1 -- 172.21.15.1:0/1005647127 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4264031d80 con 0x5602036034d0 2024-09-21T01:05:22.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.958+0000 7f427b7fe640 1 --2- 172.21.15.1:0/4153054978 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f42680b6510 0x7f42680b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:22.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.958+0000 7f42809cd640 1 -- 172.21.15.1:0/4153054978 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f426c0e6d60 con 0x7f427c1036c0 2024-09-21T01:05:22.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.958+0000 7f4288a1d740 1 -- 172.21.15.1:0/1005647127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602036034d0 msgr2=0x5602039cd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:22.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.958+0000 7f4288a1d740 1 --2- 172.21.15.1:0/1005647127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602036034d0 0x5602039cd010 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4264009230 tx=0x7f4264004520 comp rx=0 tx=0).stop 2024-09-21T01:05:22.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.958+0000 7f427b7fe640 1 --2- 172.21.15.1:0/4153054978 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f42680b6510 0x7f42680b8a20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4274005fd0 tx=0x7f4274009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:22.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.958+0000 7f4288a1d740 1 -- 172.21.15.1:0/1005647127 shutdown_connections 2024-09-21T01:05:22.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.958+0000 7f4288a1d740 1 --2- 172.21.15.1:0/1005647127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602036034d0 0x5602039cd010 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:22.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.958+0000 7f4288a1d740 1 --2- 172.21.15.1:0/1005647127 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602035fb2f0 0x5602039cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:22.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.958+0000 7f4288a1d740 1 --2- 172.21.15.1:0/1005647127 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602036241b0 0x5602039cbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:22.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.958+0000 7f4288a1d740 1 -- 172.21.15.1:0/1005647127 >> 172.21.15.1:0/1005647127 conn(0x560203618300 msgr2=0x5602039c78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:22.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.959+0000 7f4288a1d740 1 -- 172.21.15.1:0/1005647127 shutdown_connections 2024-09-21T01:05:22.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.959+0000 7f4288a1d740 1 -- 172.21.15.1:0/1005647127 wait complete. 2024-09-21T01:05:22.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.959+0000 7f4288a1d740 1 -- start start 2024-09-21T01:05:22.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.959+0000 7f4288a1d740 1 Processor -- start 2024-09-21T01:05:22.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.959+0000 7f4288a1d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602035fb2f0 0x5602039d5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:22.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.959+0000 7f4288a1d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602036034d0 0x5602039d5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:22.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.959+0000 7f4288a1d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602036241b0 0x5602039d67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:22.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.959+0000 7f4288a1d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560203865ab0 con 0x5602036241b0 2024-09-21T01:05:22.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.959+0000 7f4288a1d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5602038d3730 con 0x5602035fb2f0 2024-09-21T01:05:22.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.959+0000 7f4288a1d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5602039cdad0 con 0x5602036034d0 2024-09-21T01:05:22.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.960+0000 7f4288a1d740 10 client.0 _ll_register_callbacks cb 0x5602039276b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:05:22.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.960+0000 7f427affd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602035fb2f0 0x5602039d5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:22.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.960+0000 7f427affd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602035fb2f0 0x5602039d5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:36480/0 (socket says 172.21.15.1:36480) 2024-09-21T01:05:22.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.960+0000 7f427affd640 1 -- 172.21.15.1:0/4080506382 learned_addr learned my addr 172.21.15.1:0/4080506382 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:22.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.960+0000 7f427b7fe640 1 --2- 172.21.15.1:0/4080506382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602036241b0 0x5602039d67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:22.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.960+0000 7f4273fff640 1 --2- 172.21.15.1:0/4080506382 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602036034d0 0x5602039d5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:22.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.960+0000 7f427affd640 1 -- 172.21.15.1:0/4080506382 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602036034d0 msgr2=0x5602039d5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:22.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.960+0000 7f427affd640 1 --2- 172.21.15.1:0/4080506382 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602036034d0 0x5602039d5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:22.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.960+0000 7f427affd640 1 -- 172.21.15.1:0/4080506382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602036241b0 msgr2=0x5602039d67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:22.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.960+0000 7f427affd640 1 --2- 172.21.15.1:0/4080506382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602036241b0 0x5602039d67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:22.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.960+0000 7f427affd640 1 -- 172.21.15.1:0/4080506382 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56020368f790 con 0x5602035fb2f0 2024-09-21T01:05:22.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.960+0000 7f4273fff640 1 --2- 172.21.15.1:0/4080506382 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602036034d0 0x5602039d5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:05:22.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.960+0000 7f427affd640 1 --2- 172.21.15.1:0/4080506382 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602035fb2f0 0x5602039d5600 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f426c009610 tx=0x7f426c0a95d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af58fd6db96b0b34 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:22.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.960+0000 7f425affd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:05:22.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.960+0000 7f425affd640 1 -- 172.21.15.1:0/4080506382 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426c020030 con 0x5602035fb2f0 2024-09-21T01:05:22.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.960+0000 7f425affd640 1 -- 172.21.15.1:0/4080506382 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f426c0ac3e0 con 0x5602035fb2f0 2024-09-21T01:05:22.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.960+0000 7f4288a1d740 1 -- 172.21.15.1:0/4080506382 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4264040070 con 0x5602035fb2f0 2024-09-21T01:05:22.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.961+0000 7f425affd640 1 -- 172.21.15.1:0/4080506382 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f426c0ac8d0 con 0x5602035fb2f0 2024-09-21T01:05:22.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.961+0000 7f4288a1d740 10 client.27053 fetch_fsmap learned FSMap version 41 2024-09-21T01:05:22.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.961+0000 7f4288a1d740 1 -- 172.21.15.1:0/4080506382 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x560203708620 con 0x5602035fb2f0 2024-09-21T01:05:22.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.961+0000 7f425affd640 1 -- 172.21.15.1:0/4080506382 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4264040070 con 0x5602035fb2f0 2024-09-21T01:05:22.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.961+0000 7f425affd640 1 -- 172.21.15.1:0/4080506382 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 41) ==== 8390+0+0 (secure 0 0 0) 0x7f426c0981a0 con 0x5602035fb2f0 2024-09-21T01:05:22.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.961+0000 7f4288a1d740 10 client.27053 fetch_fsmap finished waiting for FSMap version 41 2024-09-21T01:05:22.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.961+0000 7f4288a1d740 10 client.27053 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:05:22.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.961+0000 7f4288a1d740 20 client.27053 populate_metadata read hostname 'smithi001' 2024-09-21T01:05:22.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.961+0000 7f4288a1d740 1 --2- 172.21.15.1:0/4080506382 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5602035e2d80 0x5602039e2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:22.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.961+0000 7f4288a1d740 4 client.27053 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:05:22.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.961+0000 7f4288a1d740 1 -- 172.21.15.1:0/4080506382 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560203940640 con 0x5602035e2d80 2024-09-21T01:05:22.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.961+0000 7f4273fff640 1 --2- 172.21.15.1:0/4080506382 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5602035e2d80 0x5602039e2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:22.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.962+0000 7f425affd640 10 client.27053 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:05:22.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.962+0000 7f4273fff640 1 --2- 172.21.15.1:0/4080506382 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5602035e2d80 0x5602039e2e40 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c89d48a379a60808 server_cookie=348ad02238a28aab in_seq=0 out_seq=0 2024-09-21T01:05:22.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.963+0000 7f425affd640 1 -- 172.21.15.1:0/4080506382 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560203940640 con 0x5602035e2d80 2024-09-21T01:05:22.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.963+0000 7f425affd640 10 client.27053 handle_command_reply: tid=0 2024-09-21T01:05:22.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.963+0000 7f4288a1d740 1 client.27053 shutdown 2024-09-21T01:05:22.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.963+0000 7f4288a1d740 1 -- 172.21.15.1:0/4080506382 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602035fb2f0 msgr2=0x5602039d5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:22.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.963+0000 7f4288a1d740 1 --2- 172.21.15.1:0/4080506382 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602035fb2f0 0x5602039d5600 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f426c009610 tx=0x7f426c0a95d0 comp rx=0 tx=0).stop 2024-09-21T01:05:22.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.963+0000 7f4288a1d740 1 -- 172.21.15.1:0/4080506382 shutdown_connections 2024-09-21T01:05:22.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.963+0000 7f4288a1d740 1 --2- 172.21.15.1:0/4080506382 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5602035e2d80 0x5602039e2e40 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:22.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.963+0000 7f4288a1d740 1 --2- 172.21.15.1:0/4080506382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602036241b0 0x5602039d67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:22.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.963+0000 7f4288a1d740 1 --2- 172.21.15.1:0/4080506382 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602036034d0 0x5602039d5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:22.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.963+0000 7f425affd640 0 client.27053 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:05:22.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.963+0000 7f4288a1d740 1 --2- 172.21.15.1:0/4080506382 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602035fb2f0 0x5602039d5600 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:22.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.963+0000 7f4288a1d740 1 -- 172.21.15.1:0/4080506382 >> 172.21.15.1:0/4080506382 conn(0x560203618300 msgr2=0x5602039c84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:22.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.963+0000 7f4288a1d740 1 -- 172.21.15.1:0/4080506382 shutdown_connections 2024-09-21T01:05:22.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.963+0000 7f4288a1d740 1 -- 172.21.15.1:0/4080506382 wait complete. 2024-09-21T01:05:22.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.963+0000 7f4288a1d740 20 client.27053 trim_cache size 0 max 16384 2024-09-21T01:05:22.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.978+0000 7f4288a1d740 1 Processor -- start 2024-09-21T01:05:22.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.978+0000 7f4288a1d740 1 -- start start 2024-09-21T01:05:22.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.978+0000 7f4288a1d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602035e2d80 0x5602039d0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:22.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.978+0000 7f4288a1d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602035fb2f0 0x5602039d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:22.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.978+0000 7f4288a1d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602036034d0 0x5602039d4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:22.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.978+0000 7f4288a1d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f427c1aafd0 con 0x5602035fb2f0 2024-09-21T01:05:22.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.978+0000 7f4288a1d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f427c1acc30 con 0x5602036034d0 2024-09-21T01:05:22.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.978+0000 7f4288a1d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f427c1ab6d0 con 0x5602035e2d80 2024-09-21T01:05:22.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.978+0000 7f4273fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602035fb2f0 0x5602039d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:22.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.978+0000 7f4273fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602035fb2f0 0x5602039d3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39860/0 (socket says 172.21.15.1:39860) 2024-09-21T01:05:22.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.978+0000 7f4273fff640 1 -- 172.21.15.1:0/2626766286 learned_addr learned my addr 172.21.15.1:0/2626766286 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:22.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.978+0000 7f427b7fe640 1 --2- 172.21.15.1:0/2626766286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602036034d0 0x5602039d4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:22.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.978+0000 7f427affd640 1 --2- 172.21.15.1:0/2626766286 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602035e2d80 0x5602039d0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.978+0000 7f4273fff640 1 -- 172.21.15.1:0/2626766286 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602035e2d80 msgr2=0x5602039d0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.978+0000 7f4273fff640 1 --2- 172.21.15.1:0/2626766286 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602035e2d80 0x5602039d0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.978+0000 7f4273fff640 1 -- 172.21.15.1:0/2626766286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602036034d0 msgr2=0x5602039d4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.978+0000 7f4273fff640 1 --2- 172.21.15.1:0/2626766286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602036034d0 0x5602039d4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.978+0000 7f4273fff640 1 -- 172.21.15.1:0/2626766286 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602039d6b30 con 0x5602035fb2f0 2024-09-21T01:05:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.979+0000 7f4273fff640 1 --2- 172.21.15.1:0/2626766286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602035fb2f0 0x5602039d3b00 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f4264009900 tx=0x7f4264004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8a066c872f91a07 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.979+0000 7f42717fa640 1 -- 172.21.15.1:0/2626766286 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4264035040 con 0x5602035fb2f0 2024-09-21T01:05:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.979+0000 7f42717fa640 1 -- 172.21.15.1:0/2626766286 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4264040040 con 0x5602035fb2f0 2024-09-21T01:05:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.979+0000 7f42717fa640 1 -- 172.21.15.1:0/2626766286 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4264051690 con 0x5602035fb2f0 2024-09-21T01:05:22.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.980+0000 7f4288a1d740 1 -- 172.21.15.1:0/2626766286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602035fb2f0 msgr2=0x5602039d3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:22.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.980+0000 7f4288a1d740 1 --2- 172.21.15.1:0/2626766286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602035fb2f0 0x5602039d3b00 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f4264009900 tx=0x7f4264004610 comp rx=0 tx=0).stop 2024-09-21T01:05:22.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.980+0000 7f4288a1d740 1 -- 172.21.15.1:0/2626766286 shutdown_connections 2024-09-21T01:05:22.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.980+0000 7f4288a1d740 1 --2- 172.21.15.1:0/2626766286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602036034d0 0x5602039d4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:22.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.980+0000 7f4288a1d740 1 --2- 172.21.15.1:0/2626766286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602035fb2f0 0x5602039d3b00 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:22.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.980+0000 7f4288a1d740 1 --2- 172.21.15.1:0/2626766286 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602035e2d80 0x5602039d0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:22.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.980+0000 7f4288a1d740 1 -- 172.21.15.1:0/2626766286 >> 172.21.15.1:0/2626766286 conn(0x560203618300 msgr2=0x5602039cff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:22.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.980+0000 7f4288a1d740 1 -- 172.21.15.1:0/2626766286 shutdown_connections 2024-09-21T01:05:22.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.980+0000 7f4288a1d740 1 -- 172.21.15.1:0/2626766286 wait complete. 2024-09-21T01:05:22.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.980+0000 7f4288a1d740 1 -- start start 2024-09-21T01:05:22.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.980+0000 7f4288a1d740 1 Processor -- start 2024-09-21T01:05:22.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.980+0000 7f4288a1d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602035e2d80 0x5602039da6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:22.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.980+0000 7f4288a1d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602035fb2f0 0x5602039dad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:22.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.980+0000 7f4288a1d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602036034d0 0x5602039db8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:22.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.980+0000 7f4288a1d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f427c1ac4a0 con 0x5602036034d0 2024-09-21T01:05:22.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.981+0000 7f4288a1d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f427c1abda0 con 0x5602035fb2f0 2024-09-21T01:05:22.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.981+0000 7f4288a1d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f427c1a8fb0 con 0x5602035e2d80 2024-09-21T01:05:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.981+0000 7f4288a1d740 10 client.0 _ll_register_callbacks cb 0x7f426c00d6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:05:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.981+0000 7f427b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602036034d0 0x5602039db8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.981+0000 7f427b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602036034d0 0x5602039db8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39866/0 (socket says 172.21.15.1:39866) 2024-09-21T01:05:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.981+0000 7f427b7fe640 1 -- 172.21.15.1:0/1186317770 learned_addr learned my addr 172.21.15.1:0/1186317770 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.981+0000 7f4273fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602035fb2f0 0x5602039dad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.981+0000 7f427affd640 1 --2- 172.21.15.1:0/1186317770 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602035e2d80 0x5602039da6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.981+0000 7f427b7fe640 1 -- 172.21.15.1:0/1186317770 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602035e2d80 msgr2=0x5602039da6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.981+0000 7f427b7fe640 1 --2- 172.21.15.1:0/1186317770 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602035e2d80 0x5602039da6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.981+0000 7f427b7fe640 1 -- 172.21.15.1:0/1186317770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602035fb2f0 msgr2=0x5602039dad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.981+0000 7f427b7fe640 1 --2- 172.21.15.1:0/1186317770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602035fb2f0 0x5602039dad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.981+0000 7f427b7fe640 1 -- 172.21.15.1:0/1186317770 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602039dc050 con 0x5602036034d0 2024-09-21T01:05:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.981+0000 7f4273fff640 1 --2- 172.21.15.1:0/1186317770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602035fb2f0 0x5602039dad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:05:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.981+0000 7f427b7fe640 1 --2- 172.21.15.1:0/1186317770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602036034d0 0x5602039db8f0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f4274004610 tx=0x7f4274004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d57fd8e82309d09 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:22.987 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.981+0000 7f425affd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:05:22.987 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.981+0000 7f425affd640 1 -- 172.21.15.1:0/1186317770 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4274004640 con 0x5602036034d0 2024-09-21T01:05:22.987 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.981+0000 7f425affd640 1 -- 172.21.15.1:0/1186317770 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f42740047e0 con 0x5602036034d0 2024-09-21T01:05:22.987 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.981+0000 7f4288a1d740 1 -- 172.21.15.1:0/1186317770 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4264040040 con 0x5602036034d0 2024-09-21T01:05:22.987 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.982+0000 7f425affd640 1 -- 172.21.15.1:0/1186317770 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f4274004b20 con 0x5602036034d0 2024-09-21T01:05:22.987 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.982+0000 7f4288a1d740 10 client.17415 fetch_fsmap learned FSMap version 41 2024-09-21T01:05:22.987 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.982+0000 7f4288a1d740 1 -- 172.21.15.1:0/1186317770 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x5602039dd440 con 0x5602036034d0 2024-09-21T01:05:22.987 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.982+0000 7f425affd640 1 -- 172.21.15.1:0/1186317770 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4264040040 con 0x5602036034d0 2024-09-21T01:05:22.987 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.982+0000 7f425affd640 1 -- 172.21.15.1:0/1186317770 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 41) ==== 8390+0+0 (secure 0 0 0) 0x7f4274029400 con 0x5602036034d0 2024-09-21T01:05:22.987 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.982+0000 7f4288a1d740 10 client.17415 fetch_fsmap finished waiting for FSMap version 41 2024-09-21T01:05:22.987 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.982+0000 7f4288a1d740 10 client.17415 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:05:22.987 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.982+0000 7f4288a1d740 20 client.17415 populate_metadata read hostname 'smithi001' 2024-09-21T01:05:22.987 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.982+0000 7f4288a1d740 1 --2- 172.21.15.1:0/1186317770 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5602036241b0 0x560203a4fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:22.987 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.982+0000 7f4288a1d740 4 client.17415 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:05:22.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.982+0000 7f4288a1d740 1 -- 172.21.15.1:0/1186317770 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56020393c0f0 con 0x5602036241b0 2024-09-21T01:05:22.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.982+0000 7f427affd640 1 --2- 172.21.15.1:0/1186317770 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5602036241b0 0x560203a4fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:22.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.983+0000 7f425affd640 10 client.17415 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:05:22.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.983+0000 7f427affd640 1 --2- 172.21.15.1:0/1186317770 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5602036241b0 0x560203a4fbf0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c66682f84eaa1faf server_cookie=ce9649951f1be877 in_seq=0 out_seq=0 2024-09-21T01:05:22.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.992+0000 7f425affd640 1 -- 172.21.15.1:0/1186317770 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56020393c0f0 con 0x5602036241b0 2024-09-21T01:05:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.992+0000 7f425affd640 10 client.17415 handle_command_reply: tid=0 2024-09-21T01:05:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.992+0000 7f4288a1d740 1 client.17415 shutdown 2024-09-21T01:05:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.993+0000 7f4288a1d740 1 -- 172.21.15.1:0/1186317770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602036034d0 msgr2=0x5602039db8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.993+0000 7f4288a1d740 1 --2- 172.21.15.1:0/1186317770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602036034d0 0x5602039db8f0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f4274004610 tx=0x7f4274004a40 comp rx=0 tx=0).stop 2024-09-21T01:05:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.993+0000 7f4288a1d740 1 -- 172.21.15.1:0/1186317770 shutdown_connections 2024-09-21T01:05:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.993+0000 7f4288a1d740 1 --2- 172.21.15.1:0/1186317770 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x5602036241b0 0x560203a4fbf0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.993+0000 7f4288a1d740 1 --2- 172.21.15.1:0/1186317770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602036034d0 0x5602039db8f0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.993+0000 7f4288a1d740 1 --2- 172.21.15.1:0/1186317770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602035fb2f0 0x5602039dad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.993+0000 7f425affd640 0 client.17415 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:05:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.993+0000 7f4288a1d740 1 --2- 172.21.15.1:0/1186317770 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602035e2d80 0x5602039da6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.993+0000 7f4288a1d740 1 -- 172.21.15.1:0/1186317770 >> 172.21.15.1:0/1186317770 conn(0x560203618300 msgr2=0x5602039d06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.993+0000 7f4288a1d740 1 -- 172.21.15.1:0/1186317770 shutdown_connections 2024-09-21T01:05:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.993+0000 7f4288a1d740 1 -- 172.21.15.1:0/1186317770 wait complete. 2024-09-21T01:05:22.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.993+0000 7f4288a1d740 20 client.17415 trim_cache size 0 max 16384 2024-09-21T01:05:22.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-21T01:05:22.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-21T01:05:22.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-21T01:05:22.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-21T01:05:22.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.994+0000 7f42819cf640 1 -- 172.21.15.1:0/4153054978 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f42680b6510 msgr2=0x7f42680b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:22.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.994+0000 7f42819cf640 1 --2- 172.21.15.1:0/4153054978 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f42680b6510 0x7f42680b8a20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4274005fd0 tx=0x7f4274009500 comp rx=0 tx=0).stop 2024-09-21T01:05:22.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.994+0000 7f42819cf640 1 -- 172.21.15.1:0/4153054978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f427c1036c0 msgr2=0x7f427c199f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:22.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.994+0000 7f42819cf640 1 --2- 172.21.15.1:0/4153054978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f427c1036c0 0x7f427c199f20 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f426c00d770 tx=0x7f426c00dc30 comp rx=0 tx=0).stop 2024-09-21T01:05:22.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.994+0000 7f42819cf640 1 -- 172.21.15.1:0/4153054978 shutdown_connections 2024-09-21T01:05:22.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.994+0000 7f42819cf640 1 --2- 172.21.15.1:0/4153054978 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f427c1050e0 0x7f427c19b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:22.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.994+0000 7f42819cf640 1 --2- 172.21.15.1:0/4153054978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f427c104740 0x7f427c19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:22.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.994+0000 7f42819cf640 1 --2- 172.21.15.1:0/4153054978 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f42680b6510 0x7f42680b8a20 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:22.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.994+0000 7f42819cf640 1 --2- 172.21.15.1:0/4153054978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f427c1036c0 0x7f427c199f20 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:22.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.994+0000 7f42819cf640 1 -- 172.21.15.1:0/4153054978 >> 172.21.15.1:0/4153054978 conn(0x7f427c0ff000 msgr2=0x7f427c107a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:22.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.994+0000 7f42819cf640 1 -- 172.21.15.1:0/4153054978 shutdown_connections 2024-09-21T01:05:22.998 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-21T01:05:22.994+0000 7f42819cf640 1 -- 172.21.15.1:0/4153054978 wait complete. 2024-09-21T01:05:23.034 INFO:tasks.workunit:Stopping ['suites/blogbench.sh'] on client.0... 2024-09-21T01:05:23.035 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-21T01:05:23.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.104+0000 7f20d013f640 1 -- 172.21.15.1:0/2552867397 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20c8108cf0 msgr2=0x7f20c810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:23.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.104+0000 7f20d013f640 1 --2- 172.21.15.1:0/2552867397 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20c8108cf0 0x7f20c810f520 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f20c0009be0 tx=0x7f20c002a6c0 comp rx=0 tx=0).stop 2024-09-21T01:05:23.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.104+0000 7f20d013f640 1 -- 172.21.15.1:0/2552867397 shutdown_connections 2024-09-21T01:05:23.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.104+0000 7f20d013f640 1 --2- 172.21.15.1:0/2552867397 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20c8108cf0 0x7f20c810f520 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:23.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.104+0000 7f20d013f640 1 --2- 172.21.15.1:0/2552867397 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20c81083a0 0x7f20c81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:23.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.104+0000 7f20d013f640 1 --2- 172.21.15.1:0/2552867397 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20c8102a60 0x7f20c8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:23.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.104+0000 7f20d013f640 1 -- 172.21.15.1:0/2552867397 >> 172.21.15.1:0/2552867397 conn(0x7f20c8079730 msgr2=0x7f20c8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:23.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.104+0000 7f20d013f640 1 -- 172.21.15.1:0/2552867397 shutdown_connections 2024-09-21T01:05:23.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.104+0000 7f20d013f640 1 -- 172.21.15.1:0/2552867397 wait complete. 2024-09-21T01:05:23.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.105+0000 7f20d013f640 1 Processor -- start 2024-09-21T01:05:23.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.105+0000 7f20d013f640 1 -- start start 2024-09-21T01:05:23.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.105+0000 7f20d013f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20c8102a60 0x7f20c8199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:23.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.105+0000 7f20d013f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20c81083a0 0x7f20c81998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:23.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.105+0000 7f20d013f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20c8108cf0 0x7f20c819eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:23.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.105+0000 7f20d013f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f20c8112960 con 0x7f20c8102a60 2024-09-21T01:05:23.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.105+0000 7f20d013f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f20c81127e0 con 0x7f20c8108cf0 2024-09-21T01:05:23.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.105+0000 7f20d013f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f20c8112ae0 con 0x7f20c81083a0 2024-09-21T01:05:23.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.105+0000 7f20cdedb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20c8102a60 0x7f20c8199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:23.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.105+0000 7f20cdedb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20c8102a60 0x7f20c8199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39874/0 (socket says 172.21.15.1:39874) 2024-09-21T01:05:23.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.105+0000 7f20cdedb640 1 -- 172.21.15.1:0/3789374130 learned_addr learned my addr 172.21.15.1:0/3789374130 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:23.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.105+0000 7f20cd6da640 1 --2- 172.21.15.1:0/3789374130 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20c81083a0 0x7f20c81998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:23.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.106+0000 7f20ce6dc640 1 --2- 172.21.15.1:0/3789374130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20c8108cf0 0x7f20c819eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:23.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.106+0000 7f20cdedb640 1 -- 172.21.15.1:0/3789374130 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20c81083a0 msgr2=0x7f20c81998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:23.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.106+0000 7f20cdedb640 1 --2- 172.21.15.1:0/3789374130 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20c81083a0 0x7f20c81998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:23.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.106+0000 7f20cdedb640 1 -- 172.21.15.1:0/3789374130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20c8108cf0 msgr2=0x7f20c819eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:23.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.106+0000 7f20cdedb640 1 --2- 172.21.15.1:0/3789374130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20c8108cf0 0x7f20c819eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:23.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.106+0000 7f20cdedb640 1 -- 172.21.15.1:0/3789374130 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20c819f2c0 con 0x7f20c8102a60 2024-09-21T01:05:23.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.106+0000 7f20cdedb640 1 --2- 172.21.15.1:0/3789374130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20c8102a60 0x7f20c8199350 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f20c400e9c0 tx=0x7f20c400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:23.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.106+0000 7f20beffd640 1 -- 172.21.15.1:0/3789374130 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c400cde0 con 0x7f20c8102a60 2024-09-21T01:05:23.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.106+0000 7f20d013f640 1 -- 172.21.15.1:0/3789374130 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20c819f5b0 con 0x7f20c8102a60 2024-09-21T01:05:23.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.106+0000 7f20beffd640 1 -- 172.21.15.1:0/3789374130 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20c40035f0 con 0x7f20c8102a60 2024-09-21T01:05:23.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.106+0000 7f20beffd640 1 -- 172.21.15.1:0/3789374130 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c4010690 con 0x7f20c8102a60 2024-09-21T01:05:23.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.107+0000 7f20d013f640 1 -- 172.21.15.1:0/3789374130 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20c81a5d10 con 0x7f20c8102a60 2024-09-21T01:05:23.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.109+0000 7f20beffd640 1 -- 172.21.15.1:0/3789374130 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f20c4004000 con 0x7f20c8102a60 2024-09-21T01:05:23.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.110+0000 7f20d66b3740 1 Processor -- start 2024-09-21T01:05:23.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.110+0000 7f20d66b3740 1 -- start start 2024-09-21T01:05:23.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.110+0000 7f20beffd640 1 --2- 172.21.15.1:0/3789374130 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f20b40b6590 0x7f20b40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:23.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.111+0000 7f20d66b3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb8659b070 0x55fb869422c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:23.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.111+0000 7f20d66b3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb865721b0 0x55fb86942800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:23.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.111+0000 7f20d66b3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb8657a390 0x55fb86942d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:23.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.111+0000 7f20d66b3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fb868b8ea0 con 0x55fb865721b0 2024-09-21T01:05:23.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.111+0000 7f20d66b3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55fb868a82d0 con 0x55fb8657a390 2024-09-21T01:05:23.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.111+0000 7f20d66b3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55fb868ac0e0 con 0x55fb8659b070 2024-09-21T01:05:23.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.111+0000 7f20beffd640 1 -- 172.21.15.1:0/3789374130 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f20c40e7570 con 0x7f20c8102a60 2024-09-21T01:05:23.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.111+0000 7f20ce6dc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb8657a390 0x55fb86942d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:23.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.111+0000 7f20ce6dc640 1 --2- 172.21.15.1:0/3789374130 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f20b40b6590 0x7f20b40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:23.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.111+0000 7f20cdedb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb8659b070 0x55fb869422c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:23.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.111+0000 7f20cdedb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb8659b070 0x55fb869422c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:42174/0 (socket says 172.21.15.1:42174) 2024-09-21T01:05:23.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.111+0000 7f20cdedb640 1 -- 172.21.15.1:0/2236797503 learned_addr learned my addr 172.21.15.1:0/2236797503 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:23.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.111+0000 7f20ce6dc640 1 --2- 172.21.15.1:0/2236797503 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb8657a390 0x55fb86942d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.1:36544/0 (socket says 172.21.15.1:36544) 2024-09-21T01:05:23.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.111+0000 7f20cd6da640 1 --2- 172.21.15.1:0/2236797503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb865721b0 0x55fb86942800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:23.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.111+0000 7f20cdedb640 1 -- 172.21.15.1:0/2236797503 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb8657a390 msgr2=0x55fb86942d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:23.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.111+0000 7f20cdedb640 1 --2- 172.21.15.1:0/2236797503 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb8657a390 0x55fb86942d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:23.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.111+0000 7f20cdedb640 1 -- 172.21.15.1:0/2236797503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb865721b0 msgr2=0x55fb86942800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:23.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.111+0000 7f20cdedb640 1 --2- 172.21.15.1:0/2236797503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb865721b0 0x55fb86942800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:23.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.112+0000 7f20cdedb640 1 -- 172.21.15.1:0/2236797503 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb86606650 con 0x55fb8659b070 2024-09-21T01:05:23.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.112+0000 7f20cd6da640 1 --2- 172.21.15.1:0/2236797503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb865721b0 0x55fb86942800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:05:23.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.112+0000 7f20ce6dc640 1 --2- 172.21.15.1:0/3789374130 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f20b40b6590 0x7f20b40b8aa0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f20c0009370 tx=0x7f20c00093a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:23.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.112+0000 7f20cdedb640 1 --2- 172.21.15.1:0/2236797503 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb8659b070 0x55fb869422c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f20c40a9cb0 tx=0x7f20c40ad030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b482641ee708b5e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:23.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.112+0000 7f20b3fff640 1 -- 172.21.15.1:0/2236797503 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c408cd20 con 0x55fb8659b070 2024-09-21T01:05:23.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.112+0000 7f20b3fff640 1 -- 172.21.15.1:0/2236797503 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20c40ad1f0 con 0x55fb8659b070 2024-09-21T01:05:23.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.112+0000 7f20b3fff640 1 -- 172.21.15.1:0/2236797503 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c40042f0 con 0x55fb8659b070 2024-09-21T01:05:23.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.113+0000 7f20d66b3740 1 -- 172.21.15.1:0/2236797503 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb8659b070 msgr2=0x55fb869422c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:23.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.113+0000 7f20d66b3740 1 --2- 172.21.15.1:0/2236797503 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb8659b070 0x55fb869422c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f20c40a9cb0 tx=0x7f20c40ad030 comp rx=0 tx=0).stop 2024-09-21T01:05:23.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.113+0000 7f20d66b3740 1 -- 172.21.15.1:0/2236797503 shutdown_connections 2024-09-21T01:05:23.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.113+0000 7f20d66b3740 1 --2- 172.21.15.1:0/2236797503 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb8657a390 0x55fb86942d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:23.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.113+0000 7f20d66b3740 1 --2- 172.21.15.1:0/2236797503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb865721b0 0x55fb86942800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:23.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.113+0000 7f20d66b3740 1 --2- 172.21.15.1:0/2236797503 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb8659b070 0x55fb869422c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:23.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.113+0000 7f20d66b3740 1 -- 172.21.15.1:0/2236797503 >> 172.21.15.1:0/2236797503 conn(0x55fb8658f460 msgr2=0x55fb869401b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:23.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.113+0000 7f20d66b3740 1 -- 172.21.15.1:0/2236797503 shutdown_connections 2024-09-21T01:05:23.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.113+0000 7f20d66b3740 1 -- 172.21.15.1:0/2236797503 wait complete. 2024-09-21T01:05:23.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.114+0000 7f20d66b3740 1 -- start start 2024-09-21T01:05:23.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.114+0000 7f20d66b3740 1 Processor -- start 2024-09-21T01:05:23.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.115+0000 7f20d66b3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb865721b0 0x55fb8694e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:23.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.115+0000 7f20d66b3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb8657a390 0x55fb8694e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:23.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.115+0000 7f20d66b3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb8659b070 0x55fb86959a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:23.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.115+0000 7f20d66b3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fb86709700 con 0x55fb8657a390 2024-09-21T01:05:23.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.115+0000 7f20d66b3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55fb86843160 con 0x55fb8659b070 2024-09-21T01:05:23.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.115+0000 7f20d66b3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55fb86948830 con 0x55fb865721b0 2024-09-21T01:05:23.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.115+0000 7f20d66b3740 10 client.0 _ll_register_callbacks cb 0x55fb8685c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:05:23.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.115+0000 7f20cd6da640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb8657a390 0x55fb8694e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:23.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.115+0000 7f20ce6dc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb8659b070 0x55fb86959a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:23.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.115+0000 7f20cd6da640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb8657a390 0x55fb8694e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39890/0 (socket says 172.21.15.1:39890) 2024-09-21T01:05:23.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.115+0000 7f20cd6da640 1 -- 172.21.15.1:0/273041540 learned_addr learned my addr 172.21.15.1:0/273041540 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:23.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.115+0000 7f20cdedb640 1 --2- 172.21.15.1:0/273041540 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb865721b0 0x55fb8694e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:23.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.115+0000 7f20ce6dc640 1 -- 172.21.15.1:0/273041540 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb865721b0 msgr2=0x55fb8694e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:23.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.115+0000 7f20ce6dc640 1 --2- 172.21.15.1:0/273041540 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb865721b0 0x55fb8694e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:23.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.115+0000 7f20ce6dc640 1 -- 172.21.15.1:0/273041540 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb8657a390 msgr2=0x55fb8694e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:23.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.115+0000 7f20ce6dc640 1 --2- 172.21.15.1:0/273041540 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb8657a390 0x55fb8694e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:23.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.115+0000 7f20ce6dc640 1 -- 172.21.15.1:0/273041540 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb86870c90 con 0x55fb8659b070 2024-09-21T01:05:23.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.115+0000 7f20cd6da640 1 --2- 172.21.15.1:0/273041540 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb8657a390 0x55fb8694e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:05:23.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.116+0000 7f20ce6dc640 1 --2- 172.21.15.1:0/273041540 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb8659b070 0x55fb86959a00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f20c002abe0 tx=0x7f20c0005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ff5f1eb17e4d99b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:23.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.116+0000 7f20b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-21T01:05:23.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.116+0000 7f20b17fa640 1 -- 172.21.15.1:0/273041540 <== mon.2 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c004e020 con 0x55fb8659b070 2024-09-21T01:05:23.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.116+0000 7f20b17fa640 1 -- 172.21.15.1:0/273041540 <== mon.2 v2:172.21.15.42:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f20c003f690 con 0x55fb8659b070 2024-09-21T01:05:23.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.116+0000 7f20d66b3740 1 -- 172.21.15.1:0/273041540 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20c40ad1f0 con 0x55fb8659b070 2024-09-21T01:05:23.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.116+0000 7f20b17fa640 1 -- 172.21.15.1:0/273041540 <== mon.2 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f20c0059050 con 0x55fb8659b070 2024-09-21T01:05:23.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.116+0000 7f20d66b3740 10 client.27071 fetch_fsmap learned FSMap version 41 2024-09-21T01:05:23.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.116+0000 7f20d66b3740 1 -- 172.21.15.1:0/273041540 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55fb8695c730 con 0x55fb8659b070 2024-09-21T01:05:23.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.117+0000 7f20b17fa640 1 -- 172.21.15.1:0/273041540 <== mon.2 v2:172.21.15.42:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20c40ad1f0 con 0x55fb8659b070 2024-09-21T01:05:23.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.117+0000 7f20b17fa640 1 -- 172.21.15.1:0/273041540 <== mon.2 v2:172.21.15.42:3300/0 5 ==== fsmap(e 41) ==== 8390+0+0 (secure 0 0 0) 0x7f20c003c050 con 0x55fb8659b070 2024-09-21T01:05:23.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.117+0000 7f20d66b3740 10 client.27071 fetch_fsmap finished waiting for FSMap version 41 2024-09-21T01:05:23.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.117+0000 7f20d66b3740 10 client.27071 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-21T01:05:23.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.117+0000 7f20d66b3740 20 client.27071 populate_metadata read hostname 'smithi001' 2024-09-21T01:05:23.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.117+0000 7f20d66b3740 1 --2- 172.21.15.1:0/273041540 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x55fb865599f0 0x55fb8695fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:23.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.117+0000 7f20d66b3740 4 client.27071 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:05:23.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.117+0000 7f20d66b3740 1 -- 172.21.15.1:0/273041540 --> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb868badf0 con 0x55fb865599f0 2024-09-21T01:05:23.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.117+0000 7f20cdedb640 1 --2- 172.21.15.1:0/273041540 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x55fb865599f0 0x55fb8695fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:23.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.118+0000 7f20b17fa640 10 client.27071 ms_handle_connect on v2:172.21.15.193:6836/909252228 2024-09-21T01:05:23.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.118+0000 7f20cdedb640 1 --2- 172.21.15.1:0/273041540 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x55fb865599f0 0x55fb8695fd60 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3c0cc1a1e2c69fb9 server_cookie=70594f112d484966 in_seq=0 out_seq=0 2024-09-21T01:05:23.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.118+0000 7f20b17fa640 1 -- 172.21.15.1:0/273041540 <== mds.3 v2:172.21.15.193:6836/909252228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fb868badf0 con 0x55fb865599f0 2024-09-21T01:05:23.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.118+0000 7f20b17fa640 10 client.27071 handle_command_reply: tid=0 2024-09-21T01:05:23.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.118+0000 7f20d66b3740 1 client.27071 shutdown 2024-09-21T01:05:23.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.118+0000 7f20d66b3740 1 -- 172.21.15.1:0/273041540 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb8659b070 msgr2=0x55fb86959a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:23.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.118+0000 7f20d66b3740 1 --2- 172.21.15.1:0/273041540 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb8659b070 0x55fb86959a00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f20c002abe0 tx=0x7f20c0005fd0 comp rx=0 tx=0).stop 2024-09-21T01:05:23.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.119+0000 7f20d66b3740 1 -- 172.21.15.1:0/273041540 shutdown_connections 2024-09-21T01:05:23.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.119+0000 7f20d66b3740 1 --2- 172.21.15.1:0/273041540 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x55fb865599f0 0x55fb8695fd60 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:23.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.119+0000 7f20d66b3740 1 --2- 172.21.15.1:0/273041540 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb8659b070 0x55fb86959a00 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:23.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.119+0000 7f20d66b3740 1 --2- 172.21.15.1:0/273041540 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb8657a390 0x55fb8694e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:23.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.119+0000 7f20d66b3740 1 --2- 172.21.15.1:0/273041540 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb865721b0 0x55fb8694e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:23.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.119+0000 7f20b17fa640 0 client.27071 ms_handle_reset on v2:172.21.15.193:6836/909252228 2024-09-21T01:05:23.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.119+0000 7f20d66b3740 1 -- 172.21.15.1:0/273041540 >> 172.21.15.1:0/273041540 conn(0x55fb8658f460 msgr2=0x55fb86943cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:23.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.119+0000 7f20d66b3740 1 -- 172.21.15.1:0/273041540 shutdown_connections 2024-09-21T01:05:23.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.119+0000 7f20d66b3740 1 -- 172.21.15.1:0/273041540 wait complete. 2024-09-21T01:05:23.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.119+0000 7f20d66b3740 20 client.27071 trim_cache size 0 max 16384 2024-09-21T01:05:23.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.132+0000 7f20d66b3740 1 Processor -- start 2024-09-21T01:05:23.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.132+0000 7f20d66b3740 1 -- start start 2024-09-21T01:05:23.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.132+0000 7f20d66b3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb865721b0 0x55fb8693fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:23.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.133+0000 7f20d66b3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb8657a390 0x55fb86959a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:23.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.133+0000 7f20d66b3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb8659b070 0x55fb86940010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:23.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.133+0000 7f20d66b3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f20c81ad2f0 con 0x55fb8659b070 2024-09-21T01:05:23.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.133+0000 7f20d66b3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f20c81aef50 con 0x55fb865721b0 2024-09-21T01:05:23.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.133+0000 7f20d66b3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f20c81ad9f0 con 0x55fb8657a390 2024-09-21T01:05:23.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.133+0000 7f20ce6dc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb8659b070 0x55fb86940010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:23.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.133+0000 7f20ce6dc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb8659b070 0x55fb86940010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39898/0 (socket says 172.21.15.1:39898) 2024-09-21T01:05:23.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.133+0000 7f20cdedb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb865721b0 0x55fb8693fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:23.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.133+0000 7f20ce6dc640 1 -- 172.21.15.1:0/2023834739 learned_addr learned my addr 172.21.15.1:0/2023834739 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:23.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.133+0000 7f20cd6da640 1 --2- 172.21.15.1:0/2023834739 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb8657a390 0x55fb86959a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:23.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.133+0000 7f20ce6dc640 1 -- 172.21.15.1:0/2023834739 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb8657a390 msgr2=0x55fb86959a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:23.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.133+0000 7f20ce6dc640 1 --2- 172.21.15.1:0/2023834739 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb8657a390 0x55fb86959a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:23.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.133+0000 7f20ce6dc640 1 -- 172.21.15.1:0/2023834739 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb865721b0 msgr2=0x55fb8693fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:23.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.133+0000 7f20ce6dc640 1 --2- 172.21.15.1:0/2023834739 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb865721b0 0x55fb8693fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:23.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.133+0000 7f20ce6dc640 1 -- 172.21.15.1:0/2023834739 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb8693f760 con 0x55fb8659b070 2024-09-21T01:05:23.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.133+0000 7f20cd6da640 1 --2- 172.21.15.1:0/2023834739 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb8657a390 0x55fb86959a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:05:23.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.133+0000 7f20ce6dc640 1 --2- 172.21.15.1:0/2023834739 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb8659b070 0x55fb86940010 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f20c0031c80 tx=0x7f20c0031cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2bd30ff5ac55ad4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:23.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.133+0000 7f20b37fe640 1 -- 172.21.15.1:0/2023834739 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c004e030 con 0x55fb8659b070 2024-09-21T01:05:23.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.134+0000 7f20b37fe640 1 -- 172.21.15.1:0/2023834739 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20c0031440 con 0x55fb8659b070 2024-09-21T01:05:23.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.134+0000 7f20b37fe640 1 -- 172.21.15.1:0/2023834739 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c0036040 con 0x55fb8659b070 2024-09-21T01:05:23.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.134+0000 7f20d66b3740 1 -- 172.21.15.1:0/2023834739 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb8659b070 msgr2=0x55fb86940010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:23.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.134+0000 7f20d66b3740 1 --2- 172.21.15.1:0/2023834739 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb8659b070 0x55fb86940010 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f20c0031c80 tx=0x7f20c0031cb0 comp rx=0 tx=0).stop 2024-09-21T01:05:23.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.134+0000 7f20d66b3740 1 -- 172.21.15.1:0/2023834739 shutdown_connections 2024-09-21T01:05:23.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.134+0000 7f20d66b3740 1 --2- 172.21.15.1:0/2023834739 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb8659b070 0x55fb86940010 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:23.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.134+0000 7f20d66b3740 1 --2- 172.21.15.1:0/2023834739 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb8657a390 0x55fb86959a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:23.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.134+0000 7f20d66b3740 1 --2- 172.21.15.1:0/2023834739 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb865721b0 0x55fb8693fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:23.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.134+0000 7f20d66b3740 1 -- 172.21.15.1:0/2023834739 >> 172.21.15.1:0/2023834739 conn(0x55fb8658f460 msgr2=0x55fb86948fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:23.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.135+0000 7f20d66b3740 1 -- 172.21.15.1:0/2023834739 shutdown_connections 2024-09-21T01:05:23.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.135+0000 7f20d66b3740 1 -- 172.21.15.1:0/2023834739 wait complete. 2024-09-21T01:05:23.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.135+0000 7f20d66b3740 1 -- start start 2024-09-21T01:05:23.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.135+0000 7f20d66b3740 1 Processor -- start 2024-09-21T01:05:23.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.135+0000 7f20d66b3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb865721b0 0x55fb86959970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:23.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.135+0000 7f20d66b3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb8657a390 0x55fb86954e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:23.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.136+0000 7f20d66b3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb8659b070 0x55fb86955530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:23.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.136+0000 7f20d66b3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f20c81ae7c0 con 0x55fb865721b0 2024-09-21T01:05:23.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.136+0000 7f20d66b3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f20c81ae0c0 con 0x55fb8657a390 2024-09-21T01:05:23.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.136+0000 7f20d66b3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f20c81ab2d0 con 0x55fb8659b070 2024-09-21T01:05:23.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.136+0000 7f20d66b3740 10 client.0 _ll_register_callbacks cb 0x7f20c0009a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:05:23.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.136+0000 7f20cdedb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb865721b0 0x55fb86959970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:23.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.136+0000 7f20cdedb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb865721b0 0x55fb86959970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39904/0 (socket says 172.21.15.1:39904) 2024-09-21T01:05:23.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.136+0000 7f20cdedb640 1 -- 172.21.15.1:0/973070948 learned_addr learned my addr 172.21.15.1:0/973070948 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:23.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.136+0000 7f20ce6dc640 1 --2- 172.21.15.1:0/973070948 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb8659b070 0x55fb86955530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:23.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.136+0000 7f20cd6da640 1 --2- 172.21.15.1:0/973070948 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb8657a390 0x55fb86954e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:23.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.136+0000 7f20cdedb640 1 -- 172.21.15.1:0/973070948 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb8659b070 msgr2=0x55fb86955530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:23.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.136+0000 7f20cdedb640 1 --2- 172.21.15.1:0/973070948 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb8659b070 0x55fb86955530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:23.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.136+0000 7f20cdedb640 1 -- 172.21.15.1:0/973070948 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb8657a390 msgr2=0x55fb86954e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:23.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.136+0000 7f20cdedb640 1 --2- 172.21.15.1:0/973070948 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb8657a390 0x55fb86954e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:23.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.136+0000 7f20cdedb640 1 -- 172.21.15.1:0/973070948 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb869c9660 con 0x55fb865721b0 2024-09-21T01:05:23.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.136+0000 7f20cd6da640 1 --2- 172.21.15.1:0/973070948 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb8657a390 0x55fb86954e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:05:23.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.136+0000 7f20cdedb640 1 --2- 172.21.15.1:0/973070948 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb865721b0 0x55fb86959970 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f20c40e53c0 tx=0x7f20c408d730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c767431ffb362447 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:23.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.136+0000 7f20b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:05:23.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.136+0000 7f20b17fa640 1 -- 172.21.15.1:0/973070948 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c40ad1f0 con 0x55fb865721b0 2024-09-21T01:05:23.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.136+0000 7f20b17fa640 1 -- 172.21.15.1:0/973070948 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f20c40037a0 con 0x55fb865721b0 2024-09-21T01:05:23.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.136+0000 7f20d66b3740 1 -- 172.21.15.1:0/973070948 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20c0031440 con 0x55fb865721b0 2024-09-21T01:05:23.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.137+0000 7f20b17fa640 1 -- 172.21.15.1:0/973070948 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f20c40adde0 con 0x55fb865721b0 2024-09-21T01:05:23.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.137+0000 7f20d66b3740 10 client.17433 fetch_fsmap learned FSMap version 41 2024-09-21T01:05:23.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.137+0000 7f20d66b3740 1 -- 172.21.15.1:0/973070948 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55fb869ca780 con 0x55fb865721b0 2024-09-21T01:05:23.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.137+0000 7f20b17fa640 1 -- 172.21.15.1:0/973070948 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20c0031440 con 0x55fb865721b0 2024-09-21T01:05:23.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.137+0000 7f20b17fa640 1 -- 172.21.15.1:0/973070948 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 41) ==== 8390+0+0 (secure 0 0 0) 0x7f20c40e7110 con 0x55fb865721b0 2024-09-21T01:05:23.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.137+0000 7f20d66b3740 10 client.17433 fetch_fsmap finished waiting for FSMap version 41 2024-09-21T01:05:23.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.137+0000 7f20d66b3740 10 client.17433 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-21T01:05:23.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.137+0000 7f20d66b3740 20 client.17433 populate_metadata read hostname 'smithi001' 2024-09-21T01:05:23.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.137+0000 7f20d66b3740 1 --2- 172.21.15.1:0/973070948 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x55fb8652eda0 0x55fb869cca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:23.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.137+0000 7f20d66b3740 4 client.17433 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:05:23.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.137+0000 7f20d66b3740 1 -- 172.21.15.1:0/973070948 --> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fb868b68a0 con 0x55fb8652eda0 2024-09-21T01:05:23.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.138+0000 7f20cd6da640 1 --2- 172.21.15.1:0/973070948 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x55fb8652eda0 0x55fb869cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:23.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.138+0000 7f20b17fa640 10 client.17433 ms_handle_connect on v2:172.21.15.193:6836/909252228 2024-09-21T01:05:23.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.138+0000 7f20cd6da640 1 --2- 172.21.15.1:0/973070948 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x55fb8652eda0 0x55fb869cca20 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b775d334d325f5b2 server_cookie=a8a9d43728b23718 in_seq=0 out_seq=0 2024-09-21T01:05:23.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.138+0000 7f20b17fa640 1 -- 172.21.15.1:0/973070948 <== mds.3 v2:172.21.15.193:6836/909252228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fb868b68a0 con 0x55fb8652eda0 2024-09-21T01:05:23.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.138+0000 7f20b17fa640 10 client.17433 handle_command_reply: tid=0 2024-09-21T01:05:23.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.138+0000 7f20d66b3740 1 client.17433 shutdown 2024-09-21T01:05:23.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.138+0000 7f20d66b3740 1 -- 172.21.15.1:0/973070948 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb865721b0 msgr2=0x55fb86959970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:23.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.138+0000 7f20d66b3740 1 --2- 172.21.15.1:0/973070948 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb865721b0 0x55fb86959970 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f20c40e53c0 tx=0x7f20c408d730 comp rx=0 tx=0).stop 2024-09-21T01:05:23.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.138+0000 7f20d66b3740 1 -- 172.21.15.1:0/973070948 shutdown_connections 2024-09-21T01:05:23.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.138+0000 7f20d66b3740 1 --2- 172.21.15.1:0/973070948 >> [v2:172.21.15.193:6836/909252228,v1:172.21.15.193:6837/909252228] conn(0x55fb8652eda0 0x55fb869cca20 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:23.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.138+0000 7f20d66b3740 1 --2- 172.21.15.1:0/973070948 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb8659b070 0x55fb86955530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:23.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.138+0000 7f20d66b3740 1 --2- 172.21.15.1:0/973070948 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb8657a390 0x55fb86954e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:23.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.138+0000 7f20b17fa640 0 client.17433 ms_handle_reset on v2:172.21.15.193:6836/909252228 2024-09-21T01:05:23.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.138+0000 7f20d66b3740 1 --2- 172.21.15.1:0/973070948 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb865721b0 0x55fb86959970 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:23.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.139+0000 7f20d66b3740 1 -- 172.21.15.1:0/973070948 >> 172.21.15.1:0/973070948 conn(0x55fb8658f460 msgr2=0x55fb8693fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:23.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.139+0000 7f20d66b3740 1 -- 172.21.15.1:0/973070948 shutdown_connections 2024-09-21T01:05:23.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.139+0000 7f20d66b3740 1 -- 172.21.15.1:0/973070948 wait complete. 2024-09-21T01:05:23.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.139+0000 7f20d66b3740 20 client.17433 trim_cache size 0 max 16384 2024-09-21T01:05:23.144 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T01:05:23.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.139+0000 7f20d013f640 1 -- 172.21.15.1:0/3789374130 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f20b40b6590 msgr2=0x7f20b40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:23.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.139+0000 7f20d013f640 1 --2- 172.21.15.1:0/3789374130 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f20b40b6590 0x7f20b40b8aa0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f20c0009370 tx=0x7f20c00093a0 comp rx=0 tx=0).stop 2024-09-21T01:05:23.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.139+0000 7f20d013f640 1 -- 172.21.15.1:0/3789374130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20c8102a60 msgr2=0x7f20c8199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:23.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.139+0000 7f20d013f640 1 --2- 172.21.15.1:0/3789374130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20c8102a60 0x7f20c8199350 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f20c400e9c0 tx=0x7f20c400ee80 comp rx=0 tx=0).stop 2024-09-21T01:05:23.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.140+0000 7f20d013f640 1 -- 172.21.15.1:0/3789374130 shutdown_connections 2024-09-21T01:05:23.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.140+0000 7f20d013f640 1 --2- 172.21.15.1:0/3789374130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20c8108cf0 0x7f20c819eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:23.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.140+0000 7f20d013f640 1 --2- 172.21.15.1:0/3789374130 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20c81083a0 0x7f20c81998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:23.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.140+0000 7f20d013f640 1 --2- 172.21.15.1:0/3789374130 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f20b40b6590 0x7f20b40b8aa0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:23.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.140+0000 7f20d013f640 1 --2- 172.21.15.1:0/3789374130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20c8102a60 0x7f20c8199350 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:23.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.140+0000 7f20d013f640 1 -- 172.21.15.1:0/3789374130 >> 172.21.15.1:0/3789374130 conn(0x7f20c8079730 msgr2=0x7f20c81043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:23.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.140+0000 7f20d013f640 1 -- 172.21.15.1:0/3789374130 shutdown_connections 2024-09-21T01:05:23.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:23.140+0000 7f20d013f640 1 -- 172.21.15.1:0/3789374130 wait complete. 2024-09-21T01:05:23.368 DEBUG:teuthology.parallel:result is None 2024-09-21T01:05:23.369 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T01:05:23.413 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T01:05:23.413 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-21T01:05:23.423 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi001.front.sepia.ceph.com 2024-09-21T01:05:23.463 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-21T01:05:23.840 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-21T01:05:23.872 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T01:05:23.896 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:23 smithi001 ceph-mon[31211]: pgmap v603: 97 pgs: 97 active+clean; 266 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 433 op/s 2024-09-21T01:05:23.896 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:23 smithi001 ceph-mon[31211]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:05:23.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:23 smithi193 ceph-mon[34660]: pgmap v603: 97 pgs: 97 active+clean; 266 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 433 op/s 2024-09-21T01:05:23.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:23 smithi193 ceph-mon[34660]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:05:23.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:23 smithi042 ceph-mon[34481]: pgmap v603: 97 pgs: 97 active+clean; 266 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 433 op/s 2024-09-21T01:05:23.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:23 smithi042 ceph-mon[34481]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:05:24.131 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:24.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.634+0000 7f97ab9d9640 1 -- 172.21.15.1:0/2556645422 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97a4103b60 msgr2=0x7f97a4103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:24.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.634+0000 7f97ab9d9640 1 --2- 172.21.15.1:0/2556645422 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97a4103b60 0x7f97a4103f70 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f979c009900 tx=0x7f979c02a410 comp rx=0 tx=0).stop 2024-09-21T01:05:24.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.634+0000 7f97ab9d9640 1 -- 172.21.15.1:0/2556645422 shutdown_connections 2024-09-21T01:05:24.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.634+0000 7f97ab9d9640 1 --2- 172.21.15.1:0/2556645422 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f97a4109df0 0x7f97a4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:24.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.634+0000 7f97ab9d9640 1 --2- 172.21.15.1:0/2556645422 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97a41094a0 0x7f97a41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:24.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.634+0000 7f97ab9d9640 1 --2- 172.21.15.1:0/2556645422 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97a4103b60 0x7f97a4103f70 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:24.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.634+0000 7f97ab9d9640 1 -- 172.21.15.1:0/2556645422 >> 172.21.15.1:0/2556645422 conn(0x7f97a407b850 msgr2=0x7f97a407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:24.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.634+0000 7f97ab9d9640 1 -- 172.21.15.1:0/2556645422 shutdown_connections 2024-09-21T01:05:24.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.634+0000 7f97ab9d9640 1 -- 172.21.15.1:0/2556645422 wait complete. 2024-09-21T01:05:24.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.635+0000 7f97ab9d9640 1 Processor -- start 2024-09-21T01:05:24.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.635+0000 7f97ab9d9640 1 -- start start 2024-09-21T01:05:24.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.635+0000 7f97ab9d9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f97a4103b60 0x7f97a419a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:24.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.635+0000 7f97ab9d9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97a41094a0 0x7f97a419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:24.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.635+0000 7f97ab9d9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97a4109df0 0x7f97a419fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:24.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.635+0000 7f97ab9d9640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f97a4113ab0 con 0x7f97a41094a0 2024-09-21T01:05:24.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.635+0000 7f97ab9d9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f97a4113930 con 0x7f97a4109df0 2024-09-21T01:05:24.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.635+0000 7f97ab9d9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f97a4113c30 con 0x7f97a4103b60 2024-09-21T01:05:24.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.635+0000 7f97a8f74640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97a41094a0 0x7f97a419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:24.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.635+0000 7f97a8f74640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97a41094a0 0x7f97a419ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39918/0 (socket says 172.21.15.1:39918) 2024-09-21T01:05:24.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.635+0000 7f97a8f74640 1 -- 172.21.15.1:0/1206780007 learned_addr learned my addr 172.21.15.1:0/1206780007 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:24.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.635+0000 7f97a9f76640 1 --2- 172.21.15.1:0/1206780007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97a4109df0 0x7f97a419fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:24.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.635+0000 7f97a9775640 1 --2- 172.21.15.1:0/1206780007 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f97a4103b60 0x7f97a419a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:24.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.635+0000 7f97a8f74640 1 -- 172.21.15.1:0/1206780007 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f97a4103b60 msgr2=0x7f97a419a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:24.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.635+0000 7f97a8f74640 1 --2- 172.21.15.1:0/1206780007 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f97a4103b60 0x7f97a419a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:24.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.635+0000 7f97a8f74640 1 -- 172.21.15.1:0/1206780007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97a4109df0 msgr2=0x7f97a419fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:24.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.635+0000 7f97a8f74640 1 --2- 172.21.15.1:0/1206780007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97a4109df0 0x7f97a419fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:24.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.635+0000 7f97a8f74640 1 -- 172.21.15.1:0/1206780007 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97a41a04f0 con 0x7f97a41094a0 2024-09-21T01:05:24.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.635+0000 7f97a9775640 1 --2- 172.21.15.1:0/1206780007 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f97a4103b60 0x7f97a419a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:05:24.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.636+0000 7f97a8f74640 1 --2- 172.21.15.1:0/1206780007 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97a41094a0 0x7f97a419ab20 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f979800c970 tx=0x7f979800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:24.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.636+0000 7f97a27fc640 1 -- 172.21.15.1:0/1206780007 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9798007bb0 con 0x7f97a41094a0 2024-09-21T01:05:24.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.636+0000 7f97a27fc640 1 -- 172.21.15.1:0/1206780007 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9798007d50 con 0x7f97a41094a0 2024-09-21T01:05:24.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.636+0000 7f97ab9d9640 1 -- 172.21.15.1:0/1206780007 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97a41a07e0 con 0x7f97a41094a0 2024-09-21T01:05:24.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.636+0000 7f97a27fc640 1 -- 172.21.15.1:0/1206780007 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979800f450 con 0x7f97a41094a0 2024-09-21T01:05:24.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.636+0000 7f97ab9d9640 1 -- 172.21.15.1:0/1206780007 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97a41a6f40 con 0x7f97a41094a0 2024-09-21T01:05:24.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.639+0000 7f97a27fc640 1 -- 172.21.15.1:0/1206780007 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f9798004eb0 con 0x7f97a41094a0 2024-09-21T01:05:24.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.639+0000 7f97b1f4d740 1 Processor -- start 2024-09-21T01:05:24.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.639+0000 7f97b1f4d740 1 -- start start 2024-09-21T01:05:24.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.639+0000 7f97b1f4d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56403e12f070 0x56403e4d66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:24.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.639+0000 7f97b1f4d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56403e1061b0 0x56403e4d6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:24.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.639+0000 7f97b1f4d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403e10e390 0x56403e4d7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:24.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.639+0000 7f97b1f4d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56403e44cea0 con 0x56403e12f070 2024-09-21T01:05:24.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.639+0000 7f97b1f4d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56403e43c2d0 con 0x56403e10e390 2024-09-21T01:05:24.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.639+0000 7f97b1f4d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56403e4400e0 con 0x56403e1061b0 2024-09-21T01:05:24.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.640+0000 7f97a9f76640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56403e12f070 0x56403e4d66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:24.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.640+0000 7f97a9f76640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56403e12f070 0x56403e4d66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39924/0 (socket says 172.21.15.1:39924) 2024-09-21T01:05:24.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.640+0000 7f97a9f76640 1 -- 172.21.15.1:0/1837666017 learned_addr learned my addr 172.21.15.1:0/1837666017 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:24.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.640+0000 7f97a9775640 1 --2- 172.21.15.1:0/1837666017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56403e1061b0 0x56403e4d6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:24.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.640+0000 7f97a8f74640 1 --2- 172.21.15.1:0/1837666017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403e10e390 0x56403e4d7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:24.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.640+0000 7f97a9f76640 1 -- 172.21.15.1:0/1837666017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56403e1061b0 msgr2=0x56403e4d6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:24.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.640+0000 7f97a9f76640 1 --2- 172.21.15.1:0/1837666017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56403e1061b0 0x56403e4d6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:24.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.640+0000 7f97a9f76640 1 -- 172.21.15.1:0/1837666017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403e10e390 msgr2=0x56403e4d7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:24.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.640+0000 7f97a9f76640 1 --2- 172.21.15.1:0/1837666017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403e10e390 0x56403e4d7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:24.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.640+0000 7f97a9f76640 1 -- 172.21.15.1:0/1837666017 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56403e19a650 con 0x56403e12f070 2024-09-21T01:05:24.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.640+0000 7f97a27fc640 1 --2- 172.21.15.1:0/1206780007 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f978c0b6510 0x7f978c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:24.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.640+0000 7f97a9775640 1 --2- 172.21.15.1:0/1206780007 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f978c0b6510 0x7f978c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:24.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.640+0000 7f97a9f76640 1 --2- 172.21.15.1:0/1837666017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56403e12f070 0x56403e4d66a0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f9794009e60 tx=0x7f9794010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee6008e40c53048e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:24.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.640+0000 7f97a27fc640 1 -- 172.21.15.1:0/1206780007 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f97980e70f0 con 0x7f97a41094a0 2024-09-21T01:05:24.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.641+0000 7f97a9775640 1 --2- 172.21.15.1:0/1206780007 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f978c0b6510 0x7f978c0b8a20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f979c031440 tx=0x7f979c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:24.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.642+0000 7f978b7fe640 1 -- 172.21.15.1:0/1837666017 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9794016070 con 0x56403e12f070 2024-09-21T01:05:24.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.642+0000 7f978b7fe640 1 -- 172.21.15.1:0/1837666017 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9794004d20 con 0x56403e12f070 2024-09-21T01:05:24.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.642+0000 7f978b7fe640 1 -- 172.21.15.1:0/1837666017 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97940126b0 con 0x56403e12f070 2024-09-21T01:05:24.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.642+0000 7f97b1f4d740 1 -- 172.21.15.1:0/1837666017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56403e12f070 msgr2=0x56403e4d66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:24.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.642+0000 7f97b1f4d740 1 --2- 172.21.15.1:0/1837666017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56403e12f070 0x56403e4d66a0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f9794009e60 tx=0x7f9794010740 comp rx=0 tx=0).stop 2024-09-21T01:05:24.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.643+0000 7f97b1f4d740 1 -- 172.21.15.1:0/1837666017 shutdown_connections 2024-09-21T01:05:24.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.643+0000 7f97b1f4d740 1 --2- 172.21.15.1:0/1837666017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403e10e390 0x56403e4d7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:24.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.643+0000 7f97b1f4d740 1 --2- 172.21.15.1:0/1837666017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56403e1061b0 0x56403e4d6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:24.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.643+0000 7f97b1f4d740 1 --2- 172.21.15.1:0/1837666017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56403e12f070 0x56403e4d66a0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:24.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.643+0000 7f97b1f4d740 1 -- 172.21.15.1:0/1837666017 >> 172.21.15.1:0/1837666017 conn(0x56403e123460 msgr2=0x56403e4d4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:24.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.643+0000 7f97b1f4d740 1 -- 172.21.15.1:0/1837666017 shutdown_connections 2024-09-21T01:05:24.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.643+0000 7f97b1f4d740 1 -- 172.21.15.1:0/1837666017 wait complete. 2024-09-21T01:05:24.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.643+0000 7f97b1f4d740 1 -- start start 2024-09-21T01:05:24.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.643+0000 7f97b1f4d740 1 Processor -- start 2024-09-21T01:05:24.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.644+0000 7f97b1f4d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403e1061b0 0x56403e4e6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:24.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.644+0000 7f97b1f4d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56403e10e390 0x56403e4e66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:24.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.644+0000 7f97b1f4d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56403e12f070 0x56403e4f2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:24.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.644+0000 7f97b1f4d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56403e29d700 con 0x56403e12f070 2024-09-21T01:05:24.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.644+0000 7f97b1f4d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56403e3d7160 con 0x56403e1061b0 2024-09-21T01:05:24.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.644+0000 7f97b1f4d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56403e4e91e0 con 0x56403e10e390 2024-09-21T01:05:24.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.644+0000 7f97b1f4d740 10 client.0 _ll_register_callbacks cb 0x56403e3f09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:05:24.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.644+0000 7f97a9f76640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56403e12f070 0x56403e4f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:24.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.644+0000 7f97a9f76640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56403e12f070 0x56403e4f2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39928/0 (socket says 172.21.15.1:39928) 2024-09-21T01:05:24.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.644+0000 7f97a9f76640 1 -- 172.21.15.1:0/1278466696 learned_addr learned my addr 172.21.15.1:0/1278466696 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:24.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.644+0000 7f97a8f74640 1 --2- 172.21.15.1:0/1278466696 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56403e10e390 0x56403e4e66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:24.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.644+0000 7f97a9775640 1 --2- 172.21.15.1:0/1278466696 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403e1061b0 0x56403e4e6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:24.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.644+0000 7f97a9f76640 1 -- 172.21.15.1:0/1278466696 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56403e10e390 msgr2=0x56403e4e66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:24.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.644+0000 7f97a9f76640 1 --2- 172.21.15.1:0/1278466696 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56403e10e390 0x56403e4e66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:24.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.644+0000 7f97a9f76640 1 -- 172.21.15.1:0/1278466696 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403e1061b0 msgr2=0x56403e4e6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:24.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.644+0000 7f97a9f76640 1 --2- 172.21.15.1:0/1278466696 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403e1061b0 0x56403e4e6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:24.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.644+0000 7f97a9f76640 1 -- 172.21.15.1:0/1278466696 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56403e404c90 con 0x56403e12f070 2024-09-21T01:05:24.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.644+0000 7f97a9f76640 1 --2- 172.21.15.1:0/1278466696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56403e12f070 0x56403e4f2510 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f9794004c70 tx=0x7f9794004ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6489348545c7b38 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:24.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.644+0000 7f9788ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:05:24.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.645+0000 7f9788ff9640 1 -- 172.21.15.1:0/1278466696 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9794016040 con 0x56403e12f070 2024-09-21T01:05:24.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.645+0000 7f97b1f4d740 1 -- 172.21.15.1:0/1278466696 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9794004d20 con 0x56403e12f070 2024-09-21T01:05:24.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.645+0000 7f9788ff9640 1 -- 172.21.15.1:0/1278466696 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f97940052e0 con 0x56403e12f070 2024-09-21T01:05:24.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.645+0000 7f9788ff9640 1 -- 172.21.15.1:0/1278466696 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f97940054e0 con 0x56403e12f070 2024-09-21T01:05:24.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.645+0000 7f97b1f4d740 10 client.17445 fetch_fsmap learned FSMap version 41 2024-09-21T01:05:24.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.645+0000 7f97b1f4d740 1 -- 172.21.15.1:0/1278466696 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x56403e4f4f00 con 0x56403e12f070 2024-09-21T01:05:24.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.645+0000 7f9788ff9640 1 -- 172.21.15.1:0/1278466696 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9794004d20 con 0x56403e12f070 2024-09-21T01:05:24.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.645+0000 7f9788ff9640 1 -- 172.21.15.1:0/1278466696 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 41) ==== 8390+0+0 (secure 0 0 0) 0x7f979400f040 con 0x56403e12f070 2024-09-21T01:05:24.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.645+0000 7f97b1f4d740 10 client.17445 fetch_fsmap finished waiting for FSMap version 41 2024-09-21T01:05:24.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.645+0000 7f97b1f4d740 10 client.17445 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T01:05:24.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.645+0000 7f97b1f4d740 20 client.17445 populate_metadata read hostname 'smithi001' 2024-09-21T01:05:24.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.645+0000 7f97b1f4d740 1 --2- 172.21.15.1:0/1278466696 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x56403e0ed9f0 0x56403e4f82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:24.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.645+0000 7f97b1f4d740 4 client.17445 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:05:24.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.645+0000 7f97b1f4d740 1 -- 172.21.15.1:0/1278466696 --> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56403e44edf0 con 0x56403e0ed9f0 2024-09-21T01:05:24.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.646+0000 7f97a9775640 1 --2- 172.21.15.1:0/1278466696 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x56403e0ed9f0 0x56403e4f82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:24.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.646+0000 7f9788ff9640 10 client.17445 ms_handle_connect on v2:172.21.15.42:6836/2395608508 2024-09-21T01:05:24.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.646+0000 7f97a9775640 1 --2- 172.21.15.1:0/1278466696 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x56403e0ed9f0 0x56403e4f82c0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=db7688d3984b7ae3 server_cookie=cdc7ed59ca430d96 in_seq=0 out_seq=0 2024-09-21T01:05:24.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.647+0000 7f9788ff9640 1 -- 172.21.15.1:0/1278466696 <== mds.2 v2:172.21.15.42:6836/2395608508 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56403e44edf0 con 0x56403e0ed9f0 2024-09-21T01:05:24.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.647+0000 7f9788ff9640 10 client.17445 handle_command_reply: tid=0 2024-09-21T01:05:24.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.647+0000 7f97b1f4d740 1 client.17445 shutdown 2024-09-21T01:05:24.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.647+0000 7f97b1f4d740 1 -- 172.21.15.1:0/1278466696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56403e12f070 msgr2=0x56403e4f2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:24.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.647+0000 7f97b1f4d740 1 --2- 172.21.15.1:0/1278466696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56403e12f070 0x56403e4f2510 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f9794004c70 tx=0x7f9794004ca0 comp rx=0 tx=0).stop 2024-09-21T01:05:24.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.647+0000 7f97b1f4d740 1 -- 172.21.15.1:0/1278466696 shutdown_connections 2024-09-21T01:05:24.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.647+0000 7f97b1f4d740 1 --2- 172.21.15.1:0/1278466696 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x56403e0ed9f0 0x56403e4f82c0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:24.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.647+0000 7f97b1f4d740 1 --2- 172.21.15.1:0/1278466696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56403e12f070 0x56403e4f2510 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:24.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.647+0000 7f97b1f4d740 1 --2- 172.21.15.1:0/1278466696 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56403e10e390 0x56403e4e66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:24.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.647+0000 7f97b1f4d740 1 --2- 172.21.15.1:0/1278466696 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403e1061b0 0x56403e4e6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:24.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.647+0000 7f9788ff9640 0 client.17445 ms_handle_reset on v2:172.21.15.42:6836/2395608508 2024-09-21T01:05:24.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.647+0000 7f97b1f4d740 1 -- 172.21.15.1:0/1278466696 >> 172.21.15.1:0/1278466696 conn(0x56403e123460 msgr2=0x56403e4d2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:24.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.647+0000 7f97b1f4d740 1 -- 172.21.15.1:0/1278466696 shutdown_connections 2024-09-21T01:05:24.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.647+0000 7f97b1f4d740 1 -- 172.21.15.1:0/1278466696 wait complete. 2024-09-21T01:05:24.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.647+0000 7f97b1f4d740 20 client.17445 trim_cache size 0 max 16384 2024-09-21T01:05:24.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.660+0000 7f97b1f4d740 1 Processor -- start 2024-09-21T01:05:24.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.661+0000 7f97b1f4d740 1 -- start start 2024-09-21T01:05:24.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.661+0000 7f97b1f4d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56403e1061b0 0x56403e4f2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:24.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.661+0000 7f97b1f4d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403e10e390 0x56403e4d7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:24.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.661+0000 7f97b1f4d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56403e12f070 0x56403e4e3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:24.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.661+0000 7f97b1f4d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f97a41ad3e0 con 0x56403e1061b0 2024-09-21T01:05:24.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.661+0000 7f97b1f4d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f97a41af040 con 0x56403e10e390 2024-09-21T01:05:24.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.661+0000 7f97b1f4d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f97a41adae0 con 0x56403e12f070 2024-09-21T01:05:24.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.661+0000 7f97a9775640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56403e1061b0 0x56403e4f2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:24.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.661+0000 7f97a9775640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56403e1061b0 0x56403e4f2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39938/0 (socket says 172.21.15.1:39938) 2024-09-21T01:05:24.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.661+0000 7f97a9775640 1 -- 172.21.15.1:0/2508744273 learned_addr learned my addr 172.21.15.1:0/2508744273 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:24.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.661+0000 7f97a8f74640 1 --2- 172.21.15.1:0/2508744273 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403e10e390 0x56403e4d7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:24.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.661+0000 7f97a9775640 1 -- 172.21.15.1:0/2508744273 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56403e12f070 msgr2=0x56403e4e3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:24.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.661+0000 7f97a9775640 1 --2- 172.21.15.1:0/2508744273 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56403e12f070 0x56403e4e3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:24.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.661+0000 7f97a9775640 1 -- 172.21.15.1:0/2508744273 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403e10e390 msgr2=0x56403e4d7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:24.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.661+0000 7f97a9775640 1 --2- 172.21.15.1:0/2508744273 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403e10e390 0x56403e4d7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:24.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.661+0000 7f97a9775640 1 -- 172.21.15.1:0/2508744273 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56403e4e6fd0 con 0x56403e1061b0 2024-09-21T01:05:24.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.661+0000 7f97a9775640 1 --2- 172.21.15.1:0/2508744273 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56403e1061b0 0x56403e4f2480 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f979c009230 tx=0x7f979c040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73eff7bbcf248f83 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:24.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.662+0000 7f978affd640 1 -- 172.21.15.1:0/2508744273 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979c055070 con 0x56403e1061b0 2024-09-21T01:05:24.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.662+0000 7f978affd640 1 -- 172.21.15.1:0/2508744273 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f979c0035f0 con 0x56403e1061b0 2024-09-21T01:05:24.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.662+0000 7f978affd640 1 -- 172.21.15.1:0/2508744273 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979c035040 con 0x56403e1061b0 2024-09-21T01:05:24.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.662+0000 7f97b1f4d740 1 -- 172.21.15.1:0/2508744273 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56403e1061b0 msgr2=0x56403e4f2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:24.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.662+0000 7f97b1f4d740 1 --2- 172.21.15.1:0/2508744273 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56403e1061b0 0x56403e4f2480 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f979c009230 tx=0x7f979c040000 comp rx=0 tx=0).stop 2024-09-21T01:05:24.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.662+0000 7f97b1f4d740 1 -- 172.21.15.1:0/2508744273 shutdown_connections 2024-09-21T01:05:24.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.662+0000 7f97b1f4d740 1 --2- 172.21.15.1:0/2508744273 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56403e12f070 0x56403e4e3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:24.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.662+0000 7f97b1f4d740 1 --2- 172.21.15.1:0/2508744273 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403e10e390 0x56403e4d7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:24.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.662+0000 7f97b1f4d740 1 --2- 172.21.15.1:0/2508744273 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56403e1061b0 0x56403e4f2480 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:24.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.662+0000 7f97b1f4d740 1 -- 172.21.15.1:0/2508744273 >> 172.21.15.1:0/2508744273 conn(0x56403e123460 msgr2=0x56403e4d76d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:24.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.662+0000 7f97b1f4d740 1 -- 172.21.15.1:0/2508744273 shutdown_connections 2024-09-21T01:05:24.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.662+0000 7f97b1f4d740 1 -- 172.21.15.1:0/2508744273 wait complete. 2024-09-21T01:05:24.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.663+0000 7f97b1f4d740 1 -- start start 2024-09-21T01:05:24.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.663+0000 7f97b1f4d740 1 Processor -- start 2024-09-21T01:05:24.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.663+0000 7f97b1f4d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56403e1061b0 0x56403e4f9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:24.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.663+0000 7f97b1f4d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403e10e390 0x56403e4fa310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:24.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.663+0000 7f97b1f4d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56403e12f070 0x56403e55aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:24.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.663+0000 7f97b1f4d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f97a41ae8b0 con 0x56403e1061b0 2024-09-21T01:05:24.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.663+0000 7f97b1f4d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f97a41ae1b0 con 0x56403e10e390 2024-09-21T01:05:24.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.663+0000 7f97b1f4d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f97a41ab3c0 con 0x56403e12f070 2024-09-21T01:05:24.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.663+0000 7f97b1f4d740 10 client.0 _ll_register_callbacks cb 0x7f979c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:05:24.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.663+0000 7f97a9775640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56403e1061b0 0x56403e4f9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:24.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.663+0000 7f97a9775640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56403e1061b0 0x56403e4f9d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39952/0 (socket says 172.21.15.1:39952) 2024-09-21T01:05:24.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.663+0000 7f97a9775640 1 -- 172.21.15.1:0/941227985 learned_addr learned my addr 172.21.15.1:0/941227985 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:24.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.663+0000 7f97a8f74640 1 --2- 172.21.15.1:0/941227985 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403e10e390 0x56403e4fa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:24.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.664+0000 7f97a9f76640 1 --2- 172.21.15.1:0/941227985 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56403e12f070 0x56403e55aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:24.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.664+0000 7f97a9775640 1 -- 172.21.15.1:0/941227985 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56403e12f070 msgr2=0x56403e55aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:24.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.664+0000 7f97a9775640 1 --2- 172.21.15.1:0/941227985 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56403e12f070 0x56403e55aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:24.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.664+0000 7f97a9775640 1 -- 172.21.15.1:0/941227985 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403e10e390 msgr2=0x56403e4fa310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:24.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.664+0000 7f97a9775640 1 --2- 172.21.15.1:0/941227985 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403e10e390 0x56403e4fa310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:24.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.664+0000 7f97a9775640 1 -- 172.21.15.1:0/941227985 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56403e55b070 con 0x56403e1061b0 2024-09-21T01:05:24.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.664+0000 7f97a9775640 1 --2- 172.21.15.1:0/941227985 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56403e1061b0 0x56403e4f9d70 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f979c005ab0 tx=0x7f979c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea4b7967d8f51287 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:24.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.664+0000 7f9788ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:05:24.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.664+0000 7f9788ff9640 1 -- 172.21.15.1:0/941227985 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979c055070 con 0x56403e1061b0 2024-09-21T01:05:24.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.664+0000 7f9788ff9640 1 -- 172.21.15.1:0/941227985 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f979c0039a0 con 0x56403e1061b0 2024-09-21T01:05:24.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.664+0000 7f97b1f4d740 1 -- 172.21.15.1:0/941227985 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f979c0035f0 con 0x56403e1061b0 2024-09-21T01:05:24.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.665+0000 7f9788ff9640 1 -- 172.21.15.1:0/941227985 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f979c035040 con 0x56403e1061b0 2024-09-21T01:05:24.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.665+0000 7f97b1f4d740 10 client.17451 fetch_fsmap learned FSMap version 41 2024-09-21T01:05:24.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.665+0000 7f97b1f4d740 1 -- 172.21.15.1:0/941227985 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x56403e563530 con 0x56403e1061b0 2024-09-21T01:05:24.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.665+0000 7f9788ff9640 1 -- 172.21.15.1:0/941227985 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f979c0035f0 con 0x56403e1061b0 2024-09-21T01:05:24.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.665+0000 7f9788ff9640 1 -- 172.21.15.1:0/941227985 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 41) ==== 8390+0+0 (secure 0 0 0) 0x7f979c051030 con 0x56403e1061b0 2024-09-21T01:05:24.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.665+0000 7f97b1f4d740 10 client.17451 fetch_fsmap finished waiting for FSMap version 41 2024-09-21T01:05:24.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.665+0000 7f97b1f4d740 10 client.17451 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T01:05:24.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.665+0000 7f97b1f4d740 20 client.17451 populate_metadata read hostname 'smithi001' 2024-09-21T01:05:24.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.665+0000 7f97b1f4d740 1 --2- 172.21.15.1:0/941227985 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x56403e0c2da0 0x56403e565ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:24.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.665+0000 7f97b1f4d740 4 client.17451 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:05:24.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.665+0000 7f97b1f4d740 1 -- 172.21.15.1:0/941227985 --> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56403e44a8a0 con 0x56403e0c2da0 2024-09-21T01:05:24.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.666+0000 7f97a8f74640 1 --2- 172.21.15.1:0/941227985 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x56403e0c2da0 0x56403e565ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:24.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.666+0000 7f97a8f74640 1 --2- 172.21.15.1:0/941227985 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x56403e0c2da0 0x56403e565ce0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=89fdcc6d42fb3798 server_cookie=830696e2bf1fd6ea in_seq=0 out_seq=0 2024-09-21T01:05:24.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.666+0000 7f9788ff9640 10 client.17451 ms_handle_connect on v2:172.21.15.42:6836/2395608508 2024-09-21T01:05:24.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.666+0000 7f9788ff9640 1 -- 172.21.15.1:0/941227985 <== mds.2 v2:172.21.15.42:6836/2395608508 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56403e44a8a0 con 0x56403e0c2da0 2024-09-21T01:05:24.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.666+0000 7f9788ff9640 10 client.17451 handle_command_reply: tid=0 2024-09-21T01:05:24.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.666+0000 7f97b1f4d740 1 client.17451 shutdown 2024-09-21T01:05:24.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.666+0000 7f97b1f4d740 1 -- 172.21.15.1:0/941227985 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56403e1061b0 msgr2=0x56403e4f9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:24.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.666+0000 7f97b1f4d740 1 --2- 172.21.15.1:0/941227985 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56403e1061b0 0x56403e4f9d70 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f979c005ab0 tx=0x7f979c02a410 comp rx=0 tx=0).stop 2024-09-21T01:05:24.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.666+0000 7f97b1f4d740 1 -- 172.21.15.1:0/941227985 shutdown_connections 2024-09-21T01:05:24.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.666+0000 7f97b1f4d740 1 --2- 172.21.15.1:0/941227985 >> [v2:172.21.15.42:6836/2395608508,v1:172.21.15.42:6837/2395608508] conn(0x56403e0c2da0 0x56403e565ce0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:24.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.666+0000 7f9788ff9640 0 client.17451 ms_handle_reset on v2:172.21.15.42:6836/2395608508 2024-09-21T01:05:24.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.666+0000 7f97b1f4d740 1 --2- 172.21.15.1:0/941227985 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56403e12f070 0x56403e55aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:24.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.666+0000 7f97b1f4d740 1 --2- 172.21.15.1:0/941227985 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403e10e390 0x56403e4fa310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:24.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.666+0000 7f97b1f4d740 1 --2- 172.21.15.1:0/941227985 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56403e1061b0 0x56403e4f9d70 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:24.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.667+0000 7f97b1f4d740 1 -- 172.21.15.1:0/941227985 >> 172.21.15.1:0/941227985 conn(0x56403e123460 msgr2=0x56403e4d8070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:24.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.667+0000 7f97b1f4d740 1 -- 172.21.15.1:0/941227985 shutdown_connections 2024-09-21T01:05:24.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.667+0000 7f97b1f4d740 1 -- 172.21.15.1:0/941227985 wait complete. 2024-09-21T01:05:24.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.667+0000 7f97b1f4d740 20 client.17451 trim_cache size 0 max 16384 2024-09-21T01:05:24.684 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T01:05:24.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.667+0000 7f97ab9d9640 1 -- 172.21.15.1:0/1206780007 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f978c0b6510 msgr2=0x7f978c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:24.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.667+0000 7f97ab9d9640 1 --2- 172.21.15.1:0/1206780007 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f978c0b6510 0x7f978c0b8a20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f979c031440 tx=0x7f979c005a20 comp rx=0 tx=0).stop 2024-09-21T01:05:24.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.667+0000 7f97ab9d9640 1 -- 172.21.15.1:0/1206780007 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97a41094a0 msgr2=0x7f97a419ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:24.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.667+0000 7f97ab9d9640 1 --2- 172.21.15.1:0/1206780007 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97a41094a0 0x7f97a419ab20 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f979800c970 tx=0x7f979800ce30 comp rx=0 tx=0).stop 2024-09-21T01:05:24.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.668+0000 7f97ab9d9640 1 -- 172.21.15.1:0/1206780007 shutdown_connections 2024-09-21T01:05:24.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.668+0000 7f97ab9d9640 1 --2- 172.21.15.1:0/1206780007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97a4109df0 0x7f97a419fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:24.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.668+0000 7f97ab9d9640 1 --2- 172.21.15.1:0/1206780007 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f978c0b6510 0x7f978c0b8a20 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:24.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.668+0000 7f97ab9d9640 1 --2- 172.21.15.1:0/1206780007 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97a41094a0 0x7f97a419ab20 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:24.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.668+0000 7f97ab9d9640 1 --2- 172.21.15.1:0/1206780007 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f97a4103b60 0x7f97a419a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:24.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.668+0000 7f97ab9d9640 1 -- 172.21.15.1:0/1206780007 >> 172.21.15.1:0/1206780007 conn(0x7f97a407b850 msgr2=0x7f97a4107640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:24.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.668+0000 7f97ab9d9640 1 -- 172.21.15.1:0/1206780007 shutdown_connections 2024-09-21T01:05:24.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:24.668+0000 7f97ab9d9640 1 -- 172.21.15.1:0/1206780007 wait complete. 2024-09-21T01:05:25.427 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T01:05:25.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:25 smithi001 ceph-mon[31211]: pgmap v604: 97 pgs: 97 active+clean; 256 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 420 op/s 2024-09-21T01:05:25.726 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:25.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:25 smithi193 ceph-mon[34660]: pgmap v604: 97 pgs: 97 active+clean; 256 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 420 op/s 2024-09-21T01:05:25.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:25 smithi042 ceph-mon[34481]: pgmap v604: 97 pgs: 97 active+clean; 256 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 420 op/s 2024-09-21T01:05:26.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.238+0000 7f6354088640 1 -- 172.21.15.1:0/1767473581 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f634c109df0 msgr2=0x7f634c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:26.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.238+0000 7f6354088640 1 --2- 172.21.15.1:0/1767473581 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f634c109df0 0x7f634c110620 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f6344009ca0 tx=0x7f634402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:05:26.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.238+0000 7f6354088640 1 -- 172.21.15.1:0/1767473581 shutdown_connections 2024-09-21T01:05:26.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.238+0000 7f6354088640 1 --2- 172.21.15.1:0/1767473581 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f634c109df0 0x7f634c110620 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:26.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.238+0000 7f6354088640 1 --2- 172.21.15.1:0/1767473581 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f634c1094a0 0x7f634c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:26.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.238+0000 7f6354088640 1 --2- 172.21.15.1:0/1767473581 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f634c103b60 0x7f634c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:26.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.238+0000 7f6354088640 1 -- 172.21.15.1:0/1767473581 >> 172.21.15.1:0/1767473581 conn(0x7f634c07b850 msgr2=0x7f634c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:26.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.238+0000 7f6354088640 1 -- 172.21.15.1:0/1767473581 shutdown_connections 2024-09-21T01:05:26.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.238+0000 7f6354088640 1 -- 172.21.15.1:0/1767473581 wait complete. 2024-09-21T01:05:26.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.238+0000 7f6354088640 1 Processor -- start 2024-09-21T01:05:26.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.238+0000 7f6354088640 1 -- start start 2024-09-21T01:05:26.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.239+0000 7f6354088640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f634c103b60 0x7f634c19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:26.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.239+0000 7f6354088640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f634c1094a0 0x7f634c19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:26.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.239+0000 7f6354088640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f634c109df0 0x7f634c19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:26.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.239+0000 7f6354088640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f634c113ab0 con 0x7f634c1094a0 2024-09-21T01:05:26.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.239+0000 7f6354088640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f634c113930 con 0x7f634c103b60 2024-09-21T01:05:26.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.239+0000 7f6354088640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f634c113c30 con 0x7f634c109df0 2024-09-21T01:05:26.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.239+0000 7f6351623640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f634c1094a0 0x7f634c19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:26.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.239+0000 7f6351623640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f634c1094a0 0x7f634c19aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39966/0 (socket says 172.21.15.1:39966) 2024-09-21T01:05:26.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.239+0000 7f6351623640 1 -- 172.21.15.1:0/2381735948 learned_addr learned my addr 172.21.15.1:0/2381735948 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:26.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.239+0000 7f6352625640 1 --2- 172.21.15.1:0/2381735948 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f634c109df0 0x7f634c19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:26.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.239+0000 7f6351e24640 1 --2- 172.21.15.1:0/2381735948 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f634c103b60 0x7f634c19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:26.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.239+0000 7f6351623640 1 -- 172.21.15.1:0/2381735948 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f634c109df0 msgr2=0x7f634c19fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:26.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.239+0000 7f6351623640 1 --2- 172.21.15.1:0/2381735948 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f634c109df0 0x7f634c19fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:26.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.239+0000 7f6351623640 1 -- 172.21.15.1:0/2381735948 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f634c103b60 msgr2=0x7f634c19a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:26.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.239+0000 7f6351623640 1 --2- 172.21.15.1:0/2381735948 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f634c103b60 0x7f634c19a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:26.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.239+0000 7f6351623640 1 -- 172.21.15.1:0/2381735948 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f634c1a03f0 con 0x7f634c1094a0 2024-09-21T01:05:26.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.239+0000 7f6351e24640 1 --2- 172.21.15.1:0/2381735948 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f634c103b60 0x7f634c19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:05:26.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.240+0000 7f6351623640 1 --2- 172.21.15.1:0/2381735948 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f634c1094a0 0x7f634c19aa20 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f633c00d740 tx=0x7f633c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:26.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.240+0000 7f6342ffd640 1 -- 172.21.15.1:0/2381735948 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c017070 con 0x7f634c1094a0 2024-09-21T01:05:26.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.240+0000 7f6342ffd640 1 -- 172.21.15.1:0/2381735948 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f633c00de50 con 0x7f634c1094a0 2024-09-21T01:05:26.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.240+0000 7f6342ffd640 1 -- 172.21.15.1:0/2381735948 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c00f620 con 0x7f634c1094a0 2024-09-21T01:05:26.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.240+0000 7f6354088640 1 -- 172.21.15.1:0/2381735948 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f634c1a06e0 con 0x7f634c1094a0 2024-09-21T01:05:26.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.240+0000 7f6354088640 1 -- 172.21.15.1:0/2381735948 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f634c1a6e40 con 0x7f634c1094a0 2024-09-21T01:05:26.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.242+0000 7f6342ffd640 1 -- 172.21.15.1:0/2381735948 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f633c01a070 con 0x7f634c1094a0 2024-09-21T01:05:26.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.242+0000 7f635a5fc740 1 Processor -- start 2024-09-21T01:05:26.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.243+0000 7f635a5fc740 1 -- start start 2024-09-21T01:05:26.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.243+0000 7f635a5fc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583b21cc070 0x5583b25736a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:26.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.243+0000 7f635a5fc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5583b21a31b0 0x5583b2573be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:26.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.243+0000 7f635a5fc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b21ab390 0x5583b2574120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:26.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.243+0000 7f635a5fc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5583b24e9ea0 con 0x5583b21ab390 2024-09-21T01:05:26.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.243+0000 7f635a5fc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5583b24d92d0 con 0x5583b21a31b0 2024-09-21T01:05:26.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.243+0000 7f635a5fc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5583b24dd0e0 con 0x5583b21cc070 2024-09-21T01:05:26.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.243+0000 7f6351623640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b21ab390 0x5583b2574120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:26.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.243+0000 7f6351623640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b21ab390 0x5583b2574120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39968/0 (socket says 172.21.15.1:39968) 2024-09-21T01:05:26.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.243+0000 7f6351623640 1 -- 172.21.15.1:0/2592699087 learned_addr learned my addr 172.21.15.1:0/2592699087 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:26.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.243+0000 7f6352625640 1 --2- 172.21.15.1:0/2592699087 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583b21cc070 0x5583b25736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:26.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.243+0000 7f6351e24640 1 --2- 172.21.15.1:0/2592699087 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5583b21a31b0 0x5583b2573be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:26.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.244+0000 7f6342ffd640 1 --2- 172.21.15.1:0/2381735948 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f63380b6510 0x7f63380b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:26.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.244+0000 7f6351623640 1 -- 172.21.15.1:0/2592699087 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583b21cc070 msgr2=0x5583b25736a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:26.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.244+0000 7f6351623640 1 --2- 172.21.15.1:0/2592699087 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583b21cc070 0x5583b25736a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:26.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.244+0000 7f6351623640 1 -- 172.21.15.1:0/2592699087 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5583b21a31b0 msgr2=0x5583b2573be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:26.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.244+0000 7f6351623640 1 --2- 172.21.15.1:0/2592699087 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5583b21a31b0 0x5583b2573be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:26.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.244+0000 7f6351623640 1 -- 172.21.15.1:0/2592699087 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583b2237650 con 0x5583b21ab390 2024-09-21T01:05:26.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.244+0000 7f6352625640 1 --2- 172.21.15.1:0/2592699087 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583b21cc070 0x5583b25736a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:05:26.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.244+0000 7f6352625640 1 --2- 172.21.15.1:0/2381735948 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f63380b6510 0x7f63380b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:26.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.244+0000 7f6342ffd640 1 -- 172.21.15.1:0/2381735948 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f633c0e6d30 con 0x7f634c1094a0 2024-09-21T01:05:26.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.244+0000 7f6351623640 1 --2- 172.21.15.1:0/2592699087 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b21ab390 0x5583b2574120 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f633c0bd210 tx=0x7f633c0ad090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f553596810dbddd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:26.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.244+0000 7f6337fff640 1 -- 172.21.15.1:0/2592699087 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c021070 con 0x5583b21ab390 2024-09-21T01:05:26.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.244+0000 7f6337fff640 1 -- 172.21.15.1:0/2592699087 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f633c0bc8d0 con 0x5583b21ab390 2024-09-21T01:05:26.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.244+0000 7f6337fff640 1 -- 172.21.15.1:0/2592699087 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c0ac7f0 con 0x5583b21ab390 2024-09-21T01:05:26.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.245+0000 7f635a5fc740 1 -- 172.21.15.1:0/2592699087 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b21ab390 msgr2=0x5583b2574120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:26.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.245+0000 7f6352625640 1 --2- 172.21.15.1:0/2381735948 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f63380b6510 0x7f63380b8a20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6344006010 tx=0x7f63440095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:26.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.245+0000 7f635a5fc740 1 --2- 172.21.15.1:0/2592699087 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b21ab390 0x5583b2574120 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f633c0bd210 tx=0x7f633c0ad090 comp rx=0 tx=0).stop 2024-09-21T01:05:26.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.245+0000 7f635a5fc740 1 -- 172.21.15.1:0/2592699087 shutdown_connections 2024-09-21T01:05:26.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.245+0000 7f635a5fc740 1 --2- 172.21.15.1:0/2592699087 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b21ab390 0x5583b2574120 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:26.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.245+0000 7f635a5fc740 1 --2- 172.21.15.1:0/2592699087 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5583b21a31b0 0x5583b2573be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:26.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.245+0000 7f635a5fc740 1 --2- 172.21.15.1:0/2592699087 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583b21cc070 0x5583b25736a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:26.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.245+0000 7f635a5fc740 1 -- 172.21.15.1:0/2592699087 >> 172.21.15.1:0/2592699087 conn(0x5583b21c0460 msgr2=0x5583b2571590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:26.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.245+0000 7f635a5fc740 1 -- 172.21.15.1:0/2592699087 shutdown_connections 2024-09-21T01:05:26.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.245+0000 7f635a5fc740 1 -- 172.21.15.1:0/2592699087 wait complete. 2024-09-21T01:05:26.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.246+0000 7f635a5fc740 1 -- start start 2024-09-21T01:05:26.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.246+0000 7f635a5fc740 1 Processor -- start 2024-09-21T01:05:26.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.246+0000 7f635a5fc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583b21a31b0 0x5583b25830a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:26.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.246+0000 7f635a5fc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b21ab390 0x5583b25835e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:26.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.246+0000 7f635a5fc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5583b21cc070 0x5583b2583b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:26.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.246+0000 7f635a5fc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5583b233a700 con 0x5583b21ab390 2024-09-21T01:05:26.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.246+0000 7f635a5fc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5583b2474160 con 0x5583b21cc070 2024-09-21T01:05:26.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.246+0000 7f635a5fc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5583b25861b0 con 0x5583b21a31b0 2024-09-21T01:05:26.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.246+0000 7f635a5fc740 10 client.0 _ll_register_callbacks cb 0x5583b248d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:05:26.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.247+0000 7f6351623640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b21ab390 0x5583b25835e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:26.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.247+0000 7f6351623640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b21ab390 0x5583b25835e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39970/0 (socket says 172.21.15.1:39970) 2024-09-21T01:05:26.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.247+0000 7f6351623640 1 -- 172.21.15.1:0/3694933564 learned_addr learned my addr 172.21.15.1:0/3694933564 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:26.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.247+0000 7f6351e24640 1 --2- 172.21.15.1:0/3694933564 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583b21a31b0 0x5583b25830a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:26.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.247+0000 7f6352625640 1 --2- 172.21.15.1:0/3694933564 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5583b21cc070 0x5583b2583b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:26.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.247+0000 7f6351623640 1 -- 172.21.15.1:0/3694933564 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583b21a31b0 msgr2=0x5583b25830a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:26.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.247+0000 7f6351623640 1 --2- 172.21.15.1:0/3694933564 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583b21a31b0 0x5583b25830a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:26.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.247+0000 7f6351623640 1 -- 172.21.15.1:0/3694933564 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5583b21cc070 msgr2=0x5583b2583b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:26.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.247+0000 7f6351623640 1 --2- 172.21.15.1:0/3694933564 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5583b21cc070 0x5583b2583b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:26.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.247+0000 7f6351623640 1 -- 172.21.15.1:0/3694933564 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583b24a1c90 con 0x5583b21ab390 2024-09-21T01:05:26.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.247+0000 7f6351623640 1 --2- 172.21.15.1:0/3694933564 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b21ab390 0x5583b25835e0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f633c0e4b80 tx=0x7f633c0ea380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab8d7b507d0293ee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:26.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.247+0000 7f63357fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:05:26.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.247+0000 7f63357fa640 1 -- 172.21.15.1:0/3694933564 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c021070 con 0x5583b21ab390 2024-09-21T01:05:26.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.247+0000 7f635a5fc740 1 -- 172.21.15.1:0/3694933564 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5583b24ebdf0 con 0x5583b21ab390 2024-09-21T01:05:26.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.247+0000 7f63357fa640 1 -- 172.21.15.1:0/3694933564 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f633c009c30 con 0x5583b21ab390 2024-09-21T01:05:26.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.247+0000 7f63357fa640 1 -- 172.21.15.1:0/3694933564 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f633c0ac610 con 0x5583b21ab390 2024-09-21T01:05:26.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.247+0000 7f635a5fc740 10 client.17463 fetch_fsmap learned FSMap version 41 2024-09-21T01:05:26.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.247+0000 7f635a5fc740 1 -- 172.21.15.1:0/3694933564 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x5583b2591ea0 con 0x5583b21ab390 2024-09-21T01:05:26.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.248+0000 7f63357fa640 1 -- 172.21.15.1:0/3694933564 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5583b24ebdf0 con 0x5583b21ab390 2024-09-21T01:05:26.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.248+0000 7f63357fa640 1 -- 172.21.15.1:0/3694933564 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 41) ==== 8390+0+0 (secure 0 0 0) 0x7f633c0a9110 con 0x5583b21ab390 2024-09-21T01:05:26.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.248+0000 7f635a5fc740 10 client.17463 fetch_fsmap finished waiting for FSMap version 41 2024-09-21T01:05:26.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.248+0000 7f635a5fc740 10 client.17463 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T01:05:26.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.248+0000 7f635a5fc740 20 client.17463 populate_metadata read hostname 'smithi001' 2024-09-21T01:05:26.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.248+0000 7f635a5fc740 1 --2- 172.21.15.1:0/3694933564 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5583b218a9f0 0x5583b2595200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:26.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.248+0000 7f635a5fc740 4 client.17463 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:05:26.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.248+0000 7f635a5fc740 1 -- 172.21.15.1:0/3694933564 --> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5583b24e78a0 con 0x5583b218a9f0 2024-09-21T01:05:26.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.248+0000 7f6351e24640 1 --2- 172.21.15.1:0/3694933564 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5583b218a9f0 0x5583b2595200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:26.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.249+0000 7f63357fa640 10 client.17463 ms_handle_connect on v2:172.21.15.193:6838/1365361177 2024-09-21T01:05:26.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.249+0000 7f6351e24640 1 --2- 172.21.15.1:0/3694933564 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5583b218a9f0 0x5583b2595200 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=89c5c0d384d85080 server_cookie=29357f1e4983c63d in_seq=0 out_seq=0 2024-09-21T01:05:26.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.249+0000 7f63357fa640 1 -- 172.21.15.1:0/3694933564 <== mds.1 v2:172.21.15.193:6838/1365361177 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5583b24e78a0 con 0x5583b218a9f0 2024-09-21T01:05:26.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.250+0000 7f63357fa640 10 client.17463 handle_command_reply: tid=0 2024-09-21T01:05:26.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.250+0000 7f635a5fc740 1 client.17463 shutdown 2024-09-21T01:05:26.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.250+0000 7f635a5fc740 1 -- 172.21.15.1:0/3694933564 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b21ab390 msgr2=0x5583b25835e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:26.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.250+0000 7f635a5fc740 1 --2- 172.21.15.1:0/3694933564 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b21ab390 0x5583b25835e0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f633c0e4b80 tx=0x7f633c0ea380 comp rx=0 tx=0).stop 2024-09-21T01:05:26.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.250+0000 7f635a5fc740 1 -- 172.21.15.1:0/3694933564 shutdown_connections 2024-09-21T01:05:26.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.250+0000 7f635a5fc740 1 --2- 172.21.15.1:0/3694933564 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5583b218a9f0 0x5583b2595200 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:26.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.250+0000 7f635a5fc740 1 --2- 172.21.15.1:0/3694933564 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5583b21cc070 0x5583b2583b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:26.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.250+0000 7f635a5fc740 1 --2- 172.21.15.1:0/3694933564 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b21ab390 0x5583b25835e0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:26.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.250+0000 7f635a5fc740 1 --2- 172.21.15.1:0/3694933564 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583b21a31b0 0x5583b25830a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:26.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.250+0000 7f63357fa640 0 client.17463 ms_handle_reset on v2:172.21.15.193:6838/1365361177 2024-09-21T01:05:26.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.250+0000 7f635a5fc740 1 -- 172.21.15.1:0/3694933564 >> 172.21.15.1:0/3694933564 conn(0x5583b21c0460 msgr2=0x5583b25767f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:26.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.250+0000 7f635a5fc740 1 -- 172.21.15.1:0/3694933564 shutdown_connections 2024-09-21T01:05:26.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.250+0000 7f635a5fc740 1 -- 172.21.15.1:0/3694933564 wait complete. 2024-09-21T01:05:26.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.250+0000 7f635a5fc740 20 client.17463 trim_cache size 0 max 16384 2024-09-21T01:05:26.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.263+0000 7f635a5fc740 1 Processor -- start 2024-09-21T01:05:26.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.263+0000 7f635a5fc740 1 -- start start 2024-09-21T01:05:26.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.264+0000 7f635a5fc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583b21a31b0 0x5583b2584f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:26.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.264+0000 7f635a5fc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b21ab390 0x5583b2574de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:26.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.264+0000 7f635a5fc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5583b21cc070 0x5583b2580290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:26.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.264+0000 7f635a5fc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f634c1ad300 con 0x5583b21ab390 2024-09-21T01:05:26.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.264+0000 7f635a5fc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f634c1aef60 con 0x5583b21cc070 2024-09-21T01:05:26.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.264+0000 7f635a5fc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f634c1ada00 con 0x5583b21a31b0 2024-09-21T01:05:26.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.264+0000 7f6351623640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b21ab390 0x5583b2574de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:26.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.264+0000 7f6351623640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b21ab390 0x5583b2574de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39984/0 (socket says 172.21.15.1:39984) 2024-09-21T01:05:26.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.264+0000 7f6351623640 1 -- 172.21.15.1:0/3921788696 learned_addr learned my addr 172.21.15.1:0/3921788696 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:26.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.264+0000 7f6352625640 1 --2- 172.21.15.1:0/3921788696 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5583b21cc070 0x5583b2580290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:26.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.264+0000 7f6351e24640 1 --2- 172.21.15.1:0/3921788696 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583b21a31b0 0x5583b2584f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:26.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.264+0000 7f6351623640 1 -- 172.21.15.1:0/3921788696 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583b21a31b0 msgr2=0x5583b2584f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:26.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.264+0000 7f6351623640 1 --2- 172.21.15.1:0/3921788696 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583b21a31b0 0x5583b2584f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:26.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.264+0000 7f6351623640 1 -- 172.21.15.1:0/3921788696 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5583b21cc070 msgr2=0x5583b2580290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:26.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.264+0000 7f6351623640 1 --2- 172.21.15.1:0/3921788696 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5583b21cc070 0x5583b2580290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:26.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.264+0000 7f6351623640 1 -- 172.21.15.1:0/3921788696 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583b25815a0 con 0x5583b21ab390 2024-09-21T01:05:26.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.264+0000 7f6351623640 1 --2- 172.21.15.1:0/3921788696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b21ab390 0x5583b2574de0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f633c009610 tx=0x7f633c0e4860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c91971d3269d3ec2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:26.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.264+0000 7f63377fe640 1 -- 172.21.15.1:0/3921788696 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c021070 con 0x5583b21ab390 2024-09-21T01:05:26.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.264+0000 7f63377fe640 1 -- 172.21.15.1:0/3921788696 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f633c0ad5a0 con 0x5583b21ab390 2024-09-21T01:05:26.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.264+0000 7f63377fe640 1 -- 172.21.15.1:0/3921788696 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c009c30 con 0x5583b21ab390 2024-09-21T01:05:26.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.265+0000 7f635a5fc740 1 -- 172.21.15.1:0/3921788696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b21ab390 msgr2=0x5583b2574de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:26.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.265+0000 7f635a5fc740 1 --2- 172.21.15.1:0/3921788696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b21ab390 0x5583b2574de0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f633c009610 tx=0x7f633c0e4860 comp rx=0 tx=0).stop 2024-09-21T01:05:26.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.265+0000 7f635a5fc740 1 -- 172.21.15.1:0/3921788696 shutdown_connections 2024-09-21T01:05:26.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.265+0000 7f635a5fc740 1 --2- 172.21.15.1:0/3921788696 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5583b21cc070 0x5583b2580290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:26.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.265+0000 7f635a5fc740 1 --2- 172.21.15.1:0/3921788696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b21ab390 0x5583b2574de0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:26.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.265+0000 7f635a5fc740 1 --2- 172.21.15.1:0/3921788696 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583b21a31b0 0x5583b2584f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:26.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.265+0000 7f635a5fc740 1 -- 172.21.15.1:0/3921788696 >> 172.21.15.1:0/3921788696 conn(0x5583b21c0460 msgr2=0x5583b25746d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:26.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.265+0000 7f635a5fc740 1 -- 172.21.15.1:0/3921788696 shutdown_connections 2024-09-21T01:05:26.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.265+0000 7f635a5fc740 1 -- 172.21.15.1:0/3921788696 wait complete. 2024-09-21T01:05:26.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.266+0000 7f635a5fc740 1 -- start start 2024-09-21T01:05:26.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.266+0000 7f635a5fc740 1 Processor -- start 2024-09-21T01:05:26.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.266+0000 7f635a5fc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b21a31b0 0x5583b2598740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:26.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.266+0000 7f635a5fc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5583b21ab390 0x5583b2595c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:26.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.266+0000 7f635a5fc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583b21cc070 0x5583b25961a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:26.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.266+0000 7f635a5fc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f634c1ae7d0 con 0x5583b21a31b0 2024-09-21T01:05:26.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.266+0000 7f635a5fc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f634c1ae0d0 con 0x5583b21ab390 2024-09-21T01:05:26.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.266+0000 7f635a5fc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f634c1ab2e0 con 0x5583b21cc070 2024-09-21T01:05:26.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.266+0000 7f635a5fc740 10 client.0 _ll_register_callbacks cb 0x7f634800b440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:05:26.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.266+0000 7f6351e24640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b21a31b0 0x5583b2598740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:26.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.266+0000 7f6351e24640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b21a31b0 0x5583b2598740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39986/0 (socket says 172.21.15.1:39986) 2024-09-21T01:05:26.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.266+0000 7f6351e24640 1 -- 172.21.15.1:0/380269203 learned_addr learned my addr 172.21.15.1:0/380269203 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:26.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.266+0000 7f6352625640 1 --2- 172.21.15.1:0/380269203 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583b21cc070 0x5583b25961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:26.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.267+0000 7f6351623640 1 --2- 172.21.15.1:0/380269203 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5583b21ab390 0x5583b2595c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:26.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.267+0000 7f6351e24640 1 -- 172.21.15.1:0/380269203 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583b21cc070 msgr2=0x5583b25961a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:26.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.267+0000 7f6351e24640 1 --2- 172.21.15.1:0/380269203 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583b21cc070 0x5583b25961a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:26.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.267+0000 7f6351e24640 1 -- 172.21.15.1:0/380269203 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5583b21ab390 msgr2=0x5583b2595c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:26.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.267+0000 7f6351e24640 1 --2- 172.21.15.1:0/380269203 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5583b21ab390 0x5583b2595c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:26.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.267+0000 7f6351e24640 1 -- 172.21.15.1:0/380269203 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583b25966e0 con 0x5583b21a31b0 2024-09-21T01:05:26.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.267+0000 7f6352625640 1 --2- 172.21.15.1:0/380269203 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583b21cc070 0x5583b25961a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:05:26.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.267+0000 7f6351e24640 1 --2- 172.21.15.1:0/380269203 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b21a31b0 0x5583b2598740 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f6348005fd0 tx=0x7f63480118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dd7486d8a4bfc88 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:26.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.267+0000 7f63357fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:05:26.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.267+0000 7f63357fa640 1 -- 172.21.15.1:0/380269203 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6348028060 con 0x5583b21a31b0 2024-09-21T01:05:26.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.267+0000 7f63357fa640 1 -- 172.21.15.1:0/380269203 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f634801d910 con 0x5583b21a31b0 2024-09-21T01:05:26.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.267+0000 7f635a5fc740 1 -- 172.21.15.1:0/380269203 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f633c0ad5a0 con 0x5583b21a31b0 2024-09-21T01:05:26.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.267+0000 7f63357fa640 1 -- 172.21.15.1:0/380269203 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f634801db10 con 0x5583b21a31b0 2024-09-21T01:05:26.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.267+0000 7f635a5fc740 10 client.17469 fetch_fsmap learned FSMap version 41 2024-09-21T01:05:26.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.267+0000 7f635a5fc740 1 -- 172.21.15.1:0/380269203 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x5583b25ff670 con 0x5583b21a31b0 2024-09-21T01:05:26.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.268+0000 7f63357fa640 1 -- 172.21.15.1:0/380269203 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f633c0ad5a0 con 0x5583b21a31b0 2024-09-21T01:05:26.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.268+0000 7f63357fa640 1 -- 172.21.15.1:0/380269203 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 41) ==== 8390+0+0 (secure 0 0 0) 0x7f634802e400 con 0x5583b21a31b0 2024-09-21T01:05:26.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.268+0000 7f635a5fc740 10 client.17469 fetch_fsmap finished waiting for FSMap version 41 2024-09-21T01:05:26.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.268+0000 7f635a5fc740 10 client.17469 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T01:05:26.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.268+0000 7f635a5fc740 20 client.17469 populate_metadata read hostname 'smithi001' 2024-09-21T01:05:26.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.268+0000 7f635a5fc740 1 --2- 172.21.15.1:0/380269203 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5583b215fda0 0x5583b2601e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:26.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.268+0000 7f635a5fc740 4 client.17469 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:05:26.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.268+0000 7f635a5fc740 1 -- 172.21.15.1:0/380269203 --> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5583b24e4cd0 con 0x5583b215fda0 2024-09-21T01:05:26.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.268+0000 7f6351623640 1 --2- 172.21.15.1:0/380269203 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5583b215fda0 0x5583b2601e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:26.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.268+0000 7f63357fa640 10 client.17469 ms_handle_connect on v2:172.21.15.193:6838/1365361177 2024-09-21T01:05:26.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.268+0000 7f6351623640 1 --2- 172.21.15.1:0/380269203 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5583b215fda0 0x5583b2601e90 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=886a4766d1446e99 server_cookie=be0dd6ba84e4518c in_seq=0 out_seq=0 2024-09-21T01:05:26.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.269+0000 7f63357fa640 1 -- 172.21.15.1:0/380269203 <== mds.1 v2:172.21.15.193:6838/1365361177 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5583b24e4cd0 con 0x5583b215fda0 2024-09-21T01:05:26.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.269+0000 7f63357fa640 10 client.17469 handle_command_reply: tid=0 2024-09-21T01:05:26.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.269+0000 7f635a5fc740 1 client.17469 shutdown 2024-09-21T01:05:26.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.269+0000 7f635a5fc740 1 -- 172.21.15.1:0/380269203 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b21a31b0 msgr2=0x5583b2598740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:26.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.269+0000 7f635a5fc740 1 --2- 172.21.15.1:0/380269203 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b21a31b0 0x5583b2598740 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f6348005fd0 tx=0x7f63480118d0 comp rx=0 tx=0).stop 2024-09-21T01:05:26.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.269+0000 7f635a5fc740 1 -- 172.21.15.1:0/380269203 shutdown_connections 2024-09-21T01:05:26.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.269+0000 7f635a5fc740 1 --2- 172.21.15.1:0/380269203 >> [v2:172.21.15.193:6838/1365361177,v1:172.21.15.193:6839/1365361177] conn(0x5583b215fda0 0x5583b2601e90 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:26.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.269+0000 7f635a5fc740 1 --2- 172.21.15.1:0/380269203 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583b21cc070 0x5583b25961a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:26.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.269+0000 7f635a5fc740 1 --2- 172.21.15.1:0/380269203 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5583b21ab390 0x5583b2595c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:26.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.269+0000 7f63357fa640 0 client.17469 ms_handle_reset on v2:172.21.15.193:6838/1365361177 2024-09-21T01:05:26.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.269+0000 7f635a5fc740 1 --2- 172.21.15.1:0/380269203 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b21a31b0 0x5583b2598740 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:26.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.269+0000 7f635a5fc740 1 -- 172.21.15.1:0/380269203 >> 172.21.15.1:0/380269203 conn(0x5583b21c0460 msgr2=0x5583b25835e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:26.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.269+0000 7f635a5fc740 1 -- 172.21.15.1:0/380269203 shutdown_connections 2024-09-21T01:05:26.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.269+0000 7f635a5fc740 1 -- 172.21.15.1:0/380269203 wait complete. 2024-09-21T01:05:26.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.269+0000 7f635a5fc740 20 client.17469 trim_cache size 0 max 16384 2024-09-21T01:05:26.275 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T01:05:26.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.270+0000 7f6354088640 1 -- 172.21.15.1:0/2381735948 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f63380b6510 msgr2=0x7f63380b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:26.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.270+0000 7f6354088640 1 --2- 172.21.15.1:0/2381735948 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f63380b6510 0x7f63380b8a20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6344006010 tx=0x7f63440095c0 comp rx=0 tx=0).stop 2024-09-21T01:05:26.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.270+0000 7f6354088640 1 -- 172.21.15.1:0/2381735948 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f634c1094a0 msgr2=0x7f634c19aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:26.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.270+0000 7f6354088640 1 --2- 172.21.15.1:0/2381735948 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f634c1094a0 0x7f634c19aa20 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f633c00d740 tx=0x7f633c00dc00 comp rx=0 tx=0).stop 2024-09-21T01:05:26.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.270+0000 7f6354088640 1 -- 172.21.15.1:0/2381735948 shutdown_connections 2024-09-21T01:05:26.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.270+0000 7f6354088640 1 --2- 172.21.15.1:0/2381735948 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f634c109df0 0x7f634c19fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:26.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.270+0000 7f6354088640 1 --2- 172.21.15.1:0/2381735948 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f63380b6510 0x7f63380b8a20 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:26.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.270+0000 7f6354088640 1 --2- 172.21.15.1:0/2381735948 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f634c1094a0 0x7f634c19aa20 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:26.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.270+0000 7f6354088640 1 --2- 172.21.15.1:0/2381735948 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f634c103b60 0x7f634c19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:26.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.270+0000 7f6354088640 1 -- 172.21.15.1:0/2381735948 >> 172.21.15.1:0/2381735948 conn(0x7f634c07b850 msgr2=0x7f634c105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:26.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.270+0000 7f6354088640 1 -- 172.21.15.1:0/2381735948 shutdown_connections 2024-09-21T01:05:26.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:26.270+0000 7f6354088640 1 -- 172.21.15.1:0/2381735948 wait complete. 2024-09-21T01:05:26.952 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T01:05:27.208 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:27.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.698+0000 7f844b364640 1 -- 172.21.15.1:0/2008279548 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8444108d00 msgr2=0x7f844410f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:27.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.698+0000 7f844b364640 1 --2- 172.21.15.1:0/2008279548 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8444108d00 0x7f844410f530 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f843c009ca0 tx=0x7f843c02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:05:27.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.698+0000 7f844b364640 1 -- 172.21.15.1:0/2008279548 shutdown_connections 2024-09-21T01:05:27.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.698+0000 7f844b364640 1 --2- 172.21.15.1:0/2008279548 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8444108d00 0x7f844410f530 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:27.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.698+0000 7f844b364640 1 --2- 172.21.15.1:0/2008279548 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84441083b0 0x7f84441087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:27.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.698+0000 7f844b364640 1 --2- 172.21.15.1:0/2008279548 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8444102a70 0x7f8444102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:27.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.698+0000 7f844b364640 1 -- 172.21.15.1:0/2008279548 >> 172.21.15.1:0/2008279548 conn(0x7f8444079730 msgr2=0x7f8444079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:27.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.698+0000 7f844b364640 1 -- 172.21.15.1:0/2008279548 shutdown_connections 2024-09-21T01:05:27.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.698+0000 7f844b364640 1 -- 172.21.15.1:0/2008279548 wait complete. 2024-09-21T01:05:27.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.699+0000 7f844b364640 1 Processor -- start 2024-09-21T01:05:27.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.699+0000 7f844b364640 1 -- start start 2024-09-21T01:05:27.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.699+0000 7f844b364640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8444102a70 0x7f844419a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.699+0000 7f844b364640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84441083b0 0x7f844419aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.699+0000 7f844b364640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8444108d00 0x7f844419fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.699+0000 7f844b364640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8444113a90 con 0x7f8444108d00 2024-09-21T01:05:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.699+0000 7f844b364640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8444113910 con 0x7f84441083b0 2024-09-21T01:05:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.699+0000 7f844b364640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8444113c10 con 0x7f8444102a70 2024-09-21T01:05:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.699+0000 7f8449901640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8444108d00 0x7f844419fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.699+0000 7f8449901640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8444108d00 0x7f844419fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40010/0 (socket says 172.21.15.1:40010) 2024-09-21T01:05:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.699+0000 7f8449901640 1 -- 172.21.15.1:0/1315499433 learned_addr learned my addr 172.21.15.1:0/1315499433 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.699+0000 7f8449100640 1 --2- 172.21.15.1:0/1315499433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8444102a70 0x7f844419a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.699+0000 7f84488ff640 1 --2- 172.21.15.1:0/1315499433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84441083b0 0x7f844419aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.699+0000 7f8449901640 1 -- 172.21.15.1:0/1315499433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8444102a70 msgr2=0x7f844419a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.699+0000 7f8449901640 1 --2- 172.21.15.1:0/1315499433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8444102a70 0x7f844419a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.699+0000 7f8449901640 1 -- 172.21.15.1:0/1315499433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84441083b0 msgr2=0x7f844419aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.699+0000 7f8449901640 1 --2- 172.21.15.1:0/1315499433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84441083b0 0x7f844419aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.699+0000 7f8449901640 1 -- 172.21.15.1:0/1315499433 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84441a0490 con 0x7f8444108d00 2024-09-21T01:05:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.700+0000 7f8449901640 1 --2- 172.21.15.1:0/1315499433 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8444108d00 0x7f844419fd60 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f843c005cc0 tx=0x7f843c02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.700+0000 7f843a7fc640 1 -- 172.21.15.1:0/1315499433 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843c003bf0 con 0x7f8444108d00 2024-09-21T01:05:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.700+0000 7f844b364640 1 -- 172.21.15.1:0/1315499433 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84441a0720 con 0x7f8444108d00 2024-09-21T01:05:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.700+0000 7f843a7fc640 1 -- 172.21.15.1:0/1315499433 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f843c003d90 con 0x7f8444108d00 2024-09-21T01:05:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.700+0000 7f843a7fc640 1 -- 172.21.15.1:0/1315499433 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843c02fbc0 con 0x7f8444108d00 2024-09-21T01:05:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.700+0000 7f844b364640 1 -- 172.21.15.1:0/1315499433 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84441a6ee0 con 0x7f8444108d00 2024-09-21T01:05:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.703+0000 7f84518d8740 1 Processor -- start 2024-09-21T01:05:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.703+0000 7f843a7fc640 1 -- 172.21.15.1:0/1315499433 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f843c02fd60 con 0x7f8444108d00 2024-09-21T01:05:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.703+0000 7f84518d8740 1 -- start start 2024-09-21T01:05:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.703+0000 7f84518d8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c70f56070 0x562c712fd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.704+0000 7f84518d8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c70f2d1b0 0x562c712fdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.704+0000 7f84518d8740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c70f35390 0x562c712fe120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.704+0000 7f84518d8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562c71273ea0 con 0x562c70f56070 2024-09-21T01:05:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.704+0000 7f84518d8740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562c712632d0 con 0x562c70f35390 2024-09-21T01:05:27.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.704+0000 7f84518d8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x562c712670e0 con 0x562c70f2d1b0 2024-09-21T01:05:27.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.704+0000 7f84488ff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c70f56070 0x562c712fd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:27.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.704+0000 7f8449100640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c70f2d1b0 0x562c712fdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:27.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.704+0000 7f84488ff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c70f56070 0x562c712fd6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40022/0 (socket says 172.21.15.1:40022) 2024-09-21T01:05:27.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.704+0000 7f84488ff640 1 -- 172.21.15.1:0/3177895362 learned_addr learned my addr 172.21.15.1:0/3177895362 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:27.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.704+0000 7f84488ff640 1 --2- 172.21.15.1:0/3177895362 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c70f35390 0x562c712fe120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:27.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.704+0000 7f8449100640 1 -- 172.21.15.1:0/3177895362 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c70f35390 msgr2=0x562c712fe120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:27.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.704+0000 7f843a7fc640 1 --2- 172.21.15.1:0/1315499433 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f84300b6510 0x7f84300b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:27.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.704+0000 7f8449100640 1 --2- 172.21.15.1:0/3177895362 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c70f35390 0x562c712fe120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:27.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.704+0000 7f8449100640 1 -- 172.21.15.1:0/3177895362 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c70f56070 msgr2=0x562c712fd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:27.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.704+0000 7f8449100640 1 --2- 172.21.15.1:0/3177895362 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c70f56070 0x562c712fd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:27.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.704+0000 7f8449100640 1 -- 172.21.15.1:0/3177895362 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c70fc1650 con 0x562c70f2d1b0 2024-09-21T01:05:27.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.704+0000 7f84488ff640 1 --2- 172.21.15.1:0/3177895362 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c70f35390 0x562c712fe120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:05:27.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.704+0000 7f8449901640 1 --2- 172.21.15.1:0/1315499433 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f84300b6510 0x7f84300b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:27.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.704+0000 7f8449100640 1 --2- 172.21.15.1:0/3177895362 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c70f2d1b0 0x562c712fdbe0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f844000b690 tx=0x7f844000bb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd5580ee3bb4c3f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:27.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.704+0000 7f843a7fc640 1 -- 172.21.15.1:0/1315499433 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f843c1088f0 con 0x7f8444108d00 2024-09-21T01:05:27.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.705+0000 7f842f7fe640 1 -- 172.21.15.1:0/3177895362 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8440003bd0 con 0x562c70f2d1b0 2024-09-21T01:05:27.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.705+0000 7f842f7fe640 1 -- 172.21.15.1:0/3177895362 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8440015070 con 0x562c70f2d1b0 2024-09-21T01:05:27.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.705+0000 7f842f7fe640 1 -- 172.21.15.1:0/3177895362 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8440004cd0 con 0x562c70f2d1b0 2024-09-21T01:05:27.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.705+0000 7f84518d8740 1 -- 172.21.15.1:0/3177895362 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c70f2d1b0 msgr2=0x562c712fdbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:27.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.705+0000 7f8449901640 1 --2- 172.21.15.1:0/1315499433 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f84300b6510 0x7f84300b8a20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f843c106740 tx=0x7f843c0930a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:27.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.705+0000 7f84518d8740 1 --2- 172.21.15.1:0/3177895362 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c70f2d1b0 0x562c712fdbe0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f844000b690 tx=0x7f844000bb50 comp rx=0 tx=0).stop 2024-09-21T01:05:27.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.706+0000 7f84518d8740 1 -- 172.21.15.1:0/3177895362 shutdown_connections 2024-09-21T01:05:27.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.706+0000 7f84518d8740 1 --2- 172.21.15.1:0/3177895362 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c70f35390 0x562c712fe120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:27.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.706+0000 7f84518d8740 1 --2- 172.21.15.1:0/3177895362 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c70f2d1b0 0x562c712fdbe0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:27.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.706+0000 7f84518d8740 1 --2- 172.21.15.1:0/3177895362 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c70f56070 0x562c712fd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:27.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.706+0000 7f84518d8740 1 -- 172.21.15.1:0/3177895362 >> 172.21.15.1:0/3177895362 conn(0x562c70f4a460 msgr2=0x562c712fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:27.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.706+0000 7f84518d8740 1 -- 172.21.15.1:0/3177895362 shutdown_connections 2024-09-21T01:05:27.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.706+0000 7f84518d8740 1 -- 172.21.15.1:0/3177895362 wait complete. 2024-09-21T01:05:27.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.706+0000 7f84518d8740 1 -- start start 2024-09-21T01:05:27.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.706+0000 7f84518d8740 1 Processor -- start 2024-09-21T01:05:27.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.707+0000 7f84518d8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c70f2d1b0 0x562c7130d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:27.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.707+0000 7f84518d8740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c70f35390 0x562c7130d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:27.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.707+0000 7f84518d8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c70f56070 0x562c713194e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:27.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.707+0000 7f84518d8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562c710c4700 con 0x562c70f56070 2024-09-21T01:05:27.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.707+0000 7f84518d8740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562c711fe160 con 0x562c70f35390 2024-09-21T01:05:27.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.707+0000 7f84518d8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x562c713101b0 con 0x562c70f2d1b0 2024-09-21T01:05:27.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.707+0000 7f84518d8740 10 client.0 _ll_register_callbacks cb 0x562c712179e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:05:27.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.707+0000 7f84488ff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c70f2d1b0 0x562c7130d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:27.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.707+0000 7f84488ff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c70f2d1b0 0x562c7130d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.1:42324/0 (socket says 172.21.15.1:42324) 2024-09-21T01:05:27.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.707+0000 7f84488ff640 1 -- 172.21.15.1:0/1731251684 learned_addr learned my addr 172.21.15.1:0/1731251684 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:27.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.707+0000 7f84488ff640 1 --2- 172.21.15.1:0/1731251684 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c70f56070 0x562c713194e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:27.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.707+0000 7f8449100640 1 --2- 172.21.15.1:0/1731251684 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c70f35390 0x562c7130d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:27.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.707+0000 7f84488ff640 1 -- 172.21.15.1:0/1731251684 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c70f35390 msgr2=0x562c7130d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:27.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.707+0000 7f84488ff640 1 --2- 172.21.15.1:0/1731251684 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c70f35390 0x562c7130d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:27.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.707+0000 7f84488ff640 1 -- 172.21.15.1:0/1731251684 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c70f56070 msgr2=0x562c713194e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:27.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.707+0000 7f84488ff640 1 --2- 172.21.15.1:0/1731251684 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c70f56070 0x562c713194e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:27.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.707+0000 7f84488ff640 1 -- 172.21.15.1:0/1731251684 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c7122bc90 con 0x562c70f2d1b0 2024-09-21T01:05:27.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.707+0000 7f84488ff640 1 --2- 172.21.15.1:0/1731251684 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c70f2d1b0 0x562c7130d150 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8434013a50 tx=0x7f843400b3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a221eb9db9626786 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:27.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.707+0000 7f842cff9640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-21T01:05:27.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.707+0000 7f842cff9640 1 -- 172.21.15.1:0/1731251684 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84340119c0 con 0x562c70f2d1b0 2024-09-21T01:05:27.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.708+0000 7f842cff9640 1 -- 172.21.15.1:0/1731251684 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f8434011b60 con 0x562c70f2d1b0 2024-09-21T01:05:27.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.708+0000 7f84518d8740 1 -- 172.21.15.1:0/1731251684 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8440015070 con 0x562c70f2d1b0 2024-09-21T01:05:27.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.708+0000 7f842cff9640 1 -- 172.21.15.1:0/1731251684 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f8434011d60 con 0x562c70f2d1b0 2024-09-21T01:05:27.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.708+0000 7f84518d8740 10 client.26989 fetch_fsmap learned FSMap version 42 2024-09-21T01:05:27.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.708+0000 7f84518d8740 1 -- 172.21.15.1:0/1731251684 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x562c7131beb0 con 0x562c70f2d1b0 2024-09-21T01:05:27.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.708+0000 7f842cff9640 1 -- 172.21.15.1:0/1731251684 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8440015070 con 0x562c70f2d1b0 2024-09-21T01:05:27.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.708+0000 7f842cff9640 1 -- 172.21.15.1:0/1731251684 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 42) ==== 8394+0+0 (secure 0 0 0) 0x7f843401f020 con 0x562c70f2d1b0 2024-09-21T01:05:27.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.708+0000 7f84518d8740 10 client.26989 fetch_fsmap finished waiting for FSMap version 42 2024-09-21T01:05:27.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.708+0000 7f84518d8740 10 client.26989 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:05:27.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.708+0000 7f84518d8740 20 client.26989 populate_metadata read hostname 'smithi001' 2024-09-21T01:05:27.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.708+0000 7f84518d8740 1 --2- 172.21.15.1:0/1731251684 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x562c70f149f0 0x562c7131f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:27.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.708+0000 7f84518d8740 4 client.26989 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:05:27.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.708+0000 7f84518d8740 1 -- 172.21.15.1:0/1731251684 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c71275df0 con 0x562c70f149f0 2024-09-21T01:05:27.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.708+0000 7f8449100640 1 --2- 172.21.15.1:0/1731251684 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x562c70f149f0 0x562c7131f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:27.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.709+0000 7f842cff9640 10 client.26989 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:05:27.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.709+0000 7f8449100640 1 --2- 172.21.15.1:0/1731251684 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x562c70f149f0 0x562c7131f3e0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52c7a7c0988f5aa7 server_cookie=10070493b95f1f3a in_seq=0 out_seq=0 2024-09-21T01:05:27.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.710+0000 7f842cff9640 1 -- 172.21.15.1:0/1731251684 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562c71275df0 con 0x562c70f149f0 2024-09-21T01:05:27.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.710+0000 7f842cff9640 10 client.26989 handle_command_reply: tid=0 2024-09-21T01:05:27.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.710+0000 7f84518d8740 1 client.26989 shutdown 2024-09-21T01:05:27.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.710+0000 7f84518d8740 1 -- 172.21.15.1:0/1731251684 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c70f2d1b0 msgr2=0x562c7130d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:27.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.710+0000 7f84518d8740 1 --2- 172.21.15.1:0/1731251684 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c70f2d1b0 0x562c7130d150 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8434013a50 tx=0x7f843400b3a0 comp rx=0 tx=0).stop 2024-09-21T01:05:27.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.710+0000 7f84518d8740 1 -- 172.21.15.1:0/1731251684 shutdown_connections 2024-09-21T01:05:27.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.710+0000 7f84518d8740 1 --2- 172.21.15.1:0/1731251684 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x562c70f149f0 0x562c7131f3e0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:27.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.710+0000 7f84518d8740 1 --2- 172.21.15.1:0/1731251684 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c70f56070 0x562c713194e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:27.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.710+0000 7f84518d8740 1 --2- 172.21.15.1:0/1731251684 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c70f35390 0x562c7130d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:27.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.710+0000 7f842cff9640 0 client.26989 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:05:27.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.710+0000 7f84518d8740 1 --2- 172.21.15.1:0/1731251684 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c70f2d1b0 0x562c7130d150 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:27.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.710+0000 7f84518d8740 1 -- 172.21.15.1:0/1731251684 >> 172.21.15.1:0/1731251684 conn(0x562c70f4a460 msgr2=0x562c71300830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:27.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.710+0000 7f84518d8740 1 -- 172.21.15.1:0/1731251684 shutdown_connections 2024-09-21T01:05:27.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.710+0000 7f84518d8740 1 -- 172.21.15.1:0/1731251684 wait complete. 2024-09-21T01:05:27.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.710+0000 7f84518d8740 20 client.26989 trim_cache size 0 max 16384 2024-09-21T01:05:27.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.724+0000 7f84518d8740 1 Processor -- start 2024-09-21T01:05:27.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.724+0000 7f84518d8740 1 -- start start 2024-09-21T01:05:27.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.724+0000 7f84518d8740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c70f2d1b0 0x562c7130d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:27.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.724+0000 7f84518d8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c70f35390 0x562c712fabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:27.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.724+0000 7f84518d8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c70f56070 0x562c712fb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:27.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.724+0000 7f84518d8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f84441ad260 con 0x562c70f56070 2024-09-21T01:05:27.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.724+0000 7f84518d8740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f84441aeef0 con 0x562c70f2d1b0 2024-09-21T01:05:27.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.724+0000 7f84518d8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f84441ad960 con 0x562c70f35390 2024-09-21T01:05:27.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.724+0000 7f84488ff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c70f56070 0x562c712fb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:27.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.724+0000 7f84488ff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c70f56070 0x562c712fb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40036/0 (socket says 172.21.15.1:40036) 2024-09-21T01:05:27.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.724+0000 7f84488ff640 1 -- 172.21.15.1:0/1899044050 learned_addr learned my addr 172.21.15.1:0/1899044050 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:27.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.724+0000 7f84488ff640 1 --2- 172.21.15.1:0/1899044050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c70f2d1b0 0x562c7130d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:27.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.724+0000 7f8449100640 1 --2- 172.21.15.1:0/1899044050 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c70f35390 0x562c712fabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:27.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.724+0000 7f84488ff640 1 -- 172.21.15.1:0/1899044050 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c70f35390 msgr2=0x562c712fabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:27.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.724+0000 7f84488ff640 1 --2- 172.21.15.1:0/1899044050 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c70f35390 0x562c712fabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:27.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.724+0000 7f84488ff640 1 -- 172.21.15.1:0/1899044050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c70f2d1b0 msgr2=0x562c7130d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:27.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.724+0000 7f84488ff640 1 --2- 172.21.15.1:0/1899044050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c70f2d1b0 0x562c7130d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:27.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.724+0000 7f84488ff640 1 -- 172.21.15.1:0/1899044050 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c71301750 con 0x562c70f56070 2024-09-21T01:05:27.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.725+0000 7f84488ff640 1 --2- 172.21.15.1:0/1899044050 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c70f56070 0x562c712fb100 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f8434003b10 tx=0x7f843400b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578df656f41cb1b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:27.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.725+0000 7f842effd640 1 -- 172.21.15.1:0/1899044050 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8434011bc0 con 0x562c70f56070 2024-09-21T01:05:27.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.725+0000 7f842effd640 1 -- 172.21.15.1:0/1899044050 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8434013880 con 0x562c70f56070 2024-09-21T01:05:27.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.725+0000 7f842effd640 1 -- 172.21.15.1:0/1899044050 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84340046c0 con 0x562c70f56070 2024-09-21T01:05:27.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.726+0000 7f84518d8740 1 -- 172.21.15.1:0/1899044050 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c70f56070 msgr2=0x562c712fb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:27.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.726+0000 7f84518d8740 1 --2- 172.21.15.1:0/1899044050 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c70f56070 0x562c712fb100 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f8434003b10 tx=0x7f843400b600 comp rx=0 tx=0).stop 2024-09-21T01:05:27.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.726+0000 7f84518d8740 1 -- 172.21.15.1:0/1899044050 shutdown_connections 2024-09-21T01:05:27.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.726+0000 7f84518d8740 1 --2- 172.21.15.1:0/1899044050 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c70f56070 0x562c712fb100 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:27.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.726+0000 7f84518d8740 1 --2- 172.21.15.1:0/1899044050 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c70f35390 0x562c712fabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:27.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.726+0000 7f84518d8740 1 --2- 172.21.15.1:0/1899044050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c70f2d1b0 0x562c7130d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:27.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.726+0000 7f84518d8740 1 -- 172.21.15.1:0/1899044050 >> 172.21.15.1:0/1899044050 conn(0x562c70f4a460 msgr2=0x562c7130cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:27.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.726+0000 7f84518d8740 1 -- 172.21.15.1:0/1899044050 shutdown_connections 2024-09-21T01:05:27.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.726+0000 7f84518d8740 1 -- 172.21.15.1:0/1899044050 wait complete. 2024-09-21T01:05:27.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.726+0000 7f84518d8740 1 -- start start 2024-09-21T01:05:27.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.726+0000 7f84518d8740 1 Processor -- start 2024-09-21T01:05:27.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.727+0000 7f84518d8740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c70f2d1b0 0x562c71315e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:27.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.727+0000 7f84518d8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c70f35390 0x562c71311370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:27.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.727+0000 7f84518d8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c70f56070 0x562c71311a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:27.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.727+0000 7f84518d8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f84441ae760 con 0x562c70f56070 2024-09-21T01:05:27.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.727+0000 7f84518d8740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f84441ae060 con 0x562c70f2d1b0 2024-09-21T01:05:27.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.727+0000 7f84518d8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f84441ab240 con 0x562c70f35390 2024-09-21T01:05:27.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.727+0000 7f84518d8740 10 client.0 _ll_register_callbacks cb 0x7f843400bbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:05:27.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.727+0000 7f84488ff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c70f56070 0x562c71311a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:27.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.727+0000 7f84488ff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c70f56070 0x562c71311a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40040/0 (socket says 172.21.15.1:40040) 2024-09-21T01:05:27.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.727+0000 7f84488ff640 1 -- 172.21.15.1:0/1994434552 learned_addr learned my addr 172.21.15.1:0/1994434552 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:27.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.727+0000 7f84488ff640 1 --2- 172.21.15.1:0/1994434552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c70f2d1b0 0x562c71315e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:27.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.727+0000 7f8449100640 1 --2- 172.21.15.1:0/1994434552 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c70f35390 0x562c71311370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:27.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.727+0000 7f84488ff640 1 -- 172.21.15.1:0/1994434552 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c70f35390 msgr2=0x562c71311370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:27.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.727+0000 7f84488ff640 1 --2- 172.21.15.1:0/1994434552 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c70f35390 0x562c71311370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:27.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.727+0000 7f84488ff640 1 -- 172.21.15.1:0/1994434552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c70f2d1b0 msgr2=0x562c71315e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:27.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.727+0000 7f84488ff640 1 --2- 172.21.15.1:0/1994434552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c70f2d1b0 0x562c71315e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:27.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.727+0000 7f84488ff640 1 -- 172.21.15.1:0/1994434552 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c71388de0 con 0x562c70f56070 2024-09-21T01:05:27.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.727+0000 7f84488ff640 1 --2- 172.21.15.1:0/1994434552 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c70f56070 0x562c71311a80 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f843400b960 tx=0x7f8434013540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=352fcd4655dd23bc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:27.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.727+0000 7f842cff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-21T01:05:27.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.728+0000 7f842cff9640 1 -- 172.21.15.1:0/1994434552 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8434003d00 con 0x562c70f56070 2024-09-21T01:05:27.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.728+0000 7f842cff9640 1 -- 172.21.15.1:0/1994434552 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f8434003ea0 con 0x562c70f56070 2024-09-21T01:05:27.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.728+0000 7f84518d8740 1 -- 172.21.15.1:0/1994434552 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8434013880 con 0x562c70f56070 2024-09-21T01:05:27.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.728+0000 7f842cff9640 1 -- 172.21.15.1:0/1994434552 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f84340040a0 con 0x562c70f56070 2024-09-21T01:05:27.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.728+0000 7f84518d8740 10 client.17487 fetch_fsmap learned FSMap version 42 2024-09-21T01:05:27.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.728+0000 7f84518d8740 1 -- 172.21.15.1:0/1994434552 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x562c71389f60 con 0x562c70f56070 2024-09-21T01:05:27.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.728+0000 7f842cff9640 1 -- 172.21.15.1:0/1994434552 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8434013880 con 0x562c70f56070 2024-09-21T01:05:27.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.728+0000 7f842cff9640 1 -- 172.21.15.1:0/1994434552 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 42) ==== 8394+0+0 (secure 0 0 0) 0x7f843401f040 con 0x562c70f56070 2024-09-21T01:05:27.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.728+0000 7f84518d8740 10 client.17487 fetch_fsmap finished waiting for FSMap version 42 2024-09-21T01:05:27.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.728+0000 7f84518d8740 10 client.17487 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:05:27.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.728+0000 7f84518d8740 20 client.17487 populate_metadata read hostname 'smithi001' 2024-09-21T01:05:27.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.728+0000 7f84518d8740 1 --2- 172.21.15.1:0/1994434552 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x562c70ee9da0 0x562c7138c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:27.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.728+0000 7f84518d8740 4 client.17487 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:05:27.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.728+0000 7f84518d8740 1 -- 172.21.15.1:0/1994434552 --> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562c712718a0 con 0x562c70ee9da0 2024-09-21T01:05:27.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.729+0000 7f8449100640 1 --2- 172.21.15.1:0/1994434552 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x562c70ee9da0 0x562c7138c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:27.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.729+0000 7f842cff9640 10 client.17487 ms_handle_connect on v2:172.21.15.42:6838/2526476666 2024-09-21T01:05:27.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.729+0000 7f8449100640 1 --2- 172.21.15.1:0/1994434552 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x562c70ee9da0 0x562c7138c6d0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c72d0dd4211cd813 server_cookie=1eee948f06fcc15d in_seq=0 out_seq=0 2024-09-21T01:05:27.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.729+0000 7f842cff9640 1 -- 172.21.15.1:0/1994434552 <== mds.0 v2:172.21.15.42:6838/2526476666 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562c712718a0 con 0x562c70ee9da0 2024-09-21T01:05:27.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.729+0000 7f842cff9640 10 client.17487 handle_command_reply: tid=0 2024-09-21T01:05:27.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.729+0000 7f84518d8740 1 client.17487 shutdown 2024-09-21T01:05:27.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.729+0000 7f84518d8740 1 -- 172.21.15.1:0/1994434552 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c70f56070 msgr2=0x562c71311a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:27.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.729+0000 7f84518d8740 1 --2- 172.21.15.1:0/1994434552 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c70f56070 0x562c71311a80 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f843400b960 tx=0x7f8434013540 comp rx=0 tx=0).stop 2024-09-21T01:05:27.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.729+0000 7f84518d8740 1 -- 172.21.15.1:0/1994434552 shutdown_connections 2024-09-21T01:05:27.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.730+0000 7f84518d8740 1 --2- 172.21.15.1:0/1994434552 >> [v2:172.21.15.42:6838/2526476666,v1:172.21.15.42:6839/2526476666] conn(0x562c70ee9da0 0x562c7138c6d0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:27.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.730+0000 7f84518d8740 1 --2- 172.21.15.1:0/1994434552 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c70f56070 0x562c71311a80 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:27.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.730+0000 7f84518d8740 1 --2- 172.21.15.1:0/1994434552 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c70f35390 0x562c71311370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:27.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.730+0000 7f84518d8740 1 --2- 172.21.15.1:0/1994434552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c70f2d1b0 0x562c71315e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:27.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.730+0000 7f84518d8740 1 -- 172.21.15.1:0/1994434552 >> 172.21.15.1:0/1994434552 conn(0x562c70f4a460 msgr2=0x562c71300740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:27.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.730+0000 7f842cff9640 0 client.17487 ms_handle_reset on v2:172.21.15.42:6838/2526476666 2024-09-21T01:05:27.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.730+0000 7f84518d8740 1 -- 172.21.15.1:0/1994434552 shutdown_connections 2024-09-21T01:05:27.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.730+0000 7f84518d8740 1 -- 172.21.15.1:0/1994434552 wait complete. 2024-09-21T01:05:27.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.730+0000 7f84518d8740 20 client.17487 trim_cache size 0 max 16384 2024-09-21T01:05:27.735 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-21T01:05:27.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.730+0000 7f844b364640 1 -- 172.21.15.1:0/1315499433 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f84300b6510 msgr2=0x7f84300b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:27.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.730+0000 7f844b364640 1 --2- 172.21.15.1:0/1315499433 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f84300b6510 0x7f84300b8a20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f843c106740 tx=0x7f843c0930a0 comp rx=0 tx=0).stop 2024-09-21T01:05:27.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.730+0000 7f844b364640 1 -- 172.21.15.1:0/1315499433 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8444108d00 msgr2=0x7f844419fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:27.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.730+0000 7f844b364640 1 --2- 172.21.15.1:0/1315499433 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8444108d00 0x7f844419fd60 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f843c005cc0 tx=0x7f843c02f380 comp rx=0 tx=0).stop 2024-09-21T01:05:27.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.730+0000 7f844b364640 1 -- 172.21.15.1:0/1315499433 shutdown_connections 2024-09-21T01:05:27.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.730+0000 7f844b364640 1 --2- 172.21.15.1:0/1315499433 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f84300b6510 0x7f84300b8a20 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:27.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.730+0000 7f844b364640 1 --2- 172.21.15.1:0/1315499433 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8444108d00 0x7f844419fd60 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:27.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.730+0000 7f844b364640 1 --2- 172.21.15.1:0/1315499433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84441083b0 0x7f844419aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:27.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.730+0000 7f844b364640 1 --2- 172.21.15.1:0/1315499433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8444102a70 0x7f844419a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:27.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.730+0000 7f844b364640 1 -- 172.21.15.1:0/1315499433 >> 172.21.15.1:0/1315499433 conn(0x7f8444079730 msgr2=0x7f84441044e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:27.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.731+0000 7f844b364640 1 -- 172.21.15.1:0/1315499433 shutdown_connections 2024-09-21T01:05:27.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:27.731+0000 7f844b364640 1 -- 172.21.15.1:0/1315499433 wait complete. 2024-09-21T01:05:27.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:27 smithi001 ceph-mon[31211]: pgmap v605: 97 pgs: 97 active+clean; 246 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 398 op/s 2024-09-21T01:05:27.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:27 smithi193 ceph-mon[34660]: pgmap v605: 97 pgs: 97 active+clean; 246 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 398 op/s 2024-09-21T01:05:27.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:27 smithi042 ceph-mon[34481]: pgmap v605: 97 pgs: 97 active+clean; 246 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 398 op/s 2024-09-21T01:05:28.422 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/thrasher.py", line 50, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-21T01:05:28.422 INFO:tasks.fwd_scrub:done joining 2024-09-21T01:05:28.422 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-21T01:05:28.433 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T01:05:28.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.547+0000 7fd884663640 1 -- 172.21.15.1:0/4084736950 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd87c1025b0 msgr2=0x7fd87c102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:28.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.548+0000 7fd884663640 1 --2- 172.21.15.1:0/4084736950 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd87c1025b0 0x7fd87c102a20 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fd878009900 tx=0x7fd87802a410 comp rx=0 tx=0).stop 2024-09-21T01:05:28.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.548+0000 7fd884663640 1 -- 172.21.15.1:0/4084736950 shutdown_connections 2024-09-21T01:05:28.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.548+0000 7fd884663640 1 --2- 172.21.15.1:0/4084736950 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd87c103fd0 0x7fd87c10a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:28.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.548+0000 7fd884663640 1 --2- 172.21.15.1:0/4084736950 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd87c103630 0x7fd87c103a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:28.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.548+0000 7fd884663640 1 --2- 172.21.15.1:0/4084736950 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd87c1025b0 0x7fd87c102a20 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:28.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.548+0000 7fd884663640 1 -- 172.21.15.1:0/4084736950 >> 172.21.15.1:0/4084736950 conn(0x7fd87c0fdf30 msgr2=0x7fd87c1003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:28.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.548+0000 7fd884663640 1 -- 172.21.15.1:0/4084736950 shutdown_connections 2024-09-21T01:05:28.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.548+0000 7fd884663640 1 -- 172.21.15.1:0/4084736950 wait complete. 2024-09-21T01:05:28.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.548+0000 7fd884663640 1 Processor -- start 2024-09-21T01:05:28.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.549+0000 7fd884663640 1 -- start start 2024-09-21T01:05:28.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.549+0000 7fd884663640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd87c1025b0 0x7fd87c06c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:28.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.549+0000 7fd884663640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd87c103630 0x7fd87c19ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:28.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.549+0000 7fd884663640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd87c103fd0 0x7fd87c1a11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:28.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.549+0000 7fd884663640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd87c10e1e0 con 0x7fd87c103630 2024-09-21T01:05:28.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.549+0000 7fd884663640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd87c10e060 con 0x7fd87c1025b0 2024-09-21T01:05:28.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.549+0000 7fd884663640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd87c10e360 con 0x7fd87c103fd0 2024-09-21T01:05:28.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.549+0000 7fd881bfe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd87c103630 0x7fd87c19ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:28.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.549+0000 7fd881bfe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd87c103630 0x7fd87c19ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40050/0 (socket says 172.21.15.1:40050) 2024-09-21T01:05:28.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.549+0000 7fd881bfe640 1 -- 172.21.15.1:0/208353546 learned_addr learned my addr 172.21.15.1:0/208353546 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:28.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.549+0000 7fd882c00640 1 --2- 172.21.15.1:0/208353546 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd87c103fd0 0x7fd87c1a11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:28.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.549+0000 7fd8823ff640 1 --2- 172.21.15.1:0/208353546 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd87c1025b0 0x7fd87c06c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:28.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.549+0000 7fd881bfe640 1 -- 172.21.15.1:0/208353546 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd87c103fd0 msgr2=0x7fd87c1a11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:28.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.549+0000 7fd881bfe640 1 --2- 172.21.15.1:0/208353546 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd87c103fd0 0x7fd87c1a11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:28.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.549+0000 7fd881bfe640 1 -- 172.21.15.1:0/208353546 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd87c1025b0 msgr2=0x7fd87c06c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:28.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.549+0000 7fd881bfe640 1 --2- 172.21.15.1:0/208353546 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd87c1025b0 0x7fd87c06c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:28.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.549+0000 7fd881bfe640 1 -- 172.21.15.1:0/208353546 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd87c1a19c0 con 0x7fd87c103630 2024-09-21T01:05:28.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.549+0000 7fd881bfe640 1 --2- 172.21.15.1:0/208353546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd87c103630 0x7fd87c19ec70 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fd86c00d950 tx=0x7fd86c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:28.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.550+0000 7fd8737fe640 1 -- 172.21.15.1:0/208353546 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86c017070 con 0x7fd87c103630 2024-09-21T01:05:28.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.550+0000 7fd884663640 1 -- 172.21.15.1:0/208353546 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd87c1a1cb0 con 0x7fd87c103630 2024-09-21T01:05:28.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.550+0000 7fd8737fe640 1 -- 172.21.15.1:0/208353546 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd86c009c30 con 0x7fd87c103630 2024-09-21T01:05:28.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.550+0000 7fd8737fe640 1 -- 172.21.15.1:0/208353546 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86c00f620 con 0x7fd87c103630 2024-09-21T01:05:28.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.550+0000 7fd884663640 1 -- 172.21.15.1:0/208353546 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd87c1a21b0 con 0x7fd87c103630 2024-09-21T01:05:28.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.551+0000 7fd884663640 1 -- 172.21.15.1:0/208353546 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd87c109780 con 0x7fd87c103630 2024-09-21T01:05:28.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.552+0000 7fd8737fe640 1 -- 172.21.15.1:0/208353546 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7fd86c010460 con 0x7fd87c103630 2024-09-21T01:05:28.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.553+0000 7fd8737fe640 1 --2- 172.21.15.1:0/208353546 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd8680b6510 0x7fd8680b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:28.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.553+0000 7fd8823ff640 1 --2- 172.21.15.1:0/208353546 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd8680b6510 0x7fd8680b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:28.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.553+0000 7fd8737fe640 1 -- 172.21.15.1:0/208353546 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fd86c0e6f80 con 0x7fd87c103630 2024-09-21T01:05:28.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.554+0000 7fd8823ff640 1 --2- 172.21.15.1:0/208353546 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd8680b6510 0x7fd8680b8a20 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd878031440 tx=0x7fd8780314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:28.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.556+0000 7fd8737fe640 1 -- 172.21.15.1:0/208353546 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd86c0ad7f0 con 0x7fd87c103630 2024-09-21T01:05:28.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.748+0000 7fd884663640 1 -- 172.21.15.1:0/208353546 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd87c02e890 con 0x7fd87c103630 2024-09-21T01:05:28.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.749+0000 7fd8737fe640 1 -- 172.21.15.1:0/208353546 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22720 (secure 0 0 0) 0x7fd86c009de0 con 0x7fd87c103630 2024-09-21T01:05:28.750 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T01:05:28.750 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":75,"fsid":"d3972c20-77b2-11ef-baf5-efdc52797490","created":"2024-09-21T00:46:29.745963+0000","modified":"2024-09-21T00:55:27.629379+0000","last_up_change":"2024-09-21T00:54:07.552837+0000","last_in_change":"2024-09-21T00:53:44.164415+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:50:16.456462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:54:54.305306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:54:56.506872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5bf09a34-4d6e-401c-8cef-29bbe72de68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6803","nonce":4067586847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6805","nonce":4067586847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6809","nonce":4067586847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6807","nonce":4067586847}]},"public_addr":"172.21.15.1:6803/4067586847","cluster_addr":"172.21.15.1:6805/4067586847","heartbeat_back_addr":"172.21.15.1:6809/4067586847","heartbeat_front_addr":"172.21.15.1:6807/4067586847","state":["exists","up"]},{"osd":1,"uuid":"195f9109-ef61-46be-a59a-d72e3a1b5b45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6801","nonce":436964633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6803","nonce":436964633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6807","nonce":436964633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6805","nonce":436964633}]},"public_addr":"172.21.15.42:6801/436964633","cluster_addr":"172.21.15.42:6803/436964633","heartbeat_back_addr":"172.21.15.42:6807/436964633","heartbeat_front_addr":"172.21.15.42:6805/436964633","state":["exists","up"]},{"osd":2,"uuid":"47cf90a7-6db6-464a-84ef-9f509f89a46b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6801","nonce":3495400570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6803","nonce":3495400570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6807","nonce":3495400570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6805","nonce":3495400570}]},"public_addr":"172.21.15.193:6801/3495400570","cluster_addr":"172.21.15.193:6803/3495400570","heartbeat_back_addr":"172.21.15.193:6807/3495400570","heartbeat_front_addr":"172.21.15.193:6805/3495400570","state":["exists","up"]},{"osd":3,"uuid":"a5230a66-3c74-41a7-9353-5650780ed25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6811","nonce":3221661671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6813","nonce":3221661671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6817","nonce":3221661671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6815","nonce":3221661671}]},"public_addr":"172.21.15.1:6811/3221661671","cluster_addr":"172.21.15.1:6813/3221661671","heartbeat_back_addr":"172.21.15.1:6817/3221661671","heartbeat_front_addr":"172.21.15.1:6815/3221661671","state":["exists","up"]},{"osd":4,"uuid":"b0476b9b-3257-46d4-aff7-1f038286ed43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6809","nonce":2066388104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6811","nonce":2066388104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6815","nonce":2066388104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6813","nonce":2066388104}]},"public_addr":"172.21.15.42:6809/2066388104","cluster_addr":"172.21.15.42:6811/2066388104","heartbeat_back_addr":"172.21.15.42:6815/2066388104","heartbeat_front_addr":"172.21.15.42:6813/2066388104","state":["exists","up"]},{"osd":5,"uuid":"96701ced-a55a-4ad9-be62-7f102c00697d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6809","nonce":732336675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6811","nonce":732336675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6815","nonce":732336675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6813","nonce":732336675}]},"public_addr":"172.21.15.193:6809/732336675","cluster_addr":"172.21.15.193:6811/732336675","heartbeat_back_addr":"172.21.15.193:6815/732336675","heartbeat_front_addr":"172.21.15.193:6813/732336675","state":["exists","up"]},{"osd":6,"uuid":"72d76017-e2e3-4118-8316-2c5da01c87b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6819","nonce":3201517067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6821","nonce":3201517067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6825","nonce":3201517067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6823","nonce":3201517067}]},"public_addr":"172.21.15.1:6819/3201517067","cluster_addr":"172.21.15.1:6821/3201517067","heartbeat_back_addr":"172.21.15.1:6825/3201517067","heartbeat_front_addr":"172.21.15.1:6823/3201517067","state":["exists","up"]},{"osd":7,"uuid":"8b239f96-2455-41b6-a905-9ed92078b890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6817","nonce":2124927218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6819","nonce":2124927218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6823","nonce":2124927218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6821","nonce":2124927218}]},"public_addr":"172.21.15.42:6817/2124927218","cluster_addr":"172.21.15.42:6819/2124927218","heartbeat_back_addr":"172.21.15.42:6823/2124927218","heartbeat_front_addr":"172.21.15.42:6821/2124927218","state":["exists","up"]},{"osd":8,"uuid":"8cd93aeb-fe00-4291-9f72-171d01893819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6817","nonce":2277449259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6819","nonce":2277449259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6823","nonce":2277449259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6821","nonce":2277449259}]},"public_addr":"172.21.15.193:6817/2277449259","cluster_addr":"172.21.15.193:6819/2277449259","heartbeat_back_addr":"172.21.15.193:6823/2277449259","heartbeat_front_addr":"172.21.15.193:6821/2277449259","state":["exists","up"]},{"osd":9,"uuid":"9e03e00b-0015-4aa8-adce-0d3352d2ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6827","nonce":1369323215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6829","nonce":1369323215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6833","nonce":1369323215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6831","nonce":1369323215}]},"public_addr":"172.21.15.1:6827/1369323215","cluster_addr":"172.21.15.1:6829/1369323215","heartbeat_back_addr":"172.21.15.1:6833/1369323215","heartbeat_front_addr":"172.21.15.1:6831/1369323215","state":["exists","up"]},{"osd":10,"uuid":"de55a908-b049-4f40-865f-cfa2ae6e461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6825","nonce":3182218295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6827","nonce":3182218295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6831","nonce":3182218295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6829","nonce":3182218295}]},"public_addr":"172.21.15.42:6825/3182218295","cluster_addr":"172.21.15.42:6827/3182218295","heartbeat_back_addr":"172.21.15.42:6831/3182218295","heartbeat_front_addr":"172.21.15.42:6829/3182218295","state":["exists","up"]},{"osd":11,"uuid":"1cac0c39-77aa-460b-92a0-39ed89cd6ce4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6825","nonce":2368815522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6827","nonce":2368815522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6831","nonce":2368815522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6829","nonce":2368815522}]},"public_addr":"172.21.15.193:6825/2368815522","cluster_addr":"172.21.15.193:6827/2368815522","heartbeat_back_addr":"172.21.15.193:6831/2368815522","heartbeat_front_addr":"172.21.15.193:6829/2368815522","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:49:21.491443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:49:47.486846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:50:12.757383+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:50:39.127690+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:05.545277+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:30.617491+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:57.612088+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:24.001953+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:48.447388+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:14.620538+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:40.503576+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:54:05.668236+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6801/59685083":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/309615464":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/1722941514":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/1199175740":"2024-09-22T00:47:25.985486+0000","172.21.15.1:6800/59685083":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/2811453932":"2024-09-22T00:46:58.953779+0000","172.21.15.1:0/3748689057":"2024-09-22T00:46:58.953779+0000","172.21.15.1:0/265697975":"2024-09-22T00:46:58.953779+0000","172.21.15.1:6801/1968786311":"2024-09-22T00:46:58.953779+0000","172.21.15.1:6800/1968786311":"2024-09-22T00:46:58.953779+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:05:28.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.752+0000 7fd884663640 1 -- 172.21.15.1:0/208353546 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd8680b6510 msgr2=0x7fd8680b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:28.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.752+0000 7fd884663640 1 --2- 172.21.15.1:0/208353546 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd8680b6510 0x7fd8680b8a20 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd878031440 tx=0x7fd8780314a0 comp rx=0 tx=0).stop 2024-09-21T01:05:28.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.752+0000 7fd884663640 1 -- 172.21.15.1:0/208353546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd87c103630 msgr2=0x7fd87c19ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:28.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.752+0000 7fd884663640 1 --2- 172.21.15.1:0/208353546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd87c103630 0x7fd87c19ec70 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fd86c00d950 tx=0x7fd86c00de10 comp rx=0 tx=0).stop 2024-09-21T01:05:28.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.752+0000 7fd884663640 1 -- 172.21.15.1:0/208353546 shutdown_connections 2024-09-21T01:05:28.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.752+0000 7fd884663640 1 --2- 172.21.15.1:0/208353546 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd87c103fd0 0x7fd87c1a11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:28.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.752+0000 7fd884663640 1 --2- 172.21.15.1:0/208353546 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd8680b6510 0x7fd8680b8a20 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:28.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.752+0000 7fd884663640 1 --2- 172.21.15.1:0/208353546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd87c103630 0x7fd87c19ec70 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:28.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.752+0000 7fd884663640 1 --2- 172.21.15.1:0/208353546 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd87c1025b0 0x7fd87c06c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:28.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.752+0000 7fd884663640 1 -- 172.21.15.1:0/208353546 >> 172.21.15.1:0/208353546 conn(0x7fd87c0fdf30 msgr2=0x7fd87c106950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:28.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.752+0000 7fd884663640 1 -- 172.21.15.1:0/208353546 shutdown_connections 2024-09-21T01:05:28.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.752+0000 7fd884663640 1 -- 172.21.15.1:0/208353546 wait complete. 2024-09-21T01:05:28.765 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T00:50:16.456462+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T00:54:54.305306+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T00:54:56.506872+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T01:05:28.765 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T01:05:28.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.880+0000 7fc8ab962640 1 -- 172.21.15.1:0/2065855866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8a41025a0 msgr2=0x7fc8a4102a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:28.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.880+0000 7fc8ab962640 1 --2- 172.21.15.1:0/2065855866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8a41025a0 0x7fc8a4102a10 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0009900 tx=0x7fc8a002a410 comp rx=0 tx=0).stop 2024-09-21T01:05:28.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.880+0000 7fc8ab962640 1 -- 172.21.15.1:0/2065855866 shutdown_connections 2024-09-21T01:05:28.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.880+0000 7fc8ab962640 1 --2- 172.21.15.1:0/2065855866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8a4103fc0 0x7fc8a410a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:28.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.880+0000 7fc8ab962640 1 --2- 172.21.15.1:0/2065855866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8a4103620 0x7fc8a4103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:28.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.880+0000 7fc8ab962640 1 --2- 172.21.15.1:0/2065855866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8a41025a0 0x7fc8a4102a10 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:28.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.880+0000 7fc8ab962640 1 -- 172.21.15.1:0/2065855866 >> 172.21.15.1:0/2065855866 conn(0x7fc8a40fdee0 msgr2=0x7fc8a4100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:28.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.880+0000 7fc8ab962640 1 -- 172.21.15.1:0/2065855866 shutdown_connections 2024-09-21T01:05:28.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.881+0000 7fc8ab962640 1 -- 172.21.15.1:0/2065855866 wait complete. 2024-09-21T01:05:28.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.881+0000 7fc8ab962640 1 Processor -- start 2024-09-21T01:05:28.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.881+0000 7fc8ab962640 1 -- start start 2024-09-21T01:05:28.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.881+0000 7fc8ab962640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8a41025a0 0x7fc8a4198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:28.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.881+0000 7fc8ab962640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8a4103620 0x7fc8a41994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:28.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.881+0000 7fc8ab962640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8a4103fc0 0x7fc8a419a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:28.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.881+0000 7fc8ab962640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a410e1f0 con 0x7fc8a4103620 2024-09-21T01:05:28.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.881+0000 7fc8ab962640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a410e070 con 0x7fc8a41025a0 2024-09-21T01:05:28.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.881+0000 7fc8ab962640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a410e370 con 0x7fc8a4103fc0 2024-09-21T01:05:28.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.881+0000 7fc8a8efd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8a4103620 0x7fc8a41994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:28.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.882+0000 7fc8a8efd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8a4103620 0x7fc8a41994b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40068/0 (socket says 172.21.15.1:40068) 2024-09-21T01:05:28.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.882+0000 7fc8a8efd640 1 -- 172.21.15.1:0/2740888458 learned_addr learned my addr 172.21.15.1:0/2740888458 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:28.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.882+0000 7fc8a96fe640 1 --2- 172.21.15.1:0/2740888458 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8a41025a0 0x7fc8a4198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:28.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.882+0000 7fc8a9eff640 1 --2- 172.21.15.1:0/2740888458 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8a4103fc0 0x7fc8a419a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:28.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.882+0000 7fc8a8efd640 1 -- 172.21.15.1:0/2740888458 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8a4103fc0 msgr2=0x7fc8a419a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:28.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.882+0000 7fc8a8efd640 1 --2- 172.21.15.1:0/2740888458 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8a4103fc0 0x7fc8a419a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:28.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.882+0000 7fc8a8efd640 1 -- 172.21.15.1:0/2740888458 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8a41025a0 msgr2=0x7fc8a4198e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:28.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.882+0000 7fc8a8efd640 1 --2- 172.21.15.1:0/2740888458 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8a41025a0 0x7fc8a4198e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:28.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.882+0000 7fc8a8efd640 1 -- 172.21.15.1:0/2740888458 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8a419a880 con 0x7fc8a4103620 2024-09-21T01:05:28.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.882+0000 7fc8a9eff640 1 --2- 172.21.15.1:0/2740888458 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8a4103fc0 0x7fc8a419a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:05:28.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.882+0000 7fc8a8efd640 1 --2- 172.21.15.1:0/2740888458 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8a4103620 0x7fc8a41994b0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fc89800d950 tx=0x7fc89800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:28.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.882+0000 7fc8967fc640 1 -- 172.21.15.1:0/2740888458 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc898017070 con 0x7fc8a4103620 2024-09-21T01:05:28.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.882+0000 7fc8967fc640 1 -- 172.21.15.1:0/2740888458 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc898009c30 con 0x7fc8a4103620 2024-09-21T01:05:28.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.882+0000 7fc8967fc640 1 -- 172.21.15.1:0/2740888458 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc89800f620 con 0x7fc8a4103620 2024-09-21T01:05:28.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.882+0000 7fc8ab962640 1 -- 172.21.15.1:0/2740888458 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8a419ab70 con 0x7fc8a4103620 2024-09-21T01:05:28.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.882+0000 7fc8ab962640 1 -- 172.21.15.1:0/2740888458 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8a41a1260 con 0x7fc8a4103620 2024-09-21T01:05:28.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.883+0000 7fc8ab962640 1 -- 172.21.15.1:0/2740888458 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8a4109770 con 0x7fc8a4103620 2024-09-21T01:05:28.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.885+0000 7fc8967fc640 1 -- 172.21.15.1:0/2740888458 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7fc898010460 con 0x7fc8a4103620 2024-09-21T01:05:28.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.886+0000 7fc8967fc640 1 --2- 172.21.15.1:0/2740888458 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc8900b6510 0x7fc8900b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:28.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.886+0000 7fc8a96fe640 1 --2- 172.21.15.1:0/2740888458 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc8900b6510 0x7fc8900b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:28.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.886+0000 7fc8967fc640 1 -- 172.21.15.1:0/2740888458 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fc8980e6fe0 con 0x7fc8a4103620 2024-09-21T01:05:28.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.886+0000 7fc8a96fe640 1 --2- 172.21.15.1:0/2740888458 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc8900b6510 0x7fc8900b8a20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0000c00 tx=0x7fc8a0031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:28.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:28.889+0000 7fc8967fc640 1 -- 172.21.15.1:0/2740888458 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc8980ad7f0 con 0x7fc8a4103620 2024-09-21T01:05:28.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:28 smithi001 ceph-mon[31211]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:05:28.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:28 smithi193 ceph-mon[34660]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:05:28.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:28 smithi042 ceph-mon[34481]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:05:29.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.076+0000 7fc8ab962640 1 -- 172.21.15.1:0/2740888458 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc8a402e7d0 con 0x7fc8a4103620 2024-09-21T01:05:29.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.077+0000 7fc8967fc640 1 -- 172.21.15.1:0/2740888458 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7fc898009de0 con 0x7fc8a4103620 2024-09-21T01:05:29.078 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2024-09-21T01:05:29.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.079+0000 7fc8ab962640 1 -- 172.21.15.1:0/2740888458 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc8900b6510 msgr2=0x7fc8900b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:29.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.079+0000 7fc8ab962640 1 --2- 172.21.15.1:0/2740888458 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc8900b6510 0x7fc8900b8a20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0000c00 tx=0x7fc8a0031400 comp rx=0 tx=0).stop 2024-09-21T01:05:29.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.079+0000 7fc8ab962640 1 -- 172.21.15.1:0/2740888458 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8a4103620 msgr2=0x7fc8a41994b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:29.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.079+0000 7fc8ab962640 1 --2- 172.21.15.1:0/2740888458 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8a4103620 0x7fc8a41994b0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fc89800d950 tx=0x7fc89800de10 comp rx=0 tx=0).stop 2024-09-21T01:05:29.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.079+0000 7fc8ab962640 1 -- 172.21.15.1:0/2740888458 shutdown_connections 2024-09-21T01:05:29.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.079+0000 7fc8ab962640 1 --2- 172.21.15.1:0/2740888458 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8a4103fc0 0x7fc8a419a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.079+0000 7fc8ab962640 1 --2- 172.21.15.1:0/2740888458 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fc8900b6510 0x7fc8900b8a20 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.079+0000 7fc8ab962640 1 --2- 172.21.15.1:0/2740888458 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8a4103620 0x7fc8a41994b0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.079+0000 7fc8ab962640 1 --2- 172.21.15.1:0/2740888458 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8a41025a0 0x7fc8a4198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.079+0000 7fc8ab962640 1 -- 172.21.15.1:0/2740888458 >> 172.21.15.1:0/2740888458 conn(0x7fc8a40fdee0 msgr2=0x7fc8a4106940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:29.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.079+0000 7fc8ab962640 1 -- 172.21.15.1:0/2740888458 shutdown_connections 2024-09-21T01:05:29.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.079+0000 7fc8ab962640 1 -- 172.21.15.1:0/2740888458 wait complete. 2024-09-21T01:05:29.092 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T01:05:29.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.207+0000 7fdf2538b640 1 -- 172.21.15.1:0/3982178054 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdf201025a0 msgr2=0x7fdf20102a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:29.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.207+0000 7fdf2538b640 1 --2- 172.21.15.1:0/3982178054 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdf201025a0 0x7fdf20102a10 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fdf10009900 tx=0x7fdf1002a410 comp rx=0 tx=0).stop 2024-09-21T01:05:29.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.207+0000 7fdf2538b640 1 -- 172.21.15.1:0/3982178054 shutdown_connections 2024-09-21T01:05:29.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.207+0000 7fdf2538b640 1 --2- 172.21.15.1:0/3982178054 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf20103fc0 0x7fdf2010a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.207+0000 7fdf2538b640 1 --2- 172.21.15.1:0/3982178054 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf20103620 0x7fdf20103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.207+0000 7fdf2538b640 1 --2- 172.21.15.1:0/3982178054 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdf201025a0 0x7fdf20102a10 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.207+0000 7fdf2538b640 1 -- 172.21.15.1:0/3982178054 >> 172.21.15.1:0/3982178054 conn(0x7fdf200fdf00 msgr2=0x7fdf20100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:29.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.207+0000 7fdf2538b640 1 -- 172.21.15.1:0/3982178054 shutdown_connections 2024-09-21T01:05:29.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.207+0000 7fdf2538b640 1 -- 172.21.15.1:0/3982178054 wait complete. 2024-09-21T01:05:29.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.208+0000 7fdf2538b640 1 Processor -- start 2024-09-21T01:05:29.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.208+0000 7fdf2538b640 1 -- start start 2024-09-21T01:05:29.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.208+0000 7fdf2538b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf201025a0 0x7fdf2006c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:29.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.208+0000 7fdf2538b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf20103620 0x7fdf2019ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:29.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.208+0000 7fdf2538b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdf20103fc0 0x7fdf201a1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:29.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.208+0000 7fdf2538b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2010e240 con 0x7fdf20103fc0 2024-09-21T01:05:29.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.208+0000 7fdf2538b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2010e0c0 con 0x7fdf20103620 2024-09-21T01:05:29.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.208+0000 7fdf2538b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2010e3c0 con 0x7fdf201025a0 2024-09-21T01:05:29.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.208+0000 7fdf1f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdf20103fc0 0x7fdf201a1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:29.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.208+0000 7fdf1f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdf20103fc0 0x7fdf201a1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50536/0 (socket says 172.21.15.1:50536) 2024-09-21T01:05:29.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.208+0000 7fdf1f7fe640 1 -- 172.21.15.1:0/41768100 learned_addr learned my addr 172.21.15.1:0/41768100 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:29.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.208+0000 7fdf1effd640 1 --2- 172.21.15.1:0/41768100 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf201025a0 0x7fdf2006c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:29.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.208+0000 7fdf1e7fc640 1 --2- 172.21.15.1:0/41768100 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf20103620 0x7fdf2019ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:29.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.208+0000 7fdf1f7fe640 1 -- 172.21.15.1:0/41768100 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf201025a0 msgr2=0x7fdf2006c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:29.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.208+0000 7fdf1f7fe640 1 --2- 172.21.15.1:0/41768100 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf201025a0 0x7fdf2006c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.208+0000 7fdf1f7fe640 1 -- 172.21.15.1:0/41768100 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf20103620 msgr2=0x7fdf2019ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:29.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.208+0000 7fdf1f7fe640 1 --2- 172.21.15.1:0/41768100 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf20103620 0x7fdf2019ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.209+0000 7fdf1f7fe640 1 -- 172.21.15.1:0/41768100 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf201a1a50 con 0x7fdf20103fc0 2024-09-21T01:05:29.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.209+0000 7fdf1effd640 1 --2- 172.21.15.1:0/41768100 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf201025a0 0x7fdf2006c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:05:29.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.209+0000 7fdf1f7fe640 1 --2- 172.21.15.1:0/41768100 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdf20103fc0 0x7fdf201a1250 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fdf1800b970 tx=0x7fdf1800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:29.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.209+0000 7fdf07fff640 1 -- 172.21.15.1:0/41768100 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf18019070 con 0x7fdf20103fc0 2024-09-21T01:05:29.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.209+0000 7fdf2538b640 1 -- 172.21.15.1:0/41768100 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf201a1d40 con 0x7fdf20103fc0 2024-09-21T01:05:29.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.209+0000 7fdf07fff640 1 -- 172.21.15.1:0/41768100 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf18014440 con 0x7fdf20103fc0 2024-09-21T01:05:29.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.209+0000 7fdf07fff640 1 -- 172.21.15.1:0/41768100 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf180075d0 con 0x7fdf20103fc0 2024-09-21T01:05:29.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.209+0000 7fdf2538b640 1 -- 172.21.15.1:0/41768100 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf201a2200 con 0x7fdf20103fc0 2024-09-21T01:05:29.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.210+0000 7fdf2538b640 1 -- 172.21.15.1:0/41768100 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf20109770 con 0x7fdf20103fc0 2024-09-21T01:05:29.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.211+0000 7fdf07fff640 1 -- 172.21.15.1:0/41768100 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7fdf1801c070 con 0x7fdf20103fc0 2024-09-21T01:05:29.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.212+0000 7fdf07fff640 1 --2- 172.21.15.1:0/41768100 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fdf080b6510 0x7fdf080b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:29.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.212+0000 7fdf07fff640 1 -- 172.21.15.1:0/41768100 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fdf180e6db0 con 0x7fdf20103fc0 2024-09-21T01:05:29.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.212+0000 7fdf1effd640 1 --2- 172.21.15.1:0/41768100 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fdf080b6510 0x7fdf080b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:29.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.213+0000 7fdf1effd640 1 --2- 172.21.15.1:0/41768100 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fdf080b6510 0x7fdf080b8a20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fdf10031440 tx=0x7fdf10005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:29.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.215+0000 7fdf07fff640 1 -- 172.21.15.1:0/41768100 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdf180ad5c0 con 0x7fdf20103fc0 2024-09-21T01:05:29.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.408+0000 7fdf2538b640 1 -- 172.21.15.1:0/41768100 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fdf2002e7d0 con 0x7fdf20103fc0 2024-09-21T01:05:29.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.408+0000 7fdf07fff640 1 -- 172.21.15.1:0/41768100 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) ==== 104+0+11 (secure 0 0 0) 0x7fdf2002e7d0 con 0x7fdf20103fc0 2024-09-21T01:05:29.409 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 32 2024-09-21T01:05:29.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.410+0000 7fdf2538b640 1 -- 172.21.15.1:0/41768100 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fdf080b6510 msgr2=0x7fdf080b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:29.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.410+0000 7fdf2538b640 1 --2- 172.21.15.1:0/41768100 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fdf080b6510 0x7fdf080b8a20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fdf10031440 tx=0x7fdf10005d50 comp rx=0 tx=0).stop 2024-09-21T01:05:29.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.410+0000 7fdf2538b640 1 -- 172.21.15.1:0/41768100 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdf20103fc0 msgr2=0x7fdf201a1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:29.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.410+0000 7fdf2538b640 1 --2- 172.21.15.1:0/41768100 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdf20103fc0 0x7fdf201a1250 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fdf1800b970 tx=0x7fdf1800be30 comp rx=0 tx=0).stop 2024-09-21T01:05:29.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.411+0000 7fdf2538b640 1 -- 172.21.15.1:0/41768100 shutdown_connections 2024-09-21T01:05:29.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.411+0000 7fdf2538b640 1 --2- 172.21.15.1:0/41768100 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fdf080b6510 0x7fdf080b8a20 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.411+0000 7fdf2538b640 1 --2- 172.21.15.1:0/41768100 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdf20103fc0 0x7fdf201a1250 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.411+0000 7fdf2538b640 1 --2- 172.21.15.1:0/41768100 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf20103620 0x7fdf2019ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.411+0000 7fdf2538b640 1 --2- 172.21.15.1:0/41768100 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf201025a0 0x7fdf2006c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.411+0000 7fdf2538b640 1 -- 172.21.15.1:0/41768100 >> 172.21.15.1:0/41768100 conn(0x7fdf200fdf00 msgr2=0x7fdf20106940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:29.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.411+0000 7fdf2538b640 1 -- 172.21.15.1:0/41768100 shutdown_connections 2024-09-21T01:05:29.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.411+0000 7fdf2538b640 1 -- 172.21.15.1:0/41768100 wait complete. 2024-09-21T01:05:29.423 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T01:05:29.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.539+0000 7f11c4da1640 1 -- 172.21.15.1:0/209079110 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11c0103fb0 msgr2=0x7f11c010a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:29.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.539+0000 7f11c4da1640 1 --2- 172.21.15.1:0/209079110 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11c0103fb0 0x7f11c010a950 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f11b8009ca0 tx=0x7f11b802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.539+0000 7f11c4da1640 1 -- 172.21.15.1:0/209079110 shutdown_connections 2024-09-21T01:05:29.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.539+0000 7f11c4da1640 1 --2- 172.21.15.1:0/209079110 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11c0103fb0 0x7f11c010a950 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.539+0000 7f11c4da1640 1 --2- 172.21.15.1:0/209079110 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f11c0103610 0x7f11c0103a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.539+0000 7f11c4da1640 1 --2- 172.21.15.1:0/209079110 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11c0102590 0x7f11c0102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.539+0000 7f11c4da1640 1 -- 172.21.15.1:0/209079110 >> 172.21.15.1:0/209079110 conn(0x7f11c00fded0 msgr2=0x7f11c0100380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:29.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.539+0000 7f11c4da1640 1 -- 172.21.15.1:0/209079110 shutdown_connections 2024-09-21T01:05:29.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.539+0000 7f11c4da1640 1 -- 172.21.15.1:0/209079110 wait complete. 2024-09-21T01:05:29.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.540+0000 7f11c4da1640 1 Processor -- start 2024-09-21T01:05:29.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.540+0000 7f11c4da1640 1 -- start start 2024-09-21T01:05:29.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.540+0000 7f11c4da1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11c0102590 0x7f11c0198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:29.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.540+0000 7f11c4da1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f11c0103610 0x7f11c0199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:29.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.540+0000 7f11c4da1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11c0103fb0 0x7f11c0199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:29.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.540+0000 7f11c4da1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f11c010e1f0 con 0x7f11c0103fb0 2024-09-21T01:05:29.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.540+0000 7f11c4da1640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f11c010e070 con 0x7f11c0102590 2024-09-21T01:05:29.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.540+0000 7f11c4da1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f11c010e370 con 0x7f11c0103610 2024-09-21T01:05:29.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.540+0000 7f11bed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11c0103fb0 0x7f11c0199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:29.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.541+0000 7f11bed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11c0103fb0 0x7f11c0199fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50554/0 (socket says 172.21.15.1:50554) 2024-09-21T01:05:29.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.541+0000 7f11bed9d640 1 -- 172.21.15.1:0/3264594929 learned_addr learned my addr 172.21.15.1:0/3264594929 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:29.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.541+0000 7f11be59c640 1 --2- 172.21.15.1:0/3264594929 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11c0102590 0x7f11c0198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:29.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.541+0000 7f11bdd9b640 1 --2- 172.21.15.1:0/3264594929 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f11c0103610 0x7f11c0199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:29.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.541+0000 7f11bed9d640 1 -- 172.21.15.1:0/3264594929 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f11c0103610 msgr2=0x7f11c0199420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:29.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.541+0000 7f11bed9d640 1 --2- 172.21.15.1:0/3264594929 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f11c0103610 0x7f11c0199420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.541+0000 7f11bed9d640 1 -- 172.21.15.1:0/3264594929 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11c0102590 msgr2=0x7f11c0198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:29.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.541+0000 7f11bed9d640 1 --2- 172.21.15.1:0/3264594929 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11c0102590 0x7f11c0198db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.541+0000 7f11bed9d640 1 -- 172.21.15.1:0/3264594929 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11c019a7f0 con 0x7f11c0103fb0 2024-09-21T01:05:29.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.541+0000 7f11bdd9b640 1 --2- 172.21.15.1:0/3264594929 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f11c0103610 0x7f11c0199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:05:29.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.541+0000 7f11bed9d640 1 --2- 172.21.15.1:0/3264594929 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11c0103fb0 0x7f11c0199fd0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f11b80097b0 tx=0x7f11b8003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:29.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.541+0000 7f11af7fe640 1 -- 172.21.15.1:0/3264594929 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b8004240 con 0x7f11c0103fb0 2024-09-21T01:05:29.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.541+0000 7f11af7fe640 1 -- 172.21.15.1:0/3264594929 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11b802f310 con 0x7f11c0103fb0 2024-09-21T01:05:29.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.541+0000 7f11c4da1640 1 -- 172.21.15.1:0/3264594929 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11c019aa80 con 0x7f11c0103fb0 2024-09-21T01:05:29.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.541+0000 7f11af7fe640 1 -- 172.21.15.1:0/3264594929 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b802fb50 con 0x7f11c0103fb0 2024-09-21T01:05:29.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.541+0000 7f11c4da1640 1 -- 172.21.15.1:0/3264594929 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11c01a11d0 con 0x7f11c0103fb0 2024-09-21T01:05:29.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.542+0000 7f11c4da1640 1 -- 172.21.15.1:0/3264594929 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11c0102a00 con 0x7f11c0103fb0 2024-09-21T01:05:29.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.544+0000 7f11af7fe640 1 -- 172.21.15.1:0/3264594929 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f11b802fd10 con 0x7f11c0103fb0 2024-09-21T01:05:29.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.545+0000 7f11af7fe640 1 --2- 172.21.15.1:0/3264594929 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f11a80b6590 0x7f11a80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:29.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.545+0000 7f11be59c640 1 --2- 172.21.15.1:0/3264594929 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f11a80b6590 0x7f11a80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:29.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.545+0000 7f11af7fe640 1 -- 172.21.15.1:0/3264594929 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f11b8108880 con 0x7f11c0103fb0 2024-09-21T01:05:29.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.546+0000 7f11be59c640 1 --2- 172.21.15.1:0/3264594929 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f11a80b6590 0x7f11a80b8aa0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f11b000bbe0 tx=0x7f11b000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:29.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.549+0000 7f11af7fe640 1 -- 172.21.15.1:0/3264594929 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f11b80cf0f0 con 0x7f11c0103fb0 2024-09-21T01:05:29.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.738+0000 7f11c4da1640 1 -- 172.21.15.1:0/3264594929 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f11c0063fc0 con 0x7f11c0103fb0 2024-09-21T01:05:29.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.738+0000 7f11af7fe640 1 -- 172.21.15.1:0/3264594929 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) ==== 100+0+11 (secure 0 0 0) 0x7f11b80d34d0 con 0x7f11c0103fb0 2024-09-21T01:05:29.739 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2024-09-21T01:05:29.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.740+0000 7f11c4da1640 1 -- 172.21.15.1:0/3264594929 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f11a80b6590 msgr2=0x7f11a80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:29.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.740+0000 7f11c4da1640 1 --2- 172.21.15.1:0/3264594929 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f11a80b6590 0x7f11a80b8aa0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f11b000bbe0 tx=0x7f11b000b390 comp rx=0 tx=0).stop 2024-09-21T01:05:29.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.740+0000 7f11c4da1640 1 -- 172.21.15.1:0/3264594929 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11c0103fb0 msgr2=0x7f11c0199fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:29.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.740+0000 7f11c4da1640 1 --2- 172.21.15.1:0/3264594929 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11c0103fb0 0x7f11c0199fd0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f11b80097b0 tx=0x7f11b8003c20 comp rx=0 tx=0).stop 2024-09-21T01:05:29.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.740+0000 7f11c4da1640 1 -- 172.21.15.1:0/3264594929 shutdown_connections 2024-09-21T01:05:29.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.740+0000 7f11c4da1640 1 --2- 172.21.15.1:0/3264594929 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f11a80b6590 0x7f11a80b8aa0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.740+0000 7f11c4da1640 1 --2- 172.21.15.1:0/3264594929 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11c0103fb0 0x7f11c0199fd0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.740+0000 7f11c4da1640 1 --2- 172.21.15.1:0/3264594929 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f11c0103610 0x7f11c0199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.740+0000 7f11c4da1640 1 --2- 172.21.15.1:0/3264594929 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11c0102590 0x7f11c0198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.740+0000 7f11c4da1640 1 -- 172.21.15.1:0/3264594929 >> 172.21.15.1:0/3264594929 conn(0x7f11c00fded0 msgr2=0x7f11c0106910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:29.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.741+0000 7f11c4da1640 1 -- 172.21.15.1:0/3264594929 shutdown_connections 2024-09-21T01:05:29.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.741+0000 7f11c4da1640 1 -- 172.21.15.1:0/3264594929 wait complete. 2024-09-21T01:05:29.753 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-21T01:05:29.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.865+0000 7f74c352b640 1 -- 172.21.15.1:0/2269405564 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74bc103640 msgr2=0x7f74bc103a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:29.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.865+0000 7f74c352b640 1 --2- 172.21.15.1:0/2269405564 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74bc103640 0x7f74bc103a50 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f74ac009900 tx=0x7f74ac02a410 comp rx=0 tx=0).stop 2024-09-21T01:05:29.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.865+0000 7f74c352b640 1 -- 172.21.15.1:0/2269405564 shutdown_connections 2024-09-21T01:05:29.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.865+0000 7f74c352b640 1 --2- 172.21.15.1:0/2269405564 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74bc103fe0 0x7f74bc10a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.865+0000 7f74c352b640 1 --2- 172.21.15.1:0/2269405564 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74bc103640 0x7f74bc103a50 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.865+0000 7f74c352b640 1 --2- 172.21.15.1:0/2269405564 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74bc1025c0 0x7f74bc102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.865+0000 7f74c352b640 1 -- 172.21.15.1:0/2269405564 >> 172.21.15.1:0/2269405564 conn(0x7f74bc0fdf00 msgr2=0x7f74bc1003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:29.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.865+0000 7f74c352b640 1 -- 172.21.15.1:0/2269405564 shutdown_connections 2024-09-21T01:05:29.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.865+0000 7f74c352b640 1 -- 172.21.15.1:0/2269405564 wait complete. 2024-09-21T01:05:29.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.866+0000 7f74c352b640 1 Processor -- start 2024-09-21T01:05:29.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.866+0000 7f74c352b640 1 -- start start 2024-09-21T01:05:29.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.866+0000 7f74c352b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74bc1025c0 0x7f74bc06b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:29.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.866+0000 7f74c352b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74bc103640 0x7f74bc19ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:29.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.866+0000 7f74c352b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74bc103fe0 0x7f74bc1a11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:29.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.866+0000 7f74c352b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f74bc10e1f0 con 0x7f74bc1025c0 2024-09-21T01:05:29.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.866+0000 7f74c352b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f74bc10e070 con 0x7f74bc103fe0 2024-09-21T01:05:29.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.866+0000 7f74c352b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f74bc10e370 con 0x7f74bc103640 2024-09-21T01:05:29.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.866+0000 7f74c12c7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74bc1025c0 0x7f74bc06b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:29.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.866+0000 7f74c12c7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74bc1025c0 0x7f74bc06b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50568/0 (socket says 172.21.15.1:50568) 2024-09-21T01:05:29.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.866+0000 7f74c12c7640 1 -- 172.21.15.1:0/1715724738 learned_addr learned my addr 172.21.15.1:0/1715724738 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:29.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.866+0000 7f74c12c7640 1 -- 172.21.15.1:0/1715724738 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74bc103640 msgr2=0x7f74bc19ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:29.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.866+0000 7f74c12c7640 1 --2- 172.21.15.1:0/1715724738 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74bc103640 0x7f74bc19ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.866+0000 7f74c1ac8640 1 --2- 172.21.15.1:0/1715724738 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74bc103fe0 0x7f74bc1a11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:29.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.866+0000 7f74c12c7640 1 -- 172.21.15.1:0/1715724738 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74bc103fe0 msgr2=0x7f74bc1a11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:29.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.866+0000 7f74c12c7640 1 --2- 172.21.15.1:0/1715724738 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74bc103fe0 0x7f74bc1a11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.866+0000 7f74c12c7640 1 -- 172.21.15.1:0/1715724738 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74bc1a1970 con 0x7f74bc1025c0 2024-09-21T01:05:29.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.867+0000 7f74c12c7640 1 --2- 172.21.15.1:0/1715724738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74bc1025c0 0x7f74bc06b140 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f74b800e9f0 tx=0x7f74b800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:29.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.867+0000 7f74b27fc640 1 -- 172.21.15.1:0/1715724738 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b800cd80 con 0x7f74bc1025c0 2024-09-21T01:05:29.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.867+0000 7f74c352b640 1 -- 172.21.15.1:0/1715724738 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74bc1a1c60 con 0x7f74bc1025c0 2024-09-21T01:05:29.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.867+0000 7f74b27fc640 1 -- 172.21.15.1:0/1715724738 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74b80108e0 con 0x7f74bc1025c0 2024-09-21T01:05:29.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.867+0000 7f74b27fc640 1 -- 172.21.15.1:0/1715724738 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b8018980 con 0x7f74bc1025c0 2024-09-21T01:05:29.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.867+0000 7f74c352b640 1 -- 172.21.15.1:0/1715724738 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74bc1a21b0 con 0x7f74bc1025c0 2024-09-21T01:05:29.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.868+0000 7f74c352b640 1 -- 172.21.15.1:0/1715724738 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74bc109770 con 0x7f74bc1025c0 2024-09-21T01:05:29.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.870+0000 7f74b27fc640 1 -- 172.21.15.1:0/1715724738 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f74b8010430 con 0x7f74bc1025c0 2024-09-21T01:05:29.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.870+0000 7f74b27fc640 1 --2- 172.21.15.1:0/1715724738 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f74a80b6510 0x7f74a80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:29.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.871+0000 7f74c0ac6640 1 --2- 172.21.15.1:0/1715724738 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f74a80b6510 0x7f74a80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:29.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.871+0000 7f74b27fc640 1 -- 172.21.15.1:0/1715724738 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f74b80e7c60 con 0x7f74bc1025c0 2024-09-21T01:05:29.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.871+0000 7f74c0ac6640 1 --2- 172.21.15.1:0/1715724738 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f74a80b6510 0x7f74a80b8a20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f74ac031500 tx=0x7f74ac031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:29.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:29.874+0000 7f74b27fc640 1 -- 172.21.15.1:0/1715724738 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f74b80ae4d0 con 0x7f74bc1025c0 2024-09-21T01:05:29.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:29 smithi001 ceph-mon[31211]: pgmap v606: 97 pgs: 97 active+clean; 246 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 332 op/s 2024-09-21T01:05:29.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:29 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/208353546' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:05:29.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:29 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/2740888458' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T01:05:29.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:29 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/41768100' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T01:05:29.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:29 smithi193 ceph-mon[34660]: pgmap v606: 97 pgs: 97 active+clean; 246 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 332 op/s 2024-09-21T01:05:29.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:29 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/208353546' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:05:29.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:29 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/2740888458' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T01:05:29.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:29 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/41768100' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T01:05:29.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:29 smithi042 ceph-mon[34481]: pgmap v606: 97 pgs: 97 active+clean; 246 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 332 op/s 2024-09-21T01:05:29.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:29 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/208353546' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:05:29.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:29 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/2740888458' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T01:05:29.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:29 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/41768100' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T01:05:30.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:30.115+0000 7f74c352b640 1 -- 172.21.15.1:0/1715724738 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f74bc02e8a0 con 0x7f74bc1025c0 2024-09-21T01:05:30.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:30.123+0000 7f74b27fc640 1 -- 172.21.15.1:0/1715724738 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v20) ==== 81+0+833513 (secure 0 0 0) 0x7f74b80b28b0 con 0x7f74bc1025c0 2024-09-21T01:05:30.133 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T01:05:30.133 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T01:05:30.134 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 20, 2024-09-21T01:05:30.134 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.134 INFO:teuthology.orchestra.run.smithi001.stdout: "active_gid": 14150, 2024-09-21T01:05:30.134 INFO:teuthology.orchestra.run.smithi001.stdout: "active_name": "x", 2024-09-21T01:05:30.134 INFO:teuthology.orchestra.run.smithi001.stdout: "active_addrs": { 2024-09-21T01:05:30.134 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-21T01:05:30.134 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.134 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-21T01:05:30.134 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:6800", 2024-09-21T01:05:30.134 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2032980330 2024-09-21T01:05:30.134 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.134 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.134 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-21T01:05:30.135 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:6801", 2024-09-21T01:05:30.135 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2032980330 2024-09-21T01:05:30.135 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.135 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-21T01:05:30.135 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.135 INFO:teuthology.orchestra.run.smithi001.stdout: "active_addr": "172.21.15.1:6801/2032980330", 2024-09-21T01:05:30.135 INFO:teuthology.orchestra.run.smithi001.stdout: "active_change": "2024-09-21T00:47:25.985608+0000", 2024-09-21T01:05:30.135 INFO:teuthology.orchestra.run.smithi001.stdout: "active_mgr_features": 4540719139924082687, 2024-09-21T01:05:30.135 INFO:teuthology.orchestra.run.smithi001.stdout: "available": true, 2024-09-21T01:05:30.135 INFO:teuthology.orchestra.run.smithi001.stdout: "standbys": [ 2024-09-21T01:05:30.135 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.135 INFO:teuthology.orchestra.run.smithi001.stdout: "gid": 24127, 2024-09-21T01:05:30.135 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "z", 2024-09-21T01:05:30.135 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_features": 4540719139924082687, 2024-09-21T01:05:30.136 INFO:teuthology.orchestra.run.smithi001.stdout: "available_modules": [ 2024-09-21T01:05:30.136 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.136 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "alerts", 2024-09-21T01:05:30.136 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.136 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.136 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.136 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-21T01:05:30.136 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-21T01:05:30.136 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.136 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.136 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.136 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-21T01:05:30.136 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.136 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.136 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.136 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T01:05:30.137 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.137 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.137 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.137 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.137 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.137 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.137 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.137 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.137 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.137 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.137 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.137 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.137 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.137 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.138 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.138 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.138 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.138 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.138 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.138 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.138 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.138 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.138 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.138 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.138 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.138 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.138 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.138 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.138 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.139 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.139 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.139 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.139 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.139 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.139 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.139 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.139 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.139 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.139 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.139 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.139 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.139 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.139 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.140 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.140 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.140 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.140 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.140 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.140 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.140 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.140 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.140 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.140 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.140 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.140 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.140 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.140 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.140 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.141 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.141 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.141 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.141 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.141 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.141 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.141 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.141 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.141 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.141 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.141 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.141 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.141 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.141 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.141 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.142 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.142 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_destination": { 2024-09-21T01:05:30.142 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_destination", 2024-09-21T01:05:30.142 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.142 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.142 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.142 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.142 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.142 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.142 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.142 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T01:05:30.142 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.142 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.142 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.143 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.143 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_from_name": { 2024-09-21T01:05:30.143 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_from_name", 2024-09-21T01:05:30.143 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.143 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.143 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.143 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "Ceph", 2024-09-21T01:05:30.143 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.143 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.143 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.143 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email From: name", 2024-09-21T01:05:30.143 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.143 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.143 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.143 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.143 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_host": { 2024-09-21T01:05:30.144 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_host", 2024-09-21T01:05:30.144 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.144 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.144 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.144 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.144 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.144 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.144 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.144 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP server", 2024-09-21T01:05:30.144 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.144 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.144 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.144 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.144 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_password": { 2024-09-21T01:05:30.144 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_password", 2024-09-21T01:05:30.145 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.145 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.145 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.145 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.145 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.145 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.145 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.145 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Password to authenticate with", 2024-09-21T01:05:30.145 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.145 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.145 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.145 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.145 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_port": { 2024-09-21T01:05:30.145 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_port", 2024-09-21T01:05:30.145 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.146 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.146 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.146 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "465", 2024-09-21T01:05:30.146 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.146 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.146 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.146 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP port", 2024-09-21T01:05:30.146 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.146 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.146 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.146 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.146 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_sender": { 2024-09-21T01:05:30.146 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_sender", 2024-09-21T01:05:30.146 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.147 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.147 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.147 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.147 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.147 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.147 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.147 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP envelope sender", 2024-09-21T01:05:30.147 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.147 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.147 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.147 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.147 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_ssl": { 2024-09-21T01:05:30.147 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_ssl", 2024-09-21T01:05:30.148 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.148 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.148 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.148 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.148 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.148 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.148 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.148 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T01:05:30.148 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.148 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.148 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.148 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.148 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_user": { 2024-09-21T01:05:30.148 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_user", 2024-09-21T01:05:30.148 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.149 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.149 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.149 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.149 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.149 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.149 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.149 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "User to authenticate as", 2024-09-21T01:05:30.149 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.149 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.149 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.149 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.149 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.149 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.149 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.149 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.150 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.150 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.150 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.150 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.150 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.150 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.150 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.150 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.150 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.150 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.150 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.150 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.150 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.150 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "balancer", 2024-09-21T01:05:30.150 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.151 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.151 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.151 INFO:teuthology.orchestra.run.smithi001.stdout: "active": { 2024-09-21T01:05:30.151 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "active", 2024-09-21T01:05:30.151 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.151 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.151 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.151 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.151 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.151 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.151 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.151 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T01:05:30.151 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.151 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.151 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.152 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.152 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_time": { 2024-09-21T01:05:30.152 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_time", 2024-09-21T01:05:30.152 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.152 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.152 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.152 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0000", 2024-09-21T01:05:30.152 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.152 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.152 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.152 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T01:05:30.152 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T01:05:30.152 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.152 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.152 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.153 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_weekday": { 2024-09-21T01:05:30.153 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_weekday", 2024-09-21T01:05:30.153 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-21T01:05:30.153 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.153 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.153 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.153 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-09-21T01:05:30.153 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-09-21T01:05:30.153 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.153 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T01:05:30.153 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T01:05:30.153 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.153 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.153 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.153 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_max_iterations": { 2024-09-21T01:05:30.153 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_max_iterations", 2024-09-21T01:05:30.154 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-21T01:05:30.154 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.154 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.154 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "25", 2024-09-21T01:05:30.154 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-21T01:05:30.154 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "250", 2024-09-21T01:05:30.154 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.154 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T01:05:30.154 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.154 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.154 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.154 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.154 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_metrics": { 2024-09-21T01:05:30.154 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_metrics", 2024-09-21T01:05:30.154 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.155 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.155 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.155 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T01:05:30.155 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.155 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.155 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.155 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T01:05:30.155 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T01:05:30.155 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.155 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.155 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.155 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_step": { 2024-09-21T01:05:30.155 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_step", 2024-09-21T01:05:30.155 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-21T01:05:30.155 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.156 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.156 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.5", 2024-09-21T01:05:30.156 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0.001", 2024-09-21T01:05:30.156 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "0.999", 2024-09-21T01:05:30.156 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.156 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "aggressiveness of optimization", 2024-09-21T01:05:30.156 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T01:05:30.156 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.156 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.156 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.156 INFO:teuthology.orchestra.run.smithi001.stdout: "end_time": { 2024-09-21T01:05:30.156 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_time", 2024-09-21T01:05:30.156 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.156 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.156 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.157 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2359", 2024-09-21T01:05:30.157 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.157 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.157 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.157 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T01:05:30.157 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T01:05:30.157 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.157 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.157 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.157 INFO:teuthology.orchestra.run.smithi001.stdout: "end_weekday": { 2024-09-21T01:05:30.157 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_weekday", 2024-09-21T01:05:30.157 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-21T01:05:30.157 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.157 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.157 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.157 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-09-21T01:05:30.158 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-09-21T01:05:30.158 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.158 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T01:05:30.158 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T01:05:30.158 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.158 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.158 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.158 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.158 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.158 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.158 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.158 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.158 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.158 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.158 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.159 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.159 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.159 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.159 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.159 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.159 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.159 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.159 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.159 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.159 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.159 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.159 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.159 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.160 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.160 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.160 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.160 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.160 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.160 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.160 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.160 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.160 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.160 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.160 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.160 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.160 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.160 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.160 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.161 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.161 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.161 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.161 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.161 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.161 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.161 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.161 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.161 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.161 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.161 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.161 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.161 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.161 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.161 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.162 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.162 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.162 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.162 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.162 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.162 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.162 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.162 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.162 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.162 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.162 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.162 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.162 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.162 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.163 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.163 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.163 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.163 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.163 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.163 INFO:teuthology.orchestra.run.smithi001.stdout: "min_score": { 2024-09-21T01:05:30.163 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_score", 2024-09-21T01:05:30.163 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-21T01:05:30.163 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.163 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.163 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.163 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.163 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.163 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.163 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T01:05:30.164 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.164 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.164 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.164 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.164 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-09-21T01:05:30.164 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-09-21T01:05:30.164 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.164 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.164 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.164 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "upmap", 2024-09-21T01:05:30.164 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.164 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.164 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.164 INFO:teuthology.orchestra.run.smithi001.stdout: "crush-compat", 2024-09-21T01:05:30.164 INFO:teuthology.orchestra.run.smithi001.stdout: "none", 2024-09-21T01:05:30.165 INFO:teuthology.orchestra.run.smithi001.stdout: "read", 2024-09-21T01:05:30.165 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap", 2024-09-21T01:05:30.165 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap-read" 2024-09-21T01:05:30.165 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.165 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Balancer mode", 2024-09-21T01:05:30.165 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.165 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.165 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.165 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.165 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_ids": { 2024-09-21T01:05:30.165 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_ids", 2024-09-21T01:05:30.165 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.165 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.165 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.165 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.165 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.166 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.166 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.166 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T01:05:30.166 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.166 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.166 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.166 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.166 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-21T01:05:30.166 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-21T01:05:30.166 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.166 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.166 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.166 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-21T01:05:30.166 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.166 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.167 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.167 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T01:05:30.167 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.167 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.167 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.167 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.167 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.167 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.167 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.167 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.167 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.167 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.167 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.167 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.167 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.168 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.168 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.168 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.168 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.168 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.168 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_deviation": { 2024-09-21T01:05:30.168 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_deviation", 2024-09-21T01:05:30.168 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.168 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.168 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.168 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-21T01:05:30.168 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-21T01:05:30.168 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.168 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.168 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T01:05:30.169 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T01:05:30.169 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.169 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.169 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.169 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_optimizations": { 2024-09-21T01:05:30.169 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_optimizations", 2024-09-21T01:05:30.169 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-21T01:05:30.169 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.169 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.169 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-21T01:05:30.169 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.169 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.169 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.169 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T01:05:30.169 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.169 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.170 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.170 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.170 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.170 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.170 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.170 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm", 2024-09-21T01:05:30.170 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.170 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.170 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.170 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_down_multiplier": { 2024-09-21T01:05:30.170 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_down_multiplier", 2024-09-21T01:05:30.170 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-21T01:05:30.170 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.170 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.170 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-09-21T01:05:30.171 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.171 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.171 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.171 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T01:05:30.171 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.171 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.171 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.171 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.171 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_refresh_rate": { 2024-09-21T01:05:30.171 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_refresh_rate", 2024-09-21T01:05:30.171 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.171 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.171 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.171 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "20", 2024-09-21T01:05:30.172 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.172 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.172 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.172 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T01:05:30.172 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.172 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.172 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.172 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.172 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_starting_port": { 2024-09-21T01:05:30.172 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_starting_port", 2024-09-21T01:05:30.172 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.172 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.172 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.172 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4721", 2024-09-21T01:05:30.172 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.173 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.173 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.173 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T01:05:30.173 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.173 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.173 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.173 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.174 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_ptrace": { 2024-09-21T01:05:30.174 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_ptrace", 2024-09-21T01:05:30.174 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.174 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.174 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.174 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.174 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.174 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.174 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.174 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T01:05:30.174 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T01:05:30.174 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.174 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.174 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.175 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_interval": { 2024-09-21T01:05:30.175 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_interval", 2024-09-21T01:05:30.175 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.175 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.175 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.175 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-21T01:05:30.175 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.175 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.175 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.175 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T01:05:30.175 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.175 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.175 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.175 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.175 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_memory_target_ratio": { 2024-09-21T01:05:30.176 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T01:05:30.176 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-21T01:05:30.176 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.176 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.176 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.7", 2024-09-21T01:05:30.176 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.176 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.176 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.176 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T01:05:30.176 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.176 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.176 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.176 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.176 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm_log_destination": { 2024-09-21T01:05:30.176 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm_log_destination", 2024-09-21T01:05:30.177 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.177 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.177 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.177 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.177 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.177 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.177 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.177 INFO:teuthology.orchestra.run.smithi001.stdout: "file", 2024-09-21T01:05:30.177 INFO:teuthology.orchestra.run.smithi001.stdout: "file,syslog", 2024-09-21T01:05:30.177 INFO:teuthology.orchestra.run.smithi001.stdout: "syslog" 2024-09-21T01:05:30.177 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.177 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T01:05:30.177 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.177 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.177 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.178 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.178 INFO:teuthology.orchestra.run.smithi001.stdout: "cgroups_split": { 2024-09-21T01:05:30.178 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cgroups_split", 2024-09-21T01:05:30.178 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.178 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.178 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.178 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.178 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.178 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.178 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.178 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T01:05:30.178 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.178 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.178 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.178 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.179 INFO:teuthology.orchestra.run.smithi001.stdout: "config_checks_enabled": { 2024-09-21T01:05:30.179 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_checks_enabled", 2024-09-21T01:05:30.179 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.179 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.179 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.179 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.179 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.179 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.179 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.179 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T01:05:30.179 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.179 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.179 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.179 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.179 INFO:teuthology.orchestra.run.smithi001.stdout: "config_dashboard": { 2024-09-21T01:05:30.179 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_dashboard", 2024-09-21T01:05:30.180 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.180 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.180 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.180 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.180 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.180 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.180 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.180 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T01:05:30.180 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.180 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.180 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.180 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.180 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_alertmanager": { 2024-09-21T01:05:30.180 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_alertmanager", 2024-09-21T01:05:30.180 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.181 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.181 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.181 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T01:05:30.181 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.181 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.181 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.181 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-21T01:05:30.181 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.181 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.181 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.181 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.181 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_base": { 2024-09-21T01:05:30.181 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_base", 2024-09-21T01:05:30.181 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.181 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.181 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.182 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T01:05:30.182 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.182 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.182 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.182 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Container image name, without the tag", 2024-09-21T01:05:30.182 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.182 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.182 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.182 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.182 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_elasticsearch": { 2024-09-21T01:05:30.182 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_elasticsearch", 2024-09-21T01:05:30.182 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.182 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.182 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.183 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T01:05:30.183 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.183 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.183 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.183 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "elasticsearch container image", 2024-09-21T01:05:30.183 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.183 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.183 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.183 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.183 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_grafana": { 2024-09-21T01:05:30.183 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_grafana", 2024-09-21T01:05:30.183 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.183 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.184 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.184 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T01:05:30.184 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.184 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.184 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.184 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-21T01:05:30.184 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.184 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.184 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.184 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.184 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_haproxy": { 2024-09-21T01:05:30.184 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_haproxy", 2024-09-21T01:05:30.184 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.184 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.184 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.185 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T01:05:30.185 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.185 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.185 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.185 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "HAproxy container image", 2024-09-21T01:05:30.185 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.185 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.185 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.185 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.185 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_agent": { 2024-09-21T01:05:30.185 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_agent", 2024-09-21T01:05:30.185 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.185 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.185 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.185 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T01:05:30.186 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.186 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.186 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.186 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger agent container image", 2024-09-21T01:05:30.186 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.186 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.186 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.186 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.186 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_collector": { 2024-09-21T01:05:30.186 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_collector", 2024-09-21T01:05:30.186 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.186 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.186 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.186 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T01:05:30.186 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.187 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.187 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.187 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger collector container image", 2024-09-21T01:05:30.187 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.187 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.187 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.187 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.187 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_query": { 2024-09-21T01:05:30.187 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_query", 2024-09-21T01:05:30.187 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.187 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.187 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.187 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T01:05:30.187 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.187 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.188 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.188 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger query container image", 2024-09-21T01:05:30.188 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.188 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.188 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.188 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.188 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_keepalived": { 2024-09-21T01:05:30.188 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_keepalived", 2024-09-21T01:05:30.188 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.188 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.188 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.188 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T01:05:30.188 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.188 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.188 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.189 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Keepalived container image", 2024-09-21T01:05:30.189 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.189 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.189 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.189 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.189 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_loki": { 2024-09-21T01:05:30.189 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_loki", 2024-09-21T01:05:30.189 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.189 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.189 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.189 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T01:05:30.189 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.189 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.189 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.189 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Loki container image", 2024-09-21T01:05:30.190 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.190 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.190 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.190 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.190 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_nginx": { 2024-09-21T01:05:30.190 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_nginx", 2024-09-21T01:05:30.190 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.190 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.190 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.190 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T01:05:30.190 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.190 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.190 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.190 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Nginx container image", 2024-09-21T01:05:30.190 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.191 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.191 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.191 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.191 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_node_exporter": { 2024-09-21T01:05:30.191 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_node_exporter", 2024-09-21T01:05:30.191 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.191 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.191 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.191 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T01:05:30.191 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.191 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.191 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.191 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-21T01:05:30.191 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.191 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.191 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.192 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.192 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_nvmeof": { 2024-09-21T01:05:30.192 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_nvmeof", 2024-09-21T01:05:30.192 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.192 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.192 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.192 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T01:05:30.192 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.192 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.192 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.192 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Nvme-of container image", 2024-09-21T01:05:30.192 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.192 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.192 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.192 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.193 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_oauth2_proxy": { 2024-09-21T01:05:30.193 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T01:05:30.193 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.193 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.193 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.193 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T01:05:30.193 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.193 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.193 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.193 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "oauth2-proxy container image", 2024-09-21T01:05:30.193 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.193 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.193 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.193 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.193 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_prometheus": { 2024-09-21T01:05:30.194 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_prometheus", 2024-09-21T01:05:30.194 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.194 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.194 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.194 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T01:05:30.194 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.194 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.194 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.194 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-21T01:05:30.194 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.194 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.194 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.194 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.195 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_promtail": { 2024-09-21T01:05:30.195 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_promtail", 2024-09-21T01:05:30.195 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.195 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.195 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.195 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T01:05:30.195 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.195 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.195 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.195 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Promtail container image", 2024-09-21T01:05:30.195 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.195 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.195 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.195 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.195 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_samba": { 2024-09-21T01:05:30.196 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_samba", 2024-09-21T01:05:30.196 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.196 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.196 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.196 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T01:05:30.196 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.196 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.196 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.196 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Samba/SMB container image", 2024-09-21T01:05:30.196 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.196 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.196 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.196 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.196 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_samba_metrics": { 2024-09-21T01:05:30.197 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_samba_metrics", 2024-09-21T01:05:30.197 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.197 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.197 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.197 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T01:05:30.197 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.197 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.197 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.197 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T01:05:30.197 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.197 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.197 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.197 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.197 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_snmp_gateway": { 2024-09-21T01:05:30.197 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_snmp_gateway", 2024-09-21T01:05:30.197 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.198 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.198 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.198 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T01:05:30.198 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.198 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.198 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.198 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SNMP Gateway container image", 2024-09-21T01:05:30.198 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.198 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.198 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.198 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.198 INFO:teuthology.orchestra.run.smithi001.stdout: "container_init": { 2024-09-21T01:05:30.198 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_init", 2024-09-21T01:05:30.198 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.199 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.199 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.199 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.199 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.199 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.199 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.199 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T01:05:30.199 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.199 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.199 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.199 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.199 INFO:teuthology.orchestra.run.smithi001.stdout: "daemon_cache_timeout": { 2024-09-21T01:05:30.199 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "daemon_cache_timeout", 2024-09-21T01:05:30.199 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.199 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.200 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.200 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-21T01:05:30.200 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.200 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.200 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.200 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T01:05:30.200 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.200 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.200 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.200 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.200 INFO:teuthology.orchestra.run.smithi001.stdout: "default_cephadm_command_timeout": { 2024-09-21T01:05:30.200 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T01:05:30.200 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.200 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.200 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.200 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "900", 2024-09-21T01:05:30.201 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.201 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.201 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.201 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T01:05:30.201 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.201 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.201 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.201 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.201 INFO:teuthology.orchestra.run.smithi001.stdout: "default_registry": { 2024-09-21T01:05:30.201 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_registry", 2024-09-21T01:05:30.201 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.201 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.201 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.201 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io", 2024-09-21T01:05:30.202 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.202 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.202 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.202 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T01:05:30.202 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.202 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.202 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.202 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.202 INFO:teuthology.orchestra.run.smithi001.stdout: "device_cache_timeout": { 2024-09-21T01:05:30.202 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_cache_timeout", 2024-09-21T01:05:30.202 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.202 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.202 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.202 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1800", 2024-09-21T01:05:30.202 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.203 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.203 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.203 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache device inventory", 2024-09-21T01:05:30.203 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.203 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.203 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.203 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.203 INFO:teuthology.orchestra.run.smithi001.stdout: "device_enhanced_scan": { 2024-09-21T01:05:30.203 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_enhanced_scan", 2024-09-21T01:05:30.203 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.203 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.203 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.203 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.203 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.203 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.203 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.204 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T01:05:30.204 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.204 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.204 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.204 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.204 INFO:teuthology.orchestra.run.smithi001.stdout: "facts_cache_timeout": { 2024-09-21T01:05:30.204 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "facts_cache_timeout", 2024-09-21T01:05:30.204 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.204 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.204 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.204 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-21T01:05:30.204 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.204 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.204 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.204 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache host facts data", 2024-09-21T01:05:30.205 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.205 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.205 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.205 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.205 INFO:teuthology.orchestra.run.smithi001.stdout: "grafana_dashboards_path": { 2024-09-21T01:05:30.205 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "grafana_dashboards_path", 2024-09-21T01:05:30.205 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.205 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.205 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.205 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T01:05:30.205 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.205 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.205 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.205 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T01:05:30.205 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.206 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.206 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.206 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.206 INFO:teuthology.orchestra.run.smithi001.stdout: "host_check_interval": { 2024-09-21T01:05:30.206 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "host_check_interval", 2024-09-21T01:05:30.206 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.206 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.206 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.206 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-21T01:05:30.206 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.206 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.206 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.206 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to perform a host check", 2024-09-21T01:05:30.206 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.207 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.207 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.207 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.207 INFO:teuthology.orchestra.run.smithi001.stdout: "hw_monitoring": { 2024-09-21T01:05:30.207 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hw_monitoring", 2024-09-21T01:05:30.207 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.207 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.207 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.207 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.207 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.207 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.207 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.207 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T01:05:30.207 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.207 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.208 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.208 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.208 INFO:teuthology.orchestra.run.smithi001.stdout: "inventory_list_all": { 2024-09-21T01:05:30.208 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "inventory_list_all", 2024-09-21T01:05:30.208 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.208 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.208 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.208 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.208 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.208 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.208 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.208 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T01:05:30.208 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.208 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.208 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.209 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.209 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.209 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.209 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.209 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.209 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.209 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.209 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.209 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.209 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.209 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.209 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.209 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.209 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.209 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.210 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.210 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.210 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.210 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.210 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.210 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.210 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.210 INFO:teuthology.orchestra.run.smithi001.stdout: "log_refresh_metadata": { 2024-09-21T01:05:30.210 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_refresh_metadata", 2024-09-21T01:05:30.210 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.210 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.210 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.210 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.210 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.210 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.211 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.211 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T01:05:30.211 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.211 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.211 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.211 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.211 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.211 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.211 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.211 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.211 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.211 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.211 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.211 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.211 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.212 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T01:05:30.212 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.212 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.212 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.212 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.212 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.212 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.212 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.212 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.212 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.212 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.212 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.212 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.212 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.212 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.213 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.213 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.213 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.213 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.213 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.213 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.213 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.213 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.213 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.213 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.213 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.213 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.213 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.213 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.213 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.214 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.214 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.214 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.214 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.214 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.214 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.214 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.214 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.214 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.214 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.214 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T01:05:30.214 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T01:05:30.214 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.214 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.214 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.215 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.215 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.215 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.215 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.215 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T01:05:30.215 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.215 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.215 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.215 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.215 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T01:05:30.215 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T01:05:30.215 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.215 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.215 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.215 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "*", 2024-09-21T01:05:30.216 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.216 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.216 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.216 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T01:05:30.216 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.216 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.216 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.216 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.216 INFO:teuthology.orchestra.run.smithi001.stdout: "max_count_per_host": { 2024-09-21T01:05:30.216 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_count_per_host", 2024-09-21T01:05:30.216 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.216 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.216 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.216 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-21T01:05:30.216 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.216 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.217 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.217 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of daemons per service per host", 2024-09-21T01:05:30.217 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.217 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.217 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.217 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.217 INFO:teuthology.orchestra.run.smithi001.stdout: "max_osd_draining_count": { 2024-09-21T01:05:30.217 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_osd_draining_count", 2024-09-21T01:05:30.217 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.217 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.217 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.217 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-21T01:05:30.217 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.218 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.218 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.218 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T01:05:30.218 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.218 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.218 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.218 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.218 INFO:teuthology.orchestra.run.smithi001.stdout: "migration_current": { 2024-09-21T01:05:30.218 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "migration_current", 2024-09-21T01:05:30.218 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.218 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.218 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.218 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.218 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.218 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.219 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.219 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "internal - do not modify", 2024-09-21T01:05:30.219 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.219 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.219 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.219 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.219 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-09-21T01:05:30.219 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-09-21T01:05:30.219 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.219 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.219 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.219 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "root", 2024-09-21T01:05:30.219 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.219 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.219 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.220 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm-package", 2024-09-21T01:05:30.220 INFO:teuthology.orchestra.run.smithi001.stdout: "root" 2024-09-21T01:05:30.220 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.220 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T01:05:30.220 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.220 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.220 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.220 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.220 INFO:teuthology.orchestra.run.smithi001.stdout: "oob_default_addr": { 2024-09-21T01:05:30.220 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "oob_default_addr", 2024-09-21T01:05:30.220 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.220 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.220 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.220 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "169.254.1.1", 2024-09-21T01:05:30.220 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.221 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.221 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.221 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T01:05:30.221 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.221 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.221 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.221 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.221 INFO:teuthology.orchestra.run.smithi001.stdout: "prometheus_alerts_path": { 2024-09-21T01:05:30.221 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus_alerts_path", 2024-09-21T01:05:30.221 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.221 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.221 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.221 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T01:05:30.221 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.221 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.221 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.222 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T01:05:30.222 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.222 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.222 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.222 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.222 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_insecure": { 2024-09-21T01:05:30.222 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_insecure", 2024-09-21T01:05:30.222 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.222 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.222 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.222 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.222 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.222 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.222 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.222 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T01:05:30.223 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.223 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.223 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.223 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.223 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_password": { 2024-09-21T01:05:30.223 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_password", 2024-09-21T01:05:30.223 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.223 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.223 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.223 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.223 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.223 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.223 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.223 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T01:05:30.223 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.224 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.224 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.224 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.224 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_url": { 2024-09-21T01:05:30.224 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_url", 2024-09-21T01:05:30.224 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.224 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.224 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.224 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.224 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.224 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.224 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.224 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T01:05:30.224 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.224 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.224 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.225 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.225 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_username": { 2024-09-21T01:05:30.225 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_username", 2024-09-21T01:05:30.225 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.225 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.225 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.225 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.225 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.225 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.225 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.225 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T01:05:30.225 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.225 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.225 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.225 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.226 INFO:teuthology.orchestra.run.smithi001.stdout: "secure_monitoring_stack": { 2024-09-21T01:05:30.226 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secure_monitoring_stack", 2024-09-21T01:05:30.226 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.226 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.226 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.226 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.226 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.226 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.226 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.226 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T01:05:30.226 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.226 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.226 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.226 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.226 INFO:teuthology.orchestra.run.smithi001.stdout: "service_discovery_port": { 2024-09-21T01:05:30.226 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "service_discovery_port", 2024-09-21T01:05:30.227 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.227 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.227 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.227 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8765", 2024-09-21T01:05:30.227 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.227 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.227 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.227 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "cephadm service discovery port", 2024-09-21T01:05:30.227 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.227 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.227 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.227 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.227 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.227 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.227 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.228 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.228 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.228 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.228 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.228 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.228 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.228 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.228 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.228 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.228 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.228 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.228 INFO:teuthology.orchestra.run.smithi001.stdout: "ssh_config_file": { 2024-09-21T01:05:30.228 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssh_config_file", 2024-09-21T01:05:30.228 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.229 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.229 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.229 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.229 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.229 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.229 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.229 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T01:05:30.229 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.229 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.229 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.229 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.229 INFO:teuthology.orchestra.run.smithi001.stdout: "ssh_keepalive_count_max": { 2024-09-21T01:05:30.229 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T01:05:30.230 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.230 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.230 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.230 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3", 2024-09-21T01:05:30.230 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.230 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.230 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.230 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T01:05:30.230 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.230 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.230 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.230 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.230 INFO:teuthology.orchestra.run.smithi001.stdout: "ssh_keepalive_interval": { 2024-09-21T01:05:30.230 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssh_keepalive_interval", 2024-09-21T01:05:30.230 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.231 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.231 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.231 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7", 2024-09-21T01:05:30.231 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.231 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.231 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.231 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T01:05:30.231 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.231 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.231 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.231 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.231 INFO:teuthology.orchestra.run.smithi001.stdout: "use_agent": { 2024-09-21T01:05:30.231 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_agent", 2024-09-21T01:05:30.231 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.232 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.232 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.232 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.232 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.232 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.232 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.232 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T01:05:30.232 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.232 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.232 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.232 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.232 INFO:teuthology.orchestra.run.smithi001.stdout: "use_repo_digest": { 2024-09-21T01:05:30.232 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_repo_digest", 2024-09-21T01:05:30.232 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.232 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.232 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.233 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.233 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.233 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.233 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.233 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T01:05:30.233 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.233 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.233 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.233 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.233 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_failed_host_check": { 2024-09-21T01:05:30.233 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_failed_host_check", 2024-09-21T01:05:30.233 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.233 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.233 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.234 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.234 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.234 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.234 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.234 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T01:05:30.234 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.234 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.234 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.234 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.234 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_daemons": { 2024-09-21T01:05:30.234 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_daemons", 2024-09-21T01:05:30.234 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.234 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.234 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.234 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.235 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.235 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.235 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.235 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T01:05:30.235 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.235 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.235 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.235 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.235 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_hosts": { 2024-09-21T01:05:30.235 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_hosts", 2024-09-21T01:05:30.235 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.235 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.235 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.235 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.235 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.236 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.236 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.236 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T01:05:30.236 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.236 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.236 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.236 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.236 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.236 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.236 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.236 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crash", 2024-09-21T01:05:30.236 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.236 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.236 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.236 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.236 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.237 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.237 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.237 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.237 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.237 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.237 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.237 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.237 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.237 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.237 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.237 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.237 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.237 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.237 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.237 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.238 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.238 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.238 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.238 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.238 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.238 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.238 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.238 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.238 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.238 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.238 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.238 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.238 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.238 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.238 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.239 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.239 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.239 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.239 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.239 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.239 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.239 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.239 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.239 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.239 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.239 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.239 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.239 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.239 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.239 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.239 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.240 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.240 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.240 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.240 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.240 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.240 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.240 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.240 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.240 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.240 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.240 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.240 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.240 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.240 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.240 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.240 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.241 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.241 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.241 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.241 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.241 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.241 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.241 INFO:teuthology.orchestra.run.smithi001.stdout: "retain_interval": { 2024-09-21T01:05:30.241 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retain_interval", 2024-09-21T01:05:30.241 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.241 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.241 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.241 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "31536000", 2024-09-21T01:05:30.241 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.242 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.242 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.242 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T01:05:30.242 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.242 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.242 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.242 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.242 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.242 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.242 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.242 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.242 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.242 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.242 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.243 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.243 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.243 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.243 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.243 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.243 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.243 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.243 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_recent_interval": { 2024-09-21T01:05:30.243 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_recent_interval", 2024-09-21T01:05:30.243 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.243 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.243 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.243 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1209600", 2024-09-21T01:05:30.243 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.243 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.244 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.244 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T01:05:30.244 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.244 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.244 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.244 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.244 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.244 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.244 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.244 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dashboard", 2024-09-21T01:05:30.244 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.244 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.244 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.244 INFO:teuthology.orchestra.run.smithi001.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T01:05:30.245 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T01:05:30.245 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.245 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.245 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.245 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-21T01:05:30.245 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.245 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.245 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.245 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.245 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.245 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.245 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.245 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.245 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T01:05:30.245 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T01:05:30.245 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.246 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.246 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.246 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.246 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.246 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.246 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.246 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.246 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.246 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.246 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.246 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.246 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T01:05:30.246 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T01:05:30.246 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.246 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.247 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.247 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.247 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.247 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.247 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.247 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.247 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.247 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.247 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.247 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.247 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_ENABLED": { 2024-09-21T01:05:30.247 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T01:05:30.247 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.247 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.247 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.248 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.248 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.248 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.248 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.248 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.248 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.248 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.248 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.248 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.248 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T01:05:30.248 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T01:05:30.248 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.248 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.248 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.248 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.249 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.249 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.249 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.249 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.249 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.249 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.249 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.249 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.249 INFO:teuthology.orchestra.run.smithi001.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T01:05:30.249 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T01:05:30.249 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.249 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.249 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.249 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.249 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.250 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.250 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.250 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.250 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.250 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.250 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.250 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.250 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T01:05:30.250 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T01:05:30.250 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.250 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.250 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.250 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.250 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.250 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.251 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.251 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.251 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.251 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.251 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.251 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.251 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T01:05:30.251 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T01:05:30.251 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.251 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.251 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.251 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.251 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.251 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.251 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.252 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.252 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.252 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.252 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.252 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.252 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T01:05:30.252 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T01:05:30.252 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.252 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.252 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.252 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.252 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.252 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.252 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.252 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.253 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.253 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.253 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.253 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.253 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T01:05:30.253 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T01:05:30.253 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.253 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.253 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.253 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.253 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.253 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.253 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.254 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.254 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.254 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.254 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.254 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.254 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T01:05:30.254 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T01:05:30.254 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.254 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.254 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.254 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.254 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.254 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.254 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.254 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.255 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.255 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.255 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.255 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.255 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T01:05:30.255 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T01:05:30.255 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.255 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.255 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.255 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.255 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.255 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.255 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.255 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.256 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.256 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.256 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.256 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.256 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T01:05:30.256 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T01:05:30.256 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.256 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.256 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.256 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.256 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.256 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.256 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.256 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.256 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.257 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.257 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.257 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.257 INFO:teuthology.orchestra.run.smithi001.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T01:05:30.257 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T01:05:30.257 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.257 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.257 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.257 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.257 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.257 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.257 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.257 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.257 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.257 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.258 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.258 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.258 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T01:05:30.258 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T01:05:30.258 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.258 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.258 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.258 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-21T01:05:30.258 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.258 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.258 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.258 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.258 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.258 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.258 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.259 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.259 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T01:05:30.259 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T01:05:30.259 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.259 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.259 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.259 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.259 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.259 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.259 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.259 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.259 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.259 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.259 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.259 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.260 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_URL": { 2024-09-21T01:05:30.260 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_URL", 2024-09-21T01:05:30.260 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.260 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.260 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.260 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.260 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.260 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.260 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.260 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.260 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.260 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.260 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.260 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.260 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T01:05:30.261 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T01:05:30.261 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.261 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.261 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.261 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-21T01:05:30.261 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.261 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.261 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.261 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.261 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.261 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.261 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.261 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.261 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T01:05:30.261 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T01:05:30.262 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.262 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.262 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.262 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.262 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.262 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.262 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.262 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.262 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.262 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.262 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.262 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.262 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T01:05:30.262 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T01:05:30.262 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.263 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.263 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.263 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.263 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.263 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.263 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.263 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.263 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.263 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.263 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.263 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.263 INFO:teuthology.orchestra.run.smithi001.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T01:05:30.263 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T01:05:30.263 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.263 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.264 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.264 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.264 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.264 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.264 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.264 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.264 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.264 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.264 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.264 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.264 INFO:teuthology.orchestra.run.smithi001.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T01:05:30.264 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T01:05:30.264 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.264 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.264 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.264 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.265 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.265 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.265 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.265 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.265 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.265 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.265 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.265 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.265 INFO:teuthology.orchestra.run.smithi001.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T01:05:30.265 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T01:05:30.265 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.265 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.265 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.265 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "[]", 2024-09-21T01:05:30.265 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.266 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.266 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.266 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.266 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.266 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.266 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.266 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.266 INFO:teuthology.orchestra.run.smithi001.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T01:05:30.266 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T01:05:30.266 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.266 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.266 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.266 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "{}", 2024-09-21T01:05:30.267 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.267 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.267 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.267 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.267 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.267 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.267 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.267 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.267 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T01:05:30.267 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T01:05:30.267 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.267 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.267 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.267 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.267 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.268 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.268 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.268 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.268 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.268 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.268 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.268 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.268 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T01:05:30.268 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T01:05:30.268 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.268 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.268 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.268 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.268 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.269 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.269 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.269 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.269 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.269 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.269 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.269 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.269 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T01:05:30.269 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T01:05:30.269 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.269 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.269 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.269 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.269 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.269 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.269 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.270 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.270 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.270 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.270 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.270 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.270 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T01:05:30.270 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T01:05:30.270 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.270 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.270 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.270 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.270 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.270 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.270 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.270 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.271 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.271 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.271 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.271 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.271 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T01:05:30.271 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T01:05:30.271 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.271 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.271 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.271 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.271 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.271 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.271 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.271 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.271 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.272 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.272 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.272 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.272 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T01:05:30.272 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T01:05:30.272 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.272 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.272 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.272 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.272 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.272 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.272 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.272 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.272 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.273 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.273 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.273 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.273 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T01:05:30.273 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T01:05:30.273 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.273 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.273 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.273 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.273 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.273 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.273 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.273 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.273 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.273 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.274 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.274 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.274 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T01:05:30.274 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T01:05:30.274 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.274 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.274 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.274 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.274 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.274 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.274 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.274 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.274 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.274 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.274 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.275 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.275 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T01:05:30.275 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T01:05:30.275 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.275 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.275 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.275 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.275 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.275 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.275 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.275 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.275 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.275 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.275 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.275 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.276 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T01:05:30.276 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T01:05:30.276 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.276 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.276 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.276 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.276 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.276 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.276 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.276 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.276 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.276 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.276 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.276 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.276 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T01:05:30.277 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T01:05:30.277 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.277 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.277 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.277 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T01:05:30.277 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.277 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.277 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.277 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.277 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.277 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.277 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.277 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.277 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T01:05:30.277 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T01:05:30.278 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.278 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.278 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.278 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-21T01:05:30.278 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.278 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.278 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.278 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.278 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.278 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.278 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.278 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.278 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T01:05:30.279 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T01:05:30.279 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.279 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.279 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.279 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8", 2024-09-21T01:05:30.279 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.279 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.279 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.279 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.279 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.279 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.279 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.279 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.279 INFO:teuthology.orchestra.run.smithi001.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T01:05:30.280 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T01:05:30.280 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.280 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.280 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.280 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "45", 2024-09-21T01:05:30.280 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.280 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.280 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.280 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.280 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.280 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.280 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.280 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.280 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T01:05:30.280 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T01:05:30.280 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.281 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.281 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.281 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.281 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.281 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.281 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.281 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.281 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.281 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.281 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.281 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.281 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T01:05:30.281 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T01:05:30.281 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.281 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.282 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.282 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-21T01:05:30.282 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.282 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.282 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.282 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.282 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.282 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.282 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.282 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.282 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T01:05:30.282 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T01:05:30.282 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.282 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.282 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.283 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.283 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.283 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.283 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.283 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.283 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.283 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.283 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.283 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.283 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T01:05:30.283 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T01:05:30.283 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.283 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.283 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.284 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.284 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.284 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.284 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.284 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.284 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.284 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.284 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.284 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.284 INFO:teuthology.orchestra.run.smithi001.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T01:05:30.284 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T01:05:30.284 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.284 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.284 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.284 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.284 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.285 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.285 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.285 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.285 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.285 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.285 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.285 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.285 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T01:05:30.285 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T01:05:30.285 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.285 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.285 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.285 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.285 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.285 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.286 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.286 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.286 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.286 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.286 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.286 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.286 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T01:05:30.286 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T01:05:30.286 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.286 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.286 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.286 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-21T01:05:30.286 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.286 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.287 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.287 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.287 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.287 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.287 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.287 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.287 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T01:05:30.287 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T01:05:30.287 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.287 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.287 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.287 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-21T01:05:30.287 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.287 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.287 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.288 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.288 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.288 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.288 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.288 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.288 INFO:teuthology.orchestra.run.smithi001.stdout: "cross_origin_url": { 2024-09-21T01:05:30.288 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cross_origin_url", 2024-09-21T01:05:30.288 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.288 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.288 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.288 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.288 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.288 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.288 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.288 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.289 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.289 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.289 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.289 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.289 INFO:teuthology.orchestra.run.smithi001.stdout: "crt_file": { 2024-09-21T01:05:30.289 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crt_file", 2024-09-21T01:05:30.289 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.289 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.289 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.289 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.289 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.289 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.289 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.289 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.289 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.289 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.290 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.290 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.290 INFO:teuthology.orchestra.run.smithi001.stdout: "debug": { 2024-09-21T01:05:30.290 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "debug", 2024-09-21T01:05:30.290 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.290 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.290 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.290 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.290 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.290 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.290 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.290 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable/disable debug options", 2024-09-21T01:05:30.290 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.290 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.291 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.291 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.291 INFO:teuthology.orchestra.run.smithi001.stdout: "jwt_token_ttl": { 2024-09-21T01:05:30.291 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "jwt_token_ttl", 2024-09-21T01:05:30.291 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.291 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.291 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.291 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "28800", 2024-09-21T01:05:30.291 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.291 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.291 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.291 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.291 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.291 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.292 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.292 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.292 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-09-21T01:05:30.292 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-09-21T01:05:30.293 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.293 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.293 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.293 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.293 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.294 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.294 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.294 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.294 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.294 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.294 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.294 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.294 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.294 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.294 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.294 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.294 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.294 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.294 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.295 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.295 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.295 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.295 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.295 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.295 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.295 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.295 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.295 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.295 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.295 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.295 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.295 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.295 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.295 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.296 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.296 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.296 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.296 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.296 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.296 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.296 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.296 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.296 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.296 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.296 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.296 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.296 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.296 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.296 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.296 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.297 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.297 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.297 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.297 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.297 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.297 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.297 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.297 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.297 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.297 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.297 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.297 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.297 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.297 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.298 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.298 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.298 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.298 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.298 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.298 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.298 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.298 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.298 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.298 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.298 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.298 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.298 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.298 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.298 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.299 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.299 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.299 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.299 INFO:teuthology.orchestra.run.smithi001.stdout: "motd": { 2024-09-21T01:05:30.299 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "motd", 2024-09-21T01:05:30.299 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.299 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.299 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.299 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.299 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.299 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.299 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.299 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "The message of the day", 2024-09-21T01:05:30.299 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.299 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.300 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.300 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.300 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect_resolve_ip_addr": { 2024-09-21T01:05:30.300 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T01:05:30.300 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.300 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.300 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.300 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.300 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.300 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.300 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.300 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.300 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.300 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.300 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.301 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.301 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-21T01:05:30.301 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-21T01:05:30.301 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.301 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.301 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.301 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-09-21T01:05:30.301 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.301 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.301 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.301 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.301 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.301 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.301 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.301 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.302 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-21T01:05:30.302 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-21T01:05:30.302 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.302 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.302 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.302 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8080", 2024-09-21T01:05:30.302 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.302 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.302 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.302 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.302 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.302 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.302 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.302 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.303 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.303 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.303 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.303 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.303 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.303 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.303 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.303 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.303 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.303 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.303 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.303 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.303 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.303 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.304 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-09-21T01:05:30.304 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-09-21T01:05:30.304 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.304 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.304 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.304 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.304 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.304 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.304 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.304 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.304 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.304 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.304 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.304 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.304 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl_server_port": { 2024-09-21T01:05:30.304 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl_server_port", 2024-09-21T01:05:30.305 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.305 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.305 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.305 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8443", 2024-09-21T01:05:30.305 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.305 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.305 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.305 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.305 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.305 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.305 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.305 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.305 INFO:teuthology.orchestra.run.smithi001.stdout: "sso_oauth2": { 2024-09-21T01:05:30.306 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sso_oauth2", 2024-09-21T01:05:30.306 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.306 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.306 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.306 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.306 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.306 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.306 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.306 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.306 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.306 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.306 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.306 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.306 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-09-21T01:05:30.307 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-09-21T01:05:30.307 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.307 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.307 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.307 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "redirect", 2024-09-21T01:05:30.307 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.307 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.307 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.307 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.307 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect" 2024-09-21T01:05:30.307 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.307 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.307 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.307 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.308 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.308 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.308 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-09-21T01:05:30.308 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-09-21T01:05:30.308 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.308 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.308 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.308 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-21T01:05:30.308 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-09-21T01:05:30.308 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-09-21T01:05:30.308 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.308 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.308 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.308 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.308 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.309 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.309 INFO:teuthology.orchestra.run.smithi001.stdout: "url_prefix": { 2024-09-21T01:05:30.309 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url_prefix", 2024-09-21T01:05:30.309 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.309 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.309 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.309 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.309 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.309 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.309 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.309 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.309 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.309 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.309 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.309 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.310 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.310 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.310 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.310 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "devicehealth", 2024-09-21T01:05:30.310 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.310 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.310 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.310 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_monitoring": { 2024-09-21T01:05:30.310 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_monitoring", 2024-09-21T01:05:30.310 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.310 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.310 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.310 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.310 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.311 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.311 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.311 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "monitor device health metrics", 2024-09-21T01:05:30.311 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.311 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.311 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.311 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.311 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.311 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.311 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.311 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.311 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.311 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.311 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.311 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.312 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.312 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.312 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.312 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.312 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.312 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.312 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.312 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.312 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.312 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.312 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.312 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.312 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.312 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.312 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.312 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.313 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.313 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.313 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.313 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.313 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.313 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.313 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.313 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.313 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.313 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.313 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.313 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.313 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.313 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.313 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.314 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.314 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.314 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.314 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.314 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.314 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.314 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.314 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.314 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.314 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.314 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.314 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.314 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.314 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.315 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.315 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.315 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.315 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.315 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.315 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.315 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.315 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.315 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.315 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.315 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.315 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.315 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.315 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.315 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.316 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.316 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.316 INFO:teuthology.orchestra.run.smithi001.stdout: "mark_out_threshold": { 2024-09-21T01:05:30.316 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mark_out_threshold", 2024-09-21T01:05:30.316 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.316 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.316 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.316 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2419200", 2024-09-21T01:05:30.316 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.316 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.316 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.316 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T01:05:30.316 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.316 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.316 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.317 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.317 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_name": { 2024-09-21T01:05:30.317 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_name", 2024-09-21T01:05:30.317 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.317 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.317 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.317 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "device_health_metrics", 2024-09-21T01:05:30.317 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.317 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.317 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.317 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T01:05:30.317 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.317 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.317 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.317 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.318 INFO:teuthology.orchestra.run.smithi001.stdout: "retention_period": { 2024-09-21T01:05:30.318 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retention_period", 2024-09-21T01:05:30.318 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.318 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.318 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.318 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15552000", 2024-09-21T01:05:30.318 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.318 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.318 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.318 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain device health metrics", 2024-09-21T01:05:30.318 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.318 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.318 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.319 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.319 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_frequency": { 2024-09-21T01:05:30.319 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_frequency", 2024-09-21T01:05:30.319 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.319 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.319 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.319 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-09-21T01:05:30.319 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.319 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.319 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.319 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T01:05:30.319 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.319 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.319 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.320 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.320 INFO:teuthology.orchestra.run.smithi001.stdout: "self_heal": { 2024-09-21T01:05:30.320 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "self_heal", 2024-09-21T01:05:30.320 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.320 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.320 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.320 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.320 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.320 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.320 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.320 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T01:05:30.320 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.320 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.320 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.320 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.320 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-21T01:05:30.321 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-21T01:05:30.321 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.321 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.321 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.321 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-21T01:05:30.321 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.321 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.321 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.321 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T01:05:30.321 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.321 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.321 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.321 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.321 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.322 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.322 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.322 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.322 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.322 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.322 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.322 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.322 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.322 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.322 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.322 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.322 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.322 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.322 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_threshold": { 2024-09-21T01:05:30.322 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_threshold", 2024-09-21T01:05:30.323 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.323 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.323 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.323 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7257600", 2024-09-21T01:05:30.323 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.323 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.323 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.323 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T01:05:30.323 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.323 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.323 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.323 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.323 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.323 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.324 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.324 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "diskprediction_local", 2024-09-21T01:05:30.324 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.324 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.324 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.324 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.324 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.324 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.324 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.324 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.324 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.324 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.324 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.324 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.324 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.325 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.325 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.325 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.325 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.325 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.325 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.325 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.325 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.325 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.325 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.325 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.325 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.325 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.325 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.325 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.326 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.326 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.326 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.326 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.326 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.326 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.326 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.326 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.326 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.326 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.326 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.326 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.326 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.326 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.326 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.327 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.327 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.327 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.327 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.327 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.327 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.327 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.327 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.327 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.327 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.327 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.327 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.327 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.327 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.327 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.327 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.328 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.328 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.328 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.328 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.328 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.328 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.328 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.328 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.328 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.328 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.328 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.328 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.328 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.328 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.328 INFO:teuthology.orchestra.run.smithi001.stdout: "predict_interval": { 2024-09-21T01:05:30.329 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predict_interval", 2024-09-21T01:05:30.329 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.329 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.329 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.329 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-09-21T01:05:30.329 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.329 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.329 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.329 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.329 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.329 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.329 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.329 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.329 INFO:teuthology.orchestra.run.smithi001.stdout: "predictor_model": { 2024-09-21T01:05:30.329 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predictor_model", 2024-09-21T01:05:30.329 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.330 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.330 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.330 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "prophetstor", 2024-09-21T01:05:30.330 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.330 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.330 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.330 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.330 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.330 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.330 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.330 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.330 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-21T01:05:30.330 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-21T01:05:30.330 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.330 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.331 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.331 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-21T01:05:30.331 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.331 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.331 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.331 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.331 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.331 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.331 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.331 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.331 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.331 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.331 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.332 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.332 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.332 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.332 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.332 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.332 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.332 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.332 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.332 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.332 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.332 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.332 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.332 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.332 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.332 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "influx", 2024-09-21T01:05:30.333 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": false, 2024-09-21T01:05:30.333 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "influxdb python module not found", 2024-09-21T01:05:30.333 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.333 INFO:teuthology.orchestra.run.smithi001.stdout: "batch_size": { 2024-09-21T01:05:30.333 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "batch_size", 2024-09-21T01:05:30.333 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.333 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.333 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.333 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5000", 2024-09-21T01:05:30.333 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.333 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.333 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.333 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T01:05:30.333 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.333 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.334 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.334 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.334 INFO:teuthology.orchestra.run.smithi001.stdout: "database": { 2024-09-21T01:05:30.334 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "database", 2024-09-21T01:05:30.334 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.334 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.334 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.334 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "ceph", 2024-09-21T01:05:30.334 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.334 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.334 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.334 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T01:05:30.334 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.334 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.334 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.335 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.335 INFO:teuthology.orchestra.run.smithi001.stdout: "hostname": { 2024-09-21T01:05:30.335 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hostname", 2024-09-21T01:05:30.335 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.335 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.335 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.335 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.335 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.335 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.335 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.335 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server hostname", 2024-09-21T01:05:30.335 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.335 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.335 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.336 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.336 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-21T01:05:30.336 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-21T01:05:30.336 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.336 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.336 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.336 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "30", 2024-09-21T01:05:30.336 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "5", 2024-09-21T01:05:30.336 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.336 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.336 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T01:05:30.336 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.336 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.336 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.336 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.336 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.337 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.337 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.337 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.337 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.337 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.337 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.337 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.337 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.337 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.337 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.337 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.337 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.337 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.337 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.337 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.338 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.338 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.338 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.338 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.338 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.338 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.338 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.338 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.338 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.338 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.338 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.338 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.338 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.338 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.338 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.339 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.339 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.339 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.339 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.339 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.339 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.339 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.339 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.339 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.339 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.339 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.339 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.339 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.339 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.339 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.340 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.340 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.340 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.340 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.340 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.340 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.340 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.340 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.340 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.340 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.340 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.340 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.340 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.340 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.340 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.341 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.341 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.341 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.341 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.341 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.341 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.341 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.341 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.341 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.341 INFO:teuthology.orchestra.run.smithi001.stdout: "password": { 2024-09-21T01:05:30.341 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "password", 2024-09-21T01:05:30.341 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.341 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.341 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.341 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.342 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.342 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.342 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.342 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "password of InfluxDB server user", 2024-09-21T01:05:30.342 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.342 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.342 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.342 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.342 INFO:teuthology.orchestra.run.smithi001.stdout: "port": { 2024-09-21T01:05:30.342 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "port", 2024-09-21T01:05:30.342 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.342 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.342 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.342 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8086", 2024-09-21T01:05:30.342 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.343 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.343 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.343 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server port", 2024-09-21T01:05:30.343 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.343 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.343 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.343 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.343 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.343 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.343 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.343 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.343 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.343 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.343 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.344 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.344 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.344 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.344 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.344 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.344 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.344 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.344 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-09-21T01:05:30.344 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-09-21T01:05:30.344 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.344 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.344 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.344 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "false", 2024-09-21T01:05:30.344 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.344 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.345 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.345 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T01:05:30.345 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.345 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.345 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.345 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.345 INFO:teuthology.orchestra.run.smithi001.stdout: "threads": { 2024-09-21T01:05:30.345 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threads", 2024-09-21T01:05:30.345 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.345 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.345 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.345 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-21T01:05:30.345 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-21T01:05:30.345 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "32", 2024-09-21T01:05:30.346 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.346 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T01:05:30.346 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.346 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.346 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.346 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.346 INFO:teuthology.orchestra.run.smithi001.stdout: "username": { 2024-09-21T01:05:30.346 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "username", 2024-09-21T01:05:30.346 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.346 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.346 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.346 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.346 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.346 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.346 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.346 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "username of InfluxDB server user", 2024-09-21T01:05:30.347 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.347 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.347 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.347 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.347 INFO:teuthology.orchestra.run.smithi001.stdout: "verify_ssl": { 2024-09-21T01:05:30.347 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "verify_ssl", 2024-09-21T01:05:30.347 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.347 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.347 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.347 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "true", 2024-09-21T01:05:30.347 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.347 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.347 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.347 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T01:05:30.348 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.348 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.348 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.348 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.348 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.348 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.348 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.348 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "insights", 2024-09-21T01:05:30.348 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.348 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.348 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.348 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.348 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.348 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.348 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.349 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.349 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.349 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.349 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.349 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.349 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.349 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.349 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.349 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.349 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.349 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.349 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.349 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.349 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.350 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.350 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.350 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.350 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.350 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.350 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.350 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.350 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.350 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.350 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.350 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.350 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.350 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.350 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.350 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.351 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.351 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.351 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.351 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.351 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.351 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.351 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.351 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.351 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.351 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.351 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.351 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.351 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.351 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.352 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.352 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.352 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.352 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.352 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.352 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.352 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.352 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.352 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.352 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.352 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.352 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.352 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.352 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.352 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.353 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.353 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.353 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.353 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.353 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.353 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.353 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.353 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.353 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.353 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.353 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.353 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.353 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.353 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.353 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.354 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.354 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.354 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.354 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.354 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.354 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.354 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.354 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.354 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.354 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.354 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "iostat", 2024-09-21T01:05:30.354 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.354 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.354 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.354 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.355 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.355 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.355 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.355 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.355 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.355 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.355 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.355 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.355 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.355 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.355 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.355 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.355 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.355 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.356 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.356 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.356 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.356 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.356 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.356 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.356 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.356 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.356 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.356 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.356 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.356 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.356 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.356 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.357 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.357 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.357 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.357 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.357 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.357 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.357 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.357 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.357 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.357 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.357 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.357 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.357 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.357 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.357 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.358 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.358 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.358 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.358 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.358 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.358 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.358 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.358 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.358 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.358 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.358 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.358 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.358 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.358 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.359 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.359 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.359 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.359 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.359 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.359 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.359 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.359 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.359 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.359 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.359 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.359 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.359 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.359 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.359 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.360 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.360 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.360 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.360 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.360 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.360 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.360 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.360 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.360 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.360 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.360 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.360 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.360 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.360 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.360 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "k8sevents", 2024-09-21T01:05:30.361 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.361 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.361 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.361 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_event_retention_days": { 2024-09-21T01:05:30.361 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ceph_event_retention_days", 2024-09-21T01:05:30.361 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.361 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.361 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.361 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7", 2024-09-21T01:05:30.361 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.361 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.361 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.361 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T01:05:30.361 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.361 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.362 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.362 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.362 INFO:teuthology.orchestra.run.smithi001.stdout: "config_check_secs": { 2024-09-21T01:05:30.362 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_check_secs", 2024-09-21T01:05:30.362 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.362 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.362 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.362 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-21T01:05:30.362 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "10", 2024-09-21T01:05:30.362 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.362 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.362 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T01:05:30.362 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.362 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.363 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.363 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.363 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.363 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.363 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.363 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.363 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.363 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.363 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.363 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.363 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.363 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.363 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.363 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.363 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.363 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.364 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.364 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.364 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.364 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.364 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.364 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.364 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.364 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.364 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.364 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.364 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.364 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.364 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.364 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.365 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.365 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.365 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.365 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.365 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.365 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.365 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.365 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.365 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.365 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.365 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.365 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.365 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.365 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.365 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.366 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.366 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.366 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.366 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.366 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.366 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.366 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.366 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.366 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.366 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.366 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.366 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.366 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.366 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.366 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.367 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.367 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.367 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.367 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.367 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.367 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.367 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.367 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.367 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.367 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.367 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.367 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.367 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.367 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.367 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.367 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.368 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.368 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.368 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.368 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.368 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.368 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.368 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.368 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.368 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.368 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.368 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.368 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.368 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.368 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "localpool", 2024-09-21T01:05:30.368 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.369 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.369 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.369 INFO:teuthology.orchestra.run.smithi001.stdout: "failure_domain": { 2024-09-21T01:05:30.369 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "failure_domain", 2024-09-21T01:05:30.369 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.369 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.369 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.369 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "host", 2024-09-21T01:05:30.369 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.369 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.369 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.369 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "failure domain for any created local pool", 2024-09-21T01:05:30.369 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T01:05:30.369 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.370 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.370 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.370 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.370 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.370 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.370 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.370 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.370 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.370 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.370 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.370 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.370 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.370 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.370 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.370 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.371 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.371 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.371 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.371 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.371 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.371 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.371 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.371 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.371 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.371 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.371 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.371 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.371 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.371 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.372 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.372 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.372 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.372 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.372 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.372 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.372 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.372 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.372 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.372 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.372 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.372 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.372 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.372 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.372 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.373 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.373 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.373 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.373 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.373 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.373 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.373 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.373 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.373 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.373 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.373 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.373 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.373 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.373 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.373 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.374 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.374 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.374 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.374 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.374 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.374 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.374 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.374 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.374 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.374 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.374 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.374 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.374 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.374 INFO:teuthology.orchestra.run.smithi001.stdout: "min_size": { 2024-09-21T01:05:30.374 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_size", 2024-09-21T01:05:30.375 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.375 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.375 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.375 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.375 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.375 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.375 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.375 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default min_size for any created local pool", 2024-09-21T01:05:30.375 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T01:05:30.375 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.375 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.375 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.375 INFO:teuthology.orchestra.run.smithi001.stdout: "num_rep": { 2024-09-21T01:05:30.375 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "num_rep", 2024-09-21T01:05:30.375 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.376 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.376 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.376 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3", 2024-09-21T01:05:30.376 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.376 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.376 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.376 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default replica count for any created local pool", 2024-09-21T01:05:30.376 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.376 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.376 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.376 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.376 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num": { 2024-09-21T01:05:30.376 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_num", 2024-09-21T01:05:30.376 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.376 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.376 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.377 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "128", 2024-09-21T01:05:30.377 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.377 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.377 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.377 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T01:05:30.377 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.377 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.377 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.377 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.377 INFO:teuthology.orchestra.run.smithi001.stdout: "prefix": { 2024-09-21T01:05:30.377 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prefix", 2024-09-21T01:05:30.377 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.377 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.377 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.377 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.378 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.378 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.378 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.378 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name prefix for any created local pool", 2024-09-21T01:05:30.378 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.378 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.378 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.378 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.378 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.378 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.378 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.378 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.378 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.378 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.378 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.379 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.379 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.379 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.379 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.379 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.379 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.379 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.379 INFO:teuthology.orchestra.run.smithi001.stdout: "subtree": { 2024-09-21T01:05:30.379 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "subtree", 2024-09-21T01:05:30.379 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.379 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.379 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.379 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "rack", 2024-09-21T01:05:30.379 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.379 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.379 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.380 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T01:05:30.380 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T01:05:30.380 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.380 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.380 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.380 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.380 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.380 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.380 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mds_autoscaler", 2024-09-21T01:05:30.380 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.380 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.380 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.380 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.380 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.380 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.381 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.381 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.381 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.381 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.381 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.381 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.381 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.381 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.381 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.381 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.381 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.381 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.381 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.381 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.381 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.382 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.382 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.382 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.382 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.382 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.382 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.382 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.382 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.382 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.382 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.382 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.382 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.382 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.383 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.383 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.383 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.383 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.383 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.383 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.383 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.383 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.383 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.383 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.383 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.383 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.383 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.383 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.383 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.384 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.384 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.384 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.384 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.384 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.384 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.384 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.384 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.384 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.384 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.384 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.384 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.384 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.384 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.384 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.385 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.385 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.385 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.385 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.385 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.385 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.385 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.385 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.385 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.385 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.385 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.385 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.385 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.385 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.385 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.385 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.386 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.386 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.386 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.386 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.386 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.386 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.386 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.386 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.386 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.386 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.386 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirroring", 2024-09-21T01:05:30.386 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.386 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.386 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.387 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.387 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.387 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.387 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.387 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.387 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.387 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.387 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.387 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.387 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.387 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.387 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.387 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.387 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.387 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.388 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.388 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.388 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.388 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.388 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.388 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.388 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.388 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.388 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.388 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.388 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.388 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.388 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.388 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.388 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.389 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.389 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.389 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.389 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.389 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.389 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.389 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.389 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.389 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.389 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.389 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.389 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.389 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.389 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.389 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.390 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.390 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.390 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.390 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.390 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.390 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.390 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.390 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.390 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.390 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.390 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.390 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.390 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.390 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.390 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.391 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.391 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.391 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.391 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.391 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.391 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.391 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.391 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.391 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.391 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.391 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.391 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.391 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.391 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.391 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.392 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.392 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.392 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.392 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.392 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.392 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.392 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.392 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.392 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.392 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.392 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.392 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.392 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "nfs", 2024-09-21T01:05:30.392 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.392 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.393 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.393 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.393 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.393 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.393 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.393 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.393 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.393 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.393 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.393 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.393 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.393 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.393 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.393 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.393 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.394 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.394 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.394 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.394 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.394 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.394 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.394 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.394 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.394 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.394 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.394 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.394 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.394 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.394 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.394 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.395 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.395 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.395 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.395 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.395 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.395 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.395 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.395 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.395 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.395 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.395 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.395 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.395 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.396 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.396 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.396 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.396 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.396 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.396 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.396 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.396 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.396 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.396 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.396 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.396 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.396 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.396 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.396 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.397 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.397 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.397 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.397 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.397 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.397 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.397 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.397 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.397 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.397 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.397 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.397 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.397 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.397 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.397 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.398 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.398 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.398 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.398 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.398 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.398 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.398 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.398 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.398 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.398 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.398 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.398 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.398 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.398 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.399 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.399 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-09-21T01:05:30.399 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.399 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.399 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.399 INFO:teuthology.orchestra.run.smithi001.stdout: "fail_fs": { 2024-09-21T01:05:30.399 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "fail_fs", 2024-09-21T01:05:30.399 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.399 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.399 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.399 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.399 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.399 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.399 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.400 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T01:05:30.400 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.400 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.400 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.400 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.400 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.400 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.400 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.400 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.400 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.400 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.400 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.400 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.400 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.400 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.401 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.401 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.401 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.401 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.401 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.401 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.401 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.401 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.401 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.401 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.401 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.401 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.401 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.401 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.401 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.402 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.402 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.402 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.402 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.402 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.402 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.402 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.402 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.402 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.402 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.402 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.402 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.402 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.402 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.402 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.403 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.403 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.403 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.403 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.403 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.403 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.403 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.403 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.403 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.403 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.403 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.403 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.403 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.403 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.403 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.403 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.404 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.404 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.404 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.404 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.404 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.404 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.404 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.404 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.404 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.404 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.404 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.404 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.404 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.404 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.404 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator": { 2024-09-21T01:05:30.405 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-09-21T01:05:30.405 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.405 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.405 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.405 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.405 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.405 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.405 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.405 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm", 2024-09-21T01:05:30.405 INFO:teuthology.orchestra.run.smithi001.stdout: "rook", 2024-09-21T01:05:30.405 INFO:teuthology.orchestra.run.smithi001.stdout: "test_orchestrator" 2024-09-21T01:05:30.405 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.405 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Orchestrator backend", 2024-09-21T01:05:30.405 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.405 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.405 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.406 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.406 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.406 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.406 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.406 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.406 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.406 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.406 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.406 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.406 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.406 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.406 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.406 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.406 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.407 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.407 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.407 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.407 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.407 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_perf_query", 2024-09-21T01:05:30.407 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.407 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.407 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.407 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.407 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.407 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.407 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.407 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.407 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.407 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.408 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.408 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.408 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.408 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.408 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.408 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.408 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.408 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.408 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.408 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.408 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.408 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.408 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.409 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.409 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.409 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.409 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.409 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.409 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.409 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.409 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.409 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.409 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.409 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.409 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.409 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.409 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.409 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.410 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.410 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.410 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.410 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.410 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.410 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.410 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.410 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.410 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.410 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.410 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.410 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.410 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.410 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.411 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.411 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.411 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.411 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.411 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.411 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.411 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.411 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.411 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.411 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.411 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.411 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.411 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.411 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.411 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.412 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.412 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.412 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.412 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.412 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.412 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.412 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.412 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.412 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.412 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.412 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.412 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.412 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.412 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.412 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.413 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.413 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.413 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.413 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.413 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.413 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.413 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.413 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.413 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_support", 2024-09-21T01:05:30.413 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.413 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.413 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.413 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.413 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.413 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.414 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.414 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.414 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.414 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.414 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.414 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.414 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.414 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.414 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.414 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.414 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.414 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.414 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.414 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.414 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.415 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.415 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.415 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.415 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.415 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.415 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.415 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.415 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.415 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.415 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.415 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.415 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.415 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.415 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.416 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.416 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.416 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.416 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.416 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.416 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.416 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.416 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.416 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.416 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.416 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.416 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.416 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.416 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.416 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.417 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.417 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.417 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.417 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.417 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.417 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.417 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.417 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.417 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.417 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.417 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.417 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.417 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.417 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.418 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.418 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.418 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.418 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.418 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.418 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.418 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.418 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.418 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.418 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.418 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.418 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.418 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.418 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.418 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.418 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.419 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.419 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.419 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.419 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.419 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.419 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.419 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.419 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.419 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.419 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.419 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_autoscaler", 2024-09-21T01:05:30.419 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.419 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.419 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.419 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.420 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.420 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.420 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.420 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.420 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.420 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.420 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.420 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.420 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.420 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.420 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.420 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.420 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.420 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.420 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.421 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.421 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.421 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.421 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.421 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.421 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.421 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.421 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.421 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.421 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.421 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.421 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.421 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.421 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.422 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.422 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.422 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.422 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.422 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.422 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.422 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.422 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.422 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.422 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.422 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.422 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.422 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.422 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.423 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.423 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.423 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.423 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.423 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.423 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.423 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.423 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.423 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.423 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.423 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.423 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.423 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.423 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.423 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.424 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.424 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.424 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.424 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.424 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.424 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.424 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.424 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.424 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.424 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.424 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.424 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-21T01:05:30.424 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-21T01:05:30.424 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.424 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.425 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.425 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-21T01:05:30.425 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.425 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.425 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.425 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.425 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.425 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.425 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.425 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.425 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.425 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.425 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.425 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.426 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.426 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.426 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.426 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.426 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.426 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.426 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.426 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.426 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.426 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.426 INFO:teuthology.orchestra.run.smithi001.stdout: "threshold": { 2024-09-21T01:05:30.426 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threshold", 2024-09-21T01:05:30.426 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-21T01:05:30.426 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.426 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.427 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-09-21T01:05:30.427 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1.0", 2024-09-21T01:05:30.427 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.427 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.427 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "scaling threshold", 2024-09-21T01:05:30.427 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T01:05:30.427 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.427 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.427 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.427 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.427 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.427 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.427 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "progress", 2024-09-21T01:05:30.427 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.427 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.428 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.428 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_pg_recovery_event": { 2024-09-21T01:05:30.428 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_pg_recovery_event", 2024-09-21T01:05:30.428 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.428 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.428 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.428 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.428 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.428 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.428 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.428 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T01:05:30.428 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.428 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.428 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.428 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.429 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-09-21T01:05:30.429 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-09-21T01:05:30.429 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.429 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.429 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.429 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.429 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.429 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.429 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.429 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.429 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.429 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.429 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.429 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.429 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.429 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.430 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.430 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.430 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.430 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.430 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.430 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.430 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.430 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.430 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.430 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.430 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.430 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.430 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.430 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.430 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.431 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.431 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.431 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.431 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.431 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.431 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.431 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.431 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.431 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.431 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.431 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.431 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.431 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.431 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.431 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.432 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.432 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.432 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.432 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.432 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.432 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.432 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.432 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.432 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.432 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.432 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.432 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.432 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.432 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.432 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.433 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.433 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.433 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.433 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.433 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.433 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.433 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.433 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.433 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.433 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.433 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.433 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.433 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.433 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.433 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.433 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.434 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.434 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.434 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.434 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.434 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.434 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.434 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.434 INFO:teuthology.orchestra.run.smithi001.stdout: "max_completed_events": { 2024-09-21T01:05:30.434 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_completed_events", 2024-09-21T01:05:30.434 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.434 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.434 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.435 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "50", 2024-09-21T01:05:30.435 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.435 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.435 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.435 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "number of past completed events to remember", 2024-09-21T01:05:30.435 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.435 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.435 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.435 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.435 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-21T01:05:30.435 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-21T01:05:30.435 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.435 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.435 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.436 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-21T01:05:30.436 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.436 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.436 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.436 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long the module is going to sleep", 2024-09-21T01:05:30.436 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.436 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.436 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.436 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.436 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.436 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.436 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.436 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.436 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.436 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.436 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.437 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.437 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.437 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.437 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.437 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.437 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.437 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.437 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.437 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.437 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.437 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus", 2024-09-21T01:05:30.437 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.437 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.437 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.437 INFO:teuthology.orchestra.run.smithi001.stdout: "cache": { 2024-09-21T01:05:30.438 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cache", 2024-09-21T01:05:30.438 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.438 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.438 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.438 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.438 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.438 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.438 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.438 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.438 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.438 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.438 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.438 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.438 INFO:teuthology.orchestra.run.smithi001.stdout: "exclude_perf_counters": { 2024-09-21T01:05:30.439 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "exclude_perf_counters", 2024-09-21T01:05:30.439 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.439 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.439 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.439 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.439 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.439 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.439 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.439 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T01:05:30.439 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T01:05:30.439 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.439 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.439 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.439 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.439 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.440 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.440 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.440 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.440 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.440 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.440 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.440 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.440 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.440 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.440 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.440 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.440 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.440 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.440 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.441 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.441 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.441 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.441 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.441 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.441 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.441 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.441 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.441 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.441 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.441 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.441 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.441 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.441 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.441 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.442 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.442 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.442 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.442 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.442 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.442 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.442 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.442 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.442 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.442 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.442 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.442 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.442 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.442 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.443 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.443 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.443 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.443 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.443 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.443 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.443 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.443 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.443 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.443 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.443 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.443 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.443 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.443 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.443 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.443 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.444 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.444 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.444 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.444 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.444 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.444 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.444 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.444 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.444 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.444 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools": { 2024-09-21T01:05:30.444 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools", 2024-09-21T01:05:30.444 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.444 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.444 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.445 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.445 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.445 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.445 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.445 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.445 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.445 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.445 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.445 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.445 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T01:05:30.445 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T01:05:30.445 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.445 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.445 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.445 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "300", 2024-09-21T01:05:30.446 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.446 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.446 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.446 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.446 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.446 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.446 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.446 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.446 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_interval": { 2024-09-21T01:05:30.446 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_interval", 2024-09-21T01:05:30.446 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-21T01:05:30.446 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.446 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.446 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15.0", 2024-09-21T01:05:30.446 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.447 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.447 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.447 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.447 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.447 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.447 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.447 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.447 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-21T01:05:30.447 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-21T01:05:30.447 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.447 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.447 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.447 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-09-21T01:05:30.448 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.448 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.448 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.448 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T01:05:30.448 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.448 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.448 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.448 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.448 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-21T01:05:30.448 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-21T01:05:30.448 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.448 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.448 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.448 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "9283", 2024-09-21T01:05:30.449 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.449 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.449 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.449 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T01:05:30.449 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.449 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.449 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.449 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.449 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.449 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.449 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.449 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.449 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.449 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.450 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.450 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.450 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.450 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.450 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.450 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.450 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.450 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.450 INFO:teuthology.orchestra.run.smithi001.stdout: "stale_cache_strategy": { 2024-09-21T01:05:30.450 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stale_cache_strategy", 2024-09-21T01:05:30.450 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.450 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.450 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.450 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "log", 2024-09-21T01:05:30.451 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.451 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.451 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.451 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.451 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.451 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.451 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.451 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.451 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-09-21T01:05:30.451 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-09-21T01:05:30.451 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.451 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.451 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.451 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "default", 2024-09-21T01:05:30.452 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.452 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.452 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.452 INFO:teuthology.orchestra.run.smithi001.stdout: "default", 2024-09-21T01:05:30.452 INFO:teuthology.orchestra.run.smithi001.stdout: "error" 2024-09-21T01:05:30.452 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.452 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.452 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.452 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.452 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.452 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.452 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-09-21T01:05:30.452 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-09-21T01:05:30.452 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.452 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.453 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.453 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-21T01:05:30.453 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-09-21T01:05:30.453 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-09-21T01:05:30.453 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.453 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.453 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.453 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.453 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.453 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.453 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.453 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.453 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.453 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_support", 2024-09-21T01:05:30.453 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.454 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.454 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.454 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.454 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.454 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.454 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.454 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.454 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.454 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.454 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.454 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.454 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.454 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.454 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.455 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.455 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.455 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.455 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.455 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.455 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.455 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.455 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.455 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.455 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.455 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.455 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.455 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.455 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.455 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.456 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.456 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.456 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.456 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.456 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.456 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.456 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.456 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.456 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.456 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.456 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.456 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.456 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.456 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.456 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.457 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.457 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.457 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.457 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.457 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.457 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.457 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.457 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.457 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.457 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.457 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.457 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.457 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.457 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.457 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.458 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.458 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.458 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.458 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.458 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.458 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.458 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.458 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.458 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.458 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.458 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.458 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.458 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.458 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_snap_create": { 2024-09-21T01:05:30.458 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_snap_create", 2024-09-21T01:05:30.459 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.459 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.459 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.459 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-21T01:05:30.459 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.459 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.459 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.459 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.459 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.459 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.459 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.459 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.459 INFO:teuthology.orchestra.run.smithi001.stdout: "mirror_snapshot_schedule": { 2024-09-21T01:05:30.459 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T01:05:30.459 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.460 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.460 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.460 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.460 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.460 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.460 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.460 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.460 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.460 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.460 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.460 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.460 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.460 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.460 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.461 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.461 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.461 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.461 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.461 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.461 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.461 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.461 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.461 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.461 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.461 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.461 INFO:teuthology.orchestra.run.smithi001.stdout: "trash_purge_schedule": { 2024-09-21T01:05:30.461 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "trash_purge_schedule", 2024-09-21T01:05:30.461 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.461 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.462 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.462 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.462 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.462 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.462 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.462 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.462 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.462 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.462 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.462 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.462 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.462 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.462 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.462 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "restful", 2024-09-21T01:05:30.463 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.463 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.463 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.463 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_auth": { 2024-09-21T01:05:30.463 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_auth", 2024-09-21T01:05:30.463 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.463 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.463 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.463 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.463 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.463 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.463 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.463 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.463 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.463 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.464 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.464 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.464 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-09-21T01:05:30.464 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-09-21T01:05:30.464 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.464 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.464 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.464 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.464 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.464 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.464 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.464 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.464 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.464 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.464 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.464 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.465 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.465 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.465 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.465 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.465 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.465 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.465 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.465 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.465 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.465 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.465 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.465 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.465 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.465 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.466 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.466 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.466 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.466 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.466 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.466 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.466 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.466 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.466 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.466 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.466 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.466 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.466 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.466 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.467 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.467 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.467 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.467 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.467 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.467 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.467 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.467 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.467 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.467 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.467 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.467 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.467 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.467 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.467 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.468 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.468 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.468 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.468 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.468 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.468 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.468 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.468 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.468 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.468 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.468 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.468 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.468 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.468 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.468 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.469 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.469 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.469 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.469 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.469 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.469 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.469 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.469 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.469 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.469 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.469 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.469 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.469 INFO:teuthology.orchestra.run.smithi001.stdout: "max_requests": { 2024-09-21T01:05:30.469 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_requests", 2024-09-21T01:05:30.469 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.470 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.470 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.470 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-21T01:05:30.470 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.470 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.470 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.470 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T01:05:30.470 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.470 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.470 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.470 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.470 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-21T01:05:30.470 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-21T01:05:30.470 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.471 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.471 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.471 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.471 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.471 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.471 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.471 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.471 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.471 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.471 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.471 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.471 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-21T01:05:30.471 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-21T01:05:30.471 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.471 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.472 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.472 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.472 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.472 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.472 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.472 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.472 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.472 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.472 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.472 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.472 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.472 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.472 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.472 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.472 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.472 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.473 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.473 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.473 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.473 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.473 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.473 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.473 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.473 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.473 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.473 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.473 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.473 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rgw", 2024-09-21T01:05:30.474 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.474 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.474 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.474 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.474 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.474 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.474 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.474 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.474 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.474 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.474 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.474 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.474 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.474 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.474 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.475 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.475 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.475 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.475 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.475 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.475 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.475 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.475 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.475 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.475 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.475 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.475 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.475 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.475 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.476 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.476 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.476 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.476 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.476 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.476 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.476 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.476 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.476 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.476 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.476 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.476 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.476 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.476 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.476 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.477 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.477 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.477 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.477 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.477 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.477 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.477 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.477 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.477 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.477 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.477 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.477 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.477 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.477 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.478 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.478 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.478 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.478 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.478 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.478 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.478 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.478 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.478 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.478 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.478 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.478 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.478 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.478 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.478 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.479 INFO:teuthology.orchestra.run.smithi001.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T01:05:30.479 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T01:05:30.479 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.479 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.479 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.479 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-21T01:05:30.479 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.479 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.479 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.479 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T01:05:30.479 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.479 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.479 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.479 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.479 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.480 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.480 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.480 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.480 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.480 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.480 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.480 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.480 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.480 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.480 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.480 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.480 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.480 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.480 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.480 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.481 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.481 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rook", 2024-09-21T01:05:30.481 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.481 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.481 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.481 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.481 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.481 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.481 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.481 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.481 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.481 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.481 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.481 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.481 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.482 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.482 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.482 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.482 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.482 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.482 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.482 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.482 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.482 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.482 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.482 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.482 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.482 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.482 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.482 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.483 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.483 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.483 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.483 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.483 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.483 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.483 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.483 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.483 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.483 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.483 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.483 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.483 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.483 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.484 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.484 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.484 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.484 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.484 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.484 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.484 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.484 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.484 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.484 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.484 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.484 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.484 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.484 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.484 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.485 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.485 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.485 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.485 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.485 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.485 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.485 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.485 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.485 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.485 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.485 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.485 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.485 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.485 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.485 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.485 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.486 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.486 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.486 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.486 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.486 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.486 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.486 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.486 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.486 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.486 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.486 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.486 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.486 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.487 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.487 INFO:teuthology.orchestra.run.smithi001.stdout: "storage_class": { 2024-09-21T01:05:30.487 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "storage_class", 2024-09-21T01:05:30.487 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.487 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.487 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.487 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "local", 2024-09-21T01:05:30.487 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.487 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.487 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.487 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T01:05:30.487 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.487 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.487 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.487 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.488 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.488 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.488 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.488 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "selftest", 2024-09-21T01:05:30.488 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.488 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.488 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.488 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.488 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.488 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.488 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.488 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.488 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.488 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.488 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.489 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.489 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.489 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.489 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.489 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.489 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.489 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.489 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.489 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.489 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.489 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.489 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.489 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.489 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.489 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.490 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.490 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.490 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.490 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.490 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.490 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.490 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.490 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.490 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.490 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.490 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.490 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.490 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.490 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.491 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.491 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.491 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.491 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.491 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.491 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.491 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.491 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.491 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.491 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.491 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.491 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.491 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.491 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.491 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.492 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.492 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.492 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.492 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.492 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.492 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.492 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.492 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.492 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.492 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.492 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.492 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.492 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.492 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.492 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.493 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.493 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.493 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.493 INFO:teuthology.orchestra.run.smithi001.stdout: "roption1": { 2024-09-21T01:05:30.493 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption1", 2024-09-21T01:05:30.493 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.493 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.493 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.493 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.493 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.493 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.493 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.493 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.493 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.493 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.494 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.494 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.494 INFO:teuthology.orchestra.run.smithi001.stdout: "roption2": { 2024-09-21T01:05:30.494 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption2", 2024-09-21T01:05:30.494 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.494 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.494 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.494 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "xyz", 2024-09-21T01:05:30.494 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.494 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.494 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.494 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.494 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.494 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.495 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.495 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.495 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption1": { 2024-09-21T01:05:30.495 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption1", 2024-09-21T01:05:30.495 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.495 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.495 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.495 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.497 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.497 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.497 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.497 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.497 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.497 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.498 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.498 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.498 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption2": { 2024-09-21T01:05:30.498 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption2", 2024-09-21T01:05:30.498 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.498 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.498 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.498 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.498 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.498 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.498 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.498 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.498 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.498 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.498 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.499 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.499 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption3": { 2024-09-21T01:05:30.499 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption3", 2024-09-21T01:05:30.499 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-21T01:05:30.499 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.499 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.499 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.499 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.499 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.499 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.499 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.499 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.499 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.499 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.499 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.499 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption4": { 2024-09-21T01:05:30.500 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption4", 2024-09-21T01:05:30.500 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.500 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.500 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.500 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.500 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.500 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.500 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.500 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.500 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.500 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.500 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.500 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.500 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption5": { 2024-09-21T01:05:30.500 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption5", 2024-09-21T01:05:30.500 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.501 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.501 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.501 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.501 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.501 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.501 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.501 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.501 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.501 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.501 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.501 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.501 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption6": { 2024-09-21T01:05:30.501 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption6", 2024-09-21T01:05:30.501 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.502 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.502 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.502 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.502 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.502 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.502 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.502 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.502 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.502 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.502 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.502 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.502 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption7": { 2024-09-21T01:05:30.502 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption7", 2024-09-21T01:05:30.502 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.502 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.503 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.503 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.503 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-21T01:05:30.503 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "42", 2024-09-21T01:05:30.503 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.503 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.503 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.503 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.503 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.503 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.503 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.503 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.503 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.503 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.504 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.504 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.504 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.504 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.504 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.504 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.504 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.504 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.504 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.504 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.504 INFO:teuthology.orchestra.run.smithi001.stdout: "testkey": { 2024-09-21T01:05:30.504 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testkey", 2024-09-21T01:05:30.504 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.504 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.504 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.505 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.505 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.505 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.505 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.505 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.505 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.505 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.505 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.505 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.505 INFO:teuthology.orchestra.run.smithi001.stdout: "testlkey": { 2024-09-21T01:05:30.505 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testlkey", 2024-09-21T01:05:30.505 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.505 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.505 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.505 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.505 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.506 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.506 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.506 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.506 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.506 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.506 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.506 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.506 INFO:teuthology.orchestra.run.smithi001.stdout: "testnewline": { 2024-09-21T01:05:30.506 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testnewline", 2024-09-21T01:05:30.506 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.506 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.506 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.506 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.506 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.507 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.507 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.507 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.507 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.507 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.507 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.507 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.507 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.507 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.507 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.507 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smb", 2024-09-21T01:05:30.507 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.507 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.507 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.507 INFO:teuthology.orchestra.run.smithi001.stdout: "internal_store_backend": { 2024-09-21T01:05:30.508 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "internal_store_backend", 2024-09-21T01:05:30.508 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.508 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.508 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.508 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.508 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.508 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.508 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.508 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T01:05:30.508 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.508 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.508 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.508 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.508 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.508 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.509 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.509 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.509 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.509 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.509 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.509 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.509 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.509 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.509 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.509 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.509 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.509 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.509 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.509 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.509 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.509 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.510 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.510 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.510 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.510 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.510 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.510 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.510 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.510 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.510 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.510 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.510 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.510 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.510 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.510 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.510 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.511 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.511 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.511 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.511 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.511 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.511 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.511 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.511 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.511 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.511 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.511 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.511 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.511 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.511 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.511 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.512 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.512 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.512 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.512 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.512 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.512 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.512 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.512 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.512 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.512 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.512 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.512 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.512 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.512 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.512 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.513 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.513 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.513 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.513 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.513 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.513 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.513 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.513 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.513 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.513 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.513 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.513 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.513 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.513 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.513 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.513 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.514 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.514 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.514 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.514 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.514 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.514 INFO:teuthology.orchestra.run.smithi001.stdout: "update_orchestration": { 2024-09-21T01:05:30.514 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "update_orchestration", 2024-09-21T01:05:30.514 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.514 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.514 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.514 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.514 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.514 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.514 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.515 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T01:05:30.515 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.515 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.515 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.515 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.515 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.515 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.515 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.515 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snap_schedule", 2024-09-21T01:05:30.515 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.515 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.515 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.515 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_m_granularity": { 2024-09-21T01:05:30.515 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_m_granularity", 2024-09-21T01:05:30.515 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.516 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.516 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.516 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.516 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.516 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.516 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.516 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T01:05:30.516 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.516 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.516 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.516 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.516 INFO:teuthology.orchestra.run.smithi001.stdout: "dump_on_update": { 2024-09-21T01:05:30.516 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dump_on_update", 2024-09-21T01:05:30.516 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.516 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.517 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.517 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.517 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.517 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.517 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.517 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "dump database to debug log on update", 2024-09-21T01:05:30.517 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.517 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.517 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.517 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.517 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.517 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.517 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.517 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.517 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.518 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.518 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.518 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.518 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.518 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.518 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.518 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.518 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.518 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.518 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.518 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.518 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.518 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.518 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.519 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.519 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.519 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.519 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.519 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.519 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.519 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.519 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.519 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.519 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.519 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.519 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.519 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.519 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.519 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.520 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.520 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.520 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.520 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.520 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.520 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.520 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.520 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.520 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.520 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.520 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.520 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.520 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.520 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.520 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.521 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.521 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.521 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.521 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.521 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.521 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.521 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.521 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.521 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.521 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.521 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.521 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.521 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.521 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.521 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.522 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.522 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.522 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.522 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.522 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.522 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.522 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.522 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.522 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.522 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.522 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.522 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.522 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.522 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.523 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.523 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.523 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.523 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.523 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.523 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.523 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.523 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.523 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.523 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stats", 2024-09-21T01:05:30.523 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.523 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.523 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.523 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.523 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.524 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.524 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.524 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.524 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.524 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.524 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.524 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.524 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.524 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.524 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.524 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.524 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.524 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.524 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.524 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.524 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.525 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.525 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.525 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.525 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.525 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.525 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.525 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.525 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.525 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.525 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.525 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.525 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.525 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.525 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.526 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.526 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.526 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.526 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.526 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.526 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.526 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.526 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.526 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.526 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.526 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.526 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.526 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.526 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.526 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.527 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.527 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.527 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.527 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.527 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.527 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.527 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.527 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.527 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.527 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.527 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.527 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.527 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.527 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.528 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.528 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.528 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.528 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.528 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.528 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.528 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.528 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.528 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.528 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.528 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.528 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.528 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.528 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.528 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.529 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.529 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.529 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.529 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.529 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.529 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.529 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.529 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.529 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.529 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.529 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.529 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "status", 2024-09-21T01:05:30.529 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.529 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.529 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.530 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.530 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.530 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.530 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.530 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.530 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.530 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.530 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.530 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.530 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.530 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.530 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.530 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.530 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.530 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.531 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.531 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.531 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.531 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.531 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.531 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.531 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.531 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.531 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.531 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.531 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.531 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.531 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.531 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.532 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.532 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.532 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.532 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.532 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.532 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.532 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.532 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.532 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.532 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.532 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.532 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.532 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.532 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.532 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.533 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.533 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.533 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.533 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.533 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.533 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.533 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.533 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.533 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.533 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.533 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.533 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.533 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.533 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.533 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.534 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.534 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.534 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.534 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.534 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.534 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.534 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.534 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.534 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.534 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.534 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.534 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.534 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.534 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.534 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.535 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.535 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.535 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.535 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.535 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.535 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.535 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.535 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.535 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.535 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.535 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.535 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.535 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.535 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telegraf", 2024-09-21T01:05:30.535 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.536 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.536 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.536 INFO:teuthology.orchestra.run.smithi001.stdout: "address": { 2024-09-21T01:05:30.536 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "address", 2024-09-21T01:05:30.536 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.536 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.536 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.536 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T01:05:30.536 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.536 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.536 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.536 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.536 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.536 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.536 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.537 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.537 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-21T01:05:30.537 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-21T01:05:30.537 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.537 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.537 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.537 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15", 2024-09-21T01:05:30.537 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.537 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.537 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.537 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.537 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.537 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.537 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.538 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.538 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.538 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.538 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.538 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.538 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.538 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.538 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.538 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.538 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.538 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.538 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.538 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.538 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.538 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.539 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.539 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.539 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.539 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.539 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.539 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.539 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.539 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.539 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.539 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.539 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.539 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.539 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.539 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.539 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.540 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.540 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.540 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.540 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.540 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.540 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.540 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.540 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.540 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.540 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.540 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.540 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.540 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.540 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.541 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.541 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.541 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.541 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.541 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.541 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.541 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.541 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.541 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.541 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.541 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.541 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.541 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.541 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.541 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.542 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.542 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.542 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.542 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.542 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.542 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.542 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.542 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.542 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.542 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.542 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.542 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.542 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.542 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.542 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.543 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.543 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.543 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.543 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.543 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.543 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.543 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.543 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.543 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.543 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.543 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.543 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.543 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.544 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.544 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telemetry", 2024-09-21T01:05:30.544 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.544 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.544 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.544 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_basic": { 2024-09-21T01:05:30.544 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_basic", 2024-09-21T01:05:30.544 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.544 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.544 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.544 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.544 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.544 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.544 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.544 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T01:05:30.545 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.545 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.545 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.545 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.545 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_crash": { 2024-09-21T01:05:30.545 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_crash", 2024-09-21T01:05:30.545 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.545 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.545 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.545 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.545 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.545 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.545 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.545 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T01:05:30.545 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.546 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.546 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.546 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.546 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_device": { 2024-09-21T01:05:30.546 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_device", 2024-09-21T01:05:30.546 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.546 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.546 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.546 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.546 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.546 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.546 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.546 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T01:05:30.546 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.546 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.547 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.547 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.547 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_ident": { 2024-09-21T01:05:30.547 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_ident", 2024-09-21T01:05:30.547 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.547 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.547 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.547 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.547 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.547 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.547 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.547 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T01:05:30.547 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.547 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.548 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.548 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.548 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_perf": { 2024-09-21T01:05:30.548 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_perf", 2024-09-21T01:05:30.548 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.548 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.548 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.548 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.548 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.548 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.548 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.548 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T01:05:30.548 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.548 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.548 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.549 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.549 INFO:teuthology.orchestra.run.smithi001.stdout: "contact": { 2024-09-21T01:05:30.549 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "contact", 2024-09-21T01:05:30.549 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.549 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.549 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.549 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.549 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.549 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.549 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.549 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.549 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.549 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.549 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.549 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.550 INFO:teuthology.orchestra.run.smithi001.stdout: "description": { 2024-09-21T01:05:30.550 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "description", 2024-09-21T01:05:30.550 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.550 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.550 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.550 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.550 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.550 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.550 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.550 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.550 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.550 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.550 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.550 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.551 INFO:teuthology.orchestra.run.smithi001.stdout: "device_url": { 2024-09-21T01:05:30.551 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_url", 2024-09-21T01:05:30.551 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.551 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.551 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.551 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T01:05:30.551 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.551 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.551 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.551 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.551 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.551 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.551 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.551 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.551 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-09-21T01:05:30.552 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-09-21T01:05:30.552 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.552 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.552 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.552 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.552 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.552 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.552 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.552 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.552 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.552 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.552 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.552 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.552 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-21T01:05:30.552 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-21T01:05:30.553 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.553 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.553 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.553 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "24", 2024-09-21T01:05:30.553 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "8", 2024-09-21T01:05:30.553 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.553 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.553 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.553 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.553 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.553 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.553 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.553 INFO:teuthology.orchestra.run.smithi001.stdout: "last_opt_revision": { 2024-09-21T01:05:30.553 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "last_opt_revision", 2024-09-21T01:05:30.554 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.554 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.554 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.554 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1", 2024-09-21T01:05:30.554 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.554 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.554 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.554 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.554 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.554 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.554 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.554 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.554 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard": { 2024-09-21T01:05:30.554 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard", 2024-09-21T01:05:30.555 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.555 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.555 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.555 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.555 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.555 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.555 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.555 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.555 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.555 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.555 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.555 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.555 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard_description": { 2024-09-21T01:05:30.555 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard_description", 2024-09-21T01:05:30.555 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.556 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.556 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.556 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.556 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.556 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.556 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.556 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.556 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.556 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.556 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.556 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.556 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.556 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.556 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.557 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.557 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.557 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.557 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.557 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.557 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.557 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.557 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.557 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.557 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.557 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.557 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.557 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.557 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.557 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.558 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.558 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.558 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.558 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.558 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.558 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.558 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.558 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.558 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.558 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.558 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.558 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.558 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.558 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.559 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.559 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.559 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.559 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.559 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.559 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.559 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.559 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.559 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.559 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.559 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.559 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.559 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.559 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.560 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.560 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.560 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.560 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.560 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.560 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.560 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.560 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.560 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.560 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.560 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.560 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.560 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.560 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.560 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.561 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.561 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.561 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.561 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.561 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.561 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.561 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.561 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.561 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.561 INFO:teuthology.orchestra.run.smithi001.stdout: "organization": { 2024-09-21T01:05:30.561 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "organization", 2024-09-21T01:05:30.561 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.561 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.561 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.562 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.562 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.562 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.562 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.562 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.562 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.562 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.562 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.562 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.562 INFO:teuthology.orchestra.run.smithi001.stdout: "proxy": { 2024-09-21T01:05:30.562 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "proxy", 2024-09-21T01:05:30.562 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.562 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.562 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.563 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.563 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.563 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.563 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.563 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.563 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.563 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.563 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.563 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.563 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.563 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.563 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.563 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.563 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.564 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.564 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.564 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.564 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.564 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.564 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.564 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.564 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.564 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.564 INFO:teuthology.orchestra.run.smithi001.stdout: "url": { 2024-09-21T01:05:30.564 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url", 2024-09-21T01:05:30.564 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.564 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.564 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.564 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T01:05:30.565 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.565 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.565 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.565 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.565 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.565 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.565 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.565 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.565 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.565 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.565 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.565 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "test_orchestrator", 2024-09-21T01:05:30.565 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.565 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.565 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.566 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.566 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.566 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.566 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.566 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.566 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.566 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.566 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.566 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.566 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.566 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.566 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.566 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.566 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.567 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.567 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.567 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.567 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.567 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.567 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.567 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.567 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.567 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.567 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.567 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.567 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.567 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.568 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.568 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.568 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.568 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.568 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.568 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.568 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.568 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.568 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.568 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.568 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.568 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.568 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.568 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.568 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.569 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.569 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.569 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.569 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.569 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.569 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.569 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.569 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.569 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.569 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.569 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.569 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.569 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.570 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.570 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.570 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.570 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.570 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.570 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.570 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.570 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.570 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.570 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.570 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.570 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.570 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.570 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.570 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.571 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.571 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.571 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.571 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.571 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.571 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.571 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.571 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.571 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.571 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.571 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.571 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.571 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.571 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.572 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.572 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.572 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.572 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "volumes", 2024-09-21T01:05:30.572 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.572 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.572 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.572 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.572 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.572 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.572 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.572 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.572 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.572 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.572 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.573 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.573 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.573 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.573 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.573 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.573 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.573 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.573 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.573 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.573 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.573 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.573 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.573 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.573 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.573 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.573 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.574 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.574 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.574 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.574 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.574 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.574 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.574 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.574 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.574 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.574 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.574 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.574 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.574 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.574 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.574 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.575 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.575 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.575 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.575 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.575 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.575 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.575 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.575 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.575 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.575 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.575 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.575 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.575 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.575 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.575 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.576 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.576 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.576 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.576 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.576 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.576 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.576 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.576 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.576 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.576 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.576 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.576 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.576 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.576 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.576 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.577 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.577 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_clones": { 2024-09-21T01:05:30.577 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_clones", 2024-09-21T01:05:30.577 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.577 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.577 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.577 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4", 2024-09-21T01:05:30.577 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.577 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.577 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.577 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T01:05:30.577 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.577 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.577 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.577 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.577 INFO:teuthology.orchestra.run.smithi001.stdout: "periodic_async_work": { 2024-09-21T01:05:30.578 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "periodic_async_work", 2024-09-21T01:05:30.578 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.578 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.578 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.578 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.578 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.578 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.578 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.578 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Periodically check for async work", 2024-09-21T01:05:30.578 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.578 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.578 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.578 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.578 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_delay": { 2024-09-21T01:05:30.579 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_delay", 2024-09-21T01:05:30.579 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.579 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.579 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.579 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.579 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.579 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.579 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.579 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T01:05:30.579 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.579 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.579 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.579 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.579 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_no_wait": { 2024-09-21T01:05:30.579 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T01:05:30.580 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.580 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.580 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.580 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.580 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.580 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.580 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.580 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T01:05:30.580 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.580 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.580 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.580 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.580 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.581 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.581 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.581 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.581 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.581 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.581 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.581 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.581 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.581 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.581 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.581 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.581 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.581 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.581 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.581 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.582 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.582 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix", 2024-09-21T01:05:30.582 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.582 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.582 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.582 INFO:teuthology.orchestra.run.smithi001.stdout: "discovery_interval": { 2024-09-21T01:05:30.582 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "discovery_interval", 2024-09-21T01:05:30.582 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-21T01:05:30.582 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.582 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.582 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "100", 2024-09-21T01:05:30.582 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.582 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.582 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.582 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.583 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.583 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.583 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.583 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.583 INFO:teuthology.orchestra.run.smithi001.stdout: "identifier": { 2024-09-21T01:05:30.583 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "identifier", 2024-09-21T01:05:30.583 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.583 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.583 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.583 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.583 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.583 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.583 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.583 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.584 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.584 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.584 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.584 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.584 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-21T01:05:30.584 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-21T01:05:30.584 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.584 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.584 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.584 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-21T01:05:30.584 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.584 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.584 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.584 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.584 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.585 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.585 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.585 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.585 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.585 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.585 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.585 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.585 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.585 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.585 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.585 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.585 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.585 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.585 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.585 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.586 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.586 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.586 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.586 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.586 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.586 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.586 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.586 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.586 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.586 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.586 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.586 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.586 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.586 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.587 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.587 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.587 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.587 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.587 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.587 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.587 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.587 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.587 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.587 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.587 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.587 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.587 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.587 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.587 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.588 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.588 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.588 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.588 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.588 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.588 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.588 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.588 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.588 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.588 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.588 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.588 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.588 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.588 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.588 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.589 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.589 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.589 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.589 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.589 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.589 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.589 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.589 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.589 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.589 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.589 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.589 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.589 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.589 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.589 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.590 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.590 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.590 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.590 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.590 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.590 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.590 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.590 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.590 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.590 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.590 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.590 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.590 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.590 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_host": { 2024-09-21T01:05:30.590 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_host", 2024-09-21T01:05:30.591 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.591 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.591 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.591 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.591 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.591 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.591 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.591 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.591 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.591 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.591 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.591 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.591 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_port": { 2024-09-21T01:05:30.591 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_port", 2024-09-21T01:05:30.591 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.592 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.592 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.592 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10051", 2024-09-21T01:05:30.592 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.592 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.592 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.592 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.592 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.592 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.592 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.592 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.592 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_sender": { 2024-09-21T01:05:30.592 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_sender", 2024-09-21T01:05:30.592 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.592 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.592 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.593 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T01:05:30.593 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.593 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.593 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.593 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.593 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.593 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.593 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.593 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.593 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.593 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.593 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-21T01:05:30.593 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.594 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.594 INFO:teuthology.orchestra.run.smithi001.stdout: "gid": 24134, 2024-09-21T01:05:30.594 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "y", 2024-09-21T01:05:30.594 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_features": 4540719139924082687, 2024-09-21T01:05:30.594 INFO:teuthology.orchestra.run.smithi001.stdout: "available_modules": [ 2024-09-21T01:05:30.594 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.594 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "alerts", 2024-09-21T01:05:30.594 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.594 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.594 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.594 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-21T01:05:30.594 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-21T01:05:30.594 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.594 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.594 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.595 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-21T01:05:30.595 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.595 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.595 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.595 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T01:05:30.595 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.595 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.595 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.595 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.595 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.595 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.595 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.595 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.595 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.595 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.595 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.596 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.596 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.596 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.596 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.596 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.596 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.596 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.596 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.596 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.596 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.596 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.596 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.596 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.596 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.596 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.597 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.597 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.597 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.597 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.597 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.597 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.597 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.597 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.597 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.597 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.597 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.597 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.597 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.597 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.597 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.598 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.598 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.598 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.598 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.598 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.598 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.598 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.598 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.598 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.598 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.598 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.598 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.598 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.598 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.598 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.599 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.599 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.599 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.599 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.599 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.599 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.599 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.599 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.599 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.599 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.599 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.599 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.599 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.599 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.600 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.600 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.600 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.600 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.600 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_destination": { 2024-09-21T01:05:30.600 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_destination", 2024-09-21T01:05:30.600 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.600 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.600 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.600 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.600 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.600 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.600 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.600 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T01:05:30.600 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.601 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.601 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.601 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.601 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_from_name": { 2024-09-21T01:05:30.601 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_from_name", 2024-09-21T01:05:30.601 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.601 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.601 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.601 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "Ceph", 2024-09-21T01:05:30.601 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.601 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.601 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.601 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email From: name", 2024-09-21T01:05:30.601 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.601 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.602 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.602 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.602 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_host": { 2024-09-21T01:05:30.602 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_host", 2024-09-21T01:05:30.602 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.602 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.602 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.602 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.602 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.602 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.602 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.602 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP server", 2024-09-21T01:05:30.602 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.602 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.602 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.603 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.603 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_password": { 2024-09-21T01:05:30.603 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_password", 2024-09-21T01:05:30.603 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.603 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.603 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.603 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.603 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.603 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.603 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.603 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Password to authenticate with", 2024-09-21T01:05:30.603 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.603 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.603 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.603 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.603 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_port": { 2024-09-21T01:05:30.604 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_port", 2024-09-21T01:05:30.604 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.604 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.604 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.604 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "465", 2024-09-21T01:05:30.604 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.604 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.604 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.604 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP port", 2024-09-21T01:05:30.604 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.604 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.604 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.604 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.604 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_sender": { 2024-09-21T01:05:30.604 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_sender", 2024-09-21T01:05:30.605 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.605 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.605 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.605 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.605 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.605 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.605 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.605 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP envelope sender", 2024-09-21T01:05:30.605 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.605 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.605 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.605 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.605 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_ssl": { 2024-09-21T01:05:30.605 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_ssl", 2024-09-21T01:05:30.605 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.606 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.606 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.606 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.606 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.606 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.606 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.606 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T01:05:30.606 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.606 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.606 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.606 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.606 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_user": { 2024-09-21T01:05:30.606 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_user", 2024-09-21T01:05:30.607 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.607 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.607 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.607 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.607 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.607 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.607 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.607 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "User to authenticate as", 2024-09-21T01:05:30.607 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.607 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.607 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.607 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.607 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.607 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.607 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.608 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.608 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.608 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.608 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.608 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.608 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.608 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.608 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.608 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.608 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.608 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.608 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.608 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.608 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.609 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "balancer", 2024-09-21T01:05:30.609 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.609 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.609 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.609 INFO:teuthology.orchestra.run.smithi001.stdout: "active": { 2024-09-21T01:05:30.609 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "active", 2024-09-21T01:05:30.609 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.609 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.609 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.609 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.609 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.609 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.609 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.609 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T01:05:30.610 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.610 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.610 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.610 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.610 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_time": { 2024-09-21T01:05:30.610 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_time", 2024-09-21T01:05:30.610 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.610 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.610 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.610 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0000", 2024-09-21T01:05:30.610 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.610 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.610 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.610 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T01:05:30.610 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T01:05:30.611 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.611 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.611 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.611 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_weekday": { 2024-09-21T01:05:30.611 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_weekday", 2024-09-21T01:05:30.611 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-21T01:05:30.611 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.611 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.611 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.611 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-09-21T01:05:30.611 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-09-21T01:05:30.611 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.611 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T01:05:30.611 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T01:05:30.612 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.612 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.612 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.612 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_max_iterations": { 2024-09-21T01:05:30.612 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_max_iterations", 2024-09-21T01:05:30.612 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-21T01:05:30.612 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.612 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.612 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "25", 2024-09-21T01:05:30.612 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-21T01:05:30.612 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "250", 2024-09-21T01:05:30.612 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.612 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T01:05:30.612 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.612 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.613 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.613 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.613 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_metrics": { 2024-09-21T01:05:30.613 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_metrics", 2024-09-21T01:05:30.613 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.613 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.613 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.613 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T01:05:30.613 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.613 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.613 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.613 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T01:05:30.613 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T01:05:30.613 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.614 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.614 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.614 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_step": { 2024-09-21T01:05:30.614 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_step", 2024-09-21T01:05:30.614 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-21T01:05:30.614 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.614 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.614 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.5", 2024-09-21T01:05:30.614 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0.001", 2024-09-21T01:05:30.614 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "0.999", 2024-09-21T01:05:30.614 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.614 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "aggressiveness of optimization", 2024-09-21T01:05:30.614 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T01:05:30.614 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.614 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.615 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.615 INFO:teuthology.orchestra.run.smithi001.stdout: "end_time": { 2024-09-21T01:05:30.615 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_time", 2024-09-21T01:05:30.615 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.615 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.615 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.615 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2359", 2024-09-21T01:05:30.615 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.615 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.615 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.615 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T01:05:30.615 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T01:05:30.615 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.615 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.615 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.616 INFO:teuthology.orchestra.run.smithi001.stdout: "end_weekday": { 2024-09-21T01:05:30.616 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_weekday", 2024-09-21T01:05:30.616 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-21T01:05:30.616 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.616 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.616 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.616 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-09-21T01:05:30.616 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-09-21T01:05:30.616 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.616 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T01:05:30.616 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T01:05:30.616 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.616 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.616 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.616 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.617 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.617 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.617 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.617 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.617 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.617 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.617 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.617 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.617 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.617 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.617 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.617 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.617 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.617 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.617 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.618 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.618 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.618 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.618 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.618 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.618 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.618 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.618 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.618 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.618 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.618 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.618 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.618 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.618 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.619 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.619 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.619 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.619 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.619 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.619 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.619 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.619 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.619 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.619 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.619 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.619 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.619 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.619 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.619 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.620 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.620 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.620 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.620 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.620 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.620 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.620 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.620 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.620 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.620 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.620 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.620 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.620 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.620 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.620 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.621 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.621 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.621 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.621 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.621 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.621 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.621 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.621 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.621 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.621 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.621 INFO:teuthology.orchestra.run.smithi001.stdout: "min_score": { 2024-09-21T01:05:30.621 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_score", 2024-09-21T01:05:30.621 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-21T01:05:30.621 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.621 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.622 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.622 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.622 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.622 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.622 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T01:05:30.622 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.622 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.622 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.622 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.622 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-09-21T01:05:30.622 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-09-21T01:05:30.622 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.622 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.622 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.622 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "upmap", 2024-09-21T01:05:30.623 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.623 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.623 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.623 INFO:teuthology.orchestra.run.smithi001.stdout: "crush-compat", 2024-09-21T01:05:30.623 INFO:teuthology.orchestra.run.smithi001.stdout: "none", 2024-09-21T01:05:30.623 INFO:teuthology.orchestra.run.smithi001.stdout: "read", 2024-09-21T01:05:30.623 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap", 2024-09-21T01:05:30.623 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap-read" 2024-09-21T01:05:30.623 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.623 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Balancer mode", 2024-09-21T01:05:30.623 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.623 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.623 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.623 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.623 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_ids": { 2024-09-21T01:05:30.624 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_ids", 2024-09-21T01:05:30.624 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.624 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.624 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.624 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.624 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.624 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.624 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.624 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T01:05:30.624 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.624 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.624 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.624 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.624 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-21T01:05:30.624 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-21T01:05:30.625 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.625 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.625 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.625 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-21T01:05:30.625 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.625 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.625 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.625 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T01:05:30.625 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.625 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.625 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.625 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.625 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.625 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.625 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.626 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.626 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.626 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.626 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.626 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.626 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.626 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.626 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.626 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.626 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.626 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.626 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_deviation": { 2024-09-21T01:05:30.626 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_deviation", 2024-09-21T01:05:30.626 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.627 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.627 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.627 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-21T01:05:30.627 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-21T01:05:30.627 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.627 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.627 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T01:05:30.627 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T01:05:30.627 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.627 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.627 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.627 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_optimizations": { 2024-09-21T01:05:30.627 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_optimizations", 2024-09-21T01:05:30.627 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-21T01:05:30.627 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.627 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.628 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-21T01:05:30.628 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.628 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.628 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.628 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T01:05:30.628 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.628 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.628 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.628 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.628 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.628 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.628 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.628 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm", 2024-09-21T01:05:30.628 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.628 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.629 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.629 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_down_multiplier": { 2024-09-21T01:05:30.629 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_down_multiplier", 2024-09-21T01:05:30.629 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-21T01:05:30.629 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.629 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.629 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-09-21T01:05:30.629 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.629 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.629 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.629 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T01:05:30.629 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.629 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.629 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.629 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.630 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_refresh_rate": { 2024-09-21T01:05:30.630 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_refresh_rate", 2024-09-21T01:05:30.630 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.630 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.630 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.630 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "20", 2024-09-21T01:05:30.630 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.630 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.630 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.630 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T01:05:30.630 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.630 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.630 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.631 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.631 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_starting_port": { 2024-09-21T01:05:30.631 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_starting_port", 2024-09-21T01:05:30.631 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.631 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.631 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.631 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4721", 2024-09-21T01:05:30.631 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.631 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.631 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.631 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T01:05:30.631 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.631 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.631 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.631 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.631 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_ptrace": { 2024-09-21T01:05:30.632 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_ptrace", 2024-09-21T01:05:30.632 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.632 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.632 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.632 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.632 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.632 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.632 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.632 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T01:05:30.632 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T01:05:30.632 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.632 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.632 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.632 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_interval": { 2024-09-21T01:05:30.633 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_interval", 2024-09-21T01:05:30.633 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.633 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.633 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.633 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-21T01:05:30.633 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.633 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.633 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.633 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T01:05:30.633 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.633 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.633 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.633 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.633 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_memory_target_ratio": { 2024-09-21T01:05:30.633 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T01:05:30.634 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-21T01:05:30.634 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.634 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.634 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.7", 2024-09-21T01:05:30.634 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.634 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.634 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.634 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T01:05:30.634 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.634 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.634 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.634 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.634 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm_log_destination": { 2024-09-21T01:05:30.634 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm_log_destination", 2024-09-21T01:05:30.634 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.635 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.635 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.635 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.635 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.635 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.635 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.635 INFO:teuthology.orchestra.run.smithi001.stdout: "file", 2024-09-21T01:05:30.635 INFO:teuthology.orchestra.run.smithi001.stdout: "file,syslog", 2024-09-21T01:05:30.635 INFO:teuthology.orchestra.run.smithi001.stdout: "syslog" 2024-09-21T01:05:30.635 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.635 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T01:05:30.635 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.635 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.635 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.636 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.636 INFO:teuthology.orchestra.run.smithi001.stdout: "cgroups_split": { 2024-09-21T01:05:30.636 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cgroups_split", 2024-09-21T01:05:30.636 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.636 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.636 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.636 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.636 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.636 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.636 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.636 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T01:05:30.636 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.636 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.636 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.636 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.636 INFO:teuthology.orchestra.run.smithi001.stdout: "config_checks_enabled": { 2024-09-21T01:05:30.637 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_checks_enabled", 2024-09-21T01:05:30.637 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.637 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.637 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.637 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.637 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.637 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.637 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.637 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T01:05:30.637 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.637 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.637 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.637 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.637 INFO:teuthology.orchestra.run.smithi001.stdout: "config_dashboard": { 2024-09-21T01:05:30.637 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_dashboard", 2024-09-21T01:05:30.638 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.638 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.638 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.638 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.638 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.638 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.638 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.638 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T01:05:30.638 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.638 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.638 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.638 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.638 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_alertmanager": { 2024-09-21T01:05:30.638 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_alertmanager", 2024-09-21T01:05:30.638 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.639 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.639 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.639 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T01:05:30.639 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.639 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.639 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.639 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-21T01:05:30.639 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.639 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.639 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.639 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.639 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_base": { 2024-09-21T01:05:30.639 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_base", 2024-09-21T01:05:30.639 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.639 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.640 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.640 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T01:05:30.640 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.640 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.640 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.640 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Container image name, without the tag", 2024-09-21T01:05:30.640 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.640 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.640 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.640 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.640 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_elasticsearch": { 2024-09-21T01:05:30.640 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_elasticsearch", 2024-09-21T01:05:30.640 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.640 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.640 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.641 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T01:05:30.641 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.641 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.641 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.641 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "elasticsearch container image", 2024-09-21T01:05:30.641 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.641 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.641 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.641 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.641 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_grafana": { 2024-09-21T01:05:30.641 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_grafana", 2024-09-21T01:05:30.641 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.641 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.641 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.642 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T01:05:30.642 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.642 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.642 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.642 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-21T01:05:30.642 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.642 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.642 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.642 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.642 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_haproxy": { 2024-09-21T01:05:30.642 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_haproxy", 2024-09-21T01:05:30.642 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.642 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.642 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.643 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T01:05:30.643 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.643 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.643 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.643 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "HAproxy container image", 2024-09-21T01:05:30.643 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.643 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.643 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.643 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.643 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_agent": { 2024-09-21T01:05:30.643 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_agent", 2024-09-21T01:05:30.643 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.643 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.643 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.644 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T01:05:30.644 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.644 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.644 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.644 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger agent container image", 2024-09-21T01:05:30.644 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.644 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.644 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.644 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.644 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_collector": { 2024-09-21T01:05:30.644 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_collector", 2024-09-21T01:05:30.644 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.644 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.644 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.644 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T01:05:30.645 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.645 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.645 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.645 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger collector container image", 2024-09-21T01:05:30.645 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.645 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.645 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.645 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.645 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_query": { 2024-09-21T01:05:30.645 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_query", 2024-09-21T01:05:30.645 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.645 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.645 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.645 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T01:05:30.645 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.646 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.646 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.646 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger query container image", 2024-09-21T01:05:30.646 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.646 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.646 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.646 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.646 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_keepalived": { 2024-09-21T01:05:30.646 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_keepalived", 2024-09-21T01:05:30.646 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.646 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.646 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.646 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T01:05:30.646 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.646 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.647 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.647 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Keepalived container image", 2024-09-21T01:05:30.647 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.647 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.647 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.647 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.647 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_loki": { 2024-09-21T01:05:30.647 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_loki", 2024-09-21T01:05:30.647 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.647 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.647 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.647 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T01:05:30.647 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.647 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.648 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.648 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Loki container image", 2024-09-21T01:05:30.648 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.648 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.648 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.648 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.648 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_nginx": { 2024-09-21T01:05:30.648 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_nginx", 2024-09-21T01:05:30.648 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.648 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.648 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.648 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T01:05:30.648 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.648 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.648 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.649 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Nginx container image", 2024-09-21T01:05:30.649 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.649 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.649 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.649 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.649 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_node_exporter": { 2024-09-21T01:05:30.649 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_node_exporter", 2024-09-21T01:05:30.649 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.649 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.649 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.649 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T01:05:30.649 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.649 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.649 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.649 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-21T01:05:30.650 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.650 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.650 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.650 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.650 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_nvmeof": { 2024-09-21T01:05:30.650 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_nvmeof", 2024-09-21T01:05:30.650 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.650 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.650 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.650 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T01:05:30.650 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.650 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.650 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.650 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Nvme-of container image", 2024-09-21T01:05:30.650 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.651 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.651 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.651 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.651 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_oauth2_proxy": { 2024-09-21T01:05:30.651 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T01:05:30.651 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.651 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.651 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.651 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T01:05:30.651 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.651 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.651 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.651 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "oauth2-proxy container image", 2024-09-21T01:05:30.651 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.651 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.652 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.652 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.652 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_prometheus": { 2024-09-21T01:05:30.652 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_prometheus", 2024-09-21T01:05:30.652 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.652 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.652 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.652 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T01:05:30.652 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.652 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.652 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.652 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-21T01:05:30.652 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.652 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.652 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.653 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.653 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_promtail": { 2024-09-21T01:05:30.653 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_promtail", 2024-09-21T01:05:30.653 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.653 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.653 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.653 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T01:05:30.653 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.653 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.653 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.653 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Promtail container image", 2024-09-21T01:05:30.653 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.653 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.653 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.654 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.654 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_samba": { 2024-09-21T01:05:30.654 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_samba", 2024-09-21T01:05:30.654 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.654 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.654 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.654 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T01:05:30.654 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.654 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.654 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.654 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Samba/SMB container image", 2024-09-21T01:05:30.654 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.654 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.654 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.654 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.655 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_samba_metrics": { 2024-09-21T01:05:30.655 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_samba_metrics", 2024-09-21T01:05:30.655 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.655 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.655 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.655 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T01:05:30.655 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.655 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.655 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.655 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T01:05:30.655 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.655 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.655 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.655 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.656 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_snmp_gateway": { 2024-09-21T01:05:30.656 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_snmp_gateway", 2024-09-21T01:05:30.656 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.656 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.656 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.656 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T01:05:30.656 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.656 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.656 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.656 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SNMP Gateway container image", 2024-09-21T01:05:30.656 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.656 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.656 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.656 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.656 INFO:teuthology.orchestra.run.smithi001.stdout: "container_init": { 2024-09-21T01:05:30.657 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_init", 2024-09-21T01:05:30.657 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.657 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.657 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.657 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.657 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.657 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.657 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.657 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T01:05:30.657 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.657 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.657 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.657 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.657 INFO:teuthology.orchestra.run.smithi001.stdout: "daemon_cache_timeout": { 2024-09-21T01:05:30.657 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "daemon_cache_timeout", 2024-09-21T01:05:30.658 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.658 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.658 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.658 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-21T01:05:30.658 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.658 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.658 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.658 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T01:05:30.658 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.658 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.658 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.658 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.658 INFO:teuthology.orchestra.run.smithi001.stdout: "default_cephadm_command_timeout": { 2024-09-21T01:05:30.658 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T01:05:30.659 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.659 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.659 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.659 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "900", 2024-09-21T01:05:30.659 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.659 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.659 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.659 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T01:05:30.659 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.659 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.659 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.659 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.659 INFO:teuthology.orchestra.run.smithi001.stdout: "default_registry": { 2024-09-21T01:05:30.659 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_registry", 2024-09-21T01:05:30.659 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.660 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.660 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.660 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io", 2024-09-21T01:05:30.660 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.660 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.660 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.660 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T01:05:30.660 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.660 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.660 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.660 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.660 INFO:teuthology.orchestra.run.smithi001.stdout: "device_cache_timeout": { 2024-09-21T01:05:30.660 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_cache_timeout", 2024-09-21T01:05:30.660 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.661 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.661 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.661 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1800", 2024-09-21T01:05:30.661 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.661 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.661 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.661 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache device inventory", 2024-09-21T01:05:30.661 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.661 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.661 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.661 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.661 INFO:teuthology.orchestra.run.smithi001.stdout: "device_enhanced_scan": { 2024-09-21T01:05:30.661 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_enhanced_scan", 2024-09-21T01:05:30.661 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.661 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.662 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.662 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.662 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.662 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.662 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.662 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T01:05:30.662 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.662 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.662 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.662 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.662 INFO:teuthology.orchestra.run.smithi001.stdout: "facts_cache_timeout": { 2024-09-21T01:05:30.662 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "facts_cache_timeout", 2024-09-21T01:05:30.662 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.662 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.662 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.663 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-21T01:05:30.663 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.663 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.663 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.663 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache host facts data", 2024-09-21T01:05:30.663 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.663 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.663 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.663 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.663 INFO:teuthology.orchestra.run.smithi001.stdout: "grafana_dashboards_path": { 2024-09-21T01:05:30.663 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "grafana_dashboards_path", 2024-09-21T01:05:30.663 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.663 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.663 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.663 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T01:05:30.664 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.664 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.664 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.664 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T01:05:30.664 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.664 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.664 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.664 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.664 INFO:teuthology.orchestra.run.smithi001.stdout: "host_check_interval": { 2024-09-21T01:05:30.664 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "host_check_interval", 2024-09-21T01:05:30.664 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.664 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.664 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.664 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-21T01:05:30.665 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.665 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.665 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.665 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to perform a host check", 2024-09-21T01:05:30.665 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.665 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.665 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.665 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.665 INFO:teuthology.orchestra.run.smithi001.stdout: "hw_monitoring": { 2024-09-21T01:05:30.665 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hw_monitoring", 2024-09-21T01:05:30.665 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.665 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.665 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.665 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.665 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.666 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.666 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.666 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T01:05:30.666 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.666 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.666 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.666 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.666 INFO:teuthology.orchestra.run.smithi001.stdout: "inventory_list_all": { 2024-09-21T01:05:30.666 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "inventory_list_all", 2024-09-21T01:05:30.666 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.666 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.666 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.666 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.666 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.666 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.667 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.667 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T01:05:30.667 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.667 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.667 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.667 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.667 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.667 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.667 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.667 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.667 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.667 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.667 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.667 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.668 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.668 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.668 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.668 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.668 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.668 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.668 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.668 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.668 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.668 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.668 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.668 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.668 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.668 INFO:teuthology.orchestra.run.smithi001.stdout: "log_refresh_metadata": { 2024-09-21T01:05:30.668 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_refresh_metadata", 2024-09-21T01:05:30.669 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.669 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.669 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.669 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.669 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.669 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.669 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.669 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T01:05:30.669 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.669 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.669 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.669 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.669 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.669 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.669 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.670 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.670 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.670 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.670 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.670 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.670 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.670 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T01:05:30.670 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.670 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.670 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.670 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.670 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.670 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.670 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.671 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.671 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.671 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.671 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.671 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.671 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.671 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.671 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.671 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.671 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.671 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.671 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.671 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.671 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.671 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.672 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.672 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.672 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.672 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.672 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.672 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.672 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.672 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.672 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.672 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.672 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.672 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.672 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.672 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.672 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.673 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.673 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.673 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T01:05:30.673 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T01:05:30.673 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.673 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.673 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.673 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.673 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.673 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.673 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.673 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T01:05:30.673 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.673 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.674 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.674 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.674 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T01:05:30.674 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T01:05:30.674 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.674 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.674 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.674 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "*", 2024-09-21T01:05:30.674 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.674 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.674 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.674 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T01:05:30.674 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.674 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.674 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.675 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.675 INFO:teuthology.orchestra.run.smithi001.stdout: "max_count_per_host": { 2024-09-21T01:05:30.675 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_count_per_host", 2024-09-21T01:05:30.675 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.675 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.675 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.675 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-21T01:05:30.675 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.675 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.675 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.675 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of daemons per service per host", 2024-09-21T01:05:30.675 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.675 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.675 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.676 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.676 INFO:teuthology.orchestra.run.smithi001.stdout: "max_osd_draining_count": { 2024-09-21T01:05:30.676 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_osd_draining_count", 2024-09-21T01:05:30.676 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.676 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.676 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.676 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-21T01:05:30.676 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.676 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.676 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.676 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T01:05:30.676 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.676 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.676 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.677 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.677 INFO:teuthology.orchestra.run.smithi001.stdout: "migration_current": { 2024-09-21T01:05:30.677 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "migration_current", 2024-09-21T01:05:30.677 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.677 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.677 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.677 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.677 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.677 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.677 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.677 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "internal - do not modify", 2024-09-21T01:05:30.677 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.677 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.677 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.678 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.678 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-09-21T01:05:30.678 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-09-21T01:05:30.678 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.678 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.678 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.678 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "root", 2024-09-21T01:05:30.678 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.678 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.678 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.678 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm-package", 2024-09-21T01:05:30.678 INFO:teuthology.orchestra.run.smithi001.stdout: "root" 2024-09-21T01:05:30.678 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.678 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T01:05:30.678 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.679 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.679 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.679 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.679 INFO:teuthology.orchestra.run.smithi001.stdout: "oob_default_addr": { 2024-09-21T01:05:30.679 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "oob_default_addr", 2024-09-21T01:05:30.679 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.679 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.679 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.679 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "169.254.1.1", 2024-09-21T01:05:30.679 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.679 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.679 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.679 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T01:05:30.679 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.679 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.680 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.680 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.680 INFO:teuthology.orchestra.run.smithi001.stdout: "prometheus_alerts_path": { 2024-09-21T01:05:30.680 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus_alerts_path", 2024-09-21T01:05:30.680 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.680 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.680 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.680 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T01:05:30.680 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.680 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.680 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.680 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T01:05:30.680 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.680 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.680 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.681 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.681 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_insecure": { 2024-09-21T01:05:30.681 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_insecure", 2024-09-21T01:05:30.681 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.681 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.681 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.681 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.681 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.681 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.681 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.681 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T01:05:30.681 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.681 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.681 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.681 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.682 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_password": { 2024-09-21T01:05:30.682 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_password", 2024-09-21T01:05:30.682 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.682 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.682 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.682 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.682 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.682 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.682 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.682 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T01:05:30.682 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.682 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.682 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.682 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.683 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_url": { 2024-09-21T01:05:30.683 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_url", 2024-09-21T01:05:30.683 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.683 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.683 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.683 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.683 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.683 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.683 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.683 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T01:05:30.683 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.683 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.683 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.683 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.683 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_username": { 2024-09-21T01:05:30.684 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_username", 2024-09-21T01:05:30.684 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.684 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.684 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.684 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.684 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.684 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.684 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.684 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T01:05:30.684 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.684 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.684 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.684 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.684 INFO:teuthology.orchestra.run.smithi001.stdout: "secure_monitoring_stack": { 2024-09-21T01:05:30.684 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secure_monitoring_stack", 2024-09-21T01:05:30.685 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.685 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.685 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.685 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.685 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.685 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.685 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.685 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T01:05:30.685 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.685 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.685 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.685 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.685 INFO:teuthology.orchestra.run.smithi001.stdout: "service_discovery_port": { 2024-09-21T01:05:30.685 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "service_discovery_port", 2024-09-21T01:05:30.685 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.685 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.686 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.686 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8765", 2024-09-21T01:05:30.686 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.686 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.686 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.686 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "cephadm service discovery port", 2024-09-21T01:05:30.686 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.686 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.686 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.686 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.686 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.686 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.686 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.686 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.687 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.687 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.687 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.687 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.687 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.687 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.687 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.687 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.687 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.687 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.687 INFO:teuthology.orchestra.run.smithi001.stdout: "ssh_config_file": { 2024-09-21T01:05:30.687 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssh_config_file", 2024-09-21T01:05:30.687 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.687 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.687 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.688 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.688 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.688 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.688 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.688 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T01:05:30.688 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.688 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.688 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.688 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.688 INFO:teuthology.orchestra.run.smithi001.stdout: "ssh_keepalive_count_max": { 2024-09-21T01:05:30.688 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T01:05:30.688 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.688 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.688 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.689 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3", 2024-09-21T01:05:30.689 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.689 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.689 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.689 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T01:05:30.689 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.689 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.689 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.689 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.689 INFO:teuthology.orchestra.run.smithi001.stdout: "ssh_keepalive_interval": { 2024-09-21T01:05:30.689 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssh_keepalive_interval", 2024-09-21T01:05:30.689 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.689 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.689 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.689 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7", 2024-09-21T01:05:30.690 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.690 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.690 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.690 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T01:05:30.690 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.690 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.690 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.690 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.690 INFO:teuthology.orchestra.run.smithi001.stdout: "use_agent": { 2024-09-21T01:05:30.690 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_agent", 2024-09-21T01:05:30.690 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.690 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.690 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.690 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.690 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.691 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.691 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.691 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T01:05:30.691 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.691 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.691 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.691 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.691 INFO:teuthology.orchestra.run.smithi001.stdout: "use_repo_digest": { 2024-09-21T01:05:30.691 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_repo_digest", 2024-09-21T01:05:30.691 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.691 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.691 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.691 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.691 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.692 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.692 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.692 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T01:05:30.692 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.692 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.692 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.692 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.692 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_failed_host_check": { 2024-09-21T01:05:30.692 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_failed_host_check", 2024-09-21T01:05:30.692 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.692 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.692 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.692 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.692 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.692 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.693 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.693 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T01:05:30.693 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.693 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.693 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.693 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.693 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_daemons": { 2024-09-21T01:05:30.693 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_daemons", 2024-09-21T01:05:30.693 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.693 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.693 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.693 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.693 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.693 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.693 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.694 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T01:05:30.694 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.694 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.694 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.694 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.694 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_hosts": { 2024-09-21T01:05:30.694 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_hosts", 2024-09-21T01:05:30.694 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.694 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.694 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.694 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.694 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.694 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.694 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.694 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T01:05:30.695 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.695 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.695 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.695 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.695 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.695 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.695 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.695 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crash", 2024-09-21T01:05:30.695 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.695 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.695 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.695 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.695 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.695 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.696 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.696 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.696 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.696 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.696 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.696 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.696 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.696 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.696 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.696 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.696 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.696 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.696 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.696 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.696 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.697 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.697 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.697 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.697 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.697 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.697 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.697 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.697 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.697 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.697 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.697 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.697 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.697 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.697 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.697 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.698 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.698 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.698 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.698 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.698 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.698 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.698 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.698 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.698 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.698 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.698 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.698 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.698 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.698 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.698 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.699 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.699 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.699 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.699 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.699 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.699 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.699 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.699 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.699 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.699 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.699 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.699 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.699 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.699 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.699 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.700 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.700 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.700 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.700 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.700 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.700 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.700 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.700 INFO:teuthology.orchestra.run.smithi001.stdout: "retain_interval": { 2024-09-21T01:05:30.700 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retain_interval", 2024-09-21T01:05:30.700 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.700 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.700 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.700 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "31536000", 2024-09-21T01:05:30.700 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.700 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.701 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.701 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T01:05:30.701 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.701 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.701 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.701 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.701 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.701 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.702 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.702 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.702 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.702 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.702 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.702 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.702 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.702 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.702 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.702 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.702 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.702 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.702 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_recent_interval": { 2024-09-21T01:05:30.702 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_recent_interval", 2024-09-21T01:05:30.702 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.703 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.703 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.703 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1209600", 2024-09-21T01:05:30.703 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.703 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.703 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.703 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T01:05:30.703 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.703 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.703 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.703 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.703 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.703 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.703 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.703 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dashboard", 2024-09-21T01:05:30.704 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.704 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.704 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.704 INFO:teuthology.orchestra.run.smithi001.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T01:05:30.704 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T01:05:30.704 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.704 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.704 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.704 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-21T01:05:30.704 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.704 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.704 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.704 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.704 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.704 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.705 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.705 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.705 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T01:05:30.705 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T01:05:30.705 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.705 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.705 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.705 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.705 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.705 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.705 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.705 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.705 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.705 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.706 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.706 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.706 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T01:05:30.706 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T01:05:30.706 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.706 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.706 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.706 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.706 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.706 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.706 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.706 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.706 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.706 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.707 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.707 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.707 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_ENABLED": { 2024-09-21T01:05:30.707 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T01:05:30.707 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.707 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.707 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.707 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.707 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.707 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.707 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.707 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.707 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.707 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.707 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.708 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.708 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T01:05:30.708 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T01:05:30.708 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.708 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.708 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.708 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.708 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.708 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.708 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.708 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.708 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.708 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.708 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.708 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.709 INFO:teuthology.orchestra.run.smithi001.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T01:05:30.709 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T01:05:30.709 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.709 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.709 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.709 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.709 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.709 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.709 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.709 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.709 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.709 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.709 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.709 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.709 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T01:05:30.710 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T01:05:30.710 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.710 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.710 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.710 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.710 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.710 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.710 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.710 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.710 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.710 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.710 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.710 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.710 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T01:05:30.710 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T01:05:30.711 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.711 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.711 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.711 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.711 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.711 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.711 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.711 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.711 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.711 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.711 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.711 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.711 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T01:05:30.711 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T01:05:30.711 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.712 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.712 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.712 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.712 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.712 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.712 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.712 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.712 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.712 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.712 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.712 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.712 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T01:05:30.712 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T01:05:30.712 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.712 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.713 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.713 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.713 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.713 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.713 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.713 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.713 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.713 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.713 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.713 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.713 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T01:05:30.713 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T01:05:30.713 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.713 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.713 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.714 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.714 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.714 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.714 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.714 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.714 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.714 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.714 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.714 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.714 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T01:05:30.714 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T01:05:30.714 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.714 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.714 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.715 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.715 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.715 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.715 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.715 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.715 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.715 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.715 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.715 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.715 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T01:05:30.715 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T01:05:30.715 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.715 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.715 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.715 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.716 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.716 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.716 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.716 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.716 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.716 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.716 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.716 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.716 INFO:teuthology.orchestra.run.smithi001.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T01:05:30.716 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T01:05:30.716 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.716 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.716 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.716 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.717 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.717 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.717 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.717 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.717 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.717 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.717 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.717 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.717 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T01:05:30.717 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T01:05:30.717 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.717 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.717 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.717 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-21T01:05:30.717 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.718 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.718 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.718 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.718 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.718 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.718 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.718 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.718 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T01:05:30.718 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T01:05:30.718 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.718 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.718 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.718 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.718 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.719 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.719 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.719 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.719 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.719 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.719 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.719 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.719 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_URL": { 2024-09-21T01:05:30.719 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_URL", 2024-09-21T01:05:30.719 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.719 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.719 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.719 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.719 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.719 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.720 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.720 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.720 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.720 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.720 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.720 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.720 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T01:05:30.720 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T01:05:30.720 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.720 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.720 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.720 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-21T01:05:30.720 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.720 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.720 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.721 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.721 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.721 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.721 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.721 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.721 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T01:05:30.721 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T01:05:30.721 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.721 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.721 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.721 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.721 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.721 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.721 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.721 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.722 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.722 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.722 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.722 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.722 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T01:05:30.722 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T01:05:30.722 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.722 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.722 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.722 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.722 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.722 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.722 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.722 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.723 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.723 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.723 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.723 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.723 INFO:teuthology.orchestra.run.smithi001.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T01:05:30.723 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T01:05:30.723 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.723 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.723 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.723 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.723 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.723 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.723 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.723 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.723 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.724 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.724 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.724 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.724 INFO:teuthology.orchestra.run.smithi001.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T01:05:30.724 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T01:05:30.724 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.724 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.724 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.724 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.724 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.724 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.724 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.724 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.724 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.724 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.725 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.725 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.725 INFO:teuthology.orchestra.run.smithi001.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T01:05:30.725 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T01:05:30.725 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.725 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.725 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.725 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "[]", 2024-09-21T01:05:30.725 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.725 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.725 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.725 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.725 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.725 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.725 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.726 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.726 INFO:teuthology.orchestra.run.smithi001.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T01:05:30.726 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T01:05:30.726 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.726 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.726 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.726 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "{}", 2024-09-21T01:05:30.726 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.726 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.726 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.726 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.726 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.726 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.727 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.727 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.727 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T01:05:30.727 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T01:05:30.727 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.727 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.727 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.727 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.727 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.727 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.727 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.727 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.727 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.727 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.727 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.728 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.728 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T01:05:30.728 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T01:05:30.728 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.728 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.728 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.728 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.728 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.728 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.728 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.728 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.728 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.728 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.728 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.729 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.729 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T01:05:30.729 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T01:05:30.729 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.729 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.729 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.729 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.729 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.729 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.729 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.729 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.729 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.729 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.729 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.729 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.730 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T01:05:30.730 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T01:05:30.730 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.730 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.730 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.730 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.730 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.730 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.730 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.730 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.730 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.730 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.730 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.730 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.731 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T01:05:30.731 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T01:05:30.731 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.731 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.731 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.731 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.731 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.731 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.731 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.731 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.731 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.731 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.731 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.731 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.731 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T01:05:30.731 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T01:05:30.732 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.732 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.732 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.732 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.732 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.732 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.732 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.732 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.732 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.732 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.732 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.732 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.732 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T01:05:30.732 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T01:05:30.732 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.733 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.733 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.733 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.733 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.733 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.733 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.733 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.733 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.733 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.733 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.733 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.733 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T01:05:30.733 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T01:05:30.733 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.733 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.734 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.734 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.734 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.734 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.734 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.734 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.734 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.734 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.734 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.734 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.734 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T01:05:30.734 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T01:05:30.734 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.734 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.734 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.735 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.735 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.735 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.735 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.735 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.735 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.735 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.735 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.735 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.735 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T01:05:30.735 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T01:05:30.735 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.735 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.735 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.735 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.736 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.736 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.736 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.736 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.736 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.736 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.736 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.736 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.736 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T01:05:30.736 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T01:05:30.736 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.736 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.736 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.736 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T01:05:30.736 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.737 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.737 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.737 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.737 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.737 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.737 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.737 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.737 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T01:05:30.737 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T01:05:30.737 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.737 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.737 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.737 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-21T01:05:30.737 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.737 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.738 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.738 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.738 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.738 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.738 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.738 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.738 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T01:05:30.738 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T01:05:30.738 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.738 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.738 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.738 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8", 2024-09-21T01:05:30.738 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.738 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.739 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.739 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.739 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.739 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.739 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.739 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.739 INFO:teuthology.orchestra.run.smithi001.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T01:05:30.739 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T01:05:30.739 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.739 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.739 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.739 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "45", 2024-09-21T01:05:30.739 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.739 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.739 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.740 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.740 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.740 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.740 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.740 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.740 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T01:05:30.740 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T01:05:30.740 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.740 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.740 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.740 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.740 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.740 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.740 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.740 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.741 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.741 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.741 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.741 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.741 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T01:05:30.741 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T01:05:30.741 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.741 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.741 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.741 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-21T01:05:30.741 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.741 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.741 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.741 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.741 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.741 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.742 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.742 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.742 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T01:05:30.742 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T01:05:30.742 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.742 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.742 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.742 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.742 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.742 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.742 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.742 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.742 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.742 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.743 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.743 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.743 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T01:05:30.743 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T01:05:30.743 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.743 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.743 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.743 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.743 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.743 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.743 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.743 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.743 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.743 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.743 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.743 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.744 INFO:teuthology.orchestra.run.smithi001.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T01:05:30.744 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T01:05:30.744 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.744 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.744 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.744 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.744 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.744 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.744 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.744 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.744 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.744 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.744 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.744 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.745 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T01:05:30.745 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T01:05:30.745 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.745 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.745 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.745 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.745 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.745 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.745 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.745 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.745 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.745 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.745 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.745 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.745 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T01:05:30.746 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T01:05:30.746 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.746 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.746 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.746 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-21T01:05:30.746 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.746 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.746 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.746 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.746 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.746 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.746 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.746 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.746 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T01:05:30.746 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T01:05:30.747 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.747 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.747 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.747 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-21T01:05:30.747 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.747 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.747 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.747 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.747 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.747 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.747 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.747 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.747 INFO:teuthology.orchestra.run.smithi001.stdout: "cross_origin_url": { 2024-09-21T01:05:30.748 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cross_origin_url", 2024-09-21T01:05:30.748 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.748 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.748 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.748 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.748 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.748 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.748 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.748 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.748 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.748 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.748 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.748 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.748 INFO:teuthology.orchestra.run.smithi001.stdout: "crt_file": { 2024-09-21T01:05:30.748 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crt_file", 2024-09-21T01:05:30.748 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.749 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.749 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.749 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.749 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.749 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.749 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.749 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.749 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.749 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.749 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.749 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.749 INFO:teuthology.orchestra.run.smithi001.stdout: "debug": { 2024-09-21T01:05:30.749 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "debug", 2024-09-21T01:05:30.749 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.749 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.749 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.750 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.750 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.750 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.750 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.750 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable/disable debug options", 2024-09-21T01:05:30.750 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.750 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.750 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.750 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.750 INFO:teuthology.orchestra.run.smithi001.stdout: "jwt_token_ttl": { 2024-09-21T01:05:30.750 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "jwt_token_ttl", 2024-09-21T01:05:30.750 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.750 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.750 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.750 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "28800", 2024-09-21T01:05:30.751 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.751 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.751 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.751 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.751 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.751 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.751 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.751 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.751 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-09-21T01:05:30.751 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-09-21T01:05:30.751 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.751 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.751 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.751 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.751 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.752 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.752 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.752 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.752 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.752 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.752 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.752 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.752 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.752 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.752 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.752 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.752 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.752 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.752 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.753 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.753 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.753 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.753 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.753 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.753 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.753 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.753 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.753 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.753 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.753 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.753 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.753 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.753 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.753 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.754 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.754 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.754 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.754 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.754 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.754 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.754 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.754 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.754 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.754 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.754 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.754 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.754 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.754 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.755 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.755 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.755 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.755 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.755 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.755 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.755 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.755 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.755 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.755 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.755 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.755 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.755 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.755 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.755 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.755 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.756 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.756 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.756 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.756 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.756 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.756 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.756 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.756 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.756 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.756 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.756 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.756 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.756 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.756 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.756 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.757 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.757 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.757 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.757 INFO:teuthology.orchestra.run.smithi001.stdout: "motd": { 2024-09-21T01:05:30.757 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "motd", 2024-09-21T01:05:30.757 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.757 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.757 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.757 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.757 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.757 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.757 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.757 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "The message of the day", 2024-09-21T01:05:30.757 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.757 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.757 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.758 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.758 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect_resolve_ip_addr": { 2024-09-21T01:05:30.758 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T01:05:30.758 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.758 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.758 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.758 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.758 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.758 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.758 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.758 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.758 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.758 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.758 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.758 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.759 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-21T01:05:30.759 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-21T01:05:30.759 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.759 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.759 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.759 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-09-21T01:05:30.759 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.759 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.759 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.759 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.759 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.759 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.759 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.759 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.759 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-21T01:05:30.760 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-21T01:05:30.760 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.760 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.760 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.760 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8080", 2024-09-21T01:05:30.760 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.760 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.760 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.760 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.760 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.760 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.760 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.760 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.760 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.760 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.760 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.761 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.761 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.761 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.761 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.761 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.761 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.761 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.761 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.761 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.761 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.761 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.761 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-09-21T01:05:30.761 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-09-21T01:05:30.761 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.761 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.762 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.762 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.762 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.762 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.762 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.762 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.762 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.762 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.762 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.762 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.762 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl_server_port": { 2024-09-21T01:05:30.762 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl_server_port", 2024-09-21T01:05:30.762 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.762 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.762 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.763 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8443", 2024-09-21T01:05:30.763 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.763 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.763 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.763 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.763 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.763 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.763 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.763 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.763 INFO:teuthology.orchestra.run.smithi001.stdout: "sso_oauth2": { 2024-09-21T01:05:30.763 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sso_oauth2", 2024-09-21T01:05:30.764 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.764 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.764 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.764 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.764 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.764 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.764 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.764 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.764 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.764 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.764 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.764 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.764 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-09-21T01:05:30.764 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-09-21T01:05:30.764 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.765 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.765 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.765 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "redirect", 2024-09-21T01:05:30.765 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.765 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.765 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.765 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.765 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect" 2024-09-21T01:05:30.765 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.765 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.765 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.765 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.765 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.765 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.765 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-09-21T01:05:30.765 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-09-21T01:05:30.766 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.766 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.766 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.766 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-21T01:05:30.766 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-09-21T01:05:30.766 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-09-21T01:05:30.766 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.766 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.766 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.766 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.766 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.766 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.766 INFO:teuthology.orchestra.run.smithi001.stdout: "url_prefix": { 2024-09-21T01:05:30.766 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url_prefix", 2024-09-21T01:05:30.767 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.767 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.767 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.767 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.767 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.767 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.767 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.767 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.767 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.767 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.767 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.767 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.767 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.767 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.767 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.768 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "devicehealth", 2024-09-21T01:05:30.768 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.768 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.768 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.768 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_monitoring": { 2024-09-21T01:05:30.768 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_monitoring", 2024-09-21T01:05:30.768 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.768 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.768 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.768 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.768 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.768 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.768 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.768 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "monitor device health metrics", 2024-09-21T01:05:30.768 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.769 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.769 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.769 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.769 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.769 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.769 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.769 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.769 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.769 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.769 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.769 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.769 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.769 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.769 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.769 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.770 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.770 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.770 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.770 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.770 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.770 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.770 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.770 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.770 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.770 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.770 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.770 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.770 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.770 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.771 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.771 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.771 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.771 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.771 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.771 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.771 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.771 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.771 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.771 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.771 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.771 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.771 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.771 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.771 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.772 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.772 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.772 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.772 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.772 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.772 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.772 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.772 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.772 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.772 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.772 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.772 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.772 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.772 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.772 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.773 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.773 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.773 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.773 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.773 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.773 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.773 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.773 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.773 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.773 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.773 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.773 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.773 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.773 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.773 INFO:teuthology.orchestra.run.smithi001.stdout: "mark_out_threshold": { 2024-09-21T01:05:30.774 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mark_out_threshold", 2024-09-21T01:05:30.774 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.774 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.774 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.774 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2419200", 2024-09-21T01:05:30.774 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.774 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.774 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.774 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T01:05:30.774 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.774 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.774 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.774 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.774 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_name": { 2024-09-21T01:05:30.774 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_name", 2024-09-21T01:05:30.775 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.775 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.775 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.775 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "device_health_metrics", 2024-09-21T01:05:30.775 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.775 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.775 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.775 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T01:05:30.775 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.775 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.775 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.775 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.775 INFO:teuthology.orchestra.run.smithi001.stdout: "retention_period": { 2024-09-21T01:05:30.775 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retention_period", 2024-09-21T01:05:30.775 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.776 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.776 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.776 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15552000", 2024-09-21T01:05:30.776 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.776 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.776 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.776 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain device health metrics", 2024-09-21T01:05:30.776 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.776 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.776 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.776 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.776 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_frequency": { 2024-09-21T01:05:30.776 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_frequency", 2024-09-21T01:05:30.776 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.777 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.777 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.777 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-09-21T01:05:30.777 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.777 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.777 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.777 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T01:05:30.777 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.777 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.777 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.777 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.777 INFO:teuthology.orchestra.run.smithi001.stdout: "self_heal": { 2024-09-21T01:05:30.777 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "self_heal", 2024-09-21T01:05:30.777 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.777 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.778 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.778 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.778 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.778 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.778 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.778 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T01:05:30.778 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.778 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.778 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.778 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.778 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-21T01:05:30.778 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-21T01:05:30.778 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.778 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.778 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.779 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-21T01:05:30.779 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.779 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.779 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.779 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T01:05:30.779 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.779 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.779 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.779 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.779 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.779 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.779 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.779 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.779 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.779 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.780 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.780 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.780 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.780 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.780 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.780 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.780 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.780 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.780 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_threshold": { 2024-09-21T01:05:30.780 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_threshold", 2024-09-21T01:05:30.780 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.780 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.780 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.780 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7257600", 2024-09-21T01:05:30.780 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.781 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.781 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.781 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T01:05:30.781 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.781 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.781 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.781 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.781 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.781 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.781 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.781 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "diskprediction_local", 2024-09-21T01:05:30.781 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.781 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.781 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.781 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.782 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.782 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.782 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.782 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.782 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.782 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.782 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.782 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.782 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.782 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.782 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.782 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.782 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.782 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.782 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.783 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.783 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.783 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.783 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.783 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.783 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.783 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.783 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.783 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.783 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.783 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.783 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.783 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.783 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.783 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.784 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.784 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.784 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.784 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.784 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.784 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.784 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.784 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.784 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.784 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.784 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.784 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.784 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.784 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.784 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.785 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.785 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.785 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.785 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.785 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.785 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.785 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.785 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.785 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.785 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.785 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.785 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.785 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.785 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.785 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.786 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.786 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.786 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.786 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.786 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.786 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.786 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.786 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.786 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.786 INFO:teuthology.orchestra.run.smithi001.stdout: "predict_interval": { 2024-09-21T01:05:30.786 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predict_interval", 2024-09-21T01:05:30.786 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.786 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.786 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.786 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-09-21T01:05:30.787 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.787 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.787 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.787 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.787 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.787 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.787 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.787 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.787 INFO:teuthology.orchestra.run.smithi001.stdout: "predictor_model": { 2024-09-21T01:05:30.787 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predictor_model", 2024-09-21T01:05:30.787 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.787 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.787 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.787 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "prophetstor", 2024-09-21T01:05:30.787 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.787 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.788 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.788 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.788 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.788 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.788 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.788 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.788 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-21T01:05:30.788 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-21T01:05:30.788 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.788 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.788 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.788 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-21T01:05:30.788 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.788 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.788 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.789 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.789 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.789 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.789 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.789 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.789 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.789 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.789 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.789 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.789 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.789 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.789 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.789 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.789 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.790 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.790 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.790 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.790 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.790 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.790 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.790 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.790 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.790 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "influx", 2024-09-21T01:05:30.790 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": false, 2024-09-21T01:05:30.790 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "influxdb python module not found", 2024-09-21T01:05:30.790 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.790 INFO:teuthology.orchestra.run.smithi001.stdout: "batch_size": { 2024-09-21T01:05:30.790 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "batch_size", 2024-09-21T01:05:30.791 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.791 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.791 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.791 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5000", 2024-09-21T01:05:30.791 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.791 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.791 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.791 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T01:05:30.791 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.791 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.791 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.791 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.791 INFO:teuthology.orchestra.run.smithi001.stdout: "database": { 2024-09-21T01:05:30.791 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "database", 2024-09-21T01:05:30.791 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.791 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.792 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.792 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "ceph", 2024-09-21T01:05:30.792 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.792 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.792 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.792 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T01:05:30.792 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.792 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.792 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.792 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.792 INFO:teuthology.orchestra.run.smithi001.stdout: "hostname": { 2024-09-21T01:05:30.792 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hostname", 2024-09-21T01:05:30.792 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.792 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.793 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.793 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.793 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.793 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.793 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.793 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server hostname", 2024-09-21T01:05:30.793 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.793 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.793 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.793 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.793 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-21T01:05:30.793 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-21T01:05:30.793 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.793 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.793 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.794 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "30", 2024-09-21T01:05:30.794 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "5", 2024-09-21T01:05:30.794 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.794 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.794 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T01:05:30.794 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.794 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.794 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.794 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.794 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.794 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.794 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.794 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.794 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.794 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.795 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.795 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.795 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.795 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.795 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.795 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.795 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.795 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.795 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.795 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.795 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.795 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.795 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.795 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.795 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.796 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.796 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.796 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.796 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.796 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.796 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.796 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.796 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.796 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.796 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.796 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.796 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.796 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.796 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.796 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.796 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.797 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.797 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.797 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.797 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.797 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.797 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.797 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.797 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.797 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.797 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.797 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.797 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.797 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.797 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.797 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.798 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.798 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.798 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.798 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.798 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.798 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.798 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.798 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.798 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.798 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.798 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.798 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.798 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.798 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.798 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.799 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.799 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.799 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.799 INFO:teuthology.orchestra.run.smithi001.stdout: "password": { 2024-09-21T01:05:30.799 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "password", 2024-09-21T01:05:30.799 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.799 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.799 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.799 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.799 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.799 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.799 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.799 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "password of InfluxDB server user", 2024-09-21T01:05:30.799 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.799 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.800 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.800 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.800 INFO:teuthology.orchestra.run.smithi001.stdout: "port": { 2024-09-21T01:05:30.800 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "port", 2024-09-21T01:05:30.800 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.800 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.800 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.800 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8086", 2024-09-21T01:05:30.800 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.800 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.800 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.800 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server port", 2024-09-21T01:05:30.800 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.800 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.800 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.800 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.801 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.801 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.801 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.801 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.801 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.801 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.801 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.801 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.801 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.801 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.801 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.801 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.801 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.801 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.802 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-09-21T01:05:30.802 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-09-21T01:05:30.802 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.802 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.802 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.802 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "false", 2024-09-21T01:05:30.802 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.802 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.802 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.802 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T01:05:30.802 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.802 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.802 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.802 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.802 INFO:teuthology.orchestra.run.smithi001.stdout: "threads": { 2024-09-21T01:05:30.803 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threads", 2024-09-21T01:05:30.803 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.803 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.803 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.803 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-21T01:05:30.803 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-21T01:05:30.803 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "32", 2024-09-21T01:05:30.803 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.803 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T01:05:30.803 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.803 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.803 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.803 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.803 INFO:teuthology.orchestra.run.smithi001.stdout: "username": { 2024-09-21T01:05:30.803 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "username", 2024-09-21T01:05:30.804 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.804 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.804 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.804 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.804 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.804 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.804 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.804 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "username of InfluxDB server user", 2024-09-21T01:05:30.804 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.804 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.804 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.804 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.804 INFO:teuthology.orchestra.run.smithi001.stdout: "verify_ssl": { 2024-09-21T01:05:30.804 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "verify_ssl", 2024-09-21T01:05:30.804 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.805 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.805 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.805 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "true", 2024-09-21T01:05:30.805 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.805 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.805 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.805 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T01:05:30.805 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.805 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.805 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.805 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.805 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.805 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.805 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.805 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "insights", 2024-09-21T01:05:30.806 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.806 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.806 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.806 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.806 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.806 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.806 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.806 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.806 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.806 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.806 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.806 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.806 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.806 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.806 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.807 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.807 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.807 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.807 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.807 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.807 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.807 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.807 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.807 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.807 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.807 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.807 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.807 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.807 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.807 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.807 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.808 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.808 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.808 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.808 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.808 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.808 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.808 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.808 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.808 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.808 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.808 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.808 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.808 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.808 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.808 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.809 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.809 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.809 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.809 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.809 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.809 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.809 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.809 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.809 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.809 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.809 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.809 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.809 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.809 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.809 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.810 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.810 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.810 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.810 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.810 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.810 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.810 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.810 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.810 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.810 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.810 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.810 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.810 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.810 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.810 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.810 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.811 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.811 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.811 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.811 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.811 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.811 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.811 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.811 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.811 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.811 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.811 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.811 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.811 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.811 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "iostat", 2024-09-21T01:05:30.811 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.811 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.812 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.812 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.812 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.812 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.812 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.812 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.812 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.812 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.812 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.812 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.812 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.812 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.812 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.812 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.812 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.813 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.813 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.813 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.813 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.813 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.813 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.813 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.813 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.813 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.813 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.813 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.813 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.813 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.813 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.813 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.813 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.814 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.814 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.814 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.814 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.814 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.814 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.814 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.814 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.814 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.814 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.814 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.814 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.814 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.815 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.815 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.815 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.815 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.815 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.815 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.815 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.815 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.815 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.815 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.815 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.815 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.815 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.815 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.815 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.815 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.816 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.816 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.816 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.816 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.816 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.816 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.816 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.816 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.816 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.816 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.816 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.816 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.816 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.816 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.816 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.817 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.817 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.817 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.817 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.817 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.817 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.817 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.817 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.817 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.817 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.817 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.817 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.817 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.817 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "k8sevents", 2024-09-21T01:05:30.817 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.818 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.818 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.818 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_event_retention_days": { 2024-09-21T01:05:30.818 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ceph_event_retention_days", 2024-09-21T01:05:30.818 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.818 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.818 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.818 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7", 2024-09-21T01:05:30.818 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.818 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.818 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.818 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T01:05:30.818 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.818 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.818 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.819 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.819 INFO:teuthology.orchestra.run.smithi001.stdout: "config_check_secs": { 2024-09-21T01:05:30.819 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_check_secs", 2024-09-21T01:05:30.819 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.819 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.819 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.819 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-21T01:05:30.819 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "10", 2024-09-21T01:05:30.819 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.819 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.819 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T01:05:30.819 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.819 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.819 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.819 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.820 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.820 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.820 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.820 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.820 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.820 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.820 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.820 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.820 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.820 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.820 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.820 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.820 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.820 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.820 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.821 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.821 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.821 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.821 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.821 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.821 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.821 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.821 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.821 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.821 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.821 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.821 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.821 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.821 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.821 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.822 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.822 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.822 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.822 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.822 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.822 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.822 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.822 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.822 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.822 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.822 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.822 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.822 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.822 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.822 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.823 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.823 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.823 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.823 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.823 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.823 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.823 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.823 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.823 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.823 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.823 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.823 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.823 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.823 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.823 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.824 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.824 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.824 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.824 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.824 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.824 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.824 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.824 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.824 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.824 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.824 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.824 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.824 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.824 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.824 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.825 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.825 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.825 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.825 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.825 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.825 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.825 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.825 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.825 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.825 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.825 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.825 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.825 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "localpool", 2024-09-21T01:05:30.825 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.825 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.825 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.826 INFO:teuthology.orchestra.run.smithi001.stdout: "failure_domain": { 2024-09-21T01:05:30.826 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "failure_domain", 2024-09-21T01:05:30.826 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.826 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.826 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.826 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "host", 2024-09-21T01:05:30.826 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.826 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.826 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.826 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "failure domain for any created local pool", 2024-09-21T01:05:30.826 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T01:05:30.826 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.826 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.826 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.827 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.827 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.827 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.827 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.827 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.827 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.827 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.827 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.827 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.827 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.827 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.827 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.827 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.827 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.827 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.828 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.828 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.828 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.828 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.828 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.828 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.828 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.828 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.828 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.828 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.828 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.828 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.828 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.828 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.828 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.829 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.829 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.829 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.829 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.829 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.829 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.829 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.829 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.829 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.829 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.829 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.829 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.829 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.829 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.829 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.830 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.830 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.830 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.830 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.830 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.830 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.830 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.830 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.830 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.830 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.830 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.830 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.830 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.830 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.830 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.831 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.831 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.831 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.831 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.831 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.831 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.831 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.831 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.831 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.831 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.831 INFO:teuthology.orchestra.run.smithi001.stdout: "min_size": { 2024-09-21T01:05:30.831 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_size", 2024-09-21T01:05:30.831 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.831 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.832 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.832 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.832 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.832 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.832 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.832 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default min_size for any created local pool", 2024-09-21T01:05:30.832 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T01:05:30.832 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.832 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.832 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.832 INFO:teuthology.orchestra.run.smithi001.stdout: "num_rep": { 2024-09-21T01:05:30.832 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "num_rep", 2024-09-21T01:05:30.832 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.832 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.832 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.832 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3", 2024-09-21T01:05:30.833 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.833 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.833 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.833 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default replica count for any created local pool", 2024-09-21T01:05:30.833 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.833 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.833 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.833 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.833 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num": { 2024-09-21T01:05:30.833 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_num", 2024-09-21T01:05:30.833 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.833 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.833 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.833 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "128", 2024-09-21T01:05:30.834 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.834 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.834 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.834 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T01:05:30.834 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.834 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.834 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.834 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.834 INFO:teuthology.orchestra.run.smithi001.stdout: "prefix": { 2024-09-21T01:05:30.834 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prefix", 2024-09-21T01:05:30.834 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.834 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.834 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.834 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.834 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.835 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.835 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.835 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name prefix for any created local pool", 2024-09-21T01:05:30.835 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.835 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.835 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.835 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.835 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.835 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.835 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.835 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.835 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.835 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.835 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.835 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.836 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.836 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.836 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.836 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.836 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.836 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.836 INFO:teuthology.orchestra.run.smithi001.stdout: "subtree": { 2024-09-21T01:05:30.836 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "subtree", 2024-09-21T01:05:30.836 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.836 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.836 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.836 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "rack", 2024-09-21T01:05:30.836 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.836 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.836 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.836 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T01:05:30.837 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T01:05:30.837 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.837 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.837 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.837 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.837 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.837 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.837 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mds_autoscaler", 2024-09-21T01:05:30.837 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.837 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.837 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.837 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.837 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.837 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.837 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.838 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.838 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.838 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.838 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.838 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.838 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.838 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.838 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.838 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.838 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.838 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.838 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.838 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.838 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.838 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.839 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.839 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.839 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.839 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.839 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.839 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.839 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.839 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.839 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.839 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.839 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.839 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.839 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.839 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.840 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.840 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.840 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.840 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.840 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.840 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.840 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.840 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.840 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.840 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.840 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.840 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.840 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.840 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.840 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.841 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.841 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.841 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.841 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.841 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.841 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.841 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.841 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.841 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.841 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.841 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.841 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.841 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.841 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.841 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.842 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.842 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.842 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.842 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.842 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.842 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.842 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.842 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.842 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.842 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.842 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.842 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.842 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.842 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.843 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.843 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.843 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.843 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.843 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.843 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.843 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.843 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.843 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.843 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.843 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirroring", 2024-09-21T01:05:30.843 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.843 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.843 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.843 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.843 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.844 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.844 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.844 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.844 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.844 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.844 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.844 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.844 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.844 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.844 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.844 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.844 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.844 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.844 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.844 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.845 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.845 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.845 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.845 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.845 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.845 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.845 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.845 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.845 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.845 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.845 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.845 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.845 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.845 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.845 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.846 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.846 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.846 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.846 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.846 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.846 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.846 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.846 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.846 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.846 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.846 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.846 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.846 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.846 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.846 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.847 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.847 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.847 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.847 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.847 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.847 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.847 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.847 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.847 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.847 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.847 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.847 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.847 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.847 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.847 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.847 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.848 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.848 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.848 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.848 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.848 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.848 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.848 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.848 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.848 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.848 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.848 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.848 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.848 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.848 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.848 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.849 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.849 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.849 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.849 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.849 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.849 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.849 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.849 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.849 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.849 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "nfs", 2024-09-21T01:05:30.849 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.849 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.849 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.849 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.849 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.849 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.850 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.850 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.850 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.850 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.850 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.850 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.850 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.850 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.850 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.850 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.850 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.850 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.850 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.850 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.850 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.851 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.851 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.851 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.851 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.851 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.851 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.851 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.851 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.851 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.851 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.851 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.851 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.851 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.851 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.851 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.851 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.852 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.852 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.852 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.852 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.852 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.852 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.852 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.852 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.852 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.852 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.852 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.852 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.852 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.852 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.853 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.853 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.853 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.853 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.853 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.853 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.853 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.853 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.853 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.853 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.853 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.853 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.853 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.853 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.853 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.853 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.854 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.854 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.854 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.854 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.854 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.854 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.854 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.854 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.854 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.854 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.854 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.854 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.854 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.854 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.855 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.855 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.855 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.855 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.855 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.855 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.855 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.855 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.855 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.855 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-09-21T01:05:30.855 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.855 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.855 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.855 INFO:teuthology.orchestra.run.smithi001.stdout: "fail_fs": { 2024-09-21T01:05:30.855 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "fail_fs", 2024-09-21T01:05:30.855 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.856 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.856 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.856 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.856 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.856 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.856 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.856 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T01:05:30.856 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.856 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.856 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.856 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.856 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.856 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.856 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.857 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.857 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.857 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.857 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.857 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.857 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.857 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.857 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.857 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.857 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.857 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.857 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.857 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.857 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.857 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.858 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.858 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.858 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.858 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.858 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.858 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.858 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.858 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.858 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.858 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.858 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.858 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.858 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.858 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.858 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.859 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.859 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.859 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.859 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.859 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.859 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.859 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.859 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.859 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.859 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.859 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.859 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.859 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.859 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.859 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.859 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.860 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.860 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.860 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.860 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.860 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.860 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.860 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.860 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.860 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.860 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.860 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.860 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.860 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.860 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.860 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.861 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.861 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.861 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.861 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.861 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.861 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.861 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator": { 2024-09-21T01:05:30.861 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-09-21T01:05:30.861 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.861 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.861 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.861 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.861 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.861 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.861 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.862 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm", 2024-09-21T01:05:30.862 INFO:teuthology.orchestra.run.smithi001.stdout: "rook", 2024-09-21T01:05:30.862 INFO:teuthology.orchestra.run.smithi001.stdout: "test_orchestrator" 2024-09-21T01:05:30.862 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.862 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Orchestrator backend", 2024-09-21T01:05:30.862 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.862 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.862 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.862 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.862 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.862 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.862 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.862 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.862 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.862 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.863 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.863 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.863 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.863 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.863 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.863 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.863 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.863 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.863 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.863 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.863 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.863 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_perf_query", 2024-09-21T01:05:30.863 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.863 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.863 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.864 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.864 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.864 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.864 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.864 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.864 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.864 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.864 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.864 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.864 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.864 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.864 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.864 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.864 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.864 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.864 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.865 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.865 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.865 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.865 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.865 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.865 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.865 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.865 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.865 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.865 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.865 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.865 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.865 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.865 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.866 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.866 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.866 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.866 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.866 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.866 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.866 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.866 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.866 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.866 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.866 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.866 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.866 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.866 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.867 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.867 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.867 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.867 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.867 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.867 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.867 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.867 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.867 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.867 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.867 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.867 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.867 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.867 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.867 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.868 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.868 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.868 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.868 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.868 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.868 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.868 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.868 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.868 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.868 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.868 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.868 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.868 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.868 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.868 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.869 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.869 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.869 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.869 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.869 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.869 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.869 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.869 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.869 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.869 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.869 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.869 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.869 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.869 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_support", 2024-09-21T01:05:30.869 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.869 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.870 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.870 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.870 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.870 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.870 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.870 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.870 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.870 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.870 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.870 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.870 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.870 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.870 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.870 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.871 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.871 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.871 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.871 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.871 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.871 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.871 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.871 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.871 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.871 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.871 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.871 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.871 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.871 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.871 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.872 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.872 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.872 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.872 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.872 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.872 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.872 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.872 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.872 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.872 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.872 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.872 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.872 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.872 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.872 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.872 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.873 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.873 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.873 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.873 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.873 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.873 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.873 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.873 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.873 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.873 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.873 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.873 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.873 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.873 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.873 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.874 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.874 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.874 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.874 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.874 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.874 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.874 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.874 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.874 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.874 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.874 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.874 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.874 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.874 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.874 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.875 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.875 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.875 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.875 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.875 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.875 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.875 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.875 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.875 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.875 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.875 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.875 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.875 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.875 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_autoscaler", 2024-09-21T01:05:30.875 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.876 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.876 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.876 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.876 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.876 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.876 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.876 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.876 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.876 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.876 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.876 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.876 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.876 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.876 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.876 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.876 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.877 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.877 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.877 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.877 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.877 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.877 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.877 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.877 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.877 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.877 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.877 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.877 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.877 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.877 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.877 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.878 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.878 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.878 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.878 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.878 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.878 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.878 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.878 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.878 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.878 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.878 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.878 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.878 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.878 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.878 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.879 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.879 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.879 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.879 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.879 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.879 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.879 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.879 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.879 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.879 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.879 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.879 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.879 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.879 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.879 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.880 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.880 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.880 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.880 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.880 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.880 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.880 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.880 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.880 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.880 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.880 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.880 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-21T01:05:30.880 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-21T01:05:30.880 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.880 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.881 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.881 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-21T01:05:30.881 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.881 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.881 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.881 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.881 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.881 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.881 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.881 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.881 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.881 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.881 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.881 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.881 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.882 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.882 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.882 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.882 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.882 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.882 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.882 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.882 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.882 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.882 INFO:teuthology.orchestra.run.smithi001.stdout: "threshold": { 2024-09-21T01:05:30.882 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threshold", 2024-09-21T01:05:30.882 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-21T01:05:30.882 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.882 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.882 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-09-21T01:05:30.883 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1.0", 2024-09-21T01:05:30.883 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.883 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.883 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "scaling threshold", 2024-09-21T01:05:30.883 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T01:05:30.883 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.883 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.883 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.883 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.883 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.883 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.883 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "progress", 2024-09-21T01:05:30.883 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.883 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.883 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.884 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_pg_recovery_event": { 2024-09-21T01:05:30.884 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_pg_recovery_event", 2024-09-21T01:05:30.884 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.884 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.884 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.884 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.884 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.884 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.884 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.884 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T01:05:30.884 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.884 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.884 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.884 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.884 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-09-21T01:05:30.885 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-09-21T01:05:30.885 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.885 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.885 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.885 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.885 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.885 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.885 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.885 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.885 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.885 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.885 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.885 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.885 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.885 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.886 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.886 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.886 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.886 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.886 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.886 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.886 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.886 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.886 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.886 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.886 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.886 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.886 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.886 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.886 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.887 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.887 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.887 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.887 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.887 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.887 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.887 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.887 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.887 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.887 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.887 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.887 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.887 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.887 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.887 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.888 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.888 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.888 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.888 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.888 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.888 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.888 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.888 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.888 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.888 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.888 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.888 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.888 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.888 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.888 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.888 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.889 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.889 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.889 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.889 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.889 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.889 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.889 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.889 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.889 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.889 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.889 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.889 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.889 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.889 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.889 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.889 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.890 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.890 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.890 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.890 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.890 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.890 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.890 INFO:teuthology.orchestra.run.smithi001.stdout: "max_completed_events": { 2024-09-21T01:05:30.890 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_completed_events", 2024-09-21T01:05:30.890 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.890 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.890 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.890 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "50", 2024-09-21T01:05:30.890 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.890 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.891 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.891 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "number of past completed events to remember", 2024-09-21T01:05:30.891 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.891 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.891 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.891 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.891 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-21T01:05:30.891 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-21T01:05:30.891 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.891 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.891 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.891 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-21T01:05:30.891 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.891 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.891 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.892 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long the module is going to sleep", 2024-09-21T01:05:30.892 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.892 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.892 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.892 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.892 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.892 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.892 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.892 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.892 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.892 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.892 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.892 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.892 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.892 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.893 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.893 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.893 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.893 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.893 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.893 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.893 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.893 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus", 2024-09-21T01:05:30.893 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.893 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.893 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.893 INFO:teuthology.orchestra.run.smithi001.stdout: "cache": { 2024-09-21T01:05:30.893 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cache", 2024-09-21T01:05:30.893 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.893 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.894 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.894 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.894 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.894 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.894 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.894 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.894 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.894 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.894 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.894 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.894 INFO:teuthology.orchestra.run.smithi001.stdout: "exclude_perf_counters": { 2024-09-21T01:05:30.894 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "exclude_perf_counters", 2024-09-21T01:05:30.894 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.894 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.894 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.895 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.895 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.895 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.895 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.895 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T01:05:30.895 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T01:05:30.895 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.895 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.895 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.895 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.895 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.895 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.895 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.895 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.895 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.896 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.896 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.896 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.896 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.896 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.896 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.896 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.896 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.896 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.896 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.896 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.896 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.896 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.896 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.896 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.897 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.897 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.897 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.897 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.897 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.897 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.897 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.897 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.897 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.897 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.897 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.897 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.897 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.897 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.897 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.898 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.898 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.898 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.898 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.898 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.898 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.898 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.898 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.898 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.898 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.898 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.898 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.898 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.898 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.899 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.899 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.899 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.899 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.899 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.899 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.899 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.899 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.899 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.899 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.899 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.899 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.899 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.899 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.899 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.900 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.900 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.900 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.900 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.900 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.900 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools": { 2024-09-21T01:05:30.900 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools", 2024-09-21T01:05:30.900 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.900 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.900 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.900 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.900 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.900 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.900 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.901 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.901 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.901 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.901 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.901 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.901 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T01:05:30.901 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T01:05:30.901 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.901 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.901 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.901 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "300", 2024-09-21T01:05:30.901 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.901 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.901 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.901 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.902 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.902 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.902 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.902 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.902 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_interval": { 2024-09-21T01:05:30.902 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_interval", 2024-09-21T01:05:30.902 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-21T01:05:30.902 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.902 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.902 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15.0", 2024-09-21T01:05:30.902 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.902 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.902 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.902 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.902 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.902 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.903 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.903 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.903 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-21T01:05:30.903 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-21T01:05:30.903 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.903 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.903 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.903 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-09-21T01:05:30.903 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.903 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.903 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.903 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T01:05:30.903 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.903 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.904 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.904 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.904 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-21T01:05:30.904 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-21T01:05:30.904 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.904 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.905 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.905 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "9283", 2024-09-21T01:05:30.905 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.905 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.906 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.906 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T01:05:30.906 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.906 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.906 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.906 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.906 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.906 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.906 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.906 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.906 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.906 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.906 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.906 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.907 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.907 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.907 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.907 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.907 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.907 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.907 INFO:teuthology.orchestra.run.smithi001.stdout: "stale_cache_strategy": { 2024-09-21T01:05:30.907 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stale_cache_strategy", 2024-09-21T01:05:30.907 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.907 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.907 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.907 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "log", 2024-09-21T01:05:30.907 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.907 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.907 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.908 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.908 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.908 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.908 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.908 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.908 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-09-21T01:05:30.908 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-09-21T01:05:30.908 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.908 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.908 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.908 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "default", 2024-09-21T01:05:30.908 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.908 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.908 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.908 INFO:teuthology.orchestra.run.smithi001.stdout: "default", 2024-09-21T01:05:30.909 INFO:teuthology.orchestra.run.smithi001.stdout: "error" 2024-09-21T01:05:30.909 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.909 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.909 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.909 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.909 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.909 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.909 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-09-21T01:05:30.909 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-09-21T01:05:30.909 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.909 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.909 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.909 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-21T01:05:30.909 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-09-21T01:05:30.909 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-09-21T01:05:30.910 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.910 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.910 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.910 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.910 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.910 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.910 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.910 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.910 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.910 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_support", 2024-09-21T01:05:30.910 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.910 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.910 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.910 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.910 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.911 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.911 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.911 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.911 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.911 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.911 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.911 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.911 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.911 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.911 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.911 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.911 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.911 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.911 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.911 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.912 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.912 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.912 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.912 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.912 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.912 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.912 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.912 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.912 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.912 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.912 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.912 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.912 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.912 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.913 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.913 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.913 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.913 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.913 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.913 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.913 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.913 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.913 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.913 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.913 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.913 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.913 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.913 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.914 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.914 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.914 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.914 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.914 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.914 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.914 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.914 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.914 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.914 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.914 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.914 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.914 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.914 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.914 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.915 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.915 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.915 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.915 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.915 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.915 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.915 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.915 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.915 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.915 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.915 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_snap_create": { 2024-09-21T01:05:30.915 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_snap_create", 2024-09-21T01:05:30.915 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.915 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.915 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.916 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-21T01:05:30.916 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.916 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.916 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.916 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.916 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.916 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.916 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.916 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.916 INFO:teuthology.orchestra.run.smithi001.stdout: "mirror_snapshot_schedule": { 2024-09-21T01:05:30.916 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T01:05:30.916 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.916 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.916 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.916 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.917 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.917 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.917 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.917 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.917 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.917 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.917 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.917 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.917 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.917 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.917 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.917 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.917 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.917 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.918 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.918 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.918 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.918 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.918 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.918 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.918 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.918 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.918 INFO:teuthology.orchestra.run.smithi001.stdout: "trash_purge_schedule": { 2024-09-21T01:05:30.918 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "trash_purge_schedule", 2024-09-21T01:05:30.918 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.918 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.918 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.918 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.919 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.919 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.919 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.919 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.919 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.919 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.919 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.919 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.919 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.919 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.919 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.919 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "restful", 2024-09-21T01:05:30.919 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.919 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.919 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.920 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_auth": { 2024-09-21T01:05:30.920 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_auth", 2024-09-21T01:05:30.920 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.920 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.920 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.920 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.920 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.920 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.920 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.920 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.920 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.920 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.920 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.920 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.920 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-09-21T01:05:30.921 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-09-21T01:05:30.921 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.921 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.921 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.921 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.921 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.921 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.921 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.921 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.921 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.921 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.921 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.921 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.921 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.921 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.922 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.922 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.922 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.922 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.922 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.922 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.922 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.922 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.922 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.922 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.922 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.922 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.922 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.922 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.922 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.923 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.923 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.923 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.923 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.923 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.923 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.923 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.923 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.923 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.923 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.923 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.923 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.923 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.923 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.923 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.924 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.924 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.924 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.924 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.924 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.924 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.924 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.924 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.924 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.924 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.924 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.924 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.924 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.924 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.924 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.924 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.925 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.925 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.925 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.925 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.925 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.925 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.925 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.925 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.925 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.925 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.925 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.925 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.925 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.925 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.925 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.926 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.926 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.926 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.926 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.926 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.926 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.926 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.926 INFO:teuthology.orchestra.run.smithi001.stdout: "max_requests": { 2024-09-21T01:05:30.926 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_requests", 2024-09-21T01:05:30.926 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.926 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.926 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.926 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-21T01:05:30.926 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.926 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.927 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.927 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T01:05:30.927 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.927 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.927 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.927 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.927 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-21T01:05:30.927 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-21T01:05:30.927 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.927 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.927 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.927 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.927 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.927 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.927 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.928 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.928 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.928 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.928 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.928 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.928 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-21T01:05:30.928 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-21T01:05:30.928 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.928 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.928 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.928 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.928 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.928 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.928 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.929 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.929 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.929 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.929 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.929 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.929 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.929 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.929 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.929 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.929 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.929 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.929 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.929 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.929 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.929 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.929 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.930 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.930 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.930 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.930 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.930 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.930 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.930 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rgw", 2024-09-21T01:05:30.930 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.930 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.930 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.930 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.930 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.930 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.930 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.931 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.931 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.931 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.931 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.931 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.931 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.931 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.931 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.931 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.931 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.931 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.931 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.931 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.931 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.931 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.932 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.932 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.932 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.932 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.932 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.932 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.932 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.932 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.932 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.932 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.932 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.932 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.932 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.932 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.932 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.932 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.933 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.933 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.933 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.933 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.933 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.933 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.933 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.933 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.933 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.933 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.933 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.933 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.933 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.933 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.933 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.934 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.934 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.934 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.934 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.934 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.934 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.934 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.934 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.934 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.934 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.934 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.934 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.934 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.934 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.934 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.935 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.935 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.935 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.935 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.935 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.935 INFO:teuthology.orchestra.run.smithi001.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T01:05:30.935 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T01:05:30.935 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.935 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.935 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.935 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-21T01:05:30.935 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.935 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.935 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.935 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T01:05:30.936 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.936 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.936 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.936 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.936 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.936 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.936 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.936 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.936 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.936 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.936 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.936 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.936 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.936 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.936 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.937 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.937 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.937 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.937 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.937 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.937 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.937 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rook", 2024-09-21T01:05:30.937 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.937 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.937 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.937 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.937 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.937 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.937 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.937 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.938 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.938 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.938 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.938 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.938 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.938 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.938 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.938 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.938 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.938 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.938 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.938 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.938 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.938 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.938 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.938 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.939 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.939 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.939 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.939 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.939 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.939 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.939 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.939 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.939 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.939 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.939 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.939 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.939 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.939 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.939 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.940 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.940 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.940 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.940 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.940 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.940 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.940 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.940 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.940 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.940 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.940 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.940 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.940 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.940 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.940 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.941 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.941 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.941 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.941 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.941 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.941 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.941 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.941 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.941 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.941 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.941 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.941 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.941 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.941 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.941 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.941 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.942 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.942 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.942 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.942 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.942 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.942 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.942 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.942 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.942 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.942 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.942 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.942 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.942 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.942 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.942 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.943 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.943 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.943 INFO:teuthology.orchestra.run.smithi001.stdout: "storage_class": { 2024-09-21T01:05:30.943 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "storage_class", 2024-09-21T01:05:30.943 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.943 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.943 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.943 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "local", 2024-09-21T01:05:30.943 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.943 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.943 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.943 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T01:05:30.943 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.943 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.944 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.944 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.944 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.944 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.944 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.944 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "selftest", 2024-09-21T01:05:30.944 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.944 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.944 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.944 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.944 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.944 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.944 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.944 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.944 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.944 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.945 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.945 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.945 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.945 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.945 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.945 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.945 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.945 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.945 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.945 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.945 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.945 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.945 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.945 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.945 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.946 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.946 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.946 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.946 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.946 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.946 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.946 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.946 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.946 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.946 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.946 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.946 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.946 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.946 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.946 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.947 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.947 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.947 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.947 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.947 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.947 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.947 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.947 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.947 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.947 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.947 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.947 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.947 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.947 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.947 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.948 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.948 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.948 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.948 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.948 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.948 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.948 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.948 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.948 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.948 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.948 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.948 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.948 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.948 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.948 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.949 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.949 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.949 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.949 INFO:teuthology.orchestra.run.smithi001.stdout: "roption1": { 2024-09-21T01:05:30.949 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption1", 2024-09-21T01:05:30.949 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.949 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.949 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.949 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.949 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.949 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.949 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.949 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.949 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.949 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.950 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.950 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.950 INFO:teuthology.orchestra.run.smithi001.stdout: "roption2": { 2024-09-21T01:05:30.950 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption2", 2024-09-21T01:05:30.950 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.950 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.950 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.950 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "xyz", 2024-09-21T01:05:30.950 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.950 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.950 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.950 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.950 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.950 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.950 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.951 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.951 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption1": { 2024-09-21T01:05:30.951 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption1", 2024-09-21T01:05:30.951 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.951 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.951 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.951 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.951 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.951 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.951 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.951 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.951 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.951 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.951 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.951 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.951 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption2": { 2024-09-21T01:05:30.952 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption2", 2024-09-21T01:05:30.952 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.952 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.952 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.952 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.952 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.952 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.952 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.952 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.952 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.952 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.952 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.952 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.952 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption3": { 2024-09-21T01:05:30.952 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption3", 2024-09-21T01:05:30.952 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-21T01:05:30.953 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.953 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.953 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.953 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.953 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.953 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.953 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.953 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.953 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.953 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.953 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.953 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption4": { 2024-09-21T01:05:30.953 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption4", 2024-09-21T01:05:30.953 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.953 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.954 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.954 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.954 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.954 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.954 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.954 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.954 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.954 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.954 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.954 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.954 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption5": { 2024-09-21T01:05:30.954 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption5", 2024-09-21T01:05:30.954 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.954 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.954 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.955 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.955 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.955 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.955 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.955 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.955 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.955 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.955 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.955 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.955 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption6": { 2024-09-21T01:05:30.955 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption6", 2024-09-21T01:05:30.955 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.955 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.955 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.955 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.956 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.956 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.956 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.956 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.956 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.956 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.956 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.956 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.956 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption7": { 2024-09-21T01:05:30.956 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption7", 2024-09-21T01:05:30.956 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.956 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.956 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.956 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.956 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-21T01:05:30.957 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "42", 2024-09-21T01:05:30.957 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.957 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.957 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.957 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.957 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.957 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.957 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.957 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.957 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.957 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.957 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.957 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.957 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.957 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.958 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.958 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.958 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.958 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.958 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.958 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.958 INFO:teuthology.orchestra.run.smithi001.stdout: "testkey": { 2024-09-21T01:05:30.958 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testkey", 2024-09-21T01:05:30.958 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.958 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.958 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.958 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.958 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.958 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.959 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.959 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.959 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.959 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.959 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.959 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.959 INFO:teuthology.orchestra.run.smithi001.stdout: "testlkey": { 2024-09-21T01:05:30.959 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testlkey", 2024-09-21T01:05:30.959 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.959 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.959 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.959 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.959 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.959 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.959 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.960 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.960 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.960 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.960 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.960 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.960 INFO:teuthology.orchestra.run.smithi001.stdout: "testnewline": { 2024-09-21T01:05:30.960 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testnewline", 2024-09-21T01:05:30.960 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.960 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.960 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.960 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.960 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.960 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.960 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.960 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.961 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.961 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.961 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.961 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.961 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.961 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.961 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.961 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smb", 2024-09-21T01:05:30.961 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.961 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.961 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.961 INFO:teuthology.orchestra.run.smithi001.stdout: "internal_store_backend": { 2024-09-21T01:05:30.961 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "internal_store_backend", 2024-09-21T01:05:30.961 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.961 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.962 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.962 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.962 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.962 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.962 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.962 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T01:05:30.962 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.962 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.962 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.962 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.962 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.962 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.962 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.962 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.962 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.963 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.963 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.963 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.963 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.963 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.963 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.963 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.963 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.963 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.963 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.963 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.963 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.963 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.963 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.963 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.963 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.964 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.964 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.964 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.964 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.964 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.964 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.964 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.964 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.964 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.964 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.964 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.964 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.964 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.964 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.964 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.965 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.965 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.965 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.965 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.965 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.965 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.965 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.965 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.965 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.965 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.965 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.965 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.965 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.965 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.965 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.965 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.966 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.966 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.966 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.966 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.966 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.966 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.966 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.966 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.966 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.966 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.966 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.966 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.966 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.966 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.966 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.967 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.967 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.967 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.967 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.967 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.967 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.967 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.967 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.967 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.967 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.967 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.967 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.967 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.967 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.967 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.967 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.968 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.968 INFO:teuthology.orchestra.run.smithi001.stdout: "update_orchestration": { 2024-09-21T01:05:30.968 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "update_orchestration", 2024-09-21T01:05:30.968 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.968 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.968 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.968 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.968 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.968 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.968 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.968 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T01:05:30.968 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.968 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.969 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.969 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.969 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.969 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.969 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.969 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snap_schedule", 2024-09-21T01:05:30.969 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.969 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.969 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.969 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_m_granularity": { 2024-09-21T01:05:30.969 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_m_granularity", 2024-09-21T01:05:30.969 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.969 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.969 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.969 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.970 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.970 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.970 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.970 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T01:05:30.970 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.970 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.970 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.970 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.970 INFO:teuthology.orchestra.run.smithi001.stdout: "dump_on_update": { 2024-09-21T01:05:30.970 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dump_on_update", 2024-09-21T01:05:30.970 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.970 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.970 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.970 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.970 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.971 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.971 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.971 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "dump database to debug log on update", 2024-09-21T01:05:30.971 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.971 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.971 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.971 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.971 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.971 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.971 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.971 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.971 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.971 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.971 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.971 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.972 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.972 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.972 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.972 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.972 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.972 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.972 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.972 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.972 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.972 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.972 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.972 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.972 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.972 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.972 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.973 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.973 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.973 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.973 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.973 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.973 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.973 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.973 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.973 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.973 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.973 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.973 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.973 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.973 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.973 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.974 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.974 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.974 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.974 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.974 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.974 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.974 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.974 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.974 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.974 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.974 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.974 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.974 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.974 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.974 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.975 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.975 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.975 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.975 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.975 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.975 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.975 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.975 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.975 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.975 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.975 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.975 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.975 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.975 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.975 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.976 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.976 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.976 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.976 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.976 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.976 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.976 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.976 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.976 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.976 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.976 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.976 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.976 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.976 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.976 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.976 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.977 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.977 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.977 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.977 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stats", 2024-09-21T01:05:30.977 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.977 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.977 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.977 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.977 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.977 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.977 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.977 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.977 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.977 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.977 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.978 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.978 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.978 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.978 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.978 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.978 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.978 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.978 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.978 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.978 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.978 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.978 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.978 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.978 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.978 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.979 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.979 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.979 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.979 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.979 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.979 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.979 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.979 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.979 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.979 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.979 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.979 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.979 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.979 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.979 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.980 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.980 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.980 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.980 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.980 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.980 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.980 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.980 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.980 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.980 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.980 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.980 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.980 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.980 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.980 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.981 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.981 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.981 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.981 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.981 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.981 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.981 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.981 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.981 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.981 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.981 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.981 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.981 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.981 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.982 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.982 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.982 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.982 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.982 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.982 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.982 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.982 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.982 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.982 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.982 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.982 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.982 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.982 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.983 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.983 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.983 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.983 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.983 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.983 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.983 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "status", 2024-09-21T01:05:30.983 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.983 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.983 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.983 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.983 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.983 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.983 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.983 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.984 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.984 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.984 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.984 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.984 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.984 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.984 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.984 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.984 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.984 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.984 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.984 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.984 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.984 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.984 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.984 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.985 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.985 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.985 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.985 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.985 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.985 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.985 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.985 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.985 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.985 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.985 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.985 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.985 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.985 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.985 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.986 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.986 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.986 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.986 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.986 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.986 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.986 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.986 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.986 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.986 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.986 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.986 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.986 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.986 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.986 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.987 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.987 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.987 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.987 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.987 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.987 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.987 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.987 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.987 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.987 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.987 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.987 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.987 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.987 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.987 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.988 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.988 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.988 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.988 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.988 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.988 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.988 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.988 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.988 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.988 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.988 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.988 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.988 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.988 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.988 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.988 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.989 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.989 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.989 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.989 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.989 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.989 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telegraf", 2024-09-21T01:05:30.989 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.989 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.989 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.989 INFO:teuthology.orchestra.run.smithi001.stdout: "address": { 2024-09-21T01:05:30.989 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "address", 2024-09-21T01:05:30.989 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.989 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.989 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.989 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T01:05:30.990 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.990 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.990 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.990 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.990 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.990 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.990 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.990 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.990 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-21T01:05:30.990 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-21T01:05:30.990 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:30.990 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.990 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.990 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15", 2024-09-21T01:05:30.990 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.991 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.991 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.991 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.991 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.991 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.991 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.991 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.991 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:30.991 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:30.991 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.991 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.991 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.991 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:30.991 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.991 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.991 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.992 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.992 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.992 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.992 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.992 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.992 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.992 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.992 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.992 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.992 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.992 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.992 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.992 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:30.992 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:30.992 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.993 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.993 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.993 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.993 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.993 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.993 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.993 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.993 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.993 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.993 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.993 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.993 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:30.993 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:30.993 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:30.993 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.993 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.994 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:30.994 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.994 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.994 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:30.994 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:30.994 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:30.994 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:30.994 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:30.994 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:30.994 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:30.994 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:30.994 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.994 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.994 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.995 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.995 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.995 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:30.995 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:30.995 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.995 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.995 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.995 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:30.995 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.995 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.995 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.995 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.995 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.995 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.995 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.995 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.996 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:30.996 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:30.996 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:30.996 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:30.996 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:30.996 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:30.996 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.996 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.996 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.996 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:30.996 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.996 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.996 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.996 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.996 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:30.997 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.997 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:30.997 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telemetry", 2024-09-21T01:05:30.997 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:30.997 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:30.997 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:30.997 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_basic": { 2024-09-21T01:05:30.997 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_basic", 2024-09-21T01:05:30.997 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.997 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.997 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.997 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.997 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.997 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.997 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.998 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T01:05:30.998 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.998 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.998 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.998 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.998 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_crash": { 2024-09-21T01:05:30.998 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_crash", 2024-09-21T01:05:30.998 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.998 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.998 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.998 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.998 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.998 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.998 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.998 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T01:05:30.999 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:30.999 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:30.999 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:30.999 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:30.999 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_device": { 2024-09-21T01:05:30.999 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_device", 2024-09-21T01:05:30.999 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:30.999 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:30.999 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:30.999 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:30.999 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:30.999 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:30.999 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:30.999 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T01:05:30.999 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.000 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.000 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.000 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.000 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_ident": { 2024-09-21T01:05:31.000 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_ident", 2024-09-21T01:05:31.000 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.000 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.000 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.000 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.000 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.000 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.000 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.000 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T01:05:31.000 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.000 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.001 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.001 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.001 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_perf": { 2024-09-21T01:05:31.001 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_perf", 2024-09-21T01:05:31.001 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.001 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.001 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.001 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.001 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.001 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.001 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.001 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T01:05:31.001 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.001 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.002 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.002 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.002 INFO:teuthology.orchestra.run.smithi001.stdout: "contact": { 2024-09-21T01:05:31.002 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "contact", 2024-09-21T01:05:31.002 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.002 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.002 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.002 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.002 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.002 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.002 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.002 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.002 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.002 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.002 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.003 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.003 INFO:teuthology.orchestra.run.smithi001.stdout: "description": { 2024-09-21T01:05:31.003 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "description", 2024-09-21T01:05:31.003 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.003 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.003 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.003 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.003 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.003 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.003 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.003 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.003 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.003 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.003 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.003 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.003 INFO:teuthology.orchestra.run.smithi001.stdout: "device_url": { 2024-09-21T01:05:31.004 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_url", 2024-09-21T01:05:31.004 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.004 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.004 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.004 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T01:05:31.004 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.004 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.004 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.004 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.004 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.004 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.004 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.004 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.004 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-09-21T01:05:31.004 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-09-21T01:05:31.005 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.005 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.005 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.005 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.005 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.005 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.005 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.005 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.005 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.005 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.005 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.005 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.005 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-21T01:05:31.005 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-21T01:05:31.005 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.006 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.006 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.006 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "24", 2024-09-21T01:05:31.006 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "8", 2024-09-21T01:05:31.006 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.006 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.006 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.006 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.006 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.006 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.006 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.006 INFO:teuthology.orchestra.run.smithi001.stdout: "last_opt_revision": { 2024-09-21T01:05:31.006 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "last_opt_revision", 2024-09-21T01:05:31.006 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.006 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.007 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.007 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1", 2024-09-21T01:05:31.007 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.007 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.007 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.007 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.007 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.007 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.007 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.007 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.007 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard": { 2024-09-21T01:05:31.007 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard", 2024-09-21T01:05:31.007 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.007 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.008 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.008 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.008 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.008 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.008 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.008 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.008 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.008 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.008 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.008 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.008 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard_description": { 2024-09-21T01:05:31.008 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard_description", 2024-09-21T01:05:31.008 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.008 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.008 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.009 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.009 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.009 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.009 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.009 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.009 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.009 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.009 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.009 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.009 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.009 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.009 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.009 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.009 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.009 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.010 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.010 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.010 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.010 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.010 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.010 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.010 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.010 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.010 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.010 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.010 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.010 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.010 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.010 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.011 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.011 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.011 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.011 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.011 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.011 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.011 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.011 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.011 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.011 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.011 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.011 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.011 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.011 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.011 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.012 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.012 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.012 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.012 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.012 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.012 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.012 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.012 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.012 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.012 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.012 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.012 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.012 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.012 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.012 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.012 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.013 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.013 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.013 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.013 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.013 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.013 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.013 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.013 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.013 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.013 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.013 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.013 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.013 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.013 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.013 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.014 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.014 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.014 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.014 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.014 INFO:teuthology.orchestra.run.smithi001.stdout: "organization": { 2024-09-21T01:05:31.014 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "organization", 2024-09-21T01:05:31.014 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.014 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.014 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.014 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.014 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.014 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.014 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.014 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.014 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.015 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.015 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.015 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.015 INFO:teuthology.orchestra.run.smithi001.stdout: "proxy": { 2024-09-21T01:05:31.015 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "proxy", 2024-09-21T01:05:31.015 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.015 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.015 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.015 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.015 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.015 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.015 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.015 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.015 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.015 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.015 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.016 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.016 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.016 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.016 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.016 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.016 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.016 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.016 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.016 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.016 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.016 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.016 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.016 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.016 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.016 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.017 INFO:teuthology.orchestra.run.smithi001.stdout: "url": { 2024-09-21T01:05:31.017 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url", 2024-09-21T01:05:31.017 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.017 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.017 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.017 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T01:05:31.017 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.017 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.017 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.017 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.017 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.017 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.017 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.017 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.017 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.017 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.018 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.018 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "test_orchestrator", 2024-09-21T01:05:31.018 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.018 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.018 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.018 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.018 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.018 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.018 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.018 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.018 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.018 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.018 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.018 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.018 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.019 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.019 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.019 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.019 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.019 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.019 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.019 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.019 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.019 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.019 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.019 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.019 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.019 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.019 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.019 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.020 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.020 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.020 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.020 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.020 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.020 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.020 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.020 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.020 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.020 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.020 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.020 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.020 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.020 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.020 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.020 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.021 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.021 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.021 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.021 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.021 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.021 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.021 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.021 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.021 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.021 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.021 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.021 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.021 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.021 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.022 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.022 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.022 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.022 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.022 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.022 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.022 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.022 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.022 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.022 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.022 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.022 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.022 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.022 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.022 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.023 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.023 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.023 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.023 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.023 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.023 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.023 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.023 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.023 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.023 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.023 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.023 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.023 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.023 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.023 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.024 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.024 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.024 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "volumes", 2024-09-21T01:05:31.024 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.024 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.024 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.024 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.024 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.024 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.024 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.024 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.024 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.024 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.024 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.025 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.025 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.025 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.025 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.025 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.025 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.025 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.025 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.025 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.025 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.025 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.025 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.025 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.025 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.025 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.026 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.026 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.026 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.026 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.026 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.026 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.026 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.026 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.026 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.026 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.026 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.026 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.026 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.026 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.026 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.027 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.027 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.027 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.027 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.027 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.027 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.027 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.027 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.027 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.027 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.027 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.027 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.027 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.027 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.027 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.028 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.028 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.028 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.028 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.028 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.028 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.028 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.028 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.028 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.028 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.028 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.028 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.028 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.028 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.028 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.029 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.029 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.029 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_clones": { 2024-09-21T01:05:31.029 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_clones", 2024-09-21T01:05:31.029 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.029 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.029 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.029 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4", 2024-09-21T01:05:31.029 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.029 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.029 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.029 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T01:05:31.029 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.029 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.029 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.029 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.030 INFO:teuthology.orchestra.run.smithi001.stdout: "periodic_async_work": { 2024-09-21T01:05:31.030 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "periodic_async_work", 2024-09-21T01:05:31.030 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.030 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.030 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.030 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.030 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.030 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.030 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.030 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Periodically check for async work", 2024-09-21T01:05:31.030 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.030 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.030 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.030 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.030 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_delay": { 2024-09-21T01:05:31.031 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_delay", 2024-09-21T01:05:31.031 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.031 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.031 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.031 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.031 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.031 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.031 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.031 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T01:05:31.031 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.031 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.031 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.031 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.031 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_no_wait": { 2024-09-21T01:05:31.032 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T01:05:31.032 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.032 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.032 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.032 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.032 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.032 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.032 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.032 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T01:05:31.032 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.032 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.032 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.032 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.032 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.032 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.033 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.033 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.033 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.033 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.033 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.033 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.033 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.033 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.033 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.033 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.033 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.033 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.033 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.033 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.033 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.034 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix", 2024-09-21T01:05:31.034 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.034 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.034 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.034 INFO:teuthology.orchestra.run.smithi001.stdout: "discovery_interval": { 2024-09-21T01:05:31.034 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "discovery_interval", 2024-09-21T01:05:31.034 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-21T01:05:31.034 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.034 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.034 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "100", 2024-09-21T01:05:31.034 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.034 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.034 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.034 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.034 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.035 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.035 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.035 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.035 INFO:teuthology.orchestra.run.smithi001.stdout: "identifier": { 2024-09-21T01:05:31.035 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "identifier", 2024-09-21T01:05:31.035 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.035 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.035 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.035 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.035 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.035 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.035 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.035 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.035 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.035 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.036 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.036 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.036 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-21T01:05:31.036 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-21T01:05:31.036 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:31.036 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.036 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.036 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-21T01:05:31.036 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.036 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.036 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.036 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.036 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.036 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.037 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.037 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.037 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.037 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.037 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.037 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.037 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.037 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.037 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.037 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.037 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.037 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.037 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.037 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.037 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.037 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.038 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.038 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.038 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.038 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.038 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.038 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.038 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.038 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.038 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.038 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.038 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.038 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.038 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.038 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.039 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.039 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.039 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.039 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.039 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.039 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.039 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.039 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.039 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.039 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.039 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.039 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.039 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.039 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.039 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.040 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.040 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.040 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.040 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.040 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.040 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.040 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.040 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.040 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.040 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.040 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.040 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.040 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.040 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.040 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.040 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.041 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.041 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.041 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.041 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.041 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.041 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.041 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.041 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.041 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.041 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.041 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.041 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.041 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.041 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.041 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.042 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.042 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.042 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.042 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.042 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.042 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.042 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.042 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.042 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.042 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.042 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_host": { 2024-09-21T01:05:31.042 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_host", 2024-09-21T01:05:31.042 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.042 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.042 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.043 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.043 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.043 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.043 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.043 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.043 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.043 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.043 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.043 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.043 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_port": { 2024-09-21T01:05:31.043 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_port", 2024-09-21T01:05:31.043 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.043 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.043 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.043 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10051", 2024-09-21T01:05:31.044 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.044 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.044 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.044 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.044 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.044 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.044 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.044 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.044 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_sender": { 2024-09-21T01:05:31.044 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_sender", 2024-09-21T01:05:31.044 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.044 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.044 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.044 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T01:05:31.044 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.045 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.045 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.045 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.045 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.045 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.045 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.045 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.045 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.045 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.045 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-21T01:05:31.045 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.045 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.045 INFO:teuthology.orchestra.run.smithi001.stdout: "modules": [ 2024-09-21T01:05:31.045 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm", 2024-09-21T01:05:31.045 INFO:teuthology.orchestra.run.smithi001.stdout: "dashboard", 2024-09-21T01:05:31.046 INFO:teuthology.orchestra.run.smithi001.stdout: "iostat", 2024-09-21T01:05:31.046 INFO:teuthology.orchestra.run.smithi001.stdout: "nfs", 2024-09-21T01:05:31.046 INFO:teuthology.orchestra.run.smithi001.stdout: "restful" 2024-09-21T01:05:31.046 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.046 INFO:teuthology.orchestra.run.smithi001.stdout: "available_modules": [ 2024-09-21T01:05:31.046 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.046 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "alerts", 2024-09-21T01:05:31.046 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.046 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.046 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.046 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-21T01:05:31.046 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-21T01:05:31.046 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:31.046 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.046 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.047 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-21T01:05:31.047 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.047 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.047 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.047 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T01:05:31.047 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.047 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.047 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.047 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.047 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.047 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.047 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.047 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.047 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.047 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.048 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.048 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.048 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.048 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.048 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.048 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.048 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.048 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.048 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.048 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.048 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.048 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.048 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.048 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.048 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.049 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.049 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.049 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.049 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.049 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.049 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.049 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.049 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.049 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.049 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.049 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.049 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.049 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.049 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.049 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.050 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.050 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.050 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.050 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.050 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.050 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.050 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.050 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.050 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.050 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.050 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.050 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.050 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.050 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.051 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.051 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.051 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.051 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.051 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.051 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.051 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.051 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.051 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.051 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.051 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.051 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.051 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.051 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.051 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.052 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.052 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.052 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.052 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.052 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.052 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_destination": { 2024-09-21T01:05:31.052 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_destination", 2024-09-21T01:05:31.052 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.052 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.052 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.052 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.052 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.052 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.052 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.052 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T01:05:31.052 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.053 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.053 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.053 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.053 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_from_name": { 2024-09-21T01:05:31.053 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_from_name", 2024-09-21T01:05:31.053 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.053 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.053 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.053 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "Ceph", 2024-09-21T01:05:31.053 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.053 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.053 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.053 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email From: name", 2024-09-21T01:05:31.053 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.054 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.054 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.054 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.054 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_host": { 2024-09-21T01:05:31.054 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_host", 2024-09-21T01:05:31.054 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.054 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.054 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.054 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.054 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.054 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.054 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.054 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP server", 2024-09-21T01:05:31.054 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.054 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.055 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.055 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.055 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_password": { 2024-09-21T01:05:31.055 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_password", 2024-09-21T01:05:31.055 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.055 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.055 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.055 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.055 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.055 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.055 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.055 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Password to authenticate with", 2024-09-21T01:05:31.055 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.055 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.055 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.055 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.056 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_port": { 2024-09-21T01:05:31.056 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_port", 2024-09-21T01:05:31.056 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.056 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.056 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.056 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "465", 2024-09-21T01:05:31.056 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.056 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.056 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.056 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP port", 2024-09-21T01:05:31.056 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.056 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.056 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.056 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.056 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_sender": { 2024-09-21T01:05:31.057 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_sender", 2024-09-21T01:05:31.057 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.057 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.057 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.057 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.057 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.057 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.057 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.057 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP envelope sender", 2024-09-21T01:05:31.057 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.057 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.057 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.057 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.057 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_ssl": { 2024-09-21T01:05:31.057 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_ssl", 2024-09-21T01:05:31.057 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.058 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.058 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.058 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.058 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.058 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.058 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.058 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T01:05:31.058 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.058 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.058 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.058 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.058 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_user": { 2024-09-21T01:05:31.058 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_user", 2024-09-21T01:05:31.058 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.059 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.059 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.059 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.059 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.059 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.059 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.059 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "User to authenticate as", 2024-09-21T01:05:31.059 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.059 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.059 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.059 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.059 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.059 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.059 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.059 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.060 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.060 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.060 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.060 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.060 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.060 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.060 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.060 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.060 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.060 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.060 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.060 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.060 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.060 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "balancer", 2024-09-21T01:05:31.060 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.061 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.061 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.061 INFO:teuthology.orchestra.run.smithi001.stdout: "active": { 2024-09-21T01:05:31.061 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "active", 2024-09-21T01:05:31.061 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.061 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.061 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.061 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.061 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.061 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.061 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.061 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T01:05:31.061 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.061 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.061 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.062 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.062 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_time": { 2024-09-21T01:05:31.062 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_time", 2024-09-21T01:05:31.062 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.062 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.062 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.062 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0000", 2024-09-21T01:05:31.062 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.062 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.062 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.062 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T01:05:31.062 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T01:05:31.062 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.062 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.062 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.063 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_weekday": { 2024-09-21T01:05:31.063 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_weekday", 2024-09-21T01:05:31.063 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-21T01:05:31.063 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.063 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.063 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.063 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-09-21T01:05:31.063 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-09-21T01:05:31.063 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.063 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T01:05:31.063 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T01:05:31.063 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.063 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.063 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.063 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_max_iterations": { 2024-09-21T01:05:31.064 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_max_iterations", 2024-09-21T01:05:31.064 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-21T01:05:31.064 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.064 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.064 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "25", 2024-09-21T01:05:31.064 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-21T01:05:31.064 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "250", 2024-09-21T01:05:31.064 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.064 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T01:05:31.064 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.064 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.064 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.064 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.064 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_metrics": { 2024-09-21T01:05:31.064 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_metrics", 2024-09-21T01:05:31.065 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.065 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.065 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.065 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T01:05:31.065 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.065 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.065 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.065 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T01:05:31.065 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T01:05:31.065 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.065 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.065 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.065 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_step": { 2024-09-21T01:05:31.065 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_step", 2024-09-21T01:05:31.065 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-21T01:05:31.065 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.066 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.066 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.5", 2024-09-21T01:05:31.066 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0.001", 2024-09-21T01:05:31.066 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "0.999", 2024-09-21T01:05:31.066 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.066 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "aggressiveness of optimization", 2024-09-21T01:05:31.066 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T01:05:31.066 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.066 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.066 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.066 INFO:teuthology.orchestra.run.smithi001.stdout: "end_time": { 2024-09-21T01:05:31.066 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_time", 2024-09-21T01:05:31.066 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.066 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.067 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.067 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2359", 2024-09-21T01:05:31.067 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.067 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.067 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.067 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T01:05:31.067 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T01:05:31.067 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.067 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.067 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.067 INFO:teuthology.orchestra.run.smithi001.stdout: "end_weekday": { 2024-09-21T01:05:31.067 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_weekday", 2024-09-21T01:05:31.067 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-21T01:05:31.067 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.067 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.067 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.068 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-09-21T01:05:31.068 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-09-21T01:05:31.068 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.068 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T01:05:31.068 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T01:05:31.068 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.068 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.068 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.068 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.068 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.068 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.068 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.068 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.068 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.068 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.069 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.069 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.069 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.069 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.069 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.069 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.069 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.069 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.069 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.069 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.069 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.069 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.069 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.069 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.069 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.069 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.070 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.070 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.070 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.070 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.070 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.070 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.070 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.070 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.070 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.070 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.070 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.070 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.070 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.070 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.070 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.071 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.071 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.071 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.071 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.071 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.071 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.071 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.071 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.071 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.071 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.071 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.071 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.071 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.071 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.071 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.072 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.072 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.072 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.072 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.072 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.072 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.072 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.072 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.072 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.072 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.072 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.072 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.072 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.072 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.072 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.073 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.073 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.073 INFO:teuthology.orchestra.run.smithi001.stdout: "min_score": { 2024-09-21T01:05:31.073 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_score", 2024-09-21T01:05:31.073 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-21T01:05:31.073 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.073 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.073 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.073 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.073 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.073 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.073 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T01:05:31.073 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.073 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.074 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.074 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.074 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-09-21T01:05:31.074 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-09-21T01:05:31.074 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.074 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.074 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.074 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "upmap", 2024-09-21T01:05:31.074 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.074 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.074 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.074 INFO:teuthology.orchestra.run.smithi001.stdout: "crush-compat", 2024-09-21T01:05:31.074 INFO:teuthology.orchestra.run.smithi001.stdout: "none", 2024-09-21T01:05:31.074 INFO:teuthology.orchestra.run.smithi001.stdout: "read", 2024-09-21T01:05:31.074 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap", 2024-09-21T01:05:31.074 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap-read" 2024-09-21T01:05:31.075 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.075 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Balancer mode", 2024-09-21T01:05:31.075 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.075 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.075 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.075 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.075 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_ids": { 2024-09-21T01:05:31.075 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_ids", 2024-09-21T01:05:31.075 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.075 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.075 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.075 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.075 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.076 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.076 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.076 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T01:05:31.076 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.076 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.076 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.076 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.076 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-21T01:05:31.076 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-21T01:05:31.076 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:31.076 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.076 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.076 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-21T01:05:31.076 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.077 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.077 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.077 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T01:05:31.077 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.077 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.077 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.077 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.077 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.077 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.077 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.077 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.077 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.077 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.077 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.077 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.078 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.078 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.078 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.078 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.078 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.078 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.078 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_deviation": { 2024-09-21T01:05:31.078 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_deviation", 2024-09-21T01:05:31.078 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.078 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.078 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.078 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-21T01:05:31.078 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-21T01:05:31.078 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.078 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.079 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T01:05:31.079 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T01:05:31.079 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.079 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.079 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.079 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_optimizations": { 2024-09-21T01:05:31.079 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_optimizations", 2024-09-21T01:05:31.079 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-21T01:05:31.079 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.079 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.079 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-21T01:05:31.079 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.079 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.079 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.079 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T01:05:31.080 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.080 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.080 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.080 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.080 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.080 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.080 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.080 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm", 2024-09-21T01:05:31.080 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.080 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.080 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.080 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_down_multiplier": { 2024-09-21T01:05:31.080 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_down_multiplier", 2024-09-21T01:05:31.080 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-21T01:05:31.080 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.081 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.081 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-09-21T01:05:31.081 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.081 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.081 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.081 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T01:05:31.081 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.081 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.081 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.081 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.081 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_refresh_rate": { 2024-09-21T01:05:31.081 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_refresh_rate", 2024-09-21T01:05:31.081 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:31.081 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.081 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.082 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "20", 2024-09-21T01:05:31.082 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.082 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.082 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.082 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T01:05:31.082 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.082 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.082 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.082 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.082 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_starting_port": { 2024-09-21T01:05:31.082 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_starting_port", 2024-09-21T01:05:31.082 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.082 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.082 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.082 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4721", 2024-09-21T01:05:31.083 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.083 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.083 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.083 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T01:05:31.083 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.083 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.083 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.083 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.083 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_ptrace": { 2024-09-21T01:05:31.083 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_ptrace", 2024-09-21T01:05:31.083 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.083 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.083 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.083 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.083 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.084 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.084 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.084 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T01:05:31.084 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T01:05:31.084 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.084 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.084 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.084 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_interval": { 2024-09-21T01:05:31.084 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_interval", 2024-09-21T01:05:31.084 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:31.084 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.084 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.084 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-21T01:05:31.084 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.085 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.085 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.085 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T01:05:31.085 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.085 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.085 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.085 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.085 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_memory_target_ratio": { 2024-09-21T01:05:31.085 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T01:05:31.085 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-21T01:05:31.085 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.085 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.085 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.7", 2024-09-21T01:05:31.085 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.085 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.085 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.086 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T01:05:31.086 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.086 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.086 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.086 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.086 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm_log_destination": { 2024-09-21T01:05:31.086 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm_log_destination", 2024-09-21T01:05:31.086 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.086 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.086 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.086 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.086 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.086 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.086 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.087 INFO:teuthology.orchestra.run.smithi001.stdout: "file", 2024-09-21T01:05:31.087 INFO:teuthology.orchestra.run.smithi001.stdout: "file,syslog", 2024-09-21T01:05:31.087 INFO:teuthology.orchestra.run.smithi001.stdout: "syslog" 2024-09-21T01:05:31.087 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.087 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T01:05:31.087 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.087 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.087 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.087 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.087 INFO:teuthology.orchestra.run.smithi001.stdout: "cgroups_split": { 2024-09-21T01:05:31.087 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cgroups_split", 2024-09-21T01:05:31.087 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.087 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.087 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.087 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.088 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.088 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.088 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.088 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T01:05:31.088 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.088 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.088 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.088 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.088 INFO:teuthology.orchestra.run.smithi001.stdout: "config_checks_enabled": { 2024-09-21T01:05:31.088 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_checks_enabled", 2024-09-21T01:05:31.088 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.088 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.088 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.088 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.088 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.088 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.089 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.089 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T01:05:31.089 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.089 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.089 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.089 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.089 INFO:teuthology.orchestra.run.smithi001.stdout: "config_dashboard": { 2024-09-21T01:05:31.089 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_dashboard", 2024-09-21T01:05:31.089 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.089 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.089 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.089 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.089 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.089 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.090 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.090 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T01:05:31.090 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.090 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.090 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.090 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.090 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_alertmanager": { 2024-09-21T01:05:31.090 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_alertmanager", 2024-09-21T01:05:31.090 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.090 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.090 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.090 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T01:05:31.090 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.090 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.090 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.091 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-21T01:05:31.091 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.091 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.091 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.091 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.091 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_base": { 2024-09-21T01:05:31.091 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_base", 2024-09-21T01:05:31.091 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.091 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.091 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.091 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T01:05:31.091 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.091 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.091 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.091 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Container image name, without the tag", 2024-09-21T01:05:31.092 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.092 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.092 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.092 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.092 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_elasticsearch": { 2024-09-21T01:05:31.092 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_elasticsearch", 2024-09-21T01:05:31.092 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.092 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.092 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.092 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T01:05:31.092 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.092 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.092 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.092 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "elasticsearch container image", 2024-09-21T01:05:31.092 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.093 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.093 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.093 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.093 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_grafana": { 2024-09-21T01:05:31.093 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_grafana", 2024-09-21T01:05:31.093 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.093 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.093 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.093 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T01:05:31.093 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.093 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.093 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.093 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-21T01:05:31.093 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.093 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.094 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.094 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.094 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_haproxy": { 2024-09-21T01:05:31.094 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_haproxy", 2024-09-21T01:05:31.094 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.094 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.094 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.094 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T01:05:31.094 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.094 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.094 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.094 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "HAproxy container image", 2024-09-21T01:05:31.094 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.094 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.094 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.095 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.095 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_agent": { 2024-09-21T01:05:31.095 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_agent", 2024-09-21T01:05:31.095 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.095 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.095 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.095 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T01:05:31.095 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.095 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.095 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.095 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger agent container image", 2024-09-21T01:05:31.095 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.095 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.095 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.096 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.096 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_collector": { 2024-09-21T01:05:31.096 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_collector", 2024-09-21T01:05:31.096 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.096 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.096 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.096 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T01:05:31.096 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.096 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.096 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.096 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger collector container image", 2024-09-21T01:05:31.096 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.096 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.096 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.096 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.097 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_query": { 2024-09-21T01:05:31.097 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_query", 2024-09-21T01:05:31.097 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.097 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.097 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.097 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T01:05:31.097 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.097 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.097 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.097 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger query container image", 2024-09-21T01:05:31.097 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.097 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.097 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.097 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.097 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_keepalived": { 2024-09-21T01:05:31.097 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_keepalived", 2024-09-21T01:05:31.098 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.098 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.098 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.098 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T01:05:31.098 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.098 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.098 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.098 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Keepalived container image", 2024-09-21T01:05:31.098 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.098 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.098 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.098 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.098 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_loki": { 2024-09-21T01:05:31.098 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_loki", 2024-09-21T01:05:31.099 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.099 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.099 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.099 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T01:05:31.099 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.099 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.099 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.099 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Loki container image", 2024-09-21T01:05:31.099 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.099 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.099 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.099 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.099 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_nginx": { 2024-09-21T01:05:31.099 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_nginx", 2024-09-21T01:05:31.099 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.100 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.100 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.100 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T01:05:31.100 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.100 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.100 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.100 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Nginx container image", 2024-09-21T01:05:31.100 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.100 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.100 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.100 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.100 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_node_exporter": { 2024-09-21T01:05:31.100 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_node_exporter", 2024-09-21T01:05:31.100 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.100 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.100 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.101 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T01:05:31.101 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.101 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.101 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.101 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-21T01:05:31.101 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.101 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.101 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.101 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.101 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_nvmeof": { 2024-09-21T01:05:31.101 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_nvmeof", 2024-09-21T01:05:31.101 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.101 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.101 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.101 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T01:05:31.102 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.102 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.102 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.102 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Nvme-of container image", 2024-09-21T01:05:31.102 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.102 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.102 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.102 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.102 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_oauth2_proxy": { 2024-09-21T01:05:31.102 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T01:05:31.102 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.102 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.103 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.103 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T01:05:31.103 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.103 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.103 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.103 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "oauth2-proxy container image", 2024-09-21T01:05:31.103 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.103 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.103 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.103 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.103 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_prometheus": { 2024-09-21T01:05:31.103 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_prometheus", 2024-09-21T01:05:31.103 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.104 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.104 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.104 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T01:05:31.104 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.104 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.104 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.104 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-21T01:05:31.104 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.104 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.104 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.104 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.104 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_promtail": { 2024-09-21T01:05:31.104 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_promtail", 2024-09-21T01:05:31.104 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.104 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.105 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.105 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T01:05:31.105 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.105 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.105 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.105 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Promtail container image", 2024-09-21T01:05:31.105 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.105 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.105 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.105 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.105 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_samba": { 2024-09-21T01:05:31.105 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_samba", 2024-09-21T01:05:31.105 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.105 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.105 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.106 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T01:05:31.106 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.106 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.106 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.106 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Samba/SMB container image", 2024-09-21T01:05:31.106 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.106 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.106 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.106 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.106 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_samba_metrics": { 2024-09-21T01:05:31.106 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_samba_metrics", 2024-09-21T01:05:31.106 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.106 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.106 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.106 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T01:05:31.107 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.107 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.107 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.107 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T01:05:31.107 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.107 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.107 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.107 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.107 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_snmp_gateway": { 2024-09-21T01:05:31.107 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_snmp_gateway", 2024-09-21T01:05:31.107 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.107 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.107 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.107 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T01:05:31.107 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.108 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.108 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.108 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SNMP Gateway container image", 2024-09-21T01:05:31.108 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.109 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.109 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.109 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.109 INFO:teuthology.orchestra.run.smithi001.stdout: "container_init": { 2024-09-21T01:05:31.109 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_init", 2024-09-21T01:05:31.109 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.109 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.110 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.110 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.110 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.110 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.110 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.110 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T01:05:31.110 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.110 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.110 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.110 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.110 INFO:teuthology.orchestra.run.smithi001.stdout: "daemon_cache_timeout": { 2024-09-21T01:05:31.110 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "daemon_cache_timeout", 2024-09-21T01:05:31.110 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:31.110 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.111 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.111 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-21T01:05:31.111 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.111 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.111 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.111 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T01:05:31.111 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.111 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.111 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.111 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.111 INFO:teuthology.orchestra.run.smithi001.stdout: "default_cephadm_command_timeout": { 2024-09-21T01:05:31.111 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T01:05:31.111 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.111 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.111 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.112 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "900", 2024-09-21T01:05:31.112 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.112 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.112 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.112 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T01:05:31.112 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.112 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.112 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.112 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.112 INFO:teuthology.orchestra.run.smithi001.stdout: "default_registry": { 2024-09-21T01:05:31.112 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_registry", 2024-09-21T01:05:31.112 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.112 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.112 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.112 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io", 2024-09-21T01:05:31.113 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.113 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.113 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.113 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T01:05:31.113 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.113 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.113 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.113 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.113 INFO:teuthology.orchestra.run.smithi001.stdout: "device_cache_timeout": { 2024-09-21T01:05:31.113 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_cache_timeout", 2024-09-21T01:05:31.113 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:31.113 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.113 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.113 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1800", 2024-09-21T01:05:31.113 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.114 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.114 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.114 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache device inventory", 2024-09-21T01:05:31.114 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.114 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.114 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.114 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.114 INFO:teuthology.orchestra.run.smithi001.stdout: "device_enhanced_scan": { 2024-09-21T01:05:31.114 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_enhanced_scan", 2024-09-21T01:05:31.114 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.114 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.114 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.114 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.114 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.114 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.115 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.115 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T01:05:31.115 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.115 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.115 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.115 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.115 INFO:teuthology.orchestra.run.smithi001.stdout: "facts_cache_timeout": { 2024-09-21T01:05:31.115 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "facts_cache_timeout", 2024-09-21T01:05:31.115 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:31.115 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.115 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.115 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-21T01:05:31.115 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.115 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.115 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.116 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache host facts data", 2024-09-21T01:05:31.116 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.116 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.116 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.116 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.116 INFO:teuthology.orchestra.run.smithi001.stdout: "grafana_dashboards_path": { 2024-09-21T01:05:31.116 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "grafana_dashboards_path", 2024-09-21T01:05:31.116 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.116 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.116 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.116 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T01:05:31.116 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.116 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.116 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.116 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T01:05:31.116 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.117 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.117 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.117 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.117 INFO:teuthology.orchestra.run.smithi001.stdout: "host_check_interval": { 2024-09-21T01:05:31.117 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "host_check_interval", 2024-09-21T01:05:31.117 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:31.117 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.117 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.117 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-21T01:05:31.117 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.117 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.117 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.117 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to perform a host check", 2024-09-21T01:05:31.117 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.118 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.118 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.118 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.118 INFO:teuthology.orchestra.run.smithi001.stdout: "hw_monitoring": { 2024-09-21T01:05:31.118 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hw_monitoring", 2024-09-21T01:05:31.118 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.118 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.118 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.118 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.118 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.118 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.118 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.118 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T01:05:31.118 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.119 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.119 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.119 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.119 INFO:teuthology.orchestra.run.smithi001.stdout: "inventory_list_all": { 2024-09-21T01:05:31.119 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "inventory_list_all", 2024-09-21T01:05:31.119 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.119 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.119 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.119 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.119 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.119 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.119 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.119 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T01:05:31.120 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.120 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.120 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.120 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.120 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.120 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.120 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.120 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.120 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.120 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.120 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.121 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.121 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.121 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.121 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.121 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.121 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.121 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.121 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.121 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.121 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.121 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.121 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.121 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.122 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.122 INFO:teuthology.orchestra.run.smithi001.stdout: "log_refresh_metadata": { 2024-09-21T01:05:31.122 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_refresh_metadata", 2024-09-21T01:05:31.122 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.122 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.122 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.122 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.122 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.122 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.122 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.122 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T01:05:31.122 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.122 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.123 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.123 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.123 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.123 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.123 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.123 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.123 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.123 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.123 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.123 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.124 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.124 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T01:05:31.124 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.124 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.124 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.124 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.124 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.124 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.124 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.124 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.124 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.124 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.124 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.124 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.124 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.125 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.125 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.125 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.125 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.125 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.125 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.125 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.125 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.125 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.125 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.125 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.125 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.125 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.125 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.125 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.126 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.126 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.126 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.126 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.126 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.126 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.126 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.126 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.126 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.126 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.126 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.126 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T01:05:31.126 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T01:05:31.126 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.127 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.127 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.127 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.127 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.127 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.127 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.127 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T01:05:31.127 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.127 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.127 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.127 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.127 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T01:05:31.127 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T01:05:31.127 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.127 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.128 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.128 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "*", 2024-09-21T01:05:31.128 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.128 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.128 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.128 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T01:05:31.128 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.128 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.128 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.128 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.128 INFO:teuthology.orchestra.run.smithi001.stdout: "max_count_per_host": { 2024-09-21T01:05:31.128 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_count_per_host", 2024-09-21T01:05:31.128 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.128 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.129 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.129 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-21T01:05:31.129 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.129 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.129 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.129 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of daemons per service per host", 2024-09-21T01:05:31.129 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.129 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.129 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.129 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.129 INFO:teuthology.orchestra.run.smithi001.stdout: "max_osd_draining_count": { 2024-09-21T01:05:31.129 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_osd_draining_count", 2024-09-21T01:05:31.129 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.129 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.129 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.130 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-21T01:05:31.130 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.130 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.130 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.130 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T01:05:31.130 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.130 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.130 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.130 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.130 INFO:teuthology.orchestra.run.smithi001.stdout: "migration_current": { 2024-09-21T01:05:31.130 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "migration_current", 2024-09-21T01:05:31.130 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.130 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.130 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.131 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.131 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.131 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.131 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.131 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "internal - do not modify", 2024-09-21T01:05:31.131 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.131 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.131 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.131 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.131 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-09-21T01:05:31.131 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-09-21T01:05:31.131 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.131 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.131 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.131 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "root", 2024-09-21T01:05:31.132 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.132 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.132 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.132 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm-package", 2024-09-21T01:05:31.132 INFO:teuthology.orchestra.run.smithi001.stdout: "root" 2024-09-21T01:05:31.132 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.132 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T01:05:31.132 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.132 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.132 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.132 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.132 INFO:teuthology.orchestra.run.smithi001.stdout: "oob_default_addr": { 2024-09-21T01:05:31.132 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "oob_default_addr", 2024-09-21T01:05:31.132 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.132 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.133 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.133 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "169.254.1.1", 2024-09-21T01:05:31.133 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.133 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.133 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.133 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T01:05:31.133 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.133 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.133 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.133 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.133 INFO:teuthology.orchestra.run.smithi001.stdout: "prometheus_alerts_path": { 2024-09-21T01:05:31.133 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus_alerts_path", 2024-09-21T01:05:31.133 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.133 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.134 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.134 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T01:05:31.134 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.134 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.134 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.134 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T01:05:31.134 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.134 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.134 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.134 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.134 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_insecure": { 2024-09-21T01:05:31.134 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_insecure", 2024-09-21T01:05:31.134 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.134 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.135 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.135 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.135 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.135 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.135 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.135 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T01:05:31.135 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.135 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.135 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.135 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.135 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_password": { 2024-09-21T01:05:31.135 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_password", 2024-09-21T01:05:31.135 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.135 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.135 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.136 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.136 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.136 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.136 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.136 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T01:05:31.136 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.136 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.136 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.136 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.136 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_url": { 2024-09-21T01:05:31.136 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_url", 2024-09-21T01:05:31.136 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.136 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.137 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.137 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.137 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.137 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.137 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.137 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T01:05:31.137 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.137 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.137 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.137 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.137 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_username": { 2024-09-21T01:05:31.137 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_username", 2024-09-21T01:05:31.137 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.137 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.137 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.138 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.138 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.138 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.138 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.138 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T01:05:31.138 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.138 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.138 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.138 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.138 INFO:teuthology.orchestra.run.smithi001.stdout: "secure_monitoring_stack": { 2024-09-21T01:05:31.138 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secure_monitoring_stack", 2024-09-21T01:05:31.138 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.138 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.138 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.138 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.139 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.139 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.139 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.139 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T01:05:31.139 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.139 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.139 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.139 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.139 INFO:teuthology.orchestra.run.smithi001.stdout: "service_discovery_port": { 2024-09-21T01:05:31.139 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "service_discovery_port", 2024-09-21T01:05:31.139 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.139 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.139 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.139 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8765", 2024-09-21T01:05:31.139 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.139 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.140 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.140 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "cephadm service discovery port", 2024-09-21T01:05:31.140 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.140 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.140 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.140 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.140 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.140 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.140 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.140 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.140 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.140 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.140 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.140 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.141 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.141 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.141 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.141 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.141 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.141 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.141 INFO:teuthology.orchestra.run.smithi001.stdout: "ssh_config_file": { 2024-09-21T01:05:31.141 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssh_config_file", 2024-09-21T01:05:31.141 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.141 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.141 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.141 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.141 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.141 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.142 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.142 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T01:05:31.142 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.142 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.142 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.142 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.142 INFO:teuthology.orchestra.run.smithi001.stdout: "ssh_keepalive_count_max": { 2024-09-21T01:05:31.142 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T01:05:31.142 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.142 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.142 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.142 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3", 2024-09-21T01:05:31.142 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.142 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.143 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.143 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T01:05:31.143 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.143 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.143 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.143 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.143 INFO:teuthology.orchestra.run.smithi001.stdout: "ssh_keepalive_interval": { 2024-09-21T01:05:31.143 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssh_keepalive_interval", 2024-09-21T01:05:31.143 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.143 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.143 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.143 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7", 2024-09-21T01:05:31.143 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.143 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.143 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.144 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T01:05:31.144 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.144 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.144 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.144 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.144 INFO:teuthology.orchestra.run.smithi001.stdout: "use_agent": { 2024-09-21T01:05:31.144 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_agent", 2024-09-21T01:05:31.144 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.144 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.144 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.144 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.144 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.144 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.144 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.144 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T01:05:31.144 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.144 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.145 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.145 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.145 INFO:teuthology.orchestra.run.smithi001.stdout: "use_repo_digest": { 2024-09-21T01:05:31.145 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_repo_digest", 2024-09-21T01:05:31.145 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.145 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.145 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.145 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.145 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.145 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.145 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.145 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T01:05:31.145 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.145 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.146 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.146 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.146 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_failed_host_check": { 2024-09-21T01:05:31.146 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_failed_host_check", 2024-09-21T01:05:31.146 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.146 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.146 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.146 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.146 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.146 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.146 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.146 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T01:05:31.146 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.147 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.147 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.147 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.147 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_daemons": { 2024-09-21T01:05:31.147 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_daemons", 2024-09-21T01:05:31.147 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.147 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.147 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.147 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.147 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.147 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.147 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.147 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T01:05:31.147 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.148 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.148 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.148 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.148 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_hosts": { 2024-09-21T01:05:31.148 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_hosts", 2024-09-21T01:05:31.148 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.148 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.148 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.148 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.148 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.148 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.148 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.148 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T01:05:31.148 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.149 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.149 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.149 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.149 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.149 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.149 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.149 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crash", 2024-09-21T01:05:31.149 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.149 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.149 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.149 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.149 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.149 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.149 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.150 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.150 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.150 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.150 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.150 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.150 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.150 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.150 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.150 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.150 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.150 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.150 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.150 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.150 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.150 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.151 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.151 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.151 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.151 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.151 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.151 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.151 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.151 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.151 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.151 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.151 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.151 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.151 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.151 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.151 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.152 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.152 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.152 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.152 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.152 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.152 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.152 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.152 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.152 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.152 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.152 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.152 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.152 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.152 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.153 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.153 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.153 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.153 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.153 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.153 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.153 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.153 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.153 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.153 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.153 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.153 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.153 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.153 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.153 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.154 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.154 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.154 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.154 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.154 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.154 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.154 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.154 INFO:teuthology.orchestra.run.smithi001.stdout: "retain_interval": { 2024-09-21T01:05:31.154 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retain_interval", 2024-09-21T01:05:31.154 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:31.154 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.154 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.154 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "31536000", 2024-09-21T01:05:31.154 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.155 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.155 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.155 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T01:05:31.155 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.155 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.155 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.155 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.155 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.155 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.155 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.155 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.155 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.155 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.155 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.156 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.156 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.156 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.156 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.156 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.156 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.156 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.156 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_recent_interval": { 2024-09-21T01:05:31.156 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_recent_interval", 2024-09-21T01:05:31.156 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:31.156 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.156 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.156 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1209600", 2024-09-21T01:05:31.156 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.156 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.157 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.157 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T01:05:31.157 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.157 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.157 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.157 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.157 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.157 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.157 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.157 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dashboard", 2024-09-21T01:05:31.157 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.157 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.157 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.157 INFO:teuthology.orchestra.run.smithi001.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T01:05:31.157 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T01:05:31.158 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.158 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.158 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.158 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-21T01:05:31.158 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.158 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.158 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.158 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.158 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.158 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.158 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.158 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.158 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T01:05:31.158 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T01:05:31.159 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.159 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.159 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.159 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.159 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.159 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.159 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.159 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.159 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.159 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.159 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.159 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.159 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T01:05:31.159 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T01:05:31.160 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.160 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.160 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.160 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.160 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.160 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.160 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.160 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.160 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.160 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.160 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.160 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.160 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_ENABLED": { 2024-09-21T01:05:31.160 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T01:05:31.160 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.161 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.161 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.161 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.161 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.161 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.161 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.161 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.161 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.161 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.161 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.161 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.161 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T01:05:31.161 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T01:05:31.161 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.161 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.162 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.162 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.162 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.162 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.162 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.162 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.162 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.162 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.162 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.162 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.162 INFO:teuthology.orchestra.run.smithi001.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T01:05:31.162 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T01:05:31.162 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.162 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.162 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.163 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.163 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.163 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.163 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.163 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.163 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.163 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.163 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.163 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.163 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T01:05:31.163 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T01:05:31.163 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.163 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.163 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.164 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.164 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.164 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.164 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.164 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.164 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.164 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.164 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.164 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.164 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T01:05:31.164 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T01:05:31.164 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.164 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.165 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.165 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.165 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.165 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.165 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.165 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.165 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.165 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.165 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.165 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.165 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T01:05:31.165 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T01:05:31.165 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.165 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.165 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.166 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.166 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.166 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.166 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.166 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.166 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.166 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.166 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.166 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.166 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T01:05:31.166 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T01:05:31.166 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.166 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.166 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.167 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.167 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.167 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.167 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.167 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.167 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.167 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.167 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.167 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.167 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T01:05:31.167 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T01:05:31.167 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.167 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.167 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.168 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.168 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.168 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.168 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.168 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.168 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.168 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.168 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.168 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.168 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T01:05:31.168 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T01:05:31.168 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.168 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.168 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.168 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.169 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.169 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.169 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.169 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.169 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.169 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.169 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.169 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.169 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T01:05:31.169 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T01:05:31.169 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.169 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.169 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.169 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.170 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.170 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.170 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.170 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.170 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.170 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.170 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.170 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.170 INFO:teuthology.orchestra.run.smithi001.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T01:05:31.170 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T01:05:31.170 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.170 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.170 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.171 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.171 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.171 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.171 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.171 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.171 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.171 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.171 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.171 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.171 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T01:05:31.171 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T01:05:31.171 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.171 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.171 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.172 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-21T01:05:31.172 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.172 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.172 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.172 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.172 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.172 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.172 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.172 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.172 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T01:05:31.172 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T01:05:31.172 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.172 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.172 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.173 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.173 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.173 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.173 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.173 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.173 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.173 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.173 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.173 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.173 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_URL": { 2024-09-21T01:05:31.173 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_URL", 2024-09-21T01:05:31.173 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.173 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.173 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.173 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.174 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.174 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.174 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.174 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.174 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.174 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.174 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.174 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.174 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T01:05:31.174 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T01:05:31.174 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.174 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.174 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.174 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-21T01:05:31.174 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.175 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.175 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.175 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.175 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.175 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.175 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.175 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.175 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T01:05:31.175 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T01:05:31.175 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.175 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.175 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.175 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.176 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.176 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.176 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.176 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.176 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.176 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.176 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.176 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.176 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T01:05:31.176 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T01:05:31.176 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.176 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.176 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.177 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.177 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.177 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.177 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.177 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.177 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.177 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.177 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.177 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.177 INFO:teuthology.orchestra.run.smithi001.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T01:05:31.177 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T01:05:31.177 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.177 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.177 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.178 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.178 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.178 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.178 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.178 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.178 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.178 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.178 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.178 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.178 INFO:teuthology.orchestra.run.smithi001.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T01:05:31.178 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T01:05:31.178 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.178 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.178 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.178 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.179 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.179 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.179 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.179 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.179 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.179 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.179 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.179 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.179 INFO:teuthology.orchestra.run.smithi001.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T01:05:31.179 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T01:05:31.179 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.179 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.179 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.180 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "[]", 2024-09-21T01:05:31.180 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.180 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.180 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.180 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.180 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.180 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.180 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.180 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.180 INFO:teuthology.orchestra.run.smithi001.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T01:05:31.180 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T01:05:31.180 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.180 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.180 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.180 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "{}", 2024-09-21T01:05:31.181 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.181 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.181 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.181 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.181 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.181 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.181 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.181 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.181 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T01:05:31.181 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T01:05:31.181 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.181 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.181 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.181 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.181 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.182 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.182 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.182 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.182 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.182 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.182 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.182 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.182 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T01:05:31.182 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T01:05:31.182 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.182 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.182 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.182 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.182 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.183 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.183 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.183 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.183 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.183 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.183 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.183 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.183 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T01:05:31.183 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T01:05:31.183 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.183 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.183 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.183 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.183 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.183 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.184 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.184 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.184 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.184 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.184 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.184 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.184 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T01:05:31.184 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T01:05:31.184 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.184 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.184 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.184 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.184 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.184 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.184 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.185 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.185 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.185 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.185 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.185 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.185 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T01:05:31.185 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T01:05:31.185 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.185 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.185 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.185 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.185 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.185 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.185 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.186 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.186 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.186 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.186 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.186 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.186 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T01:05:31.186 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T01:05:31.186 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.186 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.186 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.186 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.186 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.186 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.186 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.187 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.187 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.187 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.187 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.187 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.187 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T01:05:31.187 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T01:05:31.187 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.187 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.187 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.187 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.187 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.187 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.187 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.187 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.188 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.188 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.188 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.188 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.188 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T01:05:31.188 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T01:05:31.188 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.188 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.188 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.188 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.188 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.188 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.188 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.188 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.189 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.189 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.189 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.189 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.189 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T01:05:31.189 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T01:05:31.189 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.189 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.189 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.189 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.189 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.189 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.189 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.189 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.190 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.190 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.190 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.190 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.190 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T01:05:31.190 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T01:05:31.190 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.190 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.190 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.190 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.190 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.190 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.190 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.190 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.190 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.191 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.191 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.191 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.191 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T01:05:31.191 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T01:05:31.191 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.191 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.191 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.191 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T01:05:31.191 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.191 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.191 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.191 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.191 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.192 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.192 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.192 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.192 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T01:05:31.192 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T01:05:31.192 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.192 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.192 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.192 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-21T01:05:31.192 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.192 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.192 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.192 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.192 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.193 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.193 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.193 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.193 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T01:05:31.193 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T01:05:31.193 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.193 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.193 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.193 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8", 2024-09-21T01:05:31.193 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.193 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.193 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.193 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.193 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.193 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.194 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.194 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.194 INFO:teuthology.orchestra.run.smithi001.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T01:05:31.194 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T01:05:31.194 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.194 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.194 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.194 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "45", 2024-09-21T01:05:31.194 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.194 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.194 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.194 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.194 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.195 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.195 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.195 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.195 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T01:05:31.195 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T01:05:31.195 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.195 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.195 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.195 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.195 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.195 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.195 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.195 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.195 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.196 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.196 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.196 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.196 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T01:05:31.196 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T01:05:31.196 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.196 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.196 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.196 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-21T01:05:31.196 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.196 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.196 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.196 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.196 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.196 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.197 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.197 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.197 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T01:05:31.197 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T01:05:31.197 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.197 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.197 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.197 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.197 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.197 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.197 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.197 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.197 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.197 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.197 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.198 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.198 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T01:05:31.198 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T01:05:31.198 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.198 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.198 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.198 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.198 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.198 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.198 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.198 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.198 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.198 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.198 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.199 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.199 INFO:teuthology.orchestra.run.smithi001.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T01:05:31.199 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T01:05:31.199 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.199 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.199 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.199 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.199 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.199 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.199 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.199 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.199 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.199 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.199 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.199 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.200 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T01:05:31.200 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T01:05:31.200 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.200 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.200 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.200 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.200 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.200 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.200 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.200 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.200 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.200 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.200 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.200 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.201 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T01:05:31.201 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T01:05:31.201 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.201 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.201 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.201 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-21T01:05:31.201 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.201 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.201 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.201 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.201 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.201 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.201 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.201 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.202 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T01:05:31.202 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T01:05:31.202 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.202 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.202 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.202 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-21T01:05:31.202 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.202 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.202 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.202 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.202 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.202 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.202 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.202 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.202 INFO:teuthology.orchestra.run.smithi001.stdout: "cross_origin_url": { 2024-09-21T01:05:31.203 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cross_origin_url", 2024-09-21T01:05:31.203 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.203 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.203 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.203 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.203 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.203 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.203 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.203 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.203 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.203 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.203 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.203 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.203 INFO:teuthology.orchestra.run.smithi001.stdout: "crt_file": { 2024-09-21T01:05:31.203 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crt_file", 2024-09-21T01:05:31.203 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.204 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.204 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.204 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.204 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.204 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.204 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.204 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.204 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.204 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.204 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.204 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.204 INFO:teuthology.orchestra.run.smithi001.stdout: "debug": { 2024-09-21T01:05:31.204 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "debug", 2024-09-21T01:05:31.204 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.205 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.205 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.205 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.205 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.205 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.205 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.205 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable/disable debug options", 2024-09-21T01:05:31.205 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.205 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.205 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.205 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.205 INFO:teuthology.orchestra.run.smithi001.stdout: "jwt_token_ttl": { 2024-09-21T01:05:31.205 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "jwt_token_ttl", 2024-09-21T01:05:31.205 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.205 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.205 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.206 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "28800", 2024-09-21T01:05:31.206 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.206 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.206 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.206 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.206 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.206 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.206 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.206 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.206 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-09-21T01:05:31.206 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-09-21T01:05:31.206 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.206 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.207 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.207 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.207 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.207 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.207 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.207 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.207 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.207 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.207 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.207 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.207 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.207 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.207 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.207 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.207 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.208 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.208 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.208 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.208 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.208 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.208 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.208 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.208 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.208 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.208 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.208 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.208 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.208 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.208 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.208 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.209 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.209 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.209 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.209 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.209 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.209 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.209 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.209 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.209 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.209 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.209 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.209 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.209 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.209 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.209 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.209 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.210 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.210 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.210 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.210 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.210 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.210 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.210 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.210 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.210 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.210 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.210 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.210 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.210 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.210 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.211 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.211 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.211 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.211 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.211 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.211 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.211 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.211 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.211 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.211 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.211 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.211 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.211 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.211 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.211 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.212 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.212 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.212 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.212 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.212 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.212 INFO:teuthology.orchestra.run.smithi001.stdout: "motd": { 2024-09-21T01:05:31.212 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "motd", 2024-09-21T01:05:31.212 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.212 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.212 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.212 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.212 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.212 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.212 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.213 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "The message of the day", 2024-09-21T01:05:31.213 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.213 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.213 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.213 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.213 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect_resolve_ip_addr": { 2024-09-21T01:05:31.213 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T01:05:31.213 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.213 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.213 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.213 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.213 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.213 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.213 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.214 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.214 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.214 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.214 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.214 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.214 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-21T01:05:31.214 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-21T01:05:31.214 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.214 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.214 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.214 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-09-21T01:05:31.214 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.214 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.214 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.215 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.215 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.215 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.215 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.215 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.215 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-21T01:05:31.215 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-21T01:05:31.215 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.215 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.215 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.215 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8080", 2024-09-21T01:05:31.215 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.215 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.215 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.216 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.216 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.216 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.216 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.216 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.216 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.216 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.216 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.216 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.216 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.216 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.216 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.216 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.216 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.216 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.217 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.217 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.217 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.217 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.217 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-09-21T01:05:31.217 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-09-21T01:05:31.217 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.217 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.217 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.217 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.217 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.217 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.217 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.217 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.217 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.218 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.218 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.218 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.218 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl_server_port": { 2024-09-21T01:05:31.218 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl_server_port", 2024-09-21T01:05:31.218 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.218 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.218 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.218 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8443", 2024-09-21T01:05:31.218 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.218 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.218 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.218 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.218 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.219 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.219 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.219 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.219 INFO:teuthology.orchestra.run.smithi001.stdout: "sso_oauth2": { 2024-09-21T01:05:31.219 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sso_oauth2", 2024-09-21T01:05:31.219 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.219 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.219 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.219 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.219 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.219 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.219 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.219 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.219 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.219 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.220 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.220 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.220 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-09-21T01:05:31.220 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-09-21T01:05:31.220 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.220 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.220 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.220 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "redirect", 2024-09-21T01:05:31.220 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.220 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.220 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.220 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.220 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect" 2024-09-21T01:05:31.220 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.221 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.221 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.221 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.221 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.221 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.221 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-09-21T01:05:31.221 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-09-21T01:05:31.221 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.221 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.221 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.221 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-21T01:05:31.221 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-09-21T01:05:31.221 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-09-21T01:05:31.221 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.221 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.222 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.222 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.222 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.222 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.222 INFO:teuthology.orchestra.run.smithi001.stdout: "url_prefix": { 2024-09-21T01:05:31.222 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url_prefix", 2024-09-21T01:05:31.222 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.222 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.222 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.222 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.222 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.222 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.222 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.222 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.223 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.223 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.223 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.223 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.223 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.223 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.223 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.223 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "devicehealth", 2024-09-21T01:05:31.223 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.223 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.223 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.223 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_monitoring": { 2024-09-21T01:05:31.223 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_monitoring", 2024-09-21T01:05:31.223 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.224 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.224 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.224 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.224 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.224 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.224 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.224 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "monitor device health metrics", 2024-09-21T01:05:31.224 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.224 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.224 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.224 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.224 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.224 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.225 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.225 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.225 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.225 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.225 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.225 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.225 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.225 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.225 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.225 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.225 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.225 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.225 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.225 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.226 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.226 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.226 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.226 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.226 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.226 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.226 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.226 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.226 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.226 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.226 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.226 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.226 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.226 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.226 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.227 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.227 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.227 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.227 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.227 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.227 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.227 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.227 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.227 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.227 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.227 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.227 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.227 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.228 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.228 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.228 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.228 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.228 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.228 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.228 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.228 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.228 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.228 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.228 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.228 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.228 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.228 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.228 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.229 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.229 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.229 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.229 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.229 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.229 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.229 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.229 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.229 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.229 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.229 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.229 INFO:teuthology.orchestra.run.smithi001.stdout: "mark_out_threshold": { 2024-09-21T01:05:31.229 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mark_out_threshold", 2024-09-21T01:05:31.229 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:31.229 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.230 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.230 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2419200", 2024-09-21T01:05:31.230 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.230 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.230 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.230 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T01:05:31.230 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.230 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.230 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.230 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.230 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_name": { 2024-09-21T01:05:31.230 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_name", 2024-09-21T01:05:31.230 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.231 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.231 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.231 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "device_health_metrics", 2024-09-21T01:05:31.231 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.231 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.231 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.231 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T01:05:31.231 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.231 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.231 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.231 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.231 INFO:teuthology.orchestra.run.smithi001.stdout: "retention_period": { 2024-09-21T01:05:31.231 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retention_period", 2024-09-21T01:05:31.231 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:31.231 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.232 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.232 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15552000", 2024-09-21T01:05:31.232 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.232 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.232 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.232 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain device health metrics", 2024-09-21T01:05:31.232 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.232 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.232 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.232 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.232 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_frequency": { 2024-09-21T01:05:31.232 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_frequency", 2024-09-21T01:05:31.232 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:31.232 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.232 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.233 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-09-21T01:05:31.233 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.233 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.233 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.233 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T01:05:31.233 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.233 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.233 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.233 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.233 INFO:teuthology.orchestra.run.smithi001.stdout: "self_heal": { 2024-09-21T01:05:31.233 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "self_heal", 2024-09-21T01:05:31.233 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.233 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.233 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.233 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.234 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.234 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.234 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.234 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T01:05:31.234 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.234 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.234 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.234 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.234 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-21T01:05:31.234 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-21T01:05:31.234 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:31.234 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.234 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.234 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-21T01:05:31.235 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.235 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.235 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.235 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T01:05:31.235 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.235 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.235 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.235 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.235 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.235 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.235 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.235 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.235 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.235 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.235 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.236 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.236 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.236 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.236 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.236 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.236 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.236 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.236 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_threshold": { 2024-09-21T01:05:31.236 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_threshold", 2024-09-21T01:05:31.236 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:31.236 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.236 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.236 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7257600", 2024-09-21T01:05:31.236 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.237 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.237 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.237 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T01:05:31.237 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.237 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.237 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.237 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.237 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.237 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.237 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.237 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "diskprediction_local", 2024-09-21T01:05:31.237 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.237 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.237 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.237 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.238 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.238 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.238 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.238 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.238 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.238 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.238 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.238 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.238 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.238 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.238 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.238 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.238 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.238 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.239 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.239 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.239 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.239 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.239 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.239 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.239 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.239 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.239 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.239 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.239 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.239 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.239 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.239 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.239 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.239 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.240 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.240 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.240 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.240 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.240 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.240 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.240 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.240 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.240 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.240 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.240 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.240 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.240 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.240 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.240 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.241 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.241 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.241 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.241 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.241 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.241 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.241 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.241 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.241 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.241 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.241 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.241 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.241 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.241 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.241 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.241 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.242 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.242 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.242 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.242 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.242 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.242 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.242 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.242 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.242 INFO:teuthology.orchestra.run.smithi001.stdout: "predict_interval": { 2024-09-21T01:05:31.242 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predict_interval", 2024-09-21T01:05:31.242 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.242 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.242 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.243 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-09-21T01:05:31.243 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.243 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.243 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.243 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.243 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.243 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.243 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.243 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.243 INFO:teuthology.orchestra.run.smithi001.stdout: "predictor_model": { 2024-09-21T01:05:31.243 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predictor_model", 2024-09-21T01:05:31.243 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.243 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.243 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.243 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "prophetstor", 2024-09-21T01:05:31.244 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.244 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.244 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.244 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.244 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.244 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.244 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.244 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.244 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-21T01:05:31.244 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-21T01:05:31.244 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.244 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.244 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.244 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-21T01:05:31.244 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.245 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.245 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.245 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.245 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.245 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.245 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.245 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.245 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.245 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.245 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.245 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.245 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.245 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.245 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.245 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.246 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.246 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.246 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.246 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.246 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.246 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.246 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.246 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.246 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.246 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "influx", 2024-09-21T01:05:31.246 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": false, 2024-09-21T01:05:31.246 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "influxdb python module not found", 2024-09-21T01:05:31.246 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.246 INFO:teuthology.orchestra.run.smithi001.stdout: "batch_size": { 2024-09-21T01:05:31.246 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "batch_size", 2024-09-21T01:05:31.247 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.247 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.247 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.247 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5000", 2024-09-21T01:05:31.247 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.247 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.247 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.247 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T01:05:31.247 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.247 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.247 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.247 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.247 INFO:teuthology.orchestra.run.smithi001.stdout: "database": { 2024-09-21T01:05:31.247 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "database", 2024-09-21T01:05:31.247 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.248 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.248 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.248 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "ceph", 2024-09-21T01:05:31.248 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.248 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.248 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.248 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T01:05:31.248 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.248 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.248 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.248 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.248 INFO:teuthology.orchestra.run.smithi001.stdout: "hostname": { 2024-09-21T01:05:31.248 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hostname", 2024-09-21T01:05:31.248 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.249 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.249 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.249 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.249 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.249 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.249 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.249 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server hostname", 2024-09-21T01:05:31.249 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.249 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.249 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.249 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.249 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-21T01:05:31.249 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-21T01:05:31.249 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:31.250 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.250 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.250 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "30", 2024-09-21T01:05:31.250 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "5", 2024-09-21T01:05:31.250 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.250 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.250 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T01:05:31.250 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.250 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.250 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.250 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.250 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.250 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.250 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.250 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.251 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.251 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.251 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.251 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.251 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.251 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.251 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.251 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.251 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.251 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.251 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.251 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.251 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.251 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.251 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.252 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.252 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.252 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.252 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.252 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.252 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.252 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.252 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.252 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.252 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.252 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.252 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.252 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.252 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.253 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.253 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.253 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.253 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.253 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.253 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.253 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.253 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.253 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.253 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.253 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.253 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.253 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.253 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.254 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.254 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.254 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.254 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.254 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.254 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.254 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.254 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.254 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.254 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.254 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.254 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.254 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.255 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.255 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.255 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.255 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.255 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.255 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.255 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.255 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.255 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.255 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.255 INFO:teuthology.orchestra.run.smithi001.stdout: "password": { 2024-09-21T01:05:31.255 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "password", 2024-09-21T01:05:31.255 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.255 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.256 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.256 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.256 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.256 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.256 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.256 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "password of InfluxDB server user", 2024-09-21T01:05:31.256 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.256 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.256 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.256 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.256 INFO:teuthology.orchestra.run.smithi001.stdout: "port": { 2024-09-21T01:05:31.256 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "port", 2024-09-21T01:05:31.256 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.256 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.256 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.256 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8086", 2024-09-21T01:05:31.257 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.257 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.257 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.257 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server port", 2024-09-21T01:05:31.257 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.257 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.257 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.257 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.257 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.257 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.257 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.257 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.257 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.257 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.257 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.258 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.258 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.258 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.258 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.258 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.258 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.258 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.258 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-09-21T01:05:31.258 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-09-21T01:05:31.258 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.258 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.258 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.258 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "false", 2024-09-21T01:05:31.258 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.259 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.259 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.259 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T01:05:31.259 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.259 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.259 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.259 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.259 INFO:teuthology.orchestra.run.smithi001.stdout: "threads": { 2024-09-21T01:05:31.259 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threads", 2024-09-21T01:05:31.259 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.259 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.259 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.259 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-21T01:05:31.259 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-21T01:05:31.259 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "32", 2024-09-21T01:05:31.260 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.260 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T01:05:31.260 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.260 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.260 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.260 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.260 INFO:teuthology.orchestra.run.smithi001.stdout: "username": { 2024-09-21T01:05:31.260 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "username", 2024-09-21T01:05:31.260 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.260 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.260 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.260 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.261 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.261 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.261 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.261 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "username of InfluxDB server user", 2024-09-21T01:05:31.261 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.261 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.261 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.261 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.261 INFO:teuthology.orchestra.run.smithi001.stdout: "verify_ssl": { 2024-09-21T01:05:31.261 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "verify_ssl", 2024-09-21T01:05:31.261 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.261 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.261 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.261 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "true", 2024-09-21T01:05:31.261 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.262 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.262 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.262 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T01:05:31.262 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.262 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.262 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.262 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.262 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.262 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.262 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.262 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "insights", 2024-09-21T01:05:31.262 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.262 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.262 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.263 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.263 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.263 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.263 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.263 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.263 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.263 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.263 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.263 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.263 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.263 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.263 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.263 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.263 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.264 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.264 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.264 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.264 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.264 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.264 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.264 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.264 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.264 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.264 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.264 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.264 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.264 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.264 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.265 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.265 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.265 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.265 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.265 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.265 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.265 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.265 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.265 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.265 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.265 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.265 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.265 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.265 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.266 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.266 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.266 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.266 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.266 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.266 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.266 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.266 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.266 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.266 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.266 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.266 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.266 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.266 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.267 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.267 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.267 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.267 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.267 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.267 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.267 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.267 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.267 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.267 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.267 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.267 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.267 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.267 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.267 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.268 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.268 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.268 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.268 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.268 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.268 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.268 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.268 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.268 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.268 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.268 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.268 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.268 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.268 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.269 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.269 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.269 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "iostat", 2024-09-21T01:05:31.269 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.269 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.269 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.269 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.269 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.269 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.269 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.269 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.269 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.269 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.269 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.270 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.270 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.270 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.270 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.270 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.270 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.270 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.270 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.270 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.270 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.270 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.270 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.270 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.271 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.271 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.271 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.271 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.271 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.271 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.271 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.271 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.271 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.271 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.271 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.271 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.271 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.271 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.272 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.272 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.272 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.272 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.272 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.272 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.272 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.272 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.272 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.272 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.272 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.272 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.272 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.272 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.273 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.273 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.273 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.273 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.273 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.273 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.273 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.273 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.273 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.273 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.273 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.273 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.273 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.273 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.273 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.274 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.274 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.274 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.274 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.274 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.274 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.274 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.274 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.274 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.274 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.274 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.274 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.274 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.274 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.274 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.275 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.275 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.275 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.275 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.275 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.275 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.275 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.275 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.275 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "k8sevents", 2024-09-21T01:05:31.275 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.275 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.275 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.275 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_event_retention_days": { 2024-09-21T01:05:31.276 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ceph_event_retention_days", 2024-09-21T01:05:31.276 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.276 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.276 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.276 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7", 2024-09-21T01:05:31.276 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.276 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.276 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.276 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T01:05:31.276 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.276 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.276 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.276 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.276 INFO:teuthology.orchestra.run.smithi001.stdout: "config_check_secs": { 2024-09-21T01:05:31.277 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_check_secs", 2024-09-21T01:05:31.277 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.277 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.277 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.277 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-21T01:05:31.277 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "10", 2024-09-21T01:05:31.277 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.277 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.277 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T01:05:31.277 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.277 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.277 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.277 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.277 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.277 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.278 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.278 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.278 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.278 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.278 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.278 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.278 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.278 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.278 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.278 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.278 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.278 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.278 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.278 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.279 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.279 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.279 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.279 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.279 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.279 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.279 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.279 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.279 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.279 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.279 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.279 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.279 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.279 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.280 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.280 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.280 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.280 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.280 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.280 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.280 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.280 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.280 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.280 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.280 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.280 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.280 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.280 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.280 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.281 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.281 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.281 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.281 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.281 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.281 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.281 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.281 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.281 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.281 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.281 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.281 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.281 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.281 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.282 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.282 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.282 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.282 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.282 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.282 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.282 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.282 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.282 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.282 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.282 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.282 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.282 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.282 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.282 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.283 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.283 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.283 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.283 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.283 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.283 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.283 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.283 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.283 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.283 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.283 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.283 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.283 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.283 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "localpool", 2024-09-21T01:05:31.283 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.284 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.284 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.284 INFO:teuthology.orchestra.run.smithi001.stdout: "failure_domain": { 2024-09-21T01:05:31.284 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "failure_domain", 2024-09-21T01:05:31.284 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.284 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.284 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.284 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "host", 2024-09-21T01:05:31.284 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.284 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.284 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.284 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "failure domain for any created local pool", 2024-09-21T01:05:31.284 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T01:05:31.284 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.285 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.285 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.285 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.285 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.285 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.285 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.285 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.285 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.285 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.285 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.285 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.285 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.285 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.285 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.285 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.286 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.286 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.286 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.286 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.286 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.286 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.286 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.286 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.286 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.286 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.286 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.286 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.286 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.286 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.286 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.287 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.287 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.287 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.287 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.287 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.287 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.287 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.287 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.287 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.287 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.287 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.287 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.287 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.287 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.287 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.288 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.288 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.288 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.288 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.288 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.288 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.288 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.288 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.288 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.288 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.288 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.288 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.288 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.288 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.288 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.289 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.289 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.289 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.289 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.289 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.289 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.289 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.289 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.289 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.289 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.289 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.289 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.289 INFO:teuthology.orchestra.run.smithi001.stdout: "min_size": { 2024-09-21T01:05:31.289 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_size", 2024-09-21T01:05:31.290 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.290 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.290 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.290 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.290 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.290 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.290 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.290 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default min_size for any created local pool", 2024-09-21T01:05:31.290 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T01:05:31.290 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.290 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.290 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.290 INFO:teuthology.orchestra.run.smithi001.stdout: "num_rep": { 2024-09-21T01:05:31.290 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "num_rep", 2024-09-21T01:05:31.291 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.291 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.291 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.291 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3", 2024-09-21T01:05:31.291 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.291 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.291 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.291 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default replica count for any created local pool", 2024-09-21T01:05:31.291 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.291 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.291 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.291 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.291 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num": { 2024-09-21T01:05:31.291 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_num", 2024-09-21T01:05:31.291 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.292 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.292 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.292 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "128", 2024-09-21T01:05:31.292 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.292 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.292 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.292 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T01:05:31.292 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.292 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.292 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.292 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.292 INFO:teuthology.orchestra.run.smithi001.stdout: "prefix": { 2024-09-21T01:05:31.292 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prefix", 2024-09-21T01:05:31.292 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.292 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.293 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.293 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.293 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.293 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.293 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.293 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name prefix for any created local pool", 2024-09-21T01:05:31.293 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.293 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.293 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.293 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.293 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.293 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.293 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.293 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.293 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.294 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.294 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.294 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.294 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.294 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.294 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.294 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.294 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.294 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.294 INFO:teuthology.orchestra.run.smithi001.stdout: "subtree": { 2024-09-21T01:05:31.294 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "subtree", 2024-09-21T01:05:31.294 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.294 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.294 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.294 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "rack", 2024-09-21T01:05:31.295 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.295 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.295 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.295 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T01:05:31.295 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T01:05:31.295 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.295 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.295 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.295 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.295 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.295 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.295 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mds_autoscaler", 2024-09-21T01:05:31.295 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.295 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.295 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.296 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.296 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.296 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.296 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.296 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.296 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.296 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.296 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.296 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.296 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.296 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.296 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.296 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.297 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.297 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.297 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.297 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.297 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.297 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.297 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.297 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.297 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.297 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.297 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.297 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.297 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.297 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.298 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.298 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.298 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.298 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.298 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.298 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.298 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.298 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.298 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.298 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.298 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.298 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.298 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.298 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.298 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.299 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.299 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.299 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.299 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.299 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.299 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.299 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.299 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.299 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.299 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.299 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.299 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.299 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.299 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.299 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.299 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.300 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.300 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.300 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.300 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.300 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.300 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.300 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.300 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.300 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.300 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.300 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.300 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.300 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.300 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.300 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.301 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.301 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.301 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.301 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.301 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.301 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.301 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.301 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.301 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.301 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.301 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.301 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.301 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.301 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.302 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirroring", 2024-09-21T01:05:31.302 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.302 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.302 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.302 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.302 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.302 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.302 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.302 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.302 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.302 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.302 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.302 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.302 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.303 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.303 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.303 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.303 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.303 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.303 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.303 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.303 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.303 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.303 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.303 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.303 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.304 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.304 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.304 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.304 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.304 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.304 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.304 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.304 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.304 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.304 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.304 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.304 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.304 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.304 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.304 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.305 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.305 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.305 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.305 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.305 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.305 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.305 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.305 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.305 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.305 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.305 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.305 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.305 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.305 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.305 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.306 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.306 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.306 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.306 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.306 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.306 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.306 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.306 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.306 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.306 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.306 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.306 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.306 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.306 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.306 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.307 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.307 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.307 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.307 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.307 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.307 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.307 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.307 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.307 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.307 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.307 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.307 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.307 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.307 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.308 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.308 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.308 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.308 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.308 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.308 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.308 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "nfs", 2024-09-21T01:05:31.308 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.308 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.308 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.308 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.308 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.308 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.308 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.309 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.309 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.309 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.309 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.309 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.309 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.309 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.309 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.309 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.309 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.309 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.309 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.309 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.309 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.309 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.310 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.310 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.310 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.310 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.310 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.310 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.310 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.310 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.310 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.310 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.310 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.310 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.310 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.311 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.311 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.311 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.311 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.311 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.311 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.311 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.313 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.313 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.313 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.313 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.313 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.313 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.314 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.314 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.314 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.314 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.314 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.314 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.314 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.314 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.314 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.314 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.314 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.314 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.314 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.314 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.315 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.315 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.315 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.315 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.315 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.315 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.315 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.315 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.315 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.315 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.315 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.315 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.315 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.315 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.315 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.316 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.316 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.316 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.316 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.316 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.316 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.316 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.316 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.316 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.316 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.316 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.316 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.316 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.316 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-09-21T01:05:31.316 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.317 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.317 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.317 INFO:teuthology.orchestra.run.smithi001.stdout: "fail_fs": { 2024-09-21T01:05:31.317 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "fail_fs", 2024-09-21T01:05:31.317 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.317 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.317 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.317 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.317 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.317 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.317 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.317 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T01:05:31.317 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.317 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.317 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.318 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.318 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.318 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.318 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.318 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.318 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.318 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.318 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.318 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.318 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.318 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.318 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.318 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.318 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.318 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.319 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.319 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.319 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.319 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.319 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.319 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.319 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.319 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.319 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.319 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.319 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.319 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.319 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.319 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.320 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.320 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.320 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.320 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.320 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.320 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.320 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.320 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.320 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.320 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.320 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.320 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.320 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.320 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.321 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.321 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.321 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.321 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.321 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.321 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.321 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.321 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.321 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.321 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.321 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.321 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.321 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.321 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.321 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.322 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.322 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.322 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.322 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.322 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.322 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.322 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.322 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.322 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.322 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.322 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.322 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.322 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.323 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator": { 2024-09-21T01:05:31.323 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-09-21T01:05:31.323 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.323 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.323 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.323 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.323 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.323 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.323 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.323 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm", 2024-09-21T01:05:31.323 INFO:teuthology.orchestra.run.smithi001.stdout: "rook", 2024-09-21T01:05:31.323 INFO:teuthology.orchestra.run.smithi001.stdout: "test_orchestrator" 2024-09-21T01:05:31.323 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.323 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Orchestrator backend", 2024-09-21T01:05:31.323 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.324 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.324 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.324 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.324 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.324 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.324 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.324 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.324 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.324 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.324 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.324 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.324 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.324 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.324 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.324 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.325 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.325 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.325 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.325 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.325 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.325 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_perf_query", 2024-09-21T01:05:31.325 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.325 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.325 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.325 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.325 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.325 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.325 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.325 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.325 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.326 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.326 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.326 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.326 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.326 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.326 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.326 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.326 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.326 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.326 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.326 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.326 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.326 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.327 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.327 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.327 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.327 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.327 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.327 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.327 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.327 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.327 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.327 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.327 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.327 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.327 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.327 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.328 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.328 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.328 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.328 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.328 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.328 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.328 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.328 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.328 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.328 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.328 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.328 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.328 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.328 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.328 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.328 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.329 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.329 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.329 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.329 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.329 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.329 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.329 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.329 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.329 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.329 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.329 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.329 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.329 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.329 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.330 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.330 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.330 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.330 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.330 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.330 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.330 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.330 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.330 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.330 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.330 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.330 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.330 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.330 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.330 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.331 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.331 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.331 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.331 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.331 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.331 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.331 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.331 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.331 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.331 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_support", 2024-09-21T01:05:31.331 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.331 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.331 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.331 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.331 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.332 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.332 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.332 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.332 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.332 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.332 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.332 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.332 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.332 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.332 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.332 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.332 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.333 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.333 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.333 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.333 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.333 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.333 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.333 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.333 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.333 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.333 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.333 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.333 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.333 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.333 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.333 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.334 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.334 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.334 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.334 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.334 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.334 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.334 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.334 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.334 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.334 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.334 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.334 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.334 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.335 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.335 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.335 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.335 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.335 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.335 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.335 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.335 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.335 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.335 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.335 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.335 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.335 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.335 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.335 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.336 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.336 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.336 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.336 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.336 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.336 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.336 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.336 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.336 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.336 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.336 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.336 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.336 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.336 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.336 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.337 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.337 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.337 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.337 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.337 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.337 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.337 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.337 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.337 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.337 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.337 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.337 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.337 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.337 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.338 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.338 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_autoscaler", 2024-09-21T01:05:31.338 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.338 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.338 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.338 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.338 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.338 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.338 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.338 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.338 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.338 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.338 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.339 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.339 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.339 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.339 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.339 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.339 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.339 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.339 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.339 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.339 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.339 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.339 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.339 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.339 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.339 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.339 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.340 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.340 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.340 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.340 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.340 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.340 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.340 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.340 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.340 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.340 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.340 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.340 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.340 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.340 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.340 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.340 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.340 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.341 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.341 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.341 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.341 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.341 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.341 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.341 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.341 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.341 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.341 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.341 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.341 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.341 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.341 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.342 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.342 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.342 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.342 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.342 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.342 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.342 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.342 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.342 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.342 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.342 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.342 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.342 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.342 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.342 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.343 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-21T01:05:31.343 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-21T01:05:31.343 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:31.343 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.343 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.343 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-21T01:05:31.343 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.343 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.343 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.343 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.343 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.343 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.343 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.343 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.344 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.344 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.344 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.344 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.344 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.344 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.344 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.344 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.344 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.344 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.344 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.344 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.344 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.345 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.345 INFO:teuthology.orchestra.run.smithi001.stdout: "threshold": { 2024-09-21T01:05:31.345 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threshold", 2024-09-21T01:05:31.345 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-21T01:05:31.345 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.345 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.345 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-09-21T01:05:31.345 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1.0", 2024-09-21T01:05:31.345 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.345 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.345 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "scaling threshold", 2024-09-21T01:05:31.345 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T01:05:31.345 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.345 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.345 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.346 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.346 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.346 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.346 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "progress", 2024-09-21T01:05:31.346 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.346 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.346 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.346 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_pg_recovery_event": { 2024-09-21T01:05:31.346 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_pg_recovery_event", 2024-09-21T01:05:31.346 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.346 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.346 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.346 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.346 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.346 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.346 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.347 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T01:05:31.347 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.347 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.347 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.347 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.347 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-09-21T01:05:31.347 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-09-21T01:05:31.347 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.347 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.347 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.347 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.347 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.347 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.347 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.348 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.348 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.348 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.348 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.348 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.348 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.348 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.348 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.348 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.348 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.348 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.348 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.348 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.348 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.349 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.349 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.349 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.349 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.349 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.349 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.349 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.349 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.349 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.349 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.349 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.349 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.349 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.349 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.349 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.349 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.350 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.350 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.350 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.350 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.350 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.350 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.350 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.350 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.350 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.350 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.350 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.350 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.350 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.351 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.351 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.351 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.351 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.351 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.351 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.351 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.351 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.351 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.351 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.351 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.351 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.351 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.351 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.351 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.352 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.352 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.352 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.352 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.352 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.352 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.352 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.352 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.352 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.352 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.352 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.352 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.352 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.352 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.353 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.353 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.353 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.353 INFO:teuthology.orchestra.run.smithi001.stdout: "max_completed_events": { 2024-09-21T01:05:31.353 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_completed_events", 2024-09-21T01:05:31.353 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.353 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.353 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.353 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "50", 2024-09-21T01:05:31.353 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.353 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.353 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.353 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "number of past completed events to remember", 2024-09-21T01:05:31.353 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.354 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.354 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.354 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.354 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-21T01:05:31.354 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-21T01:05:31.354 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:31.354 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.354 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.354 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-21T01:05:31.354 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.354 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.354 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.354 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long the module is going to sleep", 2024-09-21T01:05:31.354 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.355 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.355 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.355 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.355 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.355 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.355 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.355 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.355 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.355 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.355 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.355 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.355 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.355 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.355 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.355 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.356 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.356 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.356 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.356 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.356 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.356 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus", 2024-09-21T01:05:31.356 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.356 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.356 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.356 INFO:teuthology.orchestra.run.smithi001.stdout: "cache": { 2024-09-21T01:05:31.356 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cache", 2024-09-21T01:05:31.356 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.356 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.356 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.357 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.357 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.357 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.357 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.357 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.357 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.357 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.357 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.357 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.357 INFO:teuthology.orchestra.run.smithi001.stdout: "exclude_perf_counters": { 2024-09-21T01:05:31.357 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "exclude_perf_counters", 2024-09-21T01:05:31.357 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.357 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.357 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.357 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.358 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.358 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.358 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.358 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T01:05:31.358 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T01:05:31.358 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.358 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.358 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.358 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.358 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.358 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.358 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.358 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.358 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.359 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.359 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.359 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.359 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.359 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.359 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.359 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.359 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.359 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.359 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.359 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.359 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.359 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.359 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.359 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.360 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.360 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.360 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.360 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.360 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.360 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.360 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.360 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.360 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.360 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.360 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.360 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.360 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.360 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.360 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.361 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.361 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.361 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.361 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.361 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.361 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.361 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.361 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.361 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.361 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.361 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.361 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.361 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.361 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.361 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.362 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.362 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.362 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.362 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.362 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.362 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.362 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.362 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.362 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.362 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.362 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.362 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.362 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.362 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.363 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.363 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.363 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.363 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.363 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.363 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools": { 2024-09-21T01:05:31.363 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools", 2024-09-21T01:05:31.363 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.363 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.363 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.363 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.363 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.363 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.363 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.363 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.364 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.364 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.364 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.364 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.364 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T01:05:31.364 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T01:05:31.364 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.364 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.364 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.364 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "300", 2024-09-21T01:05:31.364 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.364 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.364 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.364 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.364 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.365 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.365 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.365 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.365 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_interval": { 2024-09-21T01:05:31.365 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_interval", 2024-09-21T01:05:31.365 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-21T01:05:31.365 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.365 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.365 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15.0", 2024-09-21T01:05:31.365 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.365 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.365 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.365 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.365 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.365 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.366 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.366 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.366 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-21T01:05:31.366 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-21T01:05:31.366 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.366 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.366 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.366 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-09-21T01:05:31.366 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.366 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.366 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.366 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T01:05:31.366 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.366 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.367 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.367 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.367 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-21T01:05:31.367 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-21T01:05:31.367 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.367 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.367 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.367 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "9283", 2024-09-21T01:05:31.367 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.367 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.367 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.367 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T01:05:31.367 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.367 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.367 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.367 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.368 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.368 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.368 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.368 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.368 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.368 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.368 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.368 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.368 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.368 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.368 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.368 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.368 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.368 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.369 INFO:teuthology.orchestra.run.smithi001.stdout: "stale_cache_strategy": { 2024-09-21T01:05:31.369 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stale_cache_strategy", 2024-09-21T01:05:31.369 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.369 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.369 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.369 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "log", 2024-09-21T01:05:31.369 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.369 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.369 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.369 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.369 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.369 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.369 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.369 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.369 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-09-21T01:05:31.370 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-09-21T01:05:31.370 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.370 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.370 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.370 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "default", 2024-09-21T01:05:31.370 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.370 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.370 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.370 INFO:teuthology.orchestra.run.smithi001.stdout: "default", 2024-09-21T01:05:31.370 INFO:teuthology.orchestra.run.smithi001.stdout: "error" 2024-09-21T01:05:31.370 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.370 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.370 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.370 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.370 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.371 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.371 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-09-21T01:05:31.371 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-09-21T01:05:31.371 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.371 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.371 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.371 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-21T01:05:31.371 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-09-21T01:05:31.371 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-09-21T01:05:31.371 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.371 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.371 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.371 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.371 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.371 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.372 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.372 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.372 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.372 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_support", 2024-09-21T01:05:31.372 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.372 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.372 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.372 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.372 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.372 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.372 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.372 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.372 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.372 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.372 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.373 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.373 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.373 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.373 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.373 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.373 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.373 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.373 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.373 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.373 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.373 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.373 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.373 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.373 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.373 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.373 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.374 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.374 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.374 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.374 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.374 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.374 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.374 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.374 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.374 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.374 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.374 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.375 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.375 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.375 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.375 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.375 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.375 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.375 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.375 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.375 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.375 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.375 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.375 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.375 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.375 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.375 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.376 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.376 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.376 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.376 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.376 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.376 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.376 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.376 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.376 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.376 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.376 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.376 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.376 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.376 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.377 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.377 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.377 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.377 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.377 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.377 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.377 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_snap_create": { 2024-09-21T01:05:31.377 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_snap_create", 2024-09-21T01:05:31.377 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.377 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.377 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.377 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-21T01:05:31.377 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.377 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.377 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.378 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.378 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.378 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.378 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.378 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.378 INFO:teuthology.orchestra.run.smithi001.stdout: "mirror_snapshot_schedule": { 2024-09-21T01:05:31.378 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T01:05:31.378 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.378 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.378 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.378 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.378 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.378 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.378 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.378 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.379 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.379 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.379 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.379 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.379 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.379 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.379 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.379 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.379 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.379 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.379 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.379 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.379 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.379 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.380 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.380 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.380 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.380 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.380 INFO:teuthology.orchestra.run.smithi001.stdout: "trash_purge_schedule": { 2024-09-21T01:05:31.380 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "trash_purge_schedule", 2024-09-21T01:05:31.380 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.380 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.380 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.380 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.380 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.380 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.380 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.381 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.381 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.381 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.381 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.381 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.381 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.381 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.381 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.381 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "restful", 2024-09-21T01:05:31.381 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.381 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.381 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.381 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_auth": { 2024-09-21T01:05:31.381 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_auth", 2024-09-21T01:05:31.382 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.382 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.382 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.382 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.382 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.382 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.382 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.382 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.382 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.382 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.382 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.382 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.382 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-09-21T01:05:31.382 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-09-21T01:05:31.383 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.383 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.383 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.383 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.383 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.383 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.383 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.383 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.383 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.383 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.383 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.383 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.383 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.383 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.383 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.384 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.384 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.384 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.384 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.384 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.384 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.384 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.384 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.384 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.384 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.384 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.384 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.384 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.384 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.384 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.385 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.385 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.385 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.385 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.385 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.385 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.385 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.385 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.385 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.385 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.385 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.385 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.385 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.385 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.385 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.385 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.386 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.386 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.386 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.386 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.386 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.386 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.386 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.386 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.386 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.386 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.386 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.386 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.387 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.387 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.387 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.387 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.387 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.387 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.387 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.387 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.387 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.387 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.387 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.387 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.387 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.387 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.388 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.388 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.388 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.388 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.388 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.388 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.388 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.388 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.388 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.388 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.388 INFO:teuthology.orchestra.run.smithi001.stdout: "max_requests": { 2024-09-21T01:05:31.388 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_requests", 2024-09-21T01:05:31.388 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.388 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.388 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.389 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-21T01:05:31.389 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.389 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.389 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.389 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T01:05:31.389 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.389 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.389 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.389 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.389 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-21T01:05:31.389 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-21T01:05:31.389 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.389 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.389 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.389 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.390 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.390 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.390 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.390 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.390 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.390 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.390 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.390 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.390 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-21T01:05:31.390 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-21T01:05:31.390 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.390 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.390 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.391 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.391 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.391 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.391 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.391 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.391 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.391 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.391 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.391 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.391 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.391 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.391 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.391 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.391 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.391 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.392 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.392 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.392 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.392 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.392 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.392 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.392 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.392 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.392 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.392 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.392 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.392 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rgw", 2024-09-21T01:05:31.393 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.393 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.393 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.393 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.393 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.393 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.393 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.393 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.393 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.393 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.393 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.393 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.393 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.393 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.393 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.394 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.394 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.394 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.394 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.394 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.394 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.394 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.394 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.394 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.394 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.394 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.394 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.394 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.394 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.394 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.395 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.395 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.395 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.395 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.395 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.395 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.395 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.395 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.395 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.395 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.395 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.395 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.395 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.395 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.395 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.396 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.396 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.396 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.396 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.396 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.396 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.396 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.396 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.396 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.396 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.396 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.396 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.396 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.396 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.397 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.397 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.397 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.397 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.397 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.397 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.397 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.397 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.397 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.397 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.397 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.397 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.397 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.397 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.397 INFO:teuthology.orchestra.run.smithi001.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T01:05:31.398 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T01:05:31.398 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.398 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.398 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.398 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-21T01:05:31.398 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.398 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.398 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.398 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T01:05:31.398 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.398 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.398 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.398 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.399 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.399 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.399 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.399 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.399 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.399 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.399 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.399 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.399 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.399 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.399 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.399 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.399 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.399 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.400 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.400 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.400 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.400 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rook", 2024-09-21T01:05:31.400 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.400 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.400 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.400 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.400 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.400 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.400 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.400 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.400 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.400 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.400 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.401 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.401 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.401 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.401 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.401 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.401 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.401 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.401 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.401 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.401 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.401 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.401 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.401 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.401 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.401 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.402 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.402 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.402 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.402 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.402 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.402 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.402 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.402 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.402 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.402 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.402 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.402 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.402 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.403 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.403 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.403 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.403 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.403 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.403 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.403 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.403 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.403 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.403 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.403 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.403 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.403 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.403 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.403 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.404 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.404 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.404 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.404 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.404 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.404 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.404 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.404 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.404 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.404 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.404 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.404 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.404 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.404 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.404 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.405 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.405 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.405 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.405 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.405 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.405 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.405 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.405 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.405 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.405 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.405 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.405 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.405 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.405 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.405 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.406 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.406 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.406 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.406 INFO:teuthology.orchestra.run.smithi001.stdout: "storage_class": { 2024-09-21T01:05:31.406 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "storage_class", 2024-09-21T01:05:31.406 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.406 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.406 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.406 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "local", 2024-09-21T01:05:31.406 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.406 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.406 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.406 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T01:05:31.406 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.406 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.407 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.407 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.407 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.407 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.407 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.407 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "selftest", 2024-09-21T01:05:31.407 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.407 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.407 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.407 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.407 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.407 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.407 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.407 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.407 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.408 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.408 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.408 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.408 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.408 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.408 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.408 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.408 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.408 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.408 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.408 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.408 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.408 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.408 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.408 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.409 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.409 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.409 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.409 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.409 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.409 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.409 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.409 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.409 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.409 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.409 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.409 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.409 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.409 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.409 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.410 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.410 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.410 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.410 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.410 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.410 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.410 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.410 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.410 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.410 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.410 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.410 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.410 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.410 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.410 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.411 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.411 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.411 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.411 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.411 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.411 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.411 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.411 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.411 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.411 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.411 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.411 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.411 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.411 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.412 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.412 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.412 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.412 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.412 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.412 INFO:teuthology.orchestra.run.smithi001.stdout: "roption1": { 2024-09-21T01:05:31.412 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption1", 2024-09-21T01:05:31.412 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.412 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.412 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.412 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.412 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.412 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.412 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.412 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.413 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.413 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.413 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.413 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.413 INFO:teuthology.orchestra.run.smithi001.stdout: "roption2": { 2024-09-21T01:05:31.413 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption2", 2024-09-21T01:05:31.413 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.413 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.413 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.413 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "xyz", 2024-09-21T01:05:31.413 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.413 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.413 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.413 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.413 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.414 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.414 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.414 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.414 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption1": { 2024-09-21T01:05:31.414 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption1", 2024-09-21T01:05:31.414 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.414 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.414 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.414 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.414 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.414 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.414 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.414 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.414 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.415 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.415 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.415 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.415 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption2": { 2024-09-21T01:05:31.415 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption2", 2024-09-21T01:05:31.415 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.415 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.415 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.415 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.415 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.415 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.415 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.415 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.415 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.415 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.416 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.416 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.416 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption3": { 2024-09-21T01:05:31.416 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption3", 2024-09-21T01:05:31.416 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-21T01:05:31.416 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.416 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.416 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.416 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.416 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.416 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.416 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.416 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.416 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.416 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.417 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.417 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption4": { 2024-09-21T01:05:31.417 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption4", 2024-09-21T01:05:31.417 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.417 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.417 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.417 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.417 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.417 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.417 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.417 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.417 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.417 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.417 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.417 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.418 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption5": { 2024-09-21T01:05:31.418 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption5", 2024-09-21T01:05:31.418 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.418 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.418 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.418 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.418 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.418 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.418 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.418 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.418 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.418 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.418 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.418 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.419 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption6": { 2024-09-21T01:05:31.419 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption6", 2024-09-21T01:05:31.419 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.419 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.419 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.419 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.419 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.419 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.419 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.419 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.419 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.419 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.419 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.419 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.419 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption7": { 2024-09-21T01:05:31.419 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption7", 2024-09-21T01:05:31.420 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.420 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.420 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.420 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.420 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-21T01:05:31.420 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "42", 2024-09-21T01:05:31.420 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.420 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.420 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.420 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.420 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.420 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.420 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.420 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.420 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.421 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.421 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.421 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.421 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.421 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.421 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.421 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.421 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.421 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.421 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.421 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.421 INFO:teuthology.orchestra.run.smithi001.stdout: "testkey": { 2024-09-21T01:05:31.421 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testkey", 2024-09-21T01:05:31.421 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.421 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.422 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.422 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.422 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.422 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.422 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.422 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.422 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.422 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.422 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.422 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.422 INFO:teuthology.orchestra.run.smithi001.stdout: "testlkey": { 2024-09-21T01:05:31.422 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testlkey", 2024-09-21T01:05:31.422 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.422 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.422 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.422 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.423 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.423 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.423 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.423 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.423 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.423 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.423 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.423 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.423 INFO:teuthology.orchestra.run.smithi001.stdout: "testnewline": { 2024-09-21T01:05:31.423 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testnewline", 2024-09-21T01:05:31.423 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.423 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.423 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.423 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.424 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.424 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.424 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.424 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.424 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.424 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.424 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.424 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.424 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.424 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.424 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.424 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smb", 2024-09-21T01:05:31.424 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.424 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.424 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.425 INFO:teuthology.orchestra.run.smithi001.stdout: "internal_store_backend": { 2024-09-21T01:05:31.425 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "internal_store_backend", 2024-09-21T01:05:31.425 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.425 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.425 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.425 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.425 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.425 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.425 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.425 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T01:05:31.425 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.425 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.425 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.425 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.425 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.425 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.426 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.426 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.426 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.426 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.426 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.426 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.426 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.426 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.426 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.426 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.426 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.426 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.426 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.426 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.427 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.427 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.427 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.427 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.427 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.427 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.427 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.427 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.427 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.427 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.427 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.427 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.427 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.427 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.428 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.428 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.428 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.428 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.428 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.428 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.428 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.428 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.428 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.428 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.428 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.428 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.428 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.428 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.428 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.429 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.429 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.429 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.429 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.429 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.429 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.429 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.429 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.429 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.429 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.429 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.429 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.429 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.429 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.429 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.430 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.430 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.430 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.430 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.430 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.430 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.430 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.430 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.430 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.430 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.430 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.430 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.430 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.430 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.430 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.431 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.431 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.431 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.431 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.431 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.431 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.431 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.431 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.431 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.431 INFO:teuthology.orchestra.run.smithi001.stdout: "update_orchestration": { 2024-09-21T01:05:31.431 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "update_orchestration", 2024-09-21T01:05:31.431 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.431 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.431 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.431 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.432 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.432 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.432 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.432 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T01:05:31.432 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.432 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.432 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.432 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.432 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.432 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.432 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.432 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snap_schedule", 2024-09-21T01:05:31.432 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.432 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.433 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.433 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_m_granularity": { 2024-09-21T01:05:31.433 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_m_granularity", 2024-09-21T01:05:31.433 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.433 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.433 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.433 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.433 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.433 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.433 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.433 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T01:05:31.433 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.433 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.433 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.433 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.434 INFO:teuthology.orchestra.run.smithi001.stdout: "dump_on_update": { 2024-09-21T01:05:31.434 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dump_on_update", 2024-09-21T01:05:31.434 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.434 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.434 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.434 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.434 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.434 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.434 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.434 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "dump database to debug log on update", 2024-09-21T01:05:31.434 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.434 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.434 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.434 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.435 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.435 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.435 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.435 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.435 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.435 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.435 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.435 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.435 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.435 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.435 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.435 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.435 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.435 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.435 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.435 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.436 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.436 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.436 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.436 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.436 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.436 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.436 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.436 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.436 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.436 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.436 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.436 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.436 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.436 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.436 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.437 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.437 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.437 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.437 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.437 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.437 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.437 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.437 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.437 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.437 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.437 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.437 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.437 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.437 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.437 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.438 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.438 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.438 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.438 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.438 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.438 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.438 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.438 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.438 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.438 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.438 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.438 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.438 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.438 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.439 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.439 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.439 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.439 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.439 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.439 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.439 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.439 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.439 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.439 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.439 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.439 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.439 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.439 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.439 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.440 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.440 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.440 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.440 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.440 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.440 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.440 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.440 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.440 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.440 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.440 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.440 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.440 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stats", 2024-09-21T01:05:31.440 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.440 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.441 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.441 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.441 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.441 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.441 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.441 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.441 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.441 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.441 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.441 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.441 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.441 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.441 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.441 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.442 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.442 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.442 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.442 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.442 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.442 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.442 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.442 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.442 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.442 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.442 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.442 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.442 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.442 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.443 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.443 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.443 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.443 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.443 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.443 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.443 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.443 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.443 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.443 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.443 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.443 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.443 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.443 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.443 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.444 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.444 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.444 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.444 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.444 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.444 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.444 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.444 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.444 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.444 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.444 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.444 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.444 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.444 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.444 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.445 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.445 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.445 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.445 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.445 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.445 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.445 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.445 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.445 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.445 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.445 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.445 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.445 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.445 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.446 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.446 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.446 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.446 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.446 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.446 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.446 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.446 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.446 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.446 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.446 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.446 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.446 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.446 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.447 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.447 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.447 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "status", 2024-09-21T01:05:31.447 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.447 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.447 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.447 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.447 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.447 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.447 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.447 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.447 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.447 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.447 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.447 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.448 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.448 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.448 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.448 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.448 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.448 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.448 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.448 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.448 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.448 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.448 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.448 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.448 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.448 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.448 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.449 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.449 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.449 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.449 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.449 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.449 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.449 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.449 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.449 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.449 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.449 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.449 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.449 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.449 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.449 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.449 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.450 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.450 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.450 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.450 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.450 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.450 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.450 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.450 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.450 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.450 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.450 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.450 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.450 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.450 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.451 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.451 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.451 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.451 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.451 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.451 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.451 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.451 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.451 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.451 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.451 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.451 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.451 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.451 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.451 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.452 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.452 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.452 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.452 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.452 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.452 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.452 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.452 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.452 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.452 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.452 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.452 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.452 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.452 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.453 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.453 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.453 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.453 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.453 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telegraf", 2024-09-21T01:05:31.453 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.453 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.453 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.453 INFO:teuthology.orchestra.run.smithi001.stdout: "address": { 2024-09-21T01:05:31.453 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "address", 2024-09-21T01:05:31.453 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.453 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.453 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.453 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T01:05:31.453 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.453 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.454 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.454 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.454 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.454 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.454 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.454 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.454 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-21T01:05:31.454 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-21T01:05:31.454 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:31.454 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.454 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.454 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15", 2024-09-21T01:05:31.454 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.454 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.455 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.455 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.455 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.455 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.455 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.455 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.455 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.455 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.455 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.455 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.455 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.455 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.455 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.455 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.455 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.456 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.456 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.456 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.456 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.456 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.456 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.456 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.456 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.456 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.456 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.456 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.456 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.456 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.456 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.456 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.457 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.457 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.457 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.457 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.457 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.457 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.457 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.457 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.457 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.457 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.457 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.457 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.457 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.457 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.458 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.458 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.458 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.458 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.458 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.458 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.458 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.458 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.458 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.458 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.458 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.458 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.458 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.458 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.459 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.459 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.459 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.459 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.459 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.459 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.459 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.459 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.459 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.459 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.459 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.459 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.459 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.459 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.459 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.460 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.460 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.460 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.460 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.460 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.460 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.460 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.460 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.460 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.460 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.460 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.460 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.460 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.460 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.461 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.461 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.461 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.461 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.461 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.461 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.461 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telemetry", 2024-09-21T01:05:31.461 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.461 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.461 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.461 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_basic": { 2024-09-21T01:05:31.461 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_basic", 2024-09-21T01:05:31.461 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.461 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.461 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.462 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.462 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.462 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.462 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.462 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T01:05:31.462 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.462 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.462 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.462 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.462 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_crash": { 2024-09-21T01:05:31.462 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_crash", 2024-09-21T01:05:31.462 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.462 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.462 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.463 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.463 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.463 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.463 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.463 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T01:05:31.463 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.463 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.463 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.463 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.463 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_device": { 2024-09-21T01:05:31.463 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_device", 2024-09-21T01:05:31.463 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.463 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.463 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.464 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.464 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.464 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.464 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.464 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T01:05:31.464 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.464 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.464 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.464 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.464 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_ident": { 2024-09-21T01:05:31.464 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_ident", 2024-09-21T01:05:31.464 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.464 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.464 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.465 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.465 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.465 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.465 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.465 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T01:05:31.465 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.465 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.465 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.465 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.465 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_perf": { 2024-09-21T01:05:31.465 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_perf", 2024-09-21T01:05:31.465 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.465 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.465 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.466 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.466 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.466 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.466 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.466 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T01:05:31.466 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.466 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.466 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.466 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.466 INFO:teuthology.orchestra.run.smithi001.stdout: "contact": { 2024-09-21T01:05:31.466 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "contact", 2024-09-21T01:05:31.466 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.466 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.466 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.466 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.467 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.467 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.467 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.467 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.467 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.467 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.467 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.467 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.467 INFO:teuthology.orchestra.run.smithi001.stdout: "description": { 2024-09-21T01:05:31.467 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "description", 2024-09-21T01:05:31.467 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.467 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.467 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.467 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.467 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.468 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.468 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.468 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.468 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.468 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.468 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.468 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.468 INFO:teuthology.orchestra.run.smithi001.stdout: "device_url": { 2024-09-21T01:05:31.468 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_url", 2024-09-21T01:05:31.468 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.468 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.468 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.468 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T01:05:31.468 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.469 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.469 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.469 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.469 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.469 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.469 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.469 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.469 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-09-21T01:05:31.469 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-09-21T01:05:31.469 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.469 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.469 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.469 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.469 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.470 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.470 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.470 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.470 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.470 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.470 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.470 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.470 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-21T01:05:31.470 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-21T01:05:31.470 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.470 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.470 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.470 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "24", 2024-09-21T01:05:31.470 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "8", 2024-09-21T01:05:31.471 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.471 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.471 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.471 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.471 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.471 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.471 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.471 INFO:teuthology.orchestra.run.smithi001.stdout: "last_opt_revision": { 2024-09-21T01:05:31.471 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "last_opt_revision", 2024-09-21T01:05:31.471 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.471 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.471 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.471 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1", 2024-09-21T01:05:31.471 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.472 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.472 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.472 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.472 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.472 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.472 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.472 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.472 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard": { 2024-09-21T01:05:31.472 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard", 2024-09-21T01:05:31.472 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.472 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.472 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.472 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.473 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.473 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.473 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.473 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.473 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.473 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.473 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.473 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.473 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard_description": { 2024-09-21T01:05:31.473 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard_description", 2024-09-21T01:05:31.473 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.473 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.473 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.473 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.473 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.474 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.474 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.474 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.474 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.474 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.474 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.474 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.474 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.474 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.474 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.474 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.474 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.474 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.474 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.475 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.475 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.475 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.475 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.475 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.475 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.475 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.475 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.475 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.475 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.475 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.475 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.475 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.475 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.476 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.476 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.476 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.476 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.476 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.476 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.476 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.476 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.476 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.476 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.476 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.476 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.476 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.477 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.477 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.477 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.477 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.477 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.477 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.477 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.477 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.477 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.477 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.477 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.477 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.477 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.477 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.477 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.478 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.478 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.478 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.478 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.478 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.478 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.478 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.478 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.478 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.478 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.478 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.478 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.478 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.478 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.479 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.479 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.479 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.479 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.479 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.479 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.479 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.479 INFO:teuthology.orchestra.run.smithi001.stdout: "organization": { 2024-09-21T01:05:31.479 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "organization", 2024-09-21T01:05:31.479 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.479 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.479 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.479 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.479 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.479 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.480 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.480 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.480 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.480 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.480 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.480 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.480 INFO:teuthology.orchestra.run.smithi001.stdout: "proxy": { 2024-09-21T01:05:31.480 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "proxy", 2024-09-21T01:05:31.480 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.480 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.480 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.480 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.480 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.480 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.481 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.481 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.481 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.481 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.481 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.481 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.481 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.481 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.481 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.481 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.481 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.481 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.481 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.481 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.481 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.482 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.482 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.482 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.482 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.482 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.482 INFO:teuthology.orchestra.run.smithi001.stdout: "url": { 2024-09-21T01:05:31.482 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url", 2024-09-21T01:05:31.482 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.482 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.482 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.482 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T01:05:31.482 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.482 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.482 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.483 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.483 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.483 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.483 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.483 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.483 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.483 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.483 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.483 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "test_orchestrator", 2024-09-21T01:05:31.483 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.483 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.483 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.483 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.483 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.484 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.484 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.484 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.484 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.484 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.484 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.484 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.484 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.484 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.484 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.484 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.484 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.484 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.484 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.484 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.485 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.485 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.485 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.485 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.485 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.485 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.485 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.485 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.485 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.485 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.485 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.485 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.485 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.485 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.485 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.486 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.486 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.486 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.486 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.486 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.486 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.486 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.486 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.486 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.486 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.486 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.486 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.486 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.486 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.486 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.487 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.487 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.487 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.487 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.487 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.487 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.487 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.487 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.487 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.487 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.487 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.487 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.487 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.487 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.487 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.488 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.488 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.488 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.488 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.488 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.488 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.488 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.488 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.488 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.488 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.488 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.488 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.488 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.488 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.489 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.489 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.489 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.489 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.489 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.489 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.489 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.489 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.489 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.489 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.489 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.489 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "volumes", 2024-09-21T01:05:31.489 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.489 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.490 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.490 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.490 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.490 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.490 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.490 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.490 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.490 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.490 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.490 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.490 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.490 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.490 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.490 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.491 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.491 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.491 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.491 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.491 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.491 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.491 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.491 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.491 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.491 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.491 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.491 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.491 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.491 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.491 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.492 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.492 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.492 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.492 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.492 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.492 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.492 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.492 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.492 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.492 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.492 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.492 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.492 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.492 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.492 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.493 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.493 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.493 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.493 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.493 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.493 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.493 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.493 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.493 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.493 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.493 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.493 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.493 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.493 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.494 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.494 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.494 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.494 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.494 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.494 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.494 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.494 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.494 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.494 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.494 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.494 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.494 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.494 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_clones": { 2024-09-21T01:05:31.495 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_clones", 2024-09-21T01:05:31.495 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.495 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.495 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.495 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4", 2024-09-21T01:05:31.495 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.495 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.495 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.495 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T01:05:31.495 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.495 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.495 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.495 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.495 INFO:teuthology.orchestra.run.smithi001.stdout: "periodic_async_work": { 2024-09-21T01:05:31.495 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "periodic_async_work", 2024-09-21T01:05:31.496 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.496 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.496 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.496 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.496 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.496 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.496 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.496 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Periodically check for async work", 2024-09-21T01:05:31.496 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.496 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.496 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.496 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.496 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_delay": { 2024-09-21T01:05:31.496 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_delay", 2024-09-21T01:05:31.496 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.497 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.497 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.497 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.497 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.497 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.497 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.497 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T01:05:31.497 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.497 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.497 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.497 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.497 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_no_wait": { 2024-09-21T01:05:31.497 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T01:05:31.497 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.497 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.498 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.498 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-21T01:05:31.498 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.498 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.498 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.498 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T01:05:31.498 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.498 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.498 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.498 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.498 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.498 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.498 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.498 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.499 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.499 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.499 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.499 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.499 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.499 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.499 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.499 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.499 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.499 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.499 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.499 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.499 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.499 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix", 2024-09-21T01:05:31.499 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-21T01:05:31.500 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-21T01:05:31.500 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-21T01:05:31.500 INFO:teuthology.orchestra.run.smithi001.stdout: "discovery_interval": { 2024-09-21T01:05:31.500 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "discovery_interval", 2024-09-21T01:05:31.500 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-21T01:05:31.500 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.500 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.500 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "100", 2024-09-21T01:05:31.500 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.500 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.500 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.500 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.500 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.500 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.501 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.501 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.501 INFO:teuthology.orchestra.run.smithi001.stdout: "identifier": { 2024-09-21T01:05:31.501 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "identifier", 2024-09-21T01:05:31.501 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.501 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.501 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.501 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.501 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.501 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.501 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.501 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.501 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.501 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.502 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.502 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.502 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-21T01:05:31.502 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-21T01:05:31.502 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-21T01:05:31.502 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.502 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.502 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-21T01:05:31.502 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.502 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.502 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.502 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.502 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.502 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.503 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.503 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.503 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-21T01:05:31.503 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-21T01:05:31.503 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.503 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.503 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.503 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.503 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.503 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.503 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.503 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.503 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.503 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.503 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.504 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.504 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.504 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.504 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.504 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.504 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.504 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.504 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.504 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-21T01:05:31.504 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-21T01:05:31.504 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.504 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.504 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.504 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.504 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.505 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.505 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.505 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.505 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.505 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.505 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.505 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.505 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-21T01:05:31.505 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-21T01:05:31.505 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.505 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.505 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.505 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-21T01:05:31.505 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.505 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.506 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-21T01:05:31.506 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-21T01:05:31.506 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-21T01:05:31.506 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-21T01:05:31.506 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-21T01:05:31.506 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-21T01:05:31.506 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-21T01:05:31.506 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.506 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.506 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.506 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.506 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.506 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.506 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-21T01:05:31.507 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-21T01:05:31.507 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-21T01:05:31.507 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.507 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.507 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-21T01:05:31.507 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.507 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.507 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.507 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.507 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.507 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.507 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.507 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.507 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-09-21T01:05:31.508 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:05:31.508 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.508 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-09-21T01:05:31.508 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-21T01:05:31.508 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-21T01:05:31.508 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.508 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.508 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.508 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.508 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.508 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.508 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.508 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.508 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_host": { 2024-09-21T01:05:31.508 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_host", 2024-09-21T01:05:31.508 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.509 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.509 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.509 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-21T01:05:31.509 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.509 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.509 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.509 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.509 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.509 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.509 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.509 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.509 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_port": { 2024-09-21T01:05:31.509 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_port", 2024-09-21T01:05:31.509 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-21T01:05:31.509 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.510 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.510 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10051", 2024-09-21T01:05:31.510 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.510 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.510 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.510 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.510 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.510 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.510 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.510 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.510 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_sender": { 2024-09-21T01:05:31.510 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_sender", 2024-09-21T01:05:31.510 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-21T01:05:31.510 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-21T01:05:31.511 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-21T01:05:31.511 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T01:05:31.511 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-21T01:05:31.511 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-21T01:05:31.511 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-21T01:05:31.511 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-21T01:05:31.511 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-21T01:05:31.511 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-21T01:05:31.511 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-21T01:05:31.511 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.511 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.511 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.511 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.511 INFO:teuthology.orchestra.run.smithi001.stdout: "services": { 2024-09-21T01:05:31.511 INFO:teuthology.orchestra.run.smithi001.stdout: "dashboard": "https://172.21.15.1:8443/" 2024-09-21T01:05:31.511 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.512 INFO:teuthology.orchestra.run.smithi001.stdout: "always_on_modules": { 2024-09-21T01:05:31.512 INFO:teuthology.orchestra.run.smithi001.stdout: "octopus": [ 2024-09-21T01:05:31.512 INFO:teuthology.orchestra.run.smithi001.stdout: "balancer", 2024-09-21T01:05:31.512 INFO:teuthology.orchestra.run.smithi001.stdout: "crash", 2024-09-21T01:05:31.512 INFO:teuthology.orchestra.run.smithi001.stdout: "devicehealth", 2024-09-21T01:05:31.512 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator", 2024-09-21T01:05:31.512 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscaler", 2024-09-21T01:05:31.512 INFO:teuthology.orchestra.run.smithi001.stdout: "progress", 2024-09-21T01:05:31.512 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_support", 2024-09-21T01:05:31.512 INFO:teuthology.orchestra.run.smithi001.stdout: "status", 2024-09-21T01:05:31.512 INFO:teuthology.orchestra.run.smithi001.stdout: "telemetry", 2024-09-21T01:05:31.512 INFO:teuthology.orchestra.run.smithi001.stdout: "volumes" 2024-09-21T01:05:31.512 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.513 INFO:teuthology.orchestra.run.smithi001.stdout: "pacific": [ 2024-09-21T01:05:31.513 INFO:teuthology.orchestra.run.smithi001.stdout: "balancer", 2024-09-21T01:05:31.513 INFO:teuthology.orchestra.run.smithi001.stdout: "crash", 2024-09-21T01:05:31.513 INFO:teuthology.orchestra.run.smithi001.stdout: "devicehealth", 2024-09-21T01:05:31.513 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator", 2024-09-21T01:05:31.513 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscaler", 2024-09-21T01:05:31.513 INFO:teuthology.orchestra.run.smithi001.stdout: "progress", 2024-09-21T01:05:31.513 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_support", 2024-09-21T01:05:31.513 INFO:teuthology.orchestra.run.smithi001.stdout: "status", 2024-09-21T01:05:31.513 INFO:teuthology.orchestra.run.smithi001.stdout: "telemetry", 2024-09-21T01:05:31.513 INFO:teuthology.orchestra.run.smithi001.stdout: "volumes" 2024-09-21T01:05:31.513 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.513 INFO:teuthology.orchestra.run.smithi001.stdout: "quincy": [ 2024-09-21T01:05:31.513 INFO:teuthology.orchestra.run.smithi001.stdout: "balancer", 2024-09-21T01:05:31.513 INFO:teuthology.orchestra.run.smithi001.stdout: "crash", 2024-09-21T01:05:31.514 INFO:teuthology.orchestra.run.smithi001.stdout: "devicehealth", 2024-09-21T01:05:31.514 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator", 2024-09-21T01:05:31.514 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscaler", 2024-09-21T01:05:31.514 INFO:teuthology.orchestra.run.smithi001.stdout: "progress", 2024-09-21T01:05:31.514 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_support", 2024-09-21T01:05:31.514 INFO:teuthology.orchestra.run.smithi001.stdout: "status", 2024-09-21T01:05:31.514 INFO:teuthology.orchestra.run.smithi001.stdout: "telemetry", 2024-09-21T01:05:31.514 INFO:teuthology.orchestra.run.smithi001.stdout: "volumes" 2024-09-21T01:05:31.514 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.514 INFO:teuthology.orchestra.run.smithi001.stdout: "reef": [ 2024-09-21T01:05:31.514 INFO:teuthology.orchestra.run.smithi001.stdout: "balancer", 2024-09-21T01:05:31.514 INFO:teuthology.orchestra.run.smithi001.stdout: "crash", 2024-09-21T01:05:31.514 INFO:teuthology.orchestra.run.smithi001.stdout: "devicehealth", 2024-09-21T01:05:31.514 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator", 2024-09-21T01:05:31.515 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscaler", 2024-09-21T01:05:31.515 INFO:teuthology.orchestra.run.smithi001.stdout: "progress", 2024-09-21T01:05:31.515 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_support", 2024-09-21T01:05:31.515 INFO:teuthology.orchestra.run.smithi001.stdout: "status", 2024-09-21T01:05:31.515 INFO:teuthology.orchestra.run.smithi001.stdout: "telemetry", 2024-09-21T01:05:31.515 INFO:teuthology.orchestra.run.smithi001.stdout: "volumes" 2024-09-21T01:05:31.515 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-21T01:05:31.515 INFO:teuthology.orchestra.run.smithi001.stdout: "squid": [ 2024-09-21T01:05:31.515 INFO:teuthology.orchestra.run.smithi001.stdout: "balancer", 2024-09-21T01:05:31.515 INFO:teuthology.orchestra.run.smithi001.stdout: "crash", 2024-09-21T01:05:31.515 INFO:teuthology.orchestra.run.smithi001.stdout: "devicehealth", 2024-09-21T01:05:31.515 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator", 2024-09-21T01:05:31.515 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscaler", 2024-09-21T01:05:31.515 INFO:teuthology.orchestra.run.smithi001.stdout: "progress", 2024-09-21T01:05:31.515 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_support", 2024-09-21T01:05:31.516 INFO:teuthology.orchestra.run.smithi001.stdout: "status", 2024-09-21T01:05:31.516 INFO:teuthology.orchestra.run.smithi001.stdout: "telemetry", 2024-09-21T01:05:31.516 INFO:teuthology.orchestra.run.smithi001.stdout: "volumes" 2024-09-21T01:05:31.516 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-21T01:05:31.517 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.517 INFO:teuthology.orchestra.run.smithi001.stdout: "last_failure_osd_epoch": 3, 2024-09-21T01:05:31.517 INFO:teuthology.orchestra.run.smithi001.stdout: "active_clients": [ 2024-09-21T01:05:31.517 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.517 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "devicehealth", 2024-09-21T01:05:31.517 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-21T01:05:31.518 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.518 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-21T01:05:31.518 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:0", 2024-09-21T01:05:31.518 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 639934325 2024-09-21T01:05:31.518 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.518 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-21T01:05:31.518 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.518 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.518 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "libcephsqlite", 2024-09-21T01:05:31.518 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-21T01:05:31.518 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.518 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-21T01:05:31.518 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:0", 2024-09-21T01:05:31.519 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 363039868 2024-09-21T01:05:31.519 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.519 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-21T01:05:31.519 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.519 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.519 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_support", 2024-09-21T01:05:31.519 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-21T01:05:31.519 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.519 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-21T01:05:31.519 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:0", 2024-09-21T01:05:31.519 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 1692608402 2024-09-21T01:05:31.519 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.519 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-21T01:05:31.519 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:31.519 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.519 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "volumes", 2024-09-21T01:05:31.520 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-21T01:05:31.520 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-21T01:05:31.520 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-21T01:05:31.520 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:0", 2024-09-21T01:05:31.520 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2224988228 2024-09-21T01:05:31.520 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.520 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-21T01:05:31.520 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:31.520 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-21T01:05:31.520 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T01:05:31.521 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:30 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/3264594929' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T01:05:31.521 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:30 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/1715724738' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T01:05:31.521 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:30 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/3264594929' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T01:05:31.522 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:30 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/1715724738' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T01:05:31.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:30.129+0000 7f74c352b640 1 -- 172.21.15.1:0/1715724738 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f74a80b6510 msgr2=0x7f74a80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:31.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:30.129+0000 7f74c352b640 1 --2- 172.21.15.1:0/1715724738 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f74a80b6510 0x7f74a80b8a20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f74ac031500 tx=0x7f74ac031400 comp rx=0 tx=0).stop 2024-09-21T01:05:31.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:30.129+0000 7f74c352b640 1 -- 172.21.15.1:0/1715724738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74bc1025c0 msgr2=0x7f74bc06b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:31.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:30.129+0000 7f74c352b640 1 --2- 172.21.15.1:0/1715724738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74bc1025c0 0x7f74bc06b140 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f74b800e9f0 tx=0x7f74b800eeb0 comp rx=0 tx=0).stop 2024-09-21T01:05:31.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:30.129+0000 7f74c352b640 1 -- 172.21.15.1:0/1715724738 shutdown_connections 2024-09-21T01:05:31.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:30.129+0000 7f74c352b640 1 --2- 172.21.15.1:0/1715724738 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74bc103fe0 0x7f74bc1a11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:31.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:30.129+0000 7f74c352b640 1 --2- 172.21.15.1:0/1715724738 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74bc103640 0x7f74bc19ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:31.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:30.129+0000 7f74c352b640 1 --2- 172.21.15.1:0/1715724738 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f74a80b6510 0x7f74a80b8a20 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:31.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:30.129+0000 7f74c352b640 1 --2- 172.21.15.1:0/1715724738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74bc1025c0 0x7f74bc06b140 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:31.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:30.129+0000 7f74c352b640 1 -- 172.21.15.1:0/1715724738 >> 172.21.15.1:0/1715724738 conn(0x7f74bc0fdf00 msgr2=0x7f74bc106940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:31.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:30.129+0000 7f74c352b640 1 -- 172.21.15.1:0/1715724738 shutdown_connections 2024-09-21T01:05:31.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:30.129+0000 7f74c352b640 1 -- 172.21.15.1:0/1715724738 wait complete. 2024-09-21T01:05:31.572 DEBUG:tasks.check_counter:Getting stats from a 2024-09-21T01:05:31.573 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph daemon mds.a perf dump 2024-09-21T01:05:31.573 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:30 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/3264594929' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T01:05:31.573 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:30 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1715724738' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T01:05:31.845 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:31.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:31 smithi001 ceph-mon[31211]: pgmap v607: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 302 op/s 2024-09-21T01:05:31.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:31 smithi193 ceph-mon[34660]: pgmap v607: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 302 op/s 2024-09-21T01:05:31.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:31 smithi042 ceph-mon[34481]: pgmap v607: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 302 op/s 2024-09-21T01:05:32.497 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T01:05:32.497 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:05:32.497 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 1318, 2024-09-21T01:05:32.497 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 1318, 2024-09-21T01:05:32.497 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 4587713, 2024-09-21T01:05:32.498 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 418301, 2024-09-21T01:05:32.498 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 7, 2024-09-21T01:05:32.498 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 3, 2024-09-21T01:05:32.498 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.145771881, 2024-09-21T01:05:32.498 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.057849762, 2024-09-21T01:05:32.498 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.037185056, 2024-09-21T01:05:32.498 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.040506137, 2024-09-21T01:05:32.498 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:05:32.498 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 1317, 2024-09-21T01:05:32.498 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.068393606, 2024-09-21T01:05:32.498 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000051931 2024-09-21T01:05:32.498 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.498 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:05:32.499 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.499 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.499 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.499 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.499 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-09-21T01:05:32.499 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T01:05:32.499 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.499 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:05:32.499 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 206, 2024-09-21T01:05:32.499 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 184, 2024-09-21T01:05:32.499 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 958238, 2024-09-21T01:05:32.499 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 109134, 2024-09-21T01:05:32.499 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 4, 2024-09-21T01:05:32.500 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 3, 2024-09-21T01:05:32.500 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.034804156, 2024-09-21T01:05:32.500 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.015243369, 2024-09-21T01:05:32.500 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.028108303, 2024-09-21T01:05:32.500 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000077476, 2024-09-21T01:05:32.500 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:05:32.500 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 183, 2024-09-21T01:05:32.500 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.013230010, 2024-09-21T01:05:32.500 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000072295 2024-09-21T01:05:32.500 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.500 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:05:32.500 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.500 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.500 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.501 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.501 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 956848, 2024-09-21T01:05:32.501 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 108112 2024-09-21T01:05:32.501 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.501 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:05:32.501 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 554, 2024-09-21T01:05:32.501 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 686, 2024-09-21T01:05:32.501 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 1512725, 2024-09-21T01:05:32.501 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 495182, 2024-09-21T01:05:32.501 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 5, 2024-09-21T01:05:32.501 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 4, 2024-09-21T01:05:32.501 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.071773195, 2024-09-21T01:05:32.501 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.033185875, 2024-09-21T01:05:32.501 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.015295544, 2024-09-21T01:05:32.502 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.018266032, 2024-09-21T01:05:32.502 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:05:32.502 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 684, 2024-09-21T01:05:32.502 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.027104370, 2024-09-21T01:05:32.502 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000039626 2024-09-21T01:05:32.502 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.502 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:05:32.502 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.502 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.502 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.502 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.502 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:05:32.502 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 319328 2024-09-21T01:05:32.502 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.503 INFO:teuthology.orchestra.run.smithi001.stdout: "cct": { 2024-09-21T01:05:32.503 INFO:teuthology.orchestra.run.smithi001.stdout: "total_workers": 1, 2024-09-21T01:05:32.503 INFO:teuthology.orchestra.run.smithi001.stdout: "unhealthy_workers": 0 2024-09-21T01:05:32.503 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.503 INFO:teuthology.orchestra.run.smithi001.stdout: "finisher-MDSRank": { 2024-09-21T01:05:32.503 INFO:teuthology.orchestra.run.smithi001.stdout: "queue_len": 0, 2024-09-21T01:05:32.503 INFO:teuthology.orchestra.run.smithi001.stdout: "complete_latency": { 2024-09-21T01:05:32.503 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 3128, 2024-09-21T01:05:32.503 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.086714248, 2024-09-21T01:05:32.503 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000027721 2024-09-21T01:05:32.503 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:32.503 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.503 INFO:teuthology.orchestra.run.smithi001.stdout: "finisher-PurgeQueue": { 2024-09-21T01:05:32.503 INFO:teuthology.orchestra.run.smithi001.stdout: "queue_len": 0, 2024-09-21T01:05:32.503 INFO:teuthology.orchestra.run.smithi001.stdout: "complete_latency": { 2024-09-21T01:05:32.504 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.504 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.504 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.504 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:32.504 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.504 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": { 2024-09-21T01:05:32.504 INFO:teuthology.orchestra.run.smithi001.stdout: "request": 0, 2024-09-21T01:05:32.504 INFO:teuthology.orchestra.run.smithi001.stdout: "reply": 0, 2024-09-21T01:05:32.504 INFO:teuthology.orchestra.run.smithi001.stdout: "reply_latency": { 2024-09-21T01:05:32.504 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.504 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.504 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.504 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.504 INFO:teuthology.orchestra.run.smithi001.stdout: "slow_reply": 0, 2024-09-21T01:05:32.505 INFO:teuthology.orchestra.run.smithi001.stdout: "forward": 0, 2024-09-21T01:05:32.505 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_fetch_complete": 0, 2024-09-21T01:05:32.505 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_fetch_keys": 0, 2024-09-21T01:05:32.505 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_commit": 0, 2024-09-21T01:05:32.505 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_split": 0, 2024-09-21T01:05:32.505 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_merge": 0, 2024-09-21T01:05:32.505 INFO:teuthology.orchestra.run.smithi001.stdout: "inodes": 543, 2024-09-21T01:05:32.505 INFO:teuthology.orchestra.run.smithi001.stdout: "inodes_top": 0, 2024-09-21T01:05:32.505 INFO:teuthology.orchestra.run.smithi001.stdout: "inodes_bottom": 543, 2024-09-21T01:05:32.505 INFO:teuthology.orchestra.run.smithi001.stdout: "inodes_pin_tail": 0, 2024-09-21T01:05:32.505 INFO:teuthology.orchestra.run.smithi001.stdout: "inodes_pinned": 543, 2024-09-21T01:05:32.505 INFO:teuthology.orchestra.run.smithi001.stdout: "inodes_expired": 0, 2024-09-21T01:05:32.505 INFO:teuthology.orchestra.run.smithi001.stdout: "inodes_with_caps": 0, 2024-09-21T01:05:32.505 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": 0, 2024-09-21T01:05:32.505 INFO:teuthology.orchestra.run.smithi001.stdout: "subtrees": 1, 2024-09-21T01:05:32.506 INFO:teuthology.orchestra.run.smithi001.stdout: "traverse": 0, 2024-09-21T01:05:32.506 INFO:teuthology.orchestra.run.smithi001.stdout: "traverse_hit": 0, 2024-09-21T01:05:32.506 INFO:teuthology.orchestra.run.smithi001.stdout: "traverse_forward": 0, 2024-09-21T01:05:32.506 INFO:teuthology.orchestra.run.smithi001.stdout: "traverse_discover": 0, 2024-09-21T01:05:32.506 INFO:teuthology.orchestra.run.smithi001.stdout: "traverse_dir_fetch": 0, 2024-09-21T01:05:32.506 INFO:teuthology.orchestra.run.smithi001.stdout: "traverse_remote_ino": 0, 2024-09-21T01:05:32.506 INFO:teuthology.orchestra.run.smithi001.stdout: "traverse_lock": 0, 2024-09-21T01:05:32.506 INFO:teuthology.orchestra.run.smithi001.stdout: "load_cent": 0, 2024-09-21T01:05:32.506 INFO:teuthology.orchestra.run.smithi001.stdout: "q": 0, 2024-09-21T01:05:32.506 INFO:teuthology.orchestra.run.smithi001.stdout: "exported": 0, 2024-09-21T01:05:32.507 INFO:teuthology.orchestra.run.smithi001.stdout: "exported_inodes": 0, 2024-09-21T01:05:32.507 INFO:teuthology.orchestra.run.smithi001.stdout: "imported": 0, 2024-09-21T01:05:32.507 INFO:teuthology.orchestra.run.smithi001.stdout: "imported_inodes": 0, 2024-09-21T01:05:32.507 INFO:teuthology.orchestra.run.smithi001.stdout: "openino_dir_fetch": 0, 2024-09-21T01:05:32.507 INFO:teuthology.orchestra.run.smithi001.stdout: "openino_backtrace_fetch": 0, 2024-09-21T01:05:32.507 INFO:teuthology.orchestra.run.smithi001.stdout: "openino_peer_discover": 0, 2024-09-21T01:05:32.507 INFO:teuthology.orchestra.run.smithi001.stdout: "root_rfiles": 0, 2024-09-21T01:05:32.507 INFO:teuthology.orchestra.run.smithi001.stdout: "root_rbytes": 0, 2024-09-21T01:05:32.507 INFO:teuthology.orchestra.run.smithi001.stdout: "root_rsnaps": 0, 2024-09-21T01:05:32.507 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T01:05:32.507 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_set_tag": 0, 2024-09-21T01:05:32.507 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T01:05:32.507 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_inotable_repaired": 0, 2024-09-21T01:05:32.507 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_dir_inodes": 0, 2024-09-21T01:05:32.507 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T01:05:32.508 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T01:05:32.508 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_file_inodes": 0, 2024-09-21T01:05:32.508 INFO:teuthology.orchestra.run.smithi001.stdout: "handle_inode_file_caps": 0, 2024-09-21T01:05:32.508 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T01:05:32.508 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_cap_op_grant": 0, 2024-09-21T01:05:32.508 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T01:05:32.508 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T01:05:32.508 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T01:05:32.508 INFO:teuthology.orchestra.run.smithi001.stdout: "handle_client_caps": 0, 2024-09-21T01:05:32.508 INFO:teuthology.orchestra.run.smithi001.stdout: "handle_client_caps_dirty": 0, 2024-09-21T01:05:32.509 INFO:teuthology.orchestra.run.smithi001.stdout: "handle_client_cap_release": 0, 2024-09-21T01:05:32.509 INFO:teuthology.orchestra.run.smithi001.stdout: "process_request_cap_release": 0 2024-09-21T01:05:32.509 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.509 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_cache": { 2024-09-21T01:05:32.509 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_update": 0, 2024-09-21T01:05:32.509 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_update_receipt": 0, 2024-09-21T01:05:32.509 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_try_discover": 0, 2024-09-21T01:05:32.509 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_send_discover": 0, 2024-09-21T01:05:32.509 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_handle_discover": 0, 2024-09-21T01:05:32.509 INFO:teuthology.orchestra.run.smithi001.stdout: "num_strays": 0, 2024-09-21T01:05:32.509 INFO:teuthology.orchestra.run.smithi001.stdout: "num_strays_delayed": 0, 2024-09-21T01:05:32.510 INFO:teuthology.orchestra.run.smithi001.stdout: "num_strays_enqueuing": 0, 2024-09-21T01:05:32.510 INFO:teuthology.orchestra.run.smithi001.stdout: "strays_created": 0, 2024-09-21T01:05:32.510 INFO:teuthology.orchestra.run.smithi001.stdout: "strays_enqueued": 0, 2024-09-21T01:05:32.510 INFO:teuthology.orchestra.run.smithi001.stdout: "strays_reintegrated": 0, 2024-09-21T01:05:32.510 INFO:teuthology.orchestra.run.smithi001.stdout: "strays_migrated": 0, 2024-09-21T01:05:32.510 INFO:teuthology.orchestra.run.smithi001.stdout: "num_recovering_processing": 0, 2024-09-21T01:05:32.510 INFO:teuthology.orchestra.run.smithi001.stdout: "num_recovering_enqueued": 0, 2024-09-21T01:05:32.510 INFO:teuthology.orchestra.run.smithi001.stdout: "num_recovering_prioritized": 0, 2024-09-21T01:05:32.510 INFO:teuthology.orchestra.run.smithi001.stdout: "recovery_started": 0, 2024-09-21T01:05:32.511 INFO:teuthology.orchestra.run.smithi001.stdout: "recovery_completed": 0, 2024-09-21T01:05:32.511 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_quiesce_path": 0, 2024-09-21T01:05:32.511 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_quiesce_inode": 0, 2024-09-21T01:05:32.511 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T01:05:32.511 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_exportdir": 0, 2024-09-21T01:05:32.511 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_flush": 0, 2024-09-21T01:05:32.511 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_fragmentdir": 0, 2024-09-21T01:05:32.511 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_fragstats": 0, 2024-09-21T01:05:32.511 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_inodestats": 0, 2024-09-21T01:05:32.511 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:05:32.511 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_succeeded": 0, 2024-09-21T01:05:32.511 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_write_failed": 0 2024-09-21T01:05:32.511 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.511 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_log": { 2024-09-21T01:05:32.512 INFO:teuthology.orchestra.run.smithi001.stdout: "evlrg": 0, 2024-09-21T01:05:32.512 INFO:teuthology.orchestra.run.smithi001.stdout: "evadd": 0, 2024-09-21T01:05:32.512 INFO:teuthology.orchestra.run.smithi001.stdout: "evex": 0, 2024-09-21T01:05:32.512 INFO:teuthology.orchestra.run.smithi001.stdout: "evtrm": 0, 2024-09-21T01:05:32.512 INFO:teuthology.orchestra.run.smithi001.stdout: "ev": 3868, 2024-09-21T01:05:32.512 INFO:teuthology.orchestra.run.smithi001.stdout: "evexg": 0, 2024-09-21T01:05:32.512 INFO:teuthology.orchestra.run.smithi001.stdout: "evexd": 0, 2024-09-21T01:05:32.512 INFO:teuthology.orchestra.run.smithi001.stdout: "segadd": 0, 2024-09-21T01:05:32.512 INFO:teuthology.orchestra.run.smithi001.stdout: "segex": 0, 2024-09-21T01:05:32.512 INFO:teuthology.orchestra.run.smithi001.stdout: "segtrm": 0, 2024-09-21T01:05:32.513 INFO:teuthology.orchestra.run.smithi001.stdout: "seg": 5, 2024-09-21T01:05:32.513 INFO:teuthology.orchestra.run.smithi001.stdout: "segmjr": 2, 2024-09-21T01:05:32.513 INFO:teuthology.orchestra.run.smithi001.stdout: "segexg": 0, 2024-09-21T01:05:32.513 INFO:teuthology.orchestra.run.smithi001.stdout: "segexd": 0, 2024-09-21T01:05:32.513 INFO:teuthology.orchestra.run.smithi001.stdout: "expos": 4194304, 2024-09-21T01:05:32.513 INFO:teuthology.orchestra.run.smithi001.stdout: "wrpos": 9763145, 2024-09-21T01:05:32.513 INFO:teuthology.orchestra.run.smithi001.stdout: "rdpos": 9762007, 2024-09-21T01:05:32.513 INFO:teuthology.orchestra.run.smithi001.stdout: "jlat": { 2024-09-21T01:05:32.513 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.513 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.513 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.513 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.514 INFO:teuthology.orchestra.run.smithi001.stdout: "replayed": 3868 2024-09-21T01:05:32.514 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.514 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_mem": { 2024-09-21T01:05:32.514 INFO:teuthology.orchestra.run.smithi001.stdout: "ino": 7, 2024-09-21T01:05:32.514 INFO:teuthology.orchestra.run.smithi001.stdout: "ino+": 561, 2024-09-21T01:05:32.514 INFO:teuthology.orchestra.run.smithi001.stdout: "ino-": 554, 2024-09-21T01:05:32.514 INFO:teuthology.orchestra.run.smithi001.stdout: "dir": 5, 2024-09-21T01:05:32.514 INFO:teuthology.orchestra.run.smithi001.stdout: "dir+": 37, 2024-09-21T01:05:32.514 INFO:teuthology.orchestra.run.smithi001.stdout: "dir-": 32, 2024-09-21T01:05:32.514 INFO:teuthology.orchestra.run.smithi001.stdout: "dn": 543, 2024-09-21T01:05:32.514 INFO:teuthology.orchestra.run.smithi001.stdout: "dn+": 1302, 2024-09-21T01:05:32.514 INFO:teuthology.orchestra.run.smithi001.stdout: "dn-": 759, 2024-09-21T01:05:32.515 INFO:teuthology.orchestra.run.smithi001.stdout: "cap": 0, 2024-09-21T01:05:32.515 INFO:teuthology.orchestra.run.smithi001.stdout: "cap+": 0, 2024-09-21T01:05:32.515 INFO:teuthology.orchestra.run.smithi001.stdout: "cap-": 0, 2024-09-21T01:05:32.515 INFO:teuthology.orchestra.run.smithi001.stdout: "rss": 120536, 2024-09-21T01:05:32.515 INFO:teuthology.orchestra.run.smithi001.stdout: "heap": 321798144 2024-09-21T01:05:32.515 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.515 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_server": { 2024-09-21T01:05:32.515 INFO:teuthology.orchestra.run.smithi001.stdout: "dispatch_client_request": 0, 2024-09-21T01:05:32.515 INFO:teuthology.orchestra.run.smithi001.stdout: "dispatch_server_request": 0, 2024-09-21T01:05:32.515 INFO:teuthology.orchestra.run.smithi001.stdout: "handle_client_request": 0, 2024-09-21T01:05:32.516 INFO:teuthology.orchestra.run.smithi001.stdout: "handle_client_session": 0, 2024-09-21T01:05:32.516 INFO:teuthology.orchestra.run.smithi001.stdout: "handle_peer_request": 0, 2024-09-21T01:05:32.516 INFO:teuthology.orchestra.run.smithi001.stdout: "req_create_latency": { 2024-09-21T01:05:32.516 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.516 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.516 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.516 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.516 INFO:teuthology.orchestra.run.smithi001.stdout: "req_getattr_latency": { 2024-09-21T01:05:32.516 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.516 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.516 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.517 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.517 INFO:teuthology.orchestra.run.smithi001.stdout: "req_getfilelock_latency": { 2024-09-21T01:05:32.517 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.517 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.517 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.517 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.517 INFO:teuthology.orchestra.run.smithi001.stdout: "req_link_latency": { 2024-09-21T01:05:32.517 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.517 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.517 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.518 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.518 INFO:teuthology.orchestra.run.smithi001.stdout: "req_lookup_latency": { 2024-09-21T01:05:32.518 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.518 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.518 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.518 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.518 INFO:teuthology.orchestra.run.smithi001.stdout: "req_lookuphash_latency": { 2024-09-21T01:05:32.518 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.518 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.518 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.518 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.519 INFO:teuthology.orchestra.run.smithi001.stdout: "req_lookupino_latency": { 2024-09-21T01:05:32.519 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.519 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.519 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.519 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.519 INFO:teuthology.orchestra.run.smithi001.stdout: "req_lookupname_latency": { 2024-09-21T01:05:32.519 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.519 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.519 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.519 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.519 INFO:teuthology.orchestra.run.smithi001.stdout: "req_lookupparent_latency": { 2024-09-21T01:05:32.519 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.519 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.519 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.519 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.520 INFO:teuthology.orchestra.run.smithi001.stdout: "req_lookupsnap_latency": { 2024-09-21T01:05:32.520 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.520 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.520 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.520 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.520 INFO:teuthology.orchestra.run.smithi001.stdout: "req_lssnap_latency": { 2024-09-21T01:05:32.520 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.520 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.521 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.521 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.521 INFO:teuthology.orchestra.run.smithi001.stdout: "req_mkdir_latency": { 2024-09-21T01:05:32.521 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.521 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.521 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.521 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.521 INFO:teuthology.orchestra.run.smithi001.stdout: "req_mknod_latency": { 2024-09-21T01:05:32.521 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.521 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.521 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.521 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.521 INFO:teuthology.orchestra.run.smithi001.stdout: "req_mksnap_latency": { 2024-09-21T01:05:32.522 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.522 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.522 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.522 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.522 INFO:teuthology.orchestra.run.smithi001.stdout: "req_open_latency": { 2024-09-21T01:05:32.522 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.522 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.522 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.522 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.522 INFO:teuthology.orchestra.run.smithi001.stdout: "req_readdir_latency": { 2024-09-21T01:05:32.522 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.522 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.522 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.522 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.523 INFO:teuthology.orchestra.run.smithi001.stdout: "req_rename_latency": { 2024-09-21T01:05:32.523 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.523 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.523 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.523 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.523 INFO:teuthology.orchestra.run.smithi001.stdout: "req_renamesnap_latency": { 2024-09-21T01:05:32.523 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.523 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.523 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.523 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.523 INFO:teuthology.orchestra.run.smithi001.stdout: "req_snapdiff_latency": { 2024-09-21T01:05:32.523 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.524 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.524 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.524 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.524 INFO:teuthology.orchestra.run.smithi001.stdout: "req_rmdir_latency": { 2024-09-21T01:05:32.524 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.524 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.524 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.524 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.524 INFO:teuthology.orchestra.run.smithi001.stdout: "req_rmsnap_latency": { 2024-09-21T01:05:32.524 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.524 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.524 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.524 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.524 INFO:teuthology.orchestra.run.smithi001.stdout: "req_rmxattr_latency": { 2024-09-21T01:05:32.524 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.525 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.525 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.525 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.525 INFO:teuthology.orchestra.run.smithi001.stdout: "req_setattr_latency": { 2024-09-21T01:05:32.525 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.525 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.525 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.525 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.525 INFO:teuthology.orchestra.run.smithi001.stdout: "req_setdirlayout_latency": { 2024-09-21T01:05:32.525 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.525 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.525 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.525 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.526 INFO:teuthology.orchestra.run.smithi001.stdout: "req_setfilelock_latency": { 2024-09-21T01:05:32.526 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.526 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.526 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.526 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.526 INFO:teuthology.orchestra.run.smithi001.stdout: "req_setlayout_latency": { 2024-09-21T01:05:32.526 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.526 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.526 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.526 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.526 INFO:teuthology.orchestra.run.smithi001.stdout: "req_setxattr_latency": { 2024-09-21T01:05:32.526 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.526 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.527 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.527 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.527 INFO:teuthology.orchestra.run.smithi001.stdout: "req_symlink_latency": { 2024-09-21T01:05:32.527 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.527 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.527 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.527 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.527 INFO:teuthology.orchestra.run.smithi001.stdout: "req_unlink_latency": { 2024-09-21T01:05:32.527 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.527 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.527 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.527 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.527 INFO:teuthology.orchestra.run.smithi001.stdout: "cap_revoke_eviction": 0, 2024-09-21T01:05:32.527 INFO:teuthology.orchestra.run.smithi001.stdout: "cap_acquisition_throttle": 0, 2024-09-21T01:05:32.528 INFO:teuthology.orchestra.run.smithi001.stdout: "req_getvxattr_latency": { 2024-09-21T01:05:32.528 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.528 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.528 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.528 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:32.528 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.528 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_sessions": { 2024-09-21T01:05:32.528 INFO:teuthology.orchestra.run.smithi001.stdout: "session_count": 1, 2024-09-21T01:05:32.528 INFO:teuthology.orchestra.run.smithi001.stdout: "session_add": 3, 2024-09-21T01:05:32.528 INFO:teuthology.orchestra.run.smithi001.stdout: "session_remove": 2, 2024-09-21T01:05:32.529 INFO:teuthology.orchestra.run.smithi001.stdout: "sessions_open": 1, 2024-09-21T01:05:32.529 INFO:teuthology.orchestra.run.smithi001.stdout: "sessions_stale": 0, 2024-09-21T01:05:32.529 INFO:teuthology.orchestra.run.smithi001.stdout: "total_load": 0, 2024-09-21T01:05:32.529 INFO:teuthology.orchestra.run.smithi001.stdout: "average_load": 0, 2024-09-21T01:05:32.529 INFO:teuthology.orchestra.run.smithi001.stdout: "avg_session_uptime": 1603, 2024-09-21T01:05:32.529 INFO:teuthology.orchestra.run.smithi001.stdout: "mdthresh_evicted": 0 2024-09-21T01:05:32.529 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.529 INFO:teuthology.orchestra.run.smithi001.stdout: "mempool": { 2024-09-21T01:05:32.529 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:05:32.530 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_items": 0, 2024-09-21T01:05:32.530 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:05:32.530 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:05:32.530 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:05:32.530 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:05:32.530 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:05:32.530 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:05:32.530 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:05:32.530 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:05:32.530 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:05:32.530 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:05:32.530 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:05:32.531 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:05:32.531 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:05:32.531 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_items": 0, 2024-09-21T01:05:32.531 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:05:32.531 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_items": 0, 2024-09-21T01:05:32.531 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:05:32.531 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:05:32.531 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:05:32.531 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:05:32.531 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:05:32.531 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:05:32.531 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:05:32.531 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_items": 0, 2024-09-21T01:05:32.532 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:05:32.532 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:05:32.532 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:05:32.532 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_items": 0, 2024-09-21T01:05:32.532 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_bytes": 0, 2024-09-21T01:05:32.532 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_items": 0, 2024-09-21T01:05:32.532 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:05:32.532 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:05:32.532 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:05:32.532 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:05:32.532 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_bytes": 205543, 2024-09-21T01:05:32.532 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_items": 58, 2024-09-21T01:05:32.532 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:05:32.532 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_items": 0, 2024-09-21T01:05:32.532 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_bytes": 0, 2024-09-21T01:05:32.533 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_items": 0, 2024-09-21T01:05:32.533 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:05:32.533 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_items": 0, 2024-09-21T01:05:32.533 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:05:32.533 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_items": 0, 2024-09-21T01:05:32.533 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_bytes": 7688, 2024-09-21T01:05:32.533 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_items": 158, 2024-09-21T01:05:32.533 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:05:32.533 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:05:32.533 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_bytes": 0, 2024-09-21T01:05:32.533 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_items": 0, 2024-09-21T01:05:32.533 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_bytes": 392128, 2024-09-21T01:05:32.533 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_items": 2234, 2024-09-21T01:05:32.533 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_bytes": 0, 2024-09-21T01:05:32.534 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_items": 0, 2024-09-21T01:05:32.534 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_bytes": 0, 2024-09-21T01:05:32.534 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_items": 0 2024-09-21T01:05:32.534 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.534 INFO:teuthology.orchestra.run.smithi001.stdout: "objecter": { 2024-09-21T01:05:32.534 INFO:teuthology.orchestra.run.smithi001.stdout: "op_active": 0, 2024-09-21T01:05:32.534 INFO:teuthology.orchestra.run.smithi001.stdout: "op_laggy": 0, 2024-09-21T01:05:32.534 INFO:teuthology.orchestra.run.smithi001.stdout: "op_send": 1870, 2024-09-21T01:05:32.534 INFO:teuthology.orchestra.run.smithi001.stdout: "op_send_bytes": 21, 2024-09-21T01:05:32.534 INFO:teuthology.orchestra.run.smithi001.stdout: "op_resend": 3, 2024-09-21T01:05:32.534 INFO:teuthology.orchestra.run.smithi001.stdout: "op_reply": 1870, 2024-09-21T01:05:32.534 INFO:teuthology.orchestra.run.smithi001.stdout: "op_latency": { 2024-09-21T01:05:32.534 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 1870, 2024-09-21T01:05:32.534 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 3.128963154, 2024-09-21T01:05:32.535 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.001673242 2024-09-21T01:05:32.535 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.535 INFO:teuthology.orchestra.run.smithi001.stdout: "op_inflight": 0, 2024-09-21T01:05:32.535 INFO:teuthology.orchestra.run.smithi001.stdout: "oplen_avg": { 2024-09-21T01:05:32.535 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 1870, 2024-09-21T01:05:32.535 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 1871 2024-09-21T01:05:32.535 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.535 INFO:teuthology.orchestra.run.smithi001.stdout: "op": 1870, 2024-09-21T01:05:32.535 INFO:teuthology.orchestra.run.smithi001.stdout: "op_r": 1870, 2024-09-21T01:05:32.535 INFO:teuthology.orchestra.run.smithi001.stdout: "op_w": 0, 2024-09-21T01:05:32.535 INFO:teuthology.orchestra.run.smithi001.stdout: "op_rmw": 0, 2024-09-21T01:05:32.535 INFO:teuthology.orchestra.run.smithi001.stdout: "op_pg": 0, 2024-09-21T01:05:32.535 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_stat": 1163, 2024-09-21T01:05:32.535 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_create": 0, 2024-09-21T01:05:32.535 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_read": 705, 2024-09-21T01:05:32.536 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_write": 0, 2024-09-21T01:05:32.536 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_writefull": 0, 2024-09-21T01:05:32.536 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_writesame": 0, 2024-09-21T01:05:32.536 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_append": 0, 2024-09-21T01:05:32.536 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_zero": 0, 2024-09-21T01:05:32.536 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_truncate": 0, 2024-09-21T01:05:32.537 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_delete": 0, 2024-09-21T01:05:32.537 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_mapext": 0, 2024-09-21T01:05:32.537 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_sparse_read": 0, 2024-09-21T01:05:32.537 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_clonerange": 0, 2024-09-21T01:05:32.537 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_getxattr": 1, 2024-09-21T01:05:32.537 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_setxattr": 0, 2024-09-21T01:05:32.538 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_cmpxattr": 0, 2024-09-21T01:05:32.538 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_rmxattr": 0, 2024-09-21T01:05:32.538 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_resetxattrs": 0, 2024-09-21T01:05:32.538 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_call": 0, 2024-09-21T01:05:32.538 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_watch": 0, 2024-09-21T01:05:32.538 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_notify": 0, 2024-09-21T01:05:32.538 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T01:05:32.538 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_pgls": 0, 2024-09-21T01:05:32.538 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_pgls_filter": 0, 2024-09-21T01:05:32.538 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_other": 0, 2024-09-21T01:05:32.538 INFO:teuthology.orchestra.run.smithi001.stdout: "linger_active": 0, 2024-09-21T01:05:32.538 INFO:teuthology.orchestra.run.smithi001.stdout: "linger_send": 0, 2024-09-21T01:05:32.539 INFO:teuthology.orchestra.run.smithi001.stdout: "linger_resend": 0, 2024-09-21T01:05:32.539 INFO:teuthology.orchestra.run.smithi001.stdout: "linger_ping": 0, 2024-09-21T01:05:32.539 INFO:teuthology.orchestra.run.smithi001.stdout: "poolop_active": 0, 2024-09-21T01:05:32.539 INFO:teuthology.orchestra.run.smithi001.stdout: "poolop_send": 0, 2024-09-21T01:05:32.539 INFO:teuthology.orchestra.run.smithi001.stdout: "poolop_resend": 0, 2024-09-21T01:05:32.539 INFO:teuthology.orchestra.run.smithi001.stdout: "poolstat_active": 0, 2024-09-21T01:05:32.539 INFO:teuthology.orchestra.run.smithi001.stdout: "poolstat_send": 0, 2024-09-21T01:05:32.539 INFO:teuthology.orchestra.run.smithi001.stdout: "poolstat_resend": 0, 2024-09-21T01:05:32.539 INFO:teuthology.orchestra.run.smithi001.stdout: "statfs_active": 0, 2024-09-21T01:05:32.539 INFO:teuthology.orchestra.run.smithi001.stdout: "statfs_send": 0, 2024-09-21T01:05:32.539 INFO:teuthology.orchestra.run.smithi001.stdout: "statfs_resend": 0, 2024-09-21T01:05:32.539 INFO:teuthology.orchestra.run.smithi001.stdout: "command_active": 0, 2024-09-21T01:05:32.539 INFO:teuthology.orchestra.run.smithi001.stdout: "command_send": 0, 2024-09-21T01:05:32.540 INFO:teuthology.orchestra.run.smithi001.stdout: "command_resend": 0, 2024-09-21T01:05:32.540 INFO:teuthology.orchestra.run.smithi001.stdout: "map_epoch": 75, 2024-09-21T01:05:32.540 INFO:teuthology.orchestra.run.smithi001.stdout: "map_full": 0, 2024-09-21T01:05:32.540 INFO:teuthology.orchestra.run.smithi001.stdout: "map_inc": 2, 2024-09-21T01:05:32.540 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_sessions": 7, 2024-09-21T01:05:32.540 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_session_open": 7, 2024-09-21T01:05:32.540 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_session_close": 0, 2024-09-21T01:05:32.540 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_laggy": 0, 2024-09-21T01:05:32.540 INFO:teuthology.orchestra.run.smithi001.stdout: "omap_wr": 0, 2024-09-21T01:05:32.540 INFO:teuthology.orchestra.run.smithi001.stdout: "omap_rd": 2, 2024-09-21T01:05:32.540 INFO:teuthology.orchestra.run.smithi001.stdout: "omap_del": 0 2024-09-21T01:05:32.540 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.541 INFO:teuthology.orchestra.run.smithi001.stdout: "oft": { 2024-09-21T01:05:32.541 INFO:teuthology.orchestra.run.smithi001.stdout: "omap_total_objs": 0, 2024-09-21T01:05:32.541 INFO:teuthology.orchestra.run.smithi001.stdout: "omap_total_kv_pairs": 0, 2024-09-21T01:05:32.541 INFO:teuthology.orchestra.run.smithi001.stdout: "omap_total_updates": 0, 2024-09-21T01:05:32.541 INFO:teuthology.orchestra.run.smithi001.stdout: "omap_total_removes": 0 2024-09-21T01:05:32.541 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.541 INFO:teuthology.orchestra.run.smithi001.stdout: "purge_queue": { 2024-09-21T01:05:32.541 INFO:teuthology.orchestra.run.smithi001.stdout: "pq_executing_ops": 0, 2024-09-21T01:05:32.541 INFO:teuthology.orchestra.run.smithi001.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T01:05:32.541 INFO:teuthology.orchestra.run.smithi001.stdout: "pq_executing": 0, 2024-09-21T01:05:32.541 INFO:teuthology.orchestra.run.smithi001.stdout: "pq_executing_high_water": 0, 2024-09-21T01:05:32.541 INFO:teuthology.orchestra.run.smithi001.stdout: "pq_executed_ops": 0, 2024-09-21T01:05:32.541 INFO:teuthology.orchestra.run.smithi001.stdout: "pq_executed": 0, 2024-09-21T01:05:32.542 INFO:teuthology.orchestra.run.smithi001.stdout: "pq_item_in_journal": 0 2024-09-21T01:05:32.542 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.542 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:05:32.542 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-09-21T01:05:32.542 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 104857600, 2024-09-21T01:05:32.542 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-09-21T01:05:32.542 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 2074, 2024-09-21T01:05:32.542 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 6858604, 2024-09-21T01:05:32.542 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:32.542 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 2074, 2024-09-21T01:05:32.542 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 0, 2024-09-21T01:05:32.542 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 0, 2024-09-21T01:05:32.543 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 2074, 2024-09-21T01:05:32.543 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 6858604, 2024-09-21T01:05:32.543 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-09-21T01:05:32.543 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.543 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.543 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.543 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:32.543 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.543 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-objecter_bytes": { 2024-09-21T01:05:32.543 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-09-21T01:05:32.543 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 104857600, 2024-09-21T01:05:32.543 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-09-21T01:05:32.543 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 0, 2024-09-21T01:05:32.544 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 0, 2024-09-21T01:05:32.544 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:32.544 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 0, 2024-09-21T01:05:32.544 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 1870, 2024-09-21T01:05:32.544 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 5571176, 2024-09-21T01:05:32.544 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 1870, 2024-09-21T01:05:32.544 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 5571176, 2024-09-21T01:05:32.544 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-09-21T01:05:32.544 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.544 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.544 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.545 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:32.545 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.545 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-objecter_ops": { 2024-09-21T01:05:32.545 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-09-21T01:05:32.545 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 1024, 2024-09-21T01:05:32.545 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-09-21T01:05:32.545 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 0, 2024-09-21T01:05:32.545 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 0, 2024-09-21T01:05:32.545 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:32.545 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 0, 2024-09-21T01:05:32.545 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 1870, 2024-09-21T01:05:32.545 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 1870, 2024-09-21T01:05:32.545 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 1870, 2024-09-21T01:05:32.546 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 1870, 2024-09-21T01:05:32.546 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-09-21T01:05:32.546 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.546 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.546 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.546 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:32.546 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.546 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-write_buf_throttle": { 2024-09-21T01:05:32.546 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-09-21T01:05:32.546 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 3758096384, 2024-09-21T01:05:32.547 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-09-21T01:05:32.547 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 0, 2024-09-21T01:05:32.547 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 0, 2024-09-21T01:05:32.547 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:32.547 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 0, 2024-09-21T01:05:32.547 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 0, 2024-09-21T01:05:32.547 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 0, 2024-09-21T01:05:32.547 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 0, 2024-09-21T01:05:32.547 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 0, 2024-09-21T01:05:32.547 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-09-21T01:05:32.547 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.547 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.547 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.547 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:32.548 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.548 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-write_buf_throttle-0x557aaf111380": { 2024-09-21T01:05:32.548 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-09-21T01:05:32.548 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 3758096384, 2024-09-21T01:05:32.548 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-09-21T01:05:32.548 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 0, 2024-09-21T01:05:32.548 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 0, 2024-09-21T01:05:32.548 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:32.548 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 0, 2024-09-21T01:05:32.548 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 0, 2024-09-21T01:05:32.548 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 0, 2024-09-21T01:05:32.548 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 0, 2024-09-21T01:05:32.548 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 0, 2024-09-21T01:05:32.549 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-09-21T01:05:32.549 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:32.549 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:32.549 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:32.549 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:32.549 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:32.549 INFO:teuthology.orchestra.run.smithi001.stdout: "trackedop": { 2024-09-21T01:05:32.549 INFO:teuthology.orchestra.run.smithi001.stdout: "slow_ops_count": 0 2024-09-21T01:05:32.549 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:32.549 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T01:05:33.342 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-21T01:05:33.342 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-21T01:05:33.342 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2024-09-21T01:05:33.342 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2024-09-21T01:05:33.342 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=0 2024-09-21T01:05:33.343 DEBUG:tasks.check_counter:Getting stats from d 2024-09-21T01:05:33.343 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph daemon mds.d perf dump 2024-09-21T01:05:33.600 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:33.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:33 smithi001 ceph-mon[31211]: pgmap v608: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 863 KiB/s rd, 870 KiB/s wr, 241 op/s 2024-09-21T01:05:33.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:33 smithi193 ceph-mon[34660]: pgmap v608: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 863 KiB/s rd, 870 KiB/s wr, 241 op/s 2024-09-21T01:05:33.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:33 smithi042 ceph-mon[34481]: pgmap v608: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 863 KiB/s rd, 870 KiB/s wr, 241 op/s 2024-09-21T01:05:34.124 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T01:05:34.124 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:05:34.124 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 4, 2024-09-21T01:05:34.124 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 4, 2024-09-21T01:05:34.124 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 3040, 2024-09-21T01:05:34.125 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 448, 2024-09-21T01:05:34.125 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 4, 2024-09-21T01:05:34.125 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 0, 2024-09-21T01:05:34.125 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.003246053, 2024-09-21T01:05:34.125 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.000043517, 2024-09-21T01:05:34.125 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.002219312, 2024-09-21T01:05:34.125 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:05:34.125 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:05:34.125 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 3, 2024-09-21T01:05:34.125 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.003982001, 2024-09-21T01:05:34.125 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.001327333 2024-09-21T01:05:34.125 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:34.125 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:05:34.125 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:34.126 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:34.126 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:34.126 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:34.126 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-09-21T01:05:34.126 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T01:05:34.126 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:34.126 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:05:34.126 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 1, 2024-09-21T01:05:34.126 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 137, 2024-09-21T01:05:34.126 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 160, 2024-09-21T01:05:34.126 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 104400, 2024-09-21T01:05:34.126 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 3, 2024-09-21T01:05:34.126 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 2, 2024-09-21T01:05:34.126 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.012763781, 2024-09-21T01:05:34.127 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.009962509, 2024-09-21T01:05:34.127 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.001420447, 2024-09-21T01:05:34.127 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:05:34.127 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:05:34.127 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 135, 2024-09-21T01:05:34.127 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.005661330, 2024-09-21T01:05:34.127 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000041935 2024-09-21T01:05:34.127 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:34.127 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:05:34.127 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:34.127 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:34.127 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:34.127 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:34.127 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:05:34.128 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 104400 2024-09-21T01:05:34.128 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:34.128 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:05:34.128 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 185, 2024-09-21T01:05:34.128 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 180, 2024-09-21T01:05:34.128 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 827184, 2024-09-21T01:05:34.128 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 110288, 2024-09-21T01:05:34.128 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 2, 2024-09-21T01:05:34.128 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 1, 2024-09-21T01:05:34.128 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.032019409, 2024-09-21T01:05:34.128 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.014937677, 2024-09-21T01:05:34.128 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.024312043, 2024-09-21T01:05:34.128 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:05:34.128 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:05:34.128 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 179, 2024-09-21T01:05:34.128 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.020194215, 2024-09-21T01:05:34.129 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000112816 2024-09-21T01:05:34.129 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:34.129 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:05:34.129 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:34.129 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:34.129 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:34.129 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:34.129 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 827184, 2024-09-21T01:05:34.129 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 110288 2024-09-21T01:05:34.129 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:34.129 INFO:teuthology.orchestra.run.smithi001.stdout: "cct": { 2024-09-21T01:05:34.130 INFO:teuthology.orchestra.run.smithi001.stdout: "total_workers": 0, 2024-09-21T01:05:34.130 INFO:teuthology.orchestra.run.smithi001.stdout: "unhealthy_workers": 0 2024-09-21T01:05:34.130 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:34.130 INFO:teuthology.orchestra.run.smithi001.stdout: "mempool": { 2024-09-21T01:05:34.130 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:05:34.130 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_items": 0, 2024-09-21T01:05:34.130 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:05:34.130 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:05:34.130 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:05:34.130 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:05:34.130 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:05:34.130 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:05:34.130 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:05:34.130 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:05:34.131 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:05:34.131 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:05:34.131 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:05:34.131 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:05:34.131 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:05:34.131 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_items": 0, 2024-09-21T01:05:34.131 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:05:34.131 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_items": 0, 2024-09-21T01:05:34.131 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:05:34.131 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:05:34.131 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:05:34.131 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:05:34.131 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:05:34.131 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:05:34.131 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:05:34.132 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_items": 0, 2024-09-21T01:05:34.132 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:05:34.132 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:05:34.132 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:05:34.132 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_items": 0, 2024-09-21T01:05:34.132 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_bytes": 0, 2024-09-21T01:05:34.132 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_items": 0, 2024-09-21T01:05:34.132 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:05:34.132 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:05:34.132 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:05:34.132 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:05:34.132 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_bytes": 148967, 2024-09-21T01:05:34.132 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_items": 29, 2024-09-21T01:05:34.132 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:05:34.132 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_items": 0, 2024-09-21T01:05:34.133 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_bytes": 0, 2024-09-21T01:05:34.133 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_items": 0, 2024-09-21T01:05:34.133 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:05:34.133 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_items": 0, 2024-09-21T01:05:34.133 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:05:34.133 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_items": 0, 2024-09-21T01:05:34.133 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_bytes": 0, 2024-09-21T01:05:34.133 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_items": 0, 2024-09-21T01:05:34.133 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:05:34.133 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:05:34.133 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_bytes": 0, 2024-09-21T01:05:34.133 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_items": 0, 2024-09-21T01:05:34.133 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_bytes": 968, 2024-09-21T01:05:34.133 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_items": 2, 2024-09-21T01:05:34.134 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_bytes": 0, 2024-09-21T01:05:34.134 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_items": 0, 2024-09-21T01:05:34.134 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_bytes": 0, 2024-09-21T01:05:34.134 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_items": 0 2024-09-21T01:05:34.134 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:34.134 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:05:34.134 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-09-21T01:05:34.134 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 104857600, 2024-09-21T01:05:34.134 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-09-21T01:05:34.134 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 186, 2024-09-21T01:05:34.134 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 801065, 2024-09-21T01:05:34.134 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:34.134 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 186, 2024-09-21T01:05:34.134 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 0, 2024-09-21T01:05:34.135 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 0, 2024-09-21T01:05:34.135 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 186, 2024-09-21T01:05:34.135 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 801065, 2024-09-21T01:05:34.135 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-09-21T01:05:34.135 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:34.135 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:34.135 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:34.135 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:34.135 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:34.135 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T01:05:34.828 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-21T01:05:34.828 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-21T01:05:34.828 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-21T01:05:34.829 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-21T01:05:34.829 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-09-21T01:05:34.829 DEBUG:tasks.check_counter:Getting stats from g 2024-09-21T01:05:34.829 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph daemon mds.g perf dump 2024-09-21T01:05:35.087 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:35.619 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T01:05:35.619 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:05:35.619 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 862, 2024-09-21T01:05:35.619 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 862, 2024-09-21T01:05:35.619 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 2826911, 2024-09-21T01:05:35.619 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 273293, 2024-09-21T01:05:35.620 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 6, 2024-09-21T01:05:35.620 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 2, 2024-09-21T01:05:35.620 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.105417085, 2024-09-21T01:05:35.620 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.047669990, 2024-09-21T01:05:35.620 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.023975462, 2024-09-21T01:05:35.620 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.025914987, 2024-09-21T01:05:35.620 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:05:35.620 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 861, 2024-09-21T01:05:35.620 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.039471716, 2024-09-21T01:05:35.620 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000045844 2024-09-21T01:05:35.620 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.620 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:05:35.620 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.620 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.621 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.621 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.621 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-09-21T01:05:35.621 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T01:05:35.621 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.621 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:05:35.621 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 923, 2024-09-21T01:05:35.621 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 1056, 2024-09-21T01:05:35.621 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 12820588, 2024-09-21T01:05:35.621 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 612773, 2024-09-21T01:05:35.621 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 5, 2024-09-21T01:05:35.621 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 4, 2024-09-21T01:05:35.621 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.107835725, 2024-09-21T01:05:35.621 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.045087451, 2024-09-21T01:05:35.621 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.032570913, 2024-09-21T01:05:35.622 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.023642225, 2024-09-21T01:05:35.622 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:05:35.622 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 1054, 2024-09-21T01:05:35.622 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.050272677, 2024-09-21T01:05:35.622 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000047697 2024-09-21T01:05:35.622 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.622 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:05:35.622 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.622 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.622 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.622 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.622 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:05:35.622 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 319520 2024-09-21T01:05:35.623 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.623 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:05:35.623 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 208, 2024-09-21T01:05:35.623 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 186, 2024-09-21T01:05:35.623 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 958740, 2024-09-21T01:05:35.623 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 110357, 2024-09-21T01:05:35.623 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 4, 2024-09-21T01:05:35.623 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 3, 2024-09-21T01:05:35.623 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.034154341, 2024-09-21T01:05:35.623 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.014643866, 2024-09-21T01:05:35.623 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.027955585, 2024-09-21T01:05:35.623 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000065043, 2024-09-21T01:05:35.623 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:05:35.623 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 185, 2024-09-21T01:05:35.624 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.012457758, 2024-09-21T01:05:35.624 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000067339 2024-09-21T01:05:35.624 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.624 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:05:35.624 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.624 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.624 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.624 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.624 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 957392, 2024-09-21T01:05:35.624 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 109392 2024-09-21T01:05:35.624 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.624 INFO:teuthology.orchestra.run.smithi001.stdout: "cct": { 2024-09-21T01:05:35.624 INFO:teuthology.orchestra.run.smithi001.stdout: "total_workers": 1, 2024-09-21T01:05:35.624 INFO:teuthology.orchestra.run.smithi001.stdout: "unhealthy_workers": 0 2024-09-21T01:05:35.624 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.625 INFO:teuthology.orchestra.run.smithi001.stdout: "finisher-MDSRank": { 2024-09-21T01:05:35.625 INFO:teuthology.orchestra.run.smithi001.stdout: "queue_len": 0, 2024-09-21T01:05:35.625 INFO:teuthology.orchestra.run.smithi001.stdout: "complete_latency": { 2024-09-21T01:05:35.625 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 3099, 2024-09-21T01:05:35.625 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.083054337, 2024-09-21T01:05:35.625 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000026800 2024-09-21T01:05:35.625 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:35.625 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.625 INFO:teuthology.orchestra.run.smithi001.stdout: "finisher-PurgeQueue": { 2024-09-21T01:05:35.625 INFO:teuthology.orchestra.run.smithi001.stdout: "queue_len": 0, 2024-09-21T01:05:35.625 INFO:teuthology.orchestra.run.smithi001.stdout: "complete_latency": { 2024-09-21T01:05:35.625 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.625 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.625 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.625 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:35.625 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.626 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": { 2024-09-21T01:05:35.626 INFO:teuthology.orchestra.run.smithi001.stdout: "request": 0, 2024-09-21T01:05:35.626 INFO:teuthology.orchestra.run.smithi001.stdout: "reply": 0, 2024-09-21T01:05:35.626 INFO:teuthology.orchestra.run.smithi001.stdout: "reply_latency": { 2024-09-21T01:05:35.626 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.626 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.626 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.626 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.626 INFO:teuthology.orchestra.run.smithi001.stdout: "slow_reply": 0, 2024-09-21T01:05:35.626 INFO:teuthology.orchestra.run.smithi001.stdout: "forward": 0, 2024-09-21T01:05:35.626 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_fetch_complete": 0, 2024-09-21T01:05:35.626 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_fetch_keys": 0, 2024-09-21T01:05:35.626 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_commit": 0, 2024-09-21T01:05:35.626 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_split": 0, 2024-09-21T01:05:35.626 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_merge": 0, 2024-09-21T01:05:35.627 INFO:teuthology.orchestra.run.smithi001.stdout: "inodes": 1386, 2024-09-21T01:05:35.627 INFO:teuthology.orchestra.run.smithi001.stdout: "inodes_top": 0, 2024-09-21T01:05:35.627 INFO:teuthology.orchestra.run.smithi001.stdout: "inodes_bottom": 1386, 2024-09-21T01:05:35.627 INFO:teuthology.orchestra.run.smithi001.stdout: "inodes_pin_tail": 0, 2024-09-21T01:05:35.627 INFO:teuthology.orchestra.run.smithi001.stdout: "inodes_pinned": 1386, 2024-09-21T01:05:35.627 INFO:teuthology.orchestra.run.smithi001.stdout: "inodes_expired": 0, 2024-09-21T01:05:35.627 INFO:teuthology.orchestra.run.smithi001.stdout: "inodes_with_caps": 0, 2024-09-21T01:05:35.627 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": 0, 2024-09-21T01:05:35.627 INFO:teuthology.orchestra.run.smithi001.stdout: "subtrees": 1, 2024-09-21T01:05:35.627 INFO:teuthology.orchestra.run.smithi001.stdout: "traverse": 0, 2024-09-21T01:05:35.627 INFO:teuthology.orchestra.run.smithi001.stdout: "traverse_hit": 0, 2024-09-21T01:05:35.627 INFO:teuthology.orchestra.run.smithi001.stdout: "traverse_forward": 0, 2024-09-21T01:05:35.627 INFO:teuthology.orchestra.run.smithi001.stdout: "traverse_discover": 0, 2024-09-21T01:05:35.627 INFO:teuthology.orchestra.run.smithi001.stdout: "traverse_dir_fetch": 0, 2024-09-21T01:05:35.628 INFO:teuthology.orchestra.run.smithi001.stdout: "traverse_remote_ino": 0, 2024-09-21T01:05:35.628 INFO:teuthology.orchestra.run.smithi001.stdout: "traverse_lock": 0, 2024-09-21T01:05:35.628 INFO:teuthology.orchestra.run.smithi001.stdout: "load_cent": 0, 2024-09-21T01:05:35.628 INFO:teuthology.orchestra.run.smithi001.stdout: "q": 0, 2024-09-21T01:05:35.628 INFO:teuthology.orchestra.run.smithi001.stdout: "exported": 0, 2024-09-21T01:05:35.628 INFO:teuthology.orchestra.run.smithi001.stdout: "exported_inodes": 0, 2024-09-21T01:05:35.628 INFO:teuthology.orchestra.run.smithi001.stdout: "imported": 0, 2024-09-21T01:05:35.628 INFO:teuthology.orchestra.run.smithi001.stdout: "imported_inodes": 0, 2024-09-21T01:05:35.628 INFO:teuthology.orchestra.run.smithi001.stdout: "openino_dir_fetch": 0, 2024-09-21T01:05:35.628 INFO:teuthology.orchestra.run.smithi001.stdout: "openino_backtrace_fetch": 0, 2024-09-21T01:05:35.628 INFO:teuthology.orchestra.run.smithi001.stdout: "openino_peer_discover": 0, 2024-09-21T01:05:35.628 INFO:teuthology.orchestra.run.smithi001.stdout: "root_rfiles": 0, 2024-09-21T01:05:35.628 INFO:teuthology.orchestra.run.smithi001.stdout: "root_rbytes": 0, 2024-09-21T01:05:35.628 INFO:teuthology.orchestra.run.smithi001.stdout: "root_rsnaps": 0, 2024-09-21T01:05:35.628 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T01:05:35.629 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_set_tag": 0, 2024-09-21T01:05:35.629 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T01:05:35.629 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_inotable_repaired": 0, 2024-09-21T01:05:35.629 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_dir_inodes": 0, 2024-09-21T01:05:35.629 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T01:05:35.629 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T01:05:35.629 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_file_inodes": 0, 2024-09-21T01:05:35.629 INFO:teuthology.orchestra.run.smithi001.stdout: "handle_inode_file_caps": 0, 2024-09-21T01:05:35.629 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T01:05:35.629 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_cap_op_grant": 0, 2024-09-21T01:05:35.629 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T01:05:35.629 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T01:05:35.629 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T01:05:35.629 INFO:teuthology.orchestra.run.smithi001.stdout: "handle_client_caps": 0, 2024-09-21T01:05:35.629 INFO:teuthology.orchestra.run.smithi001.stdout: "handle_client_caps_dirty": 0, 2024-09-21T01:05:35.630 INFO:teuthology.orchestra.run.smithi001.stdout: "handle_client_cap_release": 0, 2024-09-21T01:05:35.630 INFO:teuthology.orchestra.run.smithi001.stdout: "process_request_cap_release": 0 2024-09-21T01:05:35.630 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.630 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_cache": { 2024-09-21T01:05:35.630 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_update": 0, 2024-09-21T01:05:35.630 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_update_receipt": 0, 2024-09-21T01:05:35.630 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_try_discover": 0, 2024-09-21T01:05:35.630 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_send_discover": 0, 2024-09-21T01:05:35.630 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_handle_discover": 0, 2024-09-21T01:05:35.630 INFO:teuthology.orchestra.run.smithi001.stdout: "num_strays": 0, 2024-09-21T01:05:35.630 INFO:teuthology.orchestra.run.smithi001.stdout: "num_strays_delayed": 0, 2024-09-21T01:05:35.630 INFO:teuthology.orchestra.run.smithi001.stdout: "num_strays_enqueuing": 0, 2024-09-21T01:05:35.630 INFO:teuthology.orchestra.run.smithi001.stdout: "strays_created": 0, 2024-09-21T01:05:35.630 INFO:teuthology.orchestra.run.smithi001.stdout: "strays_enqueued": 0, 2024-09-21T01:05:35.631 INFO:teuthology.orchestra.run.smithi001.stdout: "strays_reintegrated": 0, 2024-09-21T01:05:35.631 INFO:teuthology.orchestra.run.smithi001.stdout: "strays_migrated": 0, 2024-09-21T01:05:35.631 INFO:teuthology.orchestra.run.smithi001.stdout: "num_recovering_processing": 0, 2024-09-21T01:05:35.631 INFO:teuthology.orchestra.run.smithi001.stdout: "num_recovering_enqueued": 0, 2024-09-21T01:05:35.631 INFO:teuthology.orchestra.run.smithi001.stdout: "num_recovering_prioritized": 0, 2024-09-21T01:05:35.631 INFO:teuthology.orchestra.run.smithi001.stdout: "recovery_started": 0, 2024-09-21T01:05:35.631 INFO:teuthology.orchestra.run.smithi001.stdout: "recovery_completed": 0, 2024-09-21T01:05:35.631 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_quiesce_path": 0, 2024-09-21T01:05:35.631 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_quiesce_inode": 0, 2024-09-21T01:05:35.631 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T01:05:35.631 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_exportdir": 0, 2024-09-21T01:05:35.631 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_flush": 0, 2024-09-21T01:05:35.631 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_fragmentdir": 0, 2024-09-21T01:05:35.631 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_fragstats": 0, 2024-09-21T01:05:35.632 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_inodestats": 0, 2024-09-21T01:05:35.632 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-09-21T01:05:35.632 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_succeeded": 0, 2024-09-21T01:05:35.632 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_write_failed": 0 2024-09-21T01:05:35.632 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.632 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_log": { 2024-09-21T01:05:35.632 INFO:teuthology.orchestra.run.smithi001.stdout: "evlrg": 0, 2024-09-21T01:05:35.632 INFO:teuthology.orchestra.run.smithi001.stdout: "evadd": 0, 2024-09-21T01:05:35.632 INFO:teuthology.orchestra.run.smithi001.stdout: "evex": 0, 2024-09-21T01:05:35.632 INFO:teuthology.orchestra.run.smithi001.stdout: "evtrm": 0, 2024-09-21T01:05:35.632 INFO:teuthology.orchestra.run.smithi001.stdout: "ev": 10440, 2024-09-21T01:05:35.632 INFO:teuthology.orchestra.run.smithi001.stdout: "evexg": 0, 2024-09-21T01:05:35.632 INFO:teuthology.orchestra.run.smithi001.stdout: "evexd": 0, 2024-09-21T01:05:35.632 INFO:teuthology.orchestra.run.smithi001.stdout: "segadd": 0, 2024-09-21T01:05:35.632 INFO:teuthology.orchestra.run.smithi001.stdout: "segex": 0, 2024-09-21T01:05:35.632 INFO:teuthology.orchestra.run.smithi001.stdout: "segtrm": 0, 2024-09-21T01:05:35.633 INFO:teuthology.orchestra.run.smithi001.stdout: "seg": 12, 2024-09-21T01:05:35.633 INFO:teuthology.orchestra.run.smithi001.stdout: "segmjr": 2, 2024-09-21T01:05:35.633 INFO:teuthology.orchestra.run.smithi001.stdout: "segexg": 0, 2024-09-21T01:05:35.633 INFO:teuthology.orchestra.run.smithi001.stdout: "segexd": 0, 2024-09-21T01:05:35.633 INFO:teuthology.orchestra.run.smithi001.stdout: "expos": 4194304, 2024-09-21T01:05:35.633 INFO:teuthology.orchestra.run.smithi001.stdout: "wrpos": 19332766, 2024-09-21T01:05:35.633 INFO:teuthology.orchestra.run.smithi001.stdout: "rdpos": 19331628, 2024-09-21T01:05:35.633 INFO:teuthology.orchestra.run.smithi001.stdout: "jlat": { 2024-09-21T01:05:35.633 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.633 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.633 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.633 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.633 INFO:teuthology.orchestra.run.smithi001.stdout: "replayed": 10440 2024-09-21T01:05:35.633 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.634 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_mem": { 2024-09-21T01:05:35.634 INFO:teuthology.orchestra.run.smithi001.stdout: "ino": 12, 2024-09-21T01:05:35.634 INFO:teuthology.orchestra.run.smithi001.stdout: "ino+": 1412, 2024-09-21T01:05:35.634 INFO:teuthology.orchestra.run.smithi001.stdout: "ino-": 1400, 2024-09-21T01:05:35.634 INFO:teuthology.orchestra.run.smithi001.stdout: "dir": 10, 2024-09-21T01:05:35.634 INFO:teuthology.orchestra.run.smithi001.stdout: "dir+": 74, 2024-09-21T01:05:35.634 INFO:teuthology.orchestra.run.smithi001.stdout: "dir-": 64, 2024-09-21T01:05:35.634 INFO:teuthology.orchestra.run.smithi001.stdout: "dn": 1386, 2024-09-21T01:05:35.634 INFO:teuthology.orchestra.run.smithi001.stdout: "dn+": 3154, 2024-09-21T01:05:35.634 INFO:teuthology.orchestra.run.smithi001.stdout: "dn-": 1768, 2024-09-21T01:05:35.634 INFO:teuthology.orchestra.run.smithi001.stdout: "cap": 0, 2024-09-21T01:05:35.634 INFO:teuthology.orchestra.run.smithi001.stdout: "cap+": 0, 2024-09-21T01:05:35.634 INFO:teuthology.orchestra.run.smithi001.stdout: "cap-": 0, 2024-09-21T01:05:35.634 INFO:teuthology.orchestra.run.smithi001.stdout: "rss": 121660, 2024-09-21T01:05:35.634 INFO:teuthology.orchestra.run.smithi001.stdout: "heap": 323895296 2024-09-21T01:05:35.635 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.635 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_server": { 2024-09-21T01:05:35.635 INFO:teuthology.orchestra.run.smithi001.stdout: "dispatch_client_request": 0, 2024-09-21T01:05:35.635 INFO:teuthology.orchestra.run.smithi001.stdout: "dispatch_server_request": 0, 2024-09-21T01:05:35.635 INFO:teuthology.orchestra.run.smithi001.stdout: "handle_client_request": 0, 2024-09-21T01:05:35.635 INFO:teuthology.orchestra.run.smithi001.stdout: "handle_client_session": 0, 2024-09-21T01:05:35.635 INFO:teuthology.orchestra.run.smithi001.stdout: "handle_peer_request": 0, 2024-09-21T01:05:35.635 INFO:teuthology.orchestra.run.smithi001.stdout: "req_create_latency": { 2024-09-21T01:05:35.635 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.635 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.635 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.635 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.635 INFO:teuthology.orchestra.run.smithi001.stdout: "req_getattr_latency": { 2024-09-21T01:05:35.635 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.635 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.635 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.636 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.636 INFO:teuthology.orchestra.run.smithi001.stdout: "req_getfilelock_latency": { 2024-09-21T01:05:35.636 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.636 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.636 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.636 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.636 INFO:teuthology.orchestra.run.smithi001.stdout: "req_link_latency": { 2024-09-21T01:05:35.636 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.636 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.636 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.636 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.636 INFO:teuthology.orchestra.run.smithi001.stdout: "req_lookup_latency": { 2024-09-21T01:05:35.636 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.636 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.636 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.636 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.637 INFO:teuthology.orchestra.run.smithi001.stdout: "req_lookuphash_latency": { 2024-09-21T01:05:35.637 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.637 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.637 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.637 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.637 INFO:teuthology.orchestra.run.smithi001.stdout: "req_lookupino_latency": { 2024-09-21T01:05:35.637 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.637 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.637 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.637 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.637 INFO:teuthology.orchestra.run.smithi001.stdout: "req_lookupname_latency": { 2024-09-21T01:05:35.637 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.637 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.637 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.637 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.638 INFO:teuthology.orchestra.run.smithi001.stdout: "req_lookupparent_latency": { 2024-09-21T01:05:35.638 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.638 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.638 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.638 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.638 INFO:teuthology.orchestra.run.smithi001.stdout: "req_lookupsnap_latency": { 2024-09-21T01:05:35.638 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.638 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.638 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.638 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.638 INFO:teuthology.orchestra.run.smithi001.stdout: "req_lssnap_latency": { 2024-09-21T01:05:35.638 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.639 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.639 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.639 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.639 INFO:teuthology.orchestra.run.smithi001.stdout: "req_mkdir_latency": { 2024-09-21T01:05:35.639 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.639 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.639 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.639 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.639 INFO:teuthology.orchestra.run.smithi001.stdout: "req_mknod_latency": { 2024-09-21T01:05:35.640 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.640 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.640 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.640 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.640 INFO:teuthology.orchestra.run.smithi001.stdout: "req_mksnap_latency": { 2024-09-21T01:05:35.640 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.640 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.640 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.640 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.640 INFO:teuthology.orchestra.run.smithi001.stdout: "req_open_latency": { 2024-09-21T01:05:35.640 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.640 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.640 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.640 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.640 INFO:teuthology.orchestra.run.smithi001.stdout: "req_readdir_latency": { 2024-09-21T01:05:35.640 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.641 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.641 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.641 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.641 INFO:teuthology.orchestra.run.smithi001.stdout: "req_rename_latency": { 2024-09-21T01:05:35.641 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.641 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.641 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.641 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.641 INFO:teuthology.orchestra.run.smithi001.stdout: "req_renamesnap_latency": { 2024-09-21T01:05:35.641 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.641 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.641 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.641 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.641 INFO:teuthology.orchestra.run.smithi001.stdout: "req_snapdiff_latency": { 2024-09-21T01:05:35.641 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.642 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.642 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.642 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.642 INFO:teuthology.orchestra.run.smithi001.stdout: "req_rmdir_latency": { 2024-09-21T01:05:35.642 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.642 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.642 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.642 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.642 INFO:teuthology.orchestra.run.smithi001.stdout: "req_rmsnap_latency": { 2024-09-21T01:05:35.642 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.642 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.642 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.642 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.642 INFO:teuthology.orchestra.run.smithi001.stdout: "req_rmxattr_latency": { 2024-09-21T01:05:35.643 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.643 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.643 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.643 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.643 INFO:teuthology.orchestra.run.smithi001.stdout: "req_setattr_latency": { 2024-09-21T01:05:35.643 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.643 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.643 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.643 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.643 INFO:teuthology.orchestra.run.smithi001.stdout: "req_setdirlayout_latency": { 2024-09-21T01:05:35.643 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.643 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.643 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.643 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.644 INFO:teuthology.orchestra.run.smithi001.stdout: "req_setfilelock_latency": { 2024-09-21T01:05:35.644 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.644 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.644 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.644 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.644 INFO:teuthology.orchestra.run.smithi001.stdout: "req_setlayout_latency": { 2024-09-21T01:05:35.644 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.644 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.644 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.644 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.644 INFO:teuthology.orchestra.run.smithi001.stdout: "req_setxattr_latency": { 2024-09-21T01:05:35.644 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.644 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.644 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.644 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.644 INFO:teuthology.orchestra.run.smithi001.stdout: "req_symlink_latency": { 2024-09-21T01:05:35.645 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.645 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.645 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.645 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.645 INFO:teuthology.orchestra.run.smithi001.stdout: "req_unlink_latency": { 2024-09-21T01:05:35.645 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.645 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.645 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.645 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.645 INFO:teuthology.orchestra.run.smithi001.stdout: "cap_revoke_eviction": 0, 2024-09-21T01:05:35.645 INFO:teuthology.orchestra.run.smithi001.stdout: "cap_acquisition_throttle": 0, 2024-09-21T01:05:35.645 INFO:teuthology.orchestra.run.smithi001.stdout: "req_getvxattr_latency": { 2024-09-21T01:05:35.645 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.645 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.645 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.645 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:35.646 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.646 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_sessions": { 2024-09-21T01:05:35.646 INFO:teuthology.orchestra.run.smithi001.stdout: "session_count": 1, 2024-09-21T01:05:35.646 INFO:teuthology.orchestra.run.smithi001.stdout: "session_add": 1, 2024-09-21T01:05:35.646 INFO:teuthology.orchestra.run.smithi001.stdout: "session_remove": 0, 2024-09-21T01:05:35.646 INFO:teuthology.orchestra.run.smithi001.stdout: "sessions_open": 1, 2024-09-21T01:05:35.646 INFO:teuthology.orchestra.run.smithi001.stdout: "sessions_stale": 0, 2024-09-21T01:05:35.646 INFO:teuthology.orchestra.run.smithi001.stdout: "total_load": 0, 2024-09-21T01:05:35.646 INFO:teuthology.orchestra.run.smithi001.stdout: "average_load": 0, 2024-09-21T01:05:35.646 INFO:teuthology.orchestra.run.smithi001.stdout: "avg_session_uptime": 1606, 2024-09-21T01:05:35.646 INFO:teuthology.orchestra.run.smithi001.stdout: "mdthresh_evicted": 0 2024-09-21T01:05:35.646 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.646 INFO:teuthology.orchestra.run.smithi001.stdout: "mempool": { 2024-09-21T01:05:35.646 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:05:35.646 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_items": 0, 2024-09-21T01:05:35.647 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:05:35.647 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:05:35.647 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:05:35.647 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:05:35.647 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:05:35.647 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:05:35.647 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:05:35.647 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:05:35.647 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:05:35.647 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:05:35.647 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:05:35.647 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:05:35.647 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:05:35.647 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_items": 0, 2024-09-21T01:05:35.647 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:05:35.648 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_items": 0, 2024-09-21T01:05:35.648 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:05:35.648 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:05:35.648 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:05:35.648 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:05:35.648 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:05:35.648 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:05:35.648 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:05:35.648 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_items": 0, 2024-09-21T01:05:35.648 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:05:35.648 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:05:35.648 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:05:35.648 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_items": 0, 2024-09-21T01:05:35.648 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_bytes": 0, 2024-09-21T01:05:35.648 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_items": 0, 2024-09-21T01:05:35.649 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:05:35.649 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:05:35.649 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:05:35.649 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:05:35.649 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_bytes": 198494, 2024-09-21T01:05:35.649 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_items": 55, 2024-09-21T01:05:35.649 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:05:35.649 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_items": 0, 2024-09-21T01:05:35.649 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_bytes": 0, 2024-09-21T01:05:35.649 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_items": 0, 2024-09-21T01:05:35.649 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:05:35.649 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_items": 0, 2024-09-21T01:05:35.649 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:05:35.649 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_items": 0, 2024-09-21T01:05:35.649 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_bytes": 7688, 2024-09-21T01:05:35.650 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_items": 158, 2024-09-21T01:05:35.650 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:05:35.650 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:05:35.650 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_bytes": 0, 2024-09-21T01:05:35.650 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_items": 0, 2024-09-21T01:05:35.650 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_bytes": 983088, 2024-09-21T01:05:35.650 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_items": 5661, 2024-09-21T01:05:35.650 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_bytes": 0, 2024-09-21T01:05:35.650 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_items": 0, 2024-09-21T01:05:35.650 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_bytes": 0, 2024-09-21T01:05:35.650 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_items": 0 2024-09-21T01:05:35.650 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.650 INFO:teuthology.orchestra.run.smithi001.stdout: "objecter": { 2024-09-21T01:05:35.650 INFO:teuthology.orchestra.run.smithi001.stdout: "op_active": 0, 2024-09-21T01:05:35.650 INFO:teuthology.orchestra.run.smithi001.stdout: "op_laggy": 0, 2024-09-21T01:05:35.651 INFO:teuthology.orchestra.run.smithi001.stdout: "op_send": 1783, 2024-09-21T01:05:35.651 INFO:teuthology.orchestra.run.smithi001.stdout: "op_send_bytes": 21, 2024-09-21T01:05:35.651 INFO:teuthology.orchestra.run.smithi001.stdout: "op_resend": 3, 2024-09-21T01:05:35.651 INFO:teuthology.orchestra.run.smithi001.stdout: "op_reply": 1783, 2024-09-21T01:05:35.651 INFO:teuthology.orchestra.run.smithi001.stdout: "op_latency": { 2024-09-21T01:05:35.651 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 1783, 2024-09-21T01:05:35.651 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 4.154950909, 2024-09-21T01:05:35.651 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.002330314 2024-09-21T01:05:35.651 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.651 INFO:teuthology.orchestra.run.smithi001.stdout: "op_inflight": 0, 2024-09-21T01:05:35.651 INFO:teuthology.orchestra.run.smithi001.stdout: "oplen_avg": { 2024-09-21T01:05:35.651 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 1783, 2024-09-21T01:05:35.651 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 1784 2024-09-21T01:05:35.651 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.651 INFO:teuthology.orchestra.run.smithi001.stdout: "op": 1783, 2024-09-21T01:05:35.652 INFO:teuthology.orchestra.run.smithi001.stdout: "op_r": 1783, 2024-09-21T01:05:35.652 INFO:teuthology.orchestra.run.smithi001.stdout: "op_w": 0, 2024-09-21T01:05:35.652 INFO:teuthology.orchestra.run.smithi001.stdout: "op_rmw": 0, 2024-09-21T01:05:35.652 INFO:teuthology.orchestra.run.smithi001.stdout: "op_pg": 0, 2024-09-21T01:05:35.652 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_stat": 1032, 2024-09-21T01:05:35.652 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_create": 0, 2024-09-21T01:05:35.652 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_read": 749, 2024-09-21T01:05:35.652 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_write": 0, 2024-09-21T01:05:35.652 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_writefull": 0, 2024-09-21T01:05:35.652 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_writesame": 0, 2024-09-21T01:05:35.652 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_append": 0, 2024-09-21T01:05:35.652 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_zero": 0, 2024-09-21T01:05:35.652 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_truncate": 0, 2024-09-21T01:05:35.652 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_delete": 0, 2024-09-21T01:05:35.652 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_mapext": 0, 2024-09-21T01:05:35.653 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_sparse_read": 0, 2024-09-21T01:05:35.653 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_clonerange": 0, 2024-09-21T01:05:35.653 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_getxattr": 1, 2024-09-21T01:05:35.653 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_setxattr": 0, 2024-09-21T01:05:35.653 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_cmpxattr": 0, 2024-09-21T01:05:35.653 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_rmxattr": 0, 2024-09-21T01:05:35.653 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_resetxattrs": 0, 2024-09-21T01:05:35.653 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_call": 0, 2024-09-21T01:05:35.653 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_watch": 0, 2024-09-21T01:05:35.653 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_notify": 0, 2024-09-21T01:05:35.653 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T01:05:35.653 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_pgls": 0, 2024-09-21T01:05:35.653 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_pgls_filter": 0, 2024-09-21T01:05:35.653 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_other": 0, 2024-09-21T01:05:35.653 INFO:teuthology.orchestra.run.smithi001.stdout: "linger_active": 0, 2024-09-21T01:05:35.653 INFO:teuthology.orchestra.run.smithi001.stdout: "linger_send": 0, 2024-09-21T01:05:35.654 INFO:teuthology.orchestra.run.smithi001.stdout: "linger_resend": 0, 2024-09-21T01:05:35.654 INFO:teuthology.orchestra.run.smithi001.stdout: "linger_ping": 0, 2024-09-21T01:05:35.654 INFO:teuthology.orchestra.run.smithi001.stdout: "poolop_active": 0, 2024-09-21T01:05:35.654 INFO:teuthology.orchestra.run.smithi001.stdout: "poolop_send": 0, 2024-09-21T01:05:35.654 INFO:teuthology.orchestra.run.smithi001.stdout: "poolop_resend": 0, 2024-09-21T01:05:35.654 INFO:teuthology.orchestra.run.smithi001.stdout: "poolstat_active": 0, 2024-09-21T01:05:35.654 INFO:teuthology.orchestra.run.smithi001.stdout: "poolstat_send": 0, 2024-09-21T01:05:35.654 INFO:teuthology.orchestra.run.smithi001.stdout: "poolstat_resend": 0, 2024-09-21T01:05:35.654 INFO:teuthology.orchestra.run.smithi001.stdout: "statfs_active": 0, 2024-09-21T01:05:35.654 INFO:teuthology.orchestra.run.smithi001.stdout: "statfs_send": 0, 2024-09-21T01:05:35.654 INFO:teuthology.orchestra.run.smithi001.stdout: "statfs_resend": 0, 2024-09-21T01:05:35.654 INFO:teuthology.orchestra.run.smithi001.stdout: "command_active": 0, 2024-09-21T01:05:35.654 INFO:teuthology.orchestra.run.smithi001.stdout: "command_send": 0, 2024-09-21T01:05:35.654 INFO:teuthology.orchestra.run.smithi001.stdout: "command_resend": 0, 2024-09-21T01:05:35.654 INFO:teuthology.orchestra.run.smithi001.stdout: "map_epoch": 75, 2024-09-21T01:05:35.655 INFO:teuthology.orchestra.run.smithi001.stdout: "map_full": 0, 2024-09-21T01:05:35.655 INFO:teuthology.orchestra.run.smithi001.stdout: "map_inc": 2, 2024-09-21T01:05:35.655 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_sessions": 6, 2024-09-21T01:05:35.655 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_session_open": 6, 2024-09-21T01:05:35.655 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_session_close": 0, 2024-09-21T01:05:35.655 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_laggy": 0, 2024-09-21T01:05:35.655 INFO:teuthology.orchestra.run.smithi001.stdout: "omap_wr": 0, 2024-09-21T01:05:35.655 INFO:teuthology.orchestra.run.smithi001.stdout: "omap_rd": 2, 2024-09-21T01:05:35.655 INFO:teuthology.orchestra.run.smithi001.stdout: "omap_del": 0 2024-09-21T01:05:35.655 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.655 INFO:teuthology.orchestra.run.smithi001.stdout: "oft": { 2024-09-21T01:05:35.655 INFO:teuthology.orchestra.run.smithi001.stdout: "omap_total_objs": 0, 2024-09-21T01:05:35.655 INFO:teuthology.orchestra.run.smithi001.stdout: "omap_total_kv_pairs": 0, 2024-09-21T01:05:35.655 INFO:teuthology.orchestra.run.smithi001.stdout: "omap_total_updates": 0, 2024-09-21T01:05:35.656 INFO:teuthology.orchestra.run.smithi001.stdout: "omap_total_removes": 0 2024-09-21T01:05:35.656 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.656 INFO:teuthology.orchestra.run.smithi001.stdout: "purge_queue": { 2024-09-21T01:05:35.656 INFO:teuthology.orchestra.run.smithi001.stdout: "pq_executing_ops": 0, 2024-09-21T01:05:35.656 INFO:teuthology.orchestra.run.smithi001.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T01:05:35.656 INFO:teuthology.orchestra.run.smithi001.stdout: "pq_executing": 0, 2024-09-21T01:05:35.656 INFO:teuthology.orchestra.run.smithi001.stdout: "pq_executing_high_water": 0, 2024-09-21T01:05:35.656 INFO:teuthology.orchestra.run.smithi001.stdout: "pq_executed_ops": 0, 2024-09-21T01:05:35.656 INFO:teuthology.orchestra.run.smithi001.stdout: "pq_executed": 0, 2024-09-21T01:05:35.656 INFO:teuthology.orchestra.run.smithi001.stdout: "pq_item_in_journal": 0 2024-09-21T01:05:35.656 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.656 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:05:35.656 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-09-21T01:05:35.656 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 104857600, 2024-09-21T01:05:35.657 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-09-21T01:05:35.657 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 1989, 2024-09-21T01:05:35.657 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 16413713, 2024-09-21T01:05:35.657 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:35.657 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 1989, 2024-09-21T01:05:35.657 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 0, 2024-09-21T01:05:35.657 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 0, 2024-09-21T01:05:35.657 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 1989, 2024-09-21T01:05:35.657 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 16413713, 2024-09-21T01:05:35.657 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-09-21T01:05:35.657 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.657 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.657 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.657 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:35.657 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.658 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-objecter_bytes": { 2024-09-21T01:05:35.658 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-09-21T01:05:35.658 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 104857600, 2024-09-21T01:05:35.658 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-09-21T01:05:35.658 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 0, 2024-09-21T01:05:35.658 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 0, 2024-09-21T01:05:35.658 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:35.658 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 0, 2024-09-21T01:05:35.658 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 1783, 2024-09-21T01:05:35.658 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 15139843, 2024-09-21T01:05:35.658 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 1783, 2024-09-21T01:05:35.658 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 15139843, 2024-09-21T01:05:35.658 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-09-21T01:05:35.658 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.658 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.659 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.659 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:35.659 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.659 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-objecter_ops": { 2024-09-21T01:05:35.659 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-09-21T01:05:35.659 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 1024, 2024-09-21T01:05:35.659 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-09-21T01:05:35.659 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 0, 2024-09-21T01:05:35.659 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 0, 2024-09-21T01:05:35.659 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:35.659 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 0, 2024-09-21T01:05:35.659 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 1783, 2024-09-21T01:05:35.659 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 1783, 2024-09-21T01:05:35.659 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 1783, 2024-09-21T01:05:35.660 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 1783, 2024-09-21T01:05:35.660 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-09-21T01:05:35.660 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.660 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.660 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.660 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:35.660 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.660 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-write_buf_throttle": { 2024-09-21T01:05:35.660 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-09-21T01:05:35.660 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 3758096384, 2024-09-21T01:05:35.660 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-09-21T01:05:35.660 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 0, 2024-09-21T01:05:35.660 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 0, 2024-09-21T01:05:35.660 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:35.660 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 0, 2024-09-21T01:05:35.661 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 0, 2024-09-21T01:05:35.661 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 0, 2024-09-21T01:05:35.661 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 0, 2024-09-21T01:05:35.661 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 0, 2024-09-21T01:05:35.661 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-09-21T01:05:35.661 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.661 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.661 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.661 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:35.661 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.661 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-write_buf_throttle-0x55d51e329450": { 2024-09-21T01:05:35.661 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-09-21T01:05:35.661 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 3758096384, 2024-09-21T01:05:35.661 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-09-21T01:05:35.661 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 0, 2024-09-21T01:05:35.661 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 0, 2024-09-21T01:05:35.662 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:35.662 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 0, 2024-09-21T01:05:35.662 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 0, 2024-09-21T01:05:35.662 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 0, 2024-09-21T01:05:35.662 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 0, 2024-09-21T01:05:35.662 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 0, 2024-09-21T01:05:35.662 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-09-21T01:05:35.662 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:35.662 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:35.662 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:35.662 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:35.662 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:35.662 INFO:teuthology.orchestra.run.smithi001.stdout: "trackedop": { 2024-09-21T01:05:35.662 INFO:teuthology.orchestra.run.smithi001.stdout: "slow_ops_count": 0 2024-09-21T01:05:35.662 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:35.663 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T01:05:35.941 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:35 smithi001 ceph-mon[31211]: pgmap v609: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 370 KiB/s wr, 169 op/s 2024-09-21T01:05:35.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:35 smithi193 ceph-mon[34660]: pgmap v609: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 370 KiB/s wr, 169 op/s 2024-09-21T01:05:35.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:35 smithi042 ceph-mon[34481]: pgmap v609: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 370 KiB/s wr, 169 op/s 2024-09-21T01:05:36.365 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-09-21T01:05:36.365 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-09-21T01:05:36.365 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2024-09-21T01:05:36.365 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2024-09-21T01:05:36.365 INFO:tasks.check_counter:Daemon mds.g mds.dir_split=0 2024-09-21T01:05:36.366 DEBUG:tasks.check_counter:Getting stats from j 2024-09-21T01:05:36.366 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph daemon mds.j perf dump 2024-09-21T01:05:36.622 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:37.222 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-21T01:05:37.222 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:05:37.222 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 4, 2024-09-21T01:05:37.223 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 4, 2024-09-21T01:05:37.223 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 3040, 2024-09-21T01:05:37.223 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 448, 2024-09-21T01:05:37.223 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 4, 2024-09-21T01:05:37.223 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 0, 2024-09-21T01:05:37.223 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.003186148, 2024-09-21T01:05:37.223 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.000044403, 2024-09-21T01:05:37.223 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.002196429, 2024-09-21T01:05:37.223 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:05:37.223 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:05:37.223 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 3, 2024-09-21T01:05:37.223 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.004049157, 2024-09-21T01:05:37.223 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.001349719 2024-09-21T01:05:37.224 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:37.224 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:05:37.224 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:37.224 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:37.224 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:37.224 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:37.224 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-09-21T01:05:37.224 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T01:05:37.224 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:37.224 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:05:37.224 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 1, 2024-09-21T01:05:37.224 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 138, 2024-09-21T01:05:37.224 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 160, 2024-09-21T01:05:37.224 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 104576, 2024-09-21T01:05:37.225 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 3, 2024-09-21T01:05:37.225 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 2, 2024-09-21T01:05:37.225 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.013021399, 2024-09-21T01:05:37.225 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.010371229, 2024-09-21T01:05:37.225 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.001250857, 2024-09-21T01:05:37.225 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:05:37.225 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:05:37.225 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 136, 2024-09-21T01:05:37.225 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.007599494, 2024-09-21T01:05:37.225 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000055878 2024-09-21T01:05:37.225 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:37.225 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:05:37.225 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:37.225 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:37.226 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:37.226 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:37.226 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:05:37.226 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 104576 2024-09-21T01:05:37.226 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:37.226 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:05:37.226 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 187, 2024-09-21T01:05:37.226 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 182, 2024-09-21T01:05:37.226 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 827728, 2024-09-21T01:05:37.226 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 111568, 2024-09-21T01:05:37.226 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 2, 2024-09-21T01:05:37.226 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 1, 2024-09-21T01:05:37.226 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.038102766, 2024-09-21T01:05:37.226 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.015696471, 2024-09-21T01:05:37.226 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.030130746, 2024-09-21T01:05:37.227 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:05:37.227 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:05:37.227 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 181, 2024-09-21T01:05:37.227 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.015393612, 2024-09-21T01:05:37.227 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000085047 2024-09-21T01:05:37.227 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:37.227 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:05:37.227 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:37.227 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:37.227 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:37.227 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:37.227 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 827728, 2024-09-21T01:05:37.227 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 111568 2024-09-21T01:05:37.227 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:37.227 INFO:teuthology.orchestra.run.smithi001.stdout: "cct": { 2024-09-21T01:05:37.228 INFO:teuthology.orchestra.run.smithi001.stdout: "total_workers": 0, 2024-09-21T01:05:37.228 INFO:teuthology.orchestra.run.smithi001.stdout: "unhealthy_workers": 0 2024-09-21T01:05:37.228 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:37.228 INFO:teuthology.orchestra.run.smithi001.stdout: "mempool": { 2024-09-21T01:05:37.228 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:05:37.228 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_items": 0, 2024-09-21T01:05:37.228 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:05:37.228 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:05:37.228 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:05:37.228 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:05:37.228 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:05:37.228 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:05:37.228 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:05:37.228 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:05:37.229 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:05:37.229 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:05:37.229 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:05:37.229 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:05:37.229 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:05:37.229 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_items": 0, 2024-09-21T01:05:37.229 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:05:37.229 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_items": 0, 2024-09-21T01:05:37.229 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:05:37.229 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:05:37.229 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:05:37.229 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:05:37.229 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:05:37.229 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:05:37.229 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:05:37.229 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_items": 0, 2024-09-21T01:05:37.230 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:05:37.230 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:05:37.230 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:05:37.230 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_items": 0, 2024-09-21T01:05:37.230 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_bytes": 0, 2024-09-21T01:05:37.230 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_items": 0, 2024-09-21T01:05:37.230 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:05:37.230 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:05:37.230 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:05:37.230 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:05:37.230 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_bytes": 148984, 2024-09-21T01:05:37.230 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_items": 30, 2024-09-21T01:05:37.230 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:05:37.230 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_items": 0, 2024-09-21T01:05:37.231 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_bytes": 0, 2024-09-21T01:05:37.231 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_items": 0, 2024-09-21T01:05:37.231 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:05:37.231 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_items": 0, 2024-09-21T01:05:37.231 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:05:37.231 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_items": 0, 2024-09-21T01:05:37.231 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_bytes": 0, 2024-09-21T01:05:37.231 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_items": 0, 2024-09-21T01:05:37.231 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:05:37.231 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:05:37.231 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_bytes": 0, 2024-09-21T01:05:37.231 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_items": 0, 2024-09-21T01:05:37.231 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_bytes": 968, 2024-09-21T01:05:37.231 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_items": 2, 2024-09-21T01:05:37.231 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_bytes": 0, 2024-09-21T01:05:37.232 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_items": 0, 2024-09-21T01:05:37.232 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_bytes": 0, 2024-09-21T01:05:37.232 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_items": 0 2024-09-21T01:05:37.232 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-21T01:05:37.232 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:05:37.232 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-09-21T01:05:37.232 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 104857600, 2024-09-21T01:05:37.232 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-09-21T01:05:37.232 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 188, 2024-09-21T01:05:37.232 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 801325, 2024-09-21T01:05:37.233 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:37.233 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 188, 2024-09-21T01:05:37.233 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 0, 2024-09-21T01:05:37.234 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 0, 2024-09-21T01:05:37.234 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 188, 2024-09-21T01:05:37.234 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 801325, 2024-09-21T01:05:37.234 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-09-21T01:05:37.234 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-21T01:05:37.234 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-21T01:05:37.234 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-21T01:05:37.234 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:37.234 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-21T01:05:37.234 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-21T01:05:37.930 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:37 smithi001 ceph-mon[31211]: pgmap v610: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 235 KiB/s wr, 93 op/s 2024-09-21T01:05:37.960 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-21T01:05:37.961 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-21T01:05:37.961 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-21T01:05:37.961 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-21T01:05:37.961 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-09-21T01:05:37.961 DEBUG:tasks.check_counter:Getting stats from b 2024-09-21T01:05:37.961 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph daemon mds.b perf dump 2024-09-21T01:05:37.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:37 smithi193 ceph-mon[34660]: pgmap v610: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 235 KiB/s wr, 93 op/s 2024-09-21T01:05:37.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:37 smithi042 ceph-mon[34481]: pgmap v610: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 235 KiB/s wr, 93 op/s 2024-09-21T01:05:38.301 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:05:39.616 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-21T01:05:39.617 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:05:39.617 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 133017, 2024-09-21T01:05:39.617 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 100688, 2024-09-21T01:05:39.617 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 46287682, 2024-09-21T01:05:39.617 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 59605160, 2024-09-21T01:05:39.617 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 36, 2024-09-21T01:05:39.617 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 4, 2024-09-21T01:05:39.617 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 5.977092399, 2024-09-21T01:05:39.617 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 3.262777291, 2024-09-21T01:05:39.617 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 75.810320680, 2024-09-21T01:05:39.617 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.215735546, 2024-09-21T01:05:39.617 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:05:39.617 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 100690, 2024-09-21T01:05:39.618 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 9.038676166, 2024-09-21T01:05:39.618 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000089767 2024-09-21T01:05:39.618 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.618 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:05:39.618 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 190923, 2024-09-21T01:05:39.618 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.037308361, 2024-09-21T01:05:39.618 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000195 2024-09-21T01:05:39.618 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.618 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 55248, 2024-09-21T01:05:39.618 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 32768 2024-09-21T01:05:39.618 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.618 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:05:39.618 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 10430, 2024-09-21T01:05:39.619 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 11032, 2024-09-21T01:05:39.619 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 4481844, 2024-09-21T01:05:39.619 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 23024966, 2024-09-21T01:05:39.619 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 12, 2024-09-21T01:05:39.619 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 7, 2024-09-21T01:05:39.619 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.978904589, 2024-09-21T01:05:39.619 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.480271389, 2024-09-21T01:05:39.619 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.225205014, 2024-09-21T01:05:39.619 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.238569252, 2024-09-21T01:05:39.619 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:05:39.619 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 11030, 2024-09-21T01:05:39.619 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 4.215852265, 2024-09-21T01:05:39.619 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000382216 2024-09-21T01:05:39.619 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.619 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:05:39.620 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 3412, 2024-09-21T01:05:39.620 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000717714, 2024-09-21T01:05:39.620 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000210 2024-09-21T01:05:39.620 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.620 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:05:39.620 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 328912 2024-09-21T01:05:39.620 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.620 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:05:39.620 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 20976, 2024-09-21T01:05:39.620 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 20040, 2024-09-21T01:05:39.620 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 9975683, 2024-09-21T01:05:39.620 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 16700477, 2024-09-21T01:05:39.620 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 142, 2024-09-21T01:05:39.620 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 8, 2024-09-21T01:05:39.620 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 1.787172890, 2024-09-21T01:05:39.620 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.900026562, 2024-09-21T01:05:39.621 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.916439182, 2024-09-21T01:05:39.621 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.123424823, 2024-09-21T01:05:39.621 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:05:39.621 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 20036, 2024-09-21T01:05:39.621 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 2.044492942, 2024-09-21T01:05:39.621 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000102040 2024-09-21T01:05:39.621 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.621 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:05:39.621 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 30739, 2024-09-21T01:05:39.621 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.005638192, 2024-09-21T01:05:39.621 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000183 2024-09-21T01:05:39.621 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.621 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 1023824, 2024-09-21T01:05:39.621 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 135024 2024-09-21T01:05:39.622 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.622 INFO:teuthology.orchestra.run.smithi042.stdout: "cct": { 2024-09-21T01:05:39.622 INFO:teuthology.orchestra.run.smithi042.stdout: "total_workers": 1, 2024-09-21T01:05:39.622 INFO:teuthology.orchestra.run.smithi042.stdout: "unhealthy_workers": 0 2024-09-21T01:05:39.622 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.622 INFO:teuthology.orchestra.run.smithi042.stdout: "finisher-MDSRank": { 2024-09-21T01:05:39.622 INFO:teuthology.orchestra.run.smithi042.stdout: "queue_len": 0, 2024-09-21T01:05:39.622 INFO:teuthology.orchestra.run.smithi042.stdout: "complete_latency": { 2024-09-21T01:05:39.622 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 9553, 2024-09-21T01:05:39.622 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 18.119686401, 2024-09-21T01:05:39.622 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.001896753 2024-09-21T01:05:39.622 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-21T01:05:39.622 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.622 INFO:teuthology.orchestra.run.smithi042.stdout: "finisher-PurgeQueue": { 2024-09-21T01:05:39.623 INFO:teuthology.orchestra.run.smithi042.stdout: "queue_len": 0, 2024-09-21T01:05:39.623 INFO:teuthology.orchestra.run.smithi042.stdout: "complete_latency": { 2024-09-21T01:05:39.623 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 5515, 2024-09-21T01:05:39.623 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.600857081, 2024-09-21T01:05:39.623 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000108949 2024-09-21T01:05:39.623 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-21T01:05:39.623 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.623 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": { 2024-09-21T01:05:39.623 INFO:teuthology.orchestra.run.smithi042.stdout: "request": 26790, 2024-09-21T01:05:39.623 INFO:teuthology.orchestra.run.smithi042.stdout: "reply": 25911, 2024-09-21T01:05:39.623 INFO:teuthology.orchestra.run.smithi042.stdout: "reply_latency": { 2024-09-21T01:05:39.623 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 25911, 2024-09-21T01:05:39.623 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 461.350752891, 2024-09-21T01:05:39.623 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.017805208 2024-09-21T01:05:39.623 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.624 INFO:teuthology.orchestra.run.smithi042.stdout: "slow_reply": 0, 2024-09-21T01:05:39.624 INFO:teuthology.orchestra.run.smithi042.stdout: "forward": 879, 2024-09-21T01:05:39.624 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_fetch_complete": 5, 2024-09-21T01:05:39.624 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_fetch_keys": 1, 2024-09-21T01:05:39.624 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_commit": 1119, 2024-09-21T01:05:39.624 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_split": 6, 2024-09-21T01:05:39.624 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_merge": 0, 2024-09-21T01:05:39.624 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes": 22, 2024-09-21T01:05:39.624 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_top": 4, 2024-09-21T01:05:39.624 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_bottom": 7, 2024-09-21T01:05:39.624 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_pin_tail": 11, 2024-09-21T01:05:39.624 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_pinned": 16, 2024-09-21T01:05:39.624 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_expired": 487, 2024-09-21T01:05:39.624 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_with_caps": 1, 2024-09-21T01:05:39.624 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": 1, 2024-09-21T01:05:39.624 INFO:teuthology.orchestra.run.smithi042.stdout: "subtrees": 3, 2024-09-21T01:05:39.625 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse": 55343, 2024-09-21T01:05:39.625 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_hit": 47972, 2024-09-21T01:05:39.625 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_forward": 878, 2024-09-21T01:05:39.625 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_discover": 204, 2024-09-21T01:05:39.625 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_dir_fetch": 0, 2024-09-21T01:05:39.625 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_remote_ino": 0, 2024-09-21T01:05:39.625 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_lock": 505, 2024-09-21T01:05:39.625 INFO:teuthology.orchestra.run.smithi042.stdout: "load_cent": 0, 2024-09-21T01:05:39.625 INFO:teuthology.orchestra.run.smithi042.stdout: "q": 0, 2024-09-21T01:05:39.625 INFO:teuthology.orchestra.run.smithi042.stdout: "exported": 65, 2024-09-21T01:05:39.625 INFO:teuthology.orchestra.run.smithi042.stdout: "exported_inodes": 135, 2024-09-21T01:05:39.625 INFO:teuthology.orchestra.run.smithi042.stdout: "imported": 23, 2024-09-21T01:05:39.625 INFO:teuthology.orchestra.run.smithi042.stdout: "imported_inodes": 1620, 2024-09-21T01:05:39.625 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_dir_fetch": 0, 2024-09-21T01:05:39.626 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_backtrace_fetch": 6946, 2024-09-21T01:05:39.626 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_peer_discover": 0, 2024-09-21T01:05:39.626 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rfiles": 4, 2024-09-21T01:05:39.626 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rbytes": 234, 2024-09-21T01:05:39.626 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rsnaps": 0, 2024-09-21T01:05:39.626 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_backtrace_fetch": 6946, 2024-09-21T01:05:39.626 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_set_tag": 0, 2024-09-21T01:05:39.626 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T01:05:39.626 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_inotable_repaired": 0, 2024-09-21T01:05:39.626 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_dir_inodes": 87, 2024-09-21T01:05:39.626 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_dir_base_inodes": 10, 2024-09-21T01:05:39.626 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_dirfrag_rstats": 77, 2024-09-21T01:05:39.626 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_file_inodes": 6859, 2024-09-21T01:05:39.626 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_inode_file_caps": 95, 2024-09-21T01:05:39.627 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_revoke": 19432, 2024-09-21T01:05:39.627 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_grant": 20465, 2024-09-21T01:05:39.627 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T01:05:39.627 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T01:05:39.627 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T01:05:39.627 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_caps": 81151, 2024-09-21T01:05:39.627 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_caps_dirty": 2679, 2024-09-21T01:05:39.627 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_cap_release": 336, 2024-09-21T01:05:39.627 INFO:teuthology.orchestra.run.smithi042.stdout: "process_request_cap_release": 10611 2024-09-21T01:05:39.627 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.627 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_cache": { 2024-09-21T01:05:39.627 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_update": 1566, 2024-09-21T01:05:39.627 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_update_receipt": 3324, 2024-09-21T01:05:39.627 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_try_discover": 1919, 2024-09-21T01:05:39.627 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_send_discover": 2464, 2024-09-21T01:05:39.627 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_handle_discover": 1490, 2024-09-21T01:05:39.628 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays": 0, 2024-09-21T01:05:39.628 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays_delayed": 0, 2024-09-21T01:05:39.628 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays_enqueuing": 0, 2024-09-21T01:05:39.628 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_created": 2923, 2024-09-21T01:05:39.628 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_enqueued": 2923, 2024-09-21T01:05:39.628 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_reintegrated": 0, 2024-09-21T01:05:39.628 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_migrated": 0, 2024-09-21T01:05:39.628 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_processing": 0, 2024-09-21T01:05:39.628 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_enqueued": 0, 2024-09-21T01:05:39.628 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_prioritized": 0, 2024-09-21T01:05:39.628 INFO:teuthology.orchestra.run.smithi042.stdout: "recovery_started": 0, 2024-09-21T01:05:39.628 INFO:teuthology.orchestra.run.smithi042.stdout: "recovery_completed": 0, 2024-09-21T01:05:39.628 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_quiesce_path": 0, 2024-09-21T01:05:39.628 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_quiesce_inode": 0, 2024-09-21T01:05:39.628 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_enqueue_scrub": 10, 2024-09-21T01:05:39.628 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_exportdir": 65, 2024-09-21T01:05:39.629 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_flush": 0, 2024-09-21T01:05:39.629 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_fragmentdir": 6, 2024-09-21T01:05:39.629 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_fragstats": 0, 2024-09-21T01:05:39.629 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_inodestats": 0, 2024-09-21T01:05:39.629 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-21T01:05:39.629 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_succeeded": 0, 2024-09-21T01:05:39.629 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_write_failed": 0 2024-09-21T01:05:39.629 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.629 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_log": { 2024-09-21T01:05:39.629 INFO:teuthology.orchestra.run.smithi042.stdout: "evlrg": 0, 2024-09-21T01:05:39.629 INFO:teuthology.orchestra.run.smithi042.stdout: "evadd": 23138, 2024-09-21T01:05:39.629 INFO:teuthology.orchestra.run.smithi042.stdout: "evex": 23125, 2024-09-21T01:05:39.629 INFO:teuthology.orchestra.run.smithi042.stdout: "evtrm": 23125, 2024-09-21T01:05:39.629 INFO:teuthology.orchestra.run.smithi042.stdout: "ev": 13, 2024-09-21T01:05:39.629 INFO:teuthology.orchestra.run.smithi042.stdout: "evexg": 0, 2024-09-21T01:05:39.629 INFO:teuthology.orchestra.run.smithi042.stdout: "evexd": 1010, 2024-09-21T01:05:39.630 INFO:teuthology.orchestra.run.smithi042.stdout: "segadd": 53, 2024-09-21T01:05:39.630 INFO:teuthology.orchestra.run.smithi042.stdout: "segex": 52, 2024-09-21T01:05:39.630 INFO:teuthology.orchestra.run.smithi042.stdout: "segtrm": 52, 2024-09-21T01:05:39.630 INFO:teuthology.orchestra.run.smithi042.stdout: "seg": 1, 2024-09-21T01:05:39.630 INFO:teuthology.orchestra.run.smithi042.stdout: "segmjr": 1, 2024-09-21T01:05:39.630 INFO:teuthology.orchestra.run.smithi042.stdout: "segexg": 0, 2024-09-21T01:05:39.630 INFO:teuthology.orchestra.run.smithi042.stdout: "segexd": 1, 2024-09-21T01:05:39.630 INFO:teuthology.orchestra.run.smithi042.stdout: "expos": 39848938, 2024-09-21T01:05:39.630 INFO:teuthology.orchestra.run.smithi042.stdout: "wrpos": 39881258, 2024-09-21T01:05:39.630 INFO:teuthology.orchestra.run.smithi042.stdout: "rdpos": 0, 2024-09-21T01:05:39.630 INFO:teuthology.orchestra.run.smithi042.stdout: "jlat": { 2024-09-21T01:05:39.630 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 4782, 2024-09-21T01:05:39.630 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 208.973793914, 2024-09-21T01:05:39.630 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.043700082 2024-09-21T01:05:39.630 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.631 INFO:teuthology.orchestra.run.smithi042.stdout: "replayed": 0 2024-09-21T01:05:39.631 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.631 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_mem": { 2024-09-21T01:05:39.631 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 26, 2024-09-21T01:05:39.631 INFO:teuthology.orchestra.run.smithi042.stdout: "ino+": 3196, 2024-09-21T01:05:39.631 INFO:teuthology.orchestra.run.smithi042.stdout: "ino-": 3170, 2024-09-21T01:05:39.631 INFO:teuthology.orchestra.run.smithi042.stdout: "dir": 32, 2024-09-21T01:05:39.631 INFO:teuthology.orchestra.run.smithi042.stdout: "dir+": 1701, 2024-09-21T01:05:39.631 INFO:teuthology.orchestra.run.smithi042.stdout: "dir-": 1669, 2024-09-21T01:05:39.631 INFO:teuthology.orchestra.run.smithi042.stdout: "dn": 53, 2024-09-21T01:05:39.631 INFO:teuthology.orchestra.run.smithi042.stdout: "dn+": 6737, 2024-09-21T01:05:39.631 INFO:teuthology.orchestra.run.smithi042.stdout: "dn-": 6684, 2024-09-21T01:05:39.631 INFO:teuthology.orchestra.run.smithi042.stdout: "cap": 1, 2024-09-21T01:05:39.631 INFO:teuthology.orchestra.run.smithi042.stdout: "cap+": 4672, 2024-09-21T01:05:39.631 INFO:teuthology.orchestra.run.smithi042.stdout: "cap-": 4671, 2024-09-21T01:05:39.631 INFO:teuthology.orchestra.run.smithi042.stdout: "rss": 156236, 2024-09-21T01:05:39.632 INFO:teuthology.orchestra.run.smithi042.stdout: "heap": 373170176 2024-09-21T01:05:39.632 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.632 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_server": { 2024-09-21T01:05:39.632 INFO:teuthology.orchestra.run.smithi042.stdout: "dispatch_client_request": 28929, 2024-09-21T01:05:39.632 INFO:teuthology.orchestra.run.smithi042.stdout: "dispatch_server_request": 54, 2024-09-21T01:05:39.632 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_request": 26790, 2024-09-21T01:05:39.632 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_session": 18, 2024-09-21T01:05:39.632 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_peer_request": 344, 2024-09-21T01:05:39.632 INFO:teuthology.orchestra.run.smithi042.stdout: "req_create_latency": { 2024-09-21T01:05:39.632 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 2214, 2024-09-21T01:05:39.632 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 10.377433867, 2024-09-21T01:05:39.632 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.004687187 2024-09-21T01:05:39.632 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.632 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getattr_latency": { 2024-09-21T01:05:39.632 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 2410, 2024-09-21T01:05:39.633 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 146.334150525, 2024-09-21T01:05:39.633 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.060719564 2024-09-21T01:05:39.633 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.633 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getfilelock_latency": { 2024-09-21T01:05:39.633 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:39.633 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:39.633 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:39.633 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.633 INFO:teuthology.orchestra.run.smithi042.stdout: "req_link_latency": { 2024-09-21T01:05:39.633 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:39.633 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:39.633 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:39.633 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.633 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookup_latency": { 2024-09-21T01:05:39.633 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 15566, 2024-09-21T01:05:39.633 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 290.267655596, 2024-09-21T01:05:39.634 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.018647543 2024-09-21T01:05:39.634 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.634 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookuphash_latency": { 2024-09-21T01:05:39.634 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:39.634 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:39.634 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:39.634 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.634 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupino_latency": { 2024-09-21T01:05:39.634 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:39.634 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:39.634 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:39.634 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.634 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupname_latency": { 2024-09-21T01:05:39.634 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:39.634 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:39.635 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:39.635 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.635 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupparent_latency": { 2024-09-21T01:05:39.635 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:39.635 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:39.635 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:39.635 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.635 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupsnap_latency": { 2024-09-21T01:05:39.635 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:39.636 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:39.636 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:39.636 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.636 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lssnap_latency": { 2024-09-21T01:05:39.636 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:39.636 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:39.636 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:39.636 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.636 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mkdir_latency": { 2024-09-21T01:05:39.636 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 15, 2024-09-21T01:05:39.636 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.018920232, 2024-09-21T01:05:39.636 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.001261348 2024-09-21T01:05:39.636 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.636 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mknod_latency": { 2024-09-21T01:05:39.636 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:39.637 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:39.637 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:39.637 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.637 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mksnap_latency": { 2024-09-21T01:05:39.637 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:39.637 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:39.637 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:39.637 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.637 INFO:teuthology.orchestra.run.smithi042.stdout: "req_open_latency": { 2024-09-21T01:05:39.637 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1773, 2024-09-21T01:05:39.637 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 2.106186276, 2024-09-21T01:05:39.637 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.001187922 2024-09-21T01:05:39.637 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.637 INFO:teuthology.orchestra.run.smithi042.stdout: "req_readdir_latency": { 2024-09-21T01:05:39.638 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 99, 2024-09-21T01:05:39.638 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.392637213, 2024-09-21T01:05:39.638 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.003966032 2024-09-21T01:05:39.638 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.638 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rename_latency": { 2024-09-21T01:05:39.638 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1977, 2024-09-21T01:05:39.638 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 9.526302002, 2024-09-21T01:05:39.638 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.004818564 2024-09-21T01:05:39.638 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.638 INFO:teuthology.orchestra.run.smithi042.stdout: "req_renamesnap_latency": { 2024-09-21T01:05:39.638 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:39.638 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:39.638 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:39.638 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.638 INFO:teuthology.orchestra.run.smithi042.stdout: "req_snapdiff_latency": { 2024-09-21T01:05:39.639 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:39.639 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:39.639 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:39.639 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.639 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmdir_latency": { 2024-09-21T01:05:39.639 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 5, 2024-09-21T01:05:39.639 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.049855001, 2024-09-21T01:05:39.639 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.009971000 2024-09-21T01:05:39.639 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.639 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmsnap_latency": { 2024-09-21T01:05:39.639 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:39.639 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:39.639 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:39.639 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.639 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmxattr_latency": { 2024-09-21T01:05:39.639 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:39.640 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:39.640 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:39.640 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.640 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setattr_latency": { 2024-09-21T01:05:39.640 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1, 2024-09-21T01:05:39.640 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000918745, 2024-09-21T01:05:39.640 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000918745 2024-09-21T01:05:39.640 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.640 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setdirlayout_latency": { 2024-09-21T01:05:39.640 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:39.640 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:39.640 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:39.640 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.640 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setfilelock_latency": { 2024-09-21T01:05:39.640 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:39.641 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:39.641 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:39.641 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.641 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setlayout_latency": { 2024-09-21T01:05:39.641 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:39.641 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:39.641 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:39.641 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.641 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setxattr_latency": { 2024-09-21T01:05:39.641 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 10, 2024-09-21T01:05:39.641 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.023949622, 2024-09-21T01:05:39.641 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.002394962 2024-09-21T01:05:39.641 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.641 INFO:teuthology.orchestra.run.smithi042.stdout: "req_symlink_latency": { 2024-09-21T01:05:39.641 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1, 2024-09-21T01:05:39.642 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000646964, 2024-09-21T01:05:39.642 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000646964 2024-09-21T01:05:39.642 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.642 INFO:teuthology.orchestra.run.smithi042.stdout: "req_unlink_latency": { 2024-09-21T01:05:39.642 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1840, 2024-09-21T01:05:39.642 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 2.252096848, 2024-09-21T01:05:39.642 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.001223965 2024-09-21T01:05:39.642 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.642 INFO:teuthology.orchestra.run.smithi042.stdout: "cap_revoke_eviction": 0, 2024-09-21T01:05:39.642 INFO:teuthology.orchestra.run.smithi042.stdout: "cap_acquisition_throttle": 0, 2024-09-21T01:05:39.642 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getvxattr_latency": { 2024-09-21T01:05:39.642 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:39.642 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:39.642 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:39.642 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-21T01:05:39.643 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.643 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_sessions": { 2024-09-21T01:05:39.643 INFO:teuthology.orchestra.run.smithi042.stdout: "session_count": 1, 2024-09-21T01:05:39.643 INFO:teuthology.orchestra.run.smithi042.stdout: "session_add": 3, 2024-09-21T01:05:39.643 INFO:teuthology.orchestra.run.smithi042.stdout: "session_remove": 2, 2024-09-21T01:05:39.643 INFO:teuthology.orchestra.run.smithi042.stdout: "sessions_open": 1, 2024-09-21T01:05:39.643 INFO:teuthology.orchestra.run.smithi042.stdout: "sessions_stale": 0, 2024-09-21T01:05:39.643 INFO:teuthology.orchestra.run.smithi042.stdout: "total_load": 3264, 2024-09-21T01:05:39.643 INFO:teuthology.orchestra.run.smithi042.stdout: "average_load": 3264, 2024-09-21T01:05:39.643 INFO:teuthology.orchestra.run.smithi042.stdout: "avg_session_uptime": 526, 2024-09-21T01:05:39.643 INFO:teuthology.orchestra.run.smithi042.stdout: "mdthresh_evicted": 0 2024-09-21T01:05:39.643 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.643 INFO:teuthology.orchestra.run.smithi042.stdout: "mempool": { 2024-09-21T01:05:39.643 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_bytes": 360, 2024-09-21T01:05:39.643 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_items": 360, 2024-09-21T01:05:39.644 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:05:39.644 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:05:39.644 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:05:39.644 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:05:39.644 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:05:39.644 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:05:39.644 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:05:39.644 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:05:39.644 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:05:39.644 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:05:39.644 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:05:39.644 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:05:39.644 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:05:39.644 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_items": 0, 2024-09-21T01:05:39.644 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:05:39.644 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_items": 0, 2024-09-21T01:05:39.645 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:05:39.645 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:05:39.645 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:05:39.645 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:05:39.645 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:05:39.645 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:05:39.645 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:05:39.645 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_items": 0, 2024-09-21T01:05:39.645 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:05:39.645 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:05:39.645 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:05:39.645 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_items": 0, 2024-09-21T01:05:39.645 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_bytes": 0, 2024-09-21T01:05:39.645 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_items": 0, 2024-09-21T01:05:39.645 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:05:39.646 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:05:39.646 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:05:39.646 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:05:39.646 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_bytes": 304156, 2024-09-21T01:05:39.646 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_items": 114, 2024-09-21T01:05:39.646 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_bytes": 88, 2024-09-21T01:05:39.646 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_items": 1, 2024-09-21T01:05:39.646 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_bytes": 0, 2024-09-21T01:05:39.646 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_items": 0, 2024-09-21T01:05:39.646 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:05:39.646 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_items": 0, 2024-09-21T01:05:39.646 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:05:39.646 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_items": 0, 2024-09-21T01:05:39.646 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_bytes": 7688, 2024-09-21T01:05:39.646 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_items": 158, 2024-09-21T01:05:39.647 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:05:39.647 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:05:39.647 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_bytes": 0, 2024-09-21T01:05:39.647 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_items": 0, 2024-09-21T01:05:39.647 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_bytes": 150242, 2024-09-21T01:05:39.647 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_items": 1244, 2024-09-21T01:05:39.647 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_bytes": 0, 2024-09-21T01:05:39.647 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_items": 0, 2024-09-21T01:05:39.647 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_bytes": 0, 2024-09-21T01:05:39.647 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_items": 0 2024-09-21T01:05:39.647 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.647 INFO:teuthology.orchestra.run.smithi042.stdout: "objecter": { 2024-09-21T01:05:39.647 INFO:teuthology.orchestra.run.smithi042.stdout: "op_active": 0, 2024-09-21T01:05:39.647 INFO:teuthology.orchestra.run.smithi042.stdout: "op_laggy": 0, 2024-09-21T01:05:39.647 INFO:teuthology.orchestra.run.smithi042.stdout: "op_send": 19928, 2024-09-21T01:05:39.647 INFO:teuthology.orchestra.run.smithi042.stdout: "op_send_bytes": 44484094, 2024-09-21T01:05:39.648 INFO:teuthology.orchestra.run.smithi042.stdout: "op_resend": 37, 2024-09-21T01:05:39.648 INFO:teuthology.orchestra.run.smithi042.stdout: "op_reply": 19928, 2024-09-21T01:05:39.648 INFO:teuthology.orchestra.run.smithi042.stdout: "op_latency": { 2024-09-21T01:05:39.648 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 19928, 2024-09-21T01:05:39.648 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 392.440031677, 2024-09-21T01:05:39.648 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.019692896 2024-09-21T01:05:39.648 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.648 INFO:teuthology.orchestra.run.smithi042.stdout: "op_inflight": 0, 2024-09-21T01:05:39.648 INFO:teuthology.orchestra.run.smithi042.stdout: "oplen_avg": { 2024-09-21T01:05:39.648 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 19928, 2024-09-21T01:05:39.648 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 28081 2024-09-21T01:05:39.648 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.648 INFO:teuthology.orchestra.run.smithi042.stdout: "op": 19928, 2024-09-21T01:05:39.648 INFO:teuthology.orchestra.run.smithi042.stdout: "op_r": 7111, 2024-09-21T01:05:39.648 INFO:teuthology.orchestra.run.smithi042.stdout: "op_w": 12817, 2024-09-21T01:05:39.649 INFO:teuthology.orchestra.run.smithi042.stdout: "op_rmw": 0, 2024-09-21T01:05:39.649 INFO:teuthology.orchestra.run.smithi042.stdout: "op_pg": 0, 2024-09-21T01:05:39.649 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_stat": 1046, 2024-09-21T01:05:39.649 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_create": 2852, 2024-09-21T01:05:39.649 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_read": 147, 2024-09-21T01:05:39.649 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_write": 4919, 2024-09-21T01:05:39.649 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_writefull": 191, 2024-09-21T01:05:39.649 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_writesame": 0, 2024-09-21T01:05:39.649 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_append": 0, 2024-09-21T01:05:39.649 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_zero": 0, 2024-09-21T01:05:39.649 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_truncate": 6, 2024-09-21T01:05:39.649 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_delete": 3451, 2024-09-21T01:05:39.649 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_mapext": 0, 2024-09-21T01:05:39.649 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_sparse_read": 0, 2024-09-21T01:05:39.649 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_clonerange": 0, 2024-09-21T01:05:39.649 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_getxattr": 6961, 2024-09-21T01:05:39.650 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_setxattr": 5704, 2024-09-21T01:05:39.650 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_cmpxattr": 0, 2024-09-21T01:05:39.650 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_rmxattr": 0, 2024-09-21T01:05:39.650 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_resetxattrs": 0, 2024-09-21T01:05:39.650 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_call": 0, 2024-09-21T01:05:39.650 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_watch": 0, 2024-09-21T01:05:39.650 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_notify": 0, 2024-09-21T01:05:39.650 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T01:05:39.650 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_pgls": 0, 2024-09-21T01:05:39.650 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_pgls_filter": 0, 2024-09-21T01:05:39.650 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_other": 0, 2024-09-21T01:05:39.650 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_active": 0, 2024-09-21T01:05:39.650 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_send": 0, 2024-09-21T01:05:39.650 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_resend": 0, 2024-09-21T01:05:39.650 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_ping": 0, 2024-09-21T01:05:39.651 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_active": 0, 2024-09-21T01:05:39.651 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_send": 0, 2024-09-21T01:05:39.651 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_resend": 0, 2024-09-21T01:05:39.651 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_active": 0, 2024-09-21T01:05:39.651 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_send": 0, 2024-09-21T01:05:39.651 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_resend": 0, 2024-09-21T01:05:39.651 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_active": 0, 2024-09-21T01:05:39.651 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_send": 0, 2024-09-21T01:05:39.651 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_resend": 0, 2024-09-21T01:05:39.651 INFO:teuthology.orchestra.run.smithi042.stdout: "command_active": 0, 2024-09-21T01:05:39.651 INFO:teuthology.orchestra.run.smithi042.stdout: "command_send": 0, 2024-09-21T01:05:39.651 INFO:teuthology.orchestra.run.smithi042.stdout: "command_resend": 0, 2024-09-21T01:05:39.651 INFO:teuthology.orchestra.run.smithi042.stdout: "map_epoch": 75, 2024-09-21T01:05:39.651 INFO:teuthology.orchestra.run.smithi042.stdout: "map_full": 0, 2024-09-21T01:05:39.651 INFO:teuthology.orchestra.run.smithi042.stdout: "map_inc": 2, 2024-09-21T01:05:39.651 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_sessions": 12, 2024-09-21T01:05:39.652 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_session_open": 12, 2024-09-21T01:05:39.652 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_session_close": 0, 2024-09-21T01:05:39.652 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_laggy": 0, 2024-09-21T01:05:39.652 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_wr": 2399, 2024-09-21T01:05:39.652 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_rd": 14, 2024-09-21T01:05:39.652 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_del": 391 2024-09-21T01:05:39.652 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.652 INFO:teuthology.orchestra.run.smithi042.stdout: "oft": { 2024-09-21T01:05:39.652 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_objs": 1, 2024-09-21T01:05:39.652 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_kv_pairs": 0, 2024-09-21T01:05:39.652 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_updates": 0, 2024-09-21T01:05:39.652 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_removes": 0 2024-09-21T01:05:39.652 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.652 INFO:teuthology.orchestra.run.smithi042.stdout: "purge_queue": { 2024-09-21T01:05:39.652 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_ops": 0, 2024-09-21T01:05:39.652 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_ops_high_water": 6, 2024-09-21T01:05:39.653 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing": 0, 2024-09-21T01:05:39.653 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_high_water": 6, 2024-09-21T01:05:39.653 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executed_ops": 2923, 2024-09-21T01:05:39.653 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executed": 2923, 2024-09-21T01:05:39.653 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_item_in_journal": 0 2024-09-21T01:05:39.653 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.653 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:05:39.653 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-21T01:05:39.653 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 104857600, 2024-09-21T01:05:39.653 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-21T01:05:39.653 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 164419, 2024-09-21T01:05:39.653 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 45921425, 2024-09-21T01:05:39.653 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:39.653 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 164419, 2024-09-21T01:05:39.653 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-09-21T01:05:39.653 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-09-21T01:05:39.654 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 164419, 2024-09-21T01:05:39.654 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 45921425, 2024-09-21T01:05:39.654 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-21T01:05:39.654 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:39.654 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:39.654 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:39.654 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-21T01:05:39.654 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.654 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-objecter_bytes": { 2024-09-21T01:05:39.654 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-21T01:05:39.654 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 104857600, 2024-09-21T01:05:39.654 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-21T01:05:39.654 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2024-09-21T01:05:39.654 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2024-09-21T01:05:39.654 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:39.655 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2024-09-21T01:05:39.655 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 19928, 2024-09-21T01:05:39.655 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 44779163, 2024-09-21T01:05:39.655 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 19928, 2024-09-21T01:05:39.655 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 44779163, 2024-09-21T01:05:39.655 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-21T01:05:39.655 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:39.655 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:39.655 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:39.655 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-21T01:05:39.655 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.655 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-objecter_ops": { 2024-09-21T01:05:39.655 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-21T01:05:39.655 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 1024, 2024-09-21T01:05:39.655 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-21T01:05:39.655 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2024-09-21T01:05:39.656 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2024-09-21T01:05:39.656 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:39.656 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2024-09-21T01:05:39.656 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 19928, 2024-09-21T01:05:39.656 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 19928, 2024-09-21T01:05:39.656 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 19928, 2024-09-21T01:05:39.656 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 19928, 2024-09-21T01:05:39.656 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-21T01:05:39.656 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:39.656 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:39.656 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:39.656 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-21T01:05:39.656 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.656 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-write_buf_throttle": { 2024-09-21T01:05:39.656 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-21T01:05:39.657 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 3758096384, 2024-09-21T01:05:39.657 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-21T01:05:39.657 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 2923, 2024-09-21T01:05:39.657 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 295223, 2024-09-21T01:05:39.657 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:39.657 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 2923, 2024-09-21T01:05:39.657 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-09-21T01:05:39.657 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-09-21T01:05:39.657 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 137, 2024-09-21T01:05:39.657 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 295223, 2024-09-21T01:05:39.657 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-21T01:05:39.657 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:39.657 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:39.657 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:39.657 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-21T01:05:39.657 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.658 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-write_buf_throttle-0x56253df05450": { 2024-09-21T01:05:39.658 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-21T01:05:39.658 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 3758096384, 2024-09-21T01:05:39.658 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-21T01:05:39.658 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 23138, 2024-09-21T01:05:39.658 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 35686954, 2024-09-21T01:05:39.658 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:39.658 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 23138, 2024-09-21T01:05:39.658 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-09-21T01:05:39.658 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-09-21T01:05:39.658 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 4782, 2024-09-21T01:05:39.658 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 35686954, 2024-09-21T01:05:39.658 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-21T01:05:39.658 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:39.659 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:39.659 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:39.659 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-21T01:05:39.659 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:39.659 INFO:teuthology.orchestra.run.smithi042.stdout: "trackedop": { 2024-09-21T01:05:39.659 INFO:teuthology.orchestra.run.smithi042.stdout: "slow_ops_count": 0 2024-09-21T01:05:39.659 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-21T01:05:39.659 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-21T01:05:39.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:39 smithi001 ceph-mon[31211]: pgmap v611: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 191 KiB/s wr, 34 op/s 2024-09-21T01:05:39.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:39 smithi193 ceph-mon[34660]: pgmap v611: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 191 KiB/s wr, 34 op/s 2024-09-21T01:05:39.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:39 smithi042 ceph-mon[34481]: pgmap v611: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 191 KiB/s wr, 34 op/s 2024-09-21T01:05:40.828 INFO:tasks.check_counter:Daemon mds.b mds.exported=65 2024-09-21T01:05:40.828 INFO:tasks.check_counter:Daemon mds.b mds.imported=23 2024-09-21T01:05:40.828 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=1566 2024-09-21T01:05:40.828 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=3324 2024-09-21T01:05:40.828 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=6 2024-09-21T01:05:40.828 DEBUG:tasks.check_counter:Getting stats from e 2024-09-21T01:05:40.828 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph daemon mds.e perf dump 2024-09-21T01:05:41.126 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:05:41.781 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-21T01:05:41.782 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:05:41.782 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 1226, 2024-09-21T01:05:41.782 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 1227, 2024-09-21T01:05:41.782 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 12947309, 2024-09-21T01:05:41.782 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 389560, 2024-09-21T01:05:41.782 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 7, 2024-09-21T01:05:41.782 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 3, 2024-09-21T01:05:41.782 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.127935813, 2024-09-21T01:05:41.782 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.055466795, 2024-09-21T01:05:41.782 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.033112281, 2024-09-21T01:05:41.782 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.030514130, 2024-09-21T01:05:41.782 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:05:41.782 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1225, 2024-09-21T01:05:41.783 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.036838067, 2024-09-21T01:05:41.783 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000030071 2024-09-21T01:05:41.783 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.783 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:05:41.783 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.783 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.783 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.783 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.783 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T01:05:41.783 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T01:05:41.783 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.783 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:05:41.783 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 540, 2024-09-21T01:05:41.784 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 675, 2024-09-21T01:05:41.784 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 14855992, 2024-09-21T01:05:41.784 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 494148, 2024-09-21T01:05:41.784 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 6, 2024-09-21T01:05:41.784 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 5, 2024-09-21T01:05:41.784 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.063349227, 2024-09-21T01:05:41.784 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.024662097, 2024-09-21T01:05:41.784 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.022550050, 2024-09-21T01:05:41.784 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.012186497, 2024-09-21T01:05:41.784 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:05:41.784 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 674, 2024-09-21T01:05:41.784 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.026704669, 2024-09-21T01:05:41.784 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000039621 2024-09-21T01:05:41.784 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.784 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:05:41.785 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.785 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.785 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.785 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.785 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-09-21T01:05:41.785 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 323952 2024-09-21T01:05:41.785 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.785 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:05:41.785 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 586, 2024-09-21T01:05:41.785 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 564, 2024-09-21T01:05:41.785 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 9441339, 2024-09-21T01:05:41.785 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 231845, 2024-09-21T01:05:41.785 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 4, 2024-09-21T01:05:41.785 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 3, 2024-09-21T01:05:41.785 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.073709652, 2024-09-21T01:05:41.786 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.027179202, 2024-09-21T01:05:41.786 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.042531939, 2024-09-21T01:05:41.786 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.010789460, 2024-09-21T01:05:41.786 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:05:41.786 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 563, 2024-09-21T01:05:41.786 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.022266316, 2024-09-21T01:05:41.786 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000039549 2024-09-21T01:05:41.786 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.787 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:05:41.787 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.787 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.787 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.787 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.787 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 959248, 2024-09-21T01:05:41.787 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 112912 2024-09-21T01:05:41.787 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.787 INFO:teuthology.orchestra.run.smithi042.stdout: "cct": { 2024-09-21T01:05:41.788 INFO:teuthology.orchestra.run.smithi042.stdout: "total_workers": 1, 2024-09-21T01:05:41.788 INFO:teuthology.orchestra.run.smithi042.stdout: "unhealthy_workers": 0 2024-09-21T01:05:41.788 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.788 INFO:teuthology.orchestra.run.smithi042.stdout: "finisher-MDSRank": { 2024-09-21T01:05:41.788 INFO:teuthology.orchestra.run.smithi042.stdout: "queue_len": 0, 2024-09-21T01:05:41.788 INFO:teuthology.orchestra.run.smithi042.stdout: "complete_latency": { 2024-09-21T01:05:41.788 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 3612, 2024-09-21T01:05:41.788 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.183099032, 2024-09-21T01:05:41.788 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000050691 2024-09-21T01:05:41.788 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-21T01:05:41.788 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.788 INFO:teuthology.orchestra.run.smithi042.stdout: "finisher-PurgeQueue": { 2024-09-21T01:05:41.788 INFO:teuthology.orchestra.run.smithi042.stdout: "queue_len": 0, 2024-09-21T01:05:41.788 INFO:teuthology.orchestra.run.smithi042.stdout: "complete_latency": { 2024-09-21T01:05:41.788 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.789 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.789 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.789 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-21T01:05:41.789 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.789 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": { 2024-09-21T01:05:41.789 INFO:teuthology.orchestra.run.smithi042.stdout: "request": 0, 2024-09-21T01:05:41.789 INFO:teuthology.orchestra.run.smithi042.stdout: "reply": 0, 2024-09-21T01:05:41.790 INFO:teuthology.orchestra.run.smithi042.stdout: "reply_latency": { 2024-09-21T01:05:41.790 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.790 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.790 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.790 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.790 INFO:teuthology.orchestra.run.smithi042.stdout: "slow_reply": 0, 2024-09-21T01:05:41.791 INFO:teuthology.orchestra.run.smithi042.stdout: "forward": 0, 2024-09-21T01:05:41.791 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_fetch_complete": 0, 2024-09-21T01:05:41.791 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_fetch_keys": 0, 2024-09-21T01:05:41.791 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_commit": 0, 2024-09-21T01:05:41.791 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_split": 0, 2024-09-21T01:05:41.791 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_merge": 0, 2024-09-21T01:05:41.791 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes": 2946, 2024-09-21T01:05:41.791 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_top": 2049, 2024-09-21T01:05:41.791 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_bottom": 897, 2024-09-21T01:05:41.792 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_pin_tail": 0, 2024-09-21T01:05:41.792 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_pinned": 18, 2024-09-21T01:05:41.792 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_expired": 0, 2024-09-21T01:05:41.792 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_with_caps": 0, 2024-09-21T01:05:41.792 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": 0, 2024-09-21T01:05:41.792 INFO:teuthology.orchestra.run.smithi042.stdout: "subtrees": 2, 2024-09-21T01:05:41.792 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse": 0, 2024-09-21T01:05:41.792 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_hit": 0, 2024-09-21T01:05:41.792 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_forward": 0, 2024-09-21T01:05:41.792 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_discover": 0, 2024-09-21T01:05:41.792 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_dir_fetch": 0, 2024-09-21T01:05:41.792 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_remote_ino": 0, 2024-09-21T01:05:41.792 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_lock": 0, 2024-09-21T01:05:41.792 INFO:teuthology.orchestra.run.smithi042.stdout: "load_cent": 0, 2024-09-21T01:05:41.792 INFO:teuthology.orchestra.run.smithi042.stdout: "q": 0, 2024-09-21T01:05:41.793 INFO:teuthology.orchestra.run.smithi042.stdout: "exported": 0, 2024-09-21T01:05:41.793 INFO:teuthology.orchestra.run.smithi042.stdout: "exported_inodes": 0, 2024-09-21T01:05:41.793 INFO:teuthology.orchestra.run.smithi042.stdout: "imported": 0, 2024-09-21T01:05:41.793 INFO:teuthology.orchestra.run.smithi042.stdout: "imported_inodes": 0, 2024-09-21T01:05:41.793 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_dir_fetch": 0, 2024-09-21T01:05:41.793 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_backtrace_fetch": 0, 2024-09-21T01:05:41.793 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_peer_discover": 0, 2024-09-21T01:05:41.793 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rfiles": 4, 2024-09-21T01:05:41.793 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rbytes": 234, 2024-09-21T01:05:41.793 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rsnaps": 0, 2024-09-21T01:05:41.793 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T01:05:41.793 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_set_tag": 0, 2024-09-21T01:05:41.793 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T01:05:41.793 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_inotable_repaired": 0, 2024-09-21T01:05:41.794 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_dir_inodes": 0, 2024-09-21T01:05:41.794 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T01:05:41.794 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T01:05:41.794 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_file_inodes": 0, 2024-09-21T01:05:41.794 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_inode_file_caps": 0, 2024-09-21T01:05:41.794 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T01:05:41.794 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_grant": 0, 2024-09-21T01:05:41.794 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T01:05:41.794 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T01:05:41.794 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T01:05:41.794 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_caps": 0, 2024-09-21T01:05:41.794 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_caps_dirty": 0, 2024-09-21T01:05:41.794 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_cap_release": 0, 2024-09-21T01:05:41.794 INFO:teuthology.orchestra.run.smithi042.stdout: "process_request_cap_release": 0 2024-09-21T01:05:41.794 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.795 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_cache": { 2024-09-21T01:05:41.795 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_update": 0, 2024-09-21T01:05:41.795 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_update_receipt": 0, 2024-09-21T01:05:41.795 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_try_discover": 0, 2024-09-21T01:05:41.795 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_send_discover": 0, 2024-09-21T01:05:41.795 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_handle_discover": 0, 2024-09-21T01:05:41.795 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays": 0, 2024-09-21T01:05:41.795 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays_delayed": 0, 2024-09-21T01:05:41.795 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays_enqueuing": 0, 2024-09-21T01:05:41.795 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_created": 0, 2024-09-21T01:05:41.795 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_enqueued": 0, 2024-09-21T01:05:41.795 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_reintegrated": 0, 2024-09-21T01:05:41.795 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_migrated": 0, 2024-09-21T01:05:41.795 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_processing": 0, 2024-09-21T01:05:41.795 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_enqueued": 0, 2024-09-21T01:05:41.796 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_prioritized": 0, 2024-09-21T01:05:41.796 INFO:teuthology.orchestra.run.smithi042.stdout: "recovery_started": 0, 2024-09-21T01:05:41.796 INFO:teuthology.orchestra.run.smithi042.stdout: "recovery_completed": 0, 2024-09-21T01:05:41.796 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_quiesce_path": 0, 2024-09-21T01:05:41.796 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_quiesce_inode": 0, 2024-09-21T01:05:41.796 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T01:05:41.796 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_exportdir": 0, 2024-09-21T01:05:41.796 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_flush": 0, 2024-09-21T01:05:41.796 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_fragmentdir": 0, 2024-09-21T01:05:41.796 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_fragstats": 0, 2024-09-21T01:05:41.796 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_inodestats": 0, 2024-09-21T01:05:41.796 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-21T01:05:41.796 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_succeeded": 0, 2024-09-21T01:05:41.796 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_write_failed": 0 2024-09-21T01:05:41.796 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.797 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_log": { 2024-09-21T01:05:41.797 INFO:teuthology.orchestra.run.smithi042.stdout: "evlrg": 0, 2024-09-21T01:05:41.797 INFO:teuthology.orchestra.run.smithi042.stdout: "evadd": 0, 2024-09-21T01:05:41.797 INFO:teuthology.orchestra.run.smithi042.stdout: "evex": 0, 2024-09-21T01:05:41.797 INFO:teuthology.orchestra.run.smithi042.stdout: "evtrm": 0, 2024-09-21T01:05:41.797 INFO:teuthology.orchestra.run.smithi042.stdout: "ev": 23138, 2024-09-21T01:05:41.797 INFO:teuthology.orchestra.run.smithi042.stdout: "evexg": 0, 2024-09-21T01:05:41.797 INFO:teuthology.orchestra.run.smithi042.stdout: "evexd": 0, 2024-09-21T01:05:41.797 INFO:teuthology.orchestra.run.smithi042.stdout: "segadd": 0, 2024-09-21T01:05:41.797 INFO:teuthology.orchestra.run.smithi042.stdout: "segex": 0, 2024-09-21T01:05:41.797 INFO:teuthology.orchestra.run.smithi042.stdout: "segtrm": 0, 2024-09-21T01:05:41.797 INFO:teuthology.orchestra.run.smithi042.stdout: "seg": 2, 2024-09-21T01:05:41.797 INFO:teuthology.orchestra.run.smithi042.stdout: "segmjr": 39, 2024-09-21T01:05:41.797 INFO:teuthology.orchestra.run.smithi042.stdout: "segexg": 0, 2024-09-21T01:05:41.797 INFO:teuthology.orchestra.run.smithi042.stdout: "segexd": 0, 2024-09-21T01:05:41.798 INFO:teuthology.orchestra.run.smithi042.stdout: "expos": 39848938, 2024-09-21T01:05:41.798 INFO:teuthology.orchestra.run.smithi042.stdout: "wrpos": 39881258, 2024-09-21T01:05:41.798 INFO:teuthology.orchestra.run.smithi042.stdout: "rdpos": 39880120, 2024-09-21T01:05:41.798 INFO:teuthology.orchestra.run.smithi042.stdout: "jlat": { 2024-09-21T01:05:41.798 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.798 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.798 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.798 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.798 INFO:teuthology.orchestra.run.smithi042.stdout: "replayed": 23138 2024-09-21T01:05:41.798 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.798 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_mem": { 2024-09-21T01:05:41.798 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 23, 2024-09-21T01:05:41.798 INFO:teuthology.orchestra.run.smithi042.stdout: "ino+": 3021, 2024-09-21T01:05:41.798 INFO:teuthology.orchestra.run.smithi042.stdout: "ino-": 2998, 2024-09-21T01:05:41.798 INFO:teuthology.orchestra.run.smithi042.stdout: "dir": 18, 2024-09-21T01:05:41.799 INFO:teuthology.orchestra.run.smithi042.stdout: "dir+": 124, 2024-09-21T01:05:41.799 INFO:teuthology.orchestra.run.smithi042.stdout: "dir-": 106, 2024-09-21T01:05:41.799 INFO:teuthology.orchestra.run.smithi042.stdout: "dn": 2946, 2024-09-21T01:05:41.799 INFO:teuthology.orchestra.run.smithi042.stdout: "dn+": 6390, 2024-09-21T01:05:41.799 INFO:teuthology.orchestra.run.smithi042.stdout: "dn-": 3444, 2024-09-21T01:05:41.799 INFO:teuthology.orchestra.run.smithi042.stdout: "cap": 0, 2024-09-21T01:05:41.799 INFO:teuthology.orchestra.run.smithi042.stdout: "cap+": 0, 2024-09-21T01:05:41.799 INFO:teuthology.orchestra.run.smithi042.stdout: "cap-": 0, 2024-09-21T01:05:41.799 INFO:teuthology.orchestra.run.smithi042.stdout: "rss": 124752, 2024-09-21T01:05:41.799 INFO:teuthology.orchestra.run.smithi042.stdout: "heap": 329515008 2024-09-21T01:05:41.799 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.799 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_server": { 2024-09-21T01:05:41.799 INFO:teuthology.orchestra.run.smithi042.stdout: "dispatch_client_request": 0, 2024-09-21T01:05:41.799 INFO:teuthology.orchestra.run.smithi042.stdout: "dispatch_server_request": 0, 2024-09-21T01:05:41.799 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_request": 0, 2024-09-21T01:05:41.800 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_session": 0, 2024-09-21T01:05:41.800 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_peer_request": 0, 2024-09-21T01:05:41.800 INFO:teuthology.orchestra.run.smithi042.stdout: "req_create_latency": { 2024-09-21T01:05:41.800 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.800 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.800 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.800 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.800 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getattr_latency": { 2024-09-21T01:05:41.800 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.800 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.800 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.800 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.800 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getfilelock_latency": { 2024-09-21T01:05:41.800 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.801 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.801 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.801 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.801 INFO:teuthology.orchestra.run.smithi042.stdout: "req_link_latency": { 2024-09-21T01:05:41.801 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.801 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.801 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.801 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.801 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookup_latency": { 2024-09-21T01:05:41.801 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.801 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.801 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.801 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.801 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookuphash_latency": { 2024-09-21T01:05:41.801 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.801 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.802 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.802 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.802 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupino_latency": { 2024-09-21T01:05:41.802 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.802 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.802 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.802 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.802 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupname_latency": { 2024-09-21T01:05:41.802 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.802 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.802 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.802 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.802 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupparent_latency": { 2024-09-21T01:05:41.802 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.803 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.803 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.803 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.803 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupsnap_latency": { 2024-09-21T01:05:41.803 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.803 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.803 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.803 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.803 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lssnap_latency": { 2024-09-21T01:05:41.803 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.803 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.803 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.803 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.803 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mkdir_latency": { 2024-09-21T01:05:41.803 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.804 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.804 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.804 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.804 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mknod_latency": { 2024-09-21T01:05:41.804 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.804 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.804 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.804 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.804 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mksnap_latency": { 2024-09-21T01:05:41.804 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.804 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.804 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.804 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.804 INFO:teuthology.orchestra.run.smithi042.stdout: "req_open_latency": { 2024-09-21T01:05:41.805 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.805 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.805 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.805 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.805 INFO:teuthology.orchestra.run.smithi042.stdout: "req_readdir_latency": { 2024-09-21T01:05:41.805 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.805 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.805 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.805 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.805 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rename_latency": { 2024-09-21T01:05:41.805 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.805 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.805 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.805 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.805 INFO:teuthology.orchestra.run.smithi042.stdout: "req_renamesnap_latency": { 2024-09-21T01:05:41.806 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.806 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.806 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.806 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.806 INFO:teuthology.orchestra.run.smithi042.stdout: "req_snapdiff_latency": { 2024-09-21T01:05:41.806 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.806 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.806 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.806 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.806 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmdir_latency": { 2024-09-21T01:05:41.806 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.806 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.806 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.806 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.807 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmsnap_latency": { 2024-09-21T01:05:41.807 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.807 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.807 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.807 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.807 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmxattr_latency": { 2024-09-21T01:05:41.807 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.807 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.807 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.807 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.807 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setattr_latency": { 2024-09-21T01:05:41.807 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.807 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.807 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.808 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.808 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setdirlayout_latency": { 2024-09-21T01:05:41.808 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.808 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.808 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.808 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.808 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setfilelock_latency": { 2024-09-21T01:05:41.808 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.808 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.808 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.808 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.808 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setlayout_latency": { 2024-09-21T01:05:41.808 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.808 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.808 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.809 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.809 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setxattr_latency": { 2024-09-21T01:05:41.809 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.809 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.809 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.809 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.809 INFO:teuthology.orchestra.run.smithi042.stdout: "req_symlink_latency": { 2024-09-21T01:05:41.809 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.809 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.809 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.809 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.809 INFO:teuthology.orchestra.run.smithi042.stdout: "req_unlink_latency": { 2024-09-21T01:05:41.809 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.809 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.810 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.810 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.810 INFO:teuthology.orchestra.run.smithi042.stdout: "cap_revoke_eviction": 0, 2024-09-21T01:05:41.810 INFO:teuthology.orchestra.run.smithi042.stdout: "cap_acquisition_throttle": 0, 2024-09-21T01:05:41.810 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getvxattr_latency": { 2024-09-21T01:05:41.810 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.810 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.810 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.810 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-21T01:05:41.810 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.810 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_sessions": { 2024-09-21T01:05:41.810 INFO:teuthology.orchestra.run.smithi042.stdout: "session_count": 1, 2024-09-21T01:05:41.810 INFO:teuthology.orchestra.run.smithi042.stdout: "session_add": 3, 2024-09-21T01:05:41.810 INFO:teuthology.orchestra.run.smithi042.stdout: "session_remove": 2, 2024-09-21T01:05:41.810 INFO:teuthology.orchestra.run.smithi042.stdout: "sessions_open": 2, 2024-09-21T01:05:41.811 INFO:teuthology.orchestra.run.smithi042.stdout: "sessions_stale": 0, 2024-09-21T01:05:41.811 INFO:teuthology.orchestra.run.smithi042.stdout: "total_load": 0, 2024-09-21T01:05:41.811 INFO:teuthology.orchestra.run.smithi042.stdout: "average_load": 0, 2024-09-21T01:05:41.811 INFO:teuthology.orchestra.run.smithi042.stdout: "avg_session_uptime": 3126, 2024-09-21T01:05:41.811 INFO:teuthology.orchestra.run.smithi042.stdout: "mdthresh_evicted": 0 2024-09-21T01:05:41.811 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.811 INFO:teuthology.orchestra.run.smithi042.stdout: "mempool": { 2024-09-21T01:05:41.811 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:05:41.811 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_items": 0, 2024-09-21T01:05:41.811 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:05:41.811 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:05:41.811 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:05:41.811 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:05:41.811 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:05:41.812 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:05:41.812 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:05:41.812 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:05:41.812 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:05:41.812 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:05:41.812 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:05:41.812 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:05:41.812 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:05:41.812 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_items": 0, 2024-09-21T01:05:41.812 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:05:41.812 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_items": 0, 2024-09-21T01:05:41.812 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:05:41.812 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:05:41.812 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:05:41.813 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:05:41.813 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:05:41.813 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:05:41.813 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:05:41.813 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_items": 0, 2024-09-21T01:05:41.813 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:05:41.813 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:05:41.813 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:05:41.813 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_items": 0, 2024-09-21T01:05:41.813 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_bytes": 0, 2024-09-21T01:05:41.813 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_items": 0, 2024-09-21T01:05:41.813 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:05:41.813 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:05:41.813 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:05:41.813 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:05:41.814 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_bytes": 215208, 2024-09-21T01:05:41.814 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_items": 67, 2024-09-21T01:05:41.814 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:05:41.814 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_items": 0, 2024-09-21T01:05:41.814 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_bytes": 0, 2024-09-21T01:05:41.814 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_items": 0, 2024-09-21T01:05:41.814 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:05:41.814 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_items": 0, 2024-09-21T01:05:41.814 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:05:41.814 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_items": 0, 2024-09-21T01:05:41.814 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_bytes": 7688, 2024-09-21T01:05:41.814 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_items": 158, 2024-09-21T01:05:41.814 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:05:41.814 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:05:41.814 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_bytes": 0, 2024-09-21T01:05:41.815 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_items": 0, 2024-09-21T01:05:41.815 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_bytes": 2079074, 2024-09-21T01:05:41.815 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_items": 12133, 2024-09-21T01:05:41.815 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_bytes": 0, 2024-09-21T01:05:41.815 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_items": 0, 2024-09-21T01:05:41.815 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_bytes": 0, 2024-09-21T01:05:41.815 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_items": 0 2024-09-21T01:05:41.815 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.815 INFO:teuthology.orchestra.run.smithi042.stdout: "objecter": { 2024-09-21T01:05:41.815 INFO:teuthology.orchestra.run.smithi042.stdout: "op_active": 0, 2024-09-21T01:05:41.815 INFO:teuthology.orchestra.run.smithi042.stdout: "op_laggy": 0, 2024-09-21T01:05:41.815 INFO:teuthology.orchestra.run.smithi042.stdout: "op_send": 2134, 2024-09-21T01:05:41.815 INFO:teuthology.orchestra.run.smithi042.stdout: "op_send_bytes": 26, 2024-09-21T01:05:41.815 INFO:teuthology.orchestra.run.smithi042.stdout: "op_resend": 4, 2024-09-21T01:05:41.816 INFO:teuthology.orchestra.run.smithi042.stdout: "op_reply": 2134, 2024-09-21T01:05:41.816 INFO:teuthology.orchestra.run.smithi042.stdout: "op_latency": { 2024-09-21T01:05:41.816 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 2134, 2024-09-21T01:05:41.816 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 7.032946985, 2024-09-21T01:05:41.816 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.003295664 2024-09-21T01:05:41.816 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.816 INFO:teuthology.orchestra.run.smithi042.stdout: "op_inflight": 0, 2024-09-21T01:05:41.816 INFO:teuthology.orchestra.run.smithi042.stdout: "oplen_avg": { 2024-09-21T01:05:41.816 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 2134, 2024-09-21T01:05:41.816 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 2135 2024-09-21T01:05:41.816 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.816 INFO:teuthology.orchestra.run.smithi042.stdout: "op": 2134, 2024-09-21T01:05:41.816 INFO:teuthology.orchestra.run.smithi042.stdout: "op_r": 2134, 2024-09-21T01:05:41.816 INFO:teuthology.orchestra.run.smithi042.stdout: "op_w": 0, 2024-09-21T01:05:41.816 INFO:teuthology.orchestra.run.smithi042.stdout: "op_rmw": 0, 2024-09-21T01:05:41.817 INFO:teuthology.orchestra.run.smithi042.stdout: "op_pg": 0, 2024-09-21T01:05:41.817 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_stat": 1243, 2024-09-21T01:05:41.817 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_create": 0, 2024-09-21T01:05:41.817 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_read": 888, 2024-09-21T01:05:41.817 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_write": 0, 2024-09-21T01:05:41.817 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_writefull": 0, 2024-09-21T01:05:41.817 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_writesame": 0, 2024-09-21T01:05:41.817 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_append": 0, 2024-09-21T01:05:41.817 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_zero": 0, 2024-09-21T01:05:41.817 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_truncate": 0, 2024-09-21T01:05:41.817 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_delete": 0, 2024-09-21T01:05:41.817 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_mapext": 0, 2024-09-21T01:05:41.817 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_sparse_read": 0, 2024-09-21T01:05:41.817 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_clonerange": 0, 2024-09-21T01:05:41.817 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_getxattr": 2, 2024-09-21T01:05:41.818 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_setxattr": 0, 2024-09-21T01:05:41.818 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_cmpxattr": 0, 2024-09-21T01:05:41.818 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_rmxattr": 0, 2024-09-21T01:05:41.818 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_resetxattrs": 0, 2024-09-21T01:05:41.818 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_call": 0, 2024-09-21T01:05:41.818 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_watch": 0, 2024-09-21T01:05:41.818 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_notify": 0, 2024-09-21T01:05:41.818 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T01:05:41.818 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_pgls": 0, 2024-09-21T01:05:41.818 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_pgls_filter": 0, 2024-09-21T01:05:41.818 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_other": 0, 2024-09-21T01:05:41.818 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_active": 0, 2024-09-21T01:05:41.818 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_send": 0, 2024-09-21T01:05:41.818 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_resend": 0, 2024-09-21T01:05:41.818 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_ping": 0, 2024-09-21T01:05:41.819 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_active": 0, 2024-09-21T01:05:41.819 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_send": 0, 2024-09-21T01:05:41.819 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_resend": 0, 2024-09-21T01:05:41.819 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_active": 0, 2024-09-21T01:05:41.819 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_send": 0, 2024-09-21T01:05:41.819 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_resend": 0, 2024-09-21T01:05:41.819 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_active": 0, 2024-09-21T01:05:41.819 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_send": 0, 2024-09-21T01:05:41.819 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_resend": 0, 2024-09-21T01:05:41.819 INFO:teuthology.orchestra.run.smithi042.stdout: "command_active": 0, 2024-09-21T01:05:41.819 INFO:teuthology.orchestra.run.smithi042.stdout: "command_send": 0, 2024-09-21T01:05:41.819 INFO:teuthology.orchestra.run.smithi042.stdout: "command_resend": 0, 2024-09-21T01:05:41.819 INFO:teuthology.orchestra.run.smithi042.stdout: "map_epoch": 75, 2024-09-21T01:05:41.819 INFO:teuthology.orchestra.run.smithi042.stdout: "map_full": 0, 2024-09-21T01:05:41.819 INFO:teuthology.orchestra.run.smithi042.stdout: "map_inc": 2, 2024-09-21T01:05:41.820 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_sessions": 8, 2024-09-21T01:05:41.820 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_session_open": 8, 2024-09-21T01:05:41.820 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_session_close": 0, 2024-09-21T01:05:41.820 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_laggy": 0, 2024-09-21T01:05:41.820 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_wr": 0, 2024-09-21T01:05:41.820 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_rd": 2, 2024-09-21T01:05:41.820 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_del": 0 2024-09-21T01:05:41.820 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.820 INFO:teuthology.orchestra.run.smithi042.stdout: "oft": { 2024-09-21T01:05:41.820 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_objs": 0, 2024-09-21T01:05:41.820 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_kv_pairs": 0, 2024-09-21T01:05:41.820 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_updates": 0, 2024-09-21T01:05:41.820 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_removes": 0 2024-09-21T01:05:41.820 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.820 INFO:teuthology.orchestra.run.smithi042.stdout: "purge_queue": { 2024-09-21T01:05:41.821 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_ops": 0, 2024-09-21T01:05:41.821 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T01:05:41.821 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing": 0, 2024-09-21T01:05:41.821 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_high_water": 0, 2024-09-21T01:05:41.821 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executed_ops": 0, 2024-09-21T01:05:41.821 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executed": 0, 2024-09-21T01:05:41.821 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_item_in_journal": 0 2024-09-21T01:05:41.821 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.821 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:05:41.821 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-21T01:05:41.821 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 104857600, 2024-09-21T01:05:41.821 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-21T01:05:41.821 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 2348, 2024-09-21T01:05:41.821 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 37019446, 2024-09-21T01:05:41.821 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:41.821 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 2348, 2024-09-21T01:05:41.822 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-09-21T01:05:41.822 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-09-21T01:05:41.822 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 2348, 2024-09-21T01:05:41.822 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 37019446, 2024-09-21T01:05:41.822 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-21T01:05:41.822 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.822 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.822 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.822 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-21T01:05:41.822 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.822 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-objecter_bytes": { 2024-09-21T01:05:41.822 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-21T01:05:41.822 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 104857600, 2024-09-21T01:05:41.822 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-21T01:05:41.823 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2024-09-21T01:05:41.823 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2024-09-21T01:05:41.823 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:41.823 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2024-09-21T01:05:41.823 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 2134, 2024-09-21T01:05:41.823 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 35688392, 2024-09-21T01:05:41.823 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 2134, 2024-09-21T01:05:41.823 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 35688392, 2024-09-21T01:05:41.824 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-21T01:05:41.824 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.824 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.824 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.824 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-21T01:05:41.824 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.824 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-objecter_ops": { 2024-09-21T01:05:41.824 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-21T01:05:41.824 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 1024, 2024-09-21T01:05:41.824 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-21T01:05:41.824 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2024-09-21T01:05:41.824 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2024-09-21T01:05:41.824 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:41.824 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2024-09-21T01:05:41.824 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 2134, 2024-09-21T01:05:41.825 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 2134, 2024-09-21T01:05:41.825 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 2134, 2024-09-21T01:05:41.825 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 2134, 2024-09-21T01:05:41.825 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-21T01:05:41.825 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.825 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.825 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.825 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-21T01:05:41.825 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.825 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-write_buf_throttle": { 2024-09-21T01:05:41.825 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-21T01:05:41.825 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 3758096384, 2024-09-21T01:05:41.825 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-21T01:05:41.825 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2024-09-21T01:05:41.825 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2024-09-21T01:05:41.826 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:41.826 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2024-09-21T01:05:41.826 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-09-21T01:05:41.826 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-09-21T01:05:41.826 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 0, 2024-09-21T01:05:41.826 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 0, 2024-09-21T01:05:41.826 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-21T01:05:41.826 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.826 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.826 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.826 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-21T01:05:41.826 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.826 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-write_buf_throttle-0x55757a6d5450": { 2024-09-21T01:05:41.826 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-21T01:05:41.826 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 3758096384, 2024-09-21T01:05:41.827 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-21T01:05:41.827 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2024-09-21T01:05:41.827 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2024-09-21T01:05:41.827 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:41.827 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2024-09-21T01:05:41.827 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-09-21T01:05:41.827 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-09-21T01:05:41.827 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 0, 2024-09-21T01:05:41.827 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 0, 2024-09-21T01:05:41.827 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-21T01:05:41.827 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:41.827 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:41.827 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:41.827 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-21T01:05:41.827 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:41.828 INFO:teuthology.orchestra.run.smithi042.stdout: "trackedop": { 2024-09-21T01:05:41.828 INFO:teuthology.orchestra.run.smithi042.stdout: "slow_ops_count": 0 2024-09-21T01:05:41.828 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-21T01:05:41.828 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-21T01:05:41.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:41 smithi001 ceph-mon[31211]: pgmap v612: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.3 KiB/s wr, 19 op/s 2024-09-21T01:05:41.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:41 smithi193 ceph-mon[34660]: pgmap v612: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.3 KiB/s wr, 19 op/s 2024-09-21T01:05:41.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:41 smithi042 ceph-mon[34481]: pgmap v612: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.3 KiB/s wr, 19 op/s 2024-09-21T01:05:42.909 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-21T01:05:42.909 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-21T01:05:42.909 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-21T01:05:42.909 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-21T01:05:42.910 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2024-09-21T01:05:42.910 DEBUG:tasks.check_counter:Getting stats from h 2024-09-21T01:05:42.910 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph daemon mds.h perf dump 2024-09-21T01:05:43.169 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:05:43.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:43 smithi001 ceph-mon[31211]: pgmap v613: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 2.2 KiB/s wr, 16 op/s 2024-09-21T01:05:43.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:43 smithi193 ceph-mon[34660]: pgmap v613: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 2.2 KiB/s wr, 16 op/s 2024-09-21T01:05:43.987 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:43 smithi042 ceph-mon[34481]: pgmap v613: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 2.2 KiB/s wr, 16 op/s 2024-09-21T01:05:43.987 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-21T01:05:43.987 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:05:43.987 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 70533, 2024-09-21T01:05:43.987 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 76297, 2024-09-21T01:05:43.987 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 20165160, 2024-09-21T01:05:43.987 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 202210151, 2024-09-21T01:05:43.987 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 10, 2024-09-21T01:05:43.987 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 4, 2024-09-21T01:05:43.988 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 6.617504129, 2024-09-21T01:05:43.988 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 3.324121551, 2024-09-21T01:05:43.988 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 1.702362018, 2024-09-21T01:05:43.988 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 1.453098408, 2024-09-21T01:05:43.988 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:05:43.988 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 76297, 2024-09-21T01:05:43.988 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 11.966476745, 2024-09-21T01:05:43.988 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000156840 2024-09-21T01:05:43.988 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:43.988 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:05:43.988 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 44181, 2024-09-21T01:05:43.988 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.007967736, 2024-09-21T01:05:43.988 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000180 2024-09-21T01:05:43.989 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:43.989 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T01:05:43.989 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T01:05:43.989 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:43.989 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:05:43.989 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 77397, 2024-09-21T01:05:43.989 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 80869, 2024-09-21T01:05:43.989 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 23867614, 2024-09-21T01:05:43.989 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 244458641, 2024-09-21T01:05:43.989 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 16, 2024-09-21T01:05:43.989 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 7, 2024-09-21T01:05:43.989 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 7.394491688, 2024-09-21T01:05:43.989 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 3.575585124, 2024-09-21T01:05:43.989 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 1.624291861, 2024-09-21T01:05:43.989 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 1.931785529, 2024-09-21T01:05:43.990 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:05:43.990 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 80868, 2024-09-21T01:05:43.990 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 15.520650819, 2024-09-21T01:05:43.990 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000191925 2024-09-21T01:05:43.990 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:43.990 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:05:43.990 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 25863, 2024-09-21T01:05:43.990 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.005364858, 2024-09-21T01:05:43.990 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000207 2024-09-21T01:05:43.990 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:43.990 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 981120, 2024-09-21T01:05:43.990 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 123952 2024-09-21T01:05:43.990 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:43.990 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:05:43.991 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 554132, 2024-09-21T01:05:43.991 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 703799, 2024-09-21T01:05:43.991 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 184046384, 2024-09-21T01:05:43.991 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 515170806, 2024-09-21T01:05:43.991 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 26, 2024-09-21T01:05:43.991 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 10, 2024-09-21T01:05:43.991 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 35.822935116, 2024-09-21T01:05:43.991 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 20.908401795, 2024-09-21T01:05:43.991 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 66.995147707, 2024-09-21T01:05:43.991 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 1.322712407, 2024-09-21T01:05:43.991 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:05:43.991 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 703796, 2024-09-21T01:05:43.991 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 32.664749771, 2024-09-21T01:05:43.991 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000046412 2024-09-21T01:05:43.992 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:43.992 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:05:43.992 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 959208, 2024-09-21T01:05:43.992 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.165529045, 2024-09-21T01:05:43.992 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000172 2024-09-21T01:05:43.992 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:43.992 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 4448, 2024-09-21T01:05:43.992 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 328272 2024-09-21T01:05:43.992 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:43.992 INFO:teuthology.orchestra.run.smithi042.stdout: "cct": { 2024-09-21T01:05:43.992 INFO:teuthology.orchestra.run.smithi042.stdout: "total_workers": 1, 2024-09-21T01:05:43.992 INFO:teuthology.orchestra.run.smithi042.stdout: "unhealthy_workers": 0 2024-09-21T01:05:43.992 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:43.992 INFO:teuthology.orchestra.run.smithi042.stdout: "finisher-MDSRank": { 2024-09-21T01:05:43.992 INFO:teuthology.orchestra.run.smithi042.stdout: "queue_len": 0, 2024-09-21T01:05:43.993 INFO:teuthology.orchestra.run.smithi042.stdout: "complete_latency": { 2024-09-21T01:05:43.993 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 36967, 2024-09-21T01:05:43.993 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 277.628912105, 2024-09-21T01:05:43.993 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.007510182 2024-09-21T01:05:43.993 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-21T01:05:43.993 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:43.993 INFO:teuthology.orchestra.run.smithi042.stdout: "finisher-PurgeQueue": { 2024-09-21T01:05:43.993 INFO:teuthology.orchestra.run.smithi042.stdout: "queue_len": 0, 2024-09-21T01:05:43.993 INFO:teuthology.orchestra.run.smithi042.stdout: "complete_latency": { 2024-09-21T01:05:43.993 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 68447, 2024-09-21T01:05:43.993 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 27.964882235, 2024-09-21T01:05:43.993 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000408562 2024-09-21T01:05:43.993 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-21T01:05:43.994 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:43.994 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": { 2024-09-21T01:05:43.994 INFO:teuthology.orchestra.run.smithi042.stdout: "request": 235397, 2024-09-21T01:05:43.994 INFO:teuthology.orchestra.run.smithi042.stdout: "reply": 231526, 2024-09-21T01:05:43.994 INFO:teuthology.orchestra.run.smithi042.stdout: "reply_latency": { 2024-09-21T01:05:43.994 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 231526, 2024-09-21T01:05:43.994 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 11527.705955102, 2024-09-21T01:05:43.994 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.049790114 2024-09-21T01:05:43.994 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:43.994 INFO:teuthology.orchestra.run.smithi042.stdout: "slow_reply": 0, 2024-09-21T01:05:43.994 INFO:teuthology.orchestra.run.smithi042.stdout: "forward": 3871, 2024-09-21T01:05:43.994 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_fetch_complete": 1, 2024-09-21T01:05:43.994 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_fetch_keys": 0, 2024-09-21T01:05:43.994 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_commit": 1847, 2024-09-21T01:05:43.995 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_split": 131, 2024-09-21T01:05:43.995 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_merge": 15, 2024-09-21T01:05:43.995 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes": 1091, 2024-09-21T01:05:43.995 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_top": 727, 2024-09-21T01:05:43.995 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_bottom": 347, 2024-09-21T01:05:43.995 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_pin_tail": 17, 2024-09-21T01:05:43.995 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_pinned": 51, 2024-09-21T01:05:43.995 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_expired": 5245, 2024-09-21T01:05:43.995 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_with_caps": 1, 2024-09-21T01:05:43.995 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": 1, 2024-09-21T01:05:43.995 INFO:teuthology.orchestra.run.smithi042.stdout: "subtrees": 6, 2024-09-21T01:05:43.995 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse": 476270, 2024-09-21T01:05:43.995 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_hit": 463075, 2024-09-21T01:05:43.995 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_forward": 3834, 2024-09-21T01:05:43.995 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_discover": 93, 2024-09-21T01:05:43.995 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_dir_fetch": 0, 2024-09-21T01:05:43.996 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_remote_ino": 0, 2024-09-21T01:05:43.996 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_lock": 343, 2024-09-21T01:05:43.996 INFO:teuthology.orchestra.run.smithi042.stdout: "load_cent": 0, 2024-09-21T01:05:43.996 INFO:teuthology.orchestra.run.smithi042.stdout: "q": 0, 2024-09-21T01:05:43.996 INFO:teuthology.orchestra.run.smithi042.stdout: "exported": 34, 2024-09-21T01:05:43.996 INFO:teuthology.orchestra.run.smithi042.stdout: "exported_inodes": 3181, 2024-09-21T01:05:43.996 INFO:teuthology.orchestra.run.smithi042.stdout: "imported": 146, 2024-09-21T01:05:43.996 INFO:teuthology.orchestra.run.smithi042.stdout: "imported_inodes": 230, 2024-09-21T01:05:43.996 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_dir_fetch": 0, 2024-09-21T01:05:43.996 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_backtrace_fetch": 78077, 2024-09-21T01:05:43.996 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_peer_discover": 0, 2024-09-21T01:05:43.996 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rfiles": 11953, 2024-09-21T01:05:43.996 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rbytes": 230111924, 2024-09-21T01:05:43.996 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rsnaps": 0, 2024-09-21T01:05:43.997 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_backtrace_fetch": 78077, 2024-09-21T01:05:43.997 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_set_tag": 0, 2024-09-21T01:05:43.997 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T01:05:43.997 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_inotable_repaired": 0, 2024-09-21T01:05:43.997 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_dir_inodes": 599, 2024-09-21T01:05:43.997 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T01:05:43.997 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_dirfrag_rstats": 599, 2024-09-21T01:05:43.997 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_file_inodes": 77478, 2024-09-21T01:05:43.997 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_inode_file_caps": 38, 2024-09-21T01:05:43.997 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_revoke": 169738, 2024-09-21T01:05:43.997 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_grant": 102605, 2024-09-21T01:05:43.997 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_trunc": 5, 2024-09-21T01:05:43.997 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T01:05:43.997 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T01:05:43.998 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_caps": 265592, 2024-09-21T01:05:43.998 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_caps_dirty": 40059, 2024-09-21T01:05:43.998 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_cap_release": 3709, 2024-09-21T01:05:43.998 INFO:teuthology.orchestra.run.smithi042.stdout: "process_request_cap_release": 79844 2024-09-21T01:05:43.998 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:43.998 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_cache": { 2024-09-21T01:05:43.998 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_update": 3394, 2024-09-21T01:05:43.998 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_update_receipt": 12, 2024-09-21T01:05:43.998 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_try_discover": 8, 2024-09-21T01:05:43.998 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_send_discover": 67, 2024-09-21T01:05:43.998 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_handle_discover": 9241, 2024-09-21T01:05:43.998 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays": 4, 2024-09-21T01:05:43.998 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays_delayed": 0, 2024-09-21T01:05:43.999 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays_enqueuing": 0, 2024-09-21T01:05:43.999 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_created": 38037, 2024-09-21T01:05:43.999 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_enqueued": 38033, 2024-09-21T01:05:43.999 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_reintegrated": 0, 2024-09-21T01:05:43.999 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_migrated": 0, 2024-09-21T01:05:43.999 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_processing": 0, 2024-09-21T01:05:43.999 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_enqueued": 0, 2024-09-21T01:05:43.999 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_prioritized": 0, 2024-09-21T01:05:43.999 INFO:teuthology.orchestra.run.smithi042.stdout: "recovery_started": 0, 2024-09-21T01:05:43.999 INFO:teuthology.orchestra.run.smithi042.stdout: "recovery_completed": 0, 2024-09-21T01:05:43.999 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_quiesce_path": 0, 2024-09-21T01:05:43.999 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_quiesce_inode": 0, 2024-09-21T01:05:43.999 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T01:05:43.999 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_exportdir": 34, 2024-09-21T01:05:44.000 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_flush": 0, 2024-09-21T01:05:44.000 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_fragmentdir": 146, 2024-09-21T01:05:44.000 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_fragstats": 0, 2024-09-21T01:05:44.000 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_inodestats": 0, 2024-09-21T01:05:44.000 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-21T01:05:44.000 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_succeeded": 0, 2024-09-21T01:05:44.000 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_write_failed": 0 2024-09-21T01:05:44.000 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.000 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_log": { 2024-09-21T01:05:44.000 INFO:teuthology.orchestra.run.smithi042.stdout: "evlrg": 0, 2024-09-21T01:05:44.000 INFO:teuthology.orchestra.run.smithi042.stdout: "evadd": 258013, 2024-09-21T01:05:44.000 INFO:teuthology.orchestra.run.smithi042.stdout: "evex": 156094, 2024-09-21T01:05:44.000 INFO:teuthology.orchestra.run.smithi042.stdout: "evtrm": 147481, 2024-09-21T01:05:44.000 INFO:teuthology.orchestra.run.smithi042.stdout: "ev": 110532, 2024-09-21T01:05:44.001 INFO:teuthology.orchestra.run.smithi042.stdout: "evexg": 0, 2024-09-21T01:05:44.001 INFO:teuthology.orchestra.run.smithi042.stdout: "evexd": 8613, 2024-09-21T01:05:44.001 INFO:teuthology.orchestra.run.smithi042.stdout: "segadd": 324, 2024-09-21T01:05:44.001 INFO:teuthology.orchestra.run.smithi042.stdout: "segex": 196, 2024-09-21T01:05:44.001 INFO:teuthology.orchestra.run.smithi042.stdout: "segtrm": 186, 2024-09-21T01:05:44.001 INFO:teuthology.orchestra.run.smithi042.stdout: "seg": 138, 2024-09-21T01:05:44.001 INFO:teuthology.orchestra.run.smithi042.stdout: "segmjr": 9, 2024-09-21T01:05:44.001 INFO:teuthology.orchestra.run.smithi042.stdout: "segexg": 0, 2024-09-21T01:05:44.001 INFO:teuthology.orchestra.run.smithi042.stdout: "segexd": 10, 2024-09-21T01:05:44.001 INFO:teuthology.orchestra.run.smithi042.stdout: "expos": 344817017, 2024-09-21T01:05:44.001 INFO:teuthology.orchestra.run.smithi042.stdout: "wrpos": 560894026, 2024-09-21T01:05:44.001 INFO:teuthology.orchestra.run.smithi042.stdout: "rdpos": 0, 2024-09-21T01:05:44.001 INFO:teuthology.orchestra.run.smithi042.stdout: "jlat": { 2024-09-21T01:05:44.001 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 21945, 2024-09-21T01:05:44.001 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 714.689114317, 2024-09-21T01:05:44.002 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.032567287 2024-09-21T01:05:44.002 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.002 INFO:teuthology.orchestra.run.smithi042.stdout: "replayed": 0 2024-09-21T01:05:44.002 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.002 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_mem": { 2024-09-21T01:05:44.002 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 45, 2024-09-21T01:05:44.002 INFO:teuthology.orchestra.run.smithi042.stdout: "ino+": 39605, 2024-09-21T01:05:44.002 INFO:teuthology.orchestra.run.smithi042.stdout: "ino-": 39560, 2024-09-21T01:05:44.002 INFO:teuthology.orchestra.run.smithi042.stdout: "dir": 54, 2024-09-21T01:05:44.002 INFO:teuthology.orchestra.run.smithi042.stdout: "dir+": 1400, 2024-09-21T01:05:44.002 INFO:teuthology.orchestra.run.smithi042.stdout: "dir-": 1346, 2024-09-21T01:05:44.002 INFO:teuthology.orchestra.run.smithi042.stdout: "dn": 1091, 2024-09-21T01:05:44.002 INFO:teuthology.orchestra.run.smithi042.stdout: "dn+": 89137, 2024-09-21T01:05:44.002 INFO:teuthology.orchestra.run.smithi042.stdout: "dn-": 88046, 2024-09-21T01:05:44.003 INFO:teuthology.orchestra.run.smithi042.stdout: "cap": 1, 2024-09-21T01:05:44.003 INFO:teuthology.orchestra.run.smithi042.stdout: "cap+": 40272, 2024-09-21T01:05:44.003 INFO:teuthology.orchestra.run.smithi042.stdout: "cap-": 40271, 2024-09-21T01:05:44.003 INFO:teuthology.orchestra.run.smithi042.stdout: "rss": 245728, 2024-09-21T01:05:44.003 INFO:teuthology.orchestra.run.smithi042.stdout: "heap": 533606400 2024-09-21T01:05:44.003 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.003 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_server": { 2024-09-21T01:05:44.003 INFO:teuthology.orchestra.run.smithi042.stdout: "dispatch_client_request": 243519, 2024-09-21T01:05:44.003 INFO:teuthology.orchestra.run.smithi042.stdout: "dispatch_server_request": 425, 2024-09-21T01:05:44.003 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_request": 235397, 2024-09-21T01:05:44.003 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_session": 44, 2024-09-21T01:05:44.003 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_peer_request": 1589, 2024-09-21T01:05:44.003 INFO:teuthology.orchestra.run.smithi042.stdout: "req_create_latency": { 2024-09-21T01:05:44.003 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 39298, 2024-09-21T01:05:44.003 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 966.469060892, 2024-09-21T01:05:44.003 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.024593339 2024-09-21T01:05:44.004 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.004 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getattr_latency": { 2024-09-21T01:05:44.004 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 93779, 2024-09-21T01:05:44.004 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 8207.697110468, 2024-09-21T01:05:44.004 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.087521695 2024-09-21T01:05:44.004 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.004 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getfilelock_latency": { 2024-09-21T01:05:44.004 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:44.004 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:44.004 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:44.004 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.004 INFO:teuthology.orchestra.run.smithi042.stdout: "req_link_latency": { 2024-09-21T01:05:44.004 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:44.004 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:44.005 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:44.005 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.005 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookup_latency": { 2024-09-21T01:05:44.005 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 29226, 2024-09-21T01:05:44.005 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 732.462801682, 2024-09-21T01:05:44.005 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.025062027 2024-09-21T01:05:44.005 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.005 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookuphash_latency": { 2024-09-21T01:05:44.005 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:44.005 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:44.005 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:44.005 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.005 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupino_latency": { 2024-09-21T01:05:44.005 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1, 2024-09-21T01:05:44.005 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000167779, 2024-09-21T01:05:44.006 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000167779 2024-09-21T01:05:44.006 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.006 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupname_latency": { 2024-09-21T01:05:44.006 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:44.006 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:44.006 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:44.006 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.006 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupparent_latency": { 2024-09-21T01:05:44.006 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:44.007 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:44.007 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:44.007 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.007 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupsnap_latency": { 2024-09-21T01:05:44.007 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:44.007 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:44.007 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:44.007 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.007 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lssnap_latency": { 2024-09-21T01:05:44.007 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:44.007 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:44.007 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:44.008 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.008 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mkdir_latency": { 2024-09-21T01:05:44.008 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 156, 2024-09-21T01:05:44.008 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 6.386741547, 2024-09-21T01:05:44.008 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.040940650 2024-09-21T01:05:44.008 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.008 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mknod_latency": { 2024-09-21T01:05:44.008 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:44.008 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:44.009 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:44.009 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.009 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mksnap_latency": { 2024-09-21T01:05:44.009 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:44.009 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:44.009 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:44.009 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.009 INFO:teuthology.orchestra.run.smithi042.stdout: "req_open_latency": { 2024-09-21T01:05:44.009 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 6399, 2024-09-21T01:05:44.009 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 120.919935360, 2024-09-21T01:05:44.009 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.018896692 2024-09-21T01:05:44.009 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.009 INFO:teuthology.orchestra.run.smithi042.stdout: "req_readdir_latency": { 2024-09-21T01:05:44.009 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1002, 2024-09-21T01:05:44.010 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 2.307164619, 2024-09-21T01:05:44.010 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.002302559 2024-09-21T01:05:44.010 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.010 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rename_latency": { 2024-09-21T01:05:44.010 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 39152, 2024-09-21T01:05:44.010 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 1437.744847890, 2024-09-21T01:05:44.010 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.036722130 2024-09-21T01:05:44.010 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.010 INFO:teuthology.orchestra.run.smithi042.stdout: "req_renamesnap_latency": { 2024-09-21T01:05:44.010 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:44.010 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:44.010 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:44.010 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.010 INFO:teuthology.orchestra.run.smithi042.stdout: "req_snapdiff_latency": { 2024-09-21T01:05:44.011 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:44.011 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:44.011 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:44.011 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.011 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmdir_latency": { 2024-09-21T01:05:44.011 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 160, 2024-09-21T01:05:44.011 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 19.228833051, 2024-09-21T01:05:44.011 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.120180206 2024-09-21T01:05:44.011 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.011 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmsnap_latency": { 2024-09-21T01:05:44.011 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:44.011 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:44.011 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:44.011 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.012 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmxattr_latency": { 2024-09-21T01:05:44.012 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:44.012 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:44.012 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:44.012 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.012 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setattr_latency": { 2024-09-21T01:05:44.012 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 5, 2024-09-21T01:05:44.013 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.029233282, 2024-09-21T01:05:44.013 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.005846656 2024-09-21T01:05:44.013 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.013 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setdirlayout_latency": { 2024-09-21T01:05:44.014 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:44.014 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:44.014 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:44.014 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.014 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setfilelock_latency": { 2024-09-21T01:05:44.014 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:44.014 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:44.014 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:44.014 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.014 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setlayout_latency": { 2024-09-21T01:05:44.014 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:44.014 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:44.015 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:44.015 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.016 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setxattr_latency": { 2024-09-21T01:05:44.016 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:44.016 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:44.016 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:44.016 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.016 INFO:teuthology.orchestra.run.smithi042.stdout: "req_symlink_latency": { 2024-09-21T01:05:44.016 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 2, 2024-09-21T01:05:44.016 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.001297115, 2024-09-21T01:05:44.016 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000648557 2024-09-21T01:05:44.016 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.016 INFO:teuthology.orchestra.run.smithi042.stdout: "req_unlink_latency": { 2024-09-21T01:05:44.016 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 22346, 2024-09-21T01:05:44.016 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 34.458761417, 2024-09-21T01:05:44.017 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.001542055 2024-09-21T01:05:44.017 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.017 INFO:teuthology.orchestra.run.smithi042.stdout: "cap_revoke_eviction": 0, 2024-09-21T01:05:44.017 INFO:teuthology.orchestra.run.smithi042.stdout: "cap_acquisition_throttle": 0, 2024-09-21T01:05:44.017 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getvxattr_latency": { 2024-09-21T01:05:44.017 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:44.017 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:44.017 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:44.017 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-21T01:05:44.017 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.017 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_sessions": { 2024-09-21T01:05:44.017 INFO:teuthology.orchestra.run.smithi042.stdout: "session_count": 1, 2024-09-21T01:05:44.017 INFO:teuthology.orchestra.run.smithi042.stdout: "session_add": 2, 2024-09-21T01:05:44.017 INFO:teuthology.orchestra.run.smithi042.stdout: "session_remove": 1, 2024-09-21T01:05:44.017 INFO:teuthology.orchestra.run.smithi042.stdout: "sessions_open": 1, 2024-09-21T01:05:44.018 INFO:teuthology.orchestra.run.smithi042.stdout: "sessions_stale": 0, 2024-09-21T01:05:44.018 INFO:teuthology.orchestra.run.smithi042.stdout: "total_load": 42087, 2024-09-21T01:05:44.018 INFO:teuthology.orchestra.run.smithi042.stdout: "average_load": 42087, 2024-09-21T01:05:44.018 INFO:teuthology.orchestra.run.smithi042.stdout: "avg_session_uptime": 520, 2024-09-21T01:05:44.018 INFO:teuthology.orchestra.run.smithi042.stdout: "mdthresh_evicted": 0 2024-09-21T01:05:44.018 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.018 INFO:teuthology.orchestra.run.smithi042.stdout: "mempool": { 2024-09-21T01:05:44.018 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:05:44.018 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_items": 0, 2024-09-21T01:05:44.018 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:05:44.018 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:05:44.018 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:05:44.018 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:05:44.018 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:05:44.018 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:05:44.019 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:05:44.019 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:05:44.019 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:05:44.019 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:05:44.019 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:05:44.019 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:05:44.019 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:05:44.019 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_items": 0, 2024-09-21T01:05:44.019 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:05:44.019 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_items": 0, 2024-09-21T01:05:44.019 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:05:44.019 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:05:44.019 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:05:44.019 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:05:44.019 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:05:44.019 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:05:44.020 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:05:44.020 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_items": 0, 2024-09-21T01:05:44.020 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:05:44.020 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:05:44.020 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:05:44.020 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_items": 0, 2024-09-21T01:05:44.020 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_bytes": 0, 2024-09-21T01:05:44.020 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_items": 0, 2024-09-21T01:05:44.020 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:05:44.020 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:05:44.020 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:05:44.020 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:05:44.020 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_bytes": 304653, 2024-09-21T01:05:44.020 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_items": 116, 2024-09-21T01:05:44.020 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:05:44.020 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_items": 0, 2024-09-21T01:05:44.021 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_bytes": 0, 2024-09-21T01:05:44.021 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_items": 0, 2024-09-21T01:05:44.021 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:05:44.021 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_items": 0, 2024-09-21T01:05:44.021 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:05:44.021 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_items": 0, 2024-09-21T01:05:44.021 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_bytes": 7688, 2024-09-21T01:05:44.021 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_items": 158, 2024-09-21T01:05:44.021 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:05:44.021 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:05:44.021 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_bytes": 0, 2024-09-21T01:05:44.021 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_items": 0, 2024-09-21T01:05:44.021 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_bytes": 981899, 2024-09-21T01:05:44.021 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_items": 12878, 2024-09-21T01:05:44.021 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_bytes": 0, 2024-09-21T01:05:44.022 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_items": 0, 2024-09-21T01:05:44.022 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_bytes": 0, 2024-09-21T01:05:44.022 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_items": 0 2024-09-21T01:05:44.022 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.022 INFO:teuthology.orchestra.run.smithi042.stdout: "objecter": { 2024-09-21T01:05:44.022 INFO:teuthology.orchestra.run.smithi042.stdout: "op_active": 0, 2024-09-21T01:05:44.022 INFO:teuthology.orchestra.run.smithi042.stdout: "op_laggy": 0, 2024-09-21T01:05:44.022 INFO:teuthology.orchestra.run.smithi042.stdout: "op_send": 157243, 2024-09-21T01:05:44.022 INFO:teuthology.orchestra.run.smithi042.stdout: "op_send_bytes": 603213328, 2024-09-21T01:05:44.022 INFO:teuthology.orchestra.run.smithi042.stdout: "op_resend": 28, 2024-09-21T01:05:44.022 INFO:teuthology.orchestra.run.smithi042.stdout: "op_reply": 157243, 2024-09-21T01:05:44.022 INFO:teuthology.orchestra.run.smithi042.stdout: "op_latency": { 2024-09-21T01:05:44.022 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 157243, 2024-09-21T01:05:44.022 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 1135.828519832, 2024-09-21T01:05:44.023 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.007223396 2024-09-21T01:05:44.023 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.023 INFO:teuthology.orchestra.run.smithi042.stdout: "op_inflight": 0, 2024-09-21T01:05:44.023 INFO:teuthology.orchestra.run.smithi042.stdout: "oplen_avg": { 2024-09-21T01:05:44.023 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 157243, 2024-09-21T01:05:44.023 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 187715 2024-09-21T01:05:44.023 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.023 INFO:teuthology.orchestra.run.smithi042.stdout: "op": 157243, 2024-09-21T01:05:44.023 INFO:teuthology.orchestra.run.smithi042.stdout: "op_r": 78916, 2024-09-21T01:05:44.023 INFO:teuthology.orchestra.run.smithi042.stdout: "op_w": 78327, 2024-09-21T01:05:44.023 INFO:teuthology.orchestra.run.smithi042.stdout: "op_rmw": 0, 2024-09-21T01:05:44.023 INFO:teuthology.orchestra.run.smithi042.stdout: "op_pg": 0, 2024-09-21T01:05:44.023 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_stat": 642, 2024-09-21T01:05:44.023 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_create": 13229, 2024-09-21T01:05:44.024 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_read": 838, 2024-09-21T01:05:44.024 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_write": 22783, 2024-09-21T01:05:44.024 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_writefull": 424, 2024-09-21T01:05:44.024 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_writesame": 0, 2024-09-21T01:05:44.024 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_append": 0, 2024-09-21T01:05:44.024 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_zero": 0, 2024-09-21T01:05:44.024 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_truncate": 131, 2024-09-21T01:05:44.024 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_delete": 39427, 2024-09-21T01:05:44.024 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_mapext": 0, 2024-09-21T01:05:44.024 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_sparse_read": 0, 2024-09-21T01:05:44.024 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_clonerange": 0, 2024-09-21T01:05:44.025 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_getxattr": 78078, 2024-09-21T01:05:44.025 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_setxattr": 26458, 2024-09-21T01:05:44.025 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_cmpxattr": 0, 2024-09-21T01:05:44.025 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_rmxattr": 0, 2024-09-21T01:05:44.025 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_resetxattrs": 0, 2024-09-21T01:05:44.025 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_call": 0, 2024-09-21T01:05:44.025 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_watch": 0, 2024-09-21T01:05:44.025 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_notify": 0, 2024-09-21T01:05:44.025 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T01:05:44.025 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_pgls": 0, 2024-09-21T01:05:44.025 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_pgls_filter": 0, 2024-09-21T01:05:44.025 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_other": 5, 2024-09-21T01:05:44.025 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_active": 0, 2024-09-21T01:05:44.025 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_send": 0, 2024-09-21T01:05:44.025 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_resend": 0, 2024-09-21T01:05:44.026 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_ping": 0, 2024-09-21T01:05:44.026 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_active": 0, 2024-09-21T01:05:44.026 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_send": 0, 2024-09-21T01:05:44.026 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_resend": 0, 2024-09-21T01:05:44.026 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_active": 0, 2024-09-21T01:05:44.026 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_send": 0, 2024-09-21T01:05:44.026 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_resend": 0, 2024-09-21T01:05:44.026 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_active": 0, 2024-09-21T01:05:44.026 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_send": 0, 2024-09-21T01:05:44.026 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_resend": 0, 2024-09-21T01:05:44.026 INFO:teuthology.orchestra.run.smithi042.stdout: "command_active": 0, 2024-09-21T01:05:44.026 INFO:teuthology.orchestra.run.smithi042.stdout: "command_send": 0, 2024-09-21T01:05:44.026 INFO:teuthology.orchestra.run.smithi042.stdout: "command_resend": 0, 2024-09-21T01:05:44.026 INFO:teuthology.orchestra.run.smithi042.stdout: "map_epoch": 75, 2024-09-21T01:05:44.027 INFO:teuthology.orchestra.run.smithi042.stdout: "map_full": 0, 2024-09-21T01:05:44.027 INFO:teuthology.orchestra.run.smithi042.stdout: "map_inc": 2, 2024-09-21T01:05:44.027 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_sessions": 12, 2024-09-21T01:05:44.027 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_session_open": 12, 2024-09-21T01:05:44.027 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_session_close": 0, 2024-09-21T01:05:44.027 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_laggy": 0, 2024-09-21T01:05:44.027 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_wr": 4554, 2024-09-21T01:05:44.027 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_rd": 2, 2024-09-21T01:05:44.027 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_del": 1144 2024-09-21T01:05:44.027 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.027 INFO:teuthology.orchestra.run.smithi042.stdout: "oft": { 2024-09-21T01:05:44.027 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_objs": 1, 2024-09-21T01:05:44.027 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_kv_pairs": 0, 2024-09-21T01:05:44.028 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_updates": 0, 2024-09-21T01:05:44.028 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_removes": 0 2024-09-21T01:05:44.028 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.028 INFO:teuthology.orchestra.run.smithi042.stdout: "purge_queue": { 2024-09-21T01:05:44.028 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_ops": 0, 2024-09-21T01:05:44.028 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_ops_high_water": 14, 2024-09-21T01:05:44.028 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing": 0, 2024-09-21T01:05:44.028 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_high_water": 6, 2024-09-21T01:05:44.028 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executed_ops": 39113, 2024-09-21T01:05:44.028 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executed": 38033, 2024-09-21T01:05:44.028 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_item_in_journal": 0 2024-09-21T01:05:44.028 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.028 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:05:44.028 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-21T01:05:44.028 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 104857600, 2024-09-21T01:05:44.029 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-21T01:05:44.029 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 702059, 2024-09-21T01:05:44.029 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 164877977, 2024-09-21T01:05:44.029 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:44.029 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 702059, 2024-09-21T01:05:44.029 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-09-21T01:05:44.029 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-09-21T01:05:44.029 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 702059, 2024-09-21T01:05:44.029 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 164877977, 2024-09-21T01:05:44.029 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-21T01:05:44.029 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:44.029 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:44.029 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:44.029 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-21T01:05:44.030 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.030 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-objecter_bytes": { 2024-09-21T01:05:44.030 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-21T01:05:44.030 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 104857600, 2024-09-21T01:05:44.030 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-21T01:05:44.030 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2024-09-21T01:05:44.030 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2024-09-21T01:05:44.030 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:44.030 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2024-09-21T01:05:44.030 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 157243, 2024-09-21T01:05:44.030 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 607055725, 2024-09-21T01:05:44.030 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 157243, 2024-09-21T01:05:44.030 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 607055725, 2024-09-21T01:05:44.030 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-21T01:05:44.030 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:44.031 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:44.031 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:44.031 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-21T01:05:44.031 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.031 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-objecter_ops": { 2024-09-21T01:05:44.031 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-21T01:05:44.031 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 1024, 2024-09-21T01:05:44.031 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-21T01:05:44.031 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2024-09-21T01:05:44.031 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2024-09-21T01:05:44.031 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:44.031 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2024-09-21T01:05:44.031 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 157243, 2024-09-21T01:05:44.031 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 157243, 2024-09-21T01:05:44.031 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 157243, 2024-09-21T01:05:44.032 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 157243, 2024-09-21T01:05:44.032 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-21T01:05:44.032 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:44.032 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:44.032 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:44.032 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-21T01:05:44.032 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.032 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-write_buf_throttle": { 2024-09-21T01:05:44.032 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-21T01:05:44.032 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 3758096384, 2024-09-21T01:05:44.032 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-21T01:05:44.032 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 38033, 2024-09-21T01:05:44.032 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 3842413, 2024-09-21T01:05:44.032 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:44.032 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 38033, 2024-09-21T01:05:44.033 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-09-21T01:05:44.033 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-09-21T01:05:44.033 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 838, 2024-09-21T01:05:44.033 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 3842413, 2024-09-21T01:05:44.033 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-21T01:05:44.033 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:44.033 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:44.033 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:44.033 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-21T01:05:44.033 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.033 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-write_buf_throttle-0x55ca6a799450": { 2024-09-21T01:05:44.033 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-21T01:05:44.033 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 3758096384, 2024-09-21T01:05:44.033 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-21T01:05:44.033 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 258013, 2024-09-21T01:05:44.034 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 556699722, 2024-09-21T01:05:44.034 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:44.034 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 258013, 2024-09-21T01:05:44.034 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-09-21T01:05:44.034 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-09-21T01:05:44.034 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 21945, 2024-09-21T01:05:44.034 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 556699722, 2024-09-21T01:05:44.034 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-21T01:05:44.034 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:44.034 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:44.035 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:44.035 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-21T01:05:44.035 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:44.035 INFO:teuthology.orchestra.run.smithi042.stdout: "trackedop": { 2024-09-21T01:05:44.035 INFO:teuthology.orchestra.run.smithi042.stdout: "slow_ops_count": 17488 2024-09-21T01:05:44.035 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-21T01:05:44.035 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-21T01:05:44.927 INFO:tasks.check_counter:Daemon mds.h mds.exported=34 2024-09-21T01:05:44.927 INFO:tasks.check_counter:Daemon mds.h mds.imported=146 2024-09-21T01:05:44.927 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=3394 2024-09-21T01:05:44.927 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=12 2024-09-21T01:05:44.927 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=131 2024-09-21T01:05:44.927 DEBUG:tasks.check_counter:Getting stats from k 2024-09-21T01:05:44.928 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph daemon mds.k perf dump 2024-09-21T01:05:45.182 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:05:45.747 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-21T01:05:45.747 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:05:45.747 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 1743, 2024-09-21T01:05:45.747 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 1745, 2024-09-21T01:05:45.747 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 12139239, 2024-09-21T01:05:45.747 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 554281, 2024-09-21T01:05:45.747 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 6, 2024-09-21T01:05:45.747 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 2, 2024-09-21T01:05:45.747 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.162774112, 2024-09-21T01:05:45.747 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.066166851, 2024-09-21T01:05:45.747 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.042936869, 2024-09-21T01:05:45.747 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.043880788, 2024-09-21T01:05:45.747 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:05:45.748 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1743, 2024-09-21T01:05:45.748 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.049351078, 2024-09-21T01:05:45.748 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000028313 2024-09-21T01:05:45.748 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.748 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:05:45.748 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.748 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.748 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.748 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.748 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T01:05:45.748 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T01:05:45.748 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.748 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:05:45.748 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 162, 2024-09-21T01:05:45.748 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 300, 2024-09-21T01:05:45.748 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 41886, 2024-09-21T01:05:45.749 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 376116, 2024-09-21T01:05:45.749 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 5, 2024-09-21T01:05:45.749 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 4, 2024-09-21T01:05:45.749 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.027370072, 2024-09-21T01:05:45.749 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.013385175, 2024-09-21T01:05:45.749 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.006986932, 2024-09-21T01:05:45.749 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.004880502, 2024-09-21T01:05:45.749 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:05:45.749 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 299, 2024-09-21T01:05:45.749 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.014824565, 2024-09-21T01:05:45.749 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000049580 2024-09-21T01:05:45.749 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.749 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:05:45.749 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.749 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.750 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.750 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.750 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-09-21T01:05:45.750 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 326128 2024-09-21T01:05:45.750 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.750 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:05:45.750 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 215, 2024-09-21T01:05:45.750 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 193, 2024-09-21T01:05:45.750 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 960172, 2024-09-21T01:05:45.750 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 114990, 2024-09-21T01:05:45.750 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 3, 2024-09-21T01:05:45.750 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 2, 2024-09-21T01:05:45.750 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.034454981, 2024-09-21T01:05:45.750 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.014115421, 2024-09-21T01:05:45.750 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.030213127, 2024-09-21T01:05:45.750 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.000034082, 2024-09-21T01:05:45.751 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:05:45.751 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 192, 2024-09-21T01:05:45.751 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.011301594, 2024-09-21T01:05:45.751 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000058862 2024-09-21T01:05:45.751 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.751 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:05:45.751 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.751 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.751 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.751 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.751 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 959904, 2024-09-21T01:05:45.751 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 114672 2024-09-21T01:05:45.751 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.751 INFO:teuthology.orchestra.run.smithi042.stdout: "cct": { 2024-09-21T01:05:45.751 INFO:teuthology.orchestra.run.smithi042.stdout: "total_workers": 1, 2024-09-21T01:05:45.751 INFO:teuthology.orchestra.run.smithi042.stdout: "unhealthy_workers": 0 2024-09-21T01:05:45.752 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.752 INFO:teuthology.orchestra.run.smithi042.stdout: "finisher-MDSRank": { 2024-09-21T01:05:45.752 INFO:teuthology.orchestra.run.smithi042.stdout: "queue_len": 0, 2024-09-21T01:05:45.752 INFO:teuthology.orchestra.run.smithi042.stdout: "complete_latency": { 2024-09-21T01:05:45.752 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 3258, 2024-09-21T01:05:45.752 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.078897791, 2024-09-21T01:05:45.752 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000024216 2024-09-21T01:05:45.752 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-21T01:05:45.752 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.752 INFO:teuthology.orchestra.run.smithi042.stdout: "finisher-PurgeQueue": { 2024-09-21T01:05:45.752 INFO:teuthology.orchestra.run.smithi042.stdout: "queue_len": 0, 2024-09-21T01:05:45.752 INFO:teuthology.orchestra.run.smithi042.stdout: "complete_latency": { 2024-09-21T01:05:45.752 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.752 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.752 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.753 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-21T01:05:45.753 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.753 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": { 2024-09-21T01:05:45.753 INFO:teuthology.orchestra.run.smithi042.stdout: "request": 0, 2024-09-21T01:05:45.753 INFO:teuthology.orchestra.run.smithi042.stdout: "reply": 0, 2024-09-21T01:05:45.753 INFO:teuthology.orchestra.run.smithi042.stdout: "reply_latency": { 2024-09-21T01:05:45.753 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.753 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.753 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.753 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.753 INFO:teuthology.orchestra.run.smithi042.stdout: "slow_reply": 0, 2024-09-21T01:05:45.753 INFO:teuthology.orchestra.run.smithi042.stdout: "forward": 0, 2024-09-21T01:05:45.753 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_fetch_complete": 0, 2024-09-21T01:05:45.753 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_fetch_keys": 0, 2024-09-21T01:05:45.753 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_commit": 0, 2024-09-21T01:05:45.753 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_split": 0, 2024-09-21T01:05:45.754 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_merge": 0, 2024-09-21T01:05:45.754 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes": 1134, 2024-09-21T01:05:45.754 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_top": 0, 2024-09-21T01:05:45.754 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_bottom": 1134, 2024-09-21T01:05:45.754 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_pin_tail": 0, 2024-09-21T01:05:45.754 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_pinned": 1134, 2024-09-21T01:05:45.754 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_expired": 0, 2024-09-21T01:05:45.754 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_with_caps": 0, 2024-09-21T01:05:45.754 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": 0, 2024-09-21T01:05:45.754 INFO:teuthology.orchestra.run.smithi042.stdout: "subtrees": 1, 2024-09-21T01:05:45.754 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse": 0, 2024-09-21T01:05:45.754 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_hit": 0, 2024-09-21T01:05:45.754 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_forward": 0, 2024-09-21T01:05:45.754 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_discover": 0, 2024-09-21T01:05:45.754 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_dir_fetch": 0, 2024-09-21T01:05:45.755 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_remote_ino": 0, 2024-09-21T01:05:45.755 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_lock": 0, 2024-09-21T01:05:45.755 INFO:teuthology.orchestra.run.smithi042.stdout: "load_cent": 0, 2024-09-21T01:05:45.755 INFO:teuthology.orchestra.run.smithi042.stdout: "q": 0, 2024-09-21T01:05:45.755 INFO:teuthology.orchestra.run.smithi042.stdout: "exported": 0, 2024-09-21T01:05:45.755 INFO:teuthology.orchestra.run.smithi042.stdout: "exported_inodes": 0, 2024-09-21T01:05:45.755 INFO:teuthology.orchestra.run.smithi042.stdout: "imported": 0, 2024-09-21T01:05:45.755 INFO:teuthology.orchestra.run.smithi042.stdout: "imported_inodes": 0, 2024-09-21T01:05:45.755 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_dir_fetch": 0, 2024-09-21T01:05:45.755 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_backtrace_fetch": 0, 2024-09-21T01:05:45.755 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_peer_discover": 0, 2024-09-21T01:05:45.755 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rfiles": 0, 2024-09-21T01:05:45.755 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rbytes": 0, 2024-09-21T01:05:45.755 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rsnaps": 0, 2024-09-21T01:05:45.755 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T01:05:45.755 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_set_tag": 0, 2024-09-21T01:05:45.756 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T01:05:45.756 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_inotable_repaired": 0, 2024-09-21T01:05:45.756 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_dir_inodes": 0, 2024-09-21T01:05:45.756 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T01:05:45.756 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T01:05:45.756 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_file_inodes": 0, 2024-09-21T01:05:45.756 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_inode_file_caps": 0, 2024-09-21T01:05:45.756 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T01:05:45.756 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_grant": 0, 2024-09-21T01:05:45.756 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T01:05:45.756 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T01:05:45.756 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T01:05:45.756 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_caps": 0, 2024-09-21T01:05:45.756 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_caps_dirty": 0, 2024-09-21T01:05:45.756 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_cap_release": 0, 2024-09-21T01:05:45.757 INFO:teuthology.orchestra.run.smithi042.stdout: "process_request_cap_release": 0 2024-09-21T01:05:45.757 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.757 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_cache": { 2024-09-21T01:05:45.757 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_update": 0, 2024-09-21T01:05:45.757 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_update_receipt": 0, 2024-09-21T01:05:45.757 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_try_discover": 0, 2024-09-21T01:05:45.757 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_send_discover": 0, 2024-09-21T01:05:45.757 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_handle_discover": 0, 2024-09-21T01:05:45.757 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays": 0, 2024-09-21T01:05:45.757 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays_delayed": 0, 2024-09-21T01:05:45.757 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays_enqueuing": 0, 2024-09-21T01:05:45.757 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_created": 0, 2024-09-21T01:05:45.757 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_enqueued": 0, 2024-09-21T01:05:45.757 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_reintegrated": 0, 2024-09-21T01:05:45.757 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_migrated": 0, 2024-09-21T01:05:45.757 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_processing": 0, 2024-09-21T01:05:45.757 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_enqueued": 0, 2024-09-21T01:05:45.758 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_prioritized": 0, 2024-09-21T01:05:45.758 INFO:teuthology.orchestra.run.smithi042.stdout: "recovery_started": 0, 2024-09-21T01:05:45.758 INFO:teuthology.orchestra.run.smithi042.stdout: "recovery_completed": 0, 2024-09-21T01:05:45.758 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_quiesce_path": 0, 2024-09-21T01:05:45.758 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_quiesce_inode": 0, 2024-09-21T01:05:45.758 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T01:05:45.758 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_exportdir": 0, 2024-09-21T01:05:45.758 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_flush": 0, 2024-09-21T01:05:45.758 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_fragmentdir": 0, 2024-09-21T01:05:45.758 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_fragstats": 0, 2024-09-21T01:05:45.758 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_inodestats": 0, 2024-09-21T01:05:45.758 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-21T01:05:45.758 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_succeeded": 0, 2024-09-21T01:05:45.758 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_write_failed": 0 2024-09-21T01:05:45.758 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.758 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_log": { 2024-09-21T01:05:45.759 INFO:teuthology.orchestra.run.smithi042.stdout: "evlrg": 0, 2024-09-21T01:05:45.759 INFO:teuthology.orchestra.run.smithi042.stdout: "evadd": 0, 2024-09-21T01:05:45.759 INFO:teuthology.orchestra.run.smithi042.stdout: "evex": 0, 2024-09-21T01:05:45.759 INFO:teuthology.orchestra.run.smithi042.stdout: "evtrm": 0, 2024-09-21T01:05:45.759 INFO:teuthology.orchestra.run.smithi042.stdout: "ev": 7948, 2024-09-21T01:05:45.759 INFO:teuthology.orchestra.run.smithi042.stdout: "evexg": 0, 2024-09-21T01:05:45.759 INFO:teuthology.orchestra.run.smithi042.stdout: "evexd": 0, 2024-09-21T01:05:45.759 INFO:teuthology.orchestra.run.smithi042.stdout: "segadd": 0, 2024-09-21T01:05:45.759 INFO:teuthology.orchestra.run.smithi042.stdout: "segex": 0, 2024-09-21T01:05:45.759 INFO:teuthology.orchestra.run.smithi042.stdout: "segtrm": 0, 2024-09-21T01:05:45.759 INFO:teuthology.orchestra.run.smithi042.stdout: "seg": 11, 2024-09-21T01:05:45.759 INFO:teuthology.orchestra.run.smithi042.stdout: "segmjr": 2, 2024-09-21T01:05:45.759 INFO:teuthology.orchestra.run.smithi042.stdout: "segexg": 0, 2024-09-21T01:05:45.759 INFO:teuthology.orchestra.run.smithi042.stdout: "segexd": 0, 2024-09-21T01:05:45.760 INFO:teuthology.orchestra.run.smithi042.stdout: "expos": 4194304, 2024-09-21T01:05:45.760 INFO:teuthology.orchestra.run.smithi042.stdout: "wrpos": 15836586, 2024-09-21T01:05:45.760 INFO:teuthology.orchestra.run.smithi042.stdout: "rdpos": 15835448, 2024-09-21T01:05:45.760 INFO:teuthology.orchestra.run.smithi042.stdout: "jlat": { 2024-09-21T01:05:45.760 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.760 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.760 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.760 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.760 INFO:teuthology.orchestra.run.smithi042.stdout: "replayed": 7948 2024-09-21T01:05:45.760 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.760 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_mem": { 2024-09-21T01:05:45.760 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 13, 2024-09-21T01:05:45.760 INFO:teuthology.orchestra.run.smithi042.stdout: "ino+": 1158, 2024-09-21T01:05:45.760 INFO:teuthology.orchestra.run.smithi042.stdout: "ino-": 1145, 2024-09-21T01:05:45.760 INFO:teuthology.orchestra.run.smithi042.stdout: "dir": 11, 2024-09-21T01:05:45.760 INFO:teuthology.orchestra.run.smithi042.stdout: "dir+": 73, 2024-09-21T01:05:45.761 INFO:teuthology.orchestra.run.smithi042.stdout: "dir-": 62, 2024-09-21T01:05:45.761 INFO:teuthology.orchestra.run.smithi042.stdout: "dn": 1134, 2024-09-21T01:05:45.761 INFO:teuthology.orchestra.run.smithi042.stdout: "dn+": 2436, 2024-09-21T01:05:45.761 INFO:teuthology.orchestra.run.smithi042.stdout: "dn-": 1302, 2024-09-21T01:05:45.761 INFO:teuthology.orchestra.run.smithi042.stdout: "cap": 0, 2024-09-21T01:05:45.761 INFO:teuthology.orchestra.run.smithi042.stdout: "cap+": 0, 2024-09-21T01:05:45.761 INFO:teuthology.orchestra.run.smithi042.stdout: "cap-": 0, 2024-09-21T01:05:45.761 INFO:teuthology.orchestra.run.smithi042.stdout: "rss": 119884, 2024-09-21T01:05:45.761 INFO:teuthology.orchestra.run.smithi042.stdout: "heap": 322842624 2024-09-21T01:05:45.761 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.761 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_server": { 2024-09-21T01:05:45.761 INFO:teuthology.orchestra.run.smithi042.stdout: "dispatch_client_request": 0, 2024-09-21T01:05:45.761 INFO:teuthology.orchestra.run.smithi042.stdout: "dispatch_server_request": 0, 2024-09-21T01:05:45.761 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_request": 0, 2024-09-21T01:05:45.761 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_session": 0, 2024-09-21T01:05:45.761 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_peer_request": 0, 2024-09-21T01:05:45.762 INFO:teuthology.orchestra.run.smithi042.stdout: "req_create_latency": { 2024-09-21T01:05:45.762 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.762 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.762 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.762 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.762 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getattr_latency": { 2024-09-21T01:05:45.762 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.762 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.762 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.762 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.762 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getfilelock_latency": { 2024-09-21T01:05:45.762 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.762 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.762 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.763 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.763 INFO:teuthology.orchestra.run.smithi042.stdout: "req_link_latency": { 2024-09-21T01:05:45.763 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.763 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.763 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.763 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.763 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookup_latency": { 2024-09-21T01:05:45.763 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.763 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.763 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.763 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.763 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookuphash_latency": { 2024-09-21T01:05:45.763 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.763 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.763 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.763 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.764 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupino_latency": { 2024-09-21T01:05:45.764 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.764 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.764 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.764 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.764 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupname_latency": { 2024-09-21T01:05:45.764 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.764 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.764 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.764 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.764 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupparent_latency": { 2024-09-21T01:05:45.764 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.764 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.765 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.765 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.765 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupsnap_latency": { 2024-09-21T01:05:45.765 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.765 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.765 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.765 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.765 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lssnap_latency": { 2024-09-21T01:05:45.765 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.766 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.766 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.766 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.766 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mkdir_latency": { 2024-09-21T01:05:45.766 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.766 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.766 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.766 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.766 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mknod_latency": { 2024-09-21T01:05:45.766 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.766 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.766 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.766 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.766 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mksnap_latency": { 2024-09-21T01:05:45.767 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.767 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.767 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.767 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.767 INFO:teuthology.orchestra.run.smithi042.stdout: "req_open_latency": { 2024-09-21T01:05:45.767 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.767 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.767 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.767 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.767 INFO:teuthology.orchestra.run.smithi042.stdout: "req_readdir_latency": { 2024-09-21T01:05:45.767 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.767 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.767 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.767 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.767 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rename_latency": { 2024-09-21T01:05:45.767 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.767 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.768 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.768 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.768 INFO:teuthology.orchestra.run.smithi042.stdout: "req_renamesnap_latency": { 2024-09-21T01:05:45.768 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.768 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.768 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.768 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.768 INFO:teuthology.orchestra.run.smithi042.stdout: "req_snapdiff_latency": { 2024-09-21T01:05:45.768 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.768 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.768 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.768 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.768 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmdir_latency": { 2024-09-21T01:05:45.768 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.768 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.769 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.769 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.769 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmsnap_latency": { 2024-09-21T01:05:45.769 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.769 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.769 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.769 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.769 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmxattr_latency": { 2024-09-21T01:05:45.769 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.769 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.769 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.769 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.769 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setattr_latency": { 2024-09-21T01:05:45.769 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.769 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.770 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.770 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.770 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setdirlayout_latency": { 2024-09-21T01:05:45.770 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.770 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.770 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.770 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.770 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setfilelock_latency": { 2024-09-21T01:05:45.770 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.770 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.770 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.770 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.770 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setlayout_latency": { 2024-09-21T01:05:45.770 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.771 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.771 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.771 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.771 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setxattr_latency": { 2024-09-21T01:05:45.771 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.771 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.771 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.771 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.771 INFO:teuthology.orchestra.run.smithi042.stdout: "req_symlink_latency": { 2024-09-21T01:05:45.771 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.771 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.771 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.771 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.771 INFO:teuthology.orchestra.run.smithi042.stdout: "req_unlink_latency": { 2024-09-21T01:05:45.771 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.771 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.772 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.772 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.772 INFO:teuthology.orchestra.run.smithi042.stdout: "cap_revoke_eviction": 0, 2024-09-21T01:05:45.772 INFO:teuthology.orchestra.run.smithi042.stdout: "cap_acquisition_throttle": 0, 2024-09-21T01:05:45.772 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getvxattr_latency": { 2024-09-21T01:05:45.772 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.772 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.772 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.772 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-21T01:05:45.772 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.772 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_sessions": { 2024-09-21T01:05:45.772 INFO:teuthology.orchestra.run.smithi042.stdout: "session_count": 1, 2024-09-21T01:05:45.773 INFO:teuthology.orchestra.run.smithi042.stdout: "session_add": 1, 2024-09-21T01:05:45.773 INFO:teuthology.orchestra.run.smithi042.stdout: "session_remove": 0, 2024-09-21T01:05:45.773 INFO:teuthology.orchestra.run.smithi042.stdout: "sessions_open": 1, 2024-09-21T01:05:45.773 INFO:teuthology.orchestra.run.smithi042.stdout: "sessions_stale": 0, 2024-09-21T01:05:45.773 INFO:teuthology.orchestra.run.smithi042.stdout: "total_load": 0, 2024-09-21T01:05:45.773 INFO:teuthology.orchestra.run.smithi042.stdout: "average_load": 0, 2024-09-21T01:05:45.773 INFO:teuthology.orchestra.run.smithi042.stdout: "avg_session_uptime": 1831, 2024-09-21T01:05:45.773 INFO:teuthology.orchestra.run.smithi042.stdout: "mdthresh_evicted": 0 2024-09-21T01:05:45.773 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.773 INFO:teuthology.orchestra.run.smithi042.stdout: "mempool": { 2024-09-21T01:05:45.773 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:05:45.773 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_items": 0, 2024-09-21T01:05:45.773 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:05:45.773 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:05:45.773 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:05:45.774 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:05:45.774 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:05:45.774 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:05:45.774 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:05:45.774 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:05:45.774 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:05:45.774 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:05:45.774 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:05:45.774 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:05:45.774 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:05:45.774 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_items": 0, 2024-09-21T01:05:45.774 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:05:45.774 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_items": 0, 2024-09-21T01:05:45.775 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:05:45.775 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:05:45.775 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:05:45.775 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:05:45.775 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:05:45.775 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:05:45.775 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:05:45.775 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_items": 0, 2024-09-21T01:05:45.775 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:05:45.775 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:05:45.775 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:05:45.775 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_items": 0, 2024-09-21T01:05:45.775 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_bytes": 0, 2024-09-21T01:05:45.775 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_items": 0, 2024-09-21T01:05:45.776 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:05:45.776 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:05:45.776 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:05:45.776 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:05:45.776 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_bytes": 190167, 2024-09-21T01:05:45.776 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_items": 52, 2024-09-21T01:05:45.776 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:05:45.776 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_items": 0, 2024-09-21T01:05:45.776 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_bytes": 0, 2024-09-21T01:05:45.776 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_items": 0, 2024-09-21T01:05:45.776 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:05:45.776 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_items": 0, 2024-09-21T01:05:45.776 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:05:45.776 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_items": 0, 2024-09-21T01:05:45.776 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_bytes": 7688, 2024-09-21T01:05:45.777 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_items": 158, 2024-09-21T01:05:45.777 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:05:45.777 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:05:45.777 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_bytes": 0, 2024-09-21T01:05:45.777 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_items": 0, 2024-09-21T01:05:45.777 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_bytes": 815272, 2024-09-21T01:05:45.777 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_items": 4664, 2024-09-21T01:05:45.777 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_bytes": 0, 2024-09-21T01:05:45.777 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_items": 0, 2024-09-21T01:05:45.777 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_bytes": 0, 2024-09-21T01:05:45.777 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_items": 0 2024-09-21T01:05:45.777 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.777 INFO:teuthology.orchestra.run.smithi042.stdout: "objecter": { 2024-09-21T01:05:45.777 INFO:teuthology.orchestra.run.smithi042.stdout: "op_active": 0, 2024-09-21T01:05:45.778 INFO:teuthology.orchestra.run.smithi042.stdout: "op_laggy": 0, 2024-09-21T01:05:45.778 INFO:teuthology.orchestra.run.smithi042.stdout: "op_send": 1901, 2024-09-21T01:05:45.778 INFO:teuthology.orchestra.run.smithi042.stdout: "op_send_bytes": 21, 2024-09-21T01:05:45.778 INFO:teuthology.orchestra.run.smithi042.stdout: "op_resend": 3, 2024-09-21T01:05:45.778 INFO:teuthology.orchestra.run.smithi042.stdout: "op_reply": 1901, 2024-09-21T01:05:45.778 INFO:teuthology.orchestra.run.smithi042.stdout: "op_latency": { 2024-09-21T01:05:45.778 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1901, 2024-09-21T01:05:45.778 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 1.959985250, 2024-09-21T01:05:45.778 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.001031028 2024-09-21T01:05:45.778 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.778 INFO:teuthology.orchestra.run.smithi042.stdout: "op_inflight": 0, 2024-09-21T01:05:45.778 INFO:teuthology.orchestra.run.smithi042.stdout: "oplen_avg": { 2024-09-21T01:05:45.778 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1901, 2024-09-21T01:05:45.778 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 1902 2024-09-21T01:05:45.779 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.779 INFO:teuthology.orchestra.run.smithi042.stdout: "op": 1901, 2024-09-21T01:05:45.779 INFO:teuthology.orchestra.run.smithi042.stdout: "op_r": 1901, 2024-09-21T01:05:45.779 INFO:teuthology.orchestra.run.smithi042.stdout: "op_w": 0, 2024-09-21T01:05:45.779 INFO:teuthology.orchestra.run.smithi042.stdout: "op_rmw": 0, 2024-09-21T01:05:45.779 INFO:teuthology.orchestra.run.smithi042.stdout: "op_pg": 0, 2024-09-21T01:05:45.779 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_stat": 1156, 2024-09-21T01:05:45.779 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_create": 0, 2024-09-21T01:05:45.779 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_read": 743, 2024-09-21T01:05:45.779 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_write": 0, 2024-09-21T01:05:45.779 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_writefull": 0, 2024-09-21T01:05:45.779 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_writesame": 0, 2024-09-21T01:05:45.779 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_append": 0, 2024-09-21T01:05:45.779 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_zero": 0, 2024-09-21T01:05:45.779 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_truncate": 0, 2024-09-21T01:05:45.780 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_delete": 0, 2024-09-21T01:05:45.780 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_mapext": 0, 2024-09-21T01:05:45.780 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_sparse_read": 0, 2024-09-21T01:05:45.780 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_clonerange": 0, 2024-09-21T01:05:45.780 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_getxattr": 1, 2024-09-21T01:05:45.780 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_setxattr": 0, 2024-09-21T01:05:45.780 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_cmpxattr": 0, 2024-09-21T01:05:45.780 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_rmxattr": 0, 2024-09-21T01:05:45.780 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_resetxattrs": 0, 2024-09-21T01:05:45.780 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_call": 0, 2024-09-21T01:05:45.780 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_watch": 0, 2024-09-21T01:05:45.780 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_notify": 0, 2024-09-21T01:05:45.780 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T01:05:45.780 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_pgls": 0, 2024-09-21T01:05:45.780 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_pgls_filter": 0, 2024-09-21T01:05:45.780 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_other": 0, 2024-09-21T01:05:45.781 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_active": 0, 2024-09-21T01:05:45.781 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_send": 0, 2024-09-21T01:05:45.781 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_resend": 0, 2024-09-21T01:05:45.781 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_ping": 0, 2024-09-21T01:05:45.781 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_active": 0, 2024-09-21T01:05:45.781 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_send": 0, 2024-09-21T01:05:45.781 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_resend": 0, 2024-09-21T01:05:45.781 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_active": 0, 2024-09-21T01:05:45.781 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_send": 0, 2024-09-21T01:05:45.781 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_resend": 0, 2024-09-21T01:05:45.781 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_active": 0, 2024-09-21T01:05:45.781 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_send": 0, 2024-09-21T01:05:45.781 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_resend": 0, 2024-09-21T01:05:45.781 INFO:teuthology.orchestra.run.smithi042.stdout: "command_active": 0, 2024-09-21T01:05:45.781 INFO:teuthology.orchestra.run.smithi042.stdout: "command_send": 0, 2024-09-21T01:05:45.781 INFO:teuthology.orchestra.run.smithi042.stdout: "command_resend": 0, 2024-09-21T01:05:45.781 INFO:teuthology.orchestra.run.smithi042.stdout: "map_epoch": 75, 2024-09-21T01:05:45.782 INFO:teuthology.orchestra.run.smithi042.stdout: "map_full": 0, 2024-09-21T01:05:45.782 INFO:teuthology.orchestra.run.smithi042.stdout: "map_inc": 2, 2024-09-21T01:05:45.782 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_sessions": 5, 2024-09-21T01:05:45.782 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_session_open": 5, 2024-09-21T01:05:45.782 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_session_close": 0, 2024-09-21T01:05:45.782 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_laggy": 0, 2024-09-21T01:05:45.782 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_wr": 0, 2024-09-21T01:05:45.782 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_rd": 2, 2024-09-21T01:05:45.782 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_del": 0 2024-09-21T01:05:45.782 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.782 INFO:teuthology.orchestra.run.smithi042.stdout: "oft": { 2024-09-21T01:05:45.782 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_objs": 0, 2024-09-21T01:05:45.782 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_kv_pairs": 0, 2024-09-21T01:05:45.782 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_updates": 0, 2024-09-21T01:05:45.782 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_removes": 0 2024-09-21T01:05:45.783 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.783 INFO:teuthology.orchestra.run.smithi042.stdout: "purge_queue": { 2024-09-21T01:05:45.783 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_ops": 0, 2024-09-21T01:05:45.783 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T01:05:45.783 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing": 0, 2024-09-21T01:05:45.783 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_high_water": 0, 2024-09-21T01:05:45.783 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executed_ops": 0, 2024-09-21T01:05:45.783 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executed": 0, 2024-09-21T01:05:45.783 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_item_in_journal": 0 2024-09-21T01:05:45.783 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.783 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:05:45.783 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-21T01:05:45.783 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 104857600, 2024-09-21T01:05:45.783 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-21T01:05:45.783 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 2116, 2024-09-21T01:05:45.784 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 12936873, 2024-09-21T01:05:45.784 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:45.784 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 2116, 2024-09-21T01:05:45.784 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-09-21T01:05:45.784 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-09-21T01:05:45.784 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 2116, 2024-09-21T01:05:45.784 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 12936873, 2024-09-21T01:05:45.784 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-21T01:05:45.784 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.784 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.784 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.784 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-21T01:05:45.784 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.784 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-objecter_bytes": { 2024-09-21T01:05:45.784 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-21T01:05:45.784 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 104857600, 2024-09-21T01:05:45.784 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-21T01:05:45.785 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2024-09-21T01:05:45.785 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2024-09-21T01:05:45.785 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:45.785 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2024-09-21T01:05:45.785 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 1901, 2024-09-21T01:05:45.785 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 11642287, 2024-09-21T01:05:45.785 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 1901, 2024-09-21T01:05:45.785 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 11642287, 2024-09-21T01:05:45.785 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-21T01:05:45.785 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.785 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.785 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.785 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-21T01:05:45.785 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.785 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-objecter_ops": { 2024-09-21T01:05:45.786 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-21T01:05:45.786 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 1024, 2024-09-21T01:05:45.786 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-21T01:05:45.786 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2024-09-21T01:05:45.786 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2024-09-21T01:05:45.786 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:45.786 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2024-09-21T01:05:45.786 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 1901, 2024-09-21T01:05:45.786 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 1901, 2024-09-21T01:05:45.786 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 1901, 2024-09-21T01:05:45.786 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 1901, 2024-09-21T01:05:45.786 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-21T01:05:45.786 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.786 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.786 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.787 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-21T01:05:45.787 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.787 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-write_buf_throttle": { 2024-09-21T01:05:45.787 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-21T01:05:45.787 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 3758096384, 2024-09-21T01:05:45.787 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-21T01:05:45.787 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2024-09-21T01:05:45.787 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2024-09-21T01:05:45.787 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:45.787 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2024-09-21T01:05:45.787 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-09-21T01:05:45.787 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-09-21T01:05:45.787 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 0, 2024-09-21T01:05:45.787 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 0, 2024-09-21T01:05:45.787 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-21T01:05:45.788 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.788 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.788 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.788 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-21T01:05:45.788 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.788 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-write_buf_throttle-0x55f3cec1b6c0": { 2024-09-21T01:05:45.788 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-21T01:05:45.788 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 3758096384, 2024-09-21T01:05:45.788 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-21T01:05:45.788 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2024-09-21T01:05:45.788 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2024-09-21T01:05:45.788 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:45.788 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2024-09-21T01:05:45.788 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-09-21T01:05:45.788 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-09-21T01:05:45.788 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 0, 2024-09-21T01:05:45.789 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 0, 2024-09-21T01:05:45.789 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-21T01:05:45.789 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-21T01:05:45.789 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-21T01:05:45.789 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-21T01:05:45.789 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-21T01:05:45.789 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-21T01:05:45.789 INFO:teuthology.orchestra.run.smithi042.stdout: "trackedop": { 2024-09-21T01:05:45.789 INFO:teuthology.orchestra.run.smithi042.stdout: "slow_ops_count": 0 2024-09-21T01:05:45.789 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-21T01:05:45.789 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-21T01:05:45.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:45 smithi042 ceph-mon[34481]: pgmap v614: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 938 B/s wr, 15 op/s 2024-09-21T01:05:46.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:45 smithi001 ceph-mon[31211]: pgmap v614: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 938 B/s wr, 15 op/s 2024-09-21T01:05:46.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:45 smithi193 ceph-mon[34660]: pgmap v614: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 938 B/s wr, 15 op/s 2024-09-21T01:05:46.531 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-21T01:05:46.531 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-21T01:05:46.532 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-09-21T01:05:46.532 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2024-09-21T01:05:46.532 INFO:tasks.check_counter:Daemon mds.k mds.dir_split=0 2024-09-21T01:05:46.532 DEBUG:tasks.check_counter:Getting stats from c 2024-09-21T01:05:46.532 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph daemon mds.c perf dump 2024-09-21T01:05:46.792 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:05:47.319 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-09-21T01:05:47.319 INFO:teuthology.orchestra.run.smithi193.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:05:47.320 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_messages": 4023, 2024-09-21T01:05:47.320 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages": 3476, 2024-09-21T01:05:47.320 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_bytes": 1294660, 2024-09-21T01:05:47.320 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_bytes": 5471690, 2024-09-21T01:05:47.320 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_created_connections": 10, 2024-09-21T01:05:47.320 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_active_connections": 4, 2024-09-21T01:05:47.320 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_total_time": 0.369994052, 2024-09-21T01:05:47.320 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_send_time": 0.182882593, 2024-09-21T01:05:47.320 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_recv_time": 0.153097428, 2024-09-21T01:05:47.320 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_fast_dispatch_time": 0.045198110, 2024-09-21T01:05:47.320 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:05:47.320 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 3477, 2024-09-21T01:05:47.320 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.240063068, 2024-09-21T01:05:47.321 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000069043 2024-09-21T01:05:47.321 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.321 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:05:47.321 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 4388, 2024-09-21T01:05:47.321 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000846615, 2024-09-21T01:05:47.321 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000192 2024-09-21T01:05:47.321 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.321 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-09-21T01:05:47.321 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T01:05:47.321 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.321 INFO:teuthology.orchestra.run.smithi193.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:05:47.321 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_messages": 12114, 2024-09-21T01:05:47.321 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages": 7527, 2024-09-21T01:05:47.322 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_bytes": 6330520, 2024-09-21T01:05:47.322 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_bytes": 3267547, 2024-09-21T01:05:47.322 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_created_connections": 16, 2024-09-21T01:05:47.322 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_active_connections": 7, 2024-09-21T01:05:47.322 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_total_time": 0.786808805, 2024-09-21T01:05:47.322 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_send_time": 0.352955146, 2024-09-21T01:05:47.322 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_recv_time": 0.556248346, 2024-09-21T01:05:47.322 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_fast_dispatch_time": 0.019943982, 2024-09-21T01:05:47.322 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:05:47.322 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 7526, 2024-09-21T01:05:47.323 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.285745467, 2024-09-21T01:05:47.323 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000037967 2024-09-21T01:05:47.323 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.323 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:05:47.323 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 17384, 2024-09-21T01:05:47.323 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.002884939, 2024-09-21T01:05:47.323 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000165 2024-09-21T01:05:47.323 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.323 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_encrypted_bytes": 975552, 2024-09-21T01:05:47.323 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_encrypted_bytes": 123088 2024-09-21T01:05:47.323 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.323 INFO:teuthology.orchestra.run.smithi193.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:05:47.323 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_messages": 19929, 2024-09-21T01:05:47.323 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages": 18048, 2024-09-21T01:05:47.323 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_bytes": 6849975, 2024-09-21T01:05:47.323 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_bytes": 7893455, 2024-09-21T01:05:47.324 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_created_connections": 27, 2024-09-21T01:05:47.324 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_active_connections": 11, 2024-09-21T01:05:47.324 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_total_time": 1.027389378, 2024-09-21T01:05:47.324 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_send_time": 0.552005445, 2024-09-21T01:05:47.324 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_recv_time": 4.108949953, 2024-09-21T01:05:47.324 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_fast_dispatch_time": 0.012060394, 2024-09-21T01:05:47.324 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:05:47.324 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 18044, 2024-09-21T01:05:47.324 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 1.257642095, 2024-09-21T01:05:47.324 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000069698 2024-09-21T01:05:47.324 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.324 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:05:47.324 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 31093, 2024-09-21T01:05:47.324 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.005777516, 2024-09-21T01:05:47.324 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000185 2024-09-21T01:05:47.324 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.325 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_encrypted_bytes": 3264, 2024-09-21T01:05:47.325 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_encrypted_bytes": 330304 2024-09-21T01:05:47.325 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.325 INFO:teuthology.orchestra.run.smithi193.stdout: "cct": { 2024-09-21T01:05:47.325 INFO:teuthology.orchestra.run.smithi193.stdout: "total_workers": 1, 2024-09-21T01:05:47.325 INFO:teuthology.orchestra.run.smithi193.stdout: "unhealthy_workers": 0 2024-09-21T01:05:47.325 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.325 INFO:teuthology.orchestra.run.smithi193.stdout: "finisher-MDSRank": { 2024-09-21T01:05:47.325 INFO:teuthology.orchestra.run.smithi193.stdout: "queue_len": 0, 2024-09-21T01:05:47.325 INFO:teuthology.orchestra.run.smithi193.stdout: "complete_latency": { 2024-09-21T01:05:47.325 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 1388, 2024-09-21T01:05:47.325 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 2.864850518, 2024-09-21T01:05:47.325 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.002064013 2024-09-21T01:05:47.325 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-21T01:05:47.325 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.325 INFO:teuthology.orchestra.run.smithi193.stdout: "finisher-PurgeQueue": { 2024-09-21T01:05:47.326 INFO:teuthology.orchestra.run.smithi193.stdout: "queue_len": 0, 2024-09-21T01:05:47.326 INFO:teuthology.orchestra.run.smithi193.stdout: "complete_latency": { 2024-09-21T01:05:47.326 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 1139, 2024-09-21T01:05:47.326 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.068966368, 2024-09-21T01:05:47.326 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000060549 2024-09-21T01:05:47.326 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-21T01:05:47.326 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.326 INFO:teuthology.orchestra.run.smithi193.stdout: "mds": { 2024-09-21T01:05:47.326 INFO:teuthology.orchestra.run.smithi193.stdout: "request": 5284, 2024-09-21T01:05:47.326 INFO:teuthology.orchestra.run.smithi193.stdout: "reply": 3947, 2024-09-21T01:05:47.326 INFO:teuthology.orchestra.run.smithi193.stdout: "reply_latency": { 2024-09-21T01:05:47.326 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 3947, 2024-09-21T01:05:47.326 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 35.790096835, 2024-09-21T01:05:47.326 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.009067670 2024-09-21T01:05:47.326 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.327 INFO:teuthology.orchestra.run.smithi193.stdout: "slow_reply": 0, 2024-09-21T01:05:47.327 INFO:teuthology.orchestra.run.smithi193.stdout: "forward": 1337, 2024-09-21T01:05:47.327 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_fetch_complete": 0, 2024-09-21T01:05:47.327 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_fetch_keys": 0, 2024-09-21T01:05:47.327 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_commit": 29, 2024-09-21T01:05:47.327 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_split": 2, 2024-09-21T01:05:47.327 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_merge": 0, 2024-09-21T01:05:47.327 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes": 25, 2024-09-21T01:05:47.327 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_top": 7, 2024-09-21T01:05:47.327 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_bottom": 8, 2024-09-21T01:05:47.327 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_pin_tail": 10, 2024-09-21T01:05:47.327 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_pinned": 13, 2024-09-21T01:05:47.327 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_expired": 354, 2024-09-21T01:05:47.327 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_with_caps": 0, 2024-09-21T01:05:47.327 INFO:teuthology.orchestra.run.smithi193.stdout: "caps": 0, 2024-09-21T01:05:47.328 INFO:teuthology.orchestra.run.smithi193.stdout: "subtrees": 4, 2024-09-21T01:05:47.328 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse": 12080, 2024-09-21T01:05:47.328 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_hit": 9011, 2024-09-21T01:05:47.328 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_forward": 1336, 2024-09-21T01:05:47.328 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_discover": 206, 2024-09-21T01:05:47.328 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_dir_fetch": 0, 2024-09-21T01:05:47.328 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_remote_ino": 0, 2024-09-21T01:05:47.328 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_lock": 52, 2024-09-21T01:05:47.328 INFO:teuthology.orchestra.run.smithi193.stdout: "load_cent": 0, 2024-09-21T01:05:47.328 INFO:teuthology.orchestra.run.smithi193.stdout: "q": 0, 2024-09-21T01:05:47.328 INFO:teuthology.orchestra.run.smithi193.stdout: "exported": 16, 2024-09-21T01:05:47.328 INFO:teuthology.orchestra.run.smithi193.stdout: "exported_inodes": 15, 2024-09-21T01:05:47.328 INFO:teuthology.orchestra.run.smithi193.stdout: "imported": 2, 2024-09-21T01:05:47.328 INFO:teuthology.orchestra.run.smithi193.stdout: "imported_inodes": 377, 2024-09-21T01:05:47.328 INFO:teuthology.orchestra.run.smithi193.stdout: "openino_dir_fetch": 0, 2024-09-21T01:05:47.328 INFO:teuthology.orchestra.run.smithi193.stdout: "openino_backtrace_fetch": 1185, 2024-09-21T01:05:47.329 INFO:teuthology.orchestra.run.smithi193.stdout: "openino_peer_discover": 0, 2024-09-21T01:05:47.329 INFO:teuthology.orchestra.run.smithi193.stdout: "root_rfiles": 11953, 2024-09-21T01:05:47.329 INFO:teuthology.orchestra.run.smithi193.stdout: "root_rbytes": 230111924, 2024-09-21T01:05:47.329 INFO:teuthology.orchestra.run.smithi193.stdout: "root_rsnaps": 0, 2024-09-21T01:05:47.329 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_backtrace_fetch": 1185, 2024-09-21T01:05:47.329 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_set_tag": 0, 2024-09-21T01:05:47.329 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T01:05:47.329 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_inotable_repaired": 0, 2024-09-21T01:05:47.329 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_dir_inodes": 0, 2024-09-21T01:05:47.329 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T01:05:47.329 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T01:05:47.329 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_file_inodes": 1185, 2024-09-21T01:05:47.330 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_inode_file_caps": 11, 2024-09-21T01:05:47.330 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_revoke": 3118, 2024-09-21T01:05:47.330 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_grant": 3158, 2024-09-21T01:05:47.330 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T01:05:47.330 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T01:05:47.330 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T01:05:47.330 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_caps": 9952, 2024-09-21T01:05:47.330 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_caps_dirty": 538, 2024-09-21T01:05:47.330 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_cap_release": 28, 2024-09-21T01:05:47.330 INFO:teuthology.orchestra.run.smithi193.stdout: "process_request_cap_release": 2080 2024-09-21T01:05:47.330 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.330 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_cache": { 2024-09-21T01:05:47.330 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_update": 320, 2024-09-21T01:05:47.331 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_update_receipt": 4440, 2024-09-21T01:05:47.331 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_try_discover": 2587, 2024-09-21T01:05:47.331 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_send_discover": 3494, 2024-09-21T01:05:47.331 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_handle_discover": 263, 2024-09-21T01:05:47.331 INFO:teuthology.orchestra.run.smithi193.stdout: "num_strays": 0, 2024-09-21T01:05:47.331 INFO:teuthology.orchestra.run.smithi193.stdout: "num_strays_delayed": 0, 2024-09-21T01:05:47.331 INFO:teuthology.orchestra.run.smithi193.stdout: "num_strays_enqueuing": 0, 2024-09-21T01:05:47.331 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_created": 539, 2024-09-21T01:05:47.331 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_enqueued": 539, 2024-09-21T01:05:47.331 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_reintegrated": 0, 2024-09-21T01:05:47.331 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_migrated": 0, 2024-09-21T01:05:47.331 INFO:teuthology.orchestra.run.smithi193.stdout: "num_recovering_processing": 0, 2024-09-21T01:05:47.331 INFO:teuthology.orchestra.run.smithi193.stdout: "num_recovering_enqueued": 0, 2024-09-21T01:05:47.331 INFO:teuthology.orchestra.run.smithi193.stdout: "num_recovering_prioritized": 0, 2024-09-21T01:05:47.331 INFO:teuthology.orchestra.run.smithi193.stdout: "recovery_started": 0, 2024-09-21T01:05:47.332 INFO:teuthology.orchestra.run.smithi193.stdout: "recovery_completed": 0, 2024-09-21T01:05:47.332 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_quiesce_path": 0, 2024-09-21T01:05:47.332 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_quiesce_inode": 0, 2024-09-21T01:05:47.332 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T01:05:47.332 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_exportdir": 16, 2024-09-21T01:05:47.332 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_flush": 0, 2024-09-21T01:05:47.332 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_fragmentdir": 2, 2024-09-21T01:05:47.332 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_fragstats": 0, 2024-09-21T01:05:47.332 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_inodestats": 0, 2024-09-21T01:05:47.332 INFO:teuthology.orchestra.run.smithi193.stdout: "uninline_started": 0, 2024-09-21T01:05:47.332 INFO:teuthology.orchestra.run.smithi193.stdout: "uninline_succeeded": 0, 2024-09-21T01:05:47.332 INFO:teuthology.orchestra.run.smithi193.stdout: "uninline_write_failed": 0 2024-09-21T01:05:47.332 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.333 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_log": { 2024-09-21T01:05:47.333 INFO:teuthology.orchestra.run.smithi193.stdout: "evlrg": 0, 2024-09-21T01:05:47.333 INFO:teuthology.orchestra.run.smithi193.stdout: "evadd": 3868, 2024-09-21T01:05:47.333 INFO:teuthology.orchestra.run.smithi193.stdout: "evex": 0, 2024-09-21T01:05:47.333 INFO:teuthology.orchestra.run.smithi193.stdout: "evtrm": 0, 2024-09-21T01:05:47.333 INFO:teuthology.orchestra.run.smithi193.stdout: "ev": 3868, 2024-09-21T01:05:47.333 INFO:teuthology.orchestra.run.smithi193.stdout: "evexg": 0, 2024-09-21T01:05:47.333 INFO:teuthology.orchestra.run.smithi193.stdout: "evexd": 0, 2024-09-21T01:05:47.333 INFO:teuthology.orchestra.run.smithi193.stdout: "segadd": 5, 2024-09-21T01:05:47.333 INFO:teuthology.orchestra.run.smithi193.stdout: "segex": 0, 2024-09-21T01:05:47.333 INFO:teuthology.orchestra.run.smithi193.stdout: "segtrm": 0, 2024-09-21T01:05:47.333 INFO:teuthology.orchestra.run.smithi193.stdout: "seg": 5, 2024-09-21T01:05:47.333 INFO:teuthology.orchestra.run.smithi193.stdout: "segmjr": 2, 2024-09-21T01:05:47.333 INFO:teuthology.orchestra.run.smithi193.stdout: "segexg": 0, 2024-09-21T01:05:47.333 INFO:teuthology.orchestra.run.smithi193.stdout: "segexd": 0, 2024-09-21T01:05:47.334 INFO:teuthology.orchestra.run.smithi193.stdout: "expos": 4194304, 2024-09-21T01:05:47.334 INFO:teuthology.orchestra.run.smithi193.stdout: "wrpos": 9763145, 2024-09-21T01:05:47.334 INFO:teuthology.orchestra.run.smithi193.stdout: "rdpos": 0, 2024-09-21T01:05:47.334 INFO:teuthology.orchestra.run.smithi193.stdout: "jlat": { 2024-09-21T01:05:47.334 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 810, 2024-09-21T01:05:47.334 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 18.079434837, 2024-09-21T01:05:47.334 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.022320289 2024-09-21T01:05:47.334 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.334 INFO:teuthology.orchestra.run.smithi193.stdout: "replayed": 0 2024-09-21T01:05:47.334 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.335 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_mem": { 2024-09-21T01:05:47.335 INFO:teuthology.orchestra.run.smithi193.stdout: "ino": 30, 2024-09-21T01:05:47.335 INFO:teuthology.orchestra.run.smithi193.stdout: "ino+": 746, 2024-09-21T01:05:47.335 INFO:teuthology.orchestra.run.smithi193.stdout: "ino-": 716, 2024-09-21T01:05:47.335 INFO:teuthology.orchestra.run.smithi193.stdout: "dir": 29, 2024-09-21T01:05:47.335 INFO:teuthology.orchestra.run.smithi193.stdout: "dir+": 2044, 2024-09-21T01:05:47.335 INFO:teuthology.orchestra.run.smithi193.stdout: "dir-": 2015, 2024-09-21T01:05:47.335 INFO:teuthology.orchestra.run.smithi193.stdout: "dn": 25, 2024-09-21T01:05:47.335 INFO:teuthology.orchestra.run.smithi193.stdout: "dn+": 1649, 2024-09-21T01:05:47.335 INFO:teuthology.orchestra.run.smithi193.stdout: "dn-": 1624, 2024-09-21T01:05:47.335 INFO:teuthology.orchestra.run.smithi193.stdout: "cap": 0, 2024-09-21T01:05:47.335 INFO:teuthology.orchestra.run.smithi193.stdout: "cap+": 876, 2024-09-21T01:05:47.335 INFO:teuthology.orchestra.run.smithi193.stdout: "cap-": 876, 2024-09-21T01:05:47.335 INFO:teuthology.orchestra.run.smithi193.stdout: "rss": 134436, 2024-09-21T01:05:47.336 INFO:teuthology.orchestra.run.smithi193.stdout: "heap": 341721088 2024-09-21T01:05:47.336 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.336 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_server": { 2024-09-21T01:05:47.336 INFO:teuthology.orchestra.run.smithi193.stdout: "dispatch_client_request": 5476, 2024-09-21T01:05:47.336 INFO:teuthology.orchestra.run.smithi193.stdout: "dispatch_server_request": 42, 2024-09-21T01:05:47.336 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_request": 5284, 2024-09-21T01:05:47.336 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_session": 14, 2024-09-21T01:05:47.336 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_peer_request": 122, 2024-09-21T01:05:47.336 INFO:teuthology.orchestra.run.smithi193.stdout: "req_create_latency": { 2024-09-21T01:05:47.336 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 396, 2024-09-21T01:05:47.336 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.879618231, 2024-09-21T01:05:47.336 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.002221258 2024-09-21T01:05:47.336 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.336 INFO:teuthology.orchestra.run.smithi193.stdout: "req_getattr_latency": { 2024-09-21T01:05:47.336 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 40, 2024-09-21T01:05:47.337 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 2.938337804, 2024-09-21T01:05:47.337 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.073458445 2024-09-21T01:05:47.337 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.337 INFO:teuthology.orchestra.run.smithi193.stdout: "req_getfilelock_latency": { 2024-09-21T01:05:47.337 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:47.337 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:47.337 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:47.337 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.337 INFO:teuthology.orchestra.run.smithi193.stdout: "req_link_latency": { 2024-09-21T01:05:47.337 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:47.337 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:47.337 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:47.337 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.337 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookup_latency": { 2024-09-21T01:05:47.338 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 2422, 2024-09-21T01:05:47.338 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 30.905186345, 2024-09-21T01:05:47.338 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.012760192 2024-09-21T01:05:47.338 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.338 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookuphash_latency": { 2024-09-21T01:05:47.338 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:47.338 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:47.338 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:47.338 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.338 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupino_latency": { 2024-09-21T01:05:47.338 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:47.338 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:47.338 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:47.339 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.339 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupname_latency": { 2024-09-21T01:05:47.339 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:47.339 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:47.339 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:47.339 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.339 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupparent_latency": { 2024-09-21T01:05:47.339 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:47.339 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:47.339 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:47.339 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.339 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupsnap_latency": { 2024-09-21T01:05:47.339 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:47.340 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:47.340 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:47.340 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.340 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lssnap_latency": { 2024-09-21T01:05:47.340 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:47.340 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:47.340 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:47.340 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.340 INFO:teuthology.orchestra.run.smithi193.stdout: "req_mkdir_latency": { 2024-09-21T01:05:47.341 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:47.341 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:47.341 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:47.341 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.341 INFO:teuthology.orchestra.run.smithi193.stdout: "req_mknod_latency": { 2024-09-21T01:05:47.341 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:47.341 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:47.341 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:47.341 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.341 INFO:teuthology.orchestra.run.smithi193.stdout: "req_mksnap_latency": { 2024-09-21T01:05:47.341 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:47.341 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:47.341 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:47.341 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.342 INFO:teuthology.orchestra.run.smithi193.stdout: "req_open_latency": { 2024-09-21T01:05:47.342 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 346, 2024-09-21T01:05:47.342 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.142743875, 2024-09-21T01:05:47.342 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000412554 2024-09-21T01:05:47.342 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.342 INFO:teuthology.orchestra.run.smithi193.stdout: "req_readdir_latency": { 2024-09-21T01:05:47.342 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 16, 2024-09-21T01:05:47.342 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.015837821, 2024-09-21T01:05:47.342 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000989863 2024-09-21T01:05:47.342 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.342 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rename_latency": { 2024-09-21T01:05:47.342 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 396, 2024-09-21T01:05:47.342 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.546120447, 2024-09-21T01:05:47.342 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.001379092 2024-09-21T01:05:47.343 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.343 INFO:teuthology.orchestra.run.smithi193.stdout: "req_renamesnap_latency": { 2024-09-21T01:05:47.343 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:47.343 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:47.343 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:47.343 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.343 INFO:teuthology.orchestra.run.smithi193.stdout: "req_snapdiff_latency": { 2024-09-21T01:05:47.343 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:47.343 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:47.343 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:47.343 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.343 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rmdir_latency": { 2024-09-21T01:05:47.343 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:47.343 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:47.344 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:47.344 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.344 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rmsnap_latency": { 2024-09-21T01:05:47.344 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:47.344 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:47.344 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:47.344 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.344 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rmxattr_latency": { 2024-09-21T01:05:47.344 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:47.344 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:47.344 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:47.344 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.344 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setattr_latency": { 2024-09-21T01:05:47.344 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:47.344 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:47.345 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:47.345 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.345 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setdirlayout_latency": { 2024-09-21T01:05:47.345 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:47.345 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:47.345 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:47.345 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.345 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setfilelock_latency": { 2024-09-21T01:05:47.345 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:47.345 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:47.345 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:47.345 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.345 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setlayout_latency": { 2024-09-21T01:05:47.345 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:47.345 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:47.345 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:47.346 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.346 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setxattr_latency": { 2024-09-21T01:05:47.346 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:47.346 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:47.346 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:47.346 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.346 INFO:teuthology.orchestra.run.smithi193.stdout: "req_symlink_latency": { 2024-09-21T01:05:47.346 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:47.346 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:47.346 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:47.346 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.346 INFO:teuthology.orchestra.run.smithi193.stdout: "req_unlink_latency": { 2024-09-21T01:05:47.346 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 331, 2024-09-21T01:05:47.346 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.362252312, 2024-09-21T01:05:47.347 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.001094417 2024-09-21T01:05:47.347 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.347 INFO:teuthology.orchestra.run.smithi193.stdout: "cap_revoke_eviction": 0, 2024-09-21T01:05:47.347 INFO:teuthology.orchestra.run.smithi193.stdout: "cap_acquisition_throttle": 0, 2024-09-21T01:05:47.347 INFO:teuthology.orchestra.run.smithi193.stdout: "req_getvxattr_latency": { 2024-09-21T01:05:47.347 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:47.347 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:47.347 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:47.347 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-21T01:05:47.347 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.347 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_sessions": { 2024-09-21T01:05:47.347 INFO:teuthology.orchestra.run.smithi193.stdout: "session_count": 1, 2024-09-21T01:05:47.347 INFO:teuthology.orchestra.run.smithi193.stdout: "session_add": 3, 2024-09-21T01:05:47.347 INFO:teuthology.orchestra.run.smithi193.stdout: "session_remove": 2, 2024-09-21T01:05:47.347 INFO:teuthology.orchestra.run.smithi193.stdout: "sessions_open": 1, 2024-09-21T01:05:47.348 INFO:teuthology.orchestra.run.smithi193.stdout: "sessions_stale": 0, 2024-09-21T01:05:47.348 INFO:teuthology.orchestra.run.smithi193.stdout: "total_load": 806, 2024-09-21T01:05:47.348 INFO:teuthology.orchestra.run.smithi193.stdout: "average_load": 806, 2024-09-21T01:05:47.348 INFO:teuthology.orchestra.run.smithi193.stdout: "avg_session_uptime": 452, 2024-09-21T01:05:47.348 INFO:teuthology.orchestra.run.smithi193.stdout: "mdthresh_evicted": 0 2024-09-21T01:05:47.348 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.348 INFO:teuthology.orchestra.run.smithi193.stdout: "mempool": { 2024-09-21T01:05:47.348 INFO:teuthology.orchestra.run.smithi193.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:05:47.348 INFO:teuthology.orchestra.run.smithi193.stdout: "bloom_filter_items": 0, 2024-09-21T01:05:47.348 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:05:47.348 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:05:47.348 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:05:47.348 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:05:47.348 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:05:47.348 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:05:47.349 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:05:47.349 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:05:47.349 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:05:47.349 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:05:47.349 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:05:47.349 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:05:47.349 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:05:47.349 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_extent_items": 0, 2024-09-21T01:05:47.349 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:05:47.349 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_blob_items": 0, 2024-09-21T01:05:47.349 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:05:47.349 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:05:47.349 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:05:47.349 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:05:47.349 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:05:47.350 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:05:47.350 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:05:47.350 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_txc_items": 0, 2024-09-21T01:05:47.350 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:05:47.350 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:05:47.350 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:05:47.350 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_items": 0, 2024-09-21T01:05:47.350 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_bytes": 0, 2024-09-21T01:05:47.350 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_items": 0, 2024-09-21T01:05:47.350 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:05:47.350 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:05:47.350 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:05:47.350 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:05:47.350 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_anon_bytes": 283809, 2024-09-21T01:05:47.351 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_anon_items": 125, 2024-09-21T01:05:47.351 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_meta_bytes": 528, 2024-09-21T01:05:47.351 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_meta_items": 6, 2024-09-21T01:05:47.351 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_bytes": 0, 2024-09-21T01:05:47.351 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_items": 0, 2024-09-21T01:05:47.351 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:05:47.351 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_mapbl_items": 0, 2024-09-21T01:05:47.351 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:05:47.351 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_pglog_items": 0, 2024-09-21T01:05:47.351 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_bytes": 7688, 2024-09-21T01:05:47.351 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_items": 158, 2024-09-21T01:05:47.351 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:05:47.351 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:05:47.351 INFO:teuthology.orchestra.run.smithi193.stdout: "pgmap_bytes": 0, 2024-09-21T01:05:47.351 INFO:teuthology.orchestra.run.smithi193.stdout: "pgmap_items": 0, 2024-09-21T01:05:47.352 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_co_bytes": 123393, 2024-09-21T01:05:47.352 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_co_items": 507, 2024-09-21T01:05:47.352 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_1_bytes": 0, 2024-09-21T01:05:47.352 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_1_items": 0, 2024-09-21T01:05:47.352 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_2_bytes": 0, 2024-09-21T01:05:47.352 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_2_items": 0 2024-09-21T01:05:47.352 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.352 INFO:teuthology.orchestra.run.smithi193.stdout: "objecter": { 2024-09-21T01:05:47.352 INFO:teuthology.orchestra.run.smithi193.stdout: "op_active": 0, 2024-09-21T01:05:47.352 INFO:teuthology.orchestra.run.smithi193.stdout: "op_laggy": 0, 2024-09-21T01:05:47.352 INFO:teuthology.orchestra.run.smithi193.stdout: "op_send": 2797, 2024-09-21T01:05:47.352 INFO:teuthology.orchestra.run.smithi193.stdout: "op_send_bytes": 6005157, 2024-09-21T01:05:47.352 INFO:teuthology.orchestra.run.smithi193.stdout: "op_resend": 29, 2024-09-21T01:05:47.352 INFO:teuthology.orchestra.run.smithi193.stdout: "op_reply": 2797, 2024-09-21T01:05:47.352 INFO:teuthology.orchestra.run.smithi193.stdout: "op_latency": { 2024-09-21T01:05:47.353 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 2797, 2024-09-21T01:05:47.353 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 28.263573184, 2024-09-21T01:05:47.353 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.010104960 2024-09-21T01:05:47.353 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.353 INFO:teuthology.orchestra.run.smithi193.stdout: "op_inflight": 0, 2024-09-21T01:05:47.353 INFO:teuthology.orchestra.run.smithi193.stdout: "oplen_avg": { 2024-09-21T01:05:47.353 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 2797, 2024-09-21T01:05:47.353 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 2926 2024-09-21T01:05:47.353 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.353 INFO:teuthology.orchestra.run.smithi193.stdout: "op": 2797, 2024-09-21T01:05:47.353 INFO:teuthology.orchestra.run.smithi193.stdout: "op_r": 1224, 2024-09-21T01:05:47.353 INFO:teuthology.orchestra.run.smithi193.stdout: "op_w": 1573, 2024-09-21T01:05:47.353 INFO:teuthology.orchestra.run.smithi193.stdout: "op_rmw": 0, 2024-09-21T01:05:47.353 INFO:teuthology.orchestra.run.smithi193.stdout: "op_pg": 0, 2024-09-21T01:05:47.354 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_stat": 0, 2024-09-21T01:05:47.354 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_create": 10, 2024-09-21T01:05:47.354 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_read": 39, 2024-09-21T01:05:47.354 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_write": 849, 2024-09-21T01:05:47.354 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_writefull": 54, 2024-09-21T01:05:47.354 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_writesame": 0, 2024-09-21T01:05:47.354 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_append": 0, 2024-09-21T01:05:47.354 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_zero": 0, 2024-09-21T01:05:47.354 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_truncate": 2, 2024-09-21T01:05:47.354 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_delete": 552, 2024-09-21T01:05:47.354 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_mapext": 0, 2024-09-21T01:05:47.354 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_sparse_read": 0, 2024-09-21T01:05:47.354 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_clonerange": 0, 2024-09-21T01:05:47.354 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_getxattr": 1185, 2024-09-21T01:05:47.354 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_setxattr": 20, 2024-09-21T01:05:47.355 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_cmpxattr": 0, 2024-09-21T01:05:47.355 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_rmxattr": 0, 2024-09-21T01:05:47.355 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_resetxattrs": 0, 2024-09-21T01:05:47.355 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_call": 0, 2024-09-21T01:05:47.355 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_watch": 0, 2024-09-21T01:05:47.355 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_notify": 0, 2024-09-21T01:05:47.355 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T01:05:47.355 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_pgls": 0, 2024-09-21T01:05:47.355 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_pgls_filter": 0, 2024-09-21T01:05:47.355 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_other": 0, 2024-09-21T01:05:47.355 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_active": 0, 2024-09-21T01:05:47.355 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_send": 0, 2024-09-21T01:05:47.355 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_resend": 0, 2024-09-21T01:05:47.355 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_ping": 0, 2024-09-21T01:05:47.355 INFO:teuthology.orchestra.run.smithi193.stdout: "poolop_active": 0, 2024-09-21T01:05:47.355 INFO:teuthology.orchestra.run.smithi193.stdout: "poolop_send": 0, 2024-09-21T01:05:47.356 INFO:teuthology.orchestra.run.smithi193.stdout: "poolop_resend": 0, 2024-09-21T01:05:47.356 INFO:teuthology.orchestra.run.smithi193.stdout: "poolstat_active": 0, 2024-09-21T01:05:47.356 INFO:teuthology.orchestra.run.smithi193.stdout: "poolstat_send": 0, 2024-09-21T01:05:47.356 INFO:teuthology.orchestra.run.smithi193.stdout: "poolstat_resend": 0, 2024-09-21T01:05:47.356 INFO:teuthology.orchestra.run.smithi193.stdout: "statfs_active": 0, 2024-09-21T01:05:47.356 INFO:teuthology.orchestra.run.smithi193.stdout: "statfs_send": 0, 2024-09-21T01:05:47.356 INFO:teuthology.orchestra.run.smithi193.stdout: "statfs_resend": 0, 2024-09-21T01:05:47.356 INFO:teuthology.orchestra.run.smithi193.stdout: "command_active": 0, 2024-09-21T01:05:47.356 INFO:teuthology.orchestra.run.smithi193.stdout: "command_send": 0, 2024-09-21T01:05:47.356 INFO:teuthology.orchestra.run.smithi193.stdout: "command_resend": 0, 2024-09-21T01:05:47.356 INFO:teuthology.orchestra.run.smithi193.stdout: "map_epoch": 75, 2024-09-21T01:05:47.356 INFO:teuthology.orchestra.run.smithi193.stdout: "map_full": 0, 2024-09-21T01:05:47.356 INFO:teuthology.orchestra.run.smithi193.stdout: "map_inc": 2, 2024-09-21T01:05:47.356 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_sessions": 12, 2024-09-21T01:05:47.356 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_session_open": 12, 2024-09-21T01:05:47.356 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_session_close": 0, 2024-09-21T01:05:47.357 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_laggy": 0, 2024-09-21T01:05:47.357 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_wr": 181, 2024-09-21T01:05:47.357 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_rd": 0, 2024-09-21T01:05:47.357 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_del": 34 2024-09-21T01:05:47.357 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.357 INFO:teuthology.orchestra.run.smithi193.stdout: "oft": { 2024-09-21T01:05:47.357 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_objs": 1, 2024-09-21T01:05:47.357 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_kv_pairs": 0, 2024-09-21T01:05:47.357 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_updates": 0, 2024-09-21T01:05:47.357 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_removes": 0 2024-09-21T01:05:47.357 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.357 INFO:teuthology.orchestra.run.smithi193.stdout: "purge_queue": { 2024-09-21T01:05:47.357 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing_ops": 0, 2024-09-21T01:05:47.357 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing_ops_high_water": 6, 2024-09-21T01:05:47.357 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing": 0, 2024-09-21T01:05:47.357 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing_high_water": 6, 2024-09-21T01:05:47.358 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executed_ops": 539, 2024-09-21T01:05:47.358 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executed": 539, 2024-09-21T01:05:47.358 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_item_in_journal": 0 2024-09-21T01:05:47.358 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.358 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:05:47.358 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-21T01:05:47.358 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 104857600, 2024-09-21T01:05:47.358 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-21T01:05:47.358 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 36062, 2024-09-21T01:05:47.358 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 11213308, 2024-09-21T01:05:47.358 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:47.358 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 36062, 2024-09-21T01:05:47.358 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 0, 2024-09-21T01:05:47.358 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 0, 2024-09-21T01:05:47.359 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 36062, 2024-09-21T01:05:47.359 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 11213308, 2024-09-21T01:05:47.359 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-21T01:05:47.359 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:47.359 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:47.359 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:47.359 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-21T01:05:47.359 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.359 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-objecter_bytes": { 2024-09-21T01:05:47.359 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-21T01:05:47.359 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 104857600, 2024-09-21T01:05:47.359 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-21T01:05:47.359 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 0, 2024-09-21T01:05:47.359 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 0, 2024-09-21T01:05:47.359 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:47.360 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 0, 2024-09-21T01:05:47.360 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 2797, 2024-09-21T01:05:47.360 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 6059596, 2024-09-21T01:05:47.360 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 2797, 2024-09-21T01:05:47.360 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 6059596, 2024-09-21T01:05:47.360 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-21T01:05:47.360 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:47.360 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:47.360 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:47.360 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-21T01:05:47.360 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.360 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-objecter_ops": { 2024-09-21T01:05:47.360 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-21T01:05:47.360 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 1024, 2024-09-21T01:05:47.360 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-21T01:05:47.360 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 0, 2024-09-21T01:05:47.361 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 0, 2024-09-21T01:05:47.361 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:47.361 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 0, 2024-09-21T01:05:47.361 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 2797, 2024-09-21T01:05:47.361 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 2797, 2024-09-21T01:05:47.361 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 2797, 2024-09-21T01:05:47.361 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 2797, 2024-09-21T01:05:47.361 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-21T01:05:47.361 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:47.361 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:47.361 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:47.361 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-21T01:05:47.361 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.361 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-write_buf_throttle": { 2024-09-21T01:05:47.361 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-21T01:05:47.361 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 3758096384, 2024-09-21T01:05:47.361 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-21T01:05:47.361 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 539, 2024-09-21T01:05:47.362 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 54439, 2024-09-21T01:05:47.362 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:47.362 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 539, 2024-09-21T01:05:47.362 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 0, 2024-09-21T01:05:47.362 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 0, 2024-09-21T01:05:47.362 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 39, 2024-09-21T01:05:47.362 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 54439, 2024-09-21T01:05:47.362 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-21T01:05:47.362 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:47.362 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:47.362 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:47.362 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-21T01:05:47.362 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.363 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-write_buf_throttle-0x563af2fb1520": { 2024-09-21T01:05:47.363 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-21T01:05:47.363 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 3758096384, 2024-09-21T01:05:47.363 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-21T01:05:47.363 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 3868, 2024-09-21T01:05:47.363 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 5568841, 2024-09-21T01:05:47.363 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:47.363 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 3868, 2024-09-21T01:05:47.363 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 0, 2024-09-21T01:05:47.363 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 0, 2024-09-21T01:05:47.363 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 810, 2024-09-21T01:05:47.363 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 5568841, 2024-09-21T01:05:47.363 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-21T01:05:47.363 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:47.364 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:47.364 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:47.364 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-21T01:05:47.364 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:47.364 INFO:teuthology.orchestra.run.smithi193.stdout: "trackedop": { 2024-09-21T01:05:47.364 INFO:teuthology.orchestra.run.smithi193.stdout: "slow_ops_count": 1 2024-09-21T01:05:47.364 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-21T01:05:47.364 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-09-21T01:05:48.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:47 smithi001 ceph-mon[31211]: pgmap v615: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-21T01:05:48.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:47 smithi193 ceph-mon[34660]: pgmap v615: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-21T01:05:48.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:47 smithi042 ceph-mon[34481]: pgmap v615: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-21T01:05:48.369 INFO:tasks.check_counter:Daemon mds.c mds.exported=16 2024-09-21T01:05:48.370 INFO:tasks.check_counter:Daemon mds.c mds.imported=2 2024-09-21T01:05:48.370 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=320 2024-09-21T01:05:48.370 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=4440 2024-09-21T01:05:48.370 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=2 2024-09-21T01:05:48.370 DEBUG:tasks.check_counter:Getting stats from f 2024-09-21T01:05:48.370 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph daemon mds.f perf dump 2024-09-21T01:05:48.621 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:05:49.141 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-09-21T01:05:49.142 INFO:teuthology.orchestra.run.smithi193.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:05:49.142 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_messages": 18244, 2024-09-21T01:05:49.142 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages": 14789, 2024-09-21T01:05:49.142 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_bytes": 7170951, 2024-09-21T01:05:49.142 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_bytes": 10745573, 2024-09-21T01:05:49.142 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_created_connections": 21, 2024-09-21T01:05:49.142 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_active_connections": 6, 2024-09-21T01:05:49.142 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_total_time": 1.248030783, 2024-09-21T01:05:49.142 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_send_time": 0.568518680, 2024-09-21T01:05:49.142 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_recv_time": 0.782337280, 2024-09-21T01:05:49.142 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_fast_dispatch_time": 0.067828092, 2024-09-21T01:05:49.143 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:05:49.143 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 14785, 2024-09-21T01:05:49.143 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.582058692, 2024-09-21T01:05:49.143 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000039368 2024-09-21T01:05:49.143 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.143 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:05:49.143 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 27235, 2024-09-21T01:05:49.143 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.004826975, 2024-09-21T01:05:49.143 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000177 2024-09-21T01:05:49.143 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.143 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T01:05:49.143 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T01:05:49.144 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.144 INFO:teuthology.orchestra.run.smithi193.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:05:49.144 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_messages": 4285, 2024-09-21T01:05:49.144 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages": 4195, 2024-09-21T01:05:49.144 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_bytes": 1260546, 2024-09-21T01:05:49.144 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_bytes": 1822111, 2024-09-21T01:05:49.144 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_created_connections": 9, 2024-09-21T01:05:49.144 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_active_connections": 6, 2024-09-21T01:05:49.144 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_total_time": 0.376153674, 2024-09-21T01:05:49.144 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_send_time": 0.185580946, 2024-09-21T01:05:49.144 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_recv_time": 0.162809439, 2024-09-21T01:05:49.144 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_fast_dispatch_time": 0.043418492, 2024-09-21T01:05:49.144 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:05:49.144 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 4195, 2024-09-21T01:05:49.145 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.229555981, 2024-09-21T01:05:49.145 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000054721 2024-09-21T01:05:49.145 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.145 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:05:49.145 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 5027, 2024-09-21T01:05:49.145 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.001092713, 2024-09-21T01:05:49.145 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000217 2024-09-21T01:05:49.145 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.145 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:05:49.145 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_encrypted_bytes": 326528 2024-09-21T01:05:49.145 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.145 INFO:teuthology.orchestra.run.smithi193.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:05:49.145 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_messages": 47864, 2024-09-21T01:05:49.145 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages": 42376, 2024-09-21T01:05:49.146 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_bytes": 17326640, 2024-09-21T01:05:49.146 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_bytes": 27454344, 2024-09-21T01:05:49.146 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_created_connections": 21, 2024-09-21T01:05:49.146 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_active_connections": 8, 2024-09-21T01:05:49.146 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_total_time": 2.310788184, 2024-09-21T01:05:49.146 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_send_time": 1.289801118, 2024-09-21T01:05:49.146 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_recv_time": 6.186774179, 2024-09-21T01:05:49.146 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_fast_dispatch_time": 0.077391116, 2024-09-21T01:05:49.146 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:05:49.146 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 42376, 2024-09-21T01:05:49.146 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 3.527332606, 2024-09-21T01:05:49.146 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000083238 2024-09-21T01:05:49.146 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.147 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:05:49.147 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 70594, 2024-09-21T01:05:49.147 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.012549765, 2024-09-21T01:05:49.147 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000177 2024-09-21T01:05:49.147 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.147 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_encrypted_bytes": 974064, 2024-09-21T01:05:49.147 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_encrypted_bytes": 126960 2024-09-21T01:05:49.147 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.147 INFO:teuthology.orchestra.run.smithi193.stdout: "cct": { 2024-09-21T01:05:49.147 INFO:teuthology.orchestra.run.smithi193.stdout: "total_workers": 1, 2024-09-21T01:05:49.147 INFO:teuthology.orchestra.run.smithi193.stdout: "unhealthy_workers": 0 2024-09-21T01:05:49.147 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.147 INFO:teuthology.orchestra.run.smithi193.stdout: "finisher-MDSRank": { 2024-09-21T01:05:49.147 INFO:teuthology.orchestra.run.smithi193.stdout: "queue_len": 0, 2024-09-21T01:05:49.147 INFO:teuthology.orchestra.run.smithi193.stdout: "complete_latency": { 2024-09-21T01:05:49.148 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 3795, 2024-09-21T01:05:49.148 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 6.710427112, 2024-09-21T01:05:49.148 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.001768228 2024-09-21T01:05:49.148 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-21T01:05:49.148 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.148 INFO:teuthology.orchestra.run.smithi193.stdout: "finisher-PurgeQueue": { 2024-09-21T01:05:49.148 INFO:teuthology.orchestra.run.smithi193.stdout: "queue_len": 0, 2024-09-21T01:05:49.148 INFO:teuthology.orchestra.run.smithi193.stdout: "complete_latency": { 2024-09-21T01:05:49.148 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 2791, 2024-09-21T01:05:49.148 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.172686290, 2024-09-21T01:05:49.148 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000061872 2024-09-21T01:05:49.148 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-21T01:05:49.148 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.149 INFO:teuthology.orchestra.run.smithi193.stdout: "mds": { 2024-09-21T01:05:49.149 INFO:teuthology.orchestra.run.smithi193.stdout: "request": 9689, 2024-09-21T01:05:49.149 INFO:teuthology.orchestra.run.smithi193.stdout: "reply": 9617, 2024-09-21T01:05:49.149 INFO:teuthology.orchestra.run.smithi193.stdout: "reply_latency": { 2024-09-21T01:05:49.149 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 9617, 2024-09-21T01:05:49.149 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 103.240827543, 2024-09-21T01:05:49.149 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.010735242 2024-09-21T01:05:49.149 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.149 INFO:teuthology.orchestra.run.smithi193.stdout: "slow_reply": 0, 2024-09-21T01:05:49.149 INFO:teuthology.orchestra.run.smithi193.stdout: "forward": 72, 2024-09-21T01:05:49.149 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_fetch_complete": 0, 2024-09-21T01:05:49.149 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_fetch_keys": 0, 2024-09-21T01:05:49.149 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_commit": 47, 2024-09-21T01:05:49.149 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_split": 4, 2024-09-21T01:05:49.149 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_merge": 0, 2024-09-21T01:05:49.150 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes": 25, 2024-09-21T01:05:49.150 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_top": 7, 2024-09-21T01:05:49.150 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_bottom": 8, 2024-09-21T01:05:49.150 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_pin_tail": 10, 2024-09-21T01:05:49.150 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_pinned": 13, 2024-09-21T01:05:49.150 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_expired": 432, 2024-09-21T01:05:49.150 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_with_caps": 0, 2024-09-21T01:05:49.150 INFO:teuthology.orchestra.run.smithi193.stdout: "caps": 0, 2024-09-21T01:05:49.150 INFO:teuthology.orchestra.run.smithi193.stdout: "subtrees": 4, 2024-09-21T01:05:49.150 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse": 22438, 2024-09-21T01:05:49.150 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_hit": 19023, 2024-09-21T01:05:49.150 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_forward": 72, 2024-09-21T01:05:49.150 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_discover": 201, 2024-09-21T01:05:49.151 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_dir_fetch": 0, 2024-09-21T01:05:49.151 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_remote_ino": 0, 2024-09-21T01:05:49.151 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_lock": 155, 2024-09-21T01:05:49.151 INFO:teuthology.orchestra.run.smithi193.stdout: "load_cent": 0, 2024-09-21T01:05:49.151 INFO:teuthology.orchestra.run.smithi193.stdout: "q": 0, 2024-09-21T01:05:49.151 INFO:teuthology.orchestra.run.smithi193.stdout: "exported": 33, 2024-09-21T01:05:49.151 INFO:teuthology.orchestra.run.smithi193.stdout: "exported_inodes": 53, 2024-09-21T01:05:49.151 INFO:teuthology.orchestra.run.smithi193.stdout: "imported": 5, 2024-09-21T01:05:49.151 INFO:teuthology.orchestra.run.smithi193.stdout: "imported_inodes": 639, 2024-09-21T01:05:49.151 INFO:teuthology.orchestra.run.smithi193.stdout: "openino_dir_fetch": 0, 2024-09-21T01:05:49.151 INFO:teuthology.orchestra.run.smithi193.stdout: "openino_backtrace_fetch": 3388, 2024-09-21T01:05:49.152 INFO:teuthology.orchestra.run.smithi193.stdout: "openino_peer_discover": 0, 2024-09-21T01:05:49.152 INFO:teuthology.orchestra.run.smithi193.stdout: "root_rfiles": 11953, 2024-09-21T01:05:49.152 INFO:teuthology.orchestra.run.smithi193.stdout: "root_rbytes": 230111924, 2024-09-21T01:05:49.152 INFO:teuthology.orchestra.run.smithi193.stdout: "root_rsnaps": 0, 2024-09-21T01:05:49.152 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_backtrace_fetch": 3388, 2024-09-21T01:05:49.152 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_set_tag": 0, 2024-09-21T01:05:49.152 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T01:05:49.152 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_inotable_repaired": 0, 2024-09-21T01:05:49.152 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_dir_inodes": 0, 2024-09-21T01:05:49.152 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T01:05:49.152 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T01:05:49.152 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_file_inodes": 3388, 2024-09-21T01:05:49.152 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_inode_file_caps": 136, 2024-09-21T01:05:49.152 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_revoke": 8783, 2024-09-21T01:05:49.153 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_grant": 9035, 2024-09-21T01:05:49.153 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T01:05:49.153 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T01:05:49.153 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T01:05:49.153 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_caps": 27908, 2024-09-21T01:05:49.153 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_caps_dirty": 1365, 2024-09-21T01:05:49.153 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_cap_release": 60, 2024-09-21T01:05:49.153 INFO:teuthology.orchestra.run.smithi193.stdout: "process_request_cap_release": 5502 2024-09-21T01:05:49.153 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.153 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_cache": { 2024-09-21T01:05:49.153 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_update": 802, 2024-09-21T01:05:49.153 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_update_receipt": 4280, 2024-09-21T01:05:49.153 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_try_discover": 2479, 2024-09-21T01:05:49.153 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_send_discover": 3208, 2024-09-21T01:05:49.154 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_handle_discover": 727, 2024-09-21T01:05:49.154 INFO:teuthology.orchestra.run.smithi193.stdout: "num_strays": 0, 2024-09-21T01:05:49.154 INFO:teuthology.orchestra.run.smithi193.stdout: "num_strays_delayed": 0, 2024-09-21T01:05:49.154 INFO:teuthology.orchestra.run.smithi193.stdout: "num_strays_enqueuing": 0, 2024-09-21T01:05:49.154 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_created": 1377, 2024-09-21T01:05:49.154 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_enqueued": 1377, 2024-09-21T01:05:49.154 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_reintegrated": 0, 2024-09-21T01:05:49.154 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_migrated": 0, 2024-09-21T01:05:49.154 INFO:teuthology.orchestra.run.smithi193.stdout: "num_recovering_processing": 0, 2024-09-21T01:05:49.154 INFO:teuthology.orchestra.run.smithi193.stdout: "num_recovering_enqueued": 0, 2024-09-21T01:05:49.154 INFO:teuthology.orchestra.run.smithi193.stdout: "num_recovering_prioritized": 0, 2024-09-21T01:05:49.154 INFO:teuthology.orchestra.run.smithi193.stdout: "recovery_started": 0, 2024-09-21T01:05:49.154 INFO:teuthology.orchestra.run.smithi193.stdout: "recovery_completed": 0, 2024-09-21T01:05:49.154 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_quiesce_path": 0, 2024-09-21T01:05:49.155 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_quiesce_inode": 0, 2024-09-21T01:05:49.155 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T01:05:49.155 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_exportdir": 33, 2024-09-21T01:05:49.155 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_flush": 0, 2024-09-21T01:05:49.155 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_fragmentdir": 4, 2024-09-21T01:05:49.155 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_fragstats": 0, 2024-09-21T01:05:49.155 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_inodestats": 0, 2024-09-21T01:05:49.155 INFO:teuthology.orchestra.run.smithi193.stdout: "uninline_started": 0, 2024-09-21T01:05:49.155 INFO:teuthology.orchestra.run.smithi193.stdout: "uninline_succeeded": 0, 2024-09-21T01:05:49.155 INFO:teuthology.orchestra.run.smithi193.stdout: "uninline_write_failed": 0 2024-09-21T01:05:49.155 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.155 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_log": { 2024-09-21T01:05:49.155 INFO:teuthology.orchestra.run.smithi193.stdout: "evlrg": 0, 2024-09-21T01:05:49.156 INFO:teuthology.orchestra.run.smithi193.stdout: "evadd": 10440, 2024-09-21T01:05:49.156 INFO:teuthology.orchestra.run.smithi193.stdout: "evex": 0, 2024-09-21T01:05:49.156 INFO:teuthology.orchestra.run.smithi193.stdout: "evtrm": 0, 2024-09-21T01:05:49.156 INFO:teuthology.orchestra.run.smithi193.stdout: "ev": 10440, 2024-09-21T01:05:49.156 INFO:teuthology.orchestra.run.smithi193.stdout: "evexg": 0, 2024-09-21T01:05:49.156 INFO:teuthology.orchestra.run.smithi193.stdout: "evexd": 0, 2024-09-21T01:05:49.156 INFO:teuthology.orchestra.run.smithi193.stdout: "segadd": 12, 2024-09-21T01:05:49.156 INFO:teuthology.orchestra.run.smithi193.stdout: "segex": 0, 2024-09-21T01:05:49.156 INFO:teuthology.orchestra.run.smithi193.stdout: "segtrm": 0, 2024-09-21T01:05:49.156 INFO:teuthology.orchestra.run.smithi193.stdout: "seg": 12, 2024-09-21T01:05:49.156 INFO:teuthology.orchestra.run.smithi193.stdout: "segmjr": 2, 2024-09-21T01:05:49.156 INFO:teuthology.orchestra.run.smithi193.stdout: "segexg": 0, 2024-09-21T01:05:49.156 INFO:teuthology.orchestra.run.smithi193.stdout: "segexd": 0, 2024-09-21T01:05:49.156 INFO:teuthology.orchestra.run.smithi193.stdout: "expos": 4194304, 2024-09-21T01:05:49.157 INFO:teuthology.orchestra.run.smithi193.stdout: "wrpos": 19332766, 2024-09-21T01:05:49.157 INFO:teuthology.orchestra.run.smithi193.stdout: "rdpos": 0, 2024-09-21T01:05:49.157 INFO:teuthology.orchestra.run.smithi193.stdout: "jlat": { 2024-09-21T01:05:49.157 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 1875, 2024-09-21T01:05:49.157 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 36.208715334, 2024-09-21T01:05:49.157 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.019311314 2024-09-21T01:05:49.157 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.157 INFO:teuthology.orchestra.run.smithi193.stdout: "replayed": 0 2024-09-21T01:05:49.157 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.157 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_mem": { 2024-09-21T01:05:49.157 INFO:teuthology.orchestra.run.smithi193.stdout: "ino": 30, 2024-09-21T01:05:49.157 INFO:teuthology.orchestra.run.smithi193.stdout: "ino+": 1605, 2024-09-21T01:05:49.157 INFO:teuthology.orchestra.run.smithi193.stdout: "ino-": 1575, 2024-09-21T01:05:49.158 INFO:teuthology.orchestra.run.smithi193.stdout: "dir": 29, 2024-09-21T01:05:49.158 INFO:teuthology.orchestra.run.smithi193.stdout: "dir+": 2008, 2024-09-21T01:05:49.158 INFO:teuthology.orchestra.run.smithi193.stdout: "dir-": 1979, 2024-09-21T01:05:49.158 INFO:teuthology.orchestra.run.smithi193.stdout: "dn": 25, 2024-09-21T01:05:49.158 INFO:teuthology.orchestra.run.smithi193.stdout: "dn+": 3553, 2024-09-21T01:05:49.158 INFO:teuthology.orchestra.run.smithi193.stdout: "dn-": 3528, 2024-09-21T01:05:49.158 INFO:teuthology.orchestra.run.smithi193.stdout: "cap": 0, 2024-09-21T01:05:49.158 INFO:teuthology.orchestra.run.smithi193.stdout: "cap+": 2294, 2024-09-21T01:05:49.158 INFO:teuthology.orchestra.run.smithi193.stdout: "cap-": 2294, 2024-09-21T01:05:49.158 INFO:teuthology.orchestra.run.smithi193.stdout: "rss": 139980, 2024-09-21T01:05:49.158 INFO:teuthology.orchestra.run.smithi193.stdout: "heap": 349061120 2024-09-21T01:05:49.158 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.158 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_server": { 2024-09-21T01:05:49.159 INFO:teuthology.orchestra.run.smithi193.stdout: "dispatch_client_request": 10256, 2024-09-21T01:05:49.159 INFO:teuthology.orchestra.run.smithi193.stdout: "dispatch_server_request": 630, 2024-09-21T01:05:49.159 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_request": 9689, 2024-09-21T01:05:49.159 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_session": 6, 2024-09-21T01:05:49.159 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_peer_request": 1324, 2024-09-21T01:05:49.159 INFO:teuthology.orchestra.run.smithi193.stdout: "req_create_latency": { 2024-09-21T01:05:49.159 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 1069, 2024-09-21T01:05:49.159 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 3.964264773, 2024-09-21T01:05:49.159 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.003708386 2024-09-21T01:05:49.160 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.160 INFO:teuthology.orchestra.run.smithi193.stdout: "req_getattr_latency": { 2024-09-21T01:05:49.160 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 94, 2024-09-21T01:05:49.160 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 8.325351016, 2024-09-21T01:05:49.160 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.088567564 2024-09-21T01:05:49.160 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.161 INFO:teuthology.orchestra.run.smithi193.stdout: "req_getfilelock_latency": { 2024-09-21T01:05:49.161 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:49.161 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:49.161 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:49.161 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.161 INFO:teuthology.orchestra.run.smithi193.stdout: "req_link_latency": { 2024-09-21T01:05:49.161 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:49.161 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:49.161 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:49.162 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.162 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookup_latency": { 2024-09-21T01:05:49.162 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 5395, 2024-09-21T01:05:49.162 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 83.584667192, 2024-09-21T01:05:49.162 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.015492987 2024-09-21T01:05:49.162 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.162 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookuphash_latency": { 2024-09-21T01:05:49.162 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:49.162 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:49.163 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:49.163 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.163 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupino_latency": { 2024-09-21T01:05:49.163 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:49.163 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:49.163 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:49.163 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.163 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupname_latency": { 2024-09-21T01:05:49.163 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:49.163 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:49.164 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:49.164 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.164 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupparent_latency": { 2024-09-21T01:05:49.164 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:49.164 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:49.164 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:49.164 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.164 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupsnap_latency": { 2024-09-21T01:05:49.164 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:49.165 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:49.165 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:49.165 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.165 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lssnap_latency": { 2024-09-21T01:05:49.165 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:49.165 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:49.166 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:49.166 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.166 INFO:teuthology.orchestra.run.smithi193.stdout: "req_mkdir_latency": { 2024-09-21T01:05:49.166 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:49.166 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:49.166 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:49.166 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.166 INFO:teuthology.orchestra.run.smithi193.stdout: "req_mknod_latency": { 2024-09-21T01:05:49.166 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:49.166 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:49.166 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:49.166 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.166 INFO:teuthology.orchestra.run.smithi193.stdout: "req_mksnap_latency": { 2024-09-21T01:05:49.167 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:49.167 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:49.167 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:49.167 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.167 INFO:teuthology.orchestra.run.smithi193.stdout: "req_open_latency": { 2024-09-21T01:05:49.167 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 1084, 2024-09-21T01:05:49.167 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 1.728638131, 2024-09-21T01:05:49.167 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.001594684 2024-09-21T01:05:49.167 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.167 INFO:teuthology.orchestra.run.smithi193.stdout: "req_readdir_latency": { 2024-09-21T01:05:49.167 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 33, 2024-09-21T01:05:49.167 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.031916059, 2024-09-21T01:05:49.167 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000967153 2024-09-21T01:05:49.167 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.167 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rename_latency": { 2024-09-21T01:05:49.168 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 1072, 2024-09-21T01:05:49.168 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 4.528121828, 2024-09-21T01:05:49.168 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.004223994 2024-09-21T01:05:49.168 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.168 INFO:teuthology.orchestra.run.smithi193.stdout: "req_renamesnap_latency": { 2024-09-21T01:05:49.168 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:49.168 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:49.168 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:49.168 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.168 INFO:teuthology.orchestra.run.smithi193.stdout: "req_snapdiff_latency": { 2024-09-21T01:05:49.168 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:49.168 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:49.168 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:49.168 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.168 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rmdir_latency": { 2024-09-21T01:05:49.169 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:49.169 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:49.169 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:49.169 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.169 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rmsnap_latency": { 2024-09-21T01:05:49.169 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:49.169 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:49.169 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:49.169 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.169 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rmxattr_latency": { 2024-09-21T01:05:49.169 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:49.169 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:49.170 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:49.170 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.170 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setattr_latency": { 2024-09-21T01:05:49.170 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:49.170 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:49.170 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:49.170 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.170 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setdirlayout_latency": { 2024-09-21T01:05:49.170 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:49.170 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:49.170 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:49.170 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.170 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setfilelock_latency": { 2024-09-21T01:05:49.170 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:49.171 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:49.171 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:49.171 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.171 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setlayout_latency": { 2024-09-21T01:05:49.171 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:49.171 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:49.171 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:49.171 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.171 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setxattr_latency": { 2024-09-21T01:05:49.171 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:49.171 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:49.171 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:49.171 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.172 INFO:teuthology.orchestra.run.smithi193.stdout: "req_symlink_latency": { 2024-09-21T01:05:49.172 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:49.172 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:49.172 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:49.172 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.172 INFO:teuthology.orchestra.run.smithi193.stdout: "req_unlink_latency": { 2024-09-21T01:05:49.172 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 870, 2024-09-21T01:05:49.172 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 1.077868544, 2024-09-21T01:05:49.172 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.001238929 2024-09-21T01:05:49.172 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.172 INFO:teuthology.orchestra.run.smithi193.stdout: "cap_revoke_eviction": 0, 2024-09-21T01:05:49.172 INFO:teuthology.orchestra.run.smithi193.stdout: "cap_acquisition_throttle": 0, 2024-09-21T01:05:49.172 INFO:teuthology.orchestra.run.smithi193.stdout: "req_getvxattr_latency": { 2024-09-21T01:05:49.172 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:49.173 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:49.173 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:49.173 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-21T01:05:49.173 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.173 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_sessions": { 2024-09-21T01:05:49.173 INFO:teuthology.orchestra.run.smithi193.stdout: "session_count": 1, 2024-09-21T01:05:49.173 INFO:teuthology.orchestra.run.smithi193.stdout: "session_add": 1, 2024-09-21T01:05:49.173 INFO:teuthology.orchestra.run.smithi193.stdout: "session_remove": 0, 2024-09-21T01:05:49.173 INFO:teuthology.orchestra.run.smithi193.stdout: "sessions_open": 1, 2024-09-21T01:05:49.173 INFO:teuthology.orchestra.run.smithi193.stdout: "sessions_stale": 0, 2024-09-21T01:05:49.173 INFO:teuthology.orchestra.run.smithi193.stdout: "total_load": 1998, 2024-09-21T01:05:49.173 INFO:teuthology.orchestra.run.smithi193.stdout: "average_load": 1998, 2024-09-21T01:05:49.173 INFO:teuthology.orchestra.run.smithi193.stdout: "avg_session_uptime": 1845, 2024-09-21T01:05:49.173 INFO:teuthology.orchestra.run.smithi193.stdout: "mdthresh_evicted": 0 2024-09-21T01:05:49.174 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.174 INFO:teuthology.orchestra.run.smithi193.stdout: "mempool": { 2024-09-21T01:05:49.174 INFO:teuthology.orchestra.run.smithi193.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:05:49.174 INFO:teuthology.orchestra.run.smithi193.stdout: "bloom_filter_items": 0, 2024-09-21T01:05:49.174 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:05:49.174 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:05:49.174 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:05:49.174 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:05:49.174 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:05:49.174 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:05:49.174 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:05:49.174 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:05:49.174 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:05:49.174 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:05:49.174 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:05:49.175 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:05:49.175 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:05:49.175 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_extent_items": 0, 2024-09-21T01:05:49.175 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:05:49.175 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_blob_items": 0, 2024-09-21T01:05:49.175 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:05:49.175 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:05:49.175 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:05:49.175 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:05:49.175 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:05:49.175 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:05:49.175 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:05:49.175 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_txc_items": 0, 2024-09-21T01:05:49.175 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:05:49.176 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:05:49.176 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:05:49.176 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_items": 0, 2024-09-21T01:05:49.176 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_bytes": 0, 2024-09-21T01:05:49.176 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_items": 0, 2024-09-21T01:05:49.176 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:05:49.176 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:05:49.176 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:05:49.176 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:05:49.176 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_anon_bytes": 296865, 2024-09-21T01:05:49.176 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_anon_items": 112, 2024-09-21T01:05:49.176 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_meta_bytes": 176, 2024-09-21T01:05:49.176 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_meta_items": 2, 2024-09-21T01:05:49.177 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_bytes": 0, 2024-09-21T01:05:49.177 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_items": 0, 2024-09-21T01:05:49.177 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:05:49.177 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_mapbl_items": 0, 2024-09-21T01:05:49.177 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:05:49.177 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_pglog_items": 0, 2024-09-21T01:05:49.177 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_bytes": 7688, 2024-09-21T01:05:49.177 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_items": 158, 2024-09-21T01:05:49.177 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:05:49.177 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:05:49.177 INFO:teuthology.orchestra.run.smithi193.stdout: "pgmap_bytes": 0, 2024-09-21T01:05:49.177 INFO:teuthology.orchestra.run.smithi193.stdout: "pgmap_items": 0, 2024-09-21T01:05:49.177 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_co_bytes": 124345, 2024-09-21T01:05:49.177 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_co_items": 554, 2024-09-21T01:05:49.177 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_1_bytes": 0, 2024-09-21T01:05:49.177 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_1_items": 0, 2024-09-21T01:05:49.178 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_2_bytes": 0, 2024-09-21T01:05:49.178 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_2_items": 0 2024-09-21T01:05:49.178 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.178 INFO:teuthology.orchestra.run.smithi193.stdout: "objecter": { 2024-09-21T01:05:49.178 INFO:teuthology.orchestra.run.smithi193.stdout: "op_active": 0, 2024-09-21T01:05:49.178 INFO:teuthology.orchestra.run.smithi193.stdout: "op_laggy": 0, 2024-09-21T01:05:49.178 INFO:teuthology.orchestra.run.smithi193.stdout: "op_send": 7100, 2024-09-21T01:05:49.178 INFO:teuthology.orchestra.run.smithi193.stdout: "op_send_bytes": 16165364, 2024-09-21T01:05:49.178 INFO:teuthology.orchestra.run.smithi193.stdout: "op_resend": 33, 2024-09-21T01:05:49.178 INFO:teuthology.orchestra.run.smithi193.stdout: "op_reply": 7100, 2024-09-21T01:05:49.179 INFO:teuthology.orchestra.run.smithi193.stdout: "op_latency": { 2024-09-21T01:05:49.179 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 7100, 2024-09-21T01:05:49.179 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 38.929412415, 2024-09-21T01:05:49.179 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.005483015 2024-09-21T01:05:49.179 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.179 INFO:teuthology.orchestra.run.smithi193.stdout: "op_inflight": 0, 2024-09-21T01:05:49.179 INFO:teuthology.orchestra.run.smithi193.stdout: "oplen_avg": { 2024-09-21T01:05:49.179 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 7100, 2024-09-21T01:05:49.179 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 7321 2024-09-21T01:05:49.179 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.179 INFO:teuthology.orchestra.run.smithi193.stdout: "op": 7100, 2024-09-21T01:05:49.179 INFO:teuthology.orchestra.run.smithi193.stdout: "op_r": 3472, 2024-09-21T01:05:49.179 INFO:teuthology.orchestra.run.smithi193.stdout: "op_w": 3628, 2024-09-21T01:05:49.180 INFO:teuthology.orchestra.run.smithi193.stdout: "op_rmw": 0, 2024-09-21T01:05:49.180 INFO:teuthology.orchestra.run.smithi193.stdout: "op_pg": 0, 2024-09-21T01:05:49.180 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_stat": 0, 2024-09-21T01:05:49.180 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_create": 10, 2024-09-21T01:05:49.180 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_read": 84, 2024-09-21T01:05:49.180 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_write": 1959, 2024-09-21T01:05:49.180 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_writefull": 77, 2024-09-21T01:05:49.180 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_writesame": 0, 2024-09-21T01:05:49.180 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_append": 0, 2024-09-21T01:05:49.180 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_zero": 0, 2024-09-21T01:05:49.180 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_truncate": 4, 2024-09-21T01:05:49.180 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_delete": 1392, 2024-09-21T01:05:49.180 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_mapext": 0, 2024-09-21T01:05:49.180 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_sparse_read": 0, 2024-09-21T01:05:49.180 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_clonerange": 0, 2024-09-21T01:05:49.181 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_getxattr": 3388, 2024-09-21T01:05:49.181 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_setxattr": 20, 2024-09-21T01:05:49.181 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_cmpxattr": 0, 2024-09-21T01:05:49.181 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_rmxattr": 0, 2024-09-21T01:05:49.181 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_resetxattrs": 0, 2024-09-21T01:05:49.181 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_call": 0, 2024-09-21T01:05:49.181 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_watch": 0, 2024-09-21T01:05:49.181 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_notify": 0, 2024-09-21T01:05:49.181 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T01:05:49.181 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_pgls": 0, 2024-09-21T01:05:49.181 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_pgls_filter": 0, 2024-09-21T01:05:49.181 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_other": 0, 2024-09-21T01:05:49.181 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_active": 0, 2024-09-21T01:05:49.181 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_send": 0, 2024-09-21T01:05:49.181 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_resend": 0, 2024-09-21T01:05:49.181 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_ping": 0, 2024-09-21T01:05:49.182 INFO:teuthology.orchestra.run.smithi193.stdout: "poolop_active": 0, 2024-09-21T01:05:49.182 INFO:teuthology.orchestra.run.smithi193.stdout: "poolop_send": 0, 2024-09-21T01:05:49.182 INFO:teuthology.orchestra.run.smithi193.stdout: "poolop_resend": 0, 2024-09-21T01:05:49.182 INFO:teuthology.orchestra.run.smithi193.stdout: "poolstat_active": 0, 2024-09-21T01:05:49.182 INFO:teuthology.orchestra.run.smithi193.stdout: "poolstat_send": 0, 2024-09-21T01:05:49.182 INFO:teuthology.orchestra.run.smithi193.stdout: "poolstat_resend": 0, 2024-09-21T01:05:49.182 INFO:teuthology.orchestra.run.smithi193.stdout: "statfs_active": 0, 2024-09-21T01:05:49.182 INFO:teuthology.orchestra.run.smithi193.stdout: "statfs_send": 0, 2024-09-21T01:05:49.182 INFO:teuthology.orchestra.run.smithi193.stdout: "statfs_resend": 0, 2024-09-21T01:05:49.183 INFO:teuthology.orchestra.run.smithi193.stdout: "command_active": 0, 2024-09-21T01:05:49.183 INFO:teuthology.orchestra.run.smithi193.stdout: "command_send": 0, 2024-09-21T01:05:49.183 INFO:teuthology.orchestra.run.smithi193.stdout: "command_resend": 0, 2024-09-21T01:05:49.183 INFO:teuthology.orchestra.run.smithi193.stdout: "map_epoch": 75, 2024-09-21T01:05:49.183 INFO:teuthology.orchestra.run.smithi193.stdout: "map_full": 0, 2024-09-21T01:05:49.183 INFO:teuthology.orchestra.run.smithi193.stdout: "map_inc": 2, 2024-09-21T01:05:49.183 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_sessions": 12, 2024-09-21T01:05:49.183 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_session_open": 12, 2024-09-21T01:05:49.183 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_session_close": 0, 2024-09-21T01:05:49.183 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_laggy": 0, 2024-09-21T01:05:49.183 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_wr": 319, 2024-09-21T01:05:49.183 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_rd": 0, 2024-09-21T01:05:49.183 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_del": 68 2024-09-21T01:05:49.184 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.184 INFO:teuthology.orchestra.run.smithi193.stdout: "oft": { 2024-09-21T01:05:49.184 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_objs": 1, 2024-09-21T01:05:49.184 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_kv_pairs": 0, 2024-09-21T01:05:49.184 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_updates": 0, 2024-09-21T01:05:49.184 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_removes": 0 2024-09-21T01:05:49.184 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.184 INFO:teuthology.orchestra.run.smithi193.stdout: "purge_queue": { 2024-09-21T01:05:49.184 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing_ops": 0, 2024-09-21T01:05:49.184 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing_ops_high_water": 6, 2024-09-21T01:05:49.184 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing": 0, 2024-09-21T01:05:49.184 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing_high_water": 6, 2024-09-21T01:05:49.184 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executed_ops": 1377, 2024-09-21T01:05:49.184 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executed": 1377, 2024-09-21T01:05:49.185 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_item_in_journal": 0 2024-09-21T01:05:49.185 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.185 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:05:49.185 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-21T01:05:49.185 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 104857600, 2024-09-21T01:05:49.185 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-21T01:05:49.185 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 70389, 2024-09-21T01:05:49.185 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 19407019, 2024-09-21T01:05:49.185 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:49.185 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 70389, 2024-09-21T01:05:49.185 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 0, 2024-09-21T01:05:49.185 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 0, 2024-09-21T01:05:49.185 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 70389, 2024-09-21T01:05:49.185 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 19407019, 2024-09-21T01:05:49.186 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-21T01:05:49.186 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:49.186 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:49.186 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:49.186 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-21T01:05:49.186 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.186 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-objecter_bytes": { 2024-09-21T01:05:49.186 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-21T01:05:49.186 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 104857600, 2024-09-21T01:05:49.186 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-21T01:05:49.186 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 0, 2024-09-21T01:05:49.186 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 0, 2024-09-21T01:05:49.186 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:49.186 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 0, 2024-09-21T01:05:49.186 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 7100, 2024-09-21T01:05:49.187 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 16304441, 2024-09-21T01:05:49.187 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 7100, 2024-09-21T01:05:49.187 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 16304441, 2024-09-21T01:05:49.187 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-21T01:05:49.187 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:49.187 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:49.187 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:49.187 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-21T01:05:49.187 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.187 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-objecter_ops": { 2024-09-21T01:05:49.188 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-21T01:05:49.188 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 1024, 2024-09-21T01:05:49.188 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-21T01:05:49.188 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 0, 2024-09-21T01:05:49.188 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 0, 2024-09-21T01:05:49.188 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:49.188 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 0, 2024-09-21T01:05:49.188 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 7100, 2024-09-21T01:05:49.188 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 7100, 2024-09-21T01:05:49.188 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 7100, 2024-09-21T01:05:49.188 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 7100, 2024-09-21T01:05:49.188 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-21T01:05:49.188 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:49.189 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:49.189 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:49.189 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-21T01:05:49.189 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.189 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-write_buf_throttle": { 2024-09-21T01:05:49.189 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-21T01:05:49.189 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 3758096384, 2024-09-21T01:05:49.189 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-21T01:05:49.189 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 1377, 2024-09-21T01:05:49.189 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 139077, 2024-09-21T01:05:49.189 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:49.189 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 1377, 2024-09-21T01:05:49.189 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 0, 2024-09-21T01:05:49.189 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 0, 2024-09-21T01:05:49.189 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 84, 2024-09-21T01:05:49.190 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 139077, 2024-09-21T01:05:49.190 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-21T01:05:49.190 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:49.190 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:49.190 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:49.190 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-21T01:05:49.190 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.190 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-write_buf_throttle-0x5580694732b0": { 2024-09-21T01:05:49.190 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-21T01:05:49.190 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 3758096384, 2024-09-21T01:05:49.190 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-21T01:05:49.190 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 10440, 2024-09-21T01:05:49.190 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 15138462, 2024-09-21T01:05:49.191 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:49.191 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 10440, 2024-09-21T01:05:49.191 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 0, 2024-09-21T01:05:49.191 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 0, 2024-09-21T01:05:49.191 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 1875, 2024-09-21T01:05:49.191 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 15138462, 2024-09-21T01:05:49.191 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-21T01:05:49.191 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:49.191 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:49.191 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:49.191 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-21T01:05:49.191 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:49.191 INFO:teuthology.orchestra.run.smithi193.stdout: "trackedop": { 2024-09-21T01:05:49.191 INFO:teuthology.orchestra.run.smithi193.stdout: "slow_ops_count": 0 2024-09-21T01:05:49.191 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-21T01:05:49.192 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-09-21T01:05:49.959 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:49 smithi193 ceph-mon[34660]: pgmap v616: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 12 op/s 2024-09-21T01:05:49.986 INFO:tasks.check_counter:Daemon mds.f mds.exported=33 2024-09-21T01:05:49.986 INFO:tasks.check_counter:Daemon mds.f mds.imported=5 2024-09-21T01:05:49.987 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=802 2024-09-21T01:05:49.987 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=4280 2024-09-21T01:05:49.987 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=4 2024-09-21T01:05:49.987 DEBUG:tasks.check_counter:Getting stats from i 2024-09-21T01:05:49.987 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph daemon mds.i perf dump 2024-09-21T01:05:50.026 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:49 smithi001 ceph-mon[31211]: pgmap v616: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 12 op/s 2024-09-21T01:05:50.233 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:05:50.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:49 smithi042 ceph-mon[34481]: pgmap v616: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 12 op/s 2024-09-21T01:05:50.727 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-09-21T01:05:50.727 INFO:teuthology.orchestra.run.smithi193.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:05:50.727 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_messages": 5111, 2024-09-21T01:05:50.727 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages": 4705, 2024-09-21T01:05:50.727 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_bytes": 1509053, 2024-09-21T01:05:50.727 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_bytes": 13274696, 2024-09-21T01:05:50.727 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_created_connections": 10, 2024-09-21T01:05:50.727 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_active_connections": 5, 2024-09-21T01:05:50.727 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_total_time": 0.479251991, 2024-09-21T01:05:50.728 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_send_time": 0.239094700, 2024-09-21T01:05:50.728 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_recv_time": 0.184035904, 2024-09-21T01:05:50.728 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_fast_dispatch_time": 0.066826347, 2024-09-21T01:05:50.728 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:05:50.728 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 4703, 2024-09-21T01:05:50.728 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.358876153, 2024-09-21T01:05:50.728 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000076307 2024-09-21T01:05:50.728 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.728 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:05:50.728 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 5309, 2024-09-21T01:05:50.728 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.001011625, 2024-09-21T01:05:50.728 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000190 2024-09-21T01:05:50.728 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.728 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T01:05:50.728 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T01:05:50.729 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.729 INFO:teuthology.orchestra.run.smithi193.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:05:50.729 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_messages": 38563, 2024-09-21T01:05:50.729 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages": 38549, 2024-09-21T01:05:50.729 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_bytes": 13623034, 2024-09-21T01:05:50.729 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_bytes": 20582207, 2024-09-21T01:05:50.729 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_created_connections": 13, 2024-09-21T01:05:50.729 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_active_connections": 7, 2024-09-21T01:05:50.729 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_total_time": 2.016709803, 2024-09-21T01:05:50.729 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_send_time": 1.113817159, 2024-09-21T01:05:50.729 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_recv_time": 4.076942542, 2024-09-21T01:05:50.729 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_fast_dispatch_time": 0.044017523, 2024-09-21T01:05:50.729 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:05:50.729 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 38548, 2024-09-21T01:05:50.730 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 2.115868626, 2024-09-21T01:05:50.730 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000054889 2024-09-21T01:05:50.730 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.730 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:05:50.730 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 63926, 2024-09-21T01:05:50.730 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.010532056, 2024-09-21T01:05:50.730 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000164 2024-09-21T01:05:50.730 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.730 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_encrypted_bytes": 984720, 2024-09-21T01:05:50.730 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_encrypted_bytes": 123408 2024-09-21T01:05:50.730 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.730 INFO:teuthology.orchestra.run.smithi193.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:05:50.730 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_messages": 13187, 2024-09-21T01:05:50.731 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages": 9984, 2024-09-21T01:05:50.731 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_bytes": 5887430, 2024-09-21T01:05:50.731 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_bytes": 3523117, 2024-09-21T01:05:50.731 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_created_connections": 28, 2024-09-21T01:05:50.731 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_active_connections": 8, 2024-09-21T01:05:50.731 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_total_time": 0.959939801, 2024-09-21T01:05:50.731 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_send_time": 0.439689315, 2024-09-21T01:05:50.731 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_recv_time": 0.602773921, 2024-09-21T01:05:50.731 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_fast_dispatch_time": 0.052888075, 2024-09-21T01:05:50.731 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:05:50.731 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 9983, 2024-09-21T01:05:50.731 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.414798032, 2024-09-21T01:05:50.731 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000041550 2024-09-21T01:05:50.731 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.732 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:05:50.732 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 19945, 2024-09-21T01:05:50.732 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.003484367, 2024-09-21T01:05:50.732 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000174 2024-09-21T01:05:50.732 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.732 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-09-21T01:05:50.732 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_encrypted_bytes": 328352 2024-09-21T01:05:50.732 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.732 INFO:teuthology.orchestra.run.smithi193.stdout: "cct": { 2024-09-21T01:05:50.732 INFO:teuthology.orchestra.run.smithi193.stdout: "total_workers": 1, 2024-09-21T01:05:50.732 INFO:teuthology.orchestra.run.smithi193.stdout: "unhealthy_workers": 0 2024-09-21T01:05:50.732 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.732 INFO:teuthology.orchestra.run.smithi193.stdout: "finisher-MDSRank": { 2024-09-21T01:05:50.732 INFO:teuthology.orchestra.run.smithi193.stdout: "queue_len": 0, 2024-09-21T01:05:50.732 INFO:teuthology.orchestra.run.smithi193.stdout: "complete_latency": { 2024-09-21T01:05:50.733 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 2280, 2024-09-21T01:05:50.733 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 5.378332410, 2024-09-21T01:05:50.733 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.002358917 2024-09-21T01:05:50.733 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-21T01:05:50.733 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.733 INFO:teuthology.orchestra.run.smithi193.stdout: "finisher-PurgeQueue": { 2024-09-21T01:05:50.733 INFO:teuthology.orchestra.run.smithi193.stdout: "queue_len": 0, 2024-09-21T01:05:50.733 INFO:teuthology.orchestra.run.smithi193.stdout: "complete_latency": { 2024-09-21T01:05:50.733 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 2220, 2024-09-21T01:05:50.733 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.146877570, 2024-09-21T01:05:50.733 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000066161 2024-09-21T01:05:50.733 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-21T01:05:50.733 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.733 INFO:teuthology.orchestra.run.smithi193.stdout: "mds": { 2024-09-21T01:05:50.733 INFO:teuthology.orchestra.run.smithi193.stdout: "request": 15915, 2024-09-21T01:05:50.734 INFO:teuthology.orchestra.run.smithi193.stdout: "reply": 14654, 2024-09-21T01:05:50.734 INFO:teuthology.orchestra.run.smithi193.stdout: "reply_latency": { 2024-09-21T01:05:50.734 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 14654, 2024-09-21T01:05:50.734 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 199.612739387, 2024-09-21T01:05:50.734 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.013621723 2024-09-21T01:05:50.734 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.734 INFO:teuthology.orchestra.run.smithi193.stdout: "slow_reply": 0, 2024-09-21T01:05:50.734 INFO:teuthology.orchestra.run.smithi193.stdout: "forward": 1261, 2024-09-21T01:05:50.734 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_fetch_complete": 0, 2024-09-21T01:05:50.734 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_fetch_keys": 0, 2024-09-21T01:05:50.734 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_commit": 47, 2024-09-21T01:05:50.734 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_split": 4, 2024-09-21T01:05:50.734 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_merge": 0, 2024-09-21T01:05:50.734 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes": 25, 2024-09-21T01:05:50.735 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_top": 7, 2024-09-21T01:05:50.735 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_bottom": 8, 2024-09-21T01:05:50.735 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_pin_tail": 10, 2024-09-21T01:05:50.735 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_pinned": 13, 2024-09-21T01:05:50.735 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_expired": 380, 2024-09-21T01:05:50.735 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_with_caps": 1, 2024-09-21T01:05:50.735 INFO:teuthology.orchestra.run.smithi193.stdout: "caps": 1, 2024-09-21T01:05:50.735 INFO:teuthology.orchestra.run.smithi193.stdout: "subtrees": 4, 2024-09-21T01:05:50.735 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse": 32206, 2024-09-21T01:05:50.735 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_hit": 28538, 2024-09-21T01:05:50.735 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_forward": 1261, 2024-09-21T01:05:50.735 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_discover": 220, 2024-09-21T01:05:50.735 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_dir_fetch": 0, 2024-09-21T01:05:50.735 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_remote_ino": 0, 2024-09-21T01:05:50.736 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_lock": 121, 2024-09-21T01:05:50.736 INFO:teuthology.orchestra.run.smithi193.stdout: "load_cent": 0, 2024-09-21T01:05:50.736 INFO:teuthology.orchestra.run.smithi193.stdout: "q": 0, 2024-09-21T01:05:50.736 INFO:teuthology.orchestra.run.smithi193.stdout: "exported": 32, 2024-09-21T01:05:50.736 INFO:teuthology.orchestra.run.smithi193.stdout: "exported_inodes": 27, 2024-09-21T01:05:50.736 INFO:teuthology.orchestra.run.smithi193.stdout: "imported": 4, 2024-09-21T01:05:50.736 INFO:teuthology.orchestra.run.smithi193.stdout: "imported_inodes": 545, 2024-09-21T01:05:50.736 INFO:teuthology.orchestra.run.smithi193.stdout: "openino_dir_fetch": 0, 2024-09-21T01:05:50.736 INFO:teuthology.orchestra.run.smithi193.stdout: "openino_backtrace_fetch": 2297, 2024-09-21T01:05:50.736 INFO:teuthology.orchestra.run.smithi193.stdout: "openino_peer_discover": 0, 2024-09-21T01:05:50.736 INFO:teuthology.orchestra.run.smithi193.stdout: "root_rfiles": 11953, 2024-09-21T01:05:50.736 INFO:teuthology.orchestra.run.smithi193.stdout: "root_rbytes": 230111924, 2024-09-21T01:05:50.736 INFO:teuthology.orchestra.run.smithi193.stdout: "root_rsnaps": 0, 2024-09-21T01:05:50.736 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_backtrace_fetch": 2297, 2024-09-21T01:05:50.736 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_set_tag": 0, 2024-09-21T01:05:50.737 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T01:05:50.737 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_inotable_repaired": 0, 2024-09-21T01:05:50.737 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_dir_inodes": 0, 2024-09-21T01:05:50.737 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T01:05:50.737 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T01:05:50.737 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_file_inodes": 2297, 2024-09-21T01:05:50.737 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_inode_file_caps": 99, 2024-09-21T01:05:50.737 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_revoke": 6016, 2024-09-21T01:05:50.737 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_grant": 5997, 2024-09-21T01:05:50.737 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T01:05:50.737 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T01:05:50.737 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T01:05:50.737 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_caps": 15718, 2024-09-21T01:05:50.737 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_caps_dirty": 1119, 2024-09-21T01:05:50.737 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_cap_release": 103, 2024-09-21T01:05:50.738 INFO:teuthology.orchestra.run.smithi193.stdout: "process_request_cap_release": 4393 2024-09-21T01:05:50.738 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.738 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_cache": { 2024-09-21T01:05:50.738 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_update": 639, 2024-09-21T01:05:50.738 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_update_receipt": 3844, 2024-09-21T01:05:50.738 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_try_discover": 2186, 2024-09-21T01:05:50.738 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_send_discover": 3053, 2024-09-21T01:05:50.738 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_handle_discover": 565, 2024-09-21T01:05:50.738 INFO:teuthology.orchestra.run.smithi193.stdout: "num_strays": 0, 2024-09-21T01:05:50.738 INFO:teuthology.orchestra.run.smithi193.stdout: "num_strays_delayed": 0, 2024-09-21T01:05:50.738 INFO:teuthology.orchestra.run.smithi193.stdout: "num_strays_enqueuing": 0, 2024-09-21T01:05:50.738 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_created": 1124, 2024-09-21T01:05:50.738 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_enqueued": 1124, 2024-09-21T01:05:50.739 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_reintegrated": 0, 2024-09-21T01:05:50.739 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_migrated": 0, 2024-09-21T01:05:50.739 INFO:teuthology.orchestra.run.smithi193.stdout: "num_recovering_processing": 0, 2024-09-21T01:05:50.739 INFO:teuthology.orchestra.run.smithi193.stdout: "num_recovering_enqueued": 0, 2024-09-21T01:05:50.739 INFO:teuthology.orchestra.run.smithi193.stdout: "num_recovering_prioritized": 0, 2024-09-21T01:05:50.739 INFO:teuthology.orchestra.run.smithi193.stdout: "recovery_started": 0, 2024-09-21T01:05:50.739 INFO:teuthology.orchestra.run.smithi193.stdout: "recovery_completed": 0, 2024-09-21T01:05:50.739 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_quiesce_path": 0, 2024-09-21T01:05:50.739 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_quiesce_inode": 0, 2024-09-21T01:05:50.739 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T01:05:50.739 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_exportdir": 32, 2024-09-21T01:05:50.739 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_flush": 0, 2024-09-21T01:05:50.739 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_fragmentdir": 4, 2024-09-21T01:05:50.739 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_fragstats": 0, 2024-09-21T01:05:50.739 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_inodestats": 0, 2024-09-21T01:05:50.740 INFO:teuthology.orchestra.run.smithi193.stdout: "uninline_started": 0, 2024-09-21T01:05:50.740 INFO:teuthology.orchestra.run.smithi193.stdout: "uninline_succeeded": 0, 2024-09-21T01:05:50.740 INFO:teuthology.orchestra.run.smithi193.stdout: "uninline_write_failed": 0 2024-09-21T01:05:50.740 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.740 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_log": { 2024-09-21T01:05:50.740 INFO:teuthology.orchestra.run.smithi193.stdout: "evlrg": 0, 2024-09-21T01:05:50.740 INFO:teuthology.orchestra.run.smithi193.stdout: "evadd": 7948, 2024-09-21T01:05:50.740 INFO:teuthology.orchestra.run.smithi193.stdout: "evex": 0, 2024-09-21T01:05:50.740 INFO:teuthology.orchestra.run.smithi193.stdout: "evtrm": 0, 2024-09-21T01:05:50.740 INFO:teuthology.orchestra.run.smithi193.stdout: "ev": 7948, 2024-09-21T01:05:50.740 INFO:teuthology.orchestra.run.smithi193.stdout: "evexg": 0, 2024-09-21T01:05:50.740 INFO:teuthology.orchestra.run.smithi193.stdout: "evexd": 0, 2024-09-21T01:05:50.740 INFO:teuthology.orchestra.run.smithi193.stdout: "segadd": 11, 2024-09-21T01:05:50.740 INFO:teuthology.orchestra.run.smithi193.stdout: "segex": 0, 2024-09-21T01:05:50.741 INFO:teuthology.orchestra.run.smithi193.stdout: "segtrm": 0, 2024-09-21T01:05:50.741 INFO:teuthology.orchestra.run.smithi193.stdout: "seg": 11, 2024-09-21T01:05:50.741 INFO:teuthology.orchestra.run.smithi193.stdout: "segmjr": 2, 2024-09-21T01:05:50.741 INFO:teuthology.orchestra.run.smithi193.stdout: "segexg": 0, 2024-09-21T01:05:50.741 INFO:teuthology.orchestra.run.smithi193.stdout: "segexd": 0, 2024-09-21T01:05:50.741 INFO:teuthology.orchestra.run.smithi193.stdout: "expos": 4194304, 2024-09-21T01:05:50.741 INFO:teuthology.orchestra.run.smithi193.stdout: "wrpos": 15836586, 2024-09-21T01:05:50.741 INFO:teuthology.orchestra.run.smithi193.stdout: "rdpos": 0, 2024-09-21T01:05:50.741 INFO:teuthology.orchestra.run.smithi193.stdout: "jlat": { 2024-09-21T01:05:50.741 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 1211, 2024-09-21T01:05:50.741 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 18.259924849, 2024-09-21T01:05:50.741 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.015078385 2024-09-21T01:05:50.741 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.741 INFO:teuthology.orchestra.run.smithi193.stdout: "replayed": 0 2024-09-21T01:05:50.741 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.742 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_mem": { 2024-09-21T01:05:50.742 INFO:teuthology.orchestra.run.smithi193.stdout: "ino": 30, 2024-09-21T01:05:50.742 INFO:teuthology.orchestra.run.smithi193.stdout: "ino+": 1321, 2024-09-21T01:05:50.742 INFO:teuthology.orchestra.run.smithi193.stdout: "ino-": 1291, 2024-09-21T01:05:50.742 INFO:teuthology.orchestra.run.smithi193.stdout: "dir": 29, 2024-09-21T01:05:50.742 INFO:teuthology.orchestra.run.smithi193.stdout: "dir+": 1935, 2024-09-21T01:05:50.742 INFO:teuthology.orchestra.run.smithi193.stdout: "dir-": 1906, 2024-09-21T01:05:50.742 INFO:teuthology.orchestra.run.smithi193.stdout: "dn": 25, 2024-09-21T01:05:50.742 INFO:teuthology.orchestra.run.smithi193.stdout: "dn+": 2851, 2024-09-21T01:05:50.742 INFO:teuthology.orchestra.run.smithi193.stdout: "dn-": 2826, 2024-09-21T01:05:50.742 INFO:teuthology.orchestra.run.smithi193.stdout: "cap": 1, 2024-09-21T01:05:50.742 INFO:teuthology.orchestra.run.smithi193.stdout: "cap+": 1842, 2024-09-21T01:05:50.742 INFO:teuthology.orchestra.run.smithi193.stdout: "cap-": 1841, 2024-09-21T01:05:50.742 INFO:teuthology.orchestra.run.smithi193.stdout: "rss": 140560, 2024-09-21T01:05:50.742 INFO:teuthology.orchestra.run.smithi193.stdout: "heap": 346959872 2024-09-21T01:05:50.743 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.743 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_server": { 2024-09-21T01:05:50.743 INFO:teuthology.orchestra.run.smithi193.stdout: "dispatch_client_request": 16718, 2024-09-21T01:05:50.743 INFO:teuthology.orchestra.run.smithi193.stdout: "dispatch_server_request": 48, 2024-09-21T01:05:50.743 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_request": 15915, 2024-09-21T01:05:50.743 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_session": 7, 2024-09-21T01:05:50.743 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_peer_request": 168, 2024-09-21T01:05:50.743 INFO:teuthology.orchestra.run.smithi193.stdout: "req_create_latency": { 2024-09-21T01:05:50.743 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 859, 2024-09-21T01:05:50.743 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 2.463186433, 2024-09-21T01:05:50.743 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.002867504 2024-09-21T01:05:50.743 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.743 INFO:teuthology.orchestra.run.smithi193.stdout: "req_getattr_latency": { 2024-09-21T01:05:50.743 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 1334, 2024-09-21T01:05:50.744 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 19.000682145, 2024-09-21T01:05:50.744 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.014243389 2024-09-21T01:05:50.744 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.744 INFO:teuthology.orchestra.run.smithi193.stdout: "req_getfilelock_latency": { 2024-09-21T01:05:50.744 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:50.744 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:50.744 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:50.744 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.744 INFO:teuthology.orchestra.run.smithi193.stdout: "req_link_latency": { 2024-09-21T01:05:50.744 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:50.744 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:50.744 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:50.744 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.744 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookup_latency": { 2024-09-21T01:05:50.745 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 9999, 2024-09-21T01:05:50.745 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 165.339255293, 2024-09-21T01:05:50.745 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.016535579 2024-09-21T01:05:50.745 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.745 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookuphash_latency": { 2024-09-21T01:05:50.745 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:50.745 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:50.745 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:50.745 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.745 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupino_latency": { 2024-09-21T01:05:50.745 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 1, 2024-09-21T01:05:50.745 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000155273, 2024-09-21T01:05:50.745 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000155273 2024-09-21T01:05:50.745 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.745 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupname_latency": { 2024-09-21T01:05:50.746 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:50.746 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:50.746 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:50.746 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.746 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupparent_latency": { 2024-09-21T01:05:50.746 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:50.746 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:50.746 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:50.746 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.746 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupsnap_latency": { 2024-09-21T01:05:50.747 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:50.747 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:50.747 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:50.747 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.747 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lssnap_latency": { 2024-09-21T01:05:50.747 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:50.747 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:50.747 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:50.748 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.748 INFO:teuthology.orchestra.run.smithi193.stdout: "req_mkdir_latency": { 2024-09-21T01:05:50.748 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:50.748 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:50.748 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:50.748 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.748 INFO:teuthology.orchestra.run.smithi193.stdout: "req_mknod_latency": { 2024-09-21T01:05:50.748 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:50.748 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:50.748 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:50.748 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.748 INFO:teuthology.orchestra.run.smithi193.stdout: "req_mksnap_latency": { 2024-09-21T01:05:50.748 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:50.748 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:50.749 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:50.749 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.749 INFO:teuthology.orchestra.run.smithi193.stdout: "req_open_latency": { 2024-09-21T01:05:50.749 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 928, 2024-09-21T01:05:50.749 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 3.982266761, 2024-09-21T01:05:50.749 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.004291235 2024-09-21T01:05:50.749 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.749 INFO:teuthology.orchestra.run.smithi193.stdout: "req_readdir_latency": { 2024-09-21T01:05:50.749 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 32, 2024-09-21T01:05:50.749 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.028104660, 2024-09-21T01:05:50.749 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000878270 2024-09-21T01:05:50.749 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.750 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rename_latency": { 2024-09-21T01:05:50.750 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 861, 2024-09-21T01:05:50.750 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 7.937855708, 2024-09-21T01:05:50.750 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.009219344 2024-09-21T01:05:50.750 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.750 INFO:teuthology.orchestra.run.smithi193.stdout: "req_renamesnap_latency": { 2024-09-21T01:05:50.750 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:50.750 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:50.750 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:50.750 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.750 INFO:teuthology.orchestra.run.smithi193.stdout: "req_snapdiff_latency": { 2024-09-21T01:05:50.750 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:50.750 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:50.750 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:50.751 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.751 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rmdir_latency": { 2024-09-21T01:05:50.751 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:50.751 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:50.751 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:50.751 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.751 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rmsnap_latency": { 2024-09-21T01:05:50.751 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:50.751 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:50.751 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:50.751 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.751 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rmxattr_latency": { 2024-09-21T01:05:50.751 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:50.751 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:50.752 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:50.752 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.752 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setattr_latency": { 2024-09-21T01:05:50.752 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:50.752 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:50.752 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:50.752 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.752 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setdirlayout_latency": { 2024-09-21T01:05:50.752 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:50.752 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:50.752 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:50.752 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.752 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setfilelock_latency": { 2024-09-21T01:05:50.752 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:50.753 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:50.753 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:50.753 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.753 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setlayout_latency": { 2024-09-21T01:05:50.753 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:50.753 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:50.753 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:50.753 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.753 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setxattr_latency": { 2024-09-21T01:05:50.753 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:50.753 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:50.753 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:50.753 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.753 INFO:teuthology.orchestra.run.smithi193.stdout: "req_symlink_latency": { 2024-09-21T01:05:50.754 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:50.754 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:50.754 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:50.754 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.754 INFO:teuthology.orchestra.run.smithi193.stdout: "req_unlink_latency": { 2024-09-21T01:05:50.754 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 640, 2024-09-21T01:05:50.754 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.861233114, 2024-09-21T01:05:50.754 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.001345676 2024-09-21T01:05:50.754 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.754 INFO:teuthology.orchestra.run.smithi193.stdout: "cap_revoke_eviction": 0, 2024-09-21T01:05:50.754 INFO:teuthology.orchestra.run.smithi193.stdout: "cap_acquisition_throttle": 0, 2024-09-21T01:05:50.754 INFO:teuthology.orchestra.run.smithi193.stdout: "req_getvxattr_latency": { 2024-09-21T01:05:50.754 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:50.754 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:50.755 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:50.755 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-21T01:05:50.755 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.755 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_sessions": { 2024-09-21T01:05:50.755 INFO:teuthology.orchestra.run.smithi193.stdout: "session_count": 1, 2024-09-21T01:05:50.755 INFO:teuthology.orchestra.run.smithi193.stdout: "session_add": 1, 2024-09-21T01:05:50.755 INFO:teuthology.orchestra.run.smithi193.stdout: "session_remove": 0, 2024-09-21T01:05:50.755 INFO:teuthology.orchestra.run.smithi193.stdout: "sessions_open": 1, 2024-09-21T01:05:50.755 INFO:teuthology.orchestra.run.smithi193.stdout: "sessions_stale": 0, 2024-09-21T01:05:50.755 INFO:teuthology.orchestra.run.smithi193.stdout: "total_load": 1819, 2024-09-21T01:05:50.755 INFO:teuthology.orchestra.run.smithi193.stdout: "average_load": 1819, 2024-09-21T01:05:50.755 INFO:teuthology.orchestra.run.smithi193.stdout: "avg_session_uptime": 528, 2024-09-21T01:05:50.755 INFO:teuthology.orchestra.run.smithi193.stdout: "mdthresh_evicted": 0 2024-09-21T01:05:50.755 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.755 INFO:teuthology.orchestra.run.smithi193.stdout: "mempool": { 2024-09-21T01:05:50.756 INFO:teuthology.orchestra.run.smithi193.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:05:50.756 INFO:teuthology.orchestra.run.smithi193.stdout: "bloom_filter_items": 0, 2024-09-21T01:05:50.756 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:05:50.756 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:05:50.756 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:05:50.756 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:05:50.756 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:05:50.756 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:05:50.756 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:05:50.756 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:05:50.756 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:05:50.756 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:05:50.756 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:05:50.756 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:05:50.757 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:05:50.757 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_extent_items": 0, 2024-09-21T01:05:50.757 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:05:50.757 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_blob_items": 0, 2024-09-21T01:05:50.757 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:05:50.757 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:05:50.757 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:05:50.757 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:05:50.757 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:05:50.757 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:05:50.757 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:05:50.757 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_txc_items": 0, 2024-09-21T01:05:50.757 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:05:50.757 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:05:50.757 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:05:50.758 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_items": 0, 2024-09-21T01:05:50.758 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_bytes": 0, 2024-09-21T01:05:50.758 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_items": 0, 2024-09-21T01:05:50.758 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:05:50.758 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:05:50.758 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:05:50.758 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:05:50.758 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_anon_bytes": 298598, 2024-09-21T01:05:50.758 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_anon_items": 122, 2024-09-21T01:05:50.758 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_meta_bytes": 352, 2024-09-21T01:05:50.758 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_meta_items": 4, 2024-09-21T01:05:50.758 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_bytes": 0, 2024-09-21T01:05:50.758 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_items": 0, 2024-09-21T01:05:50.758 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:05:50.758 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_mapbl_items": 0, 2024-09-21T01:05:50.759 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:05:50.759 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_pglog_items": 0, 2024-09-21T01:05:50.759 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_bytes": 7688, 2024-09-21T01:05:50.759 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_items": 158, 2024-09-21T01:05:50.759 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:05:50.759 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:05:50.759 INFO:teuthology.orchestra.run.smithi193.stdout: "pgmap_bytes": 0, 2024-09-21T01:05:50.759 INFO:teuthology.orchestra.run.smithi193.stdout: "pgmap_items": 0, 2024-09-21T01:05:50.759 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_co_bytes": 124089, 2024-09-21T01:05:50.759 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_co_items": 532, 2024-09-21T01:05:50.759 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_1_bytes": 0, 2024-09-21T01:05:50.759 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_1_items": 0, 2024-09-21T01:05:50.759 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_2_bytes": 0, 2024-09-21T01:05:50.759 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_2_items": 0 2024-09-21T01:05:50.760 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.760 INFO:teuthology.orchestra.run.smithi193.stdout: "objecter": { 2024-09-21T01:05:50.760 INFO:teuthology.orchestra.run.smithi193.stdout: "op_active": 0, 2024-09-21T01:05:50.760 INFO:teuthology.orchestra.run.smithi193.stdout: "op_laggy": 0, 2024-09-21T01:05:50.760 INFO:teuthology.orchestra.run.smithi193.stdout: "op_send": 5013, 2024-09-21T01:05:50.760 INFO:teuthology.orchestra.run.smithi193.stdout: "op_send_bytes": 12568828, 2024-09-21T01:05:50.760 INFO:teuthology.orchestra.run.smithi193.stdout: "op_resend": 29, 2024-09-21T01:05:50.760 INFO:teuthology.orchestra.run.smithi193.stdout: "op_reply": 5013, 2024-09-21T01:05:50.760 INFO:teuthology.orchestra.run.smithi193.stdout: "op_latency": { 2024-09-21T01:05:50.760 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 5013, 2024-09-21T01:05:50.760 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 29.575553642, 2024-09-21T01:05:50.760 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.005899771 2024-09-21T01:05:50.760 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.760 INFO:teuthology.orchestra.run.smithi193.stdout: "op_inflight": 0, 2024-09-21T01:05:50.760 INFO:teuthology.orchestra.run.smithi193.stdout: "oplen_avg": { 2024-09-21T01:05:50.761 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 5013, 2024-09-21T01:05:50.761 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 5219 2024-09-21T01:05:50.761 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.761 INFO:teuthology.orchestra.run.smithi193.stdout: "op": 5013, 2024-09-21T01:05:50.761 INFO:teuthology.orchestra.run.smithi193.stdout: "op_r": 2357, 2024-09-21T01:05:50.761 INFO:teuthology.orchestra.run.smithi193.stdout: "op_w": 2656, 2024-09-21T01:05:50.761 INFO:teuthology.orchestra.run.smithi193.stdout: "op_rmw": 0, 2024-09-21T01:05:50.761 INFO:teuthology.orchestra.run.smithi193.stdout: "op_pg": 0, 2024-09-21T01:05:50.761 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_stat": 0, 2024-09-21T01:05:50.761 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_create": 10, 2024-09-21T01:05:50.761 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_read": 60, 2024-09-21T01:05:50.761 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_write": 1271, 2024-09-21T01:05:50.761 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_writefull": 65, 2024-09-21T01:05:50.761 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_writesame": 0, 2024-09-21T01:05:50.761 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_append": 0, 2024-09-21T01:05:50.762 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_zero": 0, 2024-09-21T01:05:50.762 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_truncate": 4, 2024-09-21T01:05:50.762 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_delete": 1138, 2024-09-21T01:05:50.762 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_mapext": 0, 2024-09-21T01:05:50.762 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_sparse_read": 0, 2024-09-21T01:05:50.762 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_clonerange": 0, 2024-09-21T01:05:50.762 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_getxattr": 2297, 2024-09-21T01:05:50.762 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_setxattr": 20, 2024-09-21T01:05:50.762 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_cmpxattr": 0, 2024-09-21T01:05:50.762 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_rmxattr": 0, 2024-09-21T01:05:50.762 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_resetxattrs": 0, 2024-09-21T01:05:50.762 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_call": 0, 2024-09-21T01:05:50.762 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_watch": 0, 2024-09-21T01:05:50.762 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_notify": 0, 2024-09-21T01:05:50.762 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T01:05:50.763 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_pgls": 0, 2024-09-21T01:05:50.763 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_pgls_filter": 0, 2024-09-21T01:05:50.763 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_other": 0, 2024-09-21T01:05:50.763 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_active": 0, 2024-09-21T01:05:50.763 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_send": 0, 2024-09-21T01:05:50.763 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_resend": 0, 2024-09-21T01:05:50.763 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_ping": 0, 2024-09-21T01:05:50.763 INFO:teuthology.orchestra.run.smithi193.stdout: "poolop_active": 0, 2024-09-21T01:05:50.763 INFO:teuthology.orchestra.run.smithi193.stdout: "poolop_send": 0, 2024-09-21T01:05:50.763 INFO:teuthology.orchestra.run.smithi193.stdout: "poolop_resend": 0, 2024-09-21T01:05:50.763 INFO:teuthology.orchestra.run.smithi193.stdout: "poolstat_active": 0, 2024-09-21T01:05:50.763 INFO:teuthology.orchestra.run.smithi193.stdout: "poolstat_send": 0, 2024-09-21T01:05:50.763 INFO:teuthology.orchestra.run.smithi193.stdout: "poolstat_resend": 0, 2024-09-21T01:05:50.763 INFO:teuthology.orchestra.run.smithi193.stdout: "statfs_active": 0, 2024-09-21T01:05:50.763 INFO:teuthology.orchestra.run.smithi193.stdout: "statfs_send": 0, 2024-09-21T01:05:50.764 INFO:teuthology.orchestra.run.smithi193.stdout: "statfs_resend": 0, 2024-09-21T01:05:50.764 INFO:teuthology.orchestra.run.smithi193.stdout: "command_active": 0, 2024-09-21T01:05:50.764 INFO:teuthology.orchestra.run.smithi193.stdout: "command_send": 0, 2024-09-21T01:05:50.764 INFO:teuthology.orchestra.run.smithi193.stdout: "command_resend": 0, 2024-09-21T01:05:50.764 INFO:teuthology.orchestra.run.smithi193.stdout: "map_epoch": 75, 2024-09-21T01:05:50.764 INFO:teuthology.orchestra.run.smithi193.stdout: "map_full": 0, 2024-09-21T01:05:50.764 INFO:teuthology.orchestra.run.smithi193.stdout: "map_inc": 2, 2024-09-21T01:05:50.764 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_sessions": 12, 2024-09-21T01:05:50.764 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_session_open": 12, 2024-09-21T01:05:50.764 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_session_close": 0, 2024-09-21T01:05:50.764 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_laggy": 0, 2024-09-21T01:05:50.764 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_wr": 302, 2024-09-21T01:05:50.764 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_rd": 0, 2024-09-21T01:05:50.764 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_del": 52 2024-09-21T01:05:50.764 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.765 INFO:teuthology.orchestra.run.smithi193.stdout: "oft": { 2024-09-21T01:05:50.765 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_objs": 1, 2024-09-21T01:05:50.765 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_kv_pairs": 0, 2024-09-21T01:05:50.765 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_updates": 0, 2024-09-21T01:05:50.765 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_removes": 0 2024-09-21T01:05:50.765 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.765 INFO:teuthology.orchestra.run.smithi193.stdout: "purge_queue": { 2024-09-21T01:05:50.765 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing_ops": 0, 2024-09-21T01:05:50.765 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing_ops_high_water": 6, 2024-09-21T01:05:50.765 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing": 0, 2024-09-21T01:05:50.765 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing_high_water": 6, 2024-09-21T01:05:50.765 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executed_ops": 1124, 2024-09-21T01:05:50.765 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executed": 1124, 2024-09-21T01:05:50.765 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_item_in_journal": 0 2024-09-21T01:05:50.765 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.766 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:05:50.766 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-21T01:05:50.766 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 104857600, 2024-09-21T01:05:50.766 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-21T01:05:50.766 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 56857, 2024-09-21T01:05:50.766 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 15886463, 2024-09-21T01:05:50.766 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:50.766 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 56857, 2024-09-21T01:05:50.766 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 0, 2024-09-21T01:05:50.766 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 0, 2024-09-21T01:05:50.766 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 56857, 2024-09-21T01:05:50.766 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 15886463, 2024-09-21T01:05:50.766 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-21T01:05:50.766 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:50.766 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:50.767 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:50.767 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-21T01:05:50.767 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.767 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-objecter_bytes": { 2024-09-21T01:05:50.767 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-21T01:05:50.767 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 104857600, 2024-09-21T01:05:50.767 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-21T01:05:50.767 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 0, 2024-09-21T01:05:50.767 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 0, 2024-09-21T01:05:50.767 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:50.767 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 0, 2024-09-21T01:05:50.767 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 5013, 2024-09-21T01:05:50.767 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 12682352, 2024-09-21T01:05:50.767 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 5013, 2024-09-21T01:05:50.768 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 12682352, 2024-09-21T01:05:50.768 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-21T01:05:50.768 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:50.768 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:50.768 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:50.768 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-21T01:05:50.768 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.768 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-objecter_ops": { 2024-09-21T01:05:50.768 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-21T01:05:50.768 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 1024, 2024-09-21T01:05:50.768 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-21T01:05:50.769 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 0, 2024-09-21T01:05:50.769 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 0, 2024-09-21T01:05:50.769 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:50.769 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 0, 2024-09-21T01:05:50.769 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 5013, 2024-09-21T01:05:50.769 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 5013, 2024-09-21T01:05:50.769 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 5013, 2024-09-21T01:05:50.769 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 5013, 2024-09-21T01:05:50.769 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-21T01:05:50.769 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:50.769 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:50.769 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:50.769 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-21T01:05:50.769 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.769 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-write_buf_throttle": { 2024-09-21T01:05:50.770 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-21T01:05:50.770 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 3758096384, 2024-09-21T01:05:50.770 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-21T01:05:50.770 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 1124, 2024-09-21T01:05:50.770 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 113524, 2024-09-21T01:05:50.770 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:50.770 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 1124, 2024-09-21T01:05:50.770 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 0, 2024-09-21T01:05:50.770 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 0, 2024-09-21T01:05:50.770 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 60, 2024-09-21T01:05:50.770 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 113524, 2024-09-21T01:05:50.770 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-21T01:05:50.770 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:50.770 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:50.770 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:50.771 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-21T01:05:50.771 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.771 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-write_buf_throttle-0x559454d2f450": { 2024-09-21T01:05:50.771 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-21T01:05:50.771 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 3758096384, 2024-09-21T01:05:50.771 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-21T01:05:50.771 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 7948, 2024-09-21T01:05:50.771 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 11642282, 2024-09-21T01:05:50.771 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:50.771 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 7948, 2024-09-21T01:05:50.771 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 0, 2024-09-21T01:05:50.771 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 0, 2024-09-21T01:05:50.771 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 1211, 2024-09-21T01:05:50.771 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 11642282, 2024-09-21T01:05:50.771 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-21T01:05:50.771 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:50.772 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:50.772 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:50.772 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-21T01:05:50.772 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:50.772 INFO:teuthology.orchestra.run.smithi193.stdout: "trackedop": { 2024-09-21T01:05:50.772 INFO:teuthology.orchestra.run.smithi193.stdout: "slow_ops_count": 0 2024-09-21T01:05:50.772 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-21T01:05:50.772 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-09-21T01:05:51.566 INFO:tasks.check_counter:Daemon mds.i mds.exported=32 2024-09-21T01:05:51.566 INFO:tasks.check_counter:Daemon mds.i mds.imported=4 2024-09-21T01:05:51.566 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=639 2024-09-21T01:05:51.566 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=3844 2024-09-21T01:05:51.566 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=4 2024-09-21T01:05:51.567 DEBUG:tasks.check_counter:Getting stats from l 2024-09-21T01:05:51.567 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph daemon mds.l perf dump 2024-09-21T01:05:51.813 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:05:52.072 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:51 smithi193 ceph-mon[34660]: pgmap v617: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 12 op/s 2024-09-21T01:05:52.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:51 smithi001 ceph-mon[31211]: pgmap v617: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 12 op/s 2024-09-21T01:05:52.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:51 smithi042 ceph-mon[34481]: pgmap v617: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 12 op/s 2024-09-21T01:05:52.336 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-09-21T01:05:52.337 INFO:teuthology.orchestra.run.smithi193.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:05:52.337 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_messages": 741, 2024-09-21T01:05:52.337 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages": 717, 2024-09-21T01:05:52.337 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_bytes": 143710376, 2024-09-21T01:05:52.337 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_bytes": 282084, 2024-09-21T01:05:52.337 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_created_connections": 7, 2024-09-21T01:05:52.337 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_active_connections": 3, 2024-09-21T01:05:52.337 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_total_time": 0.146595596, 2024-09-21T01:05:52.337 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_send_time": 0.034594759, 2024-09-21T01:05:52.337 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_recv_time": 0.108430708, 2024-09-21T01:05:52.337 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_fast_dispatch_time": 0.010868651, 2024-09-21T01:05:52.337 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:05:52.338 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 717, 2024-09-21T01:05:52.338 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.030192280, 2024-09-21T01:05:52.338 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000042109 2024-09-21T01:05:52.338 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.338 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:05:52.338 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.338 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.338 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.338 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.338 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_encrypted_bytes": 963488, 2024-09-21T01:05:52.338 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_encrypted_bytes": 116400 2024-09-21T01:05:52.338 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.338 INFO:teuthology.orchestra.run.smithi193.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:05:52.338 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_messages": 764, 2024-09-21T01:05:52.339 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages": 905, 2024-09-21T01:05:52.339 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_bytes": 171029076, 2024-09-21T01:05:52.339 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_bytes": 568511, 2024-09-21T01:05:52.339 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_created_connections": 7, 2024-09-21T01:05:52.339 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_active_connections": 6, 2024-09-21T01:05:52.339 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_total_time": 0.163321566, 2024-09-21T01:05:52.339 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_send_time": 0.035451840, 2024-09-21T01:05:52.339 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_recv_time": 0.102485062, 2024-09-21T01:05:52.339 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_fast_dispatch_time": 0.018507077, 2024-09-21T01:05:52.339 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:05:52.339 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 903, 2024-09-21T01:05:52.339 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.031524172, 2024-09-21T01:05:52.339 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000034910 2024-09-21T01:05:52.339 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.339 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:05:52.340 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.340 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.340 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.340 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.340 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:05:52.340 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_encrypted_bytes": 325872 2024-09-21T01:05:52.340 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.340 INFO:teuthology.orchestra.run.smithi193.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:05:52.340 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_messages": 1640, 2024-09-21T01:05:52.340 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages": 1642, 2024-09-21T01:05:52.340 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_bytes": 243763788, 2024-09-21T01:05:52.340 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_bytes": 521578, 2024-09-21T01:05:52.340 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_created_connections": 6, 2024-09-21T01:05:52.340 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_active_connections": 5, 2024-09-21T01:05:52.341 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_total_time": 0.275897266, 2024-09-21T01:05:52.341 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_send_time": 0.072415558, 2024-09-21T01:05:52.341 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_recv_time": 0.145107398, 2024-09-21T01:05:52.341 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_fast_dispatch_time": 0.045682101, 2024-09-21T01:05:52.341 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:05:52.341 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 1640, 2024-09-21T01:05:52.341 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.059961194, 2024-09-21T01:05:52.341 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000036561 2024-09-21T01:05:52.341 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.341 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:05:52.341 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.341 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.341 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.341 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.342 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T01:05:52.342 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T01:05:52.342 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.342 INFO:teuthology.orchestra.run.smithi193.stdout: "cct": { 2024-09-21T01:05:52.342 INFO:teuthology.orchestra.run.smithi193.stdout: "total_workers": 1, 2024-09-21T01:05:52.342 INFO:teuthology.orchestra.run.smithi193.stdout: "unhealthy_workers": 0 2024-09-21T01:05:52.342 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.342 INFO:teuthology.orchestra.run.smithi193.stdout: "finisher-MDSRank": { 2024-09-21T01:05:52.342 INFO:teuthology.orchestra.run.smithi193.stdout: "queue_len": 0, 2024-09-21T01:05:52.342 INFO:teuthology.orchestra.run.smithi193.stdout: "complete_latency": { 2024-09-21T01:05:52.342 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 4484, 2024-09-21T01:05:52.342 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.229954103, 2024-09-21T01:05:52.342 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000051283 2024-09-21T01:05:52.342 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-21T01:05:52.343 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.343 INFO:teuthology.orchestra.run.smithi193.stdout: "finisher-PurgeQueue": { 2024-09-21T01:05:52.343 INFO:teuthology.orchestra.run.smithi193.stdout: "queue_len": 0, 2024-09-21T01:05:52.343 INFO:teuthology.orchestra.run.smithi193.stdout: "complete_latency": { 2024-09-21T01:05:52.343 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.343 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.343 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.343 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-21T01:05:52.343 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.343 INFO:teuthology.orchestra.run.smithi193.stdout: "mds": { 2024-09-21T01:05:52.343 INFO:teuthology.orchestra.run.smithi193.stdout: "request": 0, 2024-09-21T01:05:52.343 INFO:teuthology.orchestra.run.smithi193.stdout: "reply": 0, 2024-09-21T01:05:52.343 INFO:teuthology.orchestra.run.smithi193.stdout: "reply_latency": { 2024-09-21T01:05:52.343 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.344 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.344 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.344 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.344 INFO:teuthology.orchestra.run.smithi193.stdout: "slow_reply": 0, 2024-09-21T01:05:52.344 INFO:teuthology.orchestra.run.smithi193.stdout: "forward": 0, 2024-09-21T01:05:52.344 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_fetch_complete": 0, 2024-09-21T01:05:52.344 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_fetch_keys": 0, 2024-09-21T01:05:52.344 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_commit": 0, 2024-09-21T01:05:52.344 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_split": 0, 2024-09-21T01:05:52.344 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_merge": 0, 2024-09-21T01:05:52.344 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes": 38321, 2024-09-21T01:05:52.344 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_top": 8023, 2024-09-21T01:05:52.344 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_bottom": 30298, 2024-09-21T01:05:52.344 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_pin_tail": 0, 2024-09-21T01:05:52.344 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_pinned": 26859, 2024-09-21T01:05:52.345 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_expired": 0, 2024-09-21T01:05:52.345 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_with_caps": 0, 2024-09-21T01:05:52.345 INFO:teuthology.orchestra.run.smithi193.stdout: "caps": 0, 2024-09-21T01:05:52.345 INFO:teuthology.orchestra.run.smithi193.stdout: "subtrees": 1, 2024-09-21T01:05:52.345 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse": 0, 2024-09-21T01:05:52.345 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_hit": 0, 2024-09-21T01:05:52.345 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_forward": 0, 2024-09-21T01:05:52.345 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_discover": 0, 2024-09-21T01:05:52.345 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_dir_fetch": 0, 2024-09-21T01:05:52.345 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_remote_ino": 0, 2024-09-21T01:05:52.345 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_lock": 0, 2024-09-21T01:05:52.345 INFO:teuthology.orchestra.run.smithi193.stdout: "load_cent": 0, 2024-09-21T01:05:52.345 INFO:teuthology.orchestra.run.smithi193.stdout: "q": 0, 2024-09-21T01:05:52.345 INFO:teuthology.orchestra.run.smithi193.stdout: "exported": 0, 2024-09-21T01:05:52.346 INFO:teuthology.orchestra.run.smithi193.stdout: "exported_inodes": 0, 2024-09-21T01:05:52.346 INFO:teuthology.orchestra.run.smithi193.stdout: "imported": 0, 2024-09-21T01:05:52.346 INFO:teuthology.orchestra.run.smithi193.stdout: "imported_inodes": 0, 2024-09-21T01:05:52.346 INFO:teuthology.orchestra.run.smithi193.stdout: "openino_dir_fetch": 0, 2024-09-21T01:05:52.346 INFO:teuthology.orchestra.run.smithi193.stdout: "openino_backtrace_fetch": 0, 2024-09-21T01:05:52.346 INFO:teuthology.orchestra.run.smithi193.stdout: "openino_peer_discover": 0, 2024-09-21T01:05:52.346 INFO:teuthology.orchestra.run.smithi193.stdout: "root_rfiles": 0, 2024-09-21T01:05:52.346 INFO:teuthology.orchestra.run.smithi193.stdout: "root_rbytes": 0, 2024-09-21T01:05:52.346 INFO:teuthology.orchestra.run.smithi193.stdout: "root_rsnaps": 0, 2024-09-21T01:05:52.346 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T01:05:52.346 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_set_tag": 0, 2024-09-21T01:05:52.346 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T01:05:52.346 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_inotable_repaired": 0, 2024-09-21T01:05:52.346 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_dir_inodes": 0, 2024-09-21T01:05:52.347 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T01:05:52.347 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T01:05:52.347 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_file_inodes": 0, 2024-09-21T01:05:52.347 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_inode_file_caps": 0, 2024-09-21T01:05:52.347 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T01:05:52.347 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_grant": 0, 2024-09-21T01:05:52.347 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T01:05:52.347 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T01:05:52.347 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T01:05:52.347 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_caps": 0, 2024-09-21T01:05:52.347 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_caps_dirty": 0, 2024-09-21T01:05:52.347 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_cap_release": 0, 2024-09-21T01:05:52.347 INFO:teuthology.orchestra.run.smithi193.stdout: "process_request_cap_release": 0 2024-09-21T01:05:52.347 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.347 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_cache": { 2024-09-21T01:05:52.348 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_update": 0, 2024-09-21T01:05:52.348 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_update_receipt": 0, 2024-09-21T01:05:52.348 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_try_discover": 0, 2024-09-21T01:05:52.348 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_send_discover": 0, 2024-09-21T01:05:52.348 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_handle_discover": 0, 2024-09-21T01:05:52.348 INFO:teuthology.orchestra.run.smithi193.stdout: "num_strays": 0, 2024-09-21T01:05:52.348 INFO:teuthology.orchestra.run.smithi193.stdout: "num_strays_delayed": 0, 2024-09-21T01:05:52.348 INFO:teuthology.orchestra.run.smithi193.stdout: "num_strays_enqueuing": 0, 2024-09-21T01:05:52.348 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_created": 0, 2024-09-21T01:05:52.348 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_enqueued": 0, 2024-09-21T01:05:52.348 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_reintegrated": 0, 2024-09-21T01:05:52.348 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_migrated": 0, 2024-09-21T01:05:52.348 INFO:teuthology.orchestra.run.smithi193.stdout: "num_recovering_processing": 0, 2024-09-21T01:05:52.348 INFO:teuthology.orchestra.run.smithi193.stdout: "num_recovering_enqueued": 0, 2024-09-21T01:05:52.348 INFO:teuthology.orchestra.run.smithi193.stdout: "num_recovering_prioritized": 0, 2024-09-21T01:05:52.348 INFO:teuthology.orchestra.run.smithi193.stdout: "recovery_started": 0, 2024-09-21T01:05:52.349 INFO:teuthology.orchestra.run.smithi193.stdout: "recovery_completed": 0, 2024-09-21T01:05:52.349 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_quiesce_path": 0, 2024-09-21T01:05:52.349 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_quiesce_inode": 0, 2024-09-21T01:05:52.349 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T01:05:52.349 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_exportdir": 0, 2024-09-21T01:05:52.349 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_flush": 0, 2024-09-21T01:05:52.349 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_fragmentdir": 0, 2024-09-21T01:05:52.349 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_fragstats": 0, 2024-09-21T01:05:52.349 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_inodestats": 0, 2024-09-21T01:05:52.349 INFO:teuthology.orchestra.run.smithi193.stdout: "uninline_started": 0, 2024-09-21T01:05:52.349 INFO:teuthology.orchestra.run.smithi193.stdout: "uninline_succeeded": 0, 2024-09-21T01:05:52.349 INFO:teuthology.orchestra.run.smithi193.stdout: "uninline_write_failed": 0 2024-09-21T01:05:52.349 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.349 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_log": { 2024-09-21T01:05:52.349 INFO:teuthology.orchestra.run.smithi193.stdout: "evlrg": 0, 2024-09-21T01:05:52.349 INFO:teuthology.orchestra.run.smithi193.stdout: "evadd": 0, 2024-09-21T01:05:52.350 INFO:teuthology.orchestra.run.smithi193.stdout: "evex": 0, 2024-09-21T01:05:52.350 INFO:teuthology.orchestra.run.smithi193.stdout: "evtrm": 0, 2024-09-21T01:05:52.350 INFO:teuthology.orchestra.run.smithi193.stdout: "ev": 258013, 2024-09-21T01:05:52.350 INFO:teuthology.orchestra.run.smithi193.stdout: "evexg": 0, 2024-09-21T01:05:52.350 INFO:teuthology.orchestra.run.smithi193.stdout: "evexd": 0, 2024-09-21T01:05:52.350 INFO:teuthology.orchestra.run.smithi193.stdout: "segadd": 0, 2024-09-21T01:05:52.350 INFO:teuthology.orchestra.run.smithi193.stdout: "segex": 0, 2024-09-21T01:05:52.350 INFO:teuthology.orchestra.run.smithi193.stdout: "segtrm": 0, 2024-09-21T01:05:52.350 INFO:teuthology.orchestra.run.smithi193.stdout: "seg": 138, 2024-09-21T01:05:52.350 INFO:teuthology.orchestra.run.smithi193.stdout: "segmjr": 22, 2024-09-21T01:05:52.350 INFO:teuthology.orchestra.run.smithi193.stdout: "segexg": 0, 2024-09-21T01:05:52.350 INFO:teuthology.orchestra.run.smithi193.stdout: "segexd": 0, 2024-09-21T01:05:52.350 INFO:teuthology.orchestra.run.smithi193.stdout: "expos": 344817017, 2024-09-21T01:05:52.350 INFO:teuthology.orchestra.run.smithi193.stdout: "wrpos": 560894026, 2024-09-21T01:05:52.351 INFO:teuthology.orchestra.run.smithi193.stdout: "rdpos": 560891742, 2024-09-21T01:05:52.351 INFO:teuthology.orchestra.run.smithi193.stdout: "jlat": { 2024-09-21T01:05:52.351 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.351 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.351 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.351 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.351 INFO:teuthology.orchestra.run.smithi193.stdout: "replayed": 258013 2024-09-21T01:05:52.351 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.351 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_mem": { 2024-09-21T01:05:52.351 INFO:teuthology.orchestra.run.smithi193.stdout: "ino": 17, 2024-09-21T01:05:52.351 INFO:teuthology.orchestra.run.smithi193.stdout: "ino+": 39526, 2024-09-21T01:05:52.351 INFO:teuthology.orchestra.run.smithi193.stdout: "ino-": 39509, 2024-09-21T01:05:52.351 INFO:teuthology.orchestra.run.smithi193.stdout: "dir": 25, 2024-09-21T01:05:52.351 INFO:teuthology.orchestra.run.smithi193.stdout: "dir+": 1371, 2024-09-21T01:05:52.351 INFO:teuthology.orchestra.run.smithi193.stdout: "dir-": 1346, 2024-09-21T01:05:52.351 INFO:teuthology.orchestra.run.smithi193.stdout: "dn": 38321, 2024-09-21T01:05:52.352 INFO:teuthology.orchestra.run.smithi193.stdout: "dn+": 85729, 2024-09-21T01:05:52.352 INFO:teuthology.orchestra.run.smithi193.stdout: "dn-": 47408, 2024-09-21T01:05:52.352 INFO:teuthology.orchestra.run.smithi193.stdout: "cap": 0, 2024-09-21T01:05:52.352 INFO:teuthology.orchestra.run.smithi193.stdout: "cap+": 0, 2024-09-21T01:05:52.352 INFO:teuthology.orchestra.run.smithi193.stdout: "cap-": 0, 2024-09-21T01:05:52.352 INFO:teuthology.orchestra.run.smithi193.stdout: "rss": 194324, 2024-09-21T01:05:52.352 INFO:teuthology.orchestra.run.smithi193.stdout: "heap": 437043200 2024-09-21T01:05:52.352 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.352 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_server": { 2024-09-21T01:05:52.352 INFO:teuthology.orchestra.run.smithi193.stdout: "dispatch_client_request": 0, 2024-09-21T01:05:52.352 INFO:teuthology.orchestra.run.smithi193.stdout: "dispatch_server_request": 0, 2024-09-21T01:05:52.352 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_request": 0, 2024-09-21T01:05:52.352 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_session": 0, 2024-09-21T01:05:52.352 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_peer_request": 0, 2024-09-21T01:05:52.352 INFO:teuthology.orchestra.run.smithi193.stdout: "req_create_latency": { 2024-09-21T01:05:52.352 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.353 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.353 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.353 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.353 INFO:teuthology.orchestra.run.smithi193.stdout: "req_getattr_latency": { 2024-09-21T01:05:52.353 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.353 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.353 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.353 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.353 INFO:teuthology.orchestra.run.smithi193.stdout: "req_getfilelock_latency": { 2024-09-21T01:05:52.353 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.353 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.353 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.353 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.353 INFO:teuthology.orchestra.run.smithi193.stdout: "req_link_latency": { 2024-09-21T01:05:52.353 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.353 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.354 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.354 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.354 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookup_latency": { 2024-09-21T01:05:52.354 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.354 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.354 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.354 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.354 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookuphash_latency": { 2024-09-21T01:05:52.354 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.354 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.354 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.354 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.354 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupino_latency": { 2024-09-21T01:05:52.354 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.354 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.355 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.355 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.355 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupname_latency": { 2024-09-21T01:05:52.355 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.355 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.355 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.355 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.355 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupparent_latency": { 2024-09-21T01:05:52.355 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.355 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.355 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.355 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.355 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupsnap_latency": { 2024-09-21T01:05:52.355 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.355 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.355 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.356 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.356 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lssnap_latency": { 2024-09-21T01:05:52.356 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.356 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.356 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.356 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.356 INFO:teuthology.orchestra.run.smithi193.stdout: "req_mkdir_latency": { 2024-09-21T01:05:52.356 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.357 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.357 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.357 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.357 INFO:teuthology.orchestra.run.smithi193.stdout: "req_mknod_latency": { 2024-09-21T01:05:52.357 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.357 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.357 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.357 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.357 INFO:teuthology.orchestra.run.smithi193.stdout: "req_mksnap_latency": { 2024-09-21T01:05:52.357 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.357 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.357 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.357 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.357 INFO:teuthology.orchestra.run.smithi193.stdout: "req_open_latency": { 2024-09-21T01:05:52.358 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.358 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.358 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.358 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.358 INFO:teuthology.orchestra.run.smithi193.stdout: "req_readdir_latency": { 2024-09-21T01:05:52.358 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.358 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.358 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.358 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.358 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rename_latency": { 2024-09-21T01:05:52.358 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.358 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.358 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.358 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.359 INFO:teuthology.orchestra.run.smithi193.stdout: "req_renamesnap_latency": { 2024-09-21T01:05:52.359 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.359 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.359 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.359 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.359 INFO:teuthology.orchestra.run.smithi193.stdout: "req_snapdiff_latency": { 2024-09-21T01:05:52.359 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.359 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.359 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.359 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.359 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rmdir_latency": { 2024-09-21T01:05:52.359 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.359 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.359 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.359 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.359 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rmsnap_latency": { 2024-09-21T01:05:52.360 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.360 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.360 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.360 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.360 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rmxattr_latency": { 2024-09-21T01:05:52.360 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.360 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.360 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.360 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.360 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setattr_latency": { 2024-09-21T01:05:52.360 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.360 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.360 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.360 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.360 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setdirlayout_latency": { 2024-09-21T01:05:52.361 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.361 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.361 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.361 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.361 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setfilelock_latency": { 2024-09-21T01:05:52.361 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.361 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.361 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.361 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.361 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setlayout_latency": { 2024-09-21T01:05:52.361 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.361 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.361 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.361 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.362 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setxattr_latency": { 2024-09-21T01:05:52.362 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.362 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.362 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.362 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.362 INFO:teuthology.orchestra.run.smithi193.stdout: "req_symlink_latency": { 2024-09-21T01:05:52.362 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.362 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.362 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.362 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.362 INFO:teuthology.orchestra.run.smithi193.stdout: "req_unlink_latency": { 2024-09-21T01:05:52.362 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.362 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.362 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.363 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.363 INFO:teuthology.orchestra.run.smithi193.stdout: "cap_revoke_eviction": 0, 2024-09-21T01:05:52.363 INFO:teuthology.orchestra.run.smithi193.stdout: "cap_acquisition_throttle": 0, 2024-09-21T01:05:52.363 INFO:teuthology.orchestra.run.smithi193.stdout: "req_getvxattr_latency": { 2024-09-21T01:05:52.363 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.363 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.363 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.363 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-21T01:05:52.363 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.363 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_sessions": { 2024-09-21T01:05:52.363 INFO:teuthology.orchestra.run.smithi193.stdout: "session_count": 1, 2024-09-21T01:05:52.363 INFO:teuthology.orchestra.run.smithi193.stdout: "session_add": 2, 2024-09-21T01:05:52.363 INFO:teuthology.orchestra.run.smithi193.stdout: "session_remove": 1, 2024-09-21T01:05:52.363 INFO:teuthology.orchestra.run.smithi193.stdout: "sessions_open": 1, 2024-09-21T01:05:52.364 INFO:teuthology.orchestra.run.smithi193.stdout: "sessions_stale": 0, 2024-09-21T01:05:52.364 INFO:teuthology.orchestra.run.smithi193.stdout: "total_load": 0, 2024-09-21T01:05:52.364 INFO:teuthology.orchestra.run.smithi193.stdout: "average_load": 0, 2024-09-21T01:05:52.364 INFO:teuthology.orchestra.run.smithi193.stdout: "avg_session_uptime": 1845, 2024-09-21T01:05:52.364 INFO:teuthology.orchestra.run.smithi193.stdout: "mdthresh_evicted": 0 2024-09-21T01:05:52.364 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.364 INFO:teuthology.orchestra.run.smithi193.stdout: "mempool": { 2024-09-21T01:05:52.364 INFO:teuthology.orchestra.run.smithi193.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:05:52.364 INFO:teuthology.orchestra.run.smithi193.stdout: "bloom_filter_items": 0, 2024-09-21T01:05:52.364 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:05:52.364 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:05:52.364 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:05:52.364 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:05:52.364 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:05:52.364 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:05:52.365 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:05:52.365 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:05:52.365 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:05:52.365 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:05:52.365 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:05:52.365 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:05:52.365 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:05:52.365 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_extent_items": 0, 2024-09-21T01:05:52.365 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:05:52.365 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_blob_items": 0, 2024-09-21T01:05:52.365 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:05:52.366 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:05:52.366 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:05:52.366 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:05:52.366 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:05:52.366 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:05:52.366 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:05:52.366 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_txc_items": 0, 2024-09-21T01:05:52.366 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:05:52.366 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:05:52.366 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:05:52.366 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_items": 0, 2024-09-21T01:05:52.366 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_bytes": 0, 2024-09-21T01:05:52.366 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_items": 0, 2024-09-21T01:05:52.366 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:05:52.367 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:05:52.367 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:05:52.367 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:05:52.367 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_anon_bytes": 239596, 2024-09-21T01:05:52.367 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_anon_items": 83, 2024-09-21T01:05:52.367 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:05:52.367 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_meta_items": 0, 2024-09-21T01:05:52.367 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_bytes": 0, 2024-09-21T01:05:52.367 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_items": 0, 2024-09-21T01:05:52.367 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:05:52.367 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_mapbl_items": 0, 2024-09-21T01:05:52.367 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:05:52.367 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_pglog_items": 0, 2024-09-21T01:05:52.367 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_bytes": 7688, 2024-09-21T01:05:52.367 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_items": 158, 2024-09-21T01:05:52.368 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:05:52.368 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:05:52.368 INFO:teuthology.orchestra.run.smithi193.stdout: "pgmap_bytes": 0, 2024-09-21T01:05:52.368 INFO:teuthology.orchestra.run.smithi193.stdout: "pgmap_items": 0, 2024-09-21T01:05:52.368 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_co_bytes": 26131738, 2024-09-21T01:05:52.368 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_co_items": 153982, 2024-09-21T01:05:52.368 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_1_bytes": 0, 2024-09-21T01:05:52.368 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_1_items": 0, 2024-09-21T01:05:52.368 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_2_bytes": 0, 2024-09-21T01:05:52.368 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_2_items": 0 2024-09-21T01:05:52.368 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.368 INFO:teuthology.orchestra.run.smithi193.stdout: "objecter": { 2024-09-21T01:05:52.368 INFO:teuthology.orchestra.run.smithi193.stdout: "op_active": 0, 2024-09-21T01:05:52.368 INFO:teuthology.orchestra.run.smithi193.stdout: "op_laggy": 0, 2024-09-21T01:05:52.368 INFO:teuthology.orchestra.run.smithi193.stdout: "op_send": 2924, 2024-09-21T01:05:52.369 INFO:teuthology.orchestra.run.smithi193.stdout: "op_send_bytes": 21, 2024-09-21T01:05:52.369 INFO:teuthology.orchestra.run.smithi193.stdout: "op_resend": 3, 2024-09-21T01:05:52.369 INFO:teuthology.orchestra.run.smithi193.stdout: "op_reply": 2924, 2024-09-21T01:05:52.369 INFO:teuthology.orchestra.run.smithi193.stdout: "op_latency": { 2024-09-21T01:05:52.369 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 2924, 2024-09-21T01:05:52.369 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 5.274920435, 2024-09-21T01:05:52.369 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.001804008 2024-09-21T01:05:52.369 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.369 INFO:teuthology.orchestra.run.smithi193.stdout: "op_inflight": 0, 2024-09-21T01:05:52.369 INFO:teuthology.orchestra.run.smithi193.stdout: "oplen_avg": { 2024-09-21T01:05:52.369 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 2924, 2024-09-21T01:05:52.369 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 2925 2024-09-21T01:05:52.369 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.369 INFO:teuthology.orchestra.run.smithi193.stdout: "op": 2924, 2024-09-21T01:05:52.370 INFO:teuthology.orchestra.run.smithi193.stdout: "op_r": 2924, 2024-09-21T01:05:52.370 INFO:teuthology.orchestra.run.smithi193.stdout: "op_w": 0, 2024-09-21T01:05:52.370 INFO:teuthology.orchestra.run.smithi193.stdout: "op_rmw": 0, 2024-09-21T01:05:52.370 INFO:teuthology.orchestra.run.smithi193.stdout: "op_pg": 0, 2024-09-21T01:05:52.370 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_stat": 1780, 2024-09-21T01:05:52.370 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_create": 0, 2024-09-21T01:05:52.370 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_read": 1142, 2024-09-21T01:05:52.370 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_write": 0, 2024-09-21T01:05:52.370 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_writefull": 0, 2024-09-21T01:05:52.370 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_writesame": 0, 2024-09-21T01:05:52.370 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_append": 0, 2024-09-21T01:05:52.370 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_zero": 0, 2024-09-21T01:05:52.370 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_truncate": 0, 2024-09-21T01:05:52.370 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_delete": 0, 2024-09-21T01:05:52.370 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_mapext": 0, 2024-09-21T01:05:52.371 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_sparse_read": 0, 2024-09-21T01:05:52.371 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_clonerange": 0, 2024-09-21T01:05:52.371 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_getxattr": 1, 2024-09-21T01:05:52.371 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_setxattr": 0, 2024-09-21T01:05:52.371 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_cmpxattr": 0, 2024-09-21T01:05:52.371 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_rmxattr": 0, 2024-09-21T01:05:52.371 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_resetxattrs": 0, 2024-09-21T01:05:52.371 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_call": 0, 2024-09-21T01:05:52.371 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_watch": 0, 2024-09-21T01:05:52.371 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_notify": 0, 2024-09-21T01:05:52.371 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T01:05:52.371 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_pgls": 0, 2024-09-21T01:05:52.371 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_pgls_filter": 0, 2024-09-21T01:05:52.371 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_other": 0, 2024-09-21T01:05:52.371 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_active": 0, 2024-09-21T01:05:52.372 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_send": 0, 2024-09-21T01:05:52.372 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_resend": 0, 2024-09-21T01:05:52.372 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_ping": 0, 2024-09-21T01:05:52.372 INFO:teuthology.orchestra.run.smithi193.stdout: "poolop_active": 0, 2024-09-21T01:05:52.372 INFO:teuthology.orchestra.run.smithi193.stdout: "poolop_send": 0, 2024-09-21T01:05:52.372 INFO:teuthology.orchestra.run.smithi193.stdout: "poolop_resend": 0, 2024-09-21T01:05:52.372 INFO:teuthology.orchestra.run.smithi193.stdout: "poolstat_active": 0, 2024-09-21T01:05:52.372 INFO:teuthology.orchestra.run.smithi193.stdout: "poolstat_send": 0, 2024-09-21T01:05:52.372 INFO:teuthology.orchestra.run.smithi193.stdout: "poolstat_resend": 0, 2024-09-21T01:05:52.372 INFO:teuthology.orchestra.run.smithi193.stdout: "statfs_active": 0, 2024-09-21T01:05:52.372 INFO:teuthology.orchestra.run.smithi193.stdout: "statfs_send": 0, 2024-09-21T01:05:52.372 INFO:teuthology.orchestra.run.smithi193.stdout: "statfs_resend": 0, 2024-09-21T01:05:52.372 INFO:teuthology.orchestra.run.smithi193.stdout: "command_active": 0, 2024-09-21T01:05:52.372 INFO:teuthology.orchestra.run.smithi193.stdout: "command_send": 0, 2024-09-21T01:05:52.372 INFO:teuthology.orchestra.run.smithi193.stdout: "command_resend": 0, 2024-09-21T01:05:52.373 INFO:teuthology.orchestra.run.smithi193.stdout: "map_epoch": 75, 2024-09-21T01:05:52.373 INFO:teuthology.orchestra.run.smithi193.stdout: "map_full": 0, 2024-09-21T01:05:52.373 INFO:teuthology.orchestra.run.smithi193.stdout: "map_inc": 2, 2024-09-21T01:05:52.373 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_sessions": 11, 2024-09-21T01:05:52.373 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_session_open": 11, 2024-09-21T01:05:52.373 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_session_close": 0, 2024-09-21T01:05:52.373 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_laggy": 0, 2024-09-21T01:05:52.373 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_wr": 0, 2024-09-21T01:05:52.373 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_rd": 2, 2024-09-21T01:05:52.373 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_del": 0 2024-09-21T01:05:52.373 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.373 INFO:teuthology.orchestra.run.smithi193.stdout: "oft": { 2024-09-21T01:05:52.373 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_objs": 0, 2024-09-21T01:05:52.373 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_kv_pairs": 0, 2024-09-21T01:05:52.373 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_updates": 0, 2024-09-21T01:05:52.374 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_removes": 0 2024-09-21T01:05:52.374 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.374 INFO:teuthology.orchestra.run.smithi193.stdout: "purge_queue": { 2024-09-21T01:05:52.374 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing_ops": 0, 2024-09-21T01:05:52.374 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T01:05:52.374 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing": 0, 2024-09-21T01:05:52.374 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing_high_water": 0, 2024-09-21T01:05:52.374 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executed_ops": 0, 2024-09-21T01:05:52.374 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executed": 0, 2024-09-21T01:05:52.374 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_item_in_journal": 0 2024-09-21T01:05:52.374 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.374 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:05:52.374 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-21T01:05:52.374 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 104857600, 2024-09-21T01:05:52.375 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-21T01:05:52.375 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 3141, 2024-09-21T01:05:52.375 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 558206462, 2024-09-21T01:05:52.375 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:52.375 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 3141, 2024-09-21T01:05:52.375 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 0, 2024-09-21T01:05:52.375 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 0, 2024-09-21T01:05:52.375 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 3141, 2024-09-21T01:05:52.375 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 558206462, 2024-09-21T01:05:52.375 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-21T01:05:52.375 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.375 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.375 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.375 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-21T01:05:52.376 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.376 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-objecter_bytes": { 2024-09-21T01:05:52.376 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-21T01:05:52.376 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 104857600, 2024-09-21T01:05:52.376 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-21T01:05:52.376 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 0, 2024-09-21T01:05:52.376 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 0, 2024-09-21T01:05:52.376 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:52.376 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 0, 2024-09-21T01:05:52.376 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 2924, 2024-09-21T01:05:52.376 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 556738800, 2024-09-21T01:05:52.376 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 2924, 2024-09-21T01:05:52.376 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 556738800, 2024-09-21T01:05:52.376 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-21T01:05:52.376 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.377 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.377 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.377 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-21T01:05:52.377 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.377 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-objecter_ops": { 2024-09-21T01:05:52.377 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-21T01:05:52.377 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 1024, 2024-09-21T01:05:52.377 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-21T01:05:52.377 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 0, 2024-09-21T01:05:52.377 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 0, 2024-09-21T01:05:52.377 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:52.377 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 0, 2024-09-21T01:05:52.377 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 2924, 2024-09-21T01:05:52.377 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 2924, 2024-09-21T01:05:52.378 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 2924, 2024-09-21T01:05:52.378 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 2924, 2024-09-21T01:05:52.378 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-21T01:05:52.378 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.378 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.378 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.378 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-21T01:05:52.378 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.378 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-write_buf_throttle": { 2024-09-21T01:05:52.378 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-21T01:05:52.378 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 3758096384, 2024-09-21T01:05:52.378 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-21T01:05:52.378 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 0, 2024-09-21T01:05:52.378 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 0, 2024-09-21T01:05:52.378 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:52.379 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 0, 2024-09-21T01:05:52.379 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 0, 2024-09-21T01:05:52.379 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 0, 2024-09-21T01:05:52.379 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 0, 2024-09-21T01:05:52.379 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 0, 2024-09-21T01:05:52.379 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-21T01:05:52.379 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.379 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.379 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.379 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-21T01:05:52.379 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.379 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-write_buf_throttle-0x55b0fbcf32b0": { 2024-09-21T01:05:52.379 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-21T01:05:52.379 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 3758096384, 2024-09-21T01:05:52.380 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-21T01:05:52.380 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 0, 2024-09-21T01:05:52.380 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 0, 2024-09-21T01:05:52.380 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-21T01:05:52.380 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 0, 2024-09-21T01:05:52.380 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 0, 2024-09-21T01:05:52.380 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 0, 2024-09-21T01:05:52.380 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 0, 2024-09-21T01:05:52.380 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 0, 2024-09-21T01:05:52.380 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-21T01:05:52.380 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-21T01:05:52.380 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-21T01:05:52.380 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-21T01:05:52.380 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-21T01:05:52.381 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-21T01:05:52.381 INFO:teuthology.orchestra.run.smithi193.stdout: "trackedop": { 2024-09-21T01:05:52.381 INFO:teuthology.orchestra.run.smithi193.stdout: "slow_ops_count": 0 2024-09-21T01:05:52.381 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-21T01:05:52.381 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-09-21T01:05:53.141 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-21T01:05:53.141 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-21T01:05:53.141 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-09-21T01:05:53.141 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-09-21T01:05:53.142 INFO:tasks.check_counter:Daemon mds.l mds.dir_split=0 2024-09-21T01:05:53.142 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-21T01:05:53.153 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-21T01:05:53.154 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-21T01:05:53.154 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T01:05:53.177 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-21T01:05:53.177 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T01:05:53.239 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T01:05:53.551 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:53.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:53 smithi001 ceph-mon[31211]: pgmap v618: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 12 op/s 2024-09-21T01:05:54.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.093+0000 7f38f2c5b640 1 -- 172.21.15.1:0/1093079024 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38ec109df0 msgr2=0x7f38ec110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:54.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.093+0000 7f38f2c5b640 1 --2- 172.21.15.1:0/1093079024 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38ec109df0 0x7f38ec110620 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f38e4009ca0 tx=0x7f38e402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.093+0000 7f38f2c5b640 1 -- 172.21.15.1:0/1093079024 shutdown_connections 2024-09-21T01:05:54.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.093+0000 7f38f2c5b640 1 --2- 172.21.15.1:0/1093079024 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38ec109df0 0x7f38ec110620 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.093+0000 7f38f2c5b640 1 --2- 172.21.15.1:0/1093079024 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38ec1094a0 0x7f38ec1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.093+0000 7f38f2c5b640 1 --2- 172.21.15.1:0/1093079024 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f38ec103b60 0x7f38ec103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.093+0000 7f38f2c5b640 1 -- 172.21.15.1:0/1093079024 >> 172.21.15.1:0/1093079024 conn(0x7f38ec07b850 msgr2=0x7f38ec07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:54.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.093+0000 7f38f2c5b640 1 -- 172.21.15.1:0/1093079024 shutdown_connections 2024-09-21T01:05:54.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.093+0000 7f38f2c5b640 1 -- 172.21.15.1:0/1093079024 wait complete. 2024-09-21T01:05:54.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.093+0000 7f38f2c5b640 1 Processor -- start 2024-09-21T01:05:54.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.094+0000 7f38f2c5b640 1 -- start start 2024-09-21T01:05:54.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.094+0000 7f38f2c5b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38ec103b60 0x7f38ec19a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:54.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.094+0000 7f38f2c5b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38ec1094a0 0x7f38ec19a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:54.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.094+0000 7f38f2c5b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f38ec109df0 0x7f38ec19fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:54.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.094+0000 7f38f2c5b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f38ec113ab0 con 0x7f38ec1094a0 2024-09-21T01:05:54.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.094+0000 7f38f2c5b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f38ec113930 con 0x7f38ec103b60 2024-09-21T01:05:54.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.094+0000 7f38f2c5b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f38ec113c30 con 0x7f38ec109df0 2024-09-21T01:05:54.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.094+0000 7f38ebfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38ec1094a0 0x7f38ec19a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:54.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.094+0000 7f38ebfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38ec1094a0 0x7f38ec19a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35910/0 (socket says 172.21.15.1:35910) 2024-09-21T01:05:54.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.094+0000 7f38ebfff640 1 -- 172.21.15.1:0/3359963791 learned_addr learned my addr 172.21.15.1:0/3359963791 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:54.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.094+0000 7f38f09f7640 1 --2- 172.21.15.1:0/3359963791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38ec103b60 0x7f38ec19a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:54.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.094+0000 7f38f11f8640 1 --2- 172.21.15.1:0/3359963791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f38ec109df0 0x7f38ec19fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:54.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.094+0000 7f38ebfff640 1 -- 172.21.15.1:0/3359963791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f38ec109df0 msgr2=0x7f38ec19fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:54.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.094+0000 7f38ebfff640 1 --2- 172.21.15.1:0/3359963791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f38ec109df0 0x7f38ec19fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.095+0000 7f38ebfff640 1 -- 172.21.15.1:0/3359963791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38ec103b60 msgr2=0x7f38ec19a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:54.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.095+0000 7f38ebfff640 1 --2- 172.21.15.1:0/3359963791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38ec103b60 0x7f38ec19a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.095+0000 7f38ebfff640 1 -- 172.21.15.1:0/3359963791 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38ec1a0390 con 0x7f38ec1094a0 2024-09-21T01:05:54.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.095+0000 7f38ebfff640 1 --2- 172.21.15.1:0/3359963791 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38ec1094a0 0x7f38ec19a9c0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f38d400d740 tx=0x7f38d400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:54.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.095+0000 7f38e9ffb640 1 -- 172.21.15.1:0/3359963791 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d4017070 con 0x7f38ec1094a0 2024-09-21T01:05:54.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.095+0000 7f38f2c5b640 1 -- 172.21.15.1:0/3359963791 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38ec1a0680 con 0x7f38ec1094a0 2024-09-21T01:05:54.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.095+0000 7f38e9ffb640 1 -- 172.21.15.1:0/3359963791 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38d400de50 con 0x7f38ec1094a0 2024-09-21T01:05:54.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.095+0000 7f38e9ffb640 1 -- 172.21.15.1:0/3359963791 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d400f620 con 0x7f38ec1094a0 2024-09-21T01:05:54.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.095+0000 7f38f2c5b640 1 -- 172.21.15.1:0/3359963791 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38ec1a6de0 con 0x7f38ec1094a0 2024-09-21T01:05:54.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.096+0000 7f38f2c5b640 1 -- 172.21.15.1:0/3359963791 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38ec103f70 con 0x7f38ec1094a0 2024-09-21T01:05:54.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.098+0000 7f38e9ffb640 1 -- 172.21.15.1:0/3359963791 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f38d401a070 con 0x7f38ec1094a0 2024-09-21T01:05:54.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.099+0000 7f38e9ffb640 1 --2- 172.21.15.1:0/3359963791 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f38d80b6510 0x7f38d80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:54.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.099+0000 7f38f09f7640 1 --2- 172.21.15.1:0/3359963791 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f38d80b6510 0x7f38d80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:54.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.099+0000 7f38e9ffb640 1 -- 172.21.15.1:0/3359963791 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f38d40e6ca0 con 0x7f38ec1094a0 2024-09-21T01:05:54.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.099+0000 7f38f09f7640 1 --2- 172.21.15.1:0/3359963791 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f38d80b6510 0x7f38d80b8a20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f38dc009bd0 tx=0x7f38dc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:54.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.102+0000 7f38e9ffb640 1 -- 172.21.15.1:0/3359963791 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f38d40b1890 con 0x7f38ec1094a0 2024-09-21T01:05:54.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:53 smithi193 ceph-mon[34660]: pgmap v618: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 12 op/s 2024-09-21T01:05:54.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:53 smithi042 ceph-mon[34481]: pgmap v618: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 12 op/s 2024-09-21T01:05:54.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.306+0000 7f38f2c5b640 1 -- 172.21.15.1:0/3359963791 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f38ec19b550 con 0x7f38ec1094a0 2024-09-21T01:05:54.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.307+0000 7f38e9ffb640 1 -- 172.21.15.1:0/3359963791 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v75) ==== 81+0+576 (secure 0 0 0) 0x7f38d40b67d0 con 0x7f38ec1094a0 2024-09-21T01:05:54.308 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:6801/59685083 2024-09-22T00:47:25.985486+0000 2024-09-21T01:05:54.308 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/309615464 2024-09-22T00:47:25.985486+0000 2024-09-21T01:05:54.308 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/1722941514 2024-09-22T00:47:25.985486+0000 2024-09-21T01:05:54.308 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/1199175740 2024-09-22T00:47:25.985486+0000 2024-09-21T01:05:54.308 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:6800/59685083 2024-09-22T00:47:25.985486+0000 2024-09-21T01:05:54.308 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/2811453932 2024-09-22T00:46:58.953779+0000 2024-09-21T01:05:54.308 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/3748689057 2024-09-22T00:46:58.953779+0000 2024-09-21T01:05:54.308 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/265697975 2024-09-22T00:46:58.953779+0000 2024-09-21T01:05:54.308 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:6801/1968786311 2024-09-22T00:46:58.953779+0000 2024-09-21T01:05:54.308 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:6800/1968786311 2024-09-22T00:46:58.953779+0000 2024-09-21T01:05:54.309 INFO:teuthology.orchestra.run.smithi001.stderr:listed 10 entries 2024-09-21T01:05:54.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.309+0000 7f38f2c5b640 1 -- 172.21.15.1:0/3359963791 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f38d80b6510 msgr2=0x7f38d80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:54.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.309+0000 7f38f2c5b640 1 --2- 172.21.15.1:0/3359963791 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f38d80b6510 0x7f38d80b8a20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f38dc009bd0 tx=0x7f38dc005f90 comp rx=0 tx=0).stop 2024-09-21T01:05:54.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.309+0000 7f38f2c5b640 1 -- 172.21.15.1:0/3359963791 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38ec1094a0 msgr2=0x7f38ec19a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:54.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.309+0000 7f38f2c5b640 1 --2- 172.21.15.1:0/3359963791 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38ec1094a0 0x7f38ec19a9c0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f38d400d740 tx=0x7f38d400dc00 comp rx=0 tx=0).stop 2024-09-21T01:05:54.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.309+0000 7f38f2c5b640 1 -- 172.21.15.1:0/3359963791 shutdown_connections 2024-09-21T01:05:54.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.309+0000 7f38f2c5b640 1 --2- 172.21.15.1:0/3359963791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f38ec109df0 0x7f38ec19fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.309+0000 7f38f2c5b640 1 --2- 172.21.15.1:0/3359963791 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f38d80b6510 0x7f38d80b8a20 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.309+0000 7f38f2c5b640 1 --2- 172.21.15.1:0/3359963791 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38ec1094a0 0x7f38ec19a9c0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.309+0000 7f38f2c5b640 1 --2- 172.21.15.1:0/3359963791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38ec103b60 0x7f38ec19a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.309+0000 7f38f2c5b640 1 -- 172.21.15.1:0/3359963791 >> 172.21.15.1:0/3359963791 conn(0x7f38ec07b850 msgr2=0x7f38ec105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:54.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.309+0000 7f38f2c5b640 1 -- 172.21.15.1:0/3359963791 shutdown_connections 2024-09-21T01:05:54.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:54.309+0000 7f38f2c5b640 1 -- 172.21.15.1:0/3359963791 wait complete. 2024-09-21T01:05:55.073 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:54 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/3359963791' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T01:05:55.105 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T01:05:55.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:05:55.105 DEBUG:teuthology.orchestra.run.smithi001:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T01:05:55.207 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi001.front.sepia.ceph.com 2024-09-21T01:05:55.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:05:55.207 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T01:05:55.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:54 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/3359963791' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T01:05:55.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:05:55.242 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2024-09-21T01:05:55.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:54 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/3359963791' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T01:05:55.321 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T01:05:55.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:05:55.321 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T01:05:55.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:05:55.420 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link delete ceph-brx 2024-09-21T01:05:55.515 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-21T01:05:55.525 INFO:tasks.cephadm:Teardown begin 2024-09-21T01:05:55.526 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T01:05:55.526 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:05:55.818 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:56.066 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:55 smithi001 ceph-mon[31211]: pgmap v619: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 14 op/s 2024-09-21T01:05:56.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:55 smithi193 ceph-mon[34660]: pgmap v619: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 14 op/s 2024-09-21T01:05:56.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:55 smithi042 ceph-mon[34481]: pgmap v619: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 14 op/s 2024-09-21T01:05:56.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.296+0000 7fb124ac6640 1 -- 172.21.15.1:0/2352294508 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb120102a80 msgr2=0x7fb120102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:56.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.296+0000 7fb124ac6640 1 --2- 172.21.15.1:0/2352294508 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb120102a80 0x7fb120102e90 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fb110009900 tx=0x7fb11002a410 comp rx=0 tx=0).stop 2024-09-21T01:05:56.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.296+0000 7fb124ac6640 1 -- 172.21.15.1:0/2352294508 shutdown_connections 2024-09-21T01:05:56.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.296+0000 7fb124ac6640 1 --2- 172.21.15.1:0/2352294508 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb120108d10 0x7fb12010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:56.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.296+0000 7fb124ac6640 1 --2- 172.21.15.1:0/2352294508 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb1201083c0 0x7fb1201087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:56.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.296+0000 7fb124ac6640 1 --2- 172.21.15.1:0/2352294508 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb120102a80 0x7fb120102e90 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:56.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.296+0000 7fb124ac6640 1 -- 172.21.15.1:0/2352294508 >> 172.21.15.1:0/2352294508 conn(0x7fb120079740 msgr2=0x7fb120079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:56.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.296+0000 7fb124ac6640 1 -- 172.21.15.1:0/2352294508 shutdown_connections 2024-09-21T01:05:56.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.297+0000 7fb124ac6640 1 -- 172.21.15.1:0/2352294508 wait complete. 2024-09-21T01:05:56.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.297+0000 7fb124ac6640 1 Processor -- start 2024-09-21T01:05:56.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.297+0000 7fb124ac6640 1 -- start start 2024-09-21T01:05:56.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.298+0000 7fb124ac6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb120102a80 0x7fb1201993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:56.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.298+0000 7fb124ac6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1201083c0 0x7fb120199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:56.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.298+0000 7fb124ac6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb120108d10 0x7fb12019ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:56.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.298+0000 7fb124ac6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb120112980 con 0x7fb1201083c0 2024-09-21T01:05:56.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.298+0000 7fb124ac6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb120112800 con 0x7fb120108d10 2024-09-21T01:05:56.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.298+0000 7fb124ac6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb120112b00 con 0x7fb120102a80 2024-09-21T01:05:56.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.298+0000 7fb11dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1201083c0 0x7fb120199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:56.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.298+0000 7fb11dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1201083c0 0x7fb120199950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35932/0 (socket says 172.21.15.1:35932) 2024-09-21T01:05:56.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.298+0000 7fb11dd9b640 1 -- 172.21.15.1:0/881272252 learned_addr learned my addr 172.21.15.1:0/881272252 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:56.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.298+0000 7fb11ed9d640 1 --2- 172.21.15.1:0/881272252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb120108d10 0x7fb12019ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:56.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.298+0000 7fb11e59c640 1 --2- 172.21.15.1:0/881272252 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb120102a80 0x7fb1201993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:56.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.298+0000 7fb11dd9b640 1 -- 172.21.15.1:0/881272252 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb120102a80 msgr2=0x7fb1201993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:56.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.298+0000 7fb11dd9b640 1 --2- 172.21.15.1:0/881272252 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb120102a80 0x7fb1201993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:56.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.298+0000 7fb11dd9b640 1 -- 172.21.15.1:0/881272252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb120108d10 msgr2=0x7fb12019ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:56.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.298+0000 7fb11dd9b640 1 --2- 172.21.15.1:0/881272252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb120108d10 0x7fb12019ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:56.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.298+0000 7fb11dd9b640 1 -- 172.21.15.1:0/881272252 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb12019f320 con 0x7fb1201083c0 2024-09-21T01:05:56.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.298+0000 7fb11ed9d640 1 --2- 172.21.15.1:0/881272252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb120108d10 0x7fb12019ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:05:56.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.299+0000 7fb11dd9b640 1 --2- 172.21.15.1:0/881272252 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1201083c0 0x7fb120199950 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fb10800d770 tx=0x7fb10800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:56.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.299+0000 7fb1177fe640 1 -- 172.21.15.1:0/881272252 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb108017070 con 0x7fb1201083c0 2024-09-21T01:05:56.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.299+0000 7fb124ac6640 1 -- 172.21.15.1:0/881272252 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb12019f610 con 0x7fb1201083c0 2024-09-21T01:05:56.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.299+0000 7fb1177fe640 1 -- 172.21.15.1:0/881272252 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb108009c30 con 0x7fb1201083c0 2024-09-21T01:05:56.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.299+0000 7fb1177fe640 1 -- 172.21.15.1:0/881272252 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb10800f620 con 0x7fb1201083c0 2024-09-21T01:05:56.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.299+0000 7fb124ac6640 1 -- 172.21.15.1:0/881272252 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb12006bb40 con 0x7fb1201083c0 2024-09-21T01:05:56.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.300+0000 7fb124ac6640 1 -- 172.21.15.1:0/881272252 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb120103d00 con 0x7fb1201083c0 2024-09-21T01:05:56.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.302+0000 7fb1177fe640 1 -- 172.21.15.1:0/881272252 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7fb10801a070 con 0x7fb1201083c0 2024-09-21T01:05:56.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.303+0000 7fb1177fe640 1 --2- 172.21.15.1:0/881272252 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb10c0b6510 0x7fb10c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:56.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.303+0000 7fb11e59c640 1 --2- 172.21.15.1:0/881272252 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb10c0b6510 0x7fb10c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:56.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.303+0000 7fb1177fe640 1 -- 172.21.15.1:0/881272252 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fb1080e6da0 con 0x7fb1201083c0 2024-09-21T01:05:56.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.303+0000 7fb11e59c640 1 --2- 172.21.15.1:0/881272252 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb10c0b6510 0x7fb10c0b8a20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb110031440 tx=0x7fb110009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:56.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.306+0000 7fb1177fe640 1 -- 172.21.15.1:0/881272252 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb108009de0 con 0x7fb1201083c0 2024-09-21T01:05:56.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.534+0000 7fb124ac6640 1 -- 172.21.15.1:0/881272252 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb12019a4e0 con 0x7fb1201083c0 2024-09-21T01:05:56.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.535+0000 7fb1177fe640 1 -- 172.21.15.1:0/881272252 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11966 (secure 0 0 0) 0x7fb1080b1990 con 0x7fb1201083c0 2024-09-21T01:05:56.536 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T01:05:56.536 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":42,"btime":"2024-09-21T01:05:27:642291+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2810186677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2810186677},{"type":"v1","addr":"172.21.15.1:6835","nonce":2810186677}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14736,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3935320478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3935320478},{"type":"v1","addr":"172.21.15.1:6837","nonce":3935320478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:54:58.592853+0000","modified":"2024-09-21T01:05:26.922666+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24653,"mds_1":24637,"mds_2":24626,"mds_3":24622,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/2125703572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2125703572},{"type":"v1","addr":"172.21.15.1:6839","nonce":2125703572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/3860445313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860445313},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860445313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6833/712170939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":712170939},{"type":"v1","addr":"172.21.15.193:6833","nonce":712170939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6833/1653911656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1653911656},{"type":"v1","addr":"172.21.15.42:6833","nonce":1653911656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6835/793085918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":793085918},{"type":"v1","addr":"172.21.15.42:6835","nonce":793085918}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6835/3631682268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":3631682268},{"type":"v1","addr":"172.21.15.193:6835","nonce":3631682268}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.193:6837/909252228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":909252228},{"type":"v1","addr":"172.21.15.193:6837","nonce":909252228}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.42:6837/2395608508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2395608508},{"type":"v1","addr":"172.21.15.42:6837","nonce":2395608508}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.193:6839/1365361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1365361177},{"type":"v1","addr":"172.21.15.193:6839","nonce":1365361177}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6839/2526476666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2526476666},{"type":"v1","addr":"172.21.15.42:6839","nonce":2526476666}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653,24637,24626,24622,24610]},"id":1}]} 2024-09-21T01:05:56.536 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 42 2024-09-21T01:05:56.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.537+0000 7fb124ac6640 1 -- 172.21.15.1:0/881272252 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb10c0b6510 msgr2=0x7fb10c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:56.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.537+0000 7fb124ac6640 1 --2- 172.21.15.1:0/881272252 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb10c0b6510 0x7fb10c0b8a20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb110031440 tx=0x7fb110009560 comp rx=0 tx=0).stop 2024-09-21T01:05:56.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.537+0000 7fb124ac6640 1 -- 172.21.15.1:0/881272252 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1201083c0 msgr2=0x7fb120199950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:56.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.537+0000 7fb124ac6640 1 --2- 172.21.15.1:0/881272252 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1201083c0 0x7fb120199950 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fb10800d770 tx=0x7fb10800dc30 comp rx=0 tx=0).stop 2024-09-21T01:05:56.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.537+0000 7fb124ac6640 1 -- 172.21.15.1:0/881272252 shutdown_connections 2024-09-21T01:05:56.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.537+0000 7fb124ac6640 1 --2- 172.21.15.1:0/881272252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb120108d10 0x7fb12019ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:56.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.537+0000 7fb124ac6640 1 --2- 172.21.15.1:0/881272252 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fb10c0b6510 0x7fb10c0b8a20 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:56.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.537+0000 7fb124ac6640 1 --2- 172.21.15.1:0/881272252 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1201083c0 0x7fb120199950 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:56.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.537+0000 7fb124ac6640 1 --2- 172.21.15.1:0/881272252 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb120102a80 0x7fb1201993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:56.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.538+0000 7fb124ac6640 1 -- 172.21.15.1:0/881272252 >> 172.21.15.1:0/881272252 conn(0x7fb120079740 msgr2=0x7fb120101470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:56.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.538+0000 7fb124ac6640 1 -- 172.21.15.1:0/881272252 shutdown_connections 2024-09-21T01:05:56.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:56.538+0000 7fb124ac6640 1 -- 172.21.15.1:0/881272252 wait complete. 2024-09-21T01:05:56.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:56 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/881272252' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:05:57.143 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:56 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/881272252' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:05:57.174 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:05:57.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:56 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/881272252' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:05:57.434 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:57.839 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:57 smithi001 ceph-mon[31211]: pgmap v620: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-21T01:05:57.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.931+0000 7f9890219640 1 -- 172.21.15.1:0/874795319 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f98881094a0 msgr2=0x7f98881098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:57.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.931+0000 7f9890219640 1 --2- 172.21.15.1:0/874795319 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f98881094a0 0x7f98881098b0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f9878009900 tx=0x7f987802a410 comp rx=0 tx=0).stop 2024-09-21T01:05:57.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.931+0000 7f9890219640 1 -- 172.21.15.1:0/874795319 shutdown_connections 2024-09-21T01:05:57.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.931+0000 7f9890219640 1 --2- 172.21.15.1:0/874795319 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9888109df0 0x7f9888110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:57.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.931+0000 7f9890219640 1 --2- 172.21.15.1:0/874795319 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f98881094a0 0x7f98881098b0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:57.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.931+0000 7f9890219640 1 --2- 172.21.15.1:0/874795319 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9888103b60 0x7f9888103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:57.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.931+0000 7f9890219640 1 -- 172.21.15.1:0/874795319 >> 172.21.15.1:0/874795319 conn(0x7f988807b850 msgr2=0x7f988807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:57.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.931+0000 7f9890219640 1 -- 172.21.15.1:0/874795319 shutdown_connections 2024-09-21T01:05:57.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.931+0000 7f9890219640 1 -- 172.21.15.1:0/874795319 wait complete. 2024-09-21T01:05:57.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.932+0000 7f9890219640 1 Processor -- start 2024-09-21T01:05:57.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.932+0000 7f9890219640 1 -- start start 2024-09-21T01:05:57.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.932+0000 7f9890219640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9888103b60 0x7f988819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:57.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.932+0000 7f9890219640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98881094a0 0x7f988819aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:57.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.932+0000 7f9890219640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9888109df0 0x7f988819fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:57.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.932+0000 7f9890219640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9888113ab0 con 0x7f9888103b60 2024-09-21T01:05:57.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.932+0000 7f9890219640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9888113930 con 0x7f98881094a0 2024-09-21T01:05:57.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.932+0000 7f9890219640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9888113c30 con 0x7f9888109df0 2024-09-21T01:05:57.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.932+0000 7f988dfb5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9888103b60 0x7f988819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:57.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.932+0000 7f988dfb5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9888103b60 0x7f988819a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35956/0 (socket says 172.21.15.1:35956) 2024-09-21T01:05:57.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.932+0000 7f988dfb5640 1 -- 172.21.15.1:0/165474216 learned_addr learned my addr 172.21.15.1:0/165474216 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:57.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.932+0000 7f988e7b6640 1 --2- 172.21.15.1:0/165474216 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9888109df0 0x7f988819fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:57.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.932+0000 7f988d7b4640 1 --2- 172.21.15.1:0/165474216 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98881094a0 0x7f988819aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:57.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.933+0000 7f988dfb5640 1 -- 172.21.15.1:0/165474216 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9888109df0 msgr2=0x7f988819fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:57.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.933+0000 7f988dfb5640 1 --2- 172.21.15.1:0/165474216 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9888109df0 0x7f988819fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:57.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.933+0000 7f988dfb5640 1 -- 172.21.15.1:0/165474216 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98881094a0 msgr2=0x7f988819aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:57.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.933+0000 7f988dfb5640 1 --2- 172.21.15.1:0/165474216 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98881094a0 0x7f988819aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:57.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.933+0000 7f988dfb5640 1 -- 172.21.15.1:0/165474216 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98881a0370 con 0x7f9888103b60 2024-09-21T01:05:57.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.933+0000 7f988e7b6640 1 --2- 172.21.15.1:0/165474216 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9888109df0 0x7f988819fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:05:57.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.933+0000 7f988dfb5640 1 --2- 172.21.15.1:0/165474216 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9888103b60 0x7f988819a4c0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f988400c920 tx=0x7f988400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:57.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.933+0000 7f987effd640 1 -- 172.21.15.1:0/165474216 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9884007c70 con 0x7f9888103b60 2024-09-21T01:05:57.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.933+0000 7f987effd640 1 -- 172.21.15.1:0/165474216 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9884007e10 con 0x7f9888103b60 2024-09-21T01:05:57.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.933+0000 7f9890219640 1 -- 172.21.15.1:0/165474216 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98881a0660 con 0x7f9888103b60 2024-09-21T01:05:57.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.933+0000 7f987effd640 1 -- 172.21.15.1:0/165474216 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9884018820 con 0x7f9888103b60 2024-09-21T01:05:57.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.933+0000 7f9890219640 1 -- 172.21.15.1:0/165474216 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98880755f0 con 0x7f9888103b60 2024-09-21T01:05:57.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.934+0000 7f9890219640 1 -- 172.21.15.1:0/165474216 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9888104de0 con 0x7f9888103b60 2024-09-21T01:05:57.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.936+0000 7f987effd640 1 -- 172.21.15.1:0/165474216 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f988400f450 con 0x7f9888103b60 2024-09-21T01:05:57.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.937+0000 7f987effd640 1 --2- 172.21.15.1:0/165474216 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f98740b6540 0x7f98740b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:57.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.937+0000 7f988d7b4640 1 --2- 172.21.15.1:0/165474216 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f98740b6540 0x7f98740b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:57.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.937+0000 7f987effd640 1 -- 172.21.15.1:0/165474216 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f98840e77a0 con 0x7f9888103b60 2024-09-21T01:05:57.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.937+0000 7f988d7b4640 1 --2- 172.21.15.1:0/165474216 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f98740b6540 0x7f98740b8a50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9878009230 tx=0x7f9878031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:57.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:57.940+0000 7f987effd640 1 -- 172.21.15.1:0/165474216 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9884014030 con 0x7f9888103b60 2024-09-21T01:05:58.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:58.166+0000 7f9890219640 1 -- 172.21.15.1:0/165474216 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9888103f70 con 0x7f9888103b60 2024-09-21T01:05:58.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:58.167+0000 7f987effd640 1 -- 172.21.15.1:0/165474216 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11966 (secure 0 0 0) 0x7f98840ae0a0 con 0x7f9888103b60 2024-09-21T01:05:58.169 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T01:05:58.169 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":42,"btime":"2024-09-21T01:05:27:642291+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2810186677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2810186677},{"type":"v1","addr":"172.21.15.1:6835","nonce":2810186677}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14736,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3935320478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3935320478},{"type":"v1","addr":"172.21.15.1:6837","nonce":3935320478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:54:58.592853+0000","modified":"2024-09-21T01:05:26.922666+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24653,"mds_1":24637,"mds_2":24626,"mds_3":24622,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/2125703572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2125703572},{"type":"v1","addr":"172.21.15.1:6839","nonce":2125703572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/3860445313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860445313},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860445313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6833/712170939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":712170939},{"type":"v1","addr":"172.21.15.193:6833","nonce":712170939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6833/1653911656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1653911656},{"type":"v1","addr":"172.21.15.42:6833","nonce":1653911656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6835/793085918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":793085918},{"type":"v1","addr":"172.21.15.42:6835","nonce":793085918}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6835/3631682268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":3631682268},{"type":"v1","addr":"172.21.15.193:6835","nonce":3631682268}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.193:6837/909252228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":909252228},{"type":"v1","addr":"172.21.15.193:6837","nonce":909252228}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.42:6837/2395608508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2395608508},{"type":"v1","addr":"172.21.15.42:6837","nonce":2395608508}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.193:6839/1365361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1365361177},{"type":"v1","addr":"172.21.15.193:6839","nonce":1365361177}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6839/2526476666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":2526476666},{"type":"v1","addr":"172.21.15.42:6839","nonce":2526476666}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653,24637,24626,24622,24610]},"id":1}]} 2024-09-21T01:05:58.169 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 42 2024-09-21T01:05:58.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:58.169+0000 7f9890219640 1 -- 172.21.15.1:0/165474216 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f98740b6540 msgr2=0x7f98740b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:58.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:58.169+0000 7f9890219640 1 --2- 172.21.15.1:0/165474216 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f98740b6540 0x7f98740b8a50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9878009230 tx=0x7f9878031400 comp rx=0 tx=0).stop 2024-09-21T01:05:58.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:58.169+0000 7f9890219640 1 -- 172.21.15.1:0/165474216 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9888103b60 msgr2=0x7f988819a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:58.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:58.169+0000 7f9890219640 1 --2- 172.21.15.1:0/165474216 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9888103b60 0x7f988819a4c0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f988400c920 tx=0x7f988400cde0 comp rx=0 tx=0).stop 2024-09-21T01:05:58.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:58.169+0000 7f9890219640 1 -- 172.21.15.1:0/165474216 shutdown_connections 2024-09-21T01:05:58.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:58.169+0000 7f9890219640 1 --2- 172.21.15.1:0/165474216 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9888109df0 0x7f988819fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:58.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:58.169+0000 7f9890219640 1 --2- 172.21.15.1:0/165474216 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98881094a0 0x7f988819aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:58.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:58.169+0000 7f9890219640 1 --2- 172.21.15.1:0/165474216 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f98740b6540 0x7f98740b8a50 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:58.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:58.169+0000 7f9890219640 1 --2- 172.21.15.1:0/165474216 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9888103b60 0x7f988819a4c0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:58.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:58.169+0000 7f9890219640 1 -- 172.21.15.1:0/165474216 >> 172.21.15.1:0/165474216 conn(0x7f988807b850 msgr2=0x7f98881075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:58.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:58.170+0000 7f9890219640 1 -- 172.21.15.1:0/165474216 shutdown_connections 2024-09-21T01:05:58.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:58.170+0000 7f9890219640 1 -- 172.21.15.1:0/165474216 wait complete. 2024-09-21T01:05:58.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:57 smithi193 ceph-mon[34660]: pgmap v620: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-21T01:05:58.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:57 smithi042 ceph-mon[34481]: pgmap v620: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-21T01:05:58.855 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T01:05:59.116 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:59.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:58 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/165474216' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:05:59.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:58 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/165474216' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:05:59.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:58 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/165474216' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:05:59.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.583+0000 7fd923fd4640 1 -- 172.21.15.1:0/329722030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd91c108cf0 msgr2=0x7fd91c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:59.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.583+0000 7fd923fd4640 1 --2- 172.21.15.1:0/329722030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd91c108cf0 0x7fd91c10f520 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fd914009ca0 tx=0x7fd91402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:05:59.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.583+0000 7fd923fd4640 1 -- 172.21.15.1:0/329722030 shutdown_connections 2024-09-21T01:05:59.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.583+0000 7fd923fd4640 1 --2- 172.21.15.1:0/329722030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd91c108cf0 0x7fd91c10f520 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:59.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.583+0000 7fd923fd4640 1 --2- 172.21.15.1:0/329722030 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd91c1083a0 0x7fd91c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:59.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.583+0000 7fd923fd4640 1 --2- 172.21.15.1:0/329722030 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd91c102a60 0x7fd91c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:59.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.583+0000 7fd923fd4640 1 -- 172.21.15.1:0/329722030 >> 172.21.15.1:0/329722030 conn(0x7fd91c079730 msgr2=0x7fd91c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:59.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.583+0000 7fd923fd4640 1 -- 172.21.15.1:0/329722030 shutdown_connections 2024-09-21T01:05:59.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.583+0000 7fd923fd4640 1 -- 172.21.15.1:0/329722030 wait complete. 2024-09-21T01:05:59.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.584+0000 7fd923fd4640 1 Processor -- start 2024-09-21T01:05:59.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.584+0000 7fd923fd4640 1 -- start start 2024-09-21T01:05:59.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.584+0000 7fd923fd4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd91c102a60 0x7fd91c19b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:59.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.584+0000 7fd923fd4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd91c1083a0 0x7fd91c19b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:59.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.584+0000 7fd923fd4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd91c108cf0 0x7fd91c19be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:59.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.584+0000 7fd923fd4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd91c112a10 con 0x7fd91c102a60 2024-09-21T01:05:59.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.584+0000 7fd923fd4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd91c112890 con 0x7fd91c108cf0 2024-09-21T01:05:59.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.584+0000 7fd923fd4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd91c112b90 con 0x7fd91c1083a0 2024-09-21T01:05:59.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.584+0000 7fd921d70640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd91c102a60 0x7fd91c19b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:59.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.584+0000 7fd921d70640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd91c102a60 0x7fd91c19b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53962/0 (socket says 172.21.15.1:53962) 2024-09-21T01:05:59.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.584+0000 7fd921d70640 1 -- 172.21.15.1:0/2484417799 learned_addr learned my addr 172.21.15.1:0/2484417799 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:05:59.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.585+0000 7fd92156f640 1 --2- 172.21.15.1:0/2484417799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd91c1083a0 0x7fd91c19b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:59.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.585+0000 7fd922571640 1 --2- 172.21.15.1:0/2484417799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd91c108cf0 0x7fd91c19be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:59.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.585+0000 7fd921d70640 1 -- 172.21.15.1:0/2484417799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd91c1083a0 msgr2=0x7fd91c19b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:59.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.585+0000 7fd921d70640 1 --2- 172.21.15.1:0/2484417799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd91c1083a0 0x7fd91c19b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:59.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.585+0000 7fd921d70640 1 -- 172.21.15.1:0/2484417799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd91c108cf0 msgr2=0x7fd91c19be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:59.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.585+0000 7fd921d70640 1 --2- 172.21.15.1:0/2484417799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd91c108cf0 0x7fd91c19be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:59.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.585+0000 7fd921d70640 1 -- 172.21.15.1:0/2484417799 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd91c199230 con 0x7fd91c102a60 2024-09-21T01:05:59.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.585+0000 7fd922571640 1 --2- 172.21.15.1:0/2484417799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd91c108cf0 0x7fd91c19be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:05:59.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.585+0000 7fd921d70640 1 --2- 172.21.15.1:0/2484417799 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd91c102a60 0x7fd91c19b3c0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fd91800c890 tx=0x7fd91800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:59.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.585+0000 7fd912ffd640 1 -- 172.21.15.1:0/2484417799 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd918004220 con 0x7fd91c102a60 2024-09-21T01:05:59.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.585+0000 7fd912ffd640 1 -- 172.21.15.1:0/2484417799 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9180043c0 con 0x7fd91c102a60 2024-09-21T01:05:59.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.585+0000 7fd923fd4640 1 -- 172.21.15.1:0/2484417799 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd91c199520 con 0x7fd91c102a60 2024-09-21T01:05:59.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.585+0000 7fd912ffd640 1 -- 172.21.15.1:0/2484417799 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd918004a00 con 0x7fd91c102a60 2024-09-21T01:05:59.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.585+0000 7fd923fd4640 1 -- 172.21.15.1:0/2484417799 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd91c199a60 con 0x7fd91c102a60 2024-09-21T01:05:59.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.586+0000 7fd923fd4640 1 -- 172.21.15.1:0/2484417799 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd91c102e70 con 0x7fd91c102a60 2024-09-21T01:05:59.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.589+0000 7fd912ffd640 1 -- 172.21.15.1:0/2484417799 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7fd9180079b0 con 0x7fd91c102a60 2024-09-21T01:05:59.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.590+0000 7fd912ffd640 1 --2- 172.21.15.1:0/2484417799 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd9080b6540 0x7fd9080b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:59.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.590+0000 7fd92156f640 1 --2- 172.21.15.1:0/2484417799 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd9080b6540 0x7fd9080b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:59.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.590+0000 7fd912ffd640 1 -- 172.21.15.1:0/2484417799 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fd9180e75b0 con 0x7fd91c102a60 2024-09-21T01:05:59.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.590+0000 7fd92156f640 1 --2- 172.21.15.1:0/2484417799 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd9080b6540 0x7fd9080b8a50 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd91c1070c0 tx=0x7fd90c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:59.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.593+0000 7fd912ffd640 1 -- 172.21.15.1:0/2484417799 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd918014030 con 0x7fd91c102a60 2024-09-21T01:05:59.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.781+0000 7fd923fd4640 1 -- 172.21.15.1:0/2484417799 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd91c06b270 con 0x7fd91c102a60 2024-09-21T01:05:59.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.782+0000 7fd912ffd640 1 -- 172.21.15.1:0/2484417799 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22720 (secure 0 0 0) 0x7fd9180addc0 con 0x7fd91c102a60 2024-09-21T01:05:59.784 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-21T01:05:59.784 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":75,"fsid":"d3972c20-77b2-11ef-baf5-efdc52797490","created":"2024-09-21T00:46:29.745963+0000","modified":"2024-09-21T00:55:27.629379+0000","last_up_change":"2024-09-21T00:54:07.552837+0000","last_in_change":"2024-09-21T00:53:44.164415+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:50:16.456462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:54:54.305306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:54:56.506872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5bf09a34-4d6e-401c-8cef-29bbe72de68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6803","nonce":4067586847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6805","nonce":4067586847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6809","nonce":4067586847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":4067586847},{"type":"v1","addr":"172.21.15.1:6807","nonce":4067586847}]},"public_addr":"172.21.15.1:6803/4067586847","cluster_addr":"172.21.15.1:6805/4067586847","heartbeat_back_addr":"172.21.15.1:6809/4067586847","heartbeat_front_addr":"172.21.15.1:6807/4067586847","state":["exists","up"]},{"osd":1,"uuid":"195f9109-ef61-46be-a59a-d72e3a1b5b45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6801","nonce":436964633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6803","nonce":436964633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6807","nonce":436964633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":436964633},{"type":"v1","addr":"172.21.15.42:6805","nonce":436964633}]},"public_addr":"172.21.15.42:6801/436964633","cluster_addr":"172.21.15.42:6803/436964633","heartbeat_back_addr":"172.21.15.42:6807/436964633","heartbeat_front_addr":"172.21.15.42:6805/436964633","state":["exists","up"]},{"osd":2,"uuid":"47cf90a7-6db6-464a-84ef-9f509f89a46b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6801","nonce":3495400570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6803","nonce":3495400570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6807","nonce":3495400570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":3495400570},{"type":"v1","addr":"172.21.15.193:6805","nonce":3495400570}]},"public_addr":"172.21.15.193:6801/3495400570","cluster_addr":"172.21.15.193:6803/3495400570","heartbeat_back_addr":"172.21.15.193:6807/3495400570","heartbeat_front_addr":"172.21.15.193:6805/3495400570","state":["exists","up"]},{"osd":3,"uuid":"a5230a66-3c74-41a7-9353-5650780ed25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6811","nonce":3221661671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6813","nonce":3221661671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6817","nonce":3221661671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3221661671},{"type":"v1","addr":"172.21.15.1:6815","nonce":3221661671}]},"public_addr":"172.21.15.1:6811/3221661671","cluster_addr":"172.21.15.1:6813/3221661671","heartbeat_back_addr":"172.21.15.1:6817/3221661671","heartbeat_front_addr":"172.21.15.1:6815/3221661671","state":["exists","up"]},{"osd":4,"uuid":"b0476b9b-3257-46d4-aff7-1f038286ed43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6809","nonce":2066388104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6811","nonce":2066388104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6815","nonce":2066388104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":2066388104},{"type":"v1","addr":"172.21.15.42:6813","nonce":2066388104}]},"public_addr":"172.21.15.42:6809/2066388104","cluster_addr":"172.21.15.42:6811/2066388104","heartbeat_back_addr":"172.21.15.42:6815/2066388104","heartbeat_front_addr":"172.21.15.42:6813/2066388104","state":["exists","up"]},{"osd":5,"uuid":"96701ced-a55a-4ad9-be62-7f102c00697d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6809","nonce":732336675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6811","nonce":732336675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6815","nonce":732336675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":732336675},{"type":"v1","addr":"172.21.15.193:6813","nonce":732336675}]},"public_addr":"172.21.15.193:6809/732336675","cluster_addr":"172.21.15.193:6811/732336675","heartbeat_back_addr":"172.21.15.193:6815/732336675","heartbeat_front_addr":"172.21.15.193:6813/732336675","state":["exists","up"]},{"osd":6,"uuid":"72d76017-e2e3-4118-8316-2c5da01c87b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6819","nonce":3201517067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6821","nonce":3201517067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6825","nonce":3201517067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":3201517067},{"type":"v1","addr":"172.21.15.1:6823","nonce":3201517067}]},"public_addr":"172.21.15.1:6819/3201517067","cluster_addr":"172.21.15.1:6821/3201517067","heartbeat_back_addr":"172.21.15.1:6825/3201517067","heartbeat_front_addr":"172.21.15.1:6823/3201517067","state":["exists","up"]},{"osd":7,"uuid":"8b239f96-2455-41b6-a905-9ed92078b890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6817","nonce":2124927218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6819","nonce":2124927218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6823","nonce":2124927218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2124927218},{"type":"v1","addr":"172.21.15.42:6821","nonce":2124927218}]},"public_addr":"172.21.15.42:6817/2124927218","cluster_addr":"172.21.15.42:6819/2124927218","heartbeat_back_addr":"172.21.15.42:6823/2124927218","heartbeat_front_addr":"172.21.15.42:6821/2124927218","state":["exists","up"]},{"osd":8,"uuid":"8cd93aeb-fe00-4291-9f72-171d01893819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6817","nonce":2277449259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6819","nonce":2277449259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6823","nonce":2277449259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2277449259},{"type":"v1","addr":"172.21.15.193:6821","nonce":2277449259}]},"public_addr":"172.21.15.193:6817/2277449259","cluster_addr":"172.21.15.193:6819/2277449259","heartbeat_back_addr":"172.21.15.193:6823/2277449259","heartbeat_front_addr":"172.21.15.193:6821/2277449259","state":["exists","up"]},{"osd":9,"uuid":"9e03e00b-0015-4aa8-adce-0d3352d2ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6827","nonce":1369323215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6829","nonce":1369323215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6833","nonce":1369323215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1369323215},{"type":"v1","addr":"172.21.15.1:6831","nonce":1369323215}]},"public_addr":"172.21.15.1:6827/1369323215","cluster_addr":"172.21.15.1:6829/1369323215","heartbeat_back_addr":"172.21.15.1:6833/1369323215","heartbeat_front_addr":"172.21.15.1:6831/1369323215","state":["exists","up"]},{"osd":10,"uuid":"de55a908-b049-4f40-865f-cfa2ae6e461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6825","nonce":3182218295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6827","nonce":3182218295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6831","nonce":3182218295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":3182218295},{"type":"v1","addr":"172.21.15.42:6829","nonce":3182218295}]},"public_addr":"172.21.15.42:6825/3182218295","cluster_addr":"172.21.15.42:6827/3182218295","heartbeat_back_addr":"172.21.15.42:6831/3182218295","heartbeat_front_addr":"172.21.15.42:6829/3182218295","state":["exists","up"]},{"osd":11,"uuid":"1cac0c39-77aa-460b-92a0-39ed89cd6ce4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6825","nonce":2368815522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6827","nonce":2368815522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6831","nonce":2368815522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":2368815522},{"type":"v1","addr":"172.21.15.193:6829","nonce":2368815522}]},"public_addr":"172.21.15.193:6825/2368815522","cluster_addr":"172.21.15.193:6827/2368815522","heartbeat_back_addr":"172.21.15.193:6831/2368815522","heartbeat_front_addr":"172.21.15.193:6829/2368815522","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:49:21.491443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:49:47.486846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:50:12.757383+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:50:39.127690+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:05.545277+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:30.617491+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:57.612088+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:24.001953+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:48.447388+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:14.620538+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:40.503576+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:54:05.668236+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6801/59685083":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/309615464":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/1722941514":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/1199175740":"2024-09-22T00:47:25.985486+0000","172.21.15.1:6800/59685083":"2024-09-22T00:47:25.985486+0000","172.21.15.1:0/2811453932":"2024-09-22T00:46:58.953779+0000","172.21.15.1:0/3748689057":"2024-09-22T00:46:58.953779+0000","172.21.15.1:0/265697975":"2024-09-22T00:46:58.953779+0000","172.21.15.1:6801/1968786311":"2024-09-22T00:46:58.953779+0000","172.21.15.1:6800/1968786311":"2024-09-22T00:46:58.953779+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:05:59.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.785+0000 7fd923fd4640 1 -- 172.21.15.1:0/2484417799 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd9080b6540 msgr2=0x7fd9080b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:59.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.785+0000 7fd923fd4640 1 --2- 172.21.15.1:0/2484417799 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd9080b6540 0x7fd9080b8a50 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd91c1070c0 tx=0x7fd90c008040 comp rx=0 tx=0).stop 2024-09-21T01:05:59.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.785+0000 7fd923fd4640 1 -- 172.21.15.1:0/2484417799 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd91c102a60 msgr2=0x7fd91c19b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:59.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.785+0000 7fd923fd4640 1 --2- 172.21.15.1:0/2484417799 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd91c102a60 0x7fd91c19b3c0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fd91800c890 tx=0x7fd91800cd50 comp rx=0 tx=0).stop 2024-09-21T01:05:59.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.785+0000 7fd923fd4640 1 -- 172.21.15.1:0/2484417799 shutdown_connections 2024-09-21T01:05:59.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.785+0000 7fd923fd4640 1 --2- 172.21.15.1:0/2484417799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd91c108cf0 0x7fd91c19be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:59.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.785+0000 7fd923fd4640 1 --2- 172.21.15.1:0/2484417799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd91c1083a0 0x7fd91c19b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:59.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.785+0000 7fd923fd4640 1 --2- 172.21.15.1:0/2484417799 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7fd9080b6540 0x7fd9080b8a50 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:59.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.785+0000 7fd923fd4640 1 --2- 172.21.15.1:0/2484417799 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd91c102a60 0x7fd91c19b3c0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:59.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.785+0000 7fd923fd4640 1 -- 172.21.15.1:0/2484417799 >> 172.21.15.1:0/2484417799 conn(0x7fd91c079730 msgr2=0x7fd91c1052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:59.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.785+0000 7fd923fd4640 1 -- 172.21.15.1:0/2484417799 shutdown_connections 2024-09-21T01:05:59.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:05:59.785+0000 7fd923fd4640 1 -- 172.21.15.1:0/2484417799 wait complete. 2024-09-21T01:06:00.088 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:59 smithi001 ceph-mon[31211]: pgmap v621: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 853 B/s wr, 14 op/s 2024-09-21T01:06:00.088 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:05:59 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/2484417799' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:06:00.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:59 smithi193 ceph-mon[34660]: pgmap v621: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 853 B/s wr, 14 op/s 2024-09-21T01:06:00.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:05:59 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/2484417799' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:06:00.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:59 smithi042 ceph-mon[34481]: pgmap v621: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 853 B/s wr, 14 op/s 2024-09-21T01:06:00.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:05:59 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/2484417799' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:06:00.427 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs fail cephfs 2024-09-21T01:06:00.683 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:06:01.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.186+0000 7f4781da1640 1 -- 172.21.15.1:0/931305466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f477c1023f0 msgr2=0x7f477c102800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:01.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.186+0000 7f4781da1640 1 --2- 172.21.15.1:0/931305466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f477c1023f0 0x7f477c102800 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f4770009900 tx=0x7f477002a480 comp rx=0 tx=0).stop 2024-09-21T01:06:01.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.186+0000 7f4781da1640 1 -- 172.21.15.1:0/931305466 shutdown_connections 2024-09-21T01:06:01.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.186+0000 7f4781da1640 1 --2- 172.21.15.1:0/931305466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f477c10ffa0 0x7f477c1123c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:01.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.186+0000 7f4781da1640 1 --2- 172.21.15.1:0/931305466 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f477c102d40 0x7f477c10fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:01.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.186+0000 7f4781da1640 1 --2- 172.21.15.1:0/931305466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f477c1023f0 0x7f477c102800 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:01.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.186+0000 7f4781da1640 1 -- 172.21.15.1:0/931305466 >> 172.21.15.1:0/931305466 conn(0x7f477c0fe2d0 msgr2=0x7f477c100720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:01.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.186+0000 7f4781da1640 1 -- 172.21.15.1:0/931305466 shutdown_connections 2024-09-21T01:06:01.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.186+0000 7f4781da1640 1 -- 172.21.15.1:0/931305466 wait complete. 2024-09-21T01:06:01.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.187+0000 7f4781da1640 1 Processor -- start 2024-09-21T01:06:01.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.187+0000 7f4781da1640 1 -- start start 2024-09-21T01:06:01.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.187+0000 7f4781da1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f477c1023f0 0x7f477c19c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:01.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.187+0000 7f4781da1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f477c102d40 0x7f477c19ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:01.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.187+0000 7f4781da1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f477c10ffa0 0x7f477c1a1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:01.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.187+0000 7f4781da1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f477c115a90 con 0x7f477c102d40 2024-09-21T01:06:01.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.187+0000 7f4781da1640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f477c115910 con 0x7f477c10ffa0 2024-09-21T01:06:01.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.187+0000 7f4781da1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f477c115c10 con 0x7f477c1023f0 2024-09-21T01:06:01.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.187+0000 7f477bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f477c102d40 0x7f477c19ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:01.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.187+0000 7f477bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f477c102d40 0x7f477c19ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53972/0 (socket says 172.21.15.1:53972) 2024-09-21T01:06:01.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.187+0000 7f477bfff640 1 -- 172.21.15.1:0/783500244 learned_addr learned my addr 172.21.15.1:0/783500244 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:06:01.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.188+0000 7f47815a0640 1 --2- 172.21.15.1:0/783500244 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f477c10ffa0 0x7f477c1a1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:01.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.188+0000 7f4780d9f640 1 --2- 172.21.15.1:0/783500244 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f477c1023f0 0x7f477c19c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:01.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.188+0000 7f477bfff640 1 -- 172.21.15.1:0/783500244 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f477c1023f0 msgr2=0x7f477c19c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:01.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.188+0000 7f477bfff640 1 --2- 172.21.15.1:0/783500244 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f477c1023f0 0x7f477c19c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:01.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.188+0000 7f477bfff640 1 -- 172.21.15.1:0/783500244 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f477c10ffa0 msgr2=0x7f477c1a1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:01.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.188+0000 7f477bfff640 1 --2- 172.21.15.1:0/783500244 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f477c10ffa0 0x7f477c1a1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:01.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.188+0000 7f477bfff640 1 -- 172.21.15.1:0/783500244 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f477c1a23d0 con 0x7f477c102d40 2024-09-21T01:06:01.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.188+0000 7f4780d9f640 1 --2- 172.21.15.1:0/783500244 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f477c1023f0 0x7f477c19c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:06:01.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.188+0000 7f477bfff640 1 --2- 172.21.15.1:0/783500244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f477c102d40 0x7f477c19ca00 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f476800c890 tx=0x7f476800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:01.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.188+0000 7f4779ffb640 1 -- 172.21.15.1:0/783500244 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4768004220 con 0x7f477c102d40 2024-09-21T01:06:01.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.188+0000 7f4779ffb640 1 -- 172.21.15.1:0/783500244 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47680043c0 con 0x7f477c102d40 2024-09-21T01:06:01.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.188+0000 7f4781da1640 1 -- 172.21.15.1:0/783500244 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f477c1a26c0 con 0x7f477c102d40 2024-09-21T01:06:01.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.188+0000 7f4779ffb640 1 -- 172.21.15.1:0/783500244 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4768004a00 con 0x7f477c102d40 2024-09-21T01:06:01.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.188+0000 7f4781da1640 1 -- 172.21.15.1:0/783500244 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f477c1a8e20 con 0x7f477c102d40 2024-09-21T01:06:01.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.189+0000 7f4781da1640 1 -- 172.21.15.1:0/783500244 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f477c102800 con 0x7f477c102d40 2024-09-21T01:06:01.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.191+0000 7f4779ffb640 1 -- 172.21.15.1:0/783500244 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f47680079b0 con 0x7f477c102d40 2024-09-21T01:06:01.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.192+0000 7f4779ffb640 1 --2- 172.21.15.1:0/783500244 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f476c0b6510 0x7f476c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:01.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.192+0000 7f4780d9f640 1 --2- 172.21.15.1:0/783500244 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f476c0b6510 0x7f476c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:01.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.192+0000 7f4779ffb640 1 -- 172.21.15.1:0/783500244 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f47680e7500 con 0x7f477c102d40 2024-09-21T01:06:01.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.192+0000 7f4780d9f640 1 --2- 172.21.15.1:0/783500244 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f476c0b6510 0x7f476c0b8a20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4770031440 tx=0x7f4770009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:01.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.195+0000 7f4779ffb640 1 -- 172.21.15.1:0/783500244 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4768014030 con 0x7f477c102d40 2024-09-21T01:06:01.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.421+0000 7f4781da1640 1 -- 172.21.15.1:0/783500244 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f477c19d590 con 0x7f477c102d40 2024-09-21T01:06:01.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.424+0000 7f4779ffb640 1 -- 172.21.15.1:0/783500244 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v43) ==== 161+0+0 (secure 0 0 0) 0x7f477c19d590 con 0x7f477c102d40 2024-09-21T01:06:01.424 INFO:teuthology.orchestra.run.smithi001.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T01:06:01.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.427+0000 7f4781da1640 1 -- 172.21.15.1:0/783500244 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f476c0b6510 msgr2=0x7f476c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:01.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.427+0000 7f4781da1640 1 --2- 172.21.15.1:0/783500244 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f476c0b6510 0x7f476c0b8a20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4770031440 tx=0x7f4770009680 comp rx=0 tx=0).stop 2024-09-21T01:06:01.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.427+0000 7f4781da1640 1 -- 172.21.15.1:0/783500244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f477c102d40 msgr2=0x7f477c19ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:01.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.427+0000 7f4781da1640 1 --2- 172.21.15.1:0/783500244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f477c102d40 0x7f477c19ca00 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f476800c890 tx=0x7f476800cd50 comp rx=0 tx=0).stop 2024-09-21T01:06:01.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.429+0000 7f4781da1640 1 -- 172.21.15.1:0/783500244 shutdown_connections 2024-09-21T01:06:01.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.429+0000 7f4781da1640 1 --2- 172.21.15.1:0/783500244 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f477c10ffa0 0x7f477c1a1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:01.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.429+0000 7f4781da1640 1 --2- 172.21.15.1:0/783500244 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f476c0b6510 0x7f476c0b8a20 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:01.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.429+0000 7f4781da1640 1 --2- 172.21.15.1:0/783500244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f477c102d40 0x7f477c19ca00 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:01.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.429+0000 7f4781da1640 1 --2- 172.21.15.1:0/783500244 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f477c1023f0 0x7f477c19c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:01.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.429+0000 7f4781da1640 1 -- 172.21.15.1:0/783500244 >> 172.21.15.1:0/783500244 conn(0x7f477c0fe2d0 msgr2=0x7f477c1010b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:01.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.429+0000 7f4781da1640 1 -- 172.21.15.1:0/783500244 shutdown_connections 2024-09-21T01:06:01.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:01.429+0000 7f4781da1640 1 -- 172.21.15.1:0/783500244 wait complete. 2024-09-21T01:06:01.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:01 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mon-a[31207]: 2024-09-21T01:06:01.422+0000 7f87f55ec640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T01:06:01.710 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 21 01:06:01 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-a[72394]: ignoring --setuser ceph since I am not root 2024-09-21T01:06:01.710 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 21 01:06:01 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-a[72394]: ignoring --setgroup ceph since I am not root 2024-09-21T01:06:01.710 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 21 01:06:01 smithi001 ceph-mds[72398]: -- 172.21.15.1:0/1623842228 <== mon.0 v2:172.21.15.1:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560f1f133860 con 0x560f232db180 2024-09-21T01:06:01.711 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 21 01:06:01 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-a[72394]: starting mds.a at 2024-09-21T01:06:01.711 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 21 01:06:01 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-g[72084]: ignoring --setuser ceph since I am not root 2024-09-21T01:06:01.711 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 21 01:06:01 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-g[72084]: ignoring --setgroup ceph since I am not root 2024-09-21T01:06:01.711 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 21 01:06:01 smithi001 ceph-mds[72092]: -- 172.21.15.1:0/128701382 <== mon.0 v2:172.21.15.1:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cf32793860 con 0x55cf3693b600 2024-09-21T01:06:01.711 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 21 01:06:01 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-g[72084]: starting mds.g at 2024-09-21T01:06:01.804 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 21 01:06:01 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-c[63259]: ignoring --setuser ceph since I am not root 2024-09-21T01:06:01.804 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 21 01:06:01 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-c[63259]: ignoring --setgroup ceph since I am not root 2024-09-21T01:06:01.804 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 21 01:06:01 smithi193 ceph-mds[63263]: -- 172.21.15.193:0/4182169836 <== mon.2 v2:172.21.15.42:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ce72a1f860 con 0x55ce76bc7180 2024-09-21T01:06:01.804 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 21 01:06:01 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-c[63259]: starting mds.c at 2024-09-21T01:06:01.805 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 21 01:06:01 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-f[62990]: ignoring --setuser ceph since I am not root 2024-09-21T01:06:01.805 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 21 01:06:01 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-f[62990]: ignoring --setgroup ceph since I am not root 2024-09-21T01:06:01.805 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 21 01:06:01 smithi193 ceph-mds[62994]: -- 172.21.15.193:0/2406358007 <== mon.0 v2:172.21.15.1:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555b17b41c20 con 0x555b1bce9600 2024-09-21T01:06:01.805 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 21 01:06:01 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-f[62990]: starting mds.f at 2024-09-21T01:06:01.805 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 21 01:06:01 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-i[63525]: ignoring --setuser ceph since I am not root 2024-09-21T01:06:01.805 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 21 01:06:01 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-i[63525]: ignoring --setgroup ceph since I am not root 2024-09-21T01:06:01.805 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 21 01:06:01 smithi193 ceph-mds[63529]: -- 172.21.15.193:0/3815809835 <== mon.1 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55802d24f860 con 0x5580313f7600 2024-09-21T01:06:01.806 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 21 01:06:01 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-i[63525]: starting mds.i at 2024-09-21T01:06:01.806 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 21 01:06:01 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-l[62720]: ignoring --setuser ceph since I am not root 2024-09-21T01:06:01.806 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 21 01:06:01 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-l[62720]: ignoring --setgroup ceph since I am not root 2024-09-21T01:06:01.806 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 21 01:06:01 smithi193 ceph-mds[62724]: -- 172.21.15.193:0/674474271 <== mon.1 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e1640c7860 con 0x55e16826f180 2024-09-21T01:06:01.806 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 21 01:06:01 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-l[62720]: starting mds.l at 2024-09-21T01:06:01.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:01 smithi042 ceph-mon[34481]: pgmap v622: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-09-21T01:06:01.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:01 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/783500244' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T01:06:01.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:01 smithi042 ceph-mon[34481]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T01:06:01.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:01 smithi042 ceph-mon[34481]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T01:06:01.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:01 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/783500244' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T01:06:01.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:01 smithi042 ceph-mon[34481]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T01:06:01.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:01 smithi042 ceph-mon[34481]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-21T01:06:01.993 INFO:journalctl@ceph.mds.k.smithi042.stdout:Sep 21 01:06:01 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-k[62615]: ignoring --setuser ceph since I am not root 2024-09-21T01:06:01.993 INFO:journalctl@ceph.mds.k.smithi042.stdout:Sep 21 01:06:01 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-k[62615]: ignoring --setgroup ceph since I am not root 2024-09-21T01:06:01.993 INFO:journalctl@ceph.mds.k.smithi042.stdout:Sep 21 01:06:01 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-k[62615]: starting mds.k at 2024-09-21T01:06:01.994 INFO:journalctl@ceph.mds.b.smithi042.stdout:Sep 21 01:06:01 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-b[63452]: ignoring --setuser ceph since I am not root 2024-09-21T01:06:01.994 INFO:journalctl@ceph.mds.b.smithi042.stdout:Sep 21 01:06:01 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-b[63452]: ignoring --setgroup ceph since I am not root 2024-09-21T01:06:01.994 INFO:journalctl@ceph.mds.b.smithi042.stdout:Sep 21 01:06:01 smithi042 ceph-mds[63456]: -- 172.21.15.42:0/3780894161 <== mon.2 v2:172.21.15.42:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560214d9d860 con 0x560218f45a80 2024-09-21T01:06:01.994 INFO:journalctl@ceph.mds.b.smithi042.stdout:Sep 21 01:06:01 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-b[63452]: starting mds.b at 2024-09-21T01:06:01.994 INFO:journalctl@ceph.mds.h.smithi042.stdout:Sep 21 01:06:01 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-h[63170]: ignoring --setuser ceph since I am not root 2024-09-21T01:06:01.994 INFO:journalctl@ceph.mds.h.smithi042.stdout:Sep 21 01:06:01 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-h[63170]: ignoring --setgroup ceph since I am not root 2024-09-21T01:06:01.994 INFO:journalctl@ceph.mds.h.smithi042.stdout:Sep 21 01:06:01 smithi042 ceph-mds[63174]: -- 172.21.15.42:0/3909421855 <== mon.2 v2:172.21.15.42:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5639f28e1860 con 0x5639f6a89a80 2024-09-21T01:06:01.994 INFO:journalctl@ceph.mds.h.smithi042.stdout:Sep 21 01:06:01 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-h[63170]: starting mds.h at 2024-09-21T01:06:01.995 INFO:journalctl@ceph.mds.e.smithi042.stdout:Sep 21 01:06:01 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-e[62903]: ignoring --setuser ceph since I am not root 2024-09-21T01:06:01.995 INFO:journalctl@ceph.mds.e.smithi042.stdout:Sep 21 01:06:01 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-e[62903]: ignoring --setgroup ceph since I am not root 2024-09-21T01:06:01.995 INFO:journalctl@ceph.mds.e.smithi042.stdout:Sep 21 01:06:01 smithi042 ceph-mds[62907]: -- 172.21.15.42:0/303877313 <== mon.2 v2:172.21.15.42:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ea28bf5860 con 0x55ea2cd9d600 2024-09-21T01:06:01.995 INFO:journalctl@ceph.mds.e.smithi042.stdout:Sep 21 01:06:01 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-e[62903]: starting mds.e at 2024-09-21T01:06:02.058 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:01 smithi001 ceph-mon[31211]: pgmap v622: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-09-21T01:06:02.058 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:01 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/783500244' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T01:06:02.058 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:01 smithi001 ceph-mon[31211]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T01:06:02.058 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:01 smithi001 ceph-mon[31211]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T01:06:02.058 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:01 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/783500244' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T01:06:02.058 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:01 smithi001 ceph-mon[31211]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T01:06:02.058 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:01 smithi001 ceph-mon[31211]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-21T01:06:02.085 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T01:06:02.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:01 smithi193 ceph-mon[34660]: pgmap v622: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-09-21T01:06:02.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:01 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/783500244' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T01:06:02.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:01 smithi193 ceph-mon[34660]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T01:06:02.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:01 smithi193 ceph-mon[34660]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T01:06:02.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:01 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/783500244' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T01:06:02.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:01 smithi193 ceph-mon[34660]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T01:06:02.230 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:01 smithi193 ceph-mon[34660]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-21T01:06:02.341 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:06:02.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.848+0000 7f7221b4f640 1 -- 172.21.15.1:0/617343539 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f721c116640 msgr2=0x7f721c118b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:02.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.848+0000 7f7221b4f640 1 --2- 172.21.15.1:0/617343539 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f721c116640 0x7f721c118b50 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f7214009ca0 tx=0x7f721402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:06:02.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.848+0000 7f7221b4f640 1 -- 172.21.15.1:0/617343539 shutdown_connections 2024-09-21T01:06:02.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.848+0000 7f7221b4f640 1 --2- 172.21.15.1:0/617343539 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f721c116640 0x7f721c118b50 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:02.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.848+0000 7f7221b4f640 1 --2- 172.21.15.1:0/617343539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f721c10aee0 0x7f721c115fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:02.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.848+0000 7f7221b4f640 1 --2- 172.21.15.1:0/617343539 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f721c10a590 0x7f721c10a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:02.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.848+0000 7f7221b4f640 1 -- 172.21.15.1:0/617343539 >> 172.21.15.1:0/617343539 conn(0x7f721c070ec0 msgr2=0x7f721c0712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:02.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.848+0000 7f7221b4f640 1 -- 172.21.15.1:0/617343539 shutdown_connections 2024-09-21T01:06:02.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.848+0000 7f7221b4f640 1 -- 172.21.15.1:0/617343539 wait complete. 2024-09-21T01:06:02.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.849+0000 7f7221b4f640 1 Processor -- start 2024-09-21T01:06:02.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.849+0000 7f7221b4f640 1 -- start start 2024-09-21T01:06:02.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.849+0000 7f7221b4f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f721c10a590 0x7f721c1a2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:02.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.849+0000 7f7221b4f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f721c10aee0 0x7f721c1a31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:02.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.849+0000 7f7221b4f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f721c116640 0x7f721c1a8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:02.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.849+0000 7f7221b4f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f721c11c2e0 con 0x7f721c10a590 2024-09-21T01:06:02.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.849+0000 7f7221b4f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f721c11c160 con 0x7f721c10aee0 2024-09-21T01:06:02.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.849+0000 7f7221b4f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f721c11c460 con 0x7f721c116640 2024-09-21T01:06:02.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.849+0000 7f721b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f721c10a590 0x7f721c1a2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:02.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.849+0000 7f721b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f721c10a590 0x7f721c1a2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53994/0 (socket says 172.21.15.1:53994) 2024-09-21T01:06:02.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.849+0000 7f721b7fe640 1 -- 172.21.15.1:0/2914215267 learned_addr learned my addr 172.21.15.1:0/2914215267 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:06:02.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.850+0000 7f7213fff640 1 --2- 172.21.15.1:0/2914215267 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f721c10aee0 0x7f721c1a31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:02.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.850+0000 7f721bfff640 1 --2- 172.21.15.1:0/2914215267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f721c116640 0x7f721c1a8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:02.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.850+0000 7f721b7fe640 1 -- 172.21.15.1:0/2914215267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f721c116640 msgr2=0x7f721c1a8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:02.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.850+0000 7f721b7fe640 1 --2- 172.21.15.1:0/2914215267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f721c116640 0x7f721c1a8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:02.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.850+0000 7f721b7fe640 1 -- 172.21.15.1:0/2914215267 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f721c10aee0 msgr2=0x7f721c1a31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:02.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.850+0000 7f721b7fe640 1 --2- 172.21.15.1:0/2914215267 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f721c10aee0 0x7f721c1a31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:02.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.850+0000 7f721b7fe640 1 -- 172.21.15.1:0/2914215267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f721c1a8bc0 con 0x7f721c10a590 2024-09-21T01:06:02.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.850+0000 7f721b7fe640 1 --2- 172.21.15.1:0/2914215267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f721c10a590 0x7f721c1a2c50 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f720c00d770 tx=0x7f720c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:02.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.850+0000 7f72197fa640 1 -- 172.21.15.1:0/2914215267 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f720c017070 con 0x7f721c10a590 2024-09-21T01:06:02.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.850+0000 7f7221b4f640 1 -- 172.21.15.1:0/2914215267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f721c1a8eb0 con 0x7f721c10a590 2024-09-21T01:06:02.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.850+0000 7f72197fa640 1 -- 172.21.15.1:0/2914215267 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f720c0054d0 con 0x7f721c10a590 2024-09-21T01:06:02.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.850+0000 7f72197fa640 1 -- 172.21.15.1:0/2914215267 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f720c004c30 con 0x7f721c10a590 2024-09-21T01:06:02.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.850+0000 7f7221b4f640 1 -- 172.21.15.1:0/2914215267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f721c1af610 con 0x7f721c10a590 2024-09-21T01:06:02.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.851+0000 7f7221b4f640 1 -- 172.21.15.1:0/2914215267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f721c10a9a0 con 0x7f721c10a590 2024-09-21T01:06:02.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.853+0000 7f72197fa640 1 -- 172.21.15.1:0/2914215267 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f720c004dd0 con 0x7f721c10a590 2024-09-21T01:06:02.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.854+0000 7f72197fa640 1 --2- 172.21.15.1:0/2914215267 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f72080b6510 0x7f72080b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:02.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.854+0000 7f7213fff640 1 --2- 172.21.15.1:0/2914215267 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f72080b6510 0x7f72080b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:02.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.854+0000 7f72197fa640 1 -- 172.21.15.1:0/2914215267 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8699+0+0 (secure 0 0 0) 0x7f720c0e72c0 con 0x7f721c10a590 2024-09-21T01:06:02.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.855+0000 7f7213fff640 1 --2- 172.21.15.1:0/2914215267 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f72080b6510 0x7f72080b8a20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f721c118410 tx=0x7f720400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:02.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:02.858+0000 7f72197fa640 1 -- 172.21.15.1:0/2914215267 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f720c0b1d60 con 0x7f721c10a590 2024-09-21T01:06:03.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:03.086+0000 7f7221b4f640 1 -- 172.21.15.1:0/2914215267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f721c1af940 con 0x7f721c10a590 2024-09-21T01:06:03.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:03 smithi001 ceph-mon[31211]: pgmap v624: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 14 op/s 2024-09-21T01:06:03.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:03 smithi001 ceph-mon[31211]: mds.? [v2:172.21.15.1:6838/2943405440,v1:172.21.15.1:6839/2943405440] up:boot 2024-09-21T01:06:03.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:03 smithi001 ceph-mon[31211]: mds.? [v2:172.21.15.1:6840/3129851619,v1:172.21.15.1:6841/3129851619] up:boot 2024-09-21T01:06:03.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:03 smithi001 ceph-mon[31211]: mds.? [v2:172.21.15.193:6833/1850600887,v1:172.21.15.193:6835/1850600887] up:boot 2024-09-21T01:06:03.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:03 smithi001 ceph-mon[31211]: mds.? [v2:172.21.15.193:6832/2969342798,v1:172.21.15.193:6834/2969342798] up:boot 2024-09-21T01:06:03.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:03 smithi001 ceph-mon[31211]: mds.? [v2:172.21.15.193:6836/1547189869,v1:172.21.15.193:6837/1547189869] up:boot 2024-09-21T01:06:03.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:03 smithi001 ceph-mon[31211]: mds.? [v2:172.21.15.193:6838/3306172655,v1:172.21.15.193:6839/3306172655] up:boot 2024-09-21T01:06:03.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:03 smithi001 ceph-mon[31211]: mds.? [v2:172.21.15.42:6833/802396526,v1:172.21.15.42:6835/802396526] up:boot 2024-09-21T01:06:03.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:03 smithi001 ceph-mon[31211]: mds.? [v2:172.21.15.42:6832/4197888728,v1:172.21.15.42:6834/4197888728] up:boot 2024-09-21T01:06:03.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:03 smithi001 ceph-mon[31211]: mds.? [v2:172.21.15.42:6836/164848384,v1:172.21.15.42:6838/164848384] up:boot 2024-09-21T01:06:03.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:03 smithi001 ceph-mon[31211]: mds.? [v2:172.21.15.42:6837/92579086,v1:172.21.15.42:6839/92579086] up:boot 2024-09-21T01:06:03.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:03 smithi001 ceph-mon[31211]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-21T01:06:03.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:03 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T01:06:03.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:03 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T01:06:03.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:03 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T01:06:03.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:03 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T01:06:03.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:03 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T01:06:03.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:03 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T01:06:03.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:03 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T01:06:03.712 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:03 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T01:06:03.712 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:03 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T01:06:03.712 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:03 smithi001 ceph-mon[31211]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T01:06:03.712 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:03 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/2914215267' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T01:06:03.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:03 smithi193 ceph-mon[34660]: pgmap v624: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 14 op/s 2024-09-21T01:06:03.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:03 smithi193 ceph-mon[34660]: mds.? [v2:172.21.15.1:6838/2943405440,v1:172.21.15.1:6839/2943405440] up:boot 2024-09-21T01:06:03.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:03 smithi193 ceph-mon[34660]: mds.? [v2:172.21.15.1:6840/3129851619,v1:172.21.15.1:6841/3129851619] up:boot 2024-09-21T01:06:03.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:03 smithi193 ceph-mon[34660]: mds.? [v2:172.21.15.193:6833/1850600887,v1:172.21.15.193:6835/1850600887] up:boot 2024-09-21T01:06:03.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:03 smithi193 ceph-mon[34660]: mds.? [v2:172.21.15.193:6832/2969342798,v1:172.21.15.193:6834/2969342798] up:boot 2024-09-21T01:06:03.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:03 smithi193 ceph-mon[34660]: mds.? [v2:172.21.15.193:6836/1547189869,v1:172.21.15.193:6837/1547189869] up:boot 2024-09-21T01:06:03.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:03 smithi193 ceph-mon[34660]: mds.? [v2:172.21.15.193:6838/3306172655,v1:172.21.15.193:6839/3306172655] up:boot 2024-09-21T01:06:03.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:03 smithi193 ceph-mon[34660]: mds.? [v2:172.21.15.42:6833/802396526,v1:172.21.15.42:6835/802396526] up:boot 2024-09-21T01:06:03.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:03 smithi193 ceph-mon[34660]: mds.? [v2:172.21.15.42:6832/4197888728,v1:172.21.15.42:6834/4197888728] up:boot 2024-09-21T01:06:03.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:03 smithi193 ceph-mon[34660]: mds.? [v2:172.21.15.42:6836/164848384,v1:172.21.15.42:6838/164848384] up:boot 2024-09-21T01:06:03.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:03 smithi193 ceph-mon[34660]: mds.? [v2:172.21.15.42:6837/92579086,v1:172.21.15.42:6839/92579086] up:boot 2024-09-21T01:06:03.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:03 smithi193 ceph-mon[34660]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-21T01:06:03.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:03 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T01:06:03.731 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:03 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T01:06:03.731 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:03 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T01:06:03.731 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:03 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T01:06:03.731 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:03 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T01:06:03.731 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:03 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T01:06:03.731 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:03 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T01:06:03.731 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:03 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T01:06:03.731 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:03 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T01:06:03.731 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:03 smithi193 ceph-mon[34660]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T01:06:03.731 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:03 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/2914215267' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T01:06:03.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:03 smithi042 ceph-mon[34481]: pgmap v624: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 14 op/s 2024-09-21T01:06:03.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:03 smithi042 ceph-mon[34481]: mds.? [v2:172.21.15.1:6838/2943405440,v1:172.21.15.1:6839/2943405440] up:boot 2024-09-21T01:06:03.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:03 smithi042 ceph-mon[34481]: mds.? [v2:172.21.15.1:6840/3129851619,v1:172.21.15.1:6841/3129851619] up:boot 2024-09-21T01:06:03.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:03 smithi042 ceph-mon[34481]: mds.? [v2:172.21.15.193:6833/1850600887,v1:172.21.15.193:6835/1850600887] up:boot 2024-09-21T01:06:03.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:03 smithi042 ceph-mon[34481]: mds.? [v2:172.21.15.193:6832/2969342798,v1:172.21.15.193:6834/2969342798] up:boot 2024-09-21T01:06:03.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:03 smithi042 ceph-mon[34481]: mds.? [v2:172.21.15.193:6836/1547189869,v1:172.21.15.193:6837/1547189869] up:boot 2024-09-21T01:06:03.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:03 smithi042 ceph-mon[34481]: mds.? [v2:172.21.15.193:6838/3306172655,v1:172.21.15.193:6839/3306172655] up:boot 2024-09-21T01:06:03.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:03 smithi042 ceph-mon[34481]: mds.? [v2:172.21.15.42:6833/802396526,v1:172.21.15.42:6835/802396526] up:boot 2024-09-21T01:06:03.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:03 smithi042 ceph-mon[34481]: mds.? [v2:172.21.15.42:6832/4197888728,v1:172.21.15.42:6834/4197888728] up:boot 2024-09-21T01:06:03.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:03 smithi042 ceph-mon[34481]: mds.? [v2:172.21.15.42:6836/164848384,v1:172.21.15.42:6838/164848384] up:boot 2024-09-21T01:06:03.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:03 smithi042 ceph-mon[34481]: mds.? [v2:172.21.15.42:6837/92579086,v1:172.21.15.42:6839/92579086] up:boot 2024-09-21T01:06:03.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:03 smithi042 ceph-mon[34481]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-21T01:06:03.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:03 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T01:06:03.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:03 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T01:06:03.744 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:03 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T01:06:03.744 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:03 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T01:06:03.744 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:03 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T01:06:03.744 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:03 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T01:06:03.744 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:03 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T01:06:03.744 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:03 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T01:06:03.744 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:03 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T01:06:03.744 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:03 smithi042 ceph-mon[34481]: from='mgr.14150 172.21.15.1:0/3015155788' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T01:06:03.744 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:03 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/2914215267' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T01:06:03.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:03.805+0000 7f72197fa640 1 -- 172.21.15.1:0/2914215267 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v45) ==== 104+0+0 (secure 0 0 0) 0x7f720c0b6ca0 con 0x7f721c10a590 2024-09-21T01:06:03.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:03.808+0000 7f7221b4f640 1 -- 172.21.15.1:0/2914215267 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f72080b6510 msgr2=0x7f72080b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:03.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:03.808+0000 7f7221b4f640 1 --2- 172.21.15.1:0/2914215267 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f72080b6510 0x7f72080b8a20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f721c118410 tx=0x7f720400b390 comp rx=0 tx=0).stop 2024-09-21T01:06:03.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:03.808+0000 7f7221b4f640 1 -- 172.21.15.1:0/2914215267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f721c10a590 msgr2=0x7f721c1a2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:03.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:03.808+0000 7f7221b4f640 1 --2- 172.21.15.1:0/2914215267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f721c10a590 0x7f721c1a2c50 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f720c00d770 tx=0x7f720c00dc30 comp rx=0 tx=0).stop 2024-09-21T01:06:03.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:03.808+0000 7f7221b4f640 1 -- 172.21.15.1:0/2914215267 shutdown_connections 2024-09-21T01:06:03.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:03.808+0000 7f7221b4f640 1 --2- 172.21.15.1:0/2914215267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f721c116640 0x7f721c1a8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:03.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:03.808+0000 7f7221b4f640 1 --2- 172.21.15.1:0/2914215267 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f721c10aee0 0x7f721c1a31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:03.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:03.808+0000 7f7221b4f640 1 --2- 172.21.15.1:0/2914215267 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f72080b6510 0x7f72080b8a20 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:03.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:03.808+0000 7f7221b4f640 1 --2- 172.21.15.1:0/2914215267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f721c10a590 0x7f721c1a2c50 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:03.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:03.808+0000 7f7221b4f640 1 -- 172.21.15.1:0/2914215267 >> 172.21.15.1:0/2914215267 conn(0x7f721c070ec0 msgr2=0x7f721c10e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:03.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:03.808+0000 7f7221b4f640 1 -- 172.21.15.1:0/2914215267 shutdown_connections 2024-09-21T01:06:03.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:03.808+0000 7f7221b4f640 1 -- 172.21.15.1:0/2914215267 wait complete. 2024-09-21T01:06:04.489 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T01:06:04.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:04 smithi001 ceph-mon[31211]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T01:06:04.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:04 smithi001 ceph-mon[31211]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T01:06:04.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:04 smithi001 ceph-mon[31211]: Cluster is now healthy 2024-09-21T01:06:04.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:04 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/2914215267' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T01:06:04.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:04 smithi001 ceph-mon[31211]: fsmap 12 up:standby 2024-09-21T01:06:04.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:04 smithi193 ceph-mon[34660]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T01:06:04.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:04 smithi193 ceph-mon[34660]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T01:06:04.729 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:04 smithi193 ceph-mon[34660]: Cluster is now healthy 2024-09-21T01:06:04.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:04 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/2914215267' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T01:06:04.730 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:04 smithi193 ceph-mon[34660]: fsmap 12 up:standby 2024-09-21T01:06:04.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:04 smithi042 ceph-mon[34481]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T01:06:04.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:04 smithi042 ceph-mon[34481]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T01:06:04.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:04 smithi042 ceph-mon[34481]: Cluster is now healthy 2024-09-21T01:06:04.742 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:04 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/2914215267' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T01:06:04.743 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:04 smithi042 ceph-mon[34481]: fsmap 12 up:standby 2024-09-21T01:06:04.749 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:06:05.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.226+0000 7f4f26ed4640 1 -- 172.21.15.1:0/3307716369 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f201094d0 msgr2=0x7f4f201098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:05.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.226+0000 7f4f26ed4640 1 --2- 172.21.15.1:0/3307716369 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f201094d0 0x7f4f201098e0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f4f14009900 tx=0x7f4f1402a410 comp rx=0 tx=0).stop 2024-09-21T01:06:05.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.226+0000 7f4f26ed4640 1 -- 172.21.15.1:0/3307716369 shutdown_connections 2024-09-21T01:06:05.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.226+0000 7f4f26ed4640 1 --2- 172.21.15.1:0/3307716369 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4f20109e20 0x7f4f20110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.226+0000 7f4f26ed4640 1 --2- 172.21.15.1:0/3307716369 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f201094d0 0x7f4f201098e0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.226+0000 7f4f26ed4640 1 --2- 172.21.15.1:0/3307716369 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f20103b90 0x7f4f20103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.226+0000 7f4f26ed4640 1 -- 172.21.15.1:0/3307716369 >> 172.21.15.1:0/3307716369 conn(0x7f4f200ff600 msgr2=0x7f4f20101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:05.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.226+0000 7f4f26ed4640 1 -- 172.21.15.1:0/3307716369 shutdown_connections 2024-09-21T01:06:05.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.226+0000 7f4f26ed4640 1 -- 172.21.15.1:0/3307716369 wait complete. 2024-09-21T01:06:05.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.227+0000 7f4f26ed4640 1 Processor -- start 2024-09-21T01:06:05.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.227+0000 7f4f26ed4640 1 -- start start 2024-09-21T01:06:05.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.227+0000 7f4f26ed4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4f20103b90 0x7f4f2019a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:05.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.227+0000 7f4f26ed4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f201094d0 0x7f4f2019aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:05.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.227+0000 7f4f26ed4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f20109e20 0x7f4f2019fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:05.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.227+0000 7f4f26ed4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4f20113ae0 con 0x7f4f20109e20 2024-09-21T01:06:05.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.227+0000 7f4f26ed4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4f20113960 con 0x7f4f201094d0 2024-09-21T01:06:05.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.227+0000 7f4f26ed4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4f20113c60 con 0x7f4f20103b90 2024-09-21T01:06:05.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.227+0000 7f4f25471640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f20109e20 0x7f4f2019fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:05.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.227+0000 7f4f25471640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f20109e20 0x7f4f2019fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54008/0 (socket says 172.21.15.1:54008) 2024-09-21T01:06:05.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.228+0000 7f4f25471640 1 -- 172.21.15.1:0/465616917 learned_addr learned my addr 172.21.15.1:0/465616917 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:06:05.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.228+0000 7f4f24c70640 1 --2- 172.21.15.1:0/465616917 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4f20103b90 0x7f4f2019a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:05.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.228+0000 7f4f1ffff640 1 --2- 172.21.15.1:0/465616917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f201094d0 0x7f4f2019aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:05.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.228+0000 7f4f25471640 1 -- 172.21.15.1:0/465616917 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4f20103b90 msgr2=0x7f4f2019a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:05.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.228+0000 7f4f25471640 1 --2- 172.21.15.1:0/465616917 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4f20103b90 0x7f4f2019a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.228+0000 7f4f25471640 1 -- 172.21.15.1:0/465616917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f201094d0 msgr2=0x7f4f2019aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:05.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.228+0000 7f4f25471640 1 --2- 172.21.15.1:0/465616917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f201094d0 0x7f4f2019aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.228+0000 7f4f25471640 1 -- 172.21.15.1:0/465616917 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f201a0400 con 0x7f4f20109e20 2024-09-21T01:06:05.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.228+0000 7f4f25471640 1 --2- 172.21.15.1:0/465616917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f20109e20 0x7f4f2019fcd0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800eaa0 tx=0x7f4f1800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:05.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.228+0000 7f4f1dffb640 1 -- 172.21.15.1:0/465616917 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1800cdb0 con 0x7f4f20109e20 2024-09-21T01:06:05.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.228+0000 7f4f1dffb640 1 -- 172.21.15.1:0/465616917 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f18005020 con 0x7f4f20109e20 2024-09-21T01:06:05.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.228+0000 7f4f26ed4640 1 -- 172.21.15.1:0/465616917 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f201a06f0 con 0x7f4f20109e20 2024-09-21T01:06:05.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.228+0000 7f4f1dffb640 1 -- 172.21.15.1:0/465616917 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f180116d0 con 0x7f4f20109e20 2024-09-21T01:06:05.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.229+0000 7f4f26ed4640 1 -- 172.21.15.1:0/465616917 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f201a6e50 con 0x7f4f20109e20 2024-09-21T01:06:05.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.229+0000 7f4f26ed4640 1 -- 172.21.15.1:0/465616917 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f20103fa0 con 0x7f4f20109e20 2024-09-21T01:06:05.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.231+0000 7f4f1dffb640 1 -- 172.21.15.1:0/465616917 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f4f180051d0 con 0x7f4f20109e20 2024-09-21T01:06:05.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.232+0000 7f4f1dffb640 1 --2- 172.21.15.1:0/465616917 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4f080b6510 0x7f4f080b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:05.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.232+0000 7f4f24c70640 1 --2- 172.21.15.1:0/465616917 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4f080b6510 0x7f4f080b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:05.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.232+0000 7f4f1dffb640 1 -- 172.21.15.1:0/465616917 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8699+0+0 (secure 0 0 0) 0x7f4f180e7b00 con 0x7f4f20109e20 2024-09-21T01:06:05.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.232+0000 7f4f24c70640 1 --2- 172.21.15.1:0/465616917 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4f080b6510 0x7f4f080b8a20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4f1000bbe0 tx=0x7f4f1000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:05.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.235+0000 7f4f1dffb640 1 -- 172.21.15.1:0/465616917 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4f18016030 con 0x7f4f20109e20 2024-09-21T01:06:05.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.424+0000 7f4f26ed4640 1 -- 172.21.15.1:0/465616917 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4f2019b5c0 con 0x7f4f20109e20 2024-09-21T01:06:05.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.808+0000 7f4f1dffb640 1 -- 172.21.15.1:0/465616917 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v77) ==== 181+0+0 (secure 0 0 0) 0x7f4f2019b5c0 con 0x7f4f20109e20 2024-09-21T01:06:05.809 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' removed 2024-09-21T01:06:05.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.812+0000 7f4f26ed4640 1 -- 172.21.15.1:0/465616917 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4f080b6510 msgr2=0x7f4f080b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:05.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.812+0000 7f4f26ed4640 1 --2- 172.21.15.1:0/465616917 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4f080b6510 0x7f4f080b8a20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4f1000bbe0 tx=0x7f4f1000b390 comp rx=0 tx=0).stop 2024-09-21T01:06:05.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.812+0000 7f4f26ed4640 1 -- 172.21.15.1:0/465616917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f20109e20 msgr2=0x7f4f2019fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:05.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.812+0000 7f4f26ed4640 1 --2- 172.21.15.1:0/465616917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f20109e20 0x7f4f2019fcd0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800eaa0 tx=0x7f4f1800ef60 comp rx=0 tx=0).stop 2024-09-21T01:06:05.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.812+0000 7f4f26ed4640 1 -- 172.21.15.1:0/465616917 shutdown_connections 2024-09-21T01:06:05.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.812+0000 7f4f26ed4640 1 --2- 172.21.15.1:0/465616917 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f4f080b6510 0x7f4f080b8a20 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.812+0000 7f4f26ed4640 1 --2- 172.21.15.1:0/465616917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f20109e20 0x7f4f2019fcd0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.812+0000 7f4f26ed4640 1 --2- 172.21.15.1:0/465616917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f201094d0 0x7f4f2019aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.812+0000 7f4f26ed4640 1 --2- 172.21.15.1:0/465616917 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4f20103b90 0x7f4f2019a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.812+0000 7f4f26ed4640 1 -- 172.21.15.1:0/465616917 >> 172.21.15.1:0/465616917 conn(0x7f4f200ff600 msgr2=0x7f4f20101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:05.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.813+0000 7f4f26ed4640 1 -- 172.21.15.1:0/465616917 shutdown_connections 2024-09-21T01:06:05.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:05.813+0000 7f4f26ed4640 1 -- 172.21.15.1:0/465616917 wait complete. 2024-09-21T01:06:06.143 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:05 smithi001 ceph-mon[31211]: pgmap v625: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-21T01:06:06.143 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:05 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/465616917' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T01:06:06.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:05 smithi193 ceph-mon[34660]: pgmap v625: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-21T01:06:06.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:05 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/465616917' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T01:06:06.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:05 smithi042 ceph-mon[34481]: pgmap v625: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-21T01:06:06.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:05 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/465616917' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T01:06:06.588 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3972c20-77b2-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T01:06:06.856 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:06:07.136 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:06 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/465616917' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T01:06:07.137 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:06 smithi001 ceph-mon[31211]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T01:06:07.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:06 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/465616917' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T01:06:07.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:06 smithi193 ceph-mon[34660]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T01:06:07.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:06 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/465616917' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T01:06:07.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:06 smithi042 ceph-mon[34481]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T01:06:07.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.485+0000 7f42df307640 1 -- 172.21.15.1:0/1102552997 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f42d8104a30 msgr2=0x7f42d8104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:07.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.485+0000 7f42df307640 1 --2- 172.21.15.1:0/1102552997 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f42d8104a30 0x7f42d8104e40 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f42d4009900 tx=0x7f42d402a410 comp rx=0 tx=0).stop 2024-09-21T01:06:07.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.485+0000 7f42df307640 1 -- 172.21.15.1:0/1102552997 shutdown_connections 2024-09-21T01:06:07.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.485+0000 7f42df307640 1 --2- 172.21.15.1:0/1102552997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42d810de60 0x7f42d8110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:07.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.485+0000 7f42df307640 1 --2- 172.21.15.1:0/1102552997 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42d8105380 0x7f42d810d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:07.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.486+0000 7f42df307640 1 --2- 172.21.15.1:0/1102552997 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f42d8104a30 0x7f42d8104e40 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:07.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.486+0000 7f42df307640 1 -- 172.21.15.1:0/1102552997 >> 172.21.15.1:0/1102552997 conn(0x7f42d8079760 msgr2=0x7f42d8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:07.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.486+0000 7f42df307640 1 -- 172.21.15.1:0/1102552997 shutdown_connections 2024-09-21T01:06:07.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.486+0000 7f42df307640 1 -- 172.21.15.1:0/1102552997 wait complete. 2024-09-21T01:06:07.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.486+0000 7f42df307640 1 Processor -- start 2024-09-21T01:06:07.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.486+0000 7f42df307640 1 -- start start 2024-09-21T01:06:07.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.487+0000 7f42df307640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42d8104a30 0x7f42d819a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:07.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.487+0000 7f42df307640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f42d8105380 0x7f42d819aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:07.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.487+0000 7f42df307640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42d810de60 0x7f42d819fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:07.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.487+0000 7f42df307640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f42d8113ac0 con 0x7f42d8105380 2024-09-21T01:06:07.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.487+0000 7f42df307640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f42d8113940 con 0x7f42d810de60 2024-09-21T01:06:07.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.487+0000 7f42df307640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f42d8113c40 con 0x7f42d8104a30 2024-09-21T01:06:07.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.487+0000 7f42dc8a2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f42d8105380 0x7f42d819aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:07.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.487+0000 7f42dc8a2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f42d8105380 0x7f42d819aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54034/0 (socket says 172.21.15.1:54034) 2024-09-21T01:06:07.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.487+0000 7f42dc8a2640 1 -- 172.21.15.1:0/1832783615 learned_addr learned my addr 172.21.15.1:0/1832783615 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-21T01:06:07.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.487+0000 7f42dd0a3640 1 --2- 172.21.15.1:0/1832783615 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42d8104a30 0x7f42d819a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:07.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.487+0000 7f42dd8a4640 1 --2- 172.21.15.1:0/1832783615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42d810de60 0x7f42d819fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:07.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.487+0000 7f42dc8a2640 1 -- 172.21.15.1:0/1832783615 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42d8104a30 msgr2=0x7f42d819a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:07.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.487+0000 7f42dc8a2640 1 --2- 172.21.15.1:0/1832783615 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42d8104a30 0x7f42d819a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:07.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.487+0000 7f42dc8a2640 1 -- 172.21.15.1:0/1832783615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42d810de60 msgr2=0x7f42d819fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:07.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.487+0000 7f42dc8a2640 1 --2- 172.21.15.1:0/1832783615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42d810de60 0x7f42d819fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:07.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.487+0000 7f42dc8a2640 1 -- 172.21.15.1:0/1832783615 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d81a0480 con 0x7f42d8105380 2024-09-21T01:06:07.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.487+0000 7f42dd8a4640 1 --2- 172.21.15.1:0/1832783615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42d810de60 0x7f42d819fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:06:07.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.487+0000 7f42dc8a2640 1 --2- 172.21.15.1:0/1832783615 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f42d8105380 0x7f42d819aab0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f42c800d750 tx=0x7f42c800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:07.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.487+0000 7f42ce7fc640 1 -- 172.21.15.1:0/1832783615 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c8017070 con 0x7f42d8105380 2024-09-21T01:06:07.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.487+0000 7f42ce7fc640 1 -- 172.21.15.1:0/1832783615 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42c80054d0 con 0x7f42d8105380 2024-09-21T01:06:07.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.487+0000 7f42df307640 1 -- 172.21.15.1:0/1832783615 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42d81a0770 con 0x7f42d8105380 2024-09-21T01:06:07.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.487+0000 7f42ce7fc640 1 -- 172.21.15.1:0/1832783615 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c8004c30 con 0x7f42d8105380 2024-09-21T01:06:07.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.488+0000 7f42df307640 1 -- 172.21.15.1:0/1832783615 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42d81a6ed0 con 0x7f42d8105380 2024-09-21T01:06:07.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.489+0000 7f42df307640 1 -- 172.21.15.1:0/1832783615 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42d806c1f0 con 0x7f42d8105380 2024-09-21T01:06:07.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.490+0000 7f42ce7fc640 1 -- 172.21.15.1:0/1832783615 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 154511+0+0 (secure 0 0 0) 0x7f42c8004dd0 con 0x7f42d8105380 2024-09-21T01:06:07.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.491+0000 7f42ce7fc640 1 --2- 172.21.15.1:0/1832783615 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f42c40b6590 0x7f42c40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:07.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.492+0000 7f42dd0a3640 1 --2- 172.21.15.1:0/1832783615 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f42c40b6590 0x7f42c40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:07.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.492+0000 7f42ce7fc640 1 -- 172.21.15.1:0/1832783615 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8145+0+0 (secure 0 0 0) 0x7f42c80e6fb0 con 0x7f42d8105380 2024-09-21T01:06:07.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.492+0000 7f42dd0a3640 1 --2- 172.21.15.1:0/1832783615 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f42c40b6590 0x7f42c40b8aa0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f42d4000c00 tx=0x7f42d4031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:07.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.495+0000 7f42ce7fc640 1 -- 172.21.15.1:0/1832783615 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f42c80ad960 con 0x7f42d8105380 2024-09-21T01:06:07.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.684+0000 7f42df307640 1 -- 172.21.15.1:0/1832783615 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f42d8104e40 con 0x7f42d8105380 2024-09-21T01:06:07.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.830+0000 7f42ce7fc640 1 -- 172.21.15.1:0/1832783615 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v78) ==== 169+0+0 (secure 0 0 0) 0x7f42d8104e40 con 0x7f42d8105380 2024-09-21T01:06:07.831 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' removed 2024-09-21T01:06:07.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.834+0000 7f42df307640 1 -- 172.21.15.1:0/1832783615 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f42c40b6590 msgr2=0x7f42c40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:07.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.834+0000 7f42df307640 1 --2- 172.21.15.1:0/1832783615 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f42c40b6590 0x7f42c40b8aa0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f42d4000c00 tx=0x7f42d4031400 comp rx=0 tx=0).stop 2024-09-21T01:06:07.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.834+0000 7f42df307640 1 -- 172.21.15.1:0/1832783615 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f42d8105380 msgr2=0x7f42d819aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:07.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.834+0000 7f42df307640 1 --2- 172.21.15.1:0/1832783615 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f42d8105380 0x7f42d819aab0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f42c800d750 tx=0x7f42c800dc10 comp rx=0 tx=0).stop 2024-09-21T01:06:07.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.836+0000 7f42df307640 1 -- 172.21.15.1:0/1832783615 shutdown_connections 2024-09-21T01:06:07.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.836+0000 7f42df307640 1 --2- 172.21.15.1:0/1832783615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42d810de60 0x7f42d819fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:07.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.836+0000 7f42df307640 1 --2- 172.21.15.1:0/1832783615 >> [v2:172.21.15.1:6800/2032980330,v1:172.21.15.1:6801/2032980330] conn(0x7f42c40b6590 0x7f42c40b8aa0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:07.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.836+0000 7f42df307640 1 --2- 172.21.15.1:0/1832783615 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f42d8105380 0x7f42d819aab0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:07.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.836+0000 7f42df307640 1 --2- 172.21.15.1:0/1832783615 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42d8104a30 0x7f42d819a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:07.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.836+0000 7f42df307640 1 -- 172.21.15.1:0/1832783615 >> 172.21.15.1:0/1832783615 conn(0x7f42d8079760 msgr2=0x7f42d81008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:07.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.836+0000 7f42df307640 1 -- 172.21.15.1:0/1832783615 shutdown_connections 2024-09-21T01:06:07.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-21T01:06:07.836+0000 7f42df307640 1 -- 172.21.15.1:0/1832783615 wait complete. 2024-09-21T01:06:07.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:07 smithi001 ceph-mon[31211]: pgmap v627: 65 pgs: 65 active+clean; 577 KiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:06:07.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:07 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1832783615' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T01:06:08.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:07 smithi193 ceph-mon[34660]: pgmap v627: 65 pgs: 65 active+clean; 577 KiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:06:08.229 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:07 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/1832783615' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T01:06:08.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:07 smithi042 ceph-mon[34481]: pgmap v627: 65 pgs: 65 active+clean; 577 KiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:06:08.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:07 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/1832783615' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T01:06:08.525 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:06:08.554 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:06:08.591 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:06:08.618 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-21T01:06:08.618 DEBUG:teuthology.orchestra.run.smithi001:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T01:06:08.634 DEBUG:teuthology.orchestra.run.smithi042:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T01:06:08.651 DEBUG:teuthology.orchestra.run.smithi193:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T01:06:08.673 INFO:tasks.cephadm:Stopping all daemons... 2024-09-21T01:06:08.673 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-21T01:06:08.673 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mon.a 2024-09-21T01:06:08.837 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:08 smithi001 systemd[1]: Stopping Ceph mon.a for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:06:08.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:08 smithi193 ceph-mon[34660]: from='client.? 172.21.15.1:0/1832783615' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T01:06:08.980 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:08 smithi193 ceph-mon[34660]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T01:06:09.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:08 smithi001 ceph-mon[31211]: from='client.? 172.21.15.1:0/1832783615' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T01:06:09.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:08 smithi001 ceph-mon[31211]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T01:06:09.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:09 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mon-a[31207]: 2024-09-21T01:06:09.007+0000 7f87fadf7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:06:09.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:09 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mon-a[31207]: 2024-09-21T01:06:09.007+0000 7f87fadf7640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-21T01:06:09.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:09 smithi001 podman[103710]: 2024-09-21 01:06:09.039155471 +0000 UTC m=+0.172175287 container died cf9589d851866bcaa582824d56d9222900c430fe1d3313842d992dd218ff1f44 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mon-a, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T01:06:09.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:08 smithi042 ceph-mon[34481]: from='client.? 172.21.15.1:0/1832783615' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T01:06:09.242 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:08 smithi042 ceph-mon[34481]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T01:06:09.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:09 smithi001 podman[103710]: 2024-09-21 01:06:09.349119525 +0000 UTC m=+0.482139340 container cleanup cf9589d851866bcaa582824d56d9222900c430fe1d3313842d992dd218ff1f44 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mon-a, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2) 2024-09-21T01:06:09.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:09 smithi001 bash[103710]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mon-a 2024-09-21T01:06:10.011 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mon.a.service' 2024-09-21T01:06:10.033 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:09 smithi001 podman[103722]: 2024-09-21 01:06:09.77610117 +0000 UTC m=+0.740236809 container remove cf9589d851866bcaa582824d56d9222900c430fe1d3313842d992dd218ff1f44 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:06:10.034 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:10 smithi001 systemd[1]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T01:06:10.034 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:10 smithi001 systemd[1]: Stopped Ceph mon.a for d3972c20-77b2-11ef-baf5-efdc52797490. 2024-09-21T01:06:10.034 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 21 01:06:10 smithi001 systemd[1]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mon.a.service: Consumed 19.780s CPU time. 2024-09-21T01:06:10.123 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:06:10.124 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-21T01:06:10.124 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-21T01:06:10.124 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mon.b 2024-09-21T01:06:10.492 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:10 smithi042 systemd[1]: Stopping Ceph mon.b for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:06:10.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:10 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mon-b[34477]: 2024-09-21T01:06:10.530+0000 7fe2c33b1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:06:10.992 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:10 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mon-b[34477]: 2024-09-21T01:06:10.530+0000 7fe2c33b1640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-21T01:06:10.993 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:10 smithi042 podman[66614]: 2024-09-21 01:06:10.612913038 +0000 UTC m=+0.224566162 container died 966868c6dd90b21b2b8cad1930946937d59f17e1a3e1988fdf801357e9176831 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mon-b, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T01:06:11.392 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:11 smithi042 podman[66614]: 2024-09-21 01:06:11.140359219 +0000 UTC m=+0.752012343 container cleanup 966868c6dd90b21b2b8cad1930946937d59f17e1a3e1988fdf801357e9176831 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mon-b, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:06:11.392 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:11 smithi042 bash[66614]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mon-b 2024-09-21T01:06:11.622 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mon.b.service' 2024-09-21T01:06:11.644 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:11 smithi042 podman[66627]: 2024-09-21 01:06:11.391940771 +0000 UTC m=+0.776900028 container remove 966868c6dd90b21b2b8cad1930946937d59f17e1a3e1988fdf801357e9176831 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mon-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T01:06:11.644 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:11 smithi042 systemd[1]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mon.b.service: Deactivated successfully. 2024-09-21T01:06:11.644 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:11 smithi042 systemd[1]: Stopped Ceph mon.b for d3972c20-77b2-11ef-baf5-efdc52797490. 2024-09-21T01:06:11.644 INFO:journalctl@ceph.mon.b.smithi042.stdout:Sep 21 01:06:11 smithi042 systemd[1]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mon.b.service: Consumed 11.814s CPU time. 2024-09-21T01:06:11.679 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:06:11.679 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-21T01:06:11.679 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-21T01:06:11.679 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mon.c 2024-09-21T01:06:11.979 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:11 smithi193 systemd[1]: Stopping Ceph mon.c for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:06:12.302 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:11 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mon-c[34656]: 2024-09-21T01:06:11.983+0000 7ff0cf6b3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:06:12.302 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:11 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mon-c[34656]: 2024-09-21T01:06:11.983+0000 7ff0cf6b3640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-21T01:06:12.302 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:12 smithi193 podman[66752]: 2024-09-21 01:06:12.004689052 +0000 UTC m=+0.126274720 container died 9ad1b23dd6cd60d792594a83cc1ee27b4dceeee10770b04d78626f3ac77de353 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mon-c, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:06:12.611 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:12 smithi193 podman[66752]: 2024-09-21 01:06:12.401114491 +0000 UTC m=+0.522700158 container cleanup 9ad1b23dd6cd60d792594a83cc1ee27b4dceeee10770b04d78626f3ac77de353 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mon-c, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:06:12.611 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 21 01:06:12 smithi193 bash[66752]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mon-c 2024-09-21T01:06:12.829 DEBUG:teuthology.orchestra.run.smithi193:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mon.c.service' 2024-09-21T01:06:12.885 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:06:12.885 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-21T01:06:12.886 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-21T01:06:12.886 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mgr.x 2024-09-21T01:06:13.205 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 01:06:12 smithi001 systemd[1]: Stopping Ceph mgr.x for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:06:13.460 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 01:06:13 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x[31439]: 2024-09-21T01:06:13.203+0000 7fde17243640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:06:13.460 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 01:06:13 smithi001 podman[103834]: 2024-09-21 01:06:13.235108736 +0000 UTC m=+0.156641693 container died 107c19e3a41fcb34112c4f2ac8f94033095c540229c97cec871946ecf5eef34c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:06:13.850 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 01:06:13 smithi001 podman[103834]: 2024-09-21 01:06:13.588348632 +0000 UTC m=+0.509881583 container cleanup 107c19e3a41fcb34112c4f2ac8f94033095c540229c97cec871946ecf5eef34c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , ceph=True) 2024-09-21T01:06:13.850 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 21 01:06:13 smithi001 bash[103834]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-x 2024-09-21T01:06:14.071 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mgr.x.service' 2024-09-21T01:06:14.109 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:06:14.109 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-21T01:06:14.109 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-21T01:06:14.109 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mgr.y 2024-09-21T01:06:14.458 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 01:06:14 smithi042 systemd[1]: Stopping Ceph mgr.y for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:06:14.742 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 01:06:14 smithi042 podman[66738]: 2024-09-21 01:06:14.458041783 +0000 UTC m=+0.144807062 container died 67d58454386daf6e512953e30e5286251954913c8c3bd8d324b083b6eb0f9940 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-y, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T01:06:15.131 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 01:06:14 smithi042 podman[66738]: 2024-09-21 01:06:14.871341706 +0000 UTC m=+0.558106970 container cleanup 67d58454386daf6e512953e30e5286251954913c8c3bd8d324b083b6eb0f9940 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-y, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:06:15.132 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 21 01:06:14 smithi042 bash[66738]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-y 2024-09-21T01:06:15.266 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mgr.y.service' 2024-09-21T01:06:15.308 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:06:15.308 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-21T01:06:15.308 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-21T01:06:15.308 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mgr.z 2024-09-21T01:06:15.729 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 21 01:06:15 smithi193 systemd[1]: Stopping Ceph mgr.z for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:06:16.008 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 21 01:06:15 smithi193 podman[66876]: 2024-09-21 01:06:15.737423747 +0000 UTC m=+0.234599015 container died e589e006b115792cfc50300677bc2c348ceee409a172768302931a56812ade2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-z, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:06:16.384 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 21 01:06:16 smithi193 podman[66876]: 2024-09-21 01:06:16.157302245 +0000 UTC m=+0.654477507 container cleanup e589e006b115792cfc50300677bc2c348ceee409a172768302931a56812ade2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:06:16.384 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 21 01:06:16 smithi193 bash[66876]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-z 2024-09-21T01:06:16.678 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 21 01:06:16 smithi193 podman[66889]: 2024-09-21 01:06:16.383948758 +0000 UTC m=+0.641819269 container remove e589e006b115792cfc50300677bc2c348ceee409a172768302931a56812ade2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mgr-z, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-21T01:06:16.679 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 21 01:06:16 smithi193 systemd[1]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-09-21T01:06:16.697 DEBUG:teuthology.orchestra.run.smithi193:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mgr.z.service' 2024-09-21T01:06:16.733 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:06:16.733 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-21T01:06:16.734 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-21T01:06:16.734 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-d3972c20-77b2-11ef-baf5-efdc52797490@osd.0 2024-09-21T01:06:17.052 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 21 01:06:16 smithi001 systemd[1]: Stopping Ceph osd.0 for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:06:17.460 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 21 01:06:17 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-0[46657]: 2024-09-21T01:06:17.051+0000 7f7baea1b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:06:17.460 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 21 01:06:17 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-0[46657]: 2024-09-21T01:06:17.051+0000 7f7baea1b640 -1 osd.0 78 *** Got signal Terminated *** 2024-09-21T01:06:17.460 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 21 01:06:17 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-0[46657]: 2024-09-21T01:06:17.051+0000 7f7baea1b640 -1 osd.0 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:06:22.805 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 21 01:06:22 smithi001 podman[103957]: 2024-09-21 01:06:22.527261619 +0000 UTC m=+5.601941579 container died 31158983a3b4c5ba9078d1a63bc453d33cbbf471a977d28a0da9ab7586428099 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-21T01:06:23.196 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 21 01:06:22 smithi001 podman[103957]: 2024-09-21 01:06:22.894272827 +0000 UTC m=+5.968952783 container cleanup 31158983a3b4c5ba9078d1a63bc453d33cbbf471a977d28a0da9ab7586428099 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:06:23.196 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 21 01:06:22 smithi001 bash[103957]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-0 2024-09-21T01:06:23.460 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 21 01:06:23 smithi001 podman[103977]: 2024-09-21 01:06:23.195995613 +0000 UTC m=+0.665403661 container remove 31158983a3b4c5ba9078d1a63bc453d33cbbf471a977d28a0da9ab7586428099 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:06:23.713 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 21 01:06:23 smithi001 podman[104062]: 2024-09-21 01:06:23.470150245 +0000 UTC m=+0.017450618 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:06:23.713 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 21 01:06:23 smithi001 podman[104062]: 2024-09-21 01:06:23.580601479 +0000 UTC m=+0.127901881 container create 18244c45f76f40b64e89abf27e6ebbff7be7128a79a3b404eefc7fb24570b0d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-0-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-21T01:06:24.034 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 21 01:06:23 smithi001 podman[104062]: 2024-09-21 01:06:23.833363625 +0000 UTC m=+0.380663991 container init 18244c45f76f40b64e89abf27e6ebbff7be7128a79a3b404eefc7fb24570b0d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0) 2024-09-21T01:06:24.034 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 21 01:06:23 smithi001 podman[104062]: 2024-09-21 01:06:23.836754422 +0000 UTC m=+0.384054779 container start 18244c45f76f40b64e89abf27e6ebbff7be7128a79a3b404eefc7fb24570b0d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-21T01:06:24.034 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 21 01:06:23 smithi001 podman[104062]: 2024-09-21 01:06:23.924938207 +0000 UTC m=+0.472238582 container attach 18244c45f76f40b64e89abf27e6ebbff7be7128a79a3b404eefc7fb24570b0d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0) 2024-09-21T01:06:24.306 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 21 01:06:24 smithi001 podman[104062]: 2024-09-21 01:06:24.033631243 +0000 UTC m=+0.580931603 container died 18244c45f76f40b64e89abf27e6ebbff7be7128a79a3b404eefc7fb24570b0d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-21T01:06:24.831 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@osd.0.service' 2024-09-21T01:06:24.872 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:06:24.873 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-21T01:06:24.873 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-21T01:06:24.873 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-d3972c20-77b2-11ef-baf5-efdc52797490@osd.1 2024-09-21T01:06:25.202 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 01:06:24 smithi042 systemd[1]: Stopping Ceph osd.1 for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:06:25.492 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 01:06:25 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-1[38383]: 2024-09-21T01:06:25.200+0000 7f8dd1bc4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:06:25.492 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 01:06:25 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-1[38383]: 2024-09-21T01:06:25.200+0000 7f8dd1bc4640 -1 osd.1 78 *** Got signal Terminated *** 2024-09-21T01:06:25.492 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 01:06:25 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-1[38383]: 2024-09-21T01:06:25.201+0000 7f8dd1bc4640 -1 osd.1 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:06:31.053 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 01:06:30 smithi042 podman[66872]: 2024-09-21 01:06:30.753394681 +0000 UTC m=+5.673746170 container died 448f656725e0558d324de14679ad60430ea36412d2377af104d5c8e49ec34a14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-1, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T01:06:31.437 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 01:06:31 smithi042 podman[66872]: 2024-09-21 01:06:31.15229701 +0000 UTC m=+6.072648496 container cleanup 448f656725e0558d324de14679ad60430ea36412d2377af104d5c8e49ec34a14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T01:06:31.437 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 01:06:31 smithi042 bash[66872]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-1 2024-09-21T01:06:31.742 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 01:06:31 smithi042 podman[66890]: 2024-09-21 01:06:31.43739848 +0000 UTC m=+0.682078649 container remove 448f656725e0558d324de14679ad60430ea36412d2377af104d5c8e49ec34a14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-1, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T01:06:32.033 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 01:06:31 smithi042 podman[66982]: 2024-09-21 01:06:31.653880612 +0000 UTC m=+0.016127242 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:06:32.033 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 01:06:31 smithi042 podman[66982]: 2024-09-21 01:06:31.771670875 +0000 UTC m=+0.133917492 container create aab431a279536bff46cfb1b3b652a05699814e9b02bbf24fa0a29e49aee9ee66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-1-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-21T01:06:32.418 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 01:06:32 smithi042 podman[66982]: 2024-09-21 01:06:32.032685668 +0000 UTC m=+0.394932285 container init aab431a279536bff46cfb1b3b652a05699814e9b02bbf24fa0a29e49aee9ee66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-21T01:06:32.418 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 01:06:32 smithi042 podman[66982]: 2024-09-21 01:06:32.036154063 +0000 UTC m=+0.398400683 container start aab431a279536bff46cfb1b3b652a05699814e9b02bbf24fa0a29e49aee9ee66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-21T01:06:32.418 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 01:06:32 smithi042 podman[66982]: 2024-09-21 01:06:32.174680231 +0000 UTC m=+0.536926855 container attach aab431a279536bff46cfb1b3b652a05699814e9b02bbf24fa0a29e49aee9ee66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:06:32.694 INFO:journalctl@ceph.osd.1.smithi042.stdout:Sep 21 01:06:32 smithi042 podman[66982]: 2024-09-21 01:06:32.418080563 +0000 UTC m=+0.780327191 container died aab431a279536bff46cfb1b3b652a05699814e9b02bbf24fa0a29e49aee9ee66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True) 2024-09-21T01:06:33.128 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@osd.1.service' 2024-09-21T01:06:33.167 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:06:33.167 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-21T01:06:33.167 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-21T01:06:33.167 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ceph-d3972c20-77b2-11ef-baf5-efdc52797490@osd.2 2024-09-21T01:06:33.479 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 21 01:06:33 smithi193 systemd[1]: Stopping Ceph osd.2 for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:06:34.229 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 21 01:06:33 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-2[39042]: 2024-09-21T01:06:33.760+0000 7f4cfc951640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:06:34.229 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 21 01:06:33 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-2[39042]: 2024-09-21T01:06:33.761+0000 7f4cfc951640 -1 osd.2 78 *** Got signal Terminated *** 2024-09-21T01:06:34.230 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 21 01:06:33 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-2[39042]: 2024-09-21T01:06:33.761+0000 7f4cfc951640 -1 osd.2 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:06:39.520 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 21 01:06:39 smithi193 podman[67008]: 2024-09-21 01:06:39.236707368 +0000 UTC m=+5.875884269 container died a32da94b792813bbc8409a111410c6569d5cc1b45822da1d4b6aba9825ad835d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-21T01:06:39.904 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 21 01:06:39 smithi193 podman[67008]: 2024-09-21 01:06:39.619873504 +0000 UTC m=+6.259050409 container cleanup a32da94b792813bbc8409a111410c6569d5cc1b45822da1d4b6aba9825ad835d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T01:06:39.905 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 21 01:06:39 smithi193 bash[67008]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-2 2024-09-21T01:06:40.229 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 21 01:06:39 smithi193 podman[67024]: 2024-09-21 01:06:39.904504916 +0000 UTC m=+0.662276468 container remove a32da94b792813bbc8409a111410c6569d5cc1b45822da1d4b6aba9825ad835d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-21T01:06:40.500 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 21 01:06:40 smithi193 podman[67115]: 2024-09-21 01:06:40.138782279 +0000 UTC m=+0.015655887 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:06:40.500 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 21 01:06:40 smithi193 podman[67115]: 2024-09-21 01:06:40.263810687 +0000 UTC m=+0.140684294 container create 9ffc08dce3afa74c728f9b2c200302295dd9715680dbe6c2ba384f9d1d026c64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True) 2024-09-21T01:06:40.980 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 21 01:06:40 smithi193 podman[67115]: 2024-09-21 01:06:40.500116221 +0000 UTC m=+0.376989828 container init 9ffc08dce3afa74c728f9b2c200302295dd9715680dbe6c2ba384f9d1d026c64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:06:40.980 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 21 01:06:40 smithi193 podman[67115]: 2024-09-21 01:06:40.503606171 +0000 UTC m=+0.380479775 container start 9ffc08dce3afa74c728f9b2c200302295dd9715680dbe6c2ba384f9d1d026c64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-2-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux ) 2024-09-21T01:06:40.980 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 21 01:06:40 smithi193 podman[67115]: 2024-09-21 01:06:40.600095234 +0000 UTC m=+0.476968838 container attach 9ffc08dce3afa74c728f9b2c200302295dd9715680dbe6c2ba384f9d1d026c64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T01:06:40.980 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 21 01:06:40 smithi193 podman[67115]: 2024-09-21 01:06:40.695246151 +0000 UTC m=+0.572119757 container died 9ffc08dce3afa74c728f9b2c200302295dd9715680dbe6c2ba384f9d1d026c64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T01:06:41.338 DEBUG:teuthology.orchestra.run.smithi193:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@osd.2.service' 2024-09-21T01:06:41.377 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:06:41.378 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-21T01:06:41.378 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-21T01:06:41.378 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-d3972c20-77b2-11ef-baf5-efdc52797490@osd.3 2024-09-21T01:06:41.709 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 21 01:06:41 smithi001 systemd[1]: Stopping Ceph osd.3 for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:06:41.960 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 21 01:06:41 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-3[53057]: 2024-09-21T01:06:41.707+0000 7f77552eb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:06:41.960 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 21 01:06:41 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-3[53057]: 2024-09-21T01:06:41.707+0000 7f77552eb640 -1 osd.3 78 *** Got signal Terminated *** 2024-09-21T01:06:41.960 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 21 01:06:41 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-3[53057]: 2024-09-21T01:06:41.707+0000 7f77552eb640 -1 osd.3 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:06:44.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:06:44 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:06:44.206+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.655501+0000 front 2024-09-21T01:06:21.655530+0000 (oldest deadline 2024-09-21T01:06:43.955632+0000) 2024-09-21T01:06:44.461 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:06:44 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:06:44.092+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:06:45.370 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:06:45 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:06:45.062+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:06:45.371 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:06:45 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:06:45.248+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.655501+0000 front 2024-09-21T01:06:21.655530+0000 (oldest deadline 2024-09-21T01:06:43.955632+0000) 2024-09-21T01:06:45.710 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 21 01:06:45 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-3[53057]: 2024-09-21T01:06:45.368+0000 7f77518d6640 -1 osd.3 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.024692+0000 front 2024-09-21T01:06:20.024726+0000 (oldest deadline 2024-09-21T01:06:45.324837+0000) 2024-09-21T01:06:46.415 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:06:46 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:06:46.060+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:06:46.415 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:06:46 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:06:46.219+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.655501+0000 front 2024-09-21T01:06:21.655530+0000 (oldest deadline 2024-09-21T01:06:43.955632+0000) 2024-09-21T01:06:46.479 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:06:46 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T01:06:46.032+0000 7f432b246640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.769518+0000 front 2024-09-21T01:06:20.769498+0000 (oldest deadline 2024-09-21T01:06:45.469675+0000) 2024-09-21T01:06:46.710 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 21 01:06:46 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-3[53057]: 2024-09-21T01:06:46.414+0000 7f77518d6640 -1 osd.3 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.024692+0000 front 2024-09-21T01:06:20.024726+0000 (oldest deadline 2024-09-21T01:06:45.324837+0000) 2024-09-21T01:06:47.232 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:06:46 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:06:46.931+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:06:47.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:06:47 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:06:47.168+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.655501+0000 front 2024-09-21T01:06:21.655530+0000 (oldest deadline 2024-09-21T01:06:43.955632+0000) 2024-09-21T01:06:47.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:06:47 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:06:47.074+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:06:47.461 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 21 01:06:47 smithi001 podman[104177]: 2024-09-21 01:06:47.252264094 +0000 UTC m=+5.667305199 container died 013897fb6c0454d08e92e0d18246648681f26f5d261ae9957e904a40d9ca33b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-3, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T01:06:47.479 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:06:46 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T01:06:46.986+0000 7f432b246640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.769518+0000 front 2024-09-21T01:06:20.769498+0000 (oldest deadline 2024-09-21T01:06:45.469675+0000) 2024-09-21T01:06:47.960 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 21 01:06:47 smithi001 podman[104177]: 2024-09-21 01:06:47.725833986 +0000 UTC m=+6.140875156 container cleanup 013897fb6c0454d08e92e0d18246648681f26f5d261ae9957e904a40d9ca33b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-3, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:06:47.960 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 21 01:06:47 smithi001 bash[104177]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-3 2024-09-21T01:06:48.225 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:06:47 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:06:47.956+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:06:48.229 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:06:48 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T01:06:48.025+0000 7f432b246640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.769518+0000 front 2024-09-21T01:06:20.769498+0000 (oldest deadline 2024-09-21T01:06:45.469675+0000) 2024-09-21T01:06:48.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:06:47 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:06:47.922+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:06:48.358 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:06:48 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:06:48.148+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.655501+0000 front 2024-09-21T01:06:21.655530+0000 (oldest deadline 2024-09-21T01:06:43.955632+0000) 2024-09-21T01:06:48.358 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:06:48 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:06:48.069+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:06:48.358 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 21 01:06:48 smithi001 podman[104192]: 2024-09-21 01:06:48.044269281 +0000 UTC m=+0.792196519 container remove 013897fb6c0454d08e92e0d18246648681f26f5d261ae9957e904a40d9ca33b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-3, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:06:48.623 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 21 01:06:48 smithi001 podman[104283]: 2024-09-21 01:06:48.260584665 +0000 UTC m=+0.016208844 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:06:48.623 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 21 01:06:48 smithi001 podman[104283]: 2024-09-21 01:06:48.391597503 +0000 UTC m=+0.147221664 container create 32d3522d7470a12802300eeed88f2482dd142e6b4131de9d40b58d205040e568 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T01:06:48.623 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 21 01:06:48 smithi001 podman[104283]: 2024-09-21 01:06:48.622957435 +0000 UTC m=+0.378581609 container init 32d3522d7470a12802300eeed88f2482dd142e6b4131de9d40b58d205040e568 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:06:48.960 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 21 01:06:48 smithi001 podman[104283]: 2024-09-21 01:06:48.626390934 +0000 UTC m=+0.382015104 container start 32d3522d7470a12802300eeed88f2482dd142e6b4131de9d40b58d205040e568 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:06:48.960 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 21 01:06:48 smithi001 podman[104283]: 2024-09-21 01:06:48.714655274 +0000 UTC m=+0.470279436 container attach 32d3522d7470a12802300eeed88f2482dd142e6b4131de9d40b58d205040e568 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-3-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T01:06:48.961 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 21 01:06:48 smithi001 podman[104283]: 2024-09-21 01:06:48.818550838 +0000 UTC m=+0.574175000 container died 32d3522d7470a12802300eeed88f2482dd142e6b4131de9d40b58d205040e568 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-3-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T01:06:49.229 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:06:48 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T01:06:48.996+0000 7f432b246640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.769518+0000 front 2024-09-21T01:06:20.769498+0000 (oldest deadline 2024-09-21T01:06:45.469675+0000) 2024-09-21T01:06:49.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:06:48 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:06:48.941+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:06:49.242 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:06:48 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:06:48.939+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:06:49.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:06:49 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:06:49.176+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.655501+0000 front 2024-09-21T01:06:21.655530+0000 (oldest deadline 2024-09-21T01:06:43.955632+0000) 2024-09-21T01:06:49.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:06:49 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:06:49.052+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:06:49.567 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@osd.3.service' 2024-09-21T01:06:49.614 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:06:49.615 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-21T01:06:49.615 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-21T01:06:49.615 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-d3972c20-77b2-11ef-baf5-efdc52797490@osd.4 2024-09-21T01:06:49.942 INFO:journalctl@ceph.osd.4.smithi042.stdout:Sep 21 01:06:49 smithi042 systemd[1]: Stopping Ceph osd.4 for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:06:50.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:06:49 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:06:49.950+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:06:50.230 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:06:49 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T01:06:49.965+0000 7f432b246640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.769518+0000 front 2024-09-21T01:06:20.769498+0000 (oldest deadline 2024-09-21T01:06:45.469675+0000) 2024-09-21T01:06:50.242 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:06:49 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:06:49.978+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:06:50.242 INFO:journalctl@ceph.osd.4.smithi042.stdout:Sep 21 01:06:49 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-4[44832]: 2024-09-21T01:06:49.940+0000 7f7a54f25640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:06:50.242 INFO:journalctl@ceph.osd.4.smithi042.stdout:Sep 21 01:06:49 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-4[44832]: 2024-09-21T01:06:49.940+0000 7f7a54f25640 -1 osd.4 78 *** Got signal Terminated *** 2024-09-21T01:06:50.242 INFO:journalctl@ceph.osd.4.smithi042.stdout:Sep 21 01:06:49 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-4[44832]: 2024-09-21T01:06:49.940+0000 7f7a54f25640 -1 osd.4 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:06:50.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:06:50 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:06:50.213+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.655501+0000 front 2024-09-21T01:06:21.655530+0000 (oldest deadline 2024-09-21T01:06:43.955632+0000) 2024-09-21T01:06:50.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:06:50 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:06:50.063+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:06:51.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:06:50 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:06:50.978+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:06:51.229 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:06:50 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T01:06:50.933+0000 7f432b246640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.769518+0000 front 2024-09-21T01:06:20.769498+0000 (oldest deadline 2024-09-21T01:06:45.469675+0000) 2024-09-21T01:06:51.230 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:06:50 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T01:06:50.933+0000 7f432b246640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:25.470342+0000 front 2024-09-21T01:06:25.470411+0000 (oldest deadline 2024-09-21T01:06:50.770448+0000) 2024-09-21T01:06:51.462 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:06:51 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:06:51.201+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.655501+0000 front 2024-09-21T01:06:21.655530+0000 (oldest deadline 2024-09-21T01:06:43.955632+0000) 2024-09-21T01:06:51.462 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:06:51 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:06:51.106+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:06:51.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:06:51 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:06:51.009+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:06:52.037 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:06:51 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:06:51.760+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.314998+0000 front 2024-09-21T01:06:26.315030+0000 (oldest deadline 2024-09-21T01:06:51.015236+0000) 2024-09-21T01:06:52.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:06:52 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:06:52.018+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:06:52.229 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:06:51 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T01:06:51.963+0000 7f432b246640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.769518+0000 front 2024-09-21T01:06:20.769498+0000 (oldest deadline 2024-09-21T01:06:45.469675+0000) 2024-09-21T01:06:52.230 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:06:51 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T01:06:51.963+0000 7f432b246640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:25.470342+0000 front 2024-09-21T01:06:25.470411+0000 (oldest deadline 2024-09-21T01:06:50.770448+0000) 2024-09-21T01:06:52.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:06:52 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:06:52.248+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.655501+0000 front 2024-09-21T01:06:21.655530+0000 (oldest deadline 2024-09-21T01:06:43.955632+0000) 2024-09-21T01:06:52.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:06:52 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:06:52.132+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:06:52.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:06:52 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:06:52.132+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:06:52.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:06:52 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:06:52.036+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:06:53.068 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:06:52 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:06:52.808+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.314998+0000 front 2024-09-21T01:06:26.315030+0000 (oldest deadline 2024-09-21T01:06:51.015236+0000) 2024-09-21T01:06:53.068 INFO:journalctl@ceph.osd.4.smithi042.stdout:Sep 21 01:06:52 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-4[44832]: 2024-09-21T01:06:52.811+0000 7f7a4d508640 -1 osd.4 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:25.798020+0000 front 2024-09-21T01:06:25.798047+0000 (oldest deadline 2024-09-21T01:06:52.799074+0000) 2024-09-21T01:06:53.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:06:52 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:06:52.975+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:06:53.230 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:06:52 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T01:06:52.959+0000 7f432b246640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.769518+0000 front 2024-09-21T01:06:20.769498+0000 (oldest deadline 2024-09-21T01:06:45.469675+0000) 2024-09-21T01:06:53.230 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:06:52 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T01:06:52.959+0000 7f432b246640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:25.470342+0000 front 2024-09-21T01:06:25.470411+0000 (oldest deadline 2024-09-21T01:06:50.770448+0000) 2024-09-21T01:06:53.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:06:53 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:06:53.215+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.655501+0000 front 2024-09-21T01:06:21.655530+0000 (oldest deadline 2024-09-21T01:06:43.955632+0000) 2024-09-21T01:06:53.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:06:53 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:06:53.215+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.057489+0000 front 2024-09-21T01:06:29.057460+0000 (oldest deadline 2024-09-21T01:06:53.157403+0000) 2024-09-21T01:06:53.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:06:53 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:06:53.156+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:06:53.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:06:53 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:06:53.156+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:06:53.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:06:53 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:06:53.066+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:06:54.242 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:06:53 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:06:53.828+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.314998+0000 front 2024-09-21T01:06:26.315030+0000 (oldest deadline 2024-09-21T01:06:51.015236+0000) 2024-09-21T01:06:54.243 INFO:journalctl@ceph.osd.4.smithi042.stdout:Sep 21 01:06:53 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-4[44832]: 2024-09-21T01:06:53.836+0000 7f7a4d508640 -1 osd.4 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:25.798020+0000 front 2024-09-21T01:06:25.798047+0000 (oldest deadline 2024-09-21T01:06:52.799074+0000) 2024-09-21T01:06:54.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:06:54 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:06:54.057+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:06:54.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:06:54 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:06:54.057+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:06:54.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:06:54 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:06:54.246+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.655501+0000 front 2024-09-21T01:06:21.655530+0000 (oldest deadline 2024-09-21T01:06:43.955632+0000) 2024-09-21T01:06:54.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:06:54 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:06:54.246+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.057489+0000 front 2024-09-21T01:06:29.057460+0000 (oldest deadline 2024-09-21T01:06:53.157403+0000) 2024-09-21T01:06:54.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:06:54 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:06:54.189+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:06:54.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:06:54 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:06:54.189+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:06:54.479 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:06:53 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:06:53.987+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:06:54.480 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:06:53 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:06:53.987+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:06:54.480 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:06:53 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T01:06:53.987+0000 7f432b246640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.769518+0000 front 2024-09-21T01:06:20.769498+0000 (oldest deadline 2024-09-21T01:06:45.469675+0000) 2024-09-21T01:06:54.480 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:06:53 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T01:06:53.987+0000 7f432b246640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:25.470342+0000 front 2024-09-21T01:06:25.470411+0000 (oldest deadline 2024-09-21T01:06:50.770448+0000) 2024-09-21T01:06:55.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:06:54 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:06:54.972+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:06:55.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:06:54 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:06:54.972+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:06:55.230 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:06:54 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T01:06:54.990+0000 7f432b246640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.769518+0000 front 2024-09-21T01:06:20.769498+0000 (oldest deadline 2024-09-21T01:06:45.469675+0000) 2024-09-21T01:06:55.230 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:06:54 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T01:06:54.990+0000 7f432b246640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:25.470342+0000 front 2024-09-21T01:06:25.470411+0000 (oldest deadline 2024-09-21T01:06:50.770448+0000) 2024-09-21T01:06:55.242 INFO:journalctl@ceph.osd.4.smithi042.stdout:Sep 21 01:06:54 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-4[44832]: 2024-09-21T01:06:54.834+0000 7f7a4d508640 -1 osd.4 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:25.798020+0000 front 2024-09-21T01:06:25.798047+0000 (oldest deadline 2024-09-21T01:06:52.799074+0000) 2024-09-21T01:06:55.243 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:06:54 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:06:54.836+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.314998+0000 front 2024-09-21T01:06:26.315030+0000 (oldest deadline 2024-09-21T01:06:51.015236+0000) 2024-09-21T01:06:55.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:06:55 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:06:55.060+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:06:55.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:06:55 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:06:55.060+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:06:55.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:06:55 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:06:55.197+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.655501+0000 front 2024-09-21T01:06:21.655530+0000 (oldest deadline 2024-09-21T01:06:43.955632+0000) 2024-09-21T01:06:55.461 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:06:55 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:06:55.197+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.057489+0000 front 2024-09-21T01:06:29.057460+0000 (oldest deadline 2024-09-21T01:06:53.157403+0000) 2024-09-21T01:06:55.461 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:06:55 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:06:55.176+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:06:55.461 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:06:55 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:06:55.176+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:06:55.729 INFO:journalctl@ceph.osd.4.smithi042.stdout:Sep 21 01:06:55 smithi042 podman[67110]: 2024-09-21 01:06:55.4202463 +0000 UTC m=+5.609053838 container died dee95218a2deb644eecfb0cc31f25c8804a3bea8b9d0d5ccabf0785243ed87dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-4, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:06:55.949 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:06:55 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:06:55.561+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.395969+0000 front 2024-09-21T01:06:29.395996+0000 (oldest deadline 2024-09-21T01:06:55.296091+0000) 2024-09-21T01:06:55.992 INFO:journalctl@ceph.osd.4.smithi042.stdout:Sep 21 01:06:55 smithi042 podman[67110]: 2024-09-21 01:06:55.83313793 +0000 UTC m=+6.021945460 container cleanup dee95218a2deb644eecfb0cc31f25c8804a3bea8b9d0d5ccabf0785243ed87dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0) 2024-09-21T01:06:55.992 INFO:journalctl@ceph.osd.4.smithi042.stdout:Sep 21 01:06:55 smithi042 bash[67110]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-4 2024-09-21T01:06:55.993 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:06:55 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:06:55.873+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.314998+0000 front 2024-09-21T01:06:26.315030+0000 (oldest deadline 2024-09-21T01:06:51.015236+0000) 2024-09-21T01:06:56.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:06:55 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:06:55.948+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:06:56.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:06:55 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:06:55.948+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:06:56.230 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:06:56 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T01:06:56.012+0000 7f432b246640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.769518+0000 front 2024-09-21T01:06:20.769498+0000 (oldest deadline 2024-09-21T01:06:45.469675+0000) 2024-09-21T01:06:56.230 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:06:56 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T01:06:56.012+0000 7f432b246640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:25.470342+0000 front 2024-09-21T01:06:25.470411+0000 (oldest deadline 2024-09-21T01:06:50.770448+0000) 2024-09-21T01:06:56.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:06:56 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:06:56.143+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:06:56.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:06:56 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:06:56.143+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:06:56.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:06:56 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:06:56.242+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.655501+0000 front 2024-09-21T01:06:21.655530+0000 (oldest deadline 2024-09-21T01:06:43.955632+0000) 2024-09-21T01:06:56.461 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:06:56 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:06:56.242+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.057489+0000 front 2024-09-21T01:06:29.057460+0000 (oldest deadline 2024-09-21T01:06:53.157403+0000) 2024-09-21T01:06:56.492 INFO:journalctl@ceph.osd.4.smithi042.stdout:Sep 21 01:06:56 smithi042 podman[67127]: 2024-09-21 01:06:56.085020044 +0000 UTC m=+0.660295030 container remove dee95218a2deb644eecfb0cc31f25c8804a3bea8b9d0d5ccabf0785243ed87dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:06:56.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:06:56 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:06:56.098+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:06:56.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:06:56 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:06:56.098+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:06:56.781 INFO:journalctl@ceph.osd.4.smithi042.stdout:Sep 21 01:06:56 smithi042 podman[67215]: 2024-09-21 01:06:56.411220618 +0000 UTC m=+0.016037573 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:06:56.781 INFO:journalctl@ceph.osd.4.smithi042.stdout:Sep 21 01:06:56 smithi042 podman[67215]: 2024-09-21 01:06:56.535775326 +0000 UTC m=+0.140592265 container create 490eff41bc6c7762e4838770b47408a10548c51e3c81554dec061c5da6baada4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True) 2024-09-21T01:06:56.781 INFO:journalctl@ceph.osd.4.smithi042.stdout:Sep 21 01:06:56 smithi042 podman[67215]: 2024-09-21 01:06:56.780159531 +0000 UTC m=+0.384976471 container init 490eff41bc6c7762e4838770b47408a10548c51e3c81554dec061c5da6baada4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:06:56.964 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:06:56 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:06:56.514+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.395969+0000 front 2024-09-21T01:06:29.395996+0000 (oldest deadline 2024-09-21T01:06:55.296091+0000) 2024-09-21T01:06:57.066 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:06:56 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:06:56.865+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.314998+0000 front 2024-09-21T01:06:26.315030+0000 (oldest deadline 2024-09-21T01:06:51.015236+0000) 2024-09-21T01:06:57.067 INFO:journalctl@ceph.osd.4.smithi042.stdout:Sep 21 01:06:56 smithi042 podman[67215]: 2024-09-21 01:06:56.783558503 +0000 UTC m=+0.388375450 container start 490eff41bc6c7762e4838770b47408a10548c51e3c81554dec061c5da6baada4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T01:06:57.067 INFO:journalctl@ceph.osd.4.smithi042.stdout:Sep 21 01:06:56 smithi042 podman[67215]: 2024-09-21 01:06:56.880307354 +0000 UTC m=+0.485124311 container attach 490eff41bc6c7762e4838770b47408a10548c51e3c81554dec061c5da6baada4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-4-deactivate, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-21T01:06:57.067 INFO:journalctl@ceph.osd.4.smithi042.stdout:Sep 21 01:06:56 smithi042 podman[67215]: 2024-09-21 01:06:56.974397489 +0000 UTC m=+0.579214429 container died 490eff41bc6c7762e4838770b47408a10548c51e3c81554dec061c5da6baada4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True) 2024-09-21T01:06:57.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:06:56 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:06:56.977+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:06:57.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:06:56 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:06:56.977+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:06:57.230 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:06:56 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T01:06:56.963+0000 7f432b246640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.769518+0000 front 2024-09-21T01:06:20.769498+0000 (oldest deadline 2024-09-21T01:06:45.469675+0000) 2024-09-21T01:06:57.230 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:06:56 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T01:06:56.963+0000 7f432b246640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:25.470342+0000 front 2024-09-21T01:06:25.470411+0000 (oldest deadline 2024-09-21T01:06:50.770448+0000) 2024-09-21T01:06:57.334 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:06:57 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:06:57.065+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:06:57.334 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:06:57 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:06:57.065+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:06:57.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:06:57 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:06:57.101+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:06:57.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:06:57 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:06:57.101+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:06:57.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:06:57 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:06:57.233+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.655501+0000 front 2024-09-21T01:06:21.655530+0000 (oldest deadline 2024-09-21T01:06:43.955632+0000) 2024-09-21T01:06:57.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:06:57 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:06:57.233+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.057489+0000 front 2024-09-21T01:06:29.057460+0000 (oldest deadline 2024-09-21T01:06:53.157403+0000) 2024-09-21T01:06:57.689 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@osd.4.service' 2024-09-21T01:06:57.734 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:06:57.734 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-21T01:06:57.735 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-21T01:06:57.735 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ceph-d3972c20-77b2-11ef-baf5-efdc52797490@osd.5 2024-09-21T01:06:57.762 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:06:57 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:06:57.501+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.395969+0000 front 2024-09-21T01:06:29.395996+0000 (oldest deadline 2024-09-21T01:06:55.296091+0000) 2024-09-21T01:06:57.992 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:06:57 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:06:57.852+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.314998+0000 front 2024-09-21T01:06:26.315030+0000 (oldest deadline 2024-09-21T01:06:51.015236+0000) 2024-09-21T01:06:58.049 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:06:57 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:06:57.939+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:06:58.049 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:06:57 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:06:57.939+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:06:58.049 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:06:57 smithi193 systemd[1]: Stopping Ceph osd.5 for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:06:58.049 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:06:57 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T01:06:57.984+0000 7f432b246640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.769518+0000 front 2024-09-21T01:06:20.769498+0000 (oldest deadline 2024-09-21T01:06:45.469675+0000) 2024-09-21T01:06:58.049 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:06:57 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T01:06:57.984+0000 7f432b246640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:25.470342+0000 front 2024-09-21T01:06:25.470411+0000 (oldest deadline 2024-09-21T01:06:50.770448+0000) 2024-09-21T01:06:58.050 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:06:58 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T01:06:58.048+0000 7f432ec5b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:06:58.050 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:06:58 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T01:06:58.048+0000 7f432ec5b640 -1 osd.5 78 *** Got signal Terminated *** 2024-09-21T01:06:58.050 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:06:58 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T01:06:58.048+0000 7f432ec5b640 -1 osd.5 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:06:58.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:06:58 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:06:58.270+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.655501+0000 front 2024-09-21T01:06:21.655530+0000 (oldest deadline 2024-09-21T01:06:43.955632+0000) 2024-09-21T01:06:58.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:06:58 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:06:58.270+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.057489+0000 front 2024-09-21T01:06:29.057460+0000 (oldest deadline 2024-09-21T01:06:53.157403+0000) 2024-09-21T01:06:58.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:06:58 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:06:58.119+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:06:58.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:06:58 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:06:58.119+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:06:58.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:06:58 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:06:58.108+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:06:58.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:06:58 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:06:58.108+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:06:58.908 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:06:58 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:06:58.529+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.395969+0000 front 2024-09-21T01:06:29.395996+0000 (oldest deadline 2024-09-21T01:06:55.296091+0000) 2024-09-21T01:06:59.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:06:58 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:06:58.908+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:06:59.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:06:58 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:06:58.908+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:06:59.230 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:06:59 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T01:06:59.011+0000 7f432b246640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.769518+0000 front 2024-09-21T01:06:20.769498+0000 (oldest deadline 2024-09-21T01:06:45.469675+0000) 2024-09-21T01:06:59.230 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:06:59 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T01:06:59.011+0000 7f432b246640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:25.470342+0000 front 2024-09-21T01:06:25.470411+0000 (oldest deadline 2024-09-21T01:06:50.770448+0000) 2024-09-21T01:06:59.242 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:06:58 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:06:58.870+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.314998+0000 front 2024-09-21T01:06:26.315030+0000 (oldest deadline 2024-09-21T01:06:51.015236+0000) 2024-09-21T01:06:59.242 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:06:59 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:06:59.088+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:06:59.242 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:06:59 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:06:59.088+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:06:59.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:06:59 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:06:59.274+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.655501+0000 front 2024-09-21T01:06:21.655530+0000 (oldest deadline 2024-09-21T01:06:43.955632+0000) 2024-09-21T01:06:59.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:06:59 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:06:59.274+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.057489+0000 front 2024-09-21T01:06:29.057460+0000 (oldest deadline 2024-09-21T01:06:53.157403+0000) 2024-09-21T01:06:59.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:06:59 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:06:59.144+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:06:59.461 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:06:59 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:06:59.144+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:06:59.901 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:06:59 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:06:59.536+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.395969+0000 front 2024-09-21T01:06:29.395996+0000 (oldest deadline 2024-09-21T01:06:55.296091+0000) 2024-09-21T01:07:00.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:06:59 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:06:59.900+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:00.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:06:59 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:06:59.900+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:00.230 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:06:59 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T01:06:59.963+0000 7f432b246640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.769518+0000 front 2024-09-21T01:06:20.769498+0000 (oldest deadline 2024-09-21T01:06:45.469675+0000) 2024-09-21T01:07:00.230 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:06:59 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T01:06:59.963+0000 7f432b246640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:25.470342+0000 front 2024-09-21T01:06:25.470411+0000 (oldest deadline 2024-09-21T01:06:50.770448+0000) 2024-09-21T01:07:00.242 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:06:59 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:06:59.853+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.314998+0000 front 2024-09-21T01:06:26.315030+0000 (oldest deadline 2024-09-21T01:06:51.015236+0000) 2024-09-21T01:07:00.242 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:00 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:00.075+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:00.242 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:00 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:00.075+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:00.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:00 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:00.242+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.655501+0000 front 2024-09-21T01:06:21.655530+0000 (oldest deadline 2024-09-21T01:06:43.955632+0000) 2024-09-21T01:07:00.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:00 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:00.242+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.057489+0000 front 2024-09-21T01:06:29.057460+0000 (oldest deadline 2024-09-21T01:06:53.157403+0000) 2024-09-21T01:07:00.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:00 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:00.164+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:07:00.461 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:00 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:00.164+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:07:00.891 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:00 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:00.514+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.395969+0000 front 2024-09-21T01:06:29.395996+0000 (oldest deadline 2024-09-21T01:06:55.296091+0000) 2024-09-21T01:07:01.077 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:00 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:00.817+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.314998+0000 front 2024-09-21T01:06:26.315030+0000 (oldest deadline 2024-09-21T01:06:51.015236+0000) 2024-09-21T01:07:01.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:00 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:00.890+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:01.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:00 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:00.890+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:01.230 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:07:01 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T01:07:01.003+0000 7f432b246640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.769518+0000 front 2024-09-21T01:06:20.769498+0000 (oldest deadline 2024-09-21T01:06:45.469675+0000) 2024-09-21T01:07:01.230 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:07:01 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T01:07:01.003+0000 7f432b246640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:25.470342+0000 front 2024-09-21T01:06:25.470411+0000 (oldest deadline 2024-09-21T01:06:50.770448+0000) 2024-09-21T01:07:01.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:01 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:01.212+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.655501+0000 front 2024-09-21T01:06:21.655530+0000 (oldest deadline 2024-09-21T01:06:43.955632+0000) 2024-09-21T01:07:01.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:01 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:01.212+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.057489+0000 front 2024-09-21T01:06:29.057460+0000 (oldest deadline 2024-09-21T01:06:53.157403+0000) 2024-09-21T01:07:01.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:01 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:01.212+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.159298+0000 front 2024-09-21T01:06:37.159390+0000 (oldest deadline 2024-09-21T01:07:00.659473+0000) 2024-09-21T01:07:01.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:01 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:01.169+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:07:01.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:01 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:01.169+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:07:01.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:01 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:01.076+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:01.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:01 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:01.076+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:01.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:01 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:01.076+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:01.893 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:01 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:01.484+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.395969+0000 front 2024-09-21T01:06:29.395996+0000 (oldest deadline 2024-09-21T01:06:55.296091+0000) 2024-09-21T01:07:02.230 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:07:01 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T01:07:01.975+0000 7f432b246640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.769518+0000 front 2024-09-21T01:06:20.769498+0000 (oldest deadline 2024-09-21T01:06:45.469675+0000) 2024-09-21T01:07:02.230 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:07:01 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T01:07:01.975+0000 7f432b246640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:25.470342+0000 front 2024-09-21T01:06:25.470411+0000 (oldest deadline 2024-09-21T01:06:50.770448+0000) 2024-09-21T01:07:02.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:01 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:01.893+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:02.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:01 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:01.893+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:02.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:01 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:01.893+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:02.242 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:01 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:01.843+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.314998+0000 front 2024-09-21T01:06:26.315030+0000 (oldest deadline 2024-09-21T01:06:51.015236+0000) 2024-09-21T01:07:02.243 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:01 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:01.843+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:38.617213+0000 front 2024-09-21T01:06:38.617116+0000 (oldest deadline 2024-09-21T01:07:00.917223+0000) 2024-09-21T01:07:02.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:02 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:02.051+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:02.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:02 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:02.051+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:02.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:02 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:02.051+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:02.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:02 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:02.220+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.655501+0000 front 2024-09-21T01:06:21.655530+0000 (oldest deadline 2024-09-21T01:06:43.955632+0000) 2024-09-21T01:07:02.461 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:02 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:02.220+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.057489+0000 front 2024-09-21T01:06:29.057460+0000 (oldest deadline 2024-09-21T01:06:53.157403+0000) 2024-09-21T01:07:02.461 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:02 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:02.220+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.159298+0000 front 2024-09-21T01:06:37.159390+0000 (oldest deadline 2024-09-21T01:07:00.659473+0000) 2024-09-21T01:07:02.461 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:02 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:02.150+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:07:02.461 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:02 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:02.150+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:07:02.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:02 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:02.459+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.395969+0000 front 2024-09-21T01:06:29.395996+0000 (oldest deadline 2024-09-21T01:06:55.296091+0000) 2024-09-21T01:07:02.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:02 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:02.459+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:36.397149+0000 front 2024-09-21T01:06:36.397173+0000 (oldest deadline 2024-09-21T01:07:01.697370+0000) 2024-09-21T01:07:03.229 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:07:02 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T01:07:02.971+0000 7f432b246640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.769518+0000 front 2024-09-21T01:06:20.769498+0000 (oldest deadline 2024-09-21T01:06:45.469675+0000) 2024-09-21T01:07:03.230 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:07:02 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5[45499]: 2024-09-21T01:07:02.971+0000 7f432b246640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:25.470342+0000 front 2024-09-21T01:06:25.470411+0000 (oldest deadline 2024-09-21T01:06:50.770448+0000) 2024-09-21T01:07:03.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:02 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:02.926+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:03.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:02 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:02.926+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:03.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:02 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:02.926+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:03.242 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:02 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:02.867+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.314998+0000 front 2024-09-21T01:06:26.315030+0000 (oldest deadline 2024-09-21T01:06:51.015236+0000) 2024-09-21T01:07:03.242 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:02 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:02.867+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:38.617213+0000 front 2024-09-21T01:06:38.617116+0000 (oldest deadline 2024-09-21T01:07:00.917223+0000) 2024-09-21T01:07:03.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:03 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:03.031+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:03.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:03 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:03.031+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:03.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:03 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:03.031+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:03.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:03 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:03.257+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.655501+0000 front 2024-09-21T01:06:21.655530+0000 (oldest deadline 2024-09-21T01:06:43.955632+0000) 2024-09-21T01:07:03.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:03 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:03.257+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.057489+0000 front 2024-09-21T01:06:29.057460+0000 (oldest deadline 2024-09-21T01:06:53.157403+0000) 2024-09-21T01:07:03.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:03 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:03.257+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.159298+0000 front 2024-09-21T01:06:37.159390+0000 (oldest deadline 2024-09-21T01:07:00.659473+0000) 2024-09-21T01:07:03.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:03 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:03.101+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:07:03.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:03 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:03.101+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:07:03.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:03 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:03.101+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.865418+0000 front 2024-09-21T01:06:37.865671+0000 (oldest deadline 2024-09-21T01:07:02.565301+0000) 2024-09-21T01:07:03.717 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:07:03 smithi193 podman[67232]: 2024-09-21 01:07:03.416584729 +0000 UTC m=+5.483846880 container died 17556c2233caf02016c53b742808e3aebe6f4a2f212d80687044841b2a84b857 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T01:07:03.718 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:03 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:03.451+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.395969+0000 front 2024-09-21T01:06:29.395996+0000 (oldest deadline 2024-09-21T01:06:55.296091+0000) 2024-09-21T01:07:03.718 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:03 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:03.451+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:36.397149+0000 front 2024-09-21T01:06:36.397173+0000 (oldest deadline 2024-09-21T01:07:01.697370+0000) 2024-09-21T01:07:03.980 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:07:03 smithi193 podman[67232]: 2024-09-21 01:07:03.823906027 +0000 UTC m=+5.891168177 container cleanup 17556c2233caf02016c53b742808e3aebe6f4a2f212d80687044841b2a84b857 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS) 2024-09-21T01:07:03.980 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:07:03 smithi193 bash[67232]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5 2024-09-21T01:07:03.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:03 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:03.900+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:03.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:03 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:03.900+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:03.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:03 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:03.900+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:04.242 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:03 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:03.832+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.314998+0000 front 2024-09-21T01:06:26.315030+0000 (oldest deadline 2024-09-21T01:06:51.015236+0000) 2024-09-21T01:07:04.242 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:03 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:03.832+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:38.617213+0000 front 2024-09-21T01:06:38.617116+0000 (oldest deadline 2024-09-21T01:07:00.917223+0000) 2024-09-21T01:07:04.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:04 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:04.012+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:04.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:04 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:04.012+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:04.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:04 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:04.012+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:04.389 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:07:04 smithi193 podman[67247]: 2024-09-21 01:07:04.067099542 +0000 UTC m=+0.645389768 container remove 17556c2233caf02016c53b742808e3aebe6f4a2f212d80687044841b2a84b857 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T01:07:04.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:04 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:04.256+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.655501+0000 front 2024-09-21T01:06:21.655530+0000 (oldest deadline 2024-09-21T01:06:43.955632+0000) 2024-09-21T01:07:04.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:04 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:04.256+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.057489+0000 front 2024-09-21T01:06:29.057460+0000 (oldest deadline 2024-09-21T01:06:53.157403+0000) 2024-09-21T01:07:04.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:04 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:04.256+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.159298+0000 front 2024-09-21T01:06:37.159390+0000 (oldest deadline 2024-09-21T01:07:00.659473+0000) 2024-09-21T01:07:04.461 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:04 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:04.118+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:07:04.461 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:04 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:04.118+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:07:04.461 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:04 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:04.118+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.865418+0000 front 2024-09-21T01:06:37.865671+0000 (oldest deadline 2024-09-21T01:07:02.565301+0000) 2024-09-21T01:07:04.641 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:04 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:04.449+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.395969+0000 front 2024-09-21T01:06:29.395996+0000 (oldest deadline 2024-09-21T01:06:55.296091+0000) 2024-09-21T01:07:04.641 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:04 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:04.449+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:36.397149+0000 front 2024-09-21T01:06:36.397173+0000 (oldest deadline 2024-09-21T01:07:01.697370+0000) 2024-09-21T01:07:04.641 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:07:04 smithi193 podman[67335]: 2024-09-21 01:07:04.292471612 +0000 UTC m=+0.015442260 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:07:04.641 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:07:04 smithi193 podman[67335]: 2024-09-21 01:07:04.4013931 +0000 UTC m=+0.124363787 container create d0f0558ff4f24247268df4e9129d1bb787c0921a200d34a6cae7f79a2457d714 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-21T01:07:04.642 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:07:04 smithi193 podman[67335]: 2024-09-21 01:07:04.637251488 +0000 UTC m=+0.360222126 container init d0f0558ff4f24247268df4e9129d1bb787c0921a200d34a6cae7f79a2457d714 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True) 2024-09-21T01:07:04.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:04 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:04.879+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:04.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:04 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:04.879+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:04.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:04 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:04.879+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:04.980 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:07:04 smithi193 podman[67335]: 2024-09-21 01:07:04.640418973 +0000 UTC m=+0.363389614 container start d0f0558ff4f24247268df4e9129d1bb787c0921a200d34a6cae7f79a2457d714 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-21T01:07:04.980 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:07:04 smithi193 podman[67335]: 2024-09-21 01:07:04.737536869 +0000 UTC m=+0.460507508 container attach d0f0558ff4f24247268df4e9129d1bb787c0921a200d34a6cae7f79a2457d714 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-21T01:07:04.980 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 21 01:07:04 smithi193 podman[67335]: 2024-09-21 01:07:04.826372474 +0000 UTC m=+0.549343117 container died d0f0558ff4f24247268df4e9129d1bb787c0921a200d34a6cae7f79a2457d714 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-5-deactivate, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T01:07:05.242 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:04 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:04.841+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.314998+0000 front 2024-09-21T01:06:26.315030+0000 (oldest deadline 2024-09-21T01:06:51.015236+0000) 2024-09-21T01:07:05.243 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:04 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:04.841+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:38.617213+0000 front 2024-09-21T01:06:38.617116+0000 (oldest deadline 2024-09-21T01:07:00.917223+0000) 2024-09-21T01:07:05.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:05 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:05.004+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:05.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:05 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:05.004+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:05.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:05 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:05.004+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:05.444 DEBUG:teuthology.orchestra.run.smithi193:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@osd.5.service' 2024-09-21T01:07:05.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:05 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:05.230+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.655501+0000 front 2024-09-21T01:06:21.655530+0000 (oldest deadline 2024-09-21T01:06:43.955632+0000) 2024-09-21T01:07:05.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:05 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:05.230+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.057489+0000 front 2024-09-21T01:06:29.057460+0000 (oldest deadline 2024-09-21T01:06:53.157403+0000) 2024-09-21T01:07:05.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:05 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:05.230+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.159298+0000 front 2024-09-21T01:06:37.159390+0000 (oldest deadline 2024-09-21T01:07:00.659473+0000) 2024-09-21T01:07:05.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:05 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:05.147+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:07:05.461 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:05 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:05.147+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:07:05.461 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:05 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:05.147+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.865418+0000 front 2024-09-21T01:06:37.865671+0000 (oldest deadline 2024-09-21T01:07:02.565301+0000) 2024-09-21T01:07:05.524 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:07:05.525 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-21T01:07:05.525 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-21T01:07:05.525 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-d3972c20-77b2-11ef-baf5-efdc52797490@osd.6 2024-09-21T01:07:05.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:05 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:05.428+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.395969+0000 front 2024-09-21T01:06:29.395996+0000 (oldest deadline 2024-09-21T01:06:55.296091+0000) 2024-09-21T01:07:05.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:05 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:05.428+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:36.397149+0000 front 2024-09-21T01:06:36.397173+0000 (oldest deadline 2024-09-21T01:07:01.697370+0000) 2024-09-21T01:07:05.848 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:05 smithi001 systemd[1]: Stopping Ceph osd.6 for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:07:06.167 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:05 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:05.847+0000 7f4a8574a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:07:06.167 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:05 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:05.847+0000 7f4a8574a640 -1 osd.6 78 *** Got signal Terminated *** 2024-09-21T01:07:06.167 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:05 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:05.847+0000 7f4a8574a640 -1 osd.6 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:07:06.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:05 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:05.833+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:06.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:05 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:05.833+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:06.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:05 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:05.833+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:06.242 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:05 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:05.822+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.314998+0000 front 2024-09-21T01:06:26.315030+0000 (oldest deadline 2024-09-21T01:06:51.015236+0000) 2024-09-21T01:07:06.242 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:05 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:05.822+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:38.617213+0000 front 2024-09-21T01:06:38.617116+0000 (oldest deadline 2024-09-21T01:07:00.917223+0000) 2024-09-21T01:07:06.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:06 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:06.013+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:06.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:06 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:06.013+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:06.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:06 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:06.013+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:06.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:06 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:06.231+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.655501+0000 front 2024-09-21T01:06:21.655530+0000 (oldest deadline 2024-09-21T01:06:43.955632+0000) 2024-09-21T01:07:06.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:06 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:06.231+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.057489+0000 front 2024-09-21T01:06:29.057460+0000 (oldest deadline 2024-09-21T01:06:53.157403+0000) 2024-09-21T01:07:06.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:06 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:06.231+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.159298+0000 front 2024-09-21T01:06:37.159390+0000 (oldest deadline 2024-09-21T01:07:00.659473+0000) 2024-09-21T01:07:06.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:06 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:06.166+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:07:06.461 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:06 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:06.166+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:07:06.461 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:06 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:06.166+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.865418+0000 front 2024-09-21T01:06:37.865671+0000 (oldest deadline 2024-09-21T01:07:02.565301+0000) 2024-09-21T01:07:06.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:06 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:06.461+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.395969+0000 front 2024-09-21T01:06:29.395996+0000 (oldest deadline 2024-09-21T01:06:55.296091+0000) 2024-09-21T01:07:06.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:06 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:06.461+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:36.397149+0000 front 2024-09-21T01:06:36.397173+0000 (oldest deadline 2024-09-21T01:07:01.697370+0000) 2024-09-21T01:07:07.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:06 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:06.845+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:07.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:06 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:06.845+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:07.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:06 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:06.845+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:07.242 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:06 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:06.866+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.314998+0000 front 2024-09-21T01:06:26.315030+0000 (oldest deadline 2024-09-21T01:06:51.015236+0000) 2024-09-21T01:07:07.242 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:06 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:06.866+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:38.617213+0000 front 2024-09-21T01:06:38.617116+0000 (oldest deadline 2024-09-21T01:07:00.917223+0000) 2024-09-21T01:07:07.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:06 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:06.978+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:07.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:06 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:06.978+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:07.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:06 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:06.978+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:07.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:07 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:07.228+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.655501+0000 front 2024-09-21T01:06:21.655530+0000 (oldest deadline 2024-09-21T01:06:43.955632+0000) 2024-09-21T01:07:07.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:07 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:07.228+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.057489+0000 front 2024-09-21T01:06:29.057460+0000 (oldest deadline 2024-09-21T01:06:53.157403+0000) 2024-09-21T01:07:07.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:07 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:07.228+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.159298+0000 front 2024-09-21T01:06:37.159390+0000 (oldest deadline 2024-09-21T01:07:00.659473+0000) 2024-09-21T01:07:07.461 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:07 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:07.198+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:07:07.461 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:07 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:07.198+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:07:07.461 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:07 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:07.198+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.865418+0000 front 2024-09-21T01:06:37.865671+0000 (oldest deadline 2024-09-21T01:07:02.565301+0000) 2024-09-21T01:07:07.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:07 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:07.445+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.395969+0000 front 2024-09-21T01:06:29.395996+0000 (oldest deadline 2024-09-21T01:06:55.296091+0000) 2024-09-21T01:07:07.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:07 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:07.445+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:36.397149+0000 front 2024-09-21T01:06:36.397173+0000 (oldest deadline 2024-09-21T01:07:01.697370+0000) 2024-09-21T01:07:08.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:07 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:07.866+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:08.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:07 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:07.866+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:08.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:07 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:07.866+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:08.242 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:07 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:07.911+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.314998+0000 front 2024-09-21T01:06:26.315030+0000 (oldest deadline 2024-09-21T01:06:51.015236+0000) 2024-09-21T01:07:08.242 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:07 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:07.911+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:38.617213+0000 front 2024-09-21T01:06:38.617116+0000 (oldest deadline 2024-09-21T01:07:00.917223+0000) 2024-09-21T01:07:08.242 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:07 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:07.911+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.018657+0000 front 2024-09-21T01:06:45.018616+0000 (oldest deadline 2024-09-21T01:07:07.818952+0000) 2024-09-21T01:07:08.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:07 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:07.957+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:08.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:07 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:07.957+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:08.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:07 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:07.957+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:08.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:07 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:07.957+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:44.673331+0000 front 2024-09-21T01:06:44.673455+0000 (oldest deadline 2024-09-21T01:07:07.573344+0000) 2024-09-21T01:07:08.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:08 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:08.260+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.655501+0000 front 2024-09-21T01:06:21.655530+0000 (oldest deadline 2024-09-21T01:06:43.955632+0000) 2024-09-21T01:07:08.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:08 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:08.260+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.057489+0000 front 2024-09-21T01:06:29.057460+0000 (oldest deadline 2024-09-21T01:06:53.157403+0000) 2024-09-21T01:07:08.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:08 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:08.260+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.159298+0000 front 2024-09-21T01:06:37.159390+0000 (oldest deadline 2024-09-21T01:07:00.659473+0000) 2024-09-21T01:07:08.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:08 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:08.260+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:46.560688+0000 front 2024-09-21T01:06:46.560820+0000 (oldest deadline 2024-09-21T01:07:08.260900+0000) 2024-09-21T01:07:08.461 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:08 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:08.202+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:07:08.461 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:08 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:08.202+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:07:08.461 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:08 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:08.202+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.865418+0000 front 2024-09-21T01:06:37.865671+0000 (oldest deadline 2024-09-21T01:07:02.565301+0000) 2024-09-21T01:07:08.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:08 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:08.474+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.395969+0000 front 2024-09-21T01:06:29.395996+0000 (oldest deadline 2024-09-21T01:06:55.296091+0000) 2024-09-21T01:07:08.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:08 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:08.474+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:36.397149+0000 front 2024-09-21T01:06:36.397173+0000 (oldest deadline 2024-09-21T01:07:01.697370+0000) 2024-09-21T01:07:09.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:08 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:08.826+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:09.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:08 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:08.826+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:09.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:08 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:08.826+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:09.242 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:08 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:08.955+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.314998+0000 front 2024-09-21T01:06:26.315030+0000 (oldest deadline 2024-09-21T01:06:51.015236+0000) 2024-09-21T01:07:09.242 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:08 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:08.955+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:38.617213+0000 front 2024-09-21T01:06:38.617116+0000 (oldest deadline 2024-09-21T01:07:00.917223+0000) 2024-09-21T01:07:09.242 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:08 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:08.955+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.018657+0000 front 2024-09-21T01:06:45.018616+0000 (oldest deadline 2024-09-21T01:07:07.818952+0000) 2024-09-21T01:07:09.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:08 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:08.998+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:09.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:08 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:08.998+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:09.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:08 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:08.998+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:09.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:08 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:08.998+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:44.673331+0000 front 2024-09-21T01:06:44.673455+0000 (oldest deadline 2024-09-21T01:07:07.573344+0000) 2024-09-21T01:07:09.710 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:09 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:09.265+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.655501+0000 front 2024-09-21T01:06:21.655530+0000 (oldest deadline 2024-09-21T01:06:43.955632+0000) 2024-09-21T01:07:09.710 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:09 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:09.265+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.057489+0000 front 2024-09-21T01:06:29.057460+0000 (oldest deadline 2024-09-21T01:06:53.157403+0000) 2024-09-21T01:07:09.710 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:09 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:09.265+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.159298+0000 front 2024-09-21T01:06:37.159390+0000 (oldest deadline 2024-09-21T01:07:00.659473+0000) 2024-09-21T01:07:09.710 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:09 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:09.265+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:46.560688+0000 front 2024-09-21T01:06:46.560820+0000 (oldest deadline 2024-09-21T01:07:08.260900+0000) 2024-09-21T01:07:09.711 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:09 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:09.216+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:07:09.711 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:09 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:09.216+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:07:09.711 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:09 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:09.216+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.865418+0000 front 2024-09-21T01:06:37.865671+0000 (oldest deadline 2024-09-21T01:07:02.565301+0000) 2024-09-21T01:07:09.711 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:09 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:09.216+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.366611+0000 front 2024-09-21T01:06:45.366825+0000 (oldest deadline 2024-09-21T01:07:08.266719+0000) 2024-09-21T01:07:09.843 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:09 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:09.496+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.395969+0000 front 2024-09-21T01:06:29.395996+0000 (oldest deadline 2024-09-21T01:06:55.296091+0000) 2024-09-21T01:07:09.843 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:09 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:09.496+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:36.397149+0000 front 2024-09-21T01:06:36.397173+0000 (oldest deadline 2024-09-21T01:07:01.697370+0000) 2024-09-21T01:07:10.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:09 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:09.842+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:10.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:09 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:09.842+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:10.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:09 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:09.842+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:10.242 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:09 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:09.944+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.314998+0000 front 2024-09-21T01:06:26.315030+0000 (oldest deadline 2024-09-21T01:06:51.015236+0000) 2024-09-21T01:07:10.243 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:09 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:09.944+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:38.617213+0000 front 2024-09-21T01:06:38.617116+0000 (oldest deadline 2024-09-21T01:07:00.917223+0000) 2024-09-21T01:07:10.243 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:09 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:09.944+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.018657+0000 front 2024-09-21T01:06:45.018616+0000 (oldest deadline 2024-09-21T01:07:07.818952+0000) 2024-09-21T01:07:10.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:09 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:09.990+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:10.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:09 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:09.990+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:10.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:09 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:09.990+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:10.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:09 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:09.990+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:44.673331+0000 front 2024-09-21T01:06:44.673455+0000 (oldest deadline 2024-09-21T01:07:07.573344+0000) 2024-09-21T01:07:10.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:10 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:10.288+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.655501+0000 front 2024-09-21T01:06:21.655530+0000 (oldest deadline 2024-09-21T01:06:43.955632+0000) 2024-09-21T01:07:10.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:10 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:10.288+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.057489+0000 front 2024-09-21T01:06:29.057460+0000 (oldest deadline 2024-09-21T01:06:53.157403+0000) 2024-09-21T01:07:10.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:10 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:10.288+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.159298+0000 front 2024-09-21T01:06:37.159390+0000 (oldest deadline 2024-09-21T01:07:00.659473+0000) 2024-09-21T01:07:10.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:10 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6[59481]: 2024-09-21T01:07:10.288+0000 7f4a7dd2d640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:46.560688+0000 front 2024-09-21T01:06:46.560820+0000 (oldest deadline 2024-09-21T01:07:08.260900+0000) 2024-09-21T01:07:10.461 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:10 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:10.177+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:07:10.461 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:10 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:10.177+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:07:10.461 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:10 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:10.177+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.865418+0000 front 2024-09-21T01:06:37.865671+0000 (oldest deadline 2024-09-21T01:07:02.565301+0000) 2024-09-21T01:07:10.461 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:10 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:10.177+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.366611+0000 front 2024-09-21T01:06:45.366825+0000 (oldest deadline 2024-09-21T01:07:08.266719+0000) 2024-09-21T01:07:10.795 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:10 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:10.479+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.395969+0000 front 2024-09-21T01:06:29.395996+0000 (oldest deadline 2024-09-21T01:06:55.296091+0000) 2024-09-21T01:07:10.795 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:10 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:10.479+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:36.397149+0000 front 2024-09-21T01:06:36.397173+0000 (oldest deadline 2024-09-21T01:07:01.697370+0000) 2024-09-21T01:07:10.796 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:10 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:10.479+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.198361+0000 front 2024-09-21T01:06:45.198428+0000 (oldest deadline 2024-09-21T01:07:09.898570+0000) 2024-09-21T01:07:11.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:10 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:10.794+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:11.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:10 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:10.794+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:11.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:10 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:10.794+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:11.242 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:10 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:10.960+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.314998+0000 front 2024-09-21T01:06:26.315030+0000 (oldest deadline 2024-09-21T01:06:51.015236+0000) 2024-09-21T01:07:11.243 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:10 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:10.960+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:38.617213+0000 front 2024-09-21T01:06:38.617116+0000 (oldest deadline 2024-09-21T01:07:00.917223+0000) 2024-09-21T01:07:11.243 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:10 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:10.960+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.018657+0000 front 2024-09-21T01:06:45.018616+0000 (oldest deadline 2024-09-21T01:07:07.818952+0000) 2024-09-21T01:07:11.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:11 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:11.028+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:11.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:11 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:11.028+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:11.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:11 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:11.028+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:11.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:11 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:11.028+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:44.673331+0000 front 2024-09-21T01:06:44.673455+0000 (oldest deadline 2024-09-21T01:07:07.573344+0000) 2024-09-21T01:07:11.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:11 smithi001 podman[104399]: 2024-09-21 01:07:11.198675504 +0000 UTC m=+5.469762322 container died 3a7aa5000f7f090b4b3d4a7f539ab9c469a084edd3d4d54da36fa22b2d020291 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T01:07:11.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:11 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:11.186+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:07:11.461 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:11 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:11.186+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:07:11.461 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:11 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:11.186+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.865418+0000 front 2024-09-21T01:06:37.865671+0000 (oldest deadline 2024-09-21T01:07:02.565301+0000) 2024-09-21T01:07:11.461 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:11 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:11.186+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.366611+0000 front 2024-09-21T01:06:45.366825+0000 (oldest deadline 2024-09-21T01:07:08.266719+0000) 2024-09-21T01:07:11.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:11 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:11.445+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.395969+0000 front 2024-09-21T01:06:29.395996+0000 (oldest deadline 2024-09-21T01:06:55.296091+0000) 2024-09-21T01:07:11.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:11 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:11.445+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:36.397149+0000 front 2024-09-21T01:06:36.397173+0000 (oldest deadline 2024-09-21T01:07:01.697370+0000) 2024-09-21T01:07:11.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:11 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:11.445+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.198361+0000 front 2024-09-21T01:06:45.198428+0000 (oldest deadline 2024-09-21T01:07:09.898570+0000) 2024-09-21T01:07:11.866 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:11 smithi001 podman[104399]: 2024-09-21 01:07:11.556252682 +0000 UTC m=+5.827339499 container cleanup 3a7aa5000f7f090b4b3d4a7f539ab9c469a084edd3d4d54da36fa22b2d020291 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:07:11.866 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:11 smithi001 bash[104399]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6 2024-09-21T01:07:12.189 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:11 smithi001 podman[104416]: 2024-09-21 01:07:11.866025786 +0000 UTC m=+0.660965389 container remove 3a7aa5000f7f090b4b3d4a7f539ab9c469a084edd3d4d54da36fa22b2d020291 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-21T01:07:12.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:11 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:11.795+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:12.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:11 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:11.795+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:12.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:11 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:11.795+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:12.243 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:11 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:11.923+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.314998+0000 front 2024-09-21T01:06:26.315030+0000 (oldest deadline 2024-09-21T01:06:51.015236+0000) 2024-09-21T01:07:12.243 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:11 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:11.923+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:38.617213+0000 front 2024-09-21T01:06:38.617116+0000 (oldest deadline 2024-09-21T01:07:00.917223+0000) 2024-09-21T01:07:12.243 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:11 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:11.923+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.018657+0000 front 2024-09-21T01:06:45.018616+0000 (oldest deadline 2024-09-21T01:07:07.818952+0000) 2024-09-21T01:07:12.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:12 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:12.022+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:12.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:12 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:12.022+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:12.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:12 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:12.022+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:12.244 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:12 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:12.022+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:44.673331+0000 front 2024-09-21T01:06:44.673455+0000 (oldest deadline 2024-09-21T01:07:07.573344+0000) 2024-09-21T01:07:12.462 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:12 smithi001 podman[104508]: 2024-09-21 01:07:12.09178368 +0000 UTC m=+0.016561571 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:07:12.463 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:12 smithi001 podman[104508]: 2024-09-21 01:07:12.225376867 +0000 UTC m=+0.150154799 container create b7654e3afca7ac828bdd50c71219fea4cd41e63614a635c0fff5799c4ad5022c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:07:12.464 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:12 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:12.187+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:07:12.464 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:12 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:12.187+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:07:12.464 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:12 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:12.187+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.865418+0000 front 2024-09-21T01:06:37.865671+0000 (oldest deadline 2024-09-21T01:07:02.565301+0000) 2024-09-21T01:07:12.464 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:12 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:12.187+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.366611+0000 front 2024-09-21T01:06:45.366825+0000 (oldest deadline 2024-09-21T01:07:08.266719+0000) 2024-09-21T01:07:12.753 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:12 smithi001 podman[104508]: 2024-09-21 01:07:12.623959617 +0000 UTC m=+0.548737508 container init b7654e3afca7ac828bdd50c71219fea4cd41e63614a635c0fff5799c4ad5022c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T01:07:12.753 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:12 smithi001 podman[104508]: 2024-09-21 01:07:12.627670126 +0000 UTC m=+0.552448017 container start b7654e3afca7ac828bdd50c71219fea4cd41e63614a635c0fff5799c4ad5022c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:07:12.753 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:12 smithi001 podman[104508]: 2024-09-21 01:07:12.753050258 +0000 UTC m=+0.677828172 container attach b7654e3afca7ac828bdd50c71219fea4cd41e63614a635c0fff5799c4ad5022c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6-deactivate, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True) 2024-09-21T01:07:12.787 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:12 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:12.483+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.395969+0000 front 2024-09-21T01:06:29.395996+0000 (oldest deadline 2024-09-21T01:06:55.296091+0000) 2024-09-21T01:07:12.787 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:12 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:12.483+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:36.397149+0000 front 2024-09-21T01:06:36.397173+0000 (oldest deadline 2024-09-21T01:07:01.697370+0000) 2024-09-21T01:07:12.787 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:12 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:12.483+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.198361+0000 front 2024-09-21T01:06:45.198428+0000 (oldest deadline 2024-09-21T01:07:09.898570+0000) 2024-09-21T01:07:13.097 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 21 01:07:12 smithi001 podman[104508]: 2024-09-21 01:07:12.819437089 +0000 UTC m=+0.744214980 container died b7654e3afca7ac828bdd50c71219fea4cd41e63614a635c0fff5799c4ad5022c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:07:13.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:12 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:12.786+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:13.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:12 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:12.786+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:13.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:12 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:12.786+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:13.242 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:12 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:12.963+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.314998+0000 front 2024-09-21T01:06:26.315030+0000 (oldest deadline 2024-09-21T01:06:51.015236+0000) 2024-09-21T01:07:13.242 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:12 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:12.963+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:38.617213+0000 front 2024-09-21T01:06:38.617116+0000 (oldest deadline 2024-09-21T01:07:00.917223+0000) 2024-09-21T01:07:13.242 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:12 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:12.963+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.018657+0000 front 2024-09-21T01:06:45.018616+0000 (oldest deadline 2024-09-21T01:07:07.818952+0000) 2024-09-21T01:07:13.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:13 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:13.033+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:13.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:13 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:13.033+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:13.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:13 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:13.033+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:13.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:13 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:13.033+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:44.673331+0000 front 2024-09-21T01:06:44.673455+0000 (oldest deadline 2024-09-21T01:07:07.573344+0000) 2024-09-21T01:07:13.407 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:13 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:13.218+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:07:13.407 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:13 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:13.218+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:07:13.407 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:13 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:13.218+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.865418+0000 front 2024-09-21T01:06:37.865671+0000 (oldest deadline 2024-09-21T01:07:02.565301+0000) 2024-09-21T01:07:13.407 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:13 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:13.218+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.366611+0000 front 2024-09-21T01:06:45.366825+0000 (oldest deadline 2024-09-21T01:07:08.266719+0000) 2024-09-21T01:07:13.427 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@osd.6.service' 2024-09-21T01:07:13.471 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:07:13.471 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-21T01:07:13.471 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-21T01:07:13.471 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-d3972c20-77b2-11ef-baf5-efdc52797490@osd.7 2024-09-21T01:07:13.797 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:13 smithi042 systemd[1]: Stopping Ceph osd.7 for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:07:13.797 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:13 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:13.796+0000 7f23ea22c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:07:13.797 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:13 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:13.796+0000 7f23ea22c640 -1 osd.7 78 *** Got signal Terminated *** 2024-09-21T01:07:13.797 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:13 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:13.796+0000 7f23ea22c640 -1 osd.7 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:07:13.979 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:13 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:13.512+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.395969+0000 front 2024-09-21T01:06:29.395996+0000 (oldest deadline 2024-09-21T01:06:55.296091+0000) 2024-09-21T01:07:13.979 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:13 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:13.512+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:36.397149+0000 front 2024-09-21T01:06:36.397173+0000 (oldest deadline 2024-09-21T01:07:01.697370+0000) 2024-09-21T01:07:13.980 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:13 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:13.512+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.198361+0000 front 2024-09-21T01:06:45.198428+0000 (oldest deadline 2024-09-21T01:07:09.898570+0000) 2024-09-21T01:07:13.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:13 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:13.756+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:13.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:13 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:13.756+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:13.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:13 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:13.756+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:14.242 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:13 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:13.988+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.314998+0000 front 2024-09-21T01:06:26.315030+0000 (oldest deadline 2024-09-21T01:06:51.015236+0000) 2024-09-21T01:07:14.242 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:13 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:13.988+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:38.617213+0000 front 2024-09-21T01:06:38.617116+0000 (oldest deadline 2024-09-21T01:07:00.917223+0000) 2024-09-21T01:07:14.242 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:13 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:13.988+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.018657+0000 front 2024-09-21T01:06:45.018616+0000 (oldest deadline 2024-09-21T01:07:07.818952+0000) 2024-09-21T01:07:14.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:14 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:14.017+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:14.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:14 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:14.017+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:14.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:14 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:14.017+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:14.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:14 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:14.017+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:44.673331+0000 front 2024-09-21T01:06:44.673455+0000 (oldest deadline 2024-09-21T01:07:07.573344+0000) 2024-09-21T01:07:14.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:14 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:14.178+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:07:14.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:14 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:14.178+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:07:14.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:14 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:14.178+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.865418+0000 front 2024-09-21T01:06:37.865671+0000 (oldest deadline 2024-09-21T01:07:02.565301+0000) 2024-09-21T01:07:14.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:14 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:14.178+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.366611+0000 front 2024-09-21T01:06:45.366825+0000 (oldest deadline 2024-09-21T01:07:08.266719+0000) 2024-09-21T01:07:14.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:14 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:14.477+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.395969+0000 front 2024-09-21T01:06:29.395996+0000 (oldest deadline 2024-09-21T01:06:55.296091+0000) 2024-09-21T01:07:14.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:14 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:14.477+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:36.397149+0000 front 2024-09-21T01:06:36.397173+0000 (oldest deadline 2024-09-21T01:07:01.697370+0000) 2024-09-21T01:07:14.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:14 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:14.477+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.198361+0000 front 2024-09-21T01:06:45.198428+0000 (oldest deadline 2024-09-21T01:07:09.898570+0000) 2024-09-21T01:07:14.730 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:14 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:14.709+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:14.730 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:14 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:14.709+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:14.730 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:14 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:14.709+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:15.242 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:14 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:14.979+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.314998+0000 front 2024-09-21T01:06:26.315030+0000 (oldest deadline 2024-09-21T01:06:51.015236+0000) 2024-09-21T01:07:15.243 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:14 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:14.979+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:38.617213+0000 front 2024-09-21T01:06:38.617116+0000 (oldest deadline 2024-09-21T01:07:00.917223+0000) 2024-09-21T01:07:15.243 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:14 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:14.979+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.018657+0000 front 2024-09-21T01:06:45.018616+0000 (oldest deadline 2024-09-21T01:07:07.818952+0000) 2024-09-21T01:07:15.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:15 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:15.014+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:15.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:15 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:15.014+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:15.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:15 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:15.014+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:15.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:15 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:15.014+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:44.673331+0000 front 2024-09-21T01:06:44.673455+0000 (oldest deadline 2024-09-21T01:07:07.573344+0000) 2024-09-21T01:07:15.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:15 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:15.161+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:07:15.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:15 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:15.161+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:07:15.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:15 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:15.161+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.865418+0000 front 2024-09-21T01:06:37.865671+0000 (oldest deadline 2024-09-21T01:07:02.565301+0000) 2024-09-21T01:07:15.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:15 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:15.161+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.366611+0000 front 2024-09-21T01:06:45.366825+0000 (oldest deadline 2024-09-21T01:07:08.266719+0000) 2024-09-21T01:07:15.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:15 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:15.461+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.395969+0000 front 2024-09-21T01:06:29.395996+0000 (oldest deadline 2024-09-21T01:06:55.296091+0000) 2024-09-21T01:07:15.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:15 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:15.461+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:36.397149+0000 front 2024-09-21T01:06:36.397173+0000 (oldest deadline 2024-09-21T01:07:01.697370+0000) 2024-09-21T01:07:15.730 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:15 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:15.461+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.198361+0000 front 2024-09-21T01:06:45.198428+0000 (oldest deadline 2024-09-21T01:07:09.898570+0000) 2024-09-21T01:07:16.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:15 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:15.735+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:16.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:15 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:15.735+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:16.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:15 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:15.735+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:16.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:15 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:15.735+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:52.729076+0000 front 2024-09-21T01:06:52.729168+0000 (oldest deadline 2024-09-21T01:07:15.628932+0000) 2024-09-21T01:07:16.424 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:16 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:16.026+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.314998+0000 front 2024-09-21T01:06:26.315030+0000 (oldest deadline 2024-09-21T01:06:51.015236+0000) 2024-09-21T01:07:16.424 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:16 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:16.026+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:38.617213+0000 front 2024-09-21T01:06:38.617116+0000 (oldest deadline 2024-09-21T01:07:00.917223+0000) 2024-09-21T01:07:16.424 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:16 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:16.026+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.018657+0000 front 2024-09-21T01:06:45.018616+0000 (oldest deadline 2024-09-21T01:07:07.818952+0000) 2024-09-21T01:07:16.424 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:16 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:16.028+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:16.424 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:16 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:16.028+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:16.424 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:16 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:16.028+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:16.424 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:16 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:16.028+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:44.673331+0000 front 2024-09-21T01:06:44.673455+0000 (oldest deadline 2024-09-21T01:07:07.573344+0000) 2024-09-21T01:07:16.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:16 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:16.198+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:07:16.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:16 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:16.198+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:07:16.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:16 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:16.198+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.865418+0000 front 2024-09-21T01:06:37.865671+0000 (oldest deadline 2024-09-21T01:07:02.565301+0000) 2024-09-21T01:07:16.460 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:16 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:16.198+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.366611+0000 front 2024-09-21T01:06:45.366825+0000 (oldest deadline 2024-09-21T01:07:08.266719+0000) 2024-09-21T01:07:16.499 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:16 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:16.424+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.395969+0000 front 2024-09-21T01:06:29.395996+0000 (oldest deadline 2024-09-21T01:06:55.296091+0000) 2024-09-21T01:07:16.499 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:16 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:16.424+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:36.397149+0000 front 2024-09-21T01:06:36.397173+0000 (oldest deadline 2024-09-21T01:07:01.697370+0000) 2024-09-21T01:07:16.499 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:16 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:16.424+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.198361+0000 front 2024-09-21T01:06:45.198428+0000 (oldest deadline 2024-09-21T01:07:09.898570+0000) 2024-09-21T01:07:16.979 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:16 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:16.712+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:16.979 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:16 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:16.712+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:16.979 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:16 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:16.712+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:16.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:16 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:16.712+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:52.729076+0000 front 2024-09-21T01:06:52.729168+0000 (oldest deadline 2024-09-21T01:07:15.628932+0000) 2024-09-21T01:07:17.407 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:17 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:17.071+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.314998+0000 front 2024-09-21T01:06:26.315030+0000 (oldest deadline 2024-09-21T01:06:51.015236+0000) 2024-09-21T01:07:17.407 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:17 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:17.071+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:38.617213+0000 front 2024-09-21T01:06:38.617116+0000 (oldest deadline 2024-09-21T01:07:00.917223+0000) 2024-09-21T01:07:17.407 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:17 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:17.071+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.018657+0000 front 2024-09-21T01:06:45.018616+0000 (oldest deadline 2024-09-21T01:07:07.818952+0000) 2024-09-21T01:07:17.407 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:17 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:17.071+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.120940+0000 front 2024-09-21T01:06:54.120834+0000 (oldest deadline 2024-09-21T01:07:16.421000+0000) 2024-09-21T01:07:17.408 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:17 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:17.030+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:17.408 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:17 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:17.030+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:17.408 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:17 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:17.030+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:17.408 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:17 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:17.030+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:44.673331+0000 front 2024-09-21T01:06:44.673455+0000 (oldest deadline 2024-09-21T01:07:07.573344+0000) 2024-09-21T01:07:17.408 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:17 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:17.030+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.475468+0000 front 2024-09-21T01:06:54.475447+0000 (oldest deadline 2024-09-21T01:07:16.175523+0000) 2024-09-21T01:07:17.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:17 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:17.210+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:07:17.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:17 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:17.210+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:07:17.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:17 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:17.210+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.865418+0000 front 2024-09-21T01:06:37.865671+0000 (oldest deadline 2024-09-21T01:07:02.565301+0000) 2024-09-21T01:07:17.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:17 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:17.210+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.366611+0000 front 2024-09-21T01:06:45.366825+0000 (oldest deadline 2024-09-21T01:07:08.266719+0000) 2024-09-21T01:07:17.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:17 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:17.396+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.395969+0000 front 2024-09-21T01:06:29.395996+0000 (oldest deadline 2024-09-21T01:06:55.296091+0000) 2024-09-21T01:07:17.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:17 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:17.396+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:36.397149+0000 front 2024-09-21T01:06:36.397173+0000 (oldest deadline 2024-09-21T01:07:01.697370+0000) 2024-09-21T01:07:17.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:17 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:17.396+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.198361+0000 front 2024-09-21T01:06:45.198428+0000 (oldest deadline 2024-09-21T01:07:09.898570+0000) 2024-09-21T01:07:18.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:17 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:17.760+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:18.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:17 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:17.760+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:18.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:17 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:17.760+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:18.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:17 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:17.760+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:52.729076+0000 front 2024-09-21T01:06:52.729168+0000 (oldest deadline 2024-09-21T01:07:15.628932+0000) 2024-09-21T01:07:18.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:18 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:18.018+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:18.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:18 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:18.018+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:18.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:18 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:18.018+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:18.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:18 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:18.018+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:44.673331+0000 front 2024-09-21T01:06:44.673455+0000 (oldest deadline 2024-09-21T01:07:07.573344+0000) 2024-09-21T01:07:18.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:18 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:18.018+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.475468+0000 front 2024-09-21T01:06:54.475447+0000 (oldest deadline 2024-09-21T01:07:16.175523+0000) 2024-09-21T01:07:18.493 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:18 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:18.046+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.314998+0000 front 2024-09-21T01:06:26.315030+0000 (oldest deadline 2024-09-21T01:06:51.015236+0000) 2024-09-21T01:07:18.493 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:18 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:18.046+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:38.617213+0000 front 2024-09-21T01:06:38.617116+0000 (oldest deadline 2024-09-21T01:07:00.917223+0000) 2024-09-21T01:07:18.493 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:18 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:18.046+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.018657+0000 front 2024-09-21T01:06:45.018616+0000 (oldest deadline 2024-09-21T01:07:07.818952+0000) 2024-09-21T01:07:18.493 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:18 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7[51472]: 2024-09-21T01:07:18.046+0000 7f23e6817640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.120940+0000 front 2024-09-21T01:06:54.120834+0000 (oldest deadline 2024-09-21T01:07:16.421000+0000) 2024-09-21T01:07:18.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:18 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:18.227+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:07:18.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:18 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:18.227+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:07:18.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:18 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:18.227+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.865418+0000 front 2024-09-21T01:06:37.865671+0000 (oldest deadline 2024-09-21T01:07:02.565301+0000) 2024-09-21T01:07:18.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:18 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:18.227+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.366611+0000 front 2024-09-21T01:06:45.366825+0000 (oldest deadline 2024-09-21T01:07:08.266719+0000) 2024-09-21T01:07:18.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:18 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:18.407+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.395969+0000 front 2024-09-21T01:06:29.395996+0000 (oldest deadline 2024-09-21T01:06:55.296091+0000) 2024-09-21T01:07:18.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:18 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:18.407+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:36.397149+0000 front 2024-09-21T01:06:36.397173+0000 (oldest deadline 2024-09-21T01:07:01.697370+0000) 2024-09-21T01:07:18.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:18 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:18.407+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.198361+0000 front 2024-09-21T01:06:45.198428+0000 (oldest deadline 2024-09-21T01:07:09.898570+0000) 2024-09-21T01:07:19.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:18 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:18.799+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:19.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:18 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:18.799+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:19.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:18 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:18.799+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:19.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:18 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:18.799+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:52.729076+0000 front 2024-09-21T01:06:52.729168+0000 (oldest deadline 2024-09-21T01:07:15.628932+0000) 2024-09-21T01:07:19.481 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:19 smithi042 podman[67319]: 2024-09-21 01:07:19.148114107 +0000 UTC m=+5.474517566 container died c1d6dbf567f5694329b06378a8a05a069e66212d66878a6bf8c1963ff2923ac1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-21T01:07:19.482 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:19 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:19.024+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:19.482 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:19 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:19.024+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:19.482 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:19 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:19.024+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:19.482 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:19 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:19.024+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:44.673331+0000 front 2024-09-21T01:06:44.673455+0000 (oldest deadline 2024-09-21T01:07:07.573344+0000) 2024-09-21T01:07:19.482 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:19 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:19.024+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.475468+0000 front 2024-09-21T01:06:54.475447+0000 (oldest deadline 2024-09-21T01:07:16.175523+0000) 2024-09-21T01:07:19.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:19 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:19.253+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:07:19.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:19 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:19.253+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:07:19.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:19 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:19.253+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.865418+0000 front 2024-09-21T01:06:37.865671+0000 (oldest deadline 2024-09-21T01:07:02.565301+0000) 2024-09-21T01:07:19.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:19 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:19.253+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.366611+0000 front 2024-09-21T01:06:45.366825+0000 (oldest deadline 2024-09-21T01:07:08.266719+0000) 2024-09-21T01:07:19.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:19 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:19.253+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.068271+0000 front 2024-09-21T01:06:54.068382+0000 (oldest deadline 2024-09-21T01:07:18.768279+0000) 2024-09-21T01:07:19.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:19 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:19.376+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.395969+0000 front 2024-09-21T01:06:29.395996+0000 (oldest deadline 2024-09-21T01:06:55.296091+0000) 2024-09-21T01:07:19.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:19 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:19.376+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:36.397149+0000 front 2024-09-21T01:06:36.397173+0000 (oldest deadline 2024-09-21T01:07:01.697370+0000) 2024-09-21T01:07:19.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:19 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:19.376+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.198361+0000 front 2024-09-21T01:06:45.198428+0000 (oldest deadline 2024-09-21T01:07:09.898570+0000) 2024-09-21T01:07:19.742 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:19 smithi042 podman[67319]: 2024-09-21 01:07:19.563451481 +0000 UTC m=+5.889854928 container cleanup c1d6dbf567f5694329b06378a8a05a069e66212d66878a6bf8c1963ff2923ac1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T01:07:19.742 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:19 smithi042 bash[67319]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7 2024-09-21T01:07:20.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:19 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:19.813+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:20.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:19 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:19.813+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:20.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:19 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:19.813+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:20.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:19 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:19.813+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:52.729076+0000 front 2024-09-21T01:06:52.729168+0000 (oldest deadline 2024-09-21T01:07:15.628932+0000) 2024-09-21T01:07:20.240 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:19 smithi042 podman[67347]: 2024-09-21 01:07:19.823409828 +0000 UTC m=+0.671844939 container remove c1d6dbf567f5694329b06378a8a05a069e66212d66878a6bf8c1963ff2923ac1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:07:20.240 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:20 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:20.006+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:20.240 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:20 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:20.006+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:20.240 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:20 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:20.006+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:20.240 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:20 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:20.006+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:44.673331+0000 front 2024-09-21T01:06:44.673455+0000 (oldest deadline 2024-09-21T01:07:07.573344+0000) 2024-09-21T01:07:20.240 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:20 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:20.006+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.475468+0000 front 2024-09-21T01:06:54.475447+0000 (oldest deadline 2024-09-21T01:07:16.175523+0000) 2024-09-21T01:07:20.492 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:20 smithi042 podman[67436]: 2024-09-21 01:07:20.142684777 +0000 UTC m=+0.015936545 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:07:20.492 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:20 smithi042 podman[67436]: 2024-09-21 01:07:20.266024757 +0000 UTC m=+0.139276568 container create 703d6c3fb9f5427137e7db94ff7f67a90cb226df61323fe29ab87d40110d42dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-21T01:07:20.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:20 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:20.286+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:07:20.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:20 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:20.286+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:07:20.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:20 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:20.286+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.865418+0000 front 2024-09-21T01:06:37.865671+0000 (oldest deadline 2024-09-21T01:07:02.565301+0000) 2024-09-21T01:07:20.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:20 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:20.286+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.366611+0000 front 2024-09-21T01:06:45.366825+0000 (oldest deadline 2024-09-21T01:07:08.266719+0000) 2024-09-21T01:07:20.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:20 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:20.286+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.068271+0000 front 2024-09-21T01:06:54.068382+0000 (oldest deadline 2024-09-21T01:07:18.768279+0000) 2024-09-21T01:07:20.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:20 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:20.381+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.395969+0000 front 2024-09-21T01:06:29.395996+0000 (oldest deadline 2024-09-21T01:06:55.296091+0000) 2024-09-21T01:07:20.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:20 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:20.381+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:36.397149+0000 front 2024-09-21T01:06:36.397173+0000 (oldest deadline 2024-09-21T01:07:01.697370+0000) 2024-09-21T01:07:20.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:20 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:20.381+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.198361+0000 front 2024-09-21T01:06:45.198428+0000 (oldest deadline 2024-09-21T01:07:09.898570+0000) 2024-09-21T01:07:20.993 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:20 smithi042 podman[67436]: 2024-09-21 01:07:20.527131645 +0000 UTC m=+0.400383404 container init 703d6c3fb9f5427137e7db94ff7f67a90cb226df61323fe29ab87d40110d42dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True) 2024-09-21T01:07:20.993 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:20 smithi042 podman[67436]: 2024-09-21 01:07:20.530371198 +0000 UTC m=+0.403622959 container start 703d6c3fb9f5427137e7db94ff7f67a90cb226df61323fe29ab87d40110d42dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True) 2024-09-21T01:07:20.993 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:20 smithi042 podman[67436]: 2024-09-21 01:07:20.627007608 +0000 UTC m=+0.500259385 container attach 703d6c3fb9f5427137e7db94ff7f67a90cb226df61323fe29ab87d40110d42dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T01:07:20.993 INFO:journalctl@ceph.osd.7.smithi042.stdout:Sep 21 01:07:20 smithi042 podman[67436]: 2024-09-21 01:07:20.727089068 +0000 UTC m=+0.600340827 container died 703d6c3fb9f5427137e7db94ff7f67a90cb226df61323fe29ab87d40110d42dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS) 2024-09-21T01:07:21.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:20 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:20.808+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:21.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:20 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:20.808+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:21.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:20 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:20.808+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:21.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:20 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:20.808+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:52.729076+0000 front 2024-09-21T01:06:52.729168+0000 (oldest deadline 2024-09-21T01:07:15.628932+0000) 2024-09-21T01:07:21.339 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:21 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:21.009+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:21.339 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:21 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:21.009+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:21.340 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:21 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:21.009+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:21.340 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:21 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:21.009+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:44.673331+0000 front 2024-09-21T01:06:44.673455+0000 (oldest deadline 2024-09-21T01:07:07.573344+0000) 2024-09-21T01:07:21.340 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:21 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:21.009+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.475468+0000 front 2024-09-21T01:06:54.475447+0000 (oldest deadline 2024-09-21T01:07:16.175523+0000) 2024-09-21T01:07:21.356 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@osd.7.service' 2024-09-21T01:07:21.399 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:07:21.400 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-21T01:07:21.400 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-21T01:07:21.400 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ceph-d3972c20-77b2-11ef-baf5-efdc52797490@osd.8 2024-09-21T01:07:21.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:21 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:21.332+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:07:21.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:21 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:21.332+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:07:21.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:21 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:21.332+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.865418+0000 front 2024-09-21T01:06:37.865671+0000 (oldest deadline 2024-09-21T01:07:02.565301+0000) 2024-09-21T01:07:21.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:21 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:21.332+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.366611+0000 front 2024-09-21T01:06:45.366825+0000 (oldest deadline 2024-09-21T01:07:08.266719+0000) 2024-09-21T01:07:21.711 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:21 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:21.332+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.068271+0000 front 2024-09-21T01:06:54.068382+0000 (oldest deadline 2024-09-21T01:07:18.768279+0000) 2024-09-21T01:07:21.727 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:21 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:21.392+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.395969+0000 front 2024-09-21T01:06:29.395996+0000 (oldest deadline 2024-09-21T01:06:55.296091+0000) 2024-09-21T01:07:21.727 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:21 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:21.392+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:36.397149+0000 front 2024-09-21T01:06:36.397173+0000 (oldest deadline 2024-09-21T01:07:01.697370+0000) 2024-09-21T01:07:21.727 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:21 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:21.392+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.198361+0000 front 2024-09-21T01:06:45.198428+0000 (oldest deadline 2024-09-21T01:07:09.898570+0000) 2024-09-21T01:07:21.727 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:21 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:21.392+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:49.899159+0000 front 2024-09-21T01:06:49.899102+0000 (oldest deadline 2024-09-21T01:07:21.099483+0000) 2024-09-21T01:07:21.727 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:21 smithi193 systemd[1]: Stopping Ceph osd.8 for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:07:21.727 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:21 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:21.726+0000 7efdadcaa640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:07:21.728 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:21 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:21.726+0000 7efdadcaa640 -1 osd.8 78 *** Got signal Terminated *** 2024-09-21T01:07:21.728 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:21 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:21.726+0000 7efdadcaa640 -1 osd.8 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:07:21.979 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:21 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:21.820+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:21.979 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:21 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:21.820+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:21.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:21 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:21.820+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:21.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:21 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:21.820+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:52.729076+0000 front 2024-09-21T01:06:52.729168+0000 (oldest deadline 2024-09-21T01:07:15.628932+0000) 2024-09-21T01:07:22.242 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:21 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:21.987+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:22.242 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:21 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:21.987+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:22.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:21 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:21.987+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:22.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:21 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:21.987+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:44.673331+0000 front 2024-09-21T01:06:44.673455+0000 (oldest deadline 2024-09-21T01:07:07.573344+0000) 2024-09-21T01:07:22.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:21 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:21.987+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.475468+0000 front 2024-09-21T01:06:54.475447+0000 (oldest deadline 2024-09-21T01:07:16.175523+0000) 2024-09-21T01:07:22.611 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:22 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:22.329+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:07:22.612 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:22 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:22.329+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:07:22.612 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:22 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:22.329+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.865418+0000 front 2024-09-21T01:06:37.865671+0000 (oldest deadline 2024-09-21T01:07:02.565301+0000) 2024-09-21T01:07:22.612 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:22 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:22.329+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.366611+0000 front 2024-09-21T01:06:45.366825+0000 (oldest deadline 2024-09-21T01:07:08.266719+0000) 2024-09-21T01:07:22.612 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:22 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:22.329+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.068271+0000 front 2024-09-21T01:06:54.068382+0000 (oldest deadline 2024-09-21T01:07:18.768279+0000) 2024-09-21T01:07:22.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:22 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:22.406+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.395969+0000 front 2024-09-21T01:06:29.395996+0000 (oldest deadline 2024-09-21T01:06:55.296091+0000) 2024-09-21T01:07:22.730 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:22 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:22.406+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:36.397149+0000 front 2024-09-21T01:06:36.397173+0000 (oldest deadline 2024-09-21T01:07:01.697370+0000) 2024-09-21T01:07:22.730 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:22 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:22.406+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.198361+0000 front 2024-09-21T01:06:45.198428+0000 (oldest deadline 2024-09-21T01:07:09.898570+0000) 2024-09-21T01:07:22.730 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:22 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:22.406+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:49.899159+0000 front 2024-09-21T01:06:49.899102+0000 (oldest deadline 2024-09-21T01:07:21.099483+0000) 2024-09-21T01:07:23.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:22 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:22.797+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:23.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:22 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:22.797+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:23.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:22 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:22.797+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:23.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:22 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:22.797+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:52.729076+0000 front 2024-09-21T01:06:52.729168+0000 (oldest deadline 2024-09-21T01:07:15.628932+0000) 2024-09-21T01:07:23.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:23 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:23.017+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:23.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:23 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:23.017+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:23.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:23 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:23.017+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:23.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:23 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:23.017+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:44.673331+0000 front 2024-09-21T01:06:44.673455+0000 (oldest deadline 2024-09-21T01:07:07.573344+0000) 2024-09-21T01:07:23.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:23 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:23.017+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.475468+0000 front 2024-09-21T01:06:54.475447+0000 (oldest deadline 2024-09-21T01:07:16.175523+0000) 2024-09-21T01:07:23.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:23 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:23.355+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:07:23.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:23 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:23.355+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:07:23.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:23 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:23.355+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.865418+0000 front 2024-09-21T01:06:37.865671+0000 (oldest deadline 2024-09-21T01:07:02.565301+0000) 2024-09-21T01:07:23.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:23 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:23.355+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.366611+0000 front 2024-09-21T01:06:45.366825+0000 (oldest deadline 2024-09-21T01:07:08.266719+0000) 2024-09-21T01:07:23.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:23 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:23.355+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.068271+0000 front 2024-09-21T01:06:54.068382+0000 (oldest deadline 2024-09-21T01:07:18.768279+0000) 2024-09-21T01:07:23.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:23 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:23.456+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.395969+0000 front 2024-09-21T01:06:29.395996+0000 (oldest deadline 2024-09-21T01:06:55.296091+0000) 2024-09-21T01:07:23.730 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:23 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:23.456+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:36.397149+0000 front 2024-09-21T01:06:36.397173+0000 (oldest deadline 2024-09-21T01:07:01.697370+0000) 2024-09-21T01:07:23.730 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:23 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:23.456+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.198361+0000 front 2024-09-21T01:06:45.198428+0000 (oldest deadline 2024-09-21T01:07:09.898570+0000) 2024-09-21T01:07:23.730 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:23 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:23.456+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:49.899159+0000 front 2024-09-21T01:06:49.899102+0000 (oldest deadline 2024-09-21T01:07:21.099483+0000) 2024-09-21T01:07:24.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:23 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:23.823+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:24.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:23 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:23.823+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:24.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:23 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:23.823+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:24.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:23 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:23.823+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:52.729076+0000 front 2024-09-21T01:06:52.729168+0000 (oldest deadline 2024-09-21T01:07:15.628932+0000) 2024-09-21T01:07:24.242 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:23 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:23.974+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:24.242 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:23 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:23.974+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:24.242 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:23 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:23.974+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:24.242 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:23 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:23.974+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:44.673331+0000 front 2024-09-21T01:06:44.673455+0000 (oldest deadline 2024-09-21T01:07:07.573344+0000) 2024-09-21T01:07:24.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:23 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:23.974+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.475468+0000 front 2024-09-21T01:06:54.475447+0000 (oldest deadline 2024-09-21T01:07:16.175523+0000) 2024-09-21T01:07:24.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:24 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:24.316+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:07:24.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:24 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:24.316+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:07:24.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:24 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:24.316+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.865418+0000 front 2024-09-21T01:06:37.865671+0000 (oldest deadline 2024-09-21T01:07:02.565301+0000) 2024-09-21T01:07:24.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:24 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:24.316+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.366611+0000 front 2024-09-21T01:06:45.366825+0000 (oldest deadline 2024-09-21T01:07:08.266719+0000) 2024-09-21T01:07:24.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:24 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:24.316+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.068271+0000 front 2024-09-21T01:06:54.068382+0000 (oldest deadline 2024-09-21T01:07:18.768279+0000) 2024-09-21T01:07:24.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:24 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:24.430+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.395969+0000 front 2024-09-21T01:06:29.395996+0000 (oldest deadline 2024-09-21T01:06:55.296091+0000) 2024-09-21T01:07:24.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:24 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:24.430+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:36.397149+0000 front 2024-09-21T01:06:36.397173+0000 (oldest deadline 2024-09-21T01:07:01.697370+0000) 2024-09-21T01:07:24.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:24 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:24.430+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.198361+0000 front 2024-09-21T01:06:45.198428+0000 (oldest deadline 2024-09-21T01:07:09.898570+0000) 2024-09-21T01:07:24.730 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:24 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:24.430+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:49.899159+0000 front 2024-09-21T01:06:49.899102+0000 (oldest deadline 2024-09-21T01:07:21.099483+0000) 2024-09-21T01:07:25.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:24 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:24.823+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:25.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:24 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:24.823+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:25.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:24 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:24.823+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:25.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:24 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:24.823+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:52.729076+0000 front 2024-09-21T01:06:52.729168+0000 (oldest deadline 2024-09-21T01:07:15.628932+0000) 2024-09-21T01:07:25.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:24 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:24.823+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.929735+0000 front 2024-09-21T01:07:00.929834+0000 (oldest deadline 2024-09-21T01:07:23.829958+0000) 2024-09-21T01:07:25.242 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:24 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:24.982+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:25.242 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:24 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:24.982+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:25.242 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:24 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:24.982+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:25.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:24 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:24.982+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:44.673331+0000 front 2024-09-21T01:06:44.673455+0000 (oldest deadline 2024-09-21T01:07:07.573344+0000) 2024-09-21T01:07:25.243 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:24 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:24.982+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.475468+0000 front 2024-09-21T01:06:54.475447+0000 (oldest deadline 2024-09-21T01:07:16.175523+0000) 2024-09-21T01:07:25.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:25 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:25.324+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:07:25.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:25 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:25.324+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:07:25.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:25 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:25.324+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.865418+0000 front 2024-09-21T01:06:37.865671+0000 (oldest deadline 2024-09-21T01:07:02.565301+0000) 2024-09-21T01:07:25.711 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:25 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:25.324+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.366611+0000 front 2024-09-21T01:06:45.366825+0000 (oldest deadline 2024-09-21T01:07:08.266719+0000) 2024-09-21T01:07:25.711 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:25 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:25.324+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.068271+0000 front 2024-09-21T01:06:54.068382+0000 (oldest deadline 2024-09-21T01:07:18.768279+0000) 2024-09-21T01:07:25.711 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:25 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:25.324+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:01.669815+0000 front 2024-09-21T01:07:01.669712+0000 (oldest deadline 2024-09-21T01:07:25.169570+0000) 2024-09-21T01:07:25.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:25 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:25.454+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.395969+0000 front 2024-09-21T01:06:29.395996+0000 (oldest deadline 2024-09-21T01:06:55.296091+0000) 2024-09-21T01:07:25.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:25 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:25.454+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:36.397149+0000 front 2024-09-21T01:06:36.397173+0000 (oldest deadline 2024-09-21T01:07:01.697370+0000) 2024-09-21T01:07:25.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:25 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:25.454+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.198361+0000 front 2024-09-21T01:06:45.198428+0000 (oldest deadline 2024-09-21T01:07:09.898570+0000) 2024-09-21T01:07:25.730 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:25 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:25.454+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:49.899159+0000 front 2024-09-21T01:06:49.899102+0000 (oldest deadline 2024-09-21T01:07:21.099483+0000) 2024-09-21T01:07:26.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:25 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:25.845+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:26.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:25 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:25.845+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:26.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:25 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:25.845+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:26.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:25 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:25.845+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:52.729076+0000 front 2024-09-21T01:06:52.729168+0000 (oldest deadline 2024-09-21T01:07:15.628932+0000) 2024-09-21T01:07:26.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:25 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:25.845+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.929735+0000 front 2024-09-21T01:07:00.929834+0000 (oldest deadline 2024-09-21T01:07:23.829958+0000) 2024-09-21T01:07:26.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:26 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:26.021+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:26.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:26 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:26.021+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:26.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:26 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:26.021+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:26.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:26 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:26.021+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:44.673331+0000 front 2024-09-21T01:06:44.673455+0000 (oldest deadline 2024-09-21T01:07:07.573344+0000) 2024-09-21T01:07:26.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:26 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:26.021+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.475468+0000 front 2024-09-21T01:06:54.475447+0000 (oldest deadline 2024-09-21T01:07:16.175523+0000) 2024-09-21T01:07:26.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:26 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:26.021+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.177138+0000 front 2024-09-21T01:07:00.177172+0000 (oldest deadline 2024-09-21T01:07:25.477295+0000) 2024-09-21T01:07:26.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:26 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:26.325+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:07:26.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:26 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:26.325+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:07:26.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:26 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:26.325+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.865418+0000 front 2024-09-21T01:06:37.865671+0000 (oldest deadline 2024-09-21T01:07:02.565301+0000) 2024-09-21T01:07:26.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:26 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:26.325+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.366611+0000 front 2024-09-21T01:06:45.366825+0000 (oldest deadline 2024-09-21T01:07:08.266719+0000) 2024-09-21T01:07:26.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:26 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:26.325+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.068271+0000 front 2024-09-21T01:06:54.068382+0000 (oldest deadline 2024-09-21T01:07:18.768279+0000) 2024-09-21T01:07:26.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:26 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:26.325+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:01.669815+0000 front 2024-09-21T01:07:01.669712+0000 (oldest deadline 2024-09-21T01:07:25.169570+0000) 2024-09-21T01:07:26.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:26 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:26.435+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:29.395969+0000 front 2024-09-21T01:06:29.395996+0000 (oldest deadline 2024-09-21T01:06:55.296091+0000) 2024-09-21T01:07:26.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:26 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:26.435+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:36.397149+0000 front 2024-09-21T01:06:36.397173+0000 (oldest deadline 2024-09-21T01:07:01.697370+0000) 2024-09-21T01:07:26.729 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:26 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:26.435+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.198361+0000 front 2024-09-21T01:06:45.198428+0000 (oldest deadline 2024-09-21T01:07:09.898570+0000) 2024-09-21T01:07:26.730 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:26 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:26.435+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:49.899159+0000 front 2024-09-21T01:06:49.899102+0000 (oldest deadline 2024-09-21T01:07:21.099483+0000) 2024-09-21T01:07:26.730 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:26 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8[52094]: 2024-09-21T01:07:26.435+0000 7efda628d640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:01.099785+0000 front 2024-09-21T01:07:01.099836+0000 (oldest deadline 2024-09-21T01:07:26.399904+0000) 2024-09-21T01:07:27.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:26 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:26.828+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:27.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:26 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:26.828+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:27.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:26 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:26.828+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:27.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:26 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:26.828+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:52.729076+0000 front 2024-09-21T01:06:52.729168+0000 (oldest deadline 2024-09-21T01:07:15.628932+0000) 2024-09-21T01:07:27.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:26 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:26.828+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.929735+0000 front 2024-09-21T01:07:00.929834+0000 (oldest deadline 2024-09-21T01:07:23.829958+0000) 2024-09-21T01:07:27.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:27 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:27.032+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:27.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:27 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:27.032+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:27.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:27 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:27.032+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:27.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:27 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:27.032+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:44.673331+0000 front 2024-09-21T01:06:44.673455+0000 (oldest deadline 2024-09-21T01:07:07.573344+0000) 2024-09-21T01:07:27.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:27 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:27.032+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.475468+0000 front 2024-09-21T01:06:54.475447+0000 (oldest deadline 2024-09-21T01:07:16.175523+0000) 2024-09-21T01:07:27.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:27 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:27.032+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.177138+0000 front 2024-09-21T01:07:00.177172+0000 (oldest deadline 2024-09-21T01:07:25.477295+0000) 2024-09-21T01:07:27.504 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:27 smithi193 podman[67449]: 2024-09-21 01:07:27.252178259 +0000 UTC m=+5.653458000 container died 8b59632f0a3a32d7f70906ea0cf6f0fdf20b3f40eacb7642be4b5d8c7b6a9850 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2) 2024-09-21T01:07:27.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:27 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:27.316+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:07:27.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:27 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:27.316+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:07:27.711 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:27 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:27.316+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.865418+0000 front 2024-09-21T01:06:37.865671+0000 (oldest deadline 2024-09-21T01:07:02.565301+0000) 2024-09-21T01:07:27.711 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:27 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:27.316+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.366611+0000 front 2024-09-21T01:06:45.366825+0000 (oldest deadline 2024-09-21T01:07:08.266719+0000) 2024-09-21T01:07:27.711 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:27 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:27.316+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.068271+0000 front 2024-09-21T01:06:54.068382+0000 (oldest deadline 2024-09-21T01:07:18.768279+0000) 2024-09-21T01:07:27.711 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:27 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:27.316+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:01.669815+0000 front 2024-09-21T01:07:01.669712+0000 (oldest deadline 2024-09-21T01:07:25.169570+0000) 2024-09-21T01:07:27.850 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:27 smithi193 podman[67449]: 2024-09-21 01:07:27.626957209 +0000 UTC m=+6.028236947 container cleanup 8b59632f0a3a32d7f70906ea0cf6f0fdf20b3f40eacb7642be4b5d8c7b6a9850 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:07:27.850 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:27 smithi193 bash[67449]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8 2024-09-21T01:07:28.229 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:27 smithi193 podman[67466]: 2024-09-21 01:07:27.897803336 +0000 UTC m=+0.644394841 container remove 8b59632f0a3a32d7f70906ea0cf6f0fdf20b3f40eacb7642be4b5d8c7b6a9850 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:07:28.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:27 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:27.849+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:28.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:27 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:27.849+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:28.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:27 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:27.849+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:28.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:27 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:27.849+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:52.729076+0000 front 2024-09-21T01:06:52.729168+0000 (oldest deadline 2024-09-21T01:07:15.628932+0000) 2024-09-21T01:07:28.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:27 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:27.849+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.929735+0000 front 2024-09-21T01:07:00.929834+0000 (oldest deadline 2024-09-21T01:07:23.829958+0000) 2024-09-21T01:07:28.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:28 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:28.065+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:28.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:28 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:28.065+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:28.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:28 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:28.065+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:28.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:28 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:28.065+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:44.673331+0000 front 2024-09-21T01:06:44.673455+0000 (oldest deadline 2024-09-21T01:07:07.573344+0000) 2024-09-21T01:07:28.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:28 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:28.065+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.475468+0000 front 2024-09-21T01:06:54.475447+0000 (oldest deadline 2024-09-21T01:07:16.175523+0000) 2024-09-21T01:07:28.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:28 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:28.065+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.177138+0000 front 2024-09-21T01:07:00.177172+0000 (oldest deadline 2024-09-21T01:07:25.477295+0000) 2024-09-21T01:07:28.498 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:28 smithi193 podman[67557]: 2024-09-21 01:07:28.140915463 +0000 UTC m=+0.015324899 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:07:28.498 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:28 smithi193 podman[67557]: 2024-09-21 01:07:28.279252801 +0000 UTC m=+0.153662235 container create 669982461bb05105c984475e4d9883e7eff023942caa0cb6d6f80d37246688ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:07:28.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:28 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:28.294+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:07:28.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:28 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:28.294+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:07:28.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:28 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:28.294+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.865418+0000 front 2024-09-21T01:06:37.865671+0000 (oldest deadline 2024-09-21T01:07:02.565301+0000) 2024-09-21T01:07:28.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:28 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:28.294+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.366611+0000 front 2024-09-21T01:06:45.366825+0000 (oldest deadline 2024-09-21T01:07:08.266719+0000) 2024-09-21T01:07:28.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:28 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:28.294+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.068271+0000 front 2024-09-21T01:06:54.068382+0000 (oldest deadline 2024-09-21T01:07:18.768279+0000) 2024-09-21T01:07:28.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:28 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:28.294+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:01.669815+0000 front 2024-09-21T01:07:01.669712+0000 (oldest deadline 2024-09-21T01:07:25.169570+0000) 2024-09-21T01:07:28.828 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:28 smithi193 podman[67557]: 2024-09-21 01:07:28.498268487 +0000 UTC m=+0.372677922 container init 669982461bb05105c984475e4d9883e7eff023942caa0cb6d6f80d37246688ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:07:28.828 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:28 smithi193 podman[67557]: 2024-09-21 01:07:28.501706819 +0000 UTC m=+0.376116255 container start 669982461bb05105c984475e4d9883e7eff023942caa0cb6d6f80d37246688ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T01:07:28.828 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:28 smithi193 podman[67557]: 2024-09-21 01:07:28.606715329 +0000 UTC m=+0.481124765 container attach 669982461bb05105c984475e4d9883e7eff023942caa0cb6d6f80d37246688ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-21T01:07:28.828 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 21 01:07:28 smithi193 podman[67557]: 2024-09-21 01:07:28.699429237 +0000 UTC m=+0.573838673 container died 669982461bb05105c984475e4d9883e7eff023942caa0cb6d6f80d37246688ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:07:29.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:28 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:28.826+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:29.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:28 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:28.826+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:29.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:28 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:28.826+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:29.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:28 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:28.826+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:52.729076+0000 front 2024-09-21T01:06:52.729168+0000 (oldest deadline 2024-09-21T01:07:15.628932+0000) 2024-09-21T01:07:29.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:28 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:28.826+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.929735+0000 front 2024-09-21T01:07:00.929834+0000 (oldest deadline 2024-09-21T01:07:23.829958+0000) 2024-09-21T01:07:29.285 DEBUG:teuthology.orchestra.run.smithi193:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@osd.8.service' 2024-09-21T01:07:29.324 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:07:29.324 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-21T01:07:29.324 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-21T01:07:29.324 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-d3972c20-77b2-11ef-baf5-efdc52797490@osd.9 2024-09-21T01:07:29.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:29 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:29.071+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:29.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:29 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:29.071+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:29.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:29 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:29.071+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:29.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:29 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:29.071+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:44.673331+0000 front 2024-09-21T01:06:44.673455+0000 (oldest deadline 2024-09-21T01:07:07.573344+0000) 2024-09-21T01:07:29.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:29 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:29.071+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.475468+0000 front 2024-09-21T01:06:54.475447+0000 (oldest deadline 2024-09-21T01:07:16.175523+0000) 2024-09-21T01:07:29.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:29 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:29.071+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.177138+0000 front 2024-09-21T01:07:00.177172+0000 (oldest deadline 2024-09-21T01:07:25.477295+0000) 2024-09-21T01:07:29.669 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:29 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:29.296+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:07:29.669 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:29 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:29.296+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:07:29.669 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:29 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:29.296+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.865418+0000 front 2024-09-21T01:06:37.865671+0000 (oldest deadline 2024-09-21T01:07:02.565301+0000) 2024-09-21T01:07:29.669 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:29 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:29.296+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.366611+0000 front 2024-09-21T01:06:45.366825+0000 (oldest deadline 2024-09-21T01:07:08.266719+0000) 2024-09-21T01:07:29.670 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:29 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:29.296+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.068271+0000 front 2024-09-21T01:06:54.068382+0000 (oldest deadline 2024-09-21T01:07:18.768279+0000) 2024-09-21T01:07:29.670 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:29 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:29.296+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:01.669815+0000 front 2024-09-21T01:07:01.669712+0000 (oldest deadline 2024-09-21T01:07:25.169570+0000) 2024-09-21T01:07:29.670 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:29 smithi001 systemd[1]: Stopping Ceph osd.9 for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:07:29.670 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:29 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:29.668+0000 7fb0dae8d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:07:29.670 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:29 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:29.668+0000 7fb0dae8d640 -1 osd.9 78 *** Got signal Terminated *** 2024-09-21T01:07:29.670 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:29 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:29.668+0000 7fb0dae8d640 -1 osd.9 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:07:30.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:29 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:29.806+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:30.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:29 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:29.806+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:30.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:29 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:29.806+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:30.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:29 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:29.806+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:52.729076+0000 front 2024-09-21T01:06:52.729168+0000 (oldest deadline 2024-09-21T01:07:15.628932+0000) 2024-09-21T01:07:30.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:29 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:29.806+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.929735+0000 front 2024-09-21T01:07:00.929834+0000 (oldest deadline 2024-09-21T01:07:23.829958+0000) 2024-09-21T01:07:30.495 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:30 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:30.053+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:30.495 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:30 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:30.053+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:30.495 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:30 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:30.053+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:30.495 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:30 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:30.053+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:44.673331+0000 front 2024-09-21T01:06:44.673455+0000 (oldest deadline 2024-09-21T01:07:07.573344+0000) 2024-09-21T01:07:30.496 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:30 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:30.053+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.475468+0000 front 2024-09-21T01:06:54.475447+0000 (oldest deadline 2024-09-21T01:07:16.175523+0000) 2024-09-21T01:07:30.496 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:30 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:30.053+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.177138+0000 front 2024-09-21T01:07:00.177172+0000 (oldest deadline 2024-09-21T01:07:25.477295+0000) 2024-09-21T01:07:30.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:30 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:30.288+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:07:30.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:30 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:30.288+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:07:30.711 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:30 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:30.288+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.865418+0000 front 2024-09-21T01:06:37.865671+0000 (oldest deadline 2024-09-21T01:07:02.565301+0000) 2024-09-21T01:07:30.711 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:30 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:30.288+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.366611+0000 front 2024-09-21T01:06:45.366825+0000 (oldest deadline 2024-09-21T01:07:08.266719+0000) 2024-09-21T01:07:30.711 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:30 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:30.288+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.068271+0000 front 2024-09-21T01:06:54.068382+0000 (oldest deadline 2024-09-21T01:07:18.768279+0000) 2024-09-21T01:07:30.711 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:30 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:30.288+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:01.669815+0000 front 2024-09-21T01:07:01.669712+0000 (oldest deadline 2024-09-21T01:07:25.169570+0000) 2024-09-21T01:07:31.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:30 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:30.777+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:31.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:30 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:30.777+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:31.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:30 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:30.777+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:31.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:30 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:30.777+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:52.729076+0000 front 2024-09-21T01:06:52.729168+0000 (oldest deadline 2024-09-21T01:07:15.628932+0000) 2024-09-21T01:07:31.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:30 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:30.777+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.929735+0000 front 2024-09-21T01:07:00.929834+0000 (oldest deadline 2024-09-21T01:07:23.829958+0000) 2024-09-21T01:07:31.406 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:31 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:31.093+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:31.406 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:31 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:31.093+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:31.406 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:31 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:31.093+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:31.406 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:31 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:31.093+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:44.673331+0000 front 2024-09-21T01:06:44.673455+0000 (oldest deadline 2024-09-21T01:07:07.573344+0000) 2024-09-21T01:07:31.407 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:31 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:31.093+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.475468+0000 front 2024-09-21T01:06:54.475447+0000 (oldest deadline 2024-09-21T01:07:16.175523+0000) 2024-09-21T01:07:31.407 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:31 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:31.093+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.177138+0000 front 2024-09-21T01:07:00.177172+0000 (oldest deadline 2024-09-21T01:07:25.477295+0000) 2024-09-21T01:07:31.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:31 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:31.326+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:07:31.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:31 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:31.326+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:07:31.711 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:31 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:31.326+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.865418+0000 front 2024-09-21T01:06:37.865671+0000 (oldest deadline 2024-09-21T01:07:02.565301+0000) 2024-09-21T01:07:31.711 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:31 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:31.326+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.366611+0000 front 2024-09-21T01:06:45.366825+0000 (oldest deadline 2024-09-21T01:07:08.266719+0000) 2024-09-21T01:07:31.711 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:31 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:31.326+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.068271+0000 front 2024-09-21T01:06:54.068382+0000 (oldest deadline 2024-09-21T01:07:18.768279+0000) 2024-09-21T01:07:31.711 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:31 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:31.326+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:01.669815+0000 front 2024-09-21T01:07:01.669712+0000 (oldest deadline 2024-09-21T01:07:25.169570+0000) 2024-09-21T01:07:32.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:31 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:31.794+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:32.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:31 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:31.794+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:32.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:31 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:31.794+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:32.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:31 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:31.794+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:52.729076+0000 front 2024-09-21T01:06:52.729168+0000 (oldest deadline 2024-09-21T01:07:15.628932+0000) 2024-09-21T01:07:32.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:31 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:31.794+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.929735+0000 front 2024-09-21T01:07:00.929834+0000 (oldest deadline 2024-09-21T01:07:23.829958+0000) 2024-09-21T01:07:32.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:31 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:31.794+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-21T01:07:07.831410+0000 front 2024-09-21T01:07:07.831300+0000 (oldest deadline 2024-09-21T01:07:31.331333+0000) 2024-09-21T01:07:32.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:32 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:32.085+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:32.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:32 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:32.085+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:32.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:32 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:32.085+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:32.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:32 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:32.085+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:44.673331+0000 front 2024-09-21T01:06:44.673455+0000 (oldest deadline 2024-09-21T01:07:07.573344+0000) 2024-09-21T01:07:32.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:32 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:32.085+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.475468+0000 front 2024-09-21T01:06:54.475447+0000 (oldest deadline 2024-09-21T01:07:16.175523+0000) 2024-09-21T01:07:32.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:32 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:32.085+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.177138+0000 front 2024-09-21T01:07:00.177172+0000 (oldest deadline 2024-09-21T01:07:25.477295+0000) 2024-09-21T01:07:32.676 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:32 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:32.351+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:07:32.676 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:32 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:32.351+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:07:32.676 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:32 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:32.351+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.865418+0000 front 2024-09-21T01:06:37.865671+0000 (oldest deadline 2024-09-21T01:07:02.565301+0000) 2024-09-21T01:07:32.676 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:32 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:32.351+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.366611+0000 front 2024-09-21T01:06:45.366825+0000 (oldest deadline 2024-09-21T01:07:08.266719+0000) 2024-09-21T01:07:32.676 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:32 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:32.351+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.068271+0000 front 2024-09-21T01:06:54.068382+0000 (oldest deadline 2024-09-21T01:07:18.768279+0000) 2024-09-21T01:07:32.676 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:32 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:32.351+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:01.669815+0000 front 2024-09-21T01:07:01.669712+0000 (oldest deadline 2024-09-21T01:07:25.169570+0000) 2024-09-21T01:07:33.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:32 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:32.757+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:33.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:32 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:32.757+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:33.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:32 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:32.757+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:33.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:32 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:32.757+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:52.729076+0000 front 2024-09-21T01:06:52.729168+0000 (oldest deadline 2024-09-21T01:07:15.628932+0000) 2024-09-21T01:07:33.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:32 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:32.757+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.929735+0000 front 2024-09-21T01:07:00.929834+0000 (oldest deadline 2024-09-21T01:07:23.829958+0000) 2024-09-21T01:07:33.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:32 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:32.757+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-21T01:07:07.831410+0000 front 2024-09-21T01:07:07.831300+0000 (oldest deadline 2024-09-21T01:07:31.331333+0000) 2024-09-21T01:07:33.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:33 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:33.076+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:33.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:33 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:33.076+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:33.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:33 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:33.076+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:33.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:33 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:33.076+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:44.673331+0000 front 2024-09-21T01:06:44.673455+0000 (oldest deadline 2024-09-21T01:07:07.573344+0000) 2024-09-21T01:07:33.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:33 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:33.076+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.475468+0000 front 2024-09-21T01:06:54.475447+0000 (oldest deadline 2024-09-21T01:07:16.175523+0000) 2024-09-21T01:07:33.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:33 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:33.076+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.177138+0000 front 2024-09-21T01:07:00.177172+0000 (oldest deadline 2024-09-21T01:07:25.477295+0000) 2024-09-21T01:07:33.711 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:33 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:33.362+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:07:33.711 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:33 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:33.362+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:07:33.711 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:33 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:33.362+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.865418+0000 front 2024-09-21T01:06:37.865671+0000 (oldest deadline 2024-09-21T01:07:02.565301+0000) 2024-09-21T01:07:33.711 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:33 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:33.362+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.366611+0000 front 2024-09-21T01:06:45.366825+0000 (oldest deadline 2024-09-21T01:07:08.266719+0000) 2024-09-21T01:07:33.711 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:33 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:33.362+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.068271+0000 front 2024-09-21T01:06:54.068382+0000 (oldest deadline 2024-09-21T01:07:18.768279+0000) 2024-09-21T01:07:33.711 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:33 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:33.362+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:01.669815+0000 front 2024-09-21T01:07:01.669712+0000 (oldest deadline 2024-09-21T01:07:25.169570+0000) 2024-09-21T01:07:34.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:33 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:33.749+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:34.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:33 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:33.749+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:34.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:33 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:33.749+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:34.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:33 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:33.749+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:52.729076+0000 front 2024-09-21T01:06:52.729168+0000 (oldest deadline 2024-09-21T01:07:15.628932+0000) 2024-09-21T01:07:34.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:33 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:33.749+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.929735+0000 front 2024-09-21T01:07:00.929834+0000 (oldest deadline 2024-09-21T01:07:23.829958+0000) 2024-09-21T01:07:34.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:33 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:33.749+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-21T01:07:07.831410+0000 front 2024-09-21T01:07:07.831300+0000 (oldest deadline 2024-09-21T01:07:31.331333+0000) 2024-09-21T01:07:34.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:34 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:34.061+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:34.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:34 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:34.061+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:34.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:34 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:34.061+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:34.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:34 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:34.061+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:44.673331+0000 front 2024-09-21T01:06:44.673455+0000 (oldest deadline 2024-09-21T01:07:07.573344+0000) 2024-09-21T01:07:34.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:34 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:34.061+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.475468+0000 front 2024-09-21T01:06:54.475447+0000 (oldest deadline 2024-09-21T01:07:16.175523+0000) 2024-09-21T01:07:34.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:34 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:34.061+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.177138+0000 front 2024-09-21T01:07:00.177172+0000 (oldest deadline 2024-09-21T01:07:25.477295+0000) 2024-09-21T01:07:34.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:34 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:34.375+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:20.962214+0000 front 2024-09-21T01:06:20.962185+0000 (oldest deadline 2024-09-21T01:06:43.262345+0000) 2024-09-21T01:07:34.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:34 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:34.375+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:26.763719+0000 front 2024-09-21T01:06:26.763702+0000 (oldest deadline 2024-09-21T01:06:52.063682+0000) 2024-09-21T01:07:34.711 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:34 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:34.375+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.865418+0000 front 2024-09-21T01:06:37.865671+0000 (oldest deadline 2024-09-21T01:07:02.565301+0000) 2024-09-21T01:07:34.711 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:34 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:34.375+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:45.366611+0000 front 2024-09-21T01:06:45.366825+0000 (oldest deadline 2024-09-21T01:07:08.266719+0000) 2024-09-21T01:07:34.711 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:34 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:34.375+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.068271+0000 front 2024-09-21T01:06:54.068382+0000 (oldest deadline 2024-09-21T01:07:18.768279+0000) 2024-09-21T01:07:34.711 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:34 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9[65680]: 2024-09-21T01:07:34.375+0000 7fb0d7478640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:01.669815+0000 front 2024-09-21T01:07:01.669712+0000 (oldest deadline 2024-09-21T01:07:25.169570+0000) 2024-09-21T01:07:35.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:34 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:34.775+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:35.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:34 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:34.775+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:35.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:34 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:34.775+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:35.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:34 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:34.775+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:52.729076+0000 front 2024-09-21T01:06:52.729168+0000 (oldest deadline 2024-09-21T01:07:15.628932+0000) 2024-09-21T01:07:35.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:34 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:34.775+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.929735+0000 front 2024-09-21T01:07:00.929834+0000 (oldest deadline 2024-09-21T01:07:23.829958+0000) 2024-09-21T01:07:35.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:34 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:34.775+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-21T01:07:07.831410+0000 front 2024-09-21T01:07:07.831300+0000 (oldest deadline 2024-09-21T01:07:31.331333+0000) 2024-09-21T01:07:35.361 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:35 smithi001 podman[104621]: 2024-09-21 01:07:35.091627796 +0000 UTC m=+5.562902912 container died 3a9546a27a638a18392fc40a24a7e9ea6365b4e4693ccc5ca3da48a66942f163 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T01:07:35.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:35 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:35.036+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:35.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:35 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:35.036+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:35.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:35 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:35.036+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:35.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:35 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:35.036+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:44.673331+0000 front 2024-09-21T01:06:44.673455+0000 (oldest deadline 2024-09-21T01:07:07.573344+0000) 2024-09-21T01:07:35.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:35 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:35.036+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.475468+0000 front 2024-09-21T01:06:54.475447+0000 (oldest deadline 2024-09-21T01:07:16.175523+0000) 2024-09-21T01:07:35.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:35 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:35.036+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.177138+0000 front 2024-09-21T01:07:00.177172+0000 (oldest deadline 2024-09-21T01:07:25.477295+0000) 2024-09-21T01:07:35.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:35 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:35.036+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-21T01:07:10.678743+0000 front 2024-09-21T01:07:10.678770+0000 (oldest deadline 2024-09-21T01:07:34.778813+0000) 2024-09-21T01:07:35.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:35 smithi001 podman[104621]: 2024-09-21 01:07:35.5183557 +0000 UTC m=+5.989630815 container cleanup 3a9546a27a638a18392fc40a24a7e9ea6365b4e4693ccc5ca3da48a66942f163 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T01:07:35.710 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:35 smithi001 bash[104621]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9 2024-09-21T01:07:36.191 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:35 smithi001 podman[104636]: 2024-09-21 01:07:35.76148171 +0000 UTC m=+0.661694048 container remove 3a9546a27a638a18392fc40a24a7e9ea6365b4e4693ccc5ca3da48a66942f163 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T01:07:36.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:35 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:35.735+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:36.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:35 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:35.735+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:36.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:35 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:35.735+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:36.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:35 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:35.735+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:52.729076+0000 front 2024-09-21T01:06:52.729168+0000 (oldest deadline 2024-09-21T01:07:15.628932+0000) 2024-09-21T01:07:36.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:35 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:35.735+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.929735+0000 front 2024-09-21T01:07:00.929834+0000 (oldest deadline 2024-09-21T01:07:23.829958+0000) 2024-09-21T01:07:36.230 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:35 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:35.735+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-21T01:07:07.831410+0000 front 2024-09-21T01:07:07.831300+0000 (oldest deadline 2024-09-21T01:07:31.331333+0000) 2024-09-21T01:07:36.444 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:36 smithi001 podman[104722]: 2024-09-21 01:07:36.092432644 +0000 UTC m=+0.016333256 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:07:36.459 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:36 smithi001 podman[104722]: 2024-09-21 01:07:36.220873222 +0000 UTC m=+0.144773861 container create e7b0b85fce36483390d896e2415476972d077538405e7110df23a8975d8af687 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:07:36.459 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:36 smithi001 podman[104722]: 2024-09-21 01:07:36.439975669 +0000 UTC m=+0.363876272 container init e7b0b85fce36483390d896e2415476972d077538405e7110df23a8975d8af687 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-21T01:07:36.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:36 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:36.027+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:36.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:36 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:36.027+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:36.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:36 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:36.027+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:36.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:36 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:36.027+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:44.673331+0000 front 2024-09-21T01:06:44.673455+0000 (oldest deadline 2024-09-21T01:07:07.573344+0000) 2024-09-21T01:07:36.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:36 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:36.027+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.475468+0000 front 2024-09-21T01:06:54.475447+0000 (oldest deadline 2024-09-21T01:07:16.175523+0000) 2024-09-21T01:07:36.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:36 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:36.027+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.177138+0000 front 2024-09-21T01:07:00.177172+0000 (oldest deadline 2024-09-21T01:07:25.477295+0000) 2024-09-21T01:07:36.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:36 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:36.027+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-21T01:07:10.678743+0000 front 2024-09-21T01:07:10.678770+0000 (oldest deadline 2024-09-21T01:07:34.778813+0000) 2024-09-21T01:07:36.711 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:36 smithi001 podman[104722]: 2024-09-21 01:07:36.4435994 +0000 UTC m=+0.367499998 container start e7b0b85fce36483390d896e2415476972d077538405e7110df23a8975d8af687 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:07:36.711 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:36 smithi001 podman[104722]: 2024-09-21 01:07:36.523214893 +0000 UTC m=+0.447115504 container attach e7b0b85fce36483390d896e2415476972d077538405e7110df23a8975d8af687 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T01:07:36.711 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 21 01:07:36 smithi001 podman[104722]: 2024-09-21 01:07:36.636837411 +0000 UTC m=+0.560738010 container died e7b0b85fce36483390d896e2415476972d077538405e7110df23a8975d8af687 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-9-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T01:07:36.979 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:36 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:36.691+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:36.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:36 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:36.691+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:36.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:36 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:36.691+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:36.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:36 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:36.691+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:52.729076+0000 front 2024-09-21T01:06:52.729168+0000 (oldest deadline 2024-09-21T01:07:15.628932+0000) 2024-09-21T01:07:36.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:36 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:36.691+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.929735+0000 front 2024-09-21T01:07:00.929834+0000 (oldest deadline 2024-09-21T01:07:23.829958+0000) 2024-09-21T01:07:36.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:36 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:36.691+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-21T01:07:07.831410+0000 front 2024-09-21T01:07:07.831300+0000 (oldest deadline 2024-09-21T01:07:31.331333+0000) 2024-09-21T01:07:37.392 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@osd.9.service' 2024-09-21T01:07:37.439 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:07:37.441 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-21T01:07:37.441 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-21T01:07:37.442 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-d3972c20-77b2-11ef-baf5-efdc52797490@osd.10 2024-09-21T01:07:37.472 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:37 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:37.052+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:37.482 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:37 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:37.052+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:37.483 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:37 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:37.052+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:37.483 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:37 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:37.052+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:44.673331+0000 front 2024-09-21T01:06:44.673455+0000 (oldest deadline 2024-09-21T01:07:07.573344+0000) 2024-09-21T01:07:37.483 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:37 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:37.052+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.475468+0000 front 2024-09-21T01:06:54.475447+0000 (oldest deadline 2024-09-21T01:07:16.175523+0000) 2024-09-21T01:07:37.483 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:37 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:37.052+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.177138+0000 front 2024-09-21T01:07:00.177172+0000 (oldest deadline 2024-09-21T01:07:25.477295+0000) 2024-09-21T01:07:37.483 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:37 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:37.052+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-21T01:07:10.678743+0000 front 2024-09-21T01:07:10.678770+0000 (oldest deadline 2024-09-21T01:07:34.778813+0000) 2024-09-21T01:07:37.742 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:37 smithi042 systemd[1]: Stopping Ceph osd.10 for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:07:37.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:37 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:37.710+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:37.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:37 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:37.710+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:37.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:37 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:37.710+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:37.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:37 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:37.710+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:52.729076+0000 front 2024-09-21T01:06:52.729168+0000 (oldest deadline 2024-09-21T01:07:15.628932+0000) 2024-09-21T01:07:37.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:37 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:37.710+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.929735+0000 front 2024-09-21T01:07:00.929834+0000 (oldest deadline 2024-09-21T01:07:23.829958+0000) 2024-09-21T01:07:37.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:37 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:37.710+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-21T01:07:07.831410+0000 front 2024-09-21T01:07:07.831300+0000 (oldest deadline 2024-09-21T01:07:31.331333+0000) 2024-09-21T01:07:38.087 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:37 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:37.740+0000 7f22183a7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:07:38.087 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:37 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:37.740+0000 7f22183a7640 -1 osd.10 78 *** Got signal Terminated *** 2024-09-21T01:07:38.087 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:37 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:37.740+0000 7f22183a7640 -1 osd.10 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:07:38.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:38 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:38.084+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:38.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:38 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:38.084+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:38.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:38 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:38.084+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:38.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:38 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:38.084+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:44.673331+0000 front 2024-09-21T01:06:44.673455+0000 (oldest deadline 2024-09-21T01:07:07.573344+0000) 2024-09-21T01:07:38.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:38 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:38.084+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.475468+0000 front 2024-09-21T01:06:54.475447+0000 (oldest deadline 2024-09-21T01:07:16.175523+0000) 2024-09-21T01:07:38.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:38 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:38.084+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.177138+0000 front 2024-09-21T01:07:00.177172+0000 (oldest deadline 2024-09-21T01:07:25.477295+0000) 2024-09-21T01:07:38.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:38 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:38.084+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-21T01:07:10.678743+0000 front 2024-09-21T01:07:10.678770+0000 (oldest deadline 2024-09-21T01:07:34.778813+0000) 2024-09-21T01:07:38.979 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:38 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:38.693+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:38.979 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:38 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:38.693+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:38.979 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:38 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:38.693+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:38.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:38 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:38.693+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:52.729076+0000 front 2024-09-21T01:06:52.729168+0000 (oldest deadline 2024-09-21T01:07:15.628932+0000) 2024-09-21T01:07:38.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:38 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:38.693+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.929735+0000 front 2024-09-21T01:07:00.929834+0000 (oldest deadline 2024-09-21T01:07:23.829958+0000) 2024-09-21T01:07:38.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:38 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:38.693+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-21T01:07:07.831410+0000 front 2024-09-21T01:07:07.831300+0000 (oldest deadline 2024-09-21T01:07:31.331333+0000) 2024-09-21T01:07:39.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:39 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:39.055+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:39.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:39 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:39.055+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:39.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:39 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:39.055+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:39.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:39 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:39.055+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:44.673331+0000 front 2024-09-21T01:06:44.673455+0000 (oldest deadline 2024-09-21T01:07:07.573344+0000) 2024-09-21T01:07:39.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:39 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:39.055+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.475468+0000 front 2024-09-21T01:06:54.475447+0000 (oldest deadline 2024-09-21T01:07:16.175523+0000) 2024-09-21T01:07:39.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:39 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:39.055+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.177138+0000 front 2024-09-21T01:07:00.177172+0000 (oldest deadline 2024-09-21T01:07:25.477295+0000) 2024-09-21T01:07:39.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:39 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:39.055+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-21T01:07:10.678743+0000 front 2024-09-21T01:07:10.678770+0000 (oldest deadline 2024-09-21T01:07:34.778813+0000) 2024-09-21T01:07:39.979 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:39 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:39.691+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:39.979 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:39 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:39.691+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:39.979 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:39 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:39.691+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:39.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:39 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:39.691+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:52.729076+0000 front 2024-09-21T01:06:52.729168+0000 (oldest deadline 2024-09-21T01:07:15.628932+0000) 2024-09-21T01:07:39.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:39 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:39.691+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.929735+0000 front 2024-09-21T01:07:00.929834+0000 (oldest deadline 2024-09-21T01:07:23.829958+0000) 2024-09-21T01:07:39.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:39 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:39.691+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-21T01:07:07.831410+0000 front 2024-09-21T01:07:07.831300+0000 (oldest deadline 2024-09-21T01:07:31.331333+0000) 2024-09-21T01:07:40.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:40 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:40.032+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:40.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:40 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:40.032+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:40.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:40 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:40.032+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:40.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:40 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:40.032+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:44.673331+0000 front 2024-09-21T01:06:44.673455+0000 (oldest deadline 2024-09-21T01:07:07.573344+0000) 2024-09-21T01:07:40.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:40 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:40.032+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.475468+0000 front 2024-09-21T01:06:54.475447+0000 (oldest deadline 2024-09-21T01:07:16.175523+0000) 2024-09-21T01:07:40.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:40 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:40.032+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.177138+0000 front 2024-09-21T01:07:00.177172+0000 (oldest deadline 2024-09-21T01:07:25.477295+0000) 2024-09-21T01:07:40.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:40 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:40.032+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-21T01:07:10.678743+0000 front 2024-09-21T01:07:10.678770+0000 (oldest deadline 2024-09-21T01:07:34.778813+0000) 2024-09-21T01:07:40.979 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:40 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:40.677+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:40.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:40 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:40.677+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:40.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:40 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:40.677+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:40.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:40 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:40.677+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:52.729076+0000 front 2024-09-21T01:06:52.729168+0000 (oldest deadline 2024-09-21T01:07:15.628932+0000) 2024-09-21T01:07:40.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:40 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:40.677+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.929735+0000 front 2024-09-21T01:07:00.929834+0000 (oldest deadline 2024-09-21T01:07:23.829958+0000) 2024-09-21T01:07:40.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:40 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:40.677+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-21T01:07:07.831410+0000 front 2024-09-21T01:07:07.831300+0000 (oldest deadline 2024-09-21T01:07:31.331333+0000) 2024-09-21T01:07:41.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:41 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:41.045+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:41.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:41 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:41.045+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:41.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:41 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:41.045+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:41.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:41 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:41.045+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:44.673331+0000 front 2024-09-21T01:06:44.673455+0000 (oldest deadline 2024-09-21T01:07:07.573344+0000) 2024-09-21T01:07:41.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:41 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:41.045+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.475468+0000 front 2024-09-21T01:06:54.475447+0000 (oldest deadline 2024-09-21T01:07:16.175523+0000) 2024-09-21T01:07:41.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:41 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:41.045+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.177138+0000 front 2024-09-21T01:07:00.177172+0000 (oldest deadline 2024-09-21T01:07:25.477295+0000) 2024-09-21T01:07:41.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:41 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:41.045+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-21T01:07:10.678743+0000 front 2024-09-21T01:07:10.678770+0000 (oldest deadline 2024-09-21T01:07:34.778813+0000) 2024-09-21T01:07:41.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:41 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:41.644+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:41.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:41 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:41.644+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:41.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:41 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:41.644+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:41.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:41 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:41.644+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:52.729076+0000 front 2024-09-21T01:06:52.729168+0000 (oldest deadline 2024-09-21T01:07:15.628932+0000) 2024-09-21T01:07:41.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:41 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:41.644+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.929735+0000 front 2024-09-21T01:07:00.929834+0000 (oldest deadline 2024-09-21T01:07:23.829958+0000) 2024-09-21T01:07:41.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:41 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:41.644+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-21T01:07:07.831410+0000 front 2024-09-21T01:07:07.831300+0000 (oldest deadline 2024-09-21T01:07:31.331333+0000) 2024-09-21T01:07:41.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:41 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:41.644+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6820 osd.7 since back 2024-09-21T01:07:18.034894+0000 front 2024-09-21T01:07:18.034826+0000 (oldest deadline 2024-09-21T01:07:41.534746+0000) 2024-09-21T01:07:42.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:42 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:42.051+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.968552+0000 front 2024-09-21T01:06:21.968565+0000 (oldest deadline 2024-09-21T01:06:46.668611+0000) 2024-09-21T01:07:42.492 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:42 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:42.051+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:30.169906+0000 front 2024-09-21T01:06:30.169933+0000 (oldest deadline 2024-09-21T01:06:53.070041+0000) 2024-09-21T01:07:42.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:42 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:42.051+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:37.071942+0000 front 2024-09-21T01:06:37.072062+0000 (oldest deadline 2024-09-21T01:07:00.572034+0000) 2024-09-21T01:07:42.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:42 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:42.051+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-21T01:06:44.673331+0000 front 2024-09-21T01:06:44.673455+0000 (oldest deadline 2024-09-21T01:07:07.573344+0000) 2024-09-21T01:07:42.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:42 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:42.051+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:54.475468+0000 front 2024-09-21T01:06:54.475447+0000 (oldest deadline 2024-09-21T01:07:16.175523+0000) 2024-09-21T01:07:42.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:42 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:42.051+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.177138+0000 front 2024-09-21T01:07:00.177172+0000 (oldest deadline 2024-09-21T01:07:25.477295+0000) 2024-09-21T01:07:42.493 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:42 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10[58152]: 2024-09-21T01:07:42.051+0000 7f2214992640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-21T01:07:10.678743+0000 front 2024-09-21T01:07:10.678770+0000 (oldest deadline 2024-09-21T01:07:34.778813+0000) 2024-09-21T01:07:42.979 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:42 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:42.631+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:42.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:42 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:42.631+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:42.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:42 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:42.631+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:42.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:42 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:42.631+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:52.729076+0000 front 2024-09-21T01:06:52.729168+0000 (oldest deadline 2024-09-21T01:07:15.628932+0000) 2024-09-21T01:07:42.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:42 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:42.631+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.929735+0000 front 2024-09-21T01:07:00.929834+0000 (oldest deadline 2024-09-21T01:07:23.829958+0000) 2024-09-21T01:07:42.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:42 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:42.631+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-21T01:07:07.831410+0000 front 2024-09-21T01:07:07.831300+0000 (oldest deadline 2024-09-21T01:07:31.331333+0000) 2024-09-21T01:07:42.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:42 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:42.631+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6820 osd.7 since back 2024-09-21T01:07:18.034894+0000 front 2024-09-21T01:07:18.034826+0000 (oldest deadline 2024-09-21T01:07:41.534746+0000) 2024-09-21T01:07:43.409 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:43 smithi042 podman[67540]: 2024-09-21 01:07:43.133294192 +0000 UTC m=+5.493235872 container died 0a4d906df39cf482a58d8b929b97b9b46e766160865da798aa1f53b6d843498a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:07:43.742 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:43 smithi042 podman[67540]: 2024-09-21 01:07:43.491697011 +0000 UTC m=+5.851638698 container cleanup 0a4d906df39cf482a58d8b929b97b9b46e766160865da798aa1f53b6d843498a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T01:07:43.742 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:43 smithi042 bash[67540]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10 2024-09-21T01:07:43.979 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:43 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:43.610+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:43.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:43 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:43.610+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:43.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:43 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:43.610+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:43.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:43 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:43.610+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:52.729076+0000 front 2024-09-21T01:06:52.729168+0000 (oldest deadline 2024-09-21T01:07:15.628932+0000) 2024-09-21T01:07:43.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:43 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:43.610+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.929735+0000 front 2024-09-21T01:07:00.929834+0000 (oldest deadline 2024-09-21T01:07:23.829958+0000) 2024-09-21T01:07:43.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:43 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:43.610+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-21T01:07:07.831410+0000 front 2024-09-21T01:07:07.831300+0000 (oldest deadline 2024-09-21T01:07:31.331333+0000) 2024-09-21T01:07:43.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:43 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:43.610+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6820 osd.7 since back 2024-09-21T01:07:18.034894+0000 front 2024-09-21T01:07:18.034826+0000 (oldest deadline 2024-09-21T01:07:41.534746+0000) 2024-09-21T01:07:44.110 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:43 smithi042 podman[67555]: 2024-09-21 01:07:43.776507842 +0000 UTC m=+0.640889604 container remove 0a4d906df39cf482a58d8b929b97b9b46e766160865da798aa1f53b6d843498a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:07:44.413 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:44 smithi042 podman[67645]: 2024-09-21 01:07:44.110608919 +0000 UTC m=+0.106763599 container create 503c877a9e199c920aec274d890f91e23235e461f3bd7dab2f5ed13700908af6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-21T01:07:44.413 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:44 smithi042 podman[67645]: 2024-09-21 01:07:44.019965574 +0000 UTC m=+0.016120259 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:07:44.413 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:44 smithi042 podman[67645]: 2024-09-21 01:07:44.329723099 +0000 UTC m=+0.325877777 container init 503c877a9e199c920aec274d890f91e23235e461f3bd7dab2f5ed13700908af6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-21T01:07:44.414 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:44 smithi042 podman[67645]: 2024-09-21 01:07:44.33301501 +0000 UTC m=+0.329169697 container start 503c877a9e199c920aec274d890f91e23235e461f3bd7dab2f5ed13700908af6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-21T01:07:44.414 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:44 smithi042 podman[67645]: 2024-09-21 01:07:44.413056973 +0000 UTC m=+0.409211651 container attach 503c877a9e199c920aec274d890f91e23235e461f3bd7dab2f5ed13700908af6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-21T01:07:44.742 INFO:journalctl@ceph.osd.10.smithi042.stdout:Sep 21 01:07:44 smithi042 podman[67645]: 2024-09-21 01:07:44.532528894 +0000 UTC m=+0.528683580 container died 503c877a9e199c920aec274d890f91e23235e461f3bd7dab2f5ed13700908af6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T01:07:44.979 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:44 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:44.584+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:44.979 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:44 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:44.584+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:44.979 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:44 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:44.584+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:44.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:44 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:44.584+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:52.729076+0000 front 2024-09-21T01:06:52.729168+0000 (oldest deadline 2024-09-21T01:07:15.628932+0000) 2024-09-21T01:07:44.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:44 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:44.584+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.929735+0000 front 2024-09-21T01:07:00.929834+0000 (oldest deadline 2024-09-21T01:07:23.829958+0000) 2024-09-21T01:07:44.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:44 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:44.584+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-21T01:07:07.831410+0000 front 2024-09-21T01:07:07.831300+0000 (oldest deadline 2024-09-21T01:07:31.331333+0000) 2024-09-21T01:07:44.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:44 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:44.584+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6820 osd.7 since back 2024-09-21T01:07:18.034894+0000 front 2024-09-21T01:07:18.034826+0000 (oldest deadline 2024-09-21T01:07:41.534746+0000) 2024-09-21T01:07:45.124 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@osd.10.service' 2024-09-21T01:07:45.205 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:07:45.205 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-21T01:07:45.206 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-21T01:07:45.206 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ceph-d3972c20-77b2-11ef-baf5-efdc52797490@osd.11 2024-09-21T01:07:45.513 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:45 smithi193 systemd[1]: Stopping Ceph osd.11 for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:07:45.979 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:45 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:45.512+0000 7f69273a4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:07:45.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:45 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:45.512+0000 7f69273a4640 -1 osd.11 78 *** Got signal Terminated *** 2024-09-21T01:07:45.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:45 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:45.512+0000 7f69273a4640 -1 osd.11 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:07:45.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:45 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:45.543+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:45.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:45 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:45.543+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:45.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:45 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:45.543+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:45.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:45 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:45.543+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:52.729076+0000 front 2024-09-21T01:06:52.729168+0000 (oldest deadline 2024-09-21T01:07:15.628932+0000) 2024-09-21T01:07:45.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:45 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:45.543+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.929735+0000 front 2024-09-21T01:07:00.929834+0000 (oldest deadline 2024-09-21T01:07:23.829958+0000) 2024-09-21T01:07:45.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:45 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:45.543+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-21T01:07:07.831410+0000 front 2024-09-21T01:07:07.831300+0000 (oldest deadline 2024-09-21T01:07:31.331333+0000) 2024-09-21T01:07:45.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:45 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:45.543+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6820 osd.7 since back 2024-09-21T01:07:18.034894+0000 front 2024-09-21T01:07:18.034826+0000 (oldest deadline 2024-09-21T01:07:41.534746+0000) 2024-09-21T01:07:46.882 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:46 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:46.518+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:46.882 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:46 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:46.518+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:46.882 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:46 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:46.518+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:46.882 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:46 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:46.518+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:52.729076+0000 front 2024-09-21T01:06:52.729168+0000 (oldest deadline 2024-09-21T01:07:15.628932+0000) 2024-09-21T01:07:46.882 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:46 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:46.518+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.929735+0000 front 2024-09-21T01:07:00.929834+0000 (oldest deadline 2024-09-21T01:07:23.829958+0000) 2024-09-21T01:07:46.882 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:46 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:46.518+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-21T01:07:07.831410+0000 front 2024-09-21T01:07:07.831300+0000 (oldest deadline 2024-09-21T01:07:31.331333+0000) 2024-09-21T01:07:46.882 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:46 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:46.518+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6820 osd.7 since back 2024-09-21T01:07:18.034894+0000 front 2024-09-21T01:07:18.034826+0000 (oldest deadline 2024-09-21T01:07:41.534746+0000) 2024-09-21T01:07:47.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:47 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:47.492+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:47.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:47 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:47.492+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:47.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:47 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:47.492+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:47.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:47 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:47.492+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:52.729076+0000 front 2024-09-21T01:06:52.729168+0000 (oldest deadline 2024-09-21T01:07:15.628932+0000) 2024-09-21T01:07:47.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:47 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:47.492+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.929735+0000 front 2024-09-21T01:07:00.929834+0000 (oldest deadline 2024-09-21T01:07:23.829958+0000) 2024-09-21T01:07:47.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:47 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:47.492+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-21T01:07:07.831410+0000 front 2024-09-21T01:07:07.831300+0000 (oldest deadline 2024-09-21T01:07:31.331333+0000) 2024-09-21T01:07:47.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:47 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:47.492+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6820 osd.7 since back 2024-09-21T01:07:18.034894+0000 front 2024-09-21T01:07:18.034826+0000 (oldest deadline 2024-09-21T01:07:41.534746+0000) 2024-09-21T01:07:48.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:48 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:48.505+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:48.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:48 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:48.505+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:48.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:48 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:48.505+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:48.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:48 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:48.505+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:52.729076+0000 front 2024-09-21T01:06:52.729168+0000 (oldest deadline 2024-09-21T01:07:15.628932+0000) 2024-09-21T01:07:48.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:48 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:48.505+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.929735+0000 front 2024-09-21T01:07:00.929834+0000 (oldest deadline 2024-09-21T01:07:23.829958+0000) 2024-09-21T01:07:48.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:48 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:48.505+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-21T01:07:07.831410+0000 front 2024-09-21T01:07:07.831300+0000 (oldest deadline 2024-09-21T01:07:31.331333+0000) 2024-09-21T01:07:48.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:48 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:48.505+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6820 osd.7 since back 2024-09-21T01:07:18.034894+0000 front 2024-09-21T01:07:18.034826+0000 (oldest deadline 2024-09-21T01:07:41.534746+0000) 2024-09-21T01:07:49.979 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:49 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:49.521+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-21T01:06:21.224430+0000 front 2024-09-21T01:06:21.224516+0000 (oldest deadline 2024-09-21T01:06:47.625059+0000) 2024-09-21T01:07:49.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:49 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:49.521+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6804 osd.1 since back 2024-09-21T01:06:27.625710+0000 front 2024-09-21T01:06:27.625768+0000 (oldest deadline 2024-09-21T01:06:53.525490+0000) 2024-09-21T01:07:49.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:49 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:49.521+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-21T01:06:35.826427+0000 front 2024-09-21T01:06:35.826318+0000 (oldest deadline 2024-09-21T01:07:01.126468+0000) 2024-09-21T01:07:49.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:49 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:49.521+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6812 osd.4 since back 2024-09-21T01:06:52.729076+0000 front 2024-09-21T01:06:52.729168+0000 (oldest deadline 2024-09-21T01:07:15.628932+0000) 2024-09-21T01:07:49.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:49 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:49.521+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-21T01:07:00.929735+0000 front 2024-09-21T01:07:00.929834+0000 (oldest deadline 2024-09-21T01:07:23.829958+0000) 2024-09-21T01:07:49.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:49 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:49.521+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-21T01:07:07.831410+0000 front 2024-09-21T01:07:07.831300+0000 (oldest deadline 2024-09-21T01:07:31.331333+0000) 2024-09-21T01:07:49.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:49 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:49.521+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.42:6820 osd.7 since back 2024-09-21T01:07:18.034894+0000 front 2024-09-21T01:07:18.034826+0000 (oldest deadline 2024-09-21T01:07:41.534746+0000) 2024-09-21T01:07:49.980 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:49 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11[58316]: 2024-09-21T01:07:49.521+0000 7f692398f640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.193:6820 osd.8 since back 2024-09-21T01:07:23.235528+0000 front 2024-09-21T01:07:23.235502+0000 (oldest deadline 2024-09-21T01:07:48.535540+0000) 2024-09-21T01:07:51.137 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:50 smithi193 podman[67659]: 2024-09-21 01:07:50.836561592 +0000 UTC m=+5.430890036 container died ffbab4785aedd25a56b282f41a56479401fdef4c23136a4863228d8b7368ab7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:07:51.137 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:51 smithi193 podman[67659]: 2024-09-21 01:07:51.13701788 +0000 UTC m=+5.731346324 container cleanup ffbab4785aedd25a56b282f41a56479401fdef4c23136a4863228d8b7368ab7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-21T01:07:51.479 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:51 smithi193 bash[67659]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11 2024-09-21T01:07:51.479 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:51 smithi193 podman[67688]: 2024-09-21 01:07:51.363297318 +0000 UTC m=+0.528583206 container remove ffbab4785aedd25a56b282f41a56479401fdef4c23136a4863228d8b7368ab7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True) 2024-09-21T01:07:51.925 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:51 smithi193 podman[67775]: 2024-09-21 01:07:51.672481146 +0000 UTC m=+0.107820233 container create 8f4c6942b4dbae793ff1f6468cc61b0bb61414910130c1b82a0ee47d87c4e538 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T01:07:51.925 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:51 smithi193 podman[67775]: 2024-09-21 01:07:51.580657877 +0000 UTC m=+0.015996973 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:07:51.925 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:51 smithi193 podman[67775]: 2024-09-21 01:07:51.841396805 +0000 UTC m=+0.276735892 container init 8f4c6942b4dbae793ff1f6468cc61b0bb61414910130c1b82a0ee47d87c4e538 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T01:07:51.925 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:51 smithi193 podman[67775]: 2024-09-21 01:07:51.844776693 +0000 UTC m=+0.280115781 container start 8f4c6942b4dbae793ff1f6468cc61b0bb61414910130c1b82a0ee47d87c4e538 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T01:07:51.925 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:51 smithi193 podman[67775]: 2024-09-21 01:07:51.924677257 +0000 UTC m=+0.360016370 container attach 8f4c6942b4dbae793ff1f6468cc61b0bb61414910130c1b82a0ee47d87c4e538 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:07:52.229 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 21 01:07:52 smithi193 podman[67775]: 2024-09-21 01:07:52.027728427 +0000 UTC m=+0.463067522 container died 8f4c6942b4dbae793ff1f6468cc61b0bb61414910130c1b82a0ee47d87c4e538 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T01:07:52.597 DEBUG:teuthology.orchestra.run.smithi193:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@osd.11.service' 2024-09-21T01:07:52.634 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:07:52.634 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-21T01:07:52.634 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-21T01:07:52.634 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.a 2024-09-21T01:07:52.938 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 21 01:07:52 smithi001 systemd[1]: Stopping Ceph mds.a for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:07:53.210 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 21 01:07:52 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-a[72394]: 2024-09-21T01:07:52.937+0000 7fb9e453e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:07:53.210 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 21 01:07:52 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-a[72394]: 2024-09-21T01:07:52.937+0000 7fb9e453e640 -1 mds.a *** got signal Terminated *** 2024-09-21T01:07:57.210 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 21 01:07:56 smithi001 podman[104824]: 2024-09-21 01:07:56.948576664 +0000 UTC m=+4.110048432 container died a4ca57f3ea3f3ffcf073d346669d0172cc6a0703d2def87427d654e67b75174c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-a, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-21T01:07:57.597 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 21 01:07:57 smithi001 podman[104824]: 2024-09-21 01:07:57.395437854 +0000 UTC m=+4.556909613 container cleanup a4ca57f3ea3f3ffcf073d346669d0172cc6a0703d2def87427d654e67b75174c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-a, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True) 2024-09-21T01:07:57.597 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 21 01:07:57 smithi001 bash[104824]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-a 2024-09-21T01:07:57.837 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.a.service' 2024-09-21T01:07:57.860 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 21 01:07:57 smithi001 podman[104849]: 2024-09-21 01:07:57.596850108 +0000 UTC m=+0.641919616 container remove a4ca57f3ea3f3ffcf073d346669d0172cc6a0703d2def87427d654e67b75174c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-a, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True) 2024-09-21T01:07:57.861 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 21 01:07:57 smithi001 systemd[1]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.a.service: Deactivated successfully. 2024-09-21T01:07:57.861 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 21 01:07:57 smithi001 systemd[1]: Stopped Ceph mds.a for d3972c20-77b2-11ef-baf5-efdc52797490. 2024-09-21T01:07:57.861 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 21 01:07:57 smithi001 systemd[1]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.a.service: Consumed 2.646s CPU time. 2024-09-21T01:07:57.875 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:07:57.875 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-21T01:07:57.875 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-21T01:07:57.875 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.d 2024-09-21T01:07:58.200 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 21 01:07:57 smithi001 systemd[1]: Stopping Ceph mds.d for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:07:58.460 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 21 01:07:58 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-d[71353]: 2024-09-21T01:07:58.199+0000 7f201a13f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:07:58.460 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 21 01:07:58 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-d[71353]: 2024-09-21T01:07:58.199+0000 7f201a13f640 -1 mds.d *** got signal Terminated *** 2024-09-21T01:08:02.616 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 21 01:08:02 smithi001 podman[104956]: 2024-09-21 01:08:02.213876769 +0000 UTC m=+4.110291506 container died 5e6e99b06976bc68dbffacc0e205c0189148a6dc9788eb12408f915a0a4a7f7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-d, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-21T01:08:02.616 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 21 01:08:02 smithi001 podman[104956]: 2024-09-21 01:08:02.616073124 +0000 UTC m=+4.512487899 container cleanup 5e6e99b06976bc68dbffacc0e205c0189148a6dc9788eb12408f915a0a4a7f7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-d, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True) 2024-09-21T01:08:02.960 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 21 01:08:02 smithi001 bash[104956]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-d 2024-09-21T01:08:02.960 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 21 01:08:02 smithi001 podman[104968]: 2024-09-21 01:08:02.851094669 +0000 UTC m=+0.639246263 container remove 5e6e99b06976bc68dbffacc0e205c0189148a6dc9788eb12408f915a0a4a7f7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-d, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2) 2024-09-21T01:08:03.005 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.d.service' 2024-09-21T01:08:03.039 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:08:03.039 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-21T01:08:03.039 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-21T01:08:03.039 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.g 2024-09-21T01:08:03.362 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 21 01:08:03 smithi001 systemd[1]: Stopping Ceph mds.g for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:08:03.704 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 21 01:08:03 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-g[72084]: 2024-09-21T01:08:03.360+0000 7f6c9c64e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:08:03.705 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 21 01:08:03 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-g[72084]: 2024-09-21T01:08:03.361+0000 7f6c9c64e640 -1 mds.g *** got signal Terminated *** 2024-09-21T01:08:05.804 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 21 01:08:05 smithi001 podman[105075]: 2024-09-21 01:08:05.52589324 +0000 UTC m=+2.267798540 container died 2cb12d8a8843224068381f43acbb7646ba4eb679d71335315cd7102ace712953 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-g, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True) 2024-09-21T01:08:06.210 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 21 01:08:05 smithi001 podman[105075]: 2024-09-21 01:08:05.96230191 +0000 UTC m=+2.704207183 container cleanup 2cb12d8a8843224068381f43acbb7646ba4eb679d71335315cd7102ace712953 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-g, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-21T01:08:06.210 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 21 01:08:05 smithi001 bash[105075]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-g 2024-09-21T01:08:06.558 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.g.service' 2024-09-21T01:08:06.591 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:08:06.591 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-21T01:08:06.592 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-21T01:08:06.592 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.j 2024-09-21T01:08:06.960 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 21 01:08:06 smithi001 systemd[1]: Stopping Ceph mds.j for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:08:06.960 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 21 01:08:06 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-j[70976]: 2024-09-21T01:08:06.898+0000 7f8d6173c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:08:06.960 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 21 01:08:06 smithi001 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-j[70976]: 2024-09-21T01:08:06.898+0000 7f8d6173c640 -1 mds.j *** got signal Terminated *** 2024-09-21T01:08:11.210 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 21 01:08:10 smithi001 podman[105196]: 2024-09-21 01:08:10.912032539 +0000 UTC m=+4.104200600 container died c37e4c83fc0f13511bd115d0e9dedfb86d4e57d62f77c39d50bdf393e831cf13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-j, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-21T01:08:11.651 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 21 01:08:11 smithi001 podman[105196]: 2024-09-21 01:08:11.42452337 +0000 UTC m=+4.616691430 container cleanup c37e4c83fc0f13511bd115d0e9dedfb86d4e57d62f77c39d50bdf393e831cf13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-j, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T01:08:11.651 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 21 01:08:11 smithi001 bash[105196]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-j 2024-09-21T01:08:11.901 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 21 01:08:11 smithi001 podman[105209]: 2024-09-21 01:08:11.65107273 +0000 UTC m=+0.737880715 container remove c37e4c83fc0f13511bd115d0e9dedfb86d4e57d62f77c39d50bdf393e831cf13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-j, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:08:11.901 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 21 01:08:11 smithi001 systemd[1]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.j.service: Deactivated successfully. 2024-09-21T01:08:11.901 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 21 01:08:11 smithi001 systemd[1]: Stopped Ceph mds.j for d3972c20-77b2-11ef-baf5-efdc52797490. 2024-09-21T01:08:11.903 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.j.service' 2024-09-21T01:08:11.937 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:08:11.937 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-21T01:08:11.937 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-21T01:08:11.937 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.b 2024-09-21T01:08:12.242 INFO:journalctl@ceph.mds.b.smithi042.stdout:Sep 21 01:08:11 smithi042 systemd[1]: Stopping Ceph mds.b for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:08:12.509 INFO:journalctl@ceph.mds.b.smithi042.stdout:Sep 21 01:08:12 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-b[63452]: 2024-09-21T01:08:12.250+0000 7f42dda44640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:08:12.509 INFO:journalctl@ceph.mds.b.smithi042.stdout:Sep 21 01:08:12 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-b[63452]: 2024-09-21T01:08:12.250+0000 7f42dda44640 -1 mds.b *** got signal Terminated *** 2024-09-21T01:08:13.851 INFO:journalctl@ceph.mds.b.smithi042.stdout:Sep 21 01:08:13 smithi042 podman[67749]: 2024-09-21 01:08:13.592598136 +0000 UTC m=+1.447523280 container died 5092db6112c6e6abe2705acf0716689f6254206a9a8eba01d5cbeeac9c2df8b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-b, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:08:14.235 INFO:journalctl@ceph.mds.b.smithi042.stdout:Sep 21 01:08:13 smithi042 podman[67749]: 2024-09-21 01:08:13.950930594 +0000 UTC m=+1.805855729 container cleanup 5092db6112c6e6abe2705acf0716689f6254206a9a8eba01d5cbeeac9c2df8b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:08:14.235 INFO:journalctl@ceph.mds.b.smithi042.stdout:Sep 21 01:08:13 smithi042 bash[67749]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-b 2024-09-21T01:08:14.385 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.b.service' 2024-09-21T01:08:14.421 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:08:14.421 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-21T01:08:14.421 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-21T01:08:14.422 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.e 2024-09-21T01:08:14.992 INFO:journalctl@ceph.mds.e.smithi042.stdout:Sep 21 01:08:14 smithi042 systemd[1]: Stopping Ceph mds.e for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:08:14.993 INFO:journalctl@ceph.mds.e.smithi042.stdout:Sep 21 01:08:14 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-e[62903]: 2024-09-21T01:08:14.754+0000 7f5000eaf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:08:14.993 INFO:journalctl@ceph.mds.e.smithi042.stdout:Sep 21 01:08:14 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-e[62903]: 2024-09-21T01:08:14.754+0000 7f5000eaf640 -1 mds.e *** got signal Terminated *** 2024-09-21T01:08:17.889 INFO:journalctl@ceph.mds.e.smithi042.stdout:Sep 21 01:08:17 smithi042 podman[67880]: 2024-09-21 01:08:17.584684878 +0000 UTC m=+2.935121615 container died 6281cb41bb65dce26e68a6f9ae69d0484f4c0a2f7f2881609a4d58e517429db9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-e, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T01:08:18.214 INFO:journalctl@ceph.mds.e.smithi042.stdout:Sep 21 01:08:17 smithi042 podman[67880]: 2024-09-21 01:08:17.971530063 +0000 UTC m=+3.321966788 container cleanup 6281cb41bb65dce26e68a6f9ae69d0484f4c0a2f7f2881609a4d58e517429db9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-e, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T01:08:18.214 INFO:journalctl@ceph.mds.e.smithi042.stdout:Sep 21 01:08:17 smithi042 bash[67880]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-e 2024-09-21T01:08:18.355 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.e.service' 2024-09-21T01:08:18.388 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:08:18.389 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-21T01:08:18.389 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-21T01:08:18.389 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.h 2024-09-21T01:08:18.742 INFO:journalctl@ceph.mds.h.smithi042.stdout:Sep 21 01:08:18 smithi042 systemd[1]: Stopping Ceph mds.h for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:08:18.743 INFO:journalctl@ceph.mds.h.smithi042.stdout:Sep 21 01:08:18 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-h[63170]: 2024-09-21T01:08:18.716+0000 7efefe9b5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:08:18.743 INFO:journalctl@ceph.mds.h.smithi042.stdout:Sep 21 01:08:18 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-h[63170]: 2024-09-21T01:08:18.716+0000 7efefe9b5640 -1 mds.h *** got signal Terminated *** 2024-09-21T01:08:21.884 INFO:journalctl@ceph.mds.h.smithi042.stdout:Sep 21 01:08:21 smithi042 podman[68002]: 2024-09-21 01:08:21.598435932 +0000 UTC m=+2.988427228 container died 4ec141cac7f5507dadb4fcd55686fa1931abadf3ec0de54e142a74c0f2844c69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T01:08:22.218 INFO:journalctl@ceph.mds.h.smithi042.stdout:Sep 21 01:08:21 smithi042 podman[68002]: 2024-09-21 01:08:21.99234394 +0000 UTC m=+3.382335222 container cleanup 4ec141cac7f5507dadb4fcd55686fa1931abadf3ec0de54e142a74c0f2844c69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-h, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-21T01:08:22.218 INFO:journalctl@ceph.mds.h.smithi042.stdout:Sep 21 01:08:21 smithi042 bash[68002]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-h 2024-09-21T01:08:22.379 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.h.service' 2024-09-21T01:08:22.411 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:08:22.411 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-21T01:08:22.411 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-21T01:08:22.411 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.k 2024-09-21T01:08:22.730 INFO:journalctl@ceph.mds.k.smithi042.stdout:Sep 21 01:08:22 smithi042 systemd[1]: Stopping Ceph mds.k for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:08:22.985 INFO:journalctl@ceph.mds.k.smithi042.stdout:Sep 21 01:08:22 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-k[62615]: 2024-09-21T01:08:22.729+0000 7fc9d6d05640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:08:22.985 INFO:journalctl@ceph.mds.k.smithi042.stdout:Sep 21 01:08:22 smithi042 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-k[62615]: 2024-09-21T01:08:22.729+0000 7fc9d6d05640 -1 mds.k *** got signal Terminated *** 2024-09-21T01:08:25.897 INFO:journalctl@ceph.mds.k.smithi042.stdout:Sep 21 01:08:25 smithi042 podman[68121]: 2024-09-21 01:08:25.616850893 +0000 UTC m=+2.991086645 container died 6434f40b0814a7bb4737c3f96121125ab0b6e84e54da6d4373246a67f69f246f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-k, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:08:26.242 INFO:journalctl@ceph.mds.k.smithi042.stdout:Sep 21 01:08:25 smithi042 podman[68121]: 2024-09-21 01:08:25.971202966 +0000 UTC m=+3.345438707 container cleanup 6434f40b0814a7bb4737c3f96121125ab0b6e84e54da6d4373246a67f69f246f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-k, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T01:08:26.242 INFO:journalctl@ceph.mds.k.smithi042.stdout:Sep 21 01:08:25 smithi042 bash[68121]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-k 2024-09-21T01:08:26.415 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.k.service' 2024-09-21T01:08:26.447 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:08:26.447 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-21T01:08:26.447 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-21T01:08:26.447 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.c 2024-09-21T01:08:26.727 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 21 01:08:26 smithi193 systemd[1]: Stopping Ceph mds.c for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:08:26.979 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 21 01:08:26 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-c[63259]: 2024-09-21T01:08:26.726+0000 7f4efae53640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:08:26.979 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 21 01:08:26 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-c[63259]: 2024-09-21T01:08:26.726+0000 7f4efae53640 -1 mds.c *** got signal Terminated *** 2024-09-21T01:08:29.785 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 21 01:08:29 smithi193 podman[67877]: 2024-09-21 01:08:29.533821715 +0000 UTC m=+2.895199500 container died 49e476775e4b106f07091c097ad19ce307d45d839d1a094f7c2c1805c27c07ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-c, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:08:30.228 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 21 01:08:29 smithi193 podman[67877]: 2024-09-21 01:08:29.885160026 +0000 UTC m=+3.246537815 container cleanup 49e476775e4b106f07091c097ad19ce307d45d839d1a094f7c2c1805c27c07ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-c, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:08:30.228 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 21 01:08:29 smithi193 bash[67877]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-c 2024-09-21T01:08:30.370 DEBUG:teuthology.orchestra.run.smithi193:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.c.service' 2024-09-21T01:08:30.406 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:08:30.406 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-21T01:08:30.406 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-21T01:08:30.407 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.f 2024-09-21T01:08:30.979 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 21 01:08:30 smithi193 systemd[1]: Stopping Ceph mds.f for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:08:30.980 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 21 01:08:30 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-f[62990]: 2024-09-21T01:08:30.730+0000 7f6cafbf7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:08:30.980 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 21 01:08:30 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-f[62990]: 2024-09-21T01:08:30.730+0000 7f6cafbf7640 -1 mds.f *** got signal Terminated *** 2024-09-21T01:08:33.881 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 21 01:08:33 smithi193 podman[68011]: 2024-09-21 01:08:33.536981534 +0000 UTC m=+2.916763272 container died b5d5aaba5429aba0227c1cc97a7cdb1aae154f36a70266e9288b7a4ae651b92f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-f, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:08:34.140 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 21 01:08:33 smithi193 podman[68011]: 2024-09-21 01:08:33.963748814 +0000 UTC m=+3.343530555 container cleanup b5d5aaba5429aba0227c1cc97a7cdb1aae154f36a70266e9288b7a4ae651b92f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-f, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-21T01:08:34.140 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 21 01:08:33 smithi193 bash[68011]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-f 2024-09-21T01:08:34.390 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 21 01:08:34 smithi193 podman[68025]: 2024-09-21 01:08:34.139969813 +0000 UTC m=+0.603142106 container remove b5d5aaba5429aba0227c1cc97a7cdb1aae154f36a70266e9288b7a4ae651b92f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T01:08:34.392 DEBUG:teuthology.orchestra.run.smithi193:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.f.service' 2024-09-21T01:08:34.425 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:08:34.425 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-21T01:08:34.425 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-21T01:08:34.425 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.i 2024-09-21T01:08:34.729 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 21 01:08:34 smithi193 systemd[1]: Stopping Ceph mds.i for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:08:35.229 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 21 01:08:34 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-i[63525]: 2024-09-21T01:08:34.867+0000 7f916b964640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:08:35.229 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 21 01:08:34 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-i[63525]: 2024-09-21T01:08:34.867+0000 7f916b964640 -1 mds.i *** got signal Terminated *** 2024-09-21T01:08:37.834 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 21 01:08:37 smithi193 podman[68132]: 2024-09-21 01:08:37.540799566 +0000 UTC m=+2.895095335 container died c9451e7e9718fc360b923464a7f023885eddc397f23546952791400fc4527abb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-i, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T01:08:37.834 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 21 01:08:37 smithi193 podman[68132]: 2024-09-21 01:08:37.834407349 +0000 UTC m=+3.188703119 container cleanup c9451e7e9718fc360b923464a7f023885eddc397f23546952791400fc4527abb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-i, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T01:08:38.229 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 21 01:08:37 smithi193 bash[68132]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-i 2024-09-21T01:08:38.229 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 21 01:08:38 smithi193 podman[68145]: 2024-09-21 01:08:38.018995327 +0000 UTC m=+0.474300739 container remove c9451e7e9718fc360b923464a7f023885eddc397f23546952791400fc4527abb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-i, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-21T01:08:38.252 DEBUG:teuthology.orchestra.run.smithi193:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.i.service' 2024-09-21T01:08:38.283 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:08:38.284 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-21T01:08:38.284 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-21T01:08:38.284 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.l 2024-09-21T01:08:38.605 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 21 01:08:38 smithi193 systemd[1]: Stopping Ceph mds.l for d3972c20-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:08:38.982 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 21 01:08:38 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-l[62720]: 2024-09-21T01:08:38.604+0000 7f936de8d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:08:38.982 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 21 01:08:38 smithi193 ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-l[62720]: 2024-09-21T01:08:38.604+0000 7f936de8d640 -1 mds.l *** got signal Terminated *** 2024-09-21T01:08:41.863 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 21 01:08:41 smithi193 podman[68249]: 2024-09-21 01:08:41.545530195 +0000 UTC m=+3.027382154 container died 5d6c26317024e67a15252d387c31c4e65d5e7bd9a2edfe8a5808f48c4594afbb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-l, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T01:08:42.155 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 21 01:08:41 smithi193 podman[68249]: 2024-09-21 01:08:41.938033513 +0000 UTC m=+3.419885475 container cleanup 5d6c26317024e67a15252d387c31c4e65d5e7bd9a2edfe8a5808f48c4594afbb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-l, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T01:08:42.155 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 21 01:08:41 smithi193 bash[68249]: ceph-d3972c20-77b2-11ef-baf5-efdc52797490-mds-l 2024-09-21T01:08:42.282 DEBUG:teuthology.orchestra.run.smithi193:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3972c20-77b2-11ef-baf5-efdc52797490@mds.l.service' 2024-09-21T01:08:42.312 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:08:42.313 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-21T01:08:42.313 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d3972c20-77b2-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T01:08:42.525 INFO:teuthology.orchestra.run.smithi001.stdout:Deleting cluster with fsid: d3972c20-77b2-11ef-baf5-efdc52797490 2024-09-21T01:08:45.071 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d3972c20-77b2-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T01:08:45.280 INFO:teuthology.orchestra.run.smithi042.stdout:Deleting cluster with fsid: d3972c20-77b2-11ef-baf5-efdc52797490 2024-09-21T01:08:47.768 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d3972c20-77b2-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T01:08:47.968 INFO:teuthology.orchestra.run.smithi193.stdout:Deleting cluster with fsid: d3972c20-77b2-11ef-baf5-efdc52797490 2024-09-21T01:08:50.347 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:08:50.382 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:08:50.414 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:08:50.440 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-21T01:08:50.442 DEBUG:teuthology.misc:Transferring archived files from smithi001:/var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913342/remote/smithi001/crash 2024-09-21T01:08:50.443 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar c -f - -C /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/crash -- . 2024-09-21T01:08:50.472 INFO:teuthology.orchestra.run.smithi001.stderr:tar: /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T01:08:50.472 INFO:teuthology.orchestra.run.smithi001.stderr:tar: Error is not recoverable: exiting now 2024-09-21T01:08:50.475 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913342/remote/smithi042/crash 2024-09-21T01:08:50.476 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/crash -- . 2024-09-21T01:08:50.522 INFO:teuthology.orchestra.run.smithi042.stderr:tar: /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T01:08:50.522 INFO:teuthology.orchestra.run.smithi042.stderr:tar: Error is not recoverable: exiting now 2024-09-21T01:08:50.524 DEBUG:teuthology.misc:Transferring archived files from smithi193:/var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913342/remote/smithi193/crash 2024-09-21T01:08:50.525 DEBUG:teuthology.orchestra.run.smithi193:> sudo tar c -f - -C /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/crash -- . 2024-09-21T01:08:50.556 INFO:teuthology.orchestra.run.smithi193.stderr:tar: /var/lib/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T01:08:50.556 INFO:teuthology.orchestra.run.smithi193.stderr:tar: Error is not recoverable: exiting now 2024-09-21T01:08:50.558 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-21T01:08:50.558 DEBUG:teuthology.orchestra.run.smithi001:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-21T01:08:50.595 INFO:tasks.cephadm:Compressing logs... 2024-09-21T01:08:50.595 DEBUG:teuthology.orchestra.run.smithi001:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T01:08:50.638 DEBUG:teuthology.orchestra.run.smithi042:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T01:08:50.640 DEBUG:teuthology.orchestra.run.smithi193:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T01:08:50.662 INFO:teuthology.orchestra.run.smithi001.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-osd.0.log: No such file or directory 2024-09-21T01:08:50.663 INFO:teuthology.orchestra.run.smithi001.stderr: 2024-09-21T01:08:50.663 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-osd.9.log 2024-09-21T01:08:50.663 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T01:08:50.664 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-osd.0.log: /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T01:08:50.664 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mds.a.log 2024-09-21T01:08:50.669 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T01:08:50.669 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mon.a.log 2024-09-21T01:08:50.669 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mds.g.log 2024-09-21T01:08:50.669 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mon.a.log: 82.4% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T01:08:50.669 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-osd.6.log 2024-09-21T01:08:50.669 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph.log 2024-09-21T01:08:50.670 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-osd.6.log: /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mds.g.log: 90.1% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T01:08:50.670 INFO:teuthology.orchestra.run.smithi193.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T01:08:50.670 INFO:teuthology.orchestra.run.smithi193.stderr:: No such file or directory 2024-09-21T01:08:50.671 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T01:08:50.671 INFO:teuthology.orchestra.run.smithi193.stderr:gzip/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-volume.log: -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mds.i.log 2024-09-21T01:08:50.671 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mon.c.log 2024-09-21T01:08:50.671 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T01:08:50.671 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-osd.11.log 2024-09-21T01:08:50.671 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-osd.2.log 2024-09-21T01:08:50.671 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-osd.11.log: 82.2%gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-osd.5.log 2024-09-21T01:08:50.671 INFO:teuthology.orchestra.run.smithi193.stderr: -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T01:08:50.671 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph.log 2024-09-21T01:08:50.671 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mds.l.log 2024-09-21T01:08:50.671 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-osd.5.log: 90.3%/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph.log: -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T01:08:50.671 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-osd.8.log 2024-09-21T01:08:50.671 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mds.l.log: 86.6% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T01:08:50.676 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mds.d.log 2024-09-21T01:08:50.678 INFO:teuthology.orchestra.run.smithi193.stderr: 91.0% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T01:08:50.679 INFO:teuthology.orchestra.run.smithi042.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-21T01:08:50.679 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-osd.10.log 2024-09-21T01:08:50.679 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-osd.1.log 2024-09-21T01:08:50.679 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-osd.7.log 2024-09-21T01:08:50.679 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-osd.10.log: /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T01:08:50.682 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph.log: 90.9% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T01:08:50.682 INFO:teuthology.orchestra.run.smithi001.stderr: 86.5% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T01:08:50.682 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mgr.x.log 2024-09-21T01:08:50.682 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mds.j.log 2024-09-21T01:08:50.683 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mds.b.log 2024-09-21T01:08:50.683 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mds.k.log 2024-09-21T01:08:50.683 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-osd.4.log 2024-09-21T01:08:50.683 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mds.b.log: gzip/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mds.k.log: -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T01:08:50.683 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T01:08:50.683 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mgr.y.log 2024-09-21T01:08:50.683 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph.log 2024-09-21T01:08:50.683 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mds.h.log 2024-09-21T01:08:50.684 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mon.b.log 2024-09-21T01:08:50.684 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mds.e.log 2024-09-21T01:08:50.684 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T01:08:50.686 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mgr.x.log: 95.1% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mds.d.log.gz 2024-09-21T01:08:50.686 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-osd.3.log 2024-09-21T01:08:50.688 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mgr.z.log 2024-09-21T01:08:50.689 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mds.c.log 2024-09-21T01:08:50.689 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mds.e.log: /var/log/ceph/cephadm.log: 82.3% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T01:08:50.693 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mds.j.log: 95.1% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mds.j.log.gz 2024-09-21T01:08:50.694 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T01:08:50.695 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mgr.z.log: 92.3% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mgr.z.log.gz 2024-09-21T01:08:50.700 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mds.f.log 2024-09-21T01:08:50.713 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-osd.3.log: /var/log/ceph/cephadm.log: 93.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T01:08:50.714 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T01:08:50.726 INFO:teuthology.orchestra.run.smithi042.stderr: 92.2% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mgr.y.log.gz 2024-09-21T01:08:50.727 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T01:08:50.857 INFO:teuthology.orchestra.run.smithi042.stderr: 86.6% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T01:08:50.958 INFO:teuthology.orchestra.run.smithi001.stderr: 90.3% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mgr.x.log.gz 2024-09-21T01:08:51.000 INFO:teuthology.orchestra.run.smithi001.stderr: 95.0% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mds.a.log.gz 2024-09-21T01:08:51.030 INFO:teuthology.orchestra.run.smithi042.stderr: 90.8% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T01:08:51.131 INFO:teuthology.orchestra.run.smithi042.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T01:08:51.149 INFO:teuthology.orchestra.run.smithi042.stderr: 90.3% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T01:08:51.214 INFO:teuthology.orchestra.run.smithi193.stderr: 91.6% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mon.c.log.gz 2024-09-21T01:08:51.393 INFO:teuthology.orchestra.run.smithi001.stderr: 95.4% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mds.g.log.gz 2024-09-21T01:08:51.843 INFO:teuthology.orchestra.run.smithi001.stderr: 90.2% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mon.a.log.gz 2024-09-21T01:08:52.581 INFO:teuthology.orchestra.run.smithi042.stderr: 91.6% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mon.b.log.gz 2024-09-21T01:08:57.545 INFO:teuthology.orchestra.run.smithi193.stderr: 94.2% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mds.c.log.gz 2024-09-21T01:09:01.034 INFO:teuthology.orchestra.run.smithi001.stderr: 91.5% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-osd.9.log.gz 2024-09-21T01:09:01.932 INFO:teuthology.orchestra.run.smithi001.stderr: 91.9% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-osd.6.log.gz 2024-09-21T01:09:02.166 INFO:teuthology.orchestra.run.smithi001.stderr: 92.0% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-osd.0.log.gz 2024-09-21T01:09:04.192 INFO:teuthology.orchestra.run.smithi001.stderr: 91.8% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-osd.3.log.gz 2024-09-21T01:09:04.195 INFO:teuthology.orchestra.run.smithi001.stderr: 2024-09-21T01:09:04.195 INFO:teuthology.orchestra.run.smithi001.stderr:real 0m13.543s 2024-09-21T01:09:04.195 INFO:teuthology.orchestra.run.smithi001.stderr:user 0m47.654s 2024-09-21T01:09:04.195 INFO:teuthology.orchestra.run.smithi001.stderr:sys 0m1.467s 2024-09-21T01:09:04.385 INFO:teuthology.orchestra.run.smithi193.stderr: 91.7% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-osd.2.log.gz 2024-09-21T01:09:05.055 INFO:teuthology.orchestra.run.smithi193.stderr: 91.8% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-osd.11.log.gz 2024-09-21T01:09:06.097 INFO:teuthology.orchestra.run.smithi193.stderr: 94.2% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mds.i.log.gz 2024-09-21T01:09:06.721 INFO:teuthology.orchestra.run.smithi193.stderr: 94.2% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mds.f.log.gz 2024-09-21T01:09:07.490 INFO:teuthology.orchestra.run.smithi193.stderr: 92.1% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-osd.8.log.gz 2024-09-21T01:09:07.999 INFO:teuthology.orchestra.run.smithi193.stderr: 91.6% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-osd.5.log.gz 2024-09-21T01:09:08.247 INFO:teuthology.orchestra.run.smithi193.stderr: 95.1% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mds.l.log.gz 2024-09-21T01:09:08.249 INFO:teuthology.orchestra.run.smithi193.stderr: 2024-09-21T01:09:08.249 INFO:teuthology.orchestra.run.smithi193.stderr:real 0m17.594s 2024-09-21T01:09:08.249 INFO:teuthology.orchestra.run.smithi193.stderr:user 1m54.640s 2024-09-21T01:09:08.249 INFO:teuthology.orchestra.run.smithi193.stderr:sys 0m3.296s 2024-09-21T01:09:08.464 INFO:teuthology.orchestra.run.smithi042.stderr: 95.3% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mds.k.log.gz 2024-09-21T01:09:11.261 INFO:teuthology.orchestra.run.smithi042.stderr: 95.1% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mds.e.log.gz 2024-09-21T01:09:24.792 INFO:teuthology.orchestra.run.smithi042.stderr: 91.9% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-osd.7.log.gz 2024-09-21T01:09:51.322 INFO:teuthology.orchestra.run.smithi042.stderr: 92.0% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-osd.1.log.gz 2024-09-21T01:09:58.259 INFO:teuthology.orchestra.run.smithi042.stderr: 91.8% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-osd.10.log.gz 2024-09-21T01:10:15.025 INFO:teuthology.orchestra.run.smithi042.stderr: 92.0% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-osd.4.log.gz 2024-09-21T01:11:29.445 INFO:teuthology.orchestra.run.smithi042.stderr: 94.2% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mds.b.log.gz 2024-09-21T01:15:55.340 INFO:teuthology.orchestra.run.smithi042.stderr: 93.3% -- replaced with /var/log/ceph/d3972c20-77b2-11ef-baf5-efdc52797490/ceph-mds.h.log.gz 2024-09-21T01:15:55.343 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-09-21T01:15:55.343 INFO:teuthology.orchestra.run.smithi042.stderr:real 7m4.688s 2024-09-21T01:15:55.343 INFO:teuthology.orchestra.run.smithi042.stderr:user 5m46.674s 2024-09-21T01:15:55.343 INFO:teuthology.orchestra.run.smithi042.stderr:sys 0m12.403s 2024-09-21T01:15:55.343 INFO:tasks.cephadm:Archiving logs... 2024-09-21T01:15:55.344 DEBUG:teuthology.misc:Transferring archived files from smithi001:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913342/remote/smithi001/log 2024-09-21T01:15:55.345 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T01:16:03.000 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913342/remote/smithi042/log 2024-09-21T01:16:03.001 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T01:16:50.750 DEBUG:teuthology.misc:Transferring archived files from smithi193:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913342/remote/smithi193/log 2024-09-21T01:16:50.751 DEBUG:teuthology.orchestra.run.smithi193:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T01:17:03.096 INFO:tasks.cephadm:Removing cluster... 2024-09-21T01:17:03.096 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d3972c20-77b2-11ef-baf5-efdc52797490 --force 2024-09-21T01:17:03.312 INFO:teuthology.orchestra.run.smithi001.stdout:Deleting cluster with fsid: d3972c20-77b2-11ef-baf5-efdc52797490 2024-09-21T01:17:03.649 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d3972c20-77b2-11ef-baf5-efdc52797490 --force 2024-09-21T01:17:04.000 INFO:teuthology.orchestra.run.smithi042.stdout:Deleting cluster with fsid: d3972c20-77b2-11ef-baf5-efdc52797490 2024-09-21T01:17:04.542 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d3972c20-77b2-11ef-baf5-efdc52797490 --force 2024-09-21T01:17:04.751 INFO:teuthology.orchestra.run.smithi193.stdout:Deleting cluster with fsid: d3972c20-77b2-11ef-baf5-efdc52797490 2024-09-21T01:17:05.112 INFO:tasks.cephadm:Removing cephadm ... 2024-09-21T01:17:05.113 DEBUG:teuthology.orchestra.run.smithi001:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T01:17:05.136 DEBUG:teuthology.orchestra.run.smithi042:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T01:17:05.155 DEBUG:teuthology.orchestra.run.smithi193:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T01:17:05.172 INFO:tasks.cephadm:Teardown complete 2024-09-21T01:17:05.172 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T01:17:05.190 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T01:17:05.190 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T01:17:05.197 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T01:17:05.207 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T01:17:05.337 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T01:17:05.384 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T01:17:05.385 DEBUG:teuthology.orchestra.run.smithi001:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T01:17:05.388 DEBUG:teuthology.orchestra.run.smithi042:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T01:17:05.391 DEBUG:teuthology.orchestra.run.smithi193:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T01:17:05.403 INFO:teuthology.orchestra.run.smithi001.stderr:bash: line 1: ntpq: command not found 2024-09-21T01:17:05.405 INFO:teuthology.orchestra.run.smithi042.stderr:bash: line 1: ntpq: command not found 2024-09-21T01:17:05.407 INFO:teuthology.orchestra.run.smithi193.stderr:bash: line 1: ntpq: command not found 2024-09-21T01:17:05.408 INFO:teuthology.orchestra.run.smithi001.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T01:17:05.409 INFO:teuthology.orchestra.run.smithi001.stdout:=============================================================================== 2024-09-21T01:17:05.409 INFO:teuthology.orchestra.run.smithi001.stdout:^* hv01.front.sepia.ceph.com 3 6 377 50 +403us[ +476us] +/- 34ms 2024-09-21T01:17:05.409 INFO:teuthology.orchestra.run.smithi001.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 49 -1134us[-1134us] +/- 61ms 2024-09-21T01:17:05.409 INFO:teuthology.orchestra.run.smithi001.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 48 +623us[ +623us] +/- 66ms 2024-09-21T01:17:05.409 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:17:05.411 INFO:teuthology.orchestra.run.smithi193.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T01:17:05.411 INFO:teuthology.orchestra.run.smithi193.stdout:=============================================================================== 2024-09-21T01:17:05.412 INFO:teuthology.orchestra.run.smithi193.stdout:^* hv01.front.sepia.ceph.com 3 6 377 46 +399us[ +459us] +/- 34ms 2024-09-21T01:17:05.412 INFO:teuthology.orchestra.run.smithi193.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 51 -1152us[-1092us] +/- 61ms 2024-09-21T01:17:05.412 INFO:teuthology.orchestra.run.smithi193.stdout:^+ hv03.front.sepia.ceph.com 3 8 377 112 +606us[ +681us] +/- 65ms 2024-09-21T01:17:05.412 INFO:teuthology.orchestra.run.smithi193.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:17:05.443 INFO:teuthology.orchestra.run.smithi042.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T01:17:05.443 INFO:teuthology.orchestra.run.smithi042.stdout:=============================================================================== 2024-09-21T01:17:05.443 INFO:teuthology.orchestra.run.smithi042.stdout:^* hv01.front.sepia.ceph.com 3 6 377 46 +382us[ +423us] +/- 34ms 2024-09-21T01:17:05.443 INFO:teuthology.orchestra.run.smithi042.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 49 -1162us[-1121us] +/- 61ms 2024-09-21T01:17:05.443 INFO:teuthology.orchestra.run.smithi042.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 47 +597us[ +639us] +/- 66ms 2024-09-21T01:17:05.443 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:17:05.444 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T01:17:05.465 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T01:17:05.466 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T01:17:05.494 DEBUG:teuthology.orchestra.run.smithi001:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T01:17:05.582 DEBUG:teuthology.orchestra.run.smithi042:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T01:17:05.687 DEBUG:teuthology.orchestra.run.smithi193:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T01:17:05.755 DEBUG:teuthology.orchestra.run.smithi001:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T01:17:05.793 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:17:05.793 DEBUG:teuthology.orchestra.run.smithi042:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T01:17:05.825 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:17:05.825 DEBUG:teuthology.orchestra.run.smithi193:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T01:17:05.853 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:17:05.854 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T01:17:05.903 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T01:17:06.360 INFO:teuthology.task.internal:Duration was 2242.567710 seconds 2024-09-21T01:17:06.360 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T01:17:06.714 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T01:17:06.715 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T01:17:06.719 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T01:17:06.721 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T01:17:06.765 INFO:teuthology.orchestra.run.smithi001.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T01:17:06.769 INFO:teuthology.orchestra.run.smithi193.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T01:17:06.778 INFO:teuthology.orchestra.run.smithi042.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T01:17:07.302 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T01:17:07.302 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi001.front.sepia.ceph.com 2024-09-21T01:17:07.302 DEBUG:teuthology.orchestra.run.smithi001:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T01:17:07.328 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi042.front.sepia.ceph.com 2024-09-21T01:17:07.328 DEBUG:teuthology.orchestra.run.smithi042:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T01:17:07.358 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi193.front.sepia.ceph.com 2024-09-21T01:17:07.358 DEBUG:teuthology.orchestra.run.smithi193:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T01:17:07.390 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T01:17:07.391 DEBUG:teuthology.orchestra.run.smithi001:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T01:17:07.393 DEBUG:teuthology.orchestra.run.smithi042:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T01:17:07.401 DEBUG:teuthology.orchestra.run.smithi193:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T01:17:07.462 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T01:17:07.462 DEBUG:teuthology.orchestra.run.smithi001:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T01:17:07.467 DEBUG:teuthology.orchestra.run.smithi042:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T01:17:07.472 DEBUG:teuthology.orchestra.run.smithi193:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T01:17:08.440 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T01:17:08.452 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T01:17:08.452 DEBUG:teuthology.orchestra.run.smithi001:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T01:17:08.478 DEBUG:teuthology.orchestra.run.smithi042:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T01:17:08.507 DEBUG:teuthology.orchestra.run.smithi193:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T01:17:08.537 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T01:17:08.549 DEBUG:teuthology.orchestra.run.smithi001:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T01:17:08.552 DEBUG:teuthology.orchestra.run.smithi042:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T01:17:08.554 DEBUG:teuthology.orchestra.run.smithi193:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T01:17:08.574 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern = core 2024-09-21T01:17:08.593 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern = core 2024-09-21T01:17:08.603 INFO:teuthology.orchestra.run.smithi193.stdout:kernel.core_pattern = core 2024-09-21T01:17:08.629 DEBUG:teuthology.orchestra.run.smithi001:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T01:17:08.644 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:17:08.644 DEBUG:teuthology.orchestra.run.smithi042:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T01:17:08.672 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:17:08.672 DEBUG:teuthology.orchestra.run.smithi193:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T01:17:08.689 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:17:08.689 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T01:17:08.701 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T01:17:08.702 DEBUG:teuthology.misc:Transferring archived files from smithi001:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913342/remote/smithi001 2024-09-21T01:17:08.702 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T01:17:08.756 DEBUG:teuthology.misc:Transferring archived files from smithi042:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913342/remote/smithi042 2024-09-21T01:17:08.756 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T01:17:08.795 DEBUG:teuthology.misc:Transferring archived files from smithi193:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913342/remote/smithi193 2024-09-21T01:17:08.796 DEBUG:teuthology.orchestra.run.smithi193:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T01:17:08.835 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T01:17:08.835 DEBUG:teuthology.orchestra.run.smithi001:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T01:17:08.838 DEBUG:teuthology.orchestra.run.smithi042:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T01:17:08.840 DEBUG:teuthology.orchestra.run.smithi193:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T01:17:08.887 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T01:17:08.899 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T01:17:08.899 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T01:17:08.923 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T01:17:08.923 DEBUG:teuthology.orchestra.run.smithi001:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T01:17:08.925 DEBUG:teuthology.orchestra.run.smithi042:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T01:17:08.928 DEBUG:teuthology.orchestra.run.smithi193:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T01:17:08.938 INFO:teuthology.orchestra.run.smithi001.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 01:17 /home/ubuntu/cephtest 2024-09-21T01:17:08.942 INFO:teuthology.orchestra.run.smithi042.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 01:17 /home/ubuntu/cephtest 2024-09-21T01:17:08.946 INFO:teuthology.orchestra.run.smithi193.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 01:17 /home/ubuntu/cephtest 2024-09-21T01:17:08.948 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T01:17:08.961 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T01:17:09.027 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/blogbench}} duration: 2242.567710161209 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-21T01:17:09.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T01:17:09.118 INFO:teuthology.run:pass